[GitHub] [hudi] liujinhui1994 commented on issue #2162: [SUPPORT] Deltastreamer transform cannot add fields

2020-10-20 Thread GitBox
liujinhui1994 commented on issue #2162: URL: https://github.com/apache/hudi/issues/2162#issuecomment-713277243 I will do PR today This is an automated message from the Apache Git Service. To respond to the message, please

[GitHub] [hudi] liujinhui1994 commented on issue #2162: [SUPPORT] Deltastreamer transform cannot add fields

2020-10-20 Thread GitBox
liujinhui1994 commented on issue #2162: URL: https://github.com/apache/hudi/issues/2162#issuecomment-712788169 Okay, I will PR later This is an automated message from the Apache Git Service. To respond to the message,

[GitHub] [hudi] liujinhui1994 commented on issue #2162: [SUPPORT] Deltastreamer transform cannot add fields

2020-10-19 Thread GitBox
liujinhui1994 commented on issue #2162: URL: https://github.com/apache/hudi/issues/2162#issuecomment-711759479 I am late in reply, sorry. I have passed the verification in the production environment, and I am currently writing unit tests

[GitHub] [hudi] liujinhui1994 commented on issue #2162: [SUPPORT] Deltastreamer transform cannot add fields

2020-10-19 Thread GitBox
liujinhui1994 commented on issue #2162: URL: https://github.com/apache/hudi/issues/2162#issuecomment-711757869 Can work, but if the default value is not null, it will not work { "name": "adnetDesc", "type": ["null", "long"], "default": -1 } @bvaradar

[GitHub] [hudi] liujinhui1994 commented on issue #2162: [SUPPORT] Deltastreamer transform cannot add fields

2020-10-14 Thread GitBox
liujinhui1994 commented on issue #2162: URL: https://github.com/apache/hudi/issues/2162#issuecomment-708263557 @bvaradar Okay, I will be experimenting and I would be happy to complete this PR if allowed, thanks This is

[GitHub] [hudi] liujinhui1994 commented on issue #2162: [SUPPORT] Deltastreamer transform cannot add fields

2020-10-13 Thread GitBox
liujinhui1994 commented on issue #2162: URL: https://github.com/apache/hudi/issues/2162#issuecomment-707525990 This is the data I printed in the transform 1. This is before adding the ds field

[GitHub] [hudi] liujinhui1994 commented on issue #2162: [SUPPORT] Deltastreamer transform cannot add fields

2020-10-13 Thread GitBox
liujinhui1994 commented on issue #2162: URL: https://github.com/apache/hudi/issues/2162#issuecomment-707521050 These are the rowDataset I printed in transform 1. This is before I did not add the ds field

[GitHub] [hudi] liujinhui1994 commented on issue #2162: [SUPPORT] Deltastreamer transform cannot add fields

2020-10-13 Thread GitBox
liujinhui1994 commented on issue #2162: URL: https://github.com/apache/hudi/issues/2162#issuecomment-707519900 1. I have now changed all fields to “ type”:[“ null”,“ string”],“ default”:null 2. printSchema() root |-- dataId: string (nullable = true) |-- collectTime:

[GitHub] [hudi] liujinhui1994 commented on issue #2162: [SUPPORT] Deltastreamer transform cannot add fields

2020-10-12 Thread GitBox
liujinhui1994 commented on issue #2162: URL: https://github.com/apache/hudi/issues/2162#issuecomment-706989196 Please help me to find out what went wrong, it has troubled me for a long time. Thank you very much for your help @bvaradar

[GitHub] [hudi] liujinhui1994 commented on issue #2162: [SUPPORT] Deltastreamer transform cannot add fields

2020-10-12 Thread GitBox
liujinhui1994 commented on issue #2162: URL: https://github.com/apache/hudi/issues/2162#issuecomment-706986244 ![1602493307(1)](https://user-images.githubusercontent.com/25769285/95727483-c7260d00-0cac-11eb-8c37-49787001f511.jpg)

[GitHub] [hudi] liujinhui1994 commented on issue #2162: [SUPPORT] Deltastreamer transform cannot add fields

2020-10-12 Thread GitBox
liujinhui1994 commented on issue #2162: URL: https://github.com/apache/hudi/issues/2162#issuecomment-706984549 @bvaradar I am using transform and want to add a new ds field. I now re-create a new hudi table, and add the ds field to the end of target.avsc according to your suggestion, but

[GitHub] [hudi] liujinhui1994 commented on issue #2162: [SUPPORT] Deltastreamer transform cannot add fields

2020-10-12 Thread GitBox
liujinhui1994 commented on issue #2162: URL: https://github.com/apache/hudi/issues/2162#issuecomment-706983352 ![1602492991(1)](https://user-images.githubusercontent.com/25769285/95726929-1b7cbd00-0cac-11eb-9c81-0be6a178b9b0.jpg)

[GitHub] [hudi] liujinhui1994 commented on issue #2162: [SUPPORT] Deltastreamer transform cannot add fields

2020-10-12 Thread GitBox
liujinhui1994 commented on issue #2162: URL: https://github.com/apache/hudi/issues/2162#issuecomment-706983114 ![Uploading 1602492991(1).jpg…]() This is an automated message from the Apache Git Service. To respond

[GitHub] [hudi] liujinhui1994 commented on issue #2162: [SUPPORT] Deltastreamer transform cannot add fields

2020-10-12 Thread GitBox
liujinhui1994 commented on issue #2162: URL: https://github.com/apache/hudi/issues/2162#issuecomment-706981577 source.avsc { "type": "record", "name": "t3_app_td_ad_info", "fields": [{ "name": "dataId", "type":

[GitHub] [hudi] liujinhui1994 commented on issue #2162: [SUPPORT] Deltastreamer transform cannot add fields

2020-10-12 Thread GitBox
liujinhui1994 commented on issue #2162: URL: https://github.com/apache/hudi/issues/2162#issuecomment-706911463 @bhasudha can you help me thanks This is an automated message from the Apache Git Service. To respond to the