[GitHub] [hudi] nsivabalan commented on issue #2589: [SUPPORT] Issue with adding column while running deltastreamer with kafka source.

2021-03-30 Thread GitBox
nsivabalan commented on issue #2589: URL: https://github.com/apache/hudi/issues/2589#issuecomment-810303503 sounds good. will close the ticket for now. Feel free to open another ticket if you need any more help or find any issues. -- This is an automated message from the Apache Git

[GitHub] [hudi] nsivabalan commented on issue #2589: [SUPPORT] Issue with adding column while running deltastreamer with kafka source.

2021-03-29 Thread GitBox
nsivabalan commented on issue #2589: URL: https://github.com/apache/hudi/issues/2589#issuecomment-809485189 hi @t0il3ts0ap. On a related note, with upcoming release, we have added support for [custom deserializer](https://github.com/apache/hudi/pull/2619) if you are using AvroKafkaSource.

[GitHub] [hudi] nsivabalan commented on issue #2589: [SUPPORT] Issue with adding column while running deltastreamer with kafka source.

2021-03-27 Thread GitBox
nsivabalan commented on issue #2589: URL: https://github.com/apache/hudi/issues/2589#issuecomment-808810711 I assume you are using AvroKafkaSource. IIUC reading from kafka does not need a schema provider. Have you tried not setting any schema provider? -- This is an automated message

[GitHub] [hudi] nsivabalan commented on issue #2589: [SUPPORT] Issue with adding column while running deltastreamer with kafka source.

2021-03-17 Thread GitBox
nsivabalan commented on issue #2589: URL: https://github.com/apache/hudi/issues/2589#issuecomment-801540936 @t0il3ts0ap : our suggestion here is to not set any schema provider. Hudi will fallback to RowBasedSchemaProvider. Hope that would solve your use-case. Fix is very involved and we

[GitHub] [hudi] nsivabalan commented on issue #2589: [SUPPORT] Issue with adding column while running deltastreamer with kafka source.

2021-03-13 Thread GitBox
nsivabalan commented on issue #2589: URL: https://github.com/apache/hudi/issues/2589#issuecomment-798596523 @t0il3ts0ap : yes, I am working on a potential fix for this issue. https://github.com/apache/hudi/pull/2654/ crux of the issue: In deltastreamer w/ a transformer, if