sbernauer commented on issue #1806: URL: https://github.com/apache/hudi/issues/1806#issuecomment-655375517
I just wanted to point out, that i use a patched version of avro 1.8.2. If i dont patch avro 1.8.2 the following exception occurs: "org.apache.avro.AvroRuntimeException: Unknown datum type org.apache.avro.JsonProperties$Null" (see https://issues.apache.org/jira/browse/AVRO-1954) The events with `optionalField: null` can't be processed. If i run Deltastreamer with `--commit-on-errors` the events with `optionalField != null` are processed, events with `optionalField: null` are missing in the MOR table. As next step i created a similar schema without `default: null`. New Testdata, topic and schema in schema registry. Everything worked, all events (with and without null-value) get processed :) Lastly i tried reading with the new schema from the first topic with Testdata (written with `default: null`). Everything worked again. ---------------------------------------------------------------- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: [email protected]
