nsivabalan commented on pull request #1888:
URL: https://github.com/apache/hudi/pull/1888#issuecomment-751788889
I found the issue after some debugging. But need your thoughts on whether it
is a bug or how to go about fixing it.
@bvaradar @n3nash @vinothchandar
As per the test case linked to reproduce, here is what we are doing.
Generate records with SCHEMA_1 and ingest to Hudi with SCHEMA_1
Generate records with SCHEMA_2 and ingest to Hudi with SCHEMA_2
Generate records with SCHEMA_1 and ingest to Hudi with SCHEMA_2(both source
and target schema)// this is where the exception is thrown.
Here is the gist of the issue.
Lets say we have an avro record with SCHEMA_1
byte[] recordBytes = HoodieAvroUtils.avroToBytes(genericRecord);
Converting this back to GenRec with SCHEMA_1 succeeds.
HoodieAvroUtils.bytesToAvro(recordBytes, SCHEMA_1)
But converting this back to GenRec with SCHEMA_2 (which has one additional
field compared to SCHEMA_1) fails.
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
[email protected]
