kazdy commented on issue #2265: URL: https://github.com/apache/hudi/issues/2265#issuecomment-987189537
I also encountered this issue, in my case upgrading to 0.9.0 and setting `parquet.avro.write-old-list-structure` to false helped both for MOR and COW table. When using 0.8.0 issue still persists. In my case I had two problems: 1. Schema evolution in complex type column from `array<struct<col1>>` to `array<struct<col1, col2>>`, col2 should be null, hudi was failing to read table. 2. While doing upserts, the scenario was like this: do initial load with `array<struct<col1>>`, upsert records with exact same data. Hudi was creating avro file with different type for this column: `array<string>`. It was failing at avro parquet schema conversion, hive sync was failing also because of the schema change. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
