RussellSpitzer edited a comment on issue #1735: URL: https://github.com/apache/iceberg/issues/1735#issuecomment-723335583
The Status issue is caused by a BuildAvroProjection call, The empty projection note above is turned into a full manifest entry spec request including data_file as a required field. The actual records present in the "Record" call in BuildAvroProjection have a schema like ``` status type:INT pos:0 snapshot_id type:UNION pos:1 ``` This doesn't have the data_file field which causes the projection to fail with "No field data_file" found We get this because in ProjectionDatumReader.java setSchema we attempt to prune an expected schema which contains all files and result in a pruned schema with only the above 2 columns. ---------------------------------------------------------------- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
