rdblue commented on pull request #1077: URL: https://github.com/apache/iceberg/pull/1077#issuecomment-639646385
Part of the problem is that we changed this table over to use a `DataTask`, which provides the data as an iterable instead of reading a data file. The purpose was to correctly set sequence numbers, part of #951. Rows returned by `DataTask` should be full rows, not projections. That's probably why we're hitting this now. As for why you're getting the current error, I'm not sure why your manifest doesn't have the `data_file` field. It looks like it should work to me, but I can't debug it because I don't have the rest of the test case. Anyway, I think the solution is to remove the `project(fileSchema)` call after `ManifestFiles.read` because data tasks should return an unprojected record. ---------------------------------------------------------------- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
