szehon-ho commented on PR #4596: URL: https://github.com/apache/iceberg/pull/4596#issuecomment-1138764553
Yea , good idea to adding plan parallelism per table if not there already (it might be in Flink but not Spark) Yea, also curious, in Spark it seems the FileScanTask iterator in the end gets into a concrete array, though I guess its possible to consume the FileScanTask directly in some cases as soon as it's read. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
