peter-toth commented on PR #38640: URL: https://github.com/apache/spark/pull/38640#issuecomment-1315310978
> Ah I just realized that there is no way to use v2 parquet table today. Shall we support it first before benchmarking it? I'm ok with switching this benchmark to parquet v2 when it becomes available. But do you think the in memory v2 version of this PR can go in now? As it also shows the general issues (https://github.com/apache/spark/pull/38640#issuecomment-1312731989) with DSv2 optimization. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
