dtenedor commented on PR #45142: URL: https://github.com/apache/spark/pull/45142#issuecomment-1971717342
We talked offline and the benefit from this is marginal without actually propagating the column values automatically to the output table. Having prototyped that and found no benefit in latency/CPU/memory, that's a non-starter. Therefore it seems this feature is not worth the additional complexity and I am closing this PR for now. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org --------------------------------------------------------------------- To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org