HeartSaVioR commented on pull request #29066: URL: https://github.com/apache/spark/pull/29066#issuecomment-735021901
Great to see this making progress. It'd be nice if we include this in Spark 3.1.0, so that custom V2 writers could leverage this instead of sticking with V1 writer. (Personally I think it worths to ensure including this in 3.1.0. This shouldn't drag any more, discussion happened years ago, and V2 writer also exists years ago and has been lacking such essential functionality.) I tried to take a look when the PR was WIP, but I felt I'm not quite qualified to review and finally approve this. I'll try taking a look soon, but it'd be nice if some others can review this. cc. @cloud-fan @viirya Would you mind taking a look at this to make this in 3.1.0? Thanks in advance. ---------------------------------------------------------------- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
