cloud-fan commented on issue #23714: [SPARK-26744][SQL]Support schema validation in FileDataSourceV2 framework URL: https://github.com/apache/spark/pull/23714#issuecomment-463050245 every source can do schema validation if needed, the DS v2 API already allows you to do so. To save duplicated code, this PR proposes to add the entry point of schema validation in the base class of file source. @gengliangwang Can you post the details of the schema validation for these file sources?
---------------------------------------------------------------- This is an automated message from the Apache Git Service. To respond to the message, please log on GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: [email protected] With regards, Apache Git Services --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
