HyukjinKwon opened a new pull request #23828: [SPARK-26744][SQL][HOTFOX] 
Disable schema validation tests for FileDataSourceV2 (partially revert 
SPARK-26744)
URL: https://github.com/apache/spark/pull/23828
 
 
   ## What changes were proposed in this pull request?
   
   This PR partially revert SPARK-26744. 
   
   
https://github.com/apache/spark/commit/60caa92deaf6941f58da82dcc0962ebf3a598ced 
and 
https://github.com/apache/spark/commit/4dce45a5992e6a89a26b5a0739b33cfeaf979208 
were merged at similar time range independently. So the test failures were not 
caught.
   
   - 
https://github.com/apache/spark/commit/60caa92deaf6941f58da82dcc0962ebf3a598ced 
happened to add a schema reading logic in writing path for overwrite mode as 
well.
   
   - 
https://github.com/apache/spark/commit/4dce45a5992e6a89a26b5a0739b33cfeaf979208 
added some tests with overwrite modes with migrated ORC v2.
   
   And the tests looks starting to fail.
   
   I guess the discussion won't be short (see 
https://github.com/apache/spark/pull/23606#discussion_r257675083) and this PR 
proposes to disable the tests added at 
https://github.com/apache/spark/commit/4dce45a5992e6a89a26b5a0739b33cfeaf979208 
to unblock other PRs for now.
   
   ## How was this patch tested?
   
   Existing tests.

----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
[email protected]


With regards,
Apache Git Services

---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]

Reply via email to