Github user fjh100456 commented on the issue:
https://github.com/apache/spark/pull/22641
I think random tests are not a good solution. If the use case does run too
slowly, it may be much better to reduce codecs. We have done unit tests on the
codec priority in `ParquetCompressionCodecPrecedenceSuite.scala` and
`OrcSourceSuite.scala`, here we just want to test the correctness of the whole
process, so it seems feasible to choose only 1 or 2 codec(s) for testing.
---
---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org
