dongjoon-hyun edited a comment on pull request #29118:
URL: https://github.com/apache/spark/pull/29118#issuecomment-658810297
Thanks, @dilipbiswal . You're also right. Initially, it was intentional. To
be more clear, I will add a comment to refer SPARK-32318. Technically, if the
user
dongjoon-hyun edited a comment on pull request #29118:
URL: https://github.com/apache/spark/pull/29118#issuecomment-658565525
Actually, the file size check test cases are very ~flaky~ fragile. We hit
many issues before when we added `Spark Version` metadata on Parquet/ORC/Avro.
> Do you
dongjoon-hyun edited a comment on pull request #29118:
URL: https://github.com/apache/spark/pull/29118#issuecomment-658565525
This is an automated message from the Apache Git Service.
To respond to the message, please log on
dongjoon-hyun edited a comment on pull request #29118:
URL: https://github.com/apache/spark/pull/29118#issuecomment-658560629
Also, cc @cloud-fan , @HyukjinKwon , @maropu
This is an automated message from the Apache Git
dongjoon-hyun edited a comment on pull request #29118:
URL: https://github.com/apache/spark/pull/29118#issuecomment-658560339
Could you review this, @viirya ? This will protect us from the future
regression. This part is tricky.