[GitHub] [spark] mengxr commented on issue #24483: [SPARK-27588] Binary file data source fails fast and doesn't attempt to read very large files

2019-04-29 Thread GitBox
mengxr commented on issue #24483: [SPARK-27588] Binary file data source fails fast and doesn't attempt to read very large files URL: https://github.com/apache/spark/pull/24483#issuecomment-48846 Merged into master. Thanks for the review!

[GitHub] [spark] mengxr commented on issue #24483: [SPARK-27588] Binary file data source fails fast and doesn't attempt to read very large files

2019-04-29 Thread GitBox
mengxr commented on issue #24483: [SPARK-27588] Binary file data source fails fast and doesn't attempt to read very large files URL: https://github.com/apache/spark/pull/24483#issuecomment-487675242 @cloud-fan It seems I have to register the conf to verify its default value is INT_MAX. I

[GitHub] [spark] mengxr commented on issue #24483: [SPARK-27588] Binary file data source fails fast and doesn't attempt to read very large files

2019-04-29 Thread GitBox
mengxr commented on issue #24483: [SPARK-27588] Binary file data source fails fast and doesn't attempt to read very large files URL: https://github.com/apache/spark/pull/24483#issuecomment-487580307 test this please This is

[GitHub] [spark] mengxr commented on issue #24483: [SPARK-27588] Binary file data source fails fast and doesn't attempt to read very large files

2019-04-28 Thread GitBox
mengxr commented on issue #24483: [SPARK-27588] Binary file data source fails fast and doesn't attempt to read very large files URL: https://github.com/apache/spark/pull/24483#issuecomment-487456403 cc: @WeichenXu123 @HyukjinKwon @cloud-fan