AngersZhuuuu commented on a change in pull request #34337:
URL: https://github.com/apache/spark/pull/34337#discussion_r733295004
##########
File path:
sql/core/src/main/scala/org/apache/spark/sql/execution/datasources/FileScanRDD.scala
##########
@@ -177,6 +177,10 @@ class FileScanRDD(
throw QueryExecutionErrors.cannotReadParquetFilesError(e)
}
throw e
+ case e: ArrayIndexOutOfBoundsException =>
+ logError(s"Throw ArrayIndexOutOfBoundsException: ${e.getMessage}
" +
+ s"while reading file ${currentFile.filePath}")
+ throw e
Review comment:
> Do you mean `case e: Exception` instead of `case e:
ArrayIndexOutOfBoundsException`? It sounds like a broader scope of your PR
title and goal.
>
> You may revise this PR (title and PR description) for that if you want to
do that for both Parquet/ORC and others.
Update the pr desc and how about current?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
