anchovYu commented on code in PR #47813:
URL: https://github.com/apache/spark/pull/47813#discussion_r1724480707
##########
sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/analysis/CheckAnalysis.scala:
##########
@@ -57,6 +57,11 @@ trait CheckAnalysis extends PredicateHelper with
LookupCatalog with QueryErrorsB
val DATA_TYPE_MISMATCH_ERROR = TreeNodeTag[Unit]("dataTypeMismatchError")
val INVALID_FORMAT_ERROR = TreeNodeTag[Unit]("invalidFormatError")
+ // Error that has a lower priority, that are not supposed to throw
immediately on triggering,
+ // e.g. certain internal errors. These errors will be thrown at the end of
the whole check
+ // analysis process, if no other error occurs.
+ var preemptedError: Option[SparkException] = None
Review Comment:
I generalize it with a new class that records the 'heap' top. I only keep
the top element since at most one error that has the highest priority gets
thrown eventually. PTAL!
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
