dengziming opened a new pull request, #43567:
URL: https://github.com/apache/spark/pull/43567

   ### What changes were proposed in this pull request?
   The 4 errors are 
`[CONCAT/FLATTEN/CREATE/UNION]_ARRAYS_WITH_ELEMENTS_EXCEED_LIMIT`,
   CONCAT_XXX is used in concat/array_insert;
   FLATTEN_XXX is only used in flatten;
   CREATE_XXX is used in 
array_repeat/array_insert/array_distinct/array_union/array_intersect/array_remove;
   UNION_XXX is used in array_union/array_distinct;
   
   I changed all inconsistent usages to `CREATE_XXX`, and 
`CONCAT/FLATTEN/UNION_XXX` is only used in concat/flatten/union respectively.
   
   
   ### Why are the changes needed?
   To assign proper name as a part of activity in SPARK-37935.
   
   
   ### Does this PR introduce _any_ user-facing change?
   Yes, the error message will include the error class name.
   
   
   ### How was this patch tested?
   CREATE can be tested from use code, CONCAT/FLATTEN is tested using a 
`ColumnarArray`, UNION can't be tested since it will deduplicate the data can 
create a array which will cause OOM.
   
   
   ### Was this patch authored or co-authored using generative AI tooling?
   No.
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: [email protected]

For queries about this service, please contact Infrastructure at:
[email protected]


---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]

Reply via email to