AgenticSpark opened a new pull request, #56775:
URL: https://github.com/apache/spark/pull/56775

   ### What changes were proposed in this pull request?
   
   Detect unsupported Hive `uniontype<...>` values when converting Hive 
`FieldSchema` types to Spark SQL types and raise a dedicated 
`UNSUPPORTED_HIVE_TYPE` error instead of the generic 
`CANNOT_RECOGNIZE_HIVE_TYPE` parser error.
   
   ### Why are the changes needed?
   
   Spark SQL does not support Hive union types. Today the failure message comes 
from the parser path and does not clearly identify that the Hive union type is 
unsupported.
   
   ### Does this PR introduce _any_ user-facing change?
   
   Yes. Reading a Hive table column that uses `uniontype<...>` now reports 
`UNSUPPORTED_HIVE_TYPE` with the offending Hive type and column name.
   
   ### How was this patch tested?
   
   - `SPARK_GENERATE_GOLDEN_FILES=1 build/sbt "core/testOnly 
*SparkThrowableSuite -- -t \"Error conditions are correctly formatted\""`
   - `build/sbt "hive/testOnly *HiveClientImplSuite"`
   
   ### Was this patch authored or co-authored using generative AI tooling?
   
   Yes. GitHub Copilot assisted with preparing and validating this change.
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: [email protected]

For queries about this service, please contact Infrastructure at:
[email protected]


---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]

Reply via email to