Erik Krogen created SPARK-35918:
-----------------------------------
Summary: Consolidate logic between AvroSerializer/AvroDeserializer
for schema mismatch handling and error messages
Key: SPARK-35918
URL: https://issues.apache.org/jira/browse/SPARK-35918
Project: Spark
Issue Type: Improvement
Components: SQL
Affects Versions: 3.1.2
Reporter: Erik Krogen
While working on [PR #31490|https://github.com/apache/spark/pull/31490] for
SPARK-34365, we discussed that there is room for improvement in how schema
mismatch errors are reported
([comment1|https://github.com/apache/spark/pull/31490#discussion_r659970793],
[comment2|https://github.com/apache/spark/pull/31490#issuecomment-869866848]).
We can also consolidate more of the logic between AvroSerializer and
AvroDeserializer to avoid some duplication of error handling and consolidate
how these error messages are generated.
This will essentially be taking the [logic from the initial proposal from PR
#31490|https://github.com/apache/spark/pull/31490/commits/83a922fdff08528e59233f67930ac78bfb3fa178],
but applied separately from the current set of proposed changes to cut down on
PR size.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org
