Gengliang Wang created SPARK-24887:
--------------------------------------
Summary: Use SerializableConfiguration in Spark util
Key: SPARK-24887
URL: https://issues.apache.org/jira/browse/SPARK-24887
Project: Spark
Issue Type: Sub-task
Components: SQL
Affects Versions: 2.4.0
Reporter: Gengliang Wang
To implement the method `buildReader` in `FileFormat`, it is required to
serializable the hadoop configuration for executors.
Previous spark-avro uses its own class `SerializableConfiguration` for the
serialization. As now it is part of Spark, we can use SerializableConfiguration
in Spark util to deduplicate the code.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
