Zoltan Ivanfi created SPARK-25102:
-------------------------------------
Summary: Write Spark version information to Parquet file footers
Key: SPARK-25102
URL: https://issues.apache.org/jira/browse/SPARK-25102
Project: Spark
Issue Type: Improvement
Components: Spark Core
Affects Versions: 2.3.1
Reporter: Zoltan Ivanfi
-PARQUET-352- added support for the "writer.model.name" property in the Parquet
metadata to identify the object model (application) that wrote the file.
The easiest way to write this property is by overriding getName() of
org.apache.parquet.hadoop.api.WriteSupport. In Spark, this would mean adding
getName() to the
org.apache.spark.sql.execution.datasources.parquet.ParquetWriteSupport class.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
