Cheng Lian created SPARK-8580:
---------------------------------

             Summary: Add Parquet files generated by different systems to test 
interoperability and compatibility
                 Key: SPARK-8580
                 URL: https://issues.apache.org/jira/browse/SPARK-8580
             Project: Spark
          Issue Type: Test
          Components: SQL
    Affects Versions: 1.5.0
            Reporter: Cheng Lian
            Assignee: Cheng Lian


As we are implementing Parquet backwards-compatibility rules for Spark 1.5.0 to 
improve interoperability with other systems (reading non-standard Parquet files 
they generate, and generating standard Parquet files), it would be good to have 
a set of standard test Parquet files generated by various systems/tools 
(parquet-thrift, parquet-avro, parquet-hive, Impala, and old versions of Spark 
SQL) to ensure compatibility.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]

Reply via email to