dongjoon-hyun commented on PR #38180: URL: https://github.com/apache/spark/pull/38180#issuecomment-1272779405
According to the migration guide, we fixed `STORED AS ... TBLPROPERTIES` at Apache Spark 2.4. - https://github.com/apache/spark/blame/master/docs/sql-migration-guide.md#L539 ``` Since Spark 2.4, Spark respects Parquet/ORC specific table properties while converting Parquet/ORC Hive tables. As an example, `CREATE TABLE t(id int) STORED AS PARQUET TBLPROPERTIES (parquet.compression 'NONE')` would generate Snappy parquet files during insertion in Spark 2.3, and in Spark 2.4, the result would be uncompressed parquet files. ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
