[
https://issues.apache.org/jira/browse/SPARK-1383?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Andre Schumacher resolved SPARK-1383.
-------------------------------------
Resolution: Fixed
Fixed by
https://github.com/apache/spark/commit/fbebaedf26286ee8a75065822a3af1148351f828
> Spark-SQL: ParquetRelation improvements
> ---------------------------------------
>
> Key: SPARK-1383
> URL: https://issues.apache.org/jira/browse/SPARK-1383
> Project: Spark
> Issue Type: Improvement
> Affects Versions: 1.0.0
> Reporter: Andre Schumacher
> Assignee: Andre Schumacher
>
> Improve Spark-SQL's ParquetRelation as follows:
> - Instead of files a ParquetRelation is should be backed by a directory,
> which simplifies importing data from other sources
> - InsertIntoParquetTable operation should supports switching between
> overwriting or appending (at least in HiveQL)
> - tests should use the new API
> - Parquet logging should be forwarded to Log4J
> - It should be possible to enable compression (default compression for
> Parquet files: GZIP, as in parquet-mr)
> - OverwriteCatalog should support dropping of tables
--
This message was sent by Atlassian JIRA
(v6.2#6252)
