[ https://issues.apache.org/jira/browse/SPARK-1383?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Andre Schumacher resolved SPARK-1383. ------------------------------------- Resolution: Fixed Fixed by https://github.com/apache/spark/commit/fbebaedf26286ee8a75065822a3af1148351f828 > Spark-SQL: ParquetRelation improvements > --------------------------------------- > > Key: SPARK-1383 > URL: https://issues.apache.org/jira/browse/SPARK-1383 > Project: Spark > Issue Type: Improvement > Affects Versions: 1.0.0 > Reporter: Andre Schumacher > Assignee: Andre Schumacher > > Improve Spark-SQL's ParquetRelation as follows: > - Instead of files a ParquetRelation is should be backed by a directory, > which simplifies importing data from other sources > - InsertIntoParquetTable operation should supports switching between > overwriting or appending (at least in HiveQL) > - tests should use the new API > - Parquet logging should be forwarded to Log4J > - It should be possible to enable compression (default compression for > Parquet files: GZIP, as in parquet-mr) > - OverwriteCatalog should support dropping of tables -- This message was sent by Atlassian JIRA (v6.2#6252)