Andrew Or created SPARK-15715: --------------------------------- Summary: Altering partition storage information doesn't work in Hive Key: SPARK-15715 URL: https://issues.apache.org/jira/browse/SPARK-15715 Project: Spark Issue Type: Bug Components: SQL Affects Versions: 2.0.0 Reporter: Andrew Or Assignee: Andrew Or
In HiveClientImpl {code} private def toHivePartition( p: CatalogTablePartition, ht: HiveTable): HivePartition = { new HivePartition(ht, p.spec.asJava, p.storage.locationUri.map { l => new Path(l) }.orNull) } {code} Other than the location, we don't even store any of the storage information in the metastore: output format, input format, serde, serde props. The result is that doing something like the following doesn't actually do anything: {code} ALTER TABLE boxes PARTITION (width=3) SET SERDE 'com.sparkbricks.serde.ColumnarSerDe' WITH SERDEPROPERTIES ('compress'='true') {code} -- This message was sent by Atlassian JIRA (v6.3.4#6332) --------------------------------------------------------------------- To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org