Andrew Or created SPARK-15715:
---------------------------------
Summary: Altering partition storage information doesn't work in
Hive
Key: SPARK-15715
URL: https://issues.apache.org/jira/browse/SPARK-15715
Project: Spark
Issue Type: Bug
Components: SQL
Affects Versions: 2.0.0
Reporter: Andrew Or
Assignee: Andrew Or
In HiveClientImpl
{code}
private def toHivePartition(
p: CatalogTablePartition,
ht: HiveTable): HivePartition = {
new HivePartition(ht, p.spec.asJava, p.storage.locationUri.map { l => new
Path(l) }.orNull)
}
{code}
Other than the location, we don't even store any of the storage information in
the metastore: output format, input format, serde, serde props. The result is
that doing something like the following doesn't actually do anything:
{code}
ALTER TABLE boxes PARTITION (width=3)
SET SERDE 'com.sparkbricks.serde.ColumnarSerDe'
WITH SERDEPROPERTIES ('compress'='true')
{code}
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
