[ https://issues.apache.org/jira/browse/SPARK-8138?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Cheng Lian resolved SPARK-8138. ------------------------------- Resolution: Fixed Fix Version/s: 1.5.0 Issue resolved by pull request 6610 [https://github.com/apache/spark/pull/6610] > Error message for discovered conflicting partition columns is not intuitive > --------------------------------------------------------------------------- > > Key: SPARK-8138 > URL: https://issues.apache.org/jira/browse/SPARK-8138 > Project: Spark > Issue Type: Improvement > Components: SQL > Affects Versions: 1.3.0, 1.3.1, 1.4.0 > Reporter: Cheng Lian > Assignee: Cheng Lian > Priority: Minor > Fix For: 1.5.0 > > > For data stored as a Hive-style partitioned table, data files should only > live in leaf partition directories. > For example, the following directory layout is illegal: > {noformat} > . > ├── _SUCCESS > ├── b=0 > │ ├── c=0 > │ │ └── part-r-00004.gz.parquet > │ └── part-r-00004.gz.parquet > └── b=1 > ├── c=1 > │ └── part-r-00008.gz.parquet > └── part-r-00008.gz.parquet > {noformat} > For now, we give an unintuitive error message like this: > {noformat} > Conflicting partition column names detected: > ArrayBuffer(b, c) > ArrayBuffer(b) > {noformat} > This should be improved. -- This message was sent by Atlassian JIRA (v6.3.4#6332) --------------------------------------------------------------------- To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org