Github user liancheng commented on a diff in the pull request:
https://github.com/apache/spark/pull/4563#discussion_r24612662
--- Diff:
sql/core/src/main/scala/org/apache/spark/sql/parquet/newParquet.scala ---
@@ -545,13 +578,16 @@ object ParquetRelation2 {
// Whether we should merge schemas collected from all Parquet part-files.
val MERGE_SCHEMA = "mergeSchema"
- // Hive Metastore schema, passed in when the Parquet relation is
converted from Metastore
+ // Hive Metastore schema, passed in when the Parquet relation is
converted from Metastore.
val METASTORE_SCHEMA = "metastoreSchema"
- // Default partition name to use when the partition column value is null
or empty string
+ // Schema of partition keys for partitioned Hive Metastore Parquet
tables.
+ val METASTORE_PARTITION_KEYS_SCHEMA = "metastorePartitionKeysSchema"
--- End diff --
Ah, forgot to remove this. It's not used any more since we construct
`PartitionSpec` manually and pass it to `ParquetRelation2` when converting
Metastore Parquet tables.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at [email protected] or file a JIRA ticket
with INFRA.
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
