[ https://issues.apache.org/jira/browse/SPARK-7763?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14552689#comment-14552689 ]
Apache Spark commented on SPARK-7763: ------------------------------------- User 'liancheng' has created a pull request for this issue: https://github.com/apache/spark/pull/6285 > Partition columns of data source tables should be persisted into metastore > when creating persisted tables > --------------------------------------------------------------------------------------------------------- > > Key: SPARK-7763 > URL: https://issues.apache.org/jira/browse/SPARK-7763 > Project: Spark > Issue Type: Bug > Components: SQL > Affects Versions: 1.4.0 > Reporter: Cheng Lian > Assignee: Cheng Lian > Priority: Blocker > > Partition columns of {{HadoopFsRelation}} should be persisted into Hive > metastore together with relation schema. However, storing paths of all > partitions into metastore might become a bottleneck. Instead, we always do a > partition discovery while loading back the relation. -- This message was sent by Atlassian JIRA (v6.3.4#6332) --------------------------------------------------------------------- To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org