[GitHub] spark issue #10942: [SPARK-12850] [SQL] Support Bucket Pruning (Predicate Pu...

2018-02-24 Thread gengliangwang
Github user gengliangwang commented on the issue: https://github.com/apache/spark/pull/10942 @lonehacker I have just created a jira ticket for the migration project: https://issues.apache.org/jira/browse/SPARK-23507 ---

[GitHub] spark issue #10942: [SPARK-12850] [SQL] Support Bucket Pruning (Predicate Pu...

2018-02-23 Thread lonehacker
Github user lonehacker commented on the issue: https://github.com/apache/spark/pull/10942 Thanks @cloud-fan . I couldn't find a JIRA that tracks this feature, could you help with that? This feature is very important for our use case, so it would be great to get any info on when this

[GitHub] spark issue #10942: [SPARK-12850] [SQL] Support Bucket Pruning (Predicate Pu...

2018-02-22 Thread cloud-fan
Github user cloud-fan commented on the issue: https://github.com/apache/spark/pull/10942 FYI this feature will be re-designed when migrating file-based data sources to data source v2. From a quick look seems this feature is not in the current code base anymore. ---

[GitHub] spark issue #10942: [SPARK-12850] [SQL] Support Bucket Pruning (Predicate Pu...

2018-02-22 Thread lonehacker
Github user lonehacker commented on the issue: https://github.com/apache/spark/pull/10942 @gatorsmile Can you confirm if this feature is active in current master? It seems like this code was removed in [SPARK-14535][SQL] Remove buildInternalScan from FileFormat ---

[GitHub] spark issue #10942: [SPARK-12850] [SQL] Support Bucket Pruning (Predicate Pu...

2016-11-27 Thread yucai
Github user yucai commented on the issue: https://github.com/apache/spark/pull/10942 @gatorsmile, seems like getBuckets() is removed by below PR, which makes this feture not work any more, could you kindly help check? [SPARK-14535][SQL] Remove buildInternalScan from FileFormat