Github user AmplabJenkins commented on the pull request:
https://github.com/apache/spark/pull/9483#issuecomment-190527518
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/5
Github user AmplabJenkins commented on the pull request:
https://github.com/apache/spark/pull/9483#issuecomment-190527517
Merged build finished. Test PASSed.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project
Github user SparkQA commented on the pull request:
https://github.com/apache/spark/pull/9483#issuecomment-190527389
**[Test build #52210 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/52210/consoleFull)**
for PR 9483 at commit
[`fdac95b`](https://git
Github user SparkQA commented on the pull request:
https://github.com/apache/spark/pull/9483#issuecomment-190497524
**[Test build #52210 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/52210/consoleFull)**
for PR 9483 at commit
[`fdac95b`](https://gith
Github user zhichao-li commented on the pull request:
https://github.com/apache/spark/pull/9483#issuecomment-190497155
retest this please
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this
Github user AmplabJenkins commented on the pull request:
https://github.com/apache/spark/pull/9483#issuecomment-190033570
Merged build finished. Test FAILed.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project
Github user AmplabJenkins commented on the pull request:
https://github.com/apache/spark/pull/9483#issuecomment-190033571
Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/5
Github user SparkQA commented on the pull request:
https://github.com/apache/spark/pull/9483#issuecomment-190033507
**[Test build #52156 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/52156/consoleFull)**
for PR 9483 at commit
[`fdac95b`](https://git
Github user SparkQA commented on the pull request:
https://github.com/apache/spark/pull/9483#issuecomment-190017147
**[Test build #52156 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/52156/consoleFull)**
for PR 9483 at commit
[`fdac95b`](https://gith
Github user zhichao-li commented on the pull request:
https://github.com/apache/spark/pull/9483#issuecomment-190016890
retest this please
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this
Github user AmplabJenkins commented on the pull request:
https://github.com/apache/spark/pull/9483#issuecomment-190005709
Merged build finished. Test FAILed.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project
Github user AmplabJenkins commented on the pull request:
https://github.com/apache/spark/pull/9483#issuecomment-190005714
Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/5
Github user SparkQA commented on the pull request:
https://github.com/apache/spark/pull/9483#issuecomment-190005200
**[Test build #52152 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/52152/consoleFull)**
for PR 9483 at commit
[`fdac95b`](https://git
Github user SparkQA commented on the pull request:
https://github.com/apache/spark/pull/9483#issuecomment-189986044
**[Test build #52152 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/52152/consoleFull)**
for PR 9483 at commit
[`fdac95b`](https://gith
Github user chenghao-intel commented on the pull request:
https://github.com/apache/spark/pull/9483#issuecomment-189470296
LGTM except some minor suggestions.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your projec
Github user chenghao-intel commented on a diff in the pull request:
https://github.com/apache/spark/pull/9483#discussion_r54296531
--- Diff:
sql/hive/src/test/scala/org/apache/spark/sql/hive/execution/HiveTableScanSuite.scala
---
@@ -89,4 +89,25 @@ class HiveTableScanSuite extends
Github user chenghao-intel commented on a diff in the pull request:
https://github.com/apache/spark/pull/9483#discussion_r54296448
--- Diff:
sql/hive/src/main/scala/org/apache/spark/sql/hive/ParallelUnionRDD.scala ---
@@ -0,0 +1,53 @@
+/*
+ * Licensed to the Apache Software
Github user chenghao-intel commented on a diff in the pull request:
https://github.com/apache/spark/pull/9483#discussion_r54296499
--- Diff:
sql/hive/src/main/scala/org/apache/spark/sql/hive/ParallelUnionRDD.scala ---
@@ -0,0 +1,53 @@
+/*
+ * Licensed to the Apache Software
Github user AmplabJenkins commented on the pull request:
https://github.com/apache/spark/pull/9483#issuecomment-188589240
Merged build finished. Test PASSed.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project
Github user AmplabJenkins commented on the pull request:
https://github.com/apache/spark/pull/9483#issuecomment-188589241
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/5
Github user SparkQA commented on the pull request:
https://github.com/apache/spark/pull/9483#issuecomment-188589088
**[Test build #51920 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/51920/consoleFull)**
for PR 9483 at commit
[`db84ab9`](https://git
Github user SparkQA commented on the pull request:
https://github.com/apache/spark/pull/9483#issuecomment-188564809
**[Test build #51920 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/51920/consoleFull)**
for PR 9483 at commit
[`db84ab9`](https://gith
Github user zhichao-li commented on the pull request:
https://github.com/apache/spark/pull/9483#issuecomment-188561642
retest this please
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this
Github user AmplabJenkins commented on the pull request:
https://github.com/apache/spark/pull/9483#issuecomment-188155757
Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/5
Github user AmplabJenkins commented on the pull request:
https://github.com/apache/spark/pull/9483#issuecomment-188155753
Merged build finished. Test FAILed.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project
Github user SparkQA commented on the pull request:
https://github.com/apache/spark/pull/9483#issuecomment-188155365
**[Test build #51861 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/51861/consoleFull)**
for PR 9483 at commit
[`db84ab9`](https://git
Github user SparkQA commented on the pull request:
https://github.com/apache/spark/pull/9483#issuecomment-188130564
**[Test build #51861 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/51861/consoleFull)**
for PR 9483 at commit
[`db84ab9`](https://gith
Github user AmplabJenkins commented on the pull request:
https://github.com/apache/spark/pull/9483#issuecomment-188126065
Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/5
Github user AmplabJenkins commented on the pull request:
https://github.com/apache/spark/pull/9483#issuecomment-188126062
Merged build finished. Test FAILed.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project
Github user SparkQA commented on the pull request:
https://github.com/apache/spark/pull/9483#issuecomment-188126052
**[Test build #51856 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/51856/consoleFull)**
for PR 9483 at commit
[`6456f12`](https://git
Github user SparkQA commented on the pull request:
https://github.com/apache/spark/pull/9483#issuecomment-188125447
**[Test build #51856 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/51856/consoleFull)**
for PR 9483 at commit
[`6456f12`](https://gith
Github user chenghao-intel commented on a diff in the pull request:
https://github.com/apache/spark/pull/9483#discussion_r53125003
--- Diff:
sql/hive/src/main/scala/org/apache/spark/sql/hive/ParallelUnionRDD.scala ---
@@ -0,0 +1,52 @@
+/*
+ * Licensed to the Apache Software
Github user chenghao-intel commented on a diff in the pull request:
https://github.com/apache/spark/pull/9483#discussion_r53124605
--- Diff:
sql/hive/src/main/scala/org/apache/spark/sql/hive/ParallelUnionRDD.scala ---
@@ -0,0 +1,52 @@
+/*
+ * Licensed to the Apache Software
Github user chenghao-intel commented on a diff in the pull request:
https://github.com/apache/spark/pull/9483#discussion_r53124525
--- Diff: core/src/main/scala/org/apache/spark/rdd/RDD.scala ---
@@ -211,7 +211,7 @@ abstract class RDD[T: ClassTag](
// Our dependencies and par
Github user chenghao-intel commented on a diff in the pull request:
https://github.com/apache/spark/pull/9483#discussion_r53124507
--- Diff: core/src/main/scala/org/apache/spark/rdd/RDD.scala ---
@@ -211,7 +211,7 @@ abstract class RDD[T: ClassTag](
// Our dependencies and par
Github user zhichao-li commented on the pull request:
https://github.com/apache/spark/pull/9483#issuecomment-172447842
@yhuai @rxin , any thoughts or concerns for this PR? It's common that one
table contains tons of partitions(i.e every 15mins a partition for clicking
data).
---
If
Github user zhichao-li commented on a diff in the pull request:
https://github.com/apache/spark/pull/9483#discussion_r45285408
--- Diff: core/src/main/scala/org/apache/spark/rdd/RDD.scala ---
@@ -211,7 +211,7 @@ abstract class RDD[T: ClassTag](
// Our dependencies and partiti
Github user zhichao-li commented on a diff in the pull request:
https://github.com/apache/spark/pull/9483#discussion_r45285157
--- Diff:
sql/hive/src/main/scala/org/apache/spark/sql/hive/ParallelUnionRDD.scala ---
@@ -0,0 +1,52 @@
+/*
+ * Licensed to the Apache Software Fou
Github user yhuai commented on a diff in the pull request:
https://github.com/apache/spark/pull/9483#discussion_r45269601
--- Diff: core/src/main/scala/org/apache/spark/rdd/RDD.scala ---
@@ -211,7 +211,7 @@ abstract class RDD[T: ClassTag](
// Our dependencies and partitions w
Github user yhuai commented on a diff in the pull request:
https://github.com/apache/spark/pull/9483#discussion_r45269521
--- Diff:
sql/hive/src/main/scala/org/apache/spark/sql/hive/ParallelUnionRDD.scala ---
@@ -0,0 +1,52 @@
+/*
+ * Licensed to the Apache Software Foundati
Github user zhonghaihua commented on the pull request:
https://github.com/apache/spark/pull/9483#issuecomment-156810714
Hi @zhichao-li ,thanks for doing this.I got a problem of scanning
partitions slowly,and I apply this patch to my spark version.In my case:
* Before I apply this p
Github user zhonghaihua commented on the pull request:
https://github.com/apache/spark/pull/9483#issuecomment-156810307
Hi @zhichao-li ,thanks for doing this.I got a problem of scanning
partitions slowly,and I apply this patch to my spark version.In my case:
* Before I apply this
Github user chenghao-intel commented on the pull request:
https://github.com/apache/spark/pull/9483#issuecomment-153974427
cc/ @scwf @Sephiroth-Lin, not sure if you guys get time for benchmarking
this with the real world cases.
---
If your project is set up for it, you can reply to t
Github user AmplabJenkins commented on the pull request:
https://github.com/apache/spark/pull/9483#issuecomment-153956253
Merged build finished. Test PASSed.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project
Github user AmplabJenkins commented on the pull request:
https://github.com/apache/spark/pull/9483#issuecomment-153956255
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/45
Github user SparkQA commented on the pull request:
https://github.com/apache/spark/pull/9483#issuecomment-153956188
**[Test build #45083 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/45083/consoleFull)**
for PR 9483 at commit
[`63dc9c0`](https://git
Github user SparkQA commented on the pull request:
https://github.com/apache/spark/pull/9483#issuecomment-153931045
**[Test build #45083 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/45083/consoleFull)**
for PR 9483 at commit
[`63dc9c0`](https://gith
Github user AmplabJenkins commented on the pull request:
https://github.com/apache/spark/pull/9483#issuecomment-153930955
Merged build started.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have
Github user AmplabJenkins commented on the pull request:
https://github.com/apache/spark/pull/9483#issuecomment-153930934
Merged build triggered.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not h
Github user zhichao-li commented on the pull request:
https://github.com/apache/spark/pull/9483#issuecomment-153930848
cc @chenghao-intel
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this
GitHub user zhichao-li opened a pull request:
https://github.com/apache/spark/pull/9483
[SPARK-11517][SQL]Calc partitions in parallel for multiple partitions table
Currently we calculate the getPartitions for each "hive partition" in
sequence way, it would be faster if we can parall
51 matches
Mail list logo
