Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/21880
**[Test build #93591 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/93591/testReport)**
for PR 21880 at commit
Github user icexelloss commented on a diff in the pull request:
https://github.com/apache/spark/pull/21650#discussion_r205448677
--- Diff:
sql/core/src/main/scala/org/apache/spark/sql/execution/python/ExtractPythonUDFs.scala
---
@@ -94,36 +95,94 @@ object
GitHub user HyukjinKwon opened a pull request:
https://github.com/apache/spark/pull/21882
[SPARK-24934][SQL] Handle missing upper/lower bounds case in in-memory
partition pruning
## What changes were proposed in this pull request?
Looks we intentionally set `null` for
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21880
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21403
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21403
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21880
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
Github user cloud-fan commented on the issue:
https://github.com/apache/spark/pull/21758
LGTM
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail:
Github user cloud-fan commented on a diff in the pull request:
https://github.com/apache/spark/pull/21758#discussion_r205450947
--- Diff: core/src/main/scala/org/apache/spark/BarrierTaskContext.scala ---
@@ -0,0 +1,42 @@
+/*
+ * Licensed to the Apache Software Foundation
Github user HyukjinKwon commented on the issue:
https://github.com/apache/spark/pull/21882
cc @cloud-fan, mind taking a look please?
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21882
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21882
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/21873
**[Test build #93592 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/93592/testReport)**
for PR 21873 at commit
Github user HyukjinKwon commented on the issue:
https://github.com/apache/spark/pull/21880
retest this please
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail:
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/21403
**[Test build #93599 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/93599/testReport)**
for PR 21403 at commit
Github user cloud-fan commented on the issue:
https://github.com/apache/spark/pull/21802
@rxin Generally I agree with you, but currently the whole-stage-codegen
doesn't support `CodegenFallback`, which means, if we don't implement codegen,
this expression will stop WSC and hurt perf
Github user tgravescs commented on the issue:
https://github.com/apache/spark/pull/21474
just to clarify here, so the failure case if you are using a shuffle server
< 2.2, does it throw an obvious error to the user?
---
Github user icexelloss commented on a diff in the pull request:
https://github.com/apache/spark/pull/21650#discussion_r205445392
--- Diff: python/pyspark/sql/tests.py ---
@@ -5060,6 +5049,147 @@ def test_type_annotation(self):
df =
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21873
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/93592/
Test PASSed.
---
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21873
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/21882
**[Test build #93597 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/93597/testReport)**
for PR 21882 at commit
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/21880
**[Test build #93598 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/93598/testReport)**
for PR 21880 at commit
Github user tgravescs commented on the issue:
https://github.com/apache/spark/pull/21653
test this please
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail:
Github user squito commented on a diff in the pull request:
https://github.com/apache/spark/pull/21880#discussion_r205470335
--- Diff: dev/merge_spark_pr.py ---
@@ -331,6 +331,9 @@ def choose_jira_assignee(issue, asf_jira):
assignee =
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21880
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21880
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
Github user squito commented on the issue:
https://github.com/apache/spark/pull/21474
https://issues.apache.org/jira/browse/SPARK-24936
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For
Github user pwoody commented on the issue:
https://github.com/apache/spark/pull/21882
This is the same problem as #20935 , yeah?
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user yucai closed the pull request at:
https://github.com/apache/spark/pull/21156
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org
Github user HyukjinKwon commented on the issue:
https://github.com/apache/spark/pull/21882
oops it is. I didn't know. But this PR can target lower branches too since
it's a correctness issue :-)
---
-
To
Github user yucai commented on the issue:
https://github.com/apache/spark/pull/21156
closed by mistake, reopen it.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail:
GitHub user yucai reopened a pull request:
https://github.com/apache/spark/pull/21156
[SPARK-24087][SQL] Avoid shuffle when join keys are a super-set of bucket
keys
## What changes were proposed in this pull request?
To improve the bucket join, when join keys are a
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/21156
**[Test build #93601 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/93601/testReport)**
for PR 21156 at commit
Github user cloud-fan commented on a diff in the pull request:
https://github.com/apache/spark/pull/21802#discussion_r205483502
--- Diff:
sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/collectionOperations.scala
---
@@ -1184,6 +1184,110 @@ case class
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21156
Can one of the admins verify this patch?
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user cloud-fan commented on a diff in the pull request:
https://github.com/apache/spark/pull/21103#discussion_r205484762
--- Diff:
sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/collectionOperations.scala
---
@@ -3805,3 +3799,330 @@ object ArrayUnion
Github user cloud-fan commented on a diff in the pull request:
https://github.com/apache/spark/pull/21103#discussion_r205486499
--- Diff:
sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/collectionOperations.scala
---
@@ -3805,3 +3799,330 @@ object ArrayUnion
Github user tgravescs commented on the issue:
https://github.com/apache/spark/pull/21653
test this please
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail:
Github user kiszk commented on a diff in the pull request:
https://github.com/apache/spark/pull/21103#discussion_r205495042
--- Diff:
sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/collectionOperations.scala
---
@@ -3805,3 +3799,330 @@ object ArrayUnion {
Github user mgaido91 commented on the issue:
https://github.com/apache/spark/pull/21882
@pwoody I am not sure I 100% agree on your last sentence. I agree that we
should correct null bounds, but letting the users facing bugs returning wrong
results meanwhile we find all the possible
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21826
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/93596/
Test PASSed.
---
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/21826
**[Test build #93596 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/93596/testReport)**
for PR 21826 at commit
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/21653
**[Test build #4222 has
started](https://amplab.cs.berkeley.edu/jenkins/job/NewSparkPullRequestBuilder/4222/testReport)**
for PR 21653 at commit
Github user squito commented on the issue:
https://github.com/apache/spark/pull/21653
I kicked off the test manually at
https://spark-prs.appspot.com/users/hthuynh2. I dunno why the test triggering
via comments stops workign on some prs
---
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21826
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user HyukjinKwon commented on a diff in the pull request:
https://github.com/apache/spark/pull/21880#discussion_r205474983
--- Diff: dev/merge_spark_pr.py ---
@@ -331,6 +331,9 @@ def choose_jira_assignee(issue, asf_jira):
assignee =
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/21880
**[Test build #93600 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/93600/testReport)**
for PR 21880 at commit
Github user squito commented on the issue:
https://github.com/apache/spark/pull/21474
oh no, good point Tom. it'll fail with
```
18/07/26 07:15:02 WARN scheduler.TaskSetManager: Lost task 1.0 in stage 1.3
(TID 15, irashid-large-2.gce.cloudera.com, executor 2):
Github user xuanyuanking commented on a diff in the pull request:
https://github.com/apache/spark/pull/21618#discussion_r205478496
--- Diff: core/src/main/java/org/apache/hadoop/fs/SparkGlobber.java ---
@@ -0,0 +1,293 @@
+/**
+ * Licensed to the Apache Software Foundation
Github user cloud-fan commented on a diff in the pull request:
https://github.com/apache/spark/pull/21802#discussion_r205483672
--- Diff:
sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/util/RandomIndicesGenerator.scala
---
@@ -0,0 +1,45 @@
+/*
+ * Licensed to
Github user cloud-fan commented on the issue:
https://github.com/apache/spark/pull/21802
LGTM
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail:
Github user HyukjinKwon commented on the issue:
https://github.com/apache/spark/pull/21882
Also, I believe this issue still can happen even after your PR?
---
-
To unsubscribe, e-mail:
Github user cloud-fan commented on a diff in the pull request:
https://github.com/apache/spark/pull/21103#discussion_r205488729
--- Diff:
sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/collectionOperations.scala
---
@@ -3805,3 +3799,330 @@ object ArrayUnion
Github user pwoody commented on the issue:
https://github.com/apache/spark/pull/21882
The test case here works fine at least. The linked PR focuses on accurately
collecting stats, so null bounds should be correct if they occur.
---
Github user HyukjinKwon commented on the issue:
https://github.com/apache/spark/pull/21882
We should backport this one anyway. Actually the stats are logged in DEBUG
level. So, I think we are fine. I guess no harm to add this check and get rid
of this hole found, and this doesn't
GitHub user wangyum opened a pull request:
https://github.com/apache/spark/pull/21883
[SPARK-24937][SQL] Datasource partition table should load empty partitions
## What changes were proposed in this pull request?
How to reproduce:
```sql
spark-sql> CREATE TABLE tbl
Github user cloud-fan commented on a diff in the pull request:
https://github.com/apache/spark/pull/21882#discussion_r205504149
--- Diff:
sql/core/src/main/scala/org/apache/spark/sql/execution/columnar/InMemoryTableScanExec.scala
---
@@ -183,6 +183,13 @@ case class
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21883
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21883
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
Github user lindblombr commented on a diff in the pull request:
https://github.com/apache/spark/pull/21847#discussion_r205505006
--- Diff:
external/avro/src/main/scala/org/apache/spark/sql/avro/AvroSerializer.scala ---
@@ -41,7 +42,7 @@ class AvroSerializer(rootCatalystType:
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/21847
**[Test build #93603 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/93603/testReport)**
for PR 21847 at commit
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/21883
**[Test build #93602 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/93602/testReport)**
for PR 21883 at commit
Github user cloud-fan commented on a diff in the pull request:
https://github.com/apache/spark/pull/21850#discussion_r205505495
--- Diff:
sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/optimizer/expressions.scala
---
@@ -414,6 +414,9 @@ object SimplifyConditionals
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/21847
**[Test build #93604 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/93604/testReport)**
for PR 21847 at commit
Github user HyukjinKwon commented on a diff in the pull request:
https://github.com/apache/spark/pull/21882#discussion_r205508221
--- Diff:
sql/core/src/main/scala/org/apache/spark/sql/execution/columnar/InMemoryTableScanExec.scala
---
@@ -183,6 +183,13 @@ case class
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21306
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21306
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/21306
**[Test build #93605 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/93605/testReport)**
for PR 21306 at commit
Github user mgaido91 commented on a diff in the pull request:
https://github.com/apache/spark/pull/21882#discussion_r205511472
--- Diff:
sql/core/src/main/scala/org/apache/spark/sql/execution/columnar/InMemoryTableScanExec.scala
---
@@ -183,6 +183,13 @@ case class
Github user mgaido91 commented on a diff in the pull request:
https://github.com/apache/spark/pull/21882#discussion_r205504738
--- Diff:
sql/core/src/test/scala/org/apache/spark/sql/execution/columnar/PartitionBatchPruningSuite.scala
---
@@ -95,6 +103,12 @@ class
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21847
Merged build finished. Test FAILed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/21847
**[Test build #93604 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/93604/testReport)**
for PR 21847 at commit
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21847
Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/93604/
Test FAILed.
---
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/4
**[Test build #42 has
started](https://amplab.cs.berkeley.edu/jenkins/job/ubuntuSparkPRB/42/testReport)**
for PR 4 at commit
601 - 674 of 674 matches
Mail list logo
