Github user squito commented on the issue:
https://github.com/apache/spark/pull/21474
oh no, good point Tom. it'll fail with
```
18/07/26 07:15:02 WARN scheduler.TaskSetManager: Lost task 1.0 in stage 1.3
(TID 15, irashid-large-2.gce.cloudera.com, executor 2):
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/21880
**[Test build #93600 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/93600/testReport)**
for PR 21880 at commit
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21880
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21880
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
Github user HyukjinKwon commented on a diff in the pull request:
https://github.com/apache/spark/pull/21880#discussion_r205474983
--- Diff: dev/merge_spark_pr.py ---
@@ -331,6 +331,9 @@ def choose_jira_assignee(issue, asf_jira):
assignee =
Github user squito commented on a diff in the pull request:
https://github.com/apache/spark/pull/21880#discussion_r205470335
--- Diff: dev/merge_spark_pr.py ---
@@ -331,6 +331,9 @@ def choose_jira_assignee(issue, asf_jira):
assignee =
Github user tgravescs commented on the issue:
https://github.com/apache/spark/pull/21474
just to clarify here, so the failure case if you are using a shuffle server
< 2.2, does it throw an obvious error to the user?
---
Github user cloud-fan commented on the issue:
https://github.com/apache/spark/pull/21802
@rxin Generally I agree with you, but currently the whole-stage-codegen
doesn't support `CodegenFallback`, which means, if we don't implement codegen,
this expression will stop WSC and hurt perf
Github user cloud-fan commented on the issue:
https://github.com/apache/spark/pull/21758
LGTM
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail:
Github user tgravescs commented on the issue:
https://github.com/apache/spark/pull/21653
test this please
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail:
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/21403
**[Test build #93599 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/93599/testReport)**
for PR 21403 at commit
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21880
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21403
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21403
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21880
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21873
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21873
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/93592/
Test PASSed.
---
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/21880
**[Test build #93598 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/93598/testReport)**
for PR 21880 at commit
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/21882
**[Test build #93597 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/93597/testReport)**
for PR 21882 at commit
Github user HyukjinKwon commented on the issue:
https://github.com/apache/spark/pull/21880
retest this please
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail:
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21882
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21882
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/21873
**[Test build #93592 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/93592/testReport)**
for PR 21873 at commit
Github user cloud-fan commented on a diff in the pull request:
https://github.com/apache/spark/pull/21758#discussion_r205450947
--- Diff: core/src/main/scala/org/apache/spark/BarrierTaskContext.scala ---
@@ -0,0 +1,42 @@
+/*
+ * Licensed to the Apache Software Foundation
Github user HyukjinKwon commented on the issue:
https://github.com/apache/spark/pull/21882
cc @cloud-fan, mind taking a look please?
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
GitHub user HyukjinKwon opened a pull request:
https://github.com/apache/spark/pull/21882
[SPARK-24934][SQL] Handle missing upper/lower bounds case in in-memory
partition pruning
## What changes were proposed in this pull request?
Looks we intentionally set `null` for
Github user icexelloss commented on a diff in the pull request:
https://github.com/apache/spark/pull/21650#discussion_r205448677
--- Diff:
sql/core/src/main/scala/org/apache/spark/sql/execution/python/ExtractPythonUDFs.scala
---
@@ -94,36 +95,94 @@ object
Github user icexelloss commented on a diff in the pull request:
https://github.com/apache/spark/pull/21650#discussion_r205445392
--- Diff: python/pyspark/sql/tests.py ---
@@ -5060,6 +5049,147 @@ def test_type_annotation(self):
df =
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21880
Merged build finished. Test FAILed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21880
Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/93591/
Test FAILed.
---
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/21880
**[Test build #93591 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/93591/testReport)**
for PR 21880 at commit
Github user httfighter commented on the issue:
https://github.com/apache/spark/pull/21826
I have submitted a new code. Could you help me review the code? Thank you!
@HyukjinKwon @viirya @gatorsmile @rxin @hvanhovell
In Hive, "||" performs the function of STRING concat, the symbol
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21880
Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/93593/
Test FAILed.
---
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21880
Merged build finished. Test FAILed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/21880
**[Test build #93593 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/93593/testReport)**
for PR 21880 at commit
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21758
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21758
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/93590/
Test PASSed.
---
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/21758
**[Test build #93590 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/93590/testReport)**
for PR 21758 at commit
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21857
Merged build finished. Test FAILed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21857
Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/93595/
Test FAILed.
---
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/21857
**[Test build #93595 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/93595/testReport)**
for PR 21857 at commit
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/21826
**[Test build #93596 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/93596/testReport)**
for PR 21826 at commit
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/16476
Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/93594/
Test FAILed.
---
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/16476
Merged build finished. Test FAILed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/16476
**[Test build #93594 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/93594/testReport)**
for PR 16476 at commit
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21103
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21103
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/93589/
Test PASSed.
---
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/21103
**[Test build #93589 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/93589/testReport)**
for PR 21103 at commit
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21879
Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/93585/
Test FAILed.
---
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21879
Merged build finished. Test FAILed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/21879
**[Test build #93585 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/93585/testReport)**
for PR 21879 at commit
Github user mn-mikke commented on the issue:
https://github.com/apache/spark/pull/21103
Added few minor comments, but nothing serious to be solved right now.
LGTM
---
-
To unsubscribe, e-mail:
Github user mn-mikke commented on a diff in the pull request:
https://github.com/apache/spark/pull/21103#discussion_r205395435
--- Diff:
sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/collectionOperations.scala
---
@@ -3805,3 +3799,330 @@ object ArrayUnion
Github user mn-mikke commented on a diff in the pull request:
https://github.com/apache/spark/pull/21103#discussion_r205397226
--- Diff:
sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/collectionOperations.scala
---
@@ -3805,3 +3799,330 @@ object ArrayUnion
Github user mn-mikke commented on a diff in the pull request:
https://github.com/apache/spark/pull/21103#discussion_r205397802
--- Diff:
sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/collectionOperations.scala
---
@@ -3805,3 +3799,330 @@ object ArrayUnion
Github user mn-mikke commented on a diff in the pull request:
https://github.com/apache/spark/pull/21103#discussion_r205392257
--- Diff:
sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/collectionOperations.scala
---
@@ -3805,3 +3799,330 @@ object ArrayUnion
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/21857
**[Test build #93595 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/93595/testReport)**
for PR 21857 at commit
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21857
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21857
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21881
Can one of the admins verify this patch?
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21881
Can one of the admins verify this patch?
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21875
Merged build finished. Test FAILed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21875
Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/93584/
Test FAILed.
---
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/16476
**[Test build #93594 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/93594/testReport)**
for PR 16476 at commit
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/21875
**[Test build #93584 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/93584/testReport)**
for PR 21875 at commit
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21881
Can one of the admins verify this patch?
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
GitHub user ouyangxiaochen opened a pull request:
https://github.com/apache/spark/pull/21881
[SPARK-24930][SQL] Improve exception information when using LOAD DATA LOCAL
INPATH
## What changes were proposed in this pull request?
## How was this patch tested?
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21857
Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/93587/
Test FAILed.
---
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21857
Merged build finished. Test FAILed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/21857
**[Test build #93587 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/93587/testReport)**
for PR 21857 at commit
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/21880
**[Test build #93593 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/93593/testReport)**
for PR 21880 at commit
Github user gengliangwang commented on a diff in the pull request:
https://github.com/apache/spark/pull/21873#discussion_r205374847
--- Diff: scalastyle-config.xml ---
@@ -150,6 +150,19 @@ This file is divided into 3 sections:
// scalastyle:on println]]>
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21880
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21880
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/21880
**[Test build #93591 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/93591/testReport)**
for PR 21880 at commit
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21873
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/21873
**[Test build #93592 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/93592/testReport)**
for PR 21873 at commit
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21873
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21880
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21880
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user HyukjinKwon commented on the issue:
https://github.com/apache/spark/pull/21880
cc @squito
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail:
GitHub user HyukjinKwon opened a pull request:
https://github.com/apache/spark/pull/21880
[SPARK-24929][INFRA] Make merge script don't swallow KeyboardInterrupt
## What changes were proposed in this pull request?
If you want to get out of the loop to assign JIRA's user by
Github user asfgit closed the pull request at:
https://github.com/apache/spark/pull/21878
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21788
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21788
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/93588/
Test PASSed.
---
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/21788
**[Test build #93588 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/93588/testReport)**
for PR 21788 at commit
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21868
Can one of the admins verify this patch?
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21868
Can one of the admins verify this patch?
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21868
Can one of the admins verify this patch?
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user HyukjinKwon commented on the issue:
https://github.com/apache/spark/pull/21878
Merged to master.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail:
Github user HyukjinKwon commented on a diff in the pull request:
https://github.com/apache/spark/pull/21878#discussion_r205365847
--- Diff:
sql/core/src/main/scala/org/apache/spark/sql/execution/datasources/DataSource.scala
---
@@ -635,12 +637,6 @@ object DataSource extends
GitHub user habren reopened a pull request:
https://github.com/apache/spark/pull/21868
[SPARK-24906][SQL] Adaptively enlarge split / partition size for Parqâ¦
Please refer to https://issues.apache.org/jira/browse/SPARK-24906 for more
detail and test
For columnar file,
Github user gengliangwang commented on the issue:
https://github.com/apache/spark/pull/21878
LGTM.
Let's add a message for how to load avro package when the documentation for
2.4 is done :)
---
-
To
Github user zhengruifeng commented on the issue:
https://github.com/apache/spark/pull/20028
LGTM, except for the since annotations.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user HyukjinKwon commented on a diff in the pull request:
https://github.com/apache/spark/pull/21878#discussion_r205360960
--- Diff:
sql/core/src/main/scala/org/apache/spark/sql/execution/datasources/DataSource.scala
---
@@ -635,12 +637,6 @@ object DataSource extends
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21563
Merged build finished. Test FAILed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21563
Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/93586/
Test FAILed.
---
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/21563
**[Test build #93586 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/93586/testReport)**
for PR 21563 at commit
Github user HyukjinKwon commented on a diff in the pull request:
https://github.com/apache/spark/pull/21878#discussion_r205360211
--- Diff:
sql/core/src/main/scala/org/apache/spark/sql/execution/datasources/DataSource.scala
---
@@ -635,12 +637,6 @@ object DataSource extends
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/12066
Build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands,
501 - 600 of 674 matches
Mail list logo
