Github user asfgit closed the pull request at:
https://github.com/apache/spark/pull/22126
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/22130
**[Test build #94877 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/94877/testReport)**
for PR 22130 at commit
Github user gatorsmile commented on the issue:
https://github.com/apache/spark/pull/22121
@gengliangwang Could you also post the screen shot in your PR description?
---
-
To unsubscribe, e-mail:
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22130
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22130
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22130
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22130
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/22130
**[Test build #94876 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/94876/testReport)**
for PR 22130 at commit
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22130
Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/94876/
Test FAILed.
---
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22130
Merged build finished. Test FAILed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user ueshin commented on the issue:
https://github.com/apache/spark/pull/22126
Thanks! merging to master.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail:
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/22130
**[Test build #94876 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/94876/testReport)**
for PR 22130 at commit
GitHub user vinodkc opened a pull request:
https://github.com/apache/spark/pull/22130
[SPARK-25137][Spark Shell] NumberFormatException` when starting spark-shell
from Mac terminal
## What changes were proposed in this pull request?
When starting spark-shell from Mac
Github user gengliangwang commented on the issue:
https://github.com/apache/spark/pull/22121
@cloud-fan @gatorsmile
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands,
Github user bersprockets commented on the issue:
https://github.com/apache/spark/pull/22079
@jiangxb1987 gentle ping.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands,
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22126
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22126
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/94871/
Test PASSed.
---
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/22126
**[Test build #94871 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/94871/testReport)**
for PR 22126 at commit
Github user ajithme commented on the issue:
https://github.com/apache/spark/pull/22120
@vanzin I agree its a trivial change. Just wanted it to be consistent
output with yarn cluster mode. This is not just for event logs also for a
custom SparkListener , it may be confusing that appId
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/22123
**[Test build #94875 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/94875/testReport)**
for PR 22123 at commit
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22123
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user srowen commented on the issue:
https://github.com/apache/spark/pull/21794
I think we'd have to close this due to the behavior change, but would merge
an optimization of the existing behavior.
---
-
To
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22123
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
Github user koertkuipers commented on a diff in the pull request:
https://github.com/apache/spark/pull/22123#discussion_r210801081
--- Diff:
sql/core/src/test/scala/org/apache/spark/sql/execution/datasources/csv/CSVSuite.scala
---
@@ -1603,6 +1603,44 @@ class CSVSuite extends
Github user srowen commented on a diff in the pull request:
https://github.com/apache/spark/pull/21961#discussion_r210800762
--- Diff:
external/kafka-0-10-sql/src/main/scala/org/apache/spark/sql/kafka010/KafkaSourceProvider.scala
---
@@ -231,7 +231,13 @@ private[kafka010] class
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21860
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/94872/
Test PASSed.
---
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21860
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user gatorsmile commented on the issue:
https://github.com/apache/spark/pull/21537
@kiszk The initial prototype or proof of concept can be in any personal
branch. When we merge it to the master branch, we still need to separate it
from the current codegen and make it
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/21860
**[Test build #94872 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/94872/testReport)**
for PR 21860 at commit
Github user HyukjinKwon commented on a diff in the pull request:
https://github.com/apache/spark/pull/21868#discussion_r210799950
--- Diff:
sql/core/src/main/scala/org/apache/spark/sql/execution/DataSourceScanExec.scala
---
@@ -425,12 +426,44 @@ case class FileSourceScanExec(
Github user viirya commented on a diff in the pull request:
https://github.com/apache/spark/pull/21868#discussion_r210799970
--- Diff:
sql/catalyst/src/main/scala/org/apache/spark/sql/internal/SQLConf.scala ---
@@ -459,6 +460,29 @@ object SQLConf {
.intConf
Github user viirya commented on the issue:
https://github.com/apache/spark/pull/21537
If we will continue on improving current codegen framework, I think it is
good to have a design doc reviewed by the community.
If we decide to have IR design and get rid of this string based
Github user HyukjinKwon commented on a diff in the pull request:
https://github.com/apache/spark/pull/21868#discussion_r210799891
--- Diff:
sql/catalyst/src/main/scala/org/apache/spark/sql/internal/SQLConf.scala ---
@@ -459,6 +460,29 @@ object SQLConf {
.intConf
Github user HyukjinKwon commented on a diff in the pull request:
https://github.com/apache/spark/pull/21868#discussion_r210799770
--- Diff:
sql/catalyst/src/main/scala/org/apache/spark/sql/internal/SQLConf.scala ---
@@ -459,6 +460,29 @@ object SQLConf {
.intConf
Github user HyukjinKwon commented on a diff in the pull request:
https://github.com/apache/spark/pull/21868#discussion_r210799731
--- Diff:
sql/catalyst/src/main/scala/org/apache/spark/sql/internal/SQLConf.scala ---
@@ -459,6 +460,29 @@ object SQLConf {
.intConf
Github user asfgit closed the pull request at:
https://github.com/apache/spark/pull/22110
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org
Github user HyukjinKwon commented on a diff in the pull request:
https://github.com/apache/spark/pull/21868#discussion_r210799600
--- Diff:
sql/catalyst/src/main/scala/org/apache/spark/sql/internal/SQLConf.scala ---
@@ -459,6 +460,29 @@ object SQLConf {
.intConf
Github user HyukjinKwon commented on the issue:
https://github.com/apache/spark/pull/21868
@habren, BTW, just for clarification, you can set the bigger number to
`spark.sql.files.maxPartitionBytes` explicitly and that resolved your issue.
This one is to handle it dynamically, right?
Github user cloud-fan commented on a diff in the pull request:
https://github.com/apache/spark/pull/22124#discussion_r210799343
--- Diff:
sql/core/src/main/scala/org/apache/spark/sql/execution/datasources/rules.scala
---
@@ -490,7 +490,8 @@ object DDLPreprocessingUtils {
Github user cloud-fan commented on the issue:
https://github.com/apache/spark/pull/22110
thanks, merging to master!
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail:
Github user KraFusion commented on the issue:
https://github.com/apache/spark/pull/22116
@srowen Thanks!
yes, my bad. next time I will bundle (better yet I will look for the same
issue elsewhere in the docs), and I'll use a better title.
---
Github user cloud-fan commented on the issue:
https://github.com/apache/spark/pull/21537
It's a good point that we should have a design doc for this codegen
infrastructure improvement, since it's very critical to Spark. And we should
have it reviewed by the community.
There
Github user cloud-fan commented on the issue:
https://github.com/apache/spark/pull/22112
Actually we can extend the solution later and I've mentioned it in my PR
description.
Basically there are 3 kinds of closures:
1. totally random
2. always output same data set in
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/21950
**[Test build #94874 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/94874/testReport)**
for PR 21950 at commit
Github user squito commented on the issue:
https://github.com/apache/spark/pull/21950
retest this please
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail:
Github user asfgit closed the pull request at:
https://github.com/apache/spark/pull/22045
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org
Github user habren commented on a diff in the pull request:
https://github.com/apache/spark/pull/21868#discussion_r210793717
--- Diff:
sql/core/src/main/scala/org/apache/spark/sql/execution/DataSourceScanExec.scala
---
@@ -425,12 +426,44 @@ case class FileSourceScanExec(
Github user ueshin commented on the issue:
https://github.com/apache/spark/pull/22045
Thanks! merging to master.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail:
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21990
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/94873/
Test PASSed.
---
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/21990
**[Test build #94873 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/94873/testReport)**
for PR 21990 at commit
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21990
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user xuanyuanking commented on the issue:
https://github.com/apache/spark/pull/22122
Thanks.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail:
Github user mridulm commented on the issue:
https://github.com/apache/spark/pull/22112
@tgravescs To understand better, are you suggesting that we do not support
any api and/or user closure which depends on input order ?
If yes, that would break not just repartition + shuffle, but
Github user HyukjinKwon commented on a diff in the pull request:
https://github.com/apache/spark/pull/21990#discussion_r210790581
--- Diff: python/pyspark/sql/tests.py ---
@@ -3563,6 +3563,51 @@ def
test_query_execution_listener_on_collect_with_arrow(self):
Github user asfgit closed the pull request at:
https://github.com/apache/spark/pull/22122
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org
Github user HyukjinKwon commented on a diff in the pull request:
https://github.com/apache/spark/pull/21990#discussion_r210790531
--- Diff: python/pyspark/sql/tests.py ---
@@ -3563,6 +3563,51 @@ def
test_query_execution_listener_on_collect_with_arrow(self):
Github user NiharS commented on the issue:
https://github.com/apache/spark/pull/22114
They pass on my machine :(
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail:
Github user HyukjinKwon commented on the issue:
https://github.com/apache/spark/pull/22122
Merged to master.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail:
Github user xuanyuanking commented on the issue:
https://github.com/apache/spark/pull/22122
```
Are they all instances to fix?
```
@HyukjinKwon Yep, I grep all `conf.get("spark.sql.xxx")` and make sure for
this. The remaining of hard code config is StaticSQLConf
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/21990
**[Test build #94873 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/94873/testReport)**
for PR 21990 at commit
Github user HyukjinKwon commented on a diff in the pull request:
https://github.com/apache/spark/pull/22123#discussion_r210788916
--- Diff:
sql/core/src/test/scala/org/apache/spark/sql/execution/datasources/csv/CSVSuite.scala
---
@@ -1603,6 +1603,44 @@ class CSVSuite extends
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21950
Merged build finished. Test FAILed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21950
Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/94869/
Test FAILed.
---
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/21950
**[Test build #94869 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/94869/testReport)**
for PR 21950 at commit
Github user HyukjinKwon commented on the issue:
https://github.com/apache/spark/pull/22098
haha, it's more then 4 years ago .. if we are unsure on the env, let me
just push this in.
---
-
To unsubscribe, e-mail:
Github user HyukjinKwon commented on a diff in the pull request:
https://github.com/apache/spark/pull/22104#discussion_r210786895
--- Diff: python/pyspark/sql/tests.py ---
@@ -3367,6 +3367,33 @@ def test_ignore_column_of_all_nulls(self):
finally:
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22114
Merged build finished. Test FAILed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22114
Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/94867/
Test FAILed.
---
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/22114
**[Test build #94867 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/94867/testReport)**
for PR 22114 at commit
Github user viirya commented on a diff in the pull request:
https://github.com/apache/spark/pull/21868#discussion_r210785081
--- Diff:
sql/catalyst/src/main/scala/org/apache/spark/sql/internal/SQLConf.scala ---
@@ -459,6 +458,29 @@ object SQLConf {
.intConf
Github user viirya commented on a diff in the pull request:
https://github.com/apache/spark/pull/21868#discussion_r210779310
--- Diff:
sql/catalyst/src/main/scala/org/apache/spark/sql/internal/SQLConf.scala ---
@@ -459,6 +458,29 @@ object SQLConf {
.intConf
Github user viirya commented on a diff in the pull request:
https://github.com/apache/spark/pull/21868#discussion_r210765335
--- Diff:
sql/catalyst/src/main/scala/org/apache/spark/sql/internal/SQLConf.scala ---
@@ -25,17 +25,16 @@ import java.util.zip.Deflater
import
Github user HyukjinKwon commented on the issue:
https://github.com/apache/spark/pull/21819
Let me leave this in few days in case someone has more comments on this.
---
-
To unsubscribe, e-mail:
Github user HyukjinKwon commented on the issue:
https://github.com/apache/spark/pull/21320
I said either way works fine. It doesn't matter which way we go. Better
close one of them if the approach is the same and both PRs are active.
---
Github user kiszk commented on the issue:
https://github.com/apache/spark/pull/22125
@KraFusion Sorry, I overlooked another PR.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user HyukjinKwon commented on the issue:
https://github.com/apache/spark/pull/21537
I don't see a notable risk here. That's just to avoid string interpolation,
which makes less error-prone, which is discussed already and the code change is
small.
I hope we can move
GitHub user shaneknapp opened a pull request:
https://github.com/apache/spark/pull/22129
just testing pyarrow changes
## What changes were proposed in this pull request?
(Please fill in changes proposed in this fix)
## How was this patch tested?
(Please
Github user shaneknapp closed the pull request at:
https://github.com/apache/spark/pull/22129
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail:
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21221
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/94865/
Test PASSed.
---
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21221
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/21221
**[Test build #94865 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/94865/testReport)**
for PR 21221 at commit
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/21860
**[Test build #94872 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/94872/testReport)**
for PR 21860 at commit
Github user kiszk commented on the issue:
https://github.com/apache/spark/pull/22048
Thank you for creating a JIRA entry and for putting the result. The test
case is not available yet.
---
-
To unsubscribe, e-mail:
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22126
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/22126
**[Test build #94871 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/94871/testReport)**
for PR 22126 at commit
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22126
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22045
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/94864/
Test PASSed.
---
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22045
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/22045
**[Test build #94864 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/94864/testReport)**
for PR 22045 at commit
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21990
Merged build finished. Test FAILed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/21990
**[Test build #94870 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/94870/testReport)**
for PR 21990 at commit
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21990
Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/94870/
Test FAILed.
---
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/21990
**[Test build #94870 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/94870/testReport)**
for PR 21990 at commit
Github user asfgit closed the pull request at:
https://github.com/apache/spark/pull/22116
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org
Github user asfgit closed the pull request at:
https://github.com/apache/spark/pull/22125
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22127
Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/94868/
Test FAILed.
---
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22127
Merged build finished. Test FAILed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/22127
**[Test build #94868 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/94868/testReport)**
for PR 22127 at commit
Github user srowen commented on the issue:
https://github.com/apache/spark/pull/22125
Merged to master
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail:
Github user srowen commented on the issue:
https://github.com/apache/spark/pull/22116
Merged to master. For the future, a better title and bundling these in one
PR would be preferable.
---
-
To unsubscribe, e-mail:
1 - 100 of 440 matches
Mail list logo
