Github user zsxwing commented on the issue:
https://github.com/apache/spark/pull/19768
Thanks! Merging to 2.2
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail:
Github user mgaido91 commented on the issue:
https://github.com/apache/spark/pull/19720
No, a query with a `coalesce` with many/complex parameters will hit this
problem. A query with a lot of small `coalesce` will not have the problem.
For `AtLeastNNonNulls ` the fix would be safe
Github user squito commented on a diff in the pull request:
https://github.com/apache/spark/pull/19769#discussion_r151557718
--- Diff:
sql/core/src/main/java/org/apache/spark/sql/execution/datasources/parquet/VectorizedColumnReader.java
---
@@ -298,7 +304,10 @@ private void
Github user squito commented on a diff in the pull request:
https://github.com/apache/spark/pull/19769#discussion_r151556907
--- Diff:
sql/core/src/main/scala/org/apache/spark/sql/execution/datasources/parquet/ParquetFileFormat.scala
---
@@ -355,9 +361,31 @@ class
Github user vanzin commented on the issue:
https://github.com/apache/spark/pull/19760
(And even `SparkSubmit` now creates `SparkConf`.)
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For
Github user vanzin commented on the issue:
https://github.com/apache/spark/pull/19760
There's quite a lot of applications that use just `SparkContext`. And
`SparkConf` is generally created before anything else (e.g. in yarn-cluster
mode, the Spark code will instantiate `SparkConf`
Github user cloud-fan commented on the issue:
https://github.com/apache/spark/pull/19760
Since now `SparkSession` is the main entry, we just need
`spark.conf.get(xxx)` to print deprecation message(still keep the old
deprecated configs in `SparkConf`). I think then it's possible to
Github user cloud-fan commented on a diff in the pull request:
https://github.com/apache/spark/pull/19769#discussion_r151550352
--- Diff:
sql/core/src/main/java/org/apache/spark/sql/execution/datasources/parquet/VectorizedColumnReader.java
---
@@ -298,7 +304,10 @@ private void
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/19769
**[Test build #83950 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/83950/testReport)**
for PR 19769 at commit
Github user cloud-fan commented on a diff in the pull request:
https://github.com/apache/spark/pull/19769#discussion_r151549968
--- Diff:
sql/core/src/main/scala/org/apache/spark/sql/execution/datasources/parquet/ParquetFileFormat.scala
---
@@ -355,9 +361,31 @@ class
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/19768
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/19768
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/83945/
Test PASSed.
---
Github user cloud-fan commented on a diff in the pull request:
https://github.com/apache/spark/pull/19769#discussion_r151547788
--- Diff:
sql/catalyst/src/main/scala/org/apache/spark/sql/internal/SQLConf.scala ---
@@ -284,6 +284,13 @@ object SQLConf {
.booleanConf
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/19768
**[Test build #83945 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/83945/testReport)**
for PR 19768 at commit
Github user cloud-fan commented on a diff in the pull request:
https://github.com/apache/spark/pull/19769#discussion_r151547738
--- Diff:
sql/catalyst/src/main/scala/org/apache/spark/sql/internal/SQLConf.scala ---
@@ -284,6 +284,13 @@ object SQLConf {
.booleanConf
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/19769
Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/83948/
Test FAILed.
---
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/19769
**[Test build #83948 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/83948/testReport)**
for PR 19769 at commit
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/19769
Merged build finished. Test FAILed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/19770
Merged build finished. Test FAILed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/19770
**[Test build #83949 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/83949/testReport)**
for PR 19770 at commit
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/19770
Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/83949/
Test FAILed.
---
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/19770
**[Test build #83949 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/83949/testReport)**
for PR 19770 at commit
Github user vanzin commented on the issue:
https://github.com/apache/spark/pull/19770
ok to test
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail:
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/19770
Can one of the admins verify this patch?
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user ericvandenbergfb commented on the issue:
https://github.com/apache/spark/pull/18791
See continuation of pull request at
https://github.com/apache/spark/pull/19770
---
-
To unsubscribe, e-mail:
Github user ericvandenbergfb closed the pull request at:
https://github.com/apache/spark/pull/18791
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail:
Github user ericvandenbergfb commented on the issue:
https://github.com/apache/spark/pull/19770
This is a continuation of https://github.com/apache/spark/pull/18791 - the
underlying code changed so had to reimplement.
---
GitHub user ericvandenbergfb opened a pull request:
https://github.com/apache/spark/pull/19770
[SPARK-21571][WEB UI] Spark history server leaves incomplete or unreadable
logs around forever
## What changes were proposed in this pull request?
** Updated pull request based
Github user devaraj-kavali commented on a diff in the pull request:
https://github.com/apache/spark/pull/19741#discussion_r151541900
--- Diff:
resource-managers/yarn/src/main/scala/org/apache/spark/scheduler/cluster/YarnSchedulerBackend.scala
---
@@ -268,8 +268,13 @@
Github user vanzin commented on the issue:
https://github.com/apache/spark/pull/19760
It would be possible for configs declared in core; because then we can
force SparkConf to initialize those classes. (e.g., referencing any config
constant causes the `o.a.s.internal.config` package
Github user cloud-fan commented on the issue:
https://github.com/apache/spark/pull/19760
Generally having the deprecation message is good, but I hope that can be
done within the config entry, instead of a central place in `SparkConf`. Is
this possible?
---
Github user vanzin commented on the issue:
https://github.com/apache/spark/pull/19760
> the name withAlternatives says it's an alternative,
That's the other thing. Having alternative names is just confusing; there
should be a single name for a config, with others deprecated.
Github user vanzin commented on a diff in the pull request:
https://github.com/apache/spark/pull/19760#discussion_r151538808
--- Diff: core/src/main/scala/org/apache/spark/SparkConf.scala ---
@@ -663,8 +663,10 @@ private[spark] object SparkConf extends Logging {
Github user vanzin commented on a diff in the pull request:
https://github.com/apache/spark/pull/19741#discussion_r151538353
--- Diff:
resource-managers/yarn/src/main/scala/org/apache/spark/scheduler/cluster/YarnSchedulerBackend.scala
---
@@ -268,8 +268,13 @@ private[spark]
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/19769
**[Test build #83948 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/83948/testReport)**
for PR 19769 at commit
GitHub user squito opened a pull request:
https://github.com/apache/spark/pull/19769
[SPARK-12297][SQL] Adjust timezone for int96 data from impala
## What changes were proposed in this pull request?
Int96 data written by impala vs data written by hive & spark is stored
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/19741
**[Test build #83947 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/83947/testReport)**
for PR 19741 at commit
Github user cloud-fan commented on the issue:
https://github.com/apache/spark/pull/18918
what exactly are you proposing?
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands,
Github user devaraj-kavali commented on a diff in the pull request:
https://github.com/apache/spark/pull/19741#discussion_r151533418
--- Diff:
resource-managers/yarn/src/main/scala/org/apache/spark/scheduler/cluster/YarnSchedulerBackend.scala
---
@@ -268,8 +268,13 @@
Github user cloud-fan commented on a diff in the pull request:
https://github.com/apache/spark/pull/18918#discussion_r151533419
--- Diff: sql/core/src/test/scala/org/apache/spark/sql/DataFrameSuite.scala
---
@@ -2029,4 +2029,13 @@ class DataFrameSuite extends QueryTest with
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/19728
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/19728
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/83944/
Test PASSed.
---
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/19728
**[Test build #83944 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/83944/testReport)**
for PR 19728 at commit
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/19767
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/83943/
Test PASSed.
---
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/19767
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/19767
**[Test build #83943 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/83943/testReport)**
for PR 19767 at commit
Github user HyukjinKwon commented on the issue:
https://github.com/apache/spark/pull/16976
Guys, please use the mailing list or JIRA ...
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/19630
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/19630
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/83942/
Test PASSed.
---
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/19630
**[Test build #83942 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/83942/testReport)**
for PR 19630 at commit
Github user HyukjinKwon commented on the issue:
https://github.com/apache/spark/pull/16976
It was renamed `multiLine` before the release. Could we try out it instead?
---
-
To unsubscribe, e-mail:
Github user cloud-fan commented on the issue:
https://github.com/apache/spark/pull/19720
If there is a query with a lot of coalesce function, wouldn't it hit the
64kb issue?
---
-
To unsubscribe, e-mail:
Github user cloud-fan commented on the issue:
https://github.com/apache/spark/pull/19760
I don't exactly follow the purpose here, the name `withAlternatives` says
it's an alternative, not deprecated, so it should not print deprecation
message. Besides, I think `withAlternatives` is
Github user cloud-fan commented on a diff in the pull request:
https://github.com/apache/spark/pull/19760#discussion_r151524853
--- Diff: core/src/main/scala/org/apache/spark/SparkConf.scala ---
@@ -663,8 +663,10 @@ private[spark] object SparkConf extends Logging {
Github user cloud-fan commented on a diff in the pull request:
https://github.com/apache/spark/pull/19630#discussion_r151524338
--- Diff: python/pyspark/sql/tests.py ---
@@ -3166,6 +3166,92 @@ def test_filtered_frame(self):
self.assertTrue(pdf.empty)
Github user cloud-fan commented on a diff in the pull request:
https://github.com/apache/spark/pull/19630#discussion_r151524279
--- Diff: python/pyspark/sql/tests.py ---
@@ -3166,6 +3166,92 @@ def test_filtered_frame(self):
self.assertTrue(pdf.empty)
Github user cloud-fan commented on a diff in the pull request:
https://github.com/apache/spark/pull/19630#discussion_r151523879
--- Diff: python/pyspark/sql/tests.py ---
@@ -3166,6 +3166,92 @@ def test_filtered_frame(self):
self.assertTrue(pdf.empty)
Github user vanzin commented on a diff in the pull request:
https://github.com/apache/spark/pull/19390#discussion_r151521406
--- Diff:
resource-managers/mesos/src/main/scala/org/apache/spark/scheduler/cluster/mesos/MesosSchedulerUtils.scala
---
@@ -451,15 +468,22 @@ trait
Github user vanzin commented on a diff in the pull request:
https://github.com/apache/spark/pull/19390#discussion_r151520818
--- Diff:
resource-managers/mesos/src/main/scala/org/apache/spark/scheduler/cluster/mesos/MesosSchedulerUtils.scala
---
@@ -175,17 +176,39 @@ trait
Github user vanzin commented on a diff in the pull request:
https://github.com/apache/spark/pull/19390#discussion_r151521750
--- Diff:
resource-managers/mesos/src/main/scala/org/apache/spark/scheduler/cluster/mesos/MesosSchedulerUtils.scala
---
@@ -451,15 +468,22 @@ trait
Github user vanzin commented on a diff in the pull request:
https://github.com/apache/spark/pull/19390#discussion_r151521101
--- Diff:
resource-managers/mesos/src/main/scala/org/apache/spark/scheduler/cluster/mesos/MesosSchedulerUtils.scala
---
@@ -228,24 +254,15 @@ trait
Github user vanzin commented on a diff in the pull request:
https://github.com/apache/spark/pull/19390#discussion_r151520336
--- Diff:
resource-managers/mesos/src/main/scala/org/apache/spark/scheduler/cluster/mesos/MesosCoarseGrainedSchedulerBackend.scala
---
@@ -349,13 +349,22
Github user vanzin commented on a diff in the pull request:
https://github.com/apache/spark/pull/19390#discussion_r151521265
--- Diff:
resource-managers/mesos/src/main/scala/org/apache/spark/scheduler/cluster/mesos/MesosSchedulerUtils.scala
---
@@ -427,10 +444,10 @@ trait
Github user vanzin commented on a diff in the pull request:
https://github.com/apache/spark/pull/19390#discussion_r151521542
--- Diff:
resource-managers/mesos/src/main/scala/org/apache/spark/scheduler/cluster/mesos/MesosSchedulerUtils.scala
---
@@ -451,15 +468,22 @@ trait
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/19631
**[Test build #83946 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/83946/testReport)**
for PR 19631 at commit
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/17436
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/83941/
Test PASSed.
---
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/17436
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/17436
**[Test build #83941 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/83941/testReport)**
for PR 17436 at commit
Github user vanzin commented on a diff in the pull request:
https://github.com/apache/spark/pull/19751#discussion_r151510043
--- Diff:
core/src/main/scala/org/apache/spark/status/ElementTrackingStore.scala ---
@@ -0,0 +1,168 @@
+/*
+ * Licensed to the Apache Software
Github user kiszk commented on a diff in the pull request:
https://github.com/apache/spark/pull/19730#discussion_r151509423
--- Diff:
sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/Cast.scala
---
@@ -1039,13 +1039,19 @@ case class Cast(child: Expression,
Github user vanzin commented on a diff in the pull request:
https://github.com/apache/spark/pull/19741#discussion_r151509249
--- Diff:
resource-managers/yarn/src/main/scala/org/apache/spark/scheduler/cluster/YarnSchedulerBackend.scala
---
@@ -268,8 +268,13 @@ private[spark]
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/19768
**[Test build #83945 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/83945/testReport)**
for PR 19768 at commit
Github user zsxwing commented on the issue:
https://github.com/apache/spark/pull/19768
cc @ueshin
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail:
GitHub user zsxwing opened a pull request:
https://github.com/apache/spark/pull/19768
[SPARK-22535][PYSPARK] Sleep before killing the python worker in
PythRunner.MonitorThread (branch-2.2)
## What changes were proposed in this pull request?
Backport #19762 to 2.2
Github user zsxwing commented on the issue:
https://github.com/apache/spark/pull/9428
> I simply cant recompute things as results will be different.
A task may run multiple times due to failure. Why is this not a problem for
you?
---
Github user devaraj-kavali commented on a diff in the pull request:
https://github.com/apache/spark/pull/19741#discussion_r151497034
--- Diff:
resource-managers/yarn/src/main/scala/org/apache/spark/scheduler/cluster/YarnSchedulerBackend.scala
---
@@ -268,8 +268,13 @@
Github user icexelloss commented on a diff in the pull request:
https://github.com/apache/spark/pull/19630#discussion_r151493167
--- Diff: python/pyspark/sql/tests.py ---
@@ -3166,6 +3166,92 @@ def test_filtered_frame(self):
self.assertTrue(pdf.empty)
Github user vanzin commented on a diff in the pull request:
https://github.com/apache/spark/pull/19760#discussion_r151492713
--- Diff: core/src/main/scala/org/apache/spark/SparkConf.scala ---
@@ -663,8 +663,10 @@ private[spark] object SparkConf extends Logging {
Github user kiszk commented on the issue:
https://github.com/apache/spark/pull/19601
I see. Let us revisit this design later.
I would appreciate it if you would review this columnar cache reader with
simple primitive-type (non-nested) array.
---
Github user mgaido91 commented on the issue:
https://github.com/apache/spark/pull/19720
It's not about running slower. This PR solves the problem which makes the
user facing an exception if there are a lot of arguments in `coalesce` (or
`AtLestNNonNulls`), but what I am doing in the
Github user cloud-fan commented on the issue:
https://github.com/apache/spark/pull/19630
LGTM
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail:
Github user vanzin commented on a diff in the pull request:
https://github.com/apache/spark/pull/19631#discussion_r151490038
--- Diff:
core/src/main/scala/org/apache/spark/executor/CoarseGrainedExecutorBackend.scala
---
@@ -216,7 +216,9 @@ private[spark] object
Github user cloud-fan commented on a diff in the pull request:
https://github.com/apache/spark/pull/19630#discussion_r151489959
--- Diff: python/pyspark/sql/tests.py ---
@@ -3166,6 +3166,92 @@ def test_filtered_frame(self):
self.assertTrue(pdf.empty)
Github user vishnusram commented on the issue:
https://github.com/apache/spark/pull/16976
The wholeFile option doesn't seem to be working.
**Test file content:**
"num_col1","txt_col","num_col2"
10001,"regular string",20001
10002,"string with
newline",20002
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/19767
**[Test build #83943 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/83943/testReport)**
for PR 19767 at commit
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/19728
**[Test build #83944 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/83944/testReport)**
for PR 19728 at commit
Github user cloud-fan commented on the issue:
https://github.com/apache/spark/pull/19767
cc @kiszk @rednaxelafx @maropu @gatorsmile
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
GitHub user cloud-fan opened a pull request:
https://github.com/apache/spark/pull/19767
[WIP][SPARK-22543][SQL] fix java 64kb compile error for deeply nested
expressions
## What changes were proposed in this pull request?
A frequently reported issue of Spark is the Java
Github user DaimonPl commented on a diff in the pull request:
https://github.com/apache/spark/pull/16578#discussion_r151485646
--- Diff:
sql/catalyst/src/main/scala/org/apache/spark/sql/internal/SQLConf.scala ---
@@ -961,6 +961,15 @@ object SQLConf {
.booleanConf
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/19765
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/83940/
Test PASSed.
---
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/19765
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user ferdonline commented on the issue:
https://github.com/apache/spark/pull/9428
Hello. I find this feature to be really important and I would be happy to
contribute here. Even though we would potentially not support every use case,
it would already be great if in the
Github user asfgit closed the pull request at:
https://github.com/apache/spark/pull/19733
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/19765
**[Test build #83940 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/83940/testReport)**
for PR 19765 at commit
Github user cloud-fan commented on the issue:
https://github.com/apache/spark/pull/19720
hmm, isn't running slower better than can't run?
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For
Github user kiszk commented on a diff in the pull request:
https://github.com/apache/spark/pull/19728#discussion_r151482932
--- Diff:
sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/stringExpressions.scala
---
@@ -63,15 +63,32 @@ case class Concat(children:
Github user cloud-fan commented on the issue:
https://github.com/apache/spark/pull/19733
thanks , merging to master/2.2!
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands,
Github user mgaido91 commented on the issue:
https://github.com/apache/spark/pull/19720
@cloud-fan please do not backport this to 2.2. In 2.2 we don't have
SPARK-18016 and this is adding new variables in the case of coalesce. Thus it
can generate an higher pressure on the constant
Github user asfgit closed the pull request at:
https://github.com/apache/spark/pull/19720
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org
Github user cloud-fan commented on the issue:
https://github.com/apache/spark/pull/19720
thanks, merging to master/2.2!
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands,
101 - 200 of 331 matches
Mail list logo