Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21510
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional comma
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/21483
**[Test build #91546 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/91546/testReport)**
for PR 21483 at commit
[`bfcd3aa`](https://github.com/apache/spark/commit/bf
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21510
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/91536/
Test PASSed.
---
Github user HyukjinKwon commented on a diff in the pull request:
https://github.com/apache/spark/pull/21504#discussion_r193936818
--- Diff:
sql/core/src/main/scala/org/apache/spark/sql/streaming/StreamingQueryManager.scala
---
@@ -55,6 +57,19 @@ class StreamingQueryManager private
Github user HyukjinKwon commented on a diff in the pull request:
https://github.com/apache/spark/pull/21504#discussion_r193936698
--- Diff:
sql/core/src/main/scala/org/apache/spark/sql/streaming/StreamingQueryManager.scala
---
@@ -55,6 +57,19 @@ class StreamingQueryManager private
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/21510
**[Test build #91536 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/91536/testReport)**
for PR 21510 at commit
[`58a9ec4`](https://github.com/apache/spark/commit/5
Github user mccheah commented on a diff in the pull request:
https://github.com/apache/spark/pull/21366#discussion_r193936753
--- Diff:
resource-managers/kubernetes/core/src/main/scala/org/apache/spark/scheduler/cluster/k8s/ExecutorPodsAllocator.scala
---
@@ -0,0 +1,139 @@
+/*
Github user HyukjinKwon commented on the issue:
https://github.com/apache/spark/pull/21507
ping @deepaksonu close this PR please.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional comm
Github user dongjoon-hyun commented on a diff in the pull request:
https://github.com/apache/spark/pull/21495#discussion_r193936286
--- Diff:
repl/scala-2.11/src/main/scala/org/apache/spark/repl/SparkILoopInterpreter.scala
---
@@ -21,8 +21,22 @@ import scala.collection.mutable
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/21366
Kubernetes integration test status success
URL:
https://amplab.cs.berkeley.edu/jenkins/job/testing-k8s-prb-spark-integration/3699/
---
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21366
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional comma
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/21366
Kubernetes integration test starting
URL:
https://amplab.cs.berkeley.edu/jenkins/job/testing-k8s-prb-spark-integration/3699/
---
--
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21366
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/testing-k8s-prb-make-spark-distribution/3843/
Tes
Github user HyukjinKwon commented on a diff in the pull request:
https://github.com/apache/spark/pull/21477#discussion_r193935386
--- Diff: python/pyspark/sql/streaming.py ---
@@ -843,6 +844,169 @@ def trigger(self, processingTime=None, once=None,
continuous=None):
sel
Github user dongjoon-hyun commented on a diff in the pull request:
https://github.com/apache/spark/pull/21495#discussion_r193935371
--- Diff:
repl/scala-2.11/src/main/scala/org/apache/spark/repl/SparkILoopInterpreter.scala
---
@@ -21,8 +21,22 @@ import scala.collection.mutable
Github user mccheah commented on a diff in the pull request:
https://github.com/apache/spark/pull/21366#discussion_r193933505
--- Diff:
resource-managers/kubernetes/core/src/main/scala/org/apache/spark/scheduler/cluster/k8s/ExecutorPodsAllocator.scala
---
@@ -0,0 +1,139 @@
+/*
Github user mccheah commented on a diff in the pull request:
https://github.com/apache/spark/pull/21366#discussion_r193933656
--- Diff:
resource-managers/kubernetes/core/src/main/scala/org/apache/spark/scheduler/cluster/k8s/ExecutorPodsLifecycleManager.scala
---
@@ -0,0 +1,146 @@
Github user mccheah commented on a diff in the pull request:
https://github.com/apache/spark/pull/21366#discussion_r193934305
--- Diff:
resource-managers/kubernetes/core/src/main/scala/org/apache/spark/scheduler/cluster/k8s/ExecutorPodsSnapshotsStoreImpl.scala
---
@@ -0,0 +1,95 @@
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/21366
**[Test build #91545 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/91545/testReport)**
for PR 21366 at commit
[`a97fc5d`](https://github.com/apache/spark/commit/a9
Github user HyukjinKwon commented on a diff in the pull request:
https://github.com/apache/spark/pull/21477#discussion_r193933559
--- Diff: python/pyspark/sql/streaming.py ---
@@ -843,6 +844,169 @@ def trigger(self, processingTime=None, once=None,
continuous=None):
sel
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21366
Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/testing-k8s-prb-make-spark-distribution/3842/
Tes
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21366
Merged build finished. Test FAILed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional comma
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/21366
**[Test build #91544 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/91544/testReport)**
for PR 21366 at commit
[`3b85ab5`](https://github.com/apache/spark/commit/3b
Github user mccheah commented on the issue:
https://github.com/apache/spark/pull/21366
@foxish @liyinan926 @dvogelbacher ok, I think what we have here is closer
to what we want. I primarily addressed the situations outlined by the most
recent comments and observations made about the p
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/21366
**[Test build #91543 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/91543/testReport)**
for PR 21366 at commit
[`0a205f6`](https://github.com/apache/spark/commit/0a
Github user ueshin commented on a diff in the pull request:
https://github.com/apache/spark/pull/21258#discussion_r193929635
--- Diff:
sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/complexTypeCreator.scala
---
@@ -236,6 +236,76 @@ case class CreateMap(child
Github user ueshin commented on a diff in the pull request:
https://github.com/apache/spark/pull/21258#discussion_r193929951
--- Diff:
sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/complexTypeCreator.scala
---
@@ -236,6 +236,76 @@ case class CreateMap(child
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21258
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional comma
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21258
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/testing-k8s-prb-make-spark-distribution/3841/
Tes
Github user ueshin commented on a diff in the pull request:
https://github.com/apache/spark/pull/21155#discussion_r193928034
--- Diff:
sql/catalyst/src/test/scala/org/apache/spark/sql/catalyst/expressions/CollectionExpressionsSuite.scala
---
@@ -308,6 +313,292 @@ class CollectionE
Github user ueshin commented on a diff in the pull request:
https://github.com/apache/spark/pull/21155#discussion_r193928619
--- Diff:
sql/catalyst/src/test/scala/org/apache/spark/sql/catalyst/expressions/CollectionExpressionsSuite.scala
---
@@ -308,6 +313,292 @@ class CollectionE
Github user ueshin commented on a diff in the pull request:
https://github.com/apache/spark/pull/21155#discussion_r193926575
--- Diff:
sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/collectionOperations.scala
---
@@ -1887,6 +1889,402 @@ case class Flatten(ch
Github user ueshin commented on a diff in the pull request:
https://github.com/apache/spark/pull/21155#discussion_r193927174
--- Diff:
sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/collectionOperations.scala
---
@@ -1887,6 +1889,402 @@ case class Flatten(ch
Github user ueshin commented on a diff in the pull request:
https://github.com/apache/spark/pull/21155#discussion_r193927263
--- Diff:
sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/collectionOperations.scala
---
@@ -1887,6 +1889,402 @@ case class Flatten(ch
Github user ueshin commented on a diff in the pull request:
https://github.com/apache/spark/pull/21155#discussion_r193899743
--- Diff:
sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/collectionOperations.scala
---
@@ -1887,6 +1889,402 @@ case class Flatten(ch
Github user ueshin commented on a diff in the pull request:
https://github.com/apache/spark/pull/21155#discussion_r193926459
--- Diff:
sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/collectionOperations.scala
---
@@ -1887,6 +1889,402 @@ case class Flatten(ch
Github user ueshin commented on a diff in the pull request:
https://github.com/apache/spark/pull/21155#discussion_r193926035
--- Diff:
sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/collectionOperations.scala
---
@@ -1887,6 +1889,402 @@ case class Flatten(ch
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21495
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional comma
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21495
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/testing-k8s-prb-make-spark-distribution/3840/
Tes
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/21258
**[Test build #91542 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/91542/testReport)**
for PR 21258 at commit
[`228fcc6`](https://github.com/apache/spark/commit/22
Github user kiszk commented on a diff in the pull request:
https://github.com/apache/spark/pull/21258#discussion_r193928013
--- Diff:
sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/complexTypeCreator.scala
---
@@ -235,6 +235,86 @@ case class CreateMap(childr
Github user kiszk commented on a diff in the pull request:
https://github.com/apache/spark/pull/21258#discussion_r193927995
--- Diff:
sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/complexTypeCreator.scala
---
@@ -235,6 +235,86 @@ case class CreateMap(childr
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/21495
**[Test build #91541 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/91541/testReport)**
for PR 21495 at commit
[`f91d75a`](https://github.com/apache/spark/commit/f9
Github user dbtsai commented on the issue:
https://github.com/apache/spark/pull/21495
@som-snytt initialize it in `printWelcome` will not work since in order
version of Scala, `printWelcome` is the last one to be executed.
---
--
Github user kiszk commented on a diff in the pull request:
https://github.com/apache/spark/pull/21258#discussion_r193927508
--- Diff:
sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/complexTypeCreator.scala
---
@@ -235,6 +235,86 @@ case class CreateMap(childr
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21469
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/91535/
Test PASSed.
---
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21469
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional comma
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/21469
**[Test build #91535 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/91535/testReport)**
for PR 21469 at commit
[`3c80cad`](https://github.com/apache/spark/commit/3
Github user dbtsai commented on a diff in the pull request:
https://github.com/apache/spark/pull/21495#discussion_r193927042
--- Diff:
repl/scala-2.11/src/main/scala/org/apache/spark/repl/SparkILoopInterpreter.scala
---
@@ -21,8 +21,22 @@ import scala.collection.mutable
impor
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/21504
**[Test build #91540 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/91540/testReport)**
for PR 21504 at commit
[`02b2973`](https://github.com/apache/spark/commit/02
Github user arunmahadevan commented on a diff in the pull request:
https://github.com/apache/spark/pull/21504#discussion_r193923588
--- Diff:
sql/core/src/main/scala/org/apache/spark/sql/streaming/StreamingQueryManager.scala
---
@@ -55,6 +56,11 @@ class StreamingQueryManager priva
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21477
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional comma
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21477
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/testing-k8s-prb-make-spark-distribution/3839/
Tes
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/21477
**[Test build #91539 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/91539/testReport)**
for PR 21477 at commit
[`ecf3d88`](https://github.com/apache/spark/commit/ec
Github user vanzin commented on the issue:
https://github.com/apache/spark/pull/21402
> StreamRequest will not block the server netty handler thread.
Hmm, I'm not so sure that's accurate. I think the main difference is that I
don't think there is currently any code path that s
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21511
Can one of the admins verify this patch?
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user dongjoon-hyun commented on a diff in the pull request:
https://github.com/apache/spark/pull/21495#discussion_r193920472
--- Diff:
repl/scala-2.11/src/main/scala/org/apache/spark/repl/SparkILoopInterpreter.scala
---
@@ -21,8 +21,22 @@ import scala.collection.mutable
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21511
Can one of the admins verify this patch?
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
GitHub user alexmilowski opened a pull request:
https://github.com/apache/spark/pull/21511
[SPARK-24491][Kubernetes] Configuration support for requesting GPUs on k8s
## What changes were proposed in this pull request?
Configuration support for generating the GPU requests in
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21495
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional comma
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21495
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/testing-k8s-prb-make-spark-distribution/3838/
Tes
Github user dongjoon-hyun commented on a diff in the pull request:
https://github.com/apache/spark/pull/21495#discussion_r193919141
--- Diff:
repl/scala-2.11/src/main/scala/org/apache/spark/repl/SparkILoopInterpreter.scala
---
@@ -21,8 +21,22 @@ import scala.collection.mutable
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/21495
**[Test build #91538 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/91538/testReport)**
for PR 21495 at commit
[`de790fd`](https://github.com/apache/spark/commit/de
Github user dongjoon-hyun commented on the issue:
https://github.com/apache/spark/pull/21495
Retest this please.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: rev
Github user henryr commented on the issue:
https://github.com/apache/spark/pull/21482
I think consistency in Spark's naming convention (and therefore increased
discoverability by users) outweighs the advantage of naming it exactly for
the Impala equivalent. I do agree that multi
Github user ifilonenko commented on a diff in the pull request:
https://github.com/apache/spark/pull/21092#discussion_r193913624
--- Diff:
resource-managers/kubernetes/core/src/main/scala/org/apache/spark/deploy/k8s/Config.scala
---
@@ -154,6 +176,24 @@ private[spark] object Confi
Github user ifilonenko commented on the issue:
https://github.com/apache/spark/pull/21092
KubernetesSuite:
- Run SparkPi with no resources
- Run SparkPi with a very long application name.
- Run SparkPi with a master URL without a scheme.
- Run SparkPi with an argument.
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21109
Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/91534/
Test FAILed.
---
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21109
Build finished. Test FAILed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/21109
**[Test build #91534 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/91534/testReport)**
for PR 21109 at commit
[`3fa690f`](https://github.com/apache/spark/commit/3
Github user merlintang commented on a diff in the pull request:
https://github.com/apache/spark/pull/21504#discussion_r193911087
--- Diff:
sql/core/src/main/scala/org/apache/spark/sql/streaming/StreamingQueryManager.scala
---
@@ -55,6 +56,11 @@ class StreamingQueryManager private[
Github user rxin commented on the issue:
https://github.com/apache/spark/pull/21482
Thanks, Henry. In general I'm not a huge fan of adding something because
hypothetically somebody might want it. Also if you want this to be compatible
with Impala, wouldn't you want to name this the sa
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/21092
Kubernetes integration test status success
URL:
https://amplab.cs.berkeley.edu/jenkins/job/testing-k8s-prb-spark-integration/3694/
---
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/21092
Kubernetes integration test starting
URL:
https://amplab.cs.berkeley.edu/jenkins/job/testing-k8s-prb-spark-integration/3694/
---
--
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21092
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional comma
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21092
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/testing-k8s-prb-make-spark-distribution/3837/
Tes
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21510
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/testing-k8s-prb-make-spark-distribution/3836/
Tes
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21510
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional comma
Github user NihalHarish commented on a diff in the pull request:
https://github.com/apache/spark/pull/21482#discussion_r193902999
--- Diff: R/pkg/NAMESPACE ---
@@ -281,6 +281,8 @@ exportMethods("%<=>%",
"initcap",
"input_file_name",
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/21510
**[Test build #91536 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/91536/testReport)**
for PR 21510 at commit
[`58a9ec4`](https://github.com/apache/spark/commit/58
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/21092
**[Test build #91537 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/91537/testReport)**
for PR 21092 at commit
[`ab92913`](https://github.com/apache/spark/commit/ab
GitHub user jaceklaskowski opened a pull request:
https://github.com/apache/spark/pull/21510
[SPARK-24490][WebUI] Use WebUI.addStaticHandler in web UIs
`WebUI` defines `addStaticHandler` that web UIs don't use (and simply
introduce duplication). Let's clean them up and remove duplic
Github user henryr commented on a diff in the pull request:
https://github.com/apache/spark/pull/21482#discussion_r193898812
--- Diff: R/pkg/NAMESPACE ---
@@ -281,6 +281,8 @@ exportMethods("%<=>%",
"initcap",
"input_file_name",
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21504
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/91532/
Test PASSed.
---
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21504
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional comma
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/21504
**[Test build #91532 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/91532/testReport)**
for PR 21504 at commit
[`f721ebe`](https://github.com/apache/spark/commit/f
Github user BryanCutler commented on the issue:
https://github.com/apache/spark/pull/21483
Looks good to me, pending the above comments
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additiona
Github user henryr commented on the issue:
https://github.com/apache/spark/pull/21482
@rxin, that in itself is a bit weird, but there are ways to express inf
values in Scala and thus inf values can show up flowing through Spark plans.
I'm not sure MySQL has any such facility.
---
-
Github user kiszk commented on the issue:
https://github.com/apache/spark/pull/21507
@deepaksonu Would it be possible to close this PR?
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For addition
Github user merlintang commented on the issue:
https://github.com/apache/spark/pull/20823
@jmwdpk can you update this pr, since there is conflict. I have update this
pr. https://github.com/merlintang/spark/commits/SPARK-23674
---
-
Github user ueshin commented on a diff in the pull request:
https://github.com/apache/spark/pull/21155#discussion_r193895158
--- Diff:
sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/collectionOperations.scala
---
@@ -1468,3 +1472,388 @@ case class Flatten(ch
Github user HeartSaVioR commented on the issue:
https://github.com/apache/spark/pull/21500
@aalobaidi
One thing you may want to be aware is that in point of executor's view,
executor must load at least 1 version of state in memory regardless of caching
versions. I guess you may g
Github user tdas commented on a diff in the pull request:
https://github.com/apache/spark/pull/21477#discussion_r193892652
--- Diff: python/pyspark/sql/tests.py ---
@@ -1884,7 +1885,164 @@ def test_query_manager_await_termination(self):
finally:
q.stop(
Github user tdas commented on a diff in the pull request:
https://github.com/apache/spark/pull/21477#discussion_r193892565
--- Diff: python/pyspark/sql/streaming.py ---
@@ -843,6 +844,169 @@ def trigger(self, processingTime=None, once=None,
continuous=None):
self._jwri
Github user tdas commented on a diff in the pull request:
https://github.com/apache/spark/pull/21477#discussion_r193892571
--- Diff: python/pyspark/sql/streaming.py ---
@@ -843,6 +844,169 @@ def trigger(self, processingTime=None, once=None,
continuous=None):
self._jwri
Github user tdas commented on a diff in the pull request:
https://github.com/apache/spark/pull/21477#discussion_r193892514
--- Diff:
sql/core/src/main/scala/org/apache/spark/sql/execution/python/PythonForeachWriter.scala
---
@@ -0,0 +1,161 @@
+/*
+ * Licensed to the Apache
Github user tdas commented on a diff in the pull request:
https://github.com/apache/spark/pull/21477#discussion_r193892217
--- Diff: sql/core/src/main/scala/org/apache/spark/sql/ForeachWriter.scala
---
@@ -71,23 +110,17 @@ abstract class ForeachWriter[T] extends Serializable {
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21509
Can one of the admins verify this patch?
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21509
Can one of the admins verify this patch?
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
GitHub user shahidki31 opened a pull request:
https://github.com/apache/spark/pull/21509
Check for invalid input type of weight data in ml.PowerIterationClustering
## What changes were proposed in this pull request?
The test case will result the following failure. currently in ml
101 - 200 of 397 matches
Mail list logo
