Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/14275
**[Test build #62840 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/62840/consoleFull)**
for PR 14275 at commit
Github user mgummelt commented on a diff in the pull request:
https://github.com/apache/spark/pull/14275#discussion_r72141303
--- Diff:
core/src/main/scala/org/apache/spark/scheduler/cluster/mesos/MesosSchedulerBackendUtil.scala
---
@@ -105,16 +105,27 @@ private[mesos] object
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/14350
**[Test build #62838 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/62838/consoleFull)**
for PR 14350 at commit
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/14349
**[Test build #62839 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/62839/consoleFull)**
for PR 14349 at commit
GitHub user zsxwing opened a pull request:
https://github.com/apache/spark/pull/14350
[SPARK-16715][Tests]Fix a potential ExprId conflict for
SubexpressionEliminationSuite."Semantic equals and hash"
## What changes were proposed in this pull request?
Github user ooq commented on the issue:
https://github.com/apache/spark/pull/14349
This PR is a cleaner version for 14174:
https://github.com/apache/spark/pull/14174.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If
Github user ooq commented on the issue:
https://github.com/apache/spark/pull/14174
Closing this now. Open another PR for cleaner commit history:
https://github.com/apache/spark/pull/14349
---
If your project is set up for it, you can reply to this email and have your
reply appear on
Github user ooq closed the pull request at:
https://github.com/apache/spark/pull/14174
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/14132
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/62832/
Test PASSed.
---
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/14132
Merged build finished. Test PASSed.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
GitHub user ooq opened a pull request:
https://github.com/apache/spark/pull/14349
[SPARK-16524][SQL] Add RowBatch and RowBasedHashMapGenerator
## What changes were proposed in this pull request?
This PR is the first step for the following feature:
For hash
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/14132
**[Test build #62832 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/62832/consoleFull)**
for PR 14132 at commit
Github user thunterdb commented on a diff in the pull request:
https://github.com/apache/spark/pull/14298#discussion_r72137984
--- Diff:
sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/aggregate/PercentileApprox.scala
---
@@ -0,0 +1,456 @@
+/*
+ *
Github user jaceklaskowski commented on a diff in the pull request:
https://github.com/apache/spark/pull/14292#discussion_r72137376
--- Diff:
sql/core/src/main/scala/org/apache/spark/sql/execution/streaming/StreamExecution.scala
---
@@ -269,19 +273,11 @@ class StreamExecution(
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/14348
Can one of the admins verify this patch?
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/14309
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/62831/
Test PASSed.
---
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/14309
Merged build finished. Test PASSed.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/14309
**[Test build #62831 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/62831/consoleFull)**
for PR 14309 at commit
GitHub user philipphoffmann opened a pull request:
https://github.com/apache/spark/pull/14348
[SPARK-15271] [MESOS] Allow force pulling executor docker images
## What changes were proposed in this pull request?
(Please fill in changes proposed in this fix)
##
Github user philipphoffmann commented on the issue:
https://github.com/apache/spark/pull/13051
fixed the above issue and sent another request here: #14348
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/13920
**[Test build #62837 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/62837/consoleFull)**
for PR 13920 at commit
Github user JoshRosen commented on the issue:
https://github.com/apache/spark/pull/13920
Jenkins, retest this please.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/14174
**[Test build #62836 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/62836/consoleFull)**
for PR 14174 at commit
Github user vanzin commented on a diff in the pull request:
https://github.com/apache/spark/pull/14270#discussion_r72131840
--- Diff:
core/src/main/scala/org/apache/spark/internal/config/package.scala ---
@@ -103,4 +103,9 @@ package object config {
.stringConf
Github user gatorsmile commented on a diff in the pull request:
https://github.com/apache/spark/pull/14297#discussion_r72131816
--- Diff:
sql/core/src/main/scala/org/apache/spark/sql/execution/command/views.scala ---
@@ -44,7 +50,11 @@ import
Github user srowen commented on the issue:
https://github.com/apache/spark/pull/13051
Shoot, yeah PR builder tests passed, but that was 7 days ago. Sorry
@philipphoffmann can you try this one again after figuring out whatever caused
this?
---
If your project is set up for it, you
Github user piffall closed the pull request at:
https://github.com/apache/spark/pull/14345
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is
Github user piffall commented on the issue:
https://github.com/apache/spark/pull/14345
Ok. Thanks.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/14257
Merged build finished. Test PASSed.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
Github user JoshRosen commented on the issue:
https://github.com/apache/spark/pull/13051
This patch just broke the build:
```
[error]
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/14257
**[Test build #62829 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/62829/consoleFull)**
for PR 14257 at commit
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/14257
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/62829/
Test PASSed.
---
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/14292
**[Test build #62835 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/62835/consoleFull)**
for PR 14292 at commit
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/14292
Merged build finished. Test FAILed.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/14292
Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/62835/
Test FAILed.
---
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/13571
Merged build finished. Test FAILed.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/13571
**[Test build #62834 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/62834/consoleFull)**
for PR 13571 at commit
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/13571
Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/62834/
Test FAILed.
---
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/13886
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/62827/
Test PASSed.
---
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/13886
Merged build finished. Test PASSed.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/13886
**[Test build #62827 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/62827/consoleFull)**
for PR 13886 at commit
Github user asfgit closed the pull request at:
https://github.com/apache/spark/pull/14194
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/14292
**[Test build #62835 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/62835/consoleFull)**
for PR 14292 at commit
Github user srowen commented on the issue:
https://github.com/apache/spark/pull/14194
Merged to master/2.0 to match original change
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/14194
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/62833/
Test PASSed.
---
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/14194
Merged build finished. Test PASSed.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/14194
**[Test build #62833 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/62833/consoleFull)**
for PR 14194 at commit
Github user felixcheung commented on a diff in the pull request:
https://github.com/apache/spark/pull/14309#discussion_r72127680
--- Diff: sql/core/src/test/scala/org/apache/spark/sql/DataFrameSuite.scala
---
@@ -896,6 +896,19 @@ class DataFrameSuite extends QueryTest with
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/13571
**[Test build #62834 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/62834/consoleFull)**
for PR 13571 at commit
Github user tdas commented on a diff in the pull request:
https://github.com/apache/spark/pull/14292#discussion_r72127350
--- Diff:
sql/core/src/main/scala/org/apache/spark/sql/execution/streaming/HDFSMetadataLog.scala
---
@@ -91,18 +92,30 @@ class HDFSMetadataLog[T:
Github user tdas commented on a diff in the pull request:
https://github.com/apache/spark/pull/14292#discussion_r72127293
--- Diff:
sql/core/src/main/scala/org/apache/spark/sql/execution/streaming/StreamExecution.scala
---
@@ -269,19 +273,11 @@ class StreamExecution(
*
Github user srowen commented on the issue:
https://github.com/apache/spark/pull/14333
OK sounds good. So maybe we're back to this: for `bcNewCenters`, is it
really worth the overhead to track and destroy them? or just settle for
unpersisting within the loop? I could go either way,
Github user srowen commented on the issue:
https://github.com/apache/spark/pull/14275
Looks like one more last comment, and needs a rebase after
https://github.com/apache/spark/pull/13051
---
If your project is set up for it, you can reply to this email and have your
reply appear on
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/14307
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/62828/
Test PASSed.
---
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/14307
Merged build finished. Test PASSed.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
Github user tdas commented on a diff in the pull request:
https://github.com/apache/spark/pull/14292#discussion_r72126474
--- Diff:
sql/core/src/test/scala/org/apache/spark/sql/test/SQLTestUtils.scala ---
@@ -247,6 +248,46 @@ private[sql] trait SQLTestUtils
}
}
Github user asfgit closed the pull request at:
https://github.com/apache/spark/pull/13051
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/14307
**[Test build #62828 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/62828/consoleFull)**
for PR 14307 at commit
Github user srowen commented on the issue:
https://github.com/apache/spark/pull/13051
Merged to master
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or
Github user rxin commented on the issue:
https://github.com/apache/spark/pull/14345
So I'm tempted to say no to this API addition because once we want to do
things like this, we should really rely on an optimizer to push things
automatically, which is the point for SQL and the
Github user rxin commented on the issue:
https://github.com/apache/spark/pull/14257
cc @liancheng
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if
Github user tdas commented on a diff in the pull request:
https://github.com/apache/spark/pull/14292#discussion_r72125645
--- Diff:
sql/core/src/main/scala/org/apache/spark/sql/execution/streaming/HDFSMetadataLog.scala
---
@@ -91,18 +92,30 @@ class HDFSMetadataLog[T:
Github user tdas commented on a diff in the pull request:
https://github.com/apache/spark/pull/14292#discussion_r72125535
--- Diff:
sql/core/src/main/scala/org/apache/spark/sql/execution/streaming/HDFSMetadataLog.scala
---
@@ -91,18 +92,30 @@ class HDFSMetadataLog[T:
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/13758
Merged build finished. Test PASSed.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/13758
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/62826/
Test PASSed.
---
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/13758
**[Test build #62826 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/62826/consoleFull)**
for PR 13758 at commit
Github user koeninger commented on a diff in the pull request:
https://github.com/apache/spark/pull/14340#discussion_r72123421
--- Diff: python/pyspark/streaming/kafka010.py ---
@@ -0,0 +1,370 @@
+#
+# Licensed to the Apache Software Foundation (ASF) under one or more
Github user asfgit closed the pull request at:
https://github.com/apache/spark/pull/14342
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is
Github user koeninger commented on the issue:
https://github.com/apache/spark/pull/14340
In terms of feature parity, are we OK with telling python users they are
out of luck if they need something not covered by Assign / Subscribe /
SubscribePattern? For scala / java users they can
Github user srowen commented on the issue:
https://github.com/apache/spark/pull/14342
Merged to master
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or
Github user shivaram commented on the issue:
https://github.com/apache/spark/pull/14330
Yeah lets discuss this on JIRA / mailing lists and then get back to this
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your
Github user asfgit closed the pull request at:
https://github.com/apache/spark/pull/14286
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/14194
**[Test build #62833 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/62833/consoleFull)**
for PR 14194 at commit
Github user srowen commented on the issue:
https://github.com/apache/spark/pull/14194
Jenkins test this please
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes
Github user srowen commented on the issue:
https://github.com/apache/spark/pull/14286
Merged to master
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or
Github user KevinGrealish commented on the issue:
https://github.com/apache/spark/pull/13824
@vanzin the function setupLaunchEnv reads env vars directly using
sys.env.get so I don't understand how SparkConf helps you setup values for this
function to read. See my earlier link to
Github user JoshRosen commented on the issue:
https://github.com/apache/spark/pull/13920
Sorry for the delay in reviewing; I've been super busy and stuff has
slipped through the cracks. LGTM because this looks like a net improvement over
what we have today. In the longer term I think
Github user koeninger commented on a diff in the pull request:
https://github.com/apache/spark/pull/14340#discussion_r72122440
--- Diff: python/pyspark/streaming/kafka010.py ---
@@ -0,0 +1,370 @@
+#
+# Licensed to the Apache Software Foundation (ASF) under one or more
Github user koeninger commented on a diff in the pull request:
https://github.com/apache/spark/pull/14340#discussion_r72122274
--- Diff: python/pyspark/streaming/kafka010.py ---
@@ -0,0 +1,370 @@
+#
+# Licensed to the Apache Software Foundation (ASF) under one or more
Github user vanzin commented on the issue:
https://github.com/apache/spark/pull/13824
You could change that code to use `sparkConf.getenv`, since there's a
SparkConf instance available.
---
If your project is set up for it, you can reply to this email and have your
reply appear on
Github user zsxwing commented on a diff in the pull request:
https://github.com/apache/spark/pull/13620#discussion_r72121948
--- Diff: core/src/main/scala/org/apache/spark/ui/jobs/AllJobsPage.scala ---
@@ -210,64 +214,69 @@ private[ui] class AllJobsPage(parent: JobsTab)
extends
Github user koeninger commented on a diff in the pull request:
https://github.com/apache/spark/pull/14340#discussion_r72121957
--- Diff: python/pyspark/streaming/kafka010.py ---
@@ -0,0 +1,370 @@
+#
+# Licensed to the Apache Software Foundation (ASF) under one or more
Github user JoshRosen commented on a diff in the pull request:
https://github.com/apache/spark/pull/14204#discussion_r72121585
--- Diff: core/src/main/scala/org/apache/spark/util/JsonProtocol.scala ---
@@ -934,7 +935,8 @@ private[spark] object JsonProtocol {
val
Github user JoshRosen commented on a diff in the pull request:
https://github.com/apache/spark/pull/14204#discussion_r72121393
--- Diff:
core/src/main/scala/org/apache/spark/scheduler/cluster/ExecutorData.scala ---
@@ -34,5 +34,6 @@ private[cluster] class ExecutorData(
Github user koeninger commented on a diff in the pull request:
https://github.com/apache/spark/pull/14340#discussion_r72120535
--- Diff:
external/kafka-0-10/src/main/scala/org/apache/spark/streaming/kafka010/KafkaUtils.scala
---
@@ -177,3 +182,172 @@ object KafkaUtils extends
Github user srowen commented on the issue:
https://github.com/apache/spark/pull/14347
@jayunit100 this whole directory is about to be deleted anyway, so I think
this is redundant.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/12374
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/62830/
Test PASSed.
---
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/12374
Merged build finished. Test PASSed.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/12374
**[Test build #62830 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/62830/consoleFull)**
for PR 12374 at commit
Github user koeninger commented on a diff in the pull request:
https://github.com/apache/spark/pull/14340#discussion_r72118143
--- Diff:
external/kafka-0-10/src/main/scala/org/apache/spark/streaming/kafka010/KafkaUtils.scala
---
@@ -177,3 +182,172 @@ object KafkaUtils extends
Github user JoshRosen commented on the issue:
https://github.com/apache/spark/pull/14311
@ericl, these test failures appear legitimate.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this
Github user asfgit closed the pull request at:
https://github.com/apache/spark/pull/14329
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/14132
**[Test build #62832 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/62832/consoleFull)**
for PR 14132 at commit
Github user shivaram commented on the issue:
https://github.com/apache/spark/pull/14329
Thanks @felixcheung - LGTM. Merging this to master, branch-2.0
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/14309
**[Test build #62831 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/62831/consoleFull)**
for PR 14309 at commit
Github user kiszk commented on a diff in the pull request:
https://github.com/apache/spark/pull/13704#discussion_r72116259
--- Diff:
sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/optimizer/Optimizer.scala
---
@@ -1441,6 +1441,12 @@ object PushPredicateThroughJoin
Github user piffall commented on the issue:
https://github.com/apache/spark/pull/14345
```scala
val rdd1 = sc.parallelize(1 to 10)
val rdd2 = sc.parallelize(1 to 10)
val countCartesian = rdd1.cartesian(rdd2).filter(x => x._1 == x._2).count()
val
Github user koeninger commented on a diff in the pull request:
https://github.com/apache/spark/pull/14340#discussion_r72115899
--- Diff: examples/src/main/python/streaming/direct_kafka010_wordcount.py
---
@@ -0,0 +1,59 @@
+#
+# Licensed to the Apache Software Foundation
Github user shivaram commented on the issue:
https://github.com/apache/spark/pull/14309
Jenkins, ok to test
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes
Github user dongjoon-hyun commented on a diff in the pull request:
https://github.com/apache/spark/pull/14132#discussion_r72114534
--- Diff:
sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/analysis/Analyzer.scala
---
@@ -1774,6 +1775,49 @@ class Analyzer(
}
301 - 400 of 699 matches
Mail list logo
