Github user andrewor14 commented on the pull request:
https://github.com/apache/spark/pull/8710#issuecomment-220408309
Yes, unfortunately that is only available in the upcoming 2.0 so you will
have to upgrade to fix the problem.
---
If your project is set up for it, you can reply to
Github user zsxwing commented on the pull request:
https://github.com/apache/spark/pull/8710#issuecomment-220396923
@ljwagerfield it should be fixed in
https://github.com/apache/spark/pull/11586
---
If your project is set up for it, you can reply to this email and have your
reply
Github user ljwagerfield commented on the pull request:
https://github.com/apache/spark/pull/8710#issuecomment-220395710
We're seeing this exception too. We're also running our operations in
serial (at least on the surface it seems as if we are). If we execute a
`df.save` operation
Github user zsxwing commented on the pull request:
https://github.com/apache/spark/pull/8710#issuecomment-210541878
@d-ee do you have a reproducer? Let's move the discussion to JIRA instead
of here.
---
If your project is set up for it, you can reply to this email and have your
Github user d-ee commented on the pull request:
https://github.com/apache/spark/pull/8710#issuecomment-210439407
This still seems to be around.
We're using Spark 1.5.2.
java.lang.IllegalArgumentException: "spark.sql.execution.id is already set"
Trace:
Github user nicerobot commented on the pull request:
https://github.com/apache/spark/pull/8710#issuecomment-193436138
We are still experiencing this. See
[SPARK-10548](https://issues.apache.org/jira/browse/SPARK-10548).
I've verified that we are indeed using a version of
Github user andrewor14 commented on the pull request:
https://github.com/apache/spark/pull/8710#issuecomment-140582020
Thanks, I'm merging this into master.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project
Github user andrewor14 commented on the pull request:
https://github.com/apache/spark/pull/8721#issuecomment-140582042
Merging into 1.5.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this
Github user andrewor14 closed the pull request at:
https://github.com/apache/spark/pull/8721
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is
Github user asfgit closed the pull request at:
https://github.com/apache/spark/pull/8710
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is
Github user AmplabJenkins commented on the pull request:
https://github.com/apache/spark/pull/8710#issuecomment-140202638
Merged build triggered.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not
Github user AmplabJenkins commented on the pull request:
https://github.com/apache/spark/pull/8710#issuecomment-140202665
Merged build started.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not
Github user AmplabJenkins commented on the pull request:
https://github.com/apache/spark/pull/8710#issuecomment-140210442
Merged build started.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not
Github user AmplabJenkins commented on the pull request:
https://github.com/apache/spark/pull/8721#issuecomment-140210421
Merged build triggered.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not
Github user andrewor14 commented on the pull request:
https://github.com/apache/spark/pull/8710#issuecomment-140203217
> If there is no execution id in the local properties when creating a child
thread and we change it to clone the properties, then the child thread won't
see the
Github user andrewor14 commented on the pull request:
https://github.com/apache/spark/pull/8710#issuecomment-140210223
@zsxwing Alright I have updated it. Please have another look. I also
updated the one for branch-1.5 (#8721), which has all of the changes here
except the new
Github user SparkQA commented on the pull request:
https://github.com/apache/spark/pull/8710#issuecomment-140235733
[Test build #42447 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/42447/console)
for PR 8710 at commit
Github user AmplabJenkins commented on the pull request:
https://github.com/apache/spark/pull/8710#issuecomment-140235788
Merged build finished. Test FAILed.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your
Github user AmplabJenkins commented on the pull request:
https://github.com/apache/spark/pull/8721#issuecomment-140209433
Merged build triggered.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not
Github user SparkQA commented on the pull request:
https://github.com/apache/spark/pull/8721#issuecomment-140211097
[Test build #42446 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/42446/consoleFull)
for PR 8721 at commit
Github user SparkQA commented on the pull request:
https://github.com/apache/spark/pull/8710#issuecomment-140221863
[Test build #42452 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/42452/consoleFull)
for PR 8710 at commit
Github user SparkQA commented on the pull request:
https://github.com/apache/spark/pull/8710#issuecomment-140233081
[Test build #42441 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/42441/console)
for PR 8710 at commit
Github user AmplabJenkins commented on the pull request:
https://github.com/apache/spark/pull/8710#issuecomment-140233125
Merged build finished. Test FAILed.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your
Github user AmplabJenkins commented on the pull request:
https://github.com/apache/spark/pull/8710#issuecomment-140233126
Test FAILed.
Refer to this link for build results (access rights to CI server needed):
Github user SparkQA commented on the pull request:
https://github.com/apache/spark/pull/8721#issuecomment-140223287
[Test build #42453 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/42453/consoleFull)
for PR 8721 at commit
Github user AmplabJenkins commented on the pull request:
https://github.com/apache/spark/pull/8710#issuecomment-140235789
Test FAILed.
Refer to this link for build results (access rights to CI server needed):
Github user SparkQA commented on the pull request:
https://github.com/apache/spark/pull/8710#issuecomment-140204367
[Test build #42441 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/42441/consoleFull)
for PR 8710 at commit
Github user SparkQA commented on the pull request:
https://github.com/apache/spark/pull/8721#issuecomment-140209640
[Test build #42445 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/42445/consoleFull)
for PR 8721 at commit
Github user AmplabJenkins commented on the pull request:
https://github.com/apache/spark/pull/8710#issuecomment-140210426
Merged build triggered.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not
Github user AmplabJenkins commented on the pull request:
https://github.com/apache/spark/pull/8721#issuecomment-140222681
Merged build started.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not
Github user AmplabJenkins commented on the pull request:
https://github.com/apache/spark/pull/8721#issuecomment-140222613
Merged build triggered.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not
Github user AmplabJenkins commented on the pull request:
https://github.com/apache/spark/pull/8710#issuecomment-140221309
Merged build started.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not
Github user AmplabJenkins commented on the pull request:
https://github.com/apache/spark/pull/8710#issuecomment-140221278
Merged build triggered.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not
Github user AmplabJenkins commented on the pull request:
https://github.com/apache/spark/pull/8721#issuecomment-140209454
Merged build started.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not
Github user AmplabJenkins commented on the pull request:
https://github.com/apache/spark/pull/8721#issuecomment-140237497
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
Github user AmplabJenkins commented on the pull request:
https://github.com/apache/spark/pull/8721#issuecomment-140237496
Merged build finished. Test PASSed.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your
Github user SparkQA commented on the pull request:
https://github.com/apache/spark/pull/8721#issuecomment-140237306
[Test build #42445 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/42445/console)
for PR 8721 at commit
Github user SparkQA commented on the pull request:
https://github.com/apache/spark/pull/8710#issuecomment-140241253
[Test build #1751 has
started](https://amplab.cs.berkeley.edu/jenkins/job/NewSparkPullRequestBuilder/1751/consoleFull)
for PR 8710 at commit
Github user SparkQA commented on the pull request:
https://github.com/apache/spark/pull/8710#issuecomment-140241529
[Test build #1753 has
started](https://amplab.cs.berkeley.edu/jenkins/job/NewSparkPullRequestBuilder/1753/consoleFull)
for PR 8710 at commit
Github user AmplabJenkins commented on the pull request:
https://github.com/apache/spark/pull/8710#issuecomment-140242351
Test FAILed.
Refer to this link for build results (access rights to CI server needed):
Github user SparkQA commented on the pull request:
https://github.com/apache/spark/pull/8721#issuecomment-140262732
[Test build #1749 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/NewSparkPullRequestBuilder/1749/console)
for PR 8721 at commit
Github user SparkQA commented on the pull request:
https://github.com/apache/spark/pull/8721#issuecomment-140240965
[Test build #1750 has
started](https://amplab.cs.berkeley.edu/jenkins/job/NewSparkPullRequestBuilder/1750/consoleFull)
for PR 8721 at commit
Github user SparkQA commented on the pull request:
https://github.com/apache/spark/pull/8710#issuecomment-140241862
[Test build #1752 has
started](https://amplab.cs.berkeley.edu/jenkins/job/NewSparkPullRequestBuilder/1752/consoleFull)
for PR 8710 at commit
Github user SparkQA commented on the pull request:
https://github.com/apache/spark/pull/8721#issuecomment-140262613
[Test build #1750 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/NewSparkPullRequestBuilder/1750/console)
for PR 8721 at commit
Github user SparkQA commented on the pull request:
https://github.com/apache/spark/pull/8710#issuecomment-140242310
[Test build #42452 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/42452/console)
for PR 8710 at commit
Github user AmplabJenkins commented on the pull request:
https://github.com/apache/spark/pull/8710#issuecomment-140242350
Merged build finished. Test FAILed.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your
Github user SparkQA commented on the pull request:
https://github.com/apache/spark/pull/8710#issuecomment-140263014
[Test build #1751 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/NewSparkPullRequestBuilder/1751/console)
for PR 8710 at commit
Github user zsxwing commented on the pull request:
https://github.com/apache/spark/pull/8721#issuecomment-140283474
LGTM
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled
Github user zsxwing commented on the pull request:
https://github.com/apache/spark/pull/8710#issuecomment-140283134
LGTM
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled
Github user AmplabJenkins commented on the pull request:
https://github.com/apache/spark/pull/8721#issuecomment-140240598
Test FAILed.
Refer to this link for build results (access rights to CI server needed):
Github user AmplabJenkins commented on the pull request:
https://github.com/apache/spark/pull/8721#issuecomment-140240596
Merged build finished. Test FAILed.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your
Github user SparkQA commented on the pull request:
https://github.com/apache/spark/pull/8721#issuecomment-140240535
**[Test build #42446 timed
out](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/42446/console)**
for PR 8721 at commit
Github user SparkQA commented on the pull request:
https://github.com/apache/spark/pull/8710#issuecomment-140262892
[Test build #1753 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/NewSparkPullRequestBuilder/1753/console)
for PR 8710 at commit
Github user SparkQA commented on the pull request:
https://github.com/apache/spark/pull/8710#issuecomment-140267623
[Test build #1752 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/NewSparkPullRequestBuilder/1752/console)
for PR 8710 at commit
Github user SparkQA commented on the pull request:
https://github.com/apache/spark/pull/8721#issuecomment-140240940
[Test build #1749 has
started](https://amplab.cs.berkeley.edu/jenkins/job/NewSparkPullRequestBuilder/1749/consoleFull)
for PR 8721 at commit
Github user SparkQA commented on the pull request:
https://github.com/apache/spark/pull/8721#issuecomment-140244932
[Test build #42453 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/42453/console)
for PR 8721 at commit
Github user AmplabJenkins commented on the pull request:
https://github.com/apache/spark/pull/8721#issuecomment-140245004
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
Github user AmplabJenkins commented on the pull request:
https://github.com/apache/spark/pull/8721#issuecomment-140245002
Merged build finished. Test PASSed.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your
Github user AmplabJenkins commented on the pull request:
https://github.com/apache/spark/pull/8721#issuecomment-140210441
Merged build started.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not
Github user SparkQA commented on the pull request:
https://github.com/apache/spark/pull/8710#issuecomment-140210859
[Test build #42447 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/42447/consoleFull)
for PR 8710 at commit
Github user zsxwing commented on the pull request:
https://github.com/apache/spark/pull/8710#issuecomment-139849953
> the execution ID is passed directly to the child thread
I believe that this is not the cause of `SPARK-10548`. The cause of
`SPARK-10548` is the child thread
Github user andrewor14 commented on the pull request:
https://github.com/apache/spark/pull/8710#issuecomment-139848194
@zsxwing I just noticed a potential source of confusion. If I understand
correctly your view is that we should just clone the properties instead of
having the
Github user andrewor14 commented on a diff in the pull request:
https://github.com/apache/spark/pull/8710#discussion_r39345043
--- Diff: core/src/main/scala/org/apache/spark/SparkContext.scala ---
@@ -348,10 +348,24 @@ class SparkContext(config: SparkConf) extends Logging
with
Github user andrewor14 commented on a diff in the pull request:
https://github.com/apache/spark/pull/8710#discussion_r39345154
--- Diff: core/src/main/scala/org/apache/spark/SparkContext.scala ---
@@ -348,10 +348,24 @@ class SparkContext(config: SparkConf) extends Logging
with
Github user AmplabJenkins commented on the pull request:
https://github.com/apache/spark/pull/8710#issuecomment-139848070
Merged build triggered.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not
Github user AmplabJenkins commented on the pull request:
https://github.com/apache/spark/pull/8710#issuecomment-139891837
Merged build started.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not
Github user SparkQA commented on the pull request:
https://github.com/apache/spark/pull/8710#issuecomment-139892400
[Test build #42379 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/42379/consoleFull)
for PR 8710 at commit
Github user AmplabJenkins commented on the pull request:
https://github.com/apache/spark/pull/8710#issuecomment-139910837
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
Github user AmplabJenkins commented on the pull request:
https://github.com/apache/spark/pull/8710#issuecomment-139910836
Merged build finished. Test PASSed.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your
Github user SparkQA commented on the pull request:
https://github.com/apache/spark/pull/8710#issuecomment-139910807
[Test build #42379 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/42379/console)
for PR 8710 at commit
Github user zsxwing commented on a diff in the pull request:
https://github.com/apache/spark/pull/8710#discussion_r39337844
--- Diff: core/src/main/scala/org/apache/spark/SparkContext.scala ---
@@ -348,10 +348,24 @@ class SparkContext(config: SparkConf) extends Logging
with
Github user SparkQA commented on the pull request:
https://github.com/apache/spark/pull/8710#issuecomment-139614917
[Test build #42342 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/42342/consoleFull)
for PR 8710 at commit
Github user andrewor14 commented on the pull request:
https://github.com/apache/spark/pull/8710#issuecomment-139655823
retest this please
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this
Github user AmplabJenkins commented on the pull request:
https://github.com/apache/spark/pull/8710#issuecomment-139656159
Merged build started.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not
Github user AmplabJenkins commented on the pull request:
https://github.com/apache/spark/pull/8710#issuecomment-139656140
Merged build triggered.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not
Github user SparkQA commented on the pull request:
https://github.com/apache/spark/pull/8710#issuecomment-139657519
[Test build #42342 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/42342/console)
for PR 8710 at commit
Github user AmplabJenkins commented on the pull request:
https://github.com/apache/spark/pull/8710#issuecomment-139657637
Merged build finished. Test PASSed.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your
Github user SparkQA commented on the pull request:
https://github.com/apache/spark/pull/8710#issuecomment-139656574
[Test build #42357 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/42357/consoleFull)
for PR 8710 at commit
Github user AmplabJenkins commented on the pull request:
https://github.com/apache/spark/pull/8710#issuecomment-139657638
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
Github user AmplabJenkins commented on the pull request:
https://github.com/apache/spark/pull/8710#issuecomment-139683718
Merged build finished. Test FAILed.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your
Github user SparkQA commented on the pull request:
https://github.com/apache/spark/pull/8710#issuecomment-139683670
[Test build #42357 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/42357/console)
for PR 8710 at commit
Github user AmplabJenkins commented on the pull request:
https://github.com/apache/spark/pull/8710#issuecomment-139683720
Test FAILed.
Refer to this link for build results (access rights to CI server needed):
Github user AmplabJenkins commented on the pull request:
https://github.com/apache/spark/pull/8710#issuecomment-139613307
Merged build triggered.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not
Github user AmplabJenkins commented on the pull request:
https://github.com/apache/spark/pull/8710#issuecomment-139613347
Merged build started.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not
Github user andrewor14 commented on the pull request:
https://github.com/apache/spark/pull/8710#issuecomment-139613452
As of the latest commit this patch should only be merged into master. I
consider the fix for SPARK-10563 a little too risky for 1.5.1, so I will open a
separate
Github user AmplabJenkins commented on the pull request:
https://github.com/apache/spark/pull/8710#issuecomment-139688084
Merged build started.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not
Github user AmplabJenkins commented on the pull request:
https://github.com/apache/spark/pull/8710#issuecomment-139688072
Merged build triggered.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not
Github user SparkQA commented on the pull request:
https://github.com/apache/spark/pull/8710#issuecomment-139689485
[Test build #42361 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/42361/consoleFull)
for PR 8710 at commit
Github user AmplabJenkins commented on the pull request:
https://github.com/apache/spark/pull/8710#issuecomment-139703821
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
Github user AmplabJenkins commented on the pull request:
https://github.com/apache/spark/pull/8710#issuecomment-139703819
Merged build finished. Test PASSed.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your
Github user SparkQA commented on the pull request:
https://github.com/apache/spark/pull/8710#issuecomment-139703794
[Test build #42361 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/42361/console)
for PR 8710 at commit
91 matches
Mail list logo