[GitHub] spark pull request: [SPARK-5006][Deploy]spark.port.maxRetries does...

2015-01-12 Thread andrewor14
Github user andrewor14 commented on the pull request: https://github.com/apache/spark/pull/3841#issuecomment-69660257 @WangTaoTheTonic this looks much better than before. My new comments are fairly minor. --- If your project is set up for it, you can reply to this email and have

[GitHub] spark pull request: [SPARK-4296][SQL] Trims aliases when resolving...

2015-01-12 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/4010#issuecomment-69660815 [Test build #25431 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/25431/consoleFull) for PR 4010 at commit

[GitHub] spark pull request: [SPARK-4667] fix spillable memory acquisition ...

2015-01-12 Thread ryan-williams
Github user ryan-williams commented on the pull request: https://github.com/apache/spark/pull/3524#issuecomment-69660930 closed the JIRA as well, thanks for the bump @andrewor14 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as

[GitHub] spark pull request: [SPARK-4667] fix spillable memory acquisition ...

2015-01-12 Thread ryan-williams
Github user ryan-williams closed the pull request at: https://github.com/apache/spark/pull/3524 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature

[GitHub] spark pull request: [SPARK-4667] fix spillable memory acquisition ...

2015-01-12 Thread ryan-williams
Github user ryan-williams commented on the pull request: https://github.com/apache/spark/pull/3524#issuecomment-69660790 I think my initial understanding was just mistaken here so I'll just close this, don't know if it's worth futzing with the comment --- If your project is set up

[GitHub] spark pull request: SPARK-3996: Shade Jetty in Spark deliverables.

2015-01-12 Thread mccheah
Github user mccheah commented on the pull request: https://github.com/apache/spark/pull/3130#issuecomment-69662311 Hi, I was wondering if this is still being updated? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as

[GitHub] spark pull request: [SPARK-4014] Add TaskContext.attemptNumber and...

2015-01-12 Thread tnachen
Github user tnachen commented on a diff in the pull request: https://github.com/apache/spark/pull/3849#discussion_r22829776 --- Diff: core/src/main/scala/org/apache/spark/scheduler/cluster/mesos/MesosSchedulerBackend.scala --- @@ -290,13 +291,22 @@ private[spark] class

[GitHub] spark pull request: [SPARK-4348] [SPARK-4821] Backport PySpark ran...

2015-01-12 Thread JoshRosen
Github user JoshRosen commented on the pull request: https://github.com/apache/spark/pull/4011#issuecomment-69662999 /cc @davies @jkbradley --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

[GitHub] spark pull request: [SPARK-4348] [SPARK-4821] Backport PySpark ran...

2015-01-12 Thread JoshRosen
GitHub user JoshRosen opened a pull request: https://github.com/apache/spark/pull/4011 [SPARK-4348] [SPARK-4821] Backport PySpark random.py - rand.py fix to branch-1.1 This backports #3216 and #3669 to `branch-1.1` in order to fix the PySpark unit tests. You can merge this pull

[GitHub] spark pull request: [SPARK-4348] [SPARK-4821] Backport PySpark ran...

2015-01-12 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/4011#issuecomment-69663208 [QA tests have started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/25432/consoleFull) for PR 4011 at commit

[GitHub] spark pull request: [SPARK-4014] Add TaskContext.attemptNumber and...

2015-01-12 Thread JoshRosen
Github user JoshRosen commented on a diff in the pull request: https://github.com/apache/spark/pull/3849#discussion_r22830201 --- Diff: core/src/main/scala/org/apache/spark/scheduler/cluster/mesos/MesosSchedulerBackend.scala --- @@ -290,13 +291,22 @@ private[spark] class

[GitHub] spark pull request: [SPARK-4296][SQL] Trims aliases when resolving...

2015-01-12 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/4010#issuecomment-69663741 [Test build #25430 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/25430/consoleFull) for PR 4010 at commit

[GitHub] spark pull request: [SPARK-4296][SQL] Trims aliases when resolving...

2015-01-12 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/4010#issuecomment-69663749 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] spark pull request: [SPARK-4348] [SPARK-4821] Backport PySpark ran...

2015-01-12 Thread davies
Github user davies commented on the pull request: https://github.com/apache/spark/pull/4011#issuecomment-69664454 LGTM, thanks! --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark pull request: [SPARK-5063] Useful error messages for nested ...

2015-01-12 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/3884#issuecomment-69664661 [Test build #25433 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/25433/consoleFull) for PR 3884 at commit

[GitHub] spark pull request: [SPARK-4348] [SPARK-4821] Backport PySpark ran...

2015-01-12 Thread andrewor14
Github user andrewor14 commented on the pull request: https://github.com/apache/spark/pull/4011#issuecomment-6902 Yay! --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark pull request: [SPARK-4296][SQL] Trims aliases when resolving...

2015-01-12 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/4010#issuecomment-69669785 [Test build #25431 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/25431/consoleFull) for PR 4010 at commit

[GitHub] spark pull request: [SPARK-4296][SQL] Trims aliases when resolving...

2015-01-12 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/4010#issuecomment-69669791 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] spark pull request: [SPARK-4912][SQL] Persistent tables for the Sp...

2015-01-12 Thread rxin
Github user rxin commented on a diff in the pull request: https://github.com/apache/spark/pull/3960#discussion_r22834708 --- Diff: sql/hive/src/test/scala/org/apache/spark/sql/hive/MetastoreDataSourcesSuite.scala --- @@ -0,0 +1,241 @@ +/* + * Licensed to the Apache

[GitHub] spark pull request: [SPARK-4912][SQL] Persistent tables for the Sp...

2015-01-12 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/3960#issuecomment-69676512 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] spark pull request: [SPARK-4912][SQL] Persistent tables for the Sp...

2015-01-12 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/3960#issuecomment-69676506 [Test build #25435 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/25435/consoleFull) for PR 3960 at commit

[GitHub] spark pull request: [SPARK-4912][SQL] Persistent tables for the Sp...

2015-01-12 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/3960#issuecomment-69680966 [Test build #25438 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/25438/consoleFull) for PR 3960 at commit

[GitHub] spark pull request: [SPARK-4912][SQL] Persistent tables for the Sp...

2015-01-12 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/3960#issuecomment-69680968 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] spark pull request: [SPARK-4707][STREAMING] Reliable Kafka Receive...

2015-01-12 Thread jerryshao
Github user jerryshao commented on the pull request: https://github.com/apache/spark/pull/3655#issuecomment-69684611 Hi @harishreedharan , After carefully looking at the code, I think data will not be lost even in such failure situation. For example, if we meet exception in

[GitHub] spark pull request: [SPARK-4962] [CORE] Put TaskScheduler.start ba...

2015-01-12 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/3810#issuecomment-69686615 [Test build #25446 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/25446/consoleFull) for PR 3810 at commit

[GitHub] spark pull request: [SPARK-4924] Add a library for launching Spark...

2015-01-12 Thread andrewor14
Github user andrewor14 commented on a diff in the pull request: https://github.com/apache/spark/pull/3916#discussion_r22840200 --- Diff: launcher/src/main/java/org/apache/spark/launcher/SparkLauncher.java --- @@ -0,0 +1,371 @@ +/* + * Licensed to the Apache Software

[GitHub] spark pull request: [SPARK-4924] Add a library for launching Spark...

2015-01-12 Thread andrewor14
Github user andrewor14 commented on a diff in the pull request: https://github.com/apache/spark/pull/3916#discussion_r22840211 --- Diff: launcher/src/main/java/org/apache/spark/launcher/SparkLauncher.java --- @@ -0,0 +1,371 @@ +/* + * Licensed to the Apache Software

[GitHub] spark pull request: [SPARK-5196][SQL] Support `comment` in Create ...

2015-01-12 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/3999#issuecomment-69687629 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] spark pull request: [SPARK-5196][SQL] Support `comment` in Create ...

2015-01-12 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/3999#issuecomment-69687626 [Test build #25449 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/25449/consoleFull) for PR 3999 at commit

[GitHub] spark pull request: [SPARK-4962] [CORE] Put TaskScheduler.start ba...

2015-01-12 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/3810#issuecomment-69689372 [Test build #25451 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/25451/consoleFull) for PR 3810 at commit

[GitHub] spark pull request: [SPARK-5135][SQL] Add support for describe [ex...

2015-01-12 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/3935#issuecomment-69689308 [Test build #25452 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/25452/consoleFull) for PR 3935 at commit

[GitHub] spark pull request: [SPARK-4962] [CORE] Put TaskScheduler.start ba...

2015-01-12 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/3810#issuecomment-69689373 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] spark pull request: [SPARK-4912][SQL] Persistent tables for the Sp...

2015-01-12 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/3960#issuecomment-69669594 [Test build #25435 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/25435/consoleFull) for PR 3960 at commit

[GitHub] spark pull request: [SPARK-5138][SQL] Ensure schema can be inferre...

2015-01-12 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/3978#issuecomment-69681714 [Test build #25443 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/25443/consoleFull) for PR 3978 at commit

[GitHub] spark pull request: [SPARK-5208][DOCS] Add more documentation to N...

2015-01-12 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/4012#issuecomment-69681739 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] spark pull request: [SPARK-5208][DOCS] Add more documentation to N...

2015-01-12 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/4012#issuecomment-69681734 [Test build #25437 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/25437/consoleFull) for PR 4012 at commit

[GitHub] spark pull request: [SPARK-4924] Add a library for launching Spark...

2015-01-12 Thread andrewor14
Github user andrewor14 commented on a diff in the pull request: https://github.com/apache/spark/pull/3916#discussion_r22840770 --- Diff: launcher/src/main/java/org/apache/spark/launcher/AbstractLauncher.java --- @@ -0,0 +1,600 @@ +/* + * Licensed to the Apache Software

[GitHub] spark pull request: [SPARK-4924] Add a library for launching Spark...

2015-01-12 Thread andrewor14
Github user andrewor14 commented on a diff in the pull request: https://github.com/apache/spark/pull/3916#discussion_r22841069 --- Diff: launcher/src/main/java/org/apache/spark/launcher/AbstractLauncher.java --- @@ -0,0 +1,600 @@ +/* + * Licensed to the Apache Software

[GitHub] spark pull request: [SPARK-4962] [CORE] Put TaskScheduler.start ba...

2015-01-12 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/3810#issuecomment-69688937 [Test build #25451 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/25451/consoleFull) for PR 3810 at commit

[GitHub] spark pull request: [SPARK-4924] Add a library for launching Spark...

2015-01-12 Thread andrewor14
Github user andrewor14 commented on a diff in the pull request: https://github.com/apache/spark/pull/3916#discussion_r22841076 --- Diff: launcher/src/main/java/org/apache/spark/launcher/AbstractLauncher.java --- @@ -0,0 +1,600 @@ +/* + * Licensed to the Apache Software

[GitHub] spark pull request: [SPARK-4924] Add a library for launching Spark...

2015-01-12 Thread andrewor14
Github user andrewor14 commented on a diff in the pull request: https://github.com/apache/spark/pull/3916#discussion_r22841380 --- Diff: launcher/src/main/java/org/apache/spark/launcher/AbstractLauncher.java --- @@ -0,0 +1,600 @@ +/* + * Licensed to the Apache Software

[GitHub] spark pull request: [SPARK-5135][SQL] Add support for describe [ex...

2015-01-12 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/3935#issuecomment-69690973 [Test build #25455 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/25455/consoleFull) for PR 3935 at commit

[GitHub] spark pull request: [SPARK-5049][SQL] Fix ordering of partition co...

2015-01-12 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/3990 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] spark pull request: [SPARK-5049][SQL] Fix ordering of partition co...

2015-01-12 Thread marmbrus
Github user marmbrus commented on the pull request: https://github.com/apache/spark/pull/3990#issuecomment-69666852 I'm merging this to master and branch-1.2 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request: [SPARK-5108][BUILD] Jackson dependency managem...

2015-01-12 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/3938#issuecomment-69665971 [Test build #25434 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/25434/consoleFull) for PR 3938 at commit

[GitHub] spark pull request: [SPARK-4348] [SPARK-4821] Backport PySpark ran...

2015-01-12 Thread JoshRosen
Github user JoshRosen commented on the pull request: https://github.com/apache/spark/pull/4011#issuecomment-69673239 This fixed the PySpark unit tests, but the build is still failing due to a MiMa issue (which we hadn't noticed because PySpark failures were preventing those checks

[GitHub] spark pull request: [SPARK-4348] [SPARK-4821] Backport PySpark ran...

2015-01-12 Thread JoshRosen
Github user JoshRosen closed the pull request at: https://github.com/apache/spark/pull/4011 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] spark pull request: [SPARK-4912][SQL] Persistent tables for the Sp...

2015-01-12 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/3960#issuecomment-69676051 [Test build #25438 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/25438/consoleFull) for PR 3960 at commit

[GitHub] spark pull request: [SPARK-4959][SQL] Attributes are case sensitiv...

2015-01-12 Thread chenghao-intel
GitHub user chenghao-intel opened a pull request: https://github.com/apache/spark/pull/4013 [SPARK-4959][SQL] Attributes are case sensitive when using a select query from a projection(Backport to Spark-1.2) This is a follow up of #3796 , which can not be merged back to Spark-1.2.

[GitHub] spark pull request: [SPARK-4924] Add a library for launching Spark...

2015-01-12 Thread andrewor14
Github user andrewor14 commented on a diff in the pull request: https://github.com/apache/spark/pull/3916#discussion_r22840058 --- Diff: launcher/src/main/java/org/apache/spark/launcher/SparkLauncher.java --- @@ -0,0 +1,371 @@ +/* + * Licensed to the Apache Software

[GitHub] spark pull request: [SPARK-4924] Add a library for launching Spark...

2015-01-12 Thread andrewor14
Github user andrewor14 commented on a diff in the pull request: https://github.com/apache/spark/pull/3916#discussion_r22840101 --- Diff: launcher/src/main/java/org/apache/spark/launcher/SparkLauncher.java --- @@ -0,0 +1,371 @@ +/* + * Licensed to the Apache Software

[GitHub] spark pull request: [SPARK-4962] [CORE] Put TaskScheduler.start ba...

2015-01-12 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/3810#issuecomment-69686218 [Test build #25444 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/25444/consoleFull) for PR 3810 at commit

[GitHub] spark pull request: [SPARK-5196][SQL] Support `comment` in Create ...

2015-01-12 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/3999#issuecomment-69686299 [Test build #25445 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/25445/consoleFull) for PR 3999 at commit

[GitHub] spark pull request: [SPARK-5196][SQL] Support `comment` in Create ...

2015-01-12 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/3999#issuecomment-69686220 [Test build #25445 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/25445/consoleFull) for PR 3999 at commit

[GitHub] spark pull request: [Spark-3490] Disable SparkUI for tests (backpo...

2015-01-12 Thread JoshRosen
Github user JoshRosen commented on the pull request: https://github.com/apache/spark/pull/3959#issuecomment-69673762 Jenkins, retest this please. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: [SPARK-3433][BUILD] Fix for Mima false-positiv...

2015-01-12 Thread JoshRosen
Github user JoshRosen commented on the pull request: https://github.com/apache/spark/pull/2285#issuecomment-69676149 I've backported this to `branch-1.1` (1.1.2) in order to fix a false-positive MiMa failure in that branch. --- If your project is set up for it, you can reply to this

[GitHub] spark pull request: [SPARK-5063] Useful error messages for nested ...

2015-01-12 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/3884#issuecomment-69677921 **[Test build #25433 timed out](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/25433/consoleFull)** for PR 3884 at commit

[GitHub] spark pull request: [SPARK-5063] Useful error messages for nested ...

2015-01-12 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/3884#issuecomment-69677929 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] spark pull request: [SPARK-5138][SQL] Ensure schema can be inferre...

2015-01-12 Thread aarondav
Github user aarondav commented on the pull request: https://github.com/apache/spark/pull/3978#issuecomment-69681190 Jenkins, retest this please. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: [SPARK-4924] Add a library for launching Spark...

2015-01-12 Thread andrewor14
Github user andrewor14 commented on a diff in the pull request: https://github.com/apache/spark/pull/3916#discussion_r22840454 --- Diff: launcher/src/main/java/org/apache/spark/launcher/AbstractLauncher.java --- @@ -0,0 +1,600 @@ +/* + * Licensed to the Apache Software

[GitHub] spark pull request: [SPARK-5135][SQL] Add support for describe [ex...

2015-01-12 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/3935#issuecomment-69687278 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] spark pull request: [SPARK-4924] Add a library for launching Spark...

2015-01-12 Thread andrewor14
Github user andrewor14 commented on a diff in the pull request: https://github.com/apache/spark/pull/3916#discussion_r22840465 --- Diff: launcher/src/main/java/org/apache/spark/launcher/AbstractLauncher.java --- @@ -0,0 +1,600 @@ +/* + * Licensed to the Apache Software

[GitHub] spark pull request: [SPARK-5135][SQL] Add support for describe [ex...

2015-01-12 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/3935#issuecomment-69687277 [Test build #25447 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/25447/consoleFull) for PR 3935 at commit

[GitHub] spark pull request: [SPARK-5138][SQL] Ensure schema can be inferre...

2015-01-12 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/3978#issuecomment-69687281 [Test build #25443 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/25443/consoleFull) for PR 3978 at commit

[GitHub] spark pull request: [SPARK-5196][SQL] Support `comment` in Create ...

2015-01-12 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/3999#issuecomment-69687388 [Test build #25449 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/25449/consoleFull) for PR 3999 at commit

[GitHub] spark pull request: [SPARK-4924] Add a library for launching Spark...

2015-01-12 Thread andrewor14
Github user andrewor14 commented on a diff in the pull request: https://github.com/apache/spark/pull/3916#discussion_r22840490 --- Diff: launcher/src/main/java/org/apache/spark/launcher/AbstractLauncher.java --- @@ -0,0 +1,600 @@ +/* + * Licensed to the Apache Software

[GitHub] spark pull request: [SPARK-5138][SQL] Ensure schema can be inferre...

2015-01-12 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/3978#issuecomment-69687288 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] spark pull request: [SPARK-4924] Add a library for launching Spark...

2015-01-12 Thread andrewor14
Github user andrewor14 commented on a diff in the pull request: https://github.com/apache/spark/pull/3916#discussion_r22840998 --- Diff: launcher/src/main/java/org/apache/spark/launcher/AbstractLauncher.java --- @@ -0,0 +1,600 @@ +/* + * Licensed to the Apache Software

[GitHub] spark pull request: [SPARK-5006][Deploy]spark.port.maxRetries does...

2015-01-12 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/3841#issuecomment-69689663 [Test build #25453 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/25453/consoleFull) for PR 3841 at commit

[GitHub] spark pull request: [SPARK-4924] Add a library for launching Spark...

2015-01-12 Thread andrewor14
Github user andrewor14 commented on a diff in the pull request: https://github.com/apache/spark/pull/3916#discussion_r22841327 --- Diff: launcher/src/main/java/org/apache/spark/launcher/AbstractLauncher.java --- @@ -0,0 +1,600 @@ +/* + * Licensed to the Apache Software

[GitHub] spark pull request: [SPARK-4924] Add a library for launching Spark...

2015-01-12 Thread andrewor14
Github user andrewor14 commented on a diff in the pull request: https://github.com/apache/spark/pull/3916#discussion_r22841342 --- Diff: launcher/src/main/java/org/apache/spark/launcher/AbstractLauncher.java --- @@ -0,0 +1,600 @@ +/* + * Licensed to the Apache Software

[GitHub] spark pull request: [SPARK-4924] Add a library for launching Spark...

2015-01-12 Thread andrewor14
Github user andrewor14 commented on a diff in the pull request: https://github.com/apache/spark/pull/3916#discussion_r22841789 --- Diff: launcher/src/main/java/org/apache/spark/launcher/Main.java --- @@ -0,0 +1,106 @@ +/* + * Licensed to the Apache Software Foundation (ASF)

[GitHub] spark pull request: [SPARK-4924] Add a library for launching Spark...

2015-01-12 Thread andrewor14
Github user andrewor14 commented on the pull request: https://github.com/apache/spark/pull/3916#issuecomment-69691743 Hey @vanzin I left a ton of minor comments. I haven't got through the whole thing yet but on a high level the structure makes a lot of sense. --- If your project is

[GitHub] spark pull request: [SPARK-4939] move to next locality when no pen...

2015-01-12 Thread tdas
Github user tdas commented on the pull request: https://github.com/apache/spark/pull/3779#issuecomment-69666241 @pwendell Can you please take a look? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does

[GitHub] spark pull request: [SPARK-4857] [CORE] Adds Executor membership e...

2015-01-12 Thread tnachen
Github user tnachen commented on a diff in the pull request: https://github.com/apache/spark/pull/3711#discussion_r22832694 --- Diff: core/src/main/scala/org/apache/spark/scheduler/cluster/mesos/MesosSchedulerBackend.scala --- @@ -344,12 +354,20 @@ private[spark] class

[GitHub] spark pull request: [SPARK-5208][DOCS] Add more documentation to N...

2015-01-12 Thread sarutak
GitHub user sarutak opened a pull request: https://github.com/apache/spark/pull/4012 [SPARK-5208][DOCS] Add more documentation to Netty-based configs #3713 added some documentation about Netty-based configs but I think we need more. I think following configs can be useful for

[GitHub] spark pull request: [SPARK-4809] Rework Guava library shading.

2015-01-12 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/3658#issuecomment-69678894 [Test build #25442 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/25442/consoleFull) for PR 3658 at commit

[GitHub] spark pull request: [SPARK-4962] [CORE] Put TaskScheduler.start ba...

2015-01-12 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/3810#issuecomment-69687035 [Test build #25446 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/25446/consoleFull) for PR 3810 at commit

[GitHub] spark pull request: [SPARK-4962] [CORE] Put TaskScheduler.start ba...

2015-01-12 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/3810#issuecomment-69687040 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] spark pull request: [SPARK-5135][SQL] Add support for describe [ex...

2015-01-12 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/3935#issuecomment-69686968 [Test build #25447 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/25447/consoleFull) for PR 3935 at commit

[GitHub] spark pull request: [SPARK-4924] Add a library for launching Spark...

2015-01-12 Thread andrewor14
Github user andrewor14 commented on a diff in the pull request: https://github.com/apache/spark/pull/3916#discussion_r22840979 --- Diff: launcher/src/main/java/org/apache/spark/launcher/AbstractLauncher.java --- @@ -0,0 +1,600 @@ +/* + * Licensed to the Apache Software

[GitHub] spark pull request: [SPARK-4924] Add a library for launching Spark...

2015-01-12 Thread andrewor14
Github user andrewor14 commented on a diff in the pull request: https://github.com/apache/spark/pull/3916#discussion_r22841170 --- Diff: launcher/src/main/java/org/apache/spark/launcher/AbstractLauncher.java --- @@ -0,0 +1,600 @@ +/* + * Licensed to the Apache Software

[GitHub] spark pull request: [SPARK-4924] Add a library for launching Spark...

2015-01-12 Thread andrewor14
Github user andrewor14 commented on a diff in the pull request: https://github.com/apache/spark/pull/3916#discussion_r22841498 --- Diff: launcher/src/main/java/org/apache/spark/launcher/SparkSubmitCliLauncher.java --- @@ -0,0 +1,161 @@ +/* + * Licensed to the Apache

[GitHub] spark pull request: [SPARK-5135][SQL] Add support for describe [ex...

2015-01-12 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/3935#issuecomment-69690124 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] spark pull request: [SPARK-4924] Add a library for launching Spark...

2015-01-12 Thread andrewor14
Github user andrewor14 commented on a diff in the pull request: https://github.com/apache/spark/pull/3916#discussion_r22841515 --- Diff: launcher/src/main/java/org/apache/spark/launcher/SparkSubmitCliLauncher.java --- @@ -0,0 +1,161 @@ +/* + * Licensed to the Apache

[GitHub] spark pull request: [SPARK-5135][SQL] Add support for describe [ex...

2015-01-12 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/3935#issuecomment-69690119 [Test build #25452 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/25452/consoleFull) for PR 3935 at commit

[GitHub] spark pull request: [SPARK-4348] [SPARK-4821] Backport PySpark ran...

2015-01-12 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/4011#issuecomment-69672795 [QA tests have finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/25432/consoleFull) for PR 4011 at commit

[GitHub] spark pull request: [SPARK-4348] [SPARK-4821] Backport PySpark ran...

2015-01-12 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/4011#issuecomment-69672801 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] spark pull request: [Spark-3490] Disable SparkUI for tests (backpo...

2015-01-12 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/3959#issuecomment-69673956 [Test build #25436 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/25436/consoleFull) for PR 3959 at commit

[GitHub] spark pull request: [SPARK-4631] unit test for MQTT

2015-01-12 Thread JoshRosen
Github user JoshRosen commented on the pull request: https://github.com/apache/spark/pull/3844#issuecomment-69675455 It looks like there's maybe a port-binding / racing issue here?

[GitHub] spark pull request: [SPARK-5205][Streaming]:Inconsistent behaviour...

2015-01-12 Thread uncleGen
Github user uncleGen commented on the pull request: https://github.com/apache/spark/pull/4008#issuecomment-69680034 @JoshRosen Thanks for your patience, I will optimize my code based on your comments. --- If your project is set up for it, you can reply to this email and have your

[GitHub] spark pull request: [SPARK-4777][CORE] Some block memory after unr...

2015-01-12 Thread liyezhang556520
Github user liyezhang556520 commented on the pull request: https://github.com/apache/spark/pull/3629#issuecomment-69684345 Hi @andrewor14 , I think @suyanNone 's concern is for code on

[GitHub] spark pull request: [SPARK-4962] [CORE] Put TaskScheduler.start ba...

2015-01-12 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/3810#issuecomment-69686713 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] spark pull request: [SPARK-4924] Add a library for launching Spark...

2015-01-12 Thread andrewor14
Github user andrewor14 commented on a diff in the pull request: https://github.com/apache/spark/pull/3916#discussion_r22840262 --- Diff: launcher/src/main/java/org/apache/spark/launcher/SparkLauncher.java --- @@ -0,0 +1,371 @@ +/* + * Licensed to the Apache Software

[GitHub] spark pull request: [SPARK-4962] [CORE] Put TaskScheduler.start ba...

2015-01-12 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/3810#issuecomment-69686710 [Test build #25444 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/25444/consoleFull) for PR 3810 at commit

[GitHub] spark pull request: [SPARK-5006][Deploy]spark.port.maxRetries does...

2015-01-12 Thread WangTaoTheTonic
Github user WangTaoTheTonic commented on a diff in the pull request: https://github.com/apache/spark/pull/3841#discussion_r22840666 --- Diff: core/src/main/scala/org/apache/spark/SparkConf.scala --- @@ -372,5 +372,5 @@ private[spark] object SparkConf { /** * Return

[GitHub] spark pull request: [SPARK-4959][SQL] Attributes are case sensitiv...

2015-01-12 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/4013#issuecomment-69687774 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] spark pull request: [SPARK-4959][SQL] Attributes are case sensitiv...

2015-01-12 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/4013#issuecomment-69687767 [Test build #25439 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/25439/consoleFull) for PR 4013 at commit

[GitHub] spark pull request: [SPARK-4924] Add a library for launching Spark...

2015-01-12 Thread andrewor14
Github user andrewor14 commented on a diff in the pull request: https://github.com/apache/spark/pull/3916#discussion_r22840665 --- Diff: launcher/src/main/java/org/apache/spark/launcher/SparkLauncher.java --- @@ -0,0 +1,371 @@ +/* + * Licensed to the Apache Software

[GitHub] spark pull request: [SPARK-4924] Add a library for launching Spark...

2015-01-12 Thread andrewor14
Github user andrewor14 commented on a diff in the pull request: https://github.com/apache/spark/pull/3916#discussion_r22841485 --- Diff: launcher/src/main/java/org/apache/spark/launcher/SparkSubmitCliLauncher.java --- @@ -0,0 +1,161 @@ +/* + * Licensed to the Apache

<    1   2   3   4   5   >