[GitHub] spark pull request: [SPARK-11916][SQL]Expression TRIM/LTRIM/RTRIM ...

2015-11-23 Thread chenghao-intel
Github user chenghao-intel commented on a diff in the pull request: https://github.com/apache/spark/pull/9902#discussion_r45689018 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/literals.scala --- @@ -32,6 +32,7 @@ object Literal { case

[GitHub] spark pull request: [SPARK-9104][SPARK-9105][SPARK-9106][SPARK-910...

2015-11-23 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/7753#issuecomment-159132863 **[Test build #46576 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/46576/consoleFull)** for PR 7753 at commit

[GitHub] spark pull request: [SPARK-11496][GRAPHX] Parallel implementation ...

2015-11-23 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/9457#issuecomment-159134146 **[Test build #46574 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/46574/consoleFull)** for PR 9457 at commit

[GitHub] spark pull request: [SPARK-11866] [network] [core] Make sure timed...

2015-11-23 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9917#issuecomment-159134283 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request: [SPARK-11866] [network] [core] Make sure timed...

2015-11-23 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9917#issuecomment-159134285 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] spark pull request: SPARK-11686

2015-11-23 Thread ashwinswaroop
GitHub user ashwinswaroop opened a pull request: https://github.com/apache/spark/pull/9926 SPARK-11686 Changed the log type to a 'warning' instead of 'info' as required. You can merge this pull request into a Git repository by running: $ git pull

[GitHub] spark pull request: [SPARK-11563] [core] [repl] Use RpcEnv to tran...

2015-11-23 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9923#issuecomment-159134288 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] spark pull request: [SPARK-11439][ML] Optimization of creating spa...

2015-11-23 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/9756#issuecomment-159134462 **[Test build #46578 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/46578/consoleFull)** for PR 9756 at commit

[GitHub] spark pull request: [SPARK-10558][Core] Fix wrong executor state i...

2015-11-23 Thread andrewor14
Github user andrewor14 commented on a diff in the pull request: https://github.com/apache/spark/pull/8714#discussion_r45691536 --- Diff: core/src/main/scala/org/apache/spark/deploy/master/Master.scala --- @@ -702,8 +712,6 @@ private[deploy] class Master(

[GitHub] spark pull request: [WIP] [SPARK-11847] [ML] Model export/import f...

2015-11-23 Thread hhbyyh
Github user hhbyyh commented on the pull request: https://github.com/apache/spark/pull/9894#issuecomment-159136664 @jkbradley Thanks for review. Do you mean a LDAModel.load(path) which can load both local and distributed LDAModel? We can create a jira. --- If your project

[GitHub] spark pull request: [SPARK-10558][Core] Fix wrong executor state i...

2015-11-23 Thread andrewor14
Github user andrewor14 commented on a diff in the pull request: https://github.com/apache/spark/pull/8714#discussion_r45692237 --- Diff: core/src/main/scala/org/apache/spark/deploy/client/AppClient.scala --- @@ -178,9 +178,6 @@ private[spark] class AppClient( val

[GitHub] spark pull request: [WIP] [SPARK-11847] [ML] Model export/import f...

2015-11-23 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/9894#issuecomment-159137662 **[Test build #46581 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/46581/consoleFull)** for PR 9894 at commit

[GitHub] spark pull request: [SPARK-11933][SQL] Rename mapGroup -> mapGroup...

2015-11-23 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/9919#issuecomment-159138835 **[Test build #46560 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/46560/consoleFull)** for PR 9919 at commit

[GitHub] spark pull request: [SPARK-11805] free the array in UnsafeExternal...

2015-11-23 Thread JoshRosen
Github user JoshRosen commented on a diff in the pull request: https://github.com/apache/spark/pull/9793#discussion_r45693587 --- Diff: core/src/main/java/org/apache/spark/util/collection/unsafe/sort/UnsafeExternalSorter.java --- @@ -489,10 +495,6 @@ public void loadNext() throws

[GitHub] spark pull request: [SPARK-11933][SQL] Rename mapGroup -> mapGroup...

2015-11-23 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/9919#issuecomment-159140321 **[Test build #2099 has started](https://amplab.cs.berkeley.edu/jenkins/job/NewSparkPullRequestBuilder/2099/consoleFull)** for PR 9919 at commit

[GitHub] spark pull request: [SPARK-6157][CORE] Unrolling with MEMORY_AND_D...

2015-11-23 Thread suyanNone
Github user suyanNone commented on the pull request: https://github.com/apache/spark/pull/4887#issuecomment-159140817 @andrewor14 I have the impression that cogroup will hold tow RDD's iterator, If the first iterator is `MEMORY_ONLY`, and unroll failed, so the iterator is based

[GitHub] spark pull request: [SPARK-11897][SQL] Add @scala.annotations.vara...

2015-11-23 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9918#issuecomment-159141995 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] spark pull request: Updated sql programming guide to include jdbc ...

2015-11-23 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/9377 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] spark pull request: Updated sql programming guide to include jdbc ...

2015-11-23 Thread rxin
Github user rxin commented on the pull request: https://github.com/apache/spark/pull/9377#issuecomment-159143174 Thanks - going to merge this. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

[GitHub] spark pull request: [SPARK-11439][ML] Optimization of creating spa...

2015-11-23 Thread Lewuathe
Github user Lewuathe commented on the pull request: https://github.com/apache/spark/pull/9756#issuecomment-159125433 @nakul02 Thank you so much for quick updating! --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request: [SPARK-7286] [SQL] Deprecate !== in favour of ...

2015-11-23 Thread jodersky
GitHub user jodersky opened a pull request: https://github.com/apache/spark/pull/9925 [SPARK-7286] [SQL] Deprecate !== in favour of =!= Fixes subtle issues related to operator precedence, as discussed in SPARK-7286. I'm not entirely sure this is the right thing to do,

[GitHub] spark pull request: [SPARK-11897][SQL] Add @scala.annotations.vara...

2015-11-23 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/9918#issuecomment-159127225 **[Test build #46575 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/46575/consoleFull)** for PR 9918 at commit

[GitHub] spark pull request: [SPARK-11916][SQL]Expression TRIM/LTRIM/RTRIM ...

2015-11-23 Thread chenghao-intel
Github user chenghao-intel commented on a diff in the pull request: https://github.com/apache/spark/pull/9902#discussion_r45689230 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/stringExpressions.scala --- @@ -343,47 +343,71 @@ case class

[GitHub] spark pull request: [SPARK-7286] [SQL] Deprecate !== in favour of ...

2015-11-23 Thread dilipbiswal
Github user dilipbiswal commented on a diff in the pull request: https://github.com/apache/spark/pull/9925#discussion_r45690182 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/dsl/package.scala --- @@ -83,7 +83,10 @@ package object dsl { def >= (other:

[GitHub] spark pull request: [SPARK-11439][ML] Optimization of creating spa...

2015-11-23 Thread nakul02
Github user nakul02 commented on the pull request: https://github.com/apache/spark/pull/9756#issuecomment-159133997 @Lewuathe - sorry, it took a while to regenerate numbers for all the tests --- If your project is set up for it, you can reply to this email and have your reply appear

[GitHub] spark pull request: [SPARK-11496][GRAPHX] Parallel implementation ...

2015-11-23 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9457#issuecomment-159134236 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request: [SPARK-11563] [core] [repl] Use RpcEnv to tran...

2015-11-23 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9923#issuecomment-159134286 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request: [SPARK-11496][GRAPHX] Parallel implementation ...

2015-11-23 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9457#issuecomment-159134237 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] spark pull request: [SPARK-11563] [core] [repl] Use RpcEnv to tran...

2015-11-23 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/9923#issuecomment-159134192 **[Test build #46566 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/46566/consoleFull)** for PR 9923 at commit

[GitHub] spark pull request: [SPARK-11866] [network] [core] Make sure timed...

2015-11-23 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/9917#issuecomment-159134234 **[Test build #46557 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/46557/consoleFull)** for PR 9917 at commit

[GitHub] spark pull request: [SPARK-11856][SQL] add type cast if the real t...

2015-11-23 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9840#issuecomment-159134874 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request: [SPARK-11903] Remove --skip-java-test

2015-11-23 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/9924#issuecomment-159134861 **[Test build #46579 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/46579/consoleFull)** for PR 9924 at commit

[GitHub] spark pull request: SPARK-11686

2015-11-23 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9926#issuecomment-159134679 Can one of the admins verify this patch? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request: [SPARK-11856][SQL] add type cast if the real t...

2015-11-23 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9840#issuecomment-159134875 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] spark pull request: [SPARK-11863][SQL][WIP] Unable to resolve orde...

2015-11-23 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/9844#issuecomment-159136027 **[Test build #46580 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/46580/consoleFull)** for PR 9844 at commit

[GitHub] spark pull request: [SPARK-10558][Core] Fix wrong executor state i...

2015-11-23 Thread andrewor14
Github user andrewor14 commented on a diff in the pull request: https://github.com/apache/spark/pull/8714#discussion_r45692382 --- Diff: core/src/main/scala/org/apache/spark/deploy/master/Master.scala --- @@ -702,8 +712,6 @@ private[deploy] class Master(

[GitHub] spark pull request: [SPARK-11866] [network] [core] Make sure timed...

2015-11-23 Thread vanzin
Github user vanzin commented on the pull request: https://github.com/apache/spark/pull/9917#issuecomment-159137841 retest this please --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this

[GitHub] spark pull request: [SPARK-10558][Core] Fix wrong executor state i...

2015-11-23 Thread andrewor14
Github user andrewor14 commented on the pull request: https://github.com/apache/spark/pull/8714#issuecomment-159137863 @jerryshao this change looks pretty good. I think I have a good understanding of the problem. The behavior before this patch was: 1. Master launches an

[GitHub] spark pull request: [SPARK-11863][SQL][WIP] Unable to resolve orde...

2015-11-23 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/9844#issuecomment-159139182 **[Test build #46580 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/46580/consoleFull)** for PR 9844 at commit

[GitHub] spark pull request: [SPARK-11863][SQL][WIP] Unable to resolve orde...

2015-11-23 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9844#issuecomment-159139215 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] spark pull request: [SPARK-11863][SQL][WIP] Unable to resolve orde...

2015-11-23 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9844#issuecomment-159139214 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request: [SPARK-11439][ML] Optimization of creating spa...

2015-11-23 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/9756#issuecomment-159139789 **[Test build #46578 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/46578/consoleFull)** for PR 9756 at commit

[GitHub] spark pull request: [SPARK-11439][ML] Optimization of creating spa...

2015-11-23 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9756#issuecomment-159139868 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request: [SPARK-11897][SQL] Add @scala.annotations.vara...

2015-11-23 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9918#issuecomment-159141994 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request: [SPARK-7499][SPARKR][WIP] Investigate how to s...

2015-11-23 Thread sun-rui
Github user sun-rui commented on the pull request: https://github.com/apache/spark/pull/9835#issuecomment-159141992 I realize that this takes more effort than I expected as we'd better support specifying columns without $ for all DataFrame methods that take any argument of "Column"

[GitHub] spark pull request: [SPARK-11897][SQL] Add @scala.annotations.vara...

2015-11-23 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/9918#issuecomment-159141891 **[Test build #46575 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/46575/consoleFull)** for PR 9918 at commit

[GitHub] spark pull request: [SPARK-3533][Core] Add saveAsTextFileByKey() m...

2015-11-23 Thread saurfang
Github user saurfang commented on the pull request: https://github.com/apache/spark/pull/8375#issuecomment-159143064 I myself definitely want to get this merged. That being said, this will require a spark committer to drive the process. If you feel strongly about this feature, voice

[GitHub] spark pull request: [SPARK-11942][SQL] fix encoder life cycle for ...

2015-11-23 Thread cloud-fan
GitHub user cloud-fan opened a pull request: https://github.com/apache/spark/pull/9928 [SPARK-11942][SQL] fix encoder life cycle for CoGroup we should pass in resolved encodera to logical `CoGroup` and bind them in physical `CoGroup` You can merge this pull request into a Git

[GitHub] spark pull request: [SPARK-11856][SQL] add type cast if the real t...

2015-11-23 Thread cloud-fan
Github user cloud-fan commented on the pull request: https://github.com/apache/spark/pull/9840#issuecomment-159181742 It's blocked by https://github.com/apache/spark/pull/9928 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as

[GitHub] spark pull request: [SPARK-11897][SQL] Add @scala.annotations.vara...

2015-11-23 Thread cloud-fan
Github user cloud-fan commented on a diff in the pull request: https://github.com/apache/spark/pull/9918#discussion_r45703494 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/functions.scala --- @@ -689,6 +689,7 @@ object functions extends LegacyFunctions { * @group

[GitHub] spark pull request: [SPARK-11942][SQL] fix encoder life cycle for ...

2015-11-23 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/9928#issuecomment-159182159 **[Test build #46586 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/46586/consoleFull)** for PR 9928 at commit

[GitHub] spark pull request: [SPARK-11863][SQL][WIP] Unable to resolve orde...

2015-11-23 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/9844#issuecomment-159186937 **[Test build #46588 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/46588/consoleFull)** for PR 9844 at commit

[GitHub] spark pull request: [SPARK-11863][SQL][WIP] Unable to resolve orde...

2015-11-23 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9844#issuecomment-159187032 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request: [SPARK-11140] [core] Transfer files using netw...

2015-11-23 Thread JoshRosen
Github user JoshRosen commented on the pull request: https://github.com/apache/spark/pull/9530#issuecomment-159187716 The following two tests have failed for the past three builds in the Hadoop 2.4 Maven Jenkins job: - org.apache.spark.deploy.yarn.YarnClusterSuite.run Spark

[GitHub] spark pull request: [SPARK-11863][SQL][WIP] Unable to resolve orde...

2015-11-23 Thread dilipbiswal
Github user dilipbiswal commented on the pull request: https://github.com/apache/spark/pull/9844#issuecomment-159188789 @cloud-fan can you please help trigger a retest ? Thanks. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as

[GitHub] spark pull request: SPARK-5106 - Add refresh checkbox on the UI

2015-11-23 Thread JoshRosen
Github user JoshRosen commented on the pull request: https://github.com/apache/spark/pull/9860#issuecomment-159182921 I worry that this opens a can of UI / UX worms for very little net benefit to users. For instance, a common complaint with the Jenkins auto-refresh is that the delay

[GitHub] spark pull request: SPARK-5106 - Add refresh checkbox on the UI

2015-11-23 Thread jbonofre
Github user jbonofre commented on the pull request: https://github.com/apache/spark/pull/9860#issuecomment-159183472 I can add a text field to let users configure the refresh interval if you want. --- If your project is set up for it, you can reply to this email and have your reply

[GitHub] spark pull request: [SPARK-11863][SQL][WIP] Unable to resolve orde...

2015-11-23 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9844#issuecomment-159187034 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] spark pull request: [SPARK-11863][SQL][WIP] Unable to resolve orde...

2015-11-23 Thread cloud-fan
Github user cloud-fan commented on the pull request: https://github.com/apache/spark/pull/9844#issuecomment-159188818 retest this please. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this

[GitHub] spark pull request: [branch-1.5][SPARK-11821] Propagate Kerberos k...

2015-11-23 Thread tgravescs
Github user tgravescs commented on the pull request: https://github.com/apache/spark/pull/9837#issuecomment-158965258 I made comments on https://github.com/apache/spark/pull/9859. --- If your project is set up for it, you can reply to this email and have your reply appear on

[GitHub] spark pull request: [SPARK-7889] [CORE] WiP Jobs progress of apps ...

2015-11-23 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/6935#issuecomment-158971340 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] spark pull request: [SPARK-7889] [CORE] WiP Jobs progress of apps ...

2015-11-23 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/6935#issuecomment-158971329 **[Test build #46537 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/46537/consoleFull)** for PR 6935 at commit

[GitHub] spark pull request: [SPARK-7889] [CORE] WiP Jobs progress of apps ...

2015-11-23 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/6935#issuecomment-158971335 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request: [SPARK-7889] [CORE] WiP Jobs progress of apps ...

2015-11-23 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/6935#issuecomment-158957678 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] spark pull request: [SPARK-7889] [CORE] WiP Jobs progress of apps ...

2015-11-23 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/6935#issuecomment-158957671 **[Test build #46535 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/46535/consoleFull)** for PR 6935 at commit

[GitHub] spark pull request: SPARK-11065 - Display exception in debug for s...

2015-11-23 Thread srowen
Github user srowen commented on the pull request: https://github.com/apache/spark/pull/9910#issuecomment-158957920 I tend to agree with that, if in fact this is a warning only, and somewhat commonly encountered in normal operation during shutdown. This code path doesn't only occur

[GitHub] spark pull request: SPARK-11065 - Display exception in debug for s...

2015-11-23 Thread jbonofre
Github user jbonofre commented on the pull request: https://github.com/apache/spark/pull/9910#issuecomment-158963382 It's the cause of the warning that I see during shutdown (and not randomly, I always have the exception). --- If your project is set up for it, you can reply to this

[GitHub] spark pull request: [SPARK-7889] [UI] make sure click the "App ID"...

2015-11-23 Thread steveloughran
Github user steveloughran commented on the pull request: https://github.com/apache/spark/pull/6545#issuecomment-158969374 ...I'm looking at this and my PR; I think they are differently interdependent. 1. This patch adds a new method to `ApplicationHistoryProvider` for the

[GitHub] spark pull request: [SPARK-11884] Drop multiple columns in the Dat...

2015-11-23 Thread ted-yu
Github user ted-yu commented on the pull request: https://github.com/apache/spark/pull/9862#issuecomment-158959620 @marmbrus Is there anything I need to do ? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request: [SPARK-7889] [CORE] WiP Jobs progress of apps ...

2015-11-23 Thread steveloughran
Github user steveloughran commented on the pull request: https://github.com/apache/spark/pull/6935#issuecomment-158971646 As discussed on #6545, I think we could actually switch to live UI playback, provided the number of cached UIs was kept down. What must be done here is

[GitHub] spark pull request: [SPARK-11881][SQL] Fix for postgresql fetchsiz...

2015-11-23 Thread mariusvniekerk
Github user mariusvniekerk commented on a diff in the pull request: https://github.com/apache/spark/pull/9861#discussion_r45620973 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/datasources/jdbc/JDBCRDD.scala --- @@ -489,6 +492,13 @@ private[sql] class JDBCRDD(

[GitHub] spark pull request: [SPARK-11662] [YARN]. In Client mode, make sur...

2015-11-23 Thread tgravescs
Github user tgravescs commented on the pull request: https://github.com/apache/spark/pull/9875#issuecomment-158958240 @harishreedharan I thought this issue existed even without reusing the jvm (going by other jira and prs that were filed)? For instance if you just have a long

[GitHub] spark pull request: [SPARK-9104][SPARK-9105][SPARK-9106][SPARK-910...

2015-11-23 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/7753#issuecomment-158964110 Build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does

[GitHub] spark pull request: [SPARK-9104][SPARK-9105][SPARK-9106][SPARK-910...

2015-11-23 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/7753#issuecomment-158964006 **[Test build #46533 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/46533/consoleFull)** for PR 7753 at commit

[GitHub] spark pull request: [SPARK-11881][SQL] Fix for postgresql fetchsiz...

2015-11-23 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/9861#issuecomment-158984200 **[Test build #46538 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/46538/consoleFull)** for PR 9861 at commit

[GitHub] spark pull request: [SPARK-7889] [CORE] WiP Jobs progress of apps ...

2015-11-23 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/6935#issuecomment-158970671 **[Test build #46537 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/46537/consoleFull)** for PR 6935 at commit

[GitHub] spark pull request: [SPARK-11881][SQL] Fix for postgresql fetchsiz...

2015-11-23 Thread srowen
Github user srowen commented on a diff in the pull request: https://github.com/apache/spark/pull/9861#discussion_r45622542 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/datasources/jdbc/JDBCRDD.scala --- @@ -489,6 +492,13 @@ private[sql] class JDBCRDD(

[GitHub] spark pull request: [SPARK-5337][Mesos][Standalone] respect spark....

2015-11-23 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/8610#issuecomment-158994786 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] spark pull request: [SPARK-5337][Mesos][Standalone] respect spark....

2015-11-23 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/8610#issuecomment-158994687 **[Test build #46536 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/46536/consoleFull)** for PR 8610 at commit

[GitHub] spark pull request: [SPARK-11762] [network] Account for active str...

2015-11-23 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/9747 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] spark pull request: [SPARK-11140] [core] Transfer files using netw...

2015-11-23 Thread vanzin
Github user vanzin commented on the pull request: https://github.com/apache/spark/pull/9530#issuecomment-159025832 retest this please --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this

[GitHub] spark pull request: [SPARK-11140] [core] Transfer files using netw...

2015-11-23 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/9530#issuecomment-159027545 **[Test build #46542 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/46542/consoleFull)** for PR 9530 at commit

[GitHub] spark pull request: [SPARK-11861][ML] Add feature importances for ...

2015-11-23 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/9912#issuecomment-159027567 **[Test build #46540 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/46540/consoleFull)** for PR 9912 at commit

[GitHub] spark pull request: [SPARK-11861][ML] Add feature importances for ...

2015-11-23 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9912#issuecomment-159027731 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] spark pull request: [SPARK-11861][ML] Add feature importances for ...

2015-11-23 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9912#issuecomment-159027730 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request: [SPARK-7889] [Core] WiP History Caching: xu ti...

2015-11-23 Thread steveloughran
GitHub user steveloughran opened a pull request: https://github.com/apache/spark/pull/9913 [SPARK-7889] [Core] WiP History Caching: xu tingjun's patch against master This is @XuTingjun's patch (#6545) reapplied to trunk with a bit of cleanup (the probe in the history provider is

[GitHub] spark pull request: [WIP][SPARK-9686][SQL] Redirect JDBC metadata ...

2015-11-23 Thread liancheng
GitHub user liancheng opened a pull request: https://github.com/apache/spark/pull/9911 [WIP][SPARK-9686][SQL] Redirect JDBC metadata calls to Spark SQL metadata Hive client This PR is based on the patch @navis provided in [SPARK-9686][1]. Basically, it overrides all JDBC

[GitHub] spark pull request: [WIP][SPARK-9686][SQL] Redirect JDBC metadata ...

2015-11-23 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/9911#issuecomment-158990791 **[Test build #46539 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/46539/consoleFull)** for PR 9911 at commit

[GitHub] spark pull request: [SPARK-11662] [YARN]. In Client mode, make sur...

2015-11-23 Thread harishreedharan
Github user harishreedharan commented on the pull request: https://github.com/apache/spark/pull/9875#issuecomment-158988545 Yes, that is correct but this happens even without the tokens expiring. What do you think about doing the relogin in the YarnCLientSchedulerBackend?

[GitHub] spark pull request: [SPARK-5337][Mesos][Standalone] respect spark....

2015-11-23 Thread CodingCat
Github user CodingCat commented on the pull request: https://github.com/apache/spark/pull/8610#issuecomment-158995626 Jenkins, retest this please --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: [WIP][SPARK-9686][SQL] Redirect JDBC metadata ...

2015-11-23 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/9911#issuecomment-159011485 **[Test build #46539 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/46539/consoleFull)** for PR 9911 at commit

[GitHub] spark pull request: [WIP][SPARK-9686][SQL] Redirect JDBC metadata ...

2015-11-23 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9911#issuecomment-159011554 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request: [WIP][SPARK-9686][SQL] Redirect JDBC metadata ...

2015-11-23 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9911#issuecomment-159011557 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] spark pull request: [SPARK-11865] [network] Avoid returning inacti...

2015-11-23 Thread zsxwing
Github user zsxwing commented on the pull request: https://github.com/apache/spark/pull/9853#issuecomment-159011450 Since `ctx.close()` is asynchronous, this one doesn't fix the race totally. Right? --- If your project is set up for it, you can reply to this email and have your

[GitHub] spark pull request: [SPARK-11865] [network] Avoid returning inacti...

2015-11-23 Thread vanzin
Github user vanzin commented on the pull request: https://github.com/apache/spark/pull/9853#issuecomment-159003767 /cc @rxin @zsxwing ; we should probably get this into 1.6 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well.

[GitHub] spark pull request: [SPARK-11821] Propagate Kerberos keytab for al...

2015-11-23 Thread woj-i
Github user woj-i commented on the pull request: https://github.com/apache/spark/pull/9859#issuecomment-159010452 Hi! Can you test it on all environments? If not, then I can shrink the scope to the YARN and the local mode. In case of HADOOP_SECURITY_AUTHENTICATION there

[GitHub] spark pull request: [SPARK-11861][ML] Add feature importances for ...

2015-11-23 Thread sethah
GitHub user sethah opened a pull request: https://github.com/apache/spark/pull/9912 [SPARK-11861][ML] Add feature importances for decision trees This patch adds an API entry point for single decision tree feature importances. You can merge this pull request into a Git repository

[GitHub] spark pull request: [SPARK-9104][SPARK-9105][SPARK-9106][SPARK-910...

2015-11-23 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/7753#issuecomment-158964111 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] spark pull request: [SPARK-5337][Mesos][Standalone] respect spark....

2015-11-23 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/8610#issuecomment-158969995 **[Test build #46536 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/46536/consoleFull)** for PR 8610 at commit

[GitHub] spark pull request: [SPARK-11628][SQL] support column datatype of ...

2015-11-23 Thread yhuai
Github user yhuai commented on the pull request: https://github.com/apache/spark/pull/9612#issuecomment-158993697 Thanks! Merging to master and branch 1.6. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project

<    1   2   3   4   5   6   >