[GitHub] spark pull request: [SPARK-11935][PySpark]Send the Python exceptio...

2015-11-24 Thread zsxwing
Github user zsxwing commented on a diff in the pull request: https://github.com/apache/spark/pull/9922#discussion_r45803191 --- Diff: streaming/src/main/scala/org/apache/spark/streaming/api/python/PythonDStream.scala --- @@ -59,18 +74,32 @@ private[python] class

[GitHub] spark pull request: [SPARK-11866] [network] [core] Make sure timed...

2015-11-24 Thread andrewor14
Github user andrewor14 commented on a diff in the pull request: https://github.com/apache/spark/pull/9917#discussion_r45803244 --- Diff: core/src/main/scala/org/apache/spark/rpc/netty/NettyRpcEnv.scala --- @@ -208,46 +193,52 @@ private[netty] class NettyRpcEnv(

[GitHub] spark pull request: [SPARK-11140][CORE] Transfer files using netwo...

2015-11-24 Thread vanzin
Github user vanzin commented on the pull request: https://github.com/apache/spark/pull/9947#issuecomment-159427177 I'll revert all the doc changes. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: [SPARK-11866] [network] [core] Make sure timed...

2015-11-24 Thread andrewor14
Github user andrewor14 commented on a diff in the pull request: https://github.com/apache/spark/pull/9917#discussion_r45806519 --- Diff: network/common/src/main/java/org/apache/spark/network/server/RpcHandler.java --- @@ -48,10 +54,40 @@ public abstract void receive( public

[GitHub] spark pull request: [SPARK-11783][SQL] Fixes execution Hive client...

2015-11-24 Thread yhuai
Github user yhuai commented on the pull request: https://github.com/apache/spark/pull/9895#issuecomment-159432435 I am going to merge it to master and branch 1.6. I will modify the comment to point to hive's code and doc. --- If your project is set up for it, you can reply to this

[GitHub] spark pull request: [SPARK-11969] [SQL] [PYSPARK] visualization of...

2015-11-24 Thread davies
GitHub user davies opened a pull request: https://github.com/apache/spark/pull/9949 [SPARK-11969] [SQL] [PYSPARK] visualization of SQL query for pyspark Currently, we does not have visualization for SQL query from Python, this PR fix that. cc @zsxwing You can merge this

[GitHub] spark pull request: [SPARK-11935][PySpark]Send the Python exceptio...

2015-11-24 Thread zsxwing
Github user zsxwing commented on the pull request: https://github.com/apache/spark/pull/9922#issuecomment-159423701 Just fixed other overloads of `TransformFunction` --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If

[GitHub] spark pull request: [SPARK-11866] [network] [core] Make sure timed...

2015-11-24 Thread andrewor14
Github user andrewor14 commented on a diff in the pull request: https://github.com/apache/spark/pull/9917#discussion_r45802966 --- Diff: core/src/main/scala/org/apache/spark/rpc/netty/NettyRpcEnv.scala --- @@ -208,46 +193,52 @@ private[netty] class NettyRpcEnv(

[GitHub] spark pull request: [SPARK-10621][SQL] Consistent naming for funct...

2015-11-24 Thread yhuai
Github user yhuai commented on the pull request: https://github.com/apache/spark/pull/9948#issuecomment-159423533 LGTM --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled

[GitHub] spark pull request: [SPARK-11935][PySpark]Send the Python exceptio...

2015-11-24 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/9922#issuecomment-159427209 **[Test build #46624 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/46624/consoleFull)** for PR 9922 at commit

[GitHub] spark pull request: [SPARK-11935][PySpark]Send the Python exceptio...

2015-11-24 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9922#issuecomment-159427419 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request: [SPARK-11935][PySpark]Send the Python exceptio...

2015-11-24 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9922#issuecomment-159427420 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] spark pull request: [SPARK-11805] free the array in UnsafeExternal...

2015-11-24 Thread JoshRosen
Github user JoshRosen commented on a diff in the pull request: https://github.com/apache/spark/pull/9793#discussion_r45804928 --- Diff: core/src/main/java/org/apache/spark/util/collection/unsafe/sort/UnsafeExternalSorter.java --- @@ -489,10 +495,6 @@ public void loadNext() throws

[GitHub] spark pull request: [SPARK-11805] free the array in UnsafeExternal...

2015-11-24 Thread JoshRosen
Github user JoshRosen commented on the pull request: https://github.com/apache/spark/pull/9793#issuecomment-159427506 Thanks for clarifying my question upthread. This looks good to me, so I'm going to merge to master and branch-1.6. --- If your project is set up for it, you can

[GitHub] spark pull request: [SPARK-10266][Documentation, ML] Fixed @Since ...

2015-11-24 Thread noel-smith
Github user noel-smith commented on the pull request: https://github.com/apache/spark/pull/9338#issuecomment-159428812 Hi @jkbradley - the version numbers look OK - but I've been unable to get the Scala API docs building in my environment (not just this branch - I get the same

[GitHub] spark pull request: [SPARK-11140][CORE] Transfer files using netwo...

2015-11-24 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/9947#issuecomment-159433435 **[Test build #46634 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/46634/consoleFull)** for PR 9947 at commit

[GitHub] spark pull request: [SPARK-11871] Add save/load for MLPC

2015-11-24 Thread avulanov
Github user avulanov commented on the pull request: https://github.com/apache/spark/pull/9854#issuecomment-159433478 LGTM --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled

[GitHub] spark pull request: [SPARK-11935][PySpark]Send the Python exceptio...

2015-11-24 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/9922#issuecomment-159436709 **[Test build #46639 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/46639/consoleFull)** for PR 9922 at commit

[GitHub] spark pull request: [SPARK-11935][PySpark]Send the Python exceptio...

2015-11-24 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/9922#issuecomment-159445339 **[Test build #46645 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/46645/consoleFull)** for PR 9922 at commit

[GitHub] spark pull request: [SPARK-11821] Propagate Kerberos keytab for al...

2015-11-24 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/9859#issuecomment-159447241 **[Test build #46625 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/46625/consoleFull)** for PR 9859 at commit

[GitHub] spark pull request: [SPARK-11934] [SQL] Adding joinType into joinW...

2015-11-24 Thread gatorsmile
Github user gatorsmile commented on the pull request: https://github.com/apache/spark/pull/9921#issuecomment-159447230 Sure, Will do it! Thank you very much! --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If

[GitHub] spark pull request: [SPARK-11866] [network] [core] Make sure timed...

2015-11-24 Thread andrewor14
Github user andrewor14 commented on a diff in the pull request: https://github.com/apache/spark/pull/9917#discussion_r45802883 --- Diff: core/src/main/scala/org/apache/spark/rpc/netty/Outbox.scala --- @@ -22,13 +22,51 @@ import javax.annotation.concurrent.GuardedBy

[GitHub] spark pull request: [SPARK-11866] [network] [core] Make sure timed...

2015-11-24 Thread andrewor14
Github user andrewor14 commented on a diff in the pull request: https://github.com/apache/spark/pull/9917#discussion_r45803744 --- Diff: core/src/main/scala/org/apache/spark/deploy/worker/ExecutorRunner.scala --- @@ -92,7 +92,11 @@ private[deploy] class ExecutorRunner(

[GitHub] spark pull request: [SPARK-11805] free the array in UnsafeExternal...

2015-11-24 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/9793 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] spark pull request: [SPARK-11935][PySpark]Send the Python exceptio...

2015-11-24 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9922#issuecomment-159429461 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request: [SPARK-10387][ML][WIP] Add code gen for gbt

2015-11-24 Thread dbtsai
Github user dbtsai commented on a diff in the pull request: https://github.com/apache/spark/pull/9524#discussion_r45806031 --- Diff: mllib/src/main/scala/org/apache/spark/ml/tree/Split.scala --- @@ -85,7 +85,7 @@ final class CategoricalSplit private[ml] ( /** * If

[GitHub] spark pull request: [SPARK-11935][PySpark]Send the Python exceptio...

2015-11-24 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9922#issuecomment-159429463 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] spark pull request: [SPARK-11783][SQL] Fixes execution Hive client...

2015-11-24 Thread yhuai
Github user yhuai commented on the pull request: https://github.com/apache/spark/pull/9895#issuecomment-159430968 I tested it with remote metastore setup. It indeed fixes the issue. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub

[GitHub] spark pull request: [SPARK-11866] [network] [core] Make sure timed...

2015-11-24 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/9917#issuecomment-159436295 **[Test build #46636 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/46636/consoleFull)** for PR 9917 at commit

[GitHub] spark pull request: [SPARK-11935][PySpark]Send the Python exceptio...

2015-11-24 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/9922#issuecomment-159437601 **[Test build #46630 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/46630/consoleFull)** for PR 9922 at commit

[GitHub] spark pull request: [SPARK-11935][PySpark]Send the Python exceptio...

2015-11-24 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9922#issuecomment-159437786 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] spark pull request: [SPARK-11967][SQL] Consistent use of varargs f...

2015-11-24 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/9945#issuecomment-159440852 **[Test build #46641 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/46641/consoleFull)** for PR 9945 at commit

[GitHub] spark pull request: [SPARK-11967][SQL] Consistent use of varargs f...

2015-11-24 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/9945#issuecomment-159442061 **[Test build #46642 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/46642/consoleFull)** for PR 9945 at commit

[GitHub] spark pull request: [SPARK-11969] [SQL] [PYSPARK] visualization of...

2015-11-24 Thread zsxwing
Github user zsxwing commented on the pull request: https://github.com/apache/spark/pull/9949#issuecomment-159441993 Did you test `saveXXX` methods? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: [SPARK-10911] Executors should System.exit on ...

2015-11-24 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/9946#issuecomment-159443182 **[Test build #46627 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/46627/consoleFull)** for PR 9946 at commit

[GitHub] spark pull request: [SPARK-10911] Executors should System.exit on ...

2015-11-24 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9946#issuecomment-159443343 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request: [SPARK-11140][CORE] Transfer files using netwo...

2015-11-24 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/9947#issuecomment-159428993 **[Test build #46633 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/46633/consoleFull)** for PR 9947 at commit

[GitHub] spark pull request: [SPARK-11866] [network] [core] Make sure timed...

2015-11-24 Thread vanzin
Github user vanzin commented on a diff in the pull request: https://github.com/apache/spark/pull/9917#discussion_r45807174 --- Diff: network/common/src/main/java/org/apache/spark/network/server/RpcHandler.java --- @@ -48,10 +54,40 @@ public abstract void receive( public

[GitHub] spark pull request: [SPARK-11140][CORE] Transfer files using netwo...

2015-11-24 Thread zsxwing
Github user zsxwing commented on the pull request: https://github.com/apache/spark/pull/9947#issuecomment-159431775 LGTM --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled

[GitHub] spark pull request: [SPARK-11783][SQL] Fixes execution Hive client...

2015-11-24 Thread yhuai
Github user yhuai commented on the pull request: https://github.com/apache/spark/pull/9895#issuecomment-159432314 https://cwiki.apache.org/confluence/display/Hive/AdminManual+MetastoreAdmin does mention that `If hive.metastore.uris is empty local mode is assumed, remote otherwise`.

[GitHub] spark pull request: [SPARK-7889] [CORE] WiP HistoryServer cache of...

2015-11-24 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/6935#issuecomment-159433880 **[Test build #46635 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/46635/consoleFull)** for PR 6935 at commit

[GitHub] spark pull request: [SPARK-11866] [network] [core] Make sure timed...

2015-11-24 Thread vanzin
Github user vanzin commented on a diff in the pull request: https://github.com/apache/spark/pull/9917#discussion_r45808289 --- Diff: core/src/main/scala/org/apache/spark/deploy/worker/ExecutorRunner.scala --- @@ -92,7 +92,11 @@ private[deploy] class ExecutorRunner(

[GitHub] spark pull request: [SPARK-7889] [Core] WiP History Caching: xu ti...

2015-11-24 Thread steveloughran
Github user steveloughran closed the pull request at: https://github.com/apache/spark/pull/9913 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature

[GitHub] spark pull request: [SPARK-11935][PySpark]Send the Python exceptio...

2015-11-24 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9922#issuecomment-159437784 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request: [SPARK-10911] Executors should System.exit on ...

2015-11-24 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9946#issuecomment-159443345 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] spark pull request: [SPARK-11947][SQL] Mark deprecated methods wit...

2015-11-24 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/9930#issuecomment-159446018 **[Test build #2106 has started](https://amplab.cs.berkeley.edu/jenkins/job/NewSparkPullRequestBuilder/2106/consoleFull)** for PR 9930 at commit

[GitHub] spark pull request: [SPARK-11821] Propagate Kerberos keytab for al...

2015-11-24 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9859#issuecomment-159447342 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request: [SPARK-11896] [SQL] Support Sample in Dataset ...

2015-11-24 Thread gatorsmile
Github user gatorsmile closed the pull request at: https://github.com/apache/spark/pull/9877 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] spark pull request: [SPARK-11896] [SQL] Support Sample in Dataset ...

2015-11-24 Thread gatorsmile
Github user gatorsmile commented on the pull request: https://github.com/apache/spark/pull/9877#issuecomment-159447494 close this one and will merge it to https://github.com/apache/spark/pull/9921 Thank you! --- If your project is set up for it, you can reply to this email

[GitHub] spark pull request: [SPARK-11821] Propagate Kerberos keytab for al...

2015-11-24 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9859#issuecomment-159447346 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] spark pull request: [SPARK-10621][SQL] Consistent naming for funct...

2015-11-24 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9948#issuecomment-159426040 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request: [SPARK-10621][SQL] Consistent naming for funct...

2015-11-24 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9948#issuecomment-159426043 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] spark pull request: [SPARK-10621][SQL] Consistent naming for funct...

2015-11-24 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/9948#issuecomment-159426027 **[Test build #46629 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/46629/consoleFull)** for PR 9948 at commit

[GitHub] spark pull request: [SPARK-11954][SQL][WIP] Encoder for JavaBeans ...

2015-11-24 Thread rxin
Github user rxin commented on the pull request: https://github.com/apache/spark/pull/9937#issuecomment-159425958 I think Java beans is different from pojo. Beans only care about fields that have getters and setters, while pojo should care about all the fiedls. --- If your project is

[GitHub] spark pull request: [SPARK-11946][SQL] Audit pivot API for 1.6.

2015-11-24 Thread aray
Github user aray commented on a diff in the pull request: https://github.com/apache/spark/pull/9929#discussion_r45806267 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/GroupedData.scala --- @@ -282,74 +282,96 @@ class GroupedData protected[sql]( } /**

[GitHub] spark pull request: [SPARK-11783][SQL] Fixes execution Hive client...

2015-11-24 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/9895 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] spark pull request: [SPARK-11967][SQL] Consistent use of varargs f...

2015-11-24 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9945#issuecomment-159435308 Build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does

[GitHub] spark pull request: [SPARK-11783][SQL] Fixes execution Hive client...

2015-11-24 Thread yhuai
Github user yhuai commented on the pull request: https://github.com/apache/spark/pull/9895#issuecomment-159435129 Merged. @liancheng You can find my updated comments in https://github.com/apache/spark/commit/c7f95df5c6d8eb2e6f11cf58b704fea34326a5f2. --- If your project is set up for

[GitHub] spark pull request: [SPARK-11967][SQL] Consistent use of varargs f...

2015-11-24 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/9945#issuecomment-159435227 **[Test build #46623 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/46623/consoleFull)** for PR 9945 at commit

[GitHub] spark pull request: [SPARK-11967][SQL] Consistent use of varargs f...

2015-11-24 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9945#issuecomment-159435314 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] spark pull request: [SPARK-11967][SQL] Consistent use of varargs f...

2015-11-24 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/9945#issuecomment-159438072 **[Test build #46638 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/46638/consoleFull)** for PR 9945 at commit

[GitHub] spark pull request: [SPARK-11914] [SQL] Support coalesce and repar...

2015-11-24 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/9899 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] spark pull request: [SPARK-11935][PySpark]Send the Python exceptio...

2015-11-24 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9922#issuecomment-159444025 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request: [SPARK-11935][PySpark]Send the Python exceptio...

2015-11-24 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9922#issuecomment-159444027 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] spark pull request: [SPARK-11955][SQL] Mark one side fields in mer...

2015-11-24 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/9940#issuecomment-159443882 **[Test build #46626 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/46626/consoleFull)** for PR 9940 at commit

[GitHub] spark pull request: [SPARK-11955][SQL] Mark one side fields in mer...

2015-11-24 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9940#issuecomment-159443945 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request: [SPARK-11935][PySpark]Send the Python exceptio...

2015-11-24 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/9922#issuecomment-159443980 **[Test build #46639 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/46639/consoleFull)** for PR 9922 at commit

[GitHub] spark pull request: [SPARK-11955][SQL] Mark one side fields in mer...

2015-11-24 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9940#issuecomment-159443948 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] spark pull request: [SPARK-11140][CORE] Transfer files using netwo...

2015-11-24 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9947#issuecomment-159445741 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request: [SPARK-11934] [SQL] Adding joinType into joinW...

2015-11-24 Thread rxin
Github user rxin commented on a diff in the pull request: https://github.com/apache/spark/pull/9921#discussion_r45814672 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/Dataset.scala --- @@ -520,6 +523,25 @@ class Dataset[T] private[sql]( } } + /**

[GitHub] spark pull request: [SPARK-10621][SQL] Consistent naming for funct...

2015-11-24 Thread rxin
Github user rxin commented on the pull request: https://github.com/apache/spark/pull/9948#issuecomment-159421906 cc @davies --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark pull request: [SPARK-10621][SQL] Consistent naming for funct...

2015-11-24 Thread rxin
GitHub user rxin opened a pull request: https://github.com/apache/spark/pull/9948 [SPARK-10621][SQL] Consistent naming for functions in SQL, Python, Scala You can merge this pull request into a Git repository by running: $ git pull https://github.com/rxin/spark SPARK-10621

[GitHub] spark pull request: [SPARK-11866] [network] [core] Make sure timed...

2015-11-24 Thread andrewor14
Github user andrewor14 commented on a diff in the pull request: https://github.com/apache/spark/pull/9917#discussion_r45803809 --- Diff: core/src/main/scala/org/apache/spark/rpc/netty/Dispatcher.scala --- @@ -106,44 +106,39 @@ private[netty] class Dispatcher(nettyEnv:

[GitHub] spark pull request: [SPARK-11935][PySpark]Send the Python exceptio...

2015-11-24 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/9922#issuecomment-159425286 **[Test build #46630 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/46630/consoleFull)** for PR 9922 at commit

[GitHub] spark pull request: [SPARK-11866] [network] [core] Make sure timed...

2015-11-24 Thread andrewor14
Github user andrewor14 commented on a diff in the pull request: https://github.com/apache/spark/pull/9917#discussion_r45805486 --- Diff: network/common/src/main/java/org/apache/spark/network/server/RpcHandler.java --- @@ -48,10 +54,40 @@ public abstract void receive( public

[GitHub] spark pull request: [SPARK-11946][SQL] Audit pivot API for 1.6.

2015-11-24 Thread rxin
Github user rxin commented on a diff in the pull request: https://github.com/apache/spark/pull/9929#discussion_r45806695 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/GroupedData.scala --- @@ -282,74 +282,96 @@ class GroupedData protected[sql]( } /**

[GitHub] spark pull request: [SPARK-7889] [CORE] WiP HistoryServer cache of...

2015-11-24 Thread steveloughran
Github user steveloughran commented on the pull request: https://github.com/apache/spark/pull/6935#issuecomment-159434408 This is a converged patch which 1. Splits out all caching into `ApplicationCache`, for isolation and testing. 1. Now asks the history server (which then

[GitHub] spark pull request: [SPARK-7889] [CORE] WiP HistoryServer cache of...

2015-11-24 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/6935#issuecomment-159434711 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] spark pull request: [SPARK-7889] [CORE] WiP HistoryServer cache of...

2015-11-24 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/6935#issuecomment-159434703 **[Test build #46635 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/46635/consoleFull)** for PR 6935 at commit

[GitHub] spark pull request: [SPARK-7889] [CORE] WiP HistoryServer cache of...

2015-11-24 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/6935#issuecomment-159434709 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request: [SPARK-11935][PySpark]Send the Python exceptio...

2015-11-24 Thread zsxwing
Github user zsxwing commented on the pull request: https://github.com/apache/spark/pull/9922#issuecomment-159435771 retest this please --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this

[GitHub] spark pull request: [SPARK-11935][PySpark]Send the Python exceptio...

2015-11-24 Thread zsxwing
Github user zsxwing commented on the pull request: https://github.com/apache/spark/pull/9922#issuecomment-159444967 retest this please --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this

[GitHub] spark pull request: [SPARK-11905] [SQL] Support Persist/Cache and ...

2015-11-24 Thread rxin
Github user rxin commented on the pull request: https://github.com/apache/spark/pull/9889#issuecomment-159444815 cc @marmbrus I will let you merge this one. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If

[GitHub] spark pull request: [SPARK-11934] [SQL] Adding joinType into joinW...

2015-11-24 Thread rxin
Github user rxin commented on a diff in the pull request: https://github.com/apache/spark/pull/9921#discussion_r45814178 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/Dataset.scala --- @@ -17,6 +17,8 @@ package org.apache.spark.sql +import

[GitHub] spark pull request: [SPARK-11934] [SQL] Adding joinType into joinW...

2015-11-24 Thread rxin
Github user rxin commented on the pull request: https://github.com/apache/spark/pull/9921#issuecomment-159444860 OK filed: https://issues.apache.org/jira/browse/SPARK-11970 Can you merge the sample change into this one, and also add "show" support? --- If your project is

[GitHub] spark pull request: [SPARK-11866] [network] [core] Make sure timed...

2015-11-24 Thread andrewor14
Github user andrewor14 commented on a diff in the pull request: https://github.com/apache/spark/pull/9917#discussion_r45803882 --- Diff: core/src/main/scala/org/apache/spark/rpc/netty/Dispatcher.scala --- @@ -106,44 +106,39 @@ private[netty] class Dispatcher(nettyEnv:

[GitHub] spark pull request: [SPARK-10621][SQL] Consistent naming for funct...

2015-11-24 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/9948#issuecomment-159425493 **[Test build #46629 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/46629/consoleFull)** for PR 9948 at commit

[GitHub] spark pull request: [SPARK-11206] Support SQL UI on the history se...

2015-11-24 Thread vanzin
Github user vanzin commented on the pull request: https://github.com/apache/spark/pull/9297#issuecomment-159436370 retest this please --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this

[GitHub] spark pull request: [SPARK-11826][MLlib] Reimplement add() and sub...

2015-11-24 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/9916#issuecomment-159442668 **[Test build #46644 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/46644/consoleFull)** for PR 9916 at commit

[GitHub] spark pull request: [SPARK-11140][CORE] Transfer files using netwo...

2015-11-24 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9947#issuecomment-159445745 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] spark pull request: [SPARK-11934] [SQL] Adding joinType into joinW...

2015-11-24 Thread rxin
Github user rxin commented on a diff in the pull request: https://github.com/apache/spark/pull/9921#discussion_r45814648 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/Dataset.scala --- @@ -520,6 +523,25 @@ class Dataset[T] private[sql]( } } + /**

[GitHub] spark pull request: [SPARK-11934] [SQL] Adding joinType into joinW...

2015-11-24 Thread rxin
Github user rxin commented on a diff in the pull request: https://github.com/apache/spark/pull/9921#discussion_r45814607 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/Dataset.scala --- @@ -493,11 +495,12 @@ class Dataset[T] private[sql]( * * @since 1.6.0

[GitHub] spark pull request: [SPARK-11140][CORE] Transfer files using netwo...

2015-11-24 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/9947#issuecomment-159445631 **[Test build #46628 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/46628/consoleFull)** for PR 9947 at commit

[GitHub] spark pull request: [WIP][SPARK-11602] [MLlib] Refine visibility f...

2015-11-24 Thread yu-iskw
Github user yu-iskw commented on a diff in the pull request: https://github.com/apache/spark/pull/9939#discussion_r45815661 --- Diff: mllib/src/main/scala/org/apache/spark/mllib/clustering/BisectingKMeansModel.scala --- @@ -33,7 +33,7 @@ import org.apache.spark.rdd.RDD

[GitHub] spark pull request: [Spark-8426] [scheduler] enhance blacklist mec...

2015-11-24 Thread squito
Github user squito commented on a diff in the pull request: https://github.com/apache/spark/pull/8760#discussion_r45793155 --- Diff: core/src/test/scala/org/apache/spark/scheduler/BlacklistTrackerSuite.scala --- @@ -0,0 +1,200 @@ +/* + * Licensed to the Apache Software

[GitHub] spark pull request: [SPARK-11935][PySpark]Send the Python exceptio...

2015-11-24 Thread tdas
Github user tdas commented on a diff in the pull request: https://github.com/apache/spark/pull/9922#discussion_r45793158 --- Diff: python/pyspark/streaming/tests.py --- @@ -408,13 +408,17 @@ def test_failed_func(self): input_stream = self.ssc.queueStream(input)

[GitHub] spark pull request: [SPARK-11967][SQL] Use varargs for multiple pa...

2015-11-24 Thread rxin
GitHub user rxin opened a pull request: https://github.com/apache/spark/pull/9945 [SPARK-11967][SQL] Use varargs for multiple paths in DataFrameReader This patch makes it consistent to use varargs in all DataFrameReader methods, including Parquet, JSON, text, and the generic load

[GitHub] spark pull request: [SPARK-11821] Propagate Kerberos keytab for al...

2015-11-24 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/9859#issuecomment-159412787 **[Test build #46625 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/46625/consoleFull)** for PR 9859 at commit

[GitHub] spark pull request: [SPARK-11935][PySpark]Send the Python exceptio...

2015-11-24 Thread tdas
Github user tdas commented on a diff in the pull request: https://github.com/apache/spark/pull/9922#discussion_r45798494 --- Diff: streaming/src/main/scala/org/apache/spark/streaming/api/python/PythonDStream.scala --- @@ -48,6 +59,16 @@ private[python] trait

[GitHub] spark pull request: [SPARK-11401] [MLLIB] PMML export for Logistic...

2015-11-24 Thread dbtsai
Github user dbtsai commented on the pull request: https://github.com/apache/spark/pull/9397#issuecomment-159416401 Can you rebase the master? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

  1   2   3   4   5   6   7   8   >