[GitHub] spark pull request: [SPARK-10077][DOCS][ML] Add package info for j...

2015-09-15 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/8740#issuecomment-140647785 [Test build #42526 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/42526/consoleFull) for PR 8740 at commit [`392baf0`](https://gith

[GitHub] spark pull request: [SPARK-10077][DOCS][ML] Add package info for j...

2015-09-15 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/8740#issuecomment-140646066 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not h

[GitHub] spark pull request: [SPARK-10077][DOCS][ML] Add package info for j...

2015-09-15 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/8740#issuecomment-140646082 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

[GitHub] spark pull request: [SPARK-10516][ MLlib]Added values property in ...

2015-09-15 Thread vinodkc
Github user vinodkc commented on the pull request: https://github.com/apache/spark/pull/8682#issuecomment-140645936 Sure I'll work on SPARK-10631 Thanks --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project

[GitHub] spark pull request: [SPARK-9669][MESOS] Support PySpark on Mesos c...

2015-09-15 Thread tnachen
Github user tnachen commented on the pull request: https://github.com/apache/spark/pull/8349#issuecomment-140645786 This is only recently merged so this is not yet released, so Mesosphere DCOS won't able to support Python yet. And if you wan tot provide s3 you just need to give it

[GitHub] spark pull request: [SPARK-9669][MESOS] Support PySpark on Mesos c...

2015-09-15 Thread viesti
Github user viesti commented on the pull request: https://github.com/apache/spark/pull/8349#issuecomment-140644766 So gave mesosphere a go (neat that there is a cloudformation template for that :)), but didn't find a way to tell how to transfer my local program onto the cluster since

[GitHub] spark pull request: [SPARK-10516][ MLlib]Added values property in ...

2015-09-15 Thread mengxr
Github user mengxr commented on the pull request: https://github.com/apache/spark/pull/8682#issuecomment-140642543 LGTM. Merged into master. @vinodkc `values` needs API doc, alone with some other public methods. I created a JIRA for it: https://issues.apache.org/jira/browse/SPARK-1063

[GitHub] spark pull request: [SPARK-10516][ MLlib]Added values property in ...

2015-09-15 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/8682 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enab

[GitHub] spark pull request: [SPARK-10077][DOCS][ML] Add package info for j...

2015-09-15 Thread holdenk
Github user holdenk commented on a diff in the pull request: https://github.com/apache/spark/pull/8740#discussion_r39597206 --- Diff: mllib/src/test/java/org/apache/spark/ml/feature/JavaPackage.java --- @@ -0,0 +1,120 @@ +/* + * Licensed to the Apache Software Foundation (A

[GitHub] spark pull request: [SPARK-10077][DOCS][ML] Add package info for j...

2015-09-15 Thread mengxr
Github user mengxr commented on a diff in the pull request: https://github.com/apache/spark/pull/8740#discussion_r39597002 --- Diff: mllib/src/main/scala/org/apache/spark/ml/feature/package-info.java --- @@ -0,0 +1,112 @@ +/* + * Licensed to the Apache Software Foundation (

[GitHub] spark pull request: [SPARK-10077][DOCS][ML] Add package info for j...

2015-09-15 Thread mengxr
Github user mengxr commented on a diff in the pull request: https://github.com/apache/spark/pull/8740#discussion_r39597009 --- Diff: mllib/src/test/java/org/apache/spark/ml/feature/JavaPackage.java --- @@ -0,0 +1,120 @@ +/* + * Licensed to the Apache Software Foundation (AS

[GitHub] spark pull request: [SPARK-10077][DOCS][ML] Add package info for j...

2015-09-15 Thread mengxr
Github user mengxr commented on a diff in the pull request: https://github.com/apache/spark/pull/8740#discussion_r39596999 --- Diff: mllib/src/main/scala/org/apache/spark/ml/feature/package-info.java --- @@ -0,0 +1,112 @@ +/* + * Licensed to the Apache Software Foundation (

[GitHub] spark pull request: [SPARK-10077][DOCS][ML] Add package info for j...

2015-09-15 Thread mengxr
Github user mengxr commented on a diff in the pull request: https://github.com/apache/spark/pull/8740#discussion_r39596988 --- Diff: mllib/src/main/scala/org/apache/spark/ml/feature/package-info.java --- @@ -0,0 +1,112 @@ +/* + * Licensed to the Apache Software Foundation (

[GitHub] spark pull request: [SPARK-10077][DOCS][ML] Add package info for j...

2015-09-15 Thread mengxr
Github user mengxr commented on a diff in the pull request: https://github.com/apache/spark/pull/8740#discussion_r39596994 --- Diff: mllib/src/main/scala/org/apache/spark/ml/feature/package-info.java --- @@ -0,0 +1,112 @@ +/* + * Licensed to the Apache Software Foundation (

[GitHub] spark pull request: [SPARK-10077][DOCS][ML] Add package info for j...

2015-09-15 Thread mengxr
Github user mengxr commented on a diff in the pull request: https://github.com/apache/spark/pull/8740#discussion_r39596991 --- Diff: mllib/src/main/scala/org/apache/spark/ml/feature/package-info.java --- @@ -0,0 +1,112 @@ +/* + * Licensed to the Apache Software Foundation (

[GitHub] spark pull request: [SPARK-9182][SQL] Cast filters are not passed ...

2015-09-15 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/8718#issuecomment-140631024 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project

[GitHub] spark pull request: [SPARK-9182][SQL] Cast filters are not passed ...

2015-09-15 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/8718#issuecomment-140631028 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/42

[GitHub] spark pull request: [SPARK-9182][SQL] Cast filters are not passed ...

2015-09-15 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/8718#issuecomment-140630773 [Test build #42523 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/42523/console) for PR 8718 at commit [`0ecdb53`](https://github.

[GitHub] spark pull request: [SPARK-9669][MESOS] Support PySpark on Mesos c...

2015-09-15 Thread viesti
Github user viesti commented on the pull request: https://github.com/apache/spark/pull/8349#issuecomment-140625049 @tnachen Thanks for the kind advice! :) I'll have a try, although we found out that AWS EMR seems to support running Spark also and got an initial hello world PySpark scr

[GitHub] spark pull request: [SPARK-10516][ MLlib]Added values property in ...

2015-09-15 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/8682#issuecomment-140624143 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/42

[GitHub] spark pull request: [SPARK-10516][ MLlib]Added values property in ...

2015-09-15 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/8682#issuecomment-140624142 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project

[GitHub] spark pull request: [SPARK-10516][ MLlib]Added values property in ...

2015-09-15 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/8682#issuecomment-140624097 [Test build #42525 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/42525/console) for PR 8682 at commit [`b77e420`](https://github.

[GitHub] spark pull request: [SPARK-3718] FsHistoryProvider should consider...

2015-09-15 Thread abraithwaite
Github user abraithwaite commented on the pull request: https://github.com/apache/spark/pull/2573#issuecomment-140622568 Hello! I was reading the explanation and I'm not quite sure I understand the reasoning still. I spent a bit too long trying to figure out how to configure

[GitHub] spark pull request: [SPARK-10529][SQL]When creating multiple HiveC...

2015-09-15 Thread GavinGavinNo1
Github user GavinGavinNo1 commented on the pull request: https://github.com/apache/spark/pull/8713#issuecomment-140621464 @marmbrus Sorry to disturb again. Could you please give me a reply? It's my first try. Maybe I need some advice. --- If your project is set up for it, you can rep

[GitHub] spark pull request: [SPARK-9963] [ML] RandomForest cleanup: replac...

2015-09-15 Thread lkhamsurenl
Github user lkhamsurenl commented on the pull request: https://github.com/apache/spark/pull/8609#issuecomment-140621230 Sorry for the late response! I see what you're saying. The difficulty with that approach I am having is in inside def binSeqOp(agg: Array[DTStatsAggregator], baggedP

[GitHub] spark pull request: [SPARK-10516][ MLlib]Added values property in ...

2015-09-15 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/8682#issuecomment-140621207 [Test build #42525 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/42525/consoleFull) for PR 8682 at commit [`b77e420`](https://gith

[GitHub] spark pull request: [SPARK-6028][Core]A new RPC implemetation base...

2015-09-15 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/6457#issuecomment-140620519 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/42

[GitHub] spark pull request: [SPARK-6028][Core]A new RPC implemetation base...

2015-09-15 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/6457#issuecomment-140620517 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project

[GitHub] spark pull request: [SPARK-6028][Core]A new RPC implemetation base...

2015-09-15 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/6457#issuecomment-140620297 [Test build #42517 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/42517/console) for PR 6457 at commit [`e8ecab8`](https://github.

[GitHub] spark pull request: [SPARK-10516][ MLlib]Added values property in ...

2015-09-15 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/8682#issuecomment-140619959 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not h

[GitHub] spark pull request: [SPARK-10516][ MLlib]Added values property in ...

2015-09-15 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/8682#issuecomment-140619998 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

[GitHub] spark pull request: [SPARK-10101] [SQL] Added stringDataType optio...

2015-09-15 Thread pallavipr
Github user pallavipr commented on the pull request: https://github.com/apache/spark/pull/8374#issuecomment-140619445 Looks good Rama. We are almost done with DB2 changes - will send for review soon. One question, did you introduce a stringDataType property in connection url?

[GitHub] spark pull request: [SPARK-9585] add config to enable inputFormat ...

2015-09-15 Thread XuTingjun
Github user XuTingjun commented on the pull request: https://github.com/apache/spark/pull/7918#issuecomment-140619178 @JoshRosen, Can you have a look on this? Thanks. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If you

[GitHub] spark pull request: [SPARK-9698] [ML] Add RInteraction transformer...

2015-09-15 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/7987#issuecomment-140615999 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/42

[GitHub] spark pull request: [SPARK-9698] [ML] Add RInteraction transformer...

2015-09-15 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/7987#issuecomment-140615996 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project

[GitHub] spark pull request: [SPARK-9698] [ML] Add RInteraction transformer...

2015-09-15 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/7987#issuecomment-140615919 [Test build #42524 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/42524/console) for PR 7987 at commit [`92c8287`](https://github.

[GitHub] spark pull request: [SPARK-9698] [ML] Add RInteraction transformer...

2015-09-15 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/7987#issuecomment-140615923 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/42

[GitHub] spark pull request: [SPARK-9698] [ML] Add RInteraction transformer...

2015-09-15 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/7987#issuecomment-140615922 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project

[GitHub] spark pull request: [SPARK-9698] [ML] Add RInteraction transformer...

2015-09-15 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/7987#issuecomment-140615714 [Test build #42524 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/42524/consoleFull) for PR 7987 at commit [`92c8287`](https://gith

[GitHub] spark pull request: [SPARK-9182][SQL] Cast filters are not passed ...

2015-09-15 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/8718#issuecomment-140615136 [Test build #42523 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/42523/consoleFull) for PR 8718 at commit [`0ecdb53`](https://gith

[GitHub] spark pull request: [SPARK-9182][SQL] Cast filters are not passed ...

2015-09-15 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/8718#issuecomment-140614868 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

[GitHub] spark pull request: [SPARK-9698] [ML] Add RInteraction transformer...

2015-09-15 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/7987#issuecomment-140614869 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

[GitHub] spark pull request: [SPARK-9182][SQL] Cast filters are not passed ...

2015-09-15 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/8718#issuecomment-140614859 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not h

[GitHub] spark pull request: [SPARK-9698] [ML] Add RInteraction transformer...

2015-09-15 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/7987#issuecomment-140614860 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not h

[GitHub] spark pull request: [SPARK-9698] [ML] Add RInteraction transformer...

2015-09-15 Thread ericl
Github user ericl commented on the pull request: https://github.com/apache/spark/pull/7987#issuecomment-140614349 @mengxr I did the refactoring as suggested --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project

[GitHub] spark pull request: [SPARK-9698] [ML] Add RInteraction transformer...

2015-09-15 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/7987#issuecomment-140613869 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

[GitHub] spark pull request: [SPARK-9698] [ML] Add RInteraction transformer...

2015-09-15 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/7987#issuecomment-140613858 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not h

[GitHub] spark pull request: [SPARK-9987][SQL]Implement the local Aggregate...

2015-09-15 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/8769#issuecomment-140613727 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project

[GitHub] spark pull request: [SPARK-9987][SQL]Implement the local Aggregate...

2015-09-15 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/8769#issuecomment-140613728 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/42

[GitHub] spark pull request: [SPARK-9987][SQL]Implement the local Aggregate...

2015-09-15 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/8769#issuecomment-140613667 [Test build #42518 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/42518/console) for PR 8769 at commit [`1e5ed75`](https://github.

[GitHub] spark pull request: [SPARK-10577] [PySpark] DataFrame hint for bro...

2015-09-15 Thread rxin
Github user rxin commented on a diff in the pull request: https://github.com/apache/spark/pull/8777#discussion_r39589775 --- Diff: python/pyspark/sql/functions.py --- @@ -189,6 +190,14 @@ def approxCountDistinct(col, rsd=None): return Column(jc) +@since(1.6)

[GitHub] spark pull request: [SPARK-10577] [PySpark] DataFrame hint for bro...

2015-09-15 Thread rxin
Github user rxin commented on a diff in the pull request: https://github.com/apache/spark/pull/8777#discussion_r39589771 --- Diff: python/pyspark/sql/functions.py --- @@ -189,6 +190,14 @@ def approxCountDistinct(col, rsd=None): return Column(jc) +@since(1.6)

[GitHub] spark pull request: [SPARK-6624][SQL]Convert filters into CNF for ...

2015-09-15 Thread yjshen
Github user yjshen commented on the pull request: https://github.com/apache/spark/pull/8200#issuecomment-140610959 @marmbrus converting a filter into CNF may lead to an expanded filter, which I think is not necessarily a general optimisation. --- If your project is set up for it, you

[GitHub] spark pull request: [SPARK-10584][SQL][DOC] Documentation about th...

2015-09-15 Thread yhuai
Github user yhuai commented on a diff in the pull request: https://github.com/apache/spark/pull/8776#discussion_r39589393 --- Diff: docs/sql-programming-guide.md --- @@ -2261,7 +2261,7 @@ Several caching related features are not supported yet: ## Compatibility with Apache Hive

[GitHub] spark pull request: [SPARK-10595] [ML] [MLLIB] [DOCS] Various ML g...

2015-09-15 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/8752 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enab

[GitHub] spark pull request: [SPARK-9078] [SQL] Allow jdbc dialects to over...

2015-09-15 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/8676 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enab

[GitHub] spark pull request: [SPARK-10595] [ML] [MLLIB] [DOCS] Various ML g...

2015-09-15 Thread mengxr
Github user mengxr commented on the pull request: https://github.com/apache/spark/pull/8752#issuecomment-140608613 Merged into master. Thanks! --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

[GitHub] spark pull request: [SPARK-9078] [SQL] Allow jdbc dialects to over...

2015-09-15 Thread yhuai
Github user yhuai commented on the pull request: https://github.com/apache/spark/pull/8676#issuecomment-140608496 It has been merged to master. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

[GitHub] spark pull request: [SPARK-9078] [SQL] Allow jdbc dialects to over...

2015-09-15 Thread vanzin
Github user vanzin commented on the pull request: https://github.com/apache/spark/pull/8676#issuecomment-140607740 @rxin I reverted the patch that caused those. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your proj

[GitHub] spark pull request: [SPARK-9078] [SQL] Allow jdbc dialects to over...

2015-09-15 Thread rxin
Github user rxin commented on the pull request: https://github.com/apache/spark/pull/8676#issuecomment-140607734 I've merged this. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this featur

[GitHub] spark pull request: [SPARK-9078] [SQL] Allow jdbc dialects to over...

2015-09-15 Thread rxin
Github user rxin commented on the pull request: https://github.com/apache/spark/pull/8676#issuecomment-140607639 @vanzin do you know what's going on with the tests? [error] Execution of test test.org.apache.spark.sql.JavaApplySchemaSuite failed: java.lang.ClassNotFoundExcepti

[GitHub] spark pull request: [SPARK-10593] [SQL] fix resolve output of Gene...

2015-09-15 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/8755#issuecomment-140607363 [Test build #1764 has finished](https://amplab.cs.berkeley.edu/jenkins/job/NewSparkPullRequestBuilder/1764/console) for PR 8755 at commit [`887474e`](https://github

[GitHub] spark pull request: [SPARK-10577] [PySpark] DataFrame hint for bro...

2015-09-15 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/8777#issuecomment-140607334 Can one of the admins verify this patch? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your pr

[GitHub] spark pull request: [SPARK-10577] [PySpark] DataFrame hint for bro...

2015-09-15 Thread Jianfeng-chs
GitHub user Jianfeng-chs opened a pull request: https://github.com/apache/spark/pull/8777 [SPARK-10577] [PySpark] DataFrame hint for broadcast join https://issues.apache.org/jira/browse/SPARK-10577 You can merge this pull request into a Git repository by running: $ git pull htt

[GitHub] spark pull request: [SPARK-10077][DOCS][ML] Add package info for j...

2015-09-15 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/8740#issuecomment-140606717 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/42

[GitHub] spark pull request: [SPARK-10077][DOCS][ML] Add package info for j...

2015-09-15 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/8740#issuecomment-140606716 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project

[GitHub] spark pull request: [SPARK-10077][DOCS][ML] Add package info for j...

2015-09-15 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/8740#issuecomment-140606637 [Test build #42520 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/42520/console) for PR 8740 at commit [`f844d55`](https://github.

reviews@spark.apache.org

2015-09-15 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/8544#issuecomment-140606432 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project

reviews@spark.apache.org

2015-09-15 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/8544#issuecomment-140606392 [Test build #42515 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/42515/console) for PR 8544 at commit [`edbbf6f`](https://github.

reviews@spark.apache.org

2015-09-15 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/8544#issuecomment-140606433 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/42

[GitHub] spark pull request: [SPARK-10300] [BUILD] [TESTS] Add support for ...

2015-09-15 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/8775#issuecomment-140606242 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project

[GitHub] spark pull request: [SPARK-10300] [BUILD] [TESTS] Add support for ...

2015-09-15 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/8775#issuecomment-140606243 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/42

[GitHub] spark pull request: [SPARK-10300] [BUILD] [TESTS] Add support for ...

2015-09-15 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/8775#issuecomment-140606177 [Test build #42514 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/42514/console) for PR 8775 at commit [`f3bb7b4`](https://github.

[GitHub] spark pull request: [SPARK-10077][DOCS][ML] Add package info for j...

2015-09-15 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/8740#issuecomment-140606066 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/42

[GitHub] spark pull request: [SPARK-10077][DOCS][ML] Add package info for j...

2015-09-15 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/8740#issuecomment-140606065 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project

[GitHub] spark pull request: [SPARK-10515] When killing executor, there is ...

2015-09-15 Thread vanzin
Github user vanzin commented on the pull request: https://github.com/apache/spark/pull/8668#issuecomment-140606005 To clarify: the YARN backend also needs to know whether the executor being killed needs to be replaced or not. Right now, when the executor is not to be replaced, that's

[GitHub] spark pull request: [SPARK-10077][DOCS][ML] Add package info for j...

2015-09-15 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/8740#issuecomment-140605943 [Test build #42519 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/42519/console) for PR 8740 at commit [`0e1a49e`](https://github.

[GitHub] spark pull request: [SPARK-10584][SQL][DOC] Documentation about th...

2015-09-15 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/8776#issuecomment-140602316 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project

[GitHub] spark pull request: [SPARK-10584][SQL][DOC] Documentation about th...

2015-09-15 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/8776#issuecomment-140602320 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/42

[GitHub] spark pull request: [SPARK-10584][SQL][DOC] Documentation about th...

2015-09-15 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/8776#issuecomment-140601943 [Test build #42521 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/42521/console) for PR 8776 at commit [`4662a25`](https://github.

[GitHub] spark pull request: [SPARK-10515] When killing executor, there is ...

2015-09-15 Thread vanzin
Github user vanzin commented on the pull request: https://github.com/apache/spark/pull/8668#issuecomment-140601612 Ok, I think I see what the problem is. But your fix is not correct. The problem is here: doRequestTotalExecutors( numExistingExecutors +

[GitHub] spark pull request: [SPARK-10584][SQL][DOC] Documentation about th...

2015-09-15 Thread yhuai
Github user yhuai commented on a diff in the pull request: https://github.com/apache/spark/pull/8776#discussion_r39587260 --- Diff: docs/sql-programming-guide.md --- @@ -1954,7 +1954,7 @@ without the need to write any code. ## Running the Thrift JDBC/ODBC server The

[GitHub] spark pull request: [SPARK-10584][SQL][DOC] Documentation about th...

2015-09-15 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/8776#issuecomment-140597352 [Test build #42521 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/42521/consoleFull) for PR 8776 at commit [`4662a25`](https://gith

[GitHub] spark pull request: [SPARK-10531] [CORE] AppId is set as AppName i...

2015-09-15 Thread vanzin
Github user vanzin commented on the pull request: https://github.com/apache/spark/pull/8688#issuecomment-140597528 @zjffdu could you take a look at whether `SparkUI.setAppName` is really needed at all? --- If your project is set up for it, you can reply to this email and have your re

[GitHub] spark pull request: [SPARK-10584][SQL][DOC] Documentation about th...

2015-09-15 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/8776#issuecomment-140597145 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

[GitHub] spark pull request: [SPARK-10584][SQL][DOC] Documentation about th...

2015-09-15 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/8776#issuecomment-140597131 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not h

[GitHub] spark pull request: [SPARK-10584][SQL][DOC] Documentation about th...

2015-09-15 Thread sarutak
GitHub user sarutak opened a pull request: https://github.com/apache/spark/pull/8776 [SPARK-10584][SQL][DOC] Documentation about the compatible Hive version is wrong. In Spark 1.5.0, Spark SQL is compatible with Hive 0.12.0 through 1.2.1 but the documentation is wrong. /CC

[GitHub] spark pull request: [SPARK-10077][DOCS][ML] Add package info for j...

2015-09-15 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/8740#issuecomment-140596833 [Test build #42520 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/42520/consoleFull) for PR 8740 at commit [`f844d55`](https://gith

[GitHub] spark pull request: [SPARK-10077][DOCS][ML] Add package info for j...

2015-09-15 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/8740#issuecomment-140595598 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not h

[GitHub] spark pull request: [SPARK-10077][DOCS][ML] Add package info for j...

2015-09-15 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/8740#issuecomment-140595613 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

[GitHub] spark pull request: [SPARK-10077][DOCS][ML] Add package info for j...

2015-09-15 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/8740#issuecomment-140595362 [Test build #42519 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/42519/consoleFull) for PR 8740 at commit [`0e1a49e`](https://gith

[GitHub] spark pull request: [SPARK-10077][DOCS][ML] Add package info for j...

2015-09-15 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/8740#issuecomment-140594433 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not h

[GitHub] spark pull request: [SPARK-10077][DOCS][ML] Add package info for j...

2015-09-15 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/8740#issuecomment-140594442 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

[GitHub] spark pull request: [SPARK-10613] [SPARK-10624] [SQL] Reduce Local...

2015-09-15 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/8764#issuecomment-140594239 [Test build #1762 has finished](https://amplab.cs.berkeley.edu/jenkins/job/NewSparkPullRequestBuilder/1762/console) for PR 8764 at commit [`3bd5ac7`](https://github

[GitHub] spark pull request: [SPARK-9987][SQL]Implement the local Aggregate...

2015-09-15 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/8769#issuecomment-140594122 [Test build #42518 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/42518/consoleFull) for PR 8769 at commit [`1e5ed75`](https://gith

[GitHub] spark pull request: [SPARK-10584][DOC][SQL] Documentation about sp...

2015-09-15 Thread sarutak
Github user sarutak commented on the pull request: https://github.com/apache/spark/pull/8739#issuecomment-140594156 O.K. I'll do it. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this featu

[GitHub] spark pull request: [SPARK-10613] [SPARK-10624] [SQL] Reduce Local...

2015-09-15 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/8764#issuecomment-140594002 [Test build #1763 has finished](https://amplab.cs.berkeley.edu/jenkins/job/NewSparkPullRequestBuilder/1763/console) for PR 8764 at commit [`3bd5ac7`](https://github

[GitHub] spark pull request: [SPARK-9987][SQL]Implement the local Aggregate...

2015-09-15 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/8769#issuecomment-140593857 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

[GitHub] spark pull request: [SPARK-9987][SQL]Implement the local Aggregate...

2015-09-15 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/8769#issuecomment-140593845 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not h

[GitHub] spark pull request: [SPARK-10613] [SPARK-10624] [SQL] Reduce Local...

2015-09-15 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/8764#issuecomment-140593623 [Test build #1761 has finished](https://amplab.cs.berkeley.edu/jenkins/job/NewSparkPullRequestBuilder/1761/console) for PR 8764 at commit [`3bd5ac7`](https://github

  1   2   3   4   5   6   7   8   >