[GitHub] spark pull request: [SPARK-9900][MLlib] User guide for Association...

2015-08-18 Thread mengxr
Github user mengxr commented on the pull request: https://github.com/apache/spark/pull/8207#issuecomment-132331967 LGTM. Merged into master and branch-1.5. Thanks! --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request: [SPARK-9906] [ML] User guide for LogisticRegre...

2015-08-18 Thread feynmanliang
Github user feynmanliang commented on the pull request: https://github.com/apache/spark/pull/8197#issuecomment-132333581 Having a `ml-summary.md` would lead to quite a bit of repeated documentation; we would have to supply model training example code in both the model's description

[GitHub] spark pull request: [SPARK-10082] [MLlib] Validate i, j in apply D...

2015-08-18 Thread feynmanliang
Github user feynmanliang commented on a diff in the pull request: https://github.com/apache/spark/pull/8271#discussion_r37347311 --- Diff: mllib/src/main/scala/org/apache/spark/mllib/linalg/Matrices.scala --- @@ -281,9 +281,13 @@ class DenseMatrix( /** * @since

[GitHub] spark pull request: [SPARK-10082] [MLlib] Validate i, j in apply D...

2015-08-18 Thread feynmanliang
Github user feynmanliang commented on the pull request: https://github.com/apache/spark/pull/8271#issuecomment-132336480 minor suggestion but LGTM CC @mengxr @jkbradley for final pass --- If your project is set up for it, you can reply to this email and have your reply

[GitHub] spark pull request: [SPARK-9906] [ML] User guide for LogisticRegre...

2015-08-18 Thread MechCoder
Github user MechCoder commented on the pull request: https://github.com/apache/spark/pull/8197#issuecomment-132341432 You are right. But I thought that the example code such as extracting the training loss, and common metrics would be repeated across some classification and

[GitHub] spark pull request: [SPARK-10093][SQL] Avoid transformation on exe...

2015-08-18 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/8285#issuecomment-132341614 [Test build #41160 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/41160/consoleFull) for PR 8285 at commit

[GitHub] spark pull request: [SPARK-9906] [ML] User guide for LogisticRegre...

2015-08-18 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/8197#issuecomment-132343547 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: [SPARK-10093][SQL] Avoid transformation on exe...

2015-08-18 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/8285#issuecomment-132343518 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: [SPARK-9574][Streaming]Remove unnecessary cont...

2015-08-18 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/8069 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] spark pull request: [SPARK-10093][SQL] Avoid transformation on exe...

2015-08-18 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/8285#issuecomment-132343525 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: [SPARK-9954] [MLLIB] use first 64 nonzeros to ...

2015-08-18 Thread mengxr
Github user mengxr commented on the pull request: https://github.com/apache/spark/pull/8182#issuecomment-132354472 No particular reason. Just want to have less hash collision while keeping the computation cheap. 16 is certainly not sufficient. See

[GitHub] spark pull request: [SPARK-8167] Make tasks that fail from YARN pr...

2015-08-18 Thread vanzin
Github user vanzin commented on a diff in the pull request: https://github.com/apache/spark/pull/8007#discussion_r37354752 --- Diff: core/src/main/scala/org/apache/spark/scheduler/cluster/YarnSchedulerBackend.scala --- @@ -91,6 +92,68 @@ private[spark] abstract class

[GitHub] spark pull request: [SPARK-10072][STREAMING] BlockGenerator can de...

2015-08-18 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/8257#issuecomment-132356303 [Test build #1652 has started](https://amplab.cs.berkeley.edu/jenkins/job/NewSparkPullRequestBuilder/1652/consoleFull) for PR 8257 at commit

[GitHub] spark pull request: [SPARK-10017] [MLlib]: ML model broadcasts sho...

2015-08-18 Thread sabhyankar
Github user sabhyankar commented on the pull request: https://github.com/apache/spark/pull/8241#issuecomment-132364417 @holdenk yep :) I am updating those as well! --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request: [SPARK-8167] Make tasks that fail from YARN pr...

2015-08-18 Thread mccheah
Github user mccheah commented on a diff in the pull request: https://github.com/apache/spark/pull/8007#discussion_r37358117 --- Diff: core/src/main/scala/org/apache/spark/scheduler/cluster/YarnSchedulerBackend.scala --- @@ -91,6 +92,66 @@ private[spark] abstract class

[GitHub] spark pull request: [SPARK-8924] [MLLIB, DOCUMENTATION] Added @sin...

2015-08-18 Thread mengxr
Github user mengxr commented on the pull request: https://github.com/apache/spark/pull/7380#issuecomment-132368741 Okay, I merged this into master and branch-1.5 so we can unblock SPARK-9864. @MechCoder Please fix the issue you found in your PR. Thanks @BryanCutler for adding

[GitHub] spark pull request: SPARK-8918 Add @since tags to mllib.clustering

2015-08-18 Thread mengxr
Github user mengxr commented on the pull request: https://github.com/apache/spark/pull/8256#issuecomment-132371898 @XiaoqingWang I submitted #8288 based on your work, because we want to get this merged soon to unblock SPARK-9864. Thanks for your contribution! --- If your project is

[GitHub] spark pull request: [SPARK-9613] [CORE] Ban use of JavaConversions...

2015-08-18 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/8033#issuecomment-132374577 [Test build #1650 has finished](https://amplab.cs.berkeley.edu/jenkins/job/NewSparkPullRequestBuilder/1650/console) for PR 8033 at commit

[GitHub] spark pull request: [SPARK-10012][ML] Missing test case for Params...

2015-08-18 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/8223 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] spark pull request: [SPARK-9613] [CORE] Ban use of JavaConversions...

2015-08-18 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/8033#issuecomment-132331525 [Test build #1650 has started](https://amplab.cs.berkeley.edu/jenkins/job/NewSparkPullRequestBuilder/1650/consoleFull) for PR 8033 at commit

[GitHub] spark pull request: [SPARK-10029] [MLlib] [Doc] Add Python example...

2015-08-18 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/8225 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] spark pull request: [SPARK-10032] [PySpark] [Doc] Add Python examp...

2015-08-18 Thread mengxr
Github user mengxr commented on the pull request: https://github.com/apache/spark/pull/8227#issuecomment-132332636 Merged into master and branch-1.5. Thanks! --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request: [SPARK-9893] user guide for VectorSlicer

2015-08-18 Thread feynmanliang
Github user feynmanliang commented on a diff in the pull request: https://github.com/apache/spark/pull/8267#discussion_r37346365 --- Diff: docs/ml-features.md --- @@ -1389,3 +1389,145 @@ print(output.select(features, clicked).first()) # Feature Selectors +##

[GitHub] spark pull request: [SPARK-9893] user guide for VectorSlicer

2015-08-18 Thread feynmanliang
Github user feynmanliang commented on the pull request: https://github.com/apache/spark/pull/8267#issuecomment-132333980 Could you also modify the title to include java tests and python API? --- If your project is set up for it, you can reply to this email and have your reply appear

[GitHub] spark pull request: [SPARK-10082] [MLlib] Validate i, j in apply D...

2015-08-18 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/8271#issuecomment-132339964 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: [SPARK-9906] [ML] User guide for LogisticRegre...

2015-08-18 Thread feynmanliang
Github user feynmanliang commented on a diff in the pull request: https://github.com/apache/spark/pull/8197#discussion_r37349237 --- Diff: docs/ml-linear-methods.md --- @@ -118,12 +133,114 @@ lrModel = lr.fit(training) print(Weights: + str(lrModel.weights))

[GitHub] spark pull request: [SPARK-10093][SQL] Avoid transformation on exe...

2015-08-18 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/8285#issuecomment-132342162 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] spark pull request: [SPARK-10093][SQL] Avoid transformation on exe...

2015-08-18 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/8285#issuecomment-132342151 [Test build #41160 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/41160/console) for PR 8285 at commit

[GitHub] spark pull request: [SPARK-10093][SQL] Avoid transformation on exe...

2015-08-18 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/8285#issuecomment-132342156 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request: [SPARK-10072][STREAMING] BlockGenerator can de...

2015-08-18 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/8257#issuecomment-132342208 [Test build #1651 has started](https://amplab.cs.berkeley.edu/jenkins/job/NewSparkPullRequestBuilder/1651/consoleFull) for PR 8257 at commit

[GitHub] spark pull request: [SPARK-8505][SparkR] Add settings to kick `lin...

2015-08-18 Thread shivaram
Github user shivaram commented on the pull request: https://github.com/apache/spark/pull/7883#issuecomment-132345408 welcome back @shaneknapp ! --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: [SPARK-9906] [ML] User guide for LogisticRegre...

2015-08-18 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/8197#issuecomment-132348051 [Test build #41162 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/41162/console) for PR 8197 at commit

[GitHub] spark pull request: [SPARK-8473][SPARK-9889][ML] User guide and ex...

2015-08-18 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/8184#issuecomment-132350411 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request: [SPARK-9906] [ML] User guide for LogisticRegre...

2015-08-18 Thread MechCoder
Github user MechCoder commented on the pull request: https://github.com/apache/spark/pull/8197#issuecomment-132350267 Okay. But he had to told something else in that PR discussion :p. I do agree that doing model.binarySUmmary is much nearer than model.asInstanceOf[]… On

[GitHub] spark pull request: [SPARK-8473][SPARK-9889][ML] User guide and ex...

2015-08-18 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/8184#issuecomment-132350174 [Test build #41163 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/41163/console) for PR 8184 at commit

[GitHub] spark pull request: [SPARK-8167] Make tasks that fail from YARN pr...

2015-08-18 Thread vanzin
Github user vanzin commented on a diff in the pull request: https://github.com/apache/spark/pull/8007#discussion_r37356067 --- Diff: yarn/src/main/scala/org/apache/spark/deploy/yarn/YarnAllocator.scala --- @@ -207,6 +211,17 @@ private[yarn] class YarnAllocator( }

[GitHub] spark pull request: [SPARK-10054][Streaming]Add a timeout for laun...

2015-08-18 Thread tdas
Github user tdas commented on a diff in the pull request: https://github.com/apache/spark/pull/8242#discussion_r37357797 --- Diff: streaming/src/main/scala/org/apache/spark/streaming/scheduler/ReceiverTracker.scala --- @@ -439,6 +465,30 @@ class ReceiverTracker(ssc:

[GitHub] spark pull request: [SPARK-10060] [ML] [DOC] spark.ml DecisionTree...

2015-08-18 Thread mengxr
Github user mengxr commented on a diff in the pull request: https://github.com/apache/spark/pull/8244#discussion_r37357835 --- Diff: docs/ml-decision-tree.md --- @@ -0,0 +1,506 @@ +--- +layout: global +title: Decision Trees - SparkML +displayTitle: a

[GitHub] spark pull request: [SPARK-10060] [ML] [DOC] spark.ml DecisionTree...

2015-08-18 Thread mengxr
Github user mengxr commented on a diff in the pull request: https://github.com/apache/spark/pull/8244#discussion_r37357841 --- Diff: docs/ml-decision-tree.md --- @@ -0,0 +1,506 @@ +--- +layout: global +title: Decision Trees - SparkML +displayTitle: a

[GitHub] spark pull request: [SPARK-10012][ML] Missing test case for Params...

2015-08-18 Thread srowen
Github user srowen commented on the pull request: https://github.com/apache/spark/pull/8223#issuecomment-132365457 @jkbradley do we need to wait for something here? things can go into `master` safely; this looks safe for `branch-1.5` too regardless of whether it makes this RC or

[GitHub] spark pull request: [SPARK-10088] [sql] Add support for stored as...

2015-08-18 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/8282 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] spark pull request: [SPARK-10017] [MLlib]: ML model broadcasts sho...

2015-08-18 Thread holdenk
Github user holdenk commented on the pull request: https://github.com/apache/spark/pull/8241#issuecomment-132365264 Great :) --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark pull request: [SPARK-8167] Make tasks that fail from YARN pr...

2015-08-18 Thread vanzin
Github user vanzin commented on a diff in the pull request: https://github.com/apache/spark/pull/8007#discussion_r37359214 --- Diff: yarn/src/main/scala/org/apache/spark/deploy/yarn/YarnAllocator.scala --- @@ -207,6 +211,17 @@ private[yarn] class YarnAllocator( }

[GitHub] spark pull request: [SPARK-8924] [MLLIB, DOCUMENTATION] Added @sin...

2015-08-18 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/7380 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] spark pull request: [SPARK-10004] [shuffle] Perform auth checks wh...

2015-08-18 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/8218#issuecomment-132369642 [Test build #41156 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/41156/console) for PR 8218 at commit

[GitHub] spark pull request: [SPARK-8167] Make tasks that fail from YARN pr...

2015-08-18 Thread mccheah
Github user mccheah commented on a diff in the pull request: https://github.com/apache/spark/pull/8007#discussion_r37359578 --- Diff: yarn/src/main/scala/org/apache/spark/deploy/yarn/YarnAllocator.scala --- @@ -207,6 +211,17 @@ private[yarn] class YarnAllocator( }

[GitHub] spark pull request: [SPARK-10004] [shuffle] Perform auth checks wh...

2015-08-18 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/8218#issuecomment-132369817 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request: [SPARK-8918] [MLLIB] [DOC] Add @since tags to ...

2015-08-18 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/8288#issuecomment-132371705 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: [SPARK-10090] [SQL] fix decimal scale of divis...

2015-08-18 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/8287#issuecomment-132371678 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: [SPARK-10090] [SQL] fix decimal scale of divis...

2015-08-18 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/8287#issuecomment-132371704 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: [SPARK-10090] [SQL] fix decimal scale of divis...

2015-08-18 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/8287#issuecomment-132372715 [Test build #41165 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/41165/consoleFull) for PR 8287 at commit

[GitHub] spark pull request: [SPARK-10060] [ML] [DOC] spark.ml DecisionTree...

2015-08-18 Thread jkbradley
Github user jkbradley commented on a diff in the pull request: https://github.com/apache/spark/pull/8244#discussion_r37362286 --- Diff: docs/ml-decision-tree.md --- @@ -0,0 +1,506 @@ +--- +layout: global +title: Decision Trees - SparkML +displayTitle: a

[GitHub] spark pull request: [SPARK-10087] [CORE] Disable spark.shuffle.red...

2015-08-18 Thread shivaram
Github user shivaram commented on the pull request: https://github.com/apache/spark/pull/8280#issuecomment-132415909 Ok - lets leave it on in master and I'll work with @mateiz on changes to move this to ShuffleRDD and capture more use cases. @yhuai could you put in the query you ran

[GitHub] spark pull request: [SPARK-10102][Streaming]Fix a race condition t...

2015-08-18 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/8294#issuecomment-132418073 [Test build #41196 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/41196/consoleFull) for PR 8294 at commit

[GitHub] spark pull request: [SparkR][Minor] Get rid of a long line warning

2015-08-18 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/8297 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] spark pull request: [SparkR][Minor] Get rid of a long line warning

2015-08-18 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/8297#issuecomment-132417968 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] spark pull request: [SPARK-8505][SparkR] Add settings to kick `lin...

2015-08-18 Thread shivaram
Github user shivaram commented on the pull request: https://github.com/apache/spark/pull/7883#issuecomment-132418585 Jenkins, retest this please --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: [SPARK-10102][Streaming]Fix a race condition t...

2015-08-18 Thread tdas
Github user tdas commented on the pull request: https://github.com/apache/spark/pull/8294#issuecomment-132418520 LGTM. Will merge when tests pass. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: [SPARK-10100] [SQL] Perfomance improvements to...

2015-08-18 Thread hvanhovell
GitHub user hvanhovell opened a pull request: https://github.com/apache/spark/pull/8298 [SPARK-10100] [SQL] Perfomance improvements to new MIN/MAX aggregate functions. The new MIN/MAX suffer from a performance regression. This PR aims to fix this by simplifying the evaluation of

[GitHub] spark pull request: [SPARK-10075][SparkR] Add `when` expressino fu...

2015-08-18 Thread yu-iskw
Github user yu-iskw commented on the pull request: https://github.com/apache/spark/pull/8266#issuecomment-132426562 Jenkins, test this please. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

[GitHub] spark pull request: [SPARK-9939] [SQL] Resorts to Java process API...

2015-08-18 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/8168#issuecomment-132427026 [Test build #1660 has finished](https://amplab.cs.berkeley.edu/jenkins/job/NewSparkPullRequestBuilder/1660/console) for PR 8168 at commit

[GitHub] spark pull request: [SPARK-10035][SQL] Parquet filters does not pr...

2015-08-18 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/8275#issuecomment-132428215 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] spark pull request: [SPARK-10035][SQL] Parquet filters does not pr...

2015-08-18 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/8275#issuecomment-132428214 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request: [SPARK-9967][SPARK-10099][STREAMING] Small cha...

2015-08-18 Thread tdas
GitHub user tdas opened a pull request: https://github.com/apache/spark/pull/8299 [SPARK-9967][SPARK-10099][STREAMING] Small changes Small changes - Renamed conf spark.streaming.backpressure.{enable -- enabled} - Change Java Deprecated annotations to Scala deprecated

[GitHub] spark pull request: [SPARK-10075][SparkR] Add `when` expressino fu...

2015-08-18 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/8266#issuecomment-132429295 [Test build #41198 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/41198/console) for PR 8266 at commit

[GitHub] spark pull request: [SPARK-9967][SPARK-10099][STREAMING] Small cha...

2015-08-18 Thread tdas
Github user tdas commented on a diff in the pull request: https://github.com/apache/spark/pull/8299#discussion_r37376281 --- Diff: streaming/src/main/scala/org/apache/spark/streaming/scheduler/RateController.scala --- @@ -76,9 +76,9 @@ private[streaming] abstract class

[GitHub] spark pull request: [SPARK-9939] [SQL] Resorts to Java process API...

2015-08-18 Thread liancheng
Github user liancheng commented on the pull request: https://github.com/apache/spark/pull/8168#issuecomment-132430944 All builds in the last build wave passed (the last one timed out, but test suites we care about passed). I'm merging this into master and branch-1.5. --- If your

[GitHub] spark pull request: [SPARK-9735][SQL]Respect the user specified sc...

2015-08-18 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/8026#issuecomment-132431832 [Test build #41202 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/41202/consoleFull) for PR 8026 at commit

[GitHub] spark pull request: [SPARK-9939] [SQL] Resorts to Java process API...

2015-08-18 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/8168 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] spark pull request: [SPARK-10075][SparkR] Add `when` expressino fu...

2015-08-18 Thread shivaram
Github user shivaram commented on the pull request: https://github.com/apache/spark/pull/8266#issuecomment-132431814 LGTM. Merging this. @yu-iskw Can you open a JIRA for the `if-else` issue ? --- If your project is set up for it, you can reply to this email and have your reply appear

[GitHub] spark pull request: [SPARK-10075][SparkR] Add `when` expressino fu...

2015-08-18 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/8266 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] spark pull request: [SPARK-10100] [SQL] Perfomance improvements to...

2015-08-18 Thread yhuai
Github user yhuai commented on the pull request: https://github.com/apache/spark/pull/8298#issuecomment-132437613 ok to test --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark pull request: [SPARK-10100] [SQL] Perfomance improvements to...

2015-08-18 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/8298#issuecomment-132437659 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: [SPARK-10100] [SQL] Perfomance improvements to...

2015-08-18 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/8298#issuecomment-132437669 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: [SPARK-10035][SQL] Parquet filters does not pr...

2015-08-18 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/8275#issuecomment-132437660 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: [SPARK-10035][SQL] Parquet filters does not pr...

2015-08-18 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/8275#issuecomment-132437698 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: [SPARK-10100] [SQL] Perfomance improvements to...

2015-08-18 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/8298#issuecomment-132437956 [Test build #41203 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/41203/consoleFull) for PR 8298 at commit

[GitHub] spark pull request: [SPARK-10093][SPARK-10096][SQL] Avoid transfor...

2015-08-18 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/8295#issuecomment-132439632 [Test build #41192 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/41192/console) for PR 8295 at commit

[GitHub] spark pull request: [Spark-8530] [ML] add python API for MinMaxSca...

2015-08-18 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/7150#issuecomment-132440101 [Test build #41206 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/41206/consoleFull) for PR 7150 at commit

[GitHub] spark pull request: [SPARK-10102][Streaming]Fix a race condition t...

2015-08-18 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/8294#issuecomment-132442233 **[Test build #41191 timed out](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/41191/console)** for PR 8294 at commit

[GitHub] spark pull request: [SPARK-10102][Streaming]Fix a race condition t...

2015-08-18 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/8294#issuecomment-132442351 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request: [SPARK-10102][Streaming]Fix a race condition t...

2015-08-18 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/8294#issuecomment-132442354 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] spark pull request: [SPARK-9735][SQL]Respect the user specified sc...

2015-08-18 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/8026#issuecomment-13249 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: [SPARK-9735][SQL]Respect the user specified sc...

2015-08-18 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/8026#issuecomment-132445384 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] spark pull request: [SPARK-9735][SQL]Respect the user specified sc...

2015-08-18 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/8026#issuecomment-132445382 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request: [SPARK-9735][SQL]Respect the user specified sc...

2015-08-18 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/8026#issuecomment-132445340 [Test build #41211 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/41211/consoleFull) for PR 8026 at commit

[GitHub] spark pull request: [SPARK-9735][SQL]Respect the user specified sc...

2015-08-18 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/8026#issuecomment-132445375 [Test build #41211 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/41211/console) for PR 8026 at commit

[GitHub] spark pull request: [SPARK-10102][Streaming]Fix a race condition t...

2015-08-18 Thread tdas
Github user tdas commented on a diff in the pull request: https://github.com/apache/spark/pull/8294#discussion_r37373582 --- Diff: streaming/src/main/scala/org/apache/spark/streaming/scheduler/ReceiverTracker.scala --- @@ -469,7 +469,7 @@ class ReceiverTracker(ssc:

[GitHub] spark pull request: [SparkR][Minor] Get rid of a long line warning

2015-08-18 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/8297#issuecomment-132415613 [Test build #41195 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/41195/consoleFull) for PR 8297 at commit

[GitHub] spark pull request: [SPARK-9939] [SQL] Resorts to Java process API...

2015-08-18 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/8168#issuecomment-132415769 [Test build #1659 has finished](https://amplab.cs.berkeley.edu/jenkins/job/NewSparkPullRequestBuilder/1659/console) for PR 8168 at commit

[GitHub] spark pull request: [SPARK-10075][SparkR] Add `when` expressino fu...

2015-08-18 Thread shivaram
Github user shivaram commented on a diff in the pull request: https://github.com/apache/spark/pull/8266#discussion_r37374083 --- Diff: R/pkg/R/functions.R --- @@ -163,3 +163,17 @@ setMethod(n, signature(x = Column), function(x) { count(x)

[GitHub] spark pull request: [SPARK-9284] [tests] Allow all tests to run wi...

2015-08-18 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/7629#issuecomment-132416914 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request: [SPARK-9284] [tests] Allow all tests to run wi...

2015-08-18 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/7629#issuecomment-132416671 [Test build #41174 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/41174/console) for PR 7629 at commit

[GitHub] spark pull request: [SPARK-9284] [tests] Allow all tests to run wi...

2015-08-18 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/7629#issuecomment-132416917 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] spark pull request: [SparkR][Minor] Get rid of a long line warning

2015-08-18 Thread yu-iskw
Github user yu-iskw commented on the pull request: https://github.com/apache/spark/pull/8297#issuecomment-132418318 @shivaram thank you for reviewing and merging it! --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If

[GitHub] spark pull request: [SPARK-10048][SPARKR] Support arbitrary nested...

2015-08-18 Thread shivaram
Github user shivaram commented on the pull request: https://github.com/apache/spark/pull/8276#issuecomment-132418166 @sun-rui We can do the `createDataFrame` in another PR, but for this PR can we add a test case using a JSON file which has an `ArrayType` in it ? --- If your project

[GitHub] spark pull request: [SPARK-10004] [shuffle] Perform auth checks wh...

2015-08-18 Thread vanzin
Github user vanzin commented on the pull request: https://github.com/apache/spark/pull/8218#issuecomment-132418179 Let's try pinging a couple of people. @rxin @aarondav --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If

[GitHub] spark pull request: [SPARK-10073] [SQL] Python withColumn should r...

2015-08-18 Thread davies
GitHub user davies opened a pull request: https://github.com/apache/spark/pull/8300 [SPARK-10073] [SQL] Python withColumn should replace the old column DataFrame.withColumn in Python should be consistent with the Scala one (replacing the existing column that has the same name).

[GitHub] spark pull request: [SPARK-10073] [SQL] Python withColumn should r...

2015-08-18 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/8300#issuecomment-132439153 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: [SPARK-10075][SparkR] Add `when` expressino fu...

2015-08-18 Thread yu-iskw
Github user yu-iskw commented on the pull request: https://github.com/apache/spark/pull/8266#issuecomment-132440315 Sure. Thank you for merging it! --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

<    1   2   3   4   5   6   7   8   9   10   >