[GitHub] spark pull request: SPARK-1509: add zipWithIndex zipWithUniqueId m...

2014-04-29 Thread witgo
Github user witgo commented on a diff in the pull request: https://github.com/apache/spark/pull/423#discussion_r12080480 --- Diff: core/src/main/scala/org/apache/spark/api/java/JavaRDDLike.scala --- @@ -263,6 +263,26 @@ trait JavaRDDLike[T, This : JavaRDDLike[T, This]] extends

[GitHub] spark pull request: [SPARK-1580] Estimate ALS communication and co...

2014-04-29 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/493#issuecomment-41644784 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

[GitHub] spark pull request: [SPARK-1580] Estimate ALS communication and co...

2014-04-29 Thread mengxr
Github user mengxr commented on a diff in the pull request: https://github.com/apache/spark/pull/493#discussion_r12080856 --- Diff: mllib/src/main/scala/org/apache/spark/mllib/recommendation/ALS.scala --- @@ -708,6 +709,123 @@ object ALS { trainImplicit(ratings, rank,

[GitHub] spark pull request: [SPARK-1580] Estimate ALS communication and co...

2014-04-29 Thread mengxr
Github user mengxr commented on a diff in the pull request: https://github.com/apache/spark/pull/493#discussion_r12080905 --- Diff: mllib/src/main/scala/org/apache/spark/mllib/recommendation/ALS.scala --- @@ -708,6 +709,123 @@ object ALS { trainImplicit(ratings, rank,

[GitHub] spark pull request: [SPARK-1580] Estimate ALS communication and co...

2014-04-29 Thread mengxr
Github user mengxr commented on a diff in the pull request: https://github.com/apache/spark/pull/493#discussion_r12081003 --- Diff: mllib/src/main/scala/org/apache/spark/mllib/recommendation/ALS.scala --- @@ -708,6 +709,123 @@ object ALS { trainImplicit(ratings, rank,

[GitHub] spark pull request: [SPARK-1580] Estimate ALS communication and co...

2014-04-29 Thread mengxr
Github user mengxr commented on a diff in the pull request: https://github.com/apache/spark/pull/493#discussion_r12081013 --- Diff: mllib/src/main/scala/org/apache/spark/mllib/recommendation/ALS.scala --- @@ -708,6 +709,123 @@ object ALS { trainImplicit(ratings, rank,

[GitHub] spark pull request: [SPARK-1580] Estimate ALS communication and co...

2014-04-29 Thread mengxr
Github user mengxr commented on a diff in the pull request: https://github.com/apache/spark/pull/493#discussion_r12081031 --- Diff: mllib/src/main/scala/org/apache/spark/mllib/recommendation/ALS.scala --- @@ -708,6 +709,123 @@ object ALS { trainImplicit(ratings, rank,

[GitHub] spark pull request: SPARK-1588. Restore SPARK_YARN_USER_ENV and SP...

2014-04-29 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/586#issuecomment-41645419 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: [SPARK-1580] Estimate ALS communication and co...

2014-04-29 Thread mengxr
Github user mengxr commented on a diff in the pull request: https://github.com/apache/spark/pull/493#discussion_r12081107 --- Diff: mllib/src/main/scala/org/apache/spark/mllib/recommendation/ALS.scala --- @@ -708,6 +709,123 @@ object ALS { trainImplicit(ratings, rank,

[GitHub] spark pull request: [SPARK-1580] Estimate ALS communication and co...

2014-04-29 Thread tmyklebu
Github user tmyklebu commented on a diff in the pull request: https://github.com/apache/spark/pull/493#discussion_r12081159 --- Diff: mllib/src/main/scala/org/apache/spark/mllib/recommendation/ALS.scala --- @@ -708,6 +709,123 @@ object ALS { trainImplicit(ratings, rank,

[GitHub] spark pull request: Improved build configuration

2014-04-29 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/480 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] spark pull request: [SPARK-1636][MLLIB] Move main methods to examp...

2014-04-29 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/584#issuecomment-41645705 Merged build finished. All automated tests passed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well.

[GitHub] spark pull request: [SPARK-1636][MLLIB] Move main methods to examp...

2014-04-29 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/584#issuecomment-41645708 Merged build finished. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: SPARK-1588. Restore SPARK_YARN_USER_ENV and SP...

2014-04-29 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/586#issuecomment-41645712 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

[GitHub] spark pull request: [SPARK-1636][MLLIB] Move main methods to examp...

2014-04-29 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/584#issuecomment-41645711 Refer to this link for build results: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/14553/ --- If your project is set up for it, you can

[GitHub] spark pull request: [SPARK-1636][MLLIB] Move main methods to examp...

2014-04-29 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/584#issuecomment-41645709 All automated tests passed. Refer to this link for build results: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/14554/ --- If your project

[GitHub] spark pull request: [SPARK-1580] Estimate ALS communication and co...

2014-04-29 Thread mengxr
Github user mengxr commented on the pull request: https://github.com/apache/spark/pull/493#issuecomment-41645726 @tmyklebu Let us think about re-using `makeInLinkBlocks` and `makeOutLinkBlocks` for cost estimation. Otherwise, if we make changes to those methods, it is hard to make

[GitHub] spark pull request: [SPARK-1636][MLLIB] Move main methods to examp...

2014-04-29 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/584#issuecomment-41645710 All automated tests passed. Refer to this link for build results: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/14555/ --- If your project

[GitHub] spark pull request: SPARK-1588. Restore SPARK_YARN_USER_ENV and SP...

2014-04-29 Thread sryza
Github user sryza commented on the pull request: https://github.com/apache/spark/pull/586#issuecomment-41645734 Uploaded a patch that follows your comments. I tested it against YARN and verified that the opts and environment variables both show up. Right now when I try

[GitHub] spark pull request: [SPARK-1646] Micro-optimisation of ALS

2014-04-29 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/568#issuecomment-41645788 Merged build finished. All automated tests passed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well.

[GitHub] spark pull request: [SPARK-1646] Micro-optimisation of ALS

2014-04-29 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/568#issuecomment-41645790 All automated tests passed. Refer to this link for build results: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/14556/ --- If your project

[GitHub] spark pull request: [SPARK-1553] Alternating nonnegative least-squ...

2014-04-29 Thread mengxr
Github user mengxr commented on the pull request: https://github.com/apache/spark/pull/460#issuecomment-41645936 @tmyklebu Could you try to merge the latest master? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request: SPARK-1509: add zipWithIndex zipWithUniqueId m...

2014-04-29 Thread mengxr
Github user mengxr commented on a diff in the pull request: https://github.com/apache/spark/pull/423#discussion_r12081245 --- Diff: core/src/main/scala/org/apache/spark/api/java/JavaRDDLike.scala --- @@ -263,6 +263,26 @@ trait JavaRDDLike[T, This : JavaRDDLike[T, This]] extends

[GitHub] spark pull request: SPARK-1509: add zipWithIndex zipWithUniqueId m...

2014-04-29 Thread witgo
Github user witgo commented on a diff in the pull request: https://github.com/apache/spark/pull/423#discussion_r12081268 --- Diff: core/src/main/scala/org/apache/spark/api/java/JavaRDDLike.scala --- @@ -263,6 +263,26 @@ trait JavaRDDLike[T, This : JavaRDDLike[T, This]] extends

[GitHub] spark pull request: Improved build configuration

2014-04-29 Thread witgo
Github user witgo commented on the pull request: https://github.com/apache/spark/pull/480#issuecomment-41646101 Cool! --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and

[GitHub] spark pull request: SPARK-1588. Restore SPARK_YARN_USER_ENV and SP...

2014-04-29 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/586#issuecomment-41646168 Refer to this link for build results: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/14558/ --- If your project is set up for it, you can

[GitHub] spark pull request: SPARK-1588. Restore SPARK_YARN_USER_ENV and SP...

2014-04-29 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/586#issuecomment-41646166 Merged build finished. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: Update GradientDescentSuite.scala

2014-04-29 Thread mengxr
Github user mengxr commented on the pull request: https://github.com/apache/spark/pull/256#issuecomment-41646208 Jenkins, test this please. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

[GitHub] spark pull request: ROC area under the curve for binary classifica...

2014-04-29 Thread schmit
Github user schmit closed the pull request at: https://github.com/apache/spark/pull/160 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] spark pull request: Update GradientDescentSuite.scala

2014-04-29 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/256#issuecomment-41646353 Build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this

[GitHub] spark pull request: Update GradientDescentSuite.scala

2014-04-29 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/256#issuecomment-41646349 Build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

[GitHub] spark pull request: [SPARK-1580] Estimate ALS communication and co...

2014-04-29 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/493#issuecomment-41646483 Merged build finished. All automated tests passed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well.

[GitHub] spark pull request: [SPARK-1580] Estimate ALS communication and co...

2014-04-29 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/493#issuecomment-41646485 All automated tests passed. Refer to this link for build results: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/14557/ --- If your project

[GitHub] spark pull request: SPARK-1588. Restore SPARK_YARN_USER_ENV and SP...

2014-04-29 Thread pwendell
Github user pwendell commented on the pull request: https://github.com/apache/spark/pull/586#issuecomment-41646542 @sryza so are you suggesting that `spark-class` previously didn't work if SPARK_JAVA_OPTS had a quoted option? Are you just testing against master or against before we

[GitHub] spark pull request: [SPARK-1553] Alternating nonnegative least-squ...

2014-04-29 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/460#issuecomment-41647153 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

[GitHub] spark pull request: [SPARK-1553] Alternating nonnegative least-squ...

2014-04-29 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/460#issuecomment-41647146 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: SPARK-1509: add zipWithIndex zipWithUniqueId m...

2014-04-29 Thread rxin
Github user rxin commented on a diff in the pull request: https://github.com/apache/spark/pull/423#discussion_r12081688 --- Diff: core/src/main/scala/org/apache/spark/api/java/JavaRDDLike.scala --- @@ -263,6 +263,26 @@ trait JavaRDDLike[T, This : JavaRDDLike[T, This]] extends

[GitHub] spark pull request: SPARK-1509: add zipWithIndex zipWithUniqueId m...

2014-04-29 Thread rxin
Github user rxin commented on a diff in the pull request: https://github.com/apache/spark/pull/423#discussion_r12081698 --- Diff: core/src/main/scala/org/apache/spark/api/java/JavaRDDLike.scala --- @@ -263,6 +263,26 @@ trait JavaRDDLike[T, This : JavaRDDLike[T, This]] extends

[GitHub] spark pull request: SPARK-1509: add zipWithIndex zipWithUniqueId m...

2014-04-29 Thread mengxr
Github user mengxr commented on a diff in the pull request: https://github.com/apache/spark/pull/423#discussion_r12081715 --- Diff: core/src/main/scala/org/apache/spark/api/java/JavaRDDLike.scala --- @@ -263,6 +263,26 @@ trait JavaRDDLike[T, This : JavaRDDLike[T, This]] extends

[GitHub] spark pull request: Update GradientDescentSuite.scala

2014-04-29 Thread mengxr
Github user mengxr commented on the pull request: https://github.com/apache/spark/pull/256#issuecomment-41647624 @baishuo This is no longer mergeable. Could you try to merge the latest master? --- If your project is set up for it, you can reply to this email and have your reply

[GitHub] spark pull request: [SPARK-1580] Estimate ALS communication and co...

2014-04-29 Thread mengxr
Github user mengxr commented on a diff in the pull request: https://github.com/apache/spark/pull/493#discussion_r12081835 --- Diff: mllib/src/main/scala/org/apache/spark/mllib/recommendation/ALS.scala --- @@ -708,6 +709,123 @@ object ALS { trainImplicit(ratings, rank,

[GitHub] spark pull request: SPARK-1509: add zipWithIndex zipWithUniqueId m...

2014-04-29 Thread witgo
Github user witgo commented on a diff in the pull request: https://github.com/apache/spark/pull/423#discussion_r12081885 --- Diff: core/src/main/scala/org/apache/spark/api/java/JavaRDDLike.scala --- @@ -263,6 +263,26 @@ trait JavaRDDLike[T, This : JavaRDDLike[T, This]] extends

[GitHub] spark pull request: SPARK-1509: add zipWithIndex zipWithUniqueId m...

2014-04-29 Thread rxin
Github user rxin commented on a diff in the pull request: https://github.com/apache/spark/pull/423#discussion_r12081946 --- Diff: core/src/main/scala/org/apache/spark/api/java/JavaRDDLike.scala --- @@ -263,6 +263,26 @@ trait JavaRDDLike[T, This : JavaRDDLike[T, This]] extends

[GitHub] spark pull request: SPARK-1509: add zipWithIndex zipWithUniqueId m...

2014-04-29 Thread witgo
Github user witgo commented on a diff in the pull request: https://github.com/apache/spark/pull/423#discussion_r12082137 --- Diff: core/src/main/scala/org/apache/spark/api/java/JavaRDDLike.scala --- @@ -263,6 +263,26 @@ trait JavaRDDLike[T, This : JavaRDDLike[T, This]] extends

[GitHub] spark pull request: Minor fix to python table caching API.

2014-04-29 Thread pwendell
Github user pwendell commented on the pull request: https://github.com/apache/spark/pull/585#issuecomment-41648969 Thanks, merged. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this

[GitHub] spark pull request: SPARK-1509: add zipWithIndex zipWithUniqueId m...

2014-04-29 Thread mengxr
Github user mengxr commented on the pull request: https://github.com/apache/spark/pull/423#issuecomment-41649034 LGTM if Jenkins is happy. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

[GitHub] spark pull request: [SPARK-1636][MLLIB] Move main methods to examp...

2014-04-29 Thread rxin
Github user rxin commented on the pull request: https://github.com/apache/spark/pull/584#issuecomment-41649174 Thanks. Merged! --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark pull request: SPARK-1509: add zipWithIndex zipWithUniqueId m...

2014-04-29 Thread mengxr
Github user mengxr commented on the pull request: https://github.com/apache/spark/pull/423#issuecomment-41649188 Jenkins, test this please. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

[GitHub] spark pull request: SPARK-1509: add zipWithIndex zipWithUniqueId m...

2014-04-29 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/423#issuecomment-41649291 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: SPARK-1509: add zipWithIndex zipWithUniqueId m...

2014-04-29 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/423#issuecomment-41649299 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

[GitHub] spark pull request: Update GradientDescentSuite.scala

2014-04-29 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/256#issuecomment-41649507 Build finished. All automated tests passed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request: Update GradientDescentSuite.scala

2014-04-29 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/256#issuecomment-41649510 All automated tests passed. Refer to this link for build results: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/14559/ --- If your project

[GitHub] spark pull request: [SPARK-1553] Alternating nonnegative least-squ...

2014-04-29 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/460#issuecomment-41649508 Merged build finished. All automated tests passed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well.

[GitHub] spark pull request: [SPARK-1553] Alternating nonnegative least-squ...

2014-04-29 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/460#issuecomment-41649511 All automated tests passed. Refer to this link for build results: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/14560/ --- If your project

[GitHub] spark pull request: Minor fix to python table caching API.

2014-04-29 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/585 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] spark pull request: [SPARK-1636][MLLIB] Move main methods to examp...

2014-04-29 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/584 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] spark pull request: SPARK-1588. Restore SPARK_YARN_USER_ENV and SP...

2014-04-29 Thread sryza
Github user sryza commented on the pull request: https://github.com/apache/spark/pull/586#issuecomment-41649723 This is indeed what I am suggesting. I had been testing against master, but just tried against 0.9.0 and hit the same error. --- If your project is set up for it,

[GitHub] spark pull request: SPARK-1544 Add support for deep decision trees...

2014-04-29 Thread mengxr
Github user mengxr commented on the pull request: https://github.com/apache/spark/pull/475#issuecomment-41650133 @manishamde Could you try to merge the latest master? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If

[GitHub] spark pull request: SPARK-1565, update examples to be used with sp...

2014-04-29 Thread ScrapCodes
Github user ScrapCodes commented on a diff in the pull request: https://github.com/apache/spark/pull/552#discussion_r12083016 --- Diff: examples/src/main/scala/org/apache/spark/examples/bagel/WikipediaPageRankStandalone.scala --- @@ -30,22 +30,15 @@ import

[GitHub] spark pull request: SPARK-1509: add zipWithIndex zipWithUniqueId m...

2014-04-29 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/423#issuecomment-41651537 Merged build finished. All automated tests passed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well.

[GitHub] spark pull request: SPARK-1509: add zipWithIndex zipWithUniqueId m...

2014-04-29 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/423#issuecomment-41651538 All automated tests passed. Refer to this link for build results: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/14561/ --- If your project

[GitHub] spark pull request: Args for worker rather than master

2014-04-29 Thread CrazyJvm
GitHub user CrazyJvm opened a pull request: https://github.com/apache/spark/pull/587 Args for worker rather than master Args for worker rather than master You can merge this pull request into a Git repository by running: $ git pull https://github.com/CrazyJvm/spark patch-6

[GitHub] spark pull request: Args for worker rather than master

2014-04-29 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/587#issuecomment-41652254 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: Args for worker rather than master

2014-04-29 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/587#issuecomment-41652259 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

[GitHub] spark pull request: Args for worker rather than master

2014-04-29 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/587#issuecomment-41654789 All automated tests passed. Refer to this link for build results: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/14562/ --- If your project

[GitHub] spark pull request: Args for worker rather than master

2014-04-29 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/587#issuecomment-41654788 Merged build finished. All automated tests passed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well.

[GitHub] spark pull request: [WIP][SPARK-1594][MLLIB] Cleaning up MLlib API...

2014-04-29 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/524#issuecomment-41656404 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: [WIP][SPARK-1594][MLLIB] Cleaning up MLlib API...

2014-04-29 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/524#issuecomment-41656408 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

[GitHub] spark pull request: [WIP][SPARK-1594][MLLIB] Cleaning up MLlib API...

2014-04-29 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/524#issuecomment-41656486 Refer to this link for build results: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/14563/ --- If your project is set up for it, you can

[GitHub] spark pull request: [WIP][SPARK-1594][MLLIB] Cleaning up MLlib API...

2014-04-29 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/524#issuecomment-41656485 Merged build finished. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: [WIP][SPARK-1594][MLLIB] Cleaning up MLlib API...

2014-04-29 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/524#issuecomment-41656750 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: [WIP][SPARK-1594][MLLIB] Cleaning up MLlib API...

2014-04-29 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/524#issuecomment-41656757 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

[GitHub] spark pull request: Update GradientDescentSuite.scala

2014-04-29 Thread baishuo
Github user baishuo commented on the pull request: https://github.com/apache/spark/pull/256#issuecomment-41657234 no problem @mengxr --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this

[GitHub] spark pull request: [WIP][SPARK-1594][MLLIB] Cleaning up MLlib API...

2014-04-29 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/524#issuecomment-41659133 Merged build finished. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: SPARK-1565, update examples to be used with sp...

2014-04-29 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/552#issuecomment-41661200 Build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

[GitHub] spark pull request: SPARK-1565, update examples to be used with sp...

2014-04-29 Thread ScrapCodes
Github user ScrapCodes commented on the pull request: https://github.com/apache/spark/pull/552#issuecomment-41662663 Do you want this change to go for streaming as well !, because for some things it may not make sense. And then how do people stop it ? --- If your project

[GitHub] spark pull request: SPARK-1565, update examples to be used with sp...

2014-04-29 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/552#issuecomment-41665951 Build finished. All automated tests passed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request: SPARK-1565, update examples to be used with sp...

2014-04-29 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/552#issuecomment-41665952 All automated tests passed. Refer to this link for build results: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/14565/ --- If your project

[GitHub] spark pull request: Update GradientDescentSuite.scala

2014-04-29 Thread techaddict
Github user techaddict commented on the pull request: https://github.com/apache/spark/pull/588#issuecomment-41685020 IMHO this will not compile if used like this `1 +: features`, Integers with DenseVector[Double]. Are you sure we want this change ? --- If your project is set up for

[GitHub] spark pull request: SPARK-1557 Set permissions on event log files/...

2014-04-29 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/538 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] spark pull request: SPARK-1588. Restore SPARK_YARN_USER_ENV and SP...

2014-04-29 Thread tgravescs
Github user tgravescs commented on the pull request: https://github.com/apache/spark/pull/586#issuecomment-41693222 The fix here works for me with the exception of the spark.authenticate config option which we are going to have to handle differently since it needs to be set properly

[GitHub] spark pull request: SPARK-1588. Restore SPARK_YARN_USER_ENV and SP...

2014-04-29 Thread tgravescs
Github user tgravescs commented on the pull request: https://github.com/apache/spark/pull/586#issuecomment-41693617 @pwendell There isn't any config that was added to replace SPARK_YARN_USER_ENV was there? I didn't see one but wanted to make sure I didn't miss it. We should file a

[GitHub] spark pull request: [SPARK-1631] Correctly set the Yarn app name w...

2014-04-29 Thread tgravescs
Github user tgravescs commented on the pull request: https://github.com/apache/spark/pull/539#issuecomment-41698198 I just tried setting SPARK_YARN_APP_NAME and its working fine for me without this patch with the yarn-client mode. I was just running the examples. Note that the

[GitHub] spark pull request: Update GradientDescentSuite.scala

2014-04-29 Thread mengxr
Github user mengxr commented on the pull request: https://github.com/apache/spark/pull/588#issuecomment-41698810 Should use `Vectors.dense(1.0 +: features)`, which may be faster than `Vectors.dense(1.0, features: _*)`, depending on how scala compiles the code. --- If your project is

[GitHub] spark pull request: [SPARK-1631] Correctly set the Yarn app name w...

2014-04-29 Thread vanzin
Github user vanzin commented on the pull request: https://github.com/apache/spark/pull/539#issuecomment-41698742 Hi Tom. SPARK_YARN_APP_NAME works fine. What doesn't work is when you do not set that env variable; in that case, the app name in the RM will always be Spark,

[GitHub] spark pull request: Update GradientDescentSuite.scala

2014-04-29 Thread techaddict
Github user techaddict commented on a diff in the pull request: https://github.com/apache/spark/pull/588#discussion_r12102671 --- Diff: mllib/src/test/scala/org/apache/spark/mllib/optimization/GradientDescentSuite.scala --- @@ -81,11 +81,11 @@ class GradientDescentSuite extends

[GitHub] spark pull request: Update GradientDescentSuite.scala

2014-04-29 Thread techaddict
Github user techaddict commented on a diff in the pull request: https://github.com/apache/spark/pull/588#discussion_r12102704 --- Diff: mllib/src/test/scala/org/apache/spark/mllib/optimization/GradientDescentSuite.scala --- @@ -81,11 +81,11 @@ class GradientDescentSuite extends

[GitHub] spark pull request: [SPARK-1631] Correctly set the Yarn app name w...

2014-04-29 Thread tgravescs
Github user tgravescs commented on the pull request: https://github.com/apache/spark/pull/539#issuecomment-41699194 Sorry somehow my browser wasn't showing a jira number and I missed the explanation there, thanks for adding an explanation here. It makes sense now. --- If

[GitHub] spark pull request: SPARK-1663. Corrections for several compile er...

2014-04-29 Thread srowen
GitHub user srowen opened a pull request: https://github.com/apache/spark/pull/589 SPARK-1663. Corrections for several compile errors in streaming code examples, and updates to follow API changes I gave the Streaming code examples, both Scala and Java, a test run today. I turned

[GitHub] spark pull request: Update GradientDescentSuite.scala

2014-04-29 Thread techaddict
Github user techaddict commented on the pull request: https://github.com/apache/spark/pull/588#issuecomment-41699346 @mengxr yupp that would be better. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does

[GitHub] spark pull request: SPARK-1663. Corrections for several compile er...

2014-04-29 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/589#issuecomment-41699381 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

[GitHub] spark pull request: SPARK-1663. Corrections for several compile er...

2014-04-29 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/589#issuecomment-41699365 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: SPARK-1588. Restore SPARK_YARN_USER_ENV and SP...

2014-04-29 Thread pwendell
Github user pwendell commented on the pull request: https://github.com/apache/spark/pull/586#issuecomment-41699497 @sryza @tgravescs Tom - if `spark.authenticate` is true, then is it not getting set directly when the executor is launched:

[GitHub] spark pull request: SPARK-1637: Clean up examples for 1.0

2014-04-29 Thread mengxr
Github user mengxr commented on the pull request: https://github.com/apache/spark/pull/571#issuecomment-41700284 I know this is a little weird, but either `org.apache.examples.spark` or `org.apache.spark_examples` can help prevent using `private[spark]` classes. --- If your project

[GitHub] spark pull request: SPARK-1637: Clean up examples for 1.0

2014-04-29 Thread techaddict
Github user techaddict commented on the pull request: https://github.com/apache/spark/pull/571#issuecomment-41701264 @mengxr IMO we should re-implement the necessary private functions in the examples, they are not too many just 2-3 methods. It will make using/modifying the examples

[GitHub] spark pull request: [SPARK-1631] Correctly set the Yarn app name w...

2014-04-29 Thread tgravescs
Github user tgravescs commented on the pull request: https://github.com/apache/spark/pull/539#issuecomment-41703171 This case you describe wasn't originally supported on yarn. Perhaps it should have been fixed up when sparkConf was added but it looks like it wasn't so I would

[GitHub] spark pull request: [SPARK-1631] Correctly set the Yarn app name w...

2014-04-29 Thread vanzin
Github user vanzin commented on the pull request: https://github.com/apache/spark/pull/539#issuecomment-41703467 I thought I looked at yarn-cluster mode and it was doing the right thing, but I'll look again. --- If your project is set up for it, you can reply to this email and have

[GitHub] spark pull request: SPARK-1663. Corrections for several compile er...

2014-04-29 Thread techaddict
Github user techaddict commented on the pull request: https://github.com/apache/spark/pull/589#issuecomment-41703565 @srowen scala error is related to #550 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project

[GitHub] spark pull request: SPARK-1588. Restore SPARK_YARN_USER_ENV and SP...

2014-04-29 Thread tgravescs
Github user tgravescs commented on the pull request: https://github.com/apache/spark/pull/586#issuecomment-41703827 @pwendell perhaps I'm missing something, the line you point to is for java options not for spark configs. SparkConf errors out if you try to put a -Dspark.authenticate

[GitHub] spark pull request: SPARK-1663. Corrections for several compile er...

2014-04-29 Thread techaddict
Github user techaddict commented on the pull request: https://github.com/apache/spark/pull/589#issuecomment-41704140 While using these methods we have to specify the parameter type for the reduceFunc.

  1   2   3   >