[GitHub] spark pull request: [SPARK-10974][Streaming]Add progress bar for o...

2015-10-12 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9010#issuecomment-147298368 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: [SPARK-11055][SQL] Use mixing hash-based and s...

2015-10-12 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9067#issuecomment-147298428 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request: [SPARK-10974][Streaming]Add progress bar for o...

2015-10-12 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9010#issuecomment-147298371 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: [SPARK-11051][Core] Do not allow local checkpo...

2015-10-12 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/9072#issuecomment-147301286 [Test build #43560 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/43560/consoleFull) for PR 9072 at commit

[GitHub] spark pull request: [SPARK-11051][Core] Do not allow local checkpo...

2015-10-12 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/9072#issuecomment-147326801 [Test build #43560 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/43560/console) for PR 9072 at commit

[GitHub] spark pull request: [SPARK-11051][Core] Do not allow local checkpo...

2015-10-12 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9072#issuecomment-147326864 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] spark pull request: [SPARK-11051][Core] Do not allow local checkpo...

2015-10-12 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9072#issuecomment-147326863 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request: [SPARK-11051][Core] Do not allow local checkpo...

2015-10-12 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9072#issuecomment-147301029 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: [SPARK-11029] [ML] Add computeCost to KMeansMo...

2015-10-12 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9073#issuecomment-147309315 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: [SPARK-11029] [ML] Add computeCost to KMeansMo...

2015-10-12 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/9073#issuecomment-147310580 [Test build #43562 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/43562/consoleFull) for PR 9073 at commit

[GitHub] spark pull request: [SPARK-10958] Use json4s 3.3.0. Formats is now...

2015-10-12 Thread srowen
Github user srowen commented on the pull request: https://github.com/apache/spark/pull/8992#issuecomment-147313013 Sounds good. IIRC it used more Jackson artifacts than Spark does, so excluding all of them might leave it lacking a library it needs. If so the solution would be to just

[GitHub] spark pull request: [SPARK-11060][Streaming] Fix some potential NP...

2015-10-12 Thread srowen
Github user srowen commented on a diff in the pull request: https://github.com/apache/spark/pull/9070#discussion_r41731525 --- Diff: streaming/src/main/scala/org/apache/spark/streaming/dstream/ConstantInputDStream.scala --- @@ -27,6 +28,9 @@ import scala.reflect.ClassTag

[GitHub] spark pull request: [SPARK-11060][Streaming] Fix some potential NP...

2015-10-12 Thread jerryshao
Github user jerryshao commented on a diff in the pull request: https://github.com/apache/spark/pull/9070#discussion_r41732138 --- Diff: streaming/src/main/scala/org/apache/spark/streaming/dstream/TransformedDStream.scala --- @@ -39,7 +39,10 @@ class TransformedDStream[U:

[GitHub] spark pull request: [SPARK-2251] fix concurrency issues in random ...

2015-10-12 Thread srowen
Github user srowen commented on the pull request: https://github.com/apache/spark/pull/1229#issuecomment-147326922 @pauloangelo sounds like your RDD is not immutable then, in which case many bets are off. RDDs are generally always the same whenever you compute them. --- If your

[GitHub] spark pull request: [SPARK-11029] [ML] Add computeCost to KMeansMo...

2015-10-12 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9073#issuecomment-147323575 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request: [SPARK-10668][ML] Use WeightedLeastSquares in ...

2015-10-12 Thread Lewuathe
Github user Lewuathe commented on the pull request: https://github.com/apache/spark/pull/8884#issuecomment-147323507 @dbtsai I rebased master and updated. Could you check it again? Thank you. --- If your project is set up for it, you can reply to this email and have your reply appear

[GitHub] spark pull request: [SPARK-11055][SQL] Use mixing hash-based and s...

2015-10-12 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9067#issuecomment-147298737 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: [SPARK-11055][SQL] Use mixing hash-based and s...

2015-10-12 Thread viirya
Github user viirya commented on the pull request: https://github.com/apache/spark/pull/9067#issuecomment-147298690 retest this please. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this

[GitHub] spark pull request: [SPARK-11055][SQL] Use mixing hash-based and s...

2015-10-12 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9067#issuecomment-147298751 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: [SPARK-10973][ML][PYTHON] __gettitem__ method ...

2015-10-12 Thread jkbradley
Github user jkbradley commented on the pull request: https://github.com/apache/spark/pull/9009#issuecomment-147308172 Yes, please. Thanks! --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

[GitHub] spark pull request: Branch 1.5

2015-10-12 Thread srowen
Github user srowen commented on the pull request: https://github.com/apache/spark/pull/9071#issuecomment-147300348 Would you mind closing this PR? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: [SPARK-11029] [ML] Add computeCost to KMeansMo...

2015-10-12 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9073#issuecomment-147309298 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: [SPARK-11029] [ML] Add computeCost to KMeansMo...

2015-10-12 Thread hhbyyh
GitHub user hhbyyh opened a pull request: https://github.com/apache/spark/pull/9073 [SPARK-11029] [ML] Add computeCost to KMeansModel in spark.ml jira: https://issues.apache.org/jira/browse/SPARK-11029 We should add a method analogous to

[GitHub] spark pull request: [SPARK-11029] [ML] Add computeCost to KMeansMo...

2015-10-12 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9073#issuecomment-147323578 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] spark pull request: [SPARK-11029] [ML] Add computeCost to KMeansMo...

2015-10-12 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/9073#issuecomment-147323392 [Test build #43562 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/43562/console) for PR 9073 at commit

[GitHub] spark pull request: [SPARK-10974][Streaming]Add progress bar for o...

2015-10-12 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/9010#issuecomment-147298906 [Test build #43558 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/43558/consoleFull) for PR 9010 at commit

[GitHub] spark pull request: [SPARK-11055][SQL] Use mixing hash-based and s...

2015-10-12 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/9067#issuecomment-147298785 [Test build #43559 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/43559/consoleFull) for PR 9067 at commit

[GitHub] spark pull request: [SPARK-10958] Use json4s 3.3.0. Formats is now...

2015-10-12 Thread tylerprete
Github user tylerprete commented on the pull request: https://github.com/apache/spark/pull/8992#issuecomment-147300513 @srowen I'll exclude jackson from json4s's transitive dependencies and see if everything plays nice. That seems more tractable than tackling updating jackson for all

[GitHub] spark pull request: [SPARK-10974][Streaming]Add progress bar for o...

2015-10-12 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9010#issuecomment-147306040 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] spark pull request: [SPARK-10974][Streaming]Add progress bar for o...

2015-10-12 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9010#issuecomment-147306039 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request: [SPARK-10393] use ML pipeline in LDA example

2015-10-12 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/8551#issuecomment-147305874 [Test build #43561 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/43561/consoleFull) for PR 8551 at commit

[GitHub] spark pull request: [SPARK-10974][Streaming]Add progress bar for o...

2015-10-12 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/9010#issuecomment-147305902 [Test build #43558 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/43558/console) for PR 9010 at commit

[GitHub] spark pull request: [SPARK-11060][Streaming] Fix some potential NP...

2015-10-12 Thread srowen
Github user srowen commented on a diff in the pull request: https://github.com/apache/spark/pull/9070#discussion_r41731681 --- Diff: streaming/src/main/scala/org/apache/spark/streaming/dstream/TransformedDStream.scala --- @@ -39,7 +39,10 @@ class TransformedDStream[U: ClassTag] (

[GitHub] spark pull request: [SPARK-11055][SQL] Use mixing hash-based and s...

2015-10-12 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9067#issuecomment-147298429 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] spark pull request: [SPARK-11055][SQL] Use mixing hash-based and s...

2015-10-12 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/9067#issuecomment-147298405 [Test build #43557 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/43557/console) for PR 9067 at commit

[GitHub] spark pull request: [SPARK-10393] use ML pipeline in LDA example

2015-10-12 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/8551#issuecomment-147304573 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: [SPARK-10393] use ML pipeline in LDA example

2015-10-12 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/8551#issuecomment-147304561 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: [SPARK-10393] use ML pipeline in LDA example

2015-10-12 Thread hhbyyh
Github user hhbyyh commented on the pull request: https://github.com/apache/spark/pull/8551#issuecomment-147304609 @feynmanliang @jkbradley Sorry for the late update. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If

[GitHub] spark pull request: [SPARK-11055][SQL] Use mixing hash-based and s...

2015-10-12 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/9067#issuecomment-147324890 [Test build #43559 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/43559/console) for PR 9067 at commit

[GitHub] spark pull request: [SPARK-11055][SQL] Use mixing hash-based and s...

2015-10-12 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9067#issuecomment-147325034 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request: [SPARK-11055][SQL] Use mixing hash-based and s...

2015-10-12 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9067#issuecomment-147325035 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] spark pull request: [SPARK-11063][Streaming]Change preferredLocati...

2015-10-12 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9075#issuecomment-147332103 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: [SPARK-11063][Streaming]Change preferredLocati...

2015-10-12 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/9075#issuecomment-147354342 [Test build #43564 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/43564/console) for PR 9075 at commit

[GitHub] spark pull request: [SPARK-11051][Core] Do not allow local checkpo...

2015-10-12 Thread srowen
Github user srowen commented on a diff in the pull request: https://github.com/apache/spark/pull/9072#discussion_r41734082 --- Diff: core/src/main/scala/org/apache/spark/rdd/RDD.scala --- @@ -1521,8 +1521,15 @@ abstract class RDD[T: ClassTag]( }

[GitHub] spark pull request: [SPARK-11062] Thrift server does not support o...

2015-10-12 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9074#issuecomment-147330070 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: [SPARK-11062] Thrift server does not support o...

2015-10-12 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9074#issuecomment-147330040 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: [SPARK-11062] Thrift server does not support o...

2015-10-12 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9074#issuecomment-147341954 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] spark pull request: [SPARK-11062] Thrift server does not support o...

2015-10-12 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9074#issuecomment-147341952 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request: [SPARK-11060][Streaming] Fix some potential NP...

2015-10-12 Thread srowen
Github user srowen commented on a diff in the pull request: https://github.com/apache/spark/pull/9070#discussion_r41733627 --- Diff: streaming/src/main/scala/org/apache/spark/streaming/dstream/TransformedDStream.scala --- @@ -39,7 +39,10 @@ class TransformedDStream[U: ClassTag] (

[GitHub] spark pull request: [SPARK-11063][Streaming]Change preferredLocati...

2015-10-12 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/9075#issuecomment-147335370 [Test build #43564 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/43564/consoleFull) for PR 9075 at commit

[GitHub] spark pull request: [SPARK-11051][Core] Do not allow local checkpo...

2015-10-12 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/9072#issuecomment-147338950 [Test build #43565 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/43565/consoleFull) for PR 9072 at commit

[GitHub] spark pull request: [SPARK-11051][Core] Do not allow local checkpo...

2015-10-12 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9072#issuecomment-147364367 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request: [SPARK-11051][Core] Do not allow local checkpo...

2015-10-12 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9072#issuecomment-147364369 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] spark pull request: [SPARK-11051][Core] Do not allow local checkpo...

2015-10-12 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/9072#issuecomment-147364329 [Test build #43565 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/43565/console) for PR 9072 at commit

[GitHub] spark pull request: [SPARK-11051][Core] Do not allow local checkpo...

2015-10-12 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9072#issuecomment-147365411 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: [SPARK-11051][Core] Do not allow local checkpo...

2015-10-12 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/9072#issuecomment-147365490 [Test build #43566 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/43566/consoleFull) for PR 9072 at commit

[GitHub] spark pull request: [SPARK-11051][Core] Do not allow local checkpo...

2015-10-12 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9072#issuecomment-147365440 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: [SPARK-11062] Thrift server does not support o...

2015-10-12 Thread navis
GitHub user navis opened a pull request: https://github.com/apache/spark/pull/9074 [SPARK-11062] Thrift server does not support operationLog Currently, SparkExecuteStatementOperation is skipping beforeRun/afterRun method. You can merge this pull request into a Git repository by

[GitHub] spark pull request: [SPARK-11056] Improve documentation of SBT bui...

2015-10-12 Thread srowen
Github user srowen commented on the pull request: https://github.com/apache/spark/pull/9068#issuecomment-147327076 Seems fine to me, because of the pointer to more info. I don't know what the right breakdown is between info on this page and on the wiki; I suppose all in one place

[GitHub] spark pull request: [SPARK-11063][Streaming]Change preferredLocati...

2015-10-12 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9075#issuecomment-147332022 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: [SPARK-11062] Thrift server does not support o...

2015-10-12 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/9074#issuecomment-147341866 [Test build #43563 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/43563/console) for PR 9074 at commit

[GitHub] spark pull request: [SPARK-11062] Thrift server does not support o...

2015-10-12 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/9074#issuecomment-147331430 [Test build #43563 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/43563/consoleFull) for PR 9074 at commit

[GitHub] spark pull request: [SPARK-11051][Core] Do not allow local checkpo...

2015-10-12 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9072#issuecomment-147335906 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: [SPARK-11051][Core] Do not allow local checkpo...

2015-10-12 Thread viirya
Github user viirya commented on the pull request: https://github.com/apache/spark/pull/9072#issuecomment-147364822 retest this please. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this

[GitHub] spark pull request: [SPARK-11063][Streaming]Change preferredLocati...

2015-10-12 Thread zsxwing
GitHub user zsxwing opened a pull request: https://github.com/apache/spark/pull/9075 [SPARK-11063][Streaming]Change preferredLocations of Receiver's RDD to hosts rather than hostports The format of RDD's preferredLocations must be hostname but the format of Streaming Receiver's

[GitHub] spark pull request: [SPARK-11051][Core] Do not allow local checkpo...

2015-10-12 Thread viirya
Github user viirya commented on the pull request: https://github.com/apache/spark/pull/9072#issuecomment-147335883 retest this please. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this

[GitHub] spark pull request: [SPARK-11051][Core] Do not allow local checkpo...

2015-10-12 Thread viirya
Github user viirya commented on a diff in the pull request: https://github.com/apache/spark/pull/9072#discussion_r41736088 --- Diff: core/src/main/scala/org/apache/spark/rdd/RDD.scala --- @@ -1521,8 +1521,15 @@ abstract class RDD[T: ClassTag]( }

[GitHub] spark pull request: [SPARK-11051][Core] Do not allow local checkpo...

2015-10-12 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9072#issuecomment-147335942 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: [SPARK-11063][Streaming]Change preferredLocati...

2015-10-12 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9075#issuecomment-147354463 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request: [SPARK-11063][Streaming]Change preferredLocati...

2015-10-12 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9075#issuecomment-147354464 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] spark pull request: [spark-11026][yarn]spark.yarn.user.classpath.f...

2015-10-12 Thread lianhuiwang
Github user lianhuiwang commented on the pull request: https://github.com/apache/spark/pull/9045#issuecomment-147439210 @tgravescs if use --jars hdfs://users/foo.jar, now i can not put foo.jar into the system classpath without this PR. --- If your project is set up for it, you can

[GitHub] spark pull request: [SPARK-10930] Adds max task duration to all st...

2015-10-12 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9051#issuecomment-147439789 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] spark pull request: [SPARK-11042] [SQL] Add a mechanism to ban cre...

2015-10-12 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9058#issuecomment-147458321 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: [SPARK-11051][Core] Do not allow local checkpo...

2015-10-12 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9072#issuecomment-147301019 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: [SPARK-11051][Core] Do not allow local checkpo...

2015-10-12 Thread viirya
GitHub user viirya opened a pull request: https://github.com/apache/spark/pull/9072 [SPARK-11051][Core] Do not allow local checkpointing after the RDD is materialized and checkpointed JIRA: https://issues.apache.org/jira/browse/SPARK-11051 When a `RDD` is materialized and

[GitHub] spark pull request: [SPARK-10852][PySpark][SQL] Override built-in ...

2015-10-12 Thread viirya
Github user viirya commented on the pull request: https://github.com/apache/spark/pull/8934#issuecomment-147303344 ping @davies How about this updated version? Or you still think it is not worth due to the possible performance regressions? As in this version it only looks for `count`

[GitHub] spark pull request: [SPARK-10393] use ML pipeline in LDA example

2015-10-12 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/8551#issuecomment-147310376 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request: [SPARK-10393] use ML pipeline in LDA example

2015-10-12 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/8551#issuecomment-147310378 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] spark pull request: [SPARK-10393] use ML pipeline in LDA example

2015-10-12 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/8551#issuecomment-147310348 [Test build #43561 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/43561/console) for PR 8551 at commit

[GitHub] spark pull request: [Spark-8426] [scheduler] enhance blacklist mec...

2015-10-12 Thread mwws
Github user mwws commented on the pull request: https://github.com/apache/spark/pull/8760#issuecomment-147312498 @andrewor14 , could you also help review and comment. Thanks in advance. --- If your project is set up for it, you can reply to this email and have your reply appear on

[GitHub] spark pull request: [SPARK-11060][Streaming] Fix some potential NP...

2015-10-12 Thread jerryshao
Github user jerryshao commented on a diff in the pull request: https://github.com/apache/spark/pull/9070#discussion_r41731988 --- Diff: streaming/src/main/scala/org/apache/spark/streaming/dstream/TransformedDStream.scala --- @@ -39,7 +39,10 @@ class TransformedDStream[U:

[GitHub] spark pull request: SPARK-10876 - Display total uptime for complet...

2015-10-12 Thread srowen
Github user srowen commented on a diff in the pull request: https://github.com/apache/spark/pull/9059#discussion_r41768301 --- Diff: core/src/main/scala/org/apache/spark/ui/jobs/AllJobsPage.scala --- @@ -289,13 +290,14 @@ private[ui] class AllJobsPage(parent: JobsTab) extends

[GitHub] spark pull request: [SPARK-11052] Spaces in the build dir causes f...

2015-10-12 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/9065#issuecomment-147440268 [Test build #1876 has started](https://amplab.cs.berkeley.edu/jenkins/job/NewSparkPullRequestBuilder/1876/consoleFull) for PR 9065 at commit

[GitHub] spark pull request: [SPARK-10930] Adds max task duration to all st...

2015-10-12 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/9051#issuecomment-147439696 [Test build #43568 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/43568/console) for PR 9051 at commit

[GitHub] spark pull request: Update DAGScheduler's "misbehaved ResultHandle...

2015-10-12 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9076#issuecomment-147445583 Can one of the admins verify this patch? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request: [SPARK-10960][SQL] SQL with windowing function...

2015-10-12 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/9011 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] spark pull request: SPARK-10876 - Display total uptime for complet...

2015-10-12 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/9059#issuecomment-147439152 [Test build #1875 has started](https://amplab.cs.berkeley.edu/jenkins/job/NewSparkPullRequestBuilder/1875/consoleFull) for PR 9059 at commit

[GitHub] spark pull request: SPARK-10771: Implement the shuffle encryption ...

2015-10-12 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/8880#issuecomment-147441714 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: SPARK-10771: Implement the shuffle encryption ...

2015-10-12 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/8880#issuecomment-147443941 [Test build #43569 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/43569/consoleFull) for PR 8880 at commit

[GitHub] spark pull request: [SPARK-10515] When killing executor, the pendi...

2015-10-12 Thread vanzin
Github user vanzin commented on a diff in the pull request: https://github.com/apache/spark/pull/8945#discussion_r41775279 --- Diff: core/src/test/scala/org/apache/spark/deploy/StandaloneDynamicAllocationSuite.scala --- @@ -369,6 +369,38 @@ class StandaloneDynamicAllocationSuite

[GitHub] spark pull request: [SPARK-11042] [SQL] Add a mechanism to ban cre...

2015-10-12 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9058#issuecomment-147458335 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: [SPARK-10930] Adds max task duration to all st...

2015-10-12 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9051#issuecomment-147439788 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request: [SPARK-11052] Spaces in the build dir causes f...

2015-10-12 Thread srowen
Github user srowen commented on a diff in the pull request: https://github.com/apache/spark/pull/9065#discussion_r41768863 --- Diff: make-distribution.sh --- @@ -121,7 +121,7 @@ if [ $(command -v git) ]; then fi -if [ ! $(command -v "$MVN") ] ; then +if [ !

[GitHub] spark pull request: SPARK-10771: Implement the shuffle encryption ...

2015-10-12 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/8880#issuecomment-147441746 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: Update DAGScheduler's "misbehaved ResultHandle...

2015-10-12 Thread shellberg
GitHub user shellberg opened a pull request: https://github.com/apache/spark/pull/9076 Update DAGScheduler's "misbehaved ResultHandler" Restrict tasks (of job) to only 1 to ensure that the causing Exception asserted for job failure is the deliberately thrown

[GitHub] spark pull request: [SPARK-10960][SQL] SQL with windowing function...

2015-10-12 Thread viirya
Github user viirya commented on a diff in the pull request: https://github.com/apache/spark/pull/9011#discussion_r41773979 --- Diff: sql/hive/src/test/scala/org/apache/spark/sql/hive/execution/SQLQuerySuite.scala --- @@ -833,6 +833,33 @@ class SQLQuerySuite extends QueryTest with

[GitHub] spark pull request: [spark-11026][yarn]spark.yarn.user.classpath.f...

2015-10-12 Thread tgravescs
Github user tgravescs commented on the pull request: https://github.com/apache/spark/pull/9045#issuecomment-147451561 ah I understand now, thanks. I'll take a look --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request: [SPARK-11042] [SQL] Add a mechanism to ban cre...

2015-10-12 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9058#issuecomment-147452580 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: [SPARK-11042] [SQL] Add a mechanism to ban cre...

2015-10-12 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9058#issuecomment-147452546 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: SPARK-10876 - Display total uptime for complet...

2015-10-12 Thread sarutak
Github user sarutak commented on the pull request: https://github.com/apache/spark/pull/9059#issuecomment-147448778 I applied your patch and I noticed you didn't care the case we watch the status of incomplete apps through the history server. Sometimes, apps are marked as

  1   2   3   4   5   6   7   >