[GitHub] spark pull request: [SPARK-8866][SQL][WIP] use 1us precision for t...

2015-07-08 Thread rxin
Github user rxin commented on the pull request: https://github.com/apache/spark/pull/7283#issuecomment-119471716 Jenkins, add to whitelist. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

[GitHub] spark pull request: [SPARK-6123] [SPARK-6775] [SPARK-6776] [SQL] R...

2015-07-08 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/7231#issuecomment-119476219 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: [SPARK-6123] [SPARK-6775] [SPARK-6776] [SQL] R...

2015-07-08 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/7231#issuecomment-119476309 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: [SPARK-8402][MLLIB] DP Means Clustering

2015-07-08 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/6880#issuecomment-119486668 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request: [SPARK-8600] [ML] Naive Bayes API for spark.ml...

2015-07-08 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/7284#issuecomment-119494214 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: [SPARK-8247][SPARK-8249][SPARK-8252][SPARK-825...

2015-07-08 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/6762#issuecomment-119494142 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: [SPARK-6487][MLlib] Add sequential pattern min...

2015-07-08 Thread zhangjiajin
Github user zhangjiajin commented on a diff in the pull request: https://github.com/apache/spark/pull/7258#discussion_r34127138 --- Diff: mllib/src/main/scala/org/apache/spark/mllib/fpm/Prefixspan.scala --- @@ -0,0 +1,183 @@ +/* + * Licensed to the Apache Software

[GitHub] spark pull request: [SPARK-8269][SQL]string function: initcap

2015-07-08 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/7208#issuecomment-119501803 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: [SPARK-8867][SQL][WIP] Support list / describe...

2015-07-08 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/7259#issuecomment-119501809 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: [SPARK-8269][SQL]string function: initcap

2015-07-08 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/7208#issuecomment-119501683 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: [SPARK-8866][SQL][WIP] use 1us precision for t...

2015-07-08 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/7283#issuecomment-119510741 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: [SPARK-5523][Core][Streaming] Add a cache for ...

2015-07-08 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/5064#issuecomment-119510789 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: [SPARK-8840][SparkR] Add float coercion on Spa...

2015-07-08 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/7280#issuecomment-119510764 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: [SPARK-8866][SQL][WIP] use 1us precision for t...

2015-07-08 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/7283#issuecomment-119510866 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: [SPARK-8840][SparkR] Add float coercion on Spa...

2015-07-08 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/7280#issuecomment-119510872 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: [SPARK-5523][Core][Streaming] Add a cache for ...

2015-07-08 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/5064#issuecomment-119510878 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: [SPARK-8866][SQL][WIP] use 1us precision for t...

2015-07-08 Thread sarutak
Github user sarutak commented on the pull request: https://github.com/apache/spark/pull/7283#issuecomment-119511131 No problem. It works :) --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

[GitHub] spark pull request: [SPARK-6487][MLlib] Add sequential pattern min...

2015-07-08 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/7258#issuecomment-119516684 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request: [SPARK-6487][MLlib] Add sequential pattern min...

2015-07-08 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/7258#issuecomment-119516676 [Test build #36779 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/36779/console) for PR 7258 at commit

[GitHub] spark pull request: [SPARK-6797][SPARKR] Add support for YARN clus...

2015-07-08 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/6743#issuecomment-119526680 [Test build #36780 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/36780/consoleFull) for PR 6743 at commit

[GitHub] spark pull request: [SPARK-8881] Fix algorithm for scheduling exec...

2015-07-08 Thread srowen
Github user srowen commented on a diff in the pull request: https://github.com/apache/spark/pull/7274#discussion_r34131472 --- Diff: core/src/main/scala/org/apache/spark/deploy/master/Master.scala --- @@ -544,38 +544,60 @@ private[master] class Master( * has enough cores

[GitHub] spark pull request: [SPARK-8269][SQL]string function: initcap

2015-07-08 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/7208#issuecomment-119538858 [Test build #36775 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/36775/console) for PR 7208 at commit

[GitHub] spark pull request: [SPARK-8269][SQL]string function: initcap

2015-07-08 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/7208#issuecomment-119538892 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request: [SPARK-7050][build] Fix Python Kafka test asse...

2015-07-08 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/5632 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] spark pull request: [SPARK-6487][MLlib] Add sequential pattern min...

2015-07-08 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/7258#issuecomment-119546000 [Test build #36785 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/36785/console) for PR 7258 at commit

[GitHub] spark pull request: [SPARK-6797][SPARKR] Add support for YARN clus...

2015-07-08 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/6743#issuecomment-119547913 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request: [SPARK-7078] [SPARK-7079] [WIP] Binary process...

2015-07-08 Thread lianhuiwang
Github user lianhuiwang commented on a diff in the pull request: https://github.com/apache/spark/pull/6444#discussion_r34138865 --- Diff: core/src/main/java/org/apache/spark/util/collection/unsafe/sort/UnsafeSorterSpillReader.java --- @@ -0,0 +1,94 @@ +/* + * Licensed to

[GitHub] spark pull request: [SPARK-6487][MLlib] Add sequential pattern min...

2015-07-08 Thread zhangjiajin
Github user zhangjiajin commented on the pull request: https://github.com/apache/spark/pull/7258#issuecomment-119547968 @feynmanliang findPatternsLengthOne and getPatternsWithPrefix do the similar work, but the input data type is different. findPatternsLengthOne faces the entire RDD

[GitHub] spark pull request: [SPARK-8893] Add runtime checks against non-po...

2015-07-08 Thread srowen
Github user srowen commented on a diff in the pull request: https://github.com/apache/spark/pull/7285#discussion_r34137453 --- Diff: core/src/main/scala/org/apache/spark/rdd/CoalescedRDD.scala --- @@ -78,6 +78,10 @@ private[spark] class CoalescedRDD[T: ClassTag](

[GitHub] spark pull request: [SPARK-7078] [SPARK-7079] [WIP] Binary process...

2015-07-08 Thread lianhuiwang
Github user lianhuiwang commented on a diff in the pull request: https://github.com/apache/spark/pull/6444#discussion_r34137302 --- Diff: core/src/main/java/org/apache/spark/util/collection/unsafe/sort/UnsafeExternalSorter.java --- @@ -0,0 +1,281 @@ +/* + * Licensed to

[GitHub] spark pull request: [SPARK-8247][SPARK-8249][SPARK-8252][SPARK-825...

2015-07-08 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/6762#issuecomment-119547061 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: [SPARK-8247][SPARK-8249][SPARK-8252][SPARK-825...

2015-07-08 Thread chenghao-intel
Github user chenghao-intel commented on the pull request: https://github.com/apache/spark/pull/6762#issuecomment-119546905 retest this please --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

[GitHub] spark pull request: [SPARK-8866][SQL][WIP] use 1us precision for t...

2015-07-08 Thread cloud-fan
Github user cloud-fan commented on a diff in the pull request: https://github.com/apache/spark/pull/7283#discussion_r34139262 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/Cast.scala --- @@ -199,23 +199,23 @@ case class Cast(child: Expression,

[GitHub] spark pull request: [SPARK-7735] [pyspark] Raise Exception on non-...

2015-07-08 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/6262#issuecomment-119549951 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: [SPARK-8271][SQL]string function: soundex

2015-07-08 Thread cloud-fan
Github user cloud-fan commented on a diff in the pull request: https://github.com/apache/spark/pull/7115#discussion_r34139551 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/stringOperations.scala --- @@ -275,6 +276,24 @@ case class

[GitHub] spark pull request: [SPARK-8840][SparkR] Add float coercion on Spa...

2015-07-08 Thread viirya
Github user viirya commented on the pull request: https://github.com/apache/spark/pull/7280#issuecomment-119553717 retest this please. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this

[GitHub] spark pull request: [SPARK-8894][SPARKR][DOC] Example code errors ...

2015-07-08 Thread sun-rui
GitHub user sun-rui opened a pull request: https://github.com/apache/spark/pull/7287 [SPARK-8894][SPARKR][DOC] Example code errors in SparkR documentation. You can merge this pull request into a Git repository by running: $ git pull https://github.com/sun-rui/spark SPARK-8894

[GitHub] spark pull request: [SPARK-7944][SPARK-8013] Remove most of the Sp...

2015-07-08 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/6903#issuecomment-119556562 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: [SPARK-7735] [pyspark] Raise Exception on non-...

2015-07-08 Thread megatron-me-uk
Github user megatron-me-uk commented on the pull request: https://github.com/apache/spark/pull/6262#issuecomment-119549489 I have changed the implementation of the optional parameter to a boolean `checkCode` and updated the docstring to reflect that. --- If your project is set up

[GitHub] spark pull request: [SPARK-8271][SQL]string function: soundex

2015-07-08 Thread cloud-fan
Github user cloud-fan commented on the pull request: https://github.com/apache/spark/pull/7115#issuecomment-119553009 Is `soundex` a common function for string? If not, I think we should move related code to the soundex expression. --- If your project is set up for it, you can reply

[GitHub] spark pull request: [SPARK-8867][SQL][WIP] Support list / describe...

2015-07-08 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/7259#issuecomment-119555878 [Test build #36783 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/36783/console) for PR 7259 at commit

[GitHub] spark pull request: [SPARK-8867][SQL][WIP] Support list / describe...

2015-07-08 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/7259#issuecomment-119555907 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request: [SPARK-7944][SPARK-8013] Remove most of the Sp...

2015-07-08 Thread dragos
Github user dragos commented on the pull request: https://github.com/apache/spark/pull/6903#issuecomment-119556023 I removed spaces around imports (can't this be checked by ScalaStyle?). I noticed a few tests are looping on 2.11 (both on 2.11.6 and 2.11.7). I'll investigate

[GitHub] spark pull request: [SPARK-8894][SPARKR][DOC] Example code errors ...

2015-07-08 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/7287#issuecomment-119558323 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: [SPARK-6487][MLlib] Add sequential pattern min...

2015-07-08 Thread zhangjiajin
Github user zhangjiajin commented on the pull request: https://github.com/apache/spark/pull/7258#issuecomment-119564959 About the parallel method, I think method 2 performance is better than method 1.

[GitHub] spark pull request: [SPARK-8866][SQL][WIP] use 1us precision for t...

2015-07-08 Thread yijieshen
Github user yijieshen commented on a diff in the pull request: https://github.com/apache/spark/pull/7283#discussion_r34136638 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/Cast.scala --- @@ -199,23 +199,23 @@ case class Cast(child: Expression,

[GitHub] spark pull request: [SPARK-8068] [MLlib] Add confusionMatrix metho...

2015-07-08 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/7286#issuecomment-119543465 [Test build #36784 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/36784/console) for PR 7286 at commit

[GitHub] spark pull request: [SPARK-8753][SQL] Create an IntervalType data ...

2015-07-08 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/7226#issuecomment-119547051 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: [SPARK-8018][MLlib]KMeans should accept initia...

2015-07-08 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/6737#issuecomment-119554631 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: [SPARK-8840][SparkR] Add float coercion on Spa...

2015-07-08 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/7280#issuecomment-119554599 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: [SPARK-8271][SQL]string function: soundex

2015-07-08 Thread HuJiayin
Github user HuJiayin commented on the pull request: https://github.com/apache/spark/pull/7115#issuecomment-119555834 @cloud-fan The soundex is a common string encode function. You could find definition from wiki page. The original implementation in Apache common doesn't implement the

[GitHub] spark pull request: [SPARK-5523][Core][Streaming] Add a cache for ...

2015-07-08 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/5064#issuecomment-119540851 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request: [SPARK-5523][Core][Streaming] Add a cache for ...

2015-07-08 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/5064#issuecomment-119540780 [Test build #36778 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/36778/console) for PR 5064 at commit

[GitHub] spark pull request: [SPARK-8866][SQL][WIP] use 1us precision for t...

2015-07-08 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/7283#issuecomment-119542475 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: [SPARK-8068] [MLlib] Add confusionMatrix metho...

2015-07-08 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/7286#issuecomment-119540393 [Test build #36784 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/36784/consoleFull) for PR 7286 at commit

[GitHub] spark pull request: [SPARK-6487][MLlib] Add sequential pattern min...

2015-07-08 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/7258#issuecomment-119539675 [Test build #36785 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/36785/consoleFull) for PR 7258 at commit

[GitHub] spark pull request: [SPARK-7944][SPARK-8013] Remove most of the Sp...

2015-07-08 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/6903#issuecomment-119550063 [Test build #1006 has finished](https://amplab.cs.berkeley.edu/jenkins/job/NewSparkPullRequestBuilder/1006/console) for PR 6903 at commit

[GitHub] spark pull request: [SPARK-6797][SPARKR] Add support for YARN clus...

2015-07-08 Thread sun-rui
Github user sun-rui commented on the pull request: https://github.com/apache/spark/pull/6743#issuecomment-119559185 The unit test failure: [info] - Single command with -e *** FAILED *** (2 minutes, 18 seconds) [info] java.util.concurrent.TimeoutException: Futures timed out

[GitHub] spark pull request: [SPARK-8068] [MLlib] Add confusionMatrix metho...

2015-07-08 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/7286#issuecomment-119543512 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request: [SPARK-6487][MLlib] Add sequential pattern min...

2015-07-08 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/7258#issuecomment-119546057 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request: [SPARK-8840][SparkR] Add float coercion on Spa...

2015-07-08 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/7280#issuecomment-119547772 [Test build #36777 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/36777/console) for PR 7280 at commit

[GitHub] spark pull request: [SPARK-6797][SPARKR] Add support for YARN clus...

2015-07-08 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/6743#issuecomment-119547878 [Test build #36780 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/36780/console) for PR 6743 at commit

[GitHub] spark pull request: [SPARK-8840][SparkR] Add float coercion on Spa...

2015-07-08 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/7280#issuecomment-119547804 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request: [SPARK-8753][SQL] Create an IntervalType data ...

2015-07-08 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/7226#issuecomment-119548360 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: [SPARK-7944][SPARK-8013] Remove most of the Sp...

2015-07-08 Thread ScrapCodes
Github user ScrapCodes commented on the pull request: https://github.com/apache/spark/pull/6903#issuecomment-119558510 Yes, it can be. But enforcing it codebase wide is huge(+ unjustified, in the sense it affect code history) effort. See :

[GitHub] spark pull request: [SPARK-8591][CORE]Block failed to unroll to me...

2015-07-08 Thread dibbhatt
Github user dibbhatt commented on a diff in the pull request: https://github.com/apache/spark/pull/6990#discussion_r34142320 --- Diff: core/src/main/scala/org/apache/spark/storage/BlockManager.scala --- @@ -833,8 +833,10 @@ private[spark] class BlockManager( logDebug(Put

[GitHub] spark pull request: [SPARK-8866][SQL][WIP] use 1us precision for t...

2015-07-08 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/7283#issuecomment-119471364 Can one of the admins verify this patch? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request: Spark 7998 freq item api

2015-07-08 Thread rxin
Github user rxin commented on the pull request: https://github.com/apache/spark/pull/6919#issuecomment-119477645 Sorry need some time to think about this. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project

[GitHub] spark pull request: [SPARK-8866][SQL][WIP] use 1us precision for t...

2015-07-08 Thread rxin
Github user rxin commented on the pull request: https://github.com/apache/spark/pull/7283#issuecomment-119477063 Jenkins, test this please. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

[GitHub] spark pull request: [SPARK-8888][SQL] Use java.util.HashMap in Dyn...

2015-07-08 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/7282#issuecomment-119505110 [Test build #36763 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/36763/console) for PR 7282 at commit

[GitHub] spark pull request: [SPARK-8600] [ML] Naive Bayes API for spark.ml...

2015-07-08 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/7284#issuecomment-119507942 [Test build #36772 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/36772/console) for PR 7284 at commit

[GitHub] spark pull request: [SPARK-6487][MLlib] Add sequential pattern min...

2015-07-08 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/7258#issuecomment-119513877 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: [SPARK-6487][MLlib] Add sequential pattern min...

2015-07-08 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/7258#issuecomment-119513830 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: [SPARK-8884] [MLlib] 1-sample Anderson-Darling...

2015-07-08 Thread srowen
Github user srowen commented on a diff in the pull request: https://github.com/apache/spark/pull/7278#discussion_r34132604 --- Diff: mllib/src/main/scala/org/apache/spark/mllib/stat/test/ADTest.scala --- @@ -0,0 +1,269 @@ +/* + * Licensed to the Apache Software Foundation

[GitHub] spark pull request: [SPARK-7944][SPARK-8013] Remove most of the Sp...

2015-07-08 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/6903#issuecomment-119530772 [Test build #1006 has started](https://amplab.cs.berkeley.edu/jenkins/job/NewSparkPullRequestBuilder/1006/consoleFull) for PR 6903 at commit

[GitHub] spark pull request: [SPARK-6487][MLlib] Add sequential pattern min...

2015-07-08 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/7258#issuecomment-119533447 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: [SPARK-6487][MLlib] Add sequential pattern min...

2015-07-08 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/7258#issuecomment-119533465 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: [SPARK-8881] Fix algorithm for scheduling exec...

2015-07-08 Thread nishkamravi2
Github user nishkamravi2 commented on a diff in the pull request: https://github.com/apache/spark/pull/7274#discussion_r34134630 --- Diff: core/src/main/scala/org/apache/spark/deploy/master/Master.scala --- @@ -544,38 +544,60 @@ private[master] class Master( * has enough

[GitHub] spark pull request: [SPARK-8866][SQL][WIP] use 1us precision for t...

2015-07-08 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/7283#issuecomment-119535362 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request: [SPARK-8866][SQL][WIP] use 1us precision for t...

2015-07-08 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/7283#issuecomment-119535270 [Test build #36776 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/36776/console) for PR 7283 at commit

[GitHub] spark pull request: [SPARK-8893] Add runtime checks against non-po...

2015-07-08 Thread darabos
GitHub user darabos opened a pull request: https://github.com/apache/spark/pull/7285 [SPARK-8893] Add runtime checks against non-positive number of partitions https://issues.apache.org/jira/browse/SPARK-8893 What does `sc.parallelize(1 to 3).repartition(p).collect` return?

[GitHub] spark pull request: [SPARK-8867][SQL][WIP] Support list / describe...

2015-07-08 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/7259#issuecomment-119539187 [Test build #36783 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/36783/consoleFull) for PR 7259 at commit

[GitHub] spark pull request: [SPARK-8068] [MLlib] Add confusionMatrix metho...

2015-07-08 Thread yanboliang
GitHub user yanboliang opened a pull request: https://github.com/apache/spark/pull/7286 [SPARK-8068] [MLlib] Add confusionMatrix method at class MulticlassMetrics in pyspark/mllib Add confusionMatrix method at class MulticlassMetrics in pyspark/mllib You can merge this pull

[GitHub] spark pull request: [SPARK-8811][SQL] Read array struct data from ...

2015-07-08 Thread liancheng
Github user liancheng commented on a diff in the pull request: https://github.com/apache/spark/pull/7209#discussion_r34122206 --- Diff: sql/core/src/test/scala/org/apache/spark/sql/parquet/ParquetSchemaSuite.scala --- @@ -478,11 +478,12 @@ class ParquetSchemaSuite extends

[GitHub] spark pull request: [SPARK-6487][MLlib] Add sequential pattern min...

2015-07-08 Thread zhangjiajin
Github user zhangjiajin commented on a diff in the pull request: https://github.com/apache/spark/pull/7258#discussion_r34123210 --- Diff: mllib/src/test/scala/org/apache/spark/mllib/fpm/PrefixspanSuite.scala --- @@ -0,0 +1,47 @@ +/* + * Licensed to the Apache Software

[GitHub] spark pull request: [SPARK-8269][SQL]string function: initcap

2015-07-08 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/7208#issuecomment-119485728 [Test build #36770 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/36770/consoleFull) for PR 7208 at commit

[GitHub] spark pull request: [SPARK-7078] [SPARK-7079] [WIP] Binary process...

2015-07-08 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/6444#issuecomment-119485586 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request: [SPARK-8867][SQL][WIP] Support list / describe...

2015-07-08 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/7259#issuecomment-119503215 [Test build #36774 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/36774/consoleFull) for PR 7259 at commit

[GitHub] spark pull request: [SPARK-5523][Core][Streaming] Add a cache for ...

2015-07-08 Thread jerryshao
GitHub user jerryshao reopened a pull request: https://github.com/apache/spark/pull/5064 [SPARK-5523][Core][Streaming] Add a cache for hostname in TaskMetrics to decrease the memory usage and GC overhead Hostname in TaskMetrics will be created through deserialization, mostly the

[GitHub] spark pull request: [SPARK-5523][Core][Streaming] Add a cache for ...

2015-07-08 Thread jerryshao
Github user jerryshao commented on the pull request: https://github.com/apache/spark/pull/5064#issuecomment-119508679 Hi @tdas and @andrewor14 , I tested a lot on the memory consumption of `TaskMetrics` and related `_hostname` string. Here I use `DirectKafkaWordCount` as test

[GitHub] spark pull request: [SPARK-6487][MLlib] Add sequential pattern min...

2015-07-08 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/7258#issuecomment-119516043 [Test build #36779 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/36779/consoleFull) for PR 7258 at commit

[GitHub] spark pull request: [SPARK-6797][SPARKR] Add support for YARN clus...

2015-07-08 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/6743#issuecomment-119519835 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request: [SPARK-6797][SPARKR] Add support for YARN clus...

2015-07-08 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/6743#issuecomment-119519707 [Test build #36765 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/36765/console) for PR 6743 at commit

[GitHub] spark pull request: [SPARK-8884] [MLlib] 1-sample Anderson-Darling...

2015-07-08 Thread srowen
Github user srowen commented on a diff in the pull request: https://github.com/apache/spark/pull/7278#discussion_r34132525 --- Diff: mllib/src/main/scala/org/apache/spark/mllib/stat/Statistics.scala --- @@ -158,4 +158,32 @@ object Statistics { def chiSqTest(data:

[GitHub] spark pull request: [SPARK-8884] [MLlib] 1-sample Anderson-Darling...

2015-07-08 Thread srowen
Github user srowen commented on a diff in the pull request: https://github.com/apache/spark/pull/7278#discussion_r34132481 --- Diff: docs/mllib-statistics.md --- @@ -335,8 +335,8 @@ featureTestResults.foreach { result = div data-lang=java markdown=1

[GitHub] spark pull request: [SPARK-8269][SQL]string function: initcap

2015-07-08 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/7208#issuecomment-119531286 [Test build #36770 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/36770/console) for PR 7208 at commit

[GitHub] spark pull request: [SPARK-6487][MLlib] Add sequential pattern min...

2015-07-08 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/7258#issuecomment-119534503 [Test build #36782 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/36782/console) for PR 7258 at commit

[GitHub] spark pull request: [SPARK-6487][MLlib] Add sequential pattern min...

2015-07-08 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/7258#issuecomment-119534512 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request: [SPARK-7050][build] Fix Python Kafka test asse...

2015-07-08 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/5632#issuecomment-119534801 [Test build #1007 has finished](https://amplab.cs.berkeley.edu/jenkins/job/NewSparkPullRequestBuilder/1007/console) for PR 5632 at commit

[GitHub] spark pull request: [SPARK-6487][MLlib] Add sequential pattern min...

2015-07-08 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/7258#issuecomment-119537202 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

  1   2   3   4   5   6   7   8   9   10   >