[GitHub] spark pull request: [SPARK-2815]: Compilation failed upon the hado...

2014-09-18 Thread witgo
Github user witgo commented on the pull request: https://github.com/apache/spark/pull/1754#issuecomment-55998415 @pwendell I have updated the regular expression. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request: [SPARK-2815]: Compilation failed upon the hado...

2014-09-18 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/1754#issuecomment-55998761 [QA tests have started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/20526/consoleFull) for PR 1754 at commit

[GitHub] spark pull request: SPARK-3579 Jekyll doc generation is different ...

2014-09-18 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/2443#issuecomment-55999096 [QA tests have finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/20524/consoleFull) for PR 2443 at commit

[GitHub] spark pull request: [SPARK-2594][SQL] Support CACHE TABLE name A...

2014-09-18 Thread liancheng
Github user liancheng commented on a diff in the pull request: https://github.com/apache/spark/pull/2397#discussion_r17710806 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/commands.scala --- @@ -166,3 +166,20 @@ case class DescribeCommand(child: SparkPlan,

[GitHub] spark pull request: [SPARK-3547]Using a special exit code instead ...

2014-09-18 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/2421#issuecomment-55999652 [QA tests have finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/20525/consoleFull) for PR 2421 at commit

[GitHub] spark pull request: [SPARK-3418] Sparse Matrix support (CCS) and a...

2014-09-18 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/2294#issuecomment-56001230 [QA tests have started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/20527/consoleFull) for PR 2294 at commit

[GitHub] spark pull request: [SPARK-2594][SQL] Support CACHE TABLE name A...

2014-09-18 Thread ravipesala
Github user ravipesala commented on a diff in the pull request: https://github.com/apache/spark/pull/2397#discussion_r17711807 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/commands.scala --- @@ -166,3 +166,20 @@ case class DescribeCommand(child: SparkPlan,

[GitHub] spark pull request: [SPARK-2594][SQL] Support CACHE TABLE name A...

2014-09-18 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/2397#issuecomment-56001845 [QA tests have started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/20528/consoleFull) for PR 2397 at commit

[GitHub] spark pull request: [SPARK-2594][SQL] Support CACHE TABLE name A...

2014-09-18 Thread ravipesala
Github user ravipesala commented on the pull request: https://github.com/apache/spark/pull/2397#issuecomment-56001847 Updated as per comments. Please review. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request: [SPARK-3407][SQL]Add Date type support

2014-09-18 Thread adrian-wang
Github user adrian-wang commented on a diff in the pull request: https://github.com/apache/spark/pull/2344#discussion_r17711980 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/analysis/HiveTypeCoercion.scala --- @@ -221,19 +221,35 @@ trait HiveTypeCoercion {

[GitHub] spark pull request: [SPARK-3566] [BUILD] .gitignore and .rat-exclu...

2014-09-18 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/2426#issuecomment-56002947 [QA tests have started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/20529/consoleFull) for PR 2426 at commit

[GitHub] spark pull request: [SPARK-3074] [PySpark] support groupByKey() wi...

2014-09-18 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/1977#issuecomment-56002944 [QA tests have started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/20530/consoleFull) for PR 1977 at commit

[GitHub] spark pull request: [SPARK-2815]: Compilation failed upon the hado...

2014-09-18 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/1754#issuecomment-56003311 [QA tests have finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/20526/consoleFull) for PR 1754 at commit

[GitHub] spark pull request: [SPARK-3543] Write TaskContext in Java and exp...

2014-09-18 Thread ScrapCodes
Github user ScrapCodes commented on a diff in the pull request: https://github.com/apache/spark/pull/2425#discussion_r17712697 --- Diff: core/src/main/java/org/apache/spark/TaskContext.java --- @@ -0,0 +1,234 @@ +/* + * Licensed to the Apache Software Foundation (ASF) under

[GitHub] spark pull request: [SPARK-3578] Fix upper bound in GraphGenerator...

2014-09-18 Thread ankurdave
Github user ankurdave commented on the pull request: https://github.com/apache/spark/pull/2439#issuecomment-56004216 @rxin --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark pull request: [SPARK-3074] [PySpark] support groupByKey() wi...

2014-09-18 Thread davies
Github user davies commented on the pull request: https://github.com/apache/spark/pull/1977#issuecomment-56004283 @JoshRosen @mateiz I had addressed all your comments. The IResulterIterator can be iterated multiple times now, also can be pickled. --- If your project is set up for

[GitHub] spark pull request: [SPARK-2062][GraphX] VertexRDD.apply does not ...

2014-09-18 Thread ankurdave
Github user ankurdave commented on the pull request: https://github.com/apache/spark/pull/1903#issuecomment-56004578 Jenkins, test this please. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: [SPARK-3543] Write TaskContext in Java and exp...

2014-09-18 Thread rxin
Github user rxin commented on a diff in the pull request: https://github.com/apache/spark/pull/2425#discussion_r17712911 --- Diff: core/src/main/java/org/apache/spark/TaskContext.java --- @@ -0,0 +1,234 @@ +/* + * Licensed to the Apache Software Foundation (ASF) under one

[GitHub] spark pull request: [SPARK-2062][GraphX] VertexRDD.apply does not ...

2014-09-18 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/1903#issuecomment-56004870 [QA tests have started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/20532/consoleFull) for PR 1903 at commit

[GitHub] spark pull request: [SPARK-3543] Write TaskContext in Java and exp...

2014-09-18 Thread ScrapCodes
Github user ScrapCodes commented on a diff in the pull request: https://github.com/apache/spark/pull/2425#discussion_r17713126 --- Diff: core/src/main/java/org/apache/spark/TaskContext.java --- @@ -0,0 +1,234 @@ +/* + * Licensed to the Apache Software Foundation (ASF) under

[GitHub] spark pull request: [SPARK-3543] Write TaskContext in Java and exp...

2014-09-18 Thread ScrapCodes
Github user ScrapCodes commented on a diff in the pull request: https://github.com/apache/spark/pull/2425#discussion_r17713233 --- Diff: core/src/main/java/org/apache/spark/TaskContext.java --- @@ -0,0 +1,234 @@ +/* + * Licensed to the Apache Software Foundation (ASF) under

[GitHub] spark pull request: [SPARK-3543] Write TaskContext in Java and exp...

2014-09-18 Thread rxin
Github user rxin commented on a diff in the pull request: https://github.com/apache/spark/pull/2425#discussion_r17713298 --- Diff: core/src/main/java/org/apache/spark/TaskContext.java --- @@ -0,0 +1,234 @@ +/* + * Licensed to the Apache Software Foundation (ASF) under one

[GitHub] spark pull request: [SPARK-2594][SQL] Support CACHE TABLE name A...

2014-09-18 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/2397#issuecomment-56005574 [QA tests have finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/20528/consoleFull) for PR 2397 at commit

[GitHub] spark pull request: [SPARK-3543] Write TaskContext in Java and exp...

2014-09-18 Thread ScrapCodes
Github user ScrapCodes commented on a diff in the pull request: https://github.com/apache/spark/pull/2425#discussion_r17713594 --- Diff: core/src/main/java/org/apache/spark/TaskContext.java --- @@ -0,0 +1,234 @@ +/* + * Licensed to the Apache Software Foundation (ASF) under

[GitHub] spark pull request: [SPARK-3418] Sparse Matrix support (CCS) and a...

2014-09-18 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/2294#issuecomment-56006229 [QA tests have finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/20527/consoleFull) for PR 2294 at commit

[GitHub] spark pull request: [SPARK-3543] Write TaskContext in Java and exp...

2014-09-18 Thread rxin
Github user rxin commented on a diff in the pull request: https://github.com/apache/spark/pull/2425#discussion_r17713674 --- Diff: core/src/main/java/org/apache/spark/TaskContext.java --- @@ -0,0 +1,234 @@ +/* + * Licensed to the Apache Software Foundation (ASF) under one

[GitHub] spark pull request: [SPARK-3543] Write TaskContext in Java and exp...

2014-09-18 Thread rxin
Github user rxin commented on a diff in the pull request: https://github.com/apache/spark/pull/2425#discussion_r17713666 --- Diff: core/src/main/java/org/apache/spark/TaskContext.java --- @@ -0,0 +1,234 @@ +/* + * Licensed to the Apache Software Foundation (ASF) under one

[GitHub] spark pull request: [SPARK-3566] [BUILD] .gitignore and .rat-exclu...

2014-09-18 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/2426#issuecomment-56008457 [QA tests have finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/20529/consoleFull) for PR 2426 at commit

[GitHub] spark pull request: [SPARK-3074] [PySpark] support groupByKey() wi...

2014-09-18 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/1977#issuecomment-56009374 [QA tests have finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/20530/consoleFull) for PR 1977 at commit

[GitHub] spark pull request: [SPARK-2062][GraphX] VertexRDD.apply does not ...

2014-09-18 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/1903#issuecomment-56009542 [QA tests have finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/20532/consoleFull) for PR 1903 at commit

[GitHub] spark pull request: [SPARK-3547]Using a special exit code instead ...

2014-09-18 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/2421#issuecomment-56010532 [QA tests have started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/20533/consoleFull) for PR 2421 at commit

[GitHub] spark pull request: [SPARK-3584] sbin/slaves doesn't work when we ...

2014-09-18 Thread sarutak
GitHub user sarutak opened a pull request: https://github.com/apache/spark/pull/2444 [SPARK-3584] sbin/slaves doesn't work when we use password authentication for SSH You can merge this pull request into a Git repository by running: $ git pull

[GitHub] spark pull request: [SPARK-3584] sbin/slaves doesn't work when we ...

2014-09-18 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/2444#issuecomment-56014482 [QA tests have started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/20534/consoleFull) for PR 2444 at commit

[GitHub] spark pull request: [SPARK-3547]Using a special exit code instead ...

2014-09-18 Thread sarutak
Github user sarutak commented on the pull request: https://github.com/apache/spark/pull/2421#issuecomment-56014536 @WangTaoTheTonic You can let Jenkins works by saying like retest this please or test this please without extra push. --- If your project is set up for it, you can reply

[GitHub] spark pull request: [SPARK-3547]Using a special exit code instead ...

2014-09-18 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/2421#issuecomment-56015001 [QA tests have started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/20535/consoleFull) for PR 2421 at commit

[GitHub] spark pull request: SPARK-2745 [STREAMING] Add Java friendly metho...

2014-09-18 Thread ScrapCodes
Github user ScrapCodes commented on the pull request: https://github.com/apache/spark/pull/2403#issuecomment-56015430 I guess we will have to exclude those in MimaExcludes.scala. If this happens too often, then *may be* we can ignore toString for all classes possible. --- If your

[GitHub] spark pull request: [SPARK-3407][SQL]Add Date type support

2014-09-18 Thread adrian-wang
Github user adrian-wang commented on the pull request: https://github.com/apache/spark/pull/2344#issuecomment-56018809 Though Hive would throw exception when cast int to date, I think it doesn't matter if not obey, because query exit with exception is considered a failure in

[GitHub] spark pull request: [SPARK-3543] Write TaskContext in Java and exp...

2014-09-18 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/2425#issuecomment-56018945 [QA tests have started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/20536/consoleFull) for PR 2425 at commit

[GitHub] spark pull request: [SPARK-3407][SQL]Add Date type support

2014-09-18 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/2344#issuecomment-56018966 [QA tests have started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/20537/consoleFull) for PR 2344 at commit

[GitHub] spark pull request: [SPARK-3407][SQL]Add Date type support

2014-09-18 Thread adrian-wang
Github user adrian-wang commented on a diff in the pull request: https://github.com/apache/spark/pull/2344#discussion_r17718951 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/Cast.scala --- @@ -177,6 +223,8 @@ case class Cast(child: Expression,

[GitHub] spark pull request: [SPARK-3547]Using a special exit code instead ...

2014-09-18 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/2421#issuecomment-56019226 [QA tests have finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/20533/consoleFull) for PR 2421 at commit

[GitHub] spark pull request: [SPARK-2594][SQL] Add CACHE TABLE name AS SE...

2014-09-18 Thread ravipesala
Github user ravipesala commented on the pull request: https://github.com/apache/spark/pull/2381#issuecomment-56020207 OK. Closing this PR --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this

[GitHub] spark pull request: [SPARK-2594][SQL] Add CACHE TABLE name AS SE...

2014-09-18 Thread ravipesala
Github user ravipesala closed the pull request at: https://github.com/apache/spark/pull/2381 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] spark pull request: [SPARK-2594][SQL] Add CACHE TABLE name AS SE...

2014-09-18 Thread ravipesala
Github user ravipesala closed the pull request at: https://github.com/apache/spark/pull/2390 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] spark pull request: [SPARK-2594][SQL] Add CACHE TABLE name AS SE...

2014-09-18 Thread ravipesala
Github user ravipesala commented on the pull request: https://github.com/apache/spark/pull/2390#issuecomment-56020320 OK. Closing this PR --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this

[GitHub] spark pull request: [SPARK-3547]Using a special exit code instead ...

2014-09-18 Thread WangTaoTheTonic
Github user WangTaoTheTonic commented on the pull request: https://github.com/apache/spark/pull/2421#issuecomment-56020425 @sarutak Thanks I see, thought only commiters can do it this way. --- If your project is set up for it, you can reply to this email and have your reply appear on

[GitHub] spark pull request: [SPARK-3584] sbin/slaves doesn't work when we ...

2014-09-18 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/2444#issuecomment-56020878 [QA tests have finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/20534/consoleFull) for PR 2444 at commit

[GitHub] spark pull request: [SPARK-3407][SQL]Add Date type support

2014-09-18 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/2344#issuecomment-56022043 [QA tests have finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/20537/consoleFull) for PR 2344 at commit

[GitHub] spark pull request: [SPARK-3547]Using a special exit code instead ...

2014-09-18 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/2421#issuecomment-56023011 [QA tests have finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/20535/consoleFull) for PR 2421 at commit

[GitHub] spark pull request: [SPARK-3543] Write TaskContext in Java and exp...

2014-09-18 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/2425#issuecomment-56024795 [QA tests have finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/20536/consoleFull) for PR 2425 at commit

[GitHub] spark pull request: [SPARK-3589][Minor]remove redundant code

2014-09-18 Thread WangTaoTheTonic
GitHub user WangTaoTheTonic opened a pull request: https://github.com/apache/spark/pull/2445 [SPARK-3589][Minor]remove redundant code You can merge this pull request into a Git repository by running: $ git pull https://github.com/WangTaoTheTonic/spark removeRedundant

[GitHub] spark pull request: [SPARK-3589][Minor]remove redundant code

2014-09-18 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/2445#issuecomment-56026443 [QA tests have started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/20538/consoleFull) for PR 2445 at commit

[GitHub] spark pull request: [SPARK-3407][SQL]Add Date type support

2014-09-18 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/2344#issuecomment-56028120 [QA tests have started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/20539/consoleFull) for PR 2344 at commit

[GitHub] spark pull request: [SPARK-3589][Minor]remove redundant code

2014-09-18 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/2445#issuecomment-56032317 [QA tests have finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/20538/consoleFull) for PR 2445 at commit

[GitHub] spark pull request: [SPARK-3447][SQL] Remove explicit conversion w...

2014-09-18 Thread mohangadm
Github user mohangadm commented on the pull request: https://github.com/apache/spark/pull/2323#issuecomment-56032431 I have experienced the same kind of problem when using Avro with spark streaming API. If avro message is simple, its fine. but if the avro message has Union/Arrays

[GitHub] spark pull request: [SPARK-3407][SQL]Add Date type support

2014-09-18 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/2344#issuecomment-56032559 [QA tests have finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/20539/consoleFull) for PR 2344 at commit

[GitHub] spark pull request: [SPARK-1987] EdgePartitionBuilder: More memory...

2014-09-18 Thread larryxiao
GitHub user larryxiao opened a pull request: https://github.com/apache/spark/pull/2446 [SPARK-1987] EdgePartitionBuilder: More memory-efficient graph construction https://issues.apache.org/jira/browse/SPARK-1987 To save overhead of Edge objects, separate an array of Edge objects

[GitHub] spark pull request: [SPARK-1987] EdgePartitionBuilder: More memory...

2014-09-18 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/2446#issuecomment-56042212 Can one of the admins verify this patch? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project

[GitHub] spark pull request: [SPARK-3319] [SPARK-3338] Resolve Spark submit...

2014-09-18 Thread tgravescs
Github user tgravescs commented on the pull request: https://github.com/apache/spark/pull/2232#issuecomment-56042913 From the other pr we need to keep backwards compatibility for the env variables, the configs should be fine. I believe this pr matches the behavior described below.

[GitHub] spark pull request: [YARN] SPARK-2668: Add variable of yarn log di...

2014-09-18 Thread tgravescs
Github user tgravescs commented on the pull request: https://github.com/apache/spark/pull/1573#issuecomment-56044590 @renozhang can you address my comments --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project

[GitHub] spark pull request: SPARK-3389: New public method for RDD's to hav...

2014-09-18 Thread patmcdonough
GitHub user patmcdonough opened a pull request: https://github.com/apache/spark/pull/2447 SPARK-3389: New public method for RDD's to have consistent way of obtain... ...ing the number of RDD partitions across languages. You can merge this pull request into a Git repository by

[GitHub] spark pull request: SPARK-3389: New public method for RDD's to hav...

2014-09-18 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/2447#issuecomment-56048202 Can one of the admins verify this patch? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project

[GitHub] spark pull request: [SPARK-3584] sbin/slaves doesn't work when we ...

2014-09-18 Thread mattf
Github user mattf commented on a diff in the pull request: https://github.com/apache/spark/pull/2444#discussion_r17730762 --- Diff: sbin/slaves.sh --- @@ -67,20 +69,26 @@ fi if [ $HOSTLIST = ]; then if [ $SPARK_SLAVES = ]; then -export

[GitHub] spark pull request: [SPARK-3007][SQL]Add Dynamic Partition suppo...

2014-09-18 Thread baishuo
Github user baishuo commented on a diff in the pull request: https://github.com/apache/spark/pull/2226#discussion_r17731044 --- Diff: sql/hive/src/test/scala/org/apache/spark/sql/hive/execution/HiveQuerySuite.scala --- @@ -522,6 +523,52 @@ class HiveQuerySuite extends

[GitHub] spark pull request: [SPARK-3584] sbin/slaves doesn't work when we ...

2014-09-18 Thread mattf
Github user mattf commented on a diff in the pull request: https://github.com/apache/spark/pull/2444#discussion_r17730829 --- Diff: sbin/slaves.sh --- @@ -67,20 +69,26 @@ fi if [ $HOSTLIST = ]; then if [ $SPARK_SLAVES = ]; then -export

[GitHub] spark pull request: SPARK-3389: New public method for RDD's to hav...

2014-09-18 Thread laserson
Github user laserson commented on the pull request: https://github.com/apache/spark/pull/2447#issuecomment-56059045 fyi: I think you referenced the wrong JIRA --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request: SPARK-3580: New public method for RDD's to hav...

2014-09-18 Thread patmcdonough
Github user patmcdonough commented on the pull request: https://github.com/apache/spark/pull/2447#issuecomment-56061006 thanks for catching that @laserson! Fixed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request: Adding known issue for MESOS-1688

2014-09-18 Thread timothysc
Github user timothysc commented on the pull request: https://github.com/apache/spark/pull/1860#issuecomment-56064543 Just for crossref MESOS-1688 has been committed and will be part of 0.21.0 release cycle. --- If your project is set up for it, you can reply to this email and have

[GitHub] spark pull request: SPARK-3580: New public method for RDD's to hav...

2014-09-18 Thread pwendell
Github user pwendell commented on a diff in the pull request: https://github.com/apache/spark/pull/2447#discussion_r17740875 --- Diff: core/src/main/scala/org/apache/spark/rdd/RDD.scala --- @@ -208,6 +208,23 @@ abstract class RDD[T: ClassTag]( } /** + *

[GitHub] spark pull request: SPARK-3580: New public method for RDD's to hav...

2014-09-18 Thread pwendell
Github user pwendell commented on the pull request: https://github.com/apache/spark/pull/2447#issuecomment-56071597 LGTM pending a minor comment and tests. Jenkins, test this please. --- If your project is set up for it, you can reply to this email and have your reply appear on

[GitHub] spark pull request: SPARK-3580: New public method for RDD's to hav...

2014-09-18 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/2447#issuecomment-56072266 [QA tests have started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/20540/consoleFull) for PR 2447 at commit

[GitHub] spark pull request: [SPARK-3547]Using a special exit code instead ...

2014-09-18 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/2421 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] spark pull request: [WIP][SPARK-1405][MLLIB]LDA based on Graphx

2014-09-18 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/2388#issuecomment-56072999 [QA tests have started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/20541/consoleFull) for PR 2388 at commit

[GitHub] spark pull request: SPARK-3579 Jekyll doc generation is different ...

2014-09-18 Thread pwendell
Github user pwendell commented on the pull request: https://github.com/apache/spark/pull/2443#issuecomment-56073816 This is a very straightforward change, so I'm going to merge this. However, @srowen feel free to propose tweaks to this in a follow on PR if you think there are any

[GitHub] spark pull request: SPARK-3580: New public method for RDD's to hav...

2014-09-18 Thread markhamstra
Github user markhamstra commented on a diff in the pull request: https://github.com/apache/spark/pull/2447#discussion_r17741897 --- Diff: core/src/main/scala/org/apache/spark/rdd/RDD.scala --- @@ -208,6 +208,23 @@ abstract class RDD[T: ClassTag]( } /** + *

[GitHub] spark pull request: SPARK-3579 Jekyll doc generation is different ...

2014-09-18 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/2443 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] spark pull request: [SPARK-1477]: Add the lifecycle interface

2014-09-18 Thread pwendell
Github user pwendell commented on the pull request: https://github.com/apache/spark/pull/991#issuecomment-56074326 Let's close this issue for now given the comments from me and @rxin. --- If your project is set up for it, you can reply to this email and have your reply appear on

[GitHub] spark pull request: [SPARK-1477]: Add the lifecycle interface

2014-09-18 Thread witgo
Github user witgo closed the pull request at: https://github.com/apache/spark/pull/991 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] spark pull request: [SPARK-2098] All Spark processes should suppor...

2014-09-18 Thread vanzin
Github user vanzin commented on a diff in the pull request: https://github.com/apache/spark/pull/2379#discussion_r17743007 --- Diff: core/src/main/scala/org/apache/spark/deploy/history/HistoryServerArguments.scala --- @@ -44,30 +51,27 @@ private[spark] class

[GitHub] spark pull request: [SPARK-2098] All Spark processes should suppor...

2014-09-18 Thread vanzin
Github user vanzin commented on a diff in the pull request: https://github.com/apache/spark/pull/2379#discussion_r17743439 --- Diff: core/src/main/scala/org/apache/spark/deploy/worker/WorkerArguments.scala --- @@ -47,14 +48,25 @@ private[spark] class WorkerArguments(args:

[GitHub] spark pull request: [SPARK-3584] sbin/slaves doesn't work when we ...

2014-09-18 Thread pwendell
Github user pwendell commented on a diff in the pull request: https://github.com/apache/spark/pull/2444#discussion_r17743713 --- Diff: .gitignore --- @@ -19,6 +19,7 @@ conf/*.sh conf/*.properties conf/*.conf conf/*.xml +conf/slaves --- End diff --

[GitHub] spark pull request: [SPARK-2098] All Spark processes should suppor...

2014-09-18 Thread witgo
Github user witgo commented on a diff in the pull request: https://github.com/apache/spark/pull/2379#discussion_r17744702 --- Diff: core/src/main/scala/org/apache/spark/deploy/worker/WorkerArguments.scala --- @@ -47,14 +48,25 @@ private[spark] class WorkerArguments(args:

[GitHub] spark pull request: SPARK-3580: New public method for RDD's to hav...

2014-09-18 Thread pwendell
Github user pwendell commented on a diff in the pull request: https://github.com/apache/spark/pull/2447#discussion_r17745104 --- Diff: core/src/main/scala/org/apache/spark/rdd/RDD.scala --- @@ -208,6 +208,23 @@ abstract class RDD[T: ClassTag]( } /** + *

[GitHub] spark pull request: SPARK-3580: New public method for RDD's to hav...

2014-09-18 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/2447#issuecomment-56081115 [QA tests have finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/20540/consoleFull) for PR 2447 at commit

[GitHub] spark pull request: [SPARK-2098] All Spark processes should suppor...

2014-09-18 Thread vanzin
Github user vanzin commented on a diff in the pull request: https://github.com/apache/spark/pull/2379#discussion_r17745188 --- Diff: core/src/main/scala/org/apache/spark/deploy/worker/WorkerArguments.scala --- @@ -47,14 +48,25 @@ private[spark] class WorkerArguments(args:

[GitHub] spark pull request: [SPARK-3592] [SQL] [PySpark] support applySche...

2014-09-18 Thread davies
GitHub user davies opened a pull request: https://github.com/apache/spark/pull/2448 [SPARK-3592] [SQL] [PySpark] support applySchema to RDD of Row Fix the issue when applySchema() to an RDD of Row. Also add type mapping for BinaryType. You can merge this pull request into

[GitHub] spark pull request: [SPARK-3592] [SQL] [PySpark] support applySche...

2014-09-18 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/2448#issuecomment-56081817 [QA tests have started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/20544/consoleFull) for PR 2448 at commit

[GitHub] spark pull request: [SPARK-2062][GraphX] VertexRDD.apply does not ...

2014-09-18 Thread ankurdave
Github user ankurdave commented on the pull request: https://github.com/apache/spark/pull/1903#issuecomment-56082379 Unrelated failure in Streaming. Jenkins, retest this please. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as

[GitHub] spark pull request: [WIP][SPARK-1405][MLLIB]LDA based on Graphx

2014-09-18 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/2388#issuecomment-56082465 [QA tests have finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/20541/consoleFull) for PR 2388 at commit

[GitHub] spark pull request: [SPARK-2098] All Spark processes should suppor...

2014-09-18 Thread andrewor14
Github user andrewor14 commented on a diff in the pull request: https://github.com/apache/spark/pull/2379#discussion_r17745821 --- Diff: core/src/main/scala/org/apache/spark/deploy/worker/WorkerArguments.scala --- @@ -47,14 +48,25 @@ private[spark] class WorkerArguments(args:

[GitHub] spark pull request: [SPARK-1545] [mllib] Add Random Forests

2014-09-18 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/2435#issuecomment-56082554 [QA tests have started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/20545/consoleFull) for PR 2435 at commit

[GitHub] spark pull request: [SPARK-2098] All Spark processes should suppor...

2014-09-18 Thread andrewor14
Github user andrewor14 commented on a diff in the pull request: https://github.com/apache/spark/pull/2379#discussion_r17745881 --- Diff: core/src/main/scala/org/apache/spark/deploy/history/HistoryServerArguments.scala --- @@ -44,30 +50,19 @@ private[spark] class

[GitHub] spark pull request: [SPARK-2062][GraphX] VertexRDD.apply does not ...

2014-09-18 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/1903#issuecomment-56083212 [QA tests have started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/20546/consoleFull) for PR 1903 at commit

[GitHub] spark pull request: [SPARK-3418] Sparse Matrix support (CCS) and a...

2014-09-18 Thread brkyvz
Github user brkyvz commented on a diff in the pull request: https://github.com/apache/spark/pull/2294#discussion_r17746583 --- Diff: mllib/src/main/scala/org/apache/spark/mllib/linalg/BLAS.scala --- @@ -197,4 +201,368 @@ private[mllib] object BLAS extends Serializable {

[GitHub] spark pull request: [SPARK-3592] [SQL] [PySpark] support applySche...

2014-09-18 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/2448#issuecomment-56084672 [QA tests have started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/20547/consoleFull) for PR 2448 at commit

[GitHub] spark pull request: [SPARK-3005] Fix spark driver hang in mesos fi...

2014-09-18 Thread pwendell
Github user pwendell commented on the pull request: https://github.com/apache/spark/pull/1940#issuecomment-56084970 Yeah I think we should just change it to say that the kill request has been acknowledge, but since killing as asynchronous and best-effort, it may not have stopped

[GitHub] spark pull request: [SPARK-3560] Fixed setting spark.jars system p...

2014-09-18 Thread Victsm
GitHub user Victsm opened a pull request: https://github.com/apache/spark/pull/2449 [SPARK-3560] Fixed setting spark.jars system property in yarn-cluster mode You can merge this pull request into a Git repository by running: $ git pull https://github.com/Victsm/spark

[GitHub] spark pull request: [SPARK-3418] Sparse Matrix support (CCS) and a...

2014-09-18 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/2294#issuecomment-56085981 [QA tests have started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/20548/consoleFull) for PR 2294 at commit

[GitHub] spark pull request: [SPARK-3560] Fixed setting spark.jars system p...

2014-09-18 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/2449#issuecomment-56086357 Can one of the admins verify this patch? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request: [SPARK-3566] [BUILD] .gitignore and .rat-exclu...

2014-09-18 Thread pwendell
Github user pwendell commented on the pull request: https://github.com/apache/spark/pull/2426#issuecomment-56086638 This seems fine to me. For very common file editors seems okay to support them. --- If your project is set up for it, you can reply to this email and have your reply

  1   2   3   >