[GitHub] spark issue #11105: [SPARK-12469][CORE] Data Property accumulators for Spark

2016-08-05 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/11105 **[Test build #63289 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/63289/consoleFull)** for PR 11105 at commit

[GitHub] spark issue #14513: [SPARK-16928][SQL] Recursive call of ColumnVector::getIn...

2016-08-05 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14513 **[Test build #63298 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/63298/consoleFull)** for PR 14513 at commit

[GitHub] spark issue #14511: [SPARK-16927] [SPARK-16923] Override task properties at ...

2016-08-05 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14511 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/63287/ Test FAILed. ---

[GitHub] spark issue #14511: [SPARK-16927] [SPARK-16923] Override task properties at ...

2016-08-05 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14511 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #14513: [SPARK-16928][SQL] Recursive call of ColumnVector::getIn...

2016-08-05 Thread ooq
Github user ooq commented on the issue: https://github.com/apache/spark/pull/14513 @davies Updated. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if

[GitHub] spark issue #14511: [SPARK-16927] [SPARK-16923] Override task properties at ...

2016-08-05 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14511 **[Test build #63287 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/63287/consoleFull)** for PR 14511 at commit

[GitHub] spark pull request #13701: [SPARK-15639][SPARK-16321][SQL] Push down filter ...

2016-08-05 Thread viirya
Github user viirya commented on a diff in the pull request: https://github.com/apache/spark/pull/13701#discussion_r73774422 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/DataSourceScanExec.scala --- @@ -199,6 +209,19 @@ private[sql] case class

[GitHub] spark pull request #14472: [SPARK-16866][SQL] Infrastructure for file-based ...

2016-08-05 Thread petermaxlee
Github user petermaxlee commented on a diff in the pull request: https://github.com/apache/spark/pull/14472#discussion_r73774227 --- Diff: sql/core/src/test/scala/org/apache/spark/sql/SQLQueryTestSuite.scala --- @@ -0,0 +1,203 @@ +/* + * Licensed to the Apache Software

[GitHub] spark issue #14472: [SPARK-16866][SQL] Infrastructure for file-based SQL end...

2016-08-05 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14472 **[Test build #63297 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/63297/consoleFull)** for PR 14472 at commit

[GitHub] spark issue #14266: [SPARK-16526][SQL] Benchmarking Performance for Fast Has...

2016-08-05 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14266 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #14266: [SPARK-16526][SQL] Benchmarking Performance for Fast Has...

2016-08-05 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14266 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/63296/ Test FAILed. ---

[GitHub] spark issue #14266: [SPARK-16526][SQL] Benchmarking Performance for Fast Has...

2016-08-05 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14266 **[Test build #63296 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/63296/consoleFull)** for PR 14266 at commit

[GitHub] spark issue #14266: [SPARK-16526][SQL] Benchmarking Performance for Fast Has...

2016-08-05 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14266 **[Test build #63296 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/63296/consoleFull)** for PR 14266 at commit

[GitHub] spark pull request #13701: [SPARK-15639][SPARK-16321][SQL] Push down filter ...

2016-08-05 Thread viirya
Github user viirya commented on a diff in the pull request: https://github.com/apache/spark/pull/13701#discussion_r73773948 --- Diff: sql/core/src/test/scala/org/apache/spark/sql/execution/datasources/parquet/ParquetFilterSuite.scala --- @@ -368,73 +378,75 @@ class

[GitHub] spark issue #14176: [SPARK-16525][SQL] Enable Row Based HashMap in HashAggre...

2016-08-05 Thread ooq
Github user ooq commented on the issue: https://github.com/apache/spark/pull/14176 @davies @sameeragarwal I updated more results in the benchmark PR https://github.com/apache/spark/pull/14266 . --- If your project is set up for it, you can reply to this email and have your reply

[GitHub] spark issue #14266: [SPARK-16526][SQL] Benchmarking Performance for Fast Has...

2016-08-05 Thread ooq
Github user ooq commented on the issue: https://github.com/apache/spark/pull/14266 @davies Added some test results with larger number of distinct keys. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does

[GitHub] spark issue #14510: [SPARK-16925] Master should call schedule() after all ex...

2016-08-05 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14510 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #9207: [SPARK-11171][SPARK-11237][SPARK-11241][ML] Try adding PM...

2016-08-05 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/9207 **[Test build #63295 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/63295/consoleFull)** for PR 9207 at commit

[GitHub] spark issue #14510: [SPARK-16925] Master should call schedule() after all ex...

2016-08-05 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14510 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/63286/ Test PASSed. ---

[GitHub] spark issue #14510: [SPARK-16925] Master should call schedule() after all ex...

2016-08-05 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14510 **[Test build #63286 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/63286/consoleFull)** for PR 14510 at commit

[GitHub] spark issue #14474: [SPARK-16853][SQL] fixes encoder error in DataSet typed ...

2016-08-05 Thread rxin
Github user rxin commented on the issue: https://github.com/apache/spark/pull/14474 Is this a bug fix? If yes, shouldn't we merge it in 2.0? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

[GitHub] spark pull request #14489: [MINOR][SparkR] R API documentation for "coltypes...

2016-08-05 Thread keypointt
Github user keypointt commented on a diff in the pull request: https://github.com/apache/spark/pull/14489#discussion_r73773463 --- Diff: R/pkg/R/DataFrame.R --- @@ -41,7 +41,7 @@ setOldClass("structType") #'\dontrun{ #' sparkR.session() #' df <-

[GitHub] spark pull request #14489: [MINOR][SparkR] R API documentation for "coltypes...

2016-08-05 Thread shivaram
Github user shivaram commented on a diff in the pull request: https://github.com/apache/spark/pull/14489#discussion_r73773220 --- Diff: R/pkg/R/DataFrame.R --- @@ -41,7 +41,7 @@ setOldClass("structType") #'\dontrun{ #' sparkR.session() #' df <-

[GitHub] spark issue #11746: [SPARK-13602][CORE] Add shutdown hook to DriverRunner to...

2016-08-05 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/11746 **[Test build #63294 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/63294/consoleFull)** for PR 11746 at commit

[GitHub] spark issue #11746: [SPARK-13602][CORE] Add shutdown hook to DriverRunner to...

2016-08-05 Thread BryanCutler
Github user BryanCutler commented on the issue: https://github.com/apache/spark/pull/11746 Thanks for the review @vanzin! Style issues have been fixed and renamed 'Launch' to 'Run' where appropriate. --- If your project is set up for it, you can reply to this email and have your

[GitHub] spark issue #14516: [SPARK-15702][DOCS] Changed programming guide to not ref...

2016-08-05 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14516 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #14516: [SPARK-15702][DOCS] Changed programming guide to not ref...

2016-08-05 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14516 **[Test build #63293 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/63293/consoleFull)** for PR 14516 at commit

[GitHub] spark issue #14516: [SPARK-15702][DOCS] Changed programming guide to not ref...

2016-08-05 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14516 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/63293/ Test PASSed. ---

[GitHub] spark pull request #11746: [SPARK-13602][CORE] Add shutdown hook to DriverRu...

2016-08-05 Thread BryanCutler
Github user BryanCutler commented on a diff in the pull request: https://github.com/apache/spark/pull/11746#discussion_r73771605 --- Diff: core/src/main/scala/org/apache/spark/deploy/worker/DriverRunner.scala --- @@ -78,49 +80,53 @@ private[deploy] class DriverRunner(

[GitHub] spark pull request #11746: [SPARK-13602][CORE] Add shutdown hook to DriverRu...

2016-08-05 Thread BryanCutler
Github user BryanCutler commented on a diff in the pull request: https://github.com/apache/spark/pull/11746#discussion_r73771392 --- Diff: core/src/main/scala/org/apache/spark/deploy/worker/DriverRunner.scala --- @@ -53,9 +53,11 @@ private[deploy] class DriverRunner(

[GitHub] spark issue #14513: [SPARK-16928][SQL] Recursive call of ColumnVector::getIn...

2016-08-05 Thread ooq
Github user ooq commented on the issue: https://github.com/apache/spark/pull/14513 @davies Makes sense. I'll update the PR. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #14311: [SPARK-16550] [core] Certain classes fail to deserialize...

2016-08-05 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14311 **[Test build #3204 has started](https://amplab.cs.berkeley.edu/jenkins/job/NewSparkPullRequestBuilder/3204/consoleFull)** for PR 14311 at commit

[GitHub] spark issue #14513: [SPARK-16928][SQL] Recursive call of ColumnVector::getIn...

2016-08-05 Thread davies
Github user davies commented on the issue: https://github.com/apache/spark/pull/14513 It's not necessary, but more clear (consistent) --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this

[GitHub] spark issue #14509: [SPARK-16924][SQL] - Support option("inferSchema", true)...

2016-08-05 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14509 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #14509: [SPARK-16924][SQL] - Support option("inferSchema", true)...

2016-08-05 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14509 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/63285/ Test PASSed. ---

[GitHub] spark issue #14509: [SPARK-16924][SQL] - Support option("inferSchema", true)...

2016-08-05 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14509 **[Test build #63285 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/63285/consoleFull)** for PR 14509 at commit

[GitHub] spark issue #11746: [SPARK-13602][CORE] Add shutdown hook to DriverRunner to...

2016-08-05 Thread vanzin
Github user vanzin commented on the issue: https://github.com/apache/spark/pull/11746 Looks sane to me, but needs some style updates. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this

[GitHub] spark pull request #11746: [SPARK-13602][CORE] Add shutdown hook to DriverRu...

2016-08-05 Thread vanzin
Github user vanzin commented on a diff in the pull request: https://github.com/apache/spark/pull/11746#discussion_r73770621 --- Diff: core/src/main/scala/org/apache/spark/deploy/worker/DriverRunner.scala --- @@ -168,7 +173,24 @@ private[deploy] class DriverRunner(

[GitHub] spark issue #14516: [SPARK-15702][DOCS] Changed programming guide to not ref...

2016-08-05 Thread BryanCutler
Github user BryanCutler commented on the issue: https://github.com/apache/spark/pull/14516 screenshot above. it looks like some lines are cutout, but that was just an artifact of the screenshot, those lines are not modified. --- If your project is set up for it, you can reply to

[GitHub] spark pull request #11746: [SPARK-13602][CORE] Add shutdown hook to DriverRu...

2016-08-05 Thread vanzin
Github user vanzin commented on a diff in the pull request: https://github.com/apache/spark/pull/11746#discussion_r73770529 --- Diff: core/src/main/scala/org/apache/spark/deploy/worker/DriverRunner.scala --- @@ -78,49 +80,53 @@ private[deploy] class DriverRunner(

[GitHub] spark pull request #14497: [SPARK-16901] Hive settings in hive-site.xml may ...

2016-08-05 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/14497 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] spark issue #14513: [SPARK-16928][SQL] Recursive call of ColumnVector::getIn...

2016-08-05 Thread ooq
Github user ooq commented on the issue: https://github.com/apache/spark/pull/14513 @davies It should be fine right? Now we don't have recursions. We don't need to force `dictionaryIds` instance outside of `ColumnVector` class to use that method. --- If your project is set up for

[GitHub] spark issue #14516: [SPARK-15702][DOCS] Changed programming guide to not ref...

2016-08-05 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14516 **[Test build #63293 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/63293/consoleFull)** for PR 14516 at commit

[GitHub] spark issue #14516: [SPARK-15702][DOCS] Changed programming guide to not ref...

2016-08-05 Thread BryanCutler
Github user BryanCutler commented on the issue: https://github.com/apache/spark/pull/14516 ![screenshot](https://cloud.githubusercontent.com/assets/4534389/17452512/8e523b04-5b24-11e6-8972-fc700d3adc8c.png) --- If your project is set up for it, you can reply to this email and have

[GitHub] spark issue #14109: [SPARK-16404][ML] LeastSquaresAggregators serializes unn...

2016-08-05 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14109 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #14109: [SPARK-16404][ML] LeastSquaresAggregators serializes unn...

2016-08-05 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14109 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/63288/ Test PASSed. ---

[GitHub] spark pull request #14516: [SPARK-15702][DOCS] Changed programming guide to ...

2016-08-05 Thread BryanCutler
GitHub user BryanCutler opened a pull request: https://github.com/apache/spark/pull/14516 [SPARK-15702][DOCS] Changed programming guide to not reference old accumulator API in Scala ## What changes were proposed in this pull request? In the programming guide, the

[GitHub] spark issue #14109: [SPARK-16404][ML] LeastSquaresAggregators serializes unn...

2016-08-05 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14109 **[Test build #63288 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/63288/consoleFull)** for PR 14109 at commit

[GitHub] spark issue #14508: [SPARK-16586][core] Handle JVM errors printed to stdout.

2016-08-05 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14508 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #14508: [SPARK-16586][core] Handle JVM errors printed to stdout.

2016-08-05 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14508 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/63284/ Test PASSed. ---

[GitHub] spark issue #14514: document that Mesos cluster mode supports python

2016-08-05 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14514 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #14514: document that Mesos cluster mode supports python

2016-08-05 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14514 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/63292/ Test PASSed. ---

[GitHub] spark issue #14514: document that Mesos cluster mode supports python

2016-08-05 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14514 **[Test build #63292 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/63292/consoleFull)** for PR 14514 at commit

[GitHub] spark issue #14508: [SPARK-16586][core] Handle JVM errors printed to stdout.

2016-08-05 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14508 **[Test build #63284 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/63284/consoleFull)** for PR 14508 at commit

[GitHub] spark issue #14497: [SPARK-16901] Hive settings in hive-site.xml may be over...

2016-08-05 Thread yhuai
Github user yhuai commented on the issue: https://github.com/apache/spark/pull/14497 Thanks for reviewing! I am merging this to master and branch 2.0. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does

[GitHub] spark pull request #11746: [SPARK-13602][CORE] Add shutdown hook to DriverRu...

2016-08-05 Thread vanzin
Github user vanzin commented on a diff in the pull request: https://github.com/apache/spark/pull/11746#discussion_r73769000 --- Diff: core/src/main/scala/org/apache/spark/deploy/worker/DriverRunner.scala --- @@ -53,9 +53,11 @@ private[deploy] class DriverRunner( @volatile

[GitHub] spark pull request #11746: [SPARK-13602][CORE] Add shutdown hook to DriverRu...

2016-08-05 Thread vanzin
Github user vanzin commented on a diff in the pull request: https://github.com/apache/spark/pull/11746#discussion_r73768915 --- Diff: core/src/main/scala/org/apache/spark/deploy/worker/DriverRunner.scala --- @@ -78,49 +80,53 @@ private[deploy] class DriverRunner(

[GitHub] spark pull request #11746: [SPARK-13602][CORE] Add shutdown hook to DriverRu...

2016-08-05 Thread vanzin
Github user vanzin commented on a diff in the pull request: https://github.com/apache/spark/pull/11746#discussion_r73768879 --- Diff: core/src/main/scala/org/apache/spark/deploy/worker/DriverRunner.scala --- @@ -78,49 +80,53 @@ private[deploy] class DriverRunner(

[GitHub] spark issue #14461: [SPARK-16856] [WEBUI] [CORE] Link application summary pa...

2016-08-05 Thread ajbozarth
Github user ajbozarth commented on the issue: https://github.com/apache/spark/pull/14461 I forgot to comment, but I did check this out and it runs well, I still think the link on the app summary is redundant though. --- If your project is set up for it, you can reply to this email

[GitHub] spark pull request #11746: [SPARK-13602][CORE] Add shutdown hook to DriverRu...

2016-08-05 Thread vanzin
Github user vanzin commented on a diff in the pull request: https://github.com/apache/spark/pull/11746#discussion_r73768813 --- Diff: core/src/main/scala/org/apache/spark/deploy/worker/DriverRunner.scala --- @@ -78,49 +80,53 @@ private[deploy] class DriverRunner(

[GitHub] spark pull request #11746: [SPARK-13602][CORE] Add shutdown hook to DriverRu...

2016-08-05 Thread vanzin
Github user vanzin commented on a diff in the pull request: https://github.com/apache/spark/pull/11746#discussion_r73768836 --- Diff: core/src/main/scala/org/apache/spark/deploy/worker/DriverRunner.scala --- @@ -78,49 +80,53 @@ private[deploy] class DriverRunner(

[GitHub] spark issue #14500: [SPARK-16905] SQL DDL: MSCK REPAIR TABLE

2016-08-05 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14500 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/63283/ Test PASSed. ---

[GitHub] spark issue #14515: [SPARK-16926] [SQL] Remove partition columns from partit...

2016-08-05 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14515 Can one of the admins verify this patch? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this

[GitHub] spark issue #14500: [SPARK-16905] SQL DDL: MSCK REPAIR TABLE

2016-08-05 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14500 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark pull request #14515: [SPARK-16926] [SQL] Remove partition columns from...

2016-08-05 Thread dafrista
GitHub user dafrista opened a pull request: https://github.com/apache/spark/pull/14515 [SPARK-16926] [SQL] Remove partition columns from partition metadata. ## What changes were proposed in this pull request? This removes partition columns from column metadata of partitions

[GitHub] spark issue #14500: [SPARK-16905] SQL DDL: MSCK REPAIR TABLE

2016-08-05 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14500 **[Test build #63283 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/63283/consoleFull)** for PR 14500 at commit

[GitHub] spark issue #14514: document that Mesos cluster mode supports python

2016-08-05 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14514 **[Test build #63292 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/63292/consoleFull)** for PR 14514 at commit

[GitHub] spark pull request #14514: document that Mesos cluster mode supports python

2016-08-05 Thread mgummelt
GitHub user mgummelt opened a pull request: https://github.com/apache/spark/pull/14514 document that Mesos cluster mode supports python update docs to be consistent with SPARK-14645 https://issues.apache.org/jira/browse/SPARK-14645 You can merge this pull request into a

[GitHub] spark issue #14513: [SPARK-16928][SQL] Recursive call of ColumnVector::getIn...

2016-08-05 Thread davies
Github user davies commented on the issue: https://github.com/apache/spark/pull/14513 We should also update VectorizedColumnReader.decodeDictionaryIds() to use the new method. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as

[GitHub] spark issue #14176: [SPARK-16525][SQL] Enable Row Based HashMap in HashAggre...

2016-08-05 Thread davies
Github user davies commented on the issue: https://github.com/apache/spark/pull/14176 Let's hold on this, if we are going to have single implementation for fast hash map (based on the benchmark result in another PR), do need to merge this fancy implementation choosing. cc @rxin

[GitHub] spark issue #14513: [SPARK-16928][SQL] Recursive call of ColumnVector::getIn...

2016-08-05 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14513 **[Test build #63291 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/63291/consoleFull)** for PR 14513 at commit

[GitHub] spark pull request #14513: [SPARK-16928][SQL] Recursive call of ColumnVector...

2016-08-05 Thread ooq
GitHub user ooq opened a pull request: https://github.com/apache/spark/pull/14513 [SPARK-16928][SQL] Recursive call of ColumnVector::getInt() breaks JIT inlining ## What changes were proposed in this pull request? In both `OnHeapColumnVector` and `OffHeapColumnVector`, we

[GitHub] spark issue #14513: [SPARK-16928][SQL] Recursive call of ColumnVector::getIn...

2016-08-05 Thread ooq
Github user ooq commented on the issue: https://github.com/apache/spark/pull/14513 cc @davies --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the

[GitHub] spark issue #14508: [SPARK-16586][core] Handle JVM errors printed to stdout.

2016-08-05 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14508 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/63281/ Test PASSed. ---

[GitHub] spark issue #14508: [SPARK-16586][core] Handle JVM errors printed to stdout.

2016-08-05 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14508 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #14389: [SPARK-16714][SQL] Refactor type widening for consistenc...

2016-08-05 Thread petermaxlee
Github user petermaxlee commented on the issue: https://github.com/apache/spark/pull/14389 Which part do you want me to update? I thought you've already committed the changes needed. Let me know and I will update this. --- If your project is set up for it, you can reply to this

[GitHub] spark issue #12694: [SPARK-14914] Fix Command too long for windows. Especial...

2016-08-05 Thread vanzin
Github user vanzin commented on the issue: https://github.com/apache/spark/pull/12694 Update: I thought about using argument files, but they're only supported by javac (`javac @argfile`) and not by java. So if fixing anything, I'm in favor of: - removing the use of

[GitHub] spark issue #14508: [SPARK-16586][core] Handle JVM errors printed to stdout.

2016-08-05 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14508 **[Test build #63281 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/63281/consoleFull)** for PR 14508 at commit

[GitHub] spark issue #14118: [SPARK-16462][SPARK-16460][SPARK-15144][SQL] Make CSV ca...

2016-08-05 Thread rxin
Github user rxin commented on the issue: https://github.com/apache/spark/pull/14118 You can specify "com.databricks.spark.csv" as the source. On Fri, Aug 5, 2016 at 11:58 PM, djk121 wrote: > Is there a way to fall back to the old

[GitHub] spark issue #14512: [WIP] Add SSL support to dispatcher and spark-submit

2016-08-05 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14512 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #14512: [WIP] Add SSL support to dispatcher and spark-submit

2016-08-05 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14512 **[Test build #63290 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/63290/consoleFull)** for PR 14512 at commit

[GitHub] spark issue #14512: [WIP] Add SSL support to dispatcher and spark-submit

2016-08-05 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14512 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/63290/ Test FAILed. ---

[GitHub] spark issue #14512: [WIP] Add SSL support to dispatcher and spark-submit

2016-08-05 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14512 **[Test build #63290 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/63290/consoleFull)** for PR 14512 at commit

[GitHub] spark pull request #14512: [WIP] Add SSL support to dispatcher and spark-sub...

2016-08-05 Thread mgummelt
GitHub user mgummelt opened a pull request: https://github.com/apache/spark/pull/14512 [WIP] Add SSL support to dispatcher and spark-submit ## What changes were proposed in this pull request? (Please fill in changes proposed in this fix) ## How was this patch

[GitHub] spark issue #14510: [SPARK-16925] Master should call schedule() after all ex...

2016-08-05 Thread zsxwing
Github user zsxwing commented on the issue: https://github.com/apache/spark/pull/14510 LGTM --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the

[GitHub] spark issue #14484: [SPARK-16796][Web UI] Mask spark.authenticate.secret on ...

2016-08-05 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14484 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #14484: [SPARK-16796][Web UI] Mask spark.authenticate.secret on ...

2016-08-05 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14484 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/63280/ Test PASSed. ---

[GitHub] spark issue #14484: [SPARK-16796][Web UI] Mask spark.authenticate.secret on ...

2016-08-05 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14484 **[Test build #63280 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/63280/consoleFull)** for PR 14484 at commit

[GitHub] spark issue #14109: [SPARK-16404][ML] LeastSquaresAggregators serializes unn...

2016-08-05 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14109 **[Test build #63288 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/63288/consoleFull)** for PR 14109 at commit

[GitHub] spark issue #11105: [SPARK-12469][CORE] Data Property accumulators for Spark

2016-08-05 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/11105 **[Test build #63289 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/63289/consoleFull)** for PR 11105 at commit

[GitHub] spark issue #14371: [SPARK-16736] WiP Core+ SQL superfluous fs calls

2016-08-05 Thread vanzin
Github user vanzin commented on the issue: https://github.com/apache/spark/pull/14371 Looks pretty good, can you remove the wip from the pr title? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request #14371: [SPARK-16736] WiP Core+ SQL superfluous fs calls

2016-08-05 Thread vanzin
Github user vanzin commented on a diff in the pull request: https://github.com/apache/spark/pull/14371#discussion_r73765309 --- Diff: streaming/src/main/scala/org/apache/spark/streaming/util/FileBasedWriteAheadLog.scala --- @@ -231,13 +232,17 @@ private[streaming] class

[GitHub] spark pull request #14371: [SPARK-16736] WiP Core+ SQL superfluous fs calls

2016-08-05 Thread vanzin
Github user vanzin commented on a diff in the pull request: https://github.com/apache/spark/pull/14371#discussion_r73765169 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/streaming/state/HDFSBackedStateStoreProvider.scala --- @@ -443,6 +445,9 @@ private[state]

[GitHub] spark pull request #14109: [SPARK-16404][ML] LeastSquaresAggregators seriali...

2016-08-05 Thread sethah
Github user sethah commented on a diff in the pull request: https://github.com/apache/spark/pull/14109#discussion_r73765222 --- Diff: mllib/src/main/scala/org/apache/spark/ml/regression/LinearRegression.scala --- @@ -996,19 +1013,24 @@ private class LeastSquaresCostFun(

[GitHub] spark pull request #14371: [SPARK-16736] WiP Core+ SQL superfluous fs calls

2016-08-05 Thread vanzin
Github user vanzin commented on a diff in the pull request: https://github.com/apache/spark/pull/14371#discussion_r73765083 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/streaming/state/HDFSBackedStateStoreProvider.scala --- @@ -278,14 +278,15 @@ private[state]

[GitHub] spark issue #14511: [SPARK-16927] [SPARK-16923] Override task properties at ...

2016-08-05 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14511 **[Test build #63287 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/63287/consoleFull)** for PR 14511 at commit

[GitHub] spark issue #14511: [SPARK-16927] [SPARK-16923] Override task properties at ...

2016-08-05 Thread mgummelt
Github user mgummelt commented on the issue: https://github.com/apache/spark/pull/14511 @skonto Can you take a look at this? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark pull request #14511: [SPARK-16927] [SPARK-16923] Override task propert...

2016-08-05 Thread mgummelt
Github user mgummelt commented on a diff in the pull request: https://github.com/apache/spark/pull/14511#discussion_r73764731 --- Diff: core/src/main/scala/org/apache/spark/scheduler/cluster/mesos/MesosClusterScheduler.scala --- @@ -358,14 +358,12 @@ private[spark] class

[GitHub] spark pull request #14511: [SPARK-16927] [SPARK-16923] Override task propert...

2016-08-05 Thread mgummelt
GitHub user mgummelt opened a pull request: https://github.com/apache/spark/pull/14511 [SPARK-16927] [SPARK-16923] Override task properties at dispatcher. ## What changes were proposed in this pull request? - enable setting default properties for all jobs submitted through

[GitHub] spark issue #14308: [SPARK-16421][EXAMPLES][ML] Improve ML Example Outputs

2016-08-05 Thread BryanCutler
Github user BryanCutler commented on the issue: https://github.com/apache/spark/pull/14308 Thanks @srowen! --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so,

<    1   2   3   4   5   >