[GitHub] spark pull request #13758: [SPARK-16043][SQL] Prepare GenericArrayData imple...

2016-06-21 Thread hvanhovell
Github user hvanhovell commented on a diff in the pull request: https://github.com/apache/spark/pull/13758#discussion_r67992617 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/util/GenericArrayData.scala --- @@ -142,3 +196,414 @@ class GenericArrayData(val arra

[GitHub] spark pull request #13758: [SPARK-16043][SQL] Prepare GenericArrayData imple...

2016-06-21 Thread hvanhovell
Github user hvanhovell commented on a diff in the pull request: https://github.com/apache/spark/pull/13758#discussion_r67992529 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/util/GenericArrayData.scala --- @@ -23,7 +23,60 @@ import org.apache.spark.sql.cataly

[GitHub] spark issue #13830: [SPARK-16121] ListingFileCatalog does not list in parall...

2016-06-21 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/13830 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/60995/ Test PASSed. ---

[GitHub] spark issue #13830: [SPARK-16121] ListingFileCatalog does not list in parall...

2016-06-21 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/13830 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark pull request #13758: [SPARK-16043][SQL] Prepare GenericArrayData imple...

2016-06-21 Thread hvanhovell
Github user hvanhovell commented on a diff in the pull request: https://github.com/apache/spark/pull/13758#discussion_r67992307 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/util/GenericArrayData.scala --- @@ -142,3 +164,415 @@ class GenericArrayData(val arra

[GitHub] spark issue #13830: [SPARK-16121] ListingFileCatalog does not list in parall...

2016-06-21 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/13830 **[Test build #60995 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/60995/consoleFull)** for PR 13830 at commit [`d898735`](https://github.com/apache/spark/commit/

[GitHub] spark issue #13758: [SPARK-16043][SQL] Prepare GenericArrayData implementati...

2016-06-21 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/13758 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #13758: [SPARK-16043][SQL] Prepare GenericArrayData implementati...

2016-06-21 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/13758 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/61001/ Test FAILed. ---

[GitHub] spark issue #13758: [SPARK-16043][SQL] Prepare GenericArrayData implementati...

2016-06-21 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/13758 **[Test build #61001 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/61001/consoleFull)** for PR 13758 at commit [`e04ca2c`](https://github.com/apache/spark/commit/

[GitHub] spark issue #13811: [SPARK-16100] [SQL] avoid crash in TreeNode.withNewChild...

2016-06-21 Thread cloud-fan
Github user cloud-fan commented on the issue: https://github.com/apache/spark/pull/13811 hi @inouehrs , sorry I haven't noticed that you already have a PR for this JIRA ticket. Yea the root cause of this bug is exactly what you described in your PR descption, thanks for finding th

[GitHub] spark issue #13818: [SPARK-15968][SQL] Nonempty partitioned metastore tables...

2016-06-21 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/13818 **[Test build #3124 has started](https://amplab.cs.berkeley.edu/jenkins/job/NewSparkPullRequestBuilder/3124/consoleFull)** for PR 13818 at commit [`8a058c6`](https://github.com/apache/spark/commit/

[GitHub] spark issue #13835: [SPARK-16100][SQL] fix bug when use Map as the buffer ty...

2016-06-21 Thread hvanhovell
Github user hvanhovell commented on the issue: https://github.com/apache/spark/pull/13835 Is this PR https://github.com/apache/spark/pull/13811 related? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does

[GitHub] spark pull request #13764: [SPARK-16024] [SQL] [TEST] Verify Column Comment ...

2016-06-21 Thread cloud-fan
Github user cloud-fan commented on a diff in the pull request: https://github.com/apache/spark/pull/13764#discussion_r67991258 --- Diff: sql/hive/src/test/scala/org/apache/spark/sql/hive/orc/OrcQuerySuite.scala --- @@ -462,4 +463,27 @@ class OrcQuerySuite extends QueryTest with Be

[GitHub] spark pull request #13823: [MINOR] [MLLIB] deprecate setLabelCol in ChiSqSel...

2016-06-21 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/13823 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is ena

[GitHub] spark issue #13823: [MINOR] [MLLIB] deprecate setLabelCol in ChiSqSelectorMo...

2016-06-21 Thread jkbradley
Github user jkbradley commented on the issue: https://github.com/apache/spark/pull/13823 Merging with master --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so

[GitHub] spark issue #13380: [SPARK-15644] [MLlib] [SQL] Replace SQLContext with Spar...

2016-06-21 Thread jkbradley
Github user jkbradley commented on the issue: https://github.com/apache/spark/pull/13380 LGTM pending tests! --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so

[GitHub] spark issue #13835: [SPARK-16100][SQL] fix bug when use Map as the buffer ty...

2016-06-21 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/13835 **[Test build #61003 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/61003/consoleFull)** for PR 13835 at commit [`447ddcd`](https://github.com/apache/spark/commit/4

[GitHub] spark issue #13835: [SPARK-16100][SQL] fix bug when use Map as the buffer ty...

2016-06-21 Thread cloud-fan
Github user cloud-fan commented on the issue: https://github.com/apache/spark/pull/13835 cc @yhuai @liancheng @clockfly --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled a

[GitHub] spark pull request #13835: [SPARK-16100][SQL] fix bug when use Map as the bu...

2016-06-21 Thread cloud-fan
GitHub user cloud-fan opened a pull request: https://github.com/apache/spark/pull/13835 [SPARK-16100][SQL] fix bug when use Map as the buffer type of Aggregator ## What changes were proposed in this pull request? The root cause is in `MapObjects`. Its parameter `loopVar` is

[GitHub] spark issue #13806: [SPARK-16044][SQL] Backport input_file_name() for data s...

2016-06-21 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/13806 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #13806: [SPARK-16044][SQL] Backport input_file_name() for data s...

2016-06-21 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/13806 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/60990/ Test FAILed. ---

[GitHub] spark issue #13806: [SPARK-16044][SQL] Backport input_file_name() for data s...

2016-06-21 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/13806 **[Test build #60990 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/60990/consoleFull)** for PR 13806 at commit [`2a55091`](https://github.com/apache/spark/commit/

[GitHub] spark issue #13834: [TRIVIAL] [CORE] [ScriptTransform] move printing of stde...

2016-06-21 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/13834 **[Test build #61002 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/61002/consoleFull)** for PR 13834 at commit [`04c8637`](https://github.com/apache/spark/commit/0

[GitHub] spark pull request #13834: [TRIVIAL] [CORE] [ScriptTransform] move printing ...

2016-06-21 Thread tejasapatil
GitHub user tejasapatil opened a pull request: https://github.com/apache/spark/pull/13834 [TRIVIAL] [CORE] [ScriptTransform] move printing of stderr buffer before closing the outstream ## What changes were proposed in this pull request? Currently, if due to some failure, th

[GitHub] spark issue #13756: [SPARK-16041][SQL] Disallow Duplicate Columns in partiti...

2016-06-21 Thread gatorsmile
Github user gatorsmile commented on the issue: https://github.com/apache/spark/pull/13756 It sounds like `PreWriteCheck` rule is a good home for adding this checking. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If you

[GitHub] spark issue #13758: [SPARK-16043][SQL] Prepare GenericArrayData implementati...

2016-06-21 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/13758 **[Test build #61001 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/61001/consoleFull)** for PR 13758 at commit [`e04ca2c`](https://github.com/apache/spark/commit/e

[GitHub] spark pull request #13820: [SPARK-16107] [R] group glm methods in documentat...

2016-06-21 Thread mengxr
Github user mengxr commented on a diff in the pull request: https://github.com/apache/spark/pull/13820#discussion_r67989751 --- Diff: R/pkg/R/mllib.R --- @@ -173,10 +182,9 @@ setMethod("summary", signature(object = "GeneralizedLinearRegressionModel"), return(ans)

[GitHub] spark pull request #13820: [SPARK-16107] [R] group glm methods in documentat...

2016-06-21 Thread mengxr
Github user mengxr commented on a diff in the pull request: https://github.com/apache/spark/pull/13820#discussion_r67989793 --- Diff: R/pkg/R/mllib.R --- @@ -471,24 +469,13 @@ setMethod("write.ml", signature(object = "AFTSurvivalRegressionModel", path = "c invisibl

[GitHub] spark issue #13778: [SPARK-16062][SPARK-15989][SQL] Fix two bugs of Python-o...

2016-06-21 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/13778 **[Test build #61000 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/61000/consoleFull)** for PR 13778 at commit [`a0b81ba`](https://github.com/apache/spark/commit/a

[GitHub] spark pull request #13820: [SPARK-16107] [R] group glm methods in documentat...

2016-06-21 Thread mengxr
Github user mengxr commented on a diff in the pull request: https://github.com/apache/spark/pull/13820#discussion_r67989738 --- Diff: R/pkg/R/mllib.R --- @@ -124,24 +137,20 @@ setMethod("spark.glm", signature(data = "SparkDataFrame", formula = "formula"), #' summary(model)

[GitHub] spark pull request #13820: [SPARK-16107] [R] group glm methods in documentat...

2016-06-21 Thread mengxr
Github user mengxr commented on a diff in the pull request: https://github.com/apache/spark/pull/13820#discussion_r67989718 --- Diff: R/pkg/R/mllib.R --- @@ -99,10 +114,8 @@ setMethod("spark.glm", signature(data = "SparkDataFrame", formula = "formula"), return(new(

[GitHub] spark pull request #13820: [SPARK-16107] [R] group glm methods in documentat...

2016-06-21 Thread mengxr
Github user mengxr commented on a diff in the pull request: https://github.com/apache/spark/pull/13820#discussion_r67989707 --- Diff: R/pkg/R/mllib.R --- @@ -99,10 +114,8 @@ setMethod("spark.glm", signature(data = "SparkDataFrame", formula = "formula"), return(new(

[GitHub] spark issue #13817: [SPARK-16116][SQL]ConsoleSink should not require checkpo...

2016-06-21 Thread jerryshao
Github user jerryshao commented on the issue: https://github.com/apache/spark/pull/13817 LGTM. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the fe

[GitHub] spark issue #13072: [SPARK-15288] [Mesos] Mesos dispatcher should handle gra...

2016-06-21 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/13072 **[Test build #60999 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/60999/consoleFull)** for PR 13072 at commit [`2f306a7`](https://github.com/apache/spark/commit/2

[GitHub] spark issue #13713: [SPARK-15994] [MESOS] Allow enabling Mesos fetch cache i...

2016-06-21 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/13713 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #13713: [SPARK-15994] [MESOS] Allow enabling Mesos fetch cache i...

2016-06-21 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/13713 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/60998/ Test FAILed. ---

[GitHub] spark issue #13713: [SPARK-15994] [MESOS] Allow enabling Mesos fetch cache i...

2016-06-21 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/13713 **[Test build #60998 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/60998/consoleFull)** for PR 13713 at commit [`1ebfaf6`](https://github.com/apache/spark/commit/

[GitHub] spark issue #12933: [Spark-15155][Mesos] Optionally ignore default role reso...

2016-06-21 Thread tnachen
Github user tnachen commented on the issue: https://github.com/apache/spark/pull/12933 @hellertime ping --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or

[GitHub] spark issue #13072: [SPARK-15288] [Mesos] Mesos dispatcher should handle gra...

2016-06-21 Thread tnachen
Github user tnachen commented on the issue: https://github.com/apache/spark/pull/13072 ok to test --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the

[GitHub] spark issue #13143: [SPARK-15359] [Mesos] Mesos dispatcher should handle DRI...

2016-06-21 Thread tnachen
Github user tnachen commented on the issue: https://github.com/apache/spark/pull/13143 Is it because MesosDriver actually threw an exception? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have t

[GitHub] spark issue #13778: [SPARK-16062][SPARK-15989][SQL] Fix two bugs of Python-o...

2016-06-21 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/13778 **[Test build #60996 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/60996/consoleFull)** for PR 13778 at commit [`d603cc2`](https://github.com/apache/spark/commit/

[GitHub] spark issue #13829: [SPARK-16071][SQL] Checks size limit when doubling the a...

2016-06-21 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/13829 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #13778: [SPARK-16062][SPARK-15989][SQL] Fix two bugs of Python-o...

2016-06-21 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/13778 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #13829: [SPARK-16071][SQL] Checks size limit when doubling the a...

2016-06-21 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/13829 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/60993/ Test PASSed. ---

[GitHub] spark issue #13778: [SPARK-16062][SPARK-15989][SQL] Fix two bugs of Python-o...

2016-06-21 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/13778 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/60996/ Test FAILed. ---

[GitHub] spark pull request #13143: [SPARK-15359] [Mesos] Mesos dispatcher should han...

2016-06-21 Thread tnachen
Github user tnachen commented on a diff in the pull request: https://github.com/apache/spark/pull/13143#discussion_r67988954 --- Diff: core/src/main/scala/org/apache/spark/scheduler/cluster/mesos/MesosSchedulerUtils.scala --- @@ -120,14 +120,25 @@ private[mesos] trait MesosSchedul

[GitHub] spark issue #13829: [SPARK-16071][SQL] Checks size limit when doubling the a...

2016-06-21 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/13829 **[Test build #60993 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/60993/consoleFull)** for PR 13829 at commit [`6473e6d`](https://github.com/apache/spark/commit/

[GitHub] spark issue #13077: [SPARK-10748] [Mesos] Log error instead of crashing Spar...

2016-06-21 Thread tnachen
Github user tnachen commented on the issue: https://github.com/apache/spark/pull/13077 @devaraj-kavali Ping --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so,

[GitHub] spark issue #13778: [SPARK-16062][SPARK-15989][SQL] Fix two bugs of Python-o...

2016-06-21 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/13778 **[Test build #60996 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/60996/consoleFull)** for PR 13778 at commit [`d603cc2`](https://github.com/apache/spark/commit/d

[GitHub] spark issue #13715: [SPARK-15992] [MESOS] Refactor MesosCoarseGrainedSchedul...

2016-06-21 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/13715 **[Test build #60997 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/60997/consoleFull)** for PR 13715 at commit [`9e0aedf`](https://github.com/apache/spark/commit/9

[GitHub] spark issue #13326: [SPARK-15560] [Mesos] Queued/Supervise drivers waiting f...

2016-06-21 Thread tnachen
Github user tnachen commented on the issue: https://github.com/apache/spark/pull/13326 jenkins please retest --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so

[GitHub] spark issue #13713: [SPARK-15994] [MESOS] Allow enabling Mesos fetch cache i...

2016-06-21 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/13713 **[Test build #60998 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/60998/consoleFull)** for PR 13713 at commit [`1ebfaf6`](https://github.com/apache/spark/commit/1

[GitHub] spark issue #13713: [SPARK-15994] [MESOS] Allow enabling Mesos fetch cache i...

2016-06-21 Thread tnachen
Github user tnachen commented on the issue: https://github.com/apache/spark/pull/13713 ok to test --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the

[GitHub] spark pull request #13715: [SPARK-15992] [MESOS] Refactor MesosCoarseGrained...

2016-06-21 Thread tnachen
Github user tnachen commented on a diff in the pull request: https://github.com/apache/spark/pull/13715#discussion_r67988575 --- Diff: core/src/main/scala/org/apache/spark/scheduler/cluster/mesos/MesosCoarseGrainedSchedulerBackend.scala --- @@ -382,59 +382,97 @@ private[spark] cla

[GitHub] spark issue #13715: [SPARK-15992] [MESOS] Refactor MesosCoarseGrainedSchedul...

2016-06-21 Thread tnachen
Github user tnachen commented on the issue: https://github.com/apache/spark/pull/13715 ok to test --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the

[GitHub] spark issue #13824: [SPARK-16110][YARN][PYSPARK] Fix allowing python version...

2016-06-21 Thread KevinGrealish
Github user KevinGrealish commented on the issue: https://github.com/apache/spark/pull/13824 That is possible. It was done as is to be a narrower fix and less likely to cause other behavior to change. It does not look like env hashmap is read by the rest of the function (only written

[GitHub] spark pull request #13824: [SPARK-16110][YARN][PYSPARK] Fix allowing python ...

2016-06-21 Thread KevinGrealish
GitHub user KevinGrealish reopened a pull request: https://github.com/apache/spark/pull/13824 [SPARK-16110][YARN][PYSPARK] Fix allowing python version to be speicifed per submit for cluster mode. ## What changes were proposed in this pull request? This fix allows submit of

[GitHub] spark pull request #13824: [SPARK-16110][YARN][PYSPARK] Fix allowing python ...

2016-06-21 Thread KevinGrealish
Github user KevinGrealish closed the pull request at: https://github.com/apache/spark/pull/13824 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature

[GitHub] spark pull request #13727: [SPARK-15982][SPARK-16009][SPARK-16007][SQL] Harm...

2016-06-21 Thread gatorsmile
Github user gatorsmile commented on a diff in the pull request: https://github.com/apache/spark/pull/13727#discussion_r67987779 --- Diff: sql/core/src/test/scala/org/apache/spark/sql/test/DataFrameReaderWriterSuite.scala --- @@ -228,4 +222,152 @@ class DataFrameReaderWriterSuite e

[GitHub] spark pull request #13727: [SPARK-15982][SPARK-16009][SPARK-16007][SQL] Harm...

2016-06-21 Thread tdas
Github user tdas commented on a diff in the pull request: https://github.com/apache/spark/pull/13727#discussion_r67987629 --- Diff: sql/core/src/test/scala/org/apache/spark/sql/test/DataFrameReaderWriterSuite.scala --- @@ -228,4 +222,152 @@ class DataFrameReaderWriterSuite extends

[GitHub] spark issue #13699: [SPARK-15958] Make initial buffer size for the Sorter co...

2016-06-21 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/13699 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/60991/ Test PASSed. ---

[GitHub] spark issue #13699: [SPARK-15958] Make initial buffer size for the Sorter co...

2016-06-21 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/13699 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark pull request #13727: [SPARK-15982][SPARK-16009][SPARK-16007][SQL] Harm...

2016-06-21 Thread gatorsmile
Github user gatorsmile commented on a diff in the pull request: https://github.com/apache/spark/pull/13727#discussion_r67987384 --- Diff: sql/core/src/test/scala/org/apache/spark/sql/test/DataFrameReaderWriterSuite.scala --- @@ -228,4 +222,152 @@ class DataFrameReaderWriterSuite e

[GitHub] spark issue #13699: [SPARK-15958] Make initial buffer size for the Sorter co...

2016-06-21 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/13699 **[Test build #60991 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/60991/consoleFull)** for PR 13699 at commit [`13c9b2f`](https://github.com/apache/spark/commit/

[GitHub] spark issue #13824: [SPARK-16110][YARN][PYSPARK] Fix allowing python version...

2016-06-21 Thread jerryshao
Github user jerryshao commented on the issue: https://github.com/apache/spark/pull/13824 Is it possible to move "spark.yarn.appMasterEnv.*" related codes to the bottom of the function? Looks like other env variables may also have the same problem like you mentioned for `PYSPARK_DRIVER

[GitHub] spark issue #13832: [SPARK-16123] Avoid NegativeArraySizeException while res...

2016-06-21 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/13832 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #13832: [SPARK-16123] Avoid NegativeArraySizeException while res...

2016-06-21 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/13832 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/60992/ Test PASSed. ---

[GitHub] spark issue #13832: [SPARK-16123] Avoid NegativeArraySizeException while res...

2016-06-21 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/13832 **[Test build #60992 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/60992/consoleFull)** for PR 13832 at commit [`a5ec358`](https://github.com/apache/spark/commit/

[GitHub] spark issue #13827: [SQL][DOC] SQL programming guide add deprecated methods ...

2016-06-21 Thread liancheng
Github user liancheng commented on the issue: https://github.com/apache/spark/pull/13827 LGTM. Thanks! Merged to master and branch-2.0. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this fe

[GitHub] spark pull request #13827: [SQL][DOC] SQL programming guide add deprecated m...

2016-06-21 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/13827 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is ena

[GitHub] spark issue #13830: [SPARK-16121] ListingFileCatalog does not list in parall...

2016-06-21 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/13830 **[Test build #60995 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/60995/consoleFull)** for PR 13830 at commit [`d898735`](https://github.com/apache/spark/commit/d

[GitHub] spark issue #13809: [SPARK-16104][SQL] Do not creaate CSV writer object for ...

2016-06-21 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/13809 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #13809: [SPARK-16104][SQL] Do not creaate CSV writer object for ...

2016-06-21 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/13809 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/60988/ Test PASSed. ---

[GitHub] spark issue #13808: [SPARK-14480][SQL] Remove meaningless StringIteratorRead...

2016-06-21 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/13808 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/60989/ Test PASSed. ---

[GitHub] spark issue #13380: [SPARK-15644] [MLlib] [SQL] Replace SQLContext with Spar...

2016-06-21 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/13380 **[Test build #60994 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/60994/consoleFull)** for PR 13380 at commit [`65534a0`](https://github.com/apache/spark/commit/6

[GitHub] spark issue #13808: [SPARK-14480][SQL] Remove meaningless StringIteratorRead...

2016-06-21 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/13808 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #13809: [SPARK-16104][SQL] Do not creaate CSV writer object for ...

2016-06-21 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/13809 **[Test build #60988 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/60988/consoleFull)** for PR 13809 at commit [`882a24f`](https://github.com/apache/spark/commit/

[GitHub] spark issue #13808: [SPARK-14480][SQL] Remove meaningless StringIteratorRead...

2016-06-21 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/13808 **[Test build #60989 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/60989/consoleFull)** for PR 13808 at commit [`5914689`](https://github.com/apache/spark/commit/

[GitHub] spark pull request #13380: [SPARK-15644] [MLlib] [SQL] Replace SQLContext wi...

2016-06-21 Thread gatorsmile
Github user gatorsmile commented on a diff in the pull request: https://github.com/apache/spark/pull/13380#discussion_r67985277 --- Diff: mllib/src/main/scala/org/apache/spark/ml/util/ReadWrite.scala --- @@ -116,6 +129,9 @@ abstract class MLWriter extends BaseReadWrite with Logging

[GitHub] spark issue #13809: [SPARK-16104][SQL] Do not creaate CSV writer object for ...

2016-06-21 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/13809 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #13809: [SPARK-16104][SQL] Do not creaate CSV writer object for ...

2016-06-21 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/13809 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/60985/ Test PASSed. ---

[GitHub] spark issue #13809: [SPARK-16104][SQL] Do not creaate CSV writer object for ...

2016-06-21 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/13809 **[Test build #60985 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/60985/consoleFull)** for PR 13809 at commit [`61dfef8`](https://github.com/apache/spark/commit/

[GitHub] spark pull request #13778: [SPARK-16062][SPARK-15989][SQL] Fix two bugs of P...

2016-06-21 Thread viirya
Github user viirya commented on a diff in the pull request: https://github.com/apache/spark/pull/13778#discussion_r67984779 --- Diff: python/pyspark/sql/tests.py --- @@ -558,6 +558,18 @@ def check_datatype(datatype): _verify_type(PythonOnlyPoint(1.0, 2.0), PythonOnlyUDT

[GitHub] spark issue #13831: [SPARK-16119][sql] Support PURGE option to drop table / ...

2016-06-21 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/13831 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #13831: [SPARK-16119][sql] Support PURGE option to drop table / ...

2016-06-21 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/13831 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/60987/ Test FAILed. ---

[GitHub] spark issue #13831: [SPARK-16119][sql] Support PURGE option to drop table / ...

2016-06-21 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/13831 **[Test build #60987 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/60987/consoleFull)** for PR 13831 at commit [`a53b7fd`](https://github.com/apache/spark/commit/

[GitHub] spark issue #13829: [SPARK-16071][SQL] Checks size limit when doubling the a...

2016-06-21 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/13829 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/60984/ Test PASSed. ---

[GitHub] spark issue #13760: [SPARK-16012][SparkR] gapplyCollect - applies a R functi...

2016-06-21 Thread sun-rui
Github user sun-rui commented on the issue: https://github.com/apache/spark/pull/13760 LGTM except on minor comment --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wi

[GitHub] spark issue #13829: [SPARK-16071][SQL] Checks size limit when doubling the a...

2016-06-21 Thread hvanhovell
Github user hvanhovell commented on the issue: https://github.com/apache/spark/pull/13829 One small comment. LGTM otherwise. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabl

[GitHub] spark issue #13829: [SPARK-16071][SQL] Checks size limit when doubling the a...

2016-06-21 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/13829 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark pull request #13760: [SPARK-16012][SparkR] gapplyCollect - applies a R...

2016-06-21 Thread sun-rui
Github user sun-rui commented on a diff in the pull request: https://github.com/apache/spark/pull/13760#discussion_r67983701 --- Diff: R/pkg/inst/tests/testthat/test_sparkSQL.R --- @@ -2236,12 +2236,15 @@ test_that("gapply() on a DataFrame", { actual <- collect(df1) ex

[GitHub] spark pull request #13829: [SPARK-16071][SQL] Checks size limit when doublin...

2016-06-21 Thread hvanhovell
Github user hvanhovell commented on a diff in the pull request: https://github.com/apache/spark/pull/13829#discussion_r67983638 --- Diff: sql/catalyst/src/main/java/org/apache/spark/sql/catalyst/expressions/codegen/BufferHolder.java --- @@ -45,7 +45,12 @@ public BufferHolder(Unsaf

[GitHub] spark issue #13829: [SPARK-16071][SQL] Checks size limit when doubling the a...

2016-06-21 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/13829 **[Test build #60984 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/60984/consoleFull)** for PR 13829 at commit [`24dd723`](https://github.com/apache/spark/commit/

[GitHub] spark issue #13809: [SPARK-16104][SQL] Do not creaate CSV writer object for ...

2016-06-21 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/13809 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #13809: [SPARK-16104][SQL] Do not creaate CSV writer object for ...

2016-06-21 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/13809 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/60986/ Test FAILed. ---

[GitHub] spark issue #13809: [SPARK-16104][SQL] Do not creaate CSV writer object for ...

2016-06-21 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/13809 **[Test build #60986 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/60986/consoleFull)** for PR 13809 at commit [`a96d547`](https://github.com/apache/spark/commit/

[GitHub] spark issue #13833: [SPARK-16124][SQL] fix `getHiveFile` return file url in ...

2016-06-21 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/13833 Can one of the admins verify this patch? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feat

[GitHub] spark pull request #13833: [SPARK-16124][SQL] fix `getHiveFile` return file ...

2016-06-21 Thread tilumi
GitHub user tilumi opened a pull request: https://github.com/apache/spark/pull/13833 [SPARK-16124][SQL] fix `getHiveFile` return file url in jar that cannot be load in SQL ## What changes were proposed in this pull request? I create a temp file from output stream of the fil

[GitHub] spark issue #9207: [SPARK-11171][SPARK-11237][SPARK-11241][ML] Try adding PM...

2016-06-21 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/9207 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/60976/ Test PASSed. --- I

[GitHub] spark issue #9207: [SPARK-11171][SPARK-11237][SPARK-11241][ML] Try adding PM...

2016-06-21 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/9207 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature en

<    1   2   3   4   5   6   7   8   9   >