[GitHub] spark issue #13491: [SPARK-15748][SQL] Replace inefficient foldLeft() call w...

2016-06-02 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/13491 **[Test build #59921 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/59921/consoleFull)** for PR 13491 at commit

[GitHub] spark pull request #13463: [SPARK-14959][SQL] handle partitioned table direc...

2016-06-02 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/13463 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] spark issue #13463: [SPARK-14959][SQL] handle partitioned table directories ...

2016-06-02 Thread liancheng
Github user liancheng commented on the issue: https://github.com/apache/spark/pull/13463 LGTM, merging to master and branch-2.0. Thanks for fixing this! --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project

[GitHub] spark pull request #13491: [SPARK-15748][SQL] Replace inefficient foldLeft()...

2016-06-02 Thread JoshRosen
GitHub user JoshRosen opened a pull request: https://github.com/apache/spark/pull/13491 [SPARK-15748][SQL] Replace inefficient foldLeft() call with flatMap() in PartitionStatistics `PartitionStatistics` uses `foldLeft` and list concatenation (`++`) to flatten an iterator of lists,

[GitHub] spark issue #13491: [SPARK-15748][SQL] Replace inefficient foldLeft() call w...

2016-06-02 Thread JoshRosen
Github user JoshRosen commented on the issue: https://github.com/apache/spark/pull/13491 @ericl also observed this same perf. bottleneck in his profiling. I'll update the benchmark numbers tomorrrow. --- If your project is set up for it, you can reply to this email and have

[GitHub] spark pull request #13470: [SPARK-15733][SQL] Makes the explain output less ...

2016-06-02 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/13470 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] spark issue #13470: [SPARK-15733][SQL] Makes the explain output less verbose...

2016-06-02 Thread liancheng
Github user liancheng commented on the issue: https://github.com/apache/spark/pull/13470 Merging to master and branch-2.0. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #13269: [SPARK-15494][SQL] encoder code cleanup

2016-06-02 Thread liancheng
Github user liancheng commented on the issue: https://github.com/apache/spark/pull/13269 Just rebased this branch. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and

[GitHub] spark issue #13269: [SPARK-15494][SQL] encoder code cleanup

2016-06-02 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/13269 **[Test build #59920 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/59920/consoleFull)** for PR 13269 at commit

[GitHub] spark issue #13446: [SPARK-15704] [SQL] fix a crash in TungstenAggregate whi...

2016-06-02 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/13446 **[Test build #59919 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/59919/consoleFull)** for PR 13446 at commit

[GitHub] spark pull request #13476: [SPARK-15684][SparkR]Not mask startsWith and ends...

2016-06-02 Thread felixcheung
Github user felixcheung commented on a diff in the pull request: https://github.com/apache/spark/pull/13476#discussion_r65657624 --- Diff: R/pkg/R/generics.R --- @@ -695,10 +695,6 @@ setGeneric("desc", function(x) { standardGeneric("desc") }) #' @rdname column #'

[GitHub] spark issue #13489: [SPARK-15745][SQL] Use classloader's getResource() for r...

2016-06-02 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/13489 **[Test build #59918 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/59918/consoleFull)** for PR 13489 at commit

[GitHub] spark pull request #13476: [SPARK-15684][SparkR]Not mask startsWith and ends...

2016-06-02 Thread wangmiao1981
Github user wangmiao1981 commented on a diff in the pull request: https://github.com/apache/spark/pull/13476#discussion_r65657352 --- Diff: R/pkg/R/generics.R --- @@ -695,10 +695,6 @@ setGeneric("desc", function(x) { standardGeneric("desc") }) #' @rdname column #'

[GitHub] spark pull request #13483: [SPARK-15688][SQL] RelationalGroupedDataset.toDF ...

2016-06-02 Thread dilipbiswal
Github user dilipbiswal commented on a diff in the pull request: https://github.com/apache/spark/pull/13483#discussion_r65657150 --- Diff: sql/core/src/test/scala/org/apache/spark/sql/DatasetAggregatorSuite.scala --- @@ -224,6 +224,26 @@ class DatasetAggregatorSuite extends

[GitHub] spark issue #13176: [SPARK-15100][DOC] Modified user guide and examples for ...

2016-06-02 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/13176 **[Test build #59915 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/59915/consoleFull)** for PR 13176 at commit

[GitHub] spark issue #13176: [SPARK-15100][DOC] Modified user guide and examples for ...

2016-06-02 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/13176 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #13176: [SPARK-15100][DOC] Modified user guide and examples for ...

2016-06-02 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/13176 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/59915/ Test PASSed. ---

[GitHub] spark pull request #13394: [SPARK-15490][R][DOC] SparkR 2.0 QA: New R APIs a...

2016-06-02 Thread felixcheung
Github user felixcheung commented on a diff in the pull request: https://github.com/apache/spark/pull/13394#discussion_r65656790 --- Diff: R/pkg/R/DataFrame.R --- @@ -1069,6 +1079,8 @@ setMethod("first", #' #' @param x A SparkDataFrame #' +#' @family

[GitHub] spark issue #13061: [SPARK-14279] [Build] Pick the spark version from pom

2016-06-02 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/13061 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/59914/ Test FAILed. ---

[GitHub] spark issue #13061: [SPARK-14279] [Build] Pick the spark version from pom

2016-06-02 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/13061 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #13483: [SPARK-15688][SQL] RelationalGroupedDataset.toDF should ...

2016-06-02 Thread gatorsmile
Github user gatorsmile commented on the issue: https://github.com/apache/spark/pull/13483 LGTM except a few comments in test cases. : ) @cloud-fan @yhuai Could you please review this PR? Thanks! --- If your project is set up for it, you can reply to this email and have your

[GitHub] spark issue #13061: [SPARK-14279] [Build] Pick the spark version from pom

2016-06-02 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/13061 **[Test build #59914 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/59914/consoleFull)** for PR 13061 at commit

[GitHub] spark issue #13488: [MINOR][R][DOC] Fix R documentation generation instructi...

2016-06-02 Thread felixcheung
Github user felixcheung commented on the issue: https://github.com/apache/spark/pull/13488 LGTM --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the

[GitHub] spark pull request #13483: [SPARK-15688][SQL] RelationalGroupedDataset.toDF ...

2016-06-02 Thread gatorsmile
Github user gatorsmile commented on a diff in the pull request: https://github.com/apache/spark/pull/13483#discussion_r65656657 --- Diff: sql/core/src/test/scala/org/apache/spark/sql/DatasetAggregatorSuite.scala --- @@ -224,6 +224,26 @@ class DatasetAggregatorSuite extends

[GitHub] spark pull request #13476: [SPARK-15684][SparkR]Not mask startsWith and ends...

2016-06-02 Thread felixcheung
Github user felixcheung commented on a diff in the pull request: https://github.com/apache/spark/pull/13476#discussion_r65656594 --- Diff: R/pkg/R/generics.R --- @@ -695,10 +695,6 @@ setGeneric("desc", function(x) { standardGeneric("desc") }) #' @rdname column #'

[GitHub] spark pull request #13483: [SPARK-15688][SQL] RelationalGroupedDataset.toDF ...

2016-06-02 Thread gatorsmile
Github user gatorsmile commented on a diff in the pull request: https://github.com/apache/spark/pull/13483#discussion_r65656488 --- Diff: sql/core/src/test/scala/org/apache/spark/sql/DatasetAggregatorSuite.scala --- @@ -224,6 +224,26 @@ class DatasetAggregatorSuite extends

[GitHub] spark issue #13476: [SPARK-15684][SparkR]Not mask startsWith and endsWith in...

2016-06-02 Thread felixcheung
Github user felixcheung commented on the issue: https://github.com/apache/spark/pull/13476 please remove the workaround in test_context.R --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this

[GitHub] spark pull request #13476: [SPARK-15684][SparkR]Not mask startsWith and ends...

2016-06-02 Thread felixcheung
Github user felixcheung commented on a diff in the pull request: https://github.com/apache/spark/pull/13476#discussion_r65656453 --- Diff: R/pkg/R/column.R --- @@ -151,6 +151,40 @@ setMethod("substr", signature(x = "Column"), column(jc) })

[GitHub] spark pull request #13476: [SPARK-15684][SparkR]Not mask startsWith and ends...

2016-06-02 Thread felixcheung
Github user felixcheung commented on a diff in the pull request: https://github.com/apache/spark/pull/13476#discussion_r65656447 --- Diff: R/pkg/R/column.R --- @@ -151,6 +151,40 @@ setMethod("substr", signature(x = "Column"), column(jc) })

[GitHub] spark issue #13415: [SPARK-15676] [SQL] Disallow Column Names as Partition C...

2016-06-02 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/13415 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/59912/ Test PASSed. ---

[GitHub] spark issue #13483: [SPARK-15688][SQL] RelationalGroupedDataset.toDF should ...

2016-06-02 Thread dilipbiswal
Github user dilipbiswal commented on the issue: https://github.com/apache/spark/pull/13483 @gatorsmile added comments and also updated the PR description. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project

[GitHub] spark issue #13415: [SPARK-15676] [SQL] Disallow Column Names as Partition C...

2016-06-02 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/13415 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #13415: [SPARK-15676] [SQL] Disallow Column Names as Partition C...

2016-06-02 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/13415 **[Test build #59912 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/59912/consoleFull)** for PR 13415 at commit

[GitHub] spark issue #13483: [SPARK-15688][SQL] RelationalGroupedDataset.toDF should ...

2016-06-02 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/13483 **[Test build #59917 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/59917/consoleFull)** for PR 13483 at commit

[GitHub] spark issue #13176: [SPARK-15100][DOC] Modified user guide and examples for ...

2016-06-02 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/13176 **[Test build #59915 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/59915/consoleFull)** for PR 13176 at commit

[GitHub] spark issue #13070: [SPARK-15286] [SQL] Make the output readable for EXPLAIN...

2016-06-02 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/13070 **[Test build #59916 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/59916/consoleFull)** for PR 13070 at commit

[GitHub] spark issue #13481: [SPARK-15738][PYSPARK][ML] Adding Pyspark ml RFormula __...

2016-06-02 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/13481 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/59911/ Test PASSed. ---

[GitHub] spark issue #13481: [SPARK-15738][PYSPARK][ML] Adding Pyspark ml RFormula __...

2016-06-02 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/13481 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #13481: [SPARK-15738][PYSPARK][ML] Adding Pyspark ml RFormula __...

2016-06-02 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/13481 **[Test build #59911 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/59911/consoleFull)** for PR 13481 at commit

[GitHub] spark pull request #13070: [SPARK-15286] [SQL] Make the output readable for ...

2016-06-02 Thread gatorsmile
Github user gatorsmile commented on a diff in the pull request: https://github.com/apache/spark/pull/13070#discussion_r65655636 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/catalog/interface.scala --- @@ -140,6 +170,32 @@ case class CatalogTable(

[GitHub] spark pull request #13070: [SPARK-15286] [SQL] Make the output readable for ...

2016-06-02 Thread gatorsmile
Github user gatorsmile commented on a diff in the pull request: https://github.com/apache/spark/pull/13070#discussion_r65654836 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/catalog/interface.scala --- @@ -48,7 +49,26 @@ case class CatalogStorageFormat(

[GitHub] spark pull request #13070: [SPARK-15286] [SQL] Make the output readable for ...

2016-06-02 Thread gatorsmile
Github user gatorsmile commented on a diff in the pull request: https://github.com/apache/spark/pull/13070#discussion_r65654827 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/catalog/interface.scala --- @@ -65,8 +85,18 @@ case class CatalogColumn( //

[GitHub] spark issue #13484: [SPARK-15742][SQL] Reduce temp collections allocations i...

2016-06-02 Thread JoshRosen
Github user JoshRosen commented on the issue: https://github.com/apache/spark/pull/13484 Want to do more benchmarking to investigate something so don't merge yet. On Thu, Jun 2, 2016 at 7:27 PM UCB AMPLab wrote: > Test PASSed. > Refer to this

[GitHub] spark issue #13061: [SPARK-14279] [Build] Pick the spark version from pom

2016-06-02 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/13061 **[Test build #59914 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/59914/consoleFull)** for PR 13061 at commit

[GitHub] spark issue #13490: [SPARK-15722][SQL] Disallow specifying schema in CTAS st...

2016-06-02 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/13490 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #13490: [SPARK-15722][SQL] Disallow specifying schema in CTAS st...

2016-06-02 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/13490 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/59910/ Test PASSed. ---

[GitHub] spark issue #13490: [SPARK-15722][SQL] Disallow specifying schema in CTAS st...

2016-06-02 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/13490 **[Test build #59910 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/59910/consoleFull)** for PR 13490 at commit

[GitHub] spark issue #13061: [SPARK-14279] [Build] Pick the spark version from pom

2016-06-02 Thread vanzin
Github user vanzin commented on the issue: https://github.com/apache/spark/pull/13061 retest this please --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so,

[GitHub] spark issue #13415: [SPARK-15676] [SQL] Disallow Column Names as Partition C...

2016-06-02 Thread gatorsmile
Github user gatorsmile commented on the issue: https://github.com/apache/spark/pull/13415 @cloud-fan @andrewor14 In this scenario, we do not have the case sensitivity issues. All the catalog columns are converted to lower case by

[GitHub] spark issue #13176: [SPARK-15100][DOC] Modified user guide and examples for ...

2016-06-02 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/13176 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/59913/ Test FAILed. ---

[GitHub] spark issue #13176: [SPARK-15100][DOC] Modified user guide and examples for ...

2016-06-02 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/13176 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #13176: [SPARK-15100][DOC] Modified user guide and examples for ...

2016-06-02 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/13176 **[Test build #59913 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/59913/consoleFull)** for PR 13176 at commit

[GitHub] spark issue #13415: [SPARK-15676] [SQL] Disallow Column Names as Partition C...

2016-06-02 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/13415 **[Test build #59912 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/59912/consoleFull)** for PR 13415 at commit

[GitHub] spark issue #13176: [SPARK-15100][DOC] Modified user guide and examples for ...

2016-06-02 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/13176 **[Test build #59913 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/59913/consoleFull)** for PR 13176 at commit

[GitHub] spark pull request #13483: [SPARK-15688][SQL] RelationalGroupedDataset.toDF ...

2016-06-02 Thread dilipbiswal
Github user dilipbiswal commented on a diff in the pull request: https://github.com/apache/spark/pull/13483#discussion_r65650867 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/RelationalGroupedDataset.scala --- @@ -46,7 +46,18 @@ class RelationalGroupedDataset

[GitHub] spark pull request #13483: [SPARK-15688][SQL] RelationalGroupedDataset.toDF ...

2016-06-02 Thread dilipbiswal
Github user dilipbiswal commented on a diff in the pull request: https://github.com/apache/spark/pull/13483#discussion_r65650856 --- Diff: sql/core/src/test/scala/org/apache/spark/sql/DatasetAggregatorSuite.scala --- @@ -224,6 +224,21 @@ class DatasetAggregatorSuite extends

[GitHub] spark issue #13061: [SPARK-14279] [Build] Pick the spark version from pom

2016-06-02 Thread dhruve
Github user dhruve commented on the issue: https://github.com/apache/spark/pull/13061 Cool. Thanks for reviewing the changes. Once this gets merged, I will file a JIRA for the refactoring. This one's been open for quite some time now. --- If your project is set up for it,

[GitHub] spark issue #13269: [SPARK-15494][SQL] encoder code cleanup

2016-06-02 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/13269 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #13269: [SPARK-15494][SQL] encoder code cleanup

2016-06-02 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/13269 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/59906/ Test PASSed. ---

[GitHub] spark issue #13269: [SPARK-15494][SQL] encoder code cleanup

2016-06-02 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/13269 **[Test build #59906 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/59906/consoleFull)** for PR 13269 at commit

[GitHub] spark pull request #13456: [SPARK-15724] Add benchmarks for performance over...

2016-06-02 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/13456 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] spark issue #13487: [SPARK-15744][SQL] Rename two TungstenAggregation*Suites...

2016-06-02 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/13487 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #13487: [SPARK-15744][SQL] Rename two TungstenAggregation*Suites...

2016-06-02 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/13487 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/59905/ Test PASSed. ---

[GitHub] spark issue #13481: [SPARK-15738][PYSPARK][ML] Adding Pyspark ml RFormula __...

2016-06-02 Thread BryanCutler
Github user BryanCutler commented on the issue: https://github.com/apache/spark/pull/13481 Thanks @MLnick , I made those changes. The string representation for the RFormulaModel is really ugly - it has lots of `WrappedArray` types. I took all that out of the doc test, so let me

[GitHub] spark issue #13487: [SPARK-15744][SQL] Rename two TungstenAggregation*Suites...

2016-06-02 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/13487 **[Test build #59905 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/59905/consoleFull)** for PR 13487 at commit

[GitHub] spark issue #13481: [SPARK-15738][PYSPARK][ML] Adding Pyspark ml RFormula __...

2016-06-02 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/13481 **[Test build #59911 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/59911/consoleFull)** for PR 13481 at commit

[GitHub] spark issue #13456: [SPARK-15724] Add benchmarks for performance over wide s...

2016-06-02 Thread JoshRosen
Github user JoshRosen commented on the issue: https://github.com/apache/spark/pull/13456 LGTM. I'm going to merge this in for now so that we can divide-and-conquer on perf. improvement work. Let's deal with any additional feedback in followups. I'm also going to merge this

[GitHub] spark issue #13485: [SPARK-15732][SQL] better error message when use java re...

2016-06-02 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/13485 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/59903/ Test PASSed. ---

[GitHub] spark pull request #13473: [SPARK-15736][CORE] Gracefully handle loss of Dis...

2016-06-02 Thread tedyu
Github user tedyu commented on a diff in the pull request: https://github.com/apache/spark/pull/13473#discussion_r65649617 --- Diff: core/src/main/scala/org/apache/spark/storage/BlockManager.scala --- @@ -403,6 +403,17 @@ private[spark] class BlockManager( }

[GitHub] spark issue #13485: [SPARK-15732][SQL] better error message when use java re...

2016-06-02 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/13485 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #13485: [SPARK-15732][SQL] better error message when use java re...

2016-06-02 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/13485 **[Test build #59903 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/59903/consoleFull)** for PR 13485 at commit

[GitHub] spark issue #13484: [SPARK-15742][SQL] Reduce temp collections allocations i...

2016-06-02 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/13484 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #13484: [SPARK-15742][SQL] Reduce temp collections allocations i...

2016-06-02 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/13484 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/59901/ Test PASSed. ---

[GitHub] spark issue #13484: [SPARK-15742][SQL] Reduce temp collections allocations i...

2016-06-02 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/13484 **[Test build #59901 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/59901/consoleFull)** for PR 13484 at commit

[GitHub] spark issue #12105: [SPARK-14321][SQL] Reduce date format cost and string-to...

2016-06-02 Thread zzcclp
Github user zzcclp commented on the issue: https://github.com/apache/spark/pull/12105 @rajeshbalamohan , Is there any progress yet? We meet the same performance issues when formatting date or operating string-to-date . --- If your project is set up for it, you can reply to this

[GitHub] spark issue #13486: [SPARK-15743][SQL] Prevent saving with all-column partit...

2016-06-02 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/13486 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/59902/ Test PASSed. ---

[GitHub] spark issue #13486: [SPARK-15743][SQL] Prevent saving with all-column partit...

2016-06-02 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/13486 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #13486: [SPARK-15743][SQL] Prevent saving with all-column partit...

2016-06-02 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/13486 **[Test build #59902 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/59902/consoleFull)** for PR 13486 at commit

[GitHub] spark issue #13489: [SPARK-15745][SQL] Use classloader's getResource() for r...

2016-06-02 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/13489 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/59908/ Test FAILed. ---

[GitHub] spark issue #13258: [SPARK-15472][SQL][Streaming] Add partitioned `csv`, `js...

2016-06-02 Thread lw-lin
Github user lw-lin commented on the issue: https://github.com/apache/spark/pull/13258 @zsxwing , yeah let me update this in the next one day or so - I was waiting for https://github.com/apache/spark/pull/13431. Thanks for the reminder! --- If your project is set up for it, you can

[GitHub] spark pull request #13473: [SPARK-15736][CORE] Gracefully handle loss of Dis...

2016-06-02 Thread JoshRosen
Github user JoshRosen commented on a diff in the pull request: https://github.com/apache/spark/pull/13473#discussion_r65648664 --- Diff: core/src/main/scala/org/apache/spark/storage/BlockManager.scala --- @@ -403,6 +403,17 @@ private[spark] class BlockManager( }

[GitHub] spark issue #13489: [SPARK-15745][SQL] Use classloader's getResource() for r...

2016-06-02 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/13489 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #13430: [HOT-FIX] Fix the test case failures in DDLSuite

2016-06-02 Thread JackyPJB
Github user JackyPJB commented on the issue: https://github.com/apache/spark/pull/13430 æ‚¨å¥½ï¼Œæ„Ÿè°¢æ‚¨çš„å²—ä½æŽ¨èã€‚æˆ‘å¯¹è¿™ä¸ªèŒä½ä¸æ˜¯å¾ˆæœ‰å… ´è¶£ï¼Œå¦‚果有互联网企业的大数据岗位,请再推荐给我。

[GitHub] spark issue #13489: [SPARK-15745][SQL] Use classloader's getResource() for r...

2016-06-02 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/13489 **[Test build #59908 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/59908/consoleFull)** for PR 13489 at commit

[GitHub] spark issue #13485: [SPARK-15732][SQL] better error message when use java re...

2016-06-02 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/13485 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #13485: [SPARK-15732][SQL] better error message when use java re...

2016-06-02 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/13485 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/59900/ Test PASSed. ---

[GitHub] spark issue #13485: [SPARK-15732][SQL] better error message when use java re...

2016-06-02 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/13485 **[Test build #59900 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/59900/consoleFull)** for PR 13485 at commit

[GitHub] spark pull request #13473: [SPARK-15736][CORE] Gracefully handle loss of Dis...

2016-06-02 Thread tedyu
Github user tedyu commented on a diff in the pull request: https://github.com/apache/spark/pull/13473#discussion_r65648116 --- Diff: core/src/main/scala/org/apache/spark/storage/BlockManager.scala --- @@ -403,6 +403,17 @@ private[spark] class BlockManager( }

[GitHub] spark pull request #13473: [SPARK-15736][CORE] Gracefully handle loss of Dis...

2016-06-02 Thread tedyu
Github user tedyu commented on a diff in the pull request: https://github.com/apache/spark/pull/13473#discussion_r65648040 --- Diff: core/src/main/scala/org/apache/spark/storage/BlockManager.scala --- @@ -403,6 +403,17 @@ private[spark] class BlockManager( }

[GitHub] spark issue #13472: [SPARK-15735] Allow specifying min time to run in microb...

2016-06-02 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/13472 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #13472: [SPARK-15735] Allow specifying min time to run in microb...

2016-06-02 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/13472 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/59898/ Test PASSed. ---

[GitHub] spark issue #13472: [SPARK-15735] Allow specifying min time to run in microb...

2016-06-02 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/13472 **[Test build #59898 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/59898/consoleFull)** for PR 13472 at commit

[GitHub] spark issue #13470: [SPARK-15733][SQL] Makes the explain output less verbose...

2016-06-02 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/13470 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #13470: [SPARK-15733][SQL] Makes the explain output less verbose...

2016-06-02 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/13470 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/59899/ Test PASSed. ---

[GitHub] spark issue #13470: [SPARK-15733][SQL] Makes the explain output less verbose...

2016-06-02 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/13470 **[Test build #59899 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/59899/consoleFull)** for PR 13470 at commit

[GitHub] spark issue #13483: [SPARK-15688][SQL] RelationalGroupedDataset.toDF should ...

2016-06-02 Thread gatorsmile
Github user gatorsmile commented on the issue: https://github.com/apache/spark/pull/13483 Please update the PR description and post the analyzed plan. Also added another example to show the root node is `Window`. Thanks! --- If your project is set up for it, you can reply to this

[GitHub] spark pull request #13483: [SPARK-15688][SQL] RelationalGroupedDataset.toDF ...

2016-06-02 Thread gatorsmile
Github user gatorsmile commented on a diff in the pull request: https://github.com/apache/spark/pull/13483#discussion_r65647177 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/RelationalGroupedDataset.scala --- @@ -46,7 +46,18 @@ class RelationalGroupedDataset

[GitHub] spark pull request #13483: [SPARK-15688][SQL] RelationalGroupedDataset.toDF ...

2016-06-02 Thread gatorsmile
Github user gatorsmile commented on a diff in the pull request: https://github.com/apache/spark/pull/13483#discussion_r65647111 --- Diff: sql/core/src/test/scala/org/apache/spark/sql/DatasetAggregatorSuite.scala --- @@ -224,6 +224,21 @@ class DatasetAggregatorSuite extends

[GitHub] spark issue #13394: [SPARK-15490][R][DOC] SparkR 2.0 QA: New R APIs and API ...

2016-06-02 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/13394 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/59909/ Test PASSed. ---

[GitHub] spark issue #13394: [SPARK-15490][R][DOC] SparkR 2.0 QA: New R APIs and API ...

2016-06-02 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/13394 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

  1   2   3   4   5   6   7   8   >