[GitHub] spark issue #13915: [SPARK-16081][BUILD] Disallow using `l` as variable name

2016-06-26 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/13915 **[Test build #61274 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/61274/consoleFull)** for PR 13915 at commit [`8be1263`](https://github.com/apache/spark/commit/8

[GitHub] spark pull request #13915: [SPARK-16081] Disallow using `l` as variable name

2016-06-26 Thread dongjoon-hyun
GitHub user dongjoon-hyun opened a pull request: https://github.com/apache/spark/pull/13915 [SPARK-16081] Disallow using `l` as variable name ## What changes were proposed in this pull request? This PR adds a ScalaStyle custom rule, `DisallowMisleadingVariableName`, by usin

[GitHub] spark issue #11863: [SPARK-12177][Streaming][Kafka] Update KafkaDStreams to ...

2016-06-26 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/11863 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/61272/ Test PASSed. ---

[GitHub] spark issue #11863: [SPARK-12177][Streaming][Kafka] Update KafkaDStreams to ...

2016-06-26 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/11863 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #11863: [SPARK-12177][Streaming][Kafka] Update KafkaDStreams to ...

2016-06-26 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/11863 **[Test build #61272 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/61272/consoleFull)** for PR 11863 at commit [`83c9c5b`](https://github.com/apache/spark/commit/

[GitHub] spark issue #13065: [SPARK-15214][SQL] Code-generation for Generate

2016-06-26 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/13065 **[Test build #61273 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/61273/consoleFull)** for PR 13065 at commit [`36cd826`](https://github.com/apache/spark/commit/3

[GitHub] spark pull request #13885: [SPARK-16184][SPARKR] conf API for SparkSession

2016-06-26 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/13885 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is ena

[GitHub] spark pull request #13760: [SPARK-16012][SparkR] implement gapplyCollect whi...

2016-06-26 Thread shivaram
Github user shivaram commented on a diff in the pull request: https://github.com/apache/spark/pull/13760#discussion_r68508656 --- Diff: R/pkg/R/group.R --- @@ -243,17 +236,73 @@ setMethod("gapply", signature(x = "GroupedData"), function(x, func, schema)

[GitHub] spark issue #13885: [SPARK-16184][SPARKR] conf API for SparkSession

2016-06-26 Thread shivaram
Github user shivaram commented on the issue: https://github.com/apache/spark/pull/13885 LGTM. Thanks @felixcheung - Merging this into master and branch-2.0 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project d

[GitHub] spark issue #13494: [SPARK-15752] [SQL] support optimization for metadata on...

2016-06-26 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/13494 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/61271/ Test PASSed. ---

[GitHub] spark issue #13494: [SPARK-15752] [SQL] support optimization for metadata on...

2016-06-26 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/13494 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #13494: [SPARK-15752] [SQL] support optimization for metadata on...

2016-06-26 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/13494 **[Test build #61271 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/61271/consoleFull)** for PR 13494 at commit [`3411fd6`](https://github.com/apache/spark/commit/

[GitHub] spark issue #13885: [SPARK-16184][SPARKR] conf API for SparkSession

2016-06-26 Thread felixcheung
Github user felixcheung commented on the issue: https://github.com/apache/spark/pull/13885 @shivaram this is ready, thanks! --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enable

[GitHub] spark issue #11863: [SPARK-12177][Streaming][Kafka] Update KafkaDStreams to ...

2016-06-26 Thread koeninger
Github user koeninger commented on the issue: https://github.com/apache/spark/pull/11863 Moved the prefered location and consumer creation strategies to an explicit interface, let me know if that's more usable from your point of view. Scala api looks like KafkaUtils.c

[GitHub] spark issue #11863: [SPARK-12177][Streaming][Kafka] Update KafkaDStreams to ...

2016-06-26 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/11863 **[Test build #61272 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/61272/consoleFull)** for PR 11863 at commit [`83c9c5b`](https://github.com/apache/spark/commit/8

[GitHub] spark pull request #13909: [SPARK-16213][SQL] Reduce runtime overhead of a p...

2016-06-26 Thread jaceklaskowski
Github user jaceklaskowski commented on a diff in the pull request: https://github.com/apache/spark/pull/13909#discussion_r68506637 --- Diff: sql/core/src/test/scala/org/apache/spark/sql/DataFrameComplexTypeSuite.scala --- @@ -26,6 +26,20 @@ import org.apache.spark.sql.test.SharedS

[GitHub] spark pull request #13909: [SPARK-16213][SQL] Reduce runtime overhead of a p...

2016-06-26 Thread jaceklaskowski
Github user jaceklaskowski commented on a diff in the pull request: https://github.com/apache/spark/pull/13909#discussion_r68506607 --- Diff: sql/core/src/test/scala/org/apache/spark/sql/DataFrameComplexTypeSuite.scala --- @@ -26,6 +26,20 @@ import org.apache.spark.sql.test.SharedS

[GitHub] spark pull request #13909: [SPARK-16213][SQL] Reduce runtime overhead of a p...

2016-06-26 Thread jaceklaskowski
Github user jaceklaskowski commented on a diff in the pull request: https://github.com/apache/spark/pull/13909#discussion_r68506564 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/complexTypeCreator.scala --- @@ -51,27 +51,52 @@ case class CreateArr

[GitHub] spark pull request #13909: [SPARK-16213][SQL] Reduce runtime overhead of a p...

2016-06-26 Thread jaceklaskowski
Github user jaceklaskowski commented on a diff in the pull request: https://github.com/apache/spark/pull/13909#discussion_r68506515 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/complexTypeCreator.scala --- @@ -51,27 +51,52 @@ case class CreateArr

[GitHub] spark pull request #13912: [SPARK-16216][SQL] CSV data source does not write...

2016-06-26 Thread jaceklaskowski
Github user jaceklaskowski commented on a diff in the pull request: https://github.com/apache/spark/pull/13912#discussion_r68506371 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/datasources/csv/CSVRelation.scala --- @@ -195,18 +202,50 @@ private[sql] class CsvOu

[GitHub] spark pull request #13912: [SPARK-16216][SQL] CSV data source does not write...

2016-06-26 Thread jaceklaskowski
Github user jaceklaskowski commented on a diff in the pull request: https://github.com/apache/spark/pull/13912#discussion_r68506352 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/datasources/csv/CSVRelation.scala --- @@ -195,18 +202,50 @@ private[sql] class CsvOu

[GitHub] spark issue #13494: [SPARK-15752] [SQL] support optimization for metadata on...

2016-06-26 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/13494 **[Test build #61271 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/61271/consoleFull)** for PR 13494 at commit [`3411fd6`](https://github.com/apache/spark/commit/3

[GitHub] spark issue #13758: [SPARK-16043][SQL] Prepare GenericArrayData implementati...

2016-06-26 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/13758 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/61270/ Test FAILed. ---

[GitHub] spark issue #13758: [SPARK-16043][SQL] Prepare GenericArrayData implementati...

2016-06-26 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/13758 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #13758: [SPARK-16043][SQL] Prepare GenericArrayData implementati...

2016-06-26 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/13758 **[Test build #61270 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/61270/consoleFull)** for PR 13758 at commit [`efdd270`](https://github.com/apache/spark/commit/

[GitHub] spark issue #13758: [SPARK-16043][SQL] Prepare GenericArrayData implementati...

2016-06-26 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/13758 **[Test build #61270 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/61270/consoleFull)** for PR 13758 at commit [`efdd270`](https://github.com/apache/spark/commit/e

[GitHub] spark issue #13758: [SPARK-16043][SQL] Prepare GenericArrayData implementati...

2016-06-26 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/13758 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/61269/ Test PASSed. ---

[GitHub] spark issue #13758: [SPARK-16043][SQL] Prepare GenericArrayData implementati...

2016-06-26 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/13758 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #13758: [SPARK-16043][SQL] Prepare GenericArrayData implementati...

2016-06-26 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/13758 **[Test build #61269 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/61269/consoleFull)** for PR 13758 at commit [`dc5d585`](https://github.com/apache/spark/commit/

[GitHub] spark issue #13914: [SPARK-16111][SQL][DOC] Hide SparkOrcNewRecordReader in ...

2016-06-26 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/13914 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/61267/ Test PASSed. ---

[GitHub] spark issue #13914: [SPARK-16111][SQL][DOC] Hide SparkOrcNewRecordReader in ...

2016-06-26 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/13914 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #13914: [SPARK-16111][SQL][DOC] Hide SparkOrcNewRecordReader in ...

2016-06-26 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/13914 **[Test build #61267 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/61267/consoleFull)** for PR 13914 at commit [`63ab73a`](https://github.com/apache/spark/commit/

[GitHub] spark issue #13758: [SPARK-16043][SQL] Prepare GenericArrayData implementati...

2016-06-26 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/13758 **[Test build #61269 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/61269/consoleFull)** for PR 13758 at commit [`dc5d585`](https://github.com/apache/spark/commit/d

[GitHub] spark issue #13758: [SPARK-16043][SQL] Prepare GenericArrayData implementati...

2016-06-26 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/13758 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #13758: [SPARK-16043][SQL] Prepare GenericArrayData implementati...

2016-06-26 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/13758 **[Test build #61266 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/61266/consoleFull)** for PR 13758 at commit [`9378764`](https://github.com/apache/spark/commit/

[GitHub] spark issue #13758: [SPARK-16043][SQL] Prepare GenericArrayData implementati...

2016-06-26 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/13758 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/61266/ Test FAILed. ---

[GitHub] spark issue #13894: [SPARK-15254][DOC] Improve ML pipeline Cross Validation ...

2016-06-26 Thread krishnakalyan3
Github user krishnakalyan3 commented on the issue: https://github.com/apache/spark/pull/13894 cc @holdenk --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so,

[GitHub] spark issue #13910: [SPARK-16214] [Examples] fix the denominator of SparkPi

2016-06-26 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/13910 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #13910: [SPARK-16214] [Examples] fix the denominator of SparkPi

2016-06-26 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/13910 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/61268/ Test PASSed. ---

[GitHub] spark issue #13910: [SPARK-16214] [Examples] fix the denominator of SparkPi

2016-06-26 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/13910 **[Test build #61268 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/61268/consoleFull)** for PR 13910 at commit [`1cfbea2`](https://github.com/apache/spark/commit/

[GitHub] spark issue #13914: [SPARK-16111][DOC] Hide SparkOrcNewRecordReader in API d...

2016-06-26 Thread dongjoon-hyun
Github user dongjoon-hyun commented on the issue: https://github.com/apache/spark/pull/13914 Hi, @mengxr . Could you review this PR? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this f

[GitHub] spark pull request #13914: [SPARK-16111][DOC] Hide SparkOrcNewRecordReader i...

2016-06-26 Thread dongjoon-hyun
Github user dongjoon-hyun commented on a diff in the pull request: https://github.com/apache/spark/pull/13914#discussion_r68502088 --- Diff: project/SparkBuild.scala --- @@ -733,7 +734,8 @@ object Unidoc { unidocSourceBase := s"https://github.com/apache/spark/tree/v${versi

[GitHub] spark pull request #13914: [SPARK-16111][DOC] Hide SparkOrcNewRecordReader i...

2016-06-26 Thread dongjoon-hyun
Github user dongjoon-hyun commented on a diff in the pull request: https://github.com/apache/spark/pull/13914#discussion_r68502066 --- Diff: project/SparkBuild.scala --- @@ -720,6 +720,7 @@ object Unidoc { // Skip class names containing $ and some internal packages in Javad

[GitHub] spark issue #13910: [SPARK-16214] [Examples] fix the denominator of SparkPi

2016-06-26 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/13910 **[Test build #61268 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/61268/consoleFull)** for PR 13910 at commit [`1cfbea2`](https://github.com/apache/spark/commit/1

[GitHub] spark issue #13914: [SPARK-16111][DOC] Hide SparkOrcNewRecordReader in API d...

2016-06-26 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/13914 **[Test build #61267 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/61267/consoleFull)** for PR 13914 at commit [`63ab73a`](https://github.com/apache/spark/commit/6

[GitHub] spark pull request #13914: [SPARK-16111][DOC] Hide SparkOrcNewRecordReader i...

2016-06-26 Thread dongjoon-hyun
GitHub user dongjoon-hyun opened a pull request: https://github.com/apache/spark/pull/13914 [SPARK-16111][DOC] Hide SparkOrcNewRecordReader in API docs ## What changes were proposed in this pull request? This PR hides `SparkOrcNewRecordReader` from API docs. ## How

[GitHub] spark issue #13910: [SPARK-16214] [Examples] fix the denominator of SparkPi

2016-06-26 Thread srowen
Github user srowen commented on the issue: https://github.com/apache/spark/pull/13910 Jenkins retest this please --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishe

[GitHub] spark issue #13758: [SPARK-16043][SQL] Prepare GenericArrayData implementati...

2016-06-26 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/13758 **[Test build #61266 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/61266/consoleFull)** for PR 13758 at commit [`9378764`](https://github.com/apache/spark/commit/9

[GitHub] spark issue #13913: [SPARK-10591][TEST] Add a testcase to ensure if `checkAn...

2016-06-26 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/13913 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #13913: [SPARK-10591][TEST] Add a testcase to ensure if `checkAn...

2016-06-26 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/13913 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/61265/ Test PASSed. ---

[GitHub] spark issue #13913: [SPARK-10591][TEST] Add a testcase to ensure if `checkAn...

2016-06-26 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/13913 **[Test build #61265 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/61265/consoleFull)** for PR 13913 at commit [`834f515`](https://github.com/apache/spark/commit/

[GitHub] spark issue #13909: [SPARK-16213][SQL] Reduce runtime overhead of a program ...

2016-06-26 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/13909 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/61264/ Test PASSed. ---

[GitHub] spark issue #13909: [SPARK-16213][SQL] Reduce runtime overhead of a program ...

2016-06-26 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/13909 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #13909: [SPARK-16213][SQL] Reduce runtime overhead of a program ...

2016-06-26 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/13909 **[Test build #61264 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/61264/consoleFull)** for PR 13909 at commit [`681be95`](https://github.com/apache/spark/commit/

[GitHub] spark issue #13913: [SPARK-10591][TEST] Add a testcase to ensure if `checkAn...

2016-06-26 Thread dongjoon-hyun
Github user dongjoon-hyun commented on the issue: https://github.com/apache/spark/pull/13913 Hi, @liancheng . When I check [SPARK-10591](https://issues.apache.org/jira/browse/SPARK-10591) today, it is handled by `Row.equals` correctly. I just make this PR for ensuring that for

[GitHub] spark issue #13911: [SPARK-16215][SQL] Reduce runtime overhead of a program ...

2016-06-26 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/13911 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/61262/ Test PASSed. ---

[GitHub] spark issue #13911: [SPARK-16215][SQL] Reduce runtime overhead of a program ...

2016-06-26 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/13911 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #13913: [SPARK-10591][TEST] Add a testcase to ensure if `checkAn...

2016-06-26 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/13913 **[Test build #61265 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/61265/consoleFull)** for PR 13913 at commit [`834f515`](https://github.com/apache/spark/commit/8

[GitHub] spark issue #13911: [SPARK-16215][SQL] Reduce runtime overhead of a program ...

2016-06-26 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/13911 **[Test build #61262 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/61262/consoleFull)** for PR 13911 at commit [`333f7b6`](https://github.com/apache/spark/commit/

[GitHub] spark pull request #13913: [SPARK-10591][TEST] Add a testcase to ensure if `...

2016-06-26 Thread dongjoon-hyun
GitHub user dongjoon-hyun opened a pull request: https://github.com/apache/spark/pull/13913 [SPARK-10591][TEST] Add a testcase to ensure if `checkAnswer` handles map correctly ## What changes were proposed in this pull request? This PR adds a testcase to ensure if `checkAns

[GitHub] spark issue #13758: [SPARK-16043][SQL] Prepare GenericArrayData implementati...

2016-06-26 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/13758 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/61263/ Test FAILed. ---

[GitHub] spark issue #13758: [SPARK-16043][SQL] Prepare GenericArrayData implementati...

2016-06-26 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/13758 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #13758: [SPARK-16043][SQL] Prepare GenericArrayData implementati...

2016-06-26 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/13758 **[Test build #61263 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/61263/consoleFull)** for PR 13758 at commit [`3136ab5`](https://github.com/apache/spark/commit/

[GitHub] spark issue #13906: [SPARK-16208][SQL] Add `CollapseEmptyPlan` optimizer

2016-06-26 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/13906 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #13906: [SPARK-16208][SQL] Add `CollapseEmptyPlan` optimizer

2016-06-26 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/13906 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/61260/ Test PASSed. ---

[GitHub] spark issue #13906: [SPARK-16208][SQL] Add `CollapseEmptyPlan` optimizer

2016-06-26 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/13906 **[Test build #61260 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/61260/consoleFull)** for PR 13906 at commit [`bd39437`](https://github.com/apache/spark/commit/

[GitHub] spark issue #13909: [SPARK-16213][SQL] Reduce runtime overhead of a program ...

2016-06-26 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/13909 **[Test build #61264 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/61264/consoleFull)** for PR 13909 at commit [`681be95`](https://github.com/apache/spark/commit/6

[GitHub] spark issue #13758: [SPARK-16043][SQL] Prepare GenericArrayData implementati...

2016-06-26 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/13758 **[Test build #61263 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/61263/consoleFull)** for PR 13758 at commit [`3136ab5`](https://github.com/apache/spark/commit/3

[GitHub] spark issue #13910: make SparkPi iteration number correct

2016-06-26 Thread srowen
Github user srowen commented on the issue: https://github.com/apache/spark/pull/13910 I see, maybe better to just fix the denominator then. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have thi

[GitHub] spark issue #13910: make SparkPi iteration number correct

2016-06-26 Thread yanghaogn
Github user yanghaogn commented on the issue: https://github.com/apache/spark/pull/13910 As explained in apache#2874 ``` The max size of the input seq was Int.MaxValue - 1 ``` This change may cause a bug. For the input is very big and It can be treated as `not a problem

[GitHub] spark issue #13911: [SPARK-16215][SQL] Reduce runtime overhead of a program ...

2016-06-26 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/13911 **[Test build #61262 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/61262/consoleFull)** for PR 13911 at commit [`333f7b6`](https://github.com/apache/spark/commit/3

[GitHub] spark issue #13910: make SparkPi iteration number correct

2016-06-26 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/13910 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #13910: make SparkPi iteration number correct

2016-06-26 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/13910 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/61261/ Test PASSed. ---

[GitHub] spark issue #13910: make SparkPi iteration number correct

2016-06-26 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/13910 **[Test build #61261 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/61261/consoleFull)** for PR 13910 at commit [`f91e55e`](https://github.com/apache/spark/commit/

[GitHub] spark issue #13910: make SparkPi iteration number correct

2016-06-26 Thread srowen
Github user srowen commented on the issue: https://github.com/apache/spark/pull/13910 Not quite, see https://cwiki.apache.org/confluence/display/SPARK/Contributing+to+Spark and other PRs --- If your project is set up for it, you can reply to this email and have your reply appear on

[GitHub] spark issue #13910: make SparkPi iteration number correct

2016-06-26 Thread yanghaogn
Github user yanghaogn commented on the issue: https://github.com/apache/spark/pull/13910 @srowen It's been related now --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and

[GitHub] spark issue #13910: make SparkPi iteration number correct

2016-06-26 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/13910 **[Test build #61261 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/61261/consoleFull)** for PR 13910 at commit [`f91e55e`](https://github.com/apache/spark/commit/f

[GitHub] spark issue #13910: make SparkPi iteration number correct

2016-06-26 Thread srowen
Github user srowen commented on the issue: https://github.com/apache/spark/pull/13910 Jenkins test this please --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes

[GitHub] spark issue #13912: [SPARK-16216][SQL] CSV data source does not write date a...

2016-06-26 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/13912 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/61258/ Test PASSed. ---

[GitHub] spark issue #13912: [SPARK-16216][SQL] CSV data source does not write date a...

2016-06-26 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/13912 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #13912: [SPARK-16216][SQL] CSV data source does not write date a...

2016-06-26 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/13912 **[Test build #61258 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/61258/consoleFull)** for PR 13912 at commit [`79a290a`](https://github.com/apache/spark/commit/

[GitHub] spark issue #13912: [SPARK-16216][SQL] CSV data source does not write date a...

2016-06-26 Thread srowen
Github user srowen commented on the issue: https://github.com/apache/spark/pull/13912 I suppose that if it's configurable, and not the default, then you're letting people do what they want at least, including specify a format with a timezone. I think it's virtually always asking for t

[GitHub] spark issue #13906: [SPARK-16208][SQL] Add `CollapseEmptyPlan` optimizer

2016-06-26 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/13906 **[Test build #61260 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/61260/consoleFull)** for PR 13906 at commit [`bd39437`](https://github.com/apache/spark/commit/b

[GitHub] spark issue #13765: [SPARK-16052][SQL] Add `CollapseRepartitionBy` optimizer

2016-06-26 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/13765 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #13765: [SPARK-16052][SQL] Add `CollapseRepartitionBy` optimizer

2016-06-26 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/13765 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/61255/ Test PASSed. ---

[GitHub] spark issue #13765: [SPARK-16052][SQL] Add `CollapseRepartitionBy` optimizer

2016-06-26 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/13765 **[Test build #61255 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/61255/consoleFull)** for PR 13765 at commit [`c3016f3`](https://github.com/apache/spark/commit/

[GitHub] spark issue #13845: [SPARK-13023][PROJECT INFRA][FOLLOWUP][BRANCH-1.6] Unabl...

2016-06-26 Thread HyukjinKwon
Github user HyukjinKwon commented on the issue: https://github.com/apache/spark/pull/13845 @JoshRosen Could you take a look by any change please? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not ha

[GitHub] spark issue #13730: [SPARK-16006][SQL] Attemping to write empty DataFrame wi...

2016-06-26 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/13730 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/61254/ Test PASSed. ---

[GitHub] spark issue #13730: [SPARK-16006][SQL] Attemping to write empty DataFrame wi...

2016-06-26 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/13730 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #13730: [SPARK-16006][SQL] Attemping to write empty DataFrame wi...

2016-06-26 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/13730 **[Test build #61254 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/61254/consoleFull)** for PR 13730 at commit [`ba9a529`](https://github.com/apache/spark/commit/

[GitHub] spark issue #13912: [SPARK-16216][SQL] CSV data source does not write date a...

2016-06-26 Thread HyukjinKwon
Github user HyukjinKwon commented on the issue: https://github.com/apache/spark/pull/13912 Hm.. Anyway do you think I should close this and deal with JSON one? I can't decide. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as w

[GitHub] spark issue #13912: [SPARK-16216][SQL] CSV data source does not write date a...

2016-06-26 Thread HyukjinKwon
Github user HyukjinKwon commented on the issue: https://github.com/apache/spark/pull/13912 I understand the problem without a timezone but.. hm.. to be honest, I have seen a lot of cases of reading and writing times without a timezone (e.g. by Microsoft Excel). --- If your project i

[GitHub] spark issue #13911: [SPARK-16215][SQL] Reduce runtime overhead of a program ...

2016-06-26 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/13911 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/61256/ Test FAILed. ---

[GitHub] spark issue #13911: [SPARK-16215][SQL] Reduce runtime overhead of a program ...

2016-06-26 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/13911 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #13911: [SPARK-16215][SQL] Reduce runtime overhead of a program ...

2016-06-26 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/13911 **[Test build #61256 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/61256/consoleFull)** for PR 13911 at commit [`b1f6289`](https://github.com/apache/spark/commit/

[GitHub] spark issue #13912: [SPARK-16216][SQL] CSV data source does not write date a...

2016-06-26 Thread HyukjinKwon
Github user HyukjinKwon commented on the issue: https://github.com/apache/spark/pull/13912 @srowen How about leaving them as timestamps long values but write them as formatted strings only when `dateFormat` is given? --- If your project is set up for it, you can reply to this email a

[GitHub] spark issue #13680: [SPARK-15962][SQL] Introduce implementation with a dense...

2016-06-26 Thread kiszk
Github user kiszk commented on the issue: https://github.com/apache/spark/pull/13680 @rxin thank you for your comment. As you said, holistic view is important. This PR is not only for machine learning. This PR has another use case for improving projection of an array in any p

<    1   2