[GitHub] spark issue #13911: [SPARK-16215][SQL] Reduce runtime overhead of a program ...

2016-06-25 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/13911 **[Test build #61256 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/61256/consoleFull)** for PR 13911 at commit

[GitHub] spark pull request #13911: [SPARK-16215][SQL] Reduce runtime overhead of a p...

2016-06-25 Thread kiszk
GitHub user kiszk opened a pull request: https://github.com/apache/spark/pull/13911 [SPARK-16215][SQL] Reduce runtime overhead of a program that writes an primitive array in Dataframe/Dataset ## What changes were proposed in this pull request? This PR optimize generate

[GitHub] spark issue #13765: [SPARK-16052][SQL] Add `CollapseRepartitionBy` optimizer

2016-06-25 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/13765 **[Test build #61255 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/61255/consoleFull)** for PR 13765 at commit

[GitHub] spark issue #13730: [SPARK-16006][SQL] Attemping to write empty DataFrame wi...

2016-06-25 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/13730 **[Test build #61254 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/61254/consoleFull)** for PR 13730 at commit

[GitHub] spark pull request #13624: [SPARK-15858][ML]: Fix calculating error by tree ...

2016-06-25 Thread mhmoudr
Github user mhmoudr commented on a diff in the pull request: https://github.com/apache/spark/pull/13624#discussion_r68497920 --- Diff: mllib/src/main/scala/org/apache/spark/ml/tree/impl/GradientBoostedTrees.scala --- @@ -205,31 +205,29 @@ private[spark] object

[GitHub] spark issue #13886: [SPARK-16185] [SQL] Better Error Messages When Creating ...

2016-06-25 Thread gatorsmile
Github user gatorsmile commented on the issue: https://github.com/apache/spark/pull/13886 @cloud-fan Submitted a PR for converting CTAS in parquet to data source tables without hive support. Could you also review that PR? Thanks! --- If your project is set up for it, you can reply

[GitHub] spark issue #13386: [SPARK-15646] [SQL] When spark.sql.hive.convertCTAS is t...

2016-06-25 Thread gatorsmile
Github user gatorsmile commented on the issue: https://github.com/apache/spark/pull/13386 Just realized this PR introduced the original changes. Could you also review my PR: https://github.com/apache/spark/pull/13907? When users create table as query with `STORED AS` or `ROW

[GitHub] spark issue #13758: [SPARK-16043][SQL] Prepare GenericArrayData implementati...

2016-06-25 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/13758 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #13758: [SPARK-16043][SQL] Prepare GenericArrayData implementati...

2016-06-25 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/13758 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/61247/ Test FAILed. ---

[GitHub] spark issue #13758: [SPARK-16043][SQL] Prepare GenericArrayData implementati...

2016-06-25 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/13758 **[Test build #61247 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/61247/consoleFull)** for PR 13758 at commit

[GitHub] spark issue #13908: [SPARK-16212][STREAMING][KAFKA] code cleanup from review...

2016-06-25 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/13908 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/61251/ Test PASSed. ---

[GitHub] spark issue #13908: [SPARK-16212][STREAMING][KAFKA] code cleanup from review...

2016-06-25 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/13908 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #13908: [SPARK-16212][STREAMING][KAFKA] code cleanup from review...

2016-06-25 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/13908 **[Test build #61251 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/61251/consoleFull)** for PR 13908 at commit

[GitHub] spark issue #13909: [SPARK-16213][SQL] Reduce runtime overhead of a program ...

2016-06-25 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/13909 **[Test build #61250 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/61250/consoleFull)** for PR 13909 at commit

[GitHub] spark issue #11863: [SPARK-12177][Streaming][Kafka] Update KafkaDStreams to ...

2016-06-25 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/11863 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #13909: [SPARK-16213][SQL] Reduce runtime overhead of a program ...

2016-06-25 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/13909 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/61250/ Test FAILed. ---

[GitHub] spark issue #11863: [SPARK-12177][Streaming][Kafka] Update KafkaDStreams to ...

2016-06-25 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/11863 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/61252/ Test FAILed. ---

[GitHub] spark issue #13909: [SPARK-16213][SQL] Reduce runtime overhead of a program ...

2016-06-25 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/13909 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #11863: [SPARK-12177][Streaming][Kafka] Update KafkaDStreams to ...

2016-06-25 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/11863 **[Test build #61252 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/61252/consoleFull)** for PR 11863 at commit

[GitHub] spark issue #13907: [SPARK-16209] [SQL] Convert Hive Tables in PARQUET/ORC t...

2016-06-25 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/13907 **[Test build #61253 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/61253/consoleFull)** for PR 13907 at commit

[GitHub] spark issue #11863: [SPARK-12177][Streaming][Kafka] Update KafkaDStreams to ...

2016-06-25 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/11863 **[Test build #61252 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/61252/consoleFull)** for PR 11863 at commit

[GitHub] spark issue #13908: [SPARK-16212][STREAMING][KAFKA] code cleanup from review...

2016-06-25 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/13908 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/61249/ Test PASSed. ---

[GitHub] spark issue #13908: [SPARK-16212][STREAMING][KAFKA] code cleanup from review...

2016-06-25 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/13908 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #13908: [SPARK-16212][STREAMING][KAFKA] code cleanup from review...

2016-06-25 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/13908 **[Test build #61249 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/61249/consoleFull)** for PR 13908 at commit

[GitHub] spark issue #13908: [SPARK-16212][STREAMING][KAFKA] code cleanup from review...

2016-06-25 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/13908 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #13908: [SPARK-16212][STREAMING][KAFKA] code cleanup from review...

2016-06-25 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/13908 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/61248/ Test PASSed. ---

[GitHub] spark issue #13908: [SPARK-16212][STREAMING][KAFKA] code cleanup from review...

2016-06-25 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/13908 **[Test build #61248 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/61248/consoleFull)** for PR 13908 at commit

[GitHub] spark issue #13910: make rdd count be n

2016-06-25 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/13910 Can one of the admins verify this patch? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this

[GitHub] spark issue #13910: make rdd count be n

2016-06-25 Thread yanghaogn
Github user yanghaogn commented on the issue: https://github.com/apache/spark/pull/13910 As the denominator is n, the iteration time should also be n --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does

[GitHub] spark pull request #13910: make rdd count be n

2016-06-25 Thread yanghaogn
GitHub user yanghaogn opened a pull request: https://github.com/apache/spark/pull/13910 make rdd count be n ## What changes were proposed in this pull request? (Please fill in changes proposed in this fix) ## How was this patch tested? (Please explain

[GitHub] spark issue #13909: [SPARK-16213][SQL] Reduce runtime overhead of a program ...

2016-06-25 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/13909 **[Test build #61250 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/61250/consoleFull)** for PR 13909 at commit

[GitHub] spark issue #13908: [SPARK-16212][STREAMING][KAFKA] code cleanup from review...

2016-06-25 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/13908 **[Test build #61251 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/61251/consoleFull)** for PR 13908 at commit

[GitHub] spark pull request #13909: [SPARK-16213][SQL] Reduce runtime overhead of a p...

2016-06-25 Thread kiszk
GitHub user kiszk opened a pull request: https://github.com/apache/spark/pull/13909 [SPARK-16213][SQL] Reduce runtime overhead of a program that creates an primitive array in DataFrame ## What changes were proposed in this pull request? This PR reduces runtime overhead of

[GitHub] spark issue #13908: [SPARK-16212][STREAMING][KAFKA] code cleanup from review...

2016-06-25 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/13908 **[Test build #61249 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/61249/consoleFull)** for PR 13908 at commit

[GitHub] spark issue #13908: [SPARK-16212][STREAMING][KAFKA] code cleanup from review...

2016-06-25 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/13908 **[Test build #61248 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/61248/consoleFull)** for PR 13908 at commit

[GitHub] spark pull request #13908: [SPARK-16212][STREAMING][KAFKA] code cleanup from...

2016-06-25 Thread koeninger
GitHub user koeninger opened a pull request: https://github.com/apache/spark/pull/13908 [SPARK-16212][STREAMING][KAFKA] code cleanup from review feedback ## What changes were proposed in this pull request? code cleanup in kafka-0-8 to match suggested changes for kafka-0-10

[GitHub] spark issue #13758: [SPARK-16043][SQL] Prepare GenericArrayData implementati...

2016-06-25 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/13758 **[Test build #61247 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/61247/consoleFull)** for PR 13758 at commit

[GitHub] spark issue #13885: [SPARK-16184][SPARKR] conf API for SparkSession

2016-06-25 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/13885 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/61245/ Test PASSed. ---

[GitHub] spark issue #13885: [SPARK-16184][SPARKR] conf API for SparkSession

2016-06-25 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/13885 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #13885: [SPARK-16184][SPARKR] conf API for SparkSession

2016-06-25 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/13885 **[Test build #61245 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/61245/consoleFull)** for PR 13885 at commit

[GitHub] spark issue #13904: [SPARKR] add csv tests

2016-06-25 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/13904 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/61246/ Test PASSed. ---

[GitHub] spark issue #13904: [SPARKR] add csv tests

2016-06-25 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/13904 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #13904: [SPARKR] add csv tests

2016-06-25 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/13904 **[Test build #61246 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/61246/consoleFull)** for PR 13904 at commit

[GitHub] spark issue #13758: [SPARK-16043][SQL] Prepare GenericArrayData implementati...

2016-06-25 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/13758 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/61244/ Test FAILed. ---

[GitHub] spark issue #13758: [SPARK-16043][SQL] Prepare GenericArrayData implementati...

2016-06-25 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/13758 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #13758: [SPARK-16043][SQL] Prepare GenericArrayData implementati...

2016-06-25 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/13758 **[Test build #61244 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/61244/consoleFull)** for PR 13758 at commit

[GitHub] spark issue #9936: [SPARK-11938][ML] Expose numFeatures in all ML Prediction...

2016-06-25 Thread Lewuathe
Github user Lewuathe commented on the issue: https://github.com/apache/spark/pull/9936 @vectorijk It seems difficult to handle this JIRA for me. Could you help me with this? Thanks so much for taking care! --- If your project is set up for it, you can reply to this email and

[GitHub] spark issue #13904: [SPARKR] add csv tests

2016-06-25 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/13904 **[Test build #61246 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/61246/consoleFull)** for PR 13904 at commit

[GitHub] spark issue #13885: [SPARK-16184][SPARKR] conf API for SparkSession

2016-06-25 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/13885 **[Test build #61245 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/61245/consoleFull)** for PR 13885 at commit

[GitHub] spark pull request #13885: [SPARK-16184][SPARKR] conf API for SparkSession

2016-06-25 Thread felixcheung
Github user felixcheung commented on a diff in the pull request: https://github.com/apache/spark/pull/13885#discussion_r68496462 --- Diff: R/pkg/R/SQLContext.R --- @@ -110,11 +110,46 @@ infer_type <- function(x) { } } -getDefaultSqlSource <- function() {

[GitHub] spark issue #13758: [SPARK-16043][SQL] Prepare GenericArrayData implementati...

2016-06-25 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/13758 **[Test build #61244 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/61244/consoleFull)** for PR 13758 at commit

[GitHub] spark pull request #13888: [SPARK-16187] [ML] Implement util method for ML M...

2016-06-25 Thread hhbyyh
Github user hhbyyh commented on a diff in the pull request: https://github.com/apache/spark/pull/13888#discussion_r68496003 --- Diff: mllib/src/main/scala/org/apache/spark/mllib/util/MLUtils.scala --- @@ -309,8 +309,8 @@ object MLUtils extends Logging { } /**

[GitHub] spark issue #13907: [SPARK-16209] [SQL] Convert Hive Tables to Data Source T...

2016-06-25 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/13907 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/61243/ Test FAILed. ---

[GitHub] spark issue #13907: [SPARK-16209] [SQL] Convert Hive Tables to Data Source T...

2016-06-25 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/13907 **[Test build #61243 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/61243/consoleFull)** for PR 13907 at commit

[GitHub] spark issue #13907: [SPARK-16209] [SQL] Convert Hive Tables to Data Source T...

2016-06-25 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/13907 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #13876: [SPARK-16174][SQL] Improve OptimizeIn optimizer to remov...

2016-06-25 Thread dongjoon-hyun
Github user dongjoon-hyun commented on the issue: https://github.com/apache/spark/pull/13876 Hi, @rxin . For this `OptimizeIn` PR, please let me know if we need further optimization. Thank you always. --- If your project is set up for it, you can reply to this email and have

[GitHub] spark pull request #13906: [SPARK-16208][SQL] Add `CollapseEmptyPlan` optimi...

2016-06-25 Thread dongjoon-hyun
Github user dongjoon-hyun commented on a diff in the pull request: https://github.com/apache/spark/pull/13906#discussion_r68495438 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/optimizer/Optimizer.scala --- @@ -1053,6 +1055,34 @@ object PruneFilters extends

[GitHub] spark pull request #13906: [SPARK-16208][SQL] Add `CollapseEmptyPlan` optimi...

2016-06-25 Thread dongjoon-hyun
Github user dongjoon-hyun commented on a diff in the pull request: https://github.com/apache/spark/pull/13906#discussion_r68495422 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/optimizer/Optimizer.scala --- @@ -1053,6 +1055,34 @@ object PruneFilters extends

[GitHub] spark issue #13907: [SPARK-16209] [SQL] Convert Hive Tables to Data Source T...

2016-06-25 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/13907 **[Test build #61243 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/61243/consoleFull)** for PR 13907 at commit

[GitHub] spark pull request #13907: [SPARK-16209] [SQL] Convert Hive Tables to Data S...

2016-06-25 Thread gatorsmile
GitHub user gatorsmile opened a pull request: https://github.com/apache/spark/pull/13907 [SPARK-16209] [SQL] Convert Hive Tables to Data Source Tables for CREATE TABLE AS SELECT What changes were proposed in this pull request? Currently, the following created table is Hive

[GitHub] spark pull request #13906: [SPARK-16208][SQL] Add `CollapseEmptyPlan` optimi...

2016-06-25 Thread rxin
Github user rxin commented on a diff in the pull request: https://github.com/apache/spark/pull/13906#discussion_r68495048 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/optimizer/Optimizer.scala --- @@ -1053,6 +1055,34 @@ object PruneFilters extends

[GitHub] spark issue #13906: [SPARK-16208][SQL] Add `CollapseEmptyPlan` optimizer

2016-06-25 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/13906 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #13906: [SPARK-16208][SQL] Add `CollapseEmptyPlan` optimizer

2016-06-25 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/13906 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/61242/ Test PASSed. ---

[GitHub] spark issue #13906: [SPARK-16208][SQL] Add `CollapseEmptyPlan` optimizer

2016-06-25 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/13906 **[Test build #61242 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/61242/consoleFull)** for PR 13906 at commit

[GitHub] spark issue #13906: [SPARK-16208][SQL] Add `CollapseEmptyPlan` optimizer

2016-06-25 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/13906 **[Test build #61242 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/61242/consoleFull)** for PR 13906 at commit

[GitHub] spark pull request #13906: [SPARK-16208][SQL] Add `CollapseEmptyPlan` optimi...

2016-06-25 Thread dongjoon-hyun
GitHub user dongjoon-hyun opened a pull request: https://github.com/apache/spark/pull/13906 [SPARK-16208][SQL] Add `CollapseEmptyPlan` optimizer ## What changes were proposed in this pull request? This PR adds a new logical optimizer, `CollapseEmptyPlan`, to collapse a

[GitHub] spark issue #13758: [SPARK-16043][SQL] Prepare GenericArrayData implementati...

2016-06-25 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/13758 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #13758: [SPARK-16043][SQL] Prepare GenericArrayData implementati...

2016-06-25 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/13758 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/61241/ Test FAILed. ---

[GitHub] spark issue #13758: [SPARK-16043][SQL] Prepare GenericArrayData implementati...

2016-06-25 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/13758 **[Test build #61241 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/61241/consoleFull)** for PR 13758 at commit

[GitHub] spark issue #13860: [SPARK-16157] [SQL] Add New Methods for comments in Stru...

2016-06-25 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/13860 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/61240/ Test PASSed. ---

[GitHub] spark issue #13860: [SPARK-16157] [SQL] Add New Methods for comments in Stru...

2016-06-25 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/13860 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #13860: [SPARK-16157] [SQL] Add New Methods for comments in Stru...

2016-06-25 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/13860 **[Test build #61240 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/61240/consoleFull)** for PR 13860 at commit

[GitHub] spark issue #13680: [SPARK-15962][SQL] Introduce implementation with a dense...

2016-06-25 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/13680 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/61239/ Test PASSed. ---

[GitHub] spark issue #13680: [SPARK-15962][SQL] Introduce implementation with a dense...

2016-06-25 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/13680 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #13680: [SPARK-15962][SQL] Introduce implementation with a dense...

2016-06-25 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/13680 **[Test build #61239 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/61239/consoleFull)** for PR 13680 at commit

[GitHub] spark issue #11863: [SPARK-12177][Streaming][Kafka] Update KafkaDStreams to ...

2016-06-25 Thread koeninger
Github user koeninger commented on the issue: https://github.com/apache/spark/pull/11863 Sorry for the delayed reply, I had travel plans that had to be canceled due to a family emergency (everyone's mostly ok). 1 + 2, I understand that preferred locations is not a

[GitHub] spark issue #13758: [SPARK-16043][SQL] Prepare GenericArrayData implementati...

2016-06-25 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/13758 **[Test build #61241 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/61241/consoleFull)** for PR 13758 at commit

[GitHub] spark issue #13758: [SPARK-16043][SQL] Prepare GenericArrayData implementati...

2016-06-25 Thread kiszk
Github user kiszk commented on the issue: https://github.com/apache/spark/pull/13758 Jenkins, retest this please --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and

[GitHub] spark issue #13758: [SPARK-16043][SQL] Prepare GenericArrayData implementati...

2016-06-25 Thread kiszk
Github user kiszk commented on the issue: https://github.com/apache/spark/pull/13758 @hvanhovell and @cloud-fan This```GenericArrayData``` can be used in generated code for a program with an primitive array written in DataFrame or Dataset. I newly added Dataframe benchmark program

[GitHub] spark pull request #13905: [SPARK-16208][SQL] Add `CollapseEmptyPlan` optimi...

2016-06-25 Thread dongjoon-hyun
Github user dongjoon-hyun closed the pull request at: https://github.com/apache/spark/pull/13905 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the

[GitHub] spark issue #13860: [SPARK-16157] [SQL] Add New Methods for comments in Stru...

2016-06-25 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/13860 **[Test build #61240 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/61240/consoleFull)** for PR 13860 at commit

[GitHub] spark issue #13899: [SPARK-16196][SQL] Codegen in-memory scan with ColumnarB...

2016-06-25 Thread kiszk
Github user kiszk commented on the issue: https://github.com/apache/spark/pull/13899 @andrewor14 Looks interesting. I created two PRs that generate similar code like [your code](https://gist.github.com/andrewor14/7ce4c37a3c6bcd5cc2b6b16c861859e9). My PRs use current

[GitHub] spark pull request #13885: [SPARK-16184][SPARKR] conf API for SparkSession

2016-06-25 Thread shivaram
Github user shivaram commented on a diff in the pull request: https://github.com/apache/spark/pull/13885#discussion_r68491306 --- Diff: R/pkg/R/SQLContext.R --- @@ -110,11 +110,46 @@ infer_type <- function(x) { } } -getDefaultSqlSource <- function() { +#'

[GitHub] spark issue #13847: [SPARK-16135][SQL] Remove hashCode and euqals in ArrayBa...

2016-06-25 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/13847 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #13847: [SPARK-16135][SQL] Remove hashCode and euqals in ArrayBa...

2016-06-25 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/13847 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/61237/ Test PASSed. ---

[GitHub] spark issue #13847: [SPARK-16135][SQL] Remove hashCode and euqals in ArrayBa...

2016-06-25 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/13847 **[Test build #61237 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/61237/consoleFull)** for PR 13847 at commit

[GitHub] spark issue #13758: [SPARK-16043][SQL] Prepare GenericArrayData implementati...

2016-06-25 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/13758 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/61238/ Test FAILed. ---

[GitHub] spark issue #13758: [SPARK-16043][SQL] Prepare GenericArrayData implementati...

2016-06-25 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/13758 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #13758: [SPARK-16043][SQL] Prepare GenericArrayData implementati...

2016-06-25 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/13758 **[Test build #61238 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/61238/consoleFull)** for PR 13758 at commit

[GitHub] spark pull request #13860: [SPARK-16157] [SQL] Add New Methods for comments ...

2016-06-25 Thread gatorsmile
Github user gatorsmile commented on a diff in the pull request: https://github.com/apache/spark/pull/13860#discussion_r68491125 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/types/StructField.scala --- @@ -51,4 +51,35 @@ case class StructField( ("nullable"

[GitHub] spark issue #13680: [SPARK-15962][SQL] Introduce implementation with a dense...

2016-06-25 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/13680 **[Test build #61239 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/61239/consoleFull)** for PR 13680 at commit

[GitHub] spark issue #13680: [SPARK-15962][SQL] Introduce implementation with a dense...

2016-06-25 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/13680 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #13680: [SPARK-15962][SQL] Introduce implementation with a dense...

2016-06-25 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/13680 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/61236/ Test PASSed. ---

[GitHub] spark issue #13680: [SPARK-15962][SQL] Introduce implementation with a dense...

2016-06-25 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/13680 **[Test build #61236 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/61236/consoleFull)** for PR 13680 at commit

[GitHub] spark issue #13886: [SPARK-16185] [SQL] Better Error Messages When Creating ...

2016-06-25 Thread gatorsmile
Github user gatorsmile commented on the issue: https://github.com/apache/spark/pull/13886 CREATE TABLE AS SELECT can be converted to Create Data Source Table when the following condition is true: `the statement does not have the user-specified file format and row format`. (Actually,

[GitHub] spark issue #13897: [SPARK-16195][SQL] Allow users to specify empty over cla...

2016-06-25 Thread dilipbiswal
Github user dilipbiswal commented on the issue: https://github.com/apache/spark/pull/13897 Thanks a lot @hvanhovell @gatorsmile --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #13758: [SPARK-16043][SQL] Prepare GenericArrayData implementati...

2016-06-25 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/13758 **[Test build #61238 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/61238/consoleFull)** for PR 13758 at commit

[GitHub] spark issue #13847: [SPARK-16135][SQL] Remove hashCode and euqals in ArrayBa...

2016-06-25 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/13847 **[Test build #61237 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/61237/consoleFull)** for PR 13847 at commit

[GitHub] spark pull request #13847: [SPARK-16135][SQL] Remove hashCode and euqals in ...

2016-06-25 Thread maropu
Github user maropu commented on a diff in the pull request: https://github.com/apache/spark/pull/13847#discussion_r68490096 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/util/MapData.scala --- @@ -19,6 +19,10 @@ package org.apache.spark.sql.catalyst.util

[GitHub] spark issue #13680: [SPARK-15962][SQL] Introduce implementation with a dense...

2016-06-25 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/13680 **[Test build #61236 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/61236/consoleFull)** for PR 13680 at commit

  1   2   >