[GitHub] spark issue #14400: [Spark-16791] [SQL] cast struct with timestamp field fai...

2016-08-01 Thread cloud-fan
Github user cloud-fan commented on the issue: https://github.com/apache/spark/pull/14400 https://github.com/apache/spark/pull/14400#discussion_r72897142 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project

[GitHub] spark issue #14400: [Spark-16791] [SQL] cast struct with timestamp field fai...

2016-08-01 Thread eyalfa
Github user eyalfa commented on the issue: https://github.com/apache/spark/pull/14400 @cloud-fan, any update on this? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and

[GitHub] spark issue #11157: [SPARK-11714][Mesos] Make Spark on Mesos honor port rest...

2016-08-01 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/11157 **[Test build #63075 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/63075/consoleFull)** for PR 11157 at commit

[GitHub] spark pull request #14258: [Spark-16579][SparkR] add install.spark function

2016-08-01 Thread junyangq
Github user junyangq commented on a diff in the pull request: https://github.com/apache/spark/pull/14258#discussion_r72950957 --- Diff: R/pkg/R/install.R --- @@ -36,7 +36,7 @@ #' \code{without-hadoop}. #' #' @param hadoopVersion Version of Hadoop to install. Default

[GitHub] spark pull request #14258: [Spark-16579][SparkR] add install.spark function

2016-08-01 Thread junyangq
Github user junyangq commented on a diff in the pull request: https://github.com/apache/spark/pull/14258#discussion_r72950905 --- Diff: R/pkg/R/install.R --- @@ -0,0 +1,232 @@ +# +# Licensed to the Apache Software Foundation (ASF) under one or more +# contributor

[GitHub] spark issue #14435: [SPARK-16756][SQL][WIP] Add `sql` function to LogicalPla...

2016-08-01 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14435 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #14435: [SPARK-16756][SQL][WIP] Add `sql` function to LogicalPla...

2016-08-01 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14435 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/63074/ Test FAILed. ---

[GitHub] spark issue #14435: [SPARK-16756][SQL][WIP] Add `sql` function to LogicalPla...

2016-08-01 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14435 **[Test build #63074 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/63074/consoleFull)** for PR 14435 at commit

[GitHub] spark issue #14391: [SPARK-16767][SQL] Add existsRecursively to UserDefinedT...

2016-08-01 Thread cloud-fan
Github user cloud-fan commented on the issue: https://github.com/apache/spark/pull/14391 cc @mengxr what's the plan for UDT? Is it a public API now? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does

[GitHub] spark issue #14436: [SPARK-16816] Modify java example which is also refelect...

2016-08-01 Thread phalodi
Github user phalodi commented on the issue: https://github.com/apache/spark/pull/14436 @srowen @rxin Hey guyss i make changes as you suggested but yeah it not exactly what you suggested, i change in example which is also reflect in documentation, so please review it and give give

[GitHub] spark issue #14436: [SPARK-16816] Modify java example which is also refelect...

2016-08-01 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14436 Can one of the admins verify this patch? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this

[GitHub] spark pull request #14436: modify java example which is also refelect in doc...

2016-08-01 Thread phalodi
GitHub user phalodi opened a pull request: https://github.com/apache/spark/pull/14436 modify java example which is also refelect in documentation exmaple ## What changes were proposed in this pull request? Modify java example which is also reflect in document.

[GitHub] spark issue #14363: [SPARK-16731][SQL] use StructType in CatalogTable and re...

2016-08-01 Thread cloud-fan
Github user cloud-fan commented on the issue: https://github.com/apache/spark/pull/14363 Well, Spark SQL is not announced to be fully compatible with hive, I think it's reasonable to have some issues. cc @rxin @yhuai should we fix this? --- If your project is set up for it, you can

[GitHub] spark pull request #14355: [SPARK-16726][SQL] Improve `Union/Intersect/Excep...

2016-08-01 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/14355 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] spark issue #14355: [SPARK-16726][SQL] Improve `Union/Intersect/Except` erro...

2016-08-01 Thread hvanhovell
Github user hvanhovell commented on the issue: https://github.com/apache/spark/pull/14355 LGTM - merging to master. Thanks for working on this! --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark issue #14155: [SPARK-16498][SQL] move hive hack for data source table ...

2016-08-01 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14155 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #14155: [SPARK-16498][SQL] move hive hack for data source table ...

2016-08-01 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14155 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/63073/ Test PASSed. ---

[GitHub] spark issue #14155: [SPARK-16498][SQL] move hive hack for data source table ...

2016-08-01 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14155 **[Test build #63073 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/63073/consoleFull)** for PR 14155 at commit

[GitHub] spark issue #14363: [SPARK-16731][SQL] use StructType in CatalogTable and re...

2016-08-01 Thread lianhuiwang
Github user lianhuiwang commented on the issue: https://github.com/apache/spark/pull/14363 @cloud-fan There is a case that i met. The varchar(length)/char(length) type is not a String Type. But now SparkSQL consider them a string type. So there are different result with the

[GitHub] spark issue #14435: [SPARK-16756][SQL][WIP] Add `sql` function to LogicalPla...

2016-08-01 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14435 **[Test build #63074 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/63074/consoleFull)** for PR 14435 at commit

[GitHub] spark pull request #14435: [SPARK-16756][SQL][WIP] Add `sql` function to Log...

2016-08-01 Thread dongjoon-hyun
GitHub user dongjoon-hyun opened a pull request: https://github.com/apache/spark/pull/14435 [SPARK-16756][SQL][WIP] Add `sql` function to LogicalPlan and `NonSQLPlan` trait ## What changes were proposed in this pull request? This PR is a part of

[GitHub] spark issue #14434: [SPARK-16828][SQL] remove MaxOf and MinOf

2016-08-01 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14434 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/63072/ Test PASSed. ---

[GitHub] spark issue #14434: [SPARK-16828][SQL] remove MaxOf and MinOf

2016-08-01 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14434 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #14434: [SPARK-16828][SQL] remove MaxOf and MinOf

2016-08-01 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14434 **[Test build #63072 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/63072/consoleFull)** for PR 14434 at commit

[GitHub] spark issue #11673: [SPARK-13853][SQL] QueryPlan sub-classes should override...

2016-08-01 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/11673 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/63070/ Test PASSed. ---

[GitHub] spark issue #11673: [SPARK-13853][SQL] QueryPlan sub-classes should override...

2016-08-01 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/11673 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #11673: [SPARK-13853][SQL] QueryPlan sub-classes should override...

2016-08-01 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/11673 **[Test build #63070 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/63070/consoleFull)** for PR 11673 at commit

[GitHub] spark issue #14401: [SPARK-16793][SQL]Set the temporary warehouse path to sc...

2016-08-01 Thread jiangxb1987
Github user jiangxb1987 commented on the issue: https://github.com/apache/spark/pull/14401 cc @rxin --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if

[GitHub] spark issue #11601: [SPARK-13568] [ML] Create feature transformer to impute ...

2016-08-01 Thread MLnick
Github user MLnick commented on the issue: https://github.com/apache/spark/pull/11601 @hhbyyh could you update the since annotations to target `2.1.0`? @jkbradley if you have a chance to review would be great. Thanks! --- If your project is set up for it, you can reply to this email

[GitHub] spark issue #14118: [SPARK-16462][SPARK-16460][SPARK-15144][SQL] Make CSV ca...

2016-08-01 Thread lw-lin
Github user lw-lin commented on the issue: https://github.com/apache/spark/pull/14118 Here are some findings as I dug a little: 1. Since https://github.com/databricks/spark-csv/pull/102(Jul, 2015), we would cast `""` as `null` for all types other than strings. For strings,

[GitHub] spark issue #12896: [SPARK-14489][ML][PYSPARK] ALS unknown user/item predict...

2016-08-01 Thread MLnick
Github user MLnick commented on the issue: https://github.com/apache/spark/pull/12896 cc also @xsankar who was interested on the related JIRAs. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark issue #14363: [SPARK-16731][SQL] use StructType in CatalogTable and re...

2016-08-01 Thread gatorsmile
Github user gatorsmile commented on the issue: https://github.com/apache/spark/pull/14363 Your concern is valid. We are missing the test cases for verifying these scenarios. I saw a discussion in a wechat group about the issue in integration between Hive and Spark. They are

[GitHub] spark pull request #12896: [SPARK-14489][ML][PYSPARK] ALS unknown user/item ...

2016-08-01 Thread MLnick
Github user MLnick commented on a diff in the pull request: https://github.com/apache/spark/pull/12896#discussion_r72931611 --- Diff: python/pyspark/ml/recommendation.py --- @@ -332,6 +338,20 @@ def getFinalStorageLevel(self): """ return

[GitHub] spark issue #14155: [SPARK-16498][SQL] move hive hack for data source table ...

2016-08-01 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14155 **[Test build #63073 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/63073/consoleFull)** for PR 14155 at commit

[GitHub] spark pull request #14155: [SPARK-16498][SQL] move hive hack for data source...

2016-08-01 Thread cloud-fan
Github user cloud-fan commented on a diff in the pull request: https://github.com/apache/spark/pull/14155#discussion_r72930383 --- Diff: sql/core/src/test/scala/org/apache/spark/sql/execution/command/DDLSuite.scala --- @@ -359,40 +357,6 @@ class DDLSuite extends QueryTest with

[GitHub] spark issue #14391: [SPARK-16767][SQL] Add existsRecursively to UserDefinedT...

2016-08-01 Thread viirya
Github user viirya commented on the issue: https://github.com/apache/spark/pull/14391 ping @cloud-fan Please take a look this. Thank you. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this

[GitHub] spark issue #13701: [SPARK-15639][SQL] Try to push down filter at RowGroups ...

2016-08-01 Thread viirya
Github user viirya commented on the issue: https://github.com/apache/spark/pull/13701 @yhuai As 2.0 is released now, do you have time to check this? Thanks. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project

[GitHub] spark issue #14433: [SPARK-16829][SparkR]:sparkR sc.setLogLevel doesn't work

2016-08-01 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14433 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #14433: [SPARK-16829][SparkR]:sparkR sc.setLogLevel doesn't work

2016-08-01 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14433 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/63069/ Test PASSed. ---

[GitHub] spark issue #14433: [SPARK-16829][SparkR]:sparkR sc.setLogLevel doesn't work

2016-08-01 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14433 **[Test build #63069 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/63069/consoleFull)** for PR 14433 at commit

[GitHub] spark issue #12896: [SPARK-14489][ML][PYSPARK] ALS unknown user/item predict...

2016-08-01 Thread sethah
Github user sethah commented on the issue: https://github.com/apache/spark/pull/12896 LGTM pending since tags. Thanks! --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled

[GitHub] spark issue #14182: [SPARK-16444][SparkR]: Isotonic Regression wrapper in Sp...

2016-08-01 Thread wangmiao1981
Github user wangmiao1981 commented on the issue: https://github.com/apache/spark/pull/14182 @junyangq Yanbo has pointed me an example of adding weightcol. I will update this PR tomorrow. Thanks! --- If your project is set up for it, you can reply to this email and have your

[GitHub] spark issue #14434: [SPARK-16828][SQL] remove MaxOf and MinOf

2016-08-01 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14434 **[Test build #63072 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/63072/consoleFull)** for PR 14434 at commit

[GitHub] spark issue #11673: [SPARK-13853][SQL] QueryPlan sub-classes should override...

2016-08-01 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/11673 Build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled

[GitHub] spark issue #11673: [SPARK-13853][SQL] QueryPlan sub-classes should override...

2016-08-01 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/11673 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/63071/ Test FAILed. ---

[GitHub] spark issue #11673: [SPARK-13853][SQL] QueryPlan sub-classes should override...

2016-08-01 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/11673 **[Test build #63071 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/63071/consoleFull)** for PR 11673 at commit

[GitHub] spark issue #14434: [SPARK-16828][SQL] remove MaxOf and MinOf

2016-08-01 Thread cloud-fan
Github user cloud-fan commented on the issue: https://github.com/apache/spark/pull/14434 cc @yhuai @liancheng --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes

[GitHub] spark pull request #14434: [SPARK-16828][SQL] remove MaxOf and MinOf

2016-08-01 Thread cloud-fan
GitHub user cloud-fan opened a pull request: https://github.com/apache/spark/pull/14434 [SPARK-16828][SQL] remove MaxOf and MinOf ## What changes were proposed in this pull request? These 2 expressions are not needed anymore after we have `Greatest` and `Least`. This PR

[GitHub] spark issue #11673: [SPARK-13853][SQL] QueryPlan sub-classes should override...

2016-08-01 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/11673 **[Test build #63071 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/63071/consoleFull)** for PR 11673 at commit

[GitHub] spark issue #11673: [SPARK-13853][SQL] QueryPlan sub-classes should override...

2016-08-01 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/11673 **[Test build #63070 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/63070/consoleFull)** for PR 11673 at commit

[GitHub] spark issue #14433: [SPARK-16829][SparkR]:sparkR sc.setLogLevel doesn't work

2016-08-01 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14433 **[Test build #63069 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/63069/consoleFull)** for PR 14433 at commit

[GitHub] spark pull request #14433: [SPARK-16829][SparkR]:sparkR sc.setLogLevel doesn...

2016-08-01 Thread wangmiao1981
GitHub user wangmiao1981 opened a pull request: https://github.com/apache/spark/pull/14433 [SPARK-16829][SparkR]:sparkR sc.setLogLevel doesn't work ## What changes were proposed in this pull request? (Please fill in changes proposed in this fix) ./bin/sparkR

[GitHub] spark pull request #11673: [SPARK-13853][SQL] QueryPlan sub-classes should o...

2016-08-01 Thread cloud-fan
GitHub user cloud-fan reopened a pull request: https://github.com/apache/spark/pull/11673 [SPARK-13853][SQL] QueryPlan sub-classes should override producedAttributes to fix missingInput ## What changes were proposed in this pull request? Some operators will produce new

[GitHub] spark pull request #11673: [SPARK-13853][SQL] QueryPlan sub-classes should o...

2016-08-01 Thread cloud-fan
Github user cloud-fan closed the pull request at: https://github.com/apache/spark/pull/11673 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

<    1   2   3   4