[GitHub] spark issue #15861: [SPARK-18294][CORE] Implement commit protocol to support...

2016-11-20 Thread rxin
Github user rxin commented on the issue: https://github.com/apache/spark/pull/15861 cc @mridulm can you take a look? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and

[GitHub] spark pull request #15959: [SPARK-18522][SQL] Explicit contract for column s...

2016-11-20 Thread rxin
Github user rxin commented on a diff in the pull request: https://github.com/apache/spark/pull/15959#discussion_r88843463 --- Diff: sql/hive/src/main/scala/org/apache/spark/sql/hive/HiveExternalCatalog.scala --- @@ -627,26 +629,43 @@ private[spark] class HiveExternalCatalog(conf:

[GitHub] spark pull request #15959: [SPARK-18522][SQL] Explicit contract for column s...

2016-11-20 Thread rxin
Github user rxin commented on a diff in the pull request: https://github.com/apache/spark/pull/15959#discussion_r88843445 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/command/AnalyzeColumnCommand.scala --- @@ -100,99 +100,30 @@ object AnalyzeColumnCommand

[GitHub] spark issue #15959: [SPARK-18522][SQL] Explicit contract for column stats se...

2016-11-20 Thread rxin
Github user rxin commented on the issue: https://github.com/apache/spark/pull/15959 cc @srinathshankar @cloud-fan @wzhfy --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled

[GitHub] spark issue #15959: [SPARK-18522][SQL] Explicit contract for column stats se...

2016-11-20 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15959 **[Test build #68927 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/68927/consoleFull)** for PR 15959 at commit

[GitHub] spark pull request #15959: [SPARK-18522][SQL] Explicit contract for column s...

2016-11-20 Thread rxin
GitHub user rxin opened a pull request: https://github.com/apache/spark/pull/15959 [SPARK-18522][SQL] Explicit contract for column stats serialization ## What changes were proposed in this pull request? The current implementation of column stats uses the base64 encoding of the

[GitHub] spark issue #15958: [SPARK-17932][SQL] Failed to run SQL "show table extende...

2016-11-20 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15958 **[Test build #68926 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/68926/consoleFull)** for PR 15958 at commit

[GitHub] spark pull request #15958: [SPARK-17932][SQL] Failed to run SQL "show table ...

2016-11-20 Thread jiangxb1987
GitHub user jiangxb1987 opened a pull request: https://github.com/apache/spark/pull/15958 [SPARK-17932][SQL] Failed to run SQL "show table extended like table_name" in Spark2.0.0 ## What changes were proposed in this pull request? Currently we haven't implemented `SHOW

[GitHub] spark issue #15957: [SPARK-18520][ML] Add missing setXXXCol methods for Bise...

2016-11-20 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15957 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/68921/ Test PASSed. ---

[GitHub] spark issue #15957: [SPARK-18520][ML] Add missing setXXXCol methods for Bise...

2016-11-20 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15957 **[Test build #68921 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/68921/consoleFull)** for PR 15957 at commit

[GitHub] spark issue #15957: [SPARK-18520][ML] Add missing setXXXCol methods for Bise...

2016-11-20 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15957 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #15868: [SPARK-18413][SQL] Add `maxConnections` JDBCOption

2016-11-20 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15868 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #15868: [SPARK-18413][SQL] Add `maxConnections` JDBCOption

2016-11-20 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15868 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/68917/ Test PASSed. ---

[GitHub] spark issue #15868: [SPARK-18413][SQL] Add `maxConnections` JDBCOption

2016-11-20 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15868 **[Test build #68917 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/68917/consoleFull)** for PR 15868 at commit

[GitHub] spark issue #15929: [SPARK-18053][SQL] compare unsafe and safe complex-type ...

2016-11-20 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15929 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #15929: [SPARK-18053][SQL] compare unsafe and safe complex-type ...

2016-11-20 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15929 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/68915/ Test PASSed. ---

[GitHub] spark issue #15929: [SPARK-18053][SQL] compare unsafe and safe complex-type ...

2016-11-20 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15929 **[Test build #68915 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/68915/consoleFull)** for PR 15929 at commit

[GitHub] spark issue #12896: [SPARK-14489][ML][PYSPARK] ALS unknown user/item predict...

2016-11-20 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/12896 **[Test build #68925 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/68925/consoleFull)** for PR 12896 at commit

[GitHub] spark issue #15954: [WIP][SPARK-18516][SQL] Split state and progress in stre...

2016-11-20 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15954 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/68923/ Test FAILed. ---

[GitHub] spark issue #15954: [WIP][SPARK-18516][SQL] Split state and progress in stre...

2016-11-20 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15954 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #15954: [WIP][SPARK-18516][SQL] Split state and progress in stre...

2016-11-20 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15954 **[Test build #68923 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/68923/consoleFull)** for PR 15954 at commit

[GitHub] spark issue #14038: [SPARK-16317][SQL] Add a new interface to filter files i...

2016-11-20 Thread maropu
Github user maropu commented on the issue: https://github.com/apache/spark/pull/14038 yea, as for data files, it's okay to filter out '_' and '.'. But, the file pattens of metadata depend on file formats as suggested in

[GitHub] spark issue #15954: [WIP][SPARK-18516][SQL] Split state and progress in stre...

2016-11-20 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15954 **[Test build #68923 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/68923/consoleFull)** for PR 15954 at commit

[GitHub] spark issue #15888: [SPARK-18444][SPARKR] SparkR running in yarn-cluster mod...

2016-11-20 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15888 **[Test build #68924 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/68924/consoleFull)** for PR 15888 at commit

[GitHub] spark issue #15880: [SPARK-17913][SQL] compare long and string type column m...

2016-11-20 Thread dasbipulkumar
Github user dasbipulkumar commented on the issue: https://github.com/apache/spark/pull/15880 @gatorsmile configuration flag would be good approach. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project

[GitHub] spark issue #15777: [SPARK-18282][ML][PYSPARK] Add python clustering summari...

2016-11-20 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15777 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark pull request #15956: [SPARK-18519][SQL] map type can not be used in bi...

2016-11-20 Thread rxin
Github user rxin commented on a diff in the pull request: https://github.com/apache/spark/pull/15956#discussion_r88839350 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/predicates.scala --- @@ -388,6 +388,21 @@ abstract class BinaryComparison

[GitHub] spark issue #15777: [SPARK-18282][ML][PYSPARK] Add python clustering summari...

2016-11-20 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15777 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/68919/ Test PASSed. ---

[GitHub] spark issue #15777: [SPARK-18282][ML][PYSPARK] Add python clustering summari...

2016-11-20 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15777 **[Test build #68919 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/68919/consoleFull)** for PR 15777 at commit

[GitHub] spark issue #15956: [SPARK-18519][SQL] map type can not be used in binary co...

2016-11-20 Thread rxin
Github user rxin commented on the issue: https://github.com/apache/spark/pull/15956 So technically I think map type should be able to be used in equality comparison, but not orderable, so I'm not sure if this is correct. Spark SQL currently has a restriction that we just

[GitHub] spark issue #15953: [SPARK-18517][SQL] DROP TABLE IF EXISTS should not warn ...

2016-11-20 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15953 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/68914/ Test PASSed. ---

[GitHub] spark issue #15953: [SPARK-18517][SQL] DROP TABLE IF EXISTS should not warn ...

2016-11-20 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15953 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #15953: [SPARK-18517][SQL] DROP TABLE IF EXISTS should not warn ...

2016-11-20 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15953 **[Test build #68914 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/68914/consoleFull)** for PR 15953 at commit

[GitHub] spark issue #14038: [SPARK-16317][SQL] Add a new interface to filter files i...

2016-11-20 Thread rxin
Github user rxin commented on the issue: https://github.com/apache/spark/pull/14038 Do we have a strong need for this? Anything wrong with just filtering out all file names that start with _ and .? --- If your project is set up for it, you can reply to this email and have your reply

[GitHub] spark issue #15868: [SPARK-18413][SQL] Add `maxConnections` JDBCOption

2016-11-20 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15868 **[Test build #68922 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/68922/consoleFull)** for PR 15868 at commit

[GitHub] spark issue #15955: [SPARK-18434][ML][FOLLOWUP] Add checking for setSolver i...

2016-11-20 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15955 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #15955: [SPARK-18434][ML][FOLLOWUP] Add checking for setSolver i...

2016-11-20 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15955 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/68918/ Test PASSed. ---

[GitHub] spark issue #15955: [SPARK-18434][ML][FOLLOWUP] Add checking for setSolver i...

2016-11-20 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15955 **[Test build #68918 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/68918/consoleFull)** for PR 15955 at commit

[GitHub] spark issue #15957: [SPARK-18520][ML] Add missing setXXXCol methods for Bise...

2016-11-20 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15957 **[Test build #68921 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/68921/consoleFull)** for PR 15957 at commit

[GitHub] spark pull request #15957: [SPARK-18520][ML] Add missing setXXXCol methods f...

2016-11-20 Thread zhengruifeng
GitHub user zhengruifeng opened a pull request: https://github.com/apache/spark/pull/15957 [SPARK-18520][ML] Add missing setXXXCol methods for BisectingKMeansModel and GaussianMixtureModel ## What changes were proposed in this pull request? add `setFeaturesCol` and

[GitHub] spark issue #15951: [SPARK-18510] Fix data corruption from inferred partitio...

2016-11-20 Thread gatorsmile
Github user gatorsmile commented on the issue: https://github.com/apache/spark/pull/15951 When users specify schemas, we do not want to infer the schemas due to its potentially expensive cost. Based on my understanding, data corruption issues are common when user-specified schemas do

[GitHub] spark pull request #15868: [SPARK-18413][SQL] Add `maxConnections` JDBCOptio...

2016-11-20 Thread cloud-fan
Github user cloud-fan commented on a diff in the pull request: https://github.com/apache/spark/pull/15868#discussion_r88836683 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/datasources/jdbc/JDBCOptions.scala --- @@ -122,6 +122,11 @@ class JDBCOptions(

[GitHub] spark issue #15956: [SPARK-18519][SQL] map type can not be used in binary co...

2016-11-20 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15956 **[Test build #68920 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/68920/consoleFull)** for PR 15956 at commit

[GitHub] spark issue #15956: [SPARK-18519][SQL] map type can not be used in binary co...

2016-11-20 Thread cloud-fan
Github user cloud-fan commented on the issue: https://github.com/apache/spark/pull/15956 cc @yhuai @hvanhovell @gatorsmile --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark pull request #15951: [SPARK-18510] Fix data corruption from inferred p...

2016-11-20 Thread gatorsmile
Github user gatorsmile commented on a diff in the pull request: https://github.com/apache/spark/pull/15951#discussion_r88835591 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/datasources/DataSource.scala --- @@ -272,14 +309,20 @@ case class DataSource(

[GitHub] spark pull request #15956: [SPARK-18519][SQL] map type can not be used in bi...

2016-11-20 Thread cloud-fan
Github user cloud-fan commented on a diff in the pull request: https://github.com/apache/spark/pull/15956#discussion_r88835551 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/analysis/CheckAnalysis.scala --- @@ -183,21 +183,6 @@ trait CheckAnalysis extends

[GitHub] spark issue #15913: [SPARK-18481][ML] ML 2.1 QA: Remove deprecated methods f...

2016-11-20 Thread yanboliang
Github user yanboliang commented on the issue: https://github.com/apache/spark/pull/15913 cc @jkbradley @sethah --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and

[GitHub] spark pull request #15956: [SPARK-18519][SQL] map type can not be used in bi...

2016-11-20 Thread cloud-fan
GitHub user cloud-fan opened a pull request: https://github.com/apache/spark/pull/15956 [SPARK-18519][SQL] map type can not be used in binary comparison ## What changes were proposed in this pull request? MapType is not orderable, we forbid users to use map type in join key

[GitHub] spark issue #15777: [SPARK-18282][ML][PYSPARK] Add python clustering summari...

2016-11-20 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15777 **[Test build #68919 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/68919/consoleFull)** for PR 15777 at commit

[GitHub] spark pull request #15777: [SPARK-18282][ML][PYSPARK] Add python clustering ...

2016-11-20 Thread sethah
Github user sethah commented on a diff in the pull request: https://github.com/apache/spark/pull/15777#discussion_r88833295 --- Diff: mllib/src/main/scala/org/apache/spark/ml/clustering/BisectingKMeans.scala --- @@ -95,8 +95,7 @@ class BisectingKMeansModel private[ml] (

[GitHub] spark issue #15955: [SPARK-18434][ML][FOLLOWUP] Add checking for setSolver i...

2016-11-20 Thread zhengruifeng
Github user zhengruifeng commented on the issue: https://github.com/apache/spark/pull/15955 `HasSolver` now don't support value validation, so it's not easy to use: GLR and LiR inherit `HasSolver`, but need to do param validation explicitly like this PR MLP dont inherit

[GitHub] spark issue #15955: [SPARK-18434][ML][FOLLOWUP] Add checking for setSolver i...

2016-11-20 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15955 **[Test build #68918 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/68918/consoleFull)** for PR 15955 at commit

[GitHub] spark pull request #15955: [SPARK-18434][ML][FOLLOWUP] Add checking for setS...

2016-11-20 Thread zhengruifeng
GitHub user zhengruifeng opened a pull request: https://github.com/apache/spark/pull/15955 [SPARK-18434][ML][FOLLOWUP] Add checking for setSolver in GLM ## What changes were proposed in this pull request? add checking in GLM.setSolver to forbidden unsupported solvers: `val

[GitHub] spark issue #15868: [SPARK-18413][SQL] Add `maxConnections` JDBCOption

2016-11-20 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15868 **[Test build #68917 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/68917/consoleFull)** for PR 15868 at commit

[GitHub] spark issue #15954: [WIP][SPARK-18516][SQL] Split state and progress in stre...

2016-11-20 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15954 **[Test build #68916 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/68916/consoleFull)** for PR 15954 at commit

[GitHub] spark issue #15954: [WIP][SPARK-18516][SQL] Split state and progress in stre...

2016-11-20 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15954 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/68916/ Test FAILed. ---

[GitHub] spark issue #15954: [WIP][SPARK-18516][SQL] Split state and progress in stre...

2016-11-20 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15954 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #15954: [WIP][SPARK-18516][SQL] Split state and progress in stre...

2016-11-20 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15954 **[Test build #68916 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/68916/consoleFull)** for PR 15954 at commit

[GitHub] spark issue #15954: [WIP][SPARK-18516][SQL] Split state and progress in stre...

2016-11-20 Thread marmbrus
Github user marmbrus commented on the issue: https://github.com/apache/spark/pull/15954 /cc @tdas --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if

[GitHub] spark pull request #15954: [WIP][SPARK-18516][SQL] Split state and progress ...

2016-11-20 Thread marmbrus
GitHub user marmbrus opened a pull request: https://github.com/apache/spark/pull/15954 [WIP][SPARK-18516][SQL] Split state and progress in streaming This PR separates the status of a `StreamingQuery` into two separate APIs: - `status` - describes the status of a

[GitHub] spark issue #15951: [SPARK-18510] Fix data corruption from inferred partitio...

2016-11-20 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15951 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #15951: [SPARK-18510] Fix data corruption from inferred partitio...

2016-11-20 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15951 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/68913/ Test FAILed. ---

[GitHub] spark issue #15951: [SPARK-18510] Fix data corruption from inferred partitio...

2016-11-20 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15951 **[Test build #68913 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/68913/consoleFull)** for PR 15951 at commit

[GitHub] spark issue #15929: [SPARK-18053][SQL] compare unsafe and safe complex-type ...

2016-11-20 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15929 **[Test build #68915 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/68915/consoleFull)** for PR 15929 at commit

[GitHub] spark pull request #15868: [SPARK-18413][SQL] Add `maxConnections` JDBCOptio...

2016-11-20 Thread dongjoon-hyun
Github user dongjoon-hyun commented on a diff in the pull request: https://github.com/apache/spark/pull/15868#discussion_r88829741 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/datasources/jdbc/JDBCOptions.scala --- @@ -122,6 +122,11 @@ class JDBCOptions(

[GitHub] spark issue #15953: [SPARK-18517][SQL] DROP TABLE IF EXISTS should not warn ...

2016-11-20 Thread dongjoon-hyun
Github user dongjoon-hyun commented on the issue: https://github.com/apache/spark/pull/15953 Hi, @gatorsmile . This is a related case with #15682 (Dropping View) and the `uncache` issue. But, this case is different from the above case because this PR has the obvious solution.

[GitHub] spark issue #15953: [SPARK-18517][SQL] DROP TABLE IF EXISTS should not warn ...

2016-11-20 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15953 **[Test build #68914 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/68914/consoleFull)** for PR 15953 at commit

[GitHub] spark pull request #15953: [SPARK-18517][SQL] DROP TABLE IF EXISTS should no...

2016-11-20 Thread dongjoon-hyun
GitHub user dongjoon-hyun opened a pull request: https://github.com/apache/spark/pull/15953 [SPARK-18517][SQL] DROP TABLE IF EXISTS should not warn for non-existing tables ## What changes were proposed in this pull request? Currently, `DROP TABLE IF EXISTS` shows warning

[GitHub] spark pull request #15929: [SPARK-18053][SQL] compare unsafe and safe comple...

2016-11-20 Thread cloud-fan
Github user cloud-fan commented on a diff in the pull request: https://github.com/apache/spark/pull/15929#discussion_r88827491 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/predicates.scala --- @@ -452,15 +444,7 @@ case class EqualNullSafe(left:

[GitHub] spark pull request #15901: [SPARK-18467][SQL] Extracts method for preparing ...

2016-11-20 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/15901 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] spark issue #15901: [SPARK-18467][SQL] Extracts method for preparing argumen...

2016-11-20 Thread cloud-fan
Github user cloud-fan commented on the issue: https://github.com/apache/spark/pull/15901 thanks, merging to master/2.1! --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled

[GitHub] spark issue #15947: [SPARK-18447][DOCS] Fix the markdown for `Note:`/`NOTE:`...

2016-11-20 Thread jagadeesanas2
Github user jagadeesanas2 commented on the issue: https://github.com/apache/spark/pull/15947 LGTM --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if

[GitHub] spark issue #15952: [SPARK-18514][DOCS] Fix the markdown for `Note:`/`NOTE:`...

2016-11-20 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15952 **[Test build #68912 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/68912/consoleFull)** for PR 15952 at commit

[GitHub] spark issue #15952: [SPARK-18514][DOCS] Fix the markdown for `Note:`/`NOTE:`...

2016-11-20 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15952 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/68912/ Test PASSed. ---

[GitHub] spark issue #15893: [SPARK-18456][ML][FOLLOWUP] Use matrix abstraction for c...

2016-11-20 Thread MLnick
Github user MLnick commented on the issue: https://github.com/apache/spark/pull/15893 👍 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the

[GitHub] spark issue #15952: [SPARK-18514][DOCS] Fix the markdown for `Note:`/`NOTE:`...

2016-11-20 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15952 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark pull request #15926: [SPARK-16803] [SQL] SaveAsTable does not work whe...

2016-11-20 Thread cloud-fan
Github user cloud-fan commented on a diff in the pull request: https://github.com/apache/spark/pull/15926#discussion_r88824474 --- Diff: sql/hive/src/test/scala/org/apache/spark/sql/hive/MetastoreDataSourcesSuite.scala --- @@ -413,6 +413,40 @@ class MetastoreDataSourcesSuite

[GitHub] spark issue #15951: [SPARK-18510] Fix data corruption from inferred partitio...

2016-11-20 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15951 **[Test build #68913 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/68913/consoleFull)** for PR 15951 at commit

[GitHub] spark issue #15926: [SPARK-16803] [SQL] SaveAsTable does not work when targe...

2016-11-20 Thread cloud-fan
Github user cloud-fan commented on the issue: https://github.com/apache/spark/pull/15926 LGTM --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the

[GitHub] spark issue #15952: [SPARK-18514][DOCS] Fix the markdown for `Note:`/`NOTE:`...

2016-11-20 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15952 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/68911/ Test PASSed. ---

[GitHub] spark issue #15952: [SPARK-18514][DOCS] Fix the markdown for `Note:`/`NOTE:`...

2016-11-20 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15952 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #15952: [SPARK-18514][DOCS] Fix the markdown for `Note:`/`NOTE:`...

2016-11-20 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15952 **[Test build #68911 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/68911/consoleFull)** for PR 15952 at commit

[GitHub] spark issue #15952: [SPARK-18514][DOCS] Fix the markdown for `Note:`/`NOTE:`...

2016-11-20 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15952 **[Test build #68912 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/68912/consoleFull)** for PR 15952 at commit

[GitHub] spark issue #15952: [SPARK-18514][DOCS] Fix the markdown for `Note:`/`NOTE:`...

2016-11-20 Thread HyukjinKwon
Github user HyukjinKwon commented on the issue: https://github.com/apache/spark/pull/15952 @felixcheung , I just noticed that the API documentation for `context.R`, `RDD.R` and `pairRDD.R` seems not appearing in the documentation. Is this true? I ended up with getting rid of them

[GitHub] spark pull request #15952: [WIP][SPARK-18514][DOCS] Fix the markdown for `No...

2016-11-20 Thread HyukjinKwon
Github user HyukjinKwon commented on a diff in the pull request: https://github.com/apache/spark/pull/15952#discussion_r88822185 --- Diff: R/pkg/R/functions.R --- @@ -2779,7 +2779,8 @@ setMethod("window", signature(x = "Column"), #' locate #' #' Locate the position

[GitHub] spark pull request #15952: [WIP][SPARK-18514][DOCS] Fix the markdown for `No...

2016-11-20 Thread HyukjinKwon
Github user HyukjinKwon commented on a diff in the pull request: https://github.com/apache/spark/pull/15952#discussion_r88822111 --- Diff: R/pkg/R/functions.R --- @@ -2341,7 +2341,7 @@ setMethod("from_utc_timestamp", signature(y = "Column", x = "character"), #' Locate the

[GitHub] spark pull request #15952: [WIP][SPARK-18514][DOCS] Fix the markdown for `No...

2016-11-20 Thread HyukjinKwon
Github user HyukjinKwon commented on a diff in the pull request: https://github.com/apache/spark/pull/15952#discussion_r88822027 --- Diff: R/pkg/R/functions.R --- @@ -2296,7 +2296,7 @@ setMethod("n", signature(x = "Column"), #' A pattern could be for instance

[GitHub] spark issue #15952: [WIP][SPARK-18514][DOCS] Fix the markdown for `Note:`/`N...

2016-11-20 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15952 **[Test build #68911 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/68911/consoleFull)** for PR 15952 at commit

[GitHub] spark pull request #15952: [WIP][SPARK-18514][DOCS] Fix the markdown for `No...

2016-11-20 Thread HyukjinKwon
Github user HyukjinKwon commented on a diff in the pull request: https://github.com/apache/spark/pull/15952#discussion_r88821734 --- Diff: R/pkg/R/DataFrame.R --- @@ -2541,7 +2541,8 @@ generateAliasesForIntersectedCols <- function (x, intersectedColNames, suffix) { #' #'

[GitHub] spark pull request #15952: [WIP][SPARK-18514][DOCS] Fix the markdown for `No...

2016-11-20 Thread HyukjinKwon
GitHub user HyukjinKwon opened a pull request: https://github.com/apache/spark/pull/15952 [WIP][SPARK-18514][DOCS] Fix the markdown for `Note:`/`NOTE:`/`Note that` across R API documentation ## What changes were proposed in this pull request? It seems in R, there are

[GitHub] spark issue #15901: [SPARK-18467][SQL] Extracts method for preparing argumen...

2016-11-20 Thread viirya
Github user viirya commented on the issue: https://github.com/apache/spark/pull/15901 LGTM cc @cloud-fan for another look. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #14995: [Test Only][SPARK-6235][CORE]Address various 2G limits

2016-11-20 Thread witgo
Github user witgo commented on the issue: https://github.com/apache/spark/pull/14995 @srowen This PR is a comprehensive solution. Used to solve address various 2G limits, RPC memory footprint and other issues. Users often encounter these problems. Why don't we need to solve

[GitHub] spark issue #15945: [SPARK-12978][SQL] Merge unnecessary partial aggregates

2016-11-20 Thread maropu
Github user maropu commented on the issue: https://github.com/apache/spark/pull/15945 @hvanhovell @cloud-fan I think this target might be 2.2.0, so could you check this after 2.1 is cut. Thanks! --- If your project is set up for it, you can reply to this email and have your reply

[GitHub] spark issue #15951: [SPARK-18510] Fix data corruption from inferred partitio...

2016-11-20 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15951 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #15951: [SPARK-18510] Fix data corruption from inferred partitio...

2016-11-20 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15951 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/68910/ Test FAILed. ---

[GitHub] spark issue #15951: [SPARK-18510] Fix data corruption from inferred partitio...

2016-11-20 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15951 **[Test build #68910 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/68910/consoleFull)** for PR 15951 at commit

[GitHub] spark issue #15951: [SPARK-18510] Fix data corruption from inferred partitio...

2016-11-20 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15951 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/68909/ Test FAILed. ---

[GitHub] spark issue #15951: [SPARK-18510] Fix data corruption from inferred partitio...

2016-11-20 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15951 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #15951: [SPARK-18510] Fix data corruption from inferred partitio...

2016-11-20 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15951 **[Test build #68909 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/68909/consoleFull)** for PR 15951 at commit

[GitHub] spark issue #15949: [Spark-18339] [SQL] Don't push down current_timestamp fo...

2016-11-20 Thread rxin
Github user rxin commented on the issue: https://github.com/apache/spark/pull/15949 @tcondie can you use all upper case for the JIRA ticket in the future, e.g. SPARK-18339? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as

  1   2   >