[GitHub] spark issue #16116: [SPARK-18685][TESTS] Fix URI and release resources after...

2016-12-01 Thread HyukjinKwon
Github user HyukjinKwon commented on the issue: https://github.com/apache/spark/pull/16116 Build started: [Tests] `org.apache.spark.repl.ExecutorClassLoaderSuite`

[GitHub] spark pull request #16020: [SPARK-18596][ML] add checking and caching to bis...

2016-12-01 Thread MLnick
Github user MLnick commented on a diff in the pull request: https://github.com/apache/spark/pull/16020#discussion_r90599078 --- Diff: mllib/src/main/scala/org/apache/spark/ml/clustering/KMeans.scala --- @@ -334,10 +334,10 @@ class KMeans @Since("1.5.0") ( val summary =

[GitHub] spark issue #16116: [SPARK-18685][TESTS] Fix URI and release resources after...

2016-12-01 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16116 **[Test build #69552 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/69552/consoleFull)** for PR 16116 at commit

[GitHub] spark pull request #16116: [SPARK-18685][TESTS] Fix URI and release resource...

2016-12-01 Thread HyukjinKwon
GitHub user HyukjinKwon opened a pull request: https://github.com/apache/spark/pull/16116 [SPARK-18685][TESTS] Fix URI and release resources after opening in tests at ExecutorClassLoaderSuite ## What changes were proposed in this pull request? This PR fixes two problems as

[GitHub] spark issue #16108: [SPARK-18670][SS]Limit the number of StreamingQueryListe...

2016-12-01 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16108 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/69545/ Test PASSed. ---

[GitHub] spark issue #16108: [SPARK-18670][SS]Limit the number of StreamingQueryListe...

2016-12-01 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16108 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #16108: [SPARK-18670][SS]Limit the number of StreamingQueryListe...

2016-12-01 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16108 **[Test build #69545 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/69545/consoleFull)** for PR 16108 at commit

[GitHub] spark issue #16088: [SPARK-18659] [SQL] Incorrect behaviors in overwrite tab...

2016-12-01 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16088 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #16088: [SPARK-18659] [SQL] Incorrect behaviors in overwrite tab...

2016-12-01 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16088 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/69543/ Test PASSed. ---

[GitHub] spark issue #16088: [SPARK-18659] [SQL] Incorrect behaviors in overwrite tab...

2016-12-01 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16088 **[Test build #69543 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/69543/consoleFull)** for PR 16088 at commit

[GitHub] spark issue #14638: [SPARK-11374][SQL] Support `skip.header.line.count` opti...

2016-12-01 Thread dongjoon-hyun
Github user dongjoon-hyun commented on the issue: https://github.com/apache/spark/pull/14638 I didn't read Hive code part for this. I referenced the Spark csv part code. But, I'll search the corresponding one in Hive master branch tomorrow since you requested. --- If your

[GitHub] spark issue #15863: [SPARK-18419][SQL] `JDBCRelation.insert` should not remo...

2016-12-01 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15863 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/69544/ Test PASSed. ---

[GitHub] spark issue #15863: [SPARK-18419][SQL] `JDBCRelation.insert` should not remo...

2016-12-01 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15863 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #15863: [SPARK-18419][SQL] `JDBCRelation.insert` should not remo...

2016-12-01 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15863 **[Test build #69544 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/69544/consoleFull)** for PR 15863 at commit

[GitHub] spark issue #16056: [SPARK-18623][SQL] Add `returnNullable` to `StaticInvoke...

2016-12-01 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16056 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/69542/ Test PASSed. ---

[GitHub] spark issue #16056: [SPARK-18623][SQL] Add `returnNullable` to `StaticInvoke...

2016-12-01 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16056 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #16056: [SPARK-18623][SQL] Add `returnNullable` to `StaticInvoke...

2016-12-01 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16056 **[Test build #69542 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/69542/consoleFull)** for PR 16056 at commit

[GitHub] spark issue #16068: [SPARK-18637][SQL]Stateful UDF should be considered as n...

2016-12-01 Thread zhzhan
Github user zhzhan commented on the issue: https://github.com/apache/spark/pull/16068 @hvanhovell Would you like take a look and let me know if you have any concern? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If

[GitHub] spark issue #16069: [WIP][SPARK-18638][BUILD] Upgrade sbt, Zinc, and Maven p...

2016-12-01 Thread weiqingy
Github user weiqingy commented on the issue: https://github.com/apache/spark/pull/16069 Hi, @srowen Thanks for the review. I have updated the PR to fix deprecation warnings (about '`previousArtifact`', '`/`', '`stringToReference`', '`<+= `' operator, '`t3ToTable3`', '`<<=`' operator)

[GitHub] spark issue #16086: [SPARK-18653][SQL] Fix incorrect space padding for unico...

2016-12-01 Thread rxin
Github user rxin commented on the issue: https://github.com/apache/spark/pull/16086 I agree - don't think this is worth the complexity. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this

[GitHub] spark issue #16069: [WIP][SPARK-18638][BUILD] Upgrade sbt, Zinc, and Maven p...

2016-12-01 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16069 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/69551/ Test FAILed. ---

[GitHub] spark issue #16069: [WIP][SPARK-18638][BUILD] Upgrade sbt, Zinc, and Maven p...

2016-12-01 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16069 **[Test build #69551 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/69551/consoleFull)** for PR 16069 at commit

[GitHub] spark issue #16069: [WIP][SPARK-18638][BUILD] Upgrade sbt, Zinc, and Maven p...

2016-12-01 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16069 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #15998: [SPARK-18572][SQL] Add a method `listPartitionNames` to ...

2016-12-01 Thread gatorsmile
Github user gatorsmile commented on the issue: https://github.com/apache/spark/pull/15998 What is the expected output? In the ExternalCatalogSuite, it sounds like we do not issue any error. ``` catalog.listPartitionNames("db2", "tbl2", Some(Map("unknown" -> "unknown")))

[GitHub] spark pull request #15620: [SPARK-18091] [SQL] Deep if expressions cause Gen...

2016-12-01 Thread viirya
Github user viirya commented on a diff in the pull request: https://github.com/apache/spark/pull/15620#discussion_r90592789 --- Diff: sql/catalyst/src/test/scala/org/apache/spark/sql/catalyst/expressions/CodeGenerationSuite.scala --- @@ -97,6 +97,38 @@ class CodeGenerationSuite

[GitHub] spark issue #16088: [SPARK-18659] [SQL] Incorrect behaviors in overwrite tab...

2016-12-01 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16088 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/69537/ Test PASSed. ---

[GitHub] spark issue #16099: [SPARK-18665][SQL] set statement state to "ERROR" after ...

2016-12-01 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16099 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #16099: [SPARK-18665][SQL] set statement state to "ERROR" after ...

2016-12-01 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16099 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/69547/ Test PASSed. ---

[GitHub] spark issue #16088: [SPARK-18659] [SQL] Incorrect behaviors in overwrite tab...

2016-12-01 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16088 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #16099: [SPARK-18665][SQL] set statement state to "ERROR" after ...

2016-12-01 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16099 **[Test build #69547 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/69547/consoleFull)** for PR 16099 at commit

[GitHub] spark issue #16088: [SPARK-18659] [SQL] Incorrect behaviors in overwrite tab...

2016-12-01 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16088 **[Test build #69537 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/69537/consoleFull)** for PR 16088 at commit

[GitHub] spark issue #16069: [WIP][SPARK-18638][BUILD] Upgrade sbt, Zinc, and Maven p...

2016-12-01 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16069 **[Test build #69551 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/69551/consoleFull)** for PR 16069 at commit

[GitHub] spark issue #16114: [SPARK-18620][Streaming][Kinesis] Flatten input rates in...

2016-12-01 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16114 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #16114: [SPARK-18620][Streaming][Kinesis] Flatten input rates in...

2016-12-01 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16114 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/69546/ Test PASSed. ---

[GitHub] spark issue #16114: [SPARK-18620][Streaming][Kinesis] Flatten input rates in...

2016-12-01 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16114 **[Test build #69546 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/69546/consoleFull)** for PR 16114 at commit

[GitHub] spark issue #15620: [SPARK-18091] [SQL] Deep if expressions cause Generated ...

2016-12-01 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15620 **[Test build #69550 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/69550/consoleFull)** for PR 15620 at commit

[GitHub] spark issue #16068: [SPARK-18637][SQL]Stateful UDF should be considered as n...

2016-12-01 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16068 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/69541/ Test PASSed. ---

[GitHub] spark issue #16068: [SPARK-18637][SQL]Stateful UDF should be considered as n...

2016-12-01 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16068 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #16068: [SPARK-18637][SQL]Stateful UDF should be considered as n...

2016-12-01 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16068 **[Test build #69541 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/69541/consoleFull)** for PR 16068 at commit

[GitHub] spark pull request #16090: [SPARK-18661] [SQL] Creating a partitioned dataso...

2016-12-01 Thread ericl
Github user ericl commented on a diff in the pull request: https://github.com/apache/spark/pull/16090#discussion_r90591997 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/command/createDataSourceTables.scala --- @@ -58,13 +58,21 @@ case class

[GitHub] spark issue #16093: [SPARK-18663][SQL] Simplify CountMinSketch aggregate imp...

2016-12-01 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16093 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #16093: [SPARK-18663][SQL] Simplify CountMinSketch aggregate imp...

2016-12-01 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16093 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/69529/ Test FAILed. ---

[GitHub] spark issue #16093: [SPARK-18663][SQL] Simplify CountMinSketch aggregate imp...

2016-12-01 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16093 **[Test build #69529 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/69529/consoleFull)** for PR 16093 at commit

[GitHub] spark issue #15927: [SPARK-18500][SQL] Make GenericStrategy be able to prune...

2016-12-01 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15927 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/69533/ Test PASSed. ---

[GitHub] spark issue #15927: [SPARK-18500][SQL] Make GenericStrategy be able to prune...

2016-12-01 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15927 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #16112: [SPARK-18679] [SQL] Fix regression in file listing perfo...

2016-12-01 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16112 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #16112: [SPARK-18679] [SQL] Fix regression in file listing perfo...

2016-12-01 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16112 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/69531/ Test PASSed. ---

[GitHub] spark issue #16115: [SPARK-18667][PySpark][SQL] Change the way to group row ...

2016-12-01 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16115 **[Test build #69549 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/69549/consoleFull)** for PR 16115 at commit

[GitHub] spark issue #15927: [SPARK-18500][SQL] Make GenericStrategy be able to prune...

2016-12-01 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15927 **[Test build #69533 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/69533/consoleFull)** for PR 15927 at commit

[GitHub] spark issue #16112: [SPARK-18679] [SQL] Fix regression in file listing perfo...

2016-12-01 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16112 **[Test build #69531 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/69531/consoleFull)** for PR 16112 at commit

[GitHub] spark issue #16115: [SPARK-18667][PySpark][SQL] Change the way to group row ...

2016-12-01 Thread viirya
Github user viirya commented on the issue: https://github.com/apache/spark/pull/16115 cc @davies --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if

[GitHub] spark issue #14638: [SPARK-11374][SQL] Support `skip.header.line.count` opti...

2016-12-01 Thread rxin
Github user rxin commented on the issue: https://github.com/apache/spark/pull/14638 @dongjoon-hyun can you show a link to how Hive implements this? I'm just surprised that this is a general feature rather than something that is format specific. --- If your project is set up for

[GitHub] spark issue #16110: [SPARK-18674][SQL][Follow-Up] improve the error message ...

2016-12-01 Thread rxin
Github user rxin commented on the issue: https://github.com/apache/spark/pull/16110 LGTM pending tests. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so,

[GitHub] spark pull request #16115: [SPARK-18667][PySpark][SQL] Change the way to gro...

2016-12-01 Thread viirya
GitHub user viirya opened a pull request: https://github.com/apache/spark/pull/16115 [SPARK-18667][PySpark][SQL] Change the way to group row in BatchEvalPythonExec so input_file_name function can work with UDF in pyspark ## What changes were proposed in this pull request?

[GitHub] spark issue #14638: [SPARK-11374][SQL] Support `skip.header.line.count` opti...

2016-12-01 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14638 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/69539/ Test PASSed. ---

[GitHub] spark issue #14638: [SPARK-11374][SQL] Support `skip.header.line.count` opti...

2016-12-01 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14638 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #16110: [SPARK-18674][SQL][Follow-Up] improve the error message ...

2016-12-01 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16110 **[Test build #69548 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/69548/consoleFull)** for PR 16110 at commit

[GitHub] spark issue #14638: [SPARK-11374][SQL] Support `skip.header.line.count` opti...

2016-12-01 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14638 **[Test build #69539 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/69539/consoleFull)** for PR 14638 at commit

[GitHub] spark issue #16090: [SPARK-18661] [SQL] Creating a partitioned datasource ta...

2016-12-01 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16090 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/69536/ Test PASSed. ---

[GitHub] spark issue #16090: [SPARK-18661] [SQL] Creating a partitioned datasource ta...

2016-12-01 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16090 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark pull request #16106: [SPARK-17213][SQL] Disable Parquet filter push-do...

2016-12-01 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/16106 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] spark issue #16090: [SPARK-18661] [SQL] Creating a partitioned datasource ta...

2016-12-01 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16090 **[Test build #69536 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/69536/consoleFull)** for PR 16090 at commit

[GitHub] spark issue #16106: [SPARK-17213][SQL] Disable Parquet filter push-down for ...

2016-12-01 Thread rxin
Github user rxin commented on the issue: https://github.com/apache/spark/pull/16106 Merging in master/branch-2.1. Thanks. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #16114: [SPARK-18620][Streaming][Kinesis] Flatten input rates in...

2016-12-01 Thread dav009
Github user dav009 commented on the issue: https://github.com/apache/spark/pull/16114 :+1: just had a play with it, it solves my original issue. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request #16090: [SPARK-18661] [SQL] Creating a partitioned dataso...

2016-12-01 Thread ericl
Github user ericl commented on a diff in the pull request: https://github.com/apache/spark/pull/16090#discussion_r90590350 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/command/createDataSourceTables.scala --- @@ -58,13 +58,21 @@ case class

[GitHub] spark issue #16099: [SPARK-18665][SQL] set statement state to "ERROR" after ...

2016-12-01 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16099 **[Test build #69547 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/69547/consoleFull)** for PR 16099 at commit

[GitHub] spark pull request #15620: [SPARK-18091] [SQL] Deep if expressions cause Gen...

2016-12-01 Thread kapilsingh5050
Github user kapilsingh5050 commented on a diff in the pull request: https://github.com/apache/spark/pull/15620#discussion_r90590152 --- Diff: sql/catalyst/src/test/scala/org/apache/spark/sql/catalyst/expressions/CodeGenerationSuite.scala --- @@ -97,6 +97,38 @@ class

[GitHub] spark pull request #16089: [SPARK-18658][SQL] Write text records directly to...

2016-12-01 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/16089 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] spark issue #16110: [SPARK-18674][SQL][Follow-Up] improve the error message ...

2016-12-01 Thread rxin
Github user rxin commented on the issue: https://github.com/apache/spark/pull/16110 That SGTM --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the

[GitHub] spark pull request #16093: [SPARK-18663][SQL] Simplify CountMinSketch aggreg...

2016-12-01 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/16093 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] spark issue #16089: [SPARK-18658][SQL] Write text records directly to a File...

2016-12-01 Thread rxin
Github user rxin commented on the issue: https://github.com/apache/spark/pull/16089 Merging in master. Thanks. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and

[GitHub] spark issue #16093: [SPARK-18663][SQL] Simplify CountMinSketch aggregate imp...

2016-12-01 Thread rxin
Github user rxin commented on the issue: https://github.com/apache/spark/pull/16093 Merging in master. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or

[GitHub] spark issue #16114: [SPARK-18620][Streaming][Kinesis] Flatten input rates in...

2016-12-01 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16114 **[Test build #69546 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/69546/consoleFull)** for PR 16114 at commit

[GitHub] spark issue #16090: [SPARK-18661] [SQL] Creating a partitioned datasource ta...

2016-12-01 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16090 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #16110: [SPARK-18674][SQL][Follow-Up] improve the error message ...

2016-12-01 Thread gatorsmile
Github user gatorsmile commented on the issue: https://github.com/apache/spark/pull/16110 Just tried MySQL. The message is not good to me: ``` mysql> select * from t1 inner join t2 using (col2); ERROR 1054 (42S22): Unknown column 'col2' in 'from clause' ```

[GitHub] spark issue #16090: [SPARK-18661] [SQL] Creating a partitioned datasource ta...

2016-12-01 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16090 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/69534/ Test FAILed. ---

[GitHub] spark issue #16030: [SPARK-18108][SQL] Fix a bug to fail partition schema in...

2016-12-01 Thread maropu
Github user maropu commented on the issue: https://github.com/apache/spark/pull/16030 Thanks your review, @brkyvz ! I'm checking your comments now. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark issue #16090: [SPARK-18661] [SQL] Creating a partitioned datasource ta...

2016-12-01 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16090 **[Test build #69534 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/69534/consoleFull)** for PR 16090 at commit

[GitHub] spark pull request #16114: [SPARK-18620][Streaming][Kinesis] Flatten input r...

2016-12-01 Thread maropu
GitHub user maropu opened a pull request: https://github.com/apache/spark/pull/16114 [SPARK-18620][Streaming][Kinesis] Flatten input rates in timeline for streaming + kinesis ## What changes were proposed in this pull request? This pr is to make input rates in timeline more

[GitHub] spark issue #16030: [SPARK-18108][SQL] Fix a bug to fail partition schema in...

2016-12-01 Thread brkyvz
Github user brkyvz commented on the issue: https://github.com/apache/spark/pull/16030 It would be great to get this into 2.1! --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #16030: [SPARK-18108][SQL] Fix a bug to fail partition schema in...

2016-12-01 Thread brkyvz
Github user brkyvz commented on the issue: https://github.com/apache/spark/pull/16030 @maropu I would still keep the changes I proposed below L180 like I commented before. We don't need to use the inferred data type as the partition type --- If your project is set up for it, you

[GitHub] spark pull request #16030: [SPARK-18108][SQL] Fix a bug to fail partition sc...

2016-12-01 Thread brkyvz
Github user brkyvz commented on a diff in the pull request: https://github.com/apache/spark/pull/16030#discussion_r90588207 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/datasources/DataSource.scala --- @@ -174,22 +185,18 @@ case class DataSource(

[GitHub] spark pull request #16030: [SPARK-18108][SQL] Fix a bug to fail partition sc...

2016-12-01 Thread brkyvz
Github user brkyvz commented on a diff in the pull request: https://github.com/apache/spark/pull/16030#discussion_r90588223 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/datasources/DataSource.scala --- @@ -174,22 +185,18 @@ case class DataSource(

[GitHub] spark pull request #16030: [SPARK-18108][SQL] Fix a bug to fail partition sc...

2016-12-01 Thread brkyvz
Github user brkyvz commented on a diff in the pull request: https://github.com/apache/spark/pull/16030#discussion_r90588156 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/datasources/DataSource.scala --- @@ -132,13 +132,24 @@ case class DataSource(

[GitHub] spark pull request #16030: [SPARK-18108][SQL] Fix a bug to fail partition sc...

2016-12-01 Thread brkyvz
Github user brkyvz commented on a diff in the pull request: https://github.com/apache/spark/pull/16030#discussion_r90588172 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/datasources/DataSource.scala --- @@ -132,13 +132,24 @@ case class DataSource(

[GitHub] spark issue #16108: [SPARK-18670][SS]Limit the number of StreamingQueryListe...

2016-12-01 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16108 **[Test build #69545 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/69545/consoleFull)** for PR 16108 at commit

[GitHub] spark issue #16112: [SPARK-18679] [SQL] Fix regression in file listing perfo...

2016-12-01 Thread ericl
Github user ericl commented on the issue: https://github.com/apache/spark/pull/16112 Yep On Thu, Dec 1, 2016, 8:03 PM Wenchen Fan wrote: > LGTM, @ericl have you run some local benchmark > to make sure the

[GitHub] spark issue #15863: [SPARK-18419][SQL] `JDBCRelation.insert` should not remo...

2016-12-01 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15863 **[Test build #69544 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/69544/consoleFull)** for PR 15863 at commit

[GitHub] spark issue #16088: [SPARK-18659] [SQL] Incorrect behaviors in overwrite tab...

2016-12-01 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16088 **[Test build #69543 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/69543/consoleFull)** for PR 16088 at commit

[GitHub] spark issue #16080: [SPARK-18647][SQL] do not put provider in table properti...

2016-12-01 Thread cloud-fan
Github user cloud-fan commented on the issue: https://github.com/apache/spark/pull/16080 thanks for the review, merging to master/2.1! --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this

[GitHub] spark pull request #16080: [SPARK-18647][SQL] do not put provider in table p...

2016-12-01 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/16080 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] spark issue #16088: [SPARK-18659] [SQL] Incorrect behaviors in overwrite tab...

2016-12-01 Thread cloud-fan
Github user cloud-fan commented on the issue: https://github.com/apache/spark/pull/16088 retest this please --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes

[GitHub] spark pull request #13909: [SPARK-16213][SQL] Reduce runtime overhead of a p...

2016-12-01 Thread cloud-fan
Github user cloud-fan commented on a diff in the pull request: https://github.com/apache/spark/pull/13909#discussion_r90586738 --- Diff: sql/catalyst/src/test/scala/org/apache/spark/sql/catalyst/expressions/ExpressionEvalHelper.scala --- @@ -42,15 +42,48 @@ trait

[GitHub] spark issue #16093: [SPARK-18663][SQL] Simplify CountMinSketch aggregate imp...

2016-12-01 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16093 **[Test build #3454 has finished](https://amplab.cs.berkeley.edu/jenkins/job/NewSparkPullRequestBuilder/3454/consoleFull)** for PR 16093 at commit

[GitHub] spark issue #16088: [SPARK-18659] [SQL] Incorrect behaviors in overwrite tab...

2016-12-01 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16088 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #16056: [SPARK-18623][SQL] Add `returnNullable` to `StaticInvoke...

2016-12-01 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16056 **[Test build #69542 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/69542/consoleFull)** for PR 16056 at commit

[GitHub] spark issue #16088: [SPARK-18659] [SQL] Incorrect behaviors in overwrite tab...

2016-12-01 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16088 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/69532/ Test FAILed. ---

[GitHub] spark issue #13909: [SPARK-16213][SQL] Reduce runtime overhead of a program ...

2016-12-01 Thread kiszk
Github user kiszk commented on the issue: https://github.com/apache/spark/pull/13909 ping @cloud-fan @hvanhovell --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and

[GitHub] spark issue #16113: [SPARK-18657][SPARK-18668] Make StreamingQuery.id persis...

2016-12-01 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16113 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/69540/ Test FAILed. ---

[GitHub] spark pull request #13909: [SPARK-16213][SQL] Reduce runtime overhead of a p...

2016-12-01 Thread cloud-fan
Github user cloud-fan commented on a diff in the pull request: https://github.com/apache/spark/pull/13909#discussion_r90586610 --- Diff: sql/catalyst/src/test/scala/org/apache/spark/sql/catalyst/expressions/ExpressionEvalHelper.scala --- @@ -42,15 +42,48 @@ trait

  1   2   3   4   5   6   7   >