[GitHub] spark pull request #14728: [SPARK-17165][SQL] FileStreamSource should not tr...

2016-08-19 Thread rxin
Github user rxin commented on a diff in the pull request: https://github.com/apache/spark/pull/14728#discussion_r75573941 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/streaming/FileStreamOptions.scala --- @@ -0,0 +1,56 @@ +/* + * Licensed to the Apache

[GitHub] spark pull request #12790: [SPARK-15018][PYSPARK][ML] Improve handling of Py...

2016-08-19 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/12790 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is ena

[GitHub] spark issue #12790: [SPARK-15018][PYSPARK][ML] Improve handling of PySpark P...

2016-08-19 Thread yanboliang
Github user yanboliang commented on the issue: https://github.com/apache/spark/pull/12790 LGTM, merged into master. Thanks! --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enable

[GitHub] spark issue #14728: [SPARK-17165][SQL] FileStreamSource should not track the...

2016-08-19 Thread petermaxlee
Github user petermaxlee commented on the issue: https://github.com/apache/spark/pull/14728 cc @rxin @cloud-fan --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes

[GitHub] spark issue #14728: [SPARK-17165][SQL] FileStreamSource should not track the...

2016-08-19 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14728 **[Test build #64133 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/64133/consoleFull)** for PR 14728 at commit [`ce1dd9c`](https://github.com/apache/spark/commit/c

[GitHub] spark pull request #14728: [SPARK-17165][SQL] FileStreamSource should not tr...

2016-08-19 Thread petermaxlee
GitHub user petermaxlee opened a pull request: https://github.com/apache/spark/pull/14728 [SPARK-17165][SQL] FileStreamSource should not track the list of seen files indefinitely ## What changes were proposed in this pull request? Before this change, FileStreamSource uses an in-

[GitHub] spark pull request #14728: [SPARK-17165][SQL] FileStreamSource should not tr...

2016-08-19 Thread petermaxlee
Github user petermaxlee commented on a diff in the pull request: https://github.com/apache/spark/pull/14728#discussion_r75573771 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/streaming/FileStreamOptions.scala --- @@ -0,0 +1,56 @@ +/* + * Licensed to the

[GitHub] spark pull request #14712: [SPARK-17072] [SQL] support table-level statistic...

2016-08-19 Thread wzhfy
Github user wzhfy commented on a diff in the pull request: https://github.com/apache/spark/pull/14712#discussion_r75573715 --- Diff: sql/hive/src/main/scala/org/apache/spark/sql/hive/MetastoreRelation.scala --- @@ -141,7 +142,16 @@ private[hive] case class MetastoreRelation(

[GitHub] spark issue #14426: [SPARK-16475][SQL] Broadcast Hint for SQL Queries

2016-08-19 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14426 **[Test build #64132 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/64132/consoleFull)** for PR 14426 at commit [`351dfef`](https://github.com/apache/spark/commit/3

[GitHub] spark issue #14426: [SPARK-16475][SQL] Broadcast Hint for SQL Queries

2016-08-19 Thread dongjoon-hyun
Github user dongjoon-hyun commented on the issue: https://github.com/apache/spark/pull/14426 Resolve conflicts. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes

[GitHub] spark issue #14155: [SPARK-16498][SQL] move hive hack for data source table ...

2016-08-19 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14155 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #13680: [SPARK-15962][SQL] Introduce implementation with a dense...

2016-08-19 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/13680 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/64121/ Test FAILed. ---

[GitHub] spark issue #14155: [SPARK-16498][SQL] move hive hack for data source table ...

2016-08-19 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14155 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/64122/ Test FAILed. ---

[GitHub] spark issue #14623: [SPARK-17044][SQL] Make test files for window functions ...

2016-08-19 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14623 **[Test build #64129 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/64129/consoleFull)** for PR 14623 at commit [`186f28f`](https://github.com/apache/spark/commit/1

[GitHub] spark issue #13680: [SPARK-15962][SQL] Introduce implementation with a dense...

2016-08-19 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/13680 **[Test build #64121 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/64121/consoleFull)** for PR 13680 at commit [`f418f9c`](https://github.com/apache/spark/commit/

[GitHub] spark issue #13680: [SPARK-15962][SQL] Introduce implementation with a dense...

2016-08-19 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/13680 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #14155: [SPARK-16498][SQL] move hive hack for data source table ...

2016-08-19 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14155 **[Test build #64122 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/64122/consoleFull)** for PR 14155 at commit [`38b838a`](https://github.com/apache/spark/commit/

[GitHub] spark issue #14527: [SPARK-16938][SQL] `drop/dropDuplicate` should handle th...

2016-08-19 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14527 **[Test build #64131 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/64131/consoleFull)** for PR 14527 at commit [`167b055`](https://github.com/apache/spark/commit/1

[GitHub] spark issue #14571: [SPARK-16983][SQL] Add `prettyName` for row_number, dens...

2016-08-19 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14571 **[Test build #64130 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/64130/consoleFull)** for PR 14571 at commit [`27b419a`](https://github.com/apache/spark/commit/2

[GitHub] spark issue #14689: [SPARK-17098][SQL] Fix `NullPropagation` optimizer to ha...

2016-08-19 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14689 **[Test build #64127 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/64127/consoleFull)** for PR 14689 at commit [`25aa91d`](https://github.com/apache/spark/commit/2

[GitHub] spark issue #14638: [SPARK-11374][SQL] Support `skip.header.line.count` opti...

2016-08-19 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14638 **[Test build #64128 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/64128/consoleFull)** for PR 14638 at commit [`345f7f3`](https://github.com/apache/spark/commit/3

[GitHub] spark pull request #14717: [WIP][SPARK-17090][ML]Make tree aggregation level...

2016-08-19 Thread yanboliang
Github user yanboliang commented on a diff in the pull request: https://github.com/apache/spark/pull/14717#discussion_r75573599 --- Diff: mllib/src/main/scala/org/apache/spark/ml/regression/LinearRegression.scala --- @@ -172,6 +173,17 @@ class LinearRegression @Since("1.3.0") (@Si

[GitHub] spark pull request #14717: [WIP][SPARK-17090][ML]Make tree aggregation level...

2016-08-19 Thread yanboliang
Github user yanboliang commented on a diff in the pull request: https://github.com/apache/spark/pull/14717#discussion_r75573591 --- Diff: mllib/src/main/scala/org/apache/spark/ml/regression/LinearRegression.scala --- @@ -172,6 +173,17 @@ class LinearRegression @Since("1.3.0") (@Si

[GitHub] spark pull request #14712: [SPARK-17072] [SQL] support table-level statistic...

2016-08-19 Thread gatorsmile
Github user gatorsmile commented on a diff in the pull request: https://github.com/apache/spark/pull/14712#discussion_r75573560 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/datasources/LogicalRelation.scala --- @@ -72,9 +72,12 @@ case class LogicalRelation(

[GitHub] spark pull request #14712: [SPARK-17072] [SQL] support table-level statistic...

2016-08-19 Thread gatorsmile
Github user gatorsmile commented on a diff in the pull request: https://github.com/apache/spark/pull/14712#discussion_r75573529 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/datasources/LogicalRelation.scala --- @@ -72,9 +72,12 @@ case class LogicalRelation(

[GitHub] spark issue #13950: [SPARK-15487] [Web UI] Spark Master UI to reverse proxy ...

2016-08-19 Thread gurvindersingh
Github user gurvindersingh commented on the issue: https://github.com/apache/spark/pull/13950 As I mentioned in my last comment, the current code assume that the conf value is set on all components. E.g. Otherwise how you expect reverseProxyUrl to work in spark-shell, every `SparkCont

[GitHub] spark pull request #14712: [SPARK-17072] [SQL] support table-level statistic...

2016-08-19 Thread wzhfy
Github user wzhfy commented on a diff in the pull request: https://github.com/apache/spark/pull/14712#discussion_r75573442 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/datasources/LogicalRelation.scala --- @@ -72,9 +72,12 @@ case class LogicalRelation( /

[GitHub] spark issue #14719: [SPARK-17154][SQL] Wrong result can be returned or Analy...

2016-08-19 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14719 **[Test build #64126 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/64126/consoleFull)** for PR 14719 at commit [`dd0ddbc`](https://github.com/apache/spark/commit/d

[GitHub] spark issue #14625: [SPARK-17045] [SQL] Build/move Join-related test cases i...

2016-08-19 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14625 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/64120/ Test PASSed. ---

[GitHub] spark issue #14625: [SPARK-17045] [SQL] Build/move Join-related test cases i...

2016-08-19 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14625 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #14625: [SPARK-17045] [SQL] Build/move Join-related test cases i...

2016-08-19 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14625 **[Test build #64120 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/64120/consoleFull)** for PR 14625 at commit [`bf55624`](https://github.com/apache/spark/commit/

[GitHub] spark issue #14635: [SPARK-17052] [SQL] Remove Duplicate Test Cases auto_joi...

2016-08-19 Thread gatorsmile
Github user gatorsmile commented on the issue: https://github.com/apache/spark/pull/14635 cc @cloud-fan @rxin Could you check whether this PR is reasonable? Thanks! --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark issue #14727: [SPARK-17166] [SQL] Store Table Properties in CTAS that ...

2016-08-19 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14727 **[Test build #64125 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/64125/consoleFull)** for PR 14727 at commit [`bffc412`](https://github.com/apache/spark/commit/b

[GitHub] spark issue #14727: [SPARK-17166] [SQL] Store Table Properties in CTAS that ...

2016-08-19 Thread gatorsmile
Github user gatorsmile commented on the issue: https://github.com/apache/spark/pull/14727 cc @cloud-fan @yhuai This is what we discussed in another PR. Could you please review whether this is a right fix? Thanks! --- If your project is set up for it, you can reply to this email and h

[GitHub] spark issue #14577: [SPARK-16986][WEB UI] Make 'Started' time, 'Completed' t...

2016-08-19 Thread Sherry302
Github user Sherry302 commented on the issue: https://github.com/apache/spark/pull/14577 Hi, @srowen Thanks a lot for the comments. Sorry for the late reply. You are right. I will check how other pages format the date. --- If your project is set up for it, you can reply to this emai

[GitHub] spark pull request #14727: [SPARK-17166] [SQL] Store Table Properties Specif...

2016-08-19 Thread gatorsmile
GitHub user gatorsmile opened a pull request: https://github.com/apache/spark/pull/14727 [SPARK-17166] [SQL] Store Table Properties Specified in CTAS after Conversion to Data Source Tables ## What changes were proposed in this pull request? CTAS lost table properties after

[GitHub] spark issue #14682: [SPARK-17104][SQL] LogicalRelation.newInstance should fo...

2016-08-19 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14682 **[Test build #64124 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/64124/consoleFull)** for PR 14682 at commit [`e7fe68b`](https://github.com/apache/spark/commit/e

[GitHub] spark issue #14697: [SPARK-17124][SQL] RelationalGroupedDataset.agg should p...

2016-08-19 Thread petermaxlee
Github user petermaxlee commented on the issue: https://github.com/apache/spark/pull/14697 I updated the description. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled an

[GitHub] spark pull request #14682: [SPARK-17104][SQL] LogicalRelation.newInstance sh...

2016-08-19 Thread viirya
Github user viirya commented on a diff in the pull request: https://github.com/apache/spark/pull/14682#discussion_r75573056 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/datasources/LogicalRelation.scala --- @@ -79,11 +79,18 @@ case class LogicalRelation(

[GitHub] spark pull request #14726: [SPARK-16862] Configurable buffer size in `Unsafe...

2016-08-19 Thread tejasapatil
Github user tejasapatil commented on a diff in the pull request: https://github.com/apache/spark/pull/14726#discussion_r75573049 --- Diff: core/src/main/java/org/apache/spark/util/collection/unsafe/sort/UnsafeSorterSpillReader.java --- @@ -22,15 +22,21 @@ import com.google.co

[GitHub] spark issue #14697: [SPARK-17124][SQL] RelationalGroupedDataset.agg should p...

2016-08-19 Thread petermaxlee
Github user petermaxlee commented on the issue: https://github.com/apache/spark/pull/14697 For example, run both count and sum for a column. Let me update the description. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well.

[GitHub] spark issue #14475: [SPARK-16862] Configurable buffer size in `UnsafeSorterS...

2016-08-19 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14475 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #14475: [SPARK-16862] Configurable buffer size in `UnsafeSorterS...

2016-08-19 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14475 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/64118/ Test PASSed. ---

[GitHub] spark issue #14475: [SPARK-16862] Configurable buffer size in `UnsafeSorterS...

2016-08-19 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14475 **[Test build #64118 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/64118/consoleFull)** for PR 14475 at commit [`950bb21`](https://github.com/apache/spark/commit/

[GitHub] spark pull request #14709: [SPARK-17150][SQL] Support SQL generation for inl...

2016-08-19 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/14709 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is ena

[GitHub] spark issue #14709: [SPARK-17150][SQL] Support SQL generation for inline tab...

2016-08-19 Thread cloud-fan
Github user cloud-fan commented on the issue: https://github.com/apache/spark/pull/14709 thanks, merging to master/2.0 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and

[GitHub] spark issue #14475: [SPARK-16862] Configurable buffer size in `UnsafeSorterS...

2016-08-19 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14475 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #14475: [SPARK-16862] Configurable buffer size in `UnsafeSorterS...

2016-08-19 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14475 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/64117/ Test PASSed. ---

[GitHub] spark issue #14697: [SPARK-17124][SQL] RelationalGroupedDataset.agg should p...

2016-08-19 Thread cloud-fan
Github user cloud-fan commented on the issue: https://github.com/apache/spark/pull/14697 what do you mean by `allow multiple aggregates per column` in the title? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your pro

[GitHub] spark issue #14475: [SPARK-16862] Configurable buffer size in `UnsafeSorterS...

2016-08-19 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14475 **[Test build #64117 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/64117/consoleFull)** for PR 14475 at commit [`6b8fc48`](https://github.com/apache/spark/commit/

[GitHub] spark pull request #14692: [SPARK-17115] [SQL] decrease the threshold when s...

2016-08-19 Thread cloud-fan
Github user cloud-fan commented on a diff in the pull request: https://github.com/apache/spark/pull/14692#discussion_r75572921 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/codegen/CodeGenerator.scala --- @@ -584,15 +584,18 @@ class CodegenContext

[GitHub] spark issue #14659: [SPARK-16757] Set up Spark caller context to HDFS

2016-08-19 Thread Sherry302
Github user Sherry302 commented on the issue: https://github.com/apache/spark/pull/14659 Hi, @srowen . Thank you so much for the review. Sorry for the test failure and late update. The failure reasons are that ‘jobID’ were none or there was no ‘spark.app.name’ in sparkCo

[GitHub] spark issue #14726: [SPARK-16862] Configurable buffer size in `UnsafeSorterS...

2016-08-19 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14726 **[Test build #64123 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/64123/consoleFull)** for PR 14726 at commit [`c4f37b6`](https://github.com/apache/spark/commit/c

[GitHub] spark issue #14475: [SPARK-16862] Configurable buffer size in `UnsafeSorterS...

2016-08-19 Thread tejasapatil
Github user tejasapatil commented on the issue: https://github.com/apache/spark/pull/14475 Continuing to https://github.com/apache/spark/pull/14726 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request #14726: [SPARK-16862] Configurable buffer size in `Unsafe...

2016-08-19 Thread tejasapatil
GitHub user tejasapatil opened a pull request: https://github.com/apache/spark/pull/14726 [SPARK-16862] Configurable buffer size in `UnsafeSorterSpillReader` ## What changes were proposed in this pull request? Jira: https://issues.apache.org/jira/browse/SPARK-16862

[GitHub] spark issue #14155: [SPARK-16498][SQL] move hive hack for data source table ...

2016-08-19 Thread gatorsmile
Github user gatorsmile commented on the issue: https://github.com/apache/spark/pull/14155 LGTM --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the fe

[GitHub] spark issue #14712: [SPARK-17072] [SQL] support table-level statistics gener...

2016-08-19 Thread cloud-fan
Github user cloud-fan commented on the issue: https://github.com/apache/spark/pull/14712 a high-level question: Looks like the current design depends on some features of hive metastore, e.g. the `STATS_GENERATED_VIA_STATS_TASK` flag. Is it possible that we just treat hive metastore as

[GitHub] spark issue #14155: [SPARK-16498][SQL] move hive hack for data source table ...

2016-08-19 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14155 **[Test build #64122 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/64122/consoleFull)** for PR 14155 at commit [`38b838a`](https://github.com/apache/spark/commit/3

[GitHub] spark pull request #14712: [SPARK-17072] [SQL] support table-level statistic...

2016-08-19 Thread wzhfy
Github user wzhfy commented on a diff in the pull request: https://github.com/apache/spark/pull/14712#discussion_r75572799 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/command/AnalyzeTableCommand.scala --- @@ -88,14 +90,30 @@ case class AnalyzeTableCommand(tabl

[GitHub] spark pull request #14682: [SPARK-17104][SQL] LogicalRelation.newInstance sh...

2016-08-19 Thread cloud-fan
Github user cloud-fan commented on a diff in the pull request: https://github.com/apache/spark/pull/14682#discussion_r75572798 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/datasources/LogicalRelation.scala --- @@ -79,11 +79,18 @@ case class LogicalRelation(

[GitHub] spark pull request #14724: [SPARK-17162] Range does not support SQL generati...

2016-08-19 Thread rxin
Github user rxin commented on a diff in the pull request: https://github.com/apache/spark/pull/14724#discussion_r75572751 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/catalyst/SQLBuilder.scala --- @@ -205,6 +205,9 @@ class SQLBuilder private ( case p: ScriptTrans

[GitHub] spark pull request #14155: [SPARK-16498][SQL] move hive hack for data source...

2016-08-19 Thread cloud-fan
Github user cloud-fan commented on a diff in the pull request: https://github.com/apache/spark/pull/14155#discussion_r75572741 --- Diff: sql/hive/src/main/scala/org/apache/spark/sql/hive/HiveMetastoreCatalog.scala --- @@ -175,7 +127,8 @@ private[hive] class HiveMetastoreCatalog(spa

[GitHub] spark pull request #14155: [SPARK-16498][SQL] move hive hack for data source...

2016-08-19 Thread cloud-fan
Github user cloud-fan commented on a diff in the pull request: https://github.com/apache/spark/pull/14155#discussion_r75572713 --- Diff: sql/hive/src/main/scala/org/apache/spark/sql/hive/HiveExternalCatalog.scala --- @@ -200,22 +375,77 @@ private[spark] class HiveExternalCatalog(cl

[GitHub] spark pull request #11502: [SPARK-13659] Refactor BlockStore put*() APIs to ...

2016-08-19 Thread pzz2011
Github user pzz2011 commented on a diff in the pull request: https://github.com/apache/spark/pull/11502#discussion_r75572673 --- Diff: core/src/main/scala/org/apache/spark/storage/BlockManager.scala --- @@ -432,98 +432,105 @@ private[spark] class BlockManager( logDebug

[GitHub] spark issue #13680: [SPARK-15962][SQL] Introduce implementation with a dense...

2016-08-19 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/13680 **[Test build #64121 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/64121/consoleFull)** for PR 13680 at commit [`f418f9c`](https://github.com/apache/spark/commit/f

[GitHub] spark issue #14625: [SPARK-17045] [SQL] Build/move Join-related test cases i...

2016-08-19 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14625 **[Test build #64120 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/64120/consoleFull)** for PR 14625 at commit [`bf55624`](https://github.com/apache/spark/commit/b

[GitHub] spark issue #14683: [SPARK-16968]Document additional options in jdbc Writer

2016-08-19 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14683 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #14683: [SPARK-16968]Document additional options in jdbc Writer

2016-08-19 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14683 **[Test build #64119 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/64119/consoleFull)** for PR 14683 at commit [`8595ece`](https://github.com/apache/spark/commit/

[GitHub] spark issue #14683: [SPARK-16968]Document additional options in jdbc Writer

2016-08-19 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14683 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/64119/ Test PASSed. ---

[GitHub] spark issue #14705: [SPARK-16508][SparkR] Fix CRAN undocumented/duplicated a...

2016-08-19 Thread junyangq
Github user junyangq commented on the issue: https://github.com/apache/spark/pull/14705 Thanks @felixcheung! --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so

[GitHub] spark issue #14683: [SPARK-16968]Document additional options in jdbc Writer

2016-08-19 Thread GraceH
Github user GraceH commented on the issue: https://github.com/apache/spark/pull/14683 @srowen. I have updated the patch accordingly. please let me know your comments. anything missing, please let me know. --- If your project is set up for it, you can reply to this email and have your

[GitHub] spark pull request #14712: [SPARK-17072] [SQL] support table-level statistic...

2016-08-19 Thread viirya
Github user viirya commented on a diff in the pull request: https://github.com/apache/spark/pull/14712#discussion_r75572040 --- Diff: sql/hive/src/test/scala/org/apache/spark/sql/hive/StatisticsSuite.scala --- @@ -168,6 +170,57 @@ class StatisticsSuite extends QueryTest with TestH

[GitHub] spark issue #14719: [SPARK-17154][SQL] Wrong result can be returned or Analy...

2016-08-19 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14719 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/64116/ Test FAILed. ---

[GitHub] spark issue #14719: [SPARK-17154][SQL] Wrong result can be returned or Analy...

2016-08-19 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14719 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #14683: [SPARK-16968]Document additional options in jdbc Writer

2016-08-19 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14683 **[Test build #64119 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/64119/consoleFull)** for PR 14683 at commit [`8595ece`](https://github.com/apache/spark/commit/8

[GitHub] spark issue #14719: [SPARK-17154][SQL] Wrong result can be returned or Analy...

2016-08-19 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14719 **[Test build #64116 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/64116/consoleFull)** for PR 14719 at commit [`91cb915`](https://github.com/apache/spark/commit/

[GitHub] spark pull request #14712: [SPARK-17072] [SQL] support table-level statistic...

2016-08-19 Thread viirya
Github user viirya commented on a diff in the pull request: https://github.com/apache/spark/pull/14712#discussion_r75571934 --- Diff: sql/hive/src/main/scala/org/apache/spark/sql/hive/HiveMetastoreCatalog.scala --- @@ -342,7 +342,9 @@ private[hive] class HiveMetastoreCatalog(sparkS

[GitHub] spark issue #14682: [SPARK-17104][SQL] LogicalRelation.newInstance should fo...

2016-08-19 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14682 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/64114/ Test PASSed. ---

[GitHub] spark issue #14682: [SPARK-17104][SQL] LogicalRelation.newInstance should fo...

2016-08-19 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14682 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #14682: [SPARK-17104][SQL] LogicalRelation.newInstance should fo...

2016-08-19 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14682 **[Test build #64114 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/64114/consoleFull)** for PR 14682 at commit [`e243323`](https://github.com/apache/spark/commit/

[GitHub] spark pull request #14475: [SPARK-16862] Configurable buffer size in `Unsafe...

2016-08-19 Thread tejasapatil
Github user tejasapatil closed the pull request at: https://github.com/apache/spark/pull/14475 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature i

[GitHub] spark issue #14475: [SPARK-16862] Configurable buffer size in `UnsafeSorterS...

2016-08-19 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14475 **[Test build #64118 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/64118/consoleFull)** for PR 14475 at commit [`950bb21`](https://github.com/apache/spark/commit/9

[GitHub] spark pull request #14712: [SPARK-17072] [SQL] support table-level statistic...

2016-08-19 Thread viirya
Github user viirya commented on a diff in the pull request: https://github.com/apache/spark/pull/14712#discussion_r75571723 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/command/AnalyzeTableCommand.scala --- @@ -88,14 +90,30 @@ case class AnalyzeTableCommand(tab

[GitHub] spark pull request #14712: [SPARK-17072] [SQL] support table-level statistic...

2016-08-19 Thread gatorsmile
Github user gatorsmile commented on a diff in the pull request: https://github.com/apache/spark/pull/14712#discussion_r75571695 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/command/AnalyzeTableCommand.scala --- @@ -88,14 +90,30 @@ case class AnalyzeTableCommand

[GitHub] spark pull request #14712: [SPARK-17072] [SQL] support table-level statistic...

2016-08-19 Thread viirya
Github user viirya commented on a diff in the pull request: https://github.com/apache/spark/pull/14712#discussion_r75571686 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/command/AnalyzeTableCommand.scala --- @@ -88,14 +90,30 @@ case class AnalyzeTableCommand(tab

[GitHub] spark issue #14475: [SPARK-16862] Configurable buffer size in `UnsafeSorterS...

2016-08-19 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14475 **[Test build #64117 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/64117/consoleFull)** for PR 14475 at commit [`6b8fc48`](https://github.com/apache/spark/commit/6

[GitHub] spark pull request #14721: [SPARK-17158][SQL] Change error message for out o...

2016-08-19 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/14721 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is ena

[GitHub] spark issue #14635: [SPARK-17052] [SQL] Remove Duplicate Test Cases auto_joi...

2016-08-19 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14635 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/64115/ Test PASSed. ---

[GitHub] spark issue #14635: [SPARK-17052] [SQL] Remove Duplicate Test Cases auto_joi...

2016-08-19 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14635 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #14635: [SPARK-17052] [SQL] Remove Duplicate Test Cases auto_joi...

2016-08-19 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14635 **[Test build #64115 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/64115/consoleFull)** for PR 14635 at commit [`8b8725c`](https://github.com/apache/spark/commit/

[GitHub] spark issue #14721: [SPARK-17158][SQL] Change error message for out of range...

2016-08-19 Thread rxin
Github user rxin commented on the issue: https://github.com/apache/spark/pull/14721 Merging in master/2.0. Thanks! --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wi

[GitHub] spark issue #13428: [SPARK-12666][CORE] SparkSubmit packages fix for when 'd...

2016-08-19 Thread JoshRosen
Github user JoshRosen commented on the issue: https://github.com/apache/spark/pull/13428 LGTM; I'll merge when I get home tonight. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #14475: [SPARK-16862] Configurable buffer size in `UnsafeSorterS...

2016-08-19 Thread tejasapatil
Github user tejasapatil commented on the issue: https://github.com/apache/spark/pull/14475 Yeah. I have been stuck with other things so could not clean it up. Will try again. In worst case close this PR and send a new one. --- If your project is set up for it, you can reply to this e

[GitHub] spark issue #14721: [SPARK-17158][SQL] Change error message for out of range...

2016-08-19 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14721 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #14721: [SPARK-17158][SQL] Change error message for out of range...

2016-08-19 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14721 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/64112/ Test PASSed. ---

[GitHub] spark issue #14721: [SPARK-17158][SQL] Change error message for out of range...

2016-08-19 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14721 **[Test build #3230 has finished](https://amplab.cs.berkeley.edu/jenkins/job/NewSparkPullRequestBuilder/3230/consoleFull)** for PR 14721 at commit [`19582ff`](https://github.com/apache/spark/commit

[GitHub] spark issue #14721: [SPARK-17158][SQL] Change error message for out of range...

2016-08-19 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14721 **[Test build #64112 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/64112/consoleFull)** for PR 14721 at commit [`19582ff`](https://github.com/apache/spark/commit/

[GitHub] spark issue #14719: [SPARK-17154][SQL] Wrong result can be returned or Analy...

2016-08-19 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14719 **[Test build #64116 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/64116/consoleFull)** for PR 14719 at commit [`91cb915`](https://github.com/apache/spark/commit/9

[GitHub] spark issue #14635: [SPARK-17052] [SQL] Remove Duplicate Test Cases auto_joi...

2016-08-19 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14635 **[Test build #64115 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/64115/consoleFull)** for PR 14635 at commit [`8b8725c`](https://github.com/apache/spark/commit/8

[GitHub] spark issue #14682: [SPARK-17104][SQL] LogicalRelation.newInstance should fo...

2016-08-19 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14682 **[Test build #64114 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/64114/consoleFull)** for PR 14682 at commit [`e243323`](https://github.com/apache/spark/commit/e

  1   2   3   4   5   6   7   >