[GitHub] spark pull request #14156: [SPARK-16499][ML][MLLib] improve ApplyInPlace fun...

2016-07-12 Thread WeichenXu123
GitHub user WeichenXu123 opened a pull request: https://github.com/apache/spark/pull/14156 [SPARK-16499][ML][MLLib] improve ApplyInPlace function in ANN code ## What changes were proposed in this pull request? I re-code the following fuction using breeze's matrix operating f

[GitHub] spark pull request #14140: [SPARK-16426][MLlib] Fix bug that caused NaNs in ...

2016-07-12 Thread neggert
Github user neggert commented on a diff in the pull request: https://github.com/apache/spark/pull/14140#discussion_r70450795 --- Diff: mllib/src/main/scala/org/apache/spark/mllib/regression/IsotonicRegression.scala --- @@ -408,8 +409,12 @@ class IsotonicRegression private (private

[GitHub] spark pull request #14149: [SPARK-16435][YARN][MINOR] Add warning log if ini...

2016-07-12 Thread tgravescs
Github user tgravescs commented on a diff in the pull request: https://github.com/apache/spark/pull/14149#discussion_r70450332 --- Diff: core/src/main/scala/org/apache/spark/util/Utils.scala --- @@ -2342,6 +2342,12 @@ private[spark] object Utils extends Logging { * Return th

[GitHub] spark pull request #14155: [SPARK-16498][SQL][WIP] move hive hack for data s...

2016-07-12 Thread hvanhovell
Github user hvanhovell commented on a diff in the pull request: https://github.com/apache/spark/pull/14155#discussion_r70449078 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/parser/ParseDriver.scala --- @@ -34,7 +34,7 @@ import org.apache.spark.sql.types.Data

[GitHub] spark issue #14154: [SPARK-16497][SQL] Don't throw an exception if drop non-...

2016-07-12 Thread hvanhovell
Github user hvanhovell commented on the issue: https://github.com/apache/spark/pull/14154 This is by design; we throw exceptions for all invalid commands. Why should we follow Hive here? See for more context: https://github.com/apache/spark/pull/13307 & https://github.com/apa

[GitHub] spark issue #14155: [SPARK-16498][SQL][WIP] move hive hack for data source t...

2016-07-12 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14155 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/62170/ Test FAILed. ---

[GitHub] spark issue #14155: [SPARK-16498][SQL][WIP] move hive hack for data source t...

2016-07-12 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14155 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #14155: [SPARK-16498][SQL][WIP] move hive hack for data source t...

2016-07-12 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14155 **[Test build #62170 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/62170/consoleFull)** for PR 14155 at commit [`d519968`](https://github.com/apache/spark/commit/

[GitHub] spark issue #14150: [SPARK-16494] [ML] Upgrade breeze version to 0.12

2016-07-12 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14150 **[Test build #62171 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/62171/consoleFull)** for PR 14150 at commit [`3127733`](https://github.com/apache/spark/commit/3

[GitHub] spark issue #14148: [SPARK-16482] [SQL] Describe Table Command for Tables Re...

2016-07-12 Thread gatorsmile
Github user gatorsmile commented on the issue: https://github.com/apache/spark/pull/14148 @rxin The failed test case is interesting! `REFRESH TABLE` command does not refresh the metadata stored in the external catalog. When the tables are data source tables, it is a bug? Ple

[GitHub] spark issue #14155: [SPARK-16498][SQL][WIP] move hive hack for data source t...

2016-07-12 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14155 **[Test build #62170 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/62170/consoleFull)** for PR 14155 at commit [`d519968`](https://github.com/apache/spark/commit/d

[GitHub] spark pull request #14149: [SPARK-16435][YARN][MINOR] Add warning log if ini...

2016-07-12 Thread tgravescs
Github user tgravescs commented on a diff in the pull request: https://github.com/apache/spark/pull/14149#discussion_r70444399 --- Diff: core/src/main/scala/org/apache/spark/util/Utils.scala --- @@ -2342,6 +2342,12 @@ private[spark] object Utils extends Logging { * Return th

[GitHub] spark pull request #14155: [SPARK-16498][SQL][WIP] move hive hack for data s...

2016-07-12 Thread cloud-fan
GitHub user cloud-fan opened a pull request: https://github.com/apache/spark/pull/14155 [SPARK-16498][SQL][WIP] move hive hack for data source table into HiveExternalCatalog ## What changes were proposed in this pull request? Spark SQL doesn't have its own meta store yet, a

[GitHub] spark issue #14154: [SPARK-16497][SQL] Don't throw an exception if drop non-...

2016-07-12 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14154 **[Test build #62169 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/62169/consoleFull)** for PR 14154 at commit [`7b64de2`](https://github.com/apache/spark/commit/7

[GitHub] spark pull request #14149: [SPARK-16435][YARN][MINOR] Add warning log if ini...

2016-07-12 Thread tgravescs
Github user tgravescs commented on a diff in the pull request: https://github.com/apache/spark/pull/14149#discussion_r70444156 --- Diff: core/src/main/scala/org/apache/spark/util/Utils.scala --- @@ -2342,6 +2342,12 @@ private[spark] object Utils extends Logging { * Return th

[GitHub] spark issue #14142: [SPARK-16439] Fix number formatting in SQL UI

2016-07-12 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14142 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #14142: [SPARK-16439] Fix number formatting in SQL UI

2016-07-12 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14142 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/62163/ Test PASSed. ---

[GitHub] spark issue #14142: [SPARK-16439] Fix number formatting in SQL UI

2016-07-12 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14142 **[Test build #62163 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/62163/consoleFull)** for PR 14142 at commit [`fef15ce`](https://github.com/apache/spark/commit/

[GitHub] spark pull request #14149: [SPARK-16435][YARN][MINOR] Add warning log if ini...

2016-07-12 Thread tgravescs
Github user tgravescs commented on a diff in the pull request: https://github.com/apache/spark/pull/14149#discussion_r70442221 --- Diff: core/src/main/scala/org/apache/spark/util/Utils.scala --- @@ -2342,6 +2342,12 @@ private[spark] object Utils extends Logging { * Return th

[GitHub] spark issue #14154: [SPARK-16497][SQL] Don't throw an exception if drop non-...

2016-07-12 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14154 **[Test build #62168 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/62168/consoleFull)** for PR 14154 at commit [`6eb9e8e`](https://github.com/apache/spark/commit/6

[GitHub] spark pull request #14154: [SPARK-16497][SQL] Don't throw an exception if dr...

2016-07-12 Thread lianhuiwang
GitHub user lianhuiwang opened a pull request: https://github.com/apache/spark/pull/14154 [SPARK-16497][SQL] Don't throw an exception if drop non-existent TABLE/VIEW/Function/Partitions ## What changes were proposed in this pull request? from https://cwiki.apache.org/confluence

[GitHub] spark pull request #14036: [SPARK-16323] [SQL] Add IntegerDivide to avoid un...

2016-07-12 Thread techaddict
Github user techaddict commented on a diff in the pull request: https://github.com/apache/spark/pull/14036#discussion_r70437720 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/arithmetic.scala --- @@ -237,6 +229,9 @@ case class Divide(left: Expressi

[GitHub] spark issue #14132: [SPARK-16475][SQL][WIP] Broadcast Hint for SQL Queries

2016-07-12 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14132 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #14132: [SPARK-16475][SQL][WIP] Broadcast Hint for SQL Queries

2016-07-12 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14132 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/62162/ Test PASSed. ---

[GitHub] spark issue #14132: [SPARK-16475][SQL][WIP] Broadcast Hint for SQL Queries

2016-07-12 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14132 **[Test build #62162 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/62162/consoleFull)** for PR 14132 at commit [`edec2e4`](https://github.com/apache/spark/commit/

[GitHub] spark issue #14151: [SPARK-16496][SQL] Add wholetext as data source for SQL.

2016-07-12 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14151 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/62161/ Test PASSed. ---

[GitHub] spark issue #14151: [SPARK-16496][SQL] Add wholetext as data source for SQL.

2016-07-12 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14151 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #14151: [SPARK-16496][SQL] Add wholetext as data source for SQL.

2016-07-12 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14151 **[Test build #62161 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/62161/consoleFull)** for PR 14151 at commit [`dafe981`](https://github.com/apache/spark/commit/

[GitHub] spark pull request #13990: [SPARK-16287][SQL] Implement str_to_map SQL funct...

2016-07-12 Thread techaddict
Github user techaddict commented on a diff in the pull request: https://github.com/apache/spark/pull/13990#discussion_r70434309 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/complexTypeCreator.scala --- @@ -393,3 +394,84 @@ case class CreateNamedS

[GitHub] spark issue #14152: [SPARK-16395] [STREAMING] Fail if too many CheckpointWri...

2016-07-12 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14152 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/62164/ Test PASSed. ---

[GitHub] spark issue #14152: [SPARK-16395] [STREAMING] Fail if too many CheckpointWri...

2016-07-12 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14152 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #14152: [SPARK-16395] [STREAMING] Fail if too many CheckpointWri...

2016-07-12 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14152 **[Test build #62164 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/62164/consoleFull)** for PR 14152 at commit [`a6fce66`](https://github.com/apache/spark/commit/

[GitHub] spark issue #14149: [SPARK-16435][YARN][MINOR] Add warning log if initialExe...

2016-07-12 Thread jerryshao
Github user jerryshao commented on the issue: https://github.com/apache/spark/pull/14149 @tgravescs and @rdblue , please help to review, thanks a lot. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does n

[GitHub] spark issue #14150: [SPARK-16494] [ML] Upgrade breeze version to 0.12

2016-07-12 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14150 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/62167/ Test FAILed. ---

[GitHub] spark issue #14150: [SPARK-16494] [ML] Upgrade breeze version to 0.12

2016-07-12 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14150 **[Test build #62167 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/62167/consoleFull)** for PR 14150 at commit [`d2d567f`](https://github.com/apache/spark/commit/

[GitHub] spark issue #14150: [SPARK-16494] [ML] Upgrade breeze version to 0.12

2016-07-12 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14150 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #14153: [SPARK-16440] [MLLIB] Undeleted broadcast variables in W...

2016-07-12 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14153 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/62165/ Test PASSed. ---

[GitHub] spark issue #14153: [SPARK-16440] [MLLIB] Undeleted broadcast variables in W...

2016-07-12 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14153 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #14153: [SPARK-16440] [MLLIB] Undeleted broadcast variables in W...

2016-07-12 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14153 **[Test build #62165 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/62165/consoleFull)** for PR 14153 at commit [`0a933d8`](https://github.com/apache/spark/commit/

[GitHub] spark issue #14150: [SPARK-16494] [ML] Upgrade breeze version to 0.12

2016-07-12 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14150 **[Test build #62167 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/62167/consoleFull)** for PR 14150 at commit [`d2d567f`](https://github.com/apache/spark/commit/d

[GitHub] spark pull request #13990: [SPARK-16287][SQL] Implement str_to_map SQL funct...

2016-07-12 Thread cloud-fan
Github user cloud-fan commented on a diff in the pull request: https://github.com/apache/spark/pull/13990#discussion_r70432140 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/complexTypeCreator.scala --- @@ -393,3 +394,84 @@ case class CreateNamedSt

[GitHub] spark issue #14150: [SPARK-16494] [ML] Upgrade breeze version to 0.12

2016-07-12 Thread yanboliang
Github user yanboliang commented on the issue: https://github.com/apache/spark/pull/14150 Jenkins, test this please. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and w

[GitHub] spark pull request #13990: [SPARK-16287][SQL] Implement str_to_map SQL funct...

2016-07-12 Thread cloud-fan
Github user cloud-fan commented on a diff in the pull request: https://github.com/apache/spark/pull/13990#discussion_r70431713 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/complexTypeCreator.scala --- @@ -393,3 +394,84 @@ case class CreateNamedSt

[GitHub] spark pull request #13990: [SPARK-16287][SQL] Implement str_to_map SQL funct...

2016-07-12 Thread cloud-fan
Github user cloud-fan commented on a diff in the pull request: https://github.com/apache/spark/pull/13990#discussion_r70431411 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/complexTypeCreator.scala --- @@ -393,3 +394,84 @@ case class CreateNamedSt

[GitHub] spark issue #13873: [SPARK-16167][SQL] RowEncoder should preserve array/map ...

2016-07-12 Thread ueshin
Github user ueshin commented on the issue: https://github.com/apache/spark/pull/13873 ping @cloud-fan --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or i

[GitHub] spark issue #13990: [SPARK-16287][SQL] Implement str_to_map SQL function

2016-07-12 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/13990 **[Test build #62166 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/62166/consoleFull)** for PR 13990 at commit [`1592ffc`](https://github.com/apache/spark/commit/1

[GitHub] spark pull request #14140: [SPARK-16426][MLlib] Fix bug that caused NaNs in ...

2016-07-12 Thread srowen
Github user srowen commented on a diff in the pull request: https://github.com/apache/spark/pull/14140#discussion_r70429952 --- Diff: mllib/src/main/scala/org/apache/spark/mllib/regression/IsotonicRegression.scala --- @@ -408,8 +409,12 @@ class IsotonicRegression private (private

[GitHub] spark issue #13704: [SPARK-15985][SQL] Eliminate redundant cast from an arra...

2016-07-12 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/13704 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #13704: [SPARK-15985][SQL] Eliminate redundant cast from an arra...

2016-07-12 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/13704 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/62159/ Test PASSed. ---

[GitHub] spark issue #14150: [SPARK-16494] [ML] Upgrade breeze version to 0.12

2016-07-12 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14150 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/62160/ Test FAILed. ---

[GitHub] spark issue #14150: [SPARK-16494] [ML] Upgrade breeze version to 0.12

2016-07-12 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14150 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #14150: [SPARK-16494] [ML] Upgrade breeze version to 0.12

2016-07-12 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14150 **[Test build #62160 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/62160/consoleFull)** for PR 14150 at commit [`d2d567f`](https://github.com/apache/spark/commit/

[GitHub] spark issue #13704: [SPARK-15985][SQL] Eliminate redundant cast from an arra...

2016-07-12 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/13704 **[Test build #62159 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/62159/consoleFull)** for PR 13704 at commit [`e6a5772`](https://github.com/apache/spark/commit/

[GitHub] spark issue #14151: [SPARK-16496][SQL] Add wholetext as data source for SQL.

2016-07-12 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14151 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #14151: [SPARK-16496][SQL] Add wholetext as data source for SQL.

2016-07-12 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14151 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/62158/ Test PASSed. ---

[GitHub] spark issue #14151: [SPARK-16496][SQL] Add wholetext as data source for SQL.

2016-07-12 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14151 **[Test build #62158 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/62158/consoleFull)** for PR 14151 at commit [`bd2936d`](https://github.com/apache/spark/commit/

[GitHub] spark issue #13701: [SPARK-15639][SQL] Try to push down filter at RowGroups ...

2016-07-12 Thread viirya
Github user viirya commented on the issue: https://github.com/apache/spark/pull/13701 ping @liancheng @yhuai again. Can you take a look? Thanks. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not hav

[GitHub] spark pull request #14132: [SPARK-16475][SQL][WIP] Broadcast Hint for SQL Qu...

2016-07-12 Thread hvanhovell
Github user hvanhovell commented on a diff in the pull request: https://github.com/apache/spark/pull/14132#discussion_r70426742 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/analysis/Analyzer.scala --- @@ -86,6 +86,7 @@ class Analyzer( WindowsSubst

[GitHub] spark pull request #14132: [SPARK-16475][SQL][WIP] Broadcast Hint for SQL Qu...

2016-07-12 Thread hvanhovell
Github user hvanhovell commented on a diff in the pull request: https://github.com/apache/spark/pull/14132#discussion_r70426735 --- Diff: sql/catalyst/src/main/antlr4/org/apache/spark/sql/catalyst/parser/SqlBase.g4 --- @@ -945,8 +955,12 @@ SIMPLE_COMMENT : '--' ~[\r\n]* '\

[GitHub] spark pull request #14132: [SPARK-16475][SQL][WIP] Broadcast Hint for SQL Qu...

2016-07-12 Thread hvanhovell
Github user hvanhovell commented on a diff in the pull request: https://github.com/apache/spark/pull/14132#discussion_r70426683 --- Diff: sql/catalyst/src/main/antlr4/org/apache/spark/sql/catalyst/parser/SqlBase.g4 --- @@ -347,6 +347,15 @@ querySpecification windows?)

[GitHub] spark issue #14153: [SPARK-16440] [MLLIB] Undeleted broadcast variables in W...

2016-07-12 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14153 **[Test build #62165 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/62165/consoleFull)** for PR 14153 at commit [`0a933d8`](https://github.com/apache/spark/commit/0

[GitHub] spark pull request #14132: [SPARK-16475][SQL][WIP] Broadcast Hint for SQL Qu...

2016-07-12 Thread hvanhovell
Github user hvanhovell commented on a diff in the pull request: https://github.com/apache/spark/pull/14132#discussion_r70425722 --- Diff: sql/catalyst/src/main/antlr4/org/apache/spark/sql/catalyst/parser/SqlBase.g4 --- @@ -347,6 +347,15 @@ querySpecification windows?)

[GitHub] spark pull request #14153: [SPARK-16440] [MLLIB] Undeleted broadcast variabl...

2016-07-12 Thread srowen
GitHub user srowen opened a pull request: https://github.com/apache/spark/pull/14153 [SPARK-16440] [MLLIB] Undeleted broadcast variables in Word2Vec causing OoM for long runs ## What changes were proposed in this pull request? Unpersist broadcasted vars in Word2Vec.fit for

[GitHub] spark pull request #14122: [SPARK-16470][ML][Optimizer] Check linear regress...

2016-07-12 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/14122 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is ena

[GitHub] spark issue #14122: [SPARK-16470][ML][Optimizer] Check linear regression tra...

2016-07-12 Thread srowen
Github user srowen commented on the issue: https://github.com/apache/spark/pull/14122 Merged to master, and 2.0 on the grounds that it's just an added informative warning --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. I

[GitHub] spark issue #14152: [SPARK-16395] [STREAMING] Fail if too many CheckpointWri...

2016-07-12 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14152 **[Test build #62164 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/62164/consoleFull)** for PR 14152 at commit [`a6fce66`](https://github.com/apache/spark/commit/a

[GitHub] spark issue #14152: [SPARK-16395] [STREAMING] Fail if too many CheckpointWri...

2016-07-12 Thread srowen
Github user srowen commented on the issue: https://github.com/apache/spark/pull/14152 CC @tdas --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the f

[GitHub] spark pull request #14152: [SPARK-16395] [STREAMING] Fail if too many Checkp...

2016-07-12 Thread srowen
GitHub user srowen opened a pull request: https://github.com/apache/spark/pull/14152 [SPARK-16395] [STREAMING] Fail if too many CheckpointWriteHandlers are queued up in the fixed thread pool ## What changes were proposed in this pull request? Begin failing if checkpoint wri

[GitHub] spark pull request #11293: [SPARK-13080] [SQL] Implement new Catalog API usi...

2016-07-12 Thread cloud-fan
Github user cloud-fan commented on a diff in the pull request: https://github.com/apache/spark/pull/11293#discussion_r70422619 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/catalog/interface.scala --- @@ -127,33 +166,30 @@ abstract class Catalog { * @pa

[GitHub] spark issue #13494: [SPARK-15752] [SQL] Optimize metadata only query that ha...

2016-07-12 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/13494 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #13494: [SPARK-15752] [SQL] Optimize metadata only query that ha...

2016-07-12 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/13494 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/62156/ Test PASSed. ---

[GitHub] spark issue #14142: [SPARK-16439] Fix number formatting in SQL UI

2016-07-12 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14142 **[Test build #62163 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/62163/consoleFull)** for PR 14142 at commit [`fef15ce`](https://github.com/apache/spark/commit/f

[GitHub] spark issue #13494: [SPARK-15752] [SQL] Optimize metadata only query that ha...

2016-07-12 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/13494 **[Test build #62156 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/62156/consoleFull)** for PR 13494 at commit [`030776a`](https://github.com/apache/spark/commit/

[GitHub] spark issue #14104: [SPARK-16438] Add Asynchronous Actions documentation

2016-07-12 Thread srowen
Github user srowen commented on the issue: https://github.com/apache/spark/pull/14104 @phalodi no need to ping. We don't merge things immediately, especially when non-essential. It gives more time for review. --- If your project is set up for it, you can reply to this email and have

[GitHub] spark issue #14142: [SPARK-16439] Fix number formatting in SQL UI

2016-07-12 Thread srowen
Github user srowen commented on the issue: https://github.com/apache/spark/pull/14142 Jenkins test this please --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes

[GitHub] spark issue #14142: [SPARK-16439] Fix number formatting in SQL UI

2016-07-12 Thread srowen
Github user srowen commented on the issue: https://github.com/apache/spark/pull/14142 Jenkins add to whitelist --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes

[GitHub] spark issue #13704: [SPARK-15985][SQL] Eliminate redundant cast from an arra...

2016-07-12 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/13704 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #13704: [SPARK-15985][SQL] Eliminate redundant cast from an arra...

2016-07-12 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/13704 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/62155/ Test PASSed. ---

[GitHub] spark issue #13704: [SPARK-15985][SQL] Eliminate redundant cast from an arra...

2016-07-12 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/13704 **[Test build #62155 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/62155/consoleFull)** for PR 13704 at commit [`466ba88`](https://github.com/apache/spark/commit/

[GitHub] spark issue #14132: [SPARK-16475][SQL][WIP] Broadcast Hint for SQL Queries

2016-07-12 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14132 **[Test build #62162 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/62162/consoleFull)** for PR 14132 at commit [`edec2e4`](https://github.com/apache/spark/commit/e

[GitHub] spark issue #14151: [SPARK-16496][SQL] Add wholetext as data source for SQL.

2016-07-12 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14151 **[Test build #62161 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/62161/consoleFull)** for PR 14151 at commit [`dafe981`](https://github.com/apache/spark/commit/d

[GitHub] spark pull request #13704: [SPARK-15985][SQL] Eliminate redundant cast from ...

2016-07-12 Thread cloud-fan
Github user cloud-fan commented on a diff in the pull request: https://github.com/apache/spark/pull/13704#discussion_r70418445 --- Diff: sql/catalyst/src/test/scala/org/apache/spark/sql/catalyst/optimizer/SimplifyCastsSuite.scala --- @@ -0,0 +1,120 @@ +/* + * Licensed to t

[GitHub] spark issue #14150: [SPARK-16494] [ML] Upgrade breeze version to 0.12

2016-07-12 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14150 **[Test build #62160 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/62160/consoleFull)** for PR 14150 at commit [`d2d567f`](https://github.com/apache/spark/commit/d

[GitHub] spark issue #14151: [SPARK-16496][SQL] Add wholetext as data source for SQL.

2016-07-12 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14151 **[Test build #62158 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/62158/consoleFull)** for PR 14151 at commit [`bd2936d`](https://github.com/apache/spark/commit/b

[GitHub] spark issue #13704: [SPARK-15985][SQL] Eliminate redundant cast from an arra...

2016-07-12 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/13704 **[Test build #62159 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/62159/consoleFull)** for PR 13704 at commit [`e6a5772`](https://github.com/apache/spark/commit/e

[GitHub] spark pull request #14151: [SPARK-16496][SQL] Add wholetext as data source f...

2016-07-12 Thread ScrapCodes
GitHub user ScrapCodes opened a pull request: https://github.com/apache/spark/pull/14151 [SPARK-16496][SQL] Add wholetext as data source for SQL. ## What changes were proposed in this pull request? In multiple text analysis, problems it is not often desirable for the rows t

[GitHub] spark issue #13704: [SPARK-15985][SQL] Eliminate redundant cast from an arra...

2016-07-12 Thread kiszk
Github user kiszk commented on the issue: https://github.com/apache/spark/pull/13704 Thanks again for your kindly reviews. I addresses both comments. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does no

[GitHub] spark issue #14150: [SPARK-16494] [ML] Upgrade breeze version to 0.12

2016-07-12 Thread yanboliang
Github user yanboliang commented on the issue: https://github.com/apache/spark/pull/14150 @hvanhovell Yes, I updated the dependency manifests manually. I will change to use the scripts you provided. Thanks for your kindly remind! --- If your project is set up for it, you can reply to

[GitHub] spark pull request #14014: [SPARK-16344][SQL] Decoding Parquet array of stru...

2016-07-12 Thread liancheng
Github user liancheng commented on a diff in the pull request: https://github.com/apache/spark/pull/14014#discussion_r70415596 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/datasources/parquet/ParquetSchemaConverter.scala --- @@ -260,7 +260,7 @@ private[parquet]

[GitHub] spark issue #14149: [SPARK-16435][YARN][MINOR] Add warning log if initialExe...

2016-07-12 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14149 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/62153/ Test PASSed. ---

[GitHub] spark issue #14149: [SPARK-16435][YARN][MINOR] Add warning log if initialExe...

2016-07-12 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14149 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #14149: [SPARK-16435][YARN][MINOR] Add warning log if initialExe...

2016-07-12 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14149 **[Test build #62153 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/62153/consoleFull)** for PR 14149 at commit [`f08eabd`](https://github.com/apache/spark/commit/

[GitHub] spark issue #14150: [SPARK-16494] [ML] Upgrade breeze version to 0.12

2016-07-12 Thread hvanhovell
Github user hvanhovell commented on the issue: https://github.com/apache/spark/pull/14150 Hmmm it is also pulling in shapeless... did you manually update the manifests? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If

[GitHub] spark issue #13704: [SPARK-15985][SQL] Eliminate redundant cast from an arra...

2016-07-12 Thread cloud-fan
Github user cloud-fan commented on the issue: https://github.com/apache/spark/pull/13704 LGTM, one last comment: https://github.com/apache/spark/pull/13704/files#r70381491 BTW can you also update the PR description? e.g. we don't need to show the difference of generated code

[GitHub] spark issue #14150: [SPARK-16494] [ML] Upgrade breeze version to 0.12

2016-07-12 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14150 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/62157/ Test FAILed. ---

[GitHub] spark issue #14150: [SPARK-16494] [ML] Upgrade breeze version to 0.12

2016-07-12 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14150 **[Test build #62157 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/62157/consoleFull)** for PR 14150 at commit [`ba01c7e`](https://github.com/apache/spark/commit/

[GitHub] spark issue #14150: [SPARK-16494] [ML] Upgrade breeze version to 0.12

2016-07-12 Thread hvanhovell
Github user hvanhovell commented on the issue: https://github.com/apache/spark/pull/14150 NVM... --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the

[GitHub] spark issue #14150: [SPARK-16494] [ML] Upgrade breeze version to 0.12

2016-07-12 Thread hvanhovell
Github user hvanhovell commented on the issue: https://github.com/apache/spark/pull/14150 @yanboliang you need to update the dependency manifests. Run: `./dev/test-dependencies.sh --replace-manifest` --- If your project is set up for it, you can reply to this email and have your repl

[GitHub] spark issue #14150: [SPARK-16494] [ML] Upgrade breeze version to 0.12

2016-07-12 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14150 **[Test build #62157 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/62157/consoleFull)** for PR 14150 at commit [`ba01c7e`](https://github.com/apache/spark/commit/b

[GitHub] spark issue #14150: [SPARK-16494] [ML] Upgrade breeze version to 0.12

2016-07-12 Thread yanboliang
Github user yanboliang commented on the issue: https://github.com/apache/spark/pull/14150 Jenkins, test this please. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and w

<    1   2   3   4   5   6   >