[GitHub] spark issue #15945: [SPARK-12978][SQL] Merge unnecessary partial aggregates

2017-01-12 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15945 **[Test build #71264 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/71264/consoleFull)** for PR 15945 at commit [`6bd225f`](https://github.com/apache/spark/commit/

[GitHub] spark issue #15945: [SPARK-12978][SQL] Merge unnecessary partial aggregates

2017-01-12 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15945 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/71264/ Test FAILed. ---

[GitHub] spark issue #16549: [SPARK-19151][SQL]DataFrameWriter.saveAsTable support hi...

2017-01-12 Thread windpiger
Github user windpiger commented on the issue: https://github.com/apache/spark/pull/16549 thanks, I will keep track of this after hive and datasource unified . https://github.com/apache/spark/pull/16549/files#r95670788 --- If your project is set up for it, you can reply to this ema

[GitHub] spark issue #16119: [SPARK-18687][Pyspark][SQL]Backward compatibility - crea...

2017-01-12 Thread viirya
Github user viirya commented on the issue: https://github.com/apache/spark/pull/16119 @vijoshi Can you solve the conflict? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled

[GitHub] spark issue #16561: [SPARK-18209][SQL] Alias the view with its child by mapp...

2017-01-12 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16561 **[Test build #71255 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/71255/testReport)** for PR 16561 at commit [`0e82340`](https://github.com/apache/spark/commit/0

[GitHub] spark issue #16561: [SPARK-18209][SQL] Alias the view with its child by mapp...

2017-01-12 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16561 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #16561: [SPARK-18209][SQL] Alias the view with its child by mapp...

2017-01-12 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16561 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/71255/ Test PASSed. ---

[GitHub] spark issue #15945: [SPARK-12978][SQL] Merge unnecessary partial aggregates

2017-01-12 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15945 **[Test build #71265 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/71265/testReport)** for PR 15945 at commit [`30e7258`](https://github.com/apache/spark/commit/30

[GitHub] spark issue #15945: [SPARK-12978][SQL] Merge unnecessary partial aggregates

2017-01-12 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15945 **[Test build #71265 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/71265/testReport)** for PR 15945 at commit [`30e7258`](https://github.com/apache/spark/commit/3

[GitHub] spark issue #15945: [SPARK-12978][SQL] Merge unnecessary partial aggregates

2017-01-12 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15945 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/71265/ Test FAILed. ---

[GitHub] spark issue #15945: [SPARK-12978][SQL] Merge unnecessary partial aggregates

2017-01-12 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15945 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #16547: [SPARK-19168][Structured Streaming] Improvement: filter ...

2017-01-12 Thread lw-lin
Github user lw-lin commented on the issue: https://github.com/apache/spark/pull/16547 Jenkins retest this please --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishe

[GitHub] spark issue #14812: [SPARK-17237][SQL] Remove backticks in a pivot result sc...

2017-01-12 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14812 **[Test build #71256 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/71256/testReport)** for PR 14812 at commit [`2e567cc`](https://github.com/apache/spark/commit/2

[GitHub] spark issue #14812: [SPARK-17237][SQL] Remove backticks in a pivot result sc...

2017-01-12 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14812 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/71256/ Test PASSed. ---

[GitHub] spark issue #14812: [SPARK-17237][SQL] Remove backticks in a pivot result sc...

2017-01-12 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14812 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #16547: [SPARK-19168][Structured Streaming] Improvement: filter ...

2017-01-12 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16547 **[Test build #71266 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/71266/testReport)** for PR 16547 at commit [`07a020e`](https://github.com/apache/spark/commit/07

[GitHub] spark issue #16213: [SPARK-18020][Streaming][Kinesis] Checkpoint SHARD_END t...

2017-01-12 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16213 **[Test build #71263 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/71263/testReport)** for PR 16213 at commit [`7f8336c`](https://github.com/apache/spark/commit/7

[GitHub] spark issue #16213: [SPARK-18020][Streaming][Kinesis] Checkpoint SHARD_END t...

2017-01-12 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16213 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/71263/ Test FAILed. ---

[GitHub] spark issue #16213: [SPARK-18020][Streaming][Kinesis] Checkpoint SHARD_END t...

2017-01-12 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16213 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #14812: [SPARK-17237][SQL] Remove backticks in a pivot result sc...

2017-01-12 Thread maropu
Github user maropu commented on the issue: https://github.com/apache/spark/pull/14812 @gatorsmile okay, fixed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes

[GitHub] spark issue #15928: [SPARK-18478][SQL] Support codegen'd Hive UDFs

2017-01-12 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15928 **[Test build #71259 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/71259/testReport)** for PR 15928 at commit [`d7be870`](https://github.com/apache/spark/commit/d

[GitHub] spark issue #15928: [SPARK-18478][SQL] Support codegen'd Hive UDFs

2017-01-12 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15928 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #15928: [SPARK-18478][SQL] Support codegen'd Hive UDFs

2017-01-12 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15928 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/71259/ Test PASSed. ---

[GitHub] spark issue #15945: [SPARK-12978][SQL] Merge unnecessary partial aggregates

2017-01-12 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15945 **[Test build #71267 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/71267/testReport)** for PR 15945 at commit [`96d0723`](https://github.com/apache/spark/commit/96

[GitHub] spark issue #16213: [SPARK-18020][Streaming][Kinesis] Checkpoint SHARD_END t...

2017-01-12 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16213 **[Test build #71268 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/71268/testReport)** for PR 16213 at commit [`5f0e632`](https://github.com/apache/spark/commit/5f

[GitHub] spark issue #16558: Fix missing close-parens for In filter's toString

2017-01-12 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16558 **[Test build #3526 has started](https://amplab.cs.berkeley.edu/jenkins/job/NewSparkPullRequestBuilder/3526/testReport)** for PR 16558 at commit [`a3d737b`](https://github.com/apache/spark/commit/a

[GitHub] spark issue #16410: [SPARK-19005][SQL] Keep column ordering when a schema is...

2017-01-12 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16410 **[Test build #71269 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/71269/testReport)** for PR 16410 at commit [`a522ea3`](https://github.com/apache/spark/commit/a5

[GitHub] spark issue #16213: [SPARK-18020][Streaming][Kinesis] Checkpoint SHARD_END t...

2017-01-12 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16213 **[Test build #71268 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/71268/testReport)** for PR 16213 at commit [`5f0e632`](https://github.com/apache/spark/commit/5

[GitHub] spark issue #16213: [SPARK-18020][Streaming][Kinesis] Checkpoint SHARD_END t...

2017-01-12 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16213 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #16213: [SPARK-18020][Streaming][Kinesis] Checkpoint SHARD_END t...

2017-01-12 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16213 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/71268/ Test PASSed. ---

[GitHub] spark issue #16213: [SPARK-18020][Streaming][Kinesis] Checkpoint SHARD_END t...

2017-01-12 Thread maropu
Github user maropu commented on the issue: https://github.com/apache/spark/pull/16213 @brkyvz I asked AWS guys and I found correct handling in this case (See: https://forums.aws.amazon.com/thread.jspa?threadID=244218). I fixed in this way and could you check this again? Thanks! ---

[GitHub] spark issue #16550: [SPARK-19178][SQL] convert string of large numbers to in...

2017-01-12 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16550 **[Test build #71261 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/71261/testReport)** for PR 16550 at commit [`beb4fd8`](https://github.com/apache/spark/commit/b

[GitHub] spark issue #16550: [SPARK-19178][SQL] convert string of large numbers to in...

2017-01-12 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16550 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/71261/ Test PASSed. ---

[GitHub] spark issue #16550: [SPARK-19178][SQL] convert string of large numbers to in...

2017-01-12 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16550 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark pull request #16561: [SPARK-18209][SQL] Alias the view with its child ...

2017-01-12 Thread cloud-fan
Github user cloud-fan commented on a diff in the pull request: https://github.com/apache/spark/pull/16561#discussion_r95817334 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/analysis/view.scala --- @@ -29,40 +29,31 @@ import org.apache.spark.sql.catalyst.rules

[GitHub] spark issue #16557: [SPARK-18693][ML][MLLIB][WIP] ML Evaluators should use w...

2017-01-12 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16557 **[Test build #71270 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/71270/testReport)** for PR 16557 at commit [`f6d6fef`](https://github.com/apache/spark/commit/f6

[GitHub] spark pull request #16561: [SPARK-18209][SQL] Alias the view with its child ...

2017-01-12 Thread jiangxb1987
Github user jiangxb1987 commented on a diff in the pull request: https://github.com/apache/spark/pull/16561#discussion_r95823820 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/analysis/view.scala --- @@ -29,40 +29,31 @@ import org.apache.spark.sql.catalyst.rul

[GitHub] spark pull request #16563: [SPARK-17568][CORE][DEPLOY] Add spark-submit opti...

2017-01-12 Thread themodernlife
GitHub user themodernlife opened a pull request: https://github.com/apache/spark/pull/16563 [SPARK-17568][CORE][DEPLOY] Add spark-submit option to override ivy settings used to resolve packages/artifacts Backports #15119 to the 2.1 branch. Is it possible to include this in Spark

[GitHub] spark pull request #16561: [SPARK-18209][SQL] Alias the view with its child ...

2017-01-12 Thread jiangxb1987
Github user jiangxb1987 commented on a diff in the pull request: https://github.com/apache/spark/pull/16561#discussion_r95826222 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/analysis/view.scala --- @@ -29,40 +29,31 @@ import org.apache.spark.sql.catalyst.rul

[GitHub] spark issue #16563: [SPARK-17568][CORE][DEPLOY] Add spark-submit option to o...

2017-01-12 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16563 Can one of the admins verify this patch? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feat

[GitHub] spark issue #16547: [SPARK-19168][Structured Streaming] Improvement: filter ...

2017-01-12 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16547 **[Test build #71266 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/71266/testReport)** for PR 16547 at commit [`07a020e`](https://github.com/apache/spark/commit/0

[GitHub] spark issue #16547: [SPARK-19168][Structured Streaming] Improvement: filter ...

2017-01-12 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16547 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #16547: [SPARK-19168][Structured Streaming] Improvement: filter ...

2017-01-12 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16547 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/71266/ Test PASSed. ---

[GitHub] spark issue #16440: [SPARK-18857][SQL] Don't use `Iterator.duplicate` for `i...

2017-01-12 Thread dongjoon-hyun
Github user dongjoon-hyun commented on the issue: https://github.com/apache/spark/pull/16440 Thank you so much, @srowen ! --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled

[GitHub] spark issue #16410: [SPARK-19005][SQL] Keep column ordering when a schema is...

2017-01-12 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16410 **[Test build #71269 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/71269/testReport)** for PR 16410 at commit [`a522ea3`](https://github.com/apache/spark/commit/a

[GitHub] spark issue #16410: [SPARK-19005][SQL] Keep column ordering when a schema is...

2017-01-12 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16410 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/71269/ Test FAILed. ---

[GitHub] spark issue #16410: [SPARK-19005][SQL] Keep column ordering when a schema is...

2017-01-12 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16410 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #14702: [SPARK-15694] Implement ScriptTransformation in sql/core...

2017-01-12 Thread tejasapatil
Github user tejasapatil commented on the issue: https://github.com/apache/spark/pull/14702 can anyone please review this PR ? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enab

[GitHub] spark issue #15945: [SPARK-12978][SQL] Merge unnecessary partial aggregates

2017-01-12 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15945 **[Test build #71267 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/71267/testReport)** for PR 15945 at commit [`96d0723`](https://github.com/apache/spark/commit/9

[GitHub] spark issue #15945: [SPARK-12978][SQL] Merge unnecessary partial aggregates

2017-01-12 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15945 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/71267/ Test PASSed. ---

[GitHub] spark issue #15945: [SPARK-12978][SQL] Merge unnecessary partial aggregates

2017-01-12 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15945 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #16558: Fix missing close-parens for In filter's toString

2017-01-12 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16558 **[Test build #3526 has finished](https://amplab.cs.berkeley.edu/jenkins/job/NewSparkPullRequestBuilder/3526/testReport)** for PR 16558 at commit [`a3d737b`](https://github.com/apache/spark/commit/

[GitHub] spark issue #15018: [SPARK-17455][MLlib] Improve PAVA implementation in Isot...

2017-01-12 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15018 **[Test build #71271 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/71271/testReport)** for PR 15018 at commit [`132d6a6`](https://github.com/apache/spark/commit/13

[GitHub] spark issue #14812: [SPARK-17237][SQL] Remove backticks in a pivot result sc...

2017-01-12 Thread gatorsmile
Github user gatorsmile commented on the issue: https://github.com/apache/spark/pull/14812 LGTM --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the fe

[GitHub] spark issue #16513: [SPARK-12757][CORE] lower "block locks were not released...

2017-01-12 Thread felixcheung
Github user felixcheung commented on the issue: https://github.com/apache/spark/pull/16513 merged to master. thanks! --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and w

[GitHub] spark pull request #16513: [SPARK-12757][CORE] lower "block locks were not r...

2017-01-12 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/16513 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is ena

[GitHub] spark issue #14812: [SPARK-17237][SQL] Remove backticks in a pivot result sc...

2017-01-12 Thread gatorsmile
Github user gatorsmile commented on the issue: https://github.com/apache/spark/pull/14812 Thanks! Merging to master/2.1. Could you please open a PR to backport it to 2.0? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub

[GitHub] spark pull request #14812: [SPARK-17237][SQL] Remove backticks in a pivot re...

2017-01-12 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/14812 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is ena

[GitHub] spark issue #14812: [SPARK-17237][SQL] Remove backticks in a pivot result sc...

2017-01-12 Thread gatorsmile
Github user gatorsmile commented on the issue: https://github.com/apache/spark/pull/14812 @maropu JIRA is down. Will update the JIRA later. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have th

[GitHub] spark pull request #16516: [SPARK-19155][ML] Make some string params of ML a...

2017-01-12 Thread imatiach-msft
Github user imatiach-msft commented on a diff in the pull request: https://github.com/apache/spark/pull/16516#discussion_r95846332 --- Diff: mllib/src/main/scala/org/apache/spark/ml/classification/LogisticRegression.scala --- @@ -91,8 +91,8 @@ private[classification] trait Logisti

[GitHub] spark pull request #16516: [SPARK-19155][ML] Make some string params of ML a...

2017-01-12 Thread imatiach-msft
Github user imatiach-msft commented on a diff in the pull request: https://github.com/apache/spark/pull/16516#discussion_r95846429 --- Diff: mllib/src/main/scala/org/apache/spark/ml/classification/LogisticRegression.scala --- @@ -91,8 +91,8 @@ private[classification] trait Logisti

[GitHub] spark pull request #16454: [SPARK-19055][SQL][PySpark] Fix SparkSession init...

2017-01-12 Thread rdblue
Github user rdblue commented on a diff in the pull request: https://github.com/apache/spark/pull/16454#discussion_r95846835 --- Diff: python/pyspark/sql/session.py --- @@ -214,8 +214,12 @@ def __init__(self, sparkContext, jsparkSession=None): self._wrapped = SQLContext(

[GitHub] spark pull request #16454: [SPARK-19055][SQL][PySpark] Fix SparkSession init...

2017-01-12 Thread rdblue
Github user rdblue commented on a diff in the pull request: https://github.com/apache/spark/pull/16454#discussion_r95846995 --- Diff: python/pyspark/sql/session.py --- @@ -161,8 +161,8 @@ def getOrCreate(self): with self._lock: from pyspark.cont

[GitHub] spark issue #16557: [SPARK-18693][ML][MLLIB][WIP] ML Evaluators should use w...

2017-01-12 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16557 **[Test build #71270 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/71270/testReport)** for PR 16557 at commit [`f6d6fef`](https://github.com/apache/spark/commit/f

[GitHub] spark issue #16557: [SPARK-18693][ML][MLLIB][WIP] ML Evaluators should use w...

2017-01-12 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16557 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/71270/ Test FAILed. ---

[GitHub] spark issue #16557: [SPARK-18693][ML][MLLIB][WIP] ML Evaluators should use w...

2017-01-12 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16557 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark pull request #16516: [SPARK-19155][ML] Make some string params of ML a...

2017-01-12 Thread imatiach-msft
Github user imatiach-msft commented on a diff in the pull request: https://github.com/apache/spark/pull/16516#discussion_r95848454 --- Diff: mllib/src/main/scala/org/apache/spark/ml/classification/LogisticRegression.scala --- @@ -91,8 +91,8 @@ private[classification] trait Logisti

[GitHub] spark issue #16516: [SPARK-19155][ML] Make some string params of ML algorith...

2017-01-12 Thread imatiach-msft
Github user imatiach-msft commented on the issue: https://github.com/apache/spark/pull/16516 It looks like you can also update the metric name in the evaluators (binary, regression, multiclass) as well. Those should be case-insensitive too, I think. --- If your project is set up fo

[GitHub] spark issue #14719: [SPARK-17154][SQL] Wrong result can be returned or Analy...

2017-01-12 Thread nsyca
Github user nsyca commented on the issue: https://github.com/apache/spark/pull/14719 @sarutak would your code be able to solve this ambiguity of df("a") in the join condition? val df = Seq((1,0), (2,1)).toDF("a","b") val df1 = df.filter(df("b") > 0) val result

[GitHub] spark pull request #16550: [SPARK-19178][SQL] convert string of large number...

2017-01-12 Thread gatorsmile
Github user gatorsmile commented on a diff in the pull request: https://github.com/apache/spark/pull/16550#discussion_r95850028 --- Diff: common/unsafe/src/main/java/org/apache/spark/unsafe/types/UTF8String.java --- @@ -835,6 +835,187 @@ public UTF8String translate(Map dict) {

[GitHub] spark issue #16557: [SPARK-18693][ML][MLLIB][WIP] ML Evaluators should use w...

2017-01-12 Thread imatiach-msft
Github user imatiach-msft commented on the issue: https://github.com/apache/spark/pull/16557 it looks like a random test timed out: org.apache.spark.scheduler.BasicSchedulerIntegrationSuite.job with fetch failure Error Details java.util.concurrent.TimeoutException: Futures

[GitHub] spark issue #16557: [SPARK-18693][ML][MLLIB][WIP] ML Evaluators should use w...

2017-01-12 Thread imatiach-msft
Github user imatiach-msft commented on the issue: https://github.com/apache/spark/pull/16557 Jenkins retest this please --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled an

[GitHub] spark pull request #16550: [SPARK-19178][SQL] convert string of large number...

2017-01-12 Thread gatorsmile
Github user gatorsmile commented on a diff in the pull request: https://github.com/apache/spark/pull/16550#discussion_r95850133 --- Diff: sql/core/src/test/resources/sql-tests/inputs/cast.sql --- @@ -0,0 +1,43 @@ +-- cast string representing a valid fractional number to integral

[GitHub] spark issue #16557: [SPARK-18693][ML][MLLIB][WIP] ML Evaluators should use w...

2017-01-12 Thread imatiach-msft
Github user imatiach-msft commented on the issue: https://github.com/apache/spark/pull/16557 Jenkins, retest this please --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled a

[GitHub] spark issue #16550: [SPARK-19178][SQL] convert string of large numbers to in...

2017-01-12 Thread gatorsmile
Github user gatorsmile commented on the issue: https://github.com/apache/spark/pull/16550 LGTM, after re-checking the corresponding Hive code and change history --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your proj

[GitHub] spark issue #16557: [SPARK-18693][ML][MLLIB][WIP] ML Evaluators should use w...

2017-01-12 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16557 **[Test build #71272 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/71272/testReport)** for PR 16557 at commit [`f6d6fef`](https://github.com/apache/spark/commit/f6

[GitHub] spark issue #16549: [SPARK-19151][SQL]DataFrameWriter.saveAsTable support hi...

2017-01-12 Thread gatorsmile
Github user gatorsmile commented on the issue: https://github.com/apache/spark/pull/16549 : ) It could be caused by the latest merge of https://github.com/apache/spark/pull/16233 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as

[GitHub] spark issue #16563: [SPARK-17568][CORE][DEPLOY] Add spark-submit option to o...

2017-01-12 Thread vanzin
Github user vanzin commented on the issue: https://github.com/apache/spark/pull/16563 We don't usually backport features to maintenance releases. It'd be sort of ok if this were more trivial than it is, so I don't think this is a good idea. --- If your project is set up for it, you c

[GitHub] spark issue #16549: [SPARK-19151][SQL]DataFrameWriter.saveAsTable support hi...

2017-01-12 Thread gatorsmile
Github user gatorsmile commented on the issue: https://github.com/apache/spark/pull/16549 Let us know if you are unable to figure it out. BTW, you should update the `hashCode` function too, like what you did in `equals`. --- If your project is set up for it, you can reply t

[GitHub] spark issue #15018: [SPARK-17455][MLlib] Improve PAVA implementation in Isot...

2017-01-12 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15018 **[Test build #71271 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/71271/testReport)** for PR 15018 at commit [`132d6a6`](https://github.com/apache/spark/commit/1

[GitHub] spark issue #15018: [SPARK-17455][MLlib] Improve PAVA implementation in Isot...

2017-01-12 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15018 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #15018: [SPARK-17455][MLlib] Improve PAVA implementation in Isot...

2017-01-12 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15018 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/71271/ Test PASSed. ---

[GitHub] spark issue #16523: [SPARK-19142][SparkR]:spark.kmeans should take seed, ini...

2017-01-12 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16523 **[Test build #71273 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/71273/testReport)** for PR 16523 at commit [`1c27df4`](https://github.com/apache/spark/commit/1c

[GitHub] spark issue #16503: [SPARK-18113] Use ask to replace askWithRetry in canComm...

2017-01-12 Thread vanzin
Github user vanzin commented on the issue: https://github.com/apache/spark/pull/16503 ok to test --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the

[GitHub] spark pull request #12064: [SPARK-14272][ML] Evaluate GaussianMixtureModel w...

2017-01-12 Thread jkbradley
Github user jkbradley commented on a diff in the pull request: https://github.com/apache/spark/pull/12064#discussion_r95858775 --- Diff: mllib/src/main/scala/org/apache/spark/ml/clustering/GaussianMixture.scala --- @@ -130,6 +130,25 @@ class GaussianMixtureModel private[ml] (

[GitHub] spark issue #16556: [SPARK-19184][MLlib] Improve numerical stability for met...

2017-01-12 Thread hl475
Github user hl475 commented on the issue: https://github.com/apache/spark/pull/16556 @srowen: We don’t use LAPACK here since there is no pivoted QR in LAPACK that stops when the rank is exhausted. This is highlighted in the inline comments [563 to 565](https://github.com/apache/spa

[GitHub] spark issue #16503: [SPARK-18113] Use ask to replace askWithRetry in canComm...

2017-01-12 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16503 **[Test build #71274 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/71274/testReport)** for PR 16503 at commit [`6c25755`](https://github.com/apache/spark/commit/6c

[GitHub] spark pull request #16516: [SPARK-19155][ML] Make some string params of ML a...

2017-01-12 Thread jkbradley
Github user jkbradley commented on a diff in the pull request: https://github.com/apache/spark/pull/16516#discussion_r95858814 --- Diff: mllib/src/main/scala/org/apache/spark/ml/classification/LogisticRegression.scala --- @@ -365,7 +365,7 @@ class LogisticRegression @Since("1.2.0"

[GitHub] spark issue #16415: [SPARK-19063][ML]Speedup and optimize the GradientBooste...

2017-01-12 Thread jkbradley
Github user jkbradley commented on the issue: https://github.com/apache/spark/pull/16415 Thanks for the update. By "specify the storage level via a Param," I meant a public ```Param``` type in the the GBT API. Can you please check out other Params for examples and update this?

[GitHub] spark issue #16503: [SPARK-18113] Use ask to replace askWithRetry in canComm...

2017-01-12 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16503 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #16503: [SPARK-18113] Use ask to replace askWithRetry in canComm...

2017-01-12 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16503 **[Test build #71274 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/71274/testReport)** for PR 16503 at commit [`6c25755`](https://github.com/apache/spark/commit/6

[GitHub] spark issue #16503: [SPARK-18113] Use ask to replace askWithRetry in canComm...

2017-01-12 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16503 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/71274/ Test FAILed. ---

[GitHub] spark pull request #16564: [SPARK-19065][SS]Rewrite Alias in StreamExecution...

2017-01-12 Thread zsxwing
GitHub user zsxwing opened a pull request: https://github.com/apache/spark/pull/16564 [SPARK-19065][SS]Rewrite Alias in StreamExecution if necessary ## What changes were proposed in this pull request? `dropDuplicates` will create an Alias using the same exprId, so `StreamEx

[GitHub] spark issue #16534: [SPARK-19161][PYTHON][SQL] Improving UDF Docstrings

2017-01-12 Thread holdenk
Github user holdenk commented on the issue: https://github.com/apache/spark/pull/16534 Improving UDF Docstrings for Python seems like a good idea, but at the cost of breaking the public API in a point release I think it might make sense for us to do the more work approach unless there

[GitHub] spark issue #16564: [SPARK-19065][SS]Rewrite Alias in StreamExecution if nec...

2017-01-12 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16564 **[Test build #71275 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/71275/testReport)** for PR 16564 at commit [`13f54a9`](https://github.com/apache/spark/commit/13

[GitHub] spark issue #16564: [SPARK-19065][SS]Rewrite Alias in StreamExecution if nec...

2017-01-12 Thread zsxwing
Github user zsxwing commented on the issue: https://github.com/apache/spark/pull/16564 cc @marmbrus @liancheng There may be similar issues in other SQL codes. Maybe we should revert #15427? --- If your project is set up for it, you can reply to this email and have your repl

[GitHub] spark issue #16503: [SPARK-18113] Use ask to replace askWithRetry in canComm...

2017-01-12 Thread ash211
Github user ash211 commented on the issue: https://github.com/apache/spark/pull/16503 @jinxing64 can you please fix the failing Scala style tests? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not h

[GitHub] spark pull request #16542: [SPARK-18905][STREAMING] Fix the issue of removin...

2017-01-12 Thread zsxwing
Github user zsxwing commented on a diff in the pull request: https://github.com/apache/spark/pull/16542#discussion_r95864979 --- Diff: streaming/src/main/scala/org/apache/spark/streaming/scheduler/JobScheduler.scala --- @@ -200,19 +200,19 @@ class JobScheduler(val ssc: StreamingCo

[GitHub] spark pull request #16512: [SPARK-18335][SPARKR] createDataFrame to support ...

2017-01-12 Thread shivaram
Github user shivaram commented on a diff in the pull request: https://github.com/apache/spark/pull/16512#discussion_r95865135 --- Diff: R/pkg/inst/tests/testthat/test_sparkSQL.R --- @@ -196,6 +196,12 @@ test_that("create DataFrame from RDD", { expect_equal(dtypes(df), list(c(

[GitHub] spark issue #16523: [SPARK-19142][SparkR]:spark.kmeans should take seed, ini...

2017-01-12 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16523 **[Test build #71273 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/71273/testReport)** for PR 16523 at commit [`1c27df4`](https://github.com/apache/spark/commit/1

<    1   2   3   4   5   >