[GitHub] spark issue #16561: [SPARK-18209][SQL] Alias the view with its child by mapp...

2017-01-12 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16561 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/71255/ Test PASSed. ---

[GitHub] spark issue #16561: [SPARK-18209][SQL] Alias the view with its child by mapp...

2017-01-12 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16561 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #16561: [SPARK-18209][SQL] Alias the view with its child by mapp...

2017-01-12 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16561 **[Test build #71255 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/71255/testReport)** for PR 16561 at commit [`0e82340`](https://github.com/apache/spark/commit/0

[GitHub] spark issue #16119: [SPARK-18687][Pyspark][SQL]Backward compatibility - crea...

2017-01-12 Thread viirya
Github user viirya commented on the issue: https://github.com/apache/spark/pull/16119 @vijoshi Can you solve the conflict? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled

[GitHub] spark issue #16549: [SPARK-19151][SQL]DataFrameWriter.saveAsTable support hi...

2017-01-12 Thread windpiger
Github user windpiger commented on the issue: https://github.com/apache/spark/pull/16549 thanks, I will keep track of this after hive and datasource unified . https://github.com/apache/spark/pull/16549/files#r95670788 --- If your project is set up for it, you can reply to this ema

[GitHub] spark issue #15945: [SPARK-12978][SQL] Merge unnecessary partial aggregates

2017-01-12 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15945 **[Test build #71264 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/71264/consoleFull)** for PR 15945 at commit [`6bd225f`](https://github.com/apache/spark/commit/

[GitHub] spark issue #15945: [SPARK-12978][SQL] Merge unnecessary partial aggregates

2017-01-12 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15945 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/71264/ Test FAILed. ---

[GitHub] spark issue #15945: [SPARK-12978][SQL] Merge unnecessary partial aggregates

2017-01-12 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15945 Build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled

[GitHub] spark issue #15945: [SPARK-12978][SQL] Merge unnecessary partial aggregates

2017-01-12 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15945 **[Test build #71264 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/71264/consoleFull)** for PR 15945 at commit [`6bd225f`](https://github.com/apache/spark/commit/6

[GitHub] spark issue #16549: [SPARK-19151][SQL]DataFrameWriter.saveAsTable support hi...

2017-01-12 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16549 **[Test build #71258 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/71258/testReport)** for PR 16549 at commit [`569a58f`](https://github.com/apache/spark/commit/5

[GitHub] spark issue #16549: [SPARK-19151][SQL]DataFrameWriter.saveAsTable support hi...

2017-01-12 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16549 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/71258/ Test FAILed. ---

[GitHub] spark issue #16549: [SPARK-19151][SQL]DataFrameWriter.saveAsTable support hi...

2017-01-12 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16549 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark pull request #16523: [SPARK-19142][SparkR]:spark.kmeans should take se...

2017-01-12 Thread yanboliang
Github user yanboliang commented on a diff in the pull request: https://github.com/apache/spark/pull/16523#discussion_r95790319 --- Diff: R/pkg/inst/tests/testthat/test_mllib_clustering.R --- @@ -132,6 +132,26 @@ test_that("spark.kmeans", { expect_true(summary2$is.loaded)

[GitHub] spark issue #16562: Document local[*,F] master modes

2017-01-12 Thread srowen
Github user srowen commented on the issue: https://github.com/apache/spark/pull/16562 This functionality is so obscure I'd suspect it should be deprecated. Does anyone have a thought about that? In any event, it's fair enough to document it. --- If your project is set up for

[GitHub] spark issue #16213: [SPARK-18020][Streaming][Kinesis] Checkpoint SHARD_END t...

2017-01-12 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16213 **[Test build #71263 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/71263/testReport)** for PR 16213 at commit [`7f8336c`](https://github.com/apache/spark/commit/7f

[GitHub] spark issue #16562: Document local[*,F] master modes

2017-01-12 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16562 Can one of the admins verify this patch? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feat

[GitHub] spark pull request #16562: Document local[*,F] master modes

2017-01-12 Thread mcuelenaere
GitHub user mcuelenaere opened a pull request: https://github.com/apache/spark/pull/16562 Document local[*,F] master modes ## What changes were proposed in this pull request? core/src/main/scala/org/apache/spark/SparkContext.scala contains LOCAL_N_FAILURES_REGEX master mode

[GitHub] spark issue #15945: [SPARK-12978][SQL] Merge unnecessary partial aggregates

2017-01-12 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15945 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #15945: [SPARK-12978][SQL] Merge unnecessary partial aggregates

2017-01-12 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15945 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/71262/ Test FAILed. ---

[GitHub] spark issue #15945: [SPARK-12978][SQL] Merge unnecessary partial aggregates

2017-01-12 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15945 **[Test build #71262 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/71262/testReport)** for PR 15945 at commit [`da25be6`](https://github.com/apache/spark/commit/d

[GitHub] spark issue #16213: [SPARK-18020][Streaming][Kinesis] Checkpoint SHARD_END t...

2017-01-12 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16213 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/71260/ Test FAILed. ---

[GitHub] spark issue #16213: [SPARK-18020][Streaming][Kinesis] Checkpoint SHARD_END t...

2017-01-12 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16213 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #16213: [SPARK-18020][Streaming][Kinesis] Checkpoint SHARD_END t...

2017-01-12 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16213 **[Test build #71260 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/71260/testReport)** for PR 16213 at commit [`1b89a0a`](https://github.com/apache/spark/commit/1

[GitHub] spark issue #15945: [SPARK-12978][SQL] Merge unnecessary partial aggregates

2017-01-12 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15945 **[Test build #71262 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/71262/testReport)** for PR 15945 at commit [`da25be6`](https://github.com/apache/spark/commit/da

[GitHub] spark issue #16119: [SPARK-18687][Pyspark][SQL]Backward compatibility - crea...

2017-01-12 Thread cloud-fan
Github user cloud-fan commented on the issue: https://github.com/apache/spark/pull/16119 https://github.com/apache/spark/pull/16454 has been merged --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request #16454: [SPARK-19055][SQL][PySpark] Fix SparkSession init...

2017-01-12 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/16454 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is ena

[GitHub] spark issue #16454: [SPARK-19055][SQL][PySpark] Fix SparkSession initializat...

2017-01-12 Thread cloud-fan
Github user cloud-fan commented on the issue: https://github.com/apache/spark/pull/16454 thanks, merging to maser/2.1/2.0 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled

[GitHub] spark pull request #15945: [SPARK-12978][SQL] Merge unnecessary partial aggr...

2017-01-12 Thread maropu
Github user maropu commented on a diff in the pull request: https://github.com/apache/spark/pull/15945#discussion_r95782977 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/QueryExecution.scala --- @@ -90,18 +92,27 @@ class QueryExecution(val sparkSession: SparkSess

[GitHub] spark issue #12574: [SPARK-13857][ML][WIP] Add "recommend all" functionality...

2017-01-12 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/12574 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #12574: [SPARK-13857][ML][WIP] Add "recommend all" functionality...

2017-01-12 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/12574 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/71257/ Test PASSed. ---

[GitHub] spark issue #12574: [SPARK-13857][ML][WIP] Add "recommend all" functionality...

2017-01-12 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/12574 **[Test build #71257 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/71257/testReport)** for PR 12574 at commit [`32fde78`](https://github.com/apache/spark/commit/3

[GitHub] spark pull request #15945: [SPARK-12978][SQL] Merge unnecessary partial aggr...

2017-01-12 Thread cloud-fan
Github user cloud-fan commented on a diff in the pull request: https://github.com/apache/spark/pull/15945#discussion_r95782620 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/QueryExecution.scala --- @@ -90,18 +92,27 @@ class QueryExecution(val sparkSession: SparkS

[GitHub] spark issue #16550: [SPARK-19178][SQL] convert string of large numbers to in...

2017-01-12 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16550 **[Test build #71261 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/71261/testReport)** for PR 16550 at commit [`beb4fd8`](https://github.com/apache/spark/commit/be

[GitHub] spark issue #16549: [SPARK-19151][SQL]DataFrameWriter.saveAsTable support hi...

2017-01-12 Thread cloud-fan
Github user cloud-fan commented on the issue: https://github.com/apache/spark/pull/16549 LGTM except https://github.com/apache/spark/pull/16549/files#r95670788 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your proje

[GitHub] spark issue #16550: [SPARK-19178][SQL] convert string of large numbers to in...

2017-01-12 Thread cloud-fan
Github user cloud-fan commented on the issue: https://github.com/apache/spark/pull/16550 retest this please --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so,

[GitHub] spark issue #16213: [SPARK-18020][Streaming][Kinesis] Checkpoint SHARD_END t...

2017-01-12 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16213 **[Test build #71260 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/71260/testReport)** for PR 16213 at commit [`1b89a0a`](https://github.com/apache/spark/commit/1b

[GitHub] spark issue #16560: [SPARK-19179][YARN] Change spark.yarn.access.namenodes c...

2017-01-12 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16560 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/71252/ Test PASSed. ---

[GitHub] spark issue #16560: [SPARK-19179][YARN] Change spark.yarn.access.namenodes c...

2017-01-12 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16560 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #15018: [SPARK-17455][MLlib] Improve PAVA implementation in Isot...

2017-01-12 Thread viirya
Github user viirya commented on the issue: https://github.com/apache/spark/pull/15018 LGTM --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the featur

[GitHub] spark issue #16560: [SPARK-19179][YARN] Change spark.yarn.access.namenodes c...

2017-01-12 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16560 **[Test build #71252 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/71252/testReport)** for PR 16560 at commit [`d2c651c`](https://github.com/apache/spark/commit/d

[GitHub] spark pull request #16404: [SPARK-18969][SQL] Support grouping by nondetermi...

2017-01-12 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/16404 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is ena

[GitHub] spark pull request #16379: [SPARK-18969][SQL] Support grouping by nondetermi...

2017-01-12 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/16379 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is ena

[GitHub] spark issue #16404: [SPARK-18969][SQL] Support grouping by nondeterministic ...

2017-01-12 Thread cloud-fan
Github user cloud-fan commented on the issue: https://github.com/apache/spark/pull/16404 updated. Merging to master! --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and w

[GitHub] spark issue #16533: [SPARK-19160][PYTHON][SQL][WIP] Add udf decorator

2017-01-12 Thread zero323
Github user zero323 commented on the issue: https://github.com/apache/spark/pull/16533 @rdblue Unified `udf` which supports all cases (`udf(f)`, decorator with parentheses and without, decorator with `returnType`) could be implemented like this: ```python def _udf(f, re

[GitHub] spark issue #15945: [SPARK-12978][SQL] Merge unnecessary partial aggregates

2017-01-12 Thread maropu
Github user maropu commented on the issue: https://github.com/apache/spark/pull/15945 @hvanhovell @cloud-fan Could you check this? Thanks! --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this

[GitHub] spark issue #15928: [SPARK-18478][SQL] Support codegen'd Hive UDFs

2017-01-12 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15928 **[Test build #71259 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/71259/testReport)** for PR 15928 at commit [`d7be870`](https://github.com/apache/spark/commit/d7

[GitHub] spark pull request #16474: [SPARK-19082][SQL] Make ignoreCorruptFiles work f...

2017-01-12 Thread cloud-fan
Github user cloud-fan commented on a diff in the pull request: https://github.com/apache/spark/pull/16474#discussion_r95778417 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/datasources/FileScanRDD.scala --- @@ -135,11 +135,21 @@ class FileScanRDD(

[GitHub] spark issue #16549: [SPARK-19151][SQL]DataFrameWriter.saveAsTable support hi...

2017-01-12 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16549 **[Test build #71258 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/71258/testReport)** for PR 16549 at commit [`569a58f`](https://github.com/apache/spark/commit/56

[GitHub] spark pull request #16474: [SPARK-19082][SQL] Make ignoreCorruptFiles work f...

2017-01-12 Thread cloud-fan
Github user cloud-fan commented on a diff in the pull request: https://github.com/apache/spark/pull/16474#discussion_r95777107 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/datasources/FileScanRDD.scala --- @@ -135,11 +135,21 @@ class FileScanRDD(

[GitHub] spark pull request #16474: [SPARK-19082][SQL] Make ignoreCorruptFiles work f...

2017-01-12 Thread cloud-fan
Github user cloud-fan commented on a diff in the pull request: https://github.com/apache/spark/pull/16474#discussion_r95777029 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/datasources/FileScanRDD.scala --- @@ -135,11 +135,21 @@ class FileScanRDD(

[GitHub] spark pull request #15018: [SPARK-17455][MLlib] Improve PAVA implementation ...

2017-01-12 Thread viirya
Github user viirya commented on a diff in the pull request: https://github.com/apache/spark/pull/15018#discussion_r95775162 --- Diff: mllib/src/main/scala/org/apache/spark/mllib/regression/IsotonicRegression.scala --- @@ -312,10 +313,19 @@ class IsotonicRegression private (private

[GitHub] spark issue #12004: [SPARK-7481] [build] Add spark-cloud module to pull in o...

2017-01-12 Thread steveloughran
Github user steveloughran commented on the issue: https://github.com/apache/spark/pull/12004 this patch is ready for review. Anyone? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this featu

[GitHub] spark issue #12574: [SPARK-13857][ML][WIP] Add "recommend all" functionality...

2017-01-12 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/12574 **[Test build #71257 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/71257/testReport)** for PR 12574 at commit [`32fde78`](https://github.com/apache/spark/commit/32

[GitHub] spark issue #14812: [SPARK-17237][SQL] Remove backticks in a pivot result sc...

2017-01-12 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14812 **[Test build #71256 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/71256/testReport)** for PR 14812 at commit [`2e567cc`](https://github.com/apache/spark/commit/2e

[GitHub] spark issue #16440: [SPARK-18857][SQL] Don't use `Iterator.duplicate` for `i...

2017-01-12 Thread srowen
Github user srowen commented on the issue: https://github.com/apache/spark/pull/16440 Merged to 2.1/2.0 as well. I agree, it's a clean fix for a non-trivial problem. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If you

[GitHub] spark issue #16527: [SPARK-19146][Core]Drop more elements when stageData.tas...

2017-01-12 Thread srowen
Github user srowen commented on the issue: https://github.com/apache/spark/pull/16527 @wangyum one more though. I note that there are actually three instances in this file where a collection is trimmed to match a max retained number of things. See this quite related change: https://g

[GitHub] spark issue #16536: [SPARK-19163][PYTHON][SQL][WIP] Delay _judf initializati...

2017-01-12 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16536 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #16536: [SPARK-19163][PYTHON][SQL][WIP] Delay _judf initializati...

2017-01-12 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16536 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/71254/ Test PASSed. ---

[GitHub] spark issue #16536: [SPARK-19163][PYTHON][SQL][WIP] Delay _judf initializati...

2017-01-12 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16536 **[Test build #71254 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/71254/testReport)** for PR 16536 at commit [`c936813`](https://github.com/apache/spark/commit/c

[GitHub] spark issue #16561: [SPARK-18209][SQL] Alias the view with its child by mapp...

2017-01-12 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16561 **[Test build #71255 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/71255/testReport)** for PR 16561 at commit [`0e82340`](https://github.com/apache/spark/commit/0e

[GitHub] spark issue #16550: [SPARK-19178][SQL] convert string of large numbers to in...

2017-01-12 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16550 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #16550: [SPARK-19178][SQL] convert string of large numbers to in...

2017-01-12 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16550 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/71250/ Test FAILed. ---

[GitHub] spark issue #16550: [SPARK-19178][SQL] convert string of large numbers to in...

2017-01-12 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16550 **[Test build #71250 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/71250/testReport)** for PR 16550 at commit [`beb4fd8`](https://github.com/apache/spark/commit/b

[GitHub] spark pull request #16561: [SPARK-18209][SQL] Alias the view with its child ...

2017-01-12 Thread jiangxb1987
GitHub user jiangxb1987 opened a pull request: https://github.com/apache/spark/pull/16561 [SPARK-18209][SQL] Alias the view with its child by mapping the columns by index ## What changes were proposed in this pull request? This PR is a follow-up to address the comments htt

[GitHub] spark issue #16555: [SPARK-19180][SQL] the offset of short should be 4 in Of...

2017-01-12 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16555 **[Test build #3525 has finished](https://amplab.cs.berkeley.edu/jenkins/job/NewSparkPullRequestBuilder/3525/testReport)** for PR 16555 at commit [`44388a1`](https://github.com/apache/spark/commit/

[GitHub] spark issue #16503: [SPARK-18113] Use ask to replace askWithRetry in canComm...

2017-01-12 Thread ash211
Github user ash211 commented on the issue: https://github.com/apache/spark/pull/16503 You covered my concerns! I think this will fix some parts of this problem for sure, not sure if it covers every possible case though. --- If your project is set up for it, you can reply to

[GitHub] spark issue #16555: [SPARK-19180][SQL] the offset of short should be 4 in Of...

2017-01-12 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16555 **[Test build #3525 has started](https://amplab.cs.berkeley.edu/jenkins/job/NewSparkPullRequestBuilder/3525/testReport)** for PR 16555 at commit [`44388a1`](https://github.com/apache/spark/commit/4

[GitHub] spark issue #16512: [SPARK-18335][SPARKR] createDataFrame to support numPart...

2017-01-12 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16512 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #16512: [SPARK-18335][SPARKR] createDataFrame to support numPart...

2017-01-12 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16512 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/71253/ Test PASSed. ---

[GitHub] spark issue #16512: [SPARK-18335][SPARKR] createDataFrame to support numPart...

2017-01-12 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16512 **[Test build #71253 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/71253/testReport)** for PR 16512 at commit [`8b722b5`](https://github.com/apache/spark/commit/8

[GitHub] spark issue #16538: [SPARK-19164][PYTHON][SQL] Remove unused UserDefinedFunc...

2017-01-12 Thread zero323
Github user zero323 commented on the issue: https://github.com/apache/spark/pull/16538 Thanks @rxin --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if

[GitHub] spark issue #16536: [SPARK-19163][PYTHON][SQL][WIP] Delay _judf initializati...

2017-01-12 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16536 **[Test build #71254 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/71254/testReport)** for PR 16536 at commit [`c936813`](https://github.com/apache/spark/commit/c9

[GitHub] spark issue #16415: [SPARK-19007][ML]Speedup and optimize the GradientBooste...

2017-01-12 Thread srowen
Github user srowen commented on the issue: https://github.com/apache/spark/pull/16415 If you closed SPARK-19007, please update the title to match the new JIRA @zdh2292390 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well.

[GitHub] spark issue #16558: Fix missing close-parens for In filter's toString

2017-01-12 Thread srowen
Github user srowen commented on the issue: https://github.com/apache/spark/pull/16558 (@ash211 could you standardize the title? if it's a fix-up of SPARK-13671 it should start with `[SPARK-13671]`) --- If your project is set up for it, you can reply to this email and have your reply

[GitHub] spark issue #16556: [SPARK-19184][MLlib] Improve numerical stability for met...

2017-01-12 Thread srowen
Github user srowen commented on the issue: https://github.com/apache/spark/pull/16556 Is there not a library method for this? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enab

[GitHub] spark pull request #16554: [SPARK-19183] [SQL] Add deleteWithJob hook to int...

2017-01-12 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/16554 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is ena

[GitHub] spark issue #16554: [SPARK-19183] [SQL] Add deleteWithJob hook to internal c...

2017-01-12 Thread cloud-fan
Github user cloud-fan commented on the issue: https://github.com/apache/spark/pull/16554 LGTM, merging to master! --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wish

[GitHub] spark issue #16404: [SPARK-18969][SQL] Support grouping by nondeterministic ...

2017-01-12 Thread rxin
Github user rxin commented on the issue: https://github.com/apache/spark/pull/16404 Make sure you update the pull request and jira ticket description before you merge. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If

[GitHub] spark pull request #15505: [SPARK-18890][CORE] Move task serialization from ...

2017-01-12 Thread witgo
Github user witgo commented on a diff in the pull request: https://github.com/apache/spark/pull/15505#discussion_r95753220 --- Diff: core/src/main/scala/org/apache/spark/scheduler/TaskDescription.scala --- @@ -52,7 +55,43 @@ private[spark] class TaskDescription( val addedF

[GitHub] spark issue #16512: [SPARK-18335][SPARKR] createDataFrame to support numPart...

2017-01-12 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16512 **[Test build #71253 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/71253/testReport)** for PR 16512 at commit [`8b722b5`](https://github.com/apache/spark/commit/8b

[GitHub] spark issue #16404: [SPARK-18969][SQL] Support grouping by nondeterministic ...

2017-01-12 Thread rxin
Github user rxin commented on the issue: https://github.com/apache/spark/pull/16404 LGTM on the behavior --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or

[GitHub] spark issue #16560: [SPARK-19179][YARN] Change spark.yarn.access.namenodes c...

2017-01-12 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16560 **[Test build #71252 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/71252/testReport)** for PR 16560 at commit [`d2c651c`](https://github.com/apache/spark/commit/d2

[GitHub] spark pull request #16560: [SPARK-19179][YARN] Change spark.yarn.access.name...

2017-01-12 Thread jerryshao
GitHub user jerryshao opened a pull request: https://github.com/apache/spark/pull/16560 [SPARK-19179][YARN] Change spark.yarn.access.namenodes config and update docs ## What changes were proposed in this pull request? `spark.yarn.access.namenodes` configuration cannot actua

[GitHub] spark issue #16559: [WIP] Add expression index and test cases

2017-01-12 Thread rxin
Github user rxin commented on the issue: https://github.com/apache/spark/pull/16559 Do we not have something similar already? cc @cloud-fan --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have th

[GitHub] spark issue #16503: [SPARK-18113] Use ask to replace askWithRetry in canComm...

2017-01-12 Thread jinxing64
Github user jinxing64 commented on the issue: https://github.com/apache/spark/pull/16503 @ash211 Thank you so much for your comment. I've changed accordingly. Could you please give another look? --- If your project is set up for it, you can reply to this email and have your r

[GitHub] spark pull request #16538: [SPARK-19164][PYTHON][SQL] Remove unused UserDefi...

2017-01-12 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/16538 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is ena

[GitHub] spark issue #16538: [SPARK-19164][PYTHON][SQL] Remove unused UserDefinedFunc...

2017-01-12 Thread rxin
Github user rxin commented on the issue: https://github.com/apache/spark/pull/16538 Thanks - merging in master. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishe

[GitHub] spark issue #16454: [SPARK-19055][SQL][PySpark] Fix SparkSession initializat...

2017-01-12 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16454 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #16454: [SPARK-19055][SQL][PySpark] Fix SparkSession initializat...

2017-01-12 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16454 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/71251/ Test PASSed. ---

[GitHub] spark issue #16454: [SPARK-19055][SQL][PySpark] Fix SparkSession initializat...

2017-01-12 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16454 **[Test build #71251 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/71251/testReport)** for PR 16454 at commit [`6078c7d`](https://github.com/apache/spark/commit/6

[GitHub] spark pull request #16548: [SPARK-19158][SPARKR][EXAMPLES] Fix ml.R example ...

2017-01-12 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/16548 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is ena

[GitHub] spark issue #16548: [SPARK-19158][SPARKR][EXAMPLES] Fix ml.R example fails d...

2017-01-12 Thread yanboliang
Github user yanboliang commented on the issue: https://github.com/apache/spark/pull/16548 Merged into master and branch-2.1. Thanks for reviewing. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not h

[GitHub] spark pull request #16516: [SPARK-19155][ML] Make some string params of ML a...

2017-01-12 Thread yanboliang
Github user yanboliang commented on a diff in the pull request: https://github.com/apache/spark/pull/16516#discussion_r95745585 --- Diff: mllib/src/main/scala/org/apache/spark/ml/classification/LogisticRegression.scala --- @@ -91,8 +91,8 @@ private[classification] trait LogisticRe

[GitHub] spark issue #16559: Add expression index and test cases

2017-01-12 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16559 Can one of the admins verify this patch? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feat

[GitHub] spark issue #16404: [SPARK-18969][SQL] Support grouping by nondeterministic ...

2017-01-12 Thread cloud-fan
Github user cloud-fan commented on the issue: https://github.com/apache/spark/pull/16404 also cc @rxin to take a look --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and

[GitHub] spark issue #16559: Add expression index and test cases

2017-01-12 Thread gczsjdy
Github user gczsjdy commented on the issue: https://github.com/apache/spark/pull/16559 cc @chenghao-intel @adrian-wang --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled an

[GitHub] spark pull request #16559: Add expression index and test cases

2017-01-12 Thread gczsjdy
GitHub user gczsjdy opened a pull request: https://github.com/apache/spark/pull/16559 Add expression index and test cases ## What changes were proposed in this pull request? Expression Index returns the value of index n (right) of the array/map (left). To be consistent

[GitHub] spark issue #16454: [SPARK-19055][SQL][PySpark] Fix SparkSession initializat...

2017-01-12 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16454 **[Test build #71251 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/71251/testReport)** for PR 16454 at commit [`6078c7d`](https://github.com/apache/spark/commit/60

[GitHub] spark issue #16454: [SPARK-19055][SQL][PySpark] Fix SparkSession initializat...

2017-01-12 Thread cloud-fan
Github user cloud-fan commented on the issue: https://github.com/apache/spark/pull/16454 LGTM --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the fea

[GitHub] spark issue #16454: [SPARK-19055][SQL][PySpark] Fix SparkSession initializat...

2017-01-12 Thread cloud-fan
Github user cloud-fan commented on the issue: https://github.com/apache/spark/pull/16454 retest this please --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so,

<    1   2   3   4   5   >