[GitHub] spark pull request #18769: [SPARK-21574][SQL] Point out user to set hive con...

2017-08-06 Thread gatorsmile
Github user gatorsmile commented on a diff in the pull request: https://github.com/apache/spark/pull/18769#discussion_r131535017 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/command/SetCommand.scala --- @@ -87,6 +88,13 @@ case class SetCommand(kv:

[GitHub] spark pull request #18769: [SPARK-21574][SQL] Point out user to set hive con...

2017-08-06 Thread gatorsmile
Github user gatorsmile commented on a diff in the pull request: https://github.com/apache/spark/pull/18769#discussion_r131535007 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/command/SetCommand.scala --- @@ -87,6 +88,13 @@ case class SetCommand(kv:

[GitHub] spark pull request #18852: [SPARK-21588][SQL] SQLContext.getConf(key, null) ...

2017-08-06 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/18852 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] spark pull request #18317: [SPARK-21113][CORE] Read ahead input stream to am...

2017-08-06 Thread kiszk
Github user kiszk commented on a diff in the pull request: https://github.com/apache/spark/pull/18317#discussion_r131535514 --- Diff: core/src/main/java/org/apache/spark/io/ReadAheadInputStream.java --- @@ -0,0 +1,288 @@ +/* + * Licensed under the Apache License, Version

[GitHub] spark issue #18847: [SPARK-12717][SPARK-21031][SPARK-21599][SQL][BRANCH-2.2]...

2017-08-06 Thread gatorsmile
Github user gatorsmile commented on the issue: https://github.com/apache/spark/pull/18847 I see. Thanks! --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so,

[GitHub] spark issue #18769: [SPARK-21574][SQL] Point out user to set hive config bef...

2017-08-06 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/18769 **[Test build #80298 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/80298/testReport)** for PR 18769 at commit

[GitHub] spark pull request #18820: [SPARK-14932][SQL] Allow DataFrame.replace() to r...

2017-08-06 Thread HyukjinKwon
Github user HyukjinKwon commented on a diff in the pull request: https://github.com/apache/spark/pull/18820#discussion_r131535416 --- Diff: python/pyspark/sql/dataframe.py --- @@ -1428,9 +1438,9 @@ def all_of_(xs): "to_replace should be a float, int, long,

[GitHub] spark pull request #18820: [SPARK-14932][SQL] Allow DataFrame.replace() to r...

2017-08-06 Thread HyukjinKwon
Github user HyukjinKwon commented on a diff in the pull request: https://github.com/apache/spark/pull/18820#discussion_r131535534 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/DataFrameNaFunctions.scala --- @@ -366,11 +370,15 @@ final class DataFrameNaFunctions

[GitHub] spark pull request #18820: [SPARK-14932][SQL] Allow DataFrame.replace() to r...

2017-08-06 Thread HyukjinKwon
Github user HyukjinKwon commented on a diff in the pull request: https://github.com/apache/spark/pull/18820#discussion_r131535507 --- Diff: sql/core/src/test/scala/org/apache/spark/sql/DataFrameNaFunctionsSuite.scala --- @@ -248,16 +248,16 @@ class DataFrameNaFunctionsSuite

[GitHub] spark issue #18852: [SPARK-21588][SQL] SQLContext.getConf(key, null) should ...

2017-08-06 Thread gatorsmile
Github user gatorsmile commented on the issue: https://github.com/apache/spark/pull/18852 Thanks! Merging to master/2.2/2.1 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #17985: Add "full_outer" name to join types

2017-08-06 Thread gatorsmile
Github user gatorsmile commented on the issue: https://github.com/apache/spark/pull/17985 retest this please --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes

[GitHub] spark issue #18856: [SPARKR][BUILD] AppVeyor change to latest R version

2017-08-06 Thread HyukjinKwon
Github user HyukjinKwon commented on the issue: https://github.com/apache/spark/pull/18856 @felixcheung, actually, should we try to replace `http://rversions.r-pkg.org/r-release` in line 29 to `http://rversions.r-pkg.org/r-release-win`? I referred

[GitHub] spark issue #17985: Add "full_outer" name to join types

2017-08-06 Thread gatorsmile
Github user gatorsmile commented on the issue: https://github.com/apache/spark/pull/17985 test this please --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so,

[GitHub] spark issue #18544: [SPARK-21318][SQL]Improve exception message thrown by `l...

2017-08-06 Thread gatorsmile
Github user gatorsmile commented on the issue: https://github.com/apache/spark/pull/18544 ok to test --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if

[GitHub] spark issue #18544: [SPARK-21318][SQL]Improve exception message thrown by `l...

2017-08-06 Thread gatorsmile
Github user gatorsmile commented on the issue: https://github.com/apache/spark/pull/18544 @stanzhai Could you please add test cases? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this

[GitHub] spark issue #18268: [SPARK-21054] [SQL] Reset Command support reset specific...

2017-08-06 Thread gatorsmile
Github user gatorsmile commented on the issue: https://github.com/apache/spark/pull/18268 ping @ericsahit Could you update your PR with extra changes like https://github.com/apache/spark/pull/18368 ? --- If your project is set up for it, you can reply to this email and have your

[GitHub] spark issue #18769: [SPARK-21574][SQL] Point out user to set hive config bef...

2017-08-06 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/18769 **[Test build #80297 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/80297/testReport)** for PR 18769 at commit

[GitHub] spark pull request #18769: [SPARK-21574][SQL] Point out user to set hive con...

2017-08-06 Thread gatorsmile
Github user gatorsmile commented on a diff in the pull request: https://github.com/apache/spark/pull/18769#discussion_r131535400 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/command/SetCommand.scala --- @@ -88,12 +88,13 @@ case class SetCommand(kv:

[GitHub] spark pull request #18769: [SPARK-21574][SQL] Point out user to set hive con...

2017-08-06 Thread gatorsmile
Github user gatorsmile commented on a diff in the pull request: https://github.com/apache/spark/pull/18769#discussion_r131535384 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/command/SetCommand.scala --- @@ -88,12 +88,13 @@ case class SetCommand(kv:

[GitHub] spark issue #18769: [SPARK-21574][SQL] Point out user to set hive config bef...

2017-08-06 Thread wangyum
Github user wangyum commented on the issue: https://github.com/apache/spark/pull/18769 OK, I will try. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or

[GitHub] spark issue #18769: [SPARK-21574][SQL] Point out user to set hive config bef...

2017-08-06 Thread gatorsmile
Github user gatorsmile commented on the issue: https://github.com/apache/spark/pull/18769 You can refer the description in `https://github.com/apache/spark/tree/master/docs` to build the documentation. Thanks! --- If your project is set up for it, you can reply to this email and

[GitHub] spark pull request #18769: [SPARK-21574][SQL] Point out user to set hive con...

2017-08-06 Thread gatorsmile
Github user gatorsmile commented on a diff in the pull request: https://github.com/apache/spark/pull/18769#discussion_r131535411 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/command/SetCommand.scala --- @@ -88,12 +88,13 @@ case class SetCommand(kv:

[GitHub] spark issue #18857: [SPARK-20963][SQL][FOLLOW-UP] Use UnresolvedSubqueryColu...

2017-08-06 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/18857 **[Test build #80294 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/80294/testReport)** for PR 18857 at commit

[GitHub] spark pull request #18317: [SPARK-21113][CORE] Read ahead input stream to am...

2017-08-06 Thread kiszk
Github user kiszk commented on a diff in the pull request: https://github.com/apache/spark/pull/18317#discussion_r131535496 --- Diff: core/src/main/java/org/apache/spark/io/ReadAheadInputStream.java --- @@ -0,0 +1,279 @@ +/* + * Licensed under the Apache License, Version

[GitHub] spark issue #16766: [SPARK-19426][SQL] Custom coalesce for Dataset

2017-08-06 Thread maropu
Github user maropu commented on the issue: https://github.com/apache/spark/pull/16766 @gatorsmile Sure! I'll do, Thanks! --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled

[GitHub] spark pull request #17357: [SPARK-20025][CORE] Ignore SPARK_LOCAL* env, whil...

2017-08-06 Thread viirya
Github user viirya commented on a diff in the pull request: https://github.com/apache/spark/pull/17357#discussion_r131537192 --- Diff: core/src/main/scala/org/apache/spark/deploy/worker/DriverWrapper.scala --- @@ -38,8 +39,10 @@ object DriverWrapper { */

[GitHub] spark issue #18769: [SPARK-21574][SQL] Point out user to set hive config bef...

2017-08-06 Thread wangyum
Github user wangyum commented on the issue: https://github.com/apache/spark/pull/18769 retest this please --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so,

[GitHub] spark issue #18769: [SPARK-21574][SQL] Point out user to set hive config bef...

2017-08-06 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/18769 **[Test build #80299 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/80299/testReport)** for PR 18769 at commit

[GitHub] spark issue #18769: [SPARK-21574][SQL] Point out user to set hive config bef...

2017-08-06 Thread gatorsmile
Github user gatorsmile commented on the issue: https://github.com/apache/spark/pull/18769 @wangyum Could you help us submit a PR to fix the doc generation in https://spark.apache.org/docs/latest/configuration.html? See many annoying syntax issues.

[GitHub] spark issue #16766: [SPARK-19426][SQL] Custom coalesce for Dataset

2017-08-06 Thread gatorsmile
Github user gatorsmile commented on the issue: https://github.com/apache/spark/pull/16766 cc @maropu Do you want to take this over? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this

[GitHub] spark issue #18544: [SPARK-21318][SQL]Improve exception message thrown by `l...

2017-08-06 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/18544 **[Test build #80295 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/80295/testReport)** for PR 18544 at commit

[GitHub] spark issue #18555: [SPARK-21353][CORE]add checkValue in spark.internal.conf...

2017-08-06 Thread heary-cao
Github user heary-cao commented on the issue: https://github.com/apache/spark/pull/18555 @jiangxb1987 thanks. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and

[GitHub] spark issue #17985: Add "full_outer" name to join types

2017-08-06 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17985 **[Test build #80296 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/80296/testReport)** for PR 17985 at commit

[GitHub] spark issue #18769: [SPARK-21574][SQL] Point out user to set hive config bef...

2017-08-06 Thread gatorsmile
Github user gatorsmile commented on the issue: https://github.com/apache/spark/pull/18769 LGTM pending a few minor comments. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #18857: [SPARK-20963][SQL][FOLLOW-UP] Use UnresolvedSubqueryColu...

2017-08-06 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/18857 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/80294/ Test PASSed. ---

[GitHub] spark issue #18857: [SPARK-20963][SQL][FOLLOW-UP] Use UnresolvedSubqueryColu...

2017-08-06 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/18857 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #17985: Add "full_outer" name to join types

2017-08-06 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17985 **[Test build #80296 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/80296/testReport)** for PR 17985 at commit

[GitHub] spark issue #18544: [SPARK-21318][SQL]Improve exception message thrown by `l...

2017-08-06 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/18544 **[Test build #80295 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/80295/testReport)** for PR 18544 at commit

[GitHub] spark issue #18769: [SPARK-21574][SQL] Point out user to set hive config bef...

2017-08-06 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/18769 **[Test build #80297 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/80297/testReport)** for PR 18769 at commit

[GitHub] spark issue #18769: [SPARK-21574][SQL] Point out user to set hive config bef...

2017-08-06 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/18769 **[Test build #80298 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/80298/testReport)** for PR 18769 at commit

[GitHub] spark issue #18769: [SPARK-21574][SQL] Point out user to set hive config bef...

2017-08-06 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/18769 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #18769: [SPARK-21574][SQL] Point out user to set hive config bef...

2017-08-06 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/18769 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #18544: [SPARK-21318][SQL]Improve exception message thrown by `l...

2017-08-06 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/18544 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #17985: Add "full_outer" name to join types

2017-08-06 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17985 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/80296/ Test FAILed. ---

[GitHub] spark issue #18769: [SPARK-21574][SQL] Point out user to set hive config bef...

2017-08-06 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/18769 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/80297/ Test FAILed. ---

[GitHub] spark issue #18544: [SPARK-21318][SQL]Improve exception message thrown by `l...

2017-08-06 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/18544 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/80295/ Test FAILed. ---

[GitHub] spark issue #18769: [SPARK-21574][SQL] Point out user to set hive config bef...

2017-08-06 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/18769 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/80298/ Test FAILed. ---

[GitHub] spark issue #17985: Add "full_outer" name to join types

2017-08-06 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17985 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark pull request #18858: [MINOR][BUILD] Remove duplicate test-jar:test spa...

2017-08-06 Thread srowen
GitHub user srowen opened a pull request: https://github.com/apache/spark/pull/18858 [MINOR][BUILD] Remove duplicate test-jar:test spark-sql dependency from Hive module ## What changes were proposed in this pull request? Remove duplicate test-jar:test spark-sql dependency

[GitHub] spark issue #18858: [MINOR][BUILD] Remove duplicate test-jar:test spark-sql ...

2017-08-06 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/18858 **[Test build #80300 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/80300/testReport)** for PR 18858 at commit

[GitHub] spark issue #18856: [SPARKR][BUILD] AppVeyor change to latest R version

2017-08-06 Thread HyukjinKwon
Github user HyukjinKwon commented on the issue: https://github.com/apache/spark/pull/18856 Will try to open a separate PR. LGTM. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #18769: [SPARK-21574][SQL] Point out user to set hive config bef...

2017-08-06 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/18769 **[Test build #80299 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/80299/testReport)** for PR 18769 at commit

[GitHub] spark issue #18769: [SPARK-21574][SQL] Point out user to set hive config bef...

2017-08-06 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/18769 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/80299/ Test FAILed. ---

[GitHub] spark issue #18769: [SPARK-21574][SQL] Point out user to set hive config bef...

2017-08-06 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/18769 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark pull request #18856: [SPARKR][BUILD] AppVeyor change to latest R versi...

2017-08-06 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/18856 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] spark pull request #18859: [MINOR][R][BUILD] More reliable detection of R ve...

2017-08-06 Thread HyukjinKwon
GitHub user HyukjinKwon opened a pull request: https://github.com/apache/spark/pull/18859 [MINOR][R][BUILD] More reliable detection of R version for Windows ## What changes were proposed in this pull request? We met a syncing problem with Windows release (see #15709)

[GitHub] spark issue #18859: [MINOR][R][BUILD] More reliable detection of R version f...

2017-08-06 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/18859 **[Test build #80301 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/80301/testReport)** for PR 18859 at commit

[GitHub] spark issue #18859: [MINOR][R][BUILD] More reliable detection of R version f...

2017-08-06 Thread HyukjinKwon
Github user HyukjinKwon commented on the issue: https://github.com/apache/spark/pull/18859 cc @felixcheung, trivial but I believe this should be more correct. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark issue #18856: [SPARKR][BUILD] AppVeyor change to latest R version

2017-08-06 Thread HyukjinKwon
Github user HyukjinKwon commented on the issue: https://github.com/apache/spark/pull/18856 Merged to master. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes

[GitHub] spark issue #18769: [SPARK-21574][SQL] Point out user to set hive config bef...

2017-08-06 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/18769 **[Test build #80302 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/80302/testReport)** for PR 18769 at commit

[GitHub] spark issue #18769: [SPARK-21574][SQL] Point out user to set hive config bef...

2017-08-06 Thread wangyum
Github user wangyum commented on the issue: https://github.com/apache/spark/pull/18769 retest this please --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so,

[GitHub] spark issue #18857: [SPARK-20963][SQL][FOLLOW-UP] Use UnresolvedSubqueryColu...

2017-08-06 Thread maropu
Github user maropu commented on the issue: https://github.com/apache/spark/pull/18857 @gatorsmile ok. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or

[GitHub] spark issue #18858: [MINOR][BUILD] Remove duplicate test-jar:test spark-sql ...

2017-08-06 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/18858 **[Test build #80300 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/80300/testReport)** for PR 18858 at commit

[GitHub] spark issue #18858: [MINOR][BUILD] Remove duplicate test-jar:test spark-sql ...

2017-08-06 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/18858 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #18858: [MINOR][BUILD] Remove duplicate test-jar:test spark-sql ...

2017-08-06 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/18858 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/80300/ Test PASSed. ---

[GitHub] spark pull request #18860: [SPARK-21254] [WebUI] History UI performance fixe...

2017-08-06 Thread 2ooom
GitHub user 2ooom opened a pull request: https://github.com/apache/spark/pull/18860 [SPARK-21254] [WebUI] History UI performance fixes ## This is a backport of PR #18783 to the latest released branch 2.2. ## What changes were proposed in this pull request? As

[GitHub] spark issue #18860: [SPARK-21254] [WebUI] History UI performance fixes

2017-08-06 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/18860 Can one of the admins verify this patch? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this

[GitHub] spark pull request #18859: [MINOR][R][BUILD] More reliable detection of R ve...

2017-08-06 Thread HyukjinKwon
GitHub user HyukjinKwon reopened a pull request: https://github.com/apache/spark/pull/18859 [MINOR][R][BUILD] More reliable detection of R version for Windows in AppVeyor ## What changes were proposed in this pull request? This PR proposes to use

[GitHub] spark pull request #18859: [MINOR][R][BUILD] More reliable detection of R ve...

2017-08-06 Thread HyukjinKwon
Github user HyukjinKwon closed the pull request at: https://github.com/apache/spark/pull/18859 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature

[GitHub] spark issue #18846: [SPARK-21642][CORE] Use FQDN for DRIVER_HOST_ADDRESS ins...

2017-08-06 Thread jiangxb1987
Github user jiangxb1987 commented on the issue: https://github.com/apache/spark/pull/18846 This looks reasonable, cc @cloud-fan --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #18846: [SPARK-21642][CORE] Use FQDN for DRIVER_HOST_ADDRESS ins...

2017-08-06 Thread jiangxb1987
Github user jiangxb1987 commented on the issue: https://github.com/apache/spark/pull/18846 OK to test --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or

[GitHub] spark issue #18856: [SPARKR][BUILD] AppVeyor change to latest R version

2017-08-06 Thread felixcheung
Github user felixcheung commented on the issue: https://github.com/apache/spark/pull/18856 Right, this PR isn't changing how you have made the version to test with sticky - we won't still pick up the latest automatically, which is fine for now. But we should bump (manually)

[GitHub] spark pull request #18855: [SPARK-3151][Block Manager] DiskStore.getBytes fa...

2017-08-06 Thread kiszk
Github user kiszk commented on a diff in the pull request: https://github.com/apache/spark/pull/18855#discussion_r131549141 --- Diff: core/src/main/scala/org/apache/spark/storage/DiskStore.scala --- @@ -165,6 +147,62 @@ private[spark] class DiskStore( }

[GitHub] spark issue #18820: [SPARK-14932][SQL] Allow DataFrame.replace() to replace ...

2017-08-06 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/18820 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #18820: [SPARK-14932][SQL] Allow DataFrame.replace() to replace ...

2017-08-06 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/18820 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/80308/ Test PASSed. ---

[GitHub] spark issue #18820: [SPARK-14932][SQL] Allow DataFrame.replace() to replace ...

2017-08-06 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/18820 **[Test build #80308 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/80308/testReport)** for PR 18820 at commit

[GitHub] spark issue #17985: Add "full_outer" name to join types

2017-08-06 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17985 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/80310/ Test PASSed. ---

[GitHub] spark issue #18576: [SPARK-21351][SQL] Update nullability based on children'...

2017-08-06 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/18576 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/80303/ Test FAILed. ---

[GitHub] spark issue #18576: [SPARK-21351][SQL] Update nullability based on children'...

2017-08-06 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/18576 **[Test build #80304 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/80304/testReport)** for PR 18576 at commit

[GitHub] spark pull request #18801: SPARK-10878 Fix race condition when multiple clie...

2017-08-06 Thread jiangxb1987
Github user jiangxb1987 commented on a diff in the pull request: https://github.com/apache/spark/pull/18801#discussion_r131545611 --- Diff: core/src/main/scala/org/apache/spark/deploy/SparkSubmit.scala --- @@ -1216,7 +1216,36 @@ private[spark] object SparkSubmitUtils {

[GitHub] spark pull request #18801: SPARK-10878 Fix race condition when multiple clie...

2017-08-06 Thread jiangxb1987
Github user jiangxb1987 commented on a diff in the pull request: https://github.com/apache/spark/pull/18801#discussion_r131545882 --- Diff: core/src/test/scala/org/apache/spark/deploy/SparkSubmitUtilsSuite.scala --- @@ -255,4 +256,20 @@ class SparkSubmitUtilsSuite extends

[GitHub] spark issue #18791: [SPARK-21571][Scheduler] Spark history server leaves inc...

2017-08-06 Thread jiangxb1987
Github user jiangxb1987 commented on the issue: https://github.com/apache/spark/pull/18791 QQ: Do we want to default turn on the feature in some future version? If so, what pre-condition in your mind should be fulfilled? Currently we have had too much configurations that default to

[GitHub] spark pull request #18861: [SPARK-19426][SQL] Custom coalescer for Dataset

2017-08-06 Thread maropu
GitHub user maropu opened a pull request: https://github.com/apache/spark/pull/18861 [SPARK-19426][SQL] Custom coalescer for Dataset ## What changes were proposed in this pull request? This pr added a new API for `coalesce` in `Dataset`; users can specify the custom coalescer

[GitHub] spark issue #18820: [SPARK-14932][SQL] Allow DataFrame.replace() to replace ...

2017-08-06 Thread bravo-zhang
Github user bravo-zhang commented on the issue: https://github.com/apache/spark/pull/18820 @HyukjinKwon Thanks for review. Updated to address your comments. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project

[GitHub] spark issue #18820: [SPARK-14932][SQL] Allow DataFrame.replace() to replace ...

2017-08-06 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/18820 **[Test build #80308 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/80308/testReport)** for PR 18820 at commit

[GitHub] spark issue #18862: [MINOR][SQL] added errorifexists on IllegalArgumentExcep...

2017-08-06 Thread mpenate
Github user mpenate commented on the issue: https://github.com/apache/spark/pull/18862 I just knew about the change today and don't want to forget the addition to the exception message. --- If your project is set up for it, you can reply to this email and have your reply appear on

[GitHub] spark issue #18576: [SPARK-21351][SQL] Update nullability based on children'...

2017-08-06 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/18576 **[Test build #80305 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/80305/testReport)** for PR 18576 at commit

[GitHub] spark issue #18860: [SPARK-21254] [WebUI] History UI performance fixes

2017-08-06 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/18860 **[Test build #3880 has finished](https://amplab.cs.berkeley.edu/jenkins/job/NewSparkPullRequestBuilder/3880/testReport)** for PR 18860 at commit

[GitHub] spark issue #18801: SPARK-10878 Fix race condition when multiple clients res...

2017-08-06 Thread jiangxb1987
Github user jiangxb1987 commented on the issue: https://github.com/apache/spark/pull/18801 cc @JoshRosen @cloud-fan --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and

[GitHub] spark issue #18861: [SPARK-19426][SQL] Custom coalescer for Dataset

2017-08-06 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/18861 **[Test build #80306 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/80306/testReport)** for PR 18861 at commit

[GitHub] spark issue #18861: [SPARK-19426][SQL] Custom coalescer for Dataset

2017-08-06 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/18861 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #18576: [SPARK-21351][SQL] Update nullability based on children'...

2017-08-06 Thread maropu
Github user maropu commented on the issue: https://github.com/apache/spark/pull/18576 I'm looking into the failure reason... --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark pull request #18857: [SPARK-20963][SQL][FOLLOW-UP] Use UnresolvedSubqu...

2017-08-06 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/18857 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] spark issue #17985: Add "full_outer" name to join types

2017-08-06 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17985 **[Test build #80310 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/80310/testReport)** for PR 17985 at commit

[GitHub] spark issue #17985: Add "full_outer" name to join types

2017-08-06 Thread gatorsmile
Github user gatorsmile commented on the issue: https://github.com/apache/spark/pull/17985 retest this please --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes

[GitHub] spark issue #18468: [SPARK-20783][SQL] Create CachedBatchColumnVector to abs...

2017-08-06 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/18468 **[Test build #80311 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/80311/testReport)** for PR 18468 at commit

[GitHub] spark pull request #18855: [SPARK-3151][Block Manager] DiskStore.getBytes fa...

2017-08-06 Thread kiszk
Github user kiszk commented on a diff in the pull request: https://github.com/apache/spark/pull/18855#discussion_r131543084 --- Diff: core/src/main/scala/org/apache/spark/storage/DiskStore.scala --- @@ -165,6 +147,62 @@ private[spark] class DiskStore( }

[GitHub] spark issue #18859: [MINOR][R][BUILD] More reliable detection of R version f...

2017-08-06 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/18859 **[Test build #80301 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/80301/testReport)** for PR 18859 at commit

[GitHub] spark pull request #18855: [SPARK-3151][Block Manager] DiskStore.getBytes fa...

2017-08-06 Thread kiszk
Github user kiszk commented on a diff in the pull request: https://github.com/apache/spark/pull/18855#discussion_r131544332 --- Diff: core/src/test/scala/org/apache/spark/storage/DiskStoreSuite.scala --- @@ -92,6 +92,31 @@ class DiskStoreSuite extends SparkFunSuite {

[GitHub] spark pull request #18855: [SPARK-3151][Block Manager] DiskStore.getBytes fa...

2017-08-06 Thread kiszk
Github user kiszk commented on a diff in the pull request: https://github.com/apache/spark/pull/18855#discussion_r131544351 --- Diff: core/src/test/scala/org/apache/spark/storage/DiskStoreSuite.scala --- @@ -92,6 +92,31 @@ class DiskStoreSuite extends SparkFunSuite {

  1   2   3   >