[GitHub] spark issue #17728: [SPARK-20437][R] R wrappers for rollup and cube

2017-04-25 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17728 **[Test build #76158 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/76158/testReport)** for PR 17728 at commit [`0da03b2`](https://github.com/apache/spark/commit/0

[GitHub] spark issue #17728: [SPARK-20437][R] R wrappers for rollup and cube

2017-04-25 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17728 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/76158/ Test PASSed. ---

[GitHub] spark issue #17605: [SPARK-20290][MINOR][PYTHON][SQL] Add PySpark wrapper fo...

2017-04-25 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17605 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #17605: [SPARK-20290][MINOR][PYTHON][SQL] Add PySpark wrapper fo...

2017-04-25 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17605 **[Test build #76161 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/76161/testReport)** for PR 17605 at commit [`3254f8e`](https://github.com/apache/spark/commit/3

[GitHub] spark issue #17605: [SPARK-20290][MINOR][PYTHON][SQL] Add PySpark wrapper fo...

2017-04-25 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17605 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/76161/ Test PASSed. ---

[GitHub] spark issue #17605: [SPARK-20290][MINOR][PYTHON][SQL] Add PySpark wrapper fo...

2017-04-25 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17605 **[Test build #76164 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/76164/testReport)** for PR 17605 at commit [`9d75094`](https://github.com/apache/spark/commit/9d

[GitHub] spark issue #17765: [SPARK-20464][SS] Add a job group and description for st...

2017-04-25 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17765 **[Test build #76163 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/76163/testReport)** for PR 17765 at commit [`bd13a01`](https://github.com/apache/spark/commit/bd

[GitHub] spark issue #17765: [SPARK-20464][SS] Add a job group and an informative des...

2017-04-25 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17765 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/76152/ Test PASSed. ---

[GitHub] spark issue #17765: [SPARK-20464][SS] Add a job group and an informative des...

2017-04-25 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17765 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #17765: [SPARK-20464][SS] Add a job group and an informative des...

2017-04-25 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17765 **[Test build #76152 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/76152/testReport)** for PR 17765 at commit [`07e182b`](https://github.com/apache/spark/commit/0

[GitHub] spark issue #17761: [SPARK-20461][Core][SS]Use UninterruptibleThread for Exe...

2017-04-25 Thread mridulm
Github user mridulm commented on the issue: https://github.com/apache/spark/pull/17761 @zsxwing Got it, thanks for clarifying. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature ena

[GitHub] spark issue #17765: [SPARK-20464][SS] Add a job group and an informative des...

2017-04-25 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17765 **[Test build #76162 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/76162/testReport)** for PR 17765 at commit [`609d50e`](https://github.com/apache/spark/commit/60

[GitHub] spark issue #17658: [SPARK-20355] Add per application spark version on the h...

2017-04-25 Thread redsanket
Github user redsanket commented on the issue: https://github.com/apache/spark/pull/17658 Jenkins, test this please --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wis

[GitHub] spark issue #17765: [SPARK-20464][SS] Add a job group and an informative des...

2017-04-25 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17765 **[Test build #76160 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/76160/testReport)** for PR 17765 at commit [`bd13a01`](https://github.com/apache/spark/commit/bd

[GitHub] spark issue #17605: [SPARK-20290][MINOR][PYTHON][SQL] Add PySpark wrapper fo...

2017-04-25 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17605 **[Test build #76161 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/76161/testReport)** for PR 17605 at commit [`3254f8e`](https://github.com/apache/spark/commit/32

[GitHub] spark issue #17755: [SPARK-20239][CORE][2.1-backport] Improve HistoryServer'...

2017-04-25 Thread jerryshao
Github user jerryshao commented on the issue: https://github.com/apache/spark/pull/17755 Thanks @vanzin . --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, o

[GitHub] spark pull request #17755: [SPARK-20239][CORE][2.1-backport] Improve History...

2017-04-25 Thread jerryshao
Github user jerryshao closed the pull request at: https://github.com/apache/spark/pull/17755 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] spark issue #17763: [SPARK-13747][Core]Add ThreadUtils.awaitReady and disall...

2017-04-25 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17763 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/76151/ Test PASSed. ---

[GitHub] spark issue #17763: [SPARK-13747][Core]Add ThreadUtils.awaitReady and disall...

2017-04-25 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17763 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #17763: [SPARK-13747][Core]Add ThreadUtils.awaitReady and disall...

2017-04-25 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17763 **[Test build #76151 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/76151/testReport)** for PR 17763 at commit [`2bb83e1`](https://github.com/apache/spark/commit/2

[GitHub] spark issue #17605: [SPARK-20290][MINOR][PYTHON][SQL] Add PySpark wrapper fo...

2017-04-25 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17605 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/76159/ Test FAILed. ---

[GitHub] spark issue #17605: [SPARK-20290][MINOR][PYTHON][SQL] Add PySpark wrapper fo...

2017-04-25 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17605 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #17605: [SPARK-20290][MINOR][PYTHON][SQL] Add PySpark wrapper fo...

2017-04-25 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17605 **[Test build #76159 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/76159/testReport)** for PR 17605 at commit [`4b8a352`](https://github.com/apache/spark/commit/4

[GitHub] spark issue #17728: [SPARK-20437][R] R wrappers for rollup and cube

2017-04-25 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17728 **[Test build #76158 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/76158/testReport)** for PR 17728 at commit [`0da03b2`](https://github.com/apache/spark/commit/0d

[GitHub] spark issue #17605: [SPARK-20290][MINOR][PYTHON][SQL] Add PySpark wrapper fo...

2017-04-25 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17605 **[Test build #76159 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/76159/testReport)** for PR 17605 at commit [`4b8a352`](https://github.com/apache/spark/commit/4b

[GitHub] spark issue #17761: [SPARK-20461][Core][SS]Use UninterruptibleThread for Exe...

2017-04-25 Thread zsxwing
Github user zsxwing commented on the issue: https://github.com/apache/spark/pull/17761 @mridulm this only affect codes calling `runUninterruptibly` which is not a public API, so won't break any existing codes. The worst case of this PR is some task needs to wait until network timeout.

[GitHub] spark issue #17728: [SPARK-20437][R] R wrappers for rollup and cube

2017-04-25 Thread zero323
Github user zero323 commented on the issue: https://github.com/apache/spark/pull/17728 Jenkins retest this please. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wis

[GitHub] spark issue #17728: [SPARK-20437][R] R wrappers for rollup and cube

2017-04-25 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17728 **[Test build #76155 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/76155/testReport)** for PR 17728 at commit [`0da03b2`](https://github.com/apache/spark/commit/0

[GitHub] spark issue #17596: [SPARK-12837][CORE] Do not send the name of internal acc...

2017-04-25 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17596 **[Test build #76157 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/76157/testReport)** for PR 17596 at commit [`7f41155`](https://github.com/apache/spark/commit/7f

[GitHub] spark issue #17728: [SPARK-20437][R] R wrappers for rollup and cube

2017-04-25 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17728 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #17728: [SPARK-20437][R] R wrappers for rollup and cube

2017-04-25 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17728 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/76155/ Test FAILed. ---

[GitHub] spark issue #17596: [SPARK-12837][CORE] Do not send the name of internal acc...

2017-04-25 Thread cloud-fan
Github user cloud-fan commented on the issue: https://github.com/apache/spark/pull/17596 retest this please. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so

[GitHub] spark pull request #17724: [SPARK-18127] Add hooks and extension points to S...

2017-04-25 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/17724 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is ena

[GitHub] spark issue #17761: [SPARK-20461][Core][SS]Use UninterruptibleThread for Exe...

2017-04-25 Thread mridulm
Github user mridulm commented on the issue: https://github.com/apache/spark/pull/17761 Task interruption is part of our API iirc - kill with interrupt = true. Doing this will break that contract - did I miss something here ? Also, IIRC @joshrosen had done a bunch of work re

[GitHub] spark issue #17724: [SPARK-18127] Add hooks and extension points to Spark

2017-04-25 Thread gatorsmile
Github user gatorsmile commented on the issue: https://github.com/apache/spark/pull/17724 Thanks! Merging to master/2.2 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled a

[GitHub] spark issue #17724: [SPARK-18127] Add hooks and extension points to Spark

2017-04-25 Thread mridulm
Github user mridulm commented on the issue: https://github.com/apache/spark/pull/17724 Can we add SQL to pr title ? Extension to spark implies core, and means something different :-) --- If your project is set up for it, you can reply to this email and have your reply appear on GitHu

[GitHub] spark issue #17649: [SPARK-20380][SQL] Output table comment for DESC FORMATT...

2017-04-25 Thread sujith71955
Github user sujith71955 commented on the issue: https://github.com/apache/spark/pull/17649 @gatorsmile @wzhfy updated the PR by removing the 'comment' from table properties . --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as w

[GitHub] spark issue #17725: [SPARK-20435][CORE] More thorough redaction of sensitive...

2017-04-25 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17725 **[Test build #76156 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/76156/testReport)** for PR 17725 at commit [`80e40ba`](https://github.com/apache/spark/commit/80

[GitHub] spark issue #17725: [SPARK-20435][CORE] More thorough redaction of sensitive...

2017-04-25 Thread markgrover
Github user markgrover commented on the issue: https://github.com/apache/spark/pull/17725 Kicking off another run here while I am running a run locally. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does

[GitHub] spark issue #17725: [SPARK-20435][CORE] More thorough redaction of sensitive...

2017-04-25 Thread markgrover
Github user markgrover commented on the issue: https://github.com/apache/spark/pull/17725 Jenkins, retest this please. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and

[GitHub] spark pull request #17737: [SPARK-20442][PYTHON][DOCS] Fill up documentation...

2017-04-25 Thread zero323
Github user zero323 commented on a diff in the pull request: https://github.com/apache/spark/pull/17737#discussion_r113339040 --- Diff: python/pyspark/sql/column.py --- @@ -251,15 +285,16 @@ def __iter__(self): # string methods _rlike_doc = """ -Retur

[GitHub] spark issue #17728: [SPARK-20437][R] R wrappers for rollup and cube

2017-04-25 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17728 **[Test build #76155 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/76155/testReport)** for PR 17728 at commit [`0da03b2`](https://github.com/apache/spark/commit/0d

[GitHub] spark issue #17723: [SPARK-20434][YARN][CORE] Move kerberos delegation token...

2017-04-25 Thread vanzin
Github user vanzin commented on the issue: https://github.com/apache/spark/pull/17723 EOW, maybe. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the

[GitHub] spark issue #17723: [SPARK-20434][YARN][CORE] Move kerberos delegation token...

2017-04-25 Thread mgummelt
Github user mgummelt commented on the issue: https://github.com/apache/spark/pull/17723 Thanks, do you have an approx. ETA? Knowing that will help me not ping you too much. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well

[GitHub] spark issue #17766: [SPARK-20421][core] Mark internal listeners as deprecate...

2017-04-25 Thread vanzin
Github user vanzin commented on the issue: https://github.com/apache/spark/pull/17766 @JoshRosen --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the

[GitHub] spark issue #17673: [SPARK-20372] [ML] Word2Vec Continuous Bag of Words mode...

2017-04-25 Thread holdenk
Github user holdenk commented on the issue: https://github.com/apache/spark/pull/17673 I can maybe help out a bit in a week and a bit (I've also done some poking inside of Word2Vec) but I need to wrap up some travel and Python stuff first. --- If your project is set up for it, you ca

[GitHub] spark issue #17723: [SPARK-20434][YARN][CORE] Move kerberos delegation token...

2017-04-25 Thread vanzin
Github user vanzin commented on the issue: https://github.com/apache/spark/pull/17723 Really busy with all sorts of things, will get to it eventually. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does n

[GitHub] spark issue #17766: [SPARK-20421][core] Mark internal listeners as deprecate...

2017-04-25 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17766 **[Test build #76154 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/76154/testReport)** for PR 17766 at commit [`d16be2b`](https://github.com/apache/spark/commit/d1

[GitHub] spark pull request #17766: [SPARK-20421][core] Mark internal listeners as de...

2017-04-25 Thread vanzin
GitHub user vanzin opened a pull request: https://github.com/apache/spark/pull/17766 [SPARK-20421][core] Mark internal listeners as deprecated. These listeners weren't really meant for external consumption, but they're public and marked with @DeveloperApi. Adding the deprecated t

[GitHub] spark issue #17693: [SPARK-16548][SQL] Inconsistent error handling in JSON p...

2017-04-25 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17693 **[Test build #76153 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/76153/testReport)** for PR 17693 at commit [`91bb487`](https://github.com/apache/spark/commit/91

[GitHub] spark issue #17723: [SPARK-20434][YARN][CORE] Move kerberos delegation token...

2017-04-25 Thread mgummelt
Github user mgummelt commented on the issue: https://github.com/apache/spark/pull/17723 Hi @vanzin. Any thoughts on this one? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature ena

[GitHub] spark issue #17762: [SPARK-9103][WIP] Track Netty memory usage - take two

2017-04-25 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17762 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #17762: [SPARK-9103][WIP] Track Netty memory usage - take two

2017-04-25 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17762 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/76148/ Test FAILed. ---

[GitHub] spark issue #17762: [SPARK-9103][WIP] Track Netty memory usage - take two

2017-04-25 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17762 **[Test build #76148 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/76148/testReport)** for PR 17762 at commit [`550c2d8`](https://github.com/apache/spark/commit/5

[GitHub] spark issue #17725: [SPARK-20435][CORE] More thorough redaction of sensitive...

2017-04-25 Thread markgrover
Github user markgrover commented on the issue: https://github.com/apache/spark/pull/17725 Hmm, this is weird, it ran for 4h10 mins and got killed due to a timeout. Looking... --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as wel

[GitHub] spark issue #17765: [SPARK-20464][SS] Add a job group and an informative des...

2017-04-25 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17765 **[Test build #76152 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/76152/testReport)** for PR 17765 at commit [`07e182b`](https://github.com/apache/spark/commit/07

[GitHub] spark pull request #17765: [SPARK-20464][SS] Add a job group and an informat...

2017-04-25 Thread kunalkhamar
GitHub user kunalkhamar opened a pull request: https://github.com/apache/spark/pull/17765 [SPARK-20464][SS] Add a job group and an informative description for streaming queries ## What changes were proposed in this pull request? This change makes it convenient to group the

[GitHub] spark issue #17748: [SPARK-19812] YARN shuffle service fails to relocate rec...

2017-04-25 Thread mridulm
Github user mridulm commented on the issue: https://github.com/apache/spark/pull/17748 LGTM, can you please merge it Tom ? Thx --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature ena

[GitHub] spark issue #17755: [SPARK-20239][CORE][2.1-backport] Improve HistoryServer'...

2017-04-25 Thread vanzin
Github user vanzin commented on the issue: https://github.com/apache/spark/pull/17755 Merging to 2.1 / 2.0. Please close the PR manually. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this

[GitHub] spark pull request #17748: [SPARK-19812] YARN shuffle service fails to reloc...

2017-04-25 Thread mridulm
Github user mridulm commented on a diff in the pull request: https://github.com/apache/spark/pull/17748#discussion_r113325881 --- Diff: common/network-yarn/src/main/java/org/apache/spark/network/yarn/YarnShuffleService.java --- @@ -363,25 +362,29 @@ protected File initRecoveryDb(S

[GitHub] spark issue #17725: [SPARK-20435][CORE] More thorough redaction of sensitive...

2017-04-25 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17725 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #17725: [SPARK-20435][CORE] More thorough redaction of sensitive...

2017-04-25 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17725 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/76143/ Test FAILed. ---

[GitHub] spark issue #17725: [SPARK-20435][CORE] More thorough redaction of sensitive...

2017-04-25 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17725 **[Test build #76143 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/76143/testReport)** for PR 17725 at commit [`80e40ba`](https://github.com/apache/spark/commit/8

[GitHub] spark pull request #17744: [SPARK-20426] Lazy initialization of FileSegmentM...

2017-04-25 Thread tgravescs
Github user tgravescs commented on a diff in the pull request: https://github.com/apache/spark/pull/17744#discussion_r113323069 --- Diff: common/network-shuffle/src/main/java/org/apache/spark/network/shuffle/ExternalShuffleBlockHandler.java --- @@ -93,14 +92,25 @@ protected void h

[GitHub] spark issue #17761: [SPARK-20461][Core][SS]Use UninterruptibleThread for Exe...

2017-04-25 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17761 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #17761: [SPARK-20461][Core][SS]Use UninterruptibleThread for Exe...

2017-04-25 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17761 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/76145/ Test PASSed. ---

[GitHub] spark issue #17761: [SPARK-20461][Core][SS]Use UninterruptibleThread for Exe...

2017-04-25 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17761 **[Test build #76145 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/76145/testReport)** for PR 17761 at commit [`bde6120`](https://github.com/apache/spark/commit/b

[GitHub] spark issue #17764: [SPARK-20463] Add new column function isNotDistinctFrom.

2017-04-25 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17764 Can one of the admins verify this patch? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feat

[GitHub] spark pull request #17764: Add new function isNotDistinctFrom.

2017-04-25 Thread ptkool
GitHub user ptkool opened a pull request: https://github.com/apache/spark/pull/17764 Add new function isNotDistinctFrom. ## What changes were proposed in this pull request? Expose the SPARK SQL <=> operator in PySpark as a column function. ## How was this patch test

[GitHub] spark issue #17763: [SPARK-13747][Core]Add ThreadUtils.awaitReady and disall...

2017-04-25 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17763 **[Test build #76151 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/76151/testReport)** for PR 17763 at commit [`2bb83e1`](https://github.com/apache/spark/commit/2b

[GitHub] spark issue #17724: [SPARK-18127] Add hooks and extension points to Spark

2017-04-25 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17724 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #17724: [SPARK-18127] Add hooks and extension points to Spark

2017-04-25 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17724 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/76146/ Test PASSed. ---

[GitHub] spark issue #17724: [SPARK-18127] Add hooks and extension points to Spark

2017-04-25 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17724 **[Test build #76146 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/76146/testReport)** for PR 17724 at commit [`72b9cab`](https://github.com/apache/spark/commit/7

[GitHub] spark issue #17763: [SPARK-13747][Core]Add ThreadUtils.awaitReady and disall...

2017-04-25 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17763 **[Test build #76150 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/76150/testReport)** for PR 17763 at commit [`f10461b`](https://github.com/apache/spark/commit/f

[GitHub] spark issue #17763: [SPARK-13747][Core]Add ThreadUtils.awaitReady and disall...

2017-04-25 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17763 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/76150/ Test FAILed. ---

[GitHub] spark issue #17763: [SPARK-13747][Core]Add ThreadUtils.awaitReady and disall...

2017-04-25 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17763 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #17763: [SPARK-13747][Core]Add ThreadUtils.awaitReady and disall...

2017-04-25 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17763 **[Test build #76150 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/76150/testReport)** for PR 17763 at commit [`f10461b`](https://github.com/apache/spark/commit/f1

[GitHub] spark issue #17761: [SPARK-20461][Core][SS]Use UninterruptibleThread for Exe...

2017-04-25 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17761 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/76144/ Test PASSed. ---

[GitHub] spark issue #17761: [SPARK-20461][Core][SS]Use UninterruptibleThread for Exe...

2017-04-25 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17761 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #17761: [SPARK-20461][Core][SS]Use UninterruptibleThread for Exe...

2017-04-25 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17761 **[Test build #76144 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/76144/testReport)** for PR 17761 at commit [`3d7fc4d`](https://github.com/apache/spark/commit/3

[GitHub] spark issue #17763: [SPARK-13747][Core]Add ThreadUtils.awaitReady and disall...

2017-04-25 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17763 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #17763: [SPARK-13747][Core]Add ThreadUtils.awaitReady and disall...

2017-04-25 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17763 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/76149/ Test FAILed. ---

[GitHub] spark issue #17763: [SPARK-13747][Core]Add ThreadUtils.awaitReady and disall...

2017-04-25 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17763 **[Test build #76149 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/76149/testReport)** for PR 17763 at commit [`e79a05a`](https://github.com/apache/spark/commit/e

[GitHub] spark issue #17763: [SPARK-13747][Core]Add ThreadUtils.awaitReady and disall...

2017-04-25 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17763 **[Test build #76149 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/76149/testReport)** for PR 17763 at commit [`e79a05a`](https://github.com/apache/spark/commit/e7

[GitHub] spark pull request #17763: [SPARK-13747][Core]Add ThreadUtils.awaitReady and...

2017-04-25 Thread zsxwing
GitHub user zsxwing opened a pull request: https://github.com/apache/spark/pull/17763 [SPARK-13747][Core]Add ThreadUtils.awaitReady and disallow Await.ready ## What changes were proposed in this pull request? Add `ThreadUtils.awaitReady` similar to `ThreadUtils.awaitResult`

[GitHub] spark issue #17658: [SPARK-20355] Add per application spark version on the h...

2017-04-25 Thread redsanket
Github user redsanket commented on the issue: https://github.com/apache/spark/pull/17658 ok will add it to either RuntimeInfo or ApplicationInfo. I thought it might break the contract underneath but if it doesn't then I should add it here thanks for the input. Will do --- If your pr

[GitHub] spark issue #17658: [SPARK-20355] Add per application spark version on the h...

2017-04-25 Thread vanzin
Github user vanzin commented on the issue: https://github.com/apache/spark/pull/17658 Adding fields to API types is ok. It doesn't break the contract. Adding this in the configuration is weird, because it's not a config. --- If your project is set up for it, you can reply to

[GitHub] spark issue #17658: [SPARK-20355] Add per application spark version on the h...

2017-04-25 Thread redsanket
Github user redsanket commented on the issue: https://github.com/apache/spark/pull/17658 @vanzin Can I add this to SparkConf.scala https://github.com/apache/spark/blob/master/core/src/main/scala/org/apache/spark/SparkConf.scala#L58 just to have the application info here it will have t

[GitHub] spark pull request #17658: [SPARK-20355] Add per application spark version o...

2017-04-25 Thread redsanket
Github user redsanket commented on a diff in the pull request: https://github.com/apache/spark/pull/17658#discussion_r113299115 --- Diff: core/src/main/scala/org/apache/spark/scheduler/ApplicationEventListener.scala --- @@ -57,4 +58,10 @@ private[spark] class ApplicationEventListe

[GitHub] spark issue #17762: [SPARK-9103][WIP] Track Netty memory usage - take two

2017-04-25 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17762 **[Test build #76148 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/76148/testReport)** for PR 17762 at commit [`550c2d8`](https://github.com/apache/spark/commit/55

[GitHub] spark pull request #17658: [SPARK-20355] Add per application spark version o...

2017-04-25 Thread redsanket
Github user redsanket commented on a diff in the pull request: https://github.com/apache/spark/pull/17658#discussion_r113298757 --- Diff: core/src/main/scala/org/apache/spark/scheduler/ApplicationEventListener.scala --- @@ -57,4 +58,10 @@ private[spark] class ApplicationEventListe

[GitHub] spark issue #17762: [SPARK-9103][WIP] Track Netty memory usage - take two

2017-04-25 Thread squito
Github user squito commented on the issue: https://github.com/apache/spark/pull/17762 Jenkins, ok to test --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, o

[GitHub] spark issue #17762: [SPARK-9103][WIP] Track Netty memory usage - take two

2017-04-25 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17762 Can one of the admins verify this patch? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feat

[GitHub] spark pull request #17762: [SPARK-9103][WIP] Track Netty memory usage - take...

2017-04-25 Thread jsoltren
GitHub user jsoltren opened a pull request: https://github.com/apache/spark/pull/17762 [SPARK-9103][WIP] Track Netty memory usage - take two This patch resurrects #7753 by liyezhang556520 and #17625 by jsoltren. ## What changes were proposed in this pull request? Me

[GitHub] spark issue #17728: [SPARK-20437][R] R wrappers for rollup and cube

2017-04-25 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17728 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/76147/ Test PASSed. ---

[GitHub] spark issue #17728: [SPARK-20437][R] R wrappers for rollup and cube

2017-04-25 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17728 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #17728: [SPARK-20437][R] R wrappers for rollup and cube

2017-04-25 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17728 **[Test build #76147 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/76147/testReport)** for PR 17728 at commit [`c3ebeba`](https://github.com/apache/spark/commit/c

[GitHub] spark issue #17694: [SPARK-12717][PYSPARK] Resolving race condition with pys...

2017-04-25 Thread vundela
Github user vundela commented on the issue: https://github.com/apache/spark/pull/17694 Thanks for your time @holdenk. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and

[GitHub] spark issue #17694: [SPARK-12717][PYSPARK] Resolving race condition with pys...

2017-04-25 Thread holdenk
Github user holdenk commented on the issue: https://github.com/apache/spark/pull/17694 Interesting, I don't think I have all of the required context to review, but I'll try and take a look this weekend (I've got some other things happening this week already). --- If your project is

[GitHub] spark issue #17694: [SPARK-12717][PYSPARK] Resolving race condition with pys...

2017-04-25 Thread vundela
Github user vundela commented on the issue: https://github.com/apache/spark/pull/17694 cc @holdenk --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if t

<    1   2   3   4   >