[GitHub] spark issue #18655: [SPARK-21440][SQL][PYSPARK] Refactor ArrowConverters and...

2017-07-26 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/18655 **[Test build #79960 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/79960/testReport)** for PR 18655 at commit

[GitHub] spark issue #18513: [SPARK-13969][ML] Add FeatureHasher transformer

2017-07-26 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/18513 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #18702: [SPARK-21485][SQL][DOCS] Spark SQL documentation generat...

2017-07-26 Thread HyukjinKwon
Github user HyukjinKwon commented on the issue: https://github.com/apache/spark/pull/18702 I am fine with leaving it to me too :). --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this

[GitHub] spark issue #18739: [WIP][SPARK-21539][CORE] Job should not be aborted when ...

2017-07-26 Thread canezk
Github user canezk commented on the issue: https://github.com/apache/spark/pull/18739 I have implemented logic to report blacklist node for yarn and will push later. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well.

[GitHub] spark issue #18305: [SPARK-20988][ML] Logistic regression uses aggregator hi...

2017-07-26 Thread sethah
Github user sethah commented on the issue: https://github.com/apache/spark/pull/18305 Thanks @MLnick, @hhbyyh, and @facaiy for reviewing! --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this

[GitHub] spark issue #18735: [SPARK-21530] Update description of spark.shuffle.maxChu...

2017-07-26 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/18735 **[Test build #79966 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/79966/testReport)** for PR 18735 at commit

[GitHub] spark issue #18735: [SPARK-21530] Update description of spark.shuffle.maxChu...

2017-07-26 Thread tgravescs
Github user tgravescs commented on the issue: https://github.com/apache/spark/pull/18735 thanks for updating, minor formatting thing I forgot to mention before, otherwise looks good. --- If your project is set up for it, you can reply to this email and have your reply appear on

[GitHub] spark pull request #18735: [SPARK-21530] Update description of spark.shuffle...

2017-07-26 Thread tgravescs
Github user tgravescs commented on a diff in the pull request: https://github.com/apache/spark/pull/18735#discussion_r129589331 --- Diff: common/network-common/src/main/java/org/apache/spark/network/util/TransportConf.java --- @@ -259,6 +259,8 @@ public Properties cryptoConf() {

[GitHub] spark pull request #18735: [SPARK-21530] Update description of spark.shuffle...

2017-07-26 Thread jinxing64
Github user jinxing64 commented on a diff in the pull request: https://github.com/apache/spark/pull/18735#discussion_r129608114 --- Diff: docs/configuration.md --- @@ -636,6 +636,8 @@ Apart from these, the following properties are also available, and may be useful

[GitHub] spark issue #18468: [SPARK-20783][SQL] Create CachedBatchColumnVector to abs...

2017-07-26 Thread kiszk
Github user kiszk commented on the issue: https://github.com/apache/spark/pull/18468 ping @cloud-fan, @rxin --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes

[GitHub] spark issue #18739: [WIP][SPARK-21539][CORE] Job should not be aborted when ...

2017-07-26 Thread caneMi
Github user caneMi commented on the issue: https://github.com/apache/spark/pull/18739 I have implemented logic to report blacklist node for yarn and will push later. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If

[GitHub] spark issue #18554: [SPARK-21306][ML] OneVsRest should support setWeightCol

2017-07-26 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/18554 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/79964/ Test PASSed. ---

[GitHub] spark issue #18554: [SPARK-21306][ML] OneVsRest should support setWeightCol

2017-07-26 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/18554 **[Test build #79964 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/79964/testReport)** for PR 18554 at commit

[GitHub] spark issue #18554: [SPARK-21306][ML] OneVsRest should support setWeightCol

2017-07-26 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/18554 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #18735: [SPARK-21530] Update description of spark.shuffle.maxChu...

2017-07-26 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/18735 **[Test build #79965 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/79965/testReport)** for PR 18735 at commit

[GitHub] spark pull request #18735: [SPARK-21530] Update description of spark.shuffle...

2017-07-26 Thread tgravescs
Github user tgravescs commented on a diff in the pull request: https://github.com/apache/spark/pull/18735#discussion_r129613952 --- Diff: docs/configuration.md --- @@ -635,7 +635,10 @@ Apart from these, the following properties are also available, and may be useful

[GitHub] spark issue #18704: [SPARK-20783][SQL] Create CachedBatchColumnVector to abs...

2017-07-26 Thread kiszk
Github user kiszk commented on the issue: https://github.com/apache/spark/pull/18704 ping @rxin --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the

[GitHub] spark pull request #18735: [SPARK-21530] Update description of spark.shuffle...

2017-07-26 Thread tgravescs
Github user tgravescs commented on a diff in the pull request: https://github.com/apache/spark/pull/18735#discussion_r129589282 --- Diff: docs/configuration.md --- @@ -636,6 +636,8 @@ Apart from these, the following properties are also available, and may be useful

[GitHub] spark issue #18731: [SPARK-20990][SQL] Read all JSON documents in files when...

2017-07-26 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/18731 **[Test build #79963 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/79963/testReport)** for PR 18731 at commit

[GitHub] spark issue #18731: [SPARK-20990][SQL] Read all JSON documents in files when...

2017-07-26 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/18731 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #18731: [SPARK-20990][SQL] Read all JSON documents in files when...

2017-07-26 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/18731 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/79963/ Test PASSed. ---

[GitHub] spark issue #18709: [SPARK-21504] [SQL] Add spark version info into table me...

2017-07-26 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/18709 **[Test build #79967 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/79967/testReport)** for PR 18709 at commit

[GitHub] spark issue #18702: [SPARK-21485][SQL][DOCS] Spark SQL documentation generat...

2017-07-26 Thread rxin
Github user rxin commented on the issue: https://github.com/apache/spark/pull/18702 LGTM too. Merging in master. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark pull request #17882: [WIP][SPARK-20079][yarn] Re registration of AM ha...

2017-07-26 Thread witgo
Github user witgo closed the pull request at: https://github.com/apache/spark/pull/17882 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] spark issue #17882: [WIP][SPARK-20079][yarn] Re registration of AM hangs spa...

2017-07-26 Thread witgo
Github user witgo commented on the issue: https://github.com/apache/spark/pull/17882 I'm very sorry, I haven't taken the time to update this code recently. @vanzin , thank you for your work. I'll close this PR. --- If your project is set up for it, you can reply to this email and

[GitHub] spark issue #18709: [SPARK-21504] [SQL] Add spark version info into table me...

2017-07-26 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/18709 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #18709: [SPARK-21504] [SQL] Add spark version info into table me...

2017-07-26 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/18709 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/79967/ Test FAILed. ---

[GitHub] spark issue #18679: [SPARK-21319][SQL] Fix memory leak in sorter

2017-07-26 Thread cloud-fan
Github user cloud-fan commented on the issue: https://github.com/apache/spark/pull/18679 cc @ueshin --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if

[GitHub] spark issue #18735: [SPARK-21530] Update description of spark.shuffle.maxChu...

2017-07-26 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/18735 **[Test build #79966 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/79966/testReport)** for PR 18735 at commit

[GitHub] spark issue #18735: [SPARK-21530] Update description of spark.shuffle.maxChu...

2017-07-26 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/18735 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/79965/ Test PASSed. ---

[GitHub] spark issue #18735: [SPARK-21530] Update description of spark.shuffle.maxChu...

2017-07-26 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/18735 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #18679: [SPARK-21319][SQL] Fix memory leak in sorter

2017-07-26 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/18679 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #18679: [SPARK-21319][SQL] Fix memory leak in sorter

2017-07-26 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/18679 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/79971/ Test FAILed. ---

[GitHub] spark issue #18735: [SPARK-21530] Update description of spark.shuffle.maxChu...

2017-07-26 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/18735 **[Test build #79965 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/79965/testReport)** for PR 18735 at commit

[GitHub] spark issue #18664: [SPARK-21375][PYSPARK][SQL][WIP] Add Date and Timestamp ...

2017-07-26 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/18664 **[Test build #79972 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/79972/testReport)** for PR 18664 at commit

[GitHub] spark issue #16630: [SPARK-19270][ML] Add summary table to GLM summary

2017-07-26 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16630 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/79970/ Test PASSed. ---

[GitHub] spark issue #16630: [SPARK-19270][ML] Add summary table to GLM summary

2017-07-26 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16630 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #16630: [SPARK-19270][ML] Add summary table to GLM summary

2017-07-26 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16630 **[Test build #79970 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/79970/testReport)** for PR 16630 at commit

[GitHub] spark issue #18735: [SPARK-21530] Update description of spark.shuffle.maxChu...

2017-07-26 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/18735 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/79966/ Test PASSed. ---

[GitHub] spark issue #18735: [SPARK-21530] Update description of spark.shuffle.maxChu...

2017-07-26 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/18735 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #18503: [SPARK-21271][SQL] Ensure Unsafe.sizeInBytes is a multip...

2017-07-26 Thread tdas
Github user tdas commented on the issue: https://github.com/apache/spark/pull/18503 @cloud-fan @kiszk thanks for confirming. LGTM pending tests. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark issue #18645: [SPARK-14280][BUILD][WIP] Update change-version.sh and p...

2017-07-26 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/18645 **[Test build #79968 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/79968/testReport)** for PR 18645 at commit

[GitHub] spark issue #18645: [SPARK-14280][BUILD][WIP] Update change-version.sh and p...

2017-07-26 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/18645 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #18503: [SPARK-21271][SQL] Ensure Unsafe.sizeInBytes is a multip...

2017-07-26 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/18503 **[Test build #79969 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/79969/testReport)** for PR 18503 at commit

[GitHub] spark issue #18679: [SPARK-21319][SQL] Fix memory leak in sorter

2017-07-26 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/18679 **[Test build #79971 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/79971/testReport)** for PR 18679 at commit

[GitHub] spark issue #18664: [SPARK-21375][PYSPARK][SQL][WIP] Add Date and Timestamp ...

2017-07-26 Thread BryanCutler
Github user BryanCutler commented on the issue: https://github.com/apache/spark/pull/18664 Thanks @jreback and @wesm for looking. I'm going to try one more fix and if that doesn't work then I can add some printouts to see what is going on. --- If your project is set up for it, you

[GitHub] spark issue #18645: [SPARK-14280][BUILD][WIP] Update change-version.sh and p...

2017-07-26 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/18645 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/79968/ Test FAILed. ---

[GitHub] spark issue #18503: [SPARK-21271][SQL] Ensure Unsafe.sizeInBytes is a multip...

2017-07-26 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/18503 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/79969/ Test PASSed. ---

[GitHub] spark issue #18503: [SPARK-21271][SQL] Ensure Unsafe.sizeInBytes is a multip...

2017-07-26 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/18503 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark pull request #18702: [SPARK-21485][SQL][DOCS] Spark SQL documentation ...

2017-07-26 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/18702 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] spark issue #18645: [SPARK-14280][BUILD][WIP] Update change-version.sh and p...

2017-07-26 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/18645 **[Test build #79968 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/79968/testReport)** for PR 18645 at commit

[GitHub] spark issue #18503: [SPARK-21271][SQL] Ensure Unsafe.sizeInBytes is a multip...

2017-07-26 Thread cloud-fan
Github user cloud-fan commented on the issue: https://github.com/apache/spark/pull/18503 retest this please --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes

[GitHub] spark issue #16630: [SPARK-19270][ML] Add summary table to GLM summary

2017-07-26 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16630 **[Test build #79970 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/79970/testReport)** for PR 16630 at commit

[GitHub] spark pull request #18610: [SPARK-21386] ML LinearRegression supports warm s...

2017-07-26 Thread WeichenXu123
Github user WeichenXu123 commented on a diff in the pull request: https://github.com/apache/spark/pull/18610#discussion_r129652515 --- Diff: mllib/src/main/scala/org/apache/spark/ml/util/ReadWrite.scala --- @@ -309,6 +313,23 @@ private[ml] object DefaultParamsWriter { val

[GitHub] spark issue #18679: [SPARK-21319][SQL] Fix memory leak in sorter

2017-07-26 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/18679 **[Test build #79971 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/79971/testReport)** for PR 18679 at commit

[GitHub] spark issue #18315: [SPARK-21108] [ML] [WIP] convert LinearSVC to aggregator...

2017-07-26 Thread sethah
Github user sethah commented on the issue: https://github.com/apache/spark/pull/18315 ping! https://github.com/apache/spark/pull/18305 was merged. This can proceed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If

[GitHub] spark pull request #18711: [SPARK-21506][DOC]The description of "spark.execu...

2017-07-26 Thread jiangxb1987
Github user jiangxb1987 commented on a diff in the pull request: https://github.com/apache/spark/pull/18711#discussion_r129633550 --- Diff: docs/configuration.md --- @@ -1106,7 +1106,7 @@ Apart from these, the following properties are also available, and may be useful

[GitHub] spark issue #18503: [SPARK-21271][SQL] Ensure Unsafe.sizeInBytes is a multip...

2017-07-26 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/18503 **[Test build #79969 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/79969/testReport)** for PR 18503 at commit

[GitHub] spark issue #18709: [SPARK-21504] [SQL] Add spark version info into table me...

2017-07-26 Thread gatorsmile
Github user gatorsmile commented on the issue: https://github.com/apache/spark/pull/18709 retest this please --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes

[GitHub] spark issue #18645: [SPARK-14280][BUILD][WIP] Update change-version.sh and p...

2017-07-26 Thread srowen
Github user srowen commented on the issue: https://github.com/apache/spark/pull/18645 I believe the last errors were essentially the same issue discussed in json4s here: https://github.com/json4s/json4s/issues/227 I suspect that it's down to a change in the effective

[GitHub] spark issue #18694: [SPARK-21492][SQL] Memory leak in SortMergeJoin

2017-07-26 Thread cloud-fan
Github user cloud-fan commented on the issue: https://github.com/apache/spark/pull/18694 IMO the cleanup hook is a workaround for the limitation of iterator model: although the parent knows when to release resource of its child, but there is no way to notify the child via iterator.

[GitHub] spark issue #18708: [SPARK-21339] [CORE] spark-shell --packages option does ...

2017-07-26 Thread devaraj-kavali
Github user devaraj-kavali commented on the issue: https://github.com/apache/spark/pull/18708 @vanzin I have updated the changes, can you check and validate the change? Thanks --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as

[GitHub] spark issue #18709: [SPARK-21504] [SQL] Add spark version info into table me...

2017-07-26 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/18709 **[Test build #79967 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/79967/testReport)** for PR 18709 at commit

[GitHub] spark pull request #18740: [SPARK-21538][SQL] Attribute resolution inconsist...

2017-07-26 Thread aokolnychyi
GitHub user aokolnychyi opened a pull request: https://github.com/apache/spark/pull/18740 [SPARK-21538][SQL] Attribute resolution inconsistency in the Dataset API ## What changes were proposed in this pull request? This PR contains a tiny update that removes an attribute

[GitHub] spark issue #18695: [SPARK-12717][PYTHON] Adding thread-safe broadcast pickl...

2017-07-26 Thread BryanCutler
Github user BryanCutler commented on the issue: https://github.com/apache/spark/pull/18695 Thanks @viirya , that was a good idea! I updated to use a thread-local object to store the pickled vars --- If your project is set up for it, you can reply to this email and have your reply

[GitHub] spark issue #18664: [SPARK-21375][PYSPARK][SQL][WIP] Add Date and Timestamp ...

2017-07-26 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/18664 **[Test build #79975 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/79975/testReport)** for PR 18664 at commit

[GitHub] spark issue #9183: [SPARK-11215] [ML] Add multiple columns support to String...

2017-07-26 Thread WeichenXu123
Github user WeichenXu123 commented on the issue: https://github.com/apache/spark/pull/9183 @yanboliang I will take over this feature and create a new PR soon. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark issue #18695: [SPARK-12717][PYTHON] Adding thread-safe broadcast pickl...

2017-07-26 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/18695 **[Test build #79974 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/79974/testReport)** for PR 18695 at commit

[GitHub] spark issue #18695: [SPARK-12717][PYTHON] Adding thread-safe broadcast pickl...

2017-07-26 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/18695 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #18695: [SPARK-12717][PYTHON] Adding thread-safe broadcast pickl...

2017-07-26 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/18695 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/79974/ Test PASSed. ---

[GitHub] spark pull request #17373: [SPARK-12664] Expose probability in mlp model

2017-07-26 Thread WeichenXu123
Github user WeichenXu123 commented on a diff in the pull request: https://github.com/apache/spark/pull/17373#discussion_r129698281 --- Diff: mllib/src/main/scala/org/apache/spark/ml/ann/Layer.scala --- @@ -527,9 +544,21 @@ private[ml] class FeedForwardModel private(

[GitHub] spark pull request #17373: [SPARK-12664] Expose probability in mlp model

2017-07-26 Thread WeichenXu123
Github user WeichenXu123 commented on a diff in the pull request: https://github.com/apache/spark/pull/17373#discussion_r129697890 --- Diff: mllib/src/main/scala/org/apache/spark/ml/ann/Layer.scala --- @@ -527,9 +544,21 @@ private[ml] class FeedForwardModel private(

[GitHub] spark pull request #17373: [SPARK-12664] Expose probability in mlp model

2017-07-26 Thread WeichenXu123
Github user WeichenXu123 commented on a diff in the pull request: https://github.com/apache/spark/pull/17373#discussion_r129697649 --- Diff: mllib/src/main/scala/org/apache/spark/ml/ann/Layer.scala --- @@ -463,7 +479,7 @@ private[ml] class FeedForwardModel private( private

[GitHub] spark issue #17373: [SPARK-12664] Expose probability in mlp model

2017-07-26 Thread WeichenXu123
Github user WeichenXu123 commented on the issue: https://github.com/apache/spark/pull/17373 cc @yanboliang @jkbradley --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled

[GitHub] spark issue #18707: [SPARK-21503][UI]: Spark UI shows incorrect task status ...

2017-07-26 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/18707 **[Test build #79978 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/79978/testReport)** for PR 18707 at commit

[GitHub] spark issue #18664: [SPARK-21375][PYSPARK][SQL][WIP] Add Date and Timestamp ...

2017-07-26 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/18664 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #18740: [SPARK-21538][SQL] Attribute resolution inconsistency in...

2017-07-26 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/18740 **[Test build #79973 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/79973/testReport)** for PR 18740 at commit

[GitHub] spark issue #18664: [SPARK-21375][PYSPARK][SQL][WIP] Add Date and Timestamp ...

2017-07-26 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/18664 **[Test build #79972 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/79972/testReport)** for PR 18664 at commit

[GitHub] spark issue #18695: [SPARK-12717][PYTHON] Adding thread-safe broadcast pickl...

2017-07-26 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/18695 **[Test build #79974 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/79974/testReport)** for PR 18695 at commit

[GitHub] spark issue #18707: [SPARK-21503][UI]: Spark UI shows incorrect task status ...

2017-07-26 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/18707 **[Test build #79976 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/79976/testReport)** for PR 18707 at commit

[GitHub] spark issue #18707: [SPARK-21503][UI]: Spark UI shows incorrect task status ...

2017-07-26 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/18707 **[Test build #79977 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/79977/testReport)** for PR 18707 at commit

[GitHub] spark issue #18664: [SPARK-21375][PYSPARK][SQL][WIP] Add Date and Timestamp ...

2017-07-26 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/18664 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/79972/ Test FAILed. ---

[GitHub] spark issue #18707: [SPARK-21503][UI]: Spark UI shows incorrect task status ...

2017-07-26 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/18707 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #18707: [SPARK-21503][UI]: Spark UI shows incorrect task status ...

2017-07-26 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/18707 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/79977/ Test FAILed. ---

[GitHub] spark issue #18707: [SPARK-21503][UI]: Spark UI shows incorrect task status ...

2017-07-26 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/18707 **[Test build #79977 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/79977/testReport)** for PR 18707 at commit

[GitHub] spark issue #18528: [SPARK-13041][Mesos] Adds sandbox uri to spark dispatche...

2017-07-26 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/18528 **[Test build #79979 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/79979/testReport)** for PR 18528 at commit

[GitHub] spark pull request #18741: [Spark-21541][YARN]: Spark Logs show incorrect jo...

2017-07-26 Thread pgandhi999
GitHub user pgandhi999 opened a pull request: https://github.com/apache/spark/pull/18741 [Spark-21541][YARN]: Spark Logs show incorrect job status for a job that does not create SparkContext If you run a spark job without creating the SparkSession or SparkContext, the spark job

[GitHub] spark issue #18528: [SPARK-13041][Mesos] Adds sandbox uri to spark dispatche...

2017-07-26 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/18528 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #18528: [SPARK-13041][Mesos] Adds sandbox uri to spark dispatche...

2017-07-26 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/18528 **[Test build #79979 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/79979/testReport)** for PR 18528 at commit

[GitHub] spark issue #18528: [SPARK-13041][Mesos] Adds sandbox uri to spark dispatche...

2017-07-26 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/18528 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/79979/ Test PASSed. ---

[GitHub] spark issue #18742: [Spark-21542][Python]Python persistence helper functions

2017-07-26 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/18742 **[Test build #79980 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/79980/testReport)** for PR 18742 at commit

[GitHub] spark issue #18702: [SPARK-21485][SQL][DOCS] Spark SQL documentation generat...

2017-07-26 Thread HyukjinKwon
Github user HyukjinKwon commented on the issue: https://github.com/apache/spark/pull/18702 Thank you @srowen and @rxin. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled

[GitHub] spark issue #18664: [SPARK-21375][PYSPARK][SQL][WIP] Add Date and Timestamp ...

2017-07-26 Thread BryanCutler
Github user BryanCutler commented on the issue: https://github.com/apache/spark/pull/18664 So this is currently failing due to this issue: ``` ERROR: test_bbb_fail (pyspark.sql.tests.ArrowTests) --

[GitHub] spark issue #18664: [SPARK-21375][PYSPARK][SQL][WIP] Add Date and Timestamp ...

2017-07-26 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/18664 **[Test build #79982 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/79982/testReport)** for PR 18664 at commit

[GitHub] spark issue #18692: [SPARK-21417][SQL] Detect joind conditions via filter ex...

2017-07-26 Thread gatorsmile
Github user gatorsmile commented on the issue: https://github.com/apache/spark/pull/18692 You are on the right track. You might find some bugs/issues when you implement it. Sorry, too busy recently. --- If your project is set up for it, you can reply to this email and have your

[GitHub] spark issue #18528: [SPARK-13041][Mesos] Adds sandbox uri to spark dispatche...

2017-07-26 Thread ArtRand
Github user ArtRand commented on the issue: https://github.com/apache/spark/pull/18528 LGTM, pretty nice to have this now! --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark pull request #18742: Python persistence helper functions

2017-07-26 Thread ajaysaini725
GitHub user ajaysaini725 opened a pull request: https://github.com/apache/spark/pull/18742 Python persistence helper functions ## What changes were proposed in this pull request? Added DefaultParamsWriteable, DefaultParamsReadable, DefaultParamsWriter, and

[GitHub] spark issue #18742: Python persistence helper functions

2017-07-26 Thread ajaysaini725
Github user ajaysaini725 commented on the issue: https://github.com/apache/spark/pull/18742 @jkbradley @thunterdb @MrBago Could you please review this PR? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project

[GitHub] spark issue #18664: [SPARK-21375][PYSPARK][SQL][WIP] Add Date and Timestamp ...

2017-07-26 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/18664 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/79975/ Test FAILed. ---

[GitHub] spark issue #18664: [SPARK-21375][PYSPARK][SQL][WIP] Add Date and Timestamp ...

2017-07-26 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/18664 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

<    1   2   3   >