Github user viirya commented on the issue:
https://github.com/apache/spark/pull/18725
I think it's a `HiveTableScan`, rather than `FileSourceScanExec`?
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/18503
**[Test build #79956 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/79956/testReport)**
for PR 18503 at commit
[`cc467de`](https://github.com/apache/spark/commit/c
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/18655
**[Test build #79957 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/79957/testReport)**
for PR 18655 at commit
[`19f3973`](https://github.com/apache/spark/commit/1
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/18655
Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/79957/
Test FAILed.
---
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/18709
Merged build finished. Test FAILed.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
e
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/18709
**[Test build #79959 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/79959/testReport)**
for PR 18709 at commit
[`4e71b66`](https://github.com/apache/spark/commit/4
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/18655
Merged build finished. Test FAILed.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
e
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/18503
Merged build finished. Test FAILed.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
e
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/18503
Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/79956/
Test FAILed.
---
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/18709
Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/79959/
Test FAILed.
---
Github user viirya commented on the issue:
https://github.com/apache/spark/pull/18652
It is a good question. Based on previous discussion, I think Join operator
has no unique result in the non-deterministic case. The migration issue from
Hive is because this kind of queries can't run
Github user ueshin commented on the issue:
https://github.com/apache/spark/pull/18655
Jenkins, retest this please.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wis
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/18513
**[Test build #79961 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/79961/testReport)**
for PR 18513 at commit
[`d6a3117`](https://github.com/apache/spark/commit/d6
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/18655
**[Test build #79960 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/79960/testReport)**
for PR 18655 at commit
[`19f3973`](https://github.com/apache/spark/commit/19
Github user baibaichen commented on the issue:
https://github.com/apache/spark/pull/18725
The `HiveTableScans` strategy need `CatalogRelation`, but it's
`LogicalRelation` in my case. Actually, the hive table is external table in my
test, I guess that's the reason.
I believe t
Github user viirya commented on the issue:
https://github.com/apache/spark/pull/18725
@baibaichen I agree. Looks correct.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled
Github user gczsjdy commented on the issue:
https://github.com/apache/spark/pull/18632
@cloud-fan You are right, thanks. I will close this PR.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have
Github user gczsjdy closed the pull request at:
https://github.com/apache/spark/pull/18632
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is en
Github user HyukjinKwon closed the pull request at:
https://github.com/apache/spark/pull/18737
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature i
Github user HyukjinKwon commented on the issue:
https://github.com/apache/spark/pull/18737
Hm.. this is a bigger change than I thought .. I mean the change itself
here should be correct as we support dots in columns in Scala side but it looks
there are few bugs related with dots in co
Github user mgaido91 commented on the issue:
https://github.com/apache/spark/pull/18731
I am debugging, thanks.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes
Github user felixcheung commented on the issue:
https://github.com/apache/spark/pull/18737
It's a breaking change, but IMO one we need since we have quite a bit of
feedback on this.
re: test failure
```
java.lang.IllegalArgumentException: Field "Sepal_Length" does not
Github user HyukjinKwon commented on the issue:
https://github.com/apache/spark/pull/18737
Yea. The test failure above itself is legitimate but while manually running
and debugging few more tests with some more fixes, it printed:
```
Failed
---
Github user felixcheung commented on the issue:
https://github.com/apache/spark/pull/18737
it's very likely we need to make sure a column name with `.` is specified
with backtick, esp. when referenced in SQL expression...
---
If your project is set up for it, you can reply to this em
Github user heary-cao commented on the issue:
https://github.com/apache/spark/pull/18725
@viirya @baibaichen
thank your for review it.
I made a comparison test:
```
select k,k,sum(id) from (select d004 as id, floor(c010 * 1) as k,
ceil(c010) as cceila from XXX_tabl
Github user mgaido91 commented on the issue:
https://github.com/apache/spark/pull/18731
The reason of the UT failure is that in these two UTs we are passing
invalid JSONs (mind the extra closed curly brace):
-
https://github.com/apache/spark/blob/master/sql/core/src/test/scal
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/18513
**[Test build #79961 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/79961/testReport)**
for PR 18513 at commit
[`d6a3117`](https://github.com/apache/spark/commit/d
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/18513
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/79961/
Test PASSed.
---
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/18513
Merged build finished. Test PASSed.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
e
GitHub user nahoj opened a pull request:
https://github.com/apache/spark/pull/18738
Typo in comment
-
You can merge this pull request into a Git repository by running:
$ git pull https://github.com/nahoj/spark patch-1
Alternatively you can review and apply these changes as the
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/18738
Can one of the admins verify this patch?
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feat
Github user baibaichen commented on the issue:
https://github.com/apache/spark/pull/18725
@heary-cao, is the better performance with your fix? e.g. changing RDG's
deterministic property from false to true?
```
override def deterministic: Boolean = true
```
---
If yo
Github user viirya commented on a diff in the pull request:
https://github.com/apache/spark/pull/18695#discussion_r129516461
--- Diff: python/pyspark/context.py ---
@@ -195,7 +195,7 @@ def _do_init(self, master, appName, sparkHome, pyFiles,
environment, batchSize,
# Th
Github user daniellaah commented on the issue:
https://github.com/apache/spark/pull/18337
I also tested the SVDPlusPlus on movielens-100k dataset. The algorithm just
diverged. And the mse on the dataset gets 2.14748364347152E9.
I tested @lxmly 's code as well, it works but I don'
Github user heary-cao commented on the issue:
https://github.com/apache/spark/pull/18725
@baibaichen
yes, In my test environment
`Time taken: 557.276 seconds, Fetched 1 row(s)`
VS
`Time taken: 5997.238 seconds, Fetched 1 row(s)`
But I'm not sure about the ch
Github user baibaichen commented on the issue:
https://github.com/apache/spark/pull/18725
@heary-cao your fix is wrong.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
ena
Github user heary-cao commented on the issue:
https://github.com/apache/spark/pull/18555
@gatorsmile @cloud-fan
I added new test case again. except
```
DYN_ALLOCATION_MIN_EXECUTORS
DYN_ALLOCATION_INITIAL_EXECUTORS
DYN_ALLOCATION_MAX_EXECUTORS
Github user heary-cao commented on the issue:
https://github.com/apache/spark/pull/18725
@baibaichen
Okay, I try to modify this particular scenario by split it to two Projects.
thanks.
---
If your project is set up for it, you can reply to this email and have your
reply appea
Github user srowen commented on the issue:
https://github.com/apache/spark/pull/18738
Can you have a look for similar typos, or others in this file? we encourage
people to submit more than just one minor typo fix in a PR if possible
---
If your project is set up for it, you can reply
Github user kiszk commented on a diff in the pull request:
https://github.com/apache/spark/pull/18659#discussion_r129522956
--- Diff:
sql/core/src/main/scala/org/apache/spark/sql/execution/arrow/ArrowConverters.scala
---
@@ -132,6 +135,61 @@ private[sql] object ArrowConverters {
Github user nahoj commented on the issue:
https://github.com/apache/spark/pull/18738
Sorry, I don't have time to proof-read the docs, I just saw this one typo
as it is in the summary of this much-used class.
---
If your project is set up for it, you can reply to this email and have y
Github user srowen commented on the issue:
https://github.com/apache/spark/pull/18728
merged to master
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or i
Github user asfgit closed the pull request at:
https://github.com/apache/spark/pull/18728
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is ena
Github user HyukjinKwon commented on the issue:
https://github.com/apache/spark/pull/18702
I guess it probably will take about a week more for my Apache account
creation (according to the doc).
---
If your project is set up for it, you can reply to this email and have your
reply appe
Github user HyukjinKwon commented on the issue:
https://github.com/apache/spark/pull/18702
I am fine with leaving it to me too :).
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
Github user MLnick commented on the issue:
https://github.com/apache/spark/pull/18305
Jenkins retest this please
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishe
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/18655
**[Test build #79960 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/79960/testReport)**
for PR 18655 at commit
[`19f3973`](https://github.com/apache/spark/commit/1
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/18655
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/79960/
Test PASSed.
---
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/18305
**[Test build #79962 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/79962/testReport)**
for PR 18305 at commit
[`cb40b31`](https://github.com/apache/spark/commit/cb
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/18655
Merged build finished. Test PASSed.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
e
Github user yanboliang commented on a diff in the pull request:
https://github.com/apache/spark/pull/18554#discussion_r129532746
--- Diff: python/pyspark/ml/classification.py ---
@@ -1517,20 +1517,22 @@ class OneVsRest(Estimator, OneVsRestParams,
MLReadable, MLWritable):
Github user yanboliang commented on a diff in the pull request:
https://github.com/apache/spark/pull/18554#discussion_r129533677
--- Diff: python/pyspark/ml/tests.py ---
@@ -1255,6 +1255,24 @@ def test_output_columns(self):
output = model.transform(df)
self
Github user jreback commented on the issue:
https://github.com/apache/spark/pull/18664
I cannot repro this; can you show what ``item['timezone']`` is?
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does n
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/18305
**[Test build #79962 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/79962/testReport)**
for PR 18305 at commit
[`cb40b31`](https://github.com/apache/spark/commit/c
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/18305
Merged build finished. Test PASSed.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
e
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/18305
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/79962/
Test PASSed.
---
Github user MLnick commented on the issue:
https://github.com/apache/spark/pull/18305
Merged to master. Thanks @sethah, and thanks all for reviews.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not
Github user asfgit closed the pull request at:
https://github.com/apache/spark/pull/18305
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is ena
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/18731
**[Test build #79963 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/79963/testReport)**
for PR 18731 at commit
[`4da8493`](https://github.com/apache/spark/commit/4d
Github user facaiy commented on a diff in the pull request:
https://github.com/apache/spark/pull/18554#discussion_r129562189
--- Diff: python/pyspark/ml/classification.py ---
@@ -1517,20 +1517,22 @@ class OneVsRest(Estimator, OneVsRestParams,
MLReadable, MLWritable):
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/18554
**[Test build #79964 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/79964/testReport)**
for PR 18554 at commit
[`8c0beba`](https://github.com/apache/spark/commit/8c
Github user facaiy commented on a diff in the pull request:
https://github.com/apache/spark/pull/18554#discussion_r129562237
--- Diff: python/pyspark/ml/tests.py ---
@@ -1255,6 +1255,24 @@ def test_output_columns(self):
output = model.transform(df)
self.ass
GitHub user caneGuy opened a pull request:
https://github.com/apache/spark/pull/18739
[WIP][SPARK-21539][CORE] Job should not be aborted when dynamic allocation
is enâ¦
â¦abled or spark.executor.instances larger then current allocated number
by yarn
## What changes were
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/18739
Can one of the admins verify this patch?
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feat
Github user kiszk commented on the issue:
https://github.com/apache/spark/pull/17180
Is it better to fix this test instead of remove it?
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this f
Github user yanboliang commented on a diff in the pull request:
https://github.com/apache/spark/pull/18610#discussion_r129574777
--- Diff: mllib/src/main/scala/org/apache/spark/ml/util/ReadWrite.scala ---
@@ -309,6 +313,23 @@ private[ml] object DefaultParamsWriter {
val met
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/18554
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/79964/
Test PASSed.
---
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/18554
**[Test build #79964 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/79964/testReport)**
for PR 18554 at commit
[`8c0beba`](https://github.com/apache/spark/commit/8
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/18554
Merged build finished. Test PASSed.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
e
Github user tgravescs commented on a diff in the pull request:
https://github.com/apache/spark/pull/18735#discussion_r129589282
--- Diff: docs/configuration.md ---
@@ -636,6 +636,8 @@ Apart from these, the following properties are also
available, and may be useful
Long.MAX_V
Github user tgravescs commented on a diff in the pull request:
https://github.com/apache/spark/pull/18735#discussion_r129589331
--- Diff:
common/network-common/src/main/java/org/apache/spark/network/util/TransportConf.java
---
@@ -259,6 +259,8 @@ public Properties cryptoConf() {
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/18731
**[Test build #79963 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/79963/testReport)**
for PR 18731 at commit
[`4da8493`](https://github.com/apache/spark/commit/4
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/18731
Merged build finished. Test PASSed.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
e
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/18731
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/79963/
Test PASSed.
---
Github user sethah commented on the issue:
https://github.com/apache/spark/pull/18305
Thanks @MLnick, @hhbyyh, and @facaiy for reviewing!
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this
Github user caneMi commented on the issue:
https://github.com/apache/spark/pull/18739
I have implemented logic to report blacklist node for yarn and will push
later.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If you
Github user canezk commented on the issue:
https://github.com/apache/spark/pull/18739
I have implemented logic to report blacklist node for yarn and will push
later.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well.
Github user jinxing64 commented on a diff in the pull request:
https://github.com/apache/spark/pull/18735#discussion_r129608114
--- Diff: docs/configuration.md ---
@@ -636,6 +636,8 @@ Apart from these, the following properties are also
available, and may be useful
Long.MAX_V
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/18735
**[Test build #79965 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/79965/testReport)**
for PR 18735 at commit
[`2216b31`](https://github.com/apache/spark/commit/22
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/18735
**[Test build #79966 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/79966/testReport)**
for PR 18735 at commit
[`14f857e`](https://github.com/apache/spark/commit/14
Github user tgravescs commented on a diff in the pull request:
https://github.com/apache/spark/pull/18735#discussion_r129613952
--- Diff: docs/configuration.md ---
@@ -635,7 +635,10 @@ Apart from these, the following properties are also
available, and may be useful
spark.shu
Github user tgravescs commented on the issue:
https://github.com/apache/spark/pull/18735
thanks for updating, minor formatting thing I forgot to mention before,
otherwise looks good.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHu
Github user kiszk commented on the issue:
https://github.com/apache/spark/pull/18704
ping @rxin
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the f
Github user kiszk commented on the issue:
https://github.com/apache/spark/pull/18468
ping @cloud-fan, @rxin
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so,
Github user sethah commented on the issue:
https://github.com/apache/spark/pull/18315
ping! https://github.com/apache/spark/pull/18305 was merged. This can
proceed.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your
Github user gatorsmile commented on the issue:
https://github.com/apache/spark/pull/18709
retest this please
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/18709
**[Test build #79967 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/79967/testReport)**
for PR 18709 at commit
[`4e71b66`](https://github.com/apache/spark/commit/4e
Github user rxin commented on the issue:
https://github.com/apache/spark/pull/18702
LGTM too.
Merging in master.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled
Github user asfgit closed the pull request at:
https://github.com/apache/spark/pull/18702
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is ena
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/18645
**[Test build #79968 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/79968/testReport)**
for PR 18645 at commit
[`82b51dc`](https://github.com/apache/spark/commit/82
Github user srowen commented on the issue:
https://github.com/apache/spark/pull/18645
I believe the last errors were essentially the same issue discussed in
json4s here:
https://github.com/json4s/json4s/issues/227
I suspect that it's down to a change in the effective setti
Github user jiangxb1987 commented on a diff in the pull request:
https://github.com/apache/spark/pull/18711#discussion_r129633550
--- Diff: docs/configuration.md ---
@@ -1106,7 +1106,7 @@ Apart from these, the following properties are also
available, and may be useful
para
Github user witgo commented on the issue:
https://github.com/apache/spark/pull/17882
I'm very sorry, I haven't taken the time to update this code recently.
@vanzin , thank you for your work. I'll close this PR.
---
If your project is set up for it, you can reply to this email and
Github user witgo closed the pull request at:
https://github.com/apache/spark/pull/17882
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enab
Github user cloud-fan commented on the issue:
https://github.com/apache/spark/pull/18694
IMO the cleanup hook is a workaround for the limitation of iterator model:
although the parent knows when to release resource of its child, but there is
no way to notify the child via iterator.
Github user cloud-fan commented on the issue:
https://github.com/apache/spark/pull/18503
retest this please
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so,
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/18503
**[Test build #79969 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/79969/testReport)**
for PR 18503 at commit
[`cc467de`](https://github.com/apache/spark/commit/cc
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/16630
**[Test build #79970 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/79970/testReport)**
for PR 16630 at commit
[`7281b77`](https://github.com/apache/spark/commit/72
Github user devaraj-kavali commented on the issue:
https://github.com/apache/spark/pull/18708
@vanzin I have updated the changes, can you check and validate the change?
Thanks
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as we
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/18679
**[Test build #79971 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/79971/testReport)**
for PR 18679 at commit
[`9b88297`](https://github.com/apache/spark/commit/9b
1 - 100 of 260 matches
Mail list logo
