Github user dongjoon-hyun commented on the issue:
https://github.com/apache/spark/pull/18466
Thank you, @wangyum . I'll try.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabl
Github user wangyum commented on the issue:
https://github.com/apache/spark/pull/18466
@dongjoon-hyun Try the following to reproduce, I missed
`spark.serializer=org.apache.spark.serializer.KryoSerializer`, this is my
default config:
```
spark-shell --conf spark.reducer.maxReqS
Github user jinxing64 commented on the issue:
https://github.com/apache/spark/pull/18466
It's great job ! ð
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes
Github user dongjoon-hyun commented on the issue:
https://github.com/apache/spark/pull/18466
Wow, great!
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or
Github user zsxwing commented on the issue:
https://github.com/apache/spark/pull/18466
FYI, I'm fixing the root issue in https://github.com/apache/spark/pull/18472
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your p
Github user dongjoon-hyun commented on the issue:
https://github.com/apache/spark/pull/18466
Thank you, @zsxwing . I agree with both this and #18467 . Please proceed to
disable this.
Since this is not a revert, I just want to know how to check this later
when we recover this featu
Github user zsxwing commented on the issue:
https://github.com/apache/spark/pull/18466
@dongjoon-hyun I have not yet figured out the root cause of this issue. The
major reason to disable it is this feature breaks old shuffle service.
---
If your project is set up for it, you can rep
Github user dongjoon-hyun commented on the issue:
https://github.com/apache/spark/pull/18466
Sorry to bother you guys, but I'm just wondering if I missed something to
see this bug.
```
[hive@hdp26-3 spark]$ bin/spark-shell --master yarn --conf
spark.reducer.maxReqSizeShuffleTo
Github user zsxwing commented on the issue:
https://github.com/apache/spark/pull/18466
@wangyum I submitted #18466 to disable this feature via configuration
instead. You will be the commit author when it's merged.
---
If your project is set up for it, you can reply to this email and
Github user dongjoon-hyun commented on the issue:
https://github.com/apache/spark/pull/18466
Hi, @wangyum .
Is this a regression with2.2? I want to reproduce this in YARN cluster, but
2.1.1 looks okay to me.
```
$ spark-shell --master yarn --conf spark.reducer.maxReqSizeShu
Github user wangyum commented on the issue:
https://github.com/apache/spark/pull/18466
Yes, I reproduce it by Yarn cluster, local mode can't reproduce, It seems
`DownloadCallback` doesn't really work.
---
If your project is set up for it, you can reply to this email and have your
rep
Github user jinxing64 commented on the issue:
https://github.com/apache/spark/pull/18466
@wangyum
Can you reproduce this ?
It would be great if you can give more details.
I cannot reproduce on my local.
---
If your project is set up for it, you can reply to this email and
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/18466
Merged build finished. Test PASSed.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
e
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/18466
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/78901/
Test PASSed.
---
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/18466
**[Test build #78901 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/78901/testReport)**
for PR 18466 at commit
[`9336c15`](https://github.com/apache/spark/commit/9
Github user cloud-fan commented on the issue:
https://github.com/apache/spark/pull/18466
@jinxing64 how hard is it to fix this? if it's hard let's just disable it
for 2.2
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. I
Github user wangyum commented on the issue:
https://github.com/apache/spark/pull/18466
@zsxwing @cloud-fan
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so,
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/18466
**[Test build #78901 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/78901/testReport)**
for PR 18466 at commit
[`9336c15`](https://github.com/apache/spark/commit/93
18 matches
Mail list logo
