[
https://issues.apache.org/jira/browse/HADOOP-15327?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17367912#comment-17367912
]
Szilard Nemeth edited comment on HADOOP-15327 at 6/24/21, 7:52 PM:
-------------------------------------------------------------------
Hey [~weichiu],
Thanks for putting the excerpt here. This could be fixed in parallel, I would
be glad if you could point me to the config that needs to be changed.
Currently, I'm working on the test issues produced by the build that ran
against patch003:
hadoop.mapred.TestReduceFetchFromPartialMem
hadoop.mapred.TestReduceFetch
There are jiras related to these tests but checked the logs and saw very
suspicious things and it pointed me to a code defect.
I will upload a next patch soon along with explanation of what has been changed
since patch004.
Hopefully, this can be the last one and I can finally start testing on a
cluster.
Will also make sure of creating proper manual testing documentation +
collecting the test evidence.
I wouldn't expect any production issues (fingers crossed) as test coverage is
quite good and while I have been fixing the tests, I gained a lot of code
knowledge, almost being familiar with the ShuffleHandler inside and out.
was (Author: snemeth):
Hey [~weichiu],
Thanks for putting the exceprt here. This could be fixed in parallel, I would
be glad if you could point me to the config that needs to be changed.
Currently, I'm working on the test issues produced by the build that ran
against patch003:
hadoop.mapred.TestReduceFetchFromPartialMem
hadoop.mapred.TestReduceFetch
There are jiras related to these tests but checked the logs and saw very
suspicious things and it pointed me to a code defect.
I will upload a next patch soon along with explanation of what has been changed
since patch004.
Hopefully, this can be the last one and I can finally start testing on a
cluster.
Will also make sure of creating proper manual testing documentation +
collecting the test evidence.
I wouldn't expect any production issues (fingers crossed) as test coverage is
quite good and while I have been fixing the tests, I gained a lot of code
knowledge, almost being familiar with the ShuffleHandler inside and out.
> Upgrade MR ShuffleHandler to use Netty4
> ---------------------------------------
>
> Key: HADOOP-15327
> URL: https://issues.apache.org/jira/browse/HADOOP-15327
> Project: Hadoop Common
> Issue Type: Sub-task
> Reporter: Xiaoyu Yao
> Assignee: Szilard Nemeth
> Priority: Major
> Attachments: HADOOP-15327.001.patch, HADOOP-15327.002.patch,
> HADOOP-15327.003.patch, HADOOP-15327.004.patch,
> getMapOutputInfo_BlockingOperationException_awaitUninterruptibly.log
>
>
> This way, we can remove the dependencies on the netty3 (jboss.netty)
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
