[ 
https://issues.apache.org/jira/browse/HADOOP-15327?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17312744#comment-17312744
 ] 

Wei-Chiu Chuang commented on HADOOP-15327:
------------------------------------------

Here's my WIP patch for this migration:

https://github.com/jojochuang/hadoop/commits/shuffle_handler_netty4

The TestShuffleHandler is having a few failures.

The testMaxConnections UT failure is apparently caused by either a bad test or 
a behavior change in netty. The test expects connections to be received 
sequentially but connections are actually received in parallel. No order can be 
assumed. 

Other UTs in TestShuffleHandler are caused by socket timeouts. The clients 
receive the header of the response from server, but not the content. I 
suspected it was caused by Channel.write() API where it doesn't automatically 
reflush after write in netty4. I switched to writeAndFlush() but problems still 
persist.

> Upgrade MR ShuffleHandler to use Netty4
> ---------------------------------------
>
>                 Key: HADOOP-15327
>                 URL: https://issues.apache.org/jira/browse/HADOOP-15327
>             Project: Hadoop Common
>          Issue Type: Sub-task
>            Reporter: Xiaoyu Yao
>            Assignee: Wei-Chiu Chuang
>            Priority: Major
>
> This way, we can remove the dependencies on the netty3 (jboss.netty)



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]

Reply via email to