[
https://issues.apache.org/jira/browse/TEZ-2450?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Rajesh Balamohan updated TEZ-2450:
----------------------------------
Attachment: TEZ-2450.2.patch
[~sseth] - Can you plz have a look at the .2 patch when you find time?
- Rebased after TEZ-2454 went in to master.
- Using asynchttpclient 1.8.22.
- Tested couple of jobs at 10 TB scale. Under heavy load, sometimes client does
not honor the connection timeout and gets stuck in
BodyDeferringAsyncHandler.getResponse().headerReceived.await(). Possible bug in
their implementation. It provides an option to have custom handlers. Added
TezBodyDeferringAsyncHandler that is same as BodyDeferringAsyncHandler with the
fix in getResponse() to handle the timeout gracefully.
- Some of the connection manager default settings need to be tweaked in future
based on further testing.
- Added tests in TestHttpConnection and in TestFetcher for exception codepaths.
- Added test in TestSecureShuffle for async client.
> support async http clients in ordered & unordered inputs
> --------------------------------------------------------
>
> Key: TEZ-2450
> URL: https://issues.apache.org/jira/browse/TEZ-2450
> Project: Apache Tez
> Issue Type: Improvement
> Reporter: Rajesh Balamohan
> Assignee: Rajesh Balamohan
> Attachments: TEZ-2450.1.patch, TEZ-2450.2.WIP.patch,
> TEZ-2450.2.patch, TEZ-2450.WIP.patch
>
>
> It will be helpful to switch between JDK & other async http impls. For LLAP
> scenarios, it would be useful to make http clients interruptible which is
> supported in async libraries.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
