[
https://issues.apache.org/jira/browse/TEZ-2450?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14547773#comment-14547773
]
Rajesh Balamohan commented on TEZ-2450:
---------------------------------------
Thanks for the review [~sseth]. Canceling the patch as onBodyPartReceived()
implementation would need more thinking, as it would impact the way MapOutputs
are generated. It is possible to stream the contents of onBodyPartReceived to
file. But even for that decision (file/mem), we need to read ShuffleHeader from
inputStream which does not look like a straight forward approach using
onBodyPartReceived. It appears that response.getResponseBodyAsStream() is
wrapping the bytes in inputstream, which wouldn't be much useful for large
downloads.
> support async http clients in ordered & unordered inputs
> --------------------------------------------------------
>
> Key: TEZ-2450
> URL: https://issues.apache.org/jira/browse/TEZ-2450
> Project: Apache Tez
> Issue Type: Improvement
> Reporter: Rajesh Balamohan
> Assignee: Rajesh Balamohan
> Attachments: TEZ-2450.1.patch, TEZ-2450.WIP.patch
>
>
> It will be helpful to switch between JDK & other async http impls. For LLAP
> scenarios, it would be useful to make http clients interruptible which is
> supported in async libraries.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
