[
https://issues.apache.org/jira/browse/HADOOP-16254?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17494310#comment-17494310
]
Owen O'Malley commented on HADOOP-16254:
----------------------------------------
This feature is a blocker for us at LinkedIn. We can (and do) have an internal
fork, but we need a way for Hadoop RBF to get the real client ip address. This
is critical for a few reasons:
* The data locality on read is managed by the NameNode based on the client ip
address.
* The write pipeline is managed by the NameNode again based on the client ip
address.
* The HDFS audit log needs to contain the actual client IP address and not the
routers' address.
* If we were actually using client ip filtering, it would be required for that
also.
I think the proposed option to only use the parameter if the user is configured
as a proxy is reasonable, especially when tied to the option to limit it to a
fixed range of proxy ip addresses. [~daryn] do you still have concerns about
this approach?
> Add proxy address in IPC connection
> -----------------------------------
>
> Key: HADOOP-16254
> URL: https://issues.apache.org/jira/browse/HADOOP-16254
> Project: Hadoop Common
> Issue Type: New Feature
> Components: ipc
> Reporter: Xiaoqiao He
> Assignee: Xiaoqiao He
> Priority: Blocker
> Attachments: HADOOP-16254.001.patch, HADOOP-16254.002.patch,
> HADOOP-16254.004.patch, HADOOP-16254.005.patch, HADOOP-16254.006.patch,
> HADOOP-16254.007.patch
>
>
> In order to support data locality of RBF, we need to add new field about
> client hostname in the RPC headers of Router protocol calls.
> clientHostname represents hostname of client and forward by Router to
> Namenode to support data locality friendly. See more [RBF Data Locality
> Design|https://issues.apache.org/jira/secure/attachment/12965092/RBF%20Data%20Locality%20Design.pdf]
> in HDFS-13248 and [maillist
> vote|http://mail-archives.apache.org/mod_mbox/hadoop-common-dev/201904.mbox/%3CCAF3Ajax7hGxvowg4K_HVTZeDqC5H=3bfb7mv5sz5mgvadhv...@mail.gmail.com%3E].
--
This message was sent by Atlassian Jira
(v8.20.1#820001)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
