[
https://issues.apache.org/jira/browse/HDFS-7966?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14578303#comment-14578303
]
Haohui Mai commented on HDFS-7966:
----------------------------------
Sorry for the late reply. Get caught up by multiple things.
bq. 2 - If you're using your own payload encoding then tagging flush points in
a streaming RPC seems pretty trivial.
Thanks very much for the information. Based on the information it looks like
that it is possible to use a standard GRPC client to talk the new DTP protocol.
It would save a lot of effort on implementing a client of the DTP protocol.
I really appreciate if there are any pointers to the client / server code.
bq. Generally interested in progress if any. No harm if none. Thanks.
Currently [~Apache9] is making progress on HDFS-8515 and HDFS-8471. I have been
closely working with [~Apache9] on this. Hopefully we can get things committed
soon and continue to make progress.
> New Data Transfer Protocol via HTTP/2
> -------------------------------------
>
> Key: HDFS-7966
> URL: https://issues.apache.org/jira/browse/HDFS-7966
> Project: Hadoop HDFS
> Issue Type: New Feature
> Reporter: Haohui Mai
> Assignee: Qianqian Shi
> Labels: gsoc, gsoc2015, mentor
> Attachments: GSoC2015_Proposal.pdf
>
>
> The current Data Transfer Protocol (DTP) implements a rich set of features
> that span across multiple layers, including:
> * Connection pooling and authentication (session layer)
> * Encryption (presentation layer)
> * Data writing pipeline (application layer)
> All these features are HDFS-specific and defined by implementation. As a
> result it requires non-trivial amount of work to implement HDFS clients and
> servers.
> This jira explores to delegate the responsibilities of the session and
> presentation layers to the HTTP/2 protocol. Particularly, HTTP/2 handles
> connection multiplexing, QoS, authentication and encryption, reducing the
> scope of DTP to the application layer only. By leveraging the existing HTTP/2
> library, it should simplify the implementation of both HDFS clients and
> servers.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
