[ 
https://issues.apache.org/jira/browse/HDFS-6134?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14096570#comment-14096570
 ] 

Sanjay Radia commented on HDFS-6134:
------------------------------------

bq. If you set up httpfs, it runs using the 'httpfs' user, a HDFS regular user 
configured as proxyuser to interact with HDFS and KMS doing doAs calls
Alejandro , we modified the original design in this Jira so that the NN is not 
a proxy for the keys but instead the client get the keys directly from the KMS 
because  the best practice in encryption  is to eliminate  proxies (see Owen's 
comment of June 11).  With your proposal for  httpfs, the httpfs server is a 
proxy to  get the keys. Perhaps we are approaching the problem wrong. Consider 
the following alternative: let webhdfs and httpfs simply send the encrypted raw 
data to the client. For  the hdfs-native filesystem,  the encryption and 
decryption happens on the client side;  we should consider the same for the 
rest protocol. Clearly it requires more code on the rest client side.

BTW the webhdfs-fileSystem (as opposed to the  rest protocol that is discussed 
about) has a client side library that can mimic the  hdfs filesystem's client 
side.

> Transparent data at rest encryption
> -----------------------------------
>
>                 Key: HDFS-6134
>                 URL: https://issues.apache.org/jira/browse/HDFS-6134
>             Project: Hadoop HDFS
>          Issue Type: New Feature
>          Components: security
>    Affects Versions: 3.0.0, 2.3.0
>            Reporter: Alejandro Abdelnur
>            Assignee: Charles Lamb
>         Attachments: HDFS-6134.001.patch, HDFS-6134.002.patch, 
> HDFS-6134_test_plan.pdf, HDFSDataatRestEncryption.pdf, 
> HDFSDataatRestEncryptionProposal_obsolete.pdf, 
> HDFSEncryptionConceptualDesignProposal-2014-06-20.pdf
>
>
> Because of privacy and security regulations, for many industries, sensitive 
> data at rest must be in encrypted form. For example: the health­care industry 
> (HIPAA regulations), the card payment industry (PCI DSS regulations) or the 
> US government (FISMA regulations).
> This JIRA aims to provide a mechanism to encrypt HDFS data at rest that can 
> be used transparently by any application accessing HDFS via Hadoop Filesystem 
> Java API, Hadoop libhdfs C library, or WebHDFS REST API.
> The resulting implementation should be able to be used in compliance with 
> different regulation requirements.



--
This message was sent by Atlassian JIRA
(v6.2#6252)

Reply via email to