[ https://issues.apache.org/jira/browse/MAPREDUCE-4491?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13565111#comment-13565111 ]
Jerry Chen commented on MAPREDUCE-4491: --------------------------------------- [~benoyantony] Hi Benoy, I am glad that you can working on this again and I was thinking about this too. And one thing that I could think of is that the source code of the encryption feature actually span two hadoop projects: Hadoop Common and Map Reduce. We may need a hadoop common Jira entry to submit the framework and codec implementations which is mostly under the package org.apache.hadoop.io.crypto under hadoop-common; and put map reduce side things at this jira. Based on these two jira entries, we can further split subtasks if needed. What do you think as to this? Jerry > Encryption and Key Protection > ----------------------------- > > Key: MAPREDUCE-4491 > URL: https://issues.apache.org/jira/browse/MAPREDUCE-4491 > Project: Hadoop Map/Reduce > Issue Type: New Feature > Components: documentation, security, task-controller, tasktracker > Reporter: Benoy Antony > Assignee: Benoy Antony > Attachments: crypto_abstractions.zip, Hadoop_Encryption.pdf, > Hadoop_Encryption.pdf > > > When dealing with sensitive data, it is required to keep the data encrypted > wherever it is stored. Common use case is to pull encrypted data out of a > datasource and store in HDFS for analysis. The keys are stored in an external > keystore. > The feature adds a customizable framework to integrate different types of > keystores, support for Java KeyStore, read keys from keystores, and transport > keys from JobClient to Tasks. > The feature adds PGP encryption as a codec and additional utilities to > perform encryption related steps. > The design document is attached. It explains the requirement, design and use > cases. > Kindly review and comment. Collaboration is very much welcome. > I have a tested patch for this for 1.1 and will upload it soon as an initial > work for further refinement. > Update: The patches are uploaded to subtasks. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira