[ https://issues.apache.org/jira/browse/MAPREDUCE-4552?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13565435#comment-13565435 ]
Daryn Sharp commented on MAPREDUCE-4552: ---------------------------------------- Is it possible to decompose this patch further? It's very interesting work but overwhelming to review. I am a bit concerned about multiple places walking a directory structure. It also seems like it's making assumptions about MR's directory layout (ex. _temporary) which creates a fragile coupling. This will break if MR's path layout changes, and I know there's been talk of changing how commit works. On the surface, the pattern matches against filenames is worrisome that assumption are again being made. > Encryption: Add support for PGP Encryption > ------------------------------------------- > > Key: MAPREDUCE-4552 > URL: https://issues.apache.org/jira/browse/MAPREDUCE-4552 > Project: Hadoop Map/Reduce > Issue Type: Sub-task > Components: security > Reporter: Benoy Antony > Assignee: Benoy Antony > Attachments: MR_4552_1_1.patch, MR_4552_trunk.patch > > > Provide support for PGP encryption by implementing Encrypter and Decrypter > interfaces defined in MAPREDUCE-4450. This can be used by the cluster to > protect the job secrets. This also be used map reduce jobs to encrypt/decrypt > data. > Add PGPCodec as a CompressionCodec so that encrypted data can be processed > transparently like compressed data . The aliases to the keys can be specified > as part of Job. > Based on PGPCodec, a number of utilities are provided to encrypt, decrypt the > data in cluster. They include > 1. DistributedSplitter – Split an encrypted file into smaller files. > 2. DistributedEncrypter – encrypt files in a cluster. > 3. DistributedDecrypter – decrypt encrypted files in a cluster. > 4. DistributedRecrypter – decrypt an encrypted file and encrypt it with > another key. > Uitlities are added to encrypt/decrypt files in local file system > 1. Genkey - Generate an asymmetric key pair (public and private keys) of a > specified strength > 2. Encrypt - Encrypt a file > 3. Decrypt – Decrypt a file > Added as a contrib project - hadoop-crypto. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira