[jira] [Commented] (MAPREDUCE-4552) Encryption: Add support for PGP Encryption
[ https://issues.apache.org/jira/browse/MAPREDUCE-4552?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13763326#comment-13763326 ] Haijia Zhou commented on MAPREDUCE-4552: Is this feature included in any stable adoop version yet? Encryption: Add support for PGP Encryption --- Key: MAPREDUCE-4552 URL: https://issues.apache.org/jira/browse/MAPREDUCE-4552 Project: Hadoop Map/Reduce Issue Type: Sub-task Components: security Reporter: Benoy Antony Assignee: Benoy Antony Attachments: MR_4552_1_1.patch, MR_4552_trunk.patch Provide support for PGP encryption by implementing Encrypter and Decrypter interfaces defined in MAPREDUCE-4450. This can be used by the cluster to protect the job secrets. This also be used map reduce jobs to encrypt/decrypt data. Add PGPCodec as a CompressionCodec so that encrypted data can be processed transparently like compressed data . The aliases to the keys can be specified as part of Job. Based on PGPCodec, a number of utilities are provided to encrypt, decrypt the data in cluster. They include 1.DistributedSplitter – Split an encrypted file into smaller files. 2.DistributedEncrypter – encrypt files in a cluster. 3.DistributedDecrypter – decrypt encrypted files in a cluster. 4.DistributedRecrypter – decrypt an encrypted file and encrypt it with another key. Uitlities are added to encrypt/decrypt files in local file system 1.Genkey - Generate an asymmetric key pair (public and private keys) of a specified strength 2.Encrypt - Encrypt a file 3.Decrypt – Decrypt a file Added as a contrib project - hadoop-crypto. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (MAPREDUCE-4552) Encryption: Add support for PGP Encryption
[ https://issues.apache.org/jira/browse/MAPREDUCE-4552?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13579727#comment-13579727 ] efan lee commented on MAPREDUCE-4552: - How to store and protect the key file? Encryption: Add support for PGP Encryption --- Key: MAPREDUCE-4552 URL: https://issues.apache.org/jira/browse/MAPREDUCE-4552 Project: Hadoop Map/Reduce Issue Type: Sub-task Components: security Reporter: Benoy Antony Assignee: Benoy Antony Attachments: MR_4552_1_1.patch, MR_4552_trunk.patch Provide support for PGP encryption by implementing Encrypter and Decrypter interfaces defined in MAPREDUCE-4450. This can be used by the cluster to protect the job secrets. This also be used map reduce jobs to encrypt/decrypt data. Add PGPCodec as a CompressionCodec so that encrypted data can be processed transparently like compressed data . The aliases to the keys can be specified as part of Job. Based on PGPCodec, a number of utilities are provided to encrypt, decrypt the data in cluster. They include 1.DistributedSplitter – Split an encrypted file into smaller files. 2.DistributedEncrypter – encrypt files in a cluster. 3.DistributedDecrypter – decrypt encrypted files in a cluster. 4.DistributedRecrypter – decrypt an encrypted file and encrypt it with another key. Uitlities are added to encrypt/decrypt files in local file system 1.Genkey - Generate an asymmetric key pair (public and private keys) of a specified strength 2.Encrypt - Encrypt a file 3.Decrypt – Decrypt a file Added as a contrib project - hadoop-crypto. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (MAPREDUCE-4552) Encryption: Add support for PGP Encryption
[ https://issues.apache.org/jira/browse/MAPREDUCE-4552?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13568325#comment-13568325 ] Benoy Antony commented on MAPREDUCE-4552: - Sure. I'll decompose this into smaller patches. What you mentioned about directory structure is true. If that's going to change, then this feature is going to break. I would need some guidance on this. Once I break it this into smaller patches, we will review that piece separately. Encryption: Add support for PGP Encryption --- Key: MAPREDUCE-4552 URL: https://issues.apache.org/jira/browse/MAPREDUCE-4552 Project: Hadoop Map/Reduce Issue Type: Sub-task Components: security Reporter: Benoy Antony Assignee: Benoy Antony Attachments: MR_4552_1_1.patch, MR_4552_trunk.patch Provide support for PGP encryption by implementing Encrypter and Decrypter interfaces defined in MAPREDUCE-4450. This can be used by the cluster to protect the job secrets. This also be used map reduce jobs to encrypt/decrypt data. Add PGPCodec as a CompressionCodec so that encrypted data can be processed transparently like compressed data . The aliases to the keys can be specified as part of Job. Based on PGPCodec, a number of utilities are provided to encrypt, decrypt the data in cluster. They include 1.DistributedSplitter – Split an encrypted file into smaller files. 2.DistributedEncrypter – encrypt files in a cluster. 3.DistributedDecrypter – decrypt encrypted files in a cluster. 4.DistributedRecrypter – decrypt an encrypted file and encrypt it with another key. Uitlities are added to encrypt/decrypt files in local file system 1.Genkey - Generate an asymmetric key pair (public and private keys) of a specified strength 2.Encrypt - Encrypt a file 3.Decrypt – Decrypt a file Added as a contrib project - hadoop-crypto. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (MAPREDUCE-4552) Encryption: Add support for PGP Encryption
[ https://issues.apache.org/jira/browse/MAPREDUCE-4552?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13565435#comment-13565435 ] Daryn Sharp commented on MAPREDUCE-4552: Is it possible to decompose this patch further? It's very interesting work but overwhelming to review. I am a bit concerned about multiple places walking a directory structure. It also seems like it's making assumptions about MR's directory layout (ex. _temporary) which creates a fragile coupling. This will break if MR's path layout changes, and I know there's been talk of changing how commit works. On the surface, the pattern matches against filenames is worrisome that assumption are again being made. Encryption: Add support for PGP Encryption --- Key: MAPREDUCE-4552 URL: https://issues.apache.org/jira/browse/MAPREDUCE-4552 Project: Hadoop Map/Reduce Issue Type: Sub-task Components: security Reporter: Benoy Antony Assignee: Benoy Antony Attachments: MR_4552_1_1.patch, MR_4552_trunk.patch Provide support for PGP encryption by implementing Encrypter and Decrypter interfaces defined in MAPREDUCE-4450. This can be used by the cluster to protect the job secrets. This also be used map reduce jobs to encrypt/decrypt data. Add PGPCodec as a CompressionCodec so that encrypted data can be processed transparently like compressed data . The aliases to the keys can be specified as part of Job. Based on PGPCodec, a number of utilities are provided to encrypt, decrypt the data in cluster. They include 1.DistributedSplitter – Split an encrypted file into smaller files. 2.DistributedEncrypter – encrypt files in a cluster. 3.DistributedDecrypter – decrypt encrypted files in a cluster. 4.DistributedRecrypter – decrypt an encrypted file and encrypt it with another key. Uitlities are added to encrypt/decrypt files in local file system 1.Genkey - Generate an asymmetric key pair (public and private keys) of a specified strength 2.Encrypt - Encrypt a file 3.Decrypt – Decrypt a file Added as a contrib project - hadoop-crypto. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
