Right or wrong, we pretty much follow an architectural model to encrypt data before it gets to the storage system and decrypt it after pulling it off.
While it's some extra gear in your data center, it's given us flexibility to use whatever storage system we wanted to use. HDFS, NAS, SAN, Local, Oracle, MSSQL, MySQL. We use this appliance. http://www.safenet-inc.com/products/data-protection/data-encryption-control/datasecure/ No, I don't work for Safe Net. ________________________________ From: Koert Kuipers <ko...@tresata.com> To: hdfs-user@hadoop.apache.org Sent: Friday, January 20, 2012 3:09 PM Subject: encryption Does anyone know of any work/ideas to encrypt data stored on hdfs? Ideally both temporary files and final files would be encrypted. Or there would have to be a mechanism in hdfs to securely wipe temporary files, like shred in linux. So far this is what i found: https://github.com/geisbruch/HadoopCryptoCompressor Best, Koert