Re: encryption

2012-02-12 Thread Joshua Smith
Koert- I saw a presentation at Hadoop World 2011 where some guys were co-opting Hadoop's compression hooks to do encryption. http://www.cloudera.com/videos/hadoop-world-2011-presentation-video-security-considerations-for-hadoop-deployments?form=complete http://www.cloudera.com/resource/hadoop-wo

RE: encryption

2012-01-20 Thread Tim Broberg
king the lowest number you can get away with on the list. I'm not a hadoop expert yet, but what you found is the best approach I'm aware of to #2. - Tim. From: Koert Kuipers [ko...@tresata.com] Sent: Friday, January 20, 2012 3:55 PM To: hdfs-user@hado

Re: encryption

2012-01-20 Thread Koert Kuipers
agreed. many forms of data require encryption to be stored on any system. i do know now the exact motivation(s) for that, but i do know we have to conform to this. my assumption was that i want to protect against access to the data by someone stealing the harddrives or the servers. so physical ac

Re: encryption

2012-01-20 Thread Ted Dunning
Or just people who find your disks at the second-hand shop. http://www.wavy.com/dpp/news/military/tricare-beneficiaries'-data-stolen On Fri, Jan 20, 2012 at 3:36 PM, Tim Broberg wrote: > I guess the first question is the threat model: What kind of bad guy are > you trying to keep out? Is Ukrai

RE: encryption

2012-01-20 Thread Tim Broberg
I guess the first question is the threat model: What kind of bad guy are you trying to keep out? Is Ukrainian hackers? Local users, but the servers are locked up? Is it somebody who has physical access to the machines? Does the information have to be secure forever or just for a while? Once you

RE: encryption

2012-01-20 Thread Tim Broberg
me.com] Sent: Friday, January 20, 2012 1:14 PM To: hdfs-user@hadoop.apache.org Subject: Re: encryption Koert, Slightly related but not exactly is a Tahoe-LAFS plugin for hadoop http://code.google.com/p/hadoop-lafs I believe there has been discussion in this list on an encryption codec. C On Jan 20, 201

Re: encryption

2012-01-20 Thread Mac Noland
Right or wrong, we pretty much follow an architectural model to encrypt data before it gets to the storage system and decrypt it after pulling it off.  While it's some extra gear in your data center, it's given us flexibility to use whatever storage system we wanted to use.  HDFS, NAS, SAN, Lo

Re: encryption

2012-01-20 Thread Charles Earl
Koert, Slightly related but not exactly is a Tahoe-LAFS plugin for hadoop http://code.google.com/p/hadoop-lafs I believe there has been discussion in this list on an encryption codec. C On Jan 20, 2012, at 4:09 PM, Koert Kuipers wrote: > Does anyone know of any work/ideas to encrypt data stored