Locks in hadoop

2009-01-15 Thread Sagar Naik

I would like to implement a  locking mechanism across the hdfs cluster
I assume there is no inherent support for it

I was going to do it with files. According to my knowledge, file 
creation is an atomic operation. So the file-based lock should work.
I need to think through with all conditions but if some one has better 
idea/solution, pl share


Thanks
-Sagar



Re: Locks in hadoop

2009-01-15 Thread Konstantin Shvachko

Did you look at Zookeeper?
Thanks,
--Konstantin

Sagar Naik wrote:

I would like to implement a  locking mechanism across the hdfs cluster
I assume there is no inherent support for it

I was going to do it with files. According to my knowledge, file 
creation is an atomic operation. So the file-based lock should work.
I need to think through with all conditions but if some one has better 
idea/solution, pl share


Thanks
-Sagar