Hadoop Script

[Eric]

Has anyone written a script for whole web crawling using Hadoop? The  
script for nutch doesn't work since the data is inside the HDFS (tail - 
f wont work with this).

Thanks,
Eric