We find that after about 400 to 500 jobs run in succession on our Hadoop cluster, the disk space on each machine is quickly used up by logs for all the tasks. What do people do to manage these logs? Does Hadoop have anything built in for managing them? Or do we have to delete/move the logs with a home-cooked method?

Thanks,
Nathan Marz
Rapleaf

Reply via email to