Thanks, Nathan Marz Rapleaf
We find that after about 400 to 500 jobs run in succession on our
Hadoop cluster, the disk space on each machine is quickly used up by
logs for all the tasks. What do people do to manage these logs? Does
Hadoop have anything built in for managing them? Or do we have to
delete/move the logs with a home-cooked method?
- What do you do with task logs? Nathan Marz
- Re: What do you do with task logs? Alex Loddengaard
- Re: What do you do with task logs? Edward Capriolo
