Re: Task tracker archive contains too many files

2009-02-05 Thread Andrew
On Wednesday 04 February 2009 14:25:44 Amareshwari Sriramadasu wrote: Now, there is no way to stop DistributedCache from stopping unpacking of jars. I think it should have an option (thru configuration) whether to unpack or not. Can you raise a jira for the same? OK!

Re: Task tracker archive contains too many files

2009-02-04 Thread Amareshwari Sriramadasu
Andrew wrote: I've noticed that task tracker moves all unpacked jars into ${hadoop.tmp.dir}/mapred/local/taskTracker. We are using a lot of external libraries, that are deployed via -libjars option. The total number of files after unpacking is about 20 thousands. After running a number of

Task tracker archive contains too many files

2009-02-04 Thread Andrew
I've noticed that task tracker moves all unpacked jars into ${hadoop.tmp.dir}/mapred/local/taskTracker. We are using a lot of external libraries, that are deployed via -libjars option. The total number of files after unpacking is about 20 thousands. After running a number of jobs, tasks start