Re: Does anyone have any experience with running a Map/Red node that is not also a DFS node?

2008-01-20 Thread Allen Wittenauer
On 1/18/08 3:29 PM, Jason Venner [EMAIL PROTECTED] wrote: We were thinking of doing this with some machines that do not have decent disks but have plenty of netbandwidth. We were doing it for a while, in particular for our data loaders* but that was months and months ago. I

Re: Does anyone have any experience with running a Map/Red node that is not also a DFS node?

2008-01-20 Thread Ted Dunning
We effectively have this situation on a significant fraction of our work-load as well. Much of our data is summarized hourly and is encrypted and compressed which makes it unsplittable. This means that the map processes are often not local to the data since the data is typically spread only to