it sounds to me like you might want to split what you want to do up into two separate jobs entirely... i don't quite understand your use case since the point of hadoop is to spread your load as much (and haphazardly!) as possible.
-mike On Wed, Dec 16, 2009 at 3:43 PM, Ahmad Ali Iqbal <[email protected]> wrote: > Hi All, > > I am interested to know that can we use hadoop for applications where they > need more control over the data and it can specify which node will do which > part of the processing or the storage. For instance, suppose that I have two > data files (datasets, say 1 and 2) and setup a hadoop with two datanodes (A > and B) in a distributed cache, can I specify dataset 1 should load on node A > and dataset 2 should load on node B? Also I have two tasks (a and b), is it > possible to perform task a on node A and task b on node B? > > In other words, I want to supply a pattern of operation file (specifying > store and operation tasks) to hadoop to perform, will it be possible? If it > is, I would appreciate a link discussing this or if a sample > code/application doing this. > > > Thanks a lot, > > -- > Ahmad >
