I am a new hadoop user, so please forgive my naivety. >From the examples I have seen thus far, all of the input data for each task is >a file that exists in hdfs. I am writing a program that will dynamically >generate input parameters for each task.
For instance, the generator may generate the input parameters 1, 3, 5, 7, 9, ... After all the jobs start returning, the generator may change the pattern and start generating 2, 4, 6, 8,... until a solution to the problem is found. I do not want to have to create a file that will contain the parameters for the map function, how can I do it programmatically? Thanks -Derek
