Hi,
I implemented a customized input format in Java for a Map Reduce job.
The mapper and reducer classes are implemented in C++, using the Hadoop
Pipes API.
The package documentation for org.apache.hadoop.mapred.pipes states that
The job may consist of any combination of Java and C++
You should use the -pipes option in the command.
For the input format, you can pack it into the hadoop core class jar file,
or put it into the cache file.
2008/4/8, Rahul Sood [EMAIL PROTECTED]:
Hi,
I implemented a customized input format in Java for a Map Reduce job.
The mapper and reducer
I'm invoking hadoop with pipes command:
hadoop pipes -jar mytest.jar -inputformat mytest.PriceInputFormat -conf
conf/mytest.xml -input mgr/in -output mgr/out -program mgr/bin/TestMgr
I tried the -file and -cacheFile options but when either of these is
passed to hadoop pipes, the command just