Dhruv, Just a warning, before you want to lock yourself to new apis:
Yes new APIs are preferrable but it is not always possible to use them because 0.20.2 lacks _a lot_ in terms of bare necessities in new api realm . (multiple inputs/ outputs come to mind at once). I think i did weasel my way out of those in some cases but i did not test it at scale yet, it is certainly not an official way to do it. Either way it's probably not worth it for anything beyond sheer basic MR functionality until we switch to something that actually does have the 'new api' because 0.20.2 has some very much truncated version which is very far from complete. -d On Fri, May 27, 2011 at 3:19 AM, Isabel Drost <[email protected]> wrote: > On 18.05.2011 Dhruv Kumar wrote: >> For the GSoC project which version of Hadoop's API should I follow? > > Try to use the new M/R apis where possible - we had the same discussion in an > earlier thread on spectral clustering, in addition Sean just opened an issue > concerning Upgrading to newer Hadoop versions, you can take a look there as > well. > > Isabel >
