Re: Hadoop-Git-Eclipse

2012-06-18 Thread Prajakta Kalmegh
Hi Harsh I can actually run the jobs (and browse them on localhost:8088) when executed from command line. The same program gives me problems from eclipse. :( Moreover, I cannot even browse DFS locations from eclipse (indigo). I am using hadoop-0.20.3-dev-eclipse-plugin.jar and following steps fro

Re: Hadoop-Git-Eclipse

2012-06-15 Thread Harsh J
Hey, The presence of deprecated properties should not really hamper your submissions. The config for YARN (pseudo or fully distributed) I usually follow are all listed at the links I provided earlier. When running programs from within the IDE, I place the directory they are contained in onto my la

Re: Hadoop-Git-Eclipse

2012-06-15 Thread Prajakta Kalmegh
Hi Harsh You were right - it was executed via the LocalJobRunner. What settings do I need to change to ensure it goes through RM/NM? I did specify to use the yarn framework in the mapred-site.xml. The eclipse console even shows to check http://localhost:8080 to track job progress. I will again cr

Re: Hadoop-Git-Eclipse

2012-06-14 Thread Prajakta Kalmegh
Hi Shant Sorry for the delay in reply (I was not well). Did you manage to install using Shaswat's video? The video gives good demo for setting up basic Mapreduce programming environment. If you need steps for cloning and setting up Hadoop in Eclipse, please follow this link.

Re: Hadoop-Git-Eclipse

2012-06-14 Thread shashwat shriparv
Follow this video...: http://www.youtube.com/watch?v=TavehEdfNDk On Thu, Jun 14, 2012 at 10:14 AM, shant. wrote: > Hi Prajakta, > > can u please tell me the steps to do MapReduce programming using Eclipse . > I really appreciate.. ur help. i m new to hadoop . want to learn > > thanks > s

Re: Hadoop-Git-Eclipse

2012-06-13 Thread shant.....
Hi Prajakta, can u please tell me the steps to do MapReduce programming using Eclipse . I really appreciate.. ur help. i m new to hadoop . want to learn thanks shant On Thu, Jun 7, 2012 at 6:48 AM, Prajakta Kalmegh wrote: > Hi > > I have done MapReduce programming using Eclipse before but now

Re: Hadoop-Git-Eclipse

2012-06-13 Thread Prajakta Kalmegh
Hi Harsh Appreciate the response. I was able to configure and implement basic JUnits within eclipse and get some code running. Still getting familiar with the new YARN and federation architecture. I was, however, not able to check the MR jobs submitted within eclipse for a sample WordCount progra

Re: Hadoop-Git-Eclipse

2012-06-13 Thread Harsh J
Hi Prajakta, I have Eclipse setup with M2E plugins. And once thats done, I merely clone a repo and import projects in via M2E's "Import existing maven projects" feature. This seems to work just fine for apache/hadoop's trunk. On Thu, Jun 7, 2012 at 5:18 PM, Prajakta Kalmegh wrote: > Hi > > I hav

Hadoop-Git-Eclipse

2012-06-07 Thread Prajakta Kalmegh
Hi I have done MapReduce programming using Eclipse before but now I need to learn the Hadoop code internals for one of my projects. I have forked Hadoop from github (https://github.com/apache/hadoop-common ) and need to configure it to work with Eclipse. All the links I could find list steps