Hi, I am new to Hadoop, I installed hadoop on single node and running HDFS and YARN. I have written map reducer program in python but when I execute this, the command hangs or struck.
/opt/hadoop/hadoop-2.6.0>./bin/hadoop jar /opt/hadoop/hadoop-2.6.0/share/hadoop/tools/lib/hadoop-streaming-2.6.0.jar -mapper /Users/Hadoop/Documents/Python_MR/wcMapper.py -reducer /Users/Hadoop/Documents/Python_MR/wcReducer.py -input /var/bigdata/input/movies.csv -output /var/bigdata/output -file /Users/Hadoop/Documents/Python_MR/wcMapper.py -file /Users/Hadoop/Documents/Python_MR/wcReducer.py 15/09/25 01:30:02 WARN streaming.StreamJob: -file option is deprecated, please use generic option -files instead. 15/09/25 01:30:03 WARN util.NativeCodeLoader: Unable to load native-hadoop library for your platform... using builtin-java classes where applicable packageJobJar: [/Users/Hadoop/Documents/Python_MR/wcMapper.py, /Users/Hadoop/Documents/Python_MR/wcReducer.py, /var/folders/24/pw5x8fqs6zn5pz4xfd9g80m80000gp/T/hadoop-unjar4491124020000582375/] [] /var/folders/24/pw5x8fqs6zn5pz4xfd9g80m80000gp/T/streamjob6794242123082786949.jar tmpDir=null 15/09/25 01:30:03 INFO client.RMProxy: Connecting to ResourceManager at localhost/127.0.0.1:8032 15/09/25 01:30:04 INFO client.RMProxy: Connecting to ResourceManager at localhost/127.0.0.1:8032 15/09/25 01:30:05 INFO mapred.FileInputFormat: Total input paths to process : 1 15/09/25 01:30:05 INFO mapreduce.JobSubmitter: number of splits:2 15/09/25 01:30:05 INFO mapreduce.JobSubmitter: Submitting tokens for job: job_1443124681722_0001 15/09/25 01:30:05 INFO impl.YarnClientImpl: Submitted application application_1443124681722_0001 15/09/25 01:30:05 INFO mapreduce.Job: The url to track the job: http://santhoshs-MacBook-Pro.local:8088/proxy/application_1443124681722_0001/ 15/09/25 01:30:05 INFO mapreduce.Job: Running job: job_1443124681722_0001 . . . In the GUI, the Tracking UI is set to ‘UNASSIGNED’. Please let me know your expert comments !!!! Regards, santhosh
