Hi,
I have setup oozie on one node poc cluster. When I execute example PIG
job shipped with oozie, mapreduce application gets stuck forever at 1.0
percent. There is no error or exception anywhere in oozie or mapreduce
application.
Same pig script executes successfully via pig command line.
Please provide pointers on how to debug the issue.
Mapreduce application container logs -
2015-09-03 21:40:06,370 [JobControl] WARN
org.apache.hadoop.mapreduce.JobSubmitter - No job jar file set. User classes
may not be found. See Job or Job#setJar(String).
2015-09-03 21:40:06,606 [JobControl] INFO
org.apache.hadoop.mapreduce.lib.input.FileInputFormat - Total input paths to
process : 1
2015-09-03 21:40:06,606 [JobControl] INFO
org.apache.pig.backend.hadoop.executionengine.util.MapRedUtil - Total input
paths to process : 1
2015-09-03 21:40:06,633 [JobControl] INFO
org.apache.pig.backend.hadoop.executionengine.util.MapRedUtil - Total input
paths (combined) to process : 1
2015-09-03 21:40:06,790 [JobControl] INFO
org.apache.hadoop.mapreduce.JobSubmitter - number of splits:1
2015-09-03 21:40:06,882 [JobControl] INFO
org.apache.hadoop.mapreduce.JobSubmitter - Submitting tokens for job:
job_1441296493535_0002
2015-09-03 21:40:06,882 [JobControl] INFO
org.apache.hadoop.mapreduce.JobSubmitter - Kind: YARN_AM_RM_TOKEN, Service: ,
Ident: (appAttemptId { application_id { id: 1 cluster_timestamp: 1441296493535
} attemptId: 1 } keyId: 1011427767)
2015-09-03 21:40:06,883 [JobControl] INFO
org.apache.hadoop.mapreduce.JobSubmitter - Kind: RM_DELEGATION_TOKEN, Service:
127.0.0.1:8032, Ident: (owner=hduser, renewer=oozie mr token, realUser=hduser,
issueDate=1441296592038, maxDate=1441901392038, sequenceNumber=4, masterKeyId=2)
2015-09-03 21:40:06,947 [JobControl] INFO org.apache.hadoop.mapred.YARNRunner
- Job jar is not present. Not adding any jar to the list of resources.
2015-09-03 21:40:07,047 [JobControl] INFO
org.apache.hadoop.yarn.client.api.impl.YarnClientImpl - Submitted application
application_1441296493535_0002
2015-09-03 21:40:07,088 [JobControl] INFO org.apache.hadoop.mapreduce.Job -
The url to track the job:
http://saurabh:8088/proxy/application_1441296493535_0002/
2015-09-03 21:40:07,089 [uber-SubtaskRunner] INFO
org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.MapReduceLauncher
- HadoopJobId: job_1441296493535_0002
2015-09-03 21:40:07,089 [uber-SubtaskRunner] INFO
org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.MapReduceLauncher
- Processing aliases grouped,lines,wordcount,words
2015-09-03 21:40:07,089 [uber-SubtaskRunner] INFO
org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.MapReduceLauncher
- detailed locations: M:
lines[18,8],words[-1,-1],wordcount[21,12],grouped[20,10] C:
wordcount[21,12],grouped[20,10] R: wordcount[21,12]
2015-09-03 21:40:07,098 [uber-SubtaskRunner] INFO
org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.MapReduceLauncher
- 0% complete
2015-09-03 21:40:07,098 [uber-SubtaskRunner] INFO
org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.MapReduceLauncher
- Running jobs are [job_1441296493535_0002]
2015-09-03 21:40:08,633 [communication thread] INFO
org.apache.hadoop.mapred.TaskAttemptListenerImpl - Progress of TaskAttempt
attempt_1441296493535_0001_m_000000_0 is : 1.0
Heart beat
2015-09-03 21:40:38,696 [communication thread] INFO
org.apache.hadoop.mapred.TaskAttemptListenerImpl - Progress of TaskAttempt
attempt_1441296493535_0001_m_000000_0 is : 1.0
Heart beat
2015-09-03 21:41:08,756 [communication thread] INFO
org.apache.hadoop.mapred.TaskAttemptListenerImpl - Progress of TaskAttempt
attempt_1441296493535_0001_m_000000_0 is : 1.0
Heart beat
2015-09-03 21:41:38,800 [communication thread] INFO
org.apache.hadoop.mapred.TaskAttemptListenerImpl - Progress of TaskAttempt
attempt_1441296493535_0001_m_000000_0 is : 1.0
Heart beat
2015-09-03 21:42:08,855 [communication thread] INFO
org.apache.hadoop.mapred.TaskAttemptListenerImpl - Progress of TaskAttempt
attempt_1441296493535_0001_m_000000_0 is : 1.0
Heart beat
2015-09-03 21:42:38,899 [communication thread] INFO
org.apache.hadoop.mapred.TaskAttemptListenerImpl - Progress of TaskAttempt
attempt_1441296493535_0001_m_000000_0 is : 1.0
Heart beat
--
Regards,
Saurabh
Mobile: 9711001537
Skype: saurabh.jain.1537
Twitter: @saurabhjain1537
Disclaimer: The information contained in this message is intended only and
solely for the addressed individual or entity indicated in this message and for
the exclusive use of the said addressed individual or entity indicated in this
message (or responsible for delivery of the message to such person) and may
contain legally privileged and confidential information belonging to Alethe
Labs. It must not be reprinted, read, copied, disclosed, forwarded, distributed
or used (in any manner whatsoever) by any person other than the addressee.
Unauthorized use, disclosure or copying of the contents of this message is
strictly prohibited and may constitute unlawful act and can possibly attract
legal action, civil and/or criminal. The contents of this message need not
necessarily reflect or endorse the views of Alethe Labs on any subject matter.
Any action taken or omitted to be taken based on this message is not entirely
at your risk and the originator of this message nor does Alethe Labs take any
responsibility or liability towards the same. Opinions, conclusions and any
other information contained in this message that do not relate to the official
business of Alethe Labs shall be understood as neither given nor endorsed by
Alethe Labs. If you have received this message in error, you should destroy
this message and may please notify the sender by e-mail. Our official web site
is http://www.alethelabs.com. Thank you.
