Hm... ok, can you see what happens on YARN RM web ui? There should be a job that runs yuor oozie mapper launcher.
2015-11-04 15:02 GMT+01:00 Jaydeep Vishwakarma < [email protected]>: > Good, So not issue with Yarn or name node urls. Can you share stdout logs. > > > On Wed, Nov 4, 2015 at 7:15 PM, Jeetendra G <[email protected]> > wrote: > > > Hi Jaydeep here also I cant see any error below are the logs > > > > Log Type: syslog > > > > Log Upload Time: Wed Nov 04 14:59:29 +0530 2015 > > > > Log Length: 25565 > > > > 2015-11-04 14:59:11,814 INFO [main] > > org.apache.hadoop.mapreduce.v2.app.MRAppMaster: Created MRAppMaster > > for application appattempt_1446620926630_0017_000001 > > 2015-11-04 14:59:12,144 WARN [main] > > org.apache.hadoop.util.NativeCodeLoader: Unable to load native-hadoop > > library for your platform... using builtin-java classes where > > applicable > > 2015-11-04 14:59:12,184 INFO [main] > > org.apache.hadoop.mapreduce.v2.app.MRAppMaster: Executing with tokens: > > 2015-11-04 14:59:12,292 INFO [main] > > org.apache.hadoop.mapreduce.v2.app.MRAppMaster: Kind: > > YARN_AM_RM_TOKEN, Service: , Ident: (appAttemptId { application_id { > > id: 17 cluster_timestamp: 1446620926630 } attemptId: 1 } keyId: > > -173762614) > > 2015-11-04 14:59:12,293 INFO [main] > > org.apache.hadoop.mapreduce.v2.app.MRAppMaster: Kind: > > RM_DELEGATION_TOKEN, Service: 10.21.1.136:8050, Ident: (owner=hdfs, > > renewer=oozie mr token, realUser=oozie, issueDate=1446629349951, > > maxDate=1447234149951, sequenceNumber=26, masterKeyId=6) > > 2015-11-04 14:59:12,890 WARN [main] > > org.apache.hadoop.hdfs.shortcircuit.DomainSocketFactory: The > > short-circuit local reads feature cannot be used because libhadoop > > cannot be loaded. > > 2015-11-04 14:59:13,064 INFO [main] > > org.apache.hadoop.mapreduce.v2.app.MRAppMaster: OutputCommitter set in > > config null > > 2015-11-04 14:59:13,065 INFO [main] > > org.apache.hadoop.mapreduce.v2.app.MRAppMaster: OutputCommitter is > > org.apache.hadoop.mapred.FileOutputCommitter > > 2015-11-04 14:59:13,110 INFO [main] > > org.apache.hadoop.yarn.event.AsyncDispatcher: Registering class > > org.apache.hadoop.mapreduce.jobhistory.EventType for class > > org.apache.hadoop.mapreduce.jobhistory.JobHistoryEventHandler > > 2015-11-04 14:59:13,110 INFO [main] > > org.apache.hadoop.yarn.event.AsyncDispatcher: Registering class > > org.apache.hadoop.mapreduce.v2.app.job.event.JobEventType for class > > org.apache.hadoop.mapreduce.v2.app.MRAppMaster$JobEventDispatcher > > 2015-11-04 14:59:13,111 INFO [main] > > org.apache.hadoop.yarn.event.AsyncDispatcher: Registering class > > org.apache.hadoop.mapreduce.v2.app.job.event.TaskEventType for class > > org.apache.hadoop.mapreduce.v2.app.MRAppMaster$TaskEventDispatcher > > 2015-11-04 14:59:13,111 INFO [main] > > org.apache.hadoop.yarn.event.AsyncDispatcher: Registering class > > org.apache.hadoop.mapreduce.v2.app.job.event.TaskAttemptEventType for > > class > > org.apache.hadoop.mapreduce.v2.app.MRAppMaster$TaskAttemptEventDispatcher > > 2015-11-04 14:59:13,112 INFO [main] > > org.apache.hadoop.yarn.event.AsyncDispatcher: Registering class > > org.apache.hadoop.mapreduce.v2.app.commit.CommitterEventType for class > > org.apache.hadoop.mapreduce.v2.app.commit.CommitterEventHandler > > 2015-11-04 14:59:13,112 INFO [main] > > org.apache.hadoop.yarn.event.AsyncDispatcher: Registering class > > org.apache.hadoop.mapreduce.v2.app.speculate.Speculator$EventType for > > class > > org.apache.hadoop.mapreduce.v2.app.MRAppMaster$SpeculatorEventDispatcher > > 2015-11-04 14:59:13,113 INFO [main] > > org.apache.hadoop.yarn.event.AsyncDispatcher: Registering class > > org.apache.hadoop.mapreduce.v2.app.rm.ContainerAllocator$EventType for > > class > > org.apache.hadoop.mapreduce.v2.app.MRAppMaster$ContainerAllocatorRouter > > 2015-11-04 14:59:13,113 INFO [main] > > org.apache.hadoop.yarn.event.AsyncDispatcher: Registering class > > org.apache.hadoop.mapreduce.v2.app.launcher.ContainerLauncher$EventType > > for class > > org.apache.hadoop.mapreduce.v2.app.MRAppMaster$ContainerLauncherRouter > > 2015-11-04 14:59:13,144 INFO [main] > > org.apache.hadoop.mapreduce.v2.jobhistory.JobHistoryUtils: Default > > file system is set solely by core-default.xml therefore - ignoring > > 2015-11-04 14:59:13,170 INFO [main] > > org.apache.hadoop.mapreduce.v2.jobhistory.JobHistoryUtils: Default > > file system is set solely by core-default.xml therefore - ignoring > > 2015-11-04 14:59:13,189 INFO [main] > > org.apache.hadoop.mapreduce.v2.jobhistory.JobHistoryUtils: Default > > file system is set solely by core-default.xml therefore - ignoring > > 2015-11-04 14:59:13,219 INFO [main] > > org.apache.hadoop.mapreduce.jobhistory.JobHistoryEventHandler: > > Emitting job history data to the timeline server is not enabled > > 2015-11-04 14:59:13,255 INFO [main] > > org.apache.hadoop.yarn.event.AsyncDispatcher: Registering class > > org.apache.hadoop.mapreduce.v2.app.job.event.JobFinishEvent$Type for > > class > org.apache.hadoop.mapreduce.v2.app.MRAppMaster$JobFinishEventHandler > > 2015-11-04 14:59:13,453 WARN [main] > > org.apache.hadoop.metrics2.impl.MetricsConfig: Cannot locate > > configuration: tried > > hadoop-metrics2-mrappmaster.properties,hadoop-metrics2.properties > > 2015-11-04 14:59:13,546 INFO [main] > > org.apache.hadoop.metrics2.impl.MetricsSystemImpl: Scheduled snapshot > > period at 10 second(s). > > 2015-11-04 14:59:13,546 INFO [main] > > org.apache.hadoop.metrics2.impl.MetricsSystemImpl: MRAppMaster metrics > > system started > > 2015-11-04 14:59:13,557 INFO [main] > > org.apache.hadoop.mapreduce.v2.app.job.impl.JobImpl: Adding job token > > for job_1446620926630_0017 to jobTokenSecretManager > > 2015-11-04 14:59:13,680 INFO [main] > > org.apache.hadoop.mapreduce.v2.app.job.impl.JobImpl: Not uberizing > > job_1446620926630_0017 because: not enabled; too much RAM; > > 2015-11-04 14:59:13,701 INFO [main] > > org.apache.hadoop.mapreduce.v2.app.job.impl.JobImpl: Input size for > > job job_1446620926630_0017 = 0. Number of splits = 1 > > 2015-11-04 14:59:13,701 INFO [main] > > org.apache.hadoop.mapreduce.v2.app.job.impl.JobImpl: Number of reduces > > for job job_1446620926630_0017 = 0 > > 2015-11-04 14:59:13,701 INFO [main] > > org.apache.hadoop.mapreduce.v2.app.job.impl.JobImpl: > > job_1446620926630_0017Job Transitioned from NEW to INITED > > 2015-11-04 14:59:13,702 INFO [main] > > org.apache.hadoop.mapreduce.v2.app.MRAppMaster: MRAppMaster launching > > normal, non-uberized, multi-container job job_1446620926630_0017. > > 2015-11-04 14:59:13,725 INFO [main] > > org.apache.hadoop.ipc.CallQueueManager: Using callQueue class > > java.util.concurrent.LinkedBlockingQueue > > 2015-11-04 14:59:13,736 INFO [Socket Reader #1 for port 39640] > > org.apache.hadoop.ipc.Server: Starting Socket Reader #1 for port 39640 > > 2015-11-04 14:59:13,758 INFO [main] > > org.apache.hadoop.yarn.factories.impl.pb.RpcServerFactoryPBImpl: > > Adding protocol org.apache.hadoop.mapreduce.v2.api.MRClientProtocolPB > > to the server > > 2015-11-04 14:59:13,759 INFO [IPC Server Responder] > > org.apache.hadoop.ipc.Server: IPC Server Responder: starting > > 2015-11-04 14:59:13,761 INFO [IPC Server listener on 39640] > > org.apache.hadoop.ipc.Server: IPC Server listener on 39640: starting > > 2015-11-04 14:59:13,762 INFO [main] > > org.apache.hadoop.mapreduce.v2.app.client.MRClientService: > > Instantiated MRClientService at hadoop04.housing.com/10.21.1.138:39640 > > 2015-11-04 14:59:13,853 INFO [main] org.mortbay.log: Logging to > > org.slf4j.impl.Log4jLoggerAdapter(org.mortbay.log) via > > org.mortbay.log.Slf4jLog > > 2015-11-04 14:59:13,862 INFO [main] > > org.apache.hadoop.security.authentication.server.AuthenticationFilter: > > Unable to initialize FileSignerSecretProvider, falling back to use > > random secrets. > > 2015-11-04 14:59:13,867 WARN [main] > > org.apache.hadoop.http.HttpRequestLog: Jetty request log can only be > > enabled using Log4j > > 2015-11-04 14:59:13,874 INFO [main] > > org.apache.hadoop.http.HttpServer2: Added global filter 'safety' > > (class=org.apache.hadoop.http.HttpServer2$QuotingInputFilter) > > 2015-11-04 14:59:13,878 INFO [main] > > org.apache.hadoop.http.HttpServer2: Added filter AM_PROXY_FILTER > > (class=org.apache.hadoop.yarn.server.webproxy.amfilter.AmIpFilter) to > > context mapreduce > > 2015-11-04 14:59:13,879 INFO [main] > > org.apache.hadoop.http.HttpServer2: Added filter AM_PROXY_FILTER > > (class=org.apache.hadoop.yarn.server.webproxy.amfilter.AmIpFilter) to > > context static > > 2015-11-04 14:59:13,882 INFO [main] > > org.apache.hadoop.http.HttpServer2: adding path spec: /mapreduce/* > > 2015-11-04 14:59:13,882 INFO [main] > > org.apache.hadoop.http.HttpServer2: adding path spec: /ws/* > > 2015-11-04 14:59:14,217 INFO [main] > > org.apache.hadoop.yarn.webapp.WebApps: Registered webapp guice modules > > 2015-11-04 14:59:14,218 INFO [main] > > org.apache.hadoop.http.HttpServer2: Jetty bound to port 49791 > > 2015-11-04 14:59:14,219 INFO [main] org.mortbay.log: jetty-6.1.26.hwx > > 2015-11-04 14:59:14,260 INFO [main] org.mortbay.log: Extract > > > > > jar:file:/hadoop/yarn/local/filecache/10/mapreduce.tar.gz/hadoop/share/hadoop/yarn/hadoop-yarn-common-2.7.1.2.3.2.0-2950.jar!/webapps/mapreduce > > to ./tmp/Jetty_0_0_0_0_49791_mapreduce____.kdgzqp/webapp > > 2015-11-04 14:59:15,952 INFO [main] org.mortbay.log: Started > > [email protected]:49791 > > 2015-11-04 14:59:15,952 INFO [main] > > org.apache.hadoop.yarn.webapp.WebApps: Web app /mapreduce started at > > 49791 > > 2015-11-04 14:59:15,957 INFO [main] > > org.apache.hadoop.ipc.CallQueueManager: Using callQueue class > > java.util.concurrent.LinkedBlockingQueue > > 2015-11-04 14:59:15,957 INFO [Socket Reader #1 for port 50432] > > org.apache.hadoop.ipc.Server: Starting Socket Reader #1 for port 50432 > > 2015-11-04 14:59:15,963 INFO [IPC Server Responder] > > org.apache.hadoop.ipc.Server: IPC Server Responder: starting > > 2015-11-04 14:59:15,963 INFO [IPC Server listener on 50432] > > org.apache.hadoop.ipc.Server: IPC Server listener on 50432: starting > > 2015-11-04 14:59:15,988 INFO [main] > > org.apache.hadoop.mapreduce.v2.app.rm.RMContainerRequestor: > > nodeBlacklistingEnabled:true > > 2015-11-04 14:59:15,988 INFO [main] > > org.apache.hadoop.mapreduce.v2.app.rm.RMContainerRequestor: > > maxTaskFailuresPerNode is 3 > > 2015-11-04 14:59:15,988 INFO [main] > > org.apache.hadoop.mapreduce.v2.app.rm.RMContainerRequestor: > > blacklistDisablePercent is 33 > > 2015-11-04 14:59:16,035 INFO [main] > > org.apache.hadoop.yarn.client.RMProxy: Connecting to ResourceManager > > at hadoop02.housing.com/10.21.1.136:8030 > > 2015-11-04 14:59:16,113 INFO [main] > > org.apache.hadoop.mapreduce.v2.app.rm.RMCommunicator: > > maxContainerCapability: <memory:5120, vCores:3> > > 2015-11-04 14:59:16,113 INFO [main] > > org.apache.hadoop.mapreduce.v2.app.rm.RMCommunicator: queue: default > > 2015-11-04 14:59:16,117 INFO [main] > > org.apache.hadoop.mapreduce.v2.app.launcher.ContainerLauncherImpl: > > Upper limit on the thread pool size is 500 > > 2015-11-04 14:59:16,118 INFO [main] > > org.apache.hadoop.mapreduce.v2.app.launcher.ContainerLauncherImpl: The > > thread pool initial size is 10 > > 2015-11-04 14:59:16,120 INFO [main] > > org.apache.hadoop.yarn.client.api.impl.ContainerManagementProtocolProxy: > > yarn.client.max-cached-nodemanagers-proxies : 0 > > 2015-11-04 14:59:16,127 INFO [AsyncDispatcher event handler] > > org.apache.hadoop.mapreduce.v2.app.job.impl.JobImpl: > > job_1446620926630_0017Job Transitioned from INITED to SETUP > > 2015-11-04 14:59:16,157 INFO [CommitterEvent Processor #0] > > org.apache.hadoop.mapreduce.v2.app.commit.CommitterEventHandler: > > Processing the event EventType: JOB_SETUP > > 2015-11-04 14:59:16,160 INFO [CommitterEvent Processor #0] > > org.apache.hadoop.mapreduce.lib.output.FileOutputCommitter: File > > Output Committer Algorithm version is 1 > > 2015-11-04 14:59:16,173 INFO [AsyncDispatcher event handler] > > org.apache.hadoop.mapreduce.v2.app.job.impl.JobImpl: > > job_1446620926630_0017Job Transitioned from SETUP to RUNNING > > 2015-11-04 14:59:16,194 INFO [AsyncDispatcher event handler] > > org.apache.hadoop.mapreduce.v2.app.job.impl.TaskImpl: > > task_1446620926630_0017_m_000000 Task Transitioned from NEW to > > SCHEDULED > > 2015-11-04 14:59:16,195 INFO [AsyncDispatcher event handler] > > org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl: > > attempt_1446620926630_0017_m_000000_0 TaskAttempt Transitioned from > > NEW to UNASSIGNED > > 2015-11-04 14:59:16,202 INFO [Thread-51] > > org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator: > > mapResourceRequest:<memory:1536, vCores:1> > > 2015-11-04 14:59:16,252 INFO [eventHandlingThread] > > org.apache.hadoop.mapreduce.jobhistory.JobHistoryEventHandler: Event > > Writer setup for JobId: job_1446620926630_0017, File: > > hdfs:// > > > hadoop01.housing.com:8020/user/hdfs/.staging/job_1446620926630_0017/job_1446620926630_0017_1.jhist > > 2015-11-04 14:59:17,117 INFO [RMCommunicator Allocator] > > org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator: Before > > Scheduling: PendingReds:0 ScheduledMaps:1 ScheduledReds:0 > > AssignedMaps:0 AssignedReds:0 CompletedMaps:0 CompletedReds:0 > > ContAlloc:0 ContRel:0 HostLocal:0 RackLocal:0 > > 2015-11-04 14:59:17,154 INFO [RMCommunicator Allocator] > > org.apache.hadoop.mapreduce.v2.app.rm.RMContainerRequestor: > > getResources() for application_1446620926630_0017: ask=1 release= 0 > > newContainers=0 finishedContainers=0 resourcelimit=<memory:19840, > > vCores:1> knownNMs=5 > > 2015-11-04 14:59:18,171 INFO [RMCommunicator Allocator] > > org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator: Got > > allocated containers 1 > > 2015-11-04 14:59:18,198 INFO [RMCommunicator Allocator] > > org.apache.hadoop.yarn.util.RackResolver: Resolved > > hadoop04.housing.com to /default-rack > > 2015-11-04 14:59:18,201 INFO [RMCommunicator Allocator] > > org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator: Assigned > > container container_e02_1446620926630_0017_01_000002 to > > attempt_1446620926630_0017_m_000000_0 > > 2015-11-04 14:59:18,202 INFO [RMCommunicator Allocator] > > org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator: After > > Scheduling: PendingReds:0 ScheduledMaps:0 ScheduledReds:0 > > AssignedMaps:1 AssignedReds:0 CompletedMaps:0 CompletedReds:0 > > ContAlloc:1 ContRel:0 HostLocal:0 RackLocal:0 > > 2015-11-04 14:59:18,245 INFO [AsyncDispatcher event handler] > > org.apache.hadoop.yarn.util.RackResolver: Resolved > > hadoop04.housing.com to /default-rack > > 2015-11-04 14:59:18,245 INFO [AsyncDispatcher event handler] > > org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl: Job jar > > is not present. Not adding any jar to the list of resources. > > 2015-11-04 14:59:18,263 INFO [AsyncDispatcher event handler] > > org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl: The > > job-conf file on the remote FS is > > /user/hdfs/.staging/job_1446620926630_0017/job.xml > > 2015-11-04 14:59:18,290 INFO [AsyncDispatcher event handler] > > org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl: Adding #1 > > tokens and #1 secret keys for NM use for launching container > > 2015-11-04 14:59:18,290 INFO [AsyncDispatcher event handler] > > org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl: Size of > > containertokens_dob is 2 > > 2015-11-04 14:59:18,291 INFO [AsyncDispatcher event handler] > > org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl: Putting > > shuffle token in serviceData > > 2015-11-04 14:59:18,359 INFO [AsyncDispatcher event handler] > > org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl: > > attempt_1446620926630_0017_m_000000_0 TaskAttempt Transitioned from > > UNASSIGNED to ASSIGNED > > 2015-11-04 14:59:18,363 INFO [ContainerLauncher #0] > > org.apache.hadoop.mapreduce.v2.app.launcher.ContainerLauncherImpl: > > Processing the event EventType: CONTAINER_REMOTE_LAUNCH for container > > container_e02_1446620926630_0017_01_000002 taskAttempt > > attempt_1446620926630_0017_m_000000_0 > > 2015-11-04 14:59:18,364 INFO [ContainerLauncher #0] > > org.apache.hadoop.mapreduce.v2.app.launcher.ContainerLauncherImpl: > > Launching attempt_1446620926630_0017_m_000000_0 > > 2015-11-04 14:59:18,365 INFO [ContainerLauncher #0] > > org.apache.hadoop.yarn.client.api.impl.ContainerManagementProtocolProxy: > > Opening proxy : hadoop04.housing.com:45454 > > 2015-11-04 14:59:18,435 INFO [ContainerLauncher #0] > > org.apache.hadoop.mapreduce.v2.app.launcher.ContainerLauncherImpl: > > Shuffle port returned by ContainerManager for > > attempt_1446620926630_0017_m_000000_0 : 13562 > > 2015-11-04 14:59:18,437 INFO [AsyncDispatcher event handler] > > org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl: > > TaskAttempt: [attempt_1446620926630_0017_m_000000_0] using > > containerId: [container_e02_1446620926630_0017_01_000002 on NM: > > [hadoop04.housing.com:45454] > > 2015-11-04 14:59:18,439 INFO [AsyncDispatcher event handler] > > org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl: > > attempt_1446620926630_0017_m_000000_0 TaskAttempt Transitioned from > > ASSIGNED to RUNNING > > 2015-11-04 14:59:18,440 INFO [AsyncDispatcher event handler] > > org.apache.hadoop.mapreduce.v2.app.job.impl.TaskImpl: > > task_1446620926630_0017_m_000000 Task Transitioned from SCHEDULED to > > RUNNING > > 2015-11-04 14:59:19,213 INFO [RMCommunicator Allocator] > > org.apache.hadoop.mapreduce.v2.app.rm.RMContainerRequestor: > > getResources() for application_1446620926630_0017: ask=1 release= 0 > > newContainers=0 finishedContainers=0 resourcelimit=<memory:17920, > > vCores:1> knownNMs=5 > > 2015-11-04 14:59:20,114 INFO [Socket Reader #1 for port 50432] > > SecurityLogger.org.apache.hadoop.ipc.Server: Auth successful for > > job_1446620926630_0017 (auth:SIMPLE) > > 2015-11-04 14:59:20,138 INFO [IPC Server handler 3 on 50432] > > org.apache.hadoop.mapred.TaskAttemptListenerImpl: JVM with ID : > > jvm_1446620926630_0017_m_2199023255554 asked for a task > > 2015-11-04 14:59:20,139 INFO [IPC Server handler 3 on 50432] > > org.apache.hadoop.mapred.TaskAttemptListenerImpl: JVM with ID: > > jvm_1446620926630_0017_m_2199023255554 given task: > > attempt_1446620926630_0017_m_000000_0 > > 2015-11-04 14:59:22,549 INFO [IPC Server handler 2 on 50432] > > org.apache.hadoop.mapred.TaskAttemptListenerImpl: Progress of > > TaskAttempt attempt_1446620926630_0017_m_000000_0 is : 0.0 > > 2015-11-04 14:59:22,589 INFO [IPC Server handler 1 on 50432] > > org.apache.hadoop.mapred.TaskAttemptListenerImpl: Commit-pending state > > update from attempt_1446620926630_0017_m_000000_0 > > 2015-11-04 14:59:22,590 INFO [AsyncDispatcher event handler] > > org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl: > > attempt_1446620926630_0017_m_000000_0 TaskAttempt Transitioned from > > RUNNING to COMMIT_PENDING > > 2015-11-04 14:59:22,591 INFO [AsyncDispatcher event handler] > > org.apache.hadoop.mapreduce.v2.app.job.impl.TaskImpl: > > attempt_1446620926630_0017_m_000000_0 given a go for committing the > > task output. > > 2015-11-04 14:59:22,597 INFO [IPC Server handler 0 on 50432] > > org.apache.hadoop.mapred.TaskAttemptListenerImpl: Commit go/no-go > > request from attempt_1446620926630_0017_m_000000_0 > > 2015-11-04 14:59:22,598 INFO [IPC Server handler 0 on 50432] > > org.apache.hadoop.mapreduce.v2.app.job.impl.TaskImpl: Result of > > canCommit for attempt_1446620926630_0017_m_000000_0:true > > 2015-11-04 14:59:22,635 INFO [IPC Server handler 4 on 50432] > > org.apache.hadoop.mapred.TaskAttemptListenerImpl: Progress of > > TaskAttempt attempt_1446620926630_0017_m_000000_0 is : 1.0 > > 2015-11-04 14:59:22,643 INFO [IPC Server handler 16 on 50432] > > org.apache.hadoop.mapred.TaskAttemptListenerImpl: Done acknowledgement > > from attempt_1446620926630_0017_m_000000_0 > > 2015-11-04 14:59:22,645 INFO [AsyncDispatcher event handler] > > org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl: > > attempt_1446620926630_0017_m_000000_0 TaskAttempt Transitioned from > > COMMIT_PENDING to SUCCESS_CONTAINER_CLEANUP > > 2015-11-04 14:59:22,647 INFO [ContainerLauncher #1] > > org.apache.hadoop.mapreduce.v2.app.launcher.ContainerLauncherImpl: > > Processing the event EventType: CONTAINER_REMOTE_CLEANUP for container > > container_e02_1446620926630_0017_01_000002 taskAttempt > > attempt_1446620926630_0017_m_000000_0 > > 2015-11-04 14:59:22,648 INFO [ContainerLauncher #1] > > org.apache.hadoop.mapreduce.v2.app.launcher.ContainerLauncherImpl: > > KILLING attempt_1446620926630_0017_m_000000_0 > > 2015-11-04 14:59:22,648 INFO [ContainerLauncher #1] > > org.apache.hadoop.yarn.client.api.impl.ContainerManagementProtocolProxy: > > Opening proxy : hadoop04.housing.com:45454 > > 2015-11-04 14:59:22,675 INFO [AsyncDispatcher event handler] > > org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl: > > attempt_1446620926630_0017_m_000000_0 TaskAttempt Transitioned from > > SUCCESS_CONTAINER_CLEANUP to SUCCEEDED > > 2015-11-04 14:59:22,683 INFO [AsyncDispatcher event handler] > > org.apache.hadoop.mapreduce.v2.app.job.impl.TaskImpl: Task succeeded > > with attempt attempt_1446620926630_0017_m_000000_0 > > 2015-11-04 14:59:22,683 INFO [AsyncDispatcher event handler] > > org.apache.hadoop.mapreduce.v2.app.job.impl.TaskImpl: > > task_1446620926630_0017_m_000000 Task Transitioned from RUNNING to > > SUCCEEDED > > 2015-11-04 14:59:22,685 INFO [AsyncDispatcher event handler] > > org.apache.hadoop.mapreduce.v2.app.job.impl.JobImpl: Num completed > > Tasks: 1 > > 2015-11-04 14:59:22,685 INFO [AsyncDispatcher event handler] > > org.apache.hadoop.mapreduce.v2.app.job.impl.JobImpl: > > job_1446620926630_0017Job Transitioned from RUNNING to COMMITTING > > 2015-11-04 14:59:22,697 INFO [CommitterEvent Processor #1] > > org.apache.hadoop.mapreduce.v2.app.commit.CommitterEventHandler: > > Processing the event EventType: JOB_COMMIT > > 2015-11-04 14:59:22,787 INFO [AsyncDispatcher event handler] > > org.apache.hadoop.mapreduce.v2.app.job.impl.JobImpl: Calling handler > > for JobFinishedEvent > > 2015-11-04 14:59:22,787 INFO [AsyncDispatcher event handler] > > org.apache.hadoop.mapreduce.v2.app.job.impl.JobImpl: > > job_1446620926630_0017Job Transitioned from COMMITTING to SUCCEEDED > > 2015-11-04 14:59:22,792 INFO [Thread-67] > > org.apache.hadoop.mapreduce.v2.app.MRAppMaster: We are finishing > > cleanly so this is the last retry > > 2015-11-04 14:59:22,792 INFO [Thread-67] > > org.apache.hadoop.mapreduce.v2.app.MRAppMaster: Notify RMCommunicator > > isAMLastRetry: true > > 2015-11-04 14:59:22,793 INFO [Thread-67] > > org.apache.hadoop.mapreduce.v2.app.rm.RMCommunicator: RMCommunicator > > notified that shouldUnregistered is: true > > 2015-11-04 14:59:22,793 INFO [Thread-67] > > org.apache.hadoop.mapreduce.v2.app.MRAppMaster: Notify JHEH > > isAMLastRetry: true > > 2015-11-04 14:59:22,793 INFO [Thread-67] > > org.apache.hadoop.mapreduce.jobhistory.JobHistoryEventHandler: > > JobHistoryEventHandler notified that forceJobCompletion is true > > 2015-11-04 14:59:22,793 INFO [Thread-67] > > org.apache.hadoop.mapreduce.v2.app.MRAppMaster: Calling stop for all > > the services > > 2015-11-04 14:59:22,793 INFO [Thread-67] > > org.apache.hadoop.mapreduce.jobhistory.JobHistoryEventHandler: > > Stopping JobHistoryEventHandler. Size of the outstanding queue size is > > 0 > > 2015-11-04 14:59:22,845 INFO [eventHandlingThread] > > org.apache.hadoop.mapreduce.jobhistory.JobHistoryEventHandler: Copying > > hdfs:// > > > hadoop01.housing.com:8020/user/hdfs/.staging/job_1446620926630_0017/job_1446620926630_0017_1.jhist > > to hdfs:// > > > hadoop01.housing.com:8020/mr-history/tmp/hdfs/job_1446620926630_0017-1446629350323-hdfs-oozie%3Alauncher%3AT%3Djava%3AW%3Djava%2Dmain%2Dwf%3AA%3Djava%2Dnode%3AI-1446629362786-1-0-SUCCEEDED-default-1446629356124.jhist_tmp > > 2015-11-04 14:59:22,880 INFO [eventHandlingThread] > > org.apache.hadoop.mapreduce.jobhistory.JobHistoryEventHandler: Copied > > to done location: > > hdfs:// > > > hadoop01.housing.com:8020/mr-history/tmp/hdfs/job_1446620926630_0017-1446629350323-hdfs-oozie%3Alauncher%3AT%3Djava%3AW%3Djava%2Dmain%2Dwf%3AA%3Djava%2Dnode%3AI-1446629362786-1-0-SUCCEEDED-default-1446629356124.jhist_tmp > > 2015-11-04 14:59:22,883 INFO [eventHandlingThread] > > org.apache.hadoop.mapreduce.jobhistory.JobHistoryEventHandler: Copying > > hdfs:// > > > hadoop01.housing.com:8020/user/hdfs/.staging/job_1446620926630_0017/job_1446620926630_0017_1_conf.xml > > to hdfs:// > > > hadoop01.housing.com:8020/mr-history/tmp/hdfs/job_1446620926630_0017_conf.xml_tmp > > 2015-11-04 14:59:22,956 INFO [eventHandlingThread] > > org.apache.hadoop.mapreduce.jobhistory.JobHistoryEventHandler: Copied > > to done location: > > hdfs:// > > > hadoop01.housing.com:8020/mr-history/tmp/hdfs/job_1446620926630_0017_conf.xml_tmp > > 2015-11-04 14:59:22,960 INFO [eventHandlingThread] > > org.apache.hadoop.mapreduce.jobhistory.JobHistoryEventHandler: Moved > > tmp to done: hdfs:// > > > hadoop01.housing.com:8020/mr-history/tmp/hdfs/job_1446620926630_0017.summary_tmp > > to hdfs:// > > > hadoop01.housing.com:8020/mr-history/tmp/hdfs/job_1446620926630_0017.summary > > 2015-11-04 14:59:22,962 INFO [eventHandlingThread] > > org.apache.hadoop.mapreduce.jobhistory.JobHistoryEventHandler: Moved > > tmp to done: hdfs:// > > > hadoop01.housing.com:8020/mr-history/tmp/hdfs/job_1446620926630_0017_conf.xml_tmp > > to hdfs:// > > > hadoop01.housing.com:8020/mr-history/tmp/hdfs/job_1446620926630_0017_conf.xml > > 2015-11-04 14:59:22,964 INFO [eventHandlingThread] > > org.apache.hadoop.mapreduce.jobhistory.JobHistoryEventHandler: Moved > > tmp to done: hdfs:// > > > hadoop01.housing.com:8020/mr-history/tmp/hdfs/job_1446620926630_0017-1446629350323-hdfs-oozie%3Alauncher%3AT%3Djava%3AW%3Djava%2Dmain%2Dwf%3AA%3Djava%2Dnode%3AI-1446629362786-1-0-SUCCEEDED-default-1446629356124.jhist_tmp > > to hdfs:// > > > hadoop01.housing.com:8020/mr-history/tmp/hdfs/job_1446620926630_0017-1446629350323-hdfs-oozie%3Alauncher%3AT%3Djava%3AW%3Djava%2Dmain%2Dwf%3AA%3Djava%2Dnode%3AI-1446629362786-1-0-SUCCEEDED-default-1446629356124.jhist > > 2015-11-04 14:59:22,965 INFO [Thread-67] > > org.apache.hadoop.mapreduce.jobhistory.JobHistoryEventHandler: Stopped > > JobHistoryEventHandler. super.stop() > > 2015-11-04 14:59:22,968 INFO [Thread-67] > > org.apache.hadoop.mapreduce.v2.app.rm.RMCommunicator: Setting job > > diagnostics to > > 2015-11-04 14:59:22,969 INFO [Thread-67] > > org.apache.hadoop.mapreduce.v2.app.rm.RMCommunicator: History url is > > http://hadoop03.housing.com:19888/jobhistory/job/job_1446620926630_0017 > > 2015-11-04 14:59:22,976 INFO [Thread-67] > > org.apache.hadoop.mapreduce.v2.app.rm.RMCommunicator: Waiting for > > application to be successfully unregistered. > > 2015-11-04 14:59:23,979 INFO [Thread-67] > > org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator: Final > > Stats: PendingReds:0 ScheduledMaps:0 ScheduledReds:0 AssignedMaps:1 > > AssignedReds:0 CompletedMaps:0 CompletedReds:0 ContAlloc:1 ContRel:0 > > HostLocal:0 RackLocal:0 > > 2015-11-04 14:59:23,980 INFO [Thread-67] > > org.apache.hadoop.mapreduce.v2.app.MRAppMaster: Deleting staging > > directory hdfs://hadoop01.housing.com:8020 > > /user/hdfs/.staging/job_1446620926630_0017 > > 2015-11-04 14:59:23,984 INFO [Thread-67] org.apache.hadoop.ipc.Server: > > Stopping server on 50432 > > 2015-11-04 14:59:23,985 INFO [IPC Server listener on 50432] > > org.apache.hadoop.ipc.Server: Stopping IPC Server listener on 50432 > > 2015-11-04 14:59:23,986 INFO [IPC Server Responder] > > org.apache.hadoop.ipc.Server: Stopping IPC Server Responder > > 2015-11-04 14:59:23,986 INFO [TaskHeartbeatHandler PingChecker] > > org.apache.hadoop.mapreduce.v2.app.TaskHeartbeatHandler: > > TaskHeartbeatHandler thread interrupted > > > > > > On Wed, Nov 4, 2015 at 6:38 PM, Jaydeep Vishwakarma < > > [email protected]> wrote: > > > > > In first look I am not seeing any issue with job tracker or name node > > URL. > > > The job id is getting generated. Workflow Job is not going on PREP > mode. > > > > > > Open this link. > > > http://hadoop02.housing.com:8088/proxy/application_1446620926630_0014/ > > > > > > You will be see the problem. > > > > > > > > > > > > On Wed, Nov 4, 2015 at 6:24 PM, Jeetendra G <[email protected]> > > > wrote: > > > > > > > hey Serega I have cross verified jobTracker value is correct only I > am > > > > using yarn so resource manager will become the job tracker? > > > > > > > > On Wed, Nov 4, 2015 at 6:17 PM, Serega Sheypak < > > [email protected] > > > > > > > > wrote: > > > > > > > > > Can you go to oozie server and grab logs from there? My assumption > > that > > > > > <job-tracker>${jobTracker}</job-tracker> > > > > > <name-node>${nameNode}</name-node> > > > > > > > > > > have incorrect values. Probably ${jobTracker} is wrong and oozie > > can't > > > > even > > > > > start launcher mapper. > > > > > > > > > > 2015-11-04 13:43 GMT+01:00 Jaydeep Vishwakarma < > > > > > [email protected]>: > > > > > > > > > > > You are doing -log. Can you give the command as below and get the > > job > > > > url > > > > > > (application launcher url). > > > > > > > > > > > > *oozie job -info 0000040-151015123257993-oozie-oozi-W@java-node* > > > > > > > > > > > > > > > > > > > > > > > > On Wed, Nov 4, 2015 at 5:53 PM, Jeetendra G < > > [email protected] > > > > > > > > > > wrote: > > > > > > > > > > > > > and in job error log tab its saying error log is disables? by > > > default > > > > > why > > > > > > > error log is disables? i am using hortonworks > > > > > > > > > > > > > > On Wed, Nov 4, 2015 at 5:50 PM, Jeetendra G < > > > [email protected] > > > > > > > > > > > > wrote: > > > > > > > > > > > > > > > same error. > > > > > > > > > > > > > > > > 2015-11-04 14:09:00,935 INFO ActionStartXCommand:520 - > SERVER[ > > > > > > > > hadoop03.housing.com] USER[hdfs] GROUP[-] TOKEN[] > > > > APP[java-main-wf] > > > > > > > > JOB[0000004-151104124010010-oozie-oozi-W] > > > > > > > > ACTION[0000004-151104124010010-oozie-oozi-W@:start:] Start > > > action > > > > > > > > [0000004-151104124010010-oozie-oozi-W@:start:] with > user-retry > > > > > state : > > > > > > > > userRetryCount [0], userRetryMax [0], userRetryInterval [10] > > > > > > > > 2015-11-04 14:09:00,940 INFO ActionStartXCommand:520 - > SERVER[ > > > > > > > > hadoop03.housing.com] USER[hdfs] GROUP[-] TOKEN[] > > > > APP[java-main-wf] > > > > > > > > JOB[0000004-151104124010010-oozie-oozi-W] > > > > > > > > ACTION[0000004-151104124010010-oozie-oozi-W@:start:] > > > > > > > > [***0000004-151104124010010-oozie-oozi-W@:start:***]Action > > > > > status=DONE > > > > > > > > 2015-11-04 14:09:00,940 INFO ActionStartXCommand:520 - > SERVER[ > > > > > > > > hadoop03.housing.com] USER[hdfs] GROUP[-] TOKEN[] > > > > APP[java-main-wf] > > > > > > > > JOB[0000004-151104124010010-oozie-oozi-W] > > > > > > > > ACTION[0000004-151104124010010-oozie-oozi-W@:start:] > > > > > > > > [***0000004-151104124010010-oozie-oozi-W@:start:***]Action > > > updated > > > > > in > > > > > > > DB! > > > > > > > > 2015-11-04 14:09:00,994 INFO > WorkflowNotificationXCommand:520 > > - > > > > > > SERVER[ > > > > > > > > hadoop03.housing.com] USER[-] GROUP[-] TOKEN[-] APP[-] > > > > > > > > JOB[0000004-151104124010010-oozie-oozi-W] > > > > > > > > ACTION[0000004-151104124010010-oozie-oozi-W@:start:] No > > > > Notification > > > > > > URL > > > > > > > > is defined. Therefore nothing to notify for job > > > > > > > > 0000004-151104124010010-oozie-oozi-W@:start: > > > > > > > > 2015-11-04 14:09:01,004 INFO > WorkflowNotificationXCommand:520 > > - > > > > > > SERVER[ > > > > > > > > hadoop03.housing.com] USER[-] GROUP[-] TOKEN[-] APP[-] > > > > > > > > JOB[0000004-151104124010010-oozie-oozi-W] ACTION[] No > > > Notification > > > > > URL > > > > > > is > > > > > > > > defined. Therefore nothing to notify for job > > > > > > > > 0000004-151104124010010-oozie-oozi-W > > > > > > > > 2015-11-04 14:09:01,014 INFO ActionStartXCommand:520 - > SERVER[ > > > > > > > > hadoop03.housing.com] USER[hdfs] GROUP[-] TOKEN[] > > > > APP[java-main-wf] > > > > > > > > JOB[0000004-151104124010010-oozie-oozi-W] > > > > > > > > ACTION[0000004-151104124010010-oozie-oozi-W@java-node] Start > > > > action > > > > > > > > [0000004-151104124010010-oozie-oozi-W@java-node] with > > user-retry > > > > > > state : > > > > > > > > userRetryCount [0], userRetryMax [0], userRetryInterval [10] > > > > > > > > 2015-11-04 14:09:02,916 INFO JavaActionExecutor:520 - > SERVER[ > > > > > > > > hadoop03.housing.com] USER[hdfs] GROUP[-] TOKEN[] > > > > APP[java-main-wf] > > > > > > > > JOB[0000004-151104124010010-oozie-oozi-W] > > > > > > > > ACTION[0000004-151104124010010-oozie-oozi-W@java-node] > > checking > > > > > > action, > > > > > > > > hadoop job ID [job_1446620926630_0016] status [RUNNING] > > > > > > > > 2015-11-04 14:09:02,918 INFO ActionStartXCommand:520 - > SERVER[ > > > > > > > > hadoop03.housing.com] USER[hdfs] GROUP[-] TOKEN[] > > > > APP[java-main-wf] > > > > > > > > JOB[0000004-151104124010010-oozie-oozi-W] > > > > > > > > ACTION[0000004-151104124010010-oozie-oozi-W@java-node] > > > > > > > > [***0000004-151104124010010-oozie-oozi-W@java-node***]Action > > > > > > > > status=RUNNING > > > > > > > > 2015-11-04 14:09:02,918 INFO ActionStartXCommand:520 - > SERVER[ > > > > > > > > hadoop03.housing.com] USER[hdfs] GROUP[-] TOKEN[] > > > > APP[java-main-wf] > > > > > > > > JOB[0000004-151104124010010-oozie-oozi-W] > > > > > > > > ACTION[0000004-151104124010010-oozie-oozi-W@java-node] > > > > > > > > [***0000004-151104124010010-oozie-oozi-W@java-node***]Action > > > > updated > > > > > > in > > > > > > > > DB! > > > > > > > > 2015-11-04 14:09:02,926 INFO > WorkflowNotificationXCommand:520 > > - > > > > > > SERVER[ > > > > > > > > hadoop03.housing.com] USER[-] GROUP[-] TOKEN[-] APP[-] > > > > > > > > JOB[0000004-151104124010010-oozie-oozi-W] > > > > > > > > ACTION[0000004-151104124010010-oozie-oozi-W@java-node] No > > > > > Notification > > > > > > > > URL is defined. Therefore nothing to notify for job > > > > > > > > 0000004-151104124010010-oozie-oozi-W@java-node > > > > > > > > 2015-11-04 14:09:17,606 INFO CallbackServlet:520 - SERVER[ > > > > > > > > hadoop03.housing.com] USER[-] GROUP[-] TOKEN[-] APP[-] > > > > > > > > JOB[0000004-151104124010010-oozie-oozi-W] > > > > > > > > ACTION[0000004-151104124010010-oozie-oozi-W@java-node] > > callback > > > > for > > > > > > > > action [0000004-151104124010010-oozie-oozi-W@java-node] > > > > > > > > 2015-11-04 14:09:17,907 INFO JavaActionExecutor:520 - > SERVER[ > > > > > > > > hadoop03.housing.com] USER[hdfs] GROUP[-] TOKEN[] > > > > APP[java-main-wf] > > > > > > > > JOB[0000004-151104124010010-oozie-oozi-W] > > > > > > > > ACTION[0000004-151104124010010-oozie-oozi-W@java-node] > action > > > > > > completed, > > > > > > > > external ID [job_1446620926630_0016] > > > > > > > > 2015-11-04 14:09:18,029 INFO ActionStartXCommand:520 - > SERVER[ > > > > > > > > hadoop03.housing.com] USER[hdfs] GROUP[-] TOKEN[] > > > > APP[java-main-wf] > > > > > > > > JOB[0000004-151104124010010-oozie-oozi-W] > > > > > > > > ACTION[0000004-151104124010010-oozie-oozi-W@end] Start > action > > > > > > > > [0000004-151104124010010-oozie-oozi-W@end] with user-retry > > > state : > > > > > > > > userRetryCount [0], userRetryMax [0], userRetryInterval [10] > > > > > > > > 2015-11-04 14:09:18,034 INFO ActionStartXCommand:520 - > SERVER[ > > > > > > > > hadoop03.housing.com] USER[hdfs] GROUP[-] TOKEN[] > > > > APP[java-main-wf] > > > > > > > > JOB[0000004-151104124010010-oozie-oozi-W] > > > > > > > > ACTION[0000004-151104124010010-oozie-oozi-W@end] > > > > > > > > [***0000004-151104124010010-oozie-oozi-W@end***]Action > > > status=DONE > > > > > > > > 2015-11-04 14:09:18,034 INFO ActionStartXCommand:520 - > SERVER[ > > > > > > > > hadoop03.housing.com] USER[hdfs] GROUP[-] TOKEN[] > > > > APP[java-main-wf] > > > > > > > > JOB[0000004-151104124010010-oozie-oozi-W] > > > > > > > > ACTION[0000004-151104124010010-oozie-oozi-W@end] > > > > > > > > [***0000004-151104124010010-oozie-oozi-W@end***]Action > updated > > > in > > > > > DB! > > > > > > > > 2015-11-04 14:09:18,104 INFO > WorkflowNotificationXCommand:520 > > - > > > > > > SERVER[ > > > > > > > > hadoop03.housing.com] USER[-] GROUP[-] TOKEN[-] APP[-] > > > > > > > > JOB[0000004-151104124010010-oozie-oozi-W] > > > > > > > > ACTION[0000004-151104124010010-oozie-oozi-W@end] No > > Notification > > > > URL > > > > > > is > > > > > > > > defined. Therefore nothing to notify for job > > > > > > > > 0000004-151104124010010-oozie-oozi-W@end > > > > > > > > 2015-11-04 14:09:18,104 INFO > WorkflowNotificationXCommand:520 > > - > > > > > > SERVER[ > > > > > > > > hadoop03.housing.com] USER[-] GROUP[-] TOKEN[-] APP[-] > > > > > > > > JOB[0000004-151104124010010-oozie-oozi-W] ACTION[] No > > > Notification > > > > > URL > > > > > > is > > > > > > > > defined. Therefore nothing to notify for job > > > > > > > > 0000004-151104124010010-oozie-oozi-W > > > > > > > > 2015-11-04 14:09:18,105 INFO > WorkflowNotificationXCommand:520 > > - > > > > > > SERVER[ > > > > > > > > hadoop03.housing.com] USER[-] GROUP[-] TOKEN[-] APP[-] > > > > > > > > JOB[0000004-151104124010010-oozie-oozi-W] > > > > > > > > ACTION[0000004-151104124010010-oozie-oozi-W@java-node] No > > > > > Notification > > > > > > > > URL is defined. Therefore nothing to notify for job > > > > > > > > 0000004-151104124010010-oozie-oozi-W@java-node > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > On Wed, Nov 4, 2015 at 4:26 PM, Jaydeep Vishwakarma < > > > > > > > > [email protected]> wrote: > > > > > > > > > > > > > > > >> oozie job -info > 0000040-151015123257993-oozie-oozi-W@java-node > > > > > > > >> There you will find "Console URL" , Open that URL on > browser. > > > You > > > > > will > > > > > > > get > > > > > > > >> the Launcher mapper logs. > > > > > > > >> > > > > > > > >> > > > > > > > >> > > > > > > > >> On Wed, Nov 4, 2015 at 4:13 PM, Jeetendra G < > > > > > [email protected]> > > > > > > > >> wrote: > > > > > > > >> > > > > > > > >> > This is the log i am getting repeatedly > > > > > > > >> > 2015-10-29 16:39:11,095 INFO > > > WorkflowNotificationXCommand:520 - > > > > > > > SERVER[ > > > > > > > >> > hadoop03.housing.com] USER[-] GROUP[-] TOKEN[-] APP[-] > > > > > > > >> > JOB[0000040-151015123257993-oozie-oozi-W] > > > > > > > >> > ACTION[0000040-151015123257993-oozie-oozi-W@:start:] No > > > > > > Notification > > > > > > > >> URL > > > > > > > >> > is > > > > > > > >> > defined. Therefore nothing to notify for job > > > > > > > >> > 0000040-151015123257993-oozie-oozi-W@:start: > > > > > > > >> > 2015-10-29 16:39:11,095 INFO > > > WorkflowNotificationXCommand:520 - > > > > > > > SERVER[ > > > > > > > >> > hadoop03.housing.com] USER[-] GROUP[-] TOKEN[-] APP[-] > > > > > > > >> > JOB[0000040-151015123257993-oozie-oozi-W] ACTION[] No > > > > Notification > > > > > > URL > > > > > > > >> is > > > > > > > >> > defined. Therefore nothing to notify for job > > > > > > > >> > 0000040-151015123257993-oozie-oozi-W > > > > > > > >> > > > > > > > > >> > On Wed, Nov 4, 2015 at 4:11 PM, Jaydeep Vishwakarma < > > > > > > > >> > [email protected]> wrote: > > > > > > > >> > > > > > > > > >> > > Have you checked Launcher Mapper logs?. What it says? > > > > > > > >> > > > > > > > > > >> > > On Wed, Nov 4, 2015 at 4:04 PM, Jeetendra G < > > > > > > > [email protected]> > > > > > > > >> > > wrote: > > > > > > > >> > > > > > > > > > >> > > > does anybody have any idea? i have been trying this > from > > > 10 > > > > > days > > > > > > > >> > nothing > > > > > > > >> > > > worked out. > > > > > > > >> > > > > > > > > > > >> > > > On Thu, Oct 29, 2015 at 6:02 PM, Jeetendra G < > > > > > > > >> [email protected]> > > > > > > > >> > > > wrote: > > > > > > > >> > > > > > > > > > > >> > > > > my workflow.xml > > > > > > > >> > > > > > > > > > > > >> > > > > > > > > > > > >> > > > > <workflow-app xmlns="uri:oozie:workflow:0.2" > > > > > > > name="java-main-wf"> > > > > > > > >> > > > > <start to="java-node"/> > > > > > > > >> > > > > <action name="java-node"> > > > > > > > >> > > > > <java> > > > > > > > >> > > > > <job-tracker>${jobTracker}</job-tracker> > > > > > > > >> > > > > <name-node>${nameNode}</name-node> > > > > > > > >> > > > > > > > > > > > <main-class>com.housing.common.JSONMerger</main-class> > > > > > > > >> > > > > > > > > > <java-opts>-Dhadoop.custom.configuration.file=hdfs:// > > > > > > > >> > > > > 10.1.6.186:8020/configuration/jsonmerger-dev.conf > > > > > > > >> > > > > -Dyyyymmdd=20151029</java-opts> > > > > > > > >> > > > > > > > > > > > >> > > > > </java> > > > > > > > >> > > > > <ok to="end"/> > > > > > > > >> > > > > <error to="fail"/> > > > > > > > >> > > > > </action> > > > > > > > >> > > > > <kill name="fail"> > > > > > > > >> > > > > <message>Java failed, error > > > > > > > >> > > > > > > > message[${wf:errorMessage(wf:lastErrorNode())}]</message> > > > > > > > >> > > > > </kill> > > > > > > > >> > > > > <end name="end"/> > > > > > > > >> > > > > </workflow-app> > > > > > > > >> > > > > > > > > > > > >> > > > > On Thu, Oct 29, 2015 at 4:53 PM, Jeetendra G < > > > > > > > >> > [email protected]> > > > > > > > >> > > > > wrote: > > > > > > > >> > > > > > > > > > > > >> > > > >> Hi All, > > > > > > > >> > > > >> > > > > > > > >> > > > >> I am running java workflow job using oozie. > > > > > > > >> > > > >> I have Ambari server and I have installed oozie > from > > > > > Ambari. > > > > > > > >> > > > >> When i ran the job it say succeeded but its not > > running > > > > my > > > > > > java > > > > > > > >> > class > > > > > > > >> > > > >> which I mentioned inside workflow.xml. Also when I > > get > > > > > oozie > > > > > > > >> > nothing > > > > > > > >> > > > can > > > > > > > >> > > > >> be find pasting log beow, can anybody help here? > > > > > > > >> > > > >> oozie job -oozie > > > http://hadoop03.housing.com:11000/oozie > > > > > > -log > > > > > > > >> > > > >> 0000040-151015123257993-oozie-oozi-W > > > > > > > >> > > > >> 2015-10-29 16:39:11,058 INFO > > ActionStartXCommand:520 - > > > > > > SERVER[ > > > > > > > >> > > > >> hadoop03.housing.com] USER[hdfs] GROUP[-] TOKEN[] > > > > > > > >> APP[java-main-wf] > > > > > > > >> > > > >> JOB[0000040-151015123257993-oozie-oozi-W] > > > > > > > >> > > > >> ACTION[0000040-151015123257993-oozie-oozi-W@ > :start:] > > > > Start > > > > > > > >> action > > > > > > > >> > > > >> [0000040-151015123257993-oozie-oozi-W@:start:] > with > > > > > > user-retry > > > > > > > >> > state > > > > > > > >> > > : > > > > > > > >> > > > >> userRetryCount [0], userRetryMax [0], > > userRetryInterval > > > > > [10] > > > > > > > >> > > > >> 2015-10-29 16:39:11,061 INFO > > ActionStartXCommand:520 - > > > > > > SERVER[ > > > > > > > >> > > > >> hadoop03.housing.com] USER[hdfs] GROUP[-] TOKEN[] > > > > > > > >> APP[java-main-wf] > > > > > > > >> > > > >> JOB[0000040-151015123257993-oozie-oozi-W] > > > > > > > >> > > > >> ACTION[0000040-151015123257993-oozie-oozi-W@ > :start:] > > > > > > > >> > > > >> [***0000040-151015123257993-oozie-oozi-W@ > > > > :start:***]Action > > > > > > > >> > > status=DONE > > > > > > > >> > > > >> 2015-10-29 16:39:11,061 INFO > > ActionStartXCommand:520 - > > > > > > SERVER[ > > > > > > > >> > > > >> hadoop03.housing.com] USER[hdfs] GROUP[-] TOKEN[] > > > > > > > >> APP[java-main-wf] > > > > > > > >> > > > >> JOB[0000040-151015123257993-oozie-oozi-W] > > > > > > > >> > > > >> ACTION[0000040-151015123257993-oozie-oozi-W@ > :start:] > > > > > > > >> > > > >> [***0000040-151015123257993-oozie-oozi-W@ > > > > :start:***]Action > > > > > > > >> updated > > > > > > > >> > in > > > > > > > >> > > > DB! > > > > > > > >> > > > >> 2015-10-29 16:39:11,095 INFO > > > > > > WorkflowNotificationXCommand:520 > > > > > > > - > > > > > > > >> > > SERVER[ > > > > > > > >> > > > >> hadoop03.housing.com] USER[-] GROUP[-] TOKEN[-] > > APP[-] > > > > > > > >> > > > >> JOB[0000040-151015123257993-oozie-oozi-W] > > > > > > > >> > > > >> ACTION[0000040-151015123257993-oozie-oozi-W@ > :start:] > > > No > > > > > > > >> > Notification > > > > > > > >> > > > URL > > > > > > > >> > > > >> is defined. Therefore nothing to notify for job > > > > > > > >> > > > >> 0000040-151015123257993-oozie-oozi-W@:start: > > > > > > > >> > > > >> 2015-10-29 16:39:11,095 INFO > > > > > > WorkflowNotificationXCommand:520 > > > > > > > - > > > > > > > >> > > SERVER[ > > > > > > > >> > > > >> hadoop03.housing.com] USER[-] GROUP[-] TOKEN[-] > > APP[-] > > > > > > > >> > > > >> JOB[0000040-151015123257993-oozie-oozi-W] ACTION[] > No > > > > > > > >> Notification > > > > > > > >> > URL > > > > > > > >> > > > is > > > > > > > >> > > > >> defined. Therefore nothing to notify for job > > > > > > > >> > > > >> 0000040-151015123257993-oozie-oozi-W > > > > > > > >> > > > >> 2015-10-29 16:39:11,107 INFO > > ActionStartXCommand:520 - > > > > > > SERVER[ > > > > > > > >> > > > >> hadoop03.housing.com] USER[hdfs] GROUP[-] TOKEN[] > > > > > > > >> APP[java-main-wf] > > > > > > > >> > > > >> JOB[0000040-151015123257993-oozie-oozi-W] > > > > > > > >> > > > >> > ACTION[0000040-151015123257993-oozie-oozi-W@java-node > > ] > > > > > Start > > > > > > > >> action > > > > > > > >> > > > >> [0000040-151015123257993-oozie-oozi-W@java-node] > > with > > > > > > > user-retry > > > > > > > >> > > state > > > > > > > >> > > > : > > > > > > > >> > > > >> userRetryCount [0], userRetryMax [0], > > userRetryInterval > > > > > [10] > > > > > > > >> > > > >> 2015-10-29 16:39:12,222 INFO > JavaActionExecutor:520 > > - > > > > > > SERVER[ > > > > > > > >> > > > >> hadoop03.housing.com] USER[hdfs] GROUP[-] TOKEN[] > > > > > > > >> APP[java-main-wf] > > > > > > > >> > > > >> JOB[0000040-151015123257993-oozie-oozi-W] > > > > > > > >> > > > >> > ACTION[0000040-151015123257993-oozie-oozi-W@java-node > > ] > > > > > > > checking > > > > > > > >> > > action, > > > > > > > >> > > > >> hadoop job ID [job_1444892488693_0073] status > > [RUNNING] > > > > > > > >> > > > >> 2015-10-29 16:39:12,224 INFO > > ActionStartXCommand:520 - > > > > > > SERVER[ > > > > > > > >> > > > >> hadoop03.housing.com] USER[hdfs] GROUP[-] TOKEN[] > > > > > > > >> APP[java-main-wf] > > > > > > > >> > > > >> JOB[0000040-151015123257993-oozie-oozi-W] > > > > > > > >> > > > >> > ACTION[0000040-151015123257993-oozie-oozi-W@java-node > > ] > > > > > > > >> > > > >> [***0000040-151015123257993-oozie-oozi-W@java-node > > > > > ***]Action > > > > > > > >> > > > >> status=RUNNING > > > > > > > >> > > > >> 2015-10-29 16:39:12,224 INFO > > ActionStartXCommand:520 - > > > > > > SERVER[ > > > > > > > >> > > > >> hadoop03.housing.com] USER[hdfs] GROUP[-] TOKEN[] > > > > > > > >> APP[java-main-wf] > > > > > > > >> > > > >> JOB[0000040-151015123257993-oozie-oozi-W] > > > > > > > >> > > > >> > ACTION[0000040-151015123257993-oozie-oozi-W@java-node > > ] > > > > > > > >> > > > >> [***0000040-151015123257993-oozie-oozi-W@java-node > > > > > ***]Action > > > > > > > >> > updated > > > > > > > >> > > in > > > > > > > >> > > > >> DB! > > > > > > > >> > > > >> 2015-10-29 16:39:12,229 INFO > > > > > > WorkflowNotificationXCommand:520 > > > > > > > - > > > > > > > >> > > SERVER[ > > > > > > > >> > > > >> hadoop03.housing.com] USER[-] GROUP[-] TOKEN[-] > > APP[-] > > > > > > > >> > > > >> JOB[0000040-151015123257993-oozie-oozi-W] > > > > > > > >> > > > >> > ACTION[0000040-151015123257993-oozie-oozi-W@java-node > > ] > > > > No > > > > > > > >> > > Notification > > > > > > > >> > > > >> URL is defined. Therefore nothing to notify for job > > > > > > > >> > > > >> 0000040-151015123257993-oozie-oozi-W@java-node > > > > > > > >> > > > >> 2015-10-29 16:39:25,192 INFO CallbackServlet:520 - > > > > SERVER[ > > > > > > > >> > > > >> hadoop03.housing.com] USER[-] GROUP[-] TOKEN[-] > > APP[-] > > > > > > > >> > > > >> JOB[0000040-151015123257993-oozie-oozi-W] > > > > > > > >> > > > >> > ACTION[0000040-151015123257993-oozie-oozi-W@java-node > > ] > > > > > > > callback > > > > > > > >> for > > > > > > > >> > > > >> action > > [0000040-151015123257993-oozie-oozi-W@java-node > > > ] > > > > > > > >> > > > >> 2015-10-29 16:39:25,393 INFO > JavaActionExecutor:520 > > - > > > > > > SERVER[ > > > > > > > >> > > > >> hadoop03.housing.com] USER[hdfs] GROUP[-] TOKEN[] > > > > > > > >> APP[java-main-wf] > > > > > > > >> > > > >> JOB[0000040-151015123257993-oozie-oozi-W] > > > > > > > >> > > > >> > ACTION[0000040-151015123257993-oozie-oozi-W@java-node > > ] > > > > > > action > > > > > > > >> > > > completed, > > > > > > > >> > > > >> external ID [job_1444892488693_0073] > > > > > > > >> > > > >> 2015-10-29 16:39:25,462 INFO > > ActionStartXCommand:520 - > > > > > > SERVER[ > > > > > > > >> > > > >> hadoop03.housing.com] USER[hdfs] GROUP[-] TOKEN[] > > > > > > > >> APP[java-main-wf] > > > > > > > >> > > > >> JOB[0000040-151015123257993-oozie-oozi-W] > > > > > > > >> > > > >> ACTION[0000040-151015123257993-oozie-oozi-W@end] > > Start > > > > > > action > > > > > > > >> > > > >> [0000040-151015123257993-oozie-oozi-W@end] with > > > > user-retry > > > > > > > >> state : > > > > > > > >> > > > >> userRetryCount [0], userRetryMax [0], > > userRetryInterval > > > > > [10] > > > > > > > >> > > > >> 2015-10-29 16:39:25,464 INFO > > ActionStartXCommand:520 - > > > > > > SERVER[ > > > > > > > >> > > > >> hadoop03.housing.com] USER[hdfs] GROUP[-] TOKEN[] > > > > > > > >> APP[java-main-wf] > > > > > > > >> > > > >> JOB[0000040-151015123257993-oozie-oozi-W] > > > > > > > >> > > > >> ACTION[0000040-151015123257993-oozie-oozi-W@end] > > > > > > > >> > > > >> [***0000040-151015123257993-oozie-oozi-W@end > > ***]Action > > > > > > > >> status=DONE > > > > > > > >> > > > >> 2015-10-29 16:39:25,465 INFO > > ActionStartXCommand:520 - > > > > > > SERVER[ > > > > > > > >> > > > >> hadoop03.housing.com] USER[hdfs] GROUP[-] TOKEN[] > > > > > > > >> APP[java-main-wf] > > > > > > > >> > > > >> JOB[0000040-151015123257993-oozie-oozi-W] > > > > > > > >> > > > >> ACTION[0000040-151015123257993-oozie-oozi-W@end] > > > > > > > >> > > > >> [***0000040-151015123257993-oozie-oozi-W@end > > ***]Action > > > > > > updated > > > > > > > >> in > > > > > > > >> > DB! > > > > > > > >> > > > >> 2015-10-29 16:39:25,522 INFO > > > > > > WorkflowNotificationXCommand:520 > > > > > > > - > > > > > > > >> > > SERVER[ > > > > > > > >> > > > >> hadoop03.housing.com] USER[-] GROUP[-] TOKEN[-] > > APP[-] > > > > > > > >> > > > >> JOB[0000040-151015123257993-oozie-oozi-W] > > > > > > > >> > > > >> ACTION[0000040-151015123257993-oozie-oozi-W@end] > No > > > > > > > Notification > > > > > > > >> > URL > > > > > > > >> > > is > > > > > > > >> > > > >> defined. Therefore nothing to notify for job > > > > > > > >> > > > >> 0000040-151015123257993-oozie-oozi-W@end > > > > > > > >> > > > >> 2015-10-29 16:39:25,522 INFO > > > > > > WorkflowNotificationXCommand:520 > > > > > > > - > > > > > > > >> > > SERVER[ > > > > > > > >> > > > >> hadoop03.housing.com] USER[-] GROUP[-] TOKEN[-] > > APP[-] > > > > > > > >> > > > >> JOB[0000040-151015123257993-oozie-oozi-W] ACTION[] > No > > > > > > > >> Notification > > > > > > > >> > URL > > > > > > > >> > > > is > > > > > > > >> > > > >> defined. Therefore nothing to notify for job > > > > > > > >> > > > >> 0000040-151015123257993-oozie-oozi-W > > > > > > > >> > > > >> 2015-10-29 16:39:25,522 INFO > > > > > > WorkflowNotificationXCommand:520 > > > > > > > - > > > > > > > >> > > SERVER[ > > > > > > > >> > > > >> hadoop03.housing.com] USER[-] GROUP[-] TOKEN[-] > > APP[-] > > > > > > > >> > > > >> JOB[0000040-151015123257993-oozie-oozi-W] > > > > > > > >> > > > >> > ACTION[0000040-151015123257993-oozie-oozi-W@java-node > > ] > > > > No > > > > > > > >> > > Notification > > > > > > > >> > > > >> URL is defined. Therefore nothing to notify for job > > > > > > > >> > > > >> 0000040-151015123257993-oozie-oozi-W@java-node > > > > > > > >> > > > >> > > > > > > > >> > > > > > > > > > > > >> > > > > > > > > > > > >> > > > > > > > > > > >> > > > > > > > > > >> > > -- > > > > > > > >> > > > > > _____________________________________________________________ > > > > > > > >> > > The information contained in this communication is > > intended > > > > > solely > > > > > > > for > > > > > > > >> > the > > > > > > > >> > > use of the individual or entity to whom it is addressed > > and > > > > > others > > > > > > > >> > > authorized to receive it. It may contain confidential or > > > > legally > > > > > > > >> > privileged > > > > > > > >> > > information. If you are not the intended recipient you > are > > > > > hereby > > > > > > > >> > notified > > > > > > > >> > > that any disclosure, copying, distribution or taking any > > > > action > > > > > in > > > > > > > >> > reliance > > > > > > > >> > > on the contents of this information is strictly > prohibited > > > and > > > > > may > > > > > > > be > > > > > > > >> > > unlawful. If you have received this communication in > > error, > > > > > please > > > > > > > >> notify > > > > > > > >> > > us immediately by responding to this email and then > delete > > > it > > > > > from > > > > > > > >> your > > > > > > > >> > > system. The firm is neither liable for the proper and > > > complete > > > > > > > >> > transmission > > > > > > > >> > > of the information contained in this communication nor > for > > > any > > > > > > delay > > > > > > > >> in > > > > > > > >> > its > > > > > > > >> > > receipt. > > > > > > > >> > > > > > > > > > >> > > > > > > > > >> > > > > > > > >> -- > > > > > > > >> > _____________________________________________________________ > > > > > > > >> The information contained in this communication is intended > > > solely > > > > > for > > > > > > > the > > > > > > > >> use of the individual or entity to whom it is addressed and > > > others > > > > > > > >> authorized to receive it. It may contain confidential or > > legally > > > > > > > >> privileged > > > > > > > >> information. If you are not the intended recipient you are > > > hereby > > > > > > > notified > > > > > > > >> that any disclosure, copying, distribution or taking any > > action > > > in > > > > > > > >> reliance > > > > > > > >> on the contents of this information is strictly prohibited > and > > > may > > > > > be > > > > > > > >> unlawful. If you have received this communication in error, > > > please > > > > > > > notify > > > > > > > >> us immediately by responding to this email and then delete > it > > > from > > > > > > your > > > > > > > >> system. The firm is neither liable for the proper and > complete > > > > > > > >> transmission > > > > > > > >> of the information contained in this communication nor for > any > > > > delay > > > > > > in > > > > > > > >> its > > > > > > > >> receipt. > > > > > > > >> > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > -- > > > > > > _____________________________________________________________ > > > > > > The information contained in this communication is intended > solely > > > for > > > > > the > > > > > > use of the individual or entity to whom it is addressed and > others > > > > > > authorized to receive it. It may contain confidential or legally > > > > > privileged > > > > > > information. If you are not the intended recipient you are hereby > > > > > notified > > > > > > that any disclosure, copying, distribution or taking any action > in > > > > > reliance > > > > > > on the contents of this information is strictly prohibited and > may > > be > > > > > > unlawful. If you have received this communication in error, > please > > > > notify > > > > > > us immediately by responding to this email and then delete it > from > > > your > > > > > > system. The firm is neither liable for the proper and complete > > > > > transmission > > > > > > of the information contained in this communication nor for any > > delay > > > in > > > > > its > > > > > > receipt. > > > > > > > > > > > > > > > > > > > > > -- > > > _____________________________________________________________ > > > The information contained in this communication is intended solely for > > the > > > use of the individual or entity to whom it is addressed and others > > > authorized to receive it. It may contain confidential or legally > > privileged > > > information. If you are not the intended recipient you are hereby > > notified > > > that any disclosure, copying, distribution or taking any action in > > reliance > > > on the contents of this information is strictly prohibited and may be > > > unlawful. If you have received this communication in error, please > notify > > > us immediately by responding to this email and then delete it from your > > > system. The firm is neither liable for the proper and complete > > transmission > > > of the information contained in this communication nor for any delay in > > its > > > receipt. > > > > > > > -- > _____________________________________________________________ > The information contained in this communication is intended solely for the > use of the individual or entity to whom it is addressed and others > authorized to receive it. It may contain confidential or legally privileged > information. If you are not the intended recipient you are hereby notified > that any disclosure, copying, distribution or taking any action in reliance > on the contents of this information is strictly prohibited and may be > unlawful. If you have received this communication in error, please notify > us immediately by responding to this email and then delete it from your > system. The firm is neither liable for the proper and complete transmission > of the information contained in this communication nor for any delay in its > receipt. >
