Good, So not issue with Yarn or name node urls. Can you share stdout logs.
On Wed, Nov 4, 2015 at 7:15 PM, Jeetendra G <[email protected]> wrote: > Hi Jaydeep here also I cant see any error below are the logs > > Log Type: syslog > > Log Upload Time: Wed Nov 04 14:59:29 +0530 2015 > > Log Length: 25565 > > 2015-11-04 14:59:11,814 INFO [main] > org.apache.hadoop.mapreduce.v2.app.MRAppMaster: Created MRAppMaster > for application appattempt_1446620926630_0017_000001 > 2015-11-04 14:59:12,144 WARN [main] > org.apache.hadoop.util.NativeCodeLoader: Unable to load native-hadoop > library for your platform... using builtin-java classes where > applicable > 2015-11-04 14:59:12,184 INFO [main] > org.apache.hadoop.mapreduce.v2.app.MRAppMaster: Executing with tokens: > 2015-11-04 14:59:12,292 INFO [main] > org.apache.hadoop.mapreduce.v2.app.MRAppMaster: Kind: > YARN_AM_RM_TOKEN, Service: , Ident: (appAttemptId { application_id { > id: 17 cluster_timestamp: 1446620926630 } attemptId: 1 } keyId: > -173762614) > 2015-11-04 14:59:12,293 INFO [main] > org.apache.hadoop.mapreduce.v2.app.MRAppMaster: Kind: > RM_DELEGATION_TOKEN, Service: 10.21.1.136:8050, Ident: (owner=hdfs, > renewer=oozie mr token, realUser=oozie, issueDate=1446629349951, > maxDate=1447234149951, sequenceNumber=26, masterKeyId=6) > 2015-11-04 14:59:12,890 WARN [main] > org.apache.hadoop.hdfs.shortcircuit.DomainSocketFactory: The > short-circuit local reads feature cannot be used because libhadoop > cannot be loaded. > 2015-11-04 14:59:13,064 INFO [main] > org.apache.hadoop.mapreduce.v2.app.MRAppMaster: OutputCommitter set in > config null > 2015-11-04 14:59:13,065 INFO [main] > org.apache.hadoop.mapreduce.v2.app.MRAppMaster: OutputCommitter is > org.apache.hadoop.mapred.FileOutputCommitter > 2015-11-04 14:59:13,110 INFO [main] > org.apache.hadoop.yarn.event.AsyncDispatcher: Registering class > org.apache.hadoop.mapreduce.jobhistory.EventType for class > org.apache.hadoop.mapreduce.jobhistory.JobHistoryEventHandler > 2015-11-04 14:59:13,110 INFO [main] > org.apache.hadoop.yarn.event.AsyncDispatcher: Registering class > org.apache.hadoop.mapreduce.v2.app.job.event.JobEventType for class > org.apache.hadoop.mapreduce.v2.app.MRAppMaster$JobEventDispatcher > 2015-11-04 14:59:13,111 INFO [main] > org.apache.hadoop.yarn.event.AsyncDispatcher: Registering class > org.apache.hadoop.mapreduce.v2.app.job.event.TaskEventType for class > org.apache.hadoop.mapreduce.v2.app.MRAppMaster$TaskEventDispatcher > 2015-11-04 14:59:13,111 INFO [main] > org.apache.hadoop.yarn.event.AsyncDispatcher: Registering class > org.apache.hadoop.mapreduce.v2.app.job.event.TaskAttemptEventType for > class > org.apache.hadoop.mapreduce.v2.app.MRAppMaster$TaskAttemptEventDispatcher > 2015-11-04 14:59:13,112 INFO [main] > org.apache.hadoop.yarn.event.AsyncDispatcher: Registering class > org.apache.hadoop.mapreduce.v2.app.commit.CommitterEventType for class > org.apache.hadoop.mapreduce.v2.app.commit.CommitterEventHandler > 2015-11-04 14:59:13,112 INFO [main] > org.apache.hadoop.yarn.event.AsyncDispatcher: Registering class > org.apache.hadoop.mapreduce.v2.app.speculate.Speculator$EventType for > class > org.apache.hadoop.mapreduce.v2.app.MRAppMaster$SpeculatorEventDispatcher > 2015-11-04 14:59:13,113 INFO [main] > org.apache.hadoop.yarn.event.AsyncDispatcher: Registering class > org.apache.hadoop.mapreduce.v2.app.rm.ContainerAllocator$EventType for > class > org.apache.hadoop.mapreduce.v2.app.MRAppMaster$ContainerAllocatorRouter > 2015-11-04 14:59:13,113 INFO [main] > org.apache.hadoop.yarn.event.AsyncDispatcher: Registering class > org.apache.hadoop.mapreduce.v2.app.launcher.ContainerLauncher$EventType > for class > org.apache.hadoop.mapreduce.v2.app.MRAppMaster$ContainerLauncherRouter > 2015-11-04 14:59:13,144 INFO [main] > org.apache.hadoop.mapreduce.v2.jobhistory.JobHistoryUtils: Default > file system is set solely by core-default.xml therefore - ignoring > 2015-11-04 14:59:13,170 INFO [main] > org.apache.hadoop.mapreduce.v2.jobhistory.JobHistoryUtils: Default > file system is set solely by core-default.xml therefore - ignoring > 2015-11-04 14:59:13,189 INFO [main] > org.apache.hadoop.mapreduce.v2.jobhistory.JobHistoryUtils: Default > file system is set solely by core-default.xml therefore - ignoring > 2015-11-04 14:59:13,219 INFO [main] > org.apache.hadoop.mapreduce.jobhistory.JobHistoryEventHandler: > Emitting job history data to the timeline server is not enabled > 2015-11-04 14:59:13,255 INFO [main] > org.apache.hadoop.yarn.event.AsyncDispatcher: Registering class > org.apache.hadoop.mapreduce.v2.app.job.event.JobFinishEvent$Type for > class org.apache.hadoop.mapreduce.v2.app.MRAppMaster$JobFinishEventHandler > 2015-11-04 14:59:13,453 WARN [main] > org.apache.hadoop.metrics2.impl.MetricsConfig: Cannot locate > configuration: tried > hadoop-metrics2-mrappmaster.properties,hadoop-metrics2.properties > 2015-11-04 14:59:13,546 INFO [main] > org.apache.hadoop.metrics2.impl.MetricsSystemImpl: Scheduled snapshot > period at 10 second(s). > 2015-11-04 14:59:13,546 INFO [main] > org.apache.hadoop.metrics2.impl.MetricsSystemImpl: MRAppMaster metrics > system started > 2015-11-04 14:59:13,557 INFO [main] > org.apache.hadoop.mapreduce.v2.app.job.impl.JobImpl: Adding job token > for job_1446620926630_0017 to jobTokenSecretManager > 2015-11-04 14:59:13,680 INFO [main] > org.apache.hadoop.mapreduce.v2.app.job.impl.JobImpl: Not uberizing > job_1446620926630_0017 because: not enabled; too much RAM; > 2015-11-04 14:59:13,701 INFO [main] > org.apache.hadoop.mapreduce.v2.app.job.impl.JobImpl: Input size for > job job_1446620926630_0017 = 0. Number of splits = 1 > 2015-11-04 14:59:13,701 INFO [main] > org.apache.hadoop.mapreduce.v2.app.job.impl.JobImpl: Number of reduces > for job job_1446620926630_0017 = 0 > 2015-11-04 14:59:13,701 INFO [main] > org.apache.hadoop.mapreduce.v2.app.job.impl.JobImpl: > job_1446620926630_0017Job Transitioned from NEW to INITED > 2015-11-04 14:59:13,702 INFO [main] > org.apache.hadoop.mapreduce.v2.app.MRAppMaster: MRAppMaster launching > normal, non-uberized, multi-container job job_1446620926630_0017. > 2015-11-04 14:59:13,725 INFO [main] > org.apache.hadoop.ipc.CallQueueManager: Using callQueue class > java.util.concurrent.LinkedBlockingQueue > 2015-11-04 14:59:13,736 INFO [Socket Reader #1 for port 39640] > org.apache.hadoop.ipc.Server: Starting Socket Reader #1 for port 39640 > 2015-11-04 14:59:13,758 INFO [main] > org.apache.hadoop.yarn.factories.impl.pb.RpcServerFactoryPBImpl: > Adding protocol org.apache.hadoop.mapreduce.v2.api.MRClientProtocolPB > to the server > 2015-11-04 14:59:13,759 INFO [IPC Server Responder] > org.apache.hadoop.ipc.Server: IPC Server Responder: starting > 2015-11-04 14:59:13,761 INFO [IPC Server listener on 39640] > org.apache.hadoop.ipc.Server: IPC Server listener on 39640: starting > 2015-11-04 14:59:13,762 INFO [main] > org.apache.hadoop.mapreduce.v2.app.client.MRClientService: > Instantiated MRClientService at hadoop04.housing.com/10.21.1.138:39640 > 2015-11-04 14:59:13,853 INFO [main] org.mortbay.log: Logging to > org.slf4j.impl.Log4jLoggerAdapter(org.mortbay.log) via > org.mortbay.log.Slf4jLog > 2015-11-04 14:59:13,862 INFO [main] > org.apache.hadoop.security.authentication.server.AuthenticationFilter: > Unable to initialize FileSignerSecretProvider, falling back to use > random secrets. > 2015-11-04 14:59:13,867 WARN [main] > org.apache.hadoop.http.HttpRequestLog: Jetty request log can only be > enabled using Log4j > 2015-11-04 14:59:13,874 INFO [main] > org.apache.hadoop.http.HttpServer2: Added global filter 'safety' > (class=org.apache.hadoop.http.HttpServer2$QuotingInputFilter) > 2015-11-04 14:59:13,878 INFO [main] > org.apache.hadoop.http.HttpServer2: Added filter AM_PROXY_FILTER > (class=org.apache.hadoop.yarn.server.webproxy.amfilter.AmIpFilter) to > context mapreduce > 2015-11-04 14:59:13,879 INFO [main] > org.apache.hadoop.http.HttpServer2: Added filter AM_PROXY_FILTER > (class=org.apache.hadoop.yarn.server.webproxy.amfilter.AmIpFilter) to > context static > 2015-11-04 14:59:13,882 INFO [main] > org.apache.hadoop.http.HttpServer2: adding path spec: /mapreduce/* > 2015-11-04 14:59:13,882 INFO [main] > org.apache.hadoop.http.HttpServer2: adding path spec: /ws/* > 2015-11-04 14:59:14,217 INFO [main] > org.apache.hadoop.yarn.webapp.WebApps: Registered webapp guice modules > 2015-11-04 14:59:14,218 INFO [main] > org.apache.hadoop.http.HttpServer2: Jetty bound to port 49791 > 2015-11-04 14:59:14,219 INFO [main] org.mortbay.log: jetty-6.1.26.hwx > 2015-11-04 14:59:14,260 INFO [main] org.mortbay.log: Extract > > jar:file:/hadoop/yarn/local/filecache/10/mapreduce.tar.gz/hadoop/share/hadoop/yarn/hadoop-yarn-common-2.7.1.2.3.2.0-2950.jar!/webapps/mapreduce > to ./tmp/Jetty_0_0_0_0_49791_mapreduce____.kdgzqp/webapp > 2015-11-04 14:59:15,952 INFO [main] org.mortbay.log: Started > [email protected]:49791 > 2015-11-04 14:59:15,952 INFO [main] > org.apache.hadoop.yarn.webapp.WebApps: Web app /mapreduce started at > 49791 > 2015-11-04 14:59:15,957 INFO [main] > org.apache.hadoop.ipc.CallQueueManager: Using callQueue class > java.util.concurrent.LinkedBlockingQueue > 2015-11-04 14:59:15,957 INFO [Socket Reader #1 for port 50432] > org.apache.hadoop.ipc.Server: Starting Socket Reader #1 for port 50432 > 2015-11-04 14:59:15,963 INFO [IPC Server Responder] > org.apache.hadoop.ipc.Server: IPC Server Responder: starting > 2015-11-04 14:59:15,963 INFO [IPC Server listener on 50432] > org.apache.hadoop.ipc.Server: IPC Server listener on 50432: starting > 2015-11-04 14:59:15,988 INFO [main] > org.apache.hadoop.mapreduce.v2.app.rm.RMContainerRequestor: > nodeBlacklistingEnabled:true > 2015-11-04 14:59:15,988 INFO [main] > org.apache.hadoop.mapreduce.v2.app.rm.RMContainerRequestor: > maxTaskFailuresPerNode is 3 > 2015-11-04 14:59:15,988 INFO [main] > org.apache.hadoop.mapreduce.v2.app.rm.RMContainerRequestor: > blacklistDisablePercent is 33 > 2015-11-04 14:59:16,035 INFO [main] > org.apache.hadoop.yarn.client.RMProxy: Connecting to ResourceManager > at hadoop02.housing.com/10.21.1.136:8030 > 2015-11-04 14:59:16,113 INFO [main] > org.apache.hadoop.mapreduce.v2.app.rm.RMCommunicator: > maxContainerCapability: <memory:5120, vCores:3> > 2015-11-04 14:59:16,113 INFO [main] > org.apache.hadoop.mapreduce.v2.app.rm.RMCommunicator: queue: default > 2015-11-04 14:59:16,117 INFO [main] > org.apache.hadoop.mapreduce.v2.app.launcher.ContainerLauncherImpl: > Upper limit on the thread pool size is 500 > 2015-11-04 14:59:16,118 INFO [main] > org.apache.hadoop.mapreduce.v2.app.launcher.ContainerLauncherImpl: The > thread pool initial size is 10 > 2015-11-04 14:59:16,120 INFO [main] > org.apache.hadoop.yarn.client.api.impl.ContainerManagementProtocolProxy: > yarn.client.max-cached-nodemanagers-proxies : 0 > 2015-11-04 14:59:16,127 INFO [AsyncDispatcher event handler] > org.apache.hadoop.mapreduce.v2.app.job.impl.JobImpl: > job_1446620926630_0017Job Transitioned from INITED to SETUP > 2015-11-04 14:59:16,157 INFO [CommitterEvent Processor #0] > org.apache.hadoop.mapreduce.v2.app.commit.CommitterEventHandler: > Processing the event EventType: JOB_SETUP > 2015-11-04 14:59:16,160 INFO [CommitterEvent Processor #0] > org.apache.hadoop.mapreduce.lib.output.FileOutputCommitter: File > Output Committer Algorithm version is 1 > 2015-11-04 14:59:16,173 INFO [AsyncDispatcher event handler] > org.apache.hadoop.mapreduce.v2.app.job.impl.JobImpl: > job_1446620926630_0017Job Transitioned from SETUP to RUNNING > 2015-11-04 14:59:16,194 INFO [AsyncDispatcher event handler] > org.apache.hadoop.mapreduce.v2.app.job.impl.TaskImpl: > task_1446620926630_0017_m_000000 Task Transitioned from NEW to > SCHEDULED > 2015-11-04 14:59:16,195 INFO [AsyncDispatcher event handler] > org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl: > attempt_1446620926630_0017_m_000000_0 TaskAttempt Transitioned from > NEW to UNASSIGNED > 2015-11-04 14:59:16,202 INFO [Thread-51] > org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator: > mapResourceRequest:<memory:1536, vCores:1> > 2015-11-04 14:59:16,252 INFO [eventHandlingThread] > org.apache.hadoop.mapreduce.jobhistory.JobHistoryEventHandler: Event > Writer setup for JobId: job_1446620926630_0017, File: > hdfs:// > hadoop01.housing.com:8020/user/hdfs/.staging/job_1446620926630_0017/job_1446620926630_0017_1.jhist > 2015-11-04 14:59:17,117 INFO [RMCommunicator Allocator] > org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator: Before > Scheduling: PendingReds:0 ScheduledMaps:1 ScheduledReds:0 > AssignedMaps:0 AssignedReds:0 CompletedMaps:0 CompletedReds:0 > ContAlloc:0 ContRel:0 HostLocal:0 RackLocal:0 > 2015-11-04 14:59:17,154 INFO [RMCommunicator Allocator] > org.apache.hadoop.mapreduce.v2.app.rm.RMContainerRequestor: > getResources() for application_1446620926630_0017: ask=1 release= 0 > newContainers=0 finishedContainers=0 resourcelimit=<memory:19840, > vCores:1> knownNMs=5 > 2015-11-04 14:59:18,171 INFO [RMCommunicator Allocator] > org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator: Got > allocated containers 1 > 2015-11-04 14:59:18,198 INFO [RMCommunicator Allocator] > org.apache.hadoop.yarn.util.RackResolver: Resolved > hadoop04.housing.com to /default-rack > 2015-11-04 14:59:18,201 INFO [RMCommunicator Allocator] > org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator: Assigned > container container_e02_1446620926630_0017_01_000002 to > attempt_1446620926630_0017_m_000000_0 > 2015-11-04 14:59:18,202 INFO [RMCommunicator Allocator] > org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator: After > Scheduling: PendingReds:0 ScheduledMaps:0 ScheduledReds:0 > AssignedMaps:1 AssignedReds:0 CompletedMaps:0 CompletedReds:0 > ContAlloc:1 ContRel:0 HostLocal:0 RackLocal:0 > 2015-11-04 14:59:18,245 INFO [AsyncDispatcher event handler] > org.apache.hadoop.yarn.util.RackResolver: Resolved > hadoop04.housing.com to /default-rack > 2015-11-04 14:59:18,245 INFO [AsyncDispatcher event handler] > org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl: Job jar > is not present. Not adding any jar to the list of resources. > 2015-11-04 14:59:18,263 INFO [AsyncDispatcher event handler] > org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl: The > job-conf file on the remote FS is > /user/hdfs/.staging/job_1446620926630_0017/job.xml > 2015-11-04 14:59:18,290 INFO [AsyncDispatcher event handler] > org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl: Adding #1 > tokens and #1 secret keys for NM use for launching container > 2015-11-04 14:59:18,290 INFO [AsyncDispatcher event handler] > org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl: Size of > containertokens_dob is 2 > 2015-11-04 14:59:18,291 INFO [AsyncDispatcher event handler] > org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl: Putting > shuffle token in serviceData > 2015-11-04 14:59:18,359 INFO [AsyncDispatcher event handler] > org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl: > attempt_1446620926630_0017_m_000000_0 TaskAttempt Transitioned from > UNASSIGNED to ASSIGNED > 2015-11-04 14:59:18,363 INFO [ContainerLauncher #0] > org.apache.hadoop.mapreduce.v2.app.launcher.ContainerLauncherImpl: > Processing the event EventType: CONTAINER_REMOTE_LAUNCH for container > container_e02_1446620926630_0017_01_000002 taskAttempt > attempt_1446620926630_0017_m_000000_0 > 2015-11-04 14:59:18,364 INFO [ContainerLauncher #0] > org.apache.hadoop.mapreduce.v2.app.launcher.ContainerLauncherImpl: > Launching attempt_1446620926630_0017_m_000000_0 > 2015-11-04 14:59:18,365 INFO [ContainerLauncher #0] > org.apache.hadoop.yarn.client.api.impl.ContainerManagementProtocolProxy: > Opening proxy : hadoop04.housing.com:45454 > 2015-11-04 14:59:18,435 INFO [ContainerLauncher #0] > org.apache.hadoop.mapreduce.v2.app.launcher.ContainerLauncherImpl: > Shuffle port returned by ContainerManager for > attempt_1446620926630_0017_m_000000_0 : 13562 > 2015-11-04 14:59:18,437 INFO [AsyncDispatcher event handler] > org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl: > TaskAttempt: [attempt_1446620926630_0017_m_000000_0] using > containerId: [container_e02_1446620926630_0017_01_000002 on NM: > [hadoop04.housing.com:45454] > 2015-11-04 14:59:18,439 INFO [AsyncDispatcher event handler] > org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl: > attempt_1446620926630_0017_m_000000_0 TaskAttempt Transitioned from > ASSIGNED to RUNNING > 2015-11-04 14:59:18,440 INFO [AsyncDispatcher event handler] > org.apache.hadoop.mapreduce.v2.app.job.impl.TaskImpl: > task_1446620926630_0017_m_000000 Task Transitioned from SCHEDULED to > RUNNING > 2015-11-04 14:59:19,213 INFO [RMCommunicator Allocator] > org.apache.hadoop.mapreduce.v2.app.rm.RMContainerRequestor: > getResources() for application_1446620926630_0017: ask=1 release= 0 > newContainers=0 finishedContainers=0 resourcelimit=<memory:17920, > vCores:1> knownNMs=5 > 2015-11-04 14:59:20,114 INFO [Socket Reader #1 for port 50432] > SecurityLogger.org.apache.hadoop.ipc.Server: Auth successful for > job_1446620926630_0017 (auth:SIMPLE) > 2015-11-04 14:59:20,138 INFO [IPC Server handler 3 on 50432] > org.apache.hadoop.mapred.TaskAttemptListenerImpl: JVM with ID : > jvm_1446620926630_0017_m_2199023255554 asked for a task > 2015-11-04 14:59:20,139 INFO [IPC Server handler 3 on 50432] > org.apache.hadoop.mapred.TaskAttemptListenerImpl: JVM with ID: > jvm_1446620926630_0017_m_2199023255554 given task: > attempt_1446620926630_0017_m_000000_0 > 2015-11-04 14:59:22,549 INFO [IPC Server handler 2 on 50432] > org.apache.hadoop.mapred.TaskAttemptListenerImpl: Progress of > TaskAttempt attempt_1446620926630_0017_m_000000_0 is : 0.0 > 2015-11-04 14:59:22,589 INFO [IPC Server handler 1 on 50432] > org.apache.hadoop.mapred.TaskAttemptListenerImpl: Commit-pending state > update from attempt_1446620926630_0017_m_000000_0 > 2015-11-04 14:59:22,590 INFO [AsyncDispatcher event handler] > org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl: > attempt_1446620926630_0017_m_000000_0 TaskAttempt Transitioned from > RUNNING to COMMIT_PENDING > 2015-11-04 14:59:22,591 INFO [AsyncDispatcher event handler] > org.apache.hadoop.mapreduce.v2.app.job.impl.TaskImpl: > attempt_1446620926630_0017_m_000000_0 given a go for committing the > task output. > 2015-11-04 14:59:22,597 INFO [IPC Server handler 0 on 50432] > org.apache.hadoop.mapred.TaskAttemptListenerImpl: Commit go/no-go > request from attempt_1446620926630_0017_m_000000_0 > 2015-11-04 14:59:22,598 INFO [IPC Server handler 0 on 50432] > org.apache.hadoop.mapreduce.v2.app.job.impl.TaskImpl: Result of > canCommit for attempt_1446620926630_0017_m_000000_0:true > 2015-11-04 14:59:22,635 INFO [IPC Server handler 4 on 50432] > org.apache.hadoop.mapred.TaskAttemptListenerImpl: Progress of > TaskAttempt attempt_1446620926630_0017_m_000000_0 is : 1.0 > 2015-11-04 14:59:22,643 INFO [IPC Server handler 16 on 50432] > org.apache.hadoop.mapred.TaskAttemptListenerImpl: Done acknowledgement > from attempt_1446620926630_0017_m_000000_0 > 2015-11-04 14:59:22,645 INFO [AsyncDispatcher event handler] > org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl: > attempt_1446620926630_0017_m_000000_0 TaskAttempt Transitioned from > COMMIT_PENDING to SUCCESS_CONTAINER_CLEANUP > 2015-11-04 14:59:22,647 INFO [ContainerLauncher #1] > org.apache.hadoop.mapreduce.v2.app.launcher.ContainerLauncherImpl: > Processing the event EventType: CONTAINER_REMOTE_CLEANUP for container > container_e02_1446620926630_0017_01_000002 taskAttempt > attempt_1446620926630_0017_m_000000_0 > 2015-11-04 14:59:22,648 INFO [ContainerLauncher #1] > org.apache.hadoop.mapreduce.v2.app.launcher.ContainerLauncherImpl: > KILLING attempt_1446620926630_0017_m_000000_0 > 2015-11-04 14:59:22,648 INFO [ContainerLauncher #1] > org.apache.hadoop.yarn.client.api.impl.ContainerManagementProtocolProxy: > Opening proxy : hadoop04.housing.com:45454 > 2015-11-04 14:59:22,675 INFO [AsyncDispatcher event handler] > org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl: > attempt_1446620926630_0017_m_000000_0 TaskAttempt Transitioned from > SUCCESS_CONTAINER_CLEANUP to SUCCEEDED > 2015-11-04 14:59:22,683 INFO [AsyncDispatcher event handler] > org.apache.hadoop.mapreduce.v2.app.job.impl.TaskImpl: Task succeeded > with attempt attempt_1446620926630_0017_m_000000_0 > 2015-11-04 14:59:22,683 INFO [AsyncDispatcher event handler] > org.apache.hadoop.mapreduce.v2.app.job.impl.TaskImpl: > task_1446620926630_0017_m_000000 Task Transitioned from RUNNING to > SUCCEEDED > 2015-11-04 14:59:22,685 INFO [AsyncDispatcher event handler] > org.apache.hadoop.mapreduce.v2.app.job.impl.JobImpl: Num completed > Tasks: 1 > 2015-11-04 14:59:22,685 INFO [AsyncDispatcher event handler] > org.apache.hadoop.mapreduce.v2.app.job.impl.JobImpl: > job_1446620926630_0017Job Transitioned from RUNNING to COMMITTING > 2015-11-04 14:59:22,697 INFO [CommitterEvent Processor #1] > org.apache.hadoop.mapreduce.v2.app.commit.CommitterEventHandler: > Processing the event EventType: JOB_COMMIT > 2015-11-04 14:59:22,787 INFO [AsyncDispatcher event handler] > org.apache.hadoop.mapreduce.v2.app.job.impl.JobImpl: Calling handler > for JobFinishedEvent > 2015-11-04 14:59:22,787 INFO [AsyncDispatcher event handler] > org.apache.hadoop.mapreduce.v2.app.job.impl.JobImpl: > job_1446620926630_0017Job Transitioned from COMMITTING to SUCCEEDED > 2015-11-04 14:59:22,792 INFO [Thread-67] > org.apache.hadoop.mapreduce.v2.app.MRAppMaster: We are finishing > cleanly so this is the last retry > 2015-11-04 14:59:22,792 INFO [Thread-67] > org.apache.hadoop.mapreduce.v2.app.MRAppMaster: Notify RMCommunicator > isAMLastRetry: true > 2015-11-04 14:59:22,793 INFO [Thread-67] > org.apache.hadoop.mapreduce.v2.app.rm.RMCommunicator: RMCommunicator > notified that shouldUnregistered is: true > 2015-11-04 14:59:22,793 INFO [Thread-67] > org.apache.hadoop.mapreduce.v2.app.MRAppMaster: Notify JHEH > isAMLastRetry: true > 2015-11-04 14:59:22,793 INFO [Thread-67] > org.apache.hadoop.mapreduce.jobhistory.JobHistoryEventHandler: > JobHistoryEventHandler notified that forceJobCompletion is true > 2015-11-04 14:59:22,793 INFO [Thread-67] > org.apache.hadoop.mapreduce.v2.app.MRAppMaster: Calling stop for all > the services > 2015-11-04 14:59:22,793 INFO [Thread-67] > org.apache.hadoop.mapreduce.jobhistory.JobHistoryEventHandler: > Stopping JobHistoryEventHandler. Size of the outstanding queue size is > 0 > 2015-11-04 14:59:22,845 INFO [eventHandlingThread] > org.apache.hadoop.mapreduce.jobhistory.JobHistoryEventHandler: Copying > hdfs:// > hadoop01.housing.com:8020/user/hdfs/.staging/job_1446620926630_0017/job_1446620926630_0017_1.jhist > to hdfs:// > hadoop01.housing.com:8020/mr-history/tmp/hdfs/job_1446620926630_0017-1446629350323-hdfs-oozie%3Alauncher%3AT%3Djava%3AW%3Djava%2Dmain%2Dwf%3AA%3Djava%2Dnode%3AI-1446629362786-1-0-SUCCEEDED-default-1446629356124.jhist_tmp > 2015-11-04 14:59:22,880 INFO [eventHandlingThread] > org.apache.hadoop.mapreduce.jobhistory.JobHistoryEventHandler: Copied > to done location: > hdfs:// > hadoop01.housing.com:8020/mr-history/tmp/hdfs/job_1446620926630_0017-1446629350323-hdfs-oozie%3Alauncher%3AT%3Djava%3AW%3Djava%2Dmain%2Dwf%3AA%3Djava%2Dnode%3AI-1446629362786-1-0-SUCCEEDED-default-1446629356124.jhist_tmp > 2015-11-04 14:59:22,883 INFO [eventHandlingThread] > org.apache.hadoop.mapreduce.jobhistory.JobHistoryEventHandler: Copying > hdfs:// > hadoop01.housing.com:8020/user/hdfs/.staging/job_1446620926630_0017/job_1446620926630_0017_1_conf.xml > to hdfs:// > hadoop01.housing.com:8020/mr-history/tmp/hdfs/job_1446620926630_0017_conf.xml_tmp > 2015-11-04 14:59:22,956 INFO [eventHandlingThread] > org.apache.hadoop.mapreduce.jobhistory.JobHistoryEventHandler: Copied > to done location: > hdfs:// > hadoop01.housing.com:8020/mr-history/tmp/hdfs/job_1446620926630_0017_conf.xml_tmp > 2015-11-04 14:59:22,960 INFO [eventHandlingThread] > org.apache.hadoop.mapreduce.jobhistory.JobHistoryEventHandler: Moved > tmp to done: hdfs:// > hadoop01.housing.com:8020/mr-history/tmp/hdfs/job_1446620926630_0017.summary_tmp > to hdfs:// > hadoop01.housing.com:8020/mr-history/tmp/hdfs/job_1446620926630_0017.summary > 2015-11-04 14:59:22,962 INFO [eventHandlingThread] > org.apache.hadoop.mapreduce.jobhistory.JobHistoryEventHandler: Moved > tmp to done: hdfs:// > hadoop01.housing.com:8020/mr-history/tmp/hdfs/job_1446620926630_0017_conf.xml_tmp > to hdfs:// > hadoop01.housing.com:8020/mr-history/tmp/hdfs/job_1446620926630_0017_conf.xml > 2015-11-04 14:59:22,964 INFO [eventHandlingThread] > org.apache.hadoop.mapreduce.jobhistory.JobHistoryEventHandler: Moved > tmp to done: hdfs:// > hadoop01.housing.com:8020/mr-history/tmp/hdfs/job_1446620926630_0017-1446629350323-hdfs-oozie%3Alauncher%3AT%3Djava%3AW%3Djava%2Dmain%2Dwf%3AA%3Djava%2Dnode%3AI-1446629362786-1-0-SUCCEEDED-default-1446629356124.jhist_tmp > to hdfs:// > hadoop01.housing.com:8020/mr-history/tmp/hdfs/job_1446620926630_0017-1446629350323-hdfs-oozie%3Alauncher%3AT%3Djava%3AW%3Djava%2Dmain%2Dwf%3AA%3Djava%2Dnode%3AI-1446629362786-1-0-SUCCEEDED-default-1446629356124.jhist > 2015-11-04 14:59:22,965 INFO [Thread-67] > org.apache.hadoop.mapreduce.jobhistory.JobHistoryEventHandler: Stopped > JobHistoryEventHandler. super.stop() > 2015-11-04 14:59:22,968 INFO [Thread-67] > org.apache.hadoop.mapreduce.v2.app.rm.RMCommunicator: Setting job > diagnostics to > 2015-11-04 14:59:22,969 INFO [Thread-67] > org.apache.hadoop.mapreduce.v2.app.rm.RMCommunicator: History url is > http://hadoop03.housing.com:19888/jobhistory/job/job_1446620926630_0017 > 2015-11-04 14:59:22,976 INFO [Thread-67] > org.apache.hadoop.mapreduce.v2.app.rm.RMCommunicator: Waiting for > application to be successfully unregistered. > 2015-11-04 14:59:23,979 INFO [Thread-67] > org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator: Final > Stats: PendingReds:0 ScheduledMaps:0 ScheduledReds:0 AssignedMaps:1 > AssignedReds:0 CompletedMaps:0 CompletedReds:0 ContAlloc:1 ContRel:0 > HostLocal:0 RackLocal:0 > 2015-11-04 14:59:23,980 INFO [Thread-67] > org.apache.hadoop.mapreduce.v2.app.MRAppMaster: Deleting staging > directory hdfs://hadoop01.housing.com:8020 > /user/hdfs/.staging/job_1446620926630_0017 > 2015-11-04 14:59:23,984 INFO [Thread-67] org.apache.hadoop.ipc.Server: > Stopping server on 50432 > 2015-11-04 14:59:23,985 INFO [IPC Server listener on 50432] > org.apache.hadoop.ipc.Server: Stopping IPC Server listener on 50432 > 2015-11-04 14:59:23,986 INFO [IPC Server Responder] > org.apache.hadoop.ipc.Server: Stopping IPC Server Responder > 2015-11-04 14:59:23,986 INFO [TaskHeartbeatHandler PingChecker] > org.apache.hadoop.mapreduce.v2.app.TaskHeartbeatHandler: > TaskHeartbeatHandler thread interrupted > > > On Wed, Nov 4, 2015 at 6:38 PM, Jaydeep Vishwakarma < > [email protected]> wrote: > > > In first look I am not seeing any issue with job tracker or name node > URL. > > The job id is getting generated. Workflow Job is not going on PREP mode. > > > > Open this link. > > http://hadoop02.housing.com:8088/proxy/application_1446620926630_0014/ > > > > You will be see the problem. > > > > > > > > On Wed, Nov 4, 2015 at 6:24 PM, Jeetendra G <[email protected]> > > wrote: > > > > > hey Serega I have cross verified jobTracker value is correct only I am > > > using yarn so resource manager will become the job tracker? > > > > > > On Wed, Nov 4, 2015 at 6:17 PM, Serega Sheypak < > [email protected] > > > > > > wrote: > > > > > > > Can you go to oozie server and grab logs from there? My assumption > that > > > > <job-tracker>${jobTracker}</job-tracker> > > > > <name-node>${nameNode}</name-node> > > > > > > > > have incorrect values. Probably ${jobTracker} is wrong and oozie > can't > > > even > > > > start launcher mapper. > > > > > > > > 2015-11-04 13:43 GMT+01:00 Jaydeep Vishwakarma < > > > > [email protected]>: > > > > > > > > > You are doing -log. Can you give the command as below and get the > job > > > url > > > > > (application launcher url). > > > > > > > > > > *oozie job -info 0000040-151015123257993-oozie-oozi-W@java-node* > > > > > > > > > > > > > > > > > > > > On Wed, Nov 4, 2015 at 5:53 PM, Jeetendra G < > [email protected] > > > > > > > > wrote: > > > > > > > > > > > and in job error log tab its saying error log is disables? by > > default > > > > why > > > > > > error log is disables? i am using hortonworks > > > > > > > > > > > > On Wed, Nov 4, 2015 at 5:50 PM, Jeetendra G < > > [email protected] > > > > > > > > > > wrote: > > > > > > > > > > > > > same error. > > > > > > > > > > > > > > 2015-11-04 14:09:00,935 INFO ActionStartXCommand:520 - SERVER[ > > > > > > > hadoop03.housing.com] USER[hdfs] GROUP[-] TOKEN[] > > > APP[java-main-wf] > > > > > > > JOB[0000004-151104124010010-oozie-oozi-W] > > > > > > > ACTION[0000004-151104124010010-oozie-oozi-W@:start:] Start > > action > > > > > > > [0000004-151104124010010-oozie-oozi-W@:start:] with user-retry > > > > state : > > > > > > > userRetryCount [0], userRetryMax [0], userRetryInterval [10] > > > > > > > 2015-11-04 14:09:00,940 INFO ActionStartXCommand:520 - SERVER[ > > > > > > > hadoop03.housing.com] USER[hdfs] GROUP[-] TOKEN[] > > > APP[java-main-wf] > > > > > > > JOB[0000004-151104124010010-oozie-oozi-W] > > > > > > > ACTION[0000004-151104124010010-oozie-oozi-W@:start:] > > > > > > > [***0000004-151104124010010-oozie-oozi-W@:start:***]Action > > > > status=DONE > > > > > > > 2015-11-04 14:09:00,940 INFO ActionStartXCommand:520 - SERVER[ > > > > > > > hadoop03.housing.com] USER[hdfs] GROUP[-] TOKEN[] > > > APP[java-main-wf] > > > > > > > JOB[0000004-151104124010010-oozie-oozi-W] > > > > > > > ACTION[0000004-151104124010010-oozie-oozi-W@:start:] > > > > > > > [***0000004-151104124010010-oozie-oozi-W@:start:***]Action > > updated > > > > in > > > > > > DB! > > > > > > > 2015-11-04 14:09:00,994 INFO WorkflowNotificationXCommand:520 > - > > > > > SERVER[ > > > > > > > hadoop03.housing.com] USER[-] GROUP[-] TOKEN[-] APP[-] > > > > > > > JOB[0000004-151104124010010-oozie-oozi-W] > > > > > > > ACTION[0000004-151104124010010-oozie-oozi-W@:start:] No > > > Notification > > > > > URL > > > > > > > is defined. Therefore nothing to notify for job > > > > > > > 0000004-151104124010010-oozie-oozi-W@:start: > > > > > > > 2015-11-04 14:09:01,004 INFO WorkflowNotificationXCommand:520 > - > > > > > SERVER[ > > > > > > > hadoop03.housing.com] USER[-] GROUP[-] TOKEN[-] APP[-] > > > > > > > JOB[0000004-151104124010010-oozie-oozi-W] ACTION[] No > > Notification > > > > URL > > > > > is > > > > > > > defined. Therefore nothing to notify for job > > > > > > > 0000004-151104124010010-oozie-oozi-W > > > > > > > 2015-11-04 14:09:01,014 INFO ActionStartXCommand:520 - SERVER[ > > > > > > > hadoop03.housing.com] USER[hdfs] GROUP[-] TOKEN[] > > > APP[java-main-wf] > > > > > > > JOB[0000004-151104124010010-oozie-oozi-W] > > > > > > > ACTION[0000004-151104124010010-oozie-oozi-W@java-node] Start > > > action > > > > > > > [0000004-151104124010010-oozie-oozi-W@java-node] with > user-retry > > > > > state : > > > > > > > userRetryCount [0], userRetryMax [0], userRetryInterval [10] > > > > > > > 2015-11-04 14:09:02,916 INFO JavaActionExecutor:520 - SERVER[ > > > > > > > hadoop03.housing.com] USER[hdfs] GROUP[-] TOKEN[] > > > APP[java-main-wf] > > > > > > > JOB[0000004-151104124010010-oozie-oozi-W] > > > > > > > ACTION[0000004-151104124010010-oozie-oozi-W@java-node] > checking > > > > > action, > > > > > > > hadoop job ID [job_1446620926630_0016] status [RUNNING] > > > > > > > 2015-11-04 14:09:02,918 INFO ActionStartXCommand:520 - SERVER[ > > > > > > > hadoop03.housing.com] USER[hdfs] GROUP[-] TOKEN[] > > > APP[java-main-wf] > > > > > > > JOB[0000004-151104124010010-oozie-oozi-W] > > > > > > > ACTION[0000004-151104124010010-oozie-oozi-W@java-node] > > > > > > > [***0000004-151104124010010-oozie-oozi-W@java-node***]Action > > > > > > > status=RUNNING > > > > > > > 2015-11-04 14:09:02,918 INFO ActionStartXCommand:520 - SERVER[ > > > > > > > hadoop03.housing.com] USER[hdfs] GROUP[-] TOKEN[] > > > APP[java-main-wf] > > > > > > > JOB[0000004-151104124010010-oozie-oozi-W] > > > > > > > ACTION[0000004-151104124010010-oozie-oozi-W@java-node] > > > > > > > [***0000004-151104124010010-oozie-oozi-W@java-node***]Action > > > updated > > > > > in > > > > > > > DB! > > > > > > > 2015-11-04 14:09:02,926 INFO WorkflowNotificationXCommand:520 > - > > > > > SERVER[ > > > > > > > hadoop03.housing.com] USER[-] GROUP[-] TOKEN[-] APP[-] > > > > > > > JOB[0000004-151104124010010-oozie-oozi-W] > > > > > > > ACTION[0000004-151104124010010-oozie-oozi-W@java-node] No > > > > Notification > > > > > > > URL is defined. Therefore nothing to notify for job > > > > > > > 0000004-151104124010010-oozie-oozi-W@java-node > > > > > > > 2015-11-04 14:09:17,606 INFO CallbackServlet:520 - SERVER[ > > > > > > > hadoop03.housing.com] USER[-] GROUP[-] TOKEN[-] APP[-] > > > > > > > JOB[0000004-151104124010010-oozie-oozi-W] > > > > > > > ACTION[0000004-151104124010010-oozie-oozi-W@java-node] > callback > > > for > > > > > > > action [0000004-151104124010010-oozie-oozi-W@java-node] > > > > > > > 2015-11-04 14:09:17,907 INFO JavaActionExecutor:520 - SERVER[ > > > > > > > hadoop03.housing.com] USER[hdfs] GROUP[-] TOKEN[] > > > APP[java-main-wf] > > > > > > > JOB[0000004-151104124010010-oozie-oozi-W] > > > > > > > ACTION[0000004-151104124010010-oozie-oozi-W@java-node] action > > > > > completed, > > > > > > > external ID [job_1446620926630_0016] > > > > > > > 2015-11-04 14:09:18,029 INFO ActionStartXCommand:520 - SERVER[ > > > > > > > hadoop03.housing.com] USER[hdfs] GROUP[-] TOKEN[] > > > APP[java-main-wf] > > > > > > > JOB[0000004-151104124010010-oozie-oozi-W] > > > > > > > ACTION[0000004-151104124010010-oozie-oozi-W@end] Start action > > > > > > > [0000004-151104124010010-oozie-oozi-W@end] with user-retry > > state : > > > > > > > userRetryCount [0], userRetryMax [0], userRetryInterval [10] > > > > > > > 2015-11-04 14:09:18,034 INFO ActionStartXCommand:520 - SERVER[ > > > > > > > hadoop03.housing.com] USER[hdfs] GROUP[-] TOKEN[] > > > APP[java-main-wf] > > > > > > > JOB[0000004-151104124010010-oozie-oozi-W] > > > > > > > ACTION[0000004-151104124010010-oozie-oozi-W@end] > > > > > > > [***0000004-151104124010010-oozie-oozi-W@end***]Action > > status=DONE > > > > > > > 2015-11-04 14:09:18,034 INFO ActionStartXCommand:520 - SERVER[ > > > > > > > hadoop03.housing.com] USER[hdfs] GROUP[-] TOKEN[] > > > APP[java-main-wf] > > > > > > > JOB[0000004-151104124010010-oozie-oozi-W] > > > > > > > ACTION[0000004-151104124010010-oozie-oozi-W@end] > > > > > > > [***0000004-151104124010010-oozie-oozi-W@end***]Action updated > > in > > > > DB! > > > > > > > 2015-11-04 14:09:18,104 INFO WorkflowNotificationXCommand:520 > - > > > > > SERVER[ > > > > > > > hadoop03.housing.com] USER[-] GROUP[-] TOKEN[-] APP[-] > > > > > > > JOB[0000004-151104124010010-oozie-oozi-W] > > > > > > > ACTION[0000004-151104124010010-oozie-oozi-W@end] No > Notification > > > URL > > > > > is > > > > > > > defined. Therefore nothing to notify for job > > > > > > > 0000004-151104124010010-oozie-oozi-W@end > > > > > > > 2015-11-04 14:09:18,104 INFO WorkflowNotificationXCommand:520 > - > > > > > SERVER[ > > > > > > > hadoop03.housing.com] USER[-] GROUP[-] TOKEN[-] APP[-] > > > > > > > JOB[0000004-151104124010010-oozie-oozi-W] ACTION[] No > > Notification > > > > URL > > > > > is > > > > > > > defined. Therefore nothing to notify for job > > > > > > > 0000004-151104124010010-oozie-oozi-W > > > > > > > 2015-11-04 14:09:18,105 INFO WorkflowNotificationXCommand:520 > - > > > > > SERVER[ > > > > > > > hadoop03.housing.com] USER[-] GROUP[-] TOKEN[-] APP[-] > > > > > > > JOB[0000004-151104124010010-oozie-oozi-W] > > > > > > > ACTION[0000004-151104124010010-oozie-oozi-W@java-node] No > > > > Notification > > > > > > > URL is defined. Therefore nothing to notify for job > > > > > > > 0000004-151104124010010-oozie-oozi-W@java-node > > > > > > > > > > > > > > > > > > > > > > > > > > > > On Wed, Nov 4, 2015 at 4:26 PM, Jaydeep Vishwakarma < > > > > > > > [email protected]> wrote: > > > > > > > > > > > > > >> oozie job -info 0000040-151015123257993-oozie-oozi-W@java-node > > > > > > >> There you will find "Console URL" , Open that URL on browser. > > You > > > > will > > > > > > get > > > > > > >> the Launcher mapper logs. > > > > > > >> > > > > > > >> > > > > > > >> > > > > > > >> On Wed, Nov 4, 2015 at 4:13 PM, Jeetendra G < > > > > [email protected]> > > > > > > >> wrote: > > > > > > >> > > > > > > >> > This is the log i am getting repeatedly > > > > > > >> > 2015-10-29 16:39:11,095 INFO > > WorkflowNotificationXCommand:520 - > > > > > > SERVER[ > > > > > > >> > hadoop03.housing.com] USER[-] GROUP[-] TOKEN[-] APP[-] > > > > > > >> > JOB[0000040-151015123257993-oozie-oozi-W] > > > > > > >> > ACTION[0000040-151015123257993-oozie-oozi-W@:start:] No > > > > > Notification > > > > > > >> URL > > > > > > >> > is > > > > > > >> > defined. Therefore nothing to notify for job > > > > > > >> > 0000040-151015123257993-oozie-oozi-W@:start: > > > > > > >> > 2015-10-29 16:39:11,095 INFO > > WorkflowNotificationXCommand:520 - > > > > > > SERVER[ > > > > > > >> > hadoop03.housing.com] USER[-] GROUP[-] TOKEN[-] APP[-] > > > > > > >> > JOB[0000040-151015123257993-oozie-oozi-W] ACTION[] No > > > Notification > > > > > URL > > > > > > >> is > > > > > > >> > defined. Therefore nothing to notify for job > > > > > > >> > 0000040-151015123257993-oozie-oozi-W > > > > > > >> > > > > > > > >> > On Wed, Nov 4, 2015 at 4:11 PM, Jaydeep Vishwakarma < > > > > > > >> > [email protected]> wrote: > > > > > > >> > > > > > > > >> > > Have you checked Launcher Mapper logs?. What it says? > > > > > > >> > > > > > > > > >> > > On Wed, Nov 4, 2015 at 4:04 PM, Jeetendra G < > > > > > > [email protected]> > > > > > > >> > > wrote: > > > > > > >> > > > > > > > > >> > > > does anybody have any idea? i have been trying this from > > 10 > > > > days > > > > > > >> > nothing > > > > > > >> > > > worked out. > > > > > > >> > > > > > > > > > >> > > > On Thu, Oct 29, 2015 at 6:02 PM, Jeetendra G < > > > > > > >> [email protected]> > > > > > > >> > > > wrote: > > > > > > >> > > > > > > > > > >> > > > > my workflow.xml > > > > > > >> > > > > > > > > > > >> > > > > > > > > > > >> > > > > <workflow-app xmlns="uri:oozie:workflow:0.2" > > > > > > name="java-main-wf"> > > > > > > >> > > > > <start to="java-node"/> > > > > > > >> > > > > <action name="java-node"> > > > > > > >> > > > > <java> > > > > > > >> > > > > <job-tracker>${jobTracker}</job-tracker> > > > > > > >> > > > > <name-node>${nameNode}</name-node> > > > > > > >> > > > > > > > > > > <main-class>com.housing.common.JSONMerger</main-class> > > > > > > >> > > > > > > > > <java-opts>-Dhadoop.custom.configuration.file=hdfs:// > > > > > > >> > > > > 10.1.6.186:8020/configuration/jsonmerger-dev.conf > > > > > > >> > > > > -Dyyyymmdd=20151029</java-opts> > > > > > > >> > > > > > > > > > > >> > > > > </java> > > > > > > >> > > > > <ok to="end"/> > > > > > > >> > > > > <error to="fail"/> > > > > > > >> > > > > </action> > > > > > > >> > > > > <kill name="fail"> > > > > > > >> > > > > <message>Java failed, error > > > > > > >> > > > > > > message[${wf:errorMessage(wf:lastErrorNode())}]</message> > > > > > > >> > > > > </kill> > > > > > > >> > > > > <end name="end"/> > > > > > > >> > > > > </workflow-app> > > > > > > >> > > > > > > > > > > >> > > > > On Thu, Oct 29, 2015 at 4:53 PM, Jeetendra G < > > > > > > >> > [email protected]> > > > > > > >> > > > > wrote: > > > > > > >> > > > > > > > > > > >> > > > >> Hi All, > > > > > > >> > > > >> > > > > > > >> > > > >> I am running java workflow job using oozie. > > > > > > >> > > > >> I have Ambari server and I have installed oozie from > > > > Ambari. > > > > > > >> > > > >> When i ran the job it say succeeded but its not > running > > > my > > > > > java > > > > > > >> > class > > > > > > >> > > > >> which I mentioned inside workflow.xml. Also when I > get > > > > oozie > > > > > > >> > nothing > > > > > > >> > > > can > > > > > > >> > > > >> be find pasting log beow, can anybody help here? > > > > > > >> > > > >> oozie job -oozie > > http://hadoop03.housing.com:11000/oozie > > > > > -log > > > > > > >> > > > >> 0000040-151015123257993-oozie-oozi-W > > > > > > >> > > > >> 2015-10-29 16:39:11,058 INFO > ActionStartXCommand:520 - > > > > > SERVER[ > > > > > > >> > > > >> hadoop03.housing.com] USER[hdfs] GROUP[-] TOKEN[] > > > > > > >> APP[java-main-wf] > > > > > > >> > > > >> JOB[0000040-151015123257993-oozie-oozi-W] > > > > > > >> > > > >> ACTION[0000040-151015123257993-oozie-oozi-W@:start:] > > > Start > > > > > > >> action > > > > > > >> > > > >> [0000040-151015123257993-oozie-oozi-W@:start:] with > > > > > user-retry > > > > > > >> > state > > > > > > >> > > : > > > > > > >> > > > >> userRetryCount [0], userRetryMax [0], > userRetryInterval > > > > [10] > > > > > > >> > > > >> 2015-10-29 16:39:11,061 INFO > ActionStartXCommand:520 - > > > > > SERVER[ > > > > > > >> > > > >> hadoop03.housing.com] USER[hdfs] GROUP[-] TOKEN[] > > > > > > >> APP[java-main-wf] > > > > > > >> > > > >> JOB[0000040-151015123257993-oozie-oozi-W] > > > > > > >> > > > >> ACTION[0000040-151015123257993-oozie-oozi-W@:start:] > > > > > > >> > > > >> [***0000040-151015123257993-oozie-oozi-W@ > > > :start:***]Action > > > > > > >> > > status=DONE > > > > > > >> > > > >> 2015-10-29 16:39:11,061 INFO > ActionStartXCommand:520 - > > > > > SERVER[ > > > > > > >> > > > >> hadoop03.housing.com] USER[hdfs] GROUP[-] TOKEN[] > > > > > > >> APP[java-main-wf] > > > > > > >> > > > >> JOB[0000040-151015123257993-oozie-oozi-W] > > > > > > >> > > > >> ACTION[0000040-151015123257993-oozie-oozi-W@:start:] > > > > > > >> > > > >> [***0000040-151015123257993-oozie-oozi-W@ > > > :start:***]Action > > > > > > >> updated > > > > > > >> > in > > > > > > >> > > > DB! > > > > > > >> > > > >> 2015-10-29 16:39:11,095 INFO > > > > > WorkflowNotificationXCommand:520 > > > > > > - > > > > > > >> > > SERVER[ > > > > > > >> > > > >> hadoop03.housing.com] USER[-] GROUP[-] TOKEN[-] > APP[-] > > > > > > >> > > > >> JOB[0000040-151015123257993-oozie-oozi-W] > > > > > > >> > > > >> ACTION[0000040-151015123257993-oozie-oozi-W@:start:] > > No > > > > > > >> > Notification > > > > > > >> > > > URL > > > > > > >> > > > >> is defined. Therefore nothing to notify for job > > > > > > >> > > > >> 0000040-151015123257993-oozie-oozi-W@:start: > > > > > > >> > > > >> 2015-10-29 16:39:11,095 INFO > > > > > WorkflowNotificationXCommand:520 > > > > > > - > > > > > > >> > > SERVER[ > > > > > > >> > > > >> hadoop03.housing.com] USER[-] GROUP[-] TOKEN[-] > APP[-] > > > > > > >> > > > >> JOB[0000040-151015123257993-oozie-oozi-W] ACTION[] No > > > > > > >> Notification > > > > > > >> > URL > > > > > > >> > > > is > > > > > > >> > > > >> defined. Therefore nothing to notify for job > > > > > > >> > > > >> 0000040-151015123257993-oozie-oozi-W > > > > > > >> > > > >> 2015-10-29 16:39:11,107 INFO > ActionStartXCommand:520 - > > > > > SERVER[ > > > > > > >> > > > >> hadoop03.housing.com] USER[hdfs] GROUP[-] TOKEN[] > > > > > > >> APP[java-main-wf] > > > > > > >> > > > >> JOB[0000040-151015123257993-oozie-oozi-W] > > > > > > >> > > > >> ACTION[0000040-151015123257993-oozie-oozi-W@java-node > ] > > > > Start > > > > > > >> action > > > > > > >> > > > >> [0000040-151015123257993-oozie-oozi-W@java-node] > with > > > > > > user-retry > > > > > > >> > > state > > > > > > >> > > > : > > > > > > >> > > > >> userRetryCount [0], userRetryMax [0], > userRetryInterval > > > > [10] > > > > > > >> > > > >> 2015-10-29 16:39:12,222 INFO JavaActionExecutor:520 > - > > > > > SERVER[ > > > > > > >> > > > >> hadoop03.housing.com] USER[hdfs] GROUP[-] TOKEN[] > > > > > > >> APP[java-main-wf] > > > > > > >> > > > >> JOB[0000040-151015123257993-oozie-oozi-W] > > > > > > >> > > > >> ACTION[0000040-151015123257993-oozie-oozi-W@java-node > ] > > > > > > checking > > > > > > >> > > action, > > > > > > >> > > > >> hadoop job ID [job_1444892488693_0073] status > [RUNNING] > > > > > > >> > > > >> 2015-10-29 16:39:12,224 INFO > ActionStartXCommand:520 - > > > > > SERVER[ > > > > > > >> > > > >> hadoop03.housing.com] USER[hdfs] GROUP[-] TOKEN[] > > > > > > >> APP[java-main-wf] > > > > > > >> > > > >> JOB[0000040-151015123257993-oozie-oozi-W] > > > > > > >> > > > >> ACTION[0000040-151015123257993-oozie-oozi-W@java-node > ] > > > > > > >> > > > >> [***0000040-151015123257993-oozie-oozi-W@java-node > > > > ***]Action > > > > > > >> > > > >> status=RUNNING > > > > > > >> > > > >> 2015-10-29 16:39:12,224 INFO > ActionStartXCommand:520 - > > > > > SERVER[ > > > > > > >> > > > >> hadoop03.housing.com] USER[hdfs] GROUP[-] TOKEN[] > > > > > > >> APP[java-main-wf] > > > > > > >> > > > >> JOB[0000040-151015123257993-oozie-oozi-W] > > > > > > >> > > > >> ACTION[0000040-151015123257993-oozie-oozi-W@java-node > ] > > > > > > >> > > > >> [***0000040-151015123257993-oozie-oozi-W@java-node > > > > ***]Action > > > > > > >> > updated > > > > > > >> > > in > > > > > > >> > > > >> DB! > > > > > > >> > > > >> 2015-10-29 16:39:12,229 INFO > > > > > WorkflowNotificationXCommand:520 > > > > > > - > > > > > > >> > > SERVER[ > > > > > > >> > > > >> hadoop03.housing.com] USER[-] GROUP[-] TOKEN[-] > APP[-] > > > > > > >> > > > >> JOB[0000040-151015123257993-oozie-oozi-W] > > > > > > >> > > > >> ACTION[0000040-151015123257993-oozie-oozi-W@java-node > ] > > > No > > > > > > >> > > Notification > > > > > > >> > > > >> URL is defined. Therefore nothing to notify for job > > > > > > >> > > > >> 0000040-151015123257993-oozie-oozi-W@java-node > > > > > > >> > > > >> 2015-10-29 16:39:25,192 INFO CallbackServlet:520 - > > > SERVER[ > > > > > > >> > > > >> hadoop03.housing.com] USER[-] GROUP[-] TOKEN[-] > APP[-] > > > > > > >> > > > >> JOB[0000040-151015123257993-oozie-oozi-W] > > > > > > >> > > > >> ACTION[0000040-151015123257993-oozie-oozi-W@java-node > ] > > > > > > callback > > > > > > >> for > > > > > > >> > > > >> action > [0000040-151015123257993-oozie-oozi-W@java-node > > ] > > > > > > >> > > > >> 2015-10-29 16:39:25,393 INFO JavaActionExecutor:520 > - > > > > > SERVER[ > > > > > > >> > > > >> hadoop03.housing.com] USER[hdfs] GROUP[-] TOKEN[] > > > > > > >> APP[java-main-wf] > > > > > > >> > > > >> JOB[0000040-151015123257993-oozie-oozi-W] > > > > > > >> > > > >> ACTION[0000040-151015123257993-oozie-oozi-W@java-node > ] > > > > > action > > > > > > >> > > > completed, > > > > > > >> > > > >> external ID [job_1444892488693_0073] > > > > > > >> > > > >> 2015-10-29 16:39:25,462 INFO > ActionStartXCommand:520 - > > > > > SERVER[ > > > > > > >> > > > >> hadoop03.housing.com] USER[hdfs] GROUP[-] TOKEN[] > > > > > > >> APP[java-main-wf] > > > > > > >> > > > >> JOB[0000040-151015123257993-oozie-oozi-W] > > > > > > >> > > > >> ACTION[0000040-151015123257993-oozie-oozi-W@end] > Start > > > > > action > > > > > > >> > > > >> [0000040-151015123257993-oozie-oozi-W@end] with > > > user-retry > > > > > > >> state : > > > > > > >> > > > >> userRetryCount [0], userRetryMax [0], > userRetryInterval > > > > [10] > > > > > > >> > > > >> 2015-10-29 16:39:25,464 INFO > ActionStartXCommand:520 - > > > > > SERVER[ > > > > > > >> > > > >> hadoop03.housing.com] USER[hdfs] GROUP[-] TOKEN[] > > > > > > >> APP[java-main-wf] > > > > > > >> > > > >> JOB[0000040-151015123257993-oozie-oozi-W] > > > > > > >> > > > >> ACTION[0000040-151015123257993-oozie-oozi-W@end] > > > > > > >> > > > >> [***0000040-151015123257993-oozie-oozi-W@end > ***]Action > > > > > > >> status=DONE > > > > > > >> > > > >> 2015-10-29 16:39:25,465 INFO > ActionStartXCommand:520 - > > > > > SERVER[ > > > > > > >> > > > >> hadoop03.housing.com] USER[hdfs] GROUP[-] TOKEN[] > > > > > > >> APP[java-main-wf] > > > > > > >> > > > >> JOB[0000040-151015123257993-oozie-oozi-W] > > > > > > >> > > > >> ACTION[0000040-151015123257993-oozie-oozi-W@end] > > > > > > >> > > > >> [***0000040-151015123257993-oozie-oozi-W@end > ***]Action > > > > > updated > > > > > > >> in > > > > > > >> > DB! > > > > > > >> > > > >> 2015-10-29 16:39:25,522 INFO > > > > > WorkflowNotificationXCommand:520 > > > > > > - > > > > > > >> > > SERVER[ > > > > > > >> > > > >> hadoop03.housing.com] USER[-] GROUP[-] TOKEN[-] > APP[-] > > > > > > >> > > > >> JOB[0000040-151015123257993-oozie-oozi-W] > > > > > > >> > > > >> ACTION[0000040-151015123257993-oozie-oozi-W@end] No > > > > > > Notification > > > > > > >> > URL > > > > > > >> > > is > > > > > > >> > > > >> defined. Therefore nothing to notify for job > > > > > > >> > > > >> 0000040-151015123257993-oozie-oozi-W@end > > > > > > >> > > > >> 2015-10-29 16:39:25,522 INFO > > > > > WorkflowNotificationXCommand:520 > > > > > > - > > > > > > >> > > SERVER[ > > > > > > >> > > > >> hadoop03.housing.com] USER[-] GROUP[-] TOKEN[-] > APP[-] > > > > > > >> > > > >> JOB[0000040-151015123257993-oozie-oozi-W] ACTION[] No > > > > > > >> Notification > > > > > > >> > URL > > > > > > >> > > > is > > > > > > >> > > > >> defined. Therefore nothing to notify for job > > > > > > >> > > > >> 0000040-151015123257993-oozie-oozi-W > > > > > > >> > > > >> 2015-10-29 16:39:25,522 INFO > > > > > WorkflowNotificationXCommand:520 > > > > > > - > > > > > > >> > > SERVER[ > > > > > > >> > > > >> hadoop03.housing.com] USER[-] GROUP[-] TOKEN[-] > APP[-] > > > > > > >> > > > >> JOB[0000040-151015123257993-oozie-oozi-W] > > > > > > >> > > > >> ACTION[0000040-151015123257993-oozie-oozi-W@java-node > ] > > > No > > > > > > >> > > Notification > > > > > > >> > > > >> URL is defined. Therefore nothing to notify for job > > > > > > >> > > > >> 0000040-151015123257993-oozie-oozi-W@java-node > > > > > > >> > > > >> > > > > > > >> > > > > > > > > > > >> > > > > > > > > > > >> > > > > > > > > > >> > > > > > > > > >> > > -- > > > > > > >> > > > > _____________________________________________________________ > > > > > > >> > > The information contained in this communication is > intended > > > > solely > > > > > > for > > > > > > >> > the > > > > > > >> > > use of the individual or entity to whom it is addressed > and > > > > others > > > > > > >> > > authorized to receive it. It may contain confidential or > > > legally > > > > > > >> > privileged > > > > > > >> > > information. If you are not the intended recipient you are > > > > hereby > > > > > > >> > notified > > > > > > >> > > that any disclosure, copying, distribution or taking any > > > action > > > > in > > > > > > >> > reliance > > > > > > >> > > on the contents of this information is strictly prohibited > > and > > > > may > > > > > > be > > > > > > >> > > unlawful. If you have received this communication in > error, > > > > please > > > > > > >> notify > > > > > > >> > > us immediately by responding to this email and then delete > > it > > > > from > > > > > > >> your > > > > > > >> > > system. The firm is neither liable for the proper and > > complete > > > > > > >> > transmission > > > > > > >> > > of the information contained in this communication nor for > > any > > > > > delay > > > > > > >> in > > > > > > >> > its > > > > > > >> > > receipt. > > > > > > >> > > > > > > > > >> > > > > > > > >> > > > > > > >> -- > > > > > > >> _____________________________________________________________ > > > > > > >> The information contained in this communication is intended > > solely > > > > for > > > > > > the > > > > > > >> use of the individual or entity to whom it is addressed and > > others > > > > > > >> authorized to receive it. It may contain confidential or > legally > > > > > > >> privileged > > > > > > >> information. If you are not the intended recipient you are > > hereby > > > > > > notified > > > > > > >> that any disclosure, copying, distribution or taking any > action > > in > > > > > > >> reliance > > > > > > >> on the contents of this information is strictly prohibited and > > may > > > > be > > > > > > >> unlawful. If you have received this communication in error, > > please > > > > > > notify > > > > > > >> us immediately by responding to this email and then delete it > > from > > > > > your > > > > > > >> system. The firm is neither liable for the proper and complete > > > > > > >> transmission > > > > > > >> of the information contained in this communication nor for any > > > delay > > > > > in > > > > > > >> its > > > > > > >> receipt. > > > > > > >> > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > -- > > > > > _____________________________________________________________ > > > > > The information contained in this communication is intended solely > > for > > > > the > > > > > use of the individual or entity to whom it is addressed and others > > > > > authorized to receive it. It may contain confidential or legally > > > > privileged > > > > > information. If you are not the intended recipient you are hereby > > > > notified > > > > > that any disclosure, copying, distribution or taking any action in > > > > reliance > > > > > on the contents of this information is strictly prohibited and may > be > > > > > unlawful. If you have received this communication in error, please > > > notify > > > > > us immediately by responding to this email and then delete it from > > your > > > > > system. The firm is neither liable for the proper and complete > > > > transmission > > > > > of the information contained in this communication nor for any > delay > > in > > > > its > > > > > receipt. > > > > > > > > > > > > > > > > -- > > _____________________________________________________________ > > The information contained in this communication is intended solely for > the > > use of the individual or entity to whom it is addressed and others > > authorized to receive it. It may contain confidential or legally > privileged > > information. If you are not the intended recipient you are hereby > notified > > that any disclosure, copying, distribution or taking any action in > reliance > > on the contents of this information is strictly prohibited and may be > > unlawful. If you have received this communication in error, please notify > > us immediately by responding to this email and then delete it from your > > system. The firm is neither liable for the proper and complete > transmission > > of the information contained in this communication nor for any delay in > its > > receipt. > > > -- _____________________________________________________________ The information contained in this communication is intended solely for the use of the individual or entity to whom it is addressed and others authorized to receive it. It may contain confidential or legally privileged information. If you are not the intended recipient you are hereby notified that any disclosure, copying, distribution or taking any action in reliance on the contents of this information is strictly prohibited and may be unlawful. If you have received this communication in error, please notify us immediately by responding to this email and then delete it from your system. The firm is neither liable for the proper and complete transmission of the information contained in this communication nor for any delay in its receipt.
