Thanks Jaydeep fir help. One clue i have got oozie might have save output somewhere else? see below logs. but when I go to this location there is no data.my java code will read the directory and merge the small files into one bigger file in the same place.
by default where oozie write the output? 2015-11-05 14:02:04,270 INFO [main] org.apache.hadoop.mapreduce.lib.output.FileOutputCommitter: Saved output of task 'attempt_1446620926630_0034_m_000000_0' to hdfs:// hadoop01.housing.com:8020/user/hdfs/oozie-oozi/0000000-151105115318391-oozie-oozi-W/java-node--java/output/_temporary/1/task_1446620926630_0034_m_000000 2015-11-05 14:02:04,318 INFO [main] org.apache.hadoop.mapred.Task: Task 'attempt_1446620926630_0034_m_000000_0' done. End of LogType:syslog On Thu, Nov 5, 2015 at 2:05 PM, Jaydeep Vishwakarma < [email protected]> wrote: > Stdout logs will have some data in any case. As Oozie launcher writes N > number of information using System.out.print. You might be having even std > err as well which it is not coming. > > Try to see the logs form command prompt for application Id by following > command. > yarn logs -applicationId <application ID> > > If logs are still missing try to find in userlogs or do the debugging. > > On Thu, Nov 5, 2015 at 1:22 PM, Jeetendra G <[email protected]> > wrote: > > > @ Serega:There are enough resources there is no resource starvation. > > > > > > On Wed, Nov 4, 2015 at 8:10 PM, Serega Sheypak <[email protected] > > > > wrote: > > > > > Which job succeeded? What is attached? > > > Other problem could be: you have resource starvation, there are no > > > resources on RM to run your job. Did you check it? > > > > > > 2015-11-04 15:15 GMT+01:00 Jeetendra G <[email protected]>: > > > > > > > Also I verified there is no issue with my java class because when I > run > > > it > > > > without oozie its works perfectly. > > > > > > > > > > > > On Wed, Nov 4, 2015 at 7:43 PM, Jeetendra G <[email protected] > > > > > > wrote: > > > > > > > > > it says job succeeded attaching > > > > > > > > > > On Wed, Nov 4, 2015 at 7:37 PM, Serega Sheypak < > > > [email protected] > > > > > > > > > > wrote: > > > > > > > > > >> Hm... ok, can you see what happens on YARN RM web ui? > > > > >> There should be a job that runs yuor oozie mapper launcher. > > > > >> > > > > >> 2015-11-04 15:02 GMT+01:00 Jaydeep Vishwakarma < > > > > >> [email protected]>: > > > > >> > > > > >> > Good, So not issue with Yarn or name node urls. Can you share > > stdout > > > > >> logs. > > > > >> > > > > > >> > > > > > >> > On Wed, Nov 4, 2015 at 7:15 PM, Jeetendra G < > > > [email protected]> > > > > >> > wrote: > > > > >> > > > > > >> > > Hi Jaydeep here also I cant see any error below are the logs > > > > >> > > > > > > >> > > Log Type: syslog > > > > >> > > > > > > >> > > Log Upload Time: Wed Nov 04 14:59:29 +0530 2015 > > > > >> > > > > > > >> > > Log Length: 25565 > > > > >> > > > > > > >> > > 2015-11-04 14:59:11,814 INFO [main] > > > > >> > > org.apache.hadoop.mapreduce.v2.app.MRAppMaster: Created > > > MRAppMaster > > > > >> > > for application appattempt_1446620926630_0017_000001 > > > > >> > > 2015-11-04 14:59:12,144 WARN [main] > > > > >> > > org.apache.hadoop.util.NativeCodeLoader: Unable to load > > > > native-hadoop > > > > >> > > library for your platform... using builtin-java classes where > > > > >> > > applicable > > > > >> > > 2015-11-04 14:59:12,184 INFO [main] > > > > >> > > org.apache.hadoop.mapreduce.v2.app.MRAppMaster: Executing with > > > > tokens: > > > > >> > > 2015-11-04 14:59:12,292 INFO [main] > > > > >> > > org.apache.hadoop.mapreduce.v2.app.MRAppMaster: Kind: > > > > >> > > YARN_AM_RM_TOKEN, Service: , Ident: (appAttemptId { > > > application_id { > > > > >> > > id: 17 cluster_timestamp: 1446620926630 } attemptId: 1 } > keyId: > > > > >> > > -173762614) > > > > >> > > 2015-11-04 14:59:12,293 INFO [main] > > > > >> > > org.apache.hadoop.mapreduce.v2.app.MRAppMaster: Kind: > > > > >> > > RM_DELEGATION_TOKEN, Service: 10.21.1.136:8050, Ident: > > > (owner=hdfs, > > > > >> > > renewer=oozie mr token, realUser=oozie, > issueDate=1446629349951, > > > > >> > > maxDate=1447234149951, sequenceNumber=26, masterKeyId=6) > > > > >> > > 2015-11-04 14:59:12,890 WARN [main] > > > > >> > > org.apache.hadoop.hdfs.shortcircuit.DomainSocketFactory: The > > > > >> > > short-circuit local reads feature cannot be used because > > libhadoop > > > > >> > > cannot be loaded. > > > > >> > > 2015-11-04 14:59:13,064 INFO [main] > > > > >> > > org.apache.hadoop.mapreduce.v2.app.MRAppMaster: > OutputCommitter > > > set > > > > in > > > > >> > > config null > > > > >> > > 2015-11-04 14:59:13,065 INFO [main] > > > > >> > > org.apache.hadoop.mapreduce.v2.app.MRAppMaster: > OutputCommitter > > is > > > > >> > > org.apache.hadoop.mapred.FileOutputCommitter > > > > >> > > 2015-11-04 14:59:13,110 INFO [main] > > > > >> > > org.apache.hadoop.yarn.event.AsyncDispatcher: Registering > class > > > > >> > > org.apache.hadoop.mapreduce.jobhistory.EventType for class > > > > >> > > org.apache.hadoop.mapreduce.jobhistory.JobHistoryEventHandler > > > > >> > > 2015-11-04 14:59:13,110 INFO [main] > > > > >> > > org.apache.hadoop.yarn.event.AsyncDispatcher: Registering > class > > > > >> > > org.apache.hadoop.mapreduce.v2.app.job.event.JobEventType for > > > class > > > > >> > > > > org.apache.hadoop.mapreduce.v2.app.MRAppMaster$JobEventDispatcher > > > > >> > > 2015-11-04 14:59:13,111 INFO [main] > > > > >> > > org.apache.hadoop.yarn.event.AsyncDispatcher: Registering > class > > > > >> > > org.apache.hadoop.mapreduce.v2.app.job.event.TaskEventType for > > > class > > > > >> > > > > org.apache.hadoop.mapreduce.v2.app.MRAppMaster$TaskEventDispatcher > > > > >> > > 2015-11-04 14:59:13,111 INFO [main] > > > > >> > > org.apache.hadoop.yarn.event.AsyncDispatcher: Registering > class > > > > >> > > > > org.apache.hadoop.mapreduce.v2.app.job.event.TaskAttemptEventType > > > > for > > > > >> > > class > > > > >> > > > > > > >> > > > > > > org.apache.hadoop.mapreduce.v2.app.MRAppMaster$TaskAttemptEventDispatcher > > > > >> > > 2015-11-04 14:59:13,112 INFO [main] > > > > >> > > org.apache.hadoop.yarn.event.AsyncDispatcher: Registering > class > > > > >> > > org.apache.hadoop.mapreduce.v2.app.commit.CommitterEventType > for > > > > class > > > > >> > > > org.apache.hadoop.mapreduce.v2.app.commit.CommitterEventHandler > > > > >> > > 2015-11-04 14:59:13,112 INFO [main] > > > > >> > > org.apache.hadoop.yarn.event.AsyncDispatcher: Registering > class > > > > >> > > > > org.apache.hadoop.mapreduce.v2.app.speculate.Speculator$EventType > > > > for > > > > >> > > class > > > > >> > > > > > > >> > > > > org.apache.hadoop.mapreduce.v2.app.MRAppMaster$SpeculatorEventDispatcher > > > > >> > > 2015-11-04 14:59:13,113 INFO [main] > > > > >> > > org.apache.hadoop.yarn.event.AsyncDispatcher: Registering > class > > > > >> > > > > org.apache.hadoop.mapreduce.v2.app.rm.ContainerAllocator$EventType > > > > for > > > > >> > > class > > > > >> > > > > > > >> > > > org.apache.hadoop.mapreduce.v2.app.MRAppMaster$ContainerAllocatorRouter > > > > >> > > 2015-11-04 14:59:13,113 INFO [main] > > > > >> > > org.apache.hadoop.yarn.event.AsyncDispatcher: Registering > class > > > > >> > > > > > > >> > > > org.apache.hadoop.mapreduce.v2.app.launcher.ContainerLauncher$EventType > > > > >> > > for class > > > > >> > > > > > > > org.apache.hadoop.mapreduce.v2.app.MRAppMaster$ContainerLauncherRouter > > > > >> > > 2015-11-04 14:59:13,144 INFO [main] > > > > >> > > org.apache.hadoop.mapreduce.v2.jobhistory.JobHistoryUtils: > > Default > > > > >> > > file system is set solely by core-default.xml therefore - > > > ignoring > > > > >> > > 2015-11-04 14:59:13,170 INFO [main] > > > > >> > > org.apache.hadoop.mapreduce.v2.jobhistory.JobHistoryUtils: > > Default > > > > >> > > file system is set solely by core-default.xml therefore - > > > ignoring > > > > >> > > 2015-11-04 14:59:13,189 INFO [main] > > > > >> > > org.apache.hadoop.mapreduce.v2.jobhistory.JobHistoryUtils: > > Default > > > > >> > > file system is set solely by core-default.xml therefore - > > > ignoring > > > > >> > > 2015-11-04 14:59:13,219 INFO [main] > > > > >> > > org.apache.hadoop.mapreduce.jobhistory.JobHistoryEventHandler: > > > > >> > > Emitting job history data to the timeline server is not > enabled > > > > >> > > 2015-11-04 14:59:13,255 INFO [main] > > > > >> > > org.apache.hadoop.yarn.event.AsyncDispatcher: Registering > class > > > > >> > > > org.apache.hadoop.mapreduce.v2.app.job.event.JobFinishEvent$Type > > > for > > > > >> > > class > > > > >> > > > org.apache.hadoop.mapreduce.v2.app.MRAppMaster$JobFinishEventHandler > > > > >> > > 2015-11-04 14:59:13,453 WARN [main] > > > > >> > > org.apache.hadoop.metrics2.impl.MetricsConfig: Cannot locate > > > > >> > > configuration: tried > > > > >> > > > > hadoop-metrics2-mrappmaster.properties,hadoop-metrics2.properties > > > > >> > > 2015-11-04 14:59:13,546 INFO [main] > > > > >> > > org.apache.hadoop.metrics2.impl.MetricsSystemImpl: Scheduled > > > > snapshot > > > > >> > > period at 10 second(s). > > > > >> > > 2015-11-04 14:59:13,546 INFO [main] > > > > >> > > org.apache.hadoop.metrics2.impl.MetricsSystemImpl: MRAppMaster > > > > metrics > > > > >> > > system started > > > > >> > > 2015-11-04 14:59:13,557 INFO [main] > > > > >> > > org.apache.hadoop.mapreduce.v2.app.job.impl.JobImpl: Adding > job > > > > token > > > > >> > > for job_1446620926630_0017 to jobTokenSecretManager > > > > >> > > 2015-11-04 14:59:13,680 INFO [main] > > > > >> > > org.apache.hadoop.mapreduce.v2.app.job.impl.JobImpl: Not > > uberizing > > > > >> > > job_1446620926630_0017 because: not enabled; too much RAM; > > > > >> > > 2015-11-04 14:59:13,701 INFO [main] > > > > >> > > org.apache.hadoop.mapreduce.v2.app.job.impl.JobImpl: Input > size > > > for > > > > >> > > job job_1446620926630_0017 = 0. Number of splits = 1 > > > > >> > > 2015-11-04 14:59:13,701 INFO [main] > > > > >> > > org.apache.hadoop.mapreduce.v2.app.job.impl.JobImpl: Number of > > > > reduces > > > > >> > > for job job_1446620926630_0017 = 0 > > > > >> > > 2015-11-04 14:59:13,701 INFO [main] > > > > >> > > org.apache.hadoop.mapreduce.v2.app.job.impl.JobImpl: > > > > >> > > job_1446620926630_0017Job Transitioned from NEW to INITED > > > > >> > > 2015-11-04 14:59:13,702 INFO [main] > > > > >> > > org.apache.hadoop.mapreduce.v2.app.MRAppMaster: MRAppMaster > > > > launching > > > > >> > > normal, non-uberized, multi-container job > > job_1446620926630_0017. > > > > >> > > 2015-11-04 14:59:13,725 INFO [main] > > > > >> > > org.apache.hadoop.ipc.CallQueueManager: Using callQueue class > > > > >> > > java.util.concurrent.LinkedBlockingQueue > > > > >> > > 2015-11-04 14:59:13,736 INFO [Socket Reader #1 for port 39640] > > > > >> > > org.apache.hadoop.ipc.Server: Starting Socket Reader #1 for > port > > > > 39640 > > > > >> > > 2015-11-04 14:59:13,758 INFO [main] > > > > >> > > > org.apache.hadoop.yarn.factories.impl.pb.RpcServerFactoryPBImpl: > > > > >> > > Adding protocol > > > > org.apache.hadoop.mapreduce.v2.api.MRClientProtocolPB > > > > >> > > to the server > > > > >> > > 2015-11-04 14:59:13,759 INFO [IPC Server Responder] > > > > >> > > org.apache.hadoop.ipc.Server: IPC Server Responder: starting > > > > >> > > 2015-11-04 14:59:13,761 INFO [IPC Server listener on 39640] > > > > >> > > org.apache.hadoop.ipc.Server: IPC Server listener on 39640: > > > starting > > > > >> > > 2015-11-04 14:59:13,762 INFO [main] > > > > >> > > org.apache.hadoop.mapreduce.v2.app.client.MRClientService: > > > > >> > > Instantiated MRClientService at > > > > >> hadoop04.housing.com/10.21.1.138:39640 > > > > >> > > 2015-11-04 14:59:13,853 INFO [main] org.mortbay.log: Logging > to > > > > >> > > org.slf4j.impl.Log4jLoggerAdapter(org.mortbay.log) via > > > > >> > > org.mortbay.log.Slf4jLog > > > > >> > > 2015-11-04 14:59:13,862 INFO [main] > > > > >> > > > > > > > org.apache.hadoop.security.authentication.server.AuthenticationFilter: > > > > >> > > Unable to initialize FileSignerSecretProvider, falling back to > > use > > > > >> > > random secrets. > > > > >> > > 2015-11-04 14:59:13,867 WARN [main] > > > > >> > > org.apache.hadoop.http.HttpRequestLog: Jetty request log can > > only > > > be > > > > >> > > enabled using Log4j > > > > >> > > 2015-11-04 14:59:13,874 INFO [main] > > > > >> > > org.apache.hadoop.http.HttpServer2: Added global filter > 'safety' > > > > >> > > (class=org.apache.hadoop.http.HttpServer2$QuotingInputFilter) > > > > >> > > 2015-11-04 14:59:13,878 INFO [main] > > > > >> > > org.apache.hadoop.http.HttpServer2: Added filter > AM_PROXY_FILTER > > > > >> > > > > (class=org.apache.hadoop.yarn.server.webproxy.amfilter.AmIpFilter) > > > > to > > > > >> > > context mapreduce > > > > >> > > 2015-11-04 14:59:13,879 INFO [main] > > > > >> > > org.apache.hadoop.http.HttpServer2: Added filter > AM_PROXY_FILTER > > > > >> > > > > (class=org.apache.hadoop.yarn.server.webproxy.amfilter.AmIpFilter) > > > > to > > > > >> > > context static > > > > >> > > 2015-11-04 14:59:13,882 INFO [main] > > > > >> > > org.apache.hadoop.http.HttpServer2: adding path spec: > > /mapreduce/* > > > > >> > > 2015-11-04 14:59:13,882 INFO [main] > > > > >> > > org.apache.hadoop.http.HttpServer2: adding path spec: /ws/* > > > > >> > > 2015-11-04 14:59:14,217 INFO [main] > > > > >> > > org.apache.hadoop.yarn.webapp.WebApps: Registered webapp guice > > > > modules > > > > >> > > 2015-11-04 14:59:14,218 INFO [main] > > > > >> > > org.apache.hadoop.http.HttpServer2: Jetty bound to port 49791 > > > > >> > > 2015-11-04 14:59:14,219 INFO [main] org.mortbay.log: > > > > jetty-6.1.26.hwx > > > > >> > > 2015-11-04 14:59:14,260 INFO [main] org.mortbay.log: Extract > > > > >> > > > > > > >> > > > > > > >> > > > > > >> > > > > > > > > > > jar:file:/hadoop/yarn/local/filecache/10/mapreduce.tar.gz/hadoop/share/hadoop/yarn/hadoop-yarn-common-2.7.1.2.3.2.0-2950.jar!/webapps/mapreduce > > > > >> > > to ./tmp/Jetty_0_0_0_0_49791_mapreduce____.kdgzqp/webapp > > > > >> > > 2015-11-04 14:59:15,952 INFO [main] org.mortbay.log: Started > > > > >> > > HttpServer2$ > [email protected]:49791 > > > > >> > > 2015-11-04 14:59:15,952 INFO [main] > > > > >> > > org.apache.hadoop.yarn.webapp.WebApps: Web app /mapreduce > > started > > > at > > > > >> > > 49791 > > > > >> > > 2015-11-04 14:59:15,957 INFO [main] > > > > >> > > org.apache.hadoop.ipc.CallQueueManager: Using callQueue class > > > > >> > > java.util.concurrent.LinkedBlockingQueue > > > > >> > > 2015-11-04 14:59:15,957 INFO [Socket Reader #1 for port 50432] > > > > >> > > org.apache.hadoop.ipc.Server: Starting Socket Reader #1 for > port > > > > 50432 > > > > >> > > 2015-11-04 14:59:15,963 INFO [IPC Server Responder] > > > > >> > > org.apache.hadoop.ipc.Server: IPC Server Responder: starting > > > > >> > > 2015-11-04 14:59:15,963 INFO [IPC Server listener on 50432] > > > > >> > > org.apache.hadoop.ipc.Server: IPC Server listener on 50432: > > > starting > > > > >> > > 2015-11-04 14:59:15,988 INFO [main] > > > > >> > > org.apache.hadoop.mapreduce.v2.app.rm.RMContainerRequestor: > > > > >> > > nodeBlacklistingEnabled:true > > > > >> > > 2015-11-04 14:59:15,988 INFO [main] > > > > >> > > org.apache.hadoop.mapreduce.v2.app.rm.RMContainerRequestor: > > > > >> > > maxTaskFailuresPerNode is 3 > > > > >> > > 2015-11-04 14:59:15,988 INFO [main] > > > > >> > > org.apache.hadoop.mapreduce.v2.app.rm.RMContainerRequestor: > > > > >> > > blacklistDisablePercent is 33 > > > > >> > > 2015-11-04 14:59:16,035 INFO [main] > > > > >> > > org.apache.hadoop.yarn.client.RMProxy: Connecting to > > > ResourceManager > > > > >> > > at hadoop02.housing.com/10.21.1.136:8030 > > > > >> > > 2015-11-04 14:59:16,113 INFO [main] > > > > >> > > org.apache.hadoop.mapreduce.v2.app.rm.RMCommunicator: > > > > >> > > maxContainerCapability: <memory:5120, vCores:3> > > > > >> > > 2015-11-04 14:59:16,113 INFO [main] > > > > >> > > org.apache.hadoop.mapreduce.v2.app.rm.RMCommunicator: queue: > > > default > > > > >> > > 2015-11-04 14:59:16,117 INFO [main] > > > > >> > > > > org.apache.hadoop.mapreduce.v2.app.launcher.ContainerLauncherImpl: > > > > >> > > Upper limit on the thread pool size is 500 > > > > >> > > 2015-11-04 14:59:16,118 INFO [main] > > > > >> > > > > org.apache.hadoop.mapreduce.v2.app.launcher.ContainerLauncherImpl: > > > > The > > > > >> > > thread pool initial size is 10 > > > > >> > > 2015-11-04 14:59:16,120 INFO [main] > > > > >> > > > > > > >> > > > > org.apache.hadoop.yarn.client.api.impl.ContainerManagementProtocolProxy: > > > > >> > > yarn.client.max-cached-nodemanagers-proxies : 0 > > > > >> > > 2015-11-04 14:59:16,127 INFO [AsyncDispatcher event handler] > > > > >> > > org.apache.hadoop.mapreduce.v2.app.job.impl.JobImpl: > > > > >> > > job_1446620926630_0017Job Transitioned from INITED to SETUP > > > > >> > > 2015-11-04 14:59:16,157 INFO [CommitterEvent Processor #0] > > > > >> > > > org.apache.hadoop.mapreduce.v2.app.commit.CommitterEventHandler: > > > > >> > > Processing the event EventType: JOB_SETUP > > > > >> > > 2015-11-04 14:59:16,160 INFO [CommitterEvent Processor #0] > > > > >> > > org.apache.hadoop.mapreduce.lib.output.FileOutputCommitter: > File > > > > >> > > Output Committer Algorithm version is 1 > > > > >> > > 2015-11-04 14:59:16,173 INFO [AsyncDispatcher event handler] > > > > >> > > org.apache.hadoop.mapreduce.v2.app.job.impl.JobImpl: > > > > >> > > job_1446620926630_0017Job Transitioned from SETUP to RUNNING > > > > >> > > 2015-11-04 14:59:16,194 INFO [AsyncDispatcher event handler] > > > > >> > > org.apache.hadoop.mapreduce.v2.app.job.impl.TaskImpl: > > > > >> > > task_1446620926630_0017_m_000000 Task Transitioned from NEW to > > > > >> > > SCHEDULED > > > > >> > > 2015-11-04 14:59:16,195 INFO [AsyncDispatcher event handler] > > > > >> > > org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl: > > > > >> > > attempt_1446620926630_0017_m_000000_0 TaskAttempt Transitioned > > > from > > > > >> > > NEW to UNASSIGNED > > > > >> > > 2015-11-04 14:59:16,202 INFO [Thread-51] > > > > >> > > org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator: > > > > >> > > mapResourceRequest:<memory:1536, vCores:1> > > > > >> > > 2015-11-04 14:59:16,252 INFO [eventHandlingThread] > > > > >> > > org.apache.hadoop.mapreduce.jobhistory.JobHistoryEventHandler: > > > Event > > > > >> > > Writer setup for JobId: job_1446620926630_0017, File: > > > > >> > > hdfs:// > > > > >> > > > > > > >> > > > > > >> > > > > > > > > > > hadoop01.housing.com:8020/user/hdfs/.staging/job_1446620926630_0017/job_1446620926630_0017_1.jhist > > > > >> > > 2015-11-04 14:59:17,117 INFO [RMCommunicator Allocator] > > > > >> > > org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator: > > Before > > > > >> > > Scheduling: PendingReds:0 ScheduledMaps:1 ScheduledReds:0 > > > > >> > > AssignedMaps:0 AssignedReds:0 CompletedMaps:0 CompletedReds:0 > > > > >> > > ContAlloc:0 ContRel:0 HostLocal:0 RackLocal:0 > > > > >> > > 2015-11-04 14:59:17,154 INFO [RMCommunicator Allocator] > > > > >> > > org.apache.hadoop.mapreduce.v2.app.rm.RMContainerRequestor: > > > > >> > > getResources() for application_1446620926630_0017: ask=1 > > release= > > > 0 > > > > >> > > newContainers=0 finishedContainers=0 > > resourcelimit=<memory:19840, > > > > >> > > vCores:1> knownNMs=5 > > > > >> > > 2015-11-04 14:59:18,171 INFO [RMCommunicator Allocator] > > > > >> > > org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator: > Got > > > > >> > > allocated containers 1 > > > > >> > > 2015-11-04 14:59:18,198 INFO [RMCommunicator Allocator] > > > > >> > > org.apache.hadoop.yarn.util.RackResolver: Resolved > > > > >> > > hadoop04.housing.com to /default-rack > > > > >> > > 2015-11-04 14:59:18,201 INFO [RMCommunicator Allocator] > > > > >> > > org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator: > > > Assigned > > > > >> > > container container_e02_1446620926630_0017_01_000002 to > > > > >> > > attempt_1446620926630_0017_m_000000_0 > > > > >> > > 2015-11-04 14:59:18,202 INFO [RMCommunicator Allocator] > > > > >> > > org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator: > > After > > > > >> > > Scheduling: PendingReds:0 ScheduledMaps:0 ScheduledReds:0 > > > > >> > > AssignedMaps:1 AssignedReds:0 CompletedMaps:0 CompletedReds:0 > > > > >> > > ContAlloc:1 ContRel:0 HostLocal:0 RackLocal:0 > > > > >> > > 2015-11-04 14:59:18,245 INFO [AsyncDispatcher event handler] > > > > >> > > org.apache.hadoop.yarn.util.RackResolver: Resolved > > > > >> > > hadoop04.housing.com to /default-rack > > > > >> > > 2015-11-04 14:59:18,245 INFO [AsyncDispatcher event handler] > > > > >> > > org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl: > Job > > > jar > > > > >> > > is not present. Not adding any jar to the list of resources. > > > > >> > > 2015-11-04 14:59:18,263 INFO [AsyncDispatcher event handler] > > > > >> > > org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl: > The > > > > >> > > job-conf file on the remote FS is > > > > >> > > /user/hdfs/.staging/job_1446620926630_0017/job.xml > > > > >> > > 2015-11-04 14:59:18,290 INFO [AsyncDispatcher event handler] > > > > >> > > org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl: > > > Adding > > > > #1 > > > > >> > > tokens and #1 secret keys for NM use for launching container > > > > >> > > 2015-11-04 14:59:18,290 INFO [AsyncDispatcher event handler] > > > > >> > > org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl: > > Size > > > of > > > > >> > > containertokens_dob is 2 > > > > >> > > 2015-11-04 14:59:18,291 INFO [AsyncDispatcher event handler] > > > > >> > > org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl: > > > Putting > > > > >> > > shuffle token in serviceData > > > > >> > > 2015-11-04 14:59:18,359 INFO [AsyncDispatcher event handler] > > > > >> > > org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl: > > > > >> > > attempt_1446620926630_0017_m_000000_0 TaskAttempt Transitioned > > > from > > > > >> > > UNASSIGNED to ASSIGNED > > > > >> > > 2015-11-04 14:59:18,363 INFO [ContainerLauncher #0] > > > > >> > > > > org.apache.hadoop.mapreduce.v2.app.launcher.ContainerLauncherImpl: > > > > >> > > Processing the event EventType: CONTAINER_REMOTE_LAUNCH for > > > > container > > > > >> > > container_e02_1446620926630_0017_01_000002 taskAttempt > > > > >> > > attempt_1446620926630_0017_m_000000_0 > > > > >> > > 2015-11-04 14:59:18,364 INFO [ContainerLauncher #0] > > > > >> > > > > org.apache.hadoop.mapreduce.v2.app.launcher.ContainerLauncherImpl: > > > > >> > > Launching attempt_1446620926630_0017_m_000000_0 > > > > >> > > 2015-11-04 14:59:18,365 INFO [ContainerLauncher #0] > > > > >> > > > > > > >> > > > > org.apache.hadoop.yarn.client.api.impl.ContainerManagementProtocolProxy: > > > > >> > > Opening proxy : hadoop04.housing.com:45454 > > > > >> > > 2015-11-04 14:59:18,435 INFO [ContainerLauncher #0] > > > > >> > > > > org.apache.hadoop.mapreduce.v2.app.launcher.ContainerLauncherImpl: > > > > >> > > Shuffle port returned by ContainerManager for > > > > >> > > attempt_1446620926630_0017_m_000000_0 : 13562 > > > > >> > > 2015-11-04 14:59:18,437 INFO [AsyncDispatcher event handler] > > > > >> > > org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl: > > > > >> > > TaskAttempt: [attempt_1446620926630_0017_m_000000_0] using > > > > >> > > containerId: [container_e02_1446620926630_0017_01_000002 on > NM: > > > > >> > > [hadoop04.housing.com:45454] > > > > >> > > 2015-11-04 14:59:18,439 INFO [AsyncDispatcher event handler] > > > > >> > > org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl: > > > > >> > > attempt_1446620926630_0017_m_000000_0 TaskAttempt Transitioned > > > from > > > > >> > > ASSIGNED to RUNNING > > > > >> > > 2015-11-04 14:59:18,440 INFO [AsyncDispatcher event handler] > > > > >> > > org.apache.hadoop.mapreduce.v2.app.job.impl.TaskImpl: > > > > >> > > task_1446620926630_0017_m_000000 Task Transitioned from > > SCHEDULED > > > to > > > > >> > > RUNNING > > > > >> > > 2015-11-04 14:59:19,213 INFO [RMCommunicator Allocator] > > > > >> > > org.apache.hadoop.mapreduce.v2.app.rm.RMContainerRequestor: > > > > >> > > getResources() for application_1446620926630_0017: ask=1 > > release= > > > 0 > > > > >> > > newContainers=0 finishedContainers=0 > > resourcelimit=<memory:17920, > > > > >> > > vCores:1> knownNMs=5 > > > > >> > > 2015-11-04 14:59:20,114 INFO [Socket Reader #1 for port 50432] > > > > >> > > SecurityLogger.org.apache.hadoop.ipc.Server: Auth successful > for > > > > >> > > job_1446620926630_0017 (auth:SIMPLE) > > > > >> > > 2015-11-04 14:59:20,138 INFO [IPC Server handler 3 on 50432] > > > > >> > > org.apache.hadoop.mapred.TaskAttemptListenerImpl: JVM with ID > : > > > > >> > > jvm_1446620926630_0017_m_2199023255554 asked for a task > > > > >> > > 2015-11-04 14:59:20,139 INFO [IPC Server handler 3 on 50432] > > > > >> > > org.apache.hadoop.mapred.TaskAttemptListenerImpl: JVM with ID: > > > > >> > > jvm_1446620926630_0017_m_2199023255554 given task: > > > > >> > > attempt_1446620926630_0017_m_000000_0 > > > > >> > > 2015-11-04 14:59:22,549 INFO [IPC Server handler 2 on 50432] > > > > >> > > org.apache.hadoop.mapred.TaskAttemptListenerImpl: Progress of > > > > >> > > TaskAttempt attempt_1446620926630_0017_m_000000_0 is : 0.0 > > > > >> > > 2015-11-04 14:59:22,589 INFO [IPC Server handler 1 on 50432] > > > > >> > > org.apache.hadoop.mapred.TaskAttemptListenerImpl: > Commit-pending > > > > state > > > > >> > > update from attempt_1446620926630_0017_m_000000_0 > > > > >> > > 2015-11-04 14:59:22,590 INFO [AsyncDispatcher event handler] > > > > >> > > org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl: > > > > >> > > attempt_1446620926630_0017_m_000000_0 TaskAttempt Transitioned > > > from > > > > >> > > RUNNING to COMMIT_PENDING > > > > >> > > 2015-11-04 14:59:22,591 INFO [AsyncDispatcher event handler] > > > > >> > > org.apache.hadoop.mapreduce.v2.app.job.impl.TaskImpl: > > > > >> > > attempt_1446620926630_0017_m_000000_0 given a go for > committing > > > the > > > > >> > > task output. > > > > >> > > 2015-11-04 14:59:22,597 INFO [IPC Server handler 0 on 50432] > > > > >> > > org.apache.hadoop.mapred.TaskAttemptListenerImpl: Commit > > go/no-go > > > > >> > > request from attempt_1446620926630_0017_m_000000_0 > > > > >> > > 2015-11-04 14:59:22,598 INFO [IPC Server handler 0 on 50432] > > > > >> > > org.apache.hadoop.mapreduce.v2.app.job.impl.TaskImpl: Result > of > > > > >> > > canCommit for attempt_1446620926630_0017_m_000000_0:true > > > > >> > > 2015-11-04 14:59:22,635 INFO [IPC Server handler 4 on 50432] > > > > >> > > org.apache.hadoop.mapred.TaskAttemptListenerImpl: Progress of > > > > >> > > TaskAttempt attempt_1446620926630_0017_m_000000_0 is : 1.0 > > > > >> > > 2015-11-04 14:59:22,643 INFO [IPC Server handler 16 on 50432] > > > > >> > > org.apache.hadoop.mapred.TaskAttemptListenerImpl: Done > > > > acknowledgement > > > > >> > > from attempt_1446620926630_0017_m_000000_0 > > > > >> > > 2015-11-04 14:59:22,645 INFO [AsyncDispatcher event handler] > > > > >> > > org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl: > > > > >> > > attempt_1446620926630_0017_m_000000_0 TaskAttempt Transitioned > > > from > > > > >> > > COMMIT_PENDING to SUCCESS_CONTAINER_CLEANUP > > > > >> > > 2015-11-04 14:59:22,647 INFO [ContainerLauncher #1] > > > > >> > > > > org.apache.hadoop.mapreduce.v2.app.launcher.ContainerLauncherImpl: > > > > >> > > Processing the event EventType: CONTAINER_REMOTE_CLEANUP for > > > > container > > > > >> > > container_e02_1446620926630_0017_01_000002 taskAttempt > > > > >> > > attempt_1446620926630_0017_m_000000_0 > > > > >> > > 2015-11-04 14:59:22,648 INFO [ContainerLauncher #1] > > > > >> > > > > org.apache.hadoop.mapreduce.v2.app.launcher.ContainerLauncherImpl: > > > > >> > > KILLING attempt_1446620926630_0017_m_000000_0 > > > > >> > > 2015-11-04 14:59:22,648 INFO [ContainerLauncher #1] > > > > >> > > > > > > >> > > > > org.apache.hadoop.yarn.client.api.impl.ContainerManagementProtocolProxy: > > > > >> > > Opening proxy : hadoop04.housing.com:45454 > > > > >> > > 2015-11-04 14:59:22,675 INFO [AsyncDispatcher event handler] > > > > >> > > org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl: > > > > >> > > attempt_1446620926630_0017_m_000000_0 TaskAttempt Transitioned > > > from > > > > >> > > SUCCESS_CONTAINER_CLEANUP to SUCCEEDED > > > > >> > > 2015-11-04 14:59:22,683 INFO [AsyncDispatcher event handler] > > > > >> > > org.apache.hadoop.mapreduce.v2.app.job.impl.TaskImpl: Task > > > succeeded > > > > >> > > with attempt attempt_1446620926630_0017_m_000000_0 > > > > >> > > 2015-11-04 14:59:22,683 INFO [AsyncDispatcher event handler] > > > > >> > > org.apache.hadoop.mapreduce.v2.app.job.impl.TaskImpl: > > > > >> > > task_1446620926630_0017_m_000000 Task Transitioned from > RUNNING > > to > > > > >> > > SUCCEEDED > > > > >> > > 2015-11-04 14:59:22,685 INFO [AsyncDispatcher event handler] > > > > >> > > org.apache.hadoop.mapreduce.v2.app.job.impl.JobImpl: Num > > completed > > > > >> > > Tasks: 1 > > > > >> > > 2015-11-04 14:59:22,685 INFO [AsyncDispatcher event handler] > > > > >> > > org.apache.hadoop.mapreduce.v2.app.job.impl.JobImpl: > > > > >> > > job_1446620926630_0017Job Transitioned from RUNNING to > > COMMITTING > > > > >> > > 2015-11-04 14:59:22,697 INFO [CommitterEvent Processor #1] > > > > >> > > > org.apache.hadoop.mapreduce.v2.app.commit.CommitterEventHandler: > > > > >> > > Processing the event EventType: JOB_COMMIT > > > > >> > > 2015-11-04 14:59:22,787 INFO [AsyncDispatcher event handler] > > > > >> > > org.apache.hadoop.mapreduce.v2.app.job.impl.JobImpl: Calling > > > handler > > > > >> > > for JobFinishedEvent > > > > >> > > 2015-11-04 14:59:22,787 INFO [AsyncDispatcher event handler] > > > > >> > > org.apache.hadoop.mapreduce.v2.app.job.impl.JobImpl: > > > > >> > > job_1446620926630_0017Job Transitioned from COMMITTING to > > > SUCCEEDED > > > > >> > > 2015-11-04 14:59:22,792 INFO [Thread-67] > > > > >> > > org.apache.hadoop.mapreduce.v2.app.MRAppMaster: We are > finishing > > > > >> > > cleanly so this is the last retry > > > > >> > > 2015-11-04 14:59:22,792 INFO [Thread-67] > > > > >> > > org.apache.hadoop.mapreduce.v2.app.MRAppMaster: Notify > > > > RMCommunicator > > > > >> > > isAMLastRetry: true > > > > >> > > 2015-11-04 14:59:22,793 INFO [Thread-67] > > > > >> > > org.apache.hadoop.mapreduce.v2.app.rm.RMCommunicator: > > > RMCommunicator > > > > >> > > notified that shouldUnregistered is: true > > > > >> > > 2015-11-04 14:59:22,793 INFO [Thread-67] > > > > >> > > org.apache.hadoop.mapreduce.v2.app.MRAppMaster: Notify JHEH > > > > >> > > isAMLastRetry: true > > > > >> > > 2015-11-04 14:59:22,793 INFO [Thread-67] > > > > >> > > org.apache.hadoop.mapreduce.jobhistory.JobHistoryEventHandler: > > > > >> > > JobHistoryEventHandler notified that forceJobCompletion is > true > > > > >> > > 2015-11-04 14:59:22,793 INFO [Thread-67] > > > > >> > > org.apache.hadoop.mapreduce.v2.app.MRAppMaster: Calling stop > for > > > all > > > > >> > > the services > > > > >> > > 2015-11-04 14:59:22,793 INFO [Thread-67] > > > > >> > > org.apache.hadoop.mapreduce.jobhistory.JobHistoryEventHandler: > > > > >> > > Stopping JobHistoryEventHandler. Size of the outstanding queue > > > size > > > > is > > > > >> > > 0 > > > > >> > > 2015-11-04 14:59:22,845 INFO [eventHandlingThread] > > > > >> > > org.apache.hadoop.mapreduce.jobhistory.JobHistoryEventHandler: > > > > Copying > > > > >> > > hdfs:// > > > > >> > > > > > > >> > > > > > >> > > > > > > > > > > hadoop01.housing.com:8020/user/hdfs/.staging/job_1446620926630_0017/job_1446620926630_0017_1.jhist > > > > >> > > to hdfs:// > > > > >> > > > > > > >> > > > > > >> > > > > > > > > > > hadoop01.housing.com:8020/mr-history/tmp/hdfs/job_1446620926630_0017-1446629350323-hdfs-oozie%3Alauncher%3AT%3Djava%3AW%3Djava%2Dmain%2Dwf%3AA%3Djava%2Dnode%3AI-1446629362786-1-0-SUCCEEDED-default-1446629356124.jhist_tmp > > > > >> > > 2015-11-04 14:59:22,880 INFO [eventHandlingThread] > > > > >> > > org.apache.hadoop.mapreduce.jobhistory.JobHistoryEventHandler: > > > > Copied > > > > >> > > to done location: > > > > >> > > hdfs:// > > > > >> > > > > > > >> > > > > > >> > > > > > > > > > > hadoop01.housing.com:8020/mr-history/tmp/hdfs/job_1446620926630_0017-1446629350323-hdfs-oozie%3Alauncher%3AT%3Djava%3AW%3Djava%2Dmain%2Dwf%3AA%3Djava%2Dnode%3AI-1446629362786-1-0-SUCCEEDED-default-1446629356124.jhist_tmp > > > > >> > > 2015-11-04 14:59:22,883 INFO [eventHandlingThread] > > > > >> > > org.apache.hadoop.mapreduce.jobhistory.JobHistoryEventHandler: > > > > Copying > > > > >> > > hdfs:// > > > > >> > > > > > > >> > > > > > >> > > > > > > > > > > hadoop01.housing.com:8020/user/hdfs/.staging/job_1446620926630_0017/job_1446620926630_0017_1_conf.xml > > > > >> > > to hdfs:// > > > > >> > > > > > > >> > > > > > >> > > > > > > > > > > hadoop01.housing.com:8020/mr-history/tmp/hdfs/job_1446620926630_0017_conf.xml_tmp > > > > >> > > 2015-11-04 14:59:22,956 INFO [eventHandlingThread] > > > > >> > > org.apache.hadoop.mapreduce.jobhistory.JobHistoryEventHandler: > > > > Copied > > > > >> > > to done location: > > > > >> > > hdfs:// > > > > >> > > > > > > >> > > > > > >> > > > > > > > > > > hadoop01.housing.com:8020/mr-history/tmp/hdfs/job_1446620926630_0017_conf.xml_tmp > > > > >> > > 2015-11-04 14:59:22,960 INFO [eventHandlingThread] > > > > >> > > org.apache.hadoop.mapreduce.jobhistory.JobHistoryEventHandler: > > > Moved > > > > >> > > tmp to done: hdfs:// > > > > >> > > > > > > >> > > > > > >> > > > > > > > > > > hadoop01.housing.com:8020/mr-history/tmp/hdfs/job_1446620926630_0017.summary_tmp > > > > >> > > to hdfs:// > > > > >> > > > > > > >> > > > > > >> > > > > > > > > > > hadoop01.housing.com:8020/mr-history/tmp/hdfs/job_1446620926630_0017.summary > > > > >> > > 2015-11-04 14:59:22,962 INFO [eventHandlingThread] > > > > >> > > org.apache.hadoop.mapreduce.jobhistory.JobHistoryEventHandler: > > > Moved > > > > >> > > tmp to done: hdfs:// > > > > >> > > > > > > >> > > > > > >> > > > > > > > > > > hadoop01.housing.com:8020/mr-history/tmp/hdfs/job_1446620926630_0017_conf.xml_tmp > > > > >> > > to hdfs:// > > > > >> > > > > > > >> > > > > > >> > > > > > > > > > > hadoop01.housing.com:8020/mr-history/tmp/hdfs/job_1446620926630_0017_conf.xml > > > > >> > > 2015-11-04 14:59:22,964 INFO [eventHandlingThread] > > > > >> > > org.apache.hadoop.mapreduce.jobhistory.JobHistoryEventHandler: > > > Moved > > > > >> > > tmp to done: hdfs:// > > > > >> > > > > > > >> > > > > > >> > > > > > > > > > > hadoop01.housing.com:8020/mr-history/tmp/hdfs/job_1446620926630_0017-1446629350323-hdfs-oozie%3Alauncher%3AT%3Djava%3AW%3Djava%2Dmain%2Dwf%3AA%3Djava%2Dnode%3AI-1446629362786-1-0-SUCCEEDED-default-1446629356124.jhist_tmp > > > > >> > > to hdfs:// > > > > >> > > > > > > >> > > > > > >> > > > > > > > > > > hadoop01.housing.com:8020/mr-history/tmp/hdfs/job_1446620926630_0017-1446629350323-hdfs-oozie%3Alauncher%3AT%3Djava%3AW%3Djava%2Dmain%2Dwf%3AA%3Djava%2Dnode%3AI-1446629362786-1-0-SUCCEEDED-default-1446629356124.jhist > > > > >> > > 2015-11-04 14:59:22,965 INFO [Thread-67] > > > > >> > > org.apache.hadoop.mapreduce.jobhistory.JobHistoryEventHandler: > > > > Stopped > > > > >> > > JobHistoryEventHandler. super.stop() > > > > >> > > 2015-11-04 14:59:22,968 INFO [Thread-67] > > > > >> > > org.apache.hadoop.mapreduce.v2.app.rm.RMCommunicator: Setting > > job > > > > >> > > diagnostics to > > > > >> > > 2015-11-04 14:59:22,969 INFO [Thread-67] > > > > >> > > org.apache.hadoop.mapreduce.v2.app.rm.RMCommunicator: History > > url > > > is > > > > >> > > > > > > >> > > > > http://hadoop03.housing.com:19888/jobhistory/job/job_1446620926630_0017 > > > > >> > > 2015-11-04 14:59:22,976 INFO [Thread-67] > > > > >> > > org.apache.hadoop.mapreduce.v2.app.rm.RMCommunicator: Waiting > > for > > > > >> > > application to be successfully unregistered. > > > > >> > > 2015-11-04 14:59:23,979 INFO [Thread-67] > > > > >> > > org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator: > > Final > > > > >> > > Stats: PendingReds:0 ScheduledMaps:0 ScheduledReds:0 > > > AssignedMaps:1 > > > > >> > > AssignedReds:0 CompletedMaps:0 CompletedReds:0 ContAlloc:1 > > > ContRel:0 > > > > >> > > HostLocal:0 RackLocal:0 > > > > >> > > 2015-11-04 14:59:23,980 INFO [Thread-67] > > > > >> > > org.apache.hadoop.mapreduce.v2.app.MRAppMaster: Deleting > staging > > > > >> > > directory hdfs://hadoop01.housing.com:8020 > > > > >> > > /user/hdfs/.staging/job_1446620926630_0017 > > > > >> > > 2015-11-04 14:59:23,984 INFO [Thread-67] > > > > org.apache.hadoop.ipc.Server: > > > > >> > > Stopping server on 50432 > > > > >> > > 2015-11-04 14:59:23,985 INFO [IPC Server listener on 50432] > > > > >> > > org.apache.hadoop.ipc.Server: Stopping IPC Server listener on > > > 50432 > > > > >> > > 2015-11-04 14:59:23,986 INFO [IPC Server Responder] > > > > >> > > org.apache.hadoop.ipc.Server: Stopping IPC Server Responder > > > > >> > > 2015-11-04 14:59:23,986 INFO [TaskHeartbeatHandler > PingChecker] > > > > >> > > org.apache.hadoop.mapreduce.v2.app.TaskHeartbeatHandler: > > > > >> > > TaskHeartbeatHandler thread interrupted > > > > >> > > > > > > >> > > > > > > >> > > On Wed, Nov 4, 2015 at 6:38 PM, Jaydeep Vishwakarma < > > > > >> > > [email protected]> wrote: > > > > >> > > > > > > >> > > > In first look I am not seeing any issue with job tracker or > > name > > > > >> node > > > > >> > > URL. > > > > >> > > > The job id is getting generated. Workflow Job is not going > on > > > > PREP > > > > >> > mode. > > > > >> > > > > > > > >> > > > Open this link. > > > > >> > > > > > > > >> > > > http://hadoop02.housing.com:8088/proxy/application_1446620926630_0014/ > > > > >> > > > > > > > >> > > > You will be see the problem. > > > > >> > > > > > > > >> > > > > > > > >> > > > > > > > >> > > > On Wed, Nov 4, 2015 at 6:24 PM, Jeetendra G < > > > > >> [email protected]> > > > > >> > > > wrote: > > > > >> > > > > > > > >> > > > > hey Serega I have cross verified jobTracker value is > correct > > > > only > > > > >> I > > > > >> > am > > > > >> > > > > using yarn so resource manager will become the job > tracker? > > > > >> > > > > > > > > >> > > > > On Wed, Nov 4, 2015 at 6:17 PM, Serega Sheypak < > > > > >> > > [email protected] > > > > >> > > > > > > > > >> > > > > wrote: > > > > >> > > > > > > > > >> > > > > > Can you go to oozie server and grab logs from there? My > > > > >> assumption > > > > >> > > that > > > > >> > > > > > <job-tracker>${jobTracker}</job-tracker> > > > > >> > > > > > <name-node>${nameNode}</name-node> > > > > >> > > > > > > > > > >> > > > > > have incorrect values. Probably ${jobTracker} is wrong > and > > > > oozie > > > > >> > > can't > > > > >> > > > > even > > > > >> > > > > > start launcher mapper. > > > > >> > > > > > > > > > >> > > > > > 2015-11-04 13:43 GMT+01:00 Jaydeep Vishwakarma < > > > > >> > > > > > [email protected]>: > > > > >> > > > > > > > > > >> > > > > > > You are doing -log. Can you give the command as below > > and > > > > get > > > > >> the > > > > >> > > job > > > > >> > > > > url > > > > >> > > > > > > (application launcher url). > > > > >> > > > > > > > > > > >> > > > > > > *oozie job -info > > > > >> 0000040-151015123257993-oozie-oozi-W@java-node* > > > > >> > > > > > > > > > > >> > > > > > > > > > > >> > > > > > > > > > > >> > > > > > > On Wed, Nov 4, 2015 at 5:53 PM, Jeetendra G < > > > > >> > > [email protected] > > > > >> > > > > > > > > >> > > > > > > wrote: > > > > >> > > > > > > > > > > >> > > > > > > > and in job error log tab its saying error log is > > > disables? > > > > >> by > > > > >> > > > default > > > > >> > > > > > why > > > > >> > > > > > > > error log is disables? i am using hortonworks > > > > >> > > > > > > > > > > > >> > > > > > > > On Wed, Nov 4, 2015 at 5:50 PM, Jeetendra G < > > > > >> > > > [email protected] > > > > >> > > > > > > > > > >> > > > > > > > wrote: > > > > >> > > > > > > > > > > > >> > > > > > > > > same error. > > > > >> > > > > > > > > > > > > >> > > > > > > > > 2015-11-04 14:09:00,935 INFO > > ActionStartXCommand:520 > > > - > > > > >> > SERVER[ > > > > >> > > > > > > > > hadoop03.housing.com] USER[hdfs] GROUP[-] TOKEN[] > > > > >> > > > > APP[java-main-wf] > > > > >> > > > > > > > > JOB[0000004-151104124010010-oozie-oozi-W] > > > > >> > > > > > > > > ACTION[0000004-151104124010010-oozie-oozi-W@ > > :start:] > > > > >> Start > > > > >> > > > action > > > > >> > > > > > > > > [0000004-151104124010010-oozie-oozi-W@:start:] > with > > > > >> > user-retry > > > > >> > > > > > state : > > > > >> > > > > > > > > userRetryCount [0], userRetryMax [0], > > > userRetryInterval > > > > >> [10] > > > > >> > > > > > > > > 2015-11-04 14:09:00,940 INFO > > ActionStartXCommand:520 > > > - > > > > >> > SERVER[ > > > > >> > > > > > > > > hadoop03.housing.com] USER[hdfs] GROUP[-] TOKEN[] > > > > >> > > > > APP[java-main-wf] > > > > >> > > > > > > > > JOB[0000004-151104124010010-oozie-oozi-W] > > > > >> > > > > > > > > ACTION[0000004-151104124010010-oozie-oozi-W@ > > :start:] > > > > >> > > > > > > > > [***0000004-151104124010010-oozie-oozi-W@ > > > > >> :start:***]Action > > > > >> > > > > > status=DONE > > > > >> > > > > > > > > 2015-11-04 14:09:00,940 INFO > > ActionStartXCommand:520 > > > - > > > > >> > SERVER[ > > > > >> > > > > > > > > hadoop03.housing.com] USER[hdfs] GROUP[-] TOKEN[] > > > > >> > > > > APP[java-main-wf] > > > > >> > > > > > > > > JOB[0000004-151104124010010-oozie-oozi-W] > > > > >> > > > > > > > > ACTION[0000004-151104124010010-oozie-oozi-W@ > > :start:] > > > > >> > > > > > > > > [***0000004-151104124010010-oozie-oozi-W@ > > > > >> :start:***]Action > > > > >> > > > updated > > > > >> > > > > > in > > > > >> > > > > > > > DB! > > > > >> > > > > > > > > 2015-11-04 14:09:00,994 INFO > > > > >> > WorkflowNotificationXCommand:520 > > > > >> > > - > > > > >> > > > > > > SERVER[ > > > > >> > > > > > > > > hadoop03.housing.com] USER[-] GROUP[-] TOKEN[-] > > > APP[-] > > > > >> > > > > > > > > JOB[0000004-151104124010010-oozie-oozi-W] > > > > >> > > > > > > > > ACTION[0000004-151104124010010-oozie-oozi-W@ > > :start:] > > > No > > > > >> > > > > Notification > > > > >> > > > > > > URL > > > > >> > > > > > > > > is defined. Therefore nothing to notify for job > > > > >> > > > > > > > > 0000004-151104124010010-oozie-oozi-W@:start: > > > > >> > > > > > > > > 2015-11-04 14:09:01,004 INFO > > > > >> > WorkflowNotificationXCommand:520 > > > > >> > > - > > > > >> > > > > > > SERVER[ > > > > >> > > > > > > > > hadoop03.housing.com] USER[-] GROUP[-] TOKEN[-] > > > APP[-] > > > > >> > > > > > > > > JOB[0000004-151104124010010-oozie-oozi-W] ACTION[] > > No > > > > >> > > > Notification > > > > >> > > > > > URL > > > > >> > > > > > > is > > > > >> > > > > > > > > defined. Therefore nothing to notify for job > > > > >> > > > > > > > > 0000004-151104124010010-oozie-oozi-W > > > > >> > > > > > > > > 2015-11-04 14:09:01,014 INFO > > ActionStartXCommand:520 > > > - > > > > >> > SERVER[ > > > > >> > > > > > > > > hadoop03.housing.com] USER[hdfs] GROUP[-] TOKEN[] > > > > >> > > > > APP[java-main-wf] > > > > >> > > > > > > > > JOB[0000004-151104124010010-oozie-oozi-W] > > > > >> > > > > > > > > > > ACTION[0000004-151104124010010-oozie-oozi-W@java-node > > > ] > > > > >> Start > > > > >> > > > > action > > > > >> > > > > > > > > [0000004-151104124010010-oozie-oozi-W@java-node] > > with > > > > >> > > user-retry > > > > >> > > > > > > state : > > > > >> > > > > > > > > userRetryCount [0], userRetryMax [0], > > > userRetryInterval > > > > >> [10] > > > > >> > > > > > > > > 2015-11-04 14:09:02,916 INFO > > JavaActionExecutor:520 - > > > > >> > SERVER[ > > > > >> > > > > > > > > hadoop03.housing.com] USER[hdfs] GROUP[-] TOKEN[] > > > > >> > > > > APP[java-main-wf] > > > > >> > > > > > > > > JOB[0000004-151104124010010-oozie-oozi-W] > > > > >> > > > > > > > > > > ACTION[0000004-151104124010010-oozie-oozi-W@java-node > > > ] > > > > >> > > checking > > > > >> > > > > > > action, > > > > >> > > > > > > > > hadoop job ID [job_1446620926630_0016] status > > > [RUNNING] > > > > >> > > > > > > > > 2015-11-04 14:09:02,918 INFO > > ActionStartXCommand:520 > > > - > > > > >> > SERVER[ > > > > >> > > > > > > > > hadoop03.housing.com] USER[hdfs] GROUP[-] TOKEN[] > > > > >> > > > > APP[java-main-wf] > > > > >> > > > > > > > > JOB[0000004-151104124010010-oozie-oozi-W] > > > > >> > > > > > > > > > > ACTION[0000004-151104124010010-oozie-oozi-W@java-node > > > ] > > > > >> > > > > > > > > [***0000004-151104124010010-oozie-oozi-W@java-node > > > > >> ***]Action > > > > >> > > > > > > > > status=RUNNING > > > > >> > > > > > > > > 2015-11-04 14:09:02,918 INFO > > ActionStartXCommand:520 > > > - > > > > >> > SERVER[ > > > > >> > > > > > > > > hadoop03.housing.com] USER[hdfs] GROUP[-] TOKEN[] > > > > >> > > > > APP[java-main-wf] > > > > >> > > > > > > > > JOB[0000004-151104124010010-oozie-oozi-W] > > > > >> > > > > > > > > > > ACTION[0000004-151104124010010-oozie-oozi-W@java-node > > > ] > > > > >> > > > > > > > > [***0000004-151104124010010-oozie-oozi-W@java-node > > > > >> ***]Action > > > > >> > > > > updated > > > > >> > > > > > > in > > > > >> > > > > > > > > DB! > > > > >> > > > > > > > > 2015-11-04 14:09:02,926 INFO > > > > >> > WorkflowNotificationXCommand:520 > > > > >> > > - > > > > >> > > > > > > SERVER[ > > > > >> > > > > > > > > hadoop03.housing.com] USER[-] GROUP[-] TOKEN[-] > > > APP[-] > > > > >> > > > > > > > > JOB[0000004-151104124010010-oozie-oozi-W] > > > > >> > > > > > > > > > > ACTION[0000004-151104124010010-oozie-oozi-W@java-node > > > ] > > > > No > > > > >> > > > > > Notification > > > > >> > > > > > > > > URL is defined. Therefore nothing to notify for > job > > > > >> > > > > > > > > 0000004-151104124010010-oozie-oozi-W@java-node > > > > >> > > > > > > > > 2015-11-04 14:09:17,606 INFO CallbackServlet:520 > - > > > > >> SERVER[ > > > > >> > > > > > > > > hadoop03.housing.com] USER[-] GROUP[-] TOKEN[-] > > > APP[-] > > > > >> > > > > > > > > JOB[0000004-151104124010010-oozie-oozi-W] > > > > >> > > > > > > > > > > ACTION[0000004-151104124010010-oozie-oozi-W@java-node > > > ] > > > > >> > > callback > > > > >> > > > > for > > > > >> > > > > > > > > action > > [0000004-151104124010010-oozie-oozi-W@java-node > > > ] > > > > >> > > > > > > > > 2015-11-04 14:09:17,907 INFO > > JavaActionExecutor:520 - > > > > >> > SERVER[ > > > > >> > > > > > > > > hadoop03.housing.com] USER[hdfs] GROUP[-] TOKEN[] > > > > >> > > > > APP[java-main-wf] > > > > >> > > > > > > > > JOB[0000004-151104124010010-oozie-oozi-W] > > > > >> > > > > > > > > > > ACTION[0000004-151104124010010-oozie-oozi-W@java-node > > > ] > > > > >> > action > > > > >> > > > > > > completed, > > > > >> > > > > > > > > external ID [job_1446620926630_0016] > > > > >> > > > > > > > > 2015-11-04 14:09:18,029 INFO > > ActionStartXCommand:520 > > > - > > > > >> > SERVER[ > > > > >> > > > > > > > > hadoop03.housing.com] USER[hdfs] GROUP[-] TOKEN[] > > > > >> > > > > APP[java-main-wf] > > > > >> > > > > > > > > JOB[0000004-151104124010010-oozie-oozi-W] > > > > >> > > > > > > > > ACTION[0000004-151104124010010-oozie-oozi-W@end] > > > Start > > > > >> > action > > > > >> > > > > > > > > [0000004-151104124010010-oozie-oozi-W@end] with > > > > >> user-retry > > > > >> > > > state : > > > > >> > > > > > > > > userRetryCount [0], userRetryMax [0], > > > userRetryInterval > > > > >> [10] > > > > >> > > > > > > > > 2015-11-04 14:09:18,034 INFO > > ActionStartXCommand:520 > > > - > > > > >> > SERVER[ > > > > >> > > > > > > > > hadoop03.housing.com] USER[hdfs] GROUP[-] TOKEN[] > > > > >> > > > > APP[java-main-wf] > > > > >> > > > > > > > > JOB[0000004-151104124010010-oozie-oozi-W] > > > > >> > > > > > > > > ACTION[0000004-151104124010010-oozie-oozi-W@end] > > > > >> > > > > > > > > [***0000004-151104124010010-oozie-oozi-W@end > > > ***]Action > > > > >> > > > status=DONE > > > > >> > > > > > > > > 2015-11-04 14:09:18,034 INFO > > ActionStartXCommand:520 > > > - > > > > >> > SERVER[ > > > > >> > > > > > > > > hadoop03.housing.com] USER[hdfs] GROUP[-] TOKEN[] > > > > >> > > > > APP[java-main-wf] > > > > >> > > > > > > > > JOB[0000004-151104124010010-oozie-oozi-W] > > > > >> > > > > > > > > ACTION[0000004-151104124010010-oozie-oozi-W@end] > > > > >> > > > > > > > > [***0000004-151104124010010-oozie-oozi-W@end > > > ***]Action > > > > >> > updated > > > > >> > > > in > > > > >> > > > > > DB! > > > > >> > > > > > > > > 2015-11-04 14:09:18,104 INFO > > > > >> > WorkflowNotificationXCommand:520 > > > > >> > > - > > > > >> > > > > > > SERVER[ > > > > >> > > > > > > > > hadoop03.housing.com] USER[-] GROUP[-] TOKEN[-] > > > APP[-] > > > > >> > > > > > > > > JOB[0000004-151104124010010-oozie-oozi-W] > > > > >> > > > > > > > > ACTION[0000004-151104124010010-oozie-oozi-W@end] > No > > > > >> > > Notification > > > > >> > > > > URL > > > > >> > > > > > > is > > > > >> > > > > > > > > defined. Therefore nothing to notify for job > > > > >> > > > > > > > > 0000004-151104124010010-oozie-oozi-W@end > > > > >> > > > > > > > > 2015-11-04 14:09:18,104 INFO > > > > >> > WorkflowNotificationXCommand:520 > > > > >> > > - > > > > >> > > > > > > SERVER[ > > > > >> > > > > > > > > hadoop03.housing.com] USER[-] GROUP[-] TOKEN[-] > > > APP[-] > > > > >> > > > > > > > > JOB[0000004-151104124010010-oozie-oozi-W] ACTION[] > > No > > > > >> > > > Notification > > > > >> > > > > > URL > > > > >> > > > > > > is > > > > >> > > > > > > > > defined. Therefore nothing to notify for job > > > > >> > > > > > > > > 0000004-151104124010010-oozie-oozi-W > > > > >> > > > > > > > > 2015-11-04 14:09:18,105 INFO > > > > >> > WorkflowNotificationXCommand:520 > > > > >> > > - > > > > >> > > > > > > SERVER[ > > > > >> > > > > > > > > hadoop03.housing.com] USER[-] GROUP[-] TOKEN[-] > > > APP[-] > > > > >> > > > > > > > > JOB[0000004-151104124010010-oozie-oozi-W] > > > > >> > > > > > > > > > > ACTION[0000004-151104124010010-oozie-oozi-W@java-node > > > ] > > > > No > > > > >> > > > > > Notification > > > > >> > > > > > > > > URL is defined. Therefore nothing to notify for > job > > > > >> > > > > > > > > 0000004-151104124010010-oozie-oozi-W@java-node > > > > >> > > > > > > > > > > > > >> > > > > > > > > > > > > >> > > > > > > > > > > > > >> > > > > > > > > On Wed, Nov 4, 2015 at 4:26 PM, Jaydeep > Vishwakarma > > < > > > > >> > > > > > > > > [email protected]> wrote: > > > > >> > > > > > > > > > > > > >> > > > > > > > >> oozie job -info > > > > >> > 0000040-151015123257993-oozie-oozi-W@java-node > > > > >> > > > > > > > >> There you will find "Console URL" , Open that URL > > on > > > > >> > browser. > > > > >> > > > You > > > > >> > > > > > will > > > > >> > > > > > > > get > > > > >> > > > > > > > >> the Launcher mapper logs. > > > > >> > > > > > > > >> > > > > >> > > > > > > > >> > > > > >> > > > > > > > >> > > > > >> > > > > > > > >> On Wed, Nov 4, 2015 at 4:13 PM, Jeetendra G < > > > > >> > > > > > [email protected]> > > > > >> > > > > > > > >> wrote: > > > > >> > > > > > > > >> > > > > >> > > > > > > > >> > This is the log i am getting repeatedly > > > > >> > > > > > > > >> > 2015-10-29 16:39:11,095 INFO > > > > >> > > > WorkflowNotificationXCommand:520 - > > > > >> > > > > > > > SERVER[ > > > > >> > > > > > > > >> > hadoop03.housing.com] USER[-] GROUP[-] > TOKEN[-] > > > > APP[-] > > > > >> > > > > > > > >> > JOB[0000040-151015123257993-oozie-oozi-W] > > > > >> > > > > > > > >> > ACTION[0000040-151015123257993-oozie-oozi-W@ > > > :start:] > > > > >> No > > > > >> > > > > > > Notification > > > > >> > > > > > > > >> URL > > > > >> > > > > > > > >> > is > > > > >> > > > > > > > >> > defined. Therefore nothing to notify for job > > > > >> > > > > > > > >> > 0000040-151015123257993-oozie-oozi-W@:start: > > > > >> > > > > > > > >> > 2015-10-29 16:39:11,095 INFO > > > > >> > > > WorkflowNotificationXCommand:520 - > > > > >> > > > > > > > SERVER[ > > > > >> > > > > > > > >> > hadoop03.housing.com] USER[-] GROUP[-] > TOKEN[-] > > > > APP[-] > > > > >> > > > > > > > >> > JOB[0000040-151015123257993-oozie-oozi-W] > > ACTION[] > > > No > > > > >> > > > > Notification > > > > >> > > > > > > URL > > > > >> > > > > > > > >> is > > > > >> > > > > > > > >> > defined. Therefore nothing to notify for job > > > > >> > > > > > > > >> > 0000040-151015123257993-oozie-oozi-W > > > > >> > > > > > > > >> > > > > > >> > > > > > > > >> > On Wed, Nov 4, 2015 at 4:11 PM, Jaydeep > > > Vishwakarma < > > > > >> > > > > > > > >> > [email protected]> wrote: > > > > >> > > > > > > > >> > > > > > >> > > > > > > > >> > > Have you checked Launcher Mapper logs?. What > it > > > > says? > > > > >> > > > > > > > >> > > > > > > >> > > > > > > > >> > > On Wed, Nov 4, 2015 at 4:04 PM, Jeetendra G < > > > > >> > > > > > > > [email protected]> > > > > >> > > > > > > > >> > > wrote: > > > > >> > > > > > > > >> > > > > > > >> > > > > > > > >> > > > does anybody have any idea? i have been > > trying > > > > this > > > > >> > from > > > > >> > > > 10 > > > > >> > > > > > days > > > > >> > > > > > > > >> > nothing > > > > >> > > > > > > > >> > > > worked out. > > > > >> > > > > > > > >> > > > > > > > >> > > > > > > > >> > > > On Thu, Oct 29, 2015 at 6:02 PM, Jeetendra > G > > < > > > > >> > > > > > > > >> [email protected]> > > > > >> > > > > > > > >> > > > wrote: > > > > >> > > > > > > > >> > > > > > > > >> > > > > > > > >> > > > > my workflow.xml > > > > >> > > > > > > > >> > > > > > > > > >> > > > > > > > >> > > > > > > > > >> > > > > > > > >> > > > > <workflow-app > > xmlns="uri:oozie:workflow:0.2" > > > > >> > > > > > > > name="java-main-wf"> > > > > >> > > > > > > > >> > > > > <start to="java-node"/> > > > > >> > > > > > > > >> > > > > <action name="java-node"> > > > > >> > > > > > > > >> > > > > <java> > > > > >> > > > > > > > >> > > > > > > > > >> <job-tracker>${jobTracker}</job-tracker> > > > > >> > > > > > > > >> > > > > > > > <name-node>${nameNode}</name-node> > > > > >> > > > > > > > >> > > > > > > > > >> > > > > > > > > > <main-class>com.housing.common.JSONMerger</main-class> > > > > >> > > > > > > > >> > > > > > > > > >> > > > > > <java-opts>-Dhadoop.custom.configuration.file=hdfs:// > > > > >> > > > > > > > >> > > > > > > > > >> 10.1.6.186:8020/configuration/jsonmerger-dev.conf > > > > >> > > > > > > > >> > > > > -Dyyyymmdd=20151029</java-opts> > > > > >> > > > > > > > >> > > > > > > > > >> > > > > > > > >> > > > > </java> > > > > >> > > > > > > > >> > > > > <ok to="end"/> > > > > >> > > > > > > > >> > > > > <error to="fail"/> > > > > >> > > > > > > > >> > > > > </action> > > > > >> > > > > > > > >> > > > > <kill name="fail"> > > > > >> > > > > > > > >> > > > > <message>Java failed, error > > > > >> > > > > > > > >> > > > > > > > > >> > > > message[${wf:errorMessage(wf:lastErrorNode())}]</message> > > > > >> > > > > > > > >> > > > > </kill> > > > > >> > > > > > > > >> > > > > <end name="end"/> > > > > >> > > > > > > > >> > > > > </workflow-app> > > > > >> > > > > > > > >> > > > > > > > > >> > > > > > > > >> > > > > On Thu, Oct 29, 2015 at 4:53 PM, > Jeetendra > > G > > > < > > > > >> > > > > > > > >> > [email protected]> > > > > >> > > > > > > > >> > > > > wrote: > > > > >> > > > > > > > >> > > > > > > > > >> > > > > > > > >> > > > >> Hi All, > > > > >> > > > > > > > >> > > > >> > > > > >> > > > > > > > >> > > > >> I am running java workflow job using > > oozie. > > > > >> > > > > > > > >> > > > >> I have Ambari server and I have > installed > > > > oozie > > > > >> > from > > > > >> > > > > > Ambari. > > > > >> > > > > > > > >> > > > >> When i ran the job it say succeeded but > > its > > > > not > > > > >> > > running > > > > >> > > > > my > > > > >> > > > > > > java > > > > >> > > > > > > > >> > class > > > > >> > > > > > > > >> > > > >> which I mentioned inside workflow.xml. > > Also > > > > >> when I > > > > >> > > get > > > > >> > > > > > oozie > > > > >> > > > > > > > >> > nothing > > > > >> > > > > > > > >> > > > can > > > > >> > > > > > > > >> > > > >> be find pasting log beow, can anybody > help > > > > here? > > > > >> > > > > > > > >> > > > >> oozie job -oozie > > > > >> > > > http://hadoop03.housing.com:11000/oozie > > > > >> > > > > > > -log > > > > >> > > > > > > > >> > > > >> 0000040-151015123257993-oozie-oozi-W > > > > >> > > > > > > > >> > > > >> 2015-10-29 16:39:11,058 INFO > > > > >> > > ActionStartXCommand:520 - > > > > >> > > > > > > SERVER[ > > > > >> > > > > > > > >> > > > >> hadoop03.housing.com] USER[hdfs] > GROUP[-] > > > > >> TOKEN[] > > > > >> > > > > > > > >> APP[java-main-wf] > > > > >> > > > > > > > >> > > > >> > JOB[0000040-151015123257993-oozie-oozi-W] > > > > >> > > > > > > > >> > > > >> > > ACTION[0000040-151015123257993-oozie-oozi-W@ > > > > >> > :start:] > > > > >> > > > > Start > > > > >> > > > > > > > >> action > > > > >> > > > > > > > >> > > > >> [0000040-151015123257993-oozie-oozi-W@ > > > > :start:] > > > > >> > with > > > > >> > > > > > > user-retry > > > > >> > > > > > > > >> > state > > > > >> > > > > > > > >> > > : > > > > >> > > > > > > > >> > > > >> userRetryCount [0], userRetryMax [0], > > > > >> > > userRetryInterval > > > > >> > > > > > [10] > > > > >> > > > > > > > >> > > > >> 2015-10-29 16:39:11,061 INFO > > > > >> > > ActionStartXCommand:520 - > > > > >> > > > > > > SERVER[ > > > > >> > > > > > > > >> > > > >> hadoop03.housing.com] USER[hdfs] > GROUP[-] > > > > >> TOKEN[] > > > > >> > > > > > > > >> APP[java-main-wf] > > > > >> > > > > > > > >> > > > >> > JOB[0000040-151015123257993-oozie-oozi-W] > > > > >> > > > > > > > >> > > > >> > > ACTION[0000040-151015123257993-oozie-oozi-W@ > > > > >> > :start:] > > > > >> > > > > > > > >> > > > >> > [***0000040-151015123257993-oozie-oozi-W@ > > > > >> > > > > :start:***]Action > > > > >> > > > > > > > >> > > status=DONE > > > > >> > > > > > > > >> > > > >> 2015-10-29 16:39:11,061 INFO > > > > >> > > ActionStartXCommand:520 - > > > > >> > > > > > > SERVER[ > > > > >> > > > > > > > >> > > > >> hadoop03.housing.com] USER[hdfs] > GROUP[-] > > > > >> TOKEN[] > > > > >> > > > > > > > >> APP[java-main-wf] > > > > >> > > > > > > > >> > > > >> > JOB[0000040-151015123257993-oozie-oozi-W] > > > > >> > > > > > > > >> > > > >> > > ACTION[0000040-151015123257993-oozie-oozi-W@ > > > > >> > :start:] > > > > >> > > > > > > > >> > > > >> > [***0000040-151015123257993-oozie-oozi-W@ > > > > >> > > > > :start:***]Action > > > > >> > > > > > > > >> updated > > > > >> > > > > > > > >> > in > > > > >> > > > > > > > >> > > > DB! > > > > >> > > > > > > > >> > > > >> 2015-10-29 16:39:11,095 INFO > > > > >> > > > > > > WorkflowNotificationXCommand:520 > > > > >> > > > > > > > - > > > > >> > > > > > > > >> > > SERVER[ > > > > >> > > > > > > > >> > > > >> hadoop03.housing.com] USER[-] GROUP[-] > > > > TOKEN[-] > > > > >> > > APP[-] > > > > >> > > > > > > > >> > > > >> > JOB[0000040-151015123257993-oozie-oozi-W] > > > > >> > > > > > > > >> > > > >> > > ACTION[0000040-151015123257993-oozie-oozi-W@ > > > > >> > :start:] > > > > >> > > > No > > > > >> > > > > > > > >> > Notification > > > > >> > > > > > > > >> > > > URL > > > > >> > > > > > > > >> > > > >> is defined. Therefore nothing to notify > > for > > > > job > > > > >> > > > > > > > >> > > > >> 0000040-151015123257993-oozie-oozi-W@ > > > :start: > > > > >> > > > > > > > >> > > > >> 2015-10-29 16:39:11,095 INFO > > > > >> > > > > > > WorkflowNotificationXCommand:520 > > > > >> > > > > > > > - > > > > >> > > > > > > > >> > > SERVER[ > > > > >> > > > > > > > >> > > > >> hadoop03.housing.com] USER[-] GROUP[-] > > > > TOKEN[-] > > > > >> > > APP[-] > > > > >> > > > > > > > >> > > > >> > JOB[0000040-151015123257993-oozie-oozi-W] > > > > >> ACTION[] > > > > >> > No > > > > >> > > > > > > > >> Notification > > > > >> > > > > > > > >> > URL > > > > >> > > > > > > > >> > > > is > > > > >> > > > > > > > >> > > > >> defined. Therefore nothing to notify for > > job > > > > >> > > > > > > > >> > > > >> 0000040-151015123257993-oozie-oozi-W > > > > >> > > > > > > > >> > > > >> 2015-10-29 16:39:11,107 INFO > > > > >> > > ActionStartXCommand:520 - > > > > >> > > > > > > SERVER[ > > > > >> > > > > > > > >> > > > >> hadoop03.housing.com] USER[hdfs] > GROUP[-] > > > > >> TOKEN[] > > > > >> > > > > > > > >> APP[java-main-wf] > > > > >> > > > > > > > >> > > > >> > JOB[0000040-151015123257993-oozie-oozi-W] > > > > >> > > > > > > > >> > > > >> > > > > >> > ACTION[0000040-151015123257993-oozie-oozi-W@java-node > > > > >> > > ] > > > > >> > > > > > Start > > > > >> > > > > > > > >> action > > > > >> > > > > > > > >> > > > >> > > > > [0000040-151015123257993-oozie-oozi-W@java-node > > > > >> ] > > > > >> > > with > > > > >> > > > > > > > user-retry > > > > >> > > > > > > > >> > > state > > > > >> > > > > > > > >> > > > : > > > > >> > > > > > > > >> > > > >> userRetryCount [0], userRetryMax [0], > > > > >> > > userRetryInterval > > > > >> > > > > > [10] > > > > >> > > > > > > > >> > > > >> 2015-10-29 16:39:12,222 INFO > > > > >> > JavaActionExecutor:520 > > > > >> > > - > > > > >> > > > > > > SERVER[ > > > > >> > > > > > > > >> > > > >> hadoop03.housing.com] USER[hdfs] > GROUP[-] > > > > >> TOKEN[] > > > > >> > > > > > > > >> APP[java-main-wf] > > > > >> > > > > > > > >> > > > >> > JOB[0000040-151015123257993-oozie-oozi-W] > > > > >> > > > > > > > >> > > > >> > > > > >> > ACTION[0000040-151015123257993-oozie-oozi-W@java-node > > > > >> > > ] > > > > >> > > > > > > > checking > > > > >> > > > > > > > >> > > action, > > > > >> > > > > > > > >> > > > >> hadoop job ID [job_1444892488693_0073] > > > status > > > > >> > > [RUNNING] > > > > >> > > > > > > > >> > > > >> 2015-10-29 16:39:12,224 INFO > > > > >> > > ActionStartXCommand:520 - > > > > >> > > > > > > SERVER[ > > > > >> > > > > > > > >> > > > >> hadoop03.housing.com] USER[hdfs] > GROUP[-] > > > > >> TOKEN[] > > > > >> > > > > > > > >> APP[java-main-wf] > > > > >> > > > > > > > >> > > > >> > JOB[0000040-151015123257993-oozie-oozi-W] > > > > >> > > > > > > > >> > > > >> > > > > >> > ACTION[0000040-151015123257993-oozie-oozi-W@java-node > > > > >> > > ] > > > > >> > > > > > > > >> > > > >> > > > > >> [***0000040-151015123257993-oozie-oozi-W@java-node > > > > >> > > > > > ***]Action > > > > >> > > > > > > > >> > > > >> status=RUNNING > > > > >> > > > > > > > >> > > > >> 2015-10-29 16:39:12,224 INFO > > > > >> > > ActionStartXCommand:520 - > > > > >> > > > > > > SERVER[ > > > > >> > > > > > > > >> > > > >> hadoop03.housing.com] USER[hdfs] > GROUP[-] > > > > >> TOKEN[] > > > > >> > > > > > > > >> APP[java-main-wf] > > > > >> > > > > > > > >> > > > >> > JOB[0000040-151015123257993-oozie-oozi-W] > > > > >> > > > > > > > >> > > > >> > > > > >> > ACTION[0000040-151015123257993-oozie-oozi-W@java-node > > > > >> > > ] > > > > >> > > > > > > > >> > > > >> > > > > >> [***0000040-151015123257993-oozie-oozi-W@java-node > > > > >> > > > > > ***]Action > > > > >> > > > > > > > >> > updated > > > > >> > > > > > > > >> > > in > > > > >> > > > > > > > >> > > > >> DB! > > > > >> > > > > > > > >> > > > >> 2015-10-29 16:39:12,229 INFO > > > > >> > > > > > > WorkflowNotificationXCommand:520 > > > > >> > > > > > > > - > > > > >> > > > > > > > >> > > SERVER[ > > > > >> > > > > > > > >> > > > >> hadoop03.housing.com] USER[-] GROUP[-] > > > > TOKEN[-] > > > > >> > > APP[-] > > > > >> > > > > > > > >> > > > >> > JOB[0000040-151015123257993-oozie-oozi-W] > > > > >> > > > > > > > >> > > > >> > > > > >> > ACTION[0000040-151015123257993-oozie-oozi-W@java-node > > > > >> > > ] > > > > >> > > > > No > > > > >> > > > > > > > >> > > Notification > > > > >> > > > > > > > >> > > > >> URL is defined. Therefore nothing to > > notify > > > > for > > > > >> job > > > > >> > > > > > > > >> > > > >> > > > 0000040-151015123257993-oozie-oozi-W@java-node > > > > >> > > > > > > > >> > > > >> 2015-10-29 16:39:25,192 INFO > > > > >> CallbackServlet:520 - > > > > >> > > > > SERVER[ > > > > >> > > > > > > > >> > > > >> hadoop03.housing.com] USER[-] GROUP[-] > > > > TOKEN[-] > > > > >> > > APP[-] > > > > >> > > > > > > > >> > > > >> > JOB[0000040-151015123257993-oozie-oozi-W] > > > > >> > > > > > > > >> > > > >> > > > > >> > ACTION[0000040-151015123257993-oozie-oozi-W@java-node > > > > >> > > ] > > > > >> > > > > > > > callback > > > > >> > > > > > > > >> for > > > > >> > > > > > > > >> > > > >> action > > > > >> > > [0000040-151015123257993-oozie-oozi-W@java-node > > > > >> > > > ] > > > > >> > > > > > > > >> > > > >> 2015-10-29 16:39:25,393 INFO > > > > >> > JavaActionExecutor:520 > > > > >> > > - > > > > >> > > > > > > SERVER[ > > > > >> > > > > > > > >> > > > >> hadoop03.housing.com] USER[hdfs] > GROUP[-] > > > > >> TOKEN[] > > > > >> > > > > > > > >> APP[java-main-wf] > > > > >> > > > > > > > >> > > > >> > JOB[0000040-151015123257993-oozie-oozi-W] > > > > >> > > > > > > > >> > > > >> > > > > >> > ACTION[0000040-151015123257993-oozie-oozi-W@java-node > > > > >> > > ] > > > > >> > > > > > > action > > > > >> > > > > > > > >> > > > completed, > > > > >> > > > > > > > >> > > > >> external ID [job_1444892488693_0073] > > > > >> > > > > > > > >> > > > >> 2015-10-29 16:39:25,462 INFO > > > > >> > > ActionStartXCommand:520 - > > > > >> > > > > > > SERVER[ > > > > >> > > > > > > > >> > > > >> hadoop03.housing.com] USER[hdfs] > GROUP[-] > > > > >> TOKEN[] > > > > >> > > > > > > > >> APP[java-main-wf] > > > > >> > > > > > > > >> > > > >> > JOB[0000040-151015123257993-oozie-oozi-W] > > > > >> > > > > > > > >> > > > >> > > > > ACTION[0000040-151015123257993-oozie-oozi-W@end > > > > >> ] > > > > >> > > Start > > > > >> > > > > > > action > > > > >> > > > > > > > >> > > > >> > [0000040-151015123257993-oozie-oozi-W@end > > ] > > > > with > > > > >> > > > > user-retry > > > > >> > > > > > > > >> state : > > > > >> > > > > > > > >> > > > >> userRetryCount [0], userRetryMax [0], > > > > >> > > userRetryInterval > > > > >> > > > > > [10] > > > > >> > > > > > > > >> > > > >> 2015-10-29 16:39:25,464 INFO > > > > >> > > ActionStartXCommand:520 - > > > > >> > > > > > > SERVER[ > > > > >> > > > > > > > >> > > > >> hadoop03.housing.com] USER[hdfs] > GROUP[-] > > > > >> TOKEN[] > > > > >> > > > > > > > >> APP[java-main-wf] > > > > >> > > > > > > > >> > > > >> > JOB[0000040-151015123257993-oozie-oozi-W] > > > > >> > > > > > > > >> > > > >> > > > > ACTION[0000040-151015123257993-oozie-oozi-W@end > > > > >> ] > > > > >> > > > > > > > >> > > > >> > > [***0000040-151015123257993-oozie-oozi-W@end > > > > >> > > ***]Action > > > > >> > > > > > > > >> status=DONE > > > > >> > > > > > > > >> > > > >> 2015-10-29 16:39:25,465 INFO > > > > >> > > ActionStartXCommand:520 - > > > > >> > > > > > > SERVER[ > > > > >> > > > > > > > >> > > > >> hadoop03.housing.com] USER[hdfs] > GROUP[-] > > > > >> TOKEN[] > > > > >> > > > > > > > >> APP[java-main-wf] > > > > >> > > > > > > > >> > > > >> > JOB[0000040-151015123257993-oozie-oozi-W] > > > > >> > > > > > > > >> > > > >> > > > > ACTION[0000040-151015123257993-oozie-oozi-W@end > > > > >> ] > > > > >> > > > > > > > >> > > > >> > > [***0000040-151015123257993-oozie-oozi-W@end > > > > >> > > ***]Action > > > > >> > > > > > > updated > > > > >> > > > > > > > >> in > > > > >> > > > > > > > >> > DB! > > > > >> > > > > > > > >> > > > >> 2015-10-29 16:39:25,522 INFO > > > > >> > > > > > > WorkflowNotificationXCommand:520 > > > > >> > > > > > > > - > > > > >> > > > > > > > >> > > SERVER[ > > > > >> > > > > > > > >> > > > >> hadoop03.housing.com] USER[-] GROUP[-] > > > > TOKEN[-] > > > > >> > > APP[-] > > > > >> > > > > > > > >> > > > >> > JOB[0000040-151015123257993-oozie-oozi-W] > > > > >> > > > > > > > >> > > > >> > > > > ACTION[0000040-151015123257993-oozie-oozi-W@end > > > > >> ] > > > > >> > No > > > > >> > > > > > > > Notification > > > > >> > > > > > > > >> > URL > > > > >> > > > > > > > >> > > is > > > > >> > > > > > > > >> > > > >> defined. Therefore nothing to notify for > > job > > > > >> > > > > > > > >> > > > >> 0000040-151015123257993-oozie-oozi-W@end > > > > >> > > > > > > > >> > > > >> 2015-10-29 16:39:25,522 INFO > > > > >> > > > > > > WorkflowNotificationXCommand:520 > > > > >> > > > > > > > - > > > > >> > > > > > > > >> > > SERVER[ > > > > >> > > > > > > > >> > > > >> hadoop03.housing.com] USER[-] GROUP[-] > > > > TOKEN[-] > > > > >> > > APP[-] > > > > >> > > > > > > > >> > > > >> > JOB[0000040-151015123257993-oozie-oozi-W] > > > > >> ACTION[] > > > > >> > No > > > > >> > > > > > > > >> Notification > > > > >> > > > > > > > >> > URL > > > > >> > > > > > > > >> > > > is > > > > >> > > > > > > > >> > > > >> defined. Therefore nothing to notify for > > job > > > > >> > > > > > > > >> > > > >> 0000040-151015123257993-oozie-oozi-W > > > > >> > > > > > > > >> > > > >> 2015-10-29 16:39:25,522 INFO > > > > >> > > > > > > WorkflowNotificationXCommand:520 > > > > >> > > > > > > > - > > > > >> > > > > > > > >> > > SERVER[ > > > > >> > > > > > > > >> > > > >> hadoop03.housing.com] USER[-] GROUP[-] > > > > TOKEN[-] > > > > >> > > APP[-] > > > > >> > > > > > > > >> > > > >> > JOB[0000040-151015123257993-oozie-oozi-W] > > > > >> > > > > > > > >> > > > >> > > > > >> > ACTION[0000040-151015123257993-oozie-oozi-W@java-node > > > > >> > > ] > > > > >> > > > > No > > > > >> > > > > > > > >> > > Notification > > > > >> > > > > > > > >> > > > >> URL is defined. Therefore nothing to > > notify > > > > for > > > > >> job > > > > >> > > > > > > > >> > > > >> > > > 0000040-151015123257993-oozie-oozi-W@java-node > > > > >> > > > > > > > >> > > > >> > > > > >> > > > > > > > >> > > > > > > > > >> > > > > > > > >> > > > > > > > > >> > > > > > > > >> > > > > > > > >> > > > > > > > >> > > > > > > >> > > > > > > > >> > > -- > > > > >> > > > > > > > >> > > > > > > >> > > > > _____________________________________________________________ > > > > >> > > > > > > > >> > > The information contained in this > communication > > > is > > > > >> > > intended > > > > >> > > > > > solely > > > > >> > > > > > > > for > > > > >> > > > > > > > >> > the > > > > >> > > > > > > > >> > > use of the individual or entity to whom it is > > > > >> addressed > > > > >> > > and > > > > >> > > > > > others > > > > >> > > > > > > > >> > > authorized to receive it. It may contain > > > > >> confidential or > > > > >> > > > > legally > > > > >> > > > > > > > >> > privileged > > > > >> > > > > > > > >> > > information. If you are not the intended > > > recipient > > > > >> you > > > > >> > are > > > > >> > > > > > hereby > > > > >> > > > > > > > >> > notified > > > > >> > > > > > > > >> > > that any disclosure, copying, distribution or > > > > taking > > > > >> any > > > > >> > > > > action > > > > >> > > > > > in > > > > >> > > > > > > > >> > reliance > > > > >> > > > > > > > >> > > on the contents of this information is > strictly > > > > >> > prohibited > > > > >> > > > and > > > > >> > > > > > may > > > > >> > > > > > > > be > > > > >> > > > > > > > >> > > unlawful. If you have received this > > communication > > > > in > > > > >> > > error, > > > > >> > > > > > please > > > > >> > > > > > > > >> notify > > > > >> > > > > > > > >> > > us immediately by responding to this email > and > > > then > > > > >> > delete > > > > >> > > > it > > > > >> > > > > > from > > > > >> > > > > > > > >> your > > > > >> > > > > > > > >> > > system. The firm is neither liable for the > > proper > > > > and > > > > >> > > > complete > > > > >> > > > > > > > >> > transmission > > > > >> > > > > > > > >> > > of the information contained in this > > > communication > > > > >> nor > > > > >> > for > > > > >> > > > any > > > > >> > > > > > > delay > > > > >> > > > > > > > >> in > > > > >> > > > > > > > >> > its > > > > >> > > > > > > > >> > > receipt. > > > > >> > > > > > > > >> > > > > > > >> > > > > > > > >> > > > > > >> > > > > > > > >> > > > > >> > > > > > > > >> -- > > > > >> > > > > > > > >> > > > > >> > _____________________________________________________________ > > > > >> > > > > > > > >> The information contained in this communication > is > > > > >> intended > > > > >> > > > solely > > > > >> > > > > > for > > > > >> > > > > > > > the > > > > >> > > > > > > > >> use of the individual or entity to whom it is > > > addressed > > > > >> and > > > > >> > > > others > > > > >> > > > > > > > >> authorized to receive it. It may contain > > confidential > > > > or > > > > >> > > legally > > > > >> > > > > > > > >> privileged > > > > >> > > > > > > > >> information. If you are not the intended > recipient > > > you > > > > >> are > > > > >> > > > hereby > > > > >> > > > > > > > notified > > > > >> > > > > > > > >> that any disclosure, copying, distribution or > > taking > > > > any > > > > >> > > action > > > > >> > > > in > > > > >> > > > > > > > >> reliance > > > > >> > > > > > > > >> on the contents of this information is strictly > > > > >> prohibited > > > > >> > and > > > > >> > > > may > > > > >> > > > > > be > > > > >> > > > > > > > >> unlawful. If you have received this communication > > in > > > > >> error, > > > > >> > > > please > > > > >> > > > > > > > notify > > > > >> > > > > > > > >> us immediately by responding to this email and > then > > > > >> delete > > > > >> > it > > > > >> > > > from > > > > >> > > > > > > your > > > > >> > > > > > > > >> system. The firm is neither liable for the proper > > and > > > > >> > complete > > > > >> > > > > > > > >> transmission > > > > >> > > > > > > > >> of the information contained in this > communication > > > nor > > > > >> for > > > > >> > any > > > > >> > > > > delay > > > > >> > > > > > > in > > > > >> > > > > > > > >> its > > > > >> > > > > > > > >> receipt. > > > > >> > > > > > > > >> > > > > >> > > > > > > > > > > > > >> > > > > > > > > > > > > >> > > > > > > > > > > > >> > > > > > > > > > > >> > > > > > > -- > > > > >> > > > > > > > > > > _____________________________________________________________ > > > > >> > > > > > > The information contained in this communication is > > > intended > > > > >> > solely > > > > >> > > > for > > > > >> > > > > > the > > > > >> > > > > > > use of the individual or entity to whom it is > addressed > > > and > > > > >> > others > > > > >> > > > > > > authorized to receive it. It may contain confidential > or > > > > >> legally > > > > >> > > > > > privileged > > > > >> > > > > > > information. If you are not the intended recipient you > > are > > > > >> hereby > > > > >> > > > > > notified > > > > >> > > > > > > that any disclosure, copying, distribution or taking > any > > > > >> action > > > > >> > in > > > > >> > > > > > reliance > > > > >> > > > > > > on the contents of this information is strictly > > prohibited > > > > and > > > > >> > may > > > > >> > > be > > > > >> > > > > > > unlawful. If you have received this communication in > > > error, > > > > >> > please > > > > >> > > > > notify > > > > >> > > > > > > us immediately by responding to this email and then > > delete > > > > it > > > > >> > from > > > > >> > > > your > > > > >> > > > > > > system. The firm is neither liable for the proper and > > > > complete > > > > >> > > > > > transmission > > > > >> > > > > > > of the information contained in this communication nor > > for > > > > any > > > > >> > > delay > > > > >> > > > in > > > > >> > > > > > its > > > > >> > > > > > > receipt. > > > > >> > > > > > > > > > > >> > > > > > > > > > >> > > > > > > > > >> > > > > > > > >> > > > -- > > > > >> > > > > _____________________________________________________________ > > > > >> > > > The information contained in this communication is intended > > > solely > > > > >> for > > > > >> > > the > > > > >> > > > use of the individual or entity to whom it is addressed and > > > others > > > > >> > > > authorized to receive it. It may contain confidential or > > legally > > > > >> > > privileged > > > > >> > > > information. If you are not the intended recipient you are > > > hereby > > > > >> > > notified > > > > >> > > > that any disclosure, copying, distribution or taking any > > action > > > in > > > > >> > > reliance > > > > >> > > > on the contents of this information is strictly prohibited > and > > > may > > > > >> be > > > > >> > > > unlawful. If you have received this communication in error, > > > please > > > > >> > notify > > > > >> > > > us immediately by responding to this email and then delete > it > > > from > > > > >> your > > > > >> > > > system. The firm is neither liable for the proper and > complete > > > > >> > > transmission > > > > >> > > > of the information contained in this communication nor for > any > > > > >> delay in > > > > >> > > its > > > > >> > > > receipt. > > > > >> > > > > > > > >> > > > > > > >> > > > > > >> > -- > > > > >> > _____________________________________________________________ > > > > >> > The information contained in this communication is intended > solely > > > for > > > > >> the > > > > >> > use of the individual or entity to whom it is addressed and > others > > > > >> > authorized to receive it. It may contain confidential or legally > > > > >> privileged > > > > >> > information. If you are not the intended recipient you are > hereby > > > > >> notified > > > > >> > that any disclosure, copying, distribution or taking any action > in > > > > >> reliance > > > > >> > on the contents of this information is strictly prohibited and > may > > > be > > > > >> > unlawful. If you have received this communication in error, > please > > > > >> notify > > > > >> > us immediately by responding to this email and then delete it > from > > > > your > > > > >> > system. The firm is neither liable for the proper and complete > > > > >> transmission > > > > >> > of the information contained in this communication nor for any > > delay > > > > in > > > > >> its > > > > >> > receipt. > > > > >> > > > > > >> > > > > > > > > > > > > > > > > > > > > > -- > _____________________________________________________________ > The information contained in this communication is intended solely for the > use of the individual or entity to whom it is addressed and others > authorized to receive it. It may contain confidential or legally privileged > information. If you are not the intended recipient you are hereby notified > that any disclosure, copying, distribution or taking any action in reliance > on the contents of this information is strictly prohibited and may be > unlawful. If you have received this communication in error, please notify > us immediately by responding to this email and then delete it from your > system. The firm is neither liable for the proper and complete transmission > of the information contained in this communication nor for any delay in its > receipt. >
