Hi Jaydeep here also I cant see any error below are the logs
Log Type: syslog
Log Upload Time: Wed Nov 04 14:59:29 +0530 2015
Log Length: 25565
2015-11-04 14:59:11,814 INFO [main]
org.apache.hadoop.mapreduce.v2.app.MRAppMaster: Created MRAppMaster
for application appattempt_1446620926630_0017_000001
2015-11-04 14:59:12,144 WARN [main]
org.apache.hadoop.util.NativeCodeLoader: Unable to load native-hadoop
library for your platform... using builtin-java classes where
applicable
2015-11-04 14:59:12,184 INFO [main]
org.apache.hadoop.mapreduce.v2.app.MRAppMaster: Executing with tokens:
2015-11-04 14:59:12,292 INFO [main]
org.apache.hadoop.mapreduce.v2.app.MRAppMaster: Kind:
YARN_AM_RM_TOKEN, Service: , Ident: (appAttemptId { application_id {
id: 17 cluster_timestamp: 1446620926630 } attemptId: 1 } keyId:
-173762614)
2015-11-04 14:59:12,293 INFO [main]
org.apache.hadoop.mapreduce.v2.app.MRAppMaster: Kind:
RM_DELEGATION_TOKEN, Service: 10.21.1.136:8050, Ident: (owner=hdfs,
renewer=oozie mr token, realUser=oozie, issueDate=1446629349951,
maxDate=1447234149951, sequenceNumber=26, masterKeyId=6)
2015-11-04 14:59:12,890 WARN [main]
org.apache.hadoop.hdfs.shortcircuit.DomainSocketFactory: The
short-circuit local reads feature cannot be used because libhadoop
cannot be loaded.
2015-11-04 14:59:13,064 INFO [main]
org.apache.hadoop.mapreduce.v2.app.MRAppMaster: OutputCommitter set in
config null
2015-11-04 14:59:13,065 INFO [main]
org.apache.hadoop.mapreduce.v2.app.MRAppMaster: OutputCommitter is
org.apache.hadoop.mapred.FileOutputCommitter
2015-11-04 14:59:13,110 INFO [main]
org.apache.hadoop.yarn.event.AsyncDispatcher: Registering class
org.apache.hadoop.mapreduce.jobhistory.EventType for class
org.apache.hadoop.mapreduce.jobhistory.JobHistoryEventHandler
2015-11-04 14:59:13,110 INFO [main]
org.apache.hadoop.yarn.event.AsyncDispatcher: Registering class
org.apache.hadoop.mapreduce.v2.app.job.event.JobEventType for class
org.apache.hadoop.mapreduce.v2.app.MRAppMaster$JobEventDispatcher
2015-11-04 14:59:13,111 INFO [main]
org.apache.hadoop.yarn.event.AsyncDispatcher: Registering class
org.apache.hadoop.mapreduce.v2.app.job.event.TaskEventType for class
org.apache.hadoop.mapreduce.v2.app.MRAppMaster$TaskEventDispatcher
2015-11-04 14:59:13,111 INFO [main]
org.apache.hadoop.yarn.event.AsyncDispatcher: Registering class
org.apache.hadoop.mapreduce.v2.app.job.event.TaskAttemptEventType for
class org.apache.hadoop.mapreduce.v2.app.MRAppMaster$TaskAttemptEventDispatcher
2015-11-04 14:59:13,112 INFO [main]
org.apache.hadoop.yarn.event.AsyncDispatcher: Registering class
org.apache.hadoop.mapreduce.v2.app.commit.CommitterEventType for class
org.apache.hadoop.mapreduce.v2.app.commit.CommitterEventHandler
2015-11-04 14:59:13,112 INFO [main]
org.apache.hadoop.yarn.event.AsyncDispatcher: Registering class
org.apache.hadoop.mapreduce.v2.app.speculate.Speculator$EventType for
class org.apache.hadoop.mapreduce.v2.app.MRAppMaster$SpeculatorEventDispatcher
2015-11-04 14:59:13,113 INFO [main]
org.apache.hadoop.yarn.event.AsyncDispatcher: Registering class
org.apache.hadoop.mapreduce.v2.app.rm.ContainerAllocator$EventType for
class org.apache.hadoop.mapreduce.v2.app.MRAppMaster$ContainerAllocatorRouter
2015-11-04 14:59:13,113 INFO [main]
org.apache.hadoop.yarn.event.AsyncDispatcher: Registering class
org.apache.hadoop.mapreduce.v2.app.launcher.ContainerLauncher$EventType
for class org.apache.hadoop.mapreduce.v2.app.MRAppMaster$ContainerLauncherRouter
2015-11-04 14:59:13,144 INFO [main]
org.apache.hadoop.mapreduce.v2.jobhistory.JobHistoryUtils: Default
file system is set solely by core-default.xml therefore - ignoring
2015-11-04 14:59:13,170 INFO [main]
org.apache.hadoop.mapreduce.v2.jobhistory.JobHistoryUtils: Default
file system is set solely by core-default.xml therefore - ignoring
2015-11-04 14:59:13,189 INFO [main]
org.apache.hadoop.mapreduce.v2.jobhistory.JobHistoryUtils: Default
file system is set solely by core-default.xml therefore - ignoring
2015-11-04 14:59:13,219 INFO [main]
org.apache.hadoop.mapreduce.jobhistory.JobHistoryEventHandler:
Emitting job history data to the timeline server is not enabled
2015-11-04 14:59:13,255 INFO [main]
org.apache.hadoop.yarn.event.AsyncDispatcher: Registering class
org.apache.hadoop.mapreduce.v2.app.job.event.JobFinishEvent$Type for
class org.apache.hadoop.mapreduce.v2.app.MRAppMaster$JobFinishEventHandler
2015-11-04 14:59:13,453 WARN [main]
org.apache.hadoop.metrics2.impl.MetricsConfig: Cannot locate
configuration: tried
hadoop-metrics2-mrappmaster.properties,hadoop-metrics2.properties
2015-11-04 14:59:13,546 INFO [main]
org.apache.hadoop.metrics2.impl.MetricsSystemImpl: Scheduled snapshot
period at 10 second(s).
2015-11-04 14:59:13,546 INFO [main]
org.apache.hadoop.metrics2.impl.MetricsSystemImpl: MRAppMaster metrics
system started
2015-11-04 14:59:13,557 INFO [main]
org.apache.hadoop.mapreduce.v2.app.job.impl.JobImpl: Adding job token
for job_1446620926630_0017 to jobTokenSecretManager
2015-11-04 14:59:13,680 INFO [main]
org.apache.hadoop.mapreduce.v2.app.job.impl.JobImpl: Not uberizing
job_1446620926630_0017 because: not enabled; too much RAM;
2015-11-04 14:59:13,701 INFO [main]
org.apache.hadoop.mapreduce.v2.app.job.impl.JobImpl: Input size for
job job_1446620926630_0017 = 0. Number of splits = 1
2015-11-04 14:59:13,701 INFO [main]
org.apache.hadoop.mapreduce.v2.app.job.impl.JobImpl: Number of reduces
for job job_1446620926630_0017 = 0
2015-11-04 14:59:13,701 INFO [main]
org.apache.hadoop.mapreduce.v2.app.job.impl.JobImpl:
job_1446620926630_0017Job Transitioned from NEW to INITED
2015-11-04 14:59:13,702 INFO [main]
org.apache.hadoop.mapreduce.v2.app.MRAppMaster: MRAppMaster launching
normal, non-uberized, multi-container job job_1446620926630_0017.
2015-11-04 14:59:13,725 INFO [main]
org.apache.hadoop.ipc.CallQueueManager: Using callQueue class
java.util.concurrent.LinkedBlockingQueue
2015-11-04 14:59:13,736 INFO [Socket Reader #1 for port 39640]
org.apache.hadoop.ipc.Server: Starting Socket Reader #1 for port 39640
2015-11-04 14:59:13,758 INFO [main]
org.apache.hadoop.yarn.factories.impl.pb.RpcServerFactoryPBImpl:
Adding protocol org.apache.hadoop.mapreduce.v2.api.MRClientProtocolPB
to the server
2015-11-04 14:59:13,759 INFO [IPC Server Responder]
org.apache.hadoop.ipc.Server: IPC Server Responder: starting
2015-11-04 14:59:13,761 INFO [IPC Server listener on 39640]
org.apache.hadoop.ipc.Server: IPC Server listener on 39640: starting
2015-11-04 14:59:13,762 INFO [main]
org.apache.hadoop.mapreduce.v2.app.client.MRClientService:
Instantiated MRClientService at hadoop04.housing.com/10.21.1.138:39640
2015-11-04 14:59:13,853 INFO [main] org.mortbay.log: Logging to
org.slf4j.impl.Log4jLoggerAdapter(org.mortbay.log) via
org.mortbay.log.Slf4jLog
2015-11-04 14:59:13,862 INFO [main]
org.apache.hadoop.security.authentication.server.AuthenticationFilter:
Unable to initialize FileSignerSecretProvider, falling back to use
random secrets.
2015-11-04 14:59:13,867 WARN [main]
org.apache.hadoop.http.HttpRequestLog: Jetty request log can only be
enabled using Log4j
2015-11-04 14:59:13,874 INFO [main]
org.apache.hadoop.http.HttpServer2: Added global filter 'safety'
(class=org.apache.hadoop.http.HttpServer2$QuotingInputFilter)
2015-11-04 14:59:13,878 INFO [main]
org.apache.hadoop.http.HttpServer2: Added filter AM_PROXY_FILTER
(class=org.apache.hadoop.yarn.server.webproxy.amfilter.AmIpFilter) to
context mapreduce
2015-11-04 14:59:13,879 INFO [main]
org.apache.hadoop.http.HttpServer2: Added filter AM_PROXY_FILTER
(class=org.apache.hadoop.yarn.server.webproxy.amfilter.AmIpFilter) to
context static
2015-11-04 14:59:13,882 INFO [main]
org.apache.hadoop.http.HttpServer2: adding path spec: /mapreduce/*
2015-11-04 14:59:13,882 INFO [main]
org.apache.hadoop.http.HttpServer2: adding path spec: /ws/*
2015-11-04 14:59:14,217 INFO [main]
org.apache.hadoop.yarn.webapp.WebApps: Registered webapp guice modules
2015-11-04 14:59:14,218 INFO [main]
org.apache.hadoop.http.HttpServer2: Jetty bound to port 49791
2015-11-04 14:59:14,219 INFO [main] org.mortbay.log: jetty-6.1.26.hwx
2015-11-04 14:59:14,260 INFO [main] org.mortbay.log: Extract
jar:file:/hadoop/yarn/local/filecache/10/mapreduce.tar.gz/hadoop/share/hadoop/yarn/hadoop-yarn-common-2.7.1.2.3.2.0-2950.jar!/webapps/mapreduce
to ./tmp/Jetty_0_0_0_0_49791_mapreduce____.kdgzqp/webapp
2015-11-04 14:59:15,952 INFO [main] org.mortbay.log: Started
[email protected]:49791
2015-11-04 14:59:15,952 INFO [main]
org.apache.hadoop.yarn.webapp.WebApps: Web app /mapreduce started at
49791
2015-11-04 14:59:15,957 INFO [main]
org.apache.hadoop.ipc.CallQueueManager: Using callQueue class
java.util.concurrent.LinkedBlockingQueue
2015-11-04 14:59:15,957 INFO [Socket Reader #1 for port 50432]
org.apache.hadoop.ipc.Server: Starting Socket Reader #1 for port 50432
2015-11-04 14:59:15,963 INFO [IPC Server Responder]
org.apache.hadoop.ipc.Server: IPC Server Responder: starting
2015-11-04 14:59:15,963 INFO [IPC Server listener on 50432]
org.apache.hadoop.ipc.Server: IPC Server listener on 50432: starting
2015-11-04 14:59:15,988 INFO [main]
org.apache.hadoop.mapreduce.v2.app.rm.RMContainerRequestor:
nodeBlacklistingEnabled:true
2015-11-04 14:59:15,988 INFO [main]
org.apache.hadoop.mapreduce.v2.app.rm.RMContainerRequestor:
maxTaskFailuresPerNode is 3
2015-11-04 14:59:15,988 INFO [main]
org.apache.hadoop.mapreduce.v2.app.rm.RMContainerRequestor:
blacklistDisablePercent is 33
2015-11-04 14:59:16,035 INFO [main]
org.apache.hadoop.yarn.client.RMProxy: Connecting to ResourceManager
at hadoop02.housing.com/10.21.1.136:8030
2015-11-04 14:59:16,113 INFO [main]
org.apache.hadoop.mapreduce.v2.app.rm.RMCommunicator:
maxContainerCapability: <memory:5120, vCores:3>
2015-11-04 14:59:16,113 INFO [main]
org.apache.hadoop.mapreduce.v2.app.rm.RMCommunicator: queue: default
2015-11-04 14:59:16,117 INFO [main]
org.apache.hadoop.mapreduce.v2.app.launcher.ContainerLauncherImpl:
Upper limit on the thread pool size is 500
2015-11-04 14:59:16,118 INFO [main]
org.apache.hadoop.mapreduce.v2.app.launcher.ContainerLauncherImpl: The
thread pool initial size is 10
2015-11-04 14:59:16,120 INFO [main]
org.apache.hadoop.yarn.client.api.impl.ContainerManagementProtocolProxy:
yarn.client.max-cached-nodemanagers-proxies : 0
2015-11-04 14:59:16,127 INFO [AsyncDispatcher event handler]
org.apache.hadoop.mapreduce.v2.app.job.impl.JobImpl:
job_1446620926630_0017Job Transitioned from INITED to SETUP
2015-11-04 14:59:16,157 INFO [CommitterEvent Processor #0]
org.apache.hadoop.mapreduce.v2.app.commit.CommitterEventHandler:
Processing the event EventType: JOB_SETUP
2015-11-04 14:59:16,160 INFO [CommitterEvent Processor #0]
org.apache.hadoop.mapreduce.lib.output.FileOutputCommitter: File
Output Committer Algorithm version is 1
2015-11-04 14:59:16,173 INFO [AsyncDispatcher event handler]
org.apache.hadoop.mapreduce.v2.app.job.impl.JobImpl:
job_1446620926630_0017Job Transitioned from SETUP to RUNNING
2015-11-04 14:59:16,194 INFO [AsyncDispatcher event handler]
org.apache.hadoop.mapreduce.v2.app.job.impl.TaskImpl:
task_1446620926630_0017_m_000000 Task Transitioned from NEW to
SCHEDULED
2015-11-04 14:59:16,195 INFO [AsyncDispatcher event handler]
org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl:
attempt_1446620926630_0017_m_000000_0 TaskAttempt Transitioned from
NEW to UNASSIGNED
2015-11-04 14:59:16,202 INFO [Thread-51]
org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator:
mapResourceRequest:<memory:1536, vCores:1>
2015-11-04 14:59:16,252 INFO [eventHandlingThread]
org.apache.hadoop.mapreduce.jobhistory.JobHistoryEventHandler: Event
Writer setup for JobId: job_1446620926630_0017, File:
hdfs://hadoop01.housing.com:8020/user/hdfs/.staging/job_1446620926630_0017/job_1446620926630_0017_1.jhist
2015-11-04 14:59:17,117 INFO [RMCommunicator Allocator]
org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator: Before
Scheduling: PendingReds:0 ScheduledMaps:1 ScheduledReds:0
AssignedMaps:0 AssignedReds:0 CompletedMaps:0 CompletedReds:0
ContAlloc:0 ContRel:0 HostLocal:0 RackLocal:0
2015-11-04 14:59:17,154 INFO [RMCommunicator Allocator]
org.apache.hadoop.mapreduce.v2.app.rm.RMContainerRequestor:
getResources() for application_1446620926630_0017: ask=1 release= 0
newContainers=0 finishedContainers=0 resourcelimit=<memory:19840,
vCores:1> knownNMs=5
2015-11-04 14:59:18,171 INFO [RMCommunicator Allocator]
org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator: Got
allocated containers 1
2015-11-04 14:59:18,198 INFO [RMCommunicator Allocator]
org.apache.hadoop.yarn.util.RackResolver: Resolved
hadoop04.housing.com to /default-rack
2015-11-04 14:59:18,201 INFO [RMCommunicator Allocator]
org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator: Assigned
container container_e02_1446620926630_0017_01_000002 to
attempt_1446620926630_0017_m_000000_0
2015-11-04 14:59:18,202 INFO [RMCommunicator Allocator]
org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator: After
Scheduling: PendingReds:0 ScheduledMaps:0 ScheduledReds:0
AssignedMaps:1 AssignedReds:0 CompletedMaps:0 CompletedReds:0
ContAlloc:1 ContRel:0 HostLocal:0 RackLocal:0
2015-11-04 14:59:18,245 INFO [AsyncDispatcher event handler]
org.apache.hadoop.yarn.util.RackResolver: Resolved
hadoop04.housing.com to /default-rack
2015-11-04 14:59:18,245 INFO [AsyncDispatcher event handler]
org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl: Job jar
is not present. Not adding any jar to the list of resources.
2015-11-04 14:59:18,263 INFO [AsyncDispatcher event handler]
org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl: The
job-conf file on the remote FS is
/user/hdfs/.staging/job_1446620926630_0017/job.xml
2015-11-04 14:59:18,290 INFO [AsyncDispatcher event handler]
org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl: Adding #1
tokens and #1 secret keys for NM use for launching container
2015-11-04 14:59:18,290 INFO [AsyncDispatcher event handler]
org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl: Size of
containertokens_dob is 2
2015-11-04 14:59:18,291 INFO [AsyncDispatcher event handler]
org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl: Putting
shuffle token in serviceData
2015-11-04 14:59:18,359 INFO [AsyncDispatcher event handler]
org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl:
attempt_1446620926630_0017_m_000000_0 TaskAttempt Transitioned from
UNASSIGNED to ASSIGNED
2015-11-04 14:59:18,363 INFO [ContainerLauncher #0]
org.apache.hadoop.mapreduce.v2.app.launcher.ContainerLauncherImpl:
Processing the event EventType: CONTAINER_REMOTE_LAUNCH for container
container_e02_1446620926630_0017_01_000002 taskAttempt
attempt_1446620926630_0017_m_000000_0
2015-11-04 14:59:18,364 INFO [ContainerLauncher #0]
org.apache.hadoop.mapreduce.v2.app.launcher.ContainerLauncherImpl:
Launching attempt_1446620926630_0017_m_000000_0
2015-11-04 14:59:18,365 INFO [ContainerLauncher #0]
org.apache.hadoop.yarn.client.api.impl.ContainerManagementProtocolProxy:
Opening proxy : hadoop04.housing.com:45454
2015-11-04 14:59:18,435 INFO [ContainerLauncher #0]
org.apache.hadoop.mapreduce.v2.app.launcher.ContainerLauncherImpl:
Shuffle port returned by ContainerManager for
attempt_1446620926630_0017_m_000000_0 : 13562
2015-11-04 14:59:18,437 INFO [AsyncDispatcher event handler]
org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl:
TaskAttempt: [attempt_1446620926630_0017_m_000000_0] using
containerId: [container_e02_1446620926630_0017_01_000002 on NM:
[hadoop04.housing.com:45454]
2015-11-04 14:59:18,439 INFO [AsyncDispatcher event handler]
org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl:
attempt_1446620926630_0017_m_000000_0 TaskAttempt Transitioned from
ASSIGNED to RUNNING
2015-11-04 14:59:18,440 INFO [AsyncDispatcher event handler]
org.apache.hadoop.mapreduce.v2.app.job.impl.TaskImpl:
task_1446620926630_0017_m_000000 Task Transitioned from SCHEDULED to
RUNNING
2015-11-04 14:59:19,213 INFO [RMCommunicator Allocator]
org.apache.hadoop.mapreduce.v2.app.rm.RMContainerRequestor:
getResources() for application_1446620926630_0017: ask=1 release= 0
newContainers=0 finishedContainers=0 resourcelimit=<memory:17920,
vCores:1> knownNMs=5
2015-11-04 14:59:20,114 INFO [Socket Reader #1 for port 50432]
SecurityLogger.org.apache.hadoop.ipc.Server: Auth successful for
job_1446620926630_0017 (auth:SIMPLE)
2015-11-04 14:59:20,138 INFO [IPC Server handler 3 on 50432]
org.apache.hadoop.mapred.TaskAttemptListenerImpl: JVM with ID :
jvm_1446620926630_0017_m_2199023255554 asked for a task
2015-11-04 14:59:20,139 INFO [IPC Server handler 3 on 50432]
org.apache.hadoop.mapred.TaskAttemptListenerImpl: JVM with ID:
jvm_1446620926630_0017_m_2199023255554 given task:
attempt_1446620926630_0017_m_000000_0
2015-11-04 14:59:22,549 INFO [IPC Server handler 2 on 50432]
org.apache.hadoop.mapred.TaskAttemptListenerImpl: Progress of
TaskAttempt attempt_1446620926630_0017_m_000000_0 is : 0.0
2015-11-04 14:59:22,589 INFO [IPC Server handler 1 on 50432]
org.apache.hadoop.mapred.TaskAttemptListenerImpl: Commit-pending state
update from attempt_1446620926630_0017_m_000000_0
2015-11-04 14:59:22,590 INFO [AsyncDispatcher event handler]
org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl:
attempt_1446620926630_0017_m_000000_0 TaskAttempt Transitioned from
RUNNING to COMMIT_PENDING
2015-11-04 14:59:22,591 INFO [AsyncDispatcher event handler]
org.apache.hadoop.mapreduce.v2.app.job.impl.TaskImpl:
attempt_1446620926630_0017_m_000000_0 given a go for committing the
task output.
2015-11-04 14:59:22,597 INFO [IPC Server handler 0 on 50432]
org.apache.hadoop.mapred.TaskAttemptListenerImpl: Commit go/no-go
request from attempt_1446620926630_0017_m_000000_0
2015-11-04 14:59:22,598 INFO [IPC Server handler 0 on 50432]
org.apache.hadoop.mapreduce.v2.app.job.impl.TaskImpl: Result of
canCommit for attempt_1446620926630_0017_m_000000_0:true
2015-11-04 14:59:22,635 INFO [IPC Server handler 4 on 50432]
org.apache.hadoop.mapred.TaskAttemptListenerImpl: Progress of
TaskAttempt attempt_1446620926630_0017_m_000000_0 is : 1.0
2015-11-04 14:59:22,643 INFO [IPC Server handler 16 on 50432]
org.apache.hadoop.mapred.TaskAttemptListenerImpl: Done acknowledgement
from attempt_1446620926630_0017_m_000000_0
2015-11-04 14:59:22,645 INFO [AsyncDispatcher event handler]
org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl:
attempt_1446620926630_0017_m_000000_0 TaskAttempt Transitioned from
COMMIT_PENDING to SUCCESS_CONTAINER_CLEANUP
2015-11-04 14:59:22,647 INFO [ContainerLauncher #1]
org.apache.hadoop.mapreduce.v2.app.launcher.ContainerLauncherImpl:
Processing the event EventType: CONTAINER_REMOTE_CLEANUP for container
container_e02_1446620926630_0017_01_000002 taskAttempt
attempt_1446620926630_0017_m_000000_0
2015-11-04 14:59:22,648 INFO [ContainerLauncher #1]
org.apache.hadoop.mapreduce.v2.app.launcher.ContainerLauncherImpl:
KILLING attempt_1446620926630_0017_m_000000_0
2015-11-04 14:59:22,648 INFO [ContainerLauncher #1]
org.apache.hadoop.yarn.client.api.impl.ContainerManagementProtocolProxy:
Opening proxy : hadoop04.housing.com:45454
2015-11-04 14:59:22,675 INFO [AsyncDispatcher event handler]
org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl:
attempt_1446620926630_0017_m_000000_0 TaskAttempt Transitioned from
SUCCESS_CONTAINER_CLEANUP to SUCCEEDED
2015-11-04 14:59:22,683 INFO [AsyncDispatcher event handler]
org.apache.hadoop.mapreduce.v2.app.job.impl.TaskImpl: Task succeeded
with attempt attempt_1446620926630_0017_m_000000_0
2015-11-04 14:59:22,683 INFO [AsyncDispatcher event handler]
org.apache.hadoop.mapreduce.v2.app.job.impl.TaskImpl:
task_1446620926630_0017_m_000000 Task Transitioned from RUNNING to
SUCCEEDED
2015-11-04 14:59:22,685 INFO [AsyncDispatcher event handler]
org.apache.hadoop.mapreduce.v2.app.job.impl.JobImpl: Num completed
Tasks: 1
2015-11-04 14:59:22,685 INFO [AsyncDispatcher event handler]
org.apache.hadoop.mapreduce.v2.app.job.impl.JobImpl:
job_1446620926630_0017Job Transitioned from RUNNING to COMMITTING
2015-11-04 14:59:22,697 INFO [CommitterEvent Processor #1]
org.apache.hadoop.mapreduce.v2.app.commit.CommitterEventHandler:
Processing the event EventType: JOB_COMMIT
2015-11-04 14:59:22,787 INFO [AsyncDispatcher event handler]
org.apache.hadoop.mapreduce.v2.app.job.impl.JobImpl: Calling handler
for JobFinishedEvent
2015-11-04 14:59:22,787 INFO [AsyncDispatcher event handler]
org.apache.hadoop.mapreduce.v2.app.job.impl.JobImpl:
job_1446620926630_0017Job Transitioned from COMMITTING to SUCCEEDED
2015-11-04 14:59:22,792 INFO [Thread-67]
org.apache.hadoop.mapreduce.v2.app.MRAppMaster: We are finishing
cleanly so this is the last retry
2015-11-04 14:59:22,792 INFO [Thread-67]
org.apache.hadoop.mapreduce.v2.app.MRAppMaster: Notify RMCommunicator
isAMLastRetry: true
2015-11-04 14:59:22,793 INFO [Thread-67]
org.apache.hadoop.mapreduce.v2.app.rm.RMCommunicator: RMCommunicator
notified that shouldUnregistered is: true
2015-11-04 14:59:22,793 INFO [Thread-67]
org.apache.hadoop.mapreduce.v2.app.MRAppMaster: Notify JHEH
isAMLastRetry: true
2015-11-04 14:59:22,793 INFO [Thread-67]
org.apache.hadoop.mapreduce.jobhistory.JobHistoryEventHandler:
JobHistoryEventHandler notified that forceJobCompletion is true
2015-11-04 14:59:22,793 INFO [Thread-67]
org.apache.hadoop.mapreduce.v2.app.MRAppMaster: Calling stop for all
the services
2015-11-04 14:59:22,793 INFO [Thread-67]
org.apache.hadoop.mapreduce.jobhistory.JobHistoryEventHandler:
Stopping JobHistoryEventHandler. Size of the outstanding queue size is
0
2015-11-04 14:59:22,845 INFO [eventHandlingThread]
org.apache.hadoop.mapreduce.jobhistory.JobHistoryEventHandler: Copying
hdfs://hadoop01.housing.com:8020/user/hdfs/.staging/job_1446620926630_0017/job_1446620926630_0017_1.jhist
to
hdfs://hadoop01.housing.com:8020/mr-history/tmp/hdfs/job_1446620926630_0017-1446629350323-hdfs-oozie%3Alauncher%3AT%3Djava%3AW%3Djava%2Dmain%2Dwf%3AA%3Djava%2Dnode%3AI-1446629362786-1-0-SUCCEEDED-default-1446629356124.jhist_tmp
2015-11-04 14:59:22,880 INFO [eventHandlingThread]
org.apache.hadoop.mapreduce.jobhistory.JobHistoryEventHandler: Copied
to done location:
hdfs://hadoop01.housing.com:8020/mr-history/tmp/hdfs/job_1446620926630_0017-1446629350323-hdfs-oozie%3Alauncher%3AT%3Djava%3AW%3Djava%2Dmain%2Dwf%3AA%3Djava%2Dnode%3AI-1446629362786-1-0-SUCCEEDED-default-1446629356124.jhist_tmp
2015-11-04 14:59:22,883 INFO [eventHandlingThread]
org.apache.hadoop.mapreduce.jobhistory.JobHistoryEventHandler: Copying
hdfs://hadoop01.housing.com:8020/user/hdfs/.staging/job_1446620926630_0017/job_1446620926630_0017_1_conf.xml
to
hdfs://hadoop01.housing.com:8020/mr-history/tmp/hdfs/job_1446620926630_0017_conf.xml_tmp
2015-11-04 14:59:22,956 INFO [eventHandlingThread]
org.apache.hadoop.mapreduce.jobhistory.JobHistoryEventHandler: Copied
to done location:
hdfs://hadoop01.housing.com:8020/mr-history/tmp/hdfs/job_1446620926630_0017_conf.xml_tmp
2015-11-04 14:59:22,960 INFO [eventHandlingThread]
org.apache.hadoop.mapreduce.jobhistory.JobHistoryEventHandler: Moved
tmp to done:
hdfs://hadoop01.housing.com:8020/mr-history/tmp/hdfs/job_1446620926630_0017.summary_tmp
to
hdfs://hadoop01.housing.com:8020/mr-history/tmp/hdfs/job_1446620926630_0017.summary
2015-11-04 14:59:22,962 INFO [eventHandlingThread]
org.apache.hadoop.mapreduce.jobhistory.JobHistoryEventHandler: Moved
tmp to done:
hdfs://hadoop01.housing.com:8020/mr-history/tmp/hdfs/job_1446620926630_0017_conf.xml_tmp
to
hdfs://hadoop01.housing.com:8020/mr-history/tmp/hdfs/job_1446620926630_0017_conf.xml
2015-11-04 14:59:22,964 INFO [eventHandlingThread]
org.apache.hadoop.mapreduce.jobhistory.JobHistoryEventHandler: Moved
tmp to done:
hdfs://hadoop01.housing.com:8020/mr-history/tmp/hdfs/job_1446620926630_0017-1446629350323-hdfs-oozie%3Alauncher%3AT%3Djava%3AW%3Djava%2Dmain%2Dwf%3AA%3Djava%2Dnode%3AI-1446629362786-1-0-SUCCEEDED-default-1446629356124.jhist_tmp
to
hdfs://hadoop01.housing.com:8020/mr-history/tmp/hdfs/job_1446620926630_0017-1446629350323-hdfs-oozie%3Alauncher%3AT%3Djava%3AW%3Djava%2Dmain%2Dwf%3AA%3Djava%2Dnode%3AI-1446629362786-1-0-SUCCEEDED-default-1446629356124.jhist
2015-11-04 14:59:22,965 INFO [Thread-67]
org.apache.hadoop.mapreduce.jobhistory.JobHistoryEventHandler: Stopped
JobHistoryEventHandler. super.stop()
2015-11-04 14:59:22,968 INFO [Thread-67]
org.apache.hadoop.mapreduce.v2.app.rm.RMCommunicator: Setting job
diagnostics to
2015-11-04 14:59:22,969 INFO [Thread-67]
org.apache.hadoop.mapreduce.v2.app.rm.RMCommunicator: History url is
http://hadoop03.housing.com:19888/jobhistory/job/job_1446620926630_0017
2015-11-04 14:59:22,976 INFO [Thread-67]
org.apache.hadoop.mapreduce.v2.app.rm.RMCommunicator: Waiting for
application to be successfully unregistered.
2015-11-04 14:59:23,979 INFO [Thread-67]
org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator: Final
Stats: PendingReds:0 ScheduledMaps:0 ScheduledReds:0 AssignedMaps:1
AssignedReds:0 CompletedMaps:0 CompletedReds:0 ContAlloc:1 ContRel:0
HostLocal:0 RackLocal:0
2015-11-04 14:59:23,980 INFO [Thread-67]
org.apache.hadoop.mapreduce.v2.app.MRAppMaster: Deleting staging
directory hdfs://hadoop01.housing.com:8020
/user/hdfs/.staging/job_1446620926630_0017
2015-11-04 14:59:23,984 INFO [Thread-67] org.apache.hadoop.ipc.Server:
Stopping server on 50432
2015-11-04 14:59:23,985 INFO [IPC Server listener on 50432]
org.apache.hadoop.ipc.Server: Stopping IPC Server listener on 50432
2015-11-04 14:59:23,986 INFO [IPC Server Responder]
org.apache.hadoop.ipc.Server: Stopping IPC Server Responder
2015-11-04 14:59:23,986 INFO [TaskHeartbeatHandler PingChecker]
org.apache.hadoop.mapreduce.v2.app.TaskHeartbeatHandler:
TaskHeartbeatHandler thread interrupted
On Wed, Nov 4, 2015 at 6:38 PM, Jaydeep Vishwakarma <
[email protected]> wrote:
> In first look I am not seeing any issue with job tracker or name node URL.
> The job id is getting generated. Workflow Job is not going on PREP mode.
>
> Open this link.
> http://hadoop02.housing.com:8088/proxy/application_1446620926630_0014/
>
> You will be see the problem.
>
>
>
> On Wed, Nov 4, 2015 at 6:24 PM, Jeetendra G <[email protected]>
> wrote:
>
> > hey Serega I have cross verified jobTracker value is correct only I am
> > using yarn so resource manager will become the job tracker?
> >
> > On Wed, Nov 4, 2015 at 6:17 PM, Serega Sheypak <[email protected]
> >
> > wrote:
> >
> > > Can you go to oozie server and grab logs from there? My assumption that
> > > <job-tracker>${jobTracker}</job-tracker>
> > > <name-node>${nameNode}</name-node>
> > >
> > > have incorrect values. Probably ${jobTracker} is wrong and oozie can't
> > even
> > > start launcher mapper.
> > >
> > > 2015-11-04 13:43 GMT+01:00 Jaydeep Vishwakarma <
> > > [email protected]>:
> > >
> > > > You are doing -log. Can you give the command as below and get the job
> > url
> > > > (application launcher url).
> > > >
> > > > *oozie job -info 0000040-151015123257993-oozie-oozi-W@java-node*
> > > >
> > > >
> > > >
> > > > On Wed, Nov 4, 2015 at 5:53 PM, Jeetendra G <[email protected]
> >
> > > > wrote:
> > > >
> > > > > and in job error log tab its saying error log is disables? by
> default
> > > why
> > > > > error log is disables? i am using hortonworks
> > > > >
> > > > > On Wed, Nov 4, 2015 at 5:50 PM, Jeetendra G <
> [email protected]
> > >
> > > > > wrote:
> > > > >
> > > > > > same error.
> > > > > >
> > > > > > 2015-11-04 14:09:00,935 INFO ActionStartXCommand:520 - SERVER[
> > > > > > hadoop03.housing.com] USER[hdfs] GROUP[-] TOKEN[]
> > APP[java-main-wf]
> > > > > > JOB[0000004-151104124010010-oozie-oozi-W]
> > > > > > ACTION[0000004-151104124010010-oozie-oozi-W@:start:] Start
> action
> > > > > > [0000004-151104124010010-oozie-oozi-W@:start:] with user-retry
> > > state :
> > > > > > userRetryCount [0], userRetryMax [0], userRetryInterval [10]
> > > > > > 2015-11-04 14:09:00,940 INFO ActionStartXCommand:520 - SERVER[
> > > > > > hadoop03.housing.com] USER[hdfs] GROUP[-] TOKEN[]
> > APP[java-main-wf]
> > > > > > JOB[0000004-151104124010010-oozie-oozi-W]
> > > > > > ACTION[0000004-151104124010010-oozie-oozi-W@:start:]
> > > > > > [***0000004-151104124010010-oozie-oozi-W@:start:***]Action
> > > status=DONE
> > > > > > 2015-11-04 14:09:00,940 INFO ActionStartXCommand:520 - SERVER[
> > > > > > hadoop03.housing.com] USER[hdfs] GROUP[-] TOKEN[]
> > APP[java-main-wf]
> > > > > > JOB[0000004-151104124010010-oozie-oozi-W]
> > > > > > ACTION[0000004-151104124010010-oozie-oozi-W@:start:]
> > > > > > [***0000004-151104124010010-oozie-oozi-W@:start:***]Action
> updated
> > > in
> > > > > DB!
> > > > > > 2015-11-04 14:09:00,994 INFO WorkflowNotificationXCommand:520 -
> > > > SERVER[
> > > > > > hadoop03.housing.com] USER[-] GROUP[-] TOKEN[-] APP[-]
> > > > > > JOB[0000004-151104124010010-oozie-oozi-W]
> > > > > > ACTION[0000004-151104124010010-oozie-oozi-W@:start:] No
> > Notification
> > > > URL
> > > > > > is defined. Therefore nothing to notify for job
> > > > > > 0000004-151104124010010-oozie-oozi-W@:start:
> > > > > > 2015-11-04 14:09:01,004 INFO WorkflowNotificationXCommand:520 -
> > > > SERVER[
> > > > > > hadoop03.housing.com] USER[-] GROUP[-] TOKEN[-] APP[-]
> > > > > > JOB[0000004-151104124010010-oozie-oozi-W] ACTION[] No
> Notification
> > > URL
> > > > is
> > > > > > defined. Therefore nothing to notify for job
> > > > > > 0000004-151104124010010-oozie-oozi-W
> > > > > > 2015-11-04 14:09:01,014 INFO ActionStartXCommand:520 - SERVER[
> > > > > > hadoop03.housing.com] USER[hdfs] GROUP[-] TOKEN[]
> > APP[java-main-wf]
> > > > > > JOB[0000004-151104124010010-oozie-oozi-W]
> > > > > > ACTION[0000004-151104124010010-oozie-oozi-W@java-node] Start
> > action
> > > > > > [0000004-151104124010010-oozie-oozi-W@java-node] with user-retry
> > > > state :
> > > > > > userRetryCount [0], userRetryMax [0], userRetryInterval [10]
> > > > > > 2015-11-04 14:09:02,916 INFO JavaActionExecutor:520 - SERVER[
> > > > > > hadoop03.housing.com] USER[hdfs] GROUP[-] TOKEN[]
> > APP[java-main-wf]
> > > > > > JOB[0000004-151104124010010-oozie-oozi-W]
> > > > > > ACTION[0000004-151104124010010-oozie-oozi-W@java-node] checking
> > > > action,
> > > > > > hadoop job ID [job_1446620926630_0016] status [RUNNING]
> > > > > > 2015-11-04 14:09:02,918 INFO ActionStartXCommand:520 - SERVER[
> > > > > > hadoop03.housing.com] USER[hdfs] GROUP[-] TOKEN[]
> > APP[java-main-wf]
> > > > > > JOB[0000004-151104124010010-oozie-oozi-W]
> > > > > > ACTION[0000004-151104124010010-oozie-oozi-W@java-node]
> > > > > > [***0000004-151104124010010-oozie-oozi-W@java-node***]Action
> > > > > > status=RUNNING
> > > > > > 2015-11-04 14:09:02,918 INFO ActionStartXCommand:520 - SERVER[
> > > > > > hadoop03.housing.com] USER[hdfs] GROUP[-] TOKEN[]
> > APP[java-main-wf]
> > > > > > JOB[0000004-151104124010010-oozie-oozi-W]
> > > > > > ACTION[0000004-151104124010010-oozie-oozi-W@java-node]
> > > > > > [***0000004-151104124010010-oozie-oozi-W@java-node***]Action
> > updated
> > > > in
> > > > > > DB!
> > > > > > 2015-11-04 14:09:02,926 INFO WorkflowNotificationXCommand:520 -
> > > > SERVER[
> > > > > > hadoop03.housing.com] USER[-] GROUP[-] TOKEN[-] APP[-]
> > > > > > JOB[0000004-151104124010010-oozie-oozi-W]
> > > > > > ACTION[0000004-151104124010010-oozie-oozi-W@java-node] No
> > > Notification
> > > > > > URL is defined. Therefore nothing to notify for job
> > > > > > 0000004-151104124010010-oozie-oozi-W@java-node
> > > > > > 2015-11-04 14:09:17,606 INFO CallbackServlet:520 - SERVER[
> > > > > > hadoop03.housing.com] USER[-] GROUP[-] TOKEN[-] APP[-]
> > > > > > JOB[0000004-151104124010010-oozie-oozi-W]
> > > > > > ACTION[0000004-151104124010010-oozie-oozi-W@java-node] callback
> > for
> > > > > > action [0000004-151104124010010-oozie-oozi-W@java-node]
> > > > > > 2015-11-04 14:09:17,907 INFO JavaActionExecutor:520 - SERVER[
> > > > > > hadoop03.housing.com] USER[hdfs] GROUP[-] TOKEN[]
> > APP[java-main-wf]
> > > > > > JOB[0000004-151104124010010-oozie-oozi-W]
> > > > > > ACTION[0000004-151104124010010-oozie-oozi-W@java-node] action
> > > > completed,
> > > > > > external ID [job_1446620926630_0016]
> > > > > > 2015-11-04 14:09:18,029 INFO ActionStartXCommand:520 - SERVER[
> > > > > > hadoop03.housing.com] USER[hdfs] GROUP[-] TOKEN[]
> > APP[java-main-wf]
> > > > > > JOB[0000004-151104124010010-oozie-oozi-W]
> > > > > > ACTION[0000004-151104124010010-oozie-oozi-W@end] Start action
> > > > > > [0000004-151104124010010-oozie-oozi-W@end] with user-retry
> state :
> > > > > > userRetryCount [0], userRetryMax [0], userRetryInterval [10]
> > > > > > 2015-11-04 14:09:18,034 INFO ActionStartXCommand:520 - SERVER[
> > > > > > hadoop03.housing.com] USER[hdfs] GROUP[-] TOKEN[]
> > APP[java-main-wf]
> > > > > > JOB[0000004-151104124010010-oozie-oozi-W]
> > > > > > ACTION[0000004-151104124010010-oozie-oozi-W@end]
> > > > > > [***0000004-151104124010010-oozie-oozi-W@end***]Action
> status=DONE
> > > > > > 2015-11-04 14:09:18,034 INFO ActionStartXCommand:520 - SERVER[
> > > > > > hadoop03.housing.com] USER[hdfs] GROUP[-] TOKEN[]
> > APP[java-main-wf]
> > > > > > JOB[0000004-151104124010010-oozie-oozi-W]
> > > > > > ACTION[0000004-151104124010010-oozie-oozi-W@end]
> > > > > > [***0000004-151104124010010-oozie-oozi-W@end***]Action updated
> in
> > > DB!
> > > > > > 2015-11-04 14:09:18,104 INFO WorkflowNotificationXCommand:520 -
> > > > SERVER[
> > > > > > hadoop03.housing.com] USER[-] GROUP[-] TOKEN[-] APP[-]
> > > > > > JOB[0000004-151104124010010-oozie-oozi-W]
> > > > > > ACTION[0000004-151104124010010-oozie-oozi-W@end] No Notification
> > URL
> > > > is
> > > > > > defined. Therefore nothing to notify for job
> > > > > > 0000004-151104124010010-oozie-oozi-W@end
> > > > > > 2015-11-04 14:09:18,104 INFO WorkflowNotificationXCommand:520 -
> > > > SERVER[
> > > > > > hadoop03.housing.com] USER[-] GROUP[-] TOKEN[-] APP[-]
> > > > > > JOB[0000004-151104124010010-oozie-oozi-W] ACTION[] No
> Notification
> > > URL
> > > > is
> > > > > > defined. Therefore nothing to notify for job
> > > > > > 0000004-151104124010010-oozie-oozi-W
> > > > > > 2015-11-04 14:09:18,105 INFO WorkflowNotificationXCommand:520 -
> > > > SERVER[
> > > > > > hadoop03.housing.com] USER[-] GROUP[-] TOKEN[-] APP[-]
> > > > > > JOB[0000004-151104124010010-oozie-oozi-W]
> > > > > > ACTION[0000004-151104124010010-oozie-oozi-W@java-node] No
> > > Notification
> > > > > > URL is defined. Therefore nothing to notify for job
> > > > > > 0000004-151104124010010-oozie-oozi-W@java-node
> > > > > >
> > > > > >
> > > > > >
> > > > > > On Wed, Nov 4, 2015 at 4:26 PM, Jaydeep Vishwakarma <
> > > > > > [email protected]> wrote:
> > > > > >
> > > > > >> oozie job -info 0000040-151015123257993-oozie-oozi-W@java-node
> > > > > >> There you will find "Console URL" , Open that URL on browser.
> You
> > > will
> > > > > get
> > > > > >> the Launcher mapper logs.
> > > > > >>
> > > > > >>
> > > > > >>
> > > > > >> On Wed, Nov 4, 2015 at 4:13 PM, Jeetendra G <
> > > [email protected]>
> > > > > >> wrote:
> > > > > >>
> > > > > >> > This is the log i am getting repeatedly
> > > > > >> > 2015-10-29 16:39:11,095 INFO
> WorkflowNotificationXCommand:520 -
> > > > > SERVER[
> > > > > >> > hadoop03.housing.com] USER[-] GROUP[-] TOKEN[-] APP[-]
> > > > > >> > JOB[0000040-151015123257993-oozie-oozi-W]
> > > > > >> > ACTION[0000040-151015123257993-oozie-oozi-W@:start:] No
> > > > Notification
> > > > > >> URL
> > > > > >> > is
> > > > > >> > defined. Therefore nothing to notify for job
> > > > > >> > 0000040-151015123257993-oozie-oozi-W@:start:
> > > > > >> > 2015-10-29 16:39:11,095 INFO
> WorkflowNotificationXCommand:520 -
> > > > > SERVER[
> > > > > >> > hadoop03.housing.com] USER[-] GROUP[-] TOKEN[-] APP[-]
> > > > > >> > JOB[0000040-151015123257993-oozie-oozi-W] ACTION[] No
> > Notification
> > > > URL
> > > > > >> is
> > > > > >> > defined. Therefore nothing to notify for job
> > > > > >> > 0000040-151015123257993-oozie-oozi-W
> > > > > >> >
> > > > > >> > On Wed, Nov 4, 2015 at 4:11 PM, Jaydeep Vishwakarma <
> > > > > >> > [email protected]> wrote:
> > > > > >> >
> > > > > >> > > Have you checked Launcher Mapper logs?. What it says?
> > > > > >> > >
> > > > > >> > > On Wed, Nov 4, 2015 at 4:04 PM, Jeetendra G <
> > > > > [email protected]>
> > > > > >> > > wrote:
> > > > > >> > >
> > > > > >> > > > does anybody have any idea? i have been trying this from
> 10
> > > days
> > > > > >> > nothing
> > > > > >> > > > worked out.
> > > > > >> > > >
> > > > > >> > > > On Thu, Oct 29, 2015 at 6:02 PM, Jeetendra G <
> > > > > >> [email protected]>
> > > > > >> > > > wrote:
> > > > > >> > > >
> > > > > >> > > > > my workflow.xml
> > > > > >> > > > >
> > > > > >> > > > >
> > > > > >> > > > > <workflow-app xmlns="uri:oozie:workflow:0.2"
> > > > > name="java-main-wf">
> > > > > >> > > > > <start to="java-node"/>
> > > > > >> > > > > <action name="java-node">
> > > > > >> > > > > <java>
> > > > > >> > > > > <job-tracker>${jobTracker}</job-tracker>
> > > > > >> > > > > <name-node>${nameNode}</name-node>
> > > > > >> > > > >
> > > > > <main-class>com.housing.common.JSONMerger</main-class>
> > > > > >> > > > >
> > > <java-opts>-Dhadoop.custom.configuration.file=hdfs://
> > > > > >> > > > > 10.1.6.186:8020/configuration/jsonmerger-dev.conf
> > > > > >> > > > > -Dyyyymmdd=20151029</java-opts>
> > > > > >> > > > >
> > > > > >> > > > > </java>
> > > > > >> > > > > <ok to="end"/>
> > > > > >> > > > > <error to="fail"/>
> > > > > >> > > > > </action>
> > > > > >> > > > > <kill name="fail">
> > > > > >> > > > > <message>Java failed, error
> > > > > >> > > > >
> message[${wf:errorMessage(wf:lastErrorNode())}]</message>
> > > > > >> > > > > </kill>
> > > > > >> > > > > <end name="end"/>
> > > > > >> > > > > </workflow-app>
> > > > > >> > > > >
> > > > > >> > > > > On Thu, Oct 29, 2015 at 4:53 PM, Jeetendra G <
> > > > > >> > [email protected]>
> > > > > >> > > > > wrote:
> > > > > >> > > > >
> > > > > >> > > > >> Hi All,
> > > > > >> > > > >>
> > > > > >> > > > >> I am running java workflow job using oozie.
> > > > > >> > > > >> I have Ambari server and I have installed oozie from
> > > Ambari.
> > > > > >> > > > >> When i ran the job it say succeeded but its not running
> > my
> > > > java
> > > > > >> > class
> > > > > >> > > > >> which I mentioned inside workflow.xml. Also when I get
> > > oozie
> > > > > >> > nothing
> > > > > >> > > > can
> > > > > >> > > > >> be find pasting log beow, can anybody help here?
> > > > > >> > > > >> oozie job -oozie
> http://hadoop03.housing.com:11000/oozie
> > > > -log
> > > > > >> > > > >> 0000040-151015123257993-oozie-oozi-W
> > > > > >> > > > >> 2015-10-29 16:39:11,058 INFO ActionStartXCommand:520 -
> > > > SERVER[
> > > > > >> > > > >> hadoop03.housing.com] USER[hdfs] GROUP[-] TOKEN[]
> > > > > >> APP[java-main-wf]
> > > > > >> > > > >> JOB[0000040-151015123257993-oozie-oozi-W]
> > > > > >> > > > >> ACTION[0000040-151015123257993-oozie-oozi-W@:start:]
> > Start
> > > > > >> action
> > > > > >> > > > >> [0000040-151015123257993-oozie-oozi-W@:start:] with
> > > > user-retry
> > > > > >> > state
> > > > > >> > > :
> > > > > >> > > > >> userRetryCount [0], userRetryMax [0], userRetryInterval
> > > [10]
> > > > > >> > > > >> 2015-10-29 16:39:11,061 INFO ActionStartXCommand:520 -
> > > > SERVER[
> > > > > >> > > > >> hadoop03.housing.com] USER[hdfs] GROUP[-] TOKEN[]
> > > > > >> APP[java-main-wf]
> > > > > >> > > > >> JOB[0000040-151015123257993-oozie-oozi-W]
> > > > > >> > > > >> ACTION[0000040-151015123257993-oozie-oozi-W@:start:]
> > > > > >> > > > >> [***0000040-151015123257993-oozie-oozi-W@
> > :start:***]Action
> > > > > >> > > status=DONE
> > > > > >> > > > >> 2015-10-29 16:39:11,061 INFO ActionStartXCommand:520 -
> > > > SERVER[
> > > > > >> > > > >> hadoop03.housing.com] USER[hdfs] GROUP[-] TOKEN[]
> > > > > >> APP[java-main-wf]
> > > > > >> > > > >> JOB[0000040-151015123257993-oozie-oozi-W]
> > > > > >> > > > >> ACTION[0000040-151015123257993-oozie-oozi-W@:start:]
> > > > > >> > > > >> [***0000040-151015123257993-oozie-oozi-W@
> > :start:***]Action
> > > > > >> updated
> > > > > >> > in
> > > > > >> > > > DB!
> > > > > >> > > > >> 2015-10-29 16:39:11,095 INFO
> > > > WorkflowNotificationXCommand:520
> > > > > -
> > > > > >> > > SERVER[
> > > > > >> > > > >> hadoop03.housing.com] USER[-] GROUP[-] TOKEN[-] APP[-]
> > > > > >> > > > >> JOB[0000040-151015123257993-oozie-oozi-W]
> > > > > >> > > > >> ACTION[0000040-151015123257993-oozie-oozi-W@:start:]
> No
> > > > > >> > Notification
> > > > > >> > > > URL
> > > > > >> > > > >> is defined. Therefore nothing to notify for job
> > > > > >> > > > >> 0000040-151015123257993-oozie-oozi-W@:start:
> > > > > >> > > > >> 2015-10-29 16:39:11,095 INFO
> > > > WorkflowNotificationXCommand:520
> > > > > -
> > > > > >> > > SERVER[
> > > > > >> > > > >> hadoop03.housing.com] USER[-] GROUP[-] TOKEN[-] APP[-]
> > > > > >> > > > >> JOB[0000040-151015123257993-oozie-oozi-W] ACTION[] No
> > > > > >> Notification
> > > > > >> > URL
> > > > > >> > > > is
> > > > > >> > > > >> defined. Therefore nothing to notify for job
> > > > > >> > > > >> 0000040-151015123257993-oozie-oozi-W
> > > > > >> > > > >> 2015-10-29 16:39:11,107 INFO ActionStartXCommand:520 -
> > > > SERVER[
> > > > > >> > > > >> hadoop03.housing.com] USER[hdfs] GROUP[-] TOKEN[]
> > > > > >> APP[java-main-wf]
> > > > > >> > > > >> JOB[0000040-151015123257993-oozie-oozi-W]
> > > > > >> > > > >> ACTION[0000040-151015123257993-oozie-oozi-W@java-node]
> > > Start
> > > > > >> action
> > > > > >> > > > >> [0000040-151015123257993-oozie-oozi-W@java-node] with
> > > > > user-retry
> > > > > >> > > state
> > > > > >> > > > :
> > > > > >> > > > >> userRetryCount [0], userRetryMax [0], userRetryInterval
> > > [10]
> > > > > >> > > > >> 2015-10-29 16:39:12,222 INFO JavaActionExecutor:520 -
> > > > SERVER[
> > > > > >> > > > >> hadoop03.housing.com] USER[hdfs] GROUP[-] TOKEN[]
> > > > > >> APP[java-main-wf]
> > > > > >> > > > >> JOB[0000040-151015123257993-oozie-oozi-W]
> > > > > >> > > > >> ACTION[0000040-151015123257993-oozie-oozi-W@java-node]
> > > > > checking
> > > > > >> > > action,
> > > > > >> > > > >> hadoop job ID [job_1444892488693_0073] status [RUNNING]
> > > > > >> > > > >> 2015-10-29 16:39:12,224 INFO ActionStartXCommand:520 -
> > > > SERVER[
> > > > > >> > > > >> hadoop03.housing.com] USER[hdfs] GROUP[-] TOKEN[]
> > > > > >> APP[java-main-wf]
> > > > > >> > > > >> JOB[0000040-151015123257993-oozie-oozi-W]
> > > > > >> > > > >> ACTION[0000040-151015123257993-oozie-oozi-W@java-node]
> > > > > >> > > > >> [***0000040-151015123257993-oozie-oozi-W@java-node
> > > ***]Action
> > > > > >> > > > >> status=RUNNING
> > > > > >> > > > >> 2015-10-29 16:39:12,224 INFO ActionStartXCommand:520 -
> > > > SERVER[
> > > > > >> > > > >> hadoop03.housing.com] USER[hdfs] GROUP[-] TOKEN[]
> > > > > >> APP[java-main-wf]
> > > > > >> > > > >> JOB[0000040-151015123257993-oozie-oozi-W]
> > > > > >> > > > >> ACTION[0000040-151015123257993-oozie-oozi-W@java-node]
> > > > > >> > > > >> [***0000040-151015123257993-oozie-oozi-W@java-node
> > > ***]Action
> > > > > >> > updated
> > > > > >> > > in
> > > > > >> > > > >> DB!
> > > > > >> > > > >> 2015-10-29 16:39:12,229 INFO
> > > > WorkflowNotificationXCommand:520
> > > > > -
> > > > > >> > > SERVER[
> > > > > >> > > > >> hadoop03.housing.com] USER[-] GROUP[-] TOKEN[-] APP[-]
> > > > > >> > > > >> JOB[0000040-151015123257993-oozie-oozi-W]
> > > > > >> > > > >> ACTION[0000040-151015123257993-oozie-oozi-W@java-node]
> > No
> > > > > >> > > Notification
> > > > > >> > > > >> URL is defined. Therefore nothing to notify for job
> > > > > >> > > > >> 0000040-151015123257993-oozie-oozi-W@java-node
> > > > > >> > > > >> 2015-10-29 16:39:25,192 INFO CallbackServlet:520 -
> > SERVER[
> > > > > >> > > > >> hadoop03.housing.com] USER[-] GROUP[-] TOKEN[-] APP[-]
> > > > > >> > > > >> JOB[0000040-151015123257993-oozie-oozi-W]
> > > > > >> > > > >> ACTION[0000040-151015123257993-oozie-oozi-W@java-node]
> > > > > callback
> > > > > >> for
> > > > > >> > > > >> action [0000040-151015123257993-oozie-oozi-W@java-node
> ]
> > > > > >> > > > >> 2015-10-29 16:39:25,393 INFO JavaActionExecutor:520 -
> > > > SERVER[
> > > > > >> > > > >> hadoop03.housing.com] USER[hdfs] GROUP[-] TOKEN[]
> > > > > >> APP[java-main-wf]
> > > > > >> > > > >> JOB[0000040-151015123257993-oozie-oozi-W]
> > > > > >> > > > >> ACTION[0000040-151015123257993-oozie-oozi-W@java-node]
> > > > action
> > > > > >> > > > completed,
> > > > > >> > > > >> external ID [job_1444892488693_0073]
> > > > > >> > > > >> 2015-10-29 16:39:25,462 INFO ActionStartXCommand:520 -
> > > > SERVER[
> > > > > >> > > > >> hadoop03.housing.com] USER[hdfs] GROUP[-] TOKEN[]
> > > > > >> APP[java-main-wf]
> > > > > >> > > > >> JOB[0000040-151015123257993-oozie-oozi-W]
> > > > > >> > > > >> ACTION[0000040-151015123257993-oozie-oozi-W@end] Start
> > > > action
> > > > > >> > > > >> [0000040-151015123257993-oozie-oozi-W@end] with
> > user-retry
> > > > > >> state :
> > > > > >> > > > >> userRetryCount [0], userRetryMax [0], userRetryInterval
> > > [10]
> > > > > >> > > > >> 2015-10-29 16:39:25,464 INFO ActionStartXCommand:520 -
> > > > SERVER[
> > > > > >> > > > >> hadoop03.housing.com] USER[hdfs] GROUP[-] TOKEN[]
> > > > > >> APP[java-main-wf]
> > > > > >> > > > >> JOB[0000040-151015123257993-oozie-oozi-W]
> > > > > >> > > > >> ACTION[0000040-151015123257993-oozie-oozi-W@end]
> > > > > >> > > > >> [***0000040-151015123257993-oozie-oozi-W@end***]Action
> > > > > >> status=DONE
> > > > > >> > > > >> 2015-10-29 16:39:25,465 INFO ActionStartXCommand:520 -
> > > > SERVER[
> > > > > >> > > > >> hadoop03.housing.com] USER[hdfs] GROUP[-] TOKEN[]
> > > > > >> APP[java-main-wf]
> > > > > >> > > > >> JOB[0000040-151015123257993-oozie-oozi-W]
> > > > > >> > > > >> ACTION[0000040-151015123257993-oozie-oozi-W@end]
> > > > > >> > > > >> [***0000040-151015123257993-oozie-oozi-W@end***]Action
> > > > updated
> > > > > >> in
> > > > > >> > DB!
> > > > > >> > > > >> 2015-10-29 16:39:25,522 INFO
> > > > WorkflowNotificationXCommand:520
> > > > > -
> > > > > >> > > SERVER[
> > > > > >> > > > >> hadoop03.housing.com] USER[-] GROUP[-] TOKEN[-] APP[-]
> > > > > >> > > > >> JOB[0000040-151015123257993-oozie-oozi-W]
> > > > > >> > > > >> ACTION[0000040-151015123257993-oozie-oozi-W@end] No
> > > > > Notification
> > > > > >> > URL
> > > > > >> > > is
> > > > > >> > > > >> defined. Therefore nothing to notify for job
> > > > > >> > > > >> 0000040-151015123257993-oozie-oozi-W@end
> > > > > >> > > > >> 2015-10-29 16:39:25,522 INFO
> > > > WorkflowNotificationXCommand:520
> > > > > -
> > > > > >> > > SERVER[
> > > > > >> > > > >> hadoop03.housing.com] USER[-] GROUP[-] TOKEN[-] APP[-]
> > > > > >> > > > >> JOB[0000040-151015123257993-oozie-oozi-W] ACTION[] No
> > > > > >> Notification
> > > > > >> > URL
> > > > > >> > > > is
> > > > > >> > > > >> defined. Therefore nothing to notify for job
> > > > > >> > > > >> 0000040-151015123257993-oozie-oozi-W
> > > > > >> > > > >> 2015-10-29 16:39:25,522 INFO
> > > > WorkflowNotificationXCommand:520
> > > > > -
> > > > > >> > > SERVER[
> > > > > >> > > > >> hadoop03.housing.com] USER[-] GROUP[-] TOKEN[-] APP[-]
> > > > > >> > > > >> JOB[0000040-151015123257993-oozie-oozi-W]
> > > > > >> > > > >> ACTION[0000040-151015123257993-oozie-oozi-W@java-node]
> > No
> > > > > >> > > Notification
> > > > > >> > > > >> URL is defined. Therefore nothing to notify for job
> > > > > >> > > > >> 0000040-151015123257993-oozie-oozi-W@java-node
> > > > > >> > > > >>
> > > > > >> > > > >
> > > > > >> > > > >
> > > > > >> > > >
> > > > > >> > >
> > > > > >> > > --
> > > > > >> > >
> _____________________________________________________________
> > > > > >> > > The information contained in this communication is intended
> > > solely
> > > > > for
> > > > > >> > the
> > > > > >> > > use of the individual or entity to whom it is addressed and
> > > others
> > > > > >> > > authorized to receive it. It may contain confidential or
> > legally
> > > > > >> > privileged
> > > > > >> > > information. If you are not the intended recipient you are
> > > hereby
> > > > > >> > notified
> > > > > >> > > that any disclosure, copying, distribution or taking any
> > action
> > > in
> > > > > >> > reliance
> > > > > >> > > on the contents of this information is strictly prohibited
> and
> > > may
> > > > > be
> > > > > >> > > unlawful. If you have received this communication in error,
> > > please
> > > > > >> notify
> > > > > >> > > us immediately by responding to this email and then delete
> it
> > > from
> > > > > >> your
> > > > > >> > > system. The firm is neither liable for the proper and
> complete
> > > > > >> > transmission
> > > > > >> > > of the information contained in this communication nor for
> any
> > > > delay
> > > > > >> in
> > > > > >> > its
> > > > > >> > > receipt.
> > > > > >> > >
> > > > > >> >
> > > > > >>
> > > > > >> --
> > > > > >> _____________________________________________________________
> > > > > >> The information contained in this communication is intended
> solely
> > > for
> > > > > the
> > > > > >> use of the individual or entity to whom it is addressed and
> others
> > > > > >> authorized to receive it. It may contain confidential or legally
> > > > > >> privileged
> > > > > >> information. If you are not the intended recipient you are
> hereby
> > > > > notified
> > > > > >> that any disclosure, copying, distribution or taking any action
> in
> > > > > >> reliance
> > > > > >> on the contents of this information is strictly prohibited and
> may
> > > be
> > > > > >> unlawful. If you have received this communication in error,
> please
> > > > > notify
> > > > > >> us immediately by responding to this email and then delete it
> from
> > > > your
> > > > > >> system. The firm is neither liable for the proper and complete
> > > > > >> transmission
> > > > > >> of the information contained in this communication nor for any
> > delay
> > > > in
> > > > > >> its
> > > > > >> receipt.
> > > > > >>
> > > > > >
> > > > > >
> > > > >
> > > >
> > > > --
> > > > _____________________________________________________________
> > > > The information contained in this communication is intended solely
> for
> > > the
> > > > use of the individual or entity to whom it is addressed and others
> > > > authorized to receive it. It may contain confidential or legally
> > > privileged
> > > > information. If you are not the intended recipient you are hereby
> > > notified
> > > > that any disclosure, copying, distribution or taking any action in
> > > reliance
> > > > on the contents of this information is strictly prohibited and may be
> > > > unlawful. If you have received this communication in error, please
> > notify
> > > > us immediately by responding to this email and then delete it from
> your
> > > > system. The firm is neither liable for the proper and complete
> > > transmission
> > > > of the information contained in this communication nor for any delay
> in
> > > its
> > > > receipt.
> > > >
> > >
> >
>
> --
> _____________________________________________________________
> The information contained in this communication is intended solely for the
> use of the individual or entity to whom it is addressed and others
> authorized to receive it. It may contain confidential or legally privileged
> information. If you are not the intended recipient you are hereby notified
> that any disclosure, copying, distribution or taking any action in reliance
> on the contents of this information is strictly prohibited and may be
> unlawful. If you have received this communication in error, please notify
> us immediately by responding to this email and then delete it from your
> system. The firm is neither liable for the proper and complete transmission
> of the information contained in this communication nor for any delay in its
> receipt.
>
