[
https://issues.apache.org/jira/browse/MAPREDUCE-5064?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13600995#comment-13600995
]
Steve Loughran commented on MAPREDUCE-5064:
-------------------------------------------
later log
{code}
013-03-13 09:43:45,852 INFO mapred.UserLogCleaner
(UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding
job_20130313094330609_0001 for user-log deletion with
retainTimeStamp:1363254225852
JOB_SUBMITTED
JOB_PRIORITY_CHANGED
JOB_STATUS_CHANGED
JOB_INITED
JOB_INFO_CHANGED
TASK_STARTED
SETUP_ATTEMPT_STARTED
SETUP_ATTEMPT_FINISHED
MAP_ATTEMPT_FINISHED
TASK_UPDATED
TASK_FINISHED
JOB_STATUS_CHANGED
TASK_STARTED
MAP_ATTEMPT_STARTED
MAP_ATTEMPT_FINISHED
MAP_ATTEMPT_FINISHED
TASK_UPDATED
TASK_FINISHED
TASK_STARTED
REDUCE_ATTEMPT_STARTED
REDUCE_ATTEMPT_FINISHED
REDUCE_ATTEMPT_FINISHED
TASK_UPDATED
TASK_FINISHED
TASK_STARTED
CLEANUP_ATTEMPT_STARTED
CLEANUP_ATTEMPT_FINISHED
MAP_ATTEMPT_FINISHED
TASK_UPDATED
TASK_FINISHED
JOB_STATUS_CHANGED
JOB_FINISHED
2013-03-13 09:43:48,006 INFO rumen.TestRumenJobTraces
(TestRumenJobTraces.java:validateParsedJobAPI(236)) - Validating
ParsedJob.obtainXXX api... for job_20130313094330609_0001
2013-03-13 09:43:48,006 INFO rumen.TestRumenJobTraces
(TestRumenJobTraces.java:validateParsedTaskAPI(290)) - Validating
ParsedTask.obtainXXX api... for task_20130313094330609_0001_m_000000
2013-03-13 09:43:48,007 INFO rumen.TestRumenJobTraces
(TestRumenJobTraces.java:validateParsedTaskAttemptAPI(323)) - Validating
ParsedTaskAttempt.obtainXXX api... for attempt_20130313094330609_0001_m_000000_0
2013-03-13 09:43:48,007 INFO rumen.TestRumenJobTraces
(TestRumenJobTraces.java:validateParsedTaskAPI(290)) - Validating
ParsedTask.obtainXXX api... for task_20130313094330609_0001_r_000000
2013-03-13 09:43:48,007 INFO rumen.TestRumenJobTraces
(TestRumenJobTraces.java:validateParsedTaskAttemptAPI(323)) - Validating
ParsedTaskAttempt.obtainXXX api... for attempt_20130313094330609_0001_r_000000_0
2013-03-13 09:43:48,007 INFO rumen.TestRumenJobTraces
(TestRumenJobTraces.java:validateParsedTaskAPI(290)) - Validating
ParsedTask.obtainXXX api... for task_20130313094330609_0001_m_000002
2013-03-13 09:43:48,007 INFO rumen.TestRumenJobTraces
(TestRumenJobTraces.java:validateParsedTaskAttemptAPI(323)) - Validating
ParsedTaskAttempt.obtainXXX api... for attempt_20130313094330609_0001_m_000002_0
2013-03-13 09:43:48,007 INFO rumen.TestRumenJobTraces
(TestRumenJobTraces.java:validateParsedTaskAPI(290)) - Validating
ParsedTask.obtainXXX api... for task_20130313094330609_0001_m_000001
2013-03-13 09:43:48,007 INFO rumen.TestRumenJobTraces
(TestRumenJobTraces.java:validateParsedTaskAttemptAPI(323)) - Validating
ParsedTaskAttempt.obtainXXX api... for attempt_20130313094330609_0001_m_000001_0
2013-03-13 09:43:48,009 INFO mapred.TaskTracker (TaskTracker.java:run(1080)) -
Shutting down: Map-events fetcher for all reduce tasks on
tracker_host0.foo.com:localhost/127.0.0.1:57455
2013-03-13 09:43:48,009 INFO filecache.TrackerDistributedCacheManager
(TrackerDistributedCacheManager.java:run(1025)) - Cleanup...
java.lang.InterruptedException: sleep interrupted
at java.lang.Thread.sleep(Native Method)
at
org.apache.hadoop.filecache.TrackerDistributedCacheManager$CleanupThread.run(TrackerDistributedCacheManager.java:1020)
2013-03-13 09:43:48,009 INFO ipc.Server (Server.java:stop(1594)) - Stopping
server on 57455
2013-03-13 09:43:48,010 INFO ipc.Server (Server.java:run(1433)) - IPC Server
handler 1 on 57455: exiting
2013-03-13 09:43:48,010 INFO metrics.RpcInstrumentation
(RpcInstrumentation.java:shutdown(154)) - shut down
2013-03-13 09:43:48,010 INFO ipc.Server (Server.java:run(467)) - Stopping IPC
Server listener on 57455
2013-03-13 09:43:48,010 INFO ipc.Server (Server.java:run(1433)) - IPC Server
handler 0 on 57455: exiting
2013-03-13 09:43:48,010 INFO mapred.TaskTracker
(TaskTracker.java:shutdown(1438)) - Shutting down StatusHttpServer
2013-03-13 09:43:48,010 INFO ipc.Server (Server.java:run(664)) - Stopping IPC
Server Responder
2013-03-13 09:43:48,012 INFO mortbay.log (Slf4jLog.java:info(67)) - Stopped
[email protected]:0
2013-03-13 09:43:48,085 ERROR impl.MetricsSinkAdapter
(MetricsSinkAdapter.java:publishMetricsFromQueue(158)) - Got sink exception and
over retry limit, suppressing further error messages
org.apache.hadoop.metrics2.MetricsException: Failed to putMetrics
at
org.apache.hadoop.metrics2.sink.ganglia.GangliaSink30.putMetrics(GangliaSink30.java:129)
at
org.apache.hadoop.metrics2.impl.MetricsSinkAdapter.publishMetrics(MetricsSinkAdapter.java:180)
at
org.apache.hadoop.metrics2.impl.MetricsSinkAdapter$1.consume(MetricsSinkAdapter.java:60)
at
org.apache.hadoop.metrics2.impl.MetricsSinkAdapter$1.consume(MetricsSinkAdapter.java:58)
at
org.apache.hadoop.metrics2.impl.SinkQueue.consumeAll(SinkQueue.java:82)
at
org.apache.hadoop.metrics2.impl.MetricsSinkAdapter.publishMetricsFromQueue(MetricsSinkAdapter.java:135)
at
org.apache.hadoop.metrics2.impl.MetricsSinkAdapter$2.run(MetricsSinkAdapter.java:94)
Caused by: java.io.IOException: Host is down
at java.net.PlainDatagramSocketImpl.send(Native Method)
at java.net.DatagramSocket.send(DatagramSocket.java:625)
at
org.apache.hadoop.metrics2.sink.ganglia.AbstractGangliaSink.emitToGangliaHosts(AbstractGangliaSink.java:265)
at
org.apache.hadoop.metrics2.sink.ganglia.GangliaSink31.emitMetric(GangliaSink31.java:88)
at
org.apache.hadoop.metrics2.sink.ganglia.GangliaSink30.putMetrics(GangliaSink30.java:120)
... 6 more
2013-03-13 09:43:48,116 INFO mapred.TaskTracker
(TaskTracker.java:offerService(1905)) - Interrupted. Closing down.
2013-03-13 09:43:48,117 INFO mapred.JobTracker (JobTracker.java:close(2188)) -
Stopping infoServer
2013-03-13 09:43:48,118 INFO mortbay.log (Slf4jLog.java:info(67)) - Stopped
SelectChannelConnector@localhost:0
2013-03-13 09:43:48,220 INFO mapred.JobTracker (JobTracker.java:close(2196)) -
Stopping interTrackerServer
2013-03-13 09:43:48,220 INFO ipc.Server (Server.java:stop(1594)) - Stopping
server on 57453
2013-03-13 09:43:48,220 INFO ipc.Server (Server.java:run(1433)) - IPC Server
handler 5 on 57453: exiting
2013-03-13 09:43:48,221 INFO ipc.Server (Server.java:run(1433)) - IPC Server
handler 1 on 57453: exiting
2013-03-13 09:43:48,221 INFO ipc.Server (Server.java:run(1433)) - IPC Server
handler 8 on 57453: exiting
2013-03-13 09:43:48,221 INFO ipc.Server (Server.java:run(1433)) - IPC Server
handler 4 on 57453: exiting
2013-03-13 09:43:48,221 INFO ipc.Server (Server.java:run(1433)) - IPC Server
handler 2 on 57453: exiting
2013-03-13 09:43:48,221 INFO ipc.Server (Server.java:run(1433)) - IPC Server
handler 0 on 57453: exiting
2013-03-13 09:43:48,221 INFO ipc.Server (Server.java:run(1433)) - IPC Server
handler 9 on 57453: exiting
2013-03-13 09:43:48,221 INFO ipc.Server (Server.java:run(664)) - Stopping IPC
Server Responder
2013-03-13 09:43:48,221 INFO ipc.Server (Server.java:run(1433)) - IPC Server
handler 7 on 57453: exiting
2013-03-13 09:43:48,221 INFO ipc.Server (Server.java:run(1433)) - IPC Server
handler 6 on 57453: exiting
2013-03-13 09:43:48,221 INFO ipc.Server (Server.java:run(1433)) - IPC Server
handler 3 on 57453: exiting
2013-03-13 09:43:48,221 INFO ipc.Server (Server.java:run(467)) - Stopping IPC
Server listener on 57453
2013-03-13 09:43:48,221 INFO metrics.RpcInstrumentation
(RpcInstrumentation.java:shutdown(154)) - shut down
2013-03-13 09:43:48,222 INFO mapred.JobTracker (JobTracker.java:close(2200)) -
Stopping expireTrackers
2013-03-13 09:43:48,222 INFO mapred.JobTracker
(JobTracker.java:offerService(2172)) - Stopped interTrackerServer
2013-03-13 09:43:48,222 INFO mapred.JobTracker (JobTracker.java:close(2209)) -
Stopping retirer
2013-03-13 09:43:48,223 INFO mapred.EagerTaskInitializationListener
(EagerTaskInitializationListener.java:terminate(107)) - Stopping Job Init
Manager thread
2013-03-13 09:43:48,223 INFO mapred.EagerTaskInitializationListener
(EagerTaskInitializationListener.java:run(61)) - JobInitManagerThread
interrupted.
2013-03-13 09:43:48,223 INFO mapred.EagerTaskInitializationListener
(EagerTaskInitializationListener.java:run(65)) - Shutting down thread pool
2013-03-13 09:43:48,223 INFO mapred.JobTracker (JobTracker.java:close(2221)) -
Stopping expireLaunchingTasks
2013-03-13 09:43:48,224 INFO mapred.JobTracker (JobTracker.java:close(2240)) -
Stopping job history server
2013-03-13 09:43:48,224 INFO mapred.JobTracker (JobTracker.java:close(2248)) -
stopped all jobtracker services
testCurrentJHParser validating using gold std
2013-03-13 09:43:48,253 WARN rumen.ZombieJob
(ZombieJob.java:sanitizeValue(244)) - NumberMaps not defined for null
2013-03-13 09:43:48,253 WARN rumen.ZombieJob
(ZombieJob.java:sanitizeValue(244)) - NumberReduces not defined for null
2013-03-13 09:43:48,272 INFO compress.CodecPool
(CodecPool.java:getDecompressor(128)) - Got brand-new decompressor
------------- ---------------- ---------------
------------- Standard Error -----------------
In LoggedJob, we saw the unknown attribute numberMaps.
In LoggedJob, we saw the unknown attribute numberReduces.
------------- ---------------- ---------------
Testcase: testSmallTrace took 0.98 sec
Testcase: testTruncatedTask took 0.155 sec
Testcase: testRumenViaDispatch took 0.563 sec
Testcase: testBracketedCounters took 0.109 sec
Testcase: testHadoop20JHParser took 0 sec
Testcase: testJobHistoryFilenameParsing took 0.015 sec
Testcase: testProcessInputArgument took 0.047 sec
Testcase: testCurrentJHParser took 17.638 sec
FAILED
Content mismatch expected:<[MA]P_ATTEMPT_STARTED> but
was:<[SETU]P_ATTEMPT_STARTED>
junit.framework.AssertionFailedError: Content mismatch
expected:<[MA]P_ATTEMPT_STARTED> but was:<[SETU]P_ATTEMPT_STARTED>
at
org.apache.hadoop.tools.rumen.TestRumenJobTraces.testCurrentJHParser(TestRumenJobTraces.java:779)
{code}
> TestRumenJobTraces failing on 1.3.x
> -----------------------------------
>
> Key: MAPREDUCE-5064
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-5064
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Affects Versions: 1.3.0
> Environment: OS/X, java 1.6.0_41, GMT, home network (no DNS)
> Reporter: Steve Loughran
> Priority: Minor
> Attachments: TEST-org.apache.hadoop.tools.rumen.TestRumenJobTraces.txt
>
>
> {{TestRumenJobTraces.testCurrentJHParser()}} is failing locally, both in a
> bulk test and standalone
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
