[ https://issues.apache.org/jira/browse/MAPREDUCE-4135?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13251441#comment-13251441 ]
Steve Loughran commented on MAPREDUCE-4135: ------------------------------------------- The problem is that the FS shutdown process is being triggered by the app master shutdown hook -at which point it is too late to remove other shutdown hooks. {{FileSystem.Cache.remove()}} should just catch any {{IllegalStateException}} and not worry so much about shutdown hook state failures as the system is usually in an odd state at this point. > MRAppMaster throws IllegalStateException while shutting down > ------------------------------------------------------------ > > Key: MAPREDUCE-4135 > URL: https://issues.apache.org/jira/browse/MAPREDUCE-4135 > Project: Hadoop Map/Reduce > Issue Type: Bug > Components: mrv2 > Affects Versions: 3.0.0 > Reporter: Devaraj K > > Always MRAppMaster throws IllegalStateException in the stderr while shutting > down. It doesn't look good having this exception in the stderr file of > MRAppMaster container. > {code:xml} > WARNING: org.apache.hadoop.metrics.jvm.EventCounter is deprecated. Please use > org.apache.hadoop.log.metrics.EventCounter in all the log4j.properties files. > Exception in thread "Thread-1" java.lang.IllegalStateException: Shutdown in > progress > at > java.lang.ApplicationShutdownHooks.remove(ApplicationShutdownHooks.java:55) > at java.lang.Runtime.removeShutdownHook(Runtime.java:220) > at org.apache.hadoop.fs.FileSystem$Cache.remove(FileSystem.java:2148) > at org.apache.hadoop.fs.FileSystem$Cache.closeAll(FileSystem.java:2180) > at org.apache.hadoop.fs.FileSystem$Cache.closeAll(FileSystem.java:2157) > at org.apache.hadoop.fs.FileSystem.closeAll(FileSystem.java:361) > at > org.apache.hadoop.mapreduce.v2.app.MRAppMaster$MRAppMasterShutdownHook.run(MRAppMaster.java:1014) > {code} -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira