[ https://issues.apache.org/jira/browse/YARN-3561?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14529824#comment-14529824 ]
Gour Saha commented on YARN-3561: --------------------------------- Logs for the run used to file the bug are not available anymore. Attached logs (app0001.zip) for one of the recent attempts. It contains RM and NM logs from hosts running Slider AM and non-AM application containers. container_1430849660771_0001_01_000001 - host04 - SliderAM container_1430849660771_0001_01_000002 - host04 - NIMBUS container_1430849660771_0001_01_000003 - host05 - STORM_UI_SERVER container_1430849660771_0001_01_000004 - host03 - DRPC_SERVER container_1430849660771_0001_01_000005 - host07 - SUPERVISOR *Timing of issuing the commands:* Slider start command : 2015-05-06 00:01:04,710 Slider stop command : 2015-05-06 00:03:13,608 > Non-AM Containers continue to run even after AM is stopped > ---------------------------------------------------------- > > Key: YARN-3561 > URL: https://issues.apache.org/jira/browse/YARN-3561 > Project: Hadoop YARN > Issue Type: Bug > Components: nodemanager, yarn > Affects Versions: 2.6.0 > Environment: debian 7 > Reporter: Gour Saha > Priority: Critical > > Non-AM containers continue to run even after application is stopped. This > occurred while deploying Storm 0.9.3 using Slider (0.60.0 and 0.70.1) in a > Hadoop 2.6 deployment. > Following are the NM logs from 2 different nodes: > *host-07* - where Slider AM was running > *host-03* - where Storm NIMBUS container was running. > *Note:* The logs are partial, starting with the time when the relevant Slider > AM and NIMBUS containers were allocated, till the time when the Slider AM was > stopped. Also, the large number of "Memory usage" log lines were removed > keeping only a few starts and ends of every segment. > *NM log from host-07 where Slider AM container was running:* > {noformat} > 2015-04-29 00:39:24,614 INFO monitor.ContainersMonitorImpl > (ContainersMonitorImpl.java:run(356)) - Stopping resource-monitoring for > container_1428575950531_0020_02_000001 > 2015-04-29 00:41:10,310 INFO ipc.Server (Server.java:saslProcess(1306)) - > Auth successful for appattempt_1428575950531_0021_000001 (auth:SIMPLE) > 2015-04-29 00:41:10,322 INFO containermanager.ContainerManagerImpl > (ContainerManagerImpl.java:startContainerInternal(803)) - Start request for > container_1428575950531_0021_01_000001 by user yarn > 2015-04-29 00:41:10,322 INFO containermanager.ContainerManagerImpl > (ContainerManagerImpl.java:startContainerInternal(843)) - Creating a new > application reference for app application_1428575950531_0021 > 2015-04-29 00:41:10,323 INFO application.Application > (ApplicationImpl.java:handle(464)) - Application > application_1428575950531_0021 transitioned from NEW to INITING > 2015-04-29 00:41:10,325 INFO nodemanager.NMAuditLogger > (NMAuditLogger.java:logSuccess(89)) - USER=yarn IP=10.84.105.162 > OPERATION=Start Container Request TARGET=ContainerManageImpl > RESULT=SUCCESS APPID=application_1428575950531_0021 > CONTAINERID=container_1428575950531_0021_01_000001 > 2015-04-29 00:41:10,328 WARN logaggregation.LogAggregationService > (LogAggregationService.java:verifyAndCreateRemoteLogDir(195)) - Remote Root > Log Dir [/app-logs] already exist, but with incorrect permissions. Expected: > [rwxrwxrwt], Found: [rwxrwxrwx]. The cluster may have problems with multiple > users. > 2015-04-29 00:41:10,328 WARN logaggregation.AppLogAggregatorImpl > (AppLogAggregatorImpl.java:<init>(182)) - rollingMonitorInterval is set as > -1. The log rolling mornitoring interval is disabled. The logs will be > aggregated after this application is finished. > 2015-04-29 00:41:10,351 INFO application.Application > (ApplicationImpl.java:transition(304)) - Adding > container_1428575950531_0021_01_000001 to application > application_1428575950531_0021 > 2015-04-29 00:41:10,352 INFO application.Application > (ApplicationImpl.java:handle(464)) - Application > application_1428575950531_0021 transitioned from INITING to RUNNING > 2015-04-29 00:41:10,356 INFO container.Container > (ContainerImpl.java:handle(999)) - Container > container_1428575950531_0021_01_000001 transitioned from NEW to LOCALIZING > 2015-04-29 00:41:10,357 INFO containermanager.AuxServices > (AuxServices.java:handle(196)) - Got event CONTAINER_INIT for appId > application_1428575950531_0021 > 2015-04-29 00:41:10,357 INFO localizer.LocalizedResource > (LocalizedResource.java:handle(203)) - Resource > hdfs://zsexp/user/yarn/.slider/cluster/storm1/tmp/application_1428575950531_0021/am/lib/htrace-core-3.0.4.jar > transitioned from INIT to DOWNLOADING > 2015-04-29 00:41:10,357 INFO localizer.LocalizedResource > (LocalizedResource.java:handle(203)) - Resource > hdfs://zsexp/user/yarn/.slider/cluster/storm1/tmp/application_1428575950531_0021/am/lib/jettison-1.1.jar > transitioned from INIT to DOWNLOADING > 2015-04-29 00:41:10,358 INFO localizer.LocalizedResource > (LocalizedResource.java:handle(203)) - Resource > hdfs://zsexp/user/yarn/.slider/cluster/storm1/tmp/application_1428575950531_0021/am/lib/api-util-1.0.0-M20.jar > transitioned from INIT to DOWNLOADING > 2015-04-29 00:41:10,358 INFO localizer.LocalizedResource > (LocalizedResource.java:handle(203)) - Resource > hdfs://zsexp/user/yarn/.slider/cluster/storm1/confdir/log4j-server.properties > transitioned from INIT to DOWNLOADING > 2015-04-29 00:41:10,358 INFO localizer.LocalizedResource > (LocalizedResource.java:handle(203)) - Resource > hdfs://zsexp/user/yarn/.slider/cluster/storm1/tmp/application_1428575950531_0021/am/lib/httpcore-4.2.5.jar > transitioned from INIT to DOWNLOADING > 2015-04-29 00:41:10,358 INFO localizer.LocalizedResource > (LocalizedResource.java:handle(203)) - Resource > hdfs://zsexp/user/yarn/.slider/cluster/storm1/tmp/application_1428575950531_0021/am/lib/metrics-core-3.0.1.jar > transitioned from INIT to DOWNLOADING > 2015-04-29 00:41:10,359 INFO localizer.LocalizedResource > (LocalizedResource.java:handle(203)) - Resource > hdfs://zsexp/user/yarn/.slider/cluster/storm1/tmp/application_1428575950531_0021/am/lib/slf4j-log4j12-1.6.1.jar > transitioned from INIT to DOWNLOADING > 2015-04-29 00:41:10,359 INFO localizer.LocalizedResource > (LocalizedResource.java:handle(203)) - Resource > hdfs://zsexp/user/yarn/.slider/cluster/storm1/confdir/slider-env.sh > transitioned from INIT to DOWNLOADING > 2015-04-29 00:41:10,359 INFO localizer.LocalizedResource > (LocalizedResource.java:handle(203)) - Resource > hdfs://zsexp/user/yarn/.slider/cluster/storm1/tmp/application_1428575950531_0021/am/lib/hadoop-mapreduce-client-shuffle-2.6.0.jar > transitioned from INIT to DOWNLOADING > 2015-04-29 00:41:10,359 INFO localizer.LocalizedResource > (LocalizedResource.java:handle(203)) - Resource > hdfs://zsexp/user/yarn/.slider/cluster/storm1/tmp/application_1428575950531_0021/am/lib/xercesImpl-2.9.1.jar > transitioned from INIT to DOWNLOADING > 2015-04-29 00:41:10,360 INFO localizer.LocalizedResource > (LocalizedResource.java:handle(203)) - Resource > hdfs://zsexp/user/yarn/.slider/cluster/storm1/tmp/application_1428575950531_0021/am/lib/hadoop-hdfs-2.6.0.jar > transitioned from INIT to DOWNLOADING > 2015-04-29 00:41:10,360 INFO localizer.LocalizedResource > (LocalizedResource.java:handle(203)) - Resource > hdfs://zsexp/user/yarn/.slider/cluster/storm1/tmp/application_1428575950531_0021/am/lib/commons-beanutils-1.7.0.jar > transitioned from INIT to DOWNLOADING > 2015-04-29 00:41:10,360 INFO localizer.LocalizedResource > (LocalizedResource.java:handle(203)) - Resource > hdfs://zsexp/user/yarn/.slider/cluster/storm1/tmp/application_1428575950531_0021/am/lib/stax-api-1.0.1.jar > transitioned from INIT to DOWNLOADING > 2015-04-29 00:41:10,360 INFO localizer.LocalizedResource > (LocalizedResource.java:handle(203)) - Resource > hdfs://zsexp/user/yarn/.slider/cluster/storm1/tmp/application_1428575950531_0021/agent/slider-agent.tar.gz > transitioned from INIT to DOWNLOADING > 2015-04-29 00:41:10,361 INFO localizer.LocalizedResource > (LocalizedResource.java:handle(203)) - Resource > hdfs://zsexp/user/yarn/.slider/cluster/storm1/tmp/application_1428575950531_0021/am/lib/hadoop-yarn-registry-2.6.0.jar > transitioned from INIT to DOWNLOADING > 2015-04-29 00:41:10,361 INFO localizer.LocalizedResource > (LocalizedResource.java:handle(203)) - Resource > hdfs://zsexp/user/yarn/.slider/cluster/storm1/tmp/application_1428575950531_0021/am/lib/xmlenc-0.52.jar > transitioned from INIT to DOWNLOADING > 2015-04-29 00:41:10,361 INFO localizer.LocalizedResource > (LocalizedResource.java:handle(203)) - Resource > hdfs://zsexp/user/yarn/.slider/cluster/storm1/tmp/application_1428575950531_0021/am/lib/jackson-core-asl-1.9.13.jar > transitioned from INIT to DOWNLOADING > 2015-04-29 00:41:10,361 INFO localizer.LocalizedResource > (LocalizedResource.java:handle(203)) - Resource > hdfs://zsexp/user/yarn/.slider/cluster/storm1/tmp/application_1428575950531_0021/am/lib/metrics-jvm-3.0.1.jar > transitioned from INIT to DOWNLOADING > 2015-04-29 00:41:10,362 INFO localizer.LocalizedResource > (LocalizedResource.java:handle(203)) - Resource > hdfs://zsexp/user/yarn/.slider/cluster/storm1/tmp/application_1428575950531_0021/am/lib/paranamer-2.3.jar > transitioned from INIT to DOWNLOADING > 2015-04-29 00:41:10,362 INFO localizer.LocalizedResource > (LocalizedResource.java:handle(203)) - Resource > hdfs://zsexp/user/yarn/.slider/cluster/storm1/tmp/application_1428575950531_0021/am/lib/slider-core-0.70.1-incubating.jar > transitioned from INIT to DOWNLOADING > 2015-04-29 00:41:10,362 INFO localizer.LocalizedResource > (LocalizedResource.java:handle(203)) - Resource > hdfs://zsexp/user/yarn/.slider/cluster/storm1/tmp/application_1428575950531_0021/am/lib/log4j-1.2.17.jar > transitioned from INIT to DOWNLOADING > 2015-04-29 00:41:10,362 INFO localizer.LocalizedResource > (LocalizedResource.java:handle(203)) - Resource > hdfs://zsexp/user/yarn/.slider/cluster/storm1/confdir/slider-client.xml > transitioned from INIT to DOWNLOADING > 2015-04-29 00:41:10,363 INFO localizer.LocalizedResource > (LocalizedResource.java:handle(203)) - Resource > hdfs://zsexp/user/yarn/.slider/cluster/storm1/tmp/application_1428575950531_0021/am/lib/jackson-databind-2.2.2.jar > transitioned from INIT to DOWNLOADING > 2015-04-29 00:41:10,363 INFO localizer.LocalizedResource > (LocalizedResource.java:handle(203)) - Resource > hdfs://zsexp/user/yarn/.slider/cluster/storm1/tmp/application_1428575950531_0021/am/lib/guice-servlet-3.0.jar > transitioned from INIT to DOWNLOADING > 2015-04-29 00:41:10,363 INFO localizer.LocalizedResource > (LocalizedResource.java:handle(203)) - Resource > hdfs://zsexp/user/yarn/.slider/cluster/storm1/tmp/application_1428575950531_0021/am/lib/xml-apis-1.3.04.jar > transitioned from INIT to DOWNLOADING > 2015-04-29 00:41:10,363 INFO localizer.LocalizedResource > (LocalizedResource.java:handle(203)) - Resource > hdfs://zsexp/user/yarn/.slider/cluster/storm1/confdir/log4j.properties > transitioned from INIT to DOWNLOADING > 2015-04-29 00:41:10,364 INFO localizer.LocalizedResource > (LocalizedResource.java:handle(203)) - Resource > hdfs://zsexp/user/yarn/.slider/cluster/storm1/confdir/slider-server.xml > transitioned from INIT to DOWNLOADING > 2015-04-29 00:41:10,364 INFO localizer.LocalizedResource > (LocalizedResource.java:handle(203)) - Resource > hdfs://zsexp/user/yarn/.slider/cluster/storm1/tmp/application_1428575950531_0021/am/lib/jaxb-impl-2.2.3-1.jar > transitioned from INIT to DOWNLOADING > 2015-04-29 00:41:10,364 INFO localizer.LocalizedResource > (LocalizedResource.java:handle(203)) - Resource > hdfs://zsexp/user/yarn/.slider/cluster/storm1/tmp/application_1428575950531_0021/am/lib/hadoop-yarn-server-web-proxy-2.6.0.jar > transitioned from INIT to DOWNLOADING > 2015-04-29 00:41:10,364 INFO localizer.LocalizedResource > (LocalizedResource.java:handle(203)) - Resource > hdfs://zsexp/user/yarn/.slider/cluster/storm1/tmp/application_1428575950531_0021/am/lib/hadoop-mapreduce-client-core-2.6.0.jar > transitioned from INIT to DOWNLOADING > 2015-04-29 00:41:10,365 INFO localizer.LocalizedResource > (LocalizedResource.java:handle(203)) - Resource > hdfs://zsexp/user/yarn/.slider/cluster/storm1/tmp/application_1428575950531_0021/am/lib/hadoop-yarn-client-2.6.0.jar > transitioned from INIT to DOWNLOADING > 2015-04-29 00:41:10,365 INFO localizer.LocalizedResource > (LocalizedResource.java:handle(203)) - Resource > hdfs://zsexp/user/yarn/.slider/cluster/storm1/tmp/application_1428575950531_0021/am/lib/jackson-mapper-asl-1.9.13.jar > transitioned from INIT to DOWNLOADING > 2015-04-29 00:41:10,365 INFO localizer.LocalizedResource > (LocalizedResource.java:handle(203)) - Resource > hdfs://zsexp/user/yarn/.slider/cluster/storm1/tmp/application_1428575950531_0021/am/lib/asm-3.1.jar > transitioned from INIT to DOWNLOADING > 2015-04-29 00:41:10,365 INFO localizer.LocalizedResource > (LocalizedResource.java:handle(203)) - Resource > hdfs://zsexp/user/yarn/.slider/cluster/storm1/tmp/application_1428575950531_0021/am/lib/jetty-sslengine-6.1.26.jar > transitioned from INIT to DOWNLOADING > 2015-04-29 00:41:10,366 INFO localizer.LocalizedResource > (LocalizedResource.java:handle(203)) - Resource > hdfs://zsexp/user/yarn/.slider/cluster/storm1/tmp/application_1428575950531_0021/am/lib/zookeeper-3.4.6.jar > transitioned from INIT to DOWNLOADING > 2015-04-29 00:41:10,366 INFO localizer.LocalizedResource > (LocalizedResource.java:handle(203)) - Resource > hdfs://zsexp/user/yarn/.slider/cluster/storm1/tmp/application_1428575950531_0021/am/lib/hadoop-mapreduce-client-common-2.6.0.jar > transitioned from INIT to DOWNLOADING > 2015-04-29 00:41:10,366 INFO localizer.LocalizedResource > (LocalizedResource.java:handle(203)) - Resource > hdfs://zsexp/user/yarn/.slider/cluster/storm1/tmp/application_1428575950531_0021/am/lib/jsp-api-2.1.jar > transitioned from INIT to DOWNLOADING > 2015-04-29 00:41:10,366 INFO localizer.LocalizedResource > (LocalizedResource.java:handle(203)) - Resource > hdfs://zsexp/user/yarn/.slider/cluster/storm1/tmp/application_1428575950531_0021/am/lib/hadoop-auth-2.6.0.jar > transitioned from INIT to DOWNLOADING > 2015-04-29 00:41:10,367 INFO localizer.LocalizedResource > (LocalizedResource.java:handle(203)) - Resource > hdfs://zsexp/user/yarn/.slider/cluster/storm1/tmp/application_1428575950531_0021/am/lib/commons-math3-3.1.1.jar > transitioned from INIT to DOWNLOADING > 2015-04-29 00:41:10,367 INFO localizer.LocalizedResource > (LocalizedResource.java:handle(203)) - Resource > hdfs://zsexp/user/yarn/.slider/cluster/storm1/tmp/application_1428575950531_0021/am/lib/jersey-core-1.9.jar > transitioned from INIT to DOWNLOADING > 2015-04-29 00:41:10,367 INFO localizer.LocalizedResource > (LocalizedResource.java:handle(203)) - Resource > hdfs://zsexp/user/yarn/.slider/cluster/storm1/tmp/application_1428575950531_0021/am/lib/hadoop-yarn-api-2.6.0.jar > transitioned from INIT to DOWNLOADING > 2015-04-29 00:41:10,367 INFO localizer.LocalizedResource > (LocalizedResource.java:handle(203)) - Resource > hdfs://zsexp/user/yarn/.slider/cluster/storm1/tmp/application_1428575950531_0021/am/lib/avro-1.7.4.jar > transitioned from INIT to DOWNLOADING > 2015-04-29 00:41:10,368 INFO localizer.LocalizedResource > (LocalizedResource.java:handle(203)) - Resource > hdfs://zsexp/user/yarn/.slider/cluster/storm1/tmp/application_1428575950531_0021/am/lib/hadoop-client-2.6.0.jar > transitioned from INIT to DOWNLOADING > 2015-04-29 00:41:10,368 INFO localizer.LocalizedResource > (LocalizedResource.java:handle(203)) - Resource > hdfs://zsexp/user/yarn/.slider/cluster/storm1/tmp/application_1428575950531_0021/am/lib/jsr311-api-1.1.1.jar > transitioned from INIT to DOWNLOADING > 2015-04-29 00:41:10,368 INFO localizer.LocalizedResource > (LocalizedResource.java:handle(203)) - Resource > hdfs://zsexp/user/yarn/.slider/cluster/storm1/tmp/application_1428575950531_0021/am/lib/jackson-core-2.2.2.jar > transitioned from INIT to DOWNLOADING > 2015-04-29 00:41:10,368 INFO localizer.LocalizedResource > (LocalizedResource.java:handle(203)) - Resource > hdfs://zsexp/user/yarn/.slider/cluster/storm1/tmp/application_1428575950531_0021/am/lib/curator-framework-2.4.1.jar > transitioned from INIT to DOWNLOADING > 2015-04-29 00:41:10,369 INFO localizer.LocalizedResource > (LocalizedResource.java:handle(203)) - Resource > hdfs://zsexp/user/yarn/.slider/cluster/storm1/tmp/application_1428575950531_0021/am/lib/netty-3.7.0.Final.jar > transitioned from INIT to DOWNLOADING > 2015-04-29 00:41:10,369 INFO localizer.LocalizedResource > (LocalizedResource.java:handle(203)) - Resource > hdfs://zsexp/user/yarn/.slider/cluster/storm1/tmp/application_1428575950531_0021/am/lib/commons-logging-1.1.3.jar > transitioned from INIT to DOWNLOADING > 2015-04-29 00:41:10,369 INFO localizer.LocalizedResource > (LocalizedResource.java:handle(203)) - Resource > hdfs://zsexp/user/yarn/.slider/cluster/storm1/tmp/application_1428575950531_0021/am/lib/commons-lang-2.6.jar > transitioned from INIT to DOWNLOADING > 2015-04-29 00:41:10,369 INFO localizer.LocalizedResource > (LocalizedResource.java:handle(203)) - Resource > hdfs://zsexp/user/yarn/.slider/cluster/storm1/tmp/application_1428575950531_0021/am/lib/curator-recipes-2.6.0.jar > transitioned from INIT to DOWNLOADING > 2015-04-29 00:41:10,370 INFO localizer.LocalizedResource > (LocalizedResource.java:handle(203)) - Resource > hdfs://zsexp/user/yarn/.slider/cluster/storm1/tmp/application_1428575950531_0021/am/lib/jackson-annotations-2.2.2.jar > transitioned from INIT to DOWNLOADING > 2015-04-29 00:41:10,370 INFO localizer.LocalizedResource > (LocalizedResource.java:handle(203)) - Resource > hdfs://zsexp/user/yarn/.slider/cluster/storm1/tmp/application_1428575950531_0021/am/lib/jsr305-1.3.9.jar > transitioned from INIT to DOWNLOADING > 2015-04-29 00:41:10,370 INFO localizer.LocalizedResource > (LocalizedResource.java:handle(203)) - Resource > hdfs://zsexp/user/yarn/.slider/cluster/storm1/tmp/application_1428575950531_0021/am/lib/slf4j-api-1.7.5.jar > transitioned from INIT to DOWNLOADING > 2015-04-29 00:41:10,370 INFO localizer.LocalizedResource > (LocalizedResource.java:handle(203)) - Resource > hdfs://zsexp/user/yarn/.slider/cluster/storm1/tmp/application_1428575950531_0021/am/lib/aopalliance-1.0.jar > transitioned from INIT to DOWNLOADING > 2015-04-29 00:41:10,371 INFO localizer.LocalizedResource > (LocalizedResource.java:handle(203)) - Resource > hdfs://zsexp/user/yarn/.slider/cluster/storm1/tmp/application_1428575950531_0021/am/lib/commons-digester-1.8.jar > transitioned from INIT to DOWNLOADING > 2015-04-29 00:41:10,371 INFO localizer.LocalizedResource > (LocalizedResource.java:handle(203)) - Resource > hdfs://zsexp/user/yarn/.slider/cluster/storm1/tmp/application_1428575950531_0021/am/lib/metrics-json-3.0.1.jar > transitioned from INIT to DOWNLOADING > 2015-04-29 00:41:10,371 INFO localizer.LocalizedResource > (LocalizedResource.java:handle(203)) - Resource > hdfs://zsexp/user/yarn/.slider/cluster/storm1/tmp/application_1428575950531_0021/am/lib/commons-compress-1.4.1.jar > transitioned from INIT to DOWNLOADING > 2015-04-29 00:41:10,371 INFO localizer.LocalizedResource > (LocalizedResource.java:handle(203)) - Resource > hdfs://zsexp/user/yarn/.slider/cluster/storm1/tmp/application_1428575950531_0021/am/lib/hadoop-mapreduce-client-jobclient-2.6.0.jar > transitioned from INIT to DOWNLOADING > 2015-04-29 00:41:10,372 INFO localizer.LocalizedResource > (LocalizedResource.java:handle(203)) - Resource > hdfs://zsexp/user/yarn/.slider/cluster/storm1/tmp/application_1428575950531_0021/am/lib/commons-net-3.1.jar > transitioned from INIT to DOWNLOADING > 2015-04-29 00:41:10,372 INFO localizer.LocalizedResource > (LocalizedResource.java:handle(203)) - Resource > hdfs://zsexp/user/yarn/.slider/cluster/storm1/tmp/application_1428575950531_0021/am/lib/hadoop-yarn-server-common-2.6.0.jar > transitioned from INIT to DOWNLOADING > 2015-04-29 00:41:10,372 INFO localizer.LocalizedResource > (LocalizedResource.java:handle(203)) - Resource > hdfs://zsexp/user/yarn/.slider/cluster/storm1/tmp/application_1428575950531_0021/am/lib/jetty-6.1.26.jar > transitioned from INIT to DOWNLOADING > 2015-04-29 00:41:10,372 INFO localizer.LocalizedResource > (LocalizedResource.java:handle(203)) - Resource > hdfs://zsexp/user/yarn/.slider/cluster/storm1/tmp/application_1428575950531_0021/am/lib/jcommander-1.30.jar > transitioned from INIT to DOWNLOADING > 2015-04-29 00:41:10,373 INFO localizer.LocalizedResource > (LocalizedResource.java:handle(203)) - Resource > hdfs://zsexp/user/yarn/.slider/cluster/storm1/tmp/application_1428575950531_0021/am/lib/httpclient-4.2.5.jar > transitioned from INIT to DOWNLOADING > 2015-04-29 00:41:10,373 INFO localizer.LocalizedResource > (LocalizedResource.java:handle(203)) - Resource > hdfs://zsexp/user/yarn/.slider/cluster/storm1/tmp/application_1428575950531_0021/am/lib/hadoop-yarn-common-2.6.0.jar > transitioned from INIT to DOWNLOADING > 2015-04-29 00:41:10,373 INFO localizer.LocalizedResource > (LocalizedResource.java:handle(203)) - Resource > hdfs://zsexp/user/yarn/.slider/cluster/storm1/tmp/application_1428575950531_0021/am/lib/xz-1.0.jar > transitioned from INIT to DOWNLOADING > 2015-04-29 00:41:10,373 INFO localizer.LocalizedResource > (LocalizedResource.java:handle(203)) - Resource > hdfs://zsexp/user/yarn/.slider/cluster/storm1/tmp/application_1428575950531_0021/am/lib/apacheds-kerberos-codec-2.0.0-M15.jar > transitioned from INIT to DOWNLOADING > 2015-04-29 00:41:10,374 INFO localizer.LocalizedResource > (LocalizedResource.java:handle(203)) - Resource > hdfs://zsexp/user/yarn/.slider/cluster/storm1/tmp/application_1428575950531_0021/am/lib/commons-beanutils-core-1.8.0.jar > transitioned from INIT to DOWNLOADING > 2015-04-29 00:41:10,374 INFO localizer.LocalizedResource > (LocalizedResource.java:handle(203)) - Resource > hdfs://zsexp/user/yarn/.slider/cluster/storm1/tmp/application_1428575950531_0021/am/lib/jackson-xc-1.9.13.jar > transitioned from INIT to DOWNLOADING > 2015-04-29 00:41:10,374 INFO localizer.LocalizedResource > (LocalizedResource.java:handle(203)) - Resource > hdfs://zsexp/user/yarn/.slider/cluster/storm1/tmp/application_1428575950531_0021/am/lib/metrics-healthchecks-3.0.1.jar > transitioned from INIT to DOWNLOADING > 2015-04-29 00:41:10,374 INFO localizer.LocalizedResource > (LocalizedResource.java:handle(203)) - Resource > hdfs://zsexp/user/yarn/.slider/cluster/storm1/tmp/application_1428575950531_0021/am/lib/commons-io-2.4.jar > transitioned from INIT to DOWNLOADING > 2015-04-29 00:41:10,375 INFO localizer.LocalizedResource > (LocalizedResource.java:handle(203)) - Resource > hdfs://zsexp/user/yarn/.slider/cluster/storm1/tmp/application_1428575950531_0021/am/lib/hadoop-common-2.6.0.jar > transitioned from INIT to DOWNLOADING > 2015-04-29 00:41:10,375 INFO localizer.LocalizedResource > (LocalizedResource.java:handle(203)) - Resource > hdfs://zsexp/user/yarn/.slider/cluster/storm1/tmp/application_1428575950531_0021/am/lib/guava-11.0.2.jar > transitioned from INIT to DOWNLOADING > 2015-04-29 00:41:10,375 INFO localizer.LocalizedResource > (LocalizedResource.java:handle(203)) - Resource > hdfs://zsexp/user/yarn/.slider/cluster/storm1/tmp/application_1428575950531_0021/am/lib/commons-collections-3.2.1.jar > transitioned from INIT to DOWNLOADING > 2015-04-29 00:41:10,375 INFO localizer.LocalizedResource > (LocalizedResource.java:handle(203)) - Resource > hdfs://zsexp/user/yarn/.slider/cluster/storm1/tmp/application_1428575950531_0021/am/lib/jersey-client-1.9.jar > transitioned from INIT to DOWNLOADING > 2015-04-29 00:41:10,376 INFO localizer.LocalizedResource > (LocalizedResource.java:handle(203)) - Resource > hdfs://zsexp/user/yarn/.slider/cluster/storm1/tmp/application_1428575950531_0021/am/lib/servlet-api-2.5.jar > transitioned from INIT to DOWNLOADING > 2015-04-29 00:41:10,376 INFO localizer.LocalizedResource > (LocalizedResource.java:handle(203)) - Resource > hdfs://zsexp/user/yarn/.slider/cluster/storm1/tmp/application_1428575950531_0021/am/lib/protobuf-java-2.5.0.jar > transitioned from INIT to DOWNLOADING > 2015-04-29 00:41:10,376 INFO localizer.LocalizedResource > (LocalizedResource.java:handle(203)) - Resource > hdfs://zsexp/user/yarn/.slider/cluster/storm1/tmp/application_1428575950531_0021/am/lib/snappy-java-1.0.4.1.jar > transitioned from INIT to DOWNLOADING > 2015-04-29 00:41:10,376 INFO localizer.LocalizedResource > (LocalizedResource.java:handle(203)) - Resource > hdfs://zsexp/user/yarn/.slider/cluster/storm1/tmp/application_1428575950531_0021/am/lib/jline-0.9.94.jar > transitioned from INIT to DOWNLOADING > 2015-04-29 00:41:10,377 INFO localizer.LocalizedResource > (LocalizedResource.java:handle(203)) - Resource > hdfs://zsexp/user/yarn/.slider/cluster/storm1/tmp/application_1428575950531_0021/am/lib/apacheds-i18n-2.0.0-M15.jar > transitioned from INIT to DOWNLOADING > 2015-04-29 00:41:10,377 INFO localizer.LocalizedResource > (LocalizedResource.java:handle(203)) - Resource > hdfs://zsexp/user/yarn/.slider/cluster/storm1/tmp/application_1428575950531_0021/am/lib/jaxb-api-2.2.7.jar > transitioned from INIT to DOWNLOADING > 2015-04-29 00:41:10,377 INFO localizer.LocalizedResource > (LocalizedResource.java:handle(203)) - Resource > hdfs://zsexp/user/yarn/.slider/cluster/storm1/tmp/application_1428575950531_0021/am/lib/leveldbjni-all-1.8.jar > transitioned from INIT to DOWNLOADING > 2015-04-29 00:41:10,377 INFO localizer.LocalizedResource > (LocalizedResource.java:handle(203)) - Resource > hdfs://zsexp/user/yarn/.slider/cluster/storm1/tmp/application_1428575950531_0021/am/lib/gson-2.2.2.jar > transitioned from INIT to DOWNLOADING > 2015-04-29 00:41:10,378 INFO localizer.LocalizedResource > (LocalizedResource.java:handle(203)) - Resource > hdfs://zsexp/user/yarn/.slider/cluster/storm1/tmp/application_1428575950531_0021/am/lib/hadoop-mapreduce-client-app-2.6.0.jar > transitioned from INIT to DOWNLOADING > 2015-04-29 00:41:10,378 INFO localizer.LocalizedResource > (LocalizedResource.java:handle(203)) - Resource > hdfs://zsexp/user/yarn/.slider/cluster/storm1/tmp/application_1428575950531_0021/am/lib/slider.jar > transitioned from INIT to DOWNLOADING > 2015-04-29 00:41:10,378 INFO localizer.LocalizedResource > (LocalizedResource.java:handle(203)) - Resource > hdfs://zsexp/user/yarn/.slider/cluster/storm1/tmp/application_1428575950531_0021/am/lib/jackson-jaxrs-1.9.13.jar > transitioned from INIT to DOWNLOADING > 2015-04-29 00:41:10,378 INFO localizer.LocalizedResource > (LocalizedResource.java:handle(203)) - Resource > hdfs://zsexp/user/yarn/.slider/cluster/storm1/tmp/application_1428575950531_0021/am/lib/hadoop-annotations-2.6.0.jar > transitioned from INIT to DOWNLOADING > 2015-04-29 00:41:10,379 INFO localizer.LocalizedResource > (LocalizedResource.java:handle(203)) - Resource > hdfs://zsexp/user/yarn/.slider/cluster/storm1/tmp/application_1428575950531_0021/am/lib/jersey-json-1.9.jar > transitioned from INIT to DOWNLOADING > 2015-04-29 00:41:10,379 INFO localizer.LocalizedResource > (LocalizedResource.java:handle(203)) - Resource > hdfs://zsexp/user/yarn/.slider/cluster/storm1/tmp/application_1428575950531_0021/am/lib/commons-httpclient-3.1.jar > transitioned from INIT to DOWNLOADING > 2015-04-29 00:41:10,379 INFO localizer.LocalizedResource > (LocalizedResource.java:handle(203)) - Resource > hdfs://zsexp/user/yarn/.slider/cluster/storm1/tmp/application_1428575950531_0021/am/lib/jetty-util-6.1.26.jar > transitioned from INIT to DOWNLOADING > 2015-04-29 00:41:10,379 INFO localizer.LocalizedResource > (LocalizedResource.java:handle(203)) - Resource > hdfs://zsexp/user/yarn/.slider/cluster/storm1/tmp/application_1428575950531_0021/am/lib/api-asn1-api-1.0.0-M20.jar > transitioned from INIT to DOWNLOADING > 2015-04-29 00:41:10,380 INFO localizer.LocalizedResource > (LocalizedResource.java:handle(203)) - Resource > hdfs://zsexp/user/yarn/.slider/cluster/storm1/tmp/application_1428575950531_0021/am/lib/jersey-server-1.9.jar > transitioned from INIT to DOWNLOADING > 2015-04-29 00:41:10,380 INFO localizer.LocalizedResource > (LocalizedResource.java:handle(203)) - Resource > hdfs://zsexp/user/yarn/.slider/cluster/storm1/tmp/application_1428575950531_0021/am/lib/commons-cli-1.2.jar > transitioned from INIT to DOWNLOADING > 2015-04-29 00:41:10,380 INFO localizer.LocalizedResource > (LocalizedResource.java:handle(203)) - Resource > hdfs://zsexp/user/yarn/.slider/cluster/storm1/tmp/application_1428575950531_0021/am/lib/metrics-servlets-3.0.1.jar > transitioned from INIT to DOWNLOADING > 2015-04-29 00:41:10,380 INFO localizer.LocalizedResource > (LocalizedResource.java:handle(203)) - Resource > hdfs://zsexp/user/yarn/.slider/cluster/storm1/tmp/application_1428575950531_0021/am/lib/commons-configuration-1.6.jar > transitioned from INIT to DOWNLOADING > 2015-04-29 00:41:10,381 INFO localizer.LocalizedResource > (LocalizedResource.java:handle(203)) - Resource > hdfs://zsexp/user/yarn/.slider/cluster/storm1/tmp/application_1428575950531_0021/am/lib/commons-codec-1.6.jar > transitioned from INIT to DOWNLOADING > 2015-04-29 00:41:10,381 INFO localizer.LocalizedResource > (LocalizedResource.java:handle(203)) - Resource > hdfs://zsexp/user/yarn/.slider/cluster/storm1/tmp/application_1428575950531_0021/am/lib/javax.inject-1.jar > transitioned from INIT to DOWNLOADING > 2015-04-29 00:41:10,381 INFO localizer.LocalizedResource > (LocalizedResource.java:handle(203)) - Resource > hdfs://zsexp/user/yarn/.slider/cluster/storm1/tmp/application_1428575950531_0021/am/lib/jersey-guice-1.9.jar > transitioned from INIT to DOWNLOADING > 2015-04-29 00:41:10,381 INFO localizer.LocalizedResource > (LocalizedResource.java:handle(203)) - Resource > hdfs://zsexp/user/yarn/.slider/cluster/storm1/tmp/application_1428575950531_0021/am/lib/curator-client-2.4.1.jar > transitioned from INIT to DOWNLOADING > 2015-04-29 00:41:10,382 INFO localizer.LocalizedResource > (LocalizedResource.java:handle(203)) - Resource > hdfs://zsexp/user/yarn/.slider/cluster/storm1/tmp/application_1428575950531_0021/am/lib/guice-3.0.jar > transitioned from INIT to DOWNLOADING > 2015-04-29 00:41:10,382 INFO localizer.ResourceLocalizationService > (ResourceLocalizationService.java:handle(694)) - Created localizer for > container_1428575950531_0021_01_000001 > 2015-04-29 00:41:10,384 INFO localizer.ResourceLocalizationService > (ResourceLocalizationService.java:writeCredentials(1148)) - Writing > credentials to the nmPrivate file > /grid/2/hadoop/yarn/local/nmPrivate/container_1428575950531_0021_01_000001.tokens. > Credentials list: > 2015-04-29 00:41:10,494 INFO nodemanager.DefaultContainerExecutor > (DefaultContainerExecutor.java:createUserCacheDirs(606)) - Initializing user > yarn > 2015-04-29 00:41:10,505 INFO nodemanager.DefaultContainerExecutor > (DefaultContainerExecutor.java:startLocalizer(116)) - Copying from > /grid/2/hadoop/yarn/local/nmPrivate/container_1428575950531_0021_01_000001.tokens > to > /grid/4/hadoop/yarn/local/usercache/yarn/appcache/application_1428575950531_0021/container_1428575950531_0021_01_000001.tokens > 2015-04-29 00:41:10,505 INFO nodemanager.DefaultContainerExecutor > (DefaultContainerExecutor.java:startLocalizer(123)) - Localizer CWD set to > /grid/4/hadoop/yarn/local/usercache/yarn/appcache/application_1428575950531_0021 > = > file:/grid/4/hadoop/yarn/local/usercache/yarn/appcache/application_1428575950531_0021 > 2015-04-29 00:41:10,591 INFO localizer.LocalizedResource > (LocalizedResource.java:handle(203)) - Resource > hdfs://zsexp/user/yarn/.slider/cluster/storm1/tmp/application_1428575950531_0021/am/lib/htrace-core-3.0.4.jar(->/grid/2/hadoop/yarn/local/usercache/yarn/appcache/application_1428575950531_0021/filecache/10/htrace-core-3.0.4.jar) > transitioned from DOWNLOADING to LOCALIZED > 2015-04-29 00:41:10,620 INFO localizer.LocalizedResource > (LocalizedResource.java:handle(203)) - Resource > hdfs://zsexp/user/yarn/.slider/cluster/storm1/tmp/application_1428575950531_0021/am/lib/jettison-1.1.jar(->/grid/3/hadoop/yarn/local/usercache/yarn/appcache/application_1428575950531_0021/filecache/11/jettison-1.1.jar) > transitioned from DOWNLOADING to LOCALIZED > 2015-04-29 00:41:10,652 INFO localizer.LocalizedResource > (LocalizedResource.java:handle(203)) - Resource > hdfs://zsexp/user/yarn/.slider/cluster/storm1/tmp/application_1428575950531_0021/am/lib/api-util-1.0.0-M20.jar(->/grid/4/hadoop/yarn/local/usercache/yarn/appcache/application_1428575950531_0021/filecache/12/api-util-1.0.0-M20.jar) > transitioned from DOWNLOADING to LOCALIZED > 2015-04-29 00:41:10,679 INFO localizer.LocalizedResource > (LocalizedResource.java:handle(203)) - Resource > hdfs://zsexp/user/yarn/.slider/cluster/storm1/confdir/log4j-server.properties(->/grid/5/hadoop/yarn/local/usercache/yarn/appcache/application_1428575950531_0021/filecache/13/log4j-server.properties) > transitioned from DOWNLOADING to LOCALIZED > 2015-04-29 00:41:10,707 INFO localizer.LocalizedResource > (LocalizedResource.java:handle(203)) - Resource > hdfs://zsexp/user/yarn/.slider/cluster/storm1/tmp/application_1428575950531_0021/am/lib/httpcore-4.2.5.jar(->/grid/6/hadoop/yarn/local/usercache/yarn/appcache/application_1428575950531_0021/filecache/14/httpcore-4.2.5.jar) > transitioned from DOWNLOADING to LOCALIZED > 2015-04-29 00:41:10,733 INFO localizer.LocalizedResource > (LocalizedResource.java:handle(203)) - Resource > hdfs://zsexp/user/yarn/.slider/cluster/storm1/tmp/application_1428575950531_0021/am/lib/metrics-core-3.0.1.jar(->/grid/1/hadoop/yarn/local/usercache/yarn/appcache/application_1428575950531_0021/filecache/15/metrics-core-3.0.1.jar) > transitioned from DOWNLOADING to LOCALIZED > 2015-04-29 00:41:10,760 INFO localizer.LocalizedResource > (LocalizedResource.java:handle(203)) - Resource > hdfs://zsexp/user/yarn/.slider/cluster/storm1/tmp/application_1428575950531_0021/am/lib/slf4j-log4j12-1.6.1.jar(->/grid/2/hadoop/yarn/local/usercache/yarn/appcache/application_1428575950531_0021/filecache/16/slf4j-log4j12-1.6.1.jar) > transitioned from DOWNLOADING to LOCALIZED > 2015-04-29 00:41:10,786 INFO localizer.LocalizedResource > (LocalizedResource.java:handle(203)) - Resource > hdfs://zsexp/user/yarn/.slider/cluster/storm1/confdir/slider-env.sh(->/grid/3/hadoop/yarn/local/usercache/yarn/appcache/application_1428575950531_0021/filecache/17/slider-env.sh) > transitioned from DOWNLOADING to LOCALIZED > 2015-04-29 00:41:10,813 INFO localizer.LocalizedResource > (LocalizedResource.java:handle(203)) - Resource > hdfs://zsexp/user/yarn/.slider/cluster/storm1/tmp/application_1428575950531_0021/am/lib/hadoop-mapreduce-client-shuffle-2.6.0.jar(->/grid/4/hadoop/yarn/local/usercache/yarn/appcache/application_1428575950531_0021/filecache/18/hadoop-mapreduce-client-shuffle-2.6.0.jar) > transitioned from DOWNLOADING to LOCALIZED > 2015-04-29 00:41:10,846 INFO localizer.LocalizedResource > (LocalizedResource.java:handle(203)) - Resource > hdfs://zsexp/user/yarn/.slider/cluster/storm1/tmp/application_1428575950531_0021/am/lib/xercesImpl-2.9.1.jar(->/grid/5/hadoop/yarn/local/usercache/yarn/appcache/application_1428575950531_0021/filecache/19/xercesImpl-2.9.1.jar) > transitioned from DOWNLOADING to LOCALIZED > 2015-04-29 00:41:10,920 INFO localizer.LocalizedResource > (LocalizedResource.java:handle(203)) - Resource > hdfs://zsexp/user/yarn/.slider/cluster/storm1/tmp/application_1428575950531_0021/am/lib/hadoop-hdfs-2.6.0.jar(->/grid/6/hadoop/yarn/local/usercache/yarn/appcache/application_1428575950531_0021/filecache/20/hadoop-hdfs-2.6.0.jar) > transitioned from DOWNLOADING to LOCALIZED > 2015-04-29 00:41:10,952 INFO localizer.LocalizedResource > (LocalizedResource.java:handle(203)) - Resource > hdfs://zsexp/user/yarn/.slider/cluster/storm1/tmp/application_1428575950531_0021/am/lib/commons-beanutils-1.7.0.jar(->/grid/1/hadoop/yarn/local/usercache/yarn/appcache/application_1428575950531_0021/filecache/21/commons-beanutils-1.7.0.jar) > transitioned from DOWNLOADING to LOCALIZED > 2015-04-29 00:41:10,979 INFO localizer.LocalizedResource > (LocalizedResource.java:handle(203)) - Resource > hdfs://zsexp/user/yarn/.slider/cluster/storm1/tmp/application_1428575950531_0021/am/lib/stax-api-1.0.1.jar(->/grid/2/hadoop/yarn/local/usercache/yarn/appcache/application_1428575950531_0021/filecache/22/stax-api-1.0.1.jar) > transitioned from DOWNLOADING to LOCALIZED > 2015-04-29 00:41:11,135 INFO localizer.LocalizedResource > (LocalizedResource.java:handle(203)) - Resource > hdfs://zsexp/user/yarn/.slider/cluster/storm1/tmp/application_1428575950531_0021/agent/slider-agent.tar.gz(->/grid/3/hadoop/yarn/local/usercache/yarn/appcache/application_1428575950531_0021/filecache/23/slider-agent.tar.gz) > transitioned from DOWNLOADING to LOCALIZED > 2015-04-29 00:41:11,164 INFO localizer.LocalizedResource > (LocalizedResource.java:handle(203)) - Resource > hdfs://zsexp/user/yarn/.slider/cluster/storm1/tmp/application_1428575950531_0021/am/lib/hadoop-yarn-registry-2.6.0.jar(->/grid/4/hadoop/yarn/local/usercache/yarn/appcache/application_1428575950531_0021/filecache/24/hadoop-yarn-registry-2.6.0.jar) > transitioned from DOWNLOADING to LOCALIZED > 2015-04-29 00:41:11,192 INFO localizer.LocalizedResource > (LocalizedResource.java:handle(203)) - Resource > hdfs://zsexp/user/yarn/.slider/cluster/storm1/tmp/application_1428575950531_0021/am/lib/xmlenc-0.52.jar(->/grid/5/hadoop/yarn/local/usercache/yarn/appcache/application_1428575950531_0021/filecache/25/xmlenc-0.52.jar) > transitioned from DOWNLOADING to LOCALIZED > 2015-04-29 00:41:11,224 INFO localizer.LocalizedResource > (LocalizedResource.java:handle(203)) - Resource > hdfs://zsexp/user/yarn/.slider/cluster/storm1/tmp/application_1428575950531_0021/am/lib/jackson-core-asl-1.9.13.jar(->/grid/6/hadoop/yarn/local/usercache/yarn/appcache/application_1428575950531_0021/filecache/26/jackson-core-asl-1.9.13.jar) > transitioned from DOWNLOADING to LOCALIZED > 2015-04-29 00:41:11,250 INFO localizer.LocalizedResource > (LocalizedResource.java:handle(203)) - Resource > hdfs://zsexp/user/yarn/.slider/cluster/storm1/tmp/application_1428575950531_0021/am/lib/metrics-jvm-3.0.1.jar(->/grid/1/hadoop/yarn/local/usercache/yarn/appcache/application_1428575950531_0021/filecache/27/metrics-jvm-3.0.1.jar) > transitioned from DOWNLOADING to LOCALIZED > 2015-04-29 00:41:11,276 INFO localizer.LocalizedResource > (LocalizedResource.java:handle(203)) - Resource > hdfs://zsexp/user/yarn/.slider/cluster/storm1/tmp/application_1428575950531_0021/am/lib/paranamer-2.3.jar(->/grid/2/hadoop/yarn/local/usercache/yarn/appcache/application_1428575950531_0021/filecache/28/paranamer-2.3.jar) > transitioned from DOWNLOADING to LOCALIZED > 2015-04-29 00:41:11,320 INFO localizer.LocalizedResource > (LocalizedResource.java:handle(203)) - Resource > hdfs://zsexp/user/yarn/.slider/cluster/storm1/tmp/application_1428575950531_0021/am/lib/slider-core-0.70.1-incubating.jar(->/grid/3/hadoop/yarn/local/usercache/yarn/appcache/application_1428575950531_0021/filecache/29/slider-core-0.70.1-incubating.jar) > transitioned from DOWNLOADING to LOCALIZED > 2015-04-29 00:41:11,355 INFO localizer.LocalizedResource > (LocalizedResource.java:handle(203)) - Resource > hdfs://zsexp/user/yarn/.slider/cluster/storm1/tmp/application_1428575950531_0021/am/lib/log4j-1.2.17.jar(->/grid/4/hadoop/yarn/local/usercache/yarn/appcache/application_1428575950531_0021/filecache/30/log4j-1.2.17.jar) > transitioned from DOWNLOADING to LOCALIZED > 2015-04-29 00:41:11,381 INFO localizer.LocalizedResource > (LocalizedResource.java:handle(203)) - Resource > hdfs://zsexp/user/yarn/.slider/cluster/storm1/confdir/slider-client.xml(->/grid/5/hadoop/yarn/local/usercache/yarn/appcache/application_1428575950531_0021/filecache/31/slider-client.xml) > transitioned from DOWNLOADING to LOCALIZED > 2015-04-29 00:41:11,414 INFO localizer.LocalizedResource > (LocalizedResource.java:handle(203)) - Resource > hdfs://zsexp/user/yarn/.slider/cluster/storm1/tmp/application_1428575950531_0021/am/lib/jackson-databind-2.2.2.jar(->/grid/6/hadoop/yarn/local/usercache/yarn/appcache/application_1428575950531_0021/filecache/32/jackson-databind-2.2.2.jar) > transitioned from DOWNLOADING to LOCALIZED > 2015-04-29 00:41:11,441 INFO localizer.LocalizedResource > (LocalizedResource.java:handle(203)) - Resource > hdfs://zsexp/user/yarn/.slider/cluster/storm1/tmp/application_1428575950531_0021/am/lib/guice-servlet-3.0.jar(->/grid/1/hadoop/yarn/local/usercache/yarn/appcache/application_1428575950531_0021/filecache/33/guice-servlet-3.0.jar) > transitioned from DOWNLOADING to LOCALIZED > 2015-04-29 00:41:11,468 INFO localizer.LocalizedResource > (LocalizedResource.java:handle(203)) - Resource > hdfs://zsexp/user/yarn/.slider/cluster/storm1/tmp/application_1428575950531_0021/am/lib/xml-apis-1.3.04.jar(->/grid/2/hadoop/yarn/local/usercache/yarn/appcache/application_1428575950531_0021/filecache/34/xml-apis-1.3.04.jar) > transitioned from DOWNLOADING to LOCALIZED > 2015-04-29 00:41:11,494 INFO localizer.LocalizedResource > (LocalizedResource.java:handle(203)) - Resource > hdfs://zsexp/user/yarn/.slider/cluster/storm1/confdir/log4j.properties(->/grid/3/hadoop/yarn/local/usercache/yarn/appcache/application_1428575950531_0021/filecache/35/log4j.properties) > transitioned from DOWNLOADING to LOCALIZED > 2015-04-29 00:41:11,519 INFO localizer.LocalizedResource > (LocalizedResource.java:handle(203)) - Resource > hdfs://zsexp/user/yarn/.slider/cluster/storm1/confdir/slider-server.xml(->/grid/4/hadoop/yarn/local/usercache/yarn/appcache/application_1428575950531_0021/filecache/36/slider-server.xml) > transitioned from DOWNLOADING to LOCALIZED > 2015-04-29 00:41:11,558 INFO localizer.LocalizedResource > (LocalizedResource.java:handle(203)) - Resource > hdfs://zsexp/user/yarn/.slider/cluster/storm1/tmp/application_1428575950531_0021/am/lib/jaxb-impl-2.2.3-1.jar(->/grid/5/hadoop/yarn/local/usercache/yarn/appcache/application_1428575950531_0021/filecache/37/jaxb-impl-2.2.3-1.jar) > transitioned from DOWNLOADING to LOCALIZED > 2015-04-29 00:41:11,585 INFO localizer.LocalizedResource > (LocalizedResource.java:handle(203)) - Resource > hdfs://zsexp/user/yarn/.slider/cluster/storm1/tmp/application_1428575950531_0021/am/lib/hadoop-yarn-server-web-proxy-2.6.0.jar(->/grid/6/hadoop/yarn/local/usercache/yarn/appcache/application_1428575950531_0021/filecache/38/hadoop-yarn-server-web-proxy-2.6.0.jar) > transitioned from DOWNLOADING to LOCALIZED > 2015-04-29 00:41:11,620 INFO localizer.LocalizedResource > (LocalizedResource.java:handle(203)) - Resource > hdfs://zsexp/user/yarn/.slider/cluster/storm1/tmp/application_1428575950531_0021/am/lib/hadoop-mapreduce-client-core-2.6.0.jar(->/grid/1/hadoop/yarn/local/usercache/yarn/appcache/application_1428575950531_0021/filecache/39/hadoop-mapreduce-client-core-2.6.0.jar) > transitioned from DOWNLOADING to LOCALIZED > 2015-04-29 00:41:11,648 INFO localizer.LocalizedResource > (LocalizedResource.java:handle(203)) - Resource > hdfs://zsexp/user/yarn/.slider/cluster/storm1/tmp/application_1428575950531_0021/am/lib/hadoop-yarn-client-2.6.0.jar(->/grid/2/hadoop/yarn/local/usercache/yarn/appcache/application_1428575950531_0021/filecache/40/hadoop-yarn-client-2.6.0.jar) > transitioned from DOWNLOADING to LOCALIZED > 2015-04-29 00:41:11,685 INFO localizer.LocalizedResource > (LocalizedResource.java:handle(203)) - Resource > hdfs://zsexp/user/yarn/.slider/cluster/storm1/tmp/application_1428575950531_0021/am/lib/jackson-mapper-asl-1.9.13.jar(->/grid/3/hadoop/yarn/local/usercache/yarn/appcache/application_1428575950531_0021/filecache/41/jackson-mapper-asl-1.9.13.jar) > transitioned from DOWNLOADING to LOCALIZED > 2015-04-29 00:41:11,712 INFO localizer.LocalizedResource > (LocalizedResource.java:handle(203)) - Resource > hdfs://zsexp/user/yarn/.slider/cluster/storm1/tmp/application_1428575950531_0021/am/lib/asm-3.1.jar(->/grid/4/hadoop/yarn/local/usercache/yarn/appcache/application_1428575950531_0021/filecache/42/asm-3.1.jar) > transitioned from DOWNLOADING to LOCALIZED > 2015-04-29 00:41:11,740 INFO localizer.LocalizedResource > (LocalizedResource.java:handle(203)) - Resource > hdfs://zsexp/user/yarn/.slider/cluster/storm1/tmp/application_1428575950531_0021/am/lib/jetty-sslengine-6.1.26.jar(->/grid/5/hadoop/yarn/local/usercache/yarn/appcache/application_1428575950531_0021/filecache/43/jetty-sslengine-6.1.26.jar) > transitioned from DOWNLOADING to LOCALIZED > 2015-04-29 00:41:11,779 INFO localizer.LocalizedResource > (LocalizedResource.java:handle(203)) - Resource > hdfs://zsexp/user/yarn/.slider/cluster/storm1/tmp/application_1428575950531_0021/am/lib/zookeeper-3.4.6.jar(->/grid/6/hadoop/yarn/local/usercache/yarn/appcache/application_1428575950531_0021/filecache/44/zookeeper-3.4.6.jar) > transitioned from DOWNLOADING to LOCALIZED > 2015-04-29 00:41:11,811 INFO localizer.LocalizedResource > (LocalizedResource.java:handle(203)) - Resource > hdfs://zsexp/user/yarn/.slider/cluster/storm1/tmp/application_1428575950531_0021/am/lib/hadoop-mapreduce-client-common-2.6.0.jar(->/grid/1/hadoop/yarn/local/usercache/yarn/appcache/application_1428575950531_0021/filecache/45/hadoop-mapreduce-client-common-2.6.0.jar) > transitioned from DOWNLOADING to LOCALIZED > 2015-04-29 00:41:11,839 INFO localizer.LocalizedResource > (LocalizedResource.java:handle(203)) - Resource > hdfs://zsexp/user/yarn/.slider/cluster/storm1/tmp/application_1428575950531_0021/am/lib/jsp-api-2.1.jar(->/grid/2/hadoop/yarn/local/usercache/yarn/appcache/application_1428575950531_0021/filecache/46/jsp-api-2.1.jar) > transitioned from DOWNLOADING to LOCALIZED > 2015-04-29 00:41:11,873 INFO localizer.LocalizedResource > (LocalizedResource.java:handle(203)) - Resource > hdfs://zsexp/user/yarn/.slider/cluster/storm1/tmp/application_1428575950531_0021/am/lib/hadoop-auth-2.6.0.jar(->/grid/3/hadoop/yarn/local/usercache/yarn/appcache/application_1428575950531_0021/filecache/47/hadoop-auth-2.6.0.jar) > transitioned from DOWNLOADING to LOCALIZED > 2015-04-29 00:41:11,909 INFO localizer.LocalizedResource > (LocalizedResource.java:handle(203)) - Resource > hdfs://zsexp/user/yarn/.slider/cluster/storm1/tmp/application_1428575950531_0021/am/lib/commons-math3-3.1.1.jar(->/grid/4/hadoop/yarn/local/usercache/yarn/appcache/application_1428575950531_0021/filecache/48/commons-math3-3.1.1.jar) > transitioned from DOWNLOADING to LOCALIZED > 2015-04-29 00:41:11,943 INFO localizer.LocalizedResource > (LocalizedResource.java:handle(203)) - Resource > hdfs://zsexp/user/yarn/.slider/cluster/storm1/tmp/application_1428575950531_0021/am/lib/jersey-core-1.9.jar(->/grid/5/hadoop/yarn/local/usercache/yarn/appcache/application_1428575950531_0021/filecache/49/jersey-core-1.9.jar) > transitioned from DOWNLOADING to LOCALIZED > 2015-04-29 00:41:11,982 INFO localizer.LocalizedResource > (LocalizedResource.java:handle(203)) - Resource > hdfs://zsexp/user/yarn/.slider/cluster/storm1/tmp/application_1428575950531_0021/am/lib/hadoop-yarn-api-2.6.0.jar(->/grid/6/hadoop/yarn/local/usercache/yarn/appcache/application_1428575950531_0021/filecache/50/hadoop-yarn-api-2.6.0.jar) > transitioned from DOWNLOADING to LOCALIZED > 2015-04-29 00:41:12,015 INFO localizer.LocalizedResource > (LocalizedResource.java:handle(203)) - Resource > hdfs://zsexp/user/yarn/.slider/cluster/storm1/tmp/application_1428575950531_0021/am/lib/avro-1.7.4.jar(->/grid/1/hadoop/yarn/local/usercache/yarn/appcache/application_1428575950531_0021/filecache/51/avro-1.7.4.jar) > transitioned from DOWNLOADING to LOCALIZED > 2015-04-29 00:41:12,042 INFO localizer.LocalizedResource > (LocalizedResource.java:handle(203)) - Resource > hdfs://zsexp/user/yarn/.slider/cluster/storm1/tmp/application_1428575950531_0021/am/lib/hadoop-client-2.6.0.jar(->/grid/2/hadoop/yarn/local/usercache/yarn/appcache/application_1428575950531_0021/filecache/52/hadoop-client-2.6.0.jar) > transitioned from DOWNLOADING to LOCALIZED > 2015-04-29 00:41:12,069 INFO localizer.LocalizedResource > (LocalizedResource.java:handle(203)) - Resource > hdfs://zsexp/user/yarn/.slider/cluster/storm1/tmp/application_1428575950531_0021/am/lib/jsr311-api-1.1.1.jar(->/grid/3/hadoop/yarn/local/usercache/yarn/appcache/application_1428575950531_0021/filecache/53/jsr311-api-1.1.1.jar) > transitioned from DOWNLOADING to LOCALIZED > 2015-04-29 00:41:12,097 INFO localizer.LocalizedResource > (LocalizedResource.java:handle(203)) - Resource > hdfs://zsexp/user/yarn/.slider/cluster/storm1/tmp/application_1428575950531_0021/am/lib/jackson-core-2.2.2.jar(->/grid/4/hadoop/yarn/local/usercache/yarn/appcache/application_1428575950531_0021/filecache/54/jackson-core-2.2.2.jar) > transitioned from DOWNLOADING to LOCALIZED > 2015-04-29 00:41:12,127 INFO localizer.LocalizedResource > (LocalizedResource.java:handle(203)) - Resource > hdfs://zsexp/user/yarn/.slider/cluster/storm1/tmp/application_1428575950531_0021/am/lib/curator-framework-2.4.1.jar(->/grid/5/hadoop/yarn/local/usercache/yarn/appcache/application_1428575950531_0021/filecache/55/curator-framework-2.4.1.jar) > transitioned from DOWNLOADING to LOCALIZED > 2015-04-29 00:41:12,172 INFO localizer.LocalizedResource > (LocalizedResource.java:handle(203)) - Resource > hdfs://zsexp/user/yarn/.slider/cluster/storm1/tmp/application_1428575950531_0021/am/lib/netty-3.7.0.Final.jar(->/grid/6/hadoop/yarn/local/usercache/yarn/appcache/application_1428575950531_0021/filecache/56/netty-3.7.0.Final.jar) > transitioned from DOWNLOADING to LOCALIZED > 2015-04-29 00:41:12,218 INFO localizer.LocalizedResource > (LocalizedResource.java:handle(203)) - Resource > hdfs://zsexp/user/yarn/.slider/cluster/storm1/tmp/application_1428575950531_0021/am/lib/commons-logging-1.1.3.jar(->/grid/1/hadoop/yarn/local/usercache/yarn/appcache/application_1428575950531_0021/filecache/57/commons-logging-1.1.3.jar) > transitioned from DOWNLOADING to LOCALIZED > 2015-04-29 00:41:12,247 INFO localizer.LocalizedResource > (LocalizedResource.java:handle(203)) - Resource > hdfs://zsexp/user/yarn/.slider/cluster/storm1/tmp/application_1428575950531_0021/am/lib/commons-lang-2.6.jar(->/grid/2/hadoop/yarn/local/usercache/yarn/appcache/application_1428575950531_0021/filecache/58/commons-lang-2.6.jar) > transitioned from DOWNLOADING to LOCALIZED > 2015-04-29 00:41:12,276 INFO localizer.LocalizedResource > (LocalizedResource.java:handle(203)) - Resource > hdfs://zsexp/user/yarn/.slider/cluster/storm1/tmp/application_1428575950531_0021/am/lib/curator-recipes-2.6.0.jar(->/grid/3/hadoop/yarn/local/usercache/yarn/appcache/application_1428575950531_0021/filecache/59/curator-recipes-2.6.0.jar) > transitioned from DOWNLOADING to LOCALIZED > 2015-04-29 00:41:12,304 INFO localizer.LocalizedResource > (LocalizedResource.java:handle(203)) - Resource > hdfs://zsexp/user/yarn/.slider/cluster/storm1/tmp/application_1428575950531_0021/am/lib/jackson-annotations-2.2.2.jar(->/grid/4/hadoop/yarn/local/usercache/yarn/appcache/application_1428575950531_0021/filecache/60/jackson-annotations-2.2.2.jar) > transitioned from DOWNLOADING to LOCALIZED > 2015-04-29 00:41:12,332 INFO localizer.LocalizedResource > (LocalizedResource.java:handle(203)) - Resource > hdfs://zsexp/user/yarn/.slider/cluster/storm1/tmp/application_1428575950531_0021/am/lib/jsr305-1.3.9.jar(->/grid/5/hadoop/yarn/local/usercache/yarn/appcache/application_1428575950531_0021/filecache/61/jsr305-1.3.9.jar) > transitioned from DOWNLOADING to LOCALIZED > 2015-04-29 00:41:12,359 INFO localizer.LocalizedResource > (LocalizedResource.java:handle(203)) - Resource > hdfs://zsexp/user/yarn/.slider/cluster/storm1/tmp/application_1428575950531_0021/am/lib/slf4j-api-1.7.5.jar(->/grid/6/hadoop/yarn/local/usercache/yarn/appcache/application_1428575950531_0021/filecache/62/slf4j-api-1.7.5.jar) > transitioned from DOWNLOADING to LOCALIZED > 2015-04-29 00:41:12,386 INFO localizer.LocalizedResource > (LocalizedResource.java:handle(203)) - Resource > hdfs://zsexp/user/yarn/.slider/cluster/storm1/tmp/application_1428575950531_0021/am/lib/aopalliance-1.0.jar(->/grid/1/hadoop/yarn/local/usercache/yarn/appcache/application_1428575950531_0021/filecache/63/aopalliance-1.0.jar) > transitioned from DOWNLOADING to LOCALIZED > 2015-04-29 00:41:12,415 INFO localizer.LocalizedResource > (LocalizedResource.java:handle(203)) - Resource > hdfs://zsexp/user/yarn/.slider/cluster/storm1/tmp/application_1428575950531_0021/am/lib/commons-digester-1.8.jar(->/grid/2/hadoop/yarn/local/usercache/yarn/appcache/application_1428575950531_0021/filecache/64/commons-digester-1.8.jar) > transitioned from DOWNLOADING to LOCALIZED > 2015-04-29 00:41:12,442 INFO localizer.LocalizedResource > (LocalizedResource.java:handle(203)) - Resource > hdfs://zsexp/user/yarn/.slider/cluster/storm1/tmp/application_1428575950531_0021/am/lib/metrics-json-3.0.1.jar(->/grid/3/hadoop/yarn/local/usercache/yarn/appcache/application_1428575950531_0021/filecache/65/metrics-json-3.0.1.jar) > transitioned from DOWNLOADING to LOCALIZED > 2015-04-29 00:41:12,473 INFO localizer.LocalizedResource > (LocalizedResource.java:handle(203)) - Resource > hdfs://zsexp/user/yarn/.slider/cluster/storm1/tmp/application_1428575950531_0021/am/lib/commons-compress-1.4.1.jar(->/grid/4/hadoop/yarn/local/usercache/yarn/appcache/application_1428575950531_0021/filecache/66/commons-compress-1.4.1.jar) > transitioned from DOWNLOADING to LOCALIZED > 2015-04-29 00:41:12,506 INFO localizer.LocalizedResource > (LocalizedResource.java:handle(203)) - Resource > hdfs://zsexp/user/yarn/.slider/cluster/storm1/tmp/application_1428575950531_0021/am/lib/hadoop-mapreduce-client-jobclient-2.6.0.jar(->/grid/5/hadoop/yarn/local/usercache/yarn/appcache/application_1428575950531_0021/filecache/67/hadoop-mapreduce-client-jobclient-2.6.0.jar) > transitioned from DOWNLOADING to LOCALIZED > 2015-04-29 00:41:12,536 INFO localizer.LocalizedResource > (LocalizedResource.java:handle(203)) - Resource > hdfs://zsexp/user/yarn/.slider/cluster/storm1/tmp/application_1428575950531_0021/am/lib/commons-net-3.1.jar(->/grid/6/hadoop/yarn/local/usercache/yarn/appcache/application_1428575950531_0021/filecache/68/commons-net-3.1.jar) > transitioned from DOWNLOADING to LOCALIZED > 2015-04-29 00:41:12,565 INFO localizer.LocalizedResource > (LocalizedResource.java:handle(203)) - Resource > hdfs://zsexp/user/yarn/.slider/cluster/storm1/tmp/application_1428575950531_0021/am/lib/hadoop-yarn-server-common-2.6.0.jar(->/grid/1/hadoop/yarn/local/usercache/yarn/appcache/application_1428575950531_0021/filecache/69/hadoop-yarn-server-common-2.6.0.jar) > transitioned from DOWNLOADING to LOCALIZED > 2015-04-29 00:41:12,601 INFO localizer.LocalizedResource > (LocalizedResource.java:handle(203)) - Resource > hdfs://zsexp/user/yarn/.slider/cluster/storm1/tmp/application_1428575950531_0021/am/lib/jetty-6.1.26.jar(->/grid/2/hadoop/yarn/local/usercache/yarn/appcache/application_1428575950531_0021/filecache/70/jetty-6.1.26.jar) > transitioned from DOWNLOADING to LOCALIZED > 2015-04-29 00:41:12,629 INFO localizer.LocalizedResource > (LocalizedResource.java:handle(203)) - Resource > hdfs://zsexp/user/yarn/.slider/cluster/storm1/tmp/application_1428575950531_0021/am/lib/jcommander-1.30.jar(->/grid/3/hadoop/yarn/local/usercache/yarn/appcache/application_1428575950531_0021/filecache/71/jcommander-1.30.jar) > transitioned from DOWNLOADING to LOCALIZED > 2015-04-29 00:41:12,659 INFO localizer.LocalizedResource > (LocalizedResource.java:handle(203)) - Resource > hdfs://zsexp/user/yarn/.slider/cluster/storm1/tmp/application_1428575950531_0021/am/lib/httpclient-4.2.5.jar(->/grid/4/hadoop/yarn/local/usercache/yarn/appcache/application_1428575950531_0021/filecache/72/httpclient-4.2.5.jar) > transitioned from DOWNLOADING to LOCALIZED > 2015-04-29 00:41:12,696 INFO localizer.LocalizedResource > (LocalizedResource.java:handle(203)) - Resource > hdfs://zsexp/user/yarn/.slider/cluster/storm1/tmp/application_1428575950531_0021/am/lib/hadoop-yarn-common-2.6.0.jar(->/grid/5/hadoop/yarn/local/usercache/yarn/appcache/application_1428575950531_0021/filecache/73/hadoop-yarn-common-2.6.0.jar) > transitioned from DOWNLOADING to LOCALIZED > 2015-04-29 00:41:12,727 INFO localizer.LocalizedResource > (LocalizedResource.java:handle(203)) - Resource > hdfs://zsexp/user/yarn/.slider/cluster/storm1/tmp/application_1428575950531_0021/am/lib/xz-1.0.jar(->/grid/6/hadoop/yarn/local/usercache/yarn/appcache/application_1428575950531_0021/filecache/74/xz-1.0.jar) > transitioned from DOWNLOADING to LOCALIZED > 2015-04-29 00:41:12,765 INFO localizer.LocalizedResource > (LocalizedResource.java:handle(203)) - Resource > hdfs://zsexp/user/yarn/.slider/cluster/storm1/tmp/application_1428575950531_0021/am/lib/apacheds-kerberos-codec-2.0.0-M15.jar(->/grid/1/hadoop/yarn/local/usercache/yarn/appcache/application_1428575950531_0021/filecache/75/apacheds-kerberos-codec-2.0.0-M15.jar) > transitioned from DOWNLOADING to LOCALIZED > 2015-04-29 00:41:12,794 INFO localizer.LocalizedResource > (LocalizedResource.java:handle(203)) - Resource > hdfs://zsexp/user/yarn/.slider/cluster/storm1/tmp/application_1428575950531_0021/am/lib/commons-beanutils-core-1.8.0.jar(->/grid/2/hadoop/yarn/local/usercache/yarn/appcache/application_1428575950531_0021/filecache/76/commons-beanutils-core-1.8.0.jar) > transitioned from DOWNLOADING to LOCALIZED > 2015-04-29 00:41:12,822 INFO localizer.LocalizedResource > (LocalizedResource.java:handle(203)) - Resource > hdfs://zsexp/user/yarn/.slider/cluster/storm1/tmp/application_1428575950531_0021/am/lib/jackson-xc-1.9.13.jar(->/grid/3/hadoop/yarn/local/usercache/yarn/appcache/application_1428575950531_0021/filecache/77/jackson-xc-1.9.13.jar) > transitioned from DOWNLOADING to LOCALIZED > 2015-04-29 00:41:12,850 INFO localizer.LocalizedResource > (LocalizedResource.java:handle(203)) - Resource > hdfs://zsexp/user/yarn/.slider/cluster/storm1/tmp/application_1428575950531_0021/am/lib/metrics-healthchecks-3.0.1.jar(->/grid/4/hadoop/yarn/local/usercache/yarn/appcache/application_1428575950531_0021/filecache/78/metrics-healthchecks-3.0.1.jar) > transitioned from DOWNLOADING to LOCALIZED > 2015-04-29 00:41:12,879 INFO localizer.LocalizedResource > (LocalizedResource.java:handle(203)) - Resource > hdfs://zsexp/user/yarn/.slider/cluster/storm1/tmp/application_1428575950531_0021/am/lib/commons-io-2.4.jar(->/grid/5/hadoop/yarn/local/usercache/yarn/appcache/application_1428575950531_0021/filecache/79/commons-io-2.4.jar) > transitioned from DOWNLOADING to LOCALIZED > 2015-04-29 00:41:12,927 INFO localizer.LocalizedResource > (LocalizedResource.java:handle(203)) - Resource > hdfs://zsexp/user/yarn/.slider/cluster/storm1/tmp/application_1428575950531_0021/am/lib/hadoop-common-2.6.0.jar(->/grid/6/hadoop/yarn/local/usercache/yarn/appcache/application_1428575950531_0021/filecache/80/hadoop-common-2.6.0.jar) > transitioned from DOWNLOADING to LOCALIZED > 2015-04-29 00:41:12,964 INFO localizer.LocalizedResource > (LocalizedResource.java:handle(203)) - Resource > hdfs://zsexp/user/yarn/.slider/cluster/storm1/tmp/application_1428575950531_0021/am/lib/guava-11.0.2.jar(->/grid/1/hadoop/yarn/local/usercache/yarn/appcache/application_1428575950531_0021/filecache/81/guava-11.0.2.jar) > transitioned from DOWNLOADING to LOCALIZED > 2015-04-29 00:41:13,001 INFO localizer.LocalizedResource > (LocalizedResource.java:handle(203)) - Resource > hdfs://zsexp/user/yarn/.slider/cluster/storm1/tmp/application_1428575950531_0021/am/lib/commons-collections-3.2.1.jar(->/grid/2/hadoop/yarn/local/usercache/yarn/appcache/application_1428575950531_0021/filecache/82/commons-collections-3.2.1.jar) > transitioned from DOWNLOADING to LOCALIZED > 2015-04-29 00:41:13,028 INFO localizer.LocalizedResource > (LocalizedResource.java:handle(203)) - Resource > hdfs://zsexp/user/yarn/.slider/cluster/storm1/tmp/application_1428575950531_0021/am/lib/jersey-client-1.9.jar(->/grid/3/hadoop/yarn/local/usercache/yarn/appcache/application_1428575950531_0021/filecache/83/jersey-client-1.9.jar) > transitioned from DOWNLOADING to LOCALIZED > 2015-04-29 00:41:13,057 INFO localizer.LocalizedResource > (LocalizedResource.java:handle(203)) - Resource > hdfs://zsexp/user/yarn/.slider/cluster/storm1/tmp/application_1428575950531_0021/am/lib/servlet-api-2.5.jar(->/grid/4/hadoop/yarn/local/usercache/yarn/appcache/application_1428575950531_0021/filecache/84/servlet-api-2.5.jar) > transitioned from DOWNLOADING to LOCALIZED > 2015-04-29 00:41:13,093 INFO localizer.LocalizedResource > (LocalizedResource.java:handle(203)) - Resource > hdfs://zsexp/user/yarn/.slider/cluster/storm1/tmp/application_1428575950531_0021/am/lib/protobuf-java-2.5.0.jar(->/grid/5/hadoop/yarn/local/usercache/yarn/appcache/application_1428575950531_0021/filecache/85/protobuf-java-2.5.0.jar) > transitioned from DOWNLOADING to LOCALIZED > 2015-04-29 00:41:13,133 INFO localizer.LocalizedResource > (LocalizedResource.java:handle(203)) - Resource > hdfs://zsexp/user/yarn/.slider/cluster/storm1/tmp/application_1428575950531_0021/am/lib/snappy-java-1.0.4.1.jar(->/grid/6/hadoop/yarn/local/usercache/yarn/appcache/application_1428575950531_0021/filecache/86/snappy-java-1.0.4.1.jar) > transitioned from DOWNLOADING to LOCALIZED > 2015-04-29 00:41:13,166 INFO localizer.LocalizedResource > (LocalizedResource.java:handle(203)) - Resource > hdfs://zsexp/user/yarn/.slider/cluster/storm1/tmp/application_1428575950531_0021/am/lib/jline-0.9.94.jar(->/grid/1/hadoop/yarn/local/usercache/yarn/appcache/application_1428575950531_0021/filecache/87/jline-0.9.94.jar) > transitioned from DOWNLOADING to LOCALIZED > 2015-04-29 00:41:13,194 INFO localizer.LocalizedResource > (LocalizedResource.java:handle(203)) - Resource > hdfs://zsexp/user/yarn/.slider/cluster/storm1/tmp/application_1428575950531_0021/am/lib/apacheds-i18n-2.0.0-M15.jar(->/grid/2/hadoop/yarn/local/usercache/yarn/appcache/application_1428575950531_0021/filecache/88/apacheds-i18n-2.0.0-M15.jar) > transitioned from DOWNLOADING to LOCALIZED > 2015-04-29 00:41:13,223 INFO localizer.LocalizedResource > (LocalizedResource.java:handle(203)) - Resource > hdfs://zsexp/user/yarn/.slider/cluster/storm1/tmp/application_1428575950531_0021/am/lib/jaxb-api-2.2.7.jar(->/grid/3/hadoop/yarn/local/usercache/yarn/appcache/application_1428575950531_0021/filecache/89/jaxb-api-2.2.7.jar) > transitioned from DOWNLOADING to LOCALIZED > 2015-04-29 00:41:13,265 INFO localizer.LocalizedResource > (LocalizedResource.java:handle(203)) - Resource > hdfs://zsexp/user/yarn/.slider/cluster/storm1/tmp/application_1428575950531_0021/am/lib/leveldbjni-all-1.8.jar(->/grid/4/hadoop/yarn/local/usercache/yarn/appcache/application_1428575950531_0021/filecache/90/leveldbjni-all-1.8.jar) > transitioned from DOWNLOADING to LOCALIZED > 2015-04-29 00:41:13,296 INFO localizer.LocalizedResource > (LocalizedResource.java:handle(203)) - Resource > hdfs://zsexp/user/yarn/.slider/cluster/storm1/tmp/application_1428575950531_0021/am/lib/gson-2.2.2.jar(->/grid/5/hadoop/yarn/local/usercache/yarn/appcache/application_1428575950531_0021/filecache/91/gson-2.2.2.jar) > transitioned from DOWNLOADING to LOCALIZED > 2015-04-29 00:41:13,333 INFO localizer.LocalizedResource > (LocalizedResource.java:handle(203)) - Resource > hdfs://zsexp/user/yarn/.slider/cluster/storm1/tmp/application_1428575950531_0021/am/lib/hadoop-mapreduce-client-app-2.6.0.jar(->/grid/6/hadoop/yarn/local/usercache/yarn/appcache/application_1428575950531_0021/filecache/92/hadoop-mapreduce-client-app-2.6.0.jar) > transitioned from DOWNLOADING to LOCALIZED > 2015-04-29 00:41:13,369 INFO localizer.LocalizedResource > (LocalizedResource.java:handle(203)) - Resource > hdfs://zsexp/user/yarn/.slider/cluster/storm1/tmp/application_1428575950531_0021/am/lib/slider.jar(->/grid/1/hadoop/yarn/local/usercache/yarn/appcache/application_1428575950531_0021/filecache/93/slider.jar) > transitioned from DOWNLOADING to LOCALIZED > 2015-04-29 00:41:13,397 INFO localizer.LocalizedResource > (LocalizedResource.java:handle(203)) - Resource > hdfs://zsexp/user/yarn/.slider/cluster/storm1/tmp/application_1428575950531_0021/am/lib/jackson-jaxrs-1.9.13.jar(->/grid/2/hadoop/yarn/local/usercache/yarn/appcache/application_1428575950531_0021/filecache/94/jackson-jaxrs-1.9.13.jar) > transitioned from DOWNLOADING to LOCALIZED > 2015-04-29 00:41:13,427 INFO localizer.LocalizedResource > (LocalizedResource.java:handle(203)) - Resource > hdfs://zsexp/user/yarn/.slider/cluster/storm1/tmp/application_1428575950531_0021/am/lib/hadoop-annotations-2.6.0.jar(->/grid/3/hadoop/yarn/local/usercache/yarn/appcache/application_1428575950531_0021/filecache/95/hadoop-annotations-2.6.0.jar) > transitioned from DOWNLOADING to LOCALIZED > 2015-04-29 00:41:13,457 INFO localizer.LocalizedResource > (LocalizedResource.java:handle(203)) - Resource > hdfs://zsexp/user/yarn/.slider/cluster/storm1/tmp/application_1428575950531_0021/am/lib/jersey-json-1.9.jar(->/grid/4/hadoop/yarn/local/usercache/yarn/appcache/application_1428575950531_0021/filecache/96/jersey-json-1.9.jar) > transitioned from DOWNLOADING to LOCALIZED > 2015-04-29 00:41:13,487 INFO localizer.LocalizedResource > (LocalizedResource.java:handle(203)) - Resource > hdfs://zsexp/user/yarn/.slider/cluster/storm1/tmp/application_1428575950531_0021/am/lib/commons-httpclient-3.1.jar(->/grid/5/hadoop/yarn/local/usercache/yarn/appcache/application_1428575950531_0021/filecache/97/commons-httpclient-3.1.jar) > transitioned from DOWNLOADING to LOCALIZED > 2015-04-29 00:41:13,516 INFO localizer.LocalizedResource > (LocalizedResource.java:handle(203)) - Resource > hdfs://zsexp/user/yarn/.slider/cluster/storm1/tmp/application_1428575950531_0021/am/lib/jetty-util-6.1.26.jar(->/grid/6/hadoop/yarn/local/usercache/yarn/appcache/application_1428575950531_0021/filecache/98/jetty-util-6.1.26.jar) > transitioned from DOWNLOADING to LOCALIZED > 2015-04-29 00:41:13,544 INFO localizer.LocalizedResource > (LocalizedResource.java:handle(203)) - Resource > hdfs://zsexp/user/yarn/.slider/cluster/storm1/tmp/application_1428575950531_0021/am/lib/api-asn1-api-1.0.0-M20.jar(->/grid/1/hadoop/yarn/local/usercache/yarn/appcache/application_1428575950531_0021/filecache/99/api-asn1-api-1.0.0-M20.jar) > transitioned from DOWNLOADING to LOCALIZED > 2015-04-29 00:41:13,576 INFO localizer.LocalizedResource > (LocalizedResource.java:handle(203)) - Resource > hdfs://zsexp/user/yarn/.slider/cluster/storm1/tmp/application_1428575950531_0021/am/lib/jersey-server-1.9.jar(->/grid/2/hadoop/yarn/local/usercache/yarn/appcache/application_1428575950531_0021/filecache/100/jersey-server-1.9.jar) > transitioned from DOWNLOADING to LOCALIZED > 2015-04-29 00:41:13,606 INFO localizer.LocalizedResource > (LocalizedResource.java:handle(203)) - Resource > hdfs://zsexp/user/yarn/.slider/cluster/storm1/tmp/application_1428575950531_0021/am/lib/commons-cli-1.2.jar(->/grid/3/hadoop/yarn/local/usercache/yarn/appcache/application_1428575950531_0021/filecache/101/commons-cli-1.2.jar) > transitioned from DOWNLOADING to LOCALIZED > 2015-04-29 00:41:13,634 INFO localizer.LocalizedResource > (LocalizedResource.java:handle(203)) - Resource > hdfs://zsexp/user/yarn/.slider/cluster/storm1/tmp/application_1428575950531_0021/am/lib/metrics-servlets-3.0.1.jar(->/grid/4/hadoop/yarn/local/usercache/yarn/appcache/application_1428575950531_0021/filecache/102/metrics-servlets-3.0.1.jar) > transitioned from DOWNLOADING to LOCALIZED > 2015-04-29 00:41:13,663 INFO localizer.LocalizedResource > (LocalizedResource.java:handle(203)) - Resource > hdfs://zsexp/user/yarn/.slider/cluster/storm1/tmp/application_1428575950531_0021/am/lib/commons-configuration-1.6.jar(->/grid/5/hadoop/yarn/local/usercache/yarn/appcache/application_1428575950531_0021/filecache/103/commons-configuration-1.6.jar) > transitioned from DOWNLOADING to LOCALIZED > 2015-04-29 00:41:13,692 INFO localizer.LocalizedResource > (LocalizedResource.java:handle(203)) - Resource > hdfs://zsexp/user/yarn/.slider/cluster/storm1/tmp/application_1428575950531_0021/am/lib/commons-codec-1.6.jar(->/grid/6/hadoop/yarn/local/usercache/yarn/appcache/application_1428575950531_0021/filecache/104/commons-codec-1.6.jar) > transitioned from DOWNLOADING to LOCALIZED > 2015-04-29 00:41:13,721 INFO localizer.LocalizedResource > (LocalizedResource.java:handle(203)) - Resource > hdfs://zsexp/user/yarn/.slider/cluster/storm1/tmp/application_1428575950531_0021/am/lib/javax.inject-1.jar(->/grid/1/hadoop/yarn/local/usercache/yarn/appcache/application_1428575950531_0021/filecache/105/javax.inject-1.jar) > transitioned from DOWNLOADING to LOCALIZED > 2015-04-29 00:41:13,750 INFO localizer.LocalizedResource > (LocalizedResource.java:handle(203)) - Resource > hdfs://zsexp/user/yarn/.slider/cluster/storm1/tmp/application_1428575950531_0021/am/lib/jersey-guice-1.9.jar(->/grid/2/hadoop/yarn/local/usercache/yarn/appcache/application_1428575950531_0021/filecache/106/jersey-guice-1.9.jar) > transitioned from DOWNLOADING to LOCALIZED > 2015-04-29 00:41:13,784 INFO localizer.LocalizedResource > (LocalizedResource.java:handle(203)) - Resource > hdfs://zsexp/user/yarn/.slider/cluster/storm1/tmp/application_1428575950531_0021/am/lib/curator-client-2.4.1.jar(->/grid/3/hadoop/yarn/local/usercache/yarn/appcache/application_1428575950531_0021/filecache/107/curator-client-2.4.1.jar) > transitioned from DOWNLOADING to LOCALIZED > 2015-04-29 00:41:13,816 INFO localizer.LocalizedResource > (LocalizedResource.java:handle(203)) - Resource > hdfs://zsexp/user/yarn/.slider/cluster/storm1/tmp/application_1428575950531_0021/am/lib/guice-3.0.jar(->/grid/4/hadoop/yarn/local/usercache/yarn/appcache/application_1428575950531_0021/filecache/108/guice-3.0.jar) > transitioned from DOWNLOADING to LOCALIZED > 2015-04-29 00:41:13,816 INFO container.Container > (ContainerImpl.java:handle(999)) - Container > container_1428575950531_0021_01_000001 transitioned from LOCALIZING to > LOCALIZED > 2015-04-29 00:41:13,862 INFO container.Container > (ContainerImpl.java:handle(999)) - Container > container_1428575950531_0021_01_000001 transitioned from LOCALIZED to RUNNING > 2015-04-29 00:41:13,870 INFO nodemanager.DefaultContainerExecutor > (DefaultContainerExecutor.java:buildCommandExecutor(267)) - launchContainer: > [bash, > /grid/4/hadoop/yarn/local/usercache/yarn/appcache/application_1428575950531_0021/container_1428575950531_0021_01_000001/default_container_executor.sh] > 2015-04-29 00:41:15,618 INFO monitor.ContainersMonitorImpl > (ContainersMonitorImpl.java:run(346)) - Starting resource-monitoring for > container_1428575950531_0021_01_000001 > 2015-04-29 00:41:15,664 INFO monitor.ContainersMonitorImpl > (ContainersMonitorImpl.java:run(408)) - Memory usage of ProcessTree 41169 for > container-id container_1428575950531_0021_01_000001: 68.0 MB of 3.5 GB > physical memory used; 739.0 MB of 7.3 GB virtual memory used > 2015-04-29 00:41:18,681 INFO monitor.ContainersMonitorImpl > (ContainersMonitorImpl.java:run(408)) - Memory usage of ProcessTree 41169 for > container-id container_1428575950531_0021_01_000001: 172.5 MB of 3.5 GB > physical memory used; 774.3 MB of 7.3 GB virtual memory used > 2015-04-29 00:41:21,704 INFO monitor.ContainersMonitorImpl > (ContainersMonitorImpl.java:run(408)) - Memory usage of ProcessTree 41169 for > container-id container_1428575950531_0021_01_000001: 190.4 MB of 3.5 GB > physical memory used; 799.8 MB of 7.3 GB virtual memory used > 2015-04-29 00:41:23,617 INFO ipc.Server (Server.java:saslProcess(1306)) - > Auth successful for appattempt_1428575950531_0021_000001 (auth:SIMPLE) > 2015-04-29 00:41:23,627 INFO containermanager.ContainerManagerImpl > (ContainerManagerImpl.java:startContainerInternal(803)) - Start request for > container_1428575950531_0021_01_000005 by user yarn > 2015-04-29 00:41:23,629 INFO application.Application > (ApplicationImpl.java:transition(304)) - Adding > container_1428575950531_0021_01_000005 to application > application_1428575950531_0021 > 2015-04-29 00:41:23,629 INFO nodemanager.NMAuditLogger > (NMAuditLogger.java:logSuccess(89)) - USER=yarn IP=10.84.104.129 > OPERATION=Start Container Request TARGET=ContainerManageImpl > RESULT=SUCCESS APPID=application_1428575950531_0021 > CONTAINERID=container_1428575950531_0021_01_000005 > 2015-04-29 00:41:23,629 INFO container.Container > (ContainerImpl.java:handle(999)) - Container > container_1428575950531_0021_01_000005 transitioned from NEW to LOCALIZING > 2015-04-29 00:41:23,630 INFO containermanager.AuxServices > (AuxServices.java:handle(196)) - Got event CONTAINER_INIT for appId > application_1428575950531_0021 > 2015-04-29 00:41:23,630 INFO localizer.LocalizedResource > (LocalizedResource.java:handle(203)) - Resource > hdfs://zsexp/user/yarn/.slider/package/STORM/slider-storm-app-package-0.9.3.2.2.0.0-2041.zip > transitioned from INIT to DOWNLOADING > 2015-04-29 00:41:23,631 INFO localizer.ResourceLocalizationService > (ResourceLocalizationService.java:handle(694)) - Created localizer for > container_1428575950531_0021_01_000005 > 2015-04-29 00:41:23,633 INFO localizer.ResourceLocalizationService > (ResourceLocalizationService.java:writeCredentials(1148)) - Writing > credentials to the nmPrivate file > /grid/4/hadoop/yarn/local/nmPrivate/container_1428575950531_0021_01_000005.tokens. > Credentials list: > 2015-04-29 00:41:23,755 INFO nodemanager.DefaultContainerExecutor > (DefaultContainerExecutor.java:createUserCacheDirs(606)) - Initializing user > yarn > 2015-04-29 00:41:23,761 INFO nodemanager.DefaultContainerExecutor > (DefaultContainerExecutor.java:startLocalizer(116)) - Copying from > /grid/4/hadoop/yarn/local/nmPrivate/container_1428575950531_0021_01_000005.tokens > to > /grid/6/hadoop/yarn/local/usercache/yarn/appcache/application_1428575950531_0021/container_1428575950531_0021_01_000005.tokens > 2015-04-29 00:41:23,761 INFO nodemanager.DefaultContainerExecutor > (DefaultContainerExecutor.java:startLocalizer(123)) - Localizer CWD set to > /grid/6/hadoop/yarn/local/usercache/yarn/appcache/application_1428575950531_0021 > = > file:/grid/6/hadoop/yarn/local/usercache/yarn/appcache/application_1428575950531_0021 > 2015-04-29 00:41:23,777 INFO ipc.Server (Server.java:saslProcess(1306)) - > Auth successful for appattempt_1428575950531_0021_000001 (auth:SIMPLE) > 2015-04-29 00:41:23,782 INFO containermanager.ContainerManagerImpl > (ContainerManagerImpl.java:getContainerStatusInternal(1008)) - Getting > container-status for container_1428575950531_0021_01_000005 > 2015-04-29 00:41:23,782 INFO containermanager.ContainerManagerImpl > (ContainerManagerImpl.java:getContainerStatusInternal(1022)) - Returning > ContainerStatus: [ContainerId: container_1428575950531_0021_01_000005, State: > RUNNING, Diagnostics: , ExitStatus: -1000, ] > 2015-04-29 00:41:24,251 INFO localizer.LocalizedResource > (LocalizedResource.java:handle(203)) - Resource > hdfs://zsexp/user/yarn/.slider/package/STORM/slider-storm-app-package-0.9.3.2.2.0.0-2041.zip(->/grid/4/hadoop/yarn/local/usercache/yarn/appcache/application_1428575950531_0021/filecache/109/slider-storm-app-package-0.9.3.2.2.0.0-2041.zip) > transitioned from DOWNLOADING to LOCALIZED > 2015-04-29 00:41:24,251 INFO container.Container > (ContainerImpl.java:handle(999)) - Container > container_1428575950531_0021_01_000005 transitioned from LOCALIZING to > LOCALIZED > 2015-04-29 00:41:24,299 INFO container.Container > (ContainerImpl.java:handle(999)) - Container > container_1428575950531_0021_01_000005 transitioned from LOCALIZED to RUNNING > 2015-04-29 00:41:24,307 INFO nodemanager.DefaultContainerExecutor > (DefaultContainerExecutor.java:buildCommandExecutor(267)) - launchContainer: > [bash, > /grid/3/hadoop/yarn/local/usercache/yarn/appcache/application_1428575950531_0021/container_1428575950531_0021_01_000005/default_container_executor.sh] > 2015-04-29 00:41:24,704 INFO monitor.ContainersMonitorImpl > (ContainersMonitorImpl.java:run(346)) - Starting resource-monitoring for > container_1428575950531_0021_01_000005 > 2015-04-29 00:41:24,747 INFO monitor.ContainersMonitorImpl > (ContainersMonitorImpl.java:run(408)) - Memory usage of ProcessTree 41169 for > container-id container_1428575950531_0021_01_000001: 210.6 MB of 3.5 GB > physical memory used; 823.9 MB of 7.3 GB virtual memory used > 2015-04-29 00:41:24,795 INFO monitor.ContainersMonitorImpl > (ContainersMonitorImpl.java:run(408)) - Memory usage of ProcessTree 41585 for > container-id container_1428575950531_0021_01_000005: 14.3 MB of 3.5 GB > physical memory used; 279.9 MB of 7.3 GB virtual memory used > 2015-04-29 00:41:27,837 INFO monitor.ContainersMonitorImpl > (ContainersMonitorImpl.java:run(408)) - Memory usage of ProcessTree 41169 for > container-id container_1428575950531_0021_01_000001: 211.4 MB of 3.5 GB > physical memory used; 824.9 MB of 7.3 GB virtual memory used > 2015-04-29 00:41:27,884 INFO monitor.ContainersMonitorImpl > (ContainersMonitorImpl.java:run(408)) - Memory usage of ProcessTree 41585 for > container-id container_1428575950531_0021_01_000005: 15.0 MB of 3.5 GB > physical memory used; 280.0 MB of 7.3 GB virtual memory used > . > . > . > 2015-04-29 00:55:55,558 INFO monitor.ContainersMonitorImpl > (ContainersMonitorImpl.java:run(408)) - Memory usage of ProcessTree 41169 for > container-id container_1428575950531_0021_01_000001: 222.8 MB of 3.5 GB > physical memory used; 830.9 MB of 7.3 GB virtual memory used > 2015-04-29 00:55:55,605 INFO monitor.ContainersMonitorImpl > (ContainersMonitorImpl.java:run(408)) - Memory usage of ProcessTree 41585 for > container-id container_1428575950531_0021_01_000005: 15.4 MB of 3.5 GB > physical memory used; 280.3 MB of 7.3 GB virtual memory used > 2015-04-29 00:55:58,646 INFO monitor.ContainersMonitorImpl > (ContainersMonitorImpl.java:run(408)) - Memory usage of ProcessTree 41169 for > container-id container_1428575950531_0021_01_000001: 222.8 MB of 3.5 GB > physical memory used; 830.9 MB of 7.3 GB virtual memory used > 2015-04-29 00:55:58,693 INFO monitor.ContainersMonitorImpl > (ContainersMonitorImpl.java:run(408)) - Memory usage of ProcessTree 41585 for > container-id container_1428575950531_0021_01_000005: 15.4 MB of 3.5 GB > physical memory used; 280.3 MB of 7.3 GB virtual memory used > 2015-04-29 00:56:00,463 INFO ipc.Server (Server.java:saslProcess(1306)) - > Auth successful for appattempt_1428575950531_0021_000001 (auth:SIMPLE) > 2015-04-29 00:56:00,467 INFO containermanager.ContainerManagerImpl > (ContainerManagerImpl.java:stopContainerInternal(953)) - Stopping container > with container Id: container_1428575950531_0021_01_000005 > 2015-04-29 00:56:00,468 INFO nodemanager.NMAuditLogger > (NMAuditLogger.java:logSuccess(89)) - USER=yarn IP=10.84.104.129 > OPERATION=Stop Container Request TARGET=ContainerManageImpl > RESULT=SUCCESS APPID=application_1428575950531_0021 > CONTAINERID=container_1428575950531_0021_01_000005 > 2015-04-29 00:56:00,468 INFO container.Container > (ContainerImpl.java:handle(999)) - Container > container_1428575950531_0021_01_000005 transitioned from RUNNING to KILLING > 2015-04-29 00:56:00,469 INFO launcher.ContainerLaunch > (ContainerLaunch.java:cleanupContainer(370)) - Cleaning up container > container_1428575950531_0021_01_000005 > 2015-04-29 00:56:01,741 INFO monitor.ContainersMonitorImpl > (ContainersMonitorImpl.java:run(408)) - Memory usage of ProcessTree 41169 for > container-id container_1428575950531_0021_01_000001: 1.4 MB of 3.5 GB > physical memory used; 10.9 MB of 7.3 GB virtual memory used > 2015-04-29 00:56:01,763 INFO launcher.ContainerLaunch > (ContainerLaunch.java:call(346)) - Container > container_1428575950531_0021_01_000001 succeeded > 2015-04-29 00:56:01,763 INFO container.Container > (ContainerImpl.java:handle(999)) - Container > container_1428575950531_0021_01_000001 transitioned from RUNNING to > EXITED_WITH_SUCCESS > 2015-04-29 00:56:01,764 INFO launcher.ContainerLaunch > (ContainerLaunch.java:cleanupContainer(370)) - Cleaning up container > container_1428575950531_0021_01_000001 > 2015-04-29 00:56:01,782 INFO monitor.ContainersMonitorImpl > (ContainersMonitorImpl.java:run(408)) - Memory usage of ProcessTree 41585 for > container-id container_1428575950531_0021_01_000005: 15.4 MB of 3.5 GB > physical memory used; 280.3 MB of 7.3 GB virtual memory used > 2015-04-29 00:56:01,816 INFO nodemanager.DefaultContainerExecutor > (DefaultContainerExecutor.java:deleteAsUser(457)) - Deleting absolute path : > /grid/1/hadoop/yarn/local/usercache/yarn/appcache/application_1428575950531_0021/container_1428575950531_0021_01_000001 > 2015-04-29 00:56:01,816 INFO nodemanager.DefaultContainerExecutor > (DefaultContainerExecutor.java:deleteAsUser(457)) - Deleting absolute path : > /grid/2/hadoop/yarn/local/usercache/yarn/appcache/application_1428575950531_0021/container_1428575950531_0021_01_000001 > 2015-04-29 00:56:01,818 INFO nodemanager.DefaultContainerExecutor > (DefaultContainerExecutor.java:deleteAsUser(457)) - Deleting absolute path : > /grid/3/hadoop/yarn/local/usercache/yarn/appcache/application_1428575950531_0021/container_1428575950531_0021_01_000001 > 2015-04-29 00:56:01,819 INFO nodemanager.DefaultContainerExecutor > (DefaultContainerExecutor.java:deleteAsUser(457)) - Deleting absolute path : > /grid/4/hadoop/yarn/local/usercache/yarn/appcache/application_1428575950531_0021/container_1428575950531_0021_01_000001 > 2015-04-29 00:56:01,819 INFO nodemanager.DefaultContainerExecutor > (DefaultContainerExecutor.java:deleteAsUser(457)) - Deleting absolute path : > /grid/5/hadoop/yarn/local/usercache/yarn/appcache/application_1428575950531_0021/container_1428575950531_0021_01_000001 > 2015-04-29 00:56:01,820 INFO nodemanager.DefaultContainerExecutor > (DefaultContainerExecutor.java:deleteAsUser(457)) - Deleting absolute path : > /grid/6/hadoop/yarn/local/usercache/yarn/appcache/application_1428575950531_0021/container_1428575950531_0021_01_000001 > 2015-04-29 00:56:01,820 INFO nodemanager.NMAuditLogger > (NMAuditLogger.java:logSuccess(89)) - USER=yarn OPERATION=Container > Finished - Succeeded TARGET=ContainerImpl RESULT=SUCCESS > APPID=application_1428575950531_0021 > CONTAINERID=container_1428575950531_0021_01_000001 > 2015-04-29 00:56:01,821 INFO container.Container > (ContainerImpl.java:handle(999)) - Container > container_1428575950531_0021_01_000001 transitioned from EXITED_WITH_SUCCESS > to DONE > 2015-04-29 00:56:01,821 INFO application.Application > (ApplicationImpl.java:transition(347)) - Removing > container_1428575950531_0021_01_000001 from application > application_1428575950531_0021 > 2015-04-29 00:56:01,822 INFO logaggregation.AppLogAggregatorImpl > (AppLogAggregatorImpl.java:startContainerLogAggregation(488)) - Considering > container container_1428575950531_0021_01_000001 for log-aggregation > 2015-04-29 00:56:01,822 INFO containermanager.AuxServices > (AuxServices.java:handle(196)) - Got event CONTAINER_STOP for appId > application_1428575950531_0021 > 2015-04-29 00:56:02,490 INFO ipc.Server (Server.java:saslProcess(1306)) - > Auth successful for appattempt_1428575950531_0021_000001 (auth:SIMPLE) > 2015-04-29 00:56:02,496 INFO containermanager.ContainerManagerImpl > (ContainerManagerImpl.java:stopContainerInternal(953)) - Stopping container > with container Id: container_1428575950531_0021_01_000001 > 2015-04-29 00:56:02,497 INFO nodemanager.NMAuditLogger > (NMAuditLogger.java:logSuccess(89)) - USER=yarn IP=10.84.105.162 > OPERATION=Stop Container Request TARGET=ContainerManageImpl > RESULT=SUCCESS APPID=application_1428575950531_0021 > CONTAINERID=container_1428575950531_0021_01_000001 > 2015-04-29 00:56:02,499 INFO application.Application > (ApplicationImpl.java:handle(464)) - Application > application_1428575950531_0021 transitioned from RUNNING to > FINISHING_CONTAINERS_WAIT > 2015-04-29 00:56:04,782 INFO monitor.ContainersMonitorImpl > (ContainersMonitorImpl.java:run(356)) - Stopping resource-monitoring for > container_1428575950531_0021_01_000001 > 2015-04-29 00:56:04,824 INFO monitor.ContainersMonitorImpl > (ContainersMonitorImpl.java:run(408)) - Memory usage of ProcessTree 41585 for > container-id container_1428575950531_0021_01_000005: 15.4 MB of 3.5 GB > physical memory used; 280.3 MB of 7.3 GB virtual memory used > {noformat} > *NM log from host-03 where NIMBUS container was running:* > {noformat} > 2015-04-29 00:41:23,619 INFO ipc.Server (Server.java:saslProcess(1306)) - > Auth successful for appattempt_1428575950531_0021_000001 (auth:SIMPLE) > 2015-04-29 00:41:23,630 INFO containermanager.ContainerManagerImpl > (ContainerManagerImpl.java:startContainerInternal(803)) - Start request for > container_1428575950531_0021_01_000002 by user yarn > 2015-04-29 00:41:23,631 INFO containermanager.ContainerManagerImpl > (ContainerManagerImpl.java:startContainerInternal(843)) - Creating a new > application reference for app application_1428575950531_0021 > 2015-04-29 00:41:23,631 INFO application.Application > (ApplicationImpl.java:handle(464)) - Application > application_1428575950531_0021 transitioned from NEW to INITING > 2015-04-29 00:41:23,632 INFO nodemanager.NMAuditLogger > (NMAuditLogger.java:logSuccess(89)) - USER=yarn IP=10.84.104.129 > OPERATION=Start Container Request TARGET=ContainerManageImpl > RESULT=SUCCESS APPID=application_1428575950531_0021 > CONTAINERID=container_1428575950531_0021_01_000002 > 2015-04-29 00:41:23,635 WARN logaggregation.LogAggregationService > (LogAggregationService.java:verifyAndCreateRemoteLogDir(195)) - Remote Root > Log Dir [/app-logs] already exist, but with incorrect permissions. Expected: > [rwxrwxrwt], Found: [rwxrwxrwx]. The cluster may have problems with multiple > users. > 2015-04-29 00:41:23,636 WARN logaggregation.AppLogAggregatorImpl > (AppLogAggregatorImpl.java:<init>(182)) - rollingMonitorInterval is set as > -1. The log rolling mornitoring interval is disabled. The logs will be > aggregated after this application is finished. > 2015-04-29 00:41:23,646 INFO application.Application > (ApplicationImpl.java:transition(304)) - Adding > container_1428575950531_0021_01_000002 to application > application_1428575950531_0021 > 2015-04-29 00:41:23,647 INFO application.Application > (ApplicationImpl.java:handle(464)) - Application > application_1428575950531_0021 transitioned from INITING to RUNNING > 2015-04-29 00:41:23,647 INFO container.Container > (ContainerImpl.java:handle(999)) - Container > container_1428575950531_0021_01_000002 transitioned from NEW to LOCALIZING > 2015-04-29 00:41:23,648 INFO containermanager.AuxServices > (AuxServices.java:handle(196)) - Got event CONTAINER_INIT for appId > application_1428575950531_0021 > 2015-04-29 00:41:23,648 INFO localizer.LocalizedResource > (LocalizedResource.java:handle(203)) - Resource > hdfs://zsexp/user/yarn/.slider/cluster/storm1/tmp/application_1428575950531_0021/agent/slider-agent.tar.gz > transitioned from INIT to DOWNLOADING > 2015-04-29 00:41:23,648 INFO localizer.LocalizedResource > (LocalizedResource.java:handle(203)) - Resource > hdfs://zsexp/user/yarn/.slider/package/STORM/slider-storm-app-package-0.9.3.2.2.0.0-2041.zip > transitioned from INIT to DOWNLOADING > 2015-04-29 00:41:23,648 INFO localizer.ResourceLocalizationService > (ResourceLocalizationService.java:handle(694)) - Created localizer for > container_1428575950531_0021_01_000002 > 2015-04-29 00:41:23,651 INFO localizer.ResourceLocalizationService > (ResourceLocalizationService.java:writeCredentials(1148)) - Writing > credentials to the nmPrivate file > /grid/2/hadoop/yarn/local/nmPrivate/container_1428575950531_0021_01_000002.tokens. > Credentials list: > 2015-04-29 00:41:23,766 INFO nodemanager.DefaultContainerExecutor > (DefaultContainerExecutor.java:createUserCacheDirs(606)) - Initializing user > yarn > 2015-04-29 00:41:23,773 INFO nodemanager.DefaultContainerExecutor > (DefaultContainerExecutor.java:startLocalizer(116)) - Copying from > /grid/2/hadoop/yarn/local/nmPrivate/container_1428575950531_0021_01_000002.tokens > to > /grid/5/hadoop/yarn/local/usercache/yarn/appcache/application_1428575950531_0021/container_1428575950531_0021_01_000002.tokens > 2015-04-29 00:41:23,774 INFO nodemanager.DefaultContainerExecutor > (DefaultContainerExecutor.java:startLocalizer(123)) - Localizer CWD set to > /grid/5/hadoop/yarn/local/usercache/yarn/appcache/application_1428575950531_0021 > = > file:/grid/5/hadoop/yarn/local/usercache/yarn/appcache/application_1428575950531_0021 > 2015-04-29 00:41:23,807 INFO ipc.Server (Server.java:saslProcess(1306)) - > Auth successful for appattempt_1428575950531_0021_000001 (auth:SIMPLE) > 2015-04-29 00:41:23,812 INFO containermanager.ContainerManagerImpl > (ContainerManagerImpl.java:getContainerStatusInternal(1008)) - Getting > container-status for container_1428575950531_0021_01_000002 > 2015-04-29 00:41:23,812 INFO containermanager.ContainerManagerImpl > (ContainerManagerImpl.java:getContainerStatusInternal(1022)) - Returning > ContainerStatus: [ContainerId: container_1428575950531_0021_01_000002, State: > RUNNING, Diagnostics: , ExitStatus: -1000, ] > 2015-04-29 00:41:23,991 INFO localizer.LocalizedResource > (LocalizedResource.java:handle(203)) - Resource > hdfs://zsexp/user/yarn/.slider/cluster/storm1/tmp/application_1428575950531_0021/agent/slider-agent.tar.gz(->/grid/2/hadoop/yarn/local/usercache/yarn/appcache/application_1428575950531_0021/filecache/10/slider-agent.tar.gz) > transitioned from DOWNLOADING to LOCALIZED > 2015-04-29 00:41:24,344 INFO localizer.LocalizedResource > (LocalizedResource.java:handle(203)) - Resource > hdfs://zsexp/user/yarn/.slider/package/STORM/slider-storm-app-package-0.9.3.2.2.0.0-2041.zip(->/grid/3/hadoop/yarn/local/usercache/yarn/appcache/application_1428575950531_0021/filecache/11/slider-storm-app-package-0.9.3.2.2.0.0-2041.zip) > transitioned from DOWNLOADING to LOCALIZED > 2015-04-29 00:41:24,344 INFO container.Container > (ContainerImpl.java:handle(999)) - Container > container_1428575950531_0021_01_000002 transitioned from LOCALIZING to > LOCALIZED > 2015-04-29 00:41:24,388 INFO container.Container > (ContainerImpl.java:handle(999)) - Container > container_1428575950531_0021_01_000002 transitioned from LOCALIZED to RUNNING > 2015-04-29 00:41:24,396 INFO nodemanager.DefaultContainerExecutor > (DefaultContainerExecutor.java:buildCommandExecutor(267)) - launchContainer: > [bash, > /grid/5/hadoop/yarn/local/usercache/yarn/appcache/application_1428575950531_0021/container_1428575950531_0021_01_000002/default_container_executor.sh] > 2015-04-29 00:41:26,947 INFO monitor.ContainersMonitorImpl > (ContainersMonitorImpl.java:run(346)) - Starting resource-monitoring for > container_1428575950531_0021_01_000002 > 2015-04-29 00:41:26,996 INFO monitor.ContainersMonitorImpl > (ContainersMonitorImpl.java:run(408)) - Memory usage of ProcessTree 21259 for > container-id container_1428575950531_0021_01_000002: 15.0 MB of 3.5 GB > physical memory used; 280.0 MB of 7.3 GB virtual memory used > 2015-04-29 00:41:30,038 INFO monitor.ContainersMonitorImpl > (ContainersMonitorImpl.java:run(408)) - Memory usage of ProcessTree 21259 for > container-id container_1428575950531_0021_01_000002: 15.0 MB of 3.5 GB > physical memory used; 280.0 MB of 7.3 GB virtual memory used > 2015-04-29 00:41:33,087 INFO monitor.ContainersMonitorImpl > (ContainersMonitorImpl.java:run(408)) - Memory usage of ProcessTree 21259 for > container-id container_1428575950531_0021_01_000002: 15.0 MB of 3.5 GB > physical memory used; 280.0 MB of 7.3 GB virtual memory used > 2015-04-29 00:41:36,129 INFO monitor.ContainersMonitorImpl > (ContainersMonitorImpl.java:run(408)) - Memory usage of ProcessTree 21259 for > container-id container_1428575950531_0021_01_000002: 28.2 MB of 3.5 GB > physical memory used; 325.5 MB of 7.3 GB virtual memory used > 2015-04-29 00:41:39,179 INFO monitor.ContainersMonitorImpl > (ContainersMonitorImpl.java:run(408)) - Memory usage of ProcessTree 21259 for > container-id container_1428575950531_0021_01_000002: 86.0 MB of 3.5 GB > physical memory used; 63.3 GB of 7.3 GB virtual memory used > 2015-04-29 00:41:42,197 INFO monitor.ContainersMonitorImpl > (ContainersMonitorImpl.java:run(408)) - Memory usage of ProcessTree 21259 for > container-id container_1428575950531_0021_01_000002: 100.1 MB of 3.5 GB > physical memory used; 31.8 GB of 7.3 GB virtual memory used > 2015-04-29 00:41:45,243 INFO monitor.ContainersMonitorImpl > (ContainersMonitorImpl.java:run(408)) - Memory usage of ProcessTree 21259 for > container-id container_1428575950531_0021_01_000002: 167.1 MB of 3.5 GB > physical memory used; 31.8 GB of 7.3 GB virtual memory used > 2015-04-29 00:41:48,287 INFO monitor.ContainersMonitorImpl > (ContainersMonitorImpl.java:run(408)) - Memory usage of ProcessTree 21259 for > container-id container_1428575950531_0021_01_000002: 256.8 MB of 3.5 GB > physical memory used; 1.8 GB of 7.3 GB virtual memory used > 2015-04-29 00:41:51,336 INFO monitor.ContainersMonitorImpl > (ContainersMonitorImpl.java:run(408)) - Memory usage of ProcessTree 21259 for > container-id container_1428575950531_0021_01_000002: 15.3 MB of 3.5 GB > physical memory used; 280.3 MB of 7.3 GB virtual memory used > 2015-04-29 00:41:54,379 INFO monitor.ContainersMonitorImpl > (ContainersMonitorImpl.java:run(408)) - Memory usage of ProcessTree 21259 for > container-id container_1428575950531_0021_01_000002: 15.3 MB of 3.5 GB > physical memory used; 280.3 MB of 7.3 GB virtual memory used > . > . > . > 2015-04-29 00:55:51,675 INFO monitor.ContainersMonitorImpl > (ContainersMonitorImpl.java:run(408)) - Memory usage of ProcessTree 21259 for > container-id container_1428575950531_0021_01_000002: 15.4 MB of 3.5 GB > physical memory used; 280.3 MB of 7.3 GB virtual memory used > 2015-04-29 00:55:54,718 INFO monitor.ContainersMonitorImpl > (ContainersMonitorImpl.java:run(408)) - Memory usage of ProcessTree 21259 for > container-id container_1428575950531_0021_01_000002: 15.4 MB of 3.5 GB > physical memory used; 280.3 MB of 7.3 GB virtual memory used > 2015-04-29 00:55:57,760 INFO monitor.ContainersMonitorImpl > (ContainersMonitorImpl.java:run(408)) - Memory usage of ProcessTree 21259 for > container-id container_1428575950531_0021_01_000002: 15.4 MB of 3.5 GB > physical memory used; 280.3 MB of 7.3 GB virtual memory used > 2015-04-29 00:56:00,482 INFO ipc.Server (Server.java:saslProcess(1306)) - > Auth successful for appattempt_1428575950531_0021_000001 (auth:SIMPLE) > 2015-04-29 00:56:00,486 INFO containermanager.ContainerManagerImpl > (ContainerManagerImpl.java:stopContainerInternal(953)) - Stopping container > with container Id: container_1428575950531_0021_01_000002 > 2015-04-29 00:56:00,487 INFO nodemanager.NMAuditLogger > (NMAuditLogger.java:logSuccess(89)) - USER=yarn IP=10.84.104.129 > OPERATION=Stop Container Request TARGET=ContainerManageImpl > RESULT=SUCCESS APPID=application_1428575950531_0021 > CONTAINERID=container_1428575950531_0021_01_000002 > 2015-04-29 00:56:00,487 INFO container.Container > (ContainerImpl.java:handle(999)) - Container > container_1428575950531_0021_01_000002 transitioned from RUNNING to KILLING > 2015-04-29 00:56:00,489 INFO launcher.ContainerLaunch > (ContainerLaunch.java:cleanupContainer(370)) - Cleaning up container > container_1428575950531_0021_01_000002 > 2015-04-29 00:56:00,802 INFO monitor.ContainersMonitorImpl > (ContainersMonitorImpl.java:run(408)) - Memory usage of ProcessTree 21259 for > container-id container_1428575950531_0021_01_000002: 15.4 MB of 3.5 GB > physical memory used; 280.3 MB of 7.3 GB virtual memory used > 2015-04-29 00:56:02,494 INFO application.Application > (ApplicationImpl.java:handle(464)) - Application > application_1428575950531_0021 transitioned from RUNNING to > FINISHING_CONTAINERS_WAIT > 2015-04-29 00:56:03,849 INFO monitor.ContainersMonitorImpl > (ContainersMonitorImpl.java:run(408)) - Memory usage of ProcessTree 21259 for > container-id container_1428575950531_0021_01_000002: 15.5 MB of 3.5 GB > physical memory used; 280.3 MB of 7.3 GB virtual memory used > 2015-04-29 00:56:06,892 INFO monitor.ContainersMonitorImpl > (ContainersMonitorImpl.java:run(408)) - Memory usage of ProcessTree 21259 for > container-id container_1428575950531_0021_01_000002: 15.5 MB of 3.5 GB > physical memory used; 280.3 MB of 7.3 GB virtual memory used > 2015-04-29 00:56:09,940 INFO monitor.ContainersMonitorImpl > (ContainersMonitorImpl.java:run(408)) - Memory usage of ProcessTree 21259 for > container-id container_1428575950531_0021_01_000002: 15.5 MB of 3.5 GB > physical memory used; 280.3 MB of 7.3 GB virtual memory used > 2015-04-29 00:56:12,983 INFO monitor.ContainersMonitorImpl > (ContainersMonitorImpl.java:run(408)) - Memory usage of ProcessTree 21259 for > container-id container_1428575950531_0021_01_000002: 15.5 MB of 3.5 GB > physical memory used; 280.3 MB of 7.3 GB virtual memory used > 2015-04-29 00:56:16,032 INFO monitor.ContainersMonitorImpl > (ContainersMonitorImpl.java:run(408)) - Memory usage of ProcessTree 21259 for > container-id container_1428575950531_0021_01_000002: 15.5 MB of 3.5 GB > physical memory used; 280.3 MB of 7.3 GB virtual memory used > 2015-04-29 00:56:19,075 INFO monitor.ContainersMonitorImpl > (ContainersMonitorImpl.java:run(408)) - Memory usage of ProcessTree 21259 for > container-id container_1428575950531_0021_01_000002: 15.5 MB of 3.5 GB > physical memory used; 280.3 MB of 7.3 GB virtual memory used > 2015-04-29 00:56:22,122 INFO monitor.ContainersMonitorImpl > (ContainersMonitorImpl.java:run(408)) - Memory usage of ProcessTree 21259 for > container-id container_1428575950531_0021_01_000002: 15.6 MB of 3.5 GB > physical memory used; 280.5 MB of 7.3 GB virtual memory used > 2015-04-29 00:56:25,164 INFO monitor.ContainersMonitorImpl > (ContainersMonitorImpl.java:run(408)) - Memory usage of ProcessTree 21259 for > container-id container_1428575950531_0021_01_000002: 15.6 MB of 3.5 GB > physical memory used; 280.5 MB of 7.3 GB virtual memory used > 2015-04-29 00:56:28,211 INFO monitor.ContainersMonitorImpl > (ContainersMonitorImpl.java:run(408)) - Memory usage of ProcessTree 21259 for > container-id container_1428575950531_0021_01_000002: 15.6 MB of 3.5 GB > physical memory used; 280.5 MB of 7.3 GB virtual memory used > 2015-04-29 00:56:31,253 INFO monitor.ContainersMonitorImpl > (ContainersMonitorImpl.java:run(408)) - Memory usage of ProcessTree 21259 for > container-id container_1428575950531_0021_01_000002: 15.6 MB of 3.5 GB > physical memory used; 280.5 MB of 7.3 GB virtual memory used > 2015-04-29 00:56:34,302 INFO monitor.ContainersMonitorImpl > (ContainersMonitorImpl.java:run(408)) - Memory usage of ProcessTree 21259 for > container-id container_1428575950531_0021_01_000002: 15.6 MB of 3.5 GB > physical memory used; 280.5 MB of 7.3 GB virtual memory used > 2015-04-29 00:56:37,344 INFO monitor.ContainersMonitorImpl > (ContainersMonitorImpl.java:run(408)) - Memory usage of ProcessTree 21259 for > container-id container_1428575950531_0021_01_000002: 15.6 MB of 3.5 GB > physical memory used; 280.5 MB of 7.3 GB virtual memory used > 2015-04-29 00:56:40,392 INFO monitor.ContainersMonitorImpl > (ContainersMonitorImpl.java:run(408)) - Memory usage of ProcessTree 21259 for > container-id container_1428575950531_0021_01_000002: 15.6 MB of 3.5 GB > physical memory used; 280.5 MB of 7.3 GB virtual memory used > 2015-04-29 00:56:43,434 INFO monitor.ContainersMonitorImpl > (ContainersMonitorImpl.java:run(408)) - Memory usage of ProcessTree 21259 for > container-id container_1428575950531_0021_01_000002: 15.6 MB of 3.5 GB > physical memory used; 280.5 MB of 7.3 GB virtual memory used > 2015-04-29 00:56:46,482 INFO monitor.ContainersMonitorImpl > (ContainersMonitorImpl.java:run(408)) - Memory usage of ProcessTree 21259 for > container-id container_1428575950531_0021_01_000002: 15.6 MB of 3.5 GB > physical memory used; 280.5 MB of 7.3 GB virtual memory used > 2015-04-29 00:56:49,523 INFO monitor.ContainersMonitorImpl > (ContainersMonitorImpl.java:run(408)) - Memory usage of ProcessTree 21259 for > container-id container_1428575950531_0021_01_000002: 15.6 MB of 3.5 GB > physical memory used; 280.5 MB of 7.3 GB virtual memory used > 2015-04-29 00:56:52,570 INFO monitor.ContainersMonitorImpl > (ContainersMonitorImpl.java:run(408)) - Memory usage of ProcessTree 21259 for > container-id container_1428575950531_0021_01_000002: 15.6 MB of 3.5 GB > physical memory used; 280.5 MB of 7.3 GB virtual memory used > 2015-04-29 00:56:55,613 INFO monitor.ContainersMonitorImpl > (ContainersMonitorImpl.java:run(408)) - Memory usage of ProcessTree 21259 for > container-id container_1428575950531_0021_01_000002: 15.6 MB of 3.5 GB > physical memory used; 280.5 MB of 7.3 GB virtual memory used > 2015-04-29 00:56:58,661 INFO monitor.ContainersMonitorImpl > (ContainersMonitorImpl.java:run(408)) - Memory usage of ProcessTree 21259 for > container-id container_1428575950531_0021_01_000002: 15.6 MB of 3.5 GB > physical memory used; 280.5 MB of 7.3 GB virtual memory used > 2015-04-29 00:57:01,704 INFO monitor.ContainersMonitorImpl > (ContainersMonitorImpl.java:run(408)) - Memory usage of ProcessTree 21259 for > container-id container_1428575950531_0021_01_000002: 15.6 MB of 3.5 GB > physical memory used; 280.5 MB of 7.3 GB virtual memory used > 2015-04-29 00:57:04,752 INFO monitor.ContainersMonitorImpl > (ContainersMonitorImpl.java:run(408)) - Memory usage of ProcessTree 21259 for > container-id container_1428575950531_0021_01_000002: 15.6 MB of 3.5 GB > physical memory used; 280.5 MB of 7.3 GB virtual memory used > 2015-04-29 00:57:07,794 INFO monitor.ContainersMonitorImpl > (ContainersMonitorImpl.java:run(408)) - Memory usage of ProcessTree 21259 for > container-id container_1428575950531_0021_01_000002: 15.6 MB of 3.5 GB > physical memory used; 280.5 MB of 7.3 GB virtual memory used > 2015-04-29 00:57:10,843 INFO monitor.ContainersMonitorImpl > (ContainersMonitorImpl.java:run(408)) - Memory usage of ProcessTree 21259 for > container-id container_1428575950531_0021_01_000002: 15.6 MB of 3.5 GB > physical memory used; 280.5 MB of 7.3 GB virtual memory used > 2015-04-29 00:57:13,886 INFO monitor.ContainersMonitorImpl > (ContainersMonitorImpl.java:run(408)) - Memory usage of ProcessTree 21259 for > container-id container_1428575950531_0021_01_000002: 15.6 MB of 3.5 GB > physical memory used; 280.5 MB of 7.3 GB virtual memory used > 2015-04-29 00:57:16,935 INFO monitor.ContainersMonitorImpl > (ContainersMonitorImpl.java:run(408)) - Memory usage of ProcessTree 21259 for > container-id container_1428575950531_0021_01_000002: 15.6 MB of 3.5 GB > physical memory used; 296.5 MB of 7.3 GB virtual memory used > 2015-04-29 00:57:19,977 INFO monitor.ContainersMonitorImpl > (ContainersMonitorImpl.java:run(408)) - Memory usage of ProcessTree 21259 for > container-id container_1428575950531_0021_01_000002: 15.6 MB of 3.5 GB > physical memory used; 296.5 MB of 7.3 GB virtual memory used > 2015-04-29 00:57:23,025 INFO monitor.ContainersMonitorImpl > (ContainersMonitorImpl.java:run(408)) - Memory usage of ProcessTree 21259 for > container-id container_1428575950531_0021_01_000002: 15.6 MB of 3.5 GB > physical memory used; 296.5 MB of 7.3 GB virtual memory used > 2015-04-29 00:57:26,067 INFO monitor.ContainersMonitorImpl > (ContainersMonitorImpl.java:run(408)) - Memory usage of ProcessTree 21259 for > container-id container_1428575950531_0021_01_000002: 15.7 MB of 3.5 GB > physical memory used; 296.5 MB of 7.3 GB virtual memory used > {noformat} > *YARN properties of the cluster:* > {code} > { > "description": "Complete slider application settings", > "updated": 0, > "entries": { > "dfs.datanode.data.dir": > "/grid/1/dfs/data,/grid/2/dfs/data,/grid/3/dfs/data,/grid/4/dfs/data,/grid/5/dfs/data,/grid/6/dfs/data", > > "dfs.namenode.checkpoint.txns": "1000000", > "s3.replication": "3", > "mapreduce.output.fileoutputformat.compress.type": "BLOCK", > "mapreduce.jobtracker.jobhistory.lru.cache.size": "5", > "dfs.datanode.failed.volumes.tolerated": "0", > "hadoop.http.filter.initializers": > "org.apache.hadoop.yarn.server.webproxy.amfilter.AmFilterInitializer", > "mapreduce.cluster.temp.dir": > "/tmp/hadoop-yarn-${hue.suffix}/mapred/temp", > "mapreduce.reduce.shuffle.memory.limit.percent": "0.25", > "yarn.nodemanager.keytab": "/etc/krb5.keytab", > "dfs.namenode.checkpoint.max-retries": "3", > "nfs.mountd.port": "4242", > "hadoop.registry.zk.retry.times": "5", > "yarn.resourcemanager.zk-acl": "world:anyone:rwcda", > "mapreduce.reduce.skip.maxgroups": "0", > "dfs.https.server.keystore.resource": "ssl-server.xml", > "yarn.app.mapreduce.task.container.log.backups": "0", > "dfs.domain.socket.path": "/var/lib/hadoop-hdfs/dn_socket", > "hadoop.http.authentication.kerberos.keytab": > "/home/yarn/hadoop.keytab", > "yarn.timeline-service.generic-application-history.store-class": > "org.apache.hadoop.yarn.server.applicationhistoryservice.NullApplicationHistoryStore", > > > "yarn.nodemanager.disk-health-checker.max-disk-utilization-per-disk-percentage": > "90", > "mapreduce.cluster.administrators": " hadoop", > "dfs.client.block.write.replace-datanode-on-failure.best-effort": > "false", > "mapreduce.jobhistory.done-dir": "/mr-history/done", > "yarn.nodemanager.localizer.client.thread-count": "5", > "ha.failover-controller.new-active.rpc-timeout.ms": "60000", > "mapreduce.framework.name": "yarn", > "ha.health-monitor.check-interval.ms": "1000", > "io.file.buffer.size": "131072", > "mapreduce.shuffle.max.connections": "0", > "dfs.namenode.resource.check.interval": "5000", > "dfs.namenode.path.based.cache.block.map.allocation.percent": "0.25", > "dfs.namenode.checkpoint.period": "21600", > "mapreduce.task.tmp.dir": "./tmp", > "ipc.client.kill.max": "10", > "yarn.nodemanager.log-aggregation.debug-enabled": "false", > "dfs.client.mmap.cache.timeout.ms": "3600000", > "yarn.resourcemanager.scheduler.class": > "org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacityScheduler", > > "mapreduce.jobtracker.taskcache.levels": "2", > "s3.stream-buffer-size": "4096", > "dfs.namenode.secondary.http-address": "host2:50090", > "yarn.client.nodemanager-connect.max-wait-ms": "900000", > "dfs.namenode.decommission.interval": "30", > "dfs.namenode.http-address": "host1:50070", > "dfs.encrypt.data.transfer": "false", > "mapreduce.task.files.preserve.failedtasks": "false", > "yarn.resourcemanager.bind-host": "0.0.0.0", > "yarn.resourcemanager.ha.enabled": "false", > "dfs.datanode.address": "0.0.0.0:50010", > "dfs.namenode.avoid.write.stale.datanode": "true", > "hadoop.http.authentication.token.validity": "36000", > "yarn.resourcemanager.nodes.exclude-path": > "/etc/hadoop/conf/yarn.exclude", > "hadoop.security.group.mapping.ldap.search.filter.group": > "(objectClass=group)", > "dfs.client.failover.max.attempts": "15", > "yarn.resourcemanager.scheduler.monitor.policies": > "org.apache.hadoop.yarn.server.resourcemanager.monitor.capacity.ProportionalCapacityPreemptionPolicy", > > "hadoop.registry.zk.connection.timeout.ms": "15000", > "hadoop.security.crypto.cipher.suite": "AES/CTR/NoPadding", > "yarn.timeline-service.http-authentication.simple.anonymous.allowed": > "true", > "mapreduce.task.profile.params": > "-agentlib:hprof=cpu=samples,heap=sites,force=n,thread=y,verbose=n,file=%s", > "yarn.resourcemanager.fs.state-store.retry-policy-spec": "2000, 500", > "yarn.admin.acl": "*", > "yarn.nodemanager.local-cache.max-files-per-directory": "8192", > "yarn.client.failover-retries-on-socket-timeouts": "0", > "dfs.namenode.retrycache.expirytime.millis": "600000", > "yarn.resourcemanager.nodemanagers.heartbeat-interval-ms": "1000", > "dfs.client.failover.connection.retries.on.timeouts": "0", > "yarn.client.failover-proxy-provider": > "org.apache.hadoop.yarn.client.ConfiguredRMFailoverProxyProvider", > "mapreduce.map.sort.spill.percent": "0.7", > "file.stream-buffer-size": "4096", > "dfs.webhdfs.enabled": "true", > "ipc.client.connection.maxidletime": "0", > "mapreduce.task.combine.progress.records": "10000", > "mapreduce.jobtracker.persist.jobstatus.hours": "1", > "dfs.image.transfer.chunksize": "65536", > "yarn.nodemanager.address": "0.0.0.0:45454", > "dfs.datanode.ipc.address": "0.0.0.0:8010", > "yarn.resourcemanager.ha.automatic-failover.embedded": "true", > "mapreduce.jobhistory.recovery.store.fs.uri": > "/tmp/hadoop-yarn-${hue.suffix}/mapred/history/recoverystore", > "dfs.namenode.http-address.$cluster_name.nn1": "host1:50070", > "yarn.resourcemanager.zk-state-store.parent-path": "/rmstore", > "dfs.namenode.http-address.$cluster_name.nn2": "host2:50070", > "yarn.app.mapreduce.am.job.task.listener.thread-count": "30", > "nfs.dump.dir": "/tmp/.hdfs-nfs", > "dfs.namenode.list.cache.pools.num.responses": "100", > "dfs.client.read.shortcircuit": "true", > "dfs.namenode.shared.edits.dir": > "qjournal://host2:8485;host3:8485;host1:8485/$cluster_name", > "dfs.namenode.safemode.extension": "30000", > "ha.zookeeper.parent-znode": "/hadoop-ha", > "yarn.nodemanager.container-executor.class": > "org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor", > "slider.config.loaded": "true", > "io.skip.checksum.errors": "false", > "dfs.namenode.path.based.cache.refresh.interval.ms": "30000", > "dfs.encrypt.data.transfer.cipher.key.bitlength": "128", > "yarn.resourcemanager.scheduler.client.thread-count": "50", > "yarn.nodemanager.recovery.dir": > "/var/log/hadoop-yarn/nodemanager/recovery-state", > "mapreduce.job.emit-timeline-data": "false", > "hadoop.http.authentication.kerberos.principal": > "HTTP/_HOST@LOCALHOST", > "mapreduce.reduce.log.level": "INFO", > > "yarn.nodemanager.linux-container-executor.nonsecure-mode.user-pattern": > "^[_.A-Za-z0-9][-@_.A-Za-z0-9]{0,255}?[$]?$", > "fs.s3.maxRetries": "4", > "yarn.nodemanager.log-aggregation.num-log-files-per-app": "30", > "mapreduce.admin.reduce.child.java.opts": "-server -XX:NewRatio=8 > -Djava.net.preferIPv4Stack=true -Dhdp.version=2.2.0.0-2041", > "yarn.nodemanager.resourcemanager.minimum.version": "NONE", > "yarn.log-aggregation.retain-check-interval-seconds": "-1", > "hadoop.kerberos.kinit.command": "kinit", > "yarn.node-labels.fs-store.root-dir": "/system/yarn/node-labels", > "yarn.nodemanager.linux-container-executor.cgroups.mount": "false", > "yarn.nodemanager.process-kill-wait.ms": "2000", > "mapreduce.jobtracker.handler.count": "10", > "dfs.namenode.name.dir.restore": "true", > "mapreduce.jobhistory.admin.address": "0.0.0.0:10033", > "yarn.app.mapreduce.client-am.ipc.max-retries": "3", > "yarn.app.mapreduce.am.admin-command-opts": > "-Dhdp.version=2.2.0.0-2041", > "hadoop.proxyuser.hue.hosts": "*", > "dfs.client.use.datanode.hostname": "false", > > "dfs.datanode.available-space-volume-choosing-policy.balanced-space-preference-fraction": > "0.75f", > "hadoop.util.hash.type": "murmur", > "io.seqfile.lazydecompress": "true", > "dfs.datanode.dns.interface": "default", > "dfs.namenode.lazypersist.file.scrub.interval.sec": "300", > "yarn.client.max-cached-nodemanagers-proxies": "0", > "yarn.nodemanager.disk-health-checker.min-healthy-disks": "0.25", > "mapreduce.job.maxtaskfailures.per.tracker": "3", > "mapreduce.tasktracker.healthchecker.script.timeout": "600000", > "hadoop.security.group.mapping.ldap.search.attr.group.name": "cn", > "hadoop.security.crypto.buffer.size": "8192", > "fs.df.interval": "60000", > "dfs.client.cached.conn.retry": "3", > "dfs.namenode.kerberos.internal.spnego.principal": > "${dfs.web.authentication.kerberos.principal}", > "mapreduce.job.reduce.shuffle.consumer.plugin.class": > "org.apache.hadoop.mapreduce.task.reduce.Shuffle", > "mapreduce.jobtracker.address": "local", > "mapreduce.tasktracker.tasks.sleeptimebeforesigkill": "5000", > "dfs.journalnode.rpc-address": "0.0.0.0:8485", > "dfs.namenode.fs-limits.max-blocks-per-file": "1048576", > "mapreduce.job.acl-view-job": " ", > "dfs.client.block.write.replace-datanode-on-failure.policy": > "DEFAULT", > "yarn.app.mapreduce.am.job.committer.cancel-timeout": "60000", > "mapreduce.shuffle.connection-keep-alive.enable": "false", > "dfs.namenode.replication.interval": "3", > "dfs.namenode.num.checkpoints.retained": "2", > "mapreduce.jobhistory.minicluster.fixed.ports": "false", > "mapreduce.jobhistory.admin.acl": "*", > "mapreduce.tasktracker.http.address": "0.0.0.0:50060", > "yarn.resourcemanager.scheduler.address": "host2:8030", > "dfs.datanode.directoryscan.threads": "1", > "hadoop.security.group.mapping.ldap.ssl": "false", > "mapreduce.reduce.memory.mb": "3584", > "dfs.http.policy": "HTTP_ONLY", > "mapreduce.task.merge.progress.records": "10000", > "yarn.resourcemanager.system-metrics-publisher.dispatcher.pool-size": > "10", > "dfs.heartbeat.interval": "3", > "yarn.resourcemanager.recovery.enabled": "false", > "dfs.hosts.exclude": "/etc/hadoop/conf/dfs.exclude", > "net.topology.script.number.args": "100", > "mapreduce.local.clientfactory.class.name": > "org.apache.hadoop.mapred.LocalClientFactory", > "dfs.client-write-packet-size": "65536", > "hadoop.security.group.mapping.ldap.directory.search.timeout": > "10000", > "dfs.nameservices": "$cluster_name", > "io.native.lib.available": "true", > "dfs.client.failover.connection.retries": "0", > "yarn.nodemanager.disk-health-checker.interval-ms": "120000", > "dfs.blocksize": "134217728", > "dfs.client.use.legacy.blockreader.local": "false", > > "yarn.resourcemanager.container-tokens.master-key-rolling-interval-secs": > "86400", > "fs.s3a.connection.ssl.enabled": "true", > "mapreduce.jobhistory.webapp.address": "host2:19888", > "yarn.client.failover-retries": "0", > "yarn.resourcemanager.resource-tracker.client.thread-count": "50", > "hadoop.registry.jaas.context": "Client", > "dfs.blockreport.initialDelay": "120", > "yarn.resourcemanager.zk-timeout-ms": "10000", > "ha.health-monitor.rpc-timeout.ms": "45000", > "yarn.nodemanager.aux-services.mapreduce_shuffle.class": > "org.apache.hadoop.mapred.ShuffleHandler", > "mapreduce.reduce.markreset.buffer.percent": "0.0", > "dfs.ha.tail-edits.period": "60", > > "yarn.timeline-service.leveldb-timeline-store.start-time-read-cache-size": > "10000", > "mapreduce.admin.user.env": > "LD_LIBRARY_PATH=/usr/hdp/2.2.0.0-2041/hadoop/lib/native:/usr/hdp/2.2.0.0-2041/hadoop/lib/native/Linux-amd64-64", > > "yarn.nodemanager.health-checker.script.timeout-ms": "60000", > "yarn.resourcemanager.client.thread-count": "50", > "file.bytes-per-checksum": "512", > "dfs.replication.max": "50", > "dfs.namenode.max.extra.edits.segments.retained": "10000", > "yarn.nodemanager.linux-container-executor.group": "hadoop", > "io.map.index.skip": "0", > "mapreduce.jobhistory.bind-host": "0.0.0.0", > "yarn.timeline-service.client.retry-interval-ms": "1000", > "mapreduce.task.timeout": "300000", > "mapreduce.reduce.cpu.vcores": "1", > "dfs.datanode.du.reserved": "1073741824", > "dfs.support.append": "true", > "ftp.blocksize": "67108864", > "dfs.client.file-block-storage-locations.num-threads": "10", > "yarn.nodemanager.container-manager.thread-count": "20", > "ipc.server.listen.queue.size": "128", > "hadoop.ssl.hostname.verifier": "DEFAULT", > "yarn.resourcemanager.ha.automatic-failover.enabled": "true", > "nfs.server.port": "2049", > "mapreduce.tasktracker.dns.interface": "default", > "hadoop.security.group.mapping.ldap.search.attr.member": "member", > "mapreduce.job.userlog.retain.hours": "24", > "mapreduce.tasktracker.outofband.heartbeat": "false", > "fs.s3a.impl": "org.apache.hadoop.fs.s3a.S3AFileSystem", > "yarn.log.server.url": "http://host2:19888/jobhistory/logs", > "hadoop.registry.system.acls": "sasl:yarn@, sasl:mapred@, > sasl:mapred@hdfs@", > "yarn.nodemanager.resource.memory-mb": "96768", > "yarn.nodemanager.log-aggregation.roll-monitoring-interval-seconds": > "-1", > "dfs.webhdfs.user.provider.user.pattern": > "^[A-Za-z_][A-Za-z0-9._-]*[$]?$", > "dfs.namenode.delegation.token.renew-interval": "86400000", > "hadoop.ssl.keystores.factory.class": > "org.apache.hadoop.security.ssl.FileBasedKeyStoresFactory", > "hadoop.registry.zk.retry.ceiling.ms": "60000", > "yarn.http.policy": "HTTP_ONLY", > "dfs.datanode.sync.behind.writes": "false", > "nfs.wtmax": "1048576", > "fs.AbstractFileSystem.har.impl": "org.apache.hadoop.fs.HarFs", > "dfs.client.read.shortcircuit.skip.checksum": "false", > "hadoop.security.random.device.file.path": "/dev/urandom", > "mapreduce.map.maxattempts": "4", > "yarn.timeline-service.webapp.address": "host2:8188", > "dfs.datanode.handler.count": "10", > "hadoop.ssl.require.client.cert": "false", > "ftp.client-write-packet-size": "65536", > "dfs.client.write.exclude.nodes.cache.expiry.interval.millis": > "600000", > "ipc.server.tcpnodelay": "true", > "mapreduce.jobhistory.cleaner.enable": "true", > "fs.du.interval": "600000", > "mapreduce.reduce.shuffle.retry-delay.max.ms": "60000", > "mapreduce.task.profile.reduces": "0-2", > "ha.health-monitor.connect-retry-interval.ms": "1000", > "hadoop.fuse.connection.timeout": "300", > "dfs.permissions.superusergroup": "hdfs", > "mapreduce.jobtracker.jobhistory.task.numberprogresssplits": "12", > "fs.ftp.host.port": "21", > "mapreduce.map.speculative": "false", > "dfs.datanode.data.dir.perm": "750", > "mapreduce.client.submit.file.replication": "10", > "dfs.namenode.startup.delay.block.deletion.sec": "3600", > "s3native.blocksize": "67108864", > "mapreduce.job.ubertask.maxmaps": "9", > "dfs.namenode.replication.min": "1", > "mapreduce.cluster.acls.enabled": "false", > "hadoop.security.uid.cache.secs": "14400", > "nfs.allow.insecure.ports": "true", > "yarn.nodemanager.localizer.fetch.thread-count": "4", > "map.sort.class": "org.apache.hadoop.util.QuickSort", > "hadoop.proxyuser.hue.groups": "*", > "fs.trash.checkpoint.interval": "0", > "hadoop.proxyuser.hcat.groups": "users", > "dfs.image.transfer.timeout": "60000", > "dfs.namenode.name.dir": > "/grid/1/dfs/nn,/grid/2/dfs/nn,/grid/3/dfs/nn,/grid/4/dfs/nn,/grid/5/dfs/nn,/grid/6/dfs/nn", > > "ipc.client.connect.timeout": "20000", > "yarn.app.mapreduce.am.staging-dir": "/user", > "fs.AbstractFileSystem.file.impl": > "org.apache.hadoop.fs.local.LocalFs", > "yarn.nodemanager.env-whitelist": > "JAVA_HOME,HADOOP_COMMON_HOME,HADOOP_HDFS_HOME,HADOOP_CONF_DIR,HADOOP_YARN_HOME", > > "hadoop.registry.zk.retry.interval.ms": "1000", > > "yarn.nodemanager.linux-container-executor.cgroups.strict-resource-usage": > "false", > "yarn.timeline-service.keytab": "/etc/krb5.keytab", > "dfs.image.compression.codec": > "org.apache.hadoop.io.compress.DefaultCodec", > "mapreduce.job.reduces": "1", > "mapreduce.job.complete.cancel.delegation.tokens": "true", > "mapreduce.jobhistory.recovery.store.class": > "org.apache.hadoop.mapreduce.v2.hs.HistoryServerFileSystemStateStoreService", > "hadoop.security.group.mapping.ldap.search.filter.user": > "(&(objectClass=user)(sAMAccountName={0}))", > "dfs.namenode.enable.retrycache": "true", > "yarn.nodemanager.sleep-delay-before-sigkill.ms": "250", > "mapreduce.jobhistory.joblist.cache.size": "20000", > "mapreduce.tasktracker.healthchecker.interval": "60000", > "mapreduce.jobtracker.heartbeats.in.second": "100", > "hadoop.security.auth_to_local": " RULE:[2:$1@$0]([rn]m@.*)s/.*/yarn/ > RULE:[2:$1@$0](jhs@.*)s/.*/mapred/ RULE:[2:$1@$0]([nd]n@.*)s/.*/hdfs/ > RULE:[2:$1@$0](hm@.*)s/.*/hbase/ RULE:[2:$1@$0](rs@.*)s/.*/hbase/ DEFAULT", > "mapreduce.admin.map.child.java.opts": "-server -XX:NewRatio=8 > -Djava.net.preferIPv4Stack=true -Dhdp.version=2.2.0.0-2041", > "mapreduce.jobtracker.persist.jobstatus.dir": "/jobtracker/jobsInfo", > "dfs.namenode.backup.http-address": "0.0.0.0:50105", > "hadoop.rpc.protection": "authentication", > "dfs.client.mmap.enabled": "true", > "yarn.app.mapreduce.am.container.log.backups": "0", > "ftp.stream-buffer-size": "4096", > "dfs.namenode.https-address": "host1:50470", > "yarn.timeline-service.address": "host2:10200", > "dfs.ha.log-roll.period": "120", > "yarn.nodemanager.recovery.enabled": "true", > "hadoop.security.groups.negative-cache.secs": "30", > "yarn.resourcemanager.admin.client.thread-count": "1", > "dfs.datanode.fsdatasetcache.max.threads.per.volume": "4", > "file.client-write-packet-size": "65536", > "hadoop.http.authentication.simple.anonymous.allowed": "true", > "yarn.timeline-service.leveldb-timeline-store.path": > "/grid/1/hadoop/yarn/timeline", > "dfs.namenode.https-address.$cluster_name.nn1": "host1:50470", > "yarn.resourcemanager.proxy-user-privileges.enabled": "false", > "dfs.datanode.drop.cache.behind.reads": "false", > "yarn.nodemanager.log.retain-seconds": "10800", > "dfs.image.transfer.bandwidthPerSec": "0", > "yarn.resourcemanager.work-preserving-recovery.scheduling-wait-ms": > "10000", > "hadoop.registry.zk.session.timeout.ms": "60000", > "dfs.datanode.slow.io.warning.threshold.ms": "300", > "mapreduce.tasktracker.instrumentation": > "org.apache.hadoop.mapred.TaskTrackerMetricsInst", > "ha.failover-controller.cli-check.rpc-timeout.ms": "20000", > "dfs.namenode.https-address.$cluster_name.nn2": "host2:50470", > "yarn.nodemanager.linux-container-executor.cgroups.hierarchy": > "hadoop-yarn", > "dfs.namenode.write.stale.datanode.ratio": "1.0f", > "hadoop.security.groups.cache.warn.after.ms": "5000", > "mapreduce.reduce.shuffle.fetch.retry.timeout-ms": "30000", > "mapreduce.jobhistory.client.thread-count": "10", > "io.mapfile.bloom.size": "1048576", > "yarn.resourcemanager.work-preserving-recovery.enabled": "true", > "dfs.ha.fencing.ssh.connect-timeout": "30000", > "yarn.resourcemanager.zk-num-retries": "1000", > "hadoop.registry.zk.root": "/registry", > "s3.bytes-per-checksum": "512", > "yarn.app.mapreduce.am.container.log.limit.kb": "0", > "dfs.namenode.edit.log.autoroll.check.interval.ms": "300000", > "fs.automatic.close": "true", > "yarn.node-labels.fs-store.retry-policy-spec": "2000, 500", > "fs.trash.interval": "360", > "dfs.journalnode.https-address": "0.0.0.0:8481", > "yarn.timeline-service.ttl-ms": "2678400000", > "hadoop.security.authentication": "simple", > "fs.defaultFS": "hdfs://$cluster_name", > "nfs.rtmax": "1048576", > "hadoop.ssl.server.conf": "ssl-server.xml", > "ipc.client.connect.max.retries": "50", > "yarn.resourcemanager.delayed.delegation-token.removal-interval-ms": > "30000", > "dfs.journalnode.http-address": "0.0.0.0:8480", > "dfs.namenode.xattrs.enabled": "true", > "dfs.datanode.shared.file.descriptor.paths": "/dev/shm,/tmp", > "mapreduce.jobtracker.taskscheduler": > "org.apache.hadoop.mapred.JobQueueTaskScheduler", > "mapreduce.job.speculative.speculativecap": "0.1", > "yarn.timeline-service.store-class": > "org.apache.hadoop.yarn.server.timeline.LeveldbTimelineStore", > "yarn.am.liveness-monitor.expiry-interval-ms": "600000", > "mapreduce.output.fileoutputformat.compress": "false", > "yarn.timeline-service.bind-host": "0.0.0.0", > "dfs.user.home.dir.prefix": "/user", > "yarn.app.mapreduce.am.log.level": "INFO", > "net.topology.node.switch.mapping.impl": > "org.apache.hadoop.net.ScriptBasedMapping", > "dfs.namenode.replication.considerLoad": "true", > "dfs.namenode.fs-limits.min-block-size": "1048576", > "fs.swift.impl": > "org.apache.hadoop.fs.swift.snative.SwiftNativeFileSystem", > "dfs.namenode.audit.loggers": "default", > "yarn.nodemanager.bind-host": "0.0.0.0", > "mapreduce.job.max.split.locations": "10", > "yarn.resourcemanager.address": "host2:8050", > "mapreduce.job.counters.max": "120", > "mapreduce.reduce.shuffle.fetch.retry.enabled": "1", > "dfs.client.block.write.retries": "3", > "dfs.short.circuit.shared.memory.watcher.interrupt.check.ms": > "60000", > "dfs.namenode.resource.checked.volumes.minimum": "1", > "io.map.index.interval": "128", > "mapred.child.java.opts": "-Xmx200m", > "mapreduce.tasktracker.local.dir.minspacestart": "0", > "mapreduce.client.progressmonitor.pollinterval": "1000", > "dfs.client.https.keystore.resource": "ssl-client.xml", > "mapreduce.task.profile.map.params": > "-agentlib:hprof=cpu=samples,heap=sites,force=n,thread=y,verbose=n,file=%s", > "mapreduce.jobtracker.tasktracker.maxblacklists": "4", > "mapreduce.job.queuename": "default", > "hadoop.registry.zk.quorum": "host2:2181", > "yarn.app.mapreduce.client-am.ipc.max-retries-on-timeouts": "3", > "yarn.nodemanager.localizer.address": "0.0.0.0:8040", > "io.mapfile.bloom.error.rate": "0.005", > "yarn.nodemanager.delete.thread-count": "4", > "mapreduce.job.split.metainfo.maxsize": "10000000", > "yarn.scheduler.maximum-allocation-vcores": "32", > "dfs.https.port": "50470", > "yarn.app.mapreduce.am.resource.mb": "3584", > "dfs.datanode.dns.nameserver": "default", > "dfs.client.slow.io.warning.threshold.ms": "30000", > "mapreduce.job.reducer.preempt.delay.sec": "0", > "yarn.nodemanager.disk-health-checker.min-free-space-per-disk-mb": > "1000", > "mapreduce.map.output.compress.codec": > "org.apache.hadoop.io.compress.DefaultCodec", > "dfs.namenode.accesstime.precision": "0", > "mapreduce.map.log.level": "INFO", > "fs.s3a.connection.maximum": "15", > "io.seqfile.compress.blocksize": "1000000", > "mapreduce.tasktracker.taskcontroller": > "org.apache.hadoop.mapred.DefaultTaskController", > "hadoop.security.groups.cache.secs": "300", > "dfs.datanode.cache.revocation.timeout.ms": "900000", > "dfs.client.context": "default", > "hadoop.proxyuser.hive.groups": "users", > "mapreduce.input.lineinputformat.linespermap": "1", > "mapreduce.job.end-notification.max.attempts": "5", > > "yarn.nodemanager.linux-container-executor.nonsecure-mode.local-user": > "nobody", > "yarn.nodemanager.webapp.address": "0.0.0.0:8042", > "mapreduce.jobhistory.recovery.enable": "false", > "mapreduce.jobtracker.expire.trackers.interval": "600000", > "yarn.resourcemanager.webapp.address": "host2:8088", > "hadoop.security.kms.client.encrypted.key.cache.num.refill.threads": > "2", > "yarn.nodemanager.health-checker.interval-ms": "135000", > "mapreduce.jobhistory.loadedjobs.cache.size": "5", > "hadoop.security.authorization": "false", > "mapreduce.job.map.output.collector.class": > "org.apache.hadoop.mapred.MapTask$MapOutputBuffer", > "mapreduce.am.max-attempts": "2", > "fs.ftp.host": "0.0.0.0", > "fs.s3a.attempts.maximum": "10", > "yarn.app.mapreduce.am.scheduler.heartbeat.interval-ms": "1000", > "mapreduce.ifile.readahead": "true", > "yarn.resourcemanager.scheduler.monitor.enable": "false", > "yarn.resourcemanager.zk-retry-interval-ms": "1000", > "ha.zookeeper.session-timeout.ms": "5000", > "rpc.engine.org.apache.hadoop.ipc.ProtocolMetaInfoPB": > "org.apache.hadoop.ipc.ProtobufRpcEngine", > "mapreduce.tasktracker.taskmemorymanager.monitoringinterval": "5000", > "mapreduce.reduce.shuffle.parallelcopies": "30", > "mapreduce.map.skip.maxrecords": "0", > "dfs.client.mmap.retry.timeout.ms": "300000", > "dfs.namenode.avoid.read.stale.datanode": "true", > "yarn.timeline-service.webapp.https.address": "host2:8190", > "dfs.https.enable": "false", > "mapreduce.reduce.shuffle.read.timeout": "180000", > "dfs.namenode.list.encryption.zones.num.responses": "100", > "mapreduce.jobtracker.instrumentation": > "org.apache.hadoop.mapred.JobTrackerMetricsInst", > "mapreduce.output.fileoutputformat.compress.codec": > "org.apache.hadoop.io.compress.DefaultCodec", > "yarn.nodemanager.remote-app-log-dir-suffix": "logs", > "ipc.client.connect.retry.interval": "1000", > "dfs.blockreport.intervalMsec": "21600000", > "mapreduce.reduce.speculative": "false", > "mapreduce.jobhistory.keytab": > "/etc/security/keytab/jhs.service.keytab", > "mapreduce.jobhistory.datestring.cache.size": "200000", > "dfs.datanode.balance.bandwidthPerSec": "6250000", > "file.blocksize": "67108864", > "yarn.resourcemanager.admin.address": "host2:8141", > "mapreduce.map.cpu.vcores": "1", > > "yarn.nodemanager.container-monitor.procfs-tree.smaps-based-rss.enabled": > "false", > "yarn.resourcemanager.resource-tracker.address": "host2:8025", > "yarn.resourcemanager.configuration.provider-class": > "org.apache.hadoop.yarn.LocalConfigurationProvider", > "mapreduce.tasktracker.local.dir.minspacekill": "0", > "mapreduce.jobtracker.staging.root.dir": > "/tmp/hadoop-yarn-${hue.suffix}/mapred/staging", > "mapreduce.jobtracker.retiredjobs.cache.size": "1000", > "hadoop.registry.rm.enabled": "true", > "dfs.ha.fencing.methods": "shell(/bin/true)", > "ipc.client.connect.max.retries.on.timeouts": "45", > "hadoop.security.crypto.codec.classes.aes.ctr.nopadding": > "org.apache.hadoop.crypto.OpensslAesCtrCryptoCodec,org.apache.hadoop.crypto.JceAesCtrCryptoCodec", > > "ha.zookeeper.acl": "world:anyone:rwcda", > "mapreduce.app-submission.cross-platform": "false", > "yarn.nodemanager.local-dirs": > "/grid/1/hadoop/yarn/local,/grid/2/hadoop/yarn/local,/grid/3/hadoop/yarn/local,/grid/4/hadoop/yarn/local,/grid/5/hadoop/yarn/local,/grid/6/hadoop/yarn/local", > > "rpc.metrics.quantile.enable": "false", > "dfs.block.access.key.update.interval": "600", > "mapreduce.reduce.shuffle.connect.timeout": "180000", > "dfs.block.access.token.lifetime": "600", > "mapreduce.job.end-notification.retry.attempts": "0", > "dfs.namenode.fs-limits.max-xattrs-per-inode": "32", > "mapreduce.jobtracker.system.dir": > "/tmp/hadoop-yarn-${hue.suffix}/mapred/system", > "dfs.client.file-block-storage-locations.timeout.millis": "1000", > "yarn.nodemanager.admin-env": "MALLOC_ARENA_MAX=$MALLOC_ARENA_MAX", > "yarn.log-aggregation.retain-seconds": "2592000", > "mapreduce.jobtracker.jobhistory.block.size": "3145728", > "yarn.timeline-service.handler-thread-count": "10", > "mapreduce.tasktracker.indexcache.mb": "10", > "dfs.namenode.checkpoint.check.period": "60", > "dfs.client.block.write.replace-datanode-on-failure.enable": "true", > "yarn.resourcemanager.hostname": "host2", > "dfs.datanode.directoryscan.interval": "21600", > "net.topology.impl": "org.apache.hadoop.net.NetworkTopology", > "fs.s3a.multipart.purge.age": "86400", > "dfs.client.failover.proxy.provider.$cluster_name": > "org.apache.hadoop.hdfs.server.namenode.ha.ConfiguredFailoverProxyProvider", > "hadoop.security.java.secure.random.algorithm": "SHA1PRNG", > "yarn.nodemanager.container-monitor.interval-ms": "3000", > "dfs.default.chunk.view.size": "32768", > "fs.s3a.multipart.threshold": "2147483647", > "mapreduce.job.speculative.slownodethreshold": "1.0", > "mapreduce.job.reduce.slowstart.completedmaps": "0.05", > "hadoop.security.instrumentation.requires.admin": "false", > "io.compression.codec.bzip2.library": "system-native", > "dfs.namenode.safemode.min.datanodes": "0", > "hadoop.registry.secure": "false", > "hadoop.http.authentication.signature.secret.file": > "/home/yarn/hadoop-http-auth-signature-secret", > "mapreduce.reduce.maxattempts": "4", > "yarn.nodemanager.localizer.cache.target-size-mb": "10240", > "s3native.replication": "3", > "dfs.datanode.https.address": "0.0.0.0:50475", > "dfs.journalnode.edits.dir": > "/grid/1/dfs/journal,/grid/2/dfs/journal,/grid/3/dfs/journal,/grid/4/dfs/journal,/grid/5/dfs/journal,/grid/6/dfs/journal", > > "dfs.namenode.path.based.cache.retry.interval.ms": "30000", > "dfs.namenode.inotify.max.events.per.rpc": "1000", > "dfs.datanode.cache.revocation.polling.ms": "500", > "mapreduce.reduce.skip.proc.count.autoincr": "true", > "file.replication": "1", > "mapreduce.jobhistory.cleaner.interval-ms": "86400000", > "hadoop.hdfs.configuration.version": "1", > "ipc.client.idlethreshold": "8000", > "yarn.resourcemanager.store.class": > "org.apache.hadoop.yarn.server.resourcemanager.recovery.ZKRMStateStore", > "hadoop.tmp.dir": "/tmp/hadoop-yarn-${hue.suffix}", > "mapreduce.jobtracker.restart.recover": "false", > "mapreduce.jobhistory.address": "host2:10020", > "mapreduce.cluster.local.dir": > "/tmp/hadoop-yarn-${hue.suffix}/mapred/local", > "yarn.client.nodemanager-client-async.thread-pool-max-size": "500", > "proxyuser_group": "users", > "dfs.namenode.decommission.nodes.per.interval": "5", > "dfs.namenode.reject-unresolved-dn-topology-mapping": "false", > "yarn.nodemanager.resource.cpu-vcores": "20", > "dfs.namenode.delegation.key.update-interval": "86400000", > "dfs.client.read.shortcircuit.streams.cache.expiry.ms": "300000", > "fs.s3.buffer.dir": "/tmp/hadoop-yarn-${hue.suffix}/s3", > "dfs.namenode.support.allow.format": "true", > "yarn.nodemanager.remote-app-log-dir": "/app-logs", > "io.compression.codecs": > "org.apache.hadoop.io.compress.GzipCodec,org.apache.hadoop.io.compress.DefaultCodec,org.apache.hadoop.io.compress.SnappyCodec", > > "yarn.nodemanager.aux-services": "mapreduce_shuffle", > "dfs.namenode.edit.log.autoroll.multiplier.threshold": "2.0", > "mapreduce.map.memory.mb": "3584", > "hadoop.work.around.non.threadsafe.getpwuid": "false", > "mapreduce.task.profile.reduce.params": > "-agentlib:hprof=cpu=samples,heap=sites,force=n,thread=y,verbose=n,file=%s", > "dfs.ha.automatic-failover.enabled": "true", > "yarn.timeline-service.client.max-retries": "30", > "dfs.namenode.stale.datanode.interval": "30000", > "dfs.namenode.edits.noeditlogchannelflush": "false", > "mapreduce.shuffle.transfer.buffer.size": "131072", > "dfs.namenode.logging.level": "info", > "mapreduce.jobtracker.persist.jobstatus.active": "true", > "yarn.nodemanager.log-dirs": "/var/log/hadoop-yarn", > "yarn.resourcemanager.am-rm-tokens.master-key-rolling-interval-secs": > "86400", > "ha.health-monitor.sleep-after-disconnect.ms": "1000", > "dfs.namenode.checkpoint.edits.dir": > "/grid/1/dfs/snn,/grid/2/dfs/snn,/grid/3/dfs/snn,/grid/4/dfs/snn,/grid/5/dfs/snn,/grid/6/dfs/snn", > > "yarn.resourcemanager.fs.state-store.uri": " ", > "hadoop.rpc.socket.factory.class.default": > "org.apache.hadoop.net.StandardSocketFactory", > "yarn.resourcemanager.keytab": "/etc/krb5.keytab", > "dfs.datanode.http.address": "0.0.0.0:50075", > "mapreduce.task.profile": "false", > "mapreduce.jobhistory.move.interval-ms": "180000", > "dfs.namenode.edits.dir": > "/grid/1/dfs/nn,/grid/2/dfs/nn,/grid/3/dfs/nn,/grid/4/dfs/nn,/grid/5/dfs/nn,/grid/6/dfs/nn", > > "dfs.storage.policy.enabled": "true", > "hadoop.security.kms.client.encrypted.key.cache.size": "500", > "hadoop.fuse.timer.period": "5", > "mapreduce.jobhistory.http.policy": "HTTP_ONLY", > "mapreduce.jobhistory.intermediate-done-dir": "/mr-history/tmp", > "mapreduce.map.skip.proc.count.autoincr": "true", > "dfs.cluster.administrators": " hdfs", > "fs.AbstractFileSystem.viewfs.impl": > "org.apache.hadoop.fs.viewfs.ViewFs", > "mapreduce.job.speculative.slowtaskthreshold": "1.0", > "yarn.resourcemanager.webapp.delegation-token-auth-filter.enabled": > "false", > "s3native.stream-buffer-size": "4096", > "yarn.nodemanager.delete.debug-delay-sec": "0", > "dfs.secondary.namenode.kerberos.internal.spnego.principal": > "${dfs.web.authentication.kerberos.principal}", > > "dfs.datanode.available-space-volume-choosing-policy.balanced-space-threshold": > "10737418240", > "fs.s3n.multipart.uploads.block.size": "67108864", > "mapreduce.ifile.readahead.bytes": "4194304", > "dfs.namenode.safemode.threshold-pct": "0.99f", > "yarn.scheduler.maximum-allocation-mb": "96768", > "ipc.client.fallback-to-simple-auth-allowed": "false", > "yarn.timeline-service.leveldb-timeline-store.read-cache-size": > "104857600", > "fs.har.impl.disable.cache": "true", > "s3native.bytes-per-checksum": "512", > "yarn.timeline-service.hostname": "0.0.0.0", > "mapreduce.job.committer.setup.cleanup.needed": "true", > "fs.s3a.paging.maximum": "5000", > "yarn.timeline-service.leveldb-timeline-store.ttl-interval-ms": > "300000", > "yarn.client.nodemanager-connect.retry-interval-ms": "10000", > "yarn.nodemanager.log-aggregation.compression-type": "gz", > "yarn.app.mapreduce.am.job.committer.commit-window": "10000", > "hadoop.http.authentication.type": "simple", > "dfs.client.failover.sleep.base.millis": "500", > "dfs.ha.namenodes.$cluster_name": "nn1,nn2", > "yarn.nodemanager.vmem-check-enabled": "false", > "hadoop.jetty.logs.serve.aliases": "true", > "ha.failover-controller.graceful-fence.rpc-timeout.ms": "5000", > "mapreduce.reduce.shuffle.input.buffer.percent": "0.7", > "dfs.datanode.max.transfer.threads": "4096", > "mapreduce.task.io.sort.mb": "1024", > "mapreduce.reduce.merge.inmem.threshold": "1000", > "hadoop.security.kms.client.authentication.retry-count": "1", > "yarn.client.application-client-protocol.poll-interval-ms": "200", > "dfs.namenode.acls.enabled": "false", > "yarn.resourcemanager.connect.max-wait.ms": "900000", > "dfs.namenode.handler.count": "40", > "yarn.timeline-service.enabled": "true", > "dfs.namenode.retrycache.heap.percent": "0.03f", > "yarn.nodemanager.log.retain-second": "604800", > > "yarn.nodemanager.linux-container-executor.nonsecure-mode.limit-users": > "true", > "yarn.resourcemanager.container.liveness-monitor.interval-ms": > "600000", > "hadoop.ssl.client.conf": "ssl-client.xml", > "mapreduce.client.completion.pollinterval": "5000", > "yarn.nodemanager.vmem-pmem-ratio": "2.1", > "yarn.app.mapreduce.client.max-retries": "3", > "hadoop.ssl.enabled": "false", > "fs.AbstractFileSystem.hdfs.impl": "org.apache.hadoop.fs.Hdfs", > "fs.client.resolve.remote.symlinks": "true", > "mapreduce.reduce.java.opts": "-Xmx2867m", > "mapreduce.map.java.opts": "-Xmx2867m", > "mapreduce.tasktracker.reduce.tasks.maximum": "2", > "yarn.nodemanager.hostname": "0.0.0.0", > "mapreduce.reduce.input.buffer.percent": "0.0", > "fs.s3a.multipart.purge": "false", > "dfs.namenode.invalidate.work.pct.per.iteration": "0.32f", > "yarn.app.mapreduce.am.command-opts": "-Xmx2867m > -Dhdp.version=2.2.0.0-2041", > "dfs.bytes-per-checksum": "512", > "dfs.replication": "3", > "yarn.resourcemanager.webapp.https.address": "host2:8090", > "mapreduce.shuffle.ssl.file.buffer.size": "65536", > "dfs.datanode.block.id.layout.upgrade.threads": "12", > "dfs.namenode.list.cache.directives.num.responses": "100", > "dfs.permissions.enabled": "true", > "mapreduce.jobtracker.maxtasks.perjob": "-1", > "dfs.datanode.use.datanode.hostname": "false", > "mapreduce.task.userlog.limit.kb": "0", > "dfs.namenode.fs-limits.max-directory-items": "1048576", > "s3.client-write-packet-size": "65536", > "fs.s3a.buffer.dir": "/tmp/hadoop-yarn-${hue.suffix}/s3a", > "hadoop.security.kms.client.encrypted.key.cache.low-watermark": > "0.3f", > "hadoop.user.group.static.mapping.overrides": "dr.who=;", > "slider.provider.agent": > "org.apache.slider.providers.agent.AgentProviderFactory", > "mapreduce.shuffle.max.threads": "0", > "dfs.client.failover.sleep.max.millis": "15000", > "hadoop.security.kms.client.encrypted.key.cache.expiry": "43200000", > "mapreduce.job.maps": "2", > "dfs.namenode.fs-limits.max-component-length": "255", > "hadoop.ssl.enabled.protocols": "TLSv1", > "mapreduce.map.output.compress": "false", > "s3.blocksize": "67108864", > "dfs.namenode.edits.journal-plugin.qjournal": > "org.apache.hadoop.hdfs.qjournal.client.QuorumJournalManager", > "dfs.namenode.datanode.registration.ip-hostname-check": "true", > "yarn.node-labels.manager-class": > "org.apache.hadoop.yarn.server.resourcemanager.nodelabels.MemoryRMNodeLabelsManager", > > "yarn.nodemanager.pmem-check-enabled": "true", > "dfs.client.https.need-auth": "false", > "dfs.client.short.circuit.replica.stale.threshold.ms": "1800000", > "ha.zookeeper.quorum": "host1:2181,host2:2181,host3:2181", > "yarn.scheduler.minimum-allocation-mb": "3584", > "hadoop.proxyuser.hive.hosts": "host1", > "yarn.timeline-service.http-authentication.type": "simple", > "mapreduce.jobhistory.max-age-ms": "604800000", > "ftp.replication": "3", > "dfs.blockreport.split.threshold": "1000000", > "dfs.namenode.secondary.https-address": "0.0.0.0:50091", > "mapreduce.input.fileinputformat.split.minsize": "0", > "fs.s3n.block.size": "67108864", > "mapreduce.job.token.tracking.ids.enabled": "false", > "mapreduce.jobtracker.webinterface.trusted": "false", > "yarn.ipc.rpc.class": > "org.apache.hadoop.yarn.ipc.HadoopYarnProtoRPC", > "dfs.namenode.num.extra.edits.retained": "1000000", > "hadoop.http.staticuser.user": "dr.who", > "yarn.nodemanager.localizer.cache.cleanup.interval-ms": "600000", > "mapreduce.job.jvm.numtasks": "1", > "fs.s3a.multipart.size": "104857600", > "mapreduce.jobhistory.move.thread-count": "3", > "mapreduce.task.profile.maps": "0-2", > "dfs.datanode.max.locked.memory": "0", > "dfs.cachereport.intervalMsec": "10000", > "mapreduce.shuffle.port": "13562", > "mapreduce.shuffle.connection-keep-alive.timeout": "5", > "yarn.resourcemanager.nodemanager.minimum.version": "NONE", > "mapreduce.jobtracker.http.address": "0.0.0.0:50030", > "mapreduce.reduce.shuffle.merge.percent": "0.66", > "yarn.resourcemanager.connect.retry-interval.ms": "30000", > "mapreduce.task.skip.start.attempts": "2", > "yarn.scheduler.minimum-allocation-vcores": "1", > "mapreduce.task.io.sort.factor": "100", > "dfs.namenode.checkpoint.dir": > "/grid/1/dfs/snn,/grid/2/dfs/snn,/grid/3/dfs/snn,/grid/4/dfs/snn,/grid/5/dfs/snn,/grid/6/dfs/snn", > > "nfs.exports.allowed.hosts": "* rw", > "tfile.fs.input.buffer.size": "262144", > "tfile.io.chunk.size": "1048576", > "fs.s3.block.size": "67108864", > "fs.s3n.multipart.copy.block.size": "5368709120", > "io.serializations": > "org.apache.hadoop.io.serializer.WritableSerialization", > "yarn.resourcemanager.max-completed-applications": "10000", > "mapreduce.jobhistory.principal": "jhs/_h...@realm.tld", > "hadoop.proxyuser.hcat.hosts": "host1", > "yarn.resourcemanager.ha.automatic-failover.zk-base-path": > "/yarn-leader-election", > "mapreduce.reduce.shuffle.fetch.retry.interval-ms": "1000", > "mapreduce.job.end-notification.retry.interval": "1000", > "mapreduce.application.framework.path": > "/hdp/apps/2.2.0.0-2041/mapreduce/mapreduce.tar.gz#mr-framework", > "dfs.namenode.backup.address": "0.0.0.0:50100", > "fs.s3n.multipart.uploads.enabled": "false", > "s3native.client-write-packet-size": "65536", > "dfs.block.access.token.enable": "true", > "io.seqfile.sorter.recordlimit": "1000000", > "hadoop.security.group.mapping": > "org.apache.hadoop.security.JniBasedUnixGroupsMappingWithFallback", > "ftp.bytes-per-checksum": "512", > "dfs.namenode.fs-limits.max-xattr-size": "16384", > "dfs.client.read.shortcircuit.streams.cache.size": "4096", > "dfs.client.domain.socket.data.traffic": "false", > "fs.s3a.connection.timeout": "5000", > "mapreduce.job.end-notification.max.retry.interval": "5000", > "dfs.namenode.rpc-address.$cluster_name.nn1": "host1:8020", > "yarn.acl.enable": "false", > "mapreduce.application.classpath": > "$PWD/mr-framework/hadoop/share/hadoop/mapreduce/*:$PWD/mr-framework/hadoop/share/hadoop/mapreduce/lib/*:$PWD/mr-framework/hadoop/share/hadoop/common/*:$PWD/mr-framework/hadoop/share/hadoop/common/lib/*:$PWD/mr-framework/hadoop/share/hadoop/yarn/*:$PWD/mr-framework/hadoop/share/hadoop/yarn/lib/*:$PWD/mr-framework/hadoop/share/hadoop/hdfs/*:$PWD/mr-framework/hadoop/share/hadoop/hdfs/lib/*:/usr/hdp/2.2.0.0-2041/hadoop/lib/hadoop-lzo-0.6.0.2.2.0.0-2041.jar:/etc/hadoop/conf/secure", > > "yarn.nm.liveness-monitor.expiry-interval-ms": "600000", > "dfs.namenode.rpc-address.$cluster_name.nn2": "host2:8020", > "dfs.client.mmap.cache.size": "256", > "mapreduce.input.fileinputformat.list-status.num-threads": "1", > "mapreduce.tasktracker.map.tasks.maximum": "2", > "yarn.nodemanager.linux-container-executor.resources-handler.class": > "org.apache.hadoop.yarn.server.nodemanager.util.DefaultLCEResourcesHandler", > "yarn.timeline-service.ttl-enable": "true", > "yarn.resourcemanager.zk-address": "localhost:2181", > "dfs.namenode.max.objects": "0", > "yarn.resourcemanager.state-store.max-completed-applications": > "10000", > "dfs.namenode.delegation.token.max-lifetime": "604800000", > "mapreduce.job.classloader": "false", > > "yarn.timeline-service.leveldb-timeline-store.start-time-write-cache-size": > "10000", > "mapreduce.job.hdfs-servers": "hdfs://$cluster_name", > "yarn.application.classpath": > "$HADOOP_CONF_DIR,/usr/hdp/current/hadoop-client/*,/usr/hdp/current/hadoop-client/lib/*,/usr/hdp/current/hadoop-hdfs-client/*,/usr/hdp/current/hadoop-hdfs-client/lib/*,/usr/hdp/current/hadoop-yarn-client/*,/usr/hdp/current/hadoop-yarn-client/lib/*", > > "mapreduce.tasktracker.dns.nameserver": "default", > "dfs.datanode.hdfs-blocks-metadata.enabled": "false", > "dfs.datanode.readahead.bytes": "4193404", > "dfs.image.compress": "false", > "mapreduce.job.ubertask.maxreduces": "1", > "mapreduce.tasktracker.report.address": "127.0.0.1:0", > "yarn.log-aggregation-enable": "true", > "mapreduce.shuffle.ssl.enabled": "false", > > "rpc.engine.org.apache.slider.server.appmaster.rpc.SliderClusterProtocolPB": > "org.apache.hadoop.ipc.ProtobufRpcEngine", > "mapreduce.tasktracker.http.threads": "40", > "dfs.stream-buffer-size": "4096", > "tfile.fs.output.buffer.size": "262144", > "fs.permissions.umask-mode": "022", > "yarn.resourcemanager.am.max-attempts": "2", > "dfs.namenode.resource.du.reserved": "104857600", > "dfs.client.datanode-restart.timeout": "30", > "yarn.nodemanager.resource.percentage-physical-cpu-limit": "100", > "ha.failover-controller.graceful-fence.connection.retries": "1", > "dfs.datanode.drop.cache.behind.writes": "false", > "yarn.app.mapreduce.am.resource.cpu-vcores": "1", > "mapreduce.job.ubertask.enable": "false", > "hadoop.common.configuration.version": "0.23.0", > "dfs.namenode.replication.work.multiplier.per.iteration": "2", > "mapreduce.job.acl-modify-job": " ", > "io.seqfile.local.dir": "/tmp/hadoop-yarn-${hue.suffix}/io/local", > "fs.s3.sleepTimeSeconds": "10", > "yarn.resourcemanager.system-metrics-publisher.enabled": "true", > "mapreduce.client.output.filter": "FAILED" > }, > "empty": false > } > {code} -- This message was sent by Atlassian JIRA (v6.3.4#6332)