[
https://issues.apache.org/jira/browse/YARN-3561?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14519911#comment-14519911
]
Gour Saha commented on YARN-3561:
---------------------------------
Slider stop command was called which initiates the Slider Storm application to
stop (and hence the Slider AM to stop).
Which property sets the keep-containers flag on?
> Non-AM Containers continue to run even after AM is stopped
> ----------------------------------------------------------
>
> Key: YARN-3561
> URL: https://issues.apache.org/jira/browse/YARN-3561
> Project: Hadoop YARN
> Issue Type: Bug
> Components: nodemanager, yarn
> Affects Versions: 2.6.0
> Environment: debian 7
> Reporter: Gour Saha
> Priority: Critical
> Fix For: 2.6.1
>
>
> Non-AM containers continue to run even after application is stopped. This
> occurred while deploying Storm 0.9.3 using Slider (0.60.0 and 0.70.1) in a
> Hadoop 2.6 deployment.
> Following are the NM logs from 2 different nodes:
> *host-07* - where Slider AM was running
> *host-03* - where Storm NIMBUS container was running.
> *Note:* The logs are partial, starting with the time when the relevant Slider
> AM and NIMBUS containers were allocated, till the time when the Slider AM was
> stopped. Also, the large number of "Memory usage" log lines were removed
> keeping only a few starts and ends of every segment.
> *NM log from host-07 where Slider AM container was running:*
> {noformat}
> 2015-04-29 00:39:24,614 INFO monitor.ContainersMonitorImpl
> (ContainersMonitorImpl.java:run(356)) - Stopping resource-monitoring for
> container_1428575950531_0020_02_000001
> 2015-04-29 00:41:10,310 INFO ipc.Server (Server.java:saslProcess(1306)) -
> Auth successful for appattempt_1428575950531_0021_000001 (auth:SIMPLE)
> 2015-04-29 00:41:10,322 INFO containermanager.ContainerManagerImpl
> (ContainerManagerImpl.java:startContainerInternal(803)) - Start request for
> container_1428575950531_0021_01_000001 by user yarn
> 2015-04-29 00:41:10,322 INFO containermanager.ContainerManagerImpl
> (ContainerManagerImpl.java:startContainerInternal(843)) - Creating a new
> application reference for app application_1428575950531_0021
> 2015-04-29 00:41:10,323 INFO application.Application
> (ApplicationImpl.java:handle(464)) - Application
> application_1428575950531_0021 transitioned from NEW to INITING
> 2015-04-29 00:41:10,325 INFO nodemanager.NMAuditLogger
> (NMAuditLogger.java:logSuccess(89)) - USER=yarn IP=10.84.105.162
> OPERATION=Start Container Request TARGET=ContainerManageImpl
> RESULT=SUCCESS APPID=application_1428575950531_0021
> CONTAINERID=container_1428575950531_0021_01_000001
> 2015-04-29 00:41:10,328 WARN logaggregation.LogAggregationService
> (LogAggregationService.java:verifyAndCreateRemoteLogDir(195)) - Remote Root
> Log Dir [/app-logs] already exist, but with incorrect permissions. Expected:
> [rwxrwxrwt], Found: [rwxrwxrwx]. The cluster may have problems with multiple
> users.
> 2015-04-29 00:41:10,328 WARN logaggregation.AppLogAggregatorImpl
> (AppLogAggregatorImpl.java:<init>(182)) - rollingMonitorInterval is set as
> -1. The log rolling mornitoring interval is disabled. The logs will be
> aggregated after this application is finished.
> 2015-04-29 00:41:10,351 INFO application.Application
> (ApplicationImpl.java:transition(304)) - Adding
> container_1428575950531_0021_01_000001 to application
> application_1428575950531_0021
> 2015-04-29 00:41:10,352 INFO application.Application
> (ApplicationImpl.java:handle(464)) - Application
> application_1428575950531_0021 transitioned from INITING to RUNNING
> 2015-04-29 00:41:10,356 INFO container.Container
> (ContainerImpl.java:handle(999)) - Container
> container_1428575950531_0021_01_000001 transitioned from NEW to LOCALIZING
> 2015-04-29 00:41:10,357 INFO containermanager.AuxServices
> (AuxServices.java:handle(196)) - Got event CONTAINER_INIT for appId
> application_1428575950531_0021
> 2015-04-29 00:41:10,357 INFO localizer.LocalizedResource
> (LocalizedResource.java:handle(203)) - Resource
> hdfs://zsexp/user/yarn/.slider/cluster/storm1/tmp/application_1428575950531_0021/am/lib/htrace-core-3.0.4.jar
> transitioned from INIT to DOWNLOADING
> 2015-04-29 00:41:10,357 INFO localizer.LocalizedResource
> (LocalizedResource.java:handle(203)) - Resource
> hdfs://zsexp/user/yarn/.slider/cluster/storm1/tmp/application_1428575950531_0021/am/lib/jettison-1.1.jar
> transitioned from INIT to DOWNLOADING
> 2015-04-29 00:41:10,358 INFO localizer.LocalizedResource
> (LocalizedResource.java:handle(203)) - Resource
> hdfs://zsexp/user/yarn/.slider/cluster/storm1/tmp/application_1428575950531_0021/am/lib/api-util-1.0.0-M20.jar
> transitioned from INIT to DOWNLOADING
> 2015-04-29 00:41:10,358 INFO localizer.LocalizedResource
> (LocalizedResource.java:handle(203)) - Resource
> hdfs://zsexp/user/yarn/.slider/cluster/storm1/confdir/log4j-server.properties
> transitioned from INIT to DOWNLOADING
> 2015-04-29 00:41:10,358 INFO localizer.LocalizedResource
> (LocalizedResource.java:handle(203)) - Resource
> hdfs://zsexp/user/yarn/.slider/cluster/storm1/tmp/application_1428575950531_0021/am/lib/httpcore-4.2.5.jar
> transitioned from INIT to DOWNLOADING
> 2015-04-29 00:41:10,358 INFO localizer.LocalizedResource
> (LocalizedResource.java:handle(203)) - Resource
> hdfs://zsexp/user/yarn/.slider/cluster/storm1/tmp/application_1428575950531_0021/am/lib/metrics-core-3.0.1.jar
> transitioned from INIT to DOWNLOADING
> 2015-04-29 00:41:10,359 INFO localizer.LocalizedResource
> (LocalizedResource.java:handle(203)) - Resource
> hdfs://zsexp/user/yarn/.slider/cluster/storm1/tmp/application_1428575950531_0021/am/lib/slf4j-log4j12-1.6.1.jar
> transitioned from INIT to DOWNLOADING
> 2015-04-29 00:41:10,359 INFO localizer.LocalizedResource
> (LocalizedResource.java:handle(203)) - Resource
> hdfs://zsexp/user/yarn/.slider/cluster/storm1/confdir/slider-env.sh
> transitioned from INIT to DOWNLOADING
> 2015-04-29 00:41:10,359 INFO localizer.LocalizedResource
> (LocalizedResource.java:handle(203)) - Resource
> hdfs://zsexp/user/yarn/.slider/cluster/storm1/tmp/application_1428575950531_0021/am/lib/hadoop-mapreduce-client-shuffle-2.6.0.jar
> transitioned from INIT to DOWNLOADING
> 2015-04-29 00:41:10,359 INFO localizer.LocalizedResource
> (LocalizedResource.java:handle(203)) - Resource
> hdfs://zsexp/user/yarn/.slider/cluster/storm1/tmp/application_1428575950531_0021/am/lib/xercesImpl-2.9.1.jar
> transitioned from INIT to DOWNLOADING
> 2015-04-29 00:41:10,360 INFO localizer.LocalizedResource
> (LocalizedResource.java:handle(203)) - Resource
> hdfs://zsexp/user/yarn/.slider/cluster/storm1/tmp/application_1428575950531_0021/am/lib/hadoop-hdfs-2.6.0.jar
> transitioned from INIT to DOWNLOADING
> 2015-04-29 00:41:10,360 INFO localizer.LocalizedResource
> (LocalizedResource.java:handle(203)) - Resource
> hdfs://zsexp/user/yarn/.slider/cluster/storm1/tmp/application_1428575950531_0021/am/lib/commons-beanutils-1.7.0.jar
> transitioned from INIT to DOWNLOADING
> 2015-04-29 00:41:10,360 INFO localizer.LocalizedResource
> (LocalizedResource.java:handle(203)) - Resource
> hdfs://zsexp/user/yarn/.slider/cluster/storm1/tmp/application_1428575950531_0021/am/lib/stax-api-1.0.1.jar
> transitioned from INIT to DOWNLOADING
> 2015-04-29 00:41:10,360 INFO localizer.LocalizedResource
> (LocalizedResource.java:handle(203)) - Resource
> hdfs://zsexp/user/yarn/.slider/cluster/storm1/tmp/application_1428575950531_0021/agent/slider-agent.tar.gz
> transitioned from INIT to DOWNLOADING
> 2015-04-29 00:41:10,361 INFO localizer.LocalizedResource
> (LocalizedResource.java:handle(203)) - Resource
> hdfs://zsexp/user/yarn/.slider/cluster/storm1/tmp/application_1428575950531_0021/am/lib/hadoop-yarn-registry-2.6.0.jar
> transitioned from INIT to DOWNLOADING
> 2015-04-29 00:41:10,361 INFO localizer.LocalizedResource
> (LocalizedResource.java:handle(203)) - Resource
> hdfs://zsexp/user/yarn/.slider/cluster/storm1/tmp/application_1428575950531_0021/am/lib/xmlenc-0.52.jar
> transitioned from INIT to DOWNLOADING
> 2015-04-29 00:41:10,361 INFO localizer.LocalizedResource
> (LocalizedResource.java:handle(203)) - Resource
> hdfs://zsexp/user/yarn/.slider/cluster/storm1/tmp/application_1428575950531_0021/am/lib/jackson-core-asl-1.9.13.jar
> transitioned from INIT to DOWNLOADING
> 2015-04-29 00:41:10,361 INFO localizer.LocalizedResource
> (LocalizedResource.java:handle(203)) - Resource
> hdfs://zsexp/user/yarn/.slider/cluster/storm1/tmp/application_1428575950531_0021/am/lib/metrics-jvm-3.0.1.jar
> transitioned from INIT to DOWNLOADING
> 2015-04-29 00:41:10,362 INFO localizer.LocalizedResource
> (LocalizedResource.java:handle(203)) - Resource
> hdfs://zsexp/user/yarn/.slider/cluster/storm1/tmp/application_1428575950531_0021/am/lib/paranamer-2.3.jar
> transitioned from INIT to DOWNLOADING
> 2015-04-29 00:41:10,362 INFO localizer.LocalizedResource
> (LocalizedResource.java:handle(203)) - Resource
> hdfs://zsexp/user/yarn/.slider/cluster/storm1/tmp/application_1428575950531_0021/am/lib/slider-core-0.70.1-incubating.jar
> transitioned from INIT to DOWNLOADING
> 2015-04-29 00:41:10,362 INFO localizer.LocalizedResource
> (LocalizedResource.java:handle(203)) - Resource
> hdfs://zsexp/user/yarn/.slider/cluster/storm1/tmp/application_1428575950531_0021/am/lib/log4j-1.2.17.jar
> transitioned from INIT to DOWNLOADING
> 2015-04-29 00:41:10,362 INFO localizer.LocalizedResource
> (LocalizedResource.java:handle(203)) - Resource
> hdfs://zsexp/user/yarn/.slider/cluster/storm1/confdir/slider-client.xml
> transitioned from INIT to DOWNLOADING
> 2015-04-29 00:41:10,363 INFO localizer.LocalizedResource
> (LocalizedResource.java:handle(203)) - Resource
> hdfs://zsexp/user/yarn/.slider/cluster/storm1/tmp/application_1428575950531_0021/am/lib/jackson-databind-2.2.2.jar
> transitioned from INIT to DOWNLOADING
> 2015-04-29 00:41:10,363 INFO localizer.LocalizedResource
> (LocalizedResource.java:handle(203)) - Resource
> hdfs://zsexp/user/yarn/.slider/cluster/storm1/tmp/application_1428575950531_0021/am/lib/guice-servlet-3.0.jar
> transitioned from INIT to DOWNLOADING
> 2015-04-29 00:41:10,363 INFO localizer.LocalizedResource
> (LocalizedResource.java:handle(203)) - Resource
> hdfs://zsexp/user/yarn/.slider/cluster/storm1/tmp/application_1428575950531_0021/am/lib/xml-apis-1.3.04.jar
> transitioned from INIT to DOWNLOADING
> 2015-04-29 00:41:10,363 INFO localizer.LocalizedResource
> (LocalizedResource.java:handle(203)) - Resource
> hdfs://zsexp/user/yarn/.slider/cluster/storm1/confdir/log4j.properties
> transitioned from INIT to DOWNLOADING
> 2015-04-29 00:41:10,364 INFO localizer.LocalizedResource
> (LocalizedResource.java:handle(203)) - Resource
> hdfs://zsexp/user/yarn/.slider/cluster/storm1/confdir/slider-server.xml
> transitioned from INIT to DOWNLOADING
> 2015-04-29 00:41:10,364 INFO localizer.LocalizedResource
> (LocalizedResource.java:handle(203)) - Resource
> hdfs://zsexp/user/yarn/.slider/cluster/storm1/tmp/application_1428575950531_0021/am/lib/jaxb-impl-2.2.3-1.jar
> transitioned from INIT to DOWNLOADING
> 2015-04-29 00:41:10,364 INFO localizer.LocalizedResource
> (LocalizedResource.java:handle(203)) - Resource
> hdfs://zsexp/user/yarn/.slider/cluster/storm1/tmp/application_1428575950531_0021/am/lib/hadoop-yarn-server-web-proxy-2.6.0.jar
> transitioned from INIT to DOWNLOADING
> 2015-04-29 00:41:10,364 INFO localizer.LocalizedResource
> (LocalizedResource.java:handle(203)) - Resource
> hdfs://zsexp/user/yarn/.slider/cluster/storm1/tmp/application_1428575950531_0021/am/lib/hadoop-mapreduce-client-core-2.6.0.jar
> transitioned from INIT to DOWNLOADING
> 2015-04-29 00:41:10,365 INFO localizer.LocalizedResource
> (LocalizedResource.java:handle(203)) - Resource
> hdfs://zsexp/user/yarn/.slider/cluster/storm1/tmp/application_1428575950531_0021/am/lib/hadoop-yarn-client-2.6.0.jar
> transitioned from INIT to DOWNLOADING
> 2015-04-29 00:41:10,365 INFO localizer.LocalizedResource
> (LocalizedResource.java:handle(203)) - Resource
> hdfs://zsexp/user/yarn/.slider/cluster/storm1/tmp/application_1428575950531_0021/am/lib/jackson-mapper-asl-1.9.13.jar
> transitioned from INIT to DOWNLOADING
> 2015-04-29 00:41:10,365 INFO localizer.LocalizedResource
> (LocalizedResource.java:handle(203)) - Resource
> hdfs://zsexp/user/yarn/.slider/cluster/storm1/tmp/application_1428575950531_0021/am/lib/asm-3.1.jar
> transitioned from INIT to DOWNLOADING
> 2015-04-29 00:41:10,365 INFO localizer.LocalizedResource
> (LocalizedResource.java:handle(203)) - Resource
> hdfs://zsexp/user/yarn/.slider/cluster/storm1/tmp/application_1428575950531_0021/am/lib/jetty-sslengine-6.1.26.jar
> transitioned from INIT to DOWNLOADING
> 2015-04-29 00:41:10,366 INFO localizer.LocalizedResource
> (LocalizedResource.java:handle(203)) - Resource
> hdfs://zsexp/user/yarn/.slider/cluster/storm1/tmp/application_1428575950531_0021/am/lib/zookeeper-3.4.6.jar
> transitioned from INIT to DOWNLOADING
> 2015-04-29 00:41:10,366 INFO localizer.LocalizedResource
> (LocalizedResource.java:handle(203)) - Resource
> hdfs://zsexp/user/yarn/.slider/cluster/storm1/tmp/application_1428575950531_0021/am/lib/hadoop-mapreduce-client-common-2.6.0.jar
> transitioned from INIT to DOWNLOADING
> 2015-04-29 00:41:10,366 INFO localizer.LocalizedResource
> (LocalizedResource.java:handle(203)) - Resource
> hdfs://zsexp/user/yarn/.slider/cluster/storm1/tmp/application_1428575950531_0021/am/lib/jsp-api-2.1.jar
> transitioned from INIT to DOWNLOADING
> 2015-04-29 00:41:10,366 INFO localizer.LocalizedResource
> (LocalizedResource.java:handle(203)) - Resource
> hdfs://zsexp/user/yarn/.slider/cluster/storm1/tmp/application_1428575950531_0021/am/lib/hadoop-auth-2.6.0.jar
> transitioned from INIT to DOWNLOADING
> 2015-04-29 00:41:10,367 INFO localizer.LocalizedResource
> (LocalizedResource.java:handle(203)) - Resource
> hdfs://zsexp/user/yarn/.slider/cluster/storm1/tmp/application_1428575950531_0021/am/lib/commons-math3-3.1.1.jar
> transitioned from INIT to DOWNLOADING
> 2015-04-29 00:41:10,367 INFO localizer.LocalizedResource
> (LocalizedResource.java:handle(203)) - Resource
> hdfs://zsexp/user/yarn/.slider/cluster/storm1/tmp/application_1428575950531_0021/am/lib/jersey-core-1.9.jar
> transitioned from INIT to DOWNLOADING
> 2015-04-29 00:41:10,367 INFO localizer.LocalizedResource
> (LocalizedResource.java:handle(203)) - Resource
> hdfs://zsexp/user/yarn/.slider/cluster/storm1/tmp/application_1428575950531_0021/am/lib/hadoop-yarn-api-2.6.0.jar
> transitioned from INIT to DOWNLOADING
> 2015-04-29 00:41:10,367 INFO localizer.LocalizedResource
> (LocalizedResource.java:handle(203)) - Resource
> hdfs://zsexp/user/yarn/.slider/cluster/storm1/tmp/application_1428575950531_0021/am/lib/avro-1.7.4.jar
> transitioned from INIT to DOWNLOADING
> 2015-04-29 00:41:10,368 INFO localizer.LocalizedResource
> (LocalizedResource.java:handle(203)) - Resource
> hdfs://zsexp/user/yarn/.slider/cluster/storm1/tmp/application_1428575950531_0021/am/lib/hadoop-client-2.6.0.jar
> transitioned from INIT to DOWNLOADING
> 2015-04-29 00:41:10,368 INFO localizer.LocalizedResource
> (LocalizedResource.java:handle(203)) - Resource
> hdfs://zsexp/user/yarn/.slider/cluster/storm1/tmp/application_1428575950531_0021/am/lib/jsr311-api-1.1.1.jar
> transitioned from INIT to DOWNLOADING
> 2015-04-29 00:41:10,368 INFO localizer.LocalizedResource
> (LocalizedResource.java:handle(203)) - Resource
> hdfs://zsexp/user/yarn/.slider/cluster/storm1/tmp/application_1428575950531_0021/am/lib/jackson-core-2.2.2.jar
> transitioned from INIT to DOWNLOADING
> 2015-04-29 00:41:10,368 INFO localizer.LocalizedResource
> (LocalizedResource.java:handle(203)) - Resource
> hdfs://zsexp/user/yarn/.slider/cluster/storm1/tmp/application_1428575950531_0021/am/lib/curator-framework-2.4.1.jar
> transitioned from INIT to DOWNLOADING
> 2015-04-29 00:41:10,369 INFO localizer.LocalizedResource
> (LocalizedResource.java:handle(203)) - Resource
> hdfs://zsexp/user/yarn/.slider/cluster/storm1/tmp/application_1428575950531_0021/am/lib/netty-3.7.0.Final.jar
> transitioned from INIT to DOWNLOADING
> 2015-04-29 00:41:10,369 INFO localizer.LocalizedResource
> (LocalizedResource.java:handle(203)) - Resource
> hdfs://zsexp/user/yarn/.slider/cluster/storm1/tmp/application_1428575950531_0021/am/lib/commons-logging-1.1.3.jar
> transitioned from INIT to DOWNLOADING
> 2015-04-29 00:41:10,369 INFO localizer.LocalizedResource
> (LocalizedResource.java:handle(203)) - Resource
> hdfs://zsexp/user/yarn/.slider/cluster/storm1/tmp/application_1428575950531_0021/am/lib/commons-lang-2.6.jar
> transitioned from INIT to DOWNLOADING
> 2015-04-29 00:41:10,369 INFO localizer.LocalizedResource
> (LocalizedResource.java:handle(203)) - Resource
> hdfs://zsexp/user/yarn/.slider/cluster/storm1/tmp/application_1428575950531_0021/am/lib/curator-recipes-2.6.0.jar
> transitioned from INIT to DOWNLOADING
> 2015-04-29 00:41:10,370 INFO localizer.LocalizedResource
> (LocalizedResource.java:handle(203)) - Resource
> hdfs://zsexp/user/yarn/.slider/cluster/storm1/tmp/application_1428575950531_0021/am/lib/jackson-annotations-2.2.2.jar
> transitioned from INIT to DOWNLOADING
> 2015-04-29 00:41:10,370 INFO localizer.LocalizedResource
> (LocalizedResource.java:handle(203)) - Resource
> hdfs://zsexp/user/yarn/.slider/cluster/storm1/tmp/application_1428575950531_0021/am/lib/jsr305-1.3.9.jar
> transitioned from INIT to DOWNLOADING
> 2015-04-29 00:41:10,370 INFO localizer.LocalizedResource
> (LocalizedResource.java:handle(203)) - Resource
> hdfs://zsexp/user/yarn/.slider/cluster/storm1/tmp/application_1428575950531_0021/am/lib/slf4j-api-1.7.5.jar
> transitioned from INIT to DOWNLOADING
> 2015-04-29 00:41:10,370 INFO localizer.LocalizedResource
> (LocalizedResource.java:handle(203)) - Resource
> hdfs://zsexp/user/yarn/.slider/cluster/storm1/tmp/application_1428575950531_0021/am/lib/aopalliance-1.0.jar
> transitioned from INIT to DOWNLOADING
> 2015-04-29 00:41:10,371 INFO localizer.LocalizedResource
> (LocalizedResource.java:handle(203)) - Resource
> hdfs://zsexp/user/yarn/.slider/cluster/storm1/tmp/application_1428575950531_0021/am/lib/commons-digester-1.8.jar
> transitioned from INIT to DOWNLOADING
> 2015-04-29 00:41:10,371 INFO localizer.LocalizedResource
> (LocalizedResource.java:handle(203)) - Resource
> hdfs://zsexp/user/yarn/.slider/cluster/storm1/tmp/application_1428575950531_0021/am/lib/metrics-json-3.0.1.jar
> transitioned from INIT to DOWNLOADING
> 2015-04-29 00:41:10,371 INFO localizer.LocalizedResource
> (LocalizedResource.java:handle(203)) - Resource
> hdfs://zsexp/user/yarn/.slider/cluster/storm1/tmp/application_1428575950531_0021/am/lib/commons-compress-1.4.1.jar
> transitioned from INIT to DOWNLOADING
> 2015-04-29 00:41:10,371 INFO localizer.LocalizedResource
> (LocalizedResource.java:handle(203)) - Resource
> hdfs://zsexp/user/yarn/.slider/cluster/storm1/tmp/application_1428575950531_0021/am/lib/hadoop-mapreduce-client-jobclient-2.6.0.jar
> transitioned from INIT to DOWNLOADING
> 2015-04-29 00:41:10,372 INFO localizer.LocalizedResource
> (LocalizedResource.java:handle(203)) - Resource
> hdfs://zsexp/user/yarn/.slider/cluster/storm1/tmp/application_1428575950531_0021/am/lib/commons-net-3.1.jar
> transitioned from INIT to DOWNLOADING
> 2015-04-29 00:41:10,372 INFO localizer.LocalizedResource
> (LocalizedResource.java:handle(203)) - Resource
> hdfs://zsexp/user/yarn/.slider/cluster/storm1/tmp/application_1428575950531_0021/am/lib/hadoop-yarn-server-common-2.6.0.jar
> transitioned from INIT to DOWNLOADING
> 2015-04-29 00:41:10,372 INFO localizer.LocalizedResource
> (LocalizedResource.java:handle(203)) - Resource
> hdfs://zsexp/user/yarn/.slider/cluster/storm1/tmp/application_1428575950531_0021/am/lib/jetty-6.1.26.jar
> transitioned from INIT to DOWNLOADING
> 2015-04-29 00:41:10,372 INFO localizer.LocalizedResource
> (LocalizedResource.java:handle(203)) - Resource
> hdfs://zsexp/user/yarn/.slider/cluster/storm1/tmp/application_1428575950531_0021/am/lib/jcommander-1.30.jar
> transitioned from INIT to DOWNLOADING
> 2015-04-29 00:41:10,373 INFO localizer.LocalizedResource
> (LocalizedResource.java:handle(203)) - Resource
> hdfs://zsexp/user/yarn/.slider/cluster/storm1/tmp/application_1428575950531_0021/am/lib/httpclient-4.2.5.jar
> transitioned from INIT to DOWNLOADING
> 2015-04-29 00:41:10,373 INFO localizer.LocalizedResource
> (LocalizedResource.java:handle(203)) - Resource
> hdfs://zsexp/user/yarn/.slider/cluster/storm1/tmp/application_1428575950531_0021/am/lib/hadoop-yarn-common-2.6.0.jar
> transitioned from INIT to DOWNLOADING
> 2015-04-29 00:41:10,373 INFO localizer.LocalizedResource
> (LocalizedResource.java:handle(203)) - Resource
> hdfs://zsexp/user/yarn/.slider/cluster/storm1/tmp/application_1428575950531_0021/am/lib/xz-1.0.jar
> transitioned from INIT to DOWNLOADING
> 2015-04-29 00:41:10,373 INFO localizer.LocalizedResource
> (LocalizedResource.java:handle(203)) - Resource
> hdfs://zsexp/user/yarn/.slider/cluster/storm1/tmp/application_1428575950531_0021/am/lib/apacheds-kerberos-codec-2.0.0-M15.jar
> transitioned from INIT to DOWNLOADING
> 2015-04-29 00:41:10,374 INFO localizer.LocalizedResource
> (LocalizedResource.java:handle(203)) - Resource
> hdfs://zsexp/user/yarn/.slider/cluster/storm1/tmp/application_1428575950531_0021/am/lib/commons-beanutils-core-1.8.0.jar
> transitioned from INIT to DOWNLOADING
> 2015-04-29 00:41:10,374 INFO localizer.LocalizedResource
> (LocalizedResource.java:handle(203)) - Resource
> hdfs://zsexp/user/yarn/.slider/cluster/storm1/tmp/application_1428575950531_0021/am/lib/jackson-xc-1.9.13.jar
> transitioned from INIT to DOWNLOADING
> 2015-04-29 00:41:10,374 INFO localizer.LocalizedResource
> (LocalizedResource.java:handle(203)) - Resource
> hdfs://zsexp/user/yarn/.slider/cluster/storm1/tmp/application_1428575950531_0021/am/lib/metrics-healthchecks-3.0.1.jar
> transitioned from INIT to DOWNLOADING
> 2015-04-29 00:41:10,374 INFO localizer.LocalizedResource
> (LocalizedResource.java:handle(203)) - Resource
> hdfs://zsexp/user/yarn/.slider/cluster/storm1/tmp/application_1428575950531_0021/am/lib/commons-io-2.4.jar
> transitioned from INIT to DOWNLOADING
> 2015-04-29 00:41:10,375 INFO localizer.LocalizedResource
> (LocalizedResource.java:handle(203)) - Resource
> hdfs://zsexp/user/yarn/.slider/cluster/storm1/tmp/application_1428575950531_0021/am/lib/hadoop-common-2.6.0.jar
> transitioned from INIT to DOWNLOADING
> 2015-04-29 00:41:10,375 INFO localizer.LocalizedResource
> (LocalizedResource.java:handle(203)) - Resource
> hdfs://zsexp/user/yarn/.slider/cluster/storm1/tmp/application_1428575950531_0021/am/lib/guava-11.0.2.jar
> transitioned from INIT to DOWNLOADING
> 2015-04-29 00:41:10,375 INFO localizer.LocalizedResource
> (LocalizedResource.java:handle(203)) - Resource
> hdfs://zsexp/user/yarn/.slider/cluster/storm1/tmp/application_1428575950531_0021/am/lib/commons-collections-3.2.1.jar
> transitioned from INIT to DOWNLOADING
> 2015-04-29 00:41:10,375 INFO localizer.LocalizedResource
> (LocalizedResource.java:handle(203)) - Resource
> hdfs://zsexp/user/yarn/.slider/cluster/storm1/tmp/application_1428575950531_0021/am/lib/jersey-client-1.9.jar
> transitioned from INIT to DOWNLOADING
> 2015-04-29 00:41:10,376 INFO localizer.LocalizedResource
> (LocalizedResource.java:handle(203)) - Resource
> hdfs://zsexp/user/yarn/.slider/cluster/storm1/tmp/application_1428575950531_0021/am/lib/servlet-api-2.5.jar
> transitioned from INIT to DOWNLOADING
> 2015-04-29 00:41:10,376 INFO localizer.LocalizedResource
> (LocalizedResource.java:handle(203)) - Resource
> hdfs://zsexp/user/yarn/.slider/cluster/storm1/tmp/application_1428575950531_0021/am/lib/protobuf-java-2.5.0.jar
> transitioned from INIT to DOWNLOADING
> 2015-04-29 00:41:10,376 INFO localizer.LocalizedResource
> (LocalizedResource.java:handle(203)) - Resource
> hdfs://zsexp/user/yarn/.slider/cluster/storm1/tmp/application_1428575950531_0021/am/lib/snappy-java-1.0.4.1.jar
> transitioned from INIT to DOWNLOADING
> 2015-04-29 00:41:10,376 INFO localizer.LocalizedResource
> (LocalizedResource.java:handle(203)) - Resource
> hdfs://zsexp/user/yarn/.slider/cluster/storm1/tmp/application_1428575950531_0021/am/lib/jline-0.9.94.jar
> transitioned from INIT to DOWNLOADING
> 2015-04-29 00:41:10,377 INFO localizer.LocalizedResource
> (LocalizedResource.java:handle(203)) - Resource
> hdfs://zsexp/user/yarn/.slider/cluster/storm1/tmp/application_1428575950531_0021/am/lib/apacheds-i18n-2.0.0-M15.jar
> transitioned from INIT to DOWNLOADING
> 2015-04-29 00:41:10,377 INFO localizer.LocalizedResource
> (LocalizedResource.java:handle(203)) - Resource
> hdfs://zsexp/user/yarn/.slider/cluster/storm1/tmp/application_1428575950531_0021/am/lib/jaxb-api-2.2.7.jar
> transitioned from INIT to DOWNLOADING
> 2015-04-29 00:41:10,377 INFO localizer.LocalizedResource
> (LocalizedResource.java:handle(203)) - Resource
> hdfs://zsexp/user/yarn/.slider/cluster/storm1/tmp/application_1428575950531_0021/am/lib/leveldbjni-all-1.8.jar
> transitioned from INIT to DOWNLOADING
> 2015-04-29 00:41:10,377 INFO localizer.LocalizedResource
> (LocalizedResource.java:handle(203)) - Resource
> hdfs://zsexp/user/yarn/.slider/cluster/storm1/tmp/application_1428575950531_0021/am/lib/gson-2.2.2.jar
> transitioned from INIT to DOWNLOADING
> 2015-04-29 00:41:10,378 INFO localizer.LocalizedResource
> (LocalizedResource.java:handle(203)) - Resource
> hdfs://zsexp/user/yarn/.slider/cluster/storm1/tmp/application_1428575950531_0021/am/lib/hadoop-mapreduce-client-app-2.6.0.jar
> transitioned from INIT to DOWNLOADING
> 2015-04-29 00:41:10,378 INFO localizer.LocalizedResource
> (LocalizedResource.java:handle(203)) - Resource
> hdfs://zsexp/user/yarn/.slider/cluster/storm1/tmp/application_1428575950531_0021/am/lib/slider.jar
> transitioned from INIT to DOWNLOADING
> 2015-04-29 00:41:10,378 INFO localizer.LocalizedResource
> (LocalizedResource.java:handle(203)) - Resource
> hdfs://zsexp/user/yarn/.slider/cluster/storm1/tmp/application_1428575950531_0021/am/lib/jackson-jaxrs-1.9.13.jar
> transitioned from INIT to DOWNLOADING
> 2015-04-29 00:41:10,378 INFO localizer.LocalizedResource
> (LocalizedResource.java:handle(203)) - Resource
> hdfs://zsexp/user/yarn/.slider/cluster/storm1/tmp/application_1428575950531_0021/am/lib/hadoop-annotations-2.6.0.jar
> transitioned from INIT to DOWNLOADING
> 2015-04-29 00:41:10,379 INFO localizer.LocalizedResource
> (LocalizedResource.java:handle(203)) - Resource
> hdfs://zsexp/user/yarn/.slider/cluster/storm1/tmp/application_1428575950531_0021/am/lib/jersey-json-1.9.jar
> transitioned from INIT to DOWNLOADING
> 2015-04-29 00:41:10,379 INFO localizer.LocalizedResource
> (LocalizedResource.java:handle(203)) - Resource
> hdfs://zsexp/user/yarn/.slider/cluster/storm1/tmp/application_1428575950531_0021/am/lib/commons-httpclient-3.1.jar
> transitioned from INIT to DOWNLOADING
> 2015-04-29 00:41:10,379 INFO localizer.LocalizedResource
> (LocalizedResource.java:handle(203)) - Resource
> hdfs://zsexp/user/yarn/.slider/cluster/storm1/tmp/application_1428575950531_0021/am/lib/jetty-util-6.1.26.jar
> transitioned from INIT to DOWNLOADING
> 2015-04-29 00:41:10,379 INFO localizer.LocalizedResource
> (LocalizedResource.java:handle(203)) - Resource
> hdfs://zsexp/user/yarn/.slider/cluster/storm1/tmp/application_1428575950531_0021/am/lib/api-asn1-api-1.0.0-M20.jar
> transitioned from INIT to DOWNLOADING
> 2015-04-29 00:41:10,380 INFO localizer.LocalizedResource
> (LocalizedResource.java:handle(203)) - Resource
> hdfs://zsexp/user/yarn/.slider/cluster/storm1/tmp/application_1428575950531_0021/am/lib/jersey-server-1.9.jar
> transitioned from INIT to DOWNLOADING
> 2015-04-29 00:41:10,380 INFO localizer.LocalizedResource
> (LocalizedResource.java:handle(203)) - Resource
> hdfs://zsexp/user/yarn/.slider/cluster/storm1/tmp/application_1428575950531_0021/am/lib/commons-cli-1.2.jar
> transitioned from INIT to DOWNLOADING
> 2015-04-29 00:41:10,380 INFO localizer.LocalizedResource
> (LocalizedResource.java:handle(203)) - Resource
> hdfs://zsexp/user/yarn/.slider/cluster/storm1/tmp/application_1428575950531_0021/am/lib/metrics-servlets-3.0.1.jar
> transitioned from INIT to DOWNLOADING
> 2015-04-29 00:41:10,380 INFO localizer.LocalizedResource
> (LocalizedResource.java:handle(203)) - Resource
> hdfs://zsexp/user/yarn/.slider/cluster/storm1/tmp/application_1428575950531_0021/am/lib/commons-configuration-1.6.jar
> transitioned from INIT to DOWNLOADING
> 2015-04-29 00:41:10,381 INFO localizer.LocalizedResource
> (LocalizedResource.java:handle(203)) - Resource
> hdfs://zsexp/user/yarn/.slider/cluster/storm1/tmp/application_1428575950531_0021/am/lib/commons-codec-1.6.jar
> transitioned from INIT to DOWNLOADING
> 2015-04-29 00:41:10,381 INFO localizer.LocalizedResource
> (LocalizedResource.java:handle(203)) - Resource
> hdfs://zsexp/user/yarn/.slider/cluster/storm1/tmp/application_1428575950531_0021/am/lib/javax.inject-1.jar
> transitioned from INIT to DOWNLOADING
> 2015-04-29 00:41:10,381 INFO localizer.LocalizedResource
> (LocalizedResource.java:handle(203)) - Resource
> hdfs://zsexp/user/yarn/.slider/cluster/storm1/tmp/application_1428575950531_0021/am/lib/jersey-guice-1.9.jar
> transitioned from INIT to DOWNLOADING
> 2015-04-29 00:41:10,381 INFO localizer.LocalizedResource
> (LocalizedResource.java:handle(203)) - Resource
> hdfs://zsexp/user/yarn/.slider/cluster/storm1/tmp/application_1428575950531_0021/am/lib/curator-client-2.4.1.jar
> transitioned from INIT to DOWNLOADING
> 2015-04-29 00:41:10,382 INFO localizer.LocalizedResource
> (LocalizedResource.java:handle(203)) - Resource
> hdfs://zsexp/user/yarn/.slider/cluster/storm1/tmp/application_1428575950531_0021/am/lib/guice-3.0.jar
> transitioned from INIT to DOWNLOADING
> 2015-04-29 00:41:10,382 INFO localizer.ResourceLocalizationService
> (ResourceLocalizationService.java:handle(694)) - Created localizer for
> container_1428575950531_0021_01_000001
> 2015-04-29 00:41:10,384 INFO localizer.ResourceLocalizationService
> (ResourceLocalizationService.java:writeCredentials(1148)) - Writing
> credentials to the nmPrivate file
> /grid/2/hadoop/yarn/local/nmPrivate/container_1428575950531_0021_01_000001.tokens.
> Credentials list:
> 2015-04-29 00:41:10,494 INFO nodemanager.DefaultContainerExecutor
> (DefaultContainerExecutor.java:createUserCacheDirs(606)) - Initializing user
> yarn
> 2015-04-29 00:41:10,505 INFO nodemanager.DefaultContainerExecutor
> (DefaultContainerExecutor.java:startLocalizer(116)) - Copying from
> /grid/2/hadoop/yarn/local/nmPrivate/container_1428575950531_0021_01_000001.tokens
> to
> /grid/4/hadoop/yarn/local/usercache/yarn/appcache/application_1428575950531_0021/container_1428575950531_0021_01_000001.tokens
> 2015-04-29 00:41:10,505 INFO nodemanager.DefaultContainerExecutor
> (DefaultContainerExecutor.java:startLocalizer(123)) - Localizer CWD set to
> /grid/4/hadoop/yarn/local/usercache/yarn/appcache/application_1428575950531_0021
> =
> file:/grid/4/hadoop/yarn/local/usercache/yarn/appcache/application_1428575950531_0021
> 2015-04-29 00:41:10,591 INFO localizer.LocalizedResource
> (LocalizedResource.java:handle(203)) - Resource
> hdfs://zsexp/user/yarn/.slider/cluster/storm1/tmp/application_1428575950531_0021/am/lib/htrace-core-3.0.4.jar(->/grid/2/hadoop/yarn/local/usercache/yarn/appcache/application_1428575950531_0021/filecache/10/htrace-core-3.0.4.jar)
> transitioned from DOWNLOADING to LOCALIZED
> 2015-04-29 00:41:10,620 INFO localizer.LocalizedResource
> (LocalizedResource.java:handle(203)) - Resource
> hdfs://zsexp/user/yarn/.slider/cluster/storm1/tmp/application_1428575950531_0021/am/lib/jettison-1.1.jar(->/grid/3/hadoop/yarn/local/usercache/yarn/appcache/application_1428575950531_0021/filecache/11/jettison-1.1.jar)
> transitioned from DOWNLOADING to LOCALIZED
> 2015-04-29 00:41:10,652 INFO localizer.LocalizedResource
> (LocalizedResource.java:handle(203)) - Resource
> hdfs://zsexp/user/yarn/.slider/cluster/storm1/tmp/application_1428575950531_0021/am/lib/api-util-1.0.0-M20.jar(->/grid/4/hadoop/yarn/local/usercache/yarn/appcache/application_1428575950531_0021/filecache/12/api-util-1.0.0-M20.jar)
> transitioned from DOWNLOADING to LOCALIZED
> 2015-04-29 00:41:10,679 INFO localizer.LocalizedResource
> (LocalizedResource.java:handle(203)) - Resource
> hdfs://zsexp/user/yarn/.slider/cluster/storm1/confdir/log4j-server.properties(->/grid/5/hadoop/yarn/local/usercache/yarn/appcache/application_1428575950531_0021/filecache/13/log4j-server.properties)
> transitioned from DOWNLOADING to LOCALIZED
> 2015-04-29 00:41:10,707 INFO localizer.LocalizedResource
> (LocalizedResource.java:handle(203)) - Resource
> hdfs://zsexp/user/yarn/.slider/cluster/storm1/tmp/application_1428575950531_0021/am/lib/httpcore-4.2.5.jar(->/grid/6/hadoop/yarn/local/usercache/yarn/appcache/application_1428575950531_0021/filecache/14/httpcore-4.2.5.jar)
> transitioned from DOWNLOADING to LOCALIZED
> 2015-04-29 00:41:10,733 INFO localizer.LocalizedResource
> (LocalizedResource.java:handle(203)) - Resource
> hdfs://zsexp/user/yarn/.slider/cluster/storm1/tmp/application_1428575950531_0021/am/lib/metrics-core-3.0.1.jar(->/grid/1/hadoop/yarn/local/usercache/yarn/appcache/application_1428575950531_0021/filecache/15/metrics-core-3.0.1.jar)
> transitioned from DOWNLOADING to LOCALIZED
> 2015-04-29 00:41:10,760 INFO localizer.LocalizedResource
> (LocalizedResource.java:handle(203)) - Resource
> hdfs://zsexp/user/yarn/.slider/cluster/storm1/tmp/application_1428575950531_0021/am/lib/slf4j-log4j12-1.6.1.jar(->/grid/2/hadoop/yarn/local/usercache/yarn/appcache/application_1428575950531_0021/filecache/16/slf4j-log4j12-1.6.1.jar)
> transitioned from DOWNLOADING to LOCALIZED
> 2015-04-29 00:41:10,786 INFO localizer.LocalizedResource
> (LocalizedResource.java:handle(203)) - Resource
> hdfs://zsexp/user/yarn/.slider/cluster/storm1/confdir/slider-env.sh(->/grid/3/hadoop/yarn/local/usercache/yarn/appcache/application_1428575950531_0021/filecache/17/slider-env.sh)
> transitioned from DOWNLOADING to LOCALIZED
> 2015-04-29 00:41:10,813 INFO localizer.LocalizedResource
> (LocalizedResource.java:handle(203)) - Resource
> hdfs://zsexp/user/yarn/.slider/cluster/storm1/tmp/application_1428575950531_0021/am/lib/hadoop-mapreduce-client-shuffle-2.6.0.jar(->/grid/4/hadoop/yarn/local/usercache/yarn/appcache/application_1428575950531_0021/filecache/18/hadoop-mapreduce-client-shuffle-2.6.0.jar)
> transitioned from DOWNLOADING to LOCALIZED
> 2015-04-29 00:41:10,846 INFO localizer.LocalizedResource
> (LocalizedResource.java:handle(203)) - Resource
> hdfs://zsexp/user/yarn/.slider/cluster/storm1/tmp/application_1428575950531_0021/am/lib/xercesImpl-2.9.1.jar(->/grid/5/hadoop/yarn/local/usercache/yarn/appcache/application_1428575950531_0021/filecache/19/xercesImpl-2.9.1.jar)
> transitioned from DOWNLOADING to LOCALIZED
> 2015-04-29 00:41:10,920 INFO localizer.LocalizedResource
> (LocalizedResource.java:handle(203)) - Resource
> hdfs://zsexp/user/yarn/.slider/cluster/storm1/tmp/application_1428575950531_0021/am/lib/hadoop-hdfs-2.6.0.jar(->/grid/6/hadoop/yarn/local/usercache/yarn/appcache/application_1428575950531_0021/filecache/20/hadoop-hdfs-2.6.0.jar)
> transitioned from DOWNLOADING to LOCALIZED
> 2015-04-29 00:41:10,952 INFO localizer.LocalizedResource
> (LocalizedResource.java:handle(203)) - Resource
> hdfs://zsexp/user/yarn/.slider/cluster/storm1/tmp/application_1428575950531_0021/am/lib/commons-beanutils-1.7.0.jar(->/grid/1/hadoop/yarn/local/usercache/yarn/appcache/application_1428575950531_0021/filecache/21/commons-beanutils-1.7.0.jar)
> transitioned from DOWNLOADING to LOCALIZED
> 2015-04-29 00:41:10,979 INFO localizer.LocalizedResource
> (LocalizedResource.java:handle(203)) - Resource
> hdfs://zsexp/user/yarn/.slider/cluster/storm1/tmp/application_1428575950531_0021/am/lib/stax-api-1.0.1.jar(->/grid/2/hadoop/yarn/local/usercache/yarn/appcache/application_1428575950531_0021/filecache/22/stax-api-1.0.1.jar)
> transitioned from DOWNLOADING to LOCALIZED
> 2015-04-29 00:41:11,135 INFO localizer.LocalizedResource
> (LocalizedResource.java:handle(203)) - Resource
> hdfs://zsexp/user/yarn/.slider/cluster/storm1/tmp/application_1428575950531_0021/agent/slider-agent.tar.gz(->/grid/3/hadoop/yarn/local/usercache/yarn/appcache/application_1428575950531_0021/filecache/23/slider-agent.tar.gz)
> transitioned from DOWNLOADING to LOCALIZED
> 2015-04-29 00:41:11,164 INFO localizer.LocalizedResource
> (LocalizedResource.java:handle(203)) - Resource
> hdfs://zsexp/user/yarn/.slider/cluster/storm1/tmp/application_1428575950531_0021/am/lib/hadoop-yarn-registry-2.6.0.jar(->/grid/4/hadoop/yarn/local/usercache/yarn/appcache/application_1428575950531_0021/filecache/24/hadoop-yarn-registry-2.6.0.jar)
> transitioned from DOWNLOADING to LOCALIZED
> 2015-04-29 00:41:11,192 INFO localizer.LocalizedResource
> (LocalizedResource.java:handle(203)) - Resource
> hdfs://zsexp/user/yarn/.slider/cluster/storm1/tmp/application_1428575950531_0021/am/lib/xmlenc-0.52.jar(->/grid/5/hadoop/yarn/local/usercache/yarn/appcache/application_1428575950531_0021/filecache/25/xmlenc-0.52.jar)
> transitioned from DOWNLOADING to LOCALIZED
> 2015-04-29 00:41:11,224 INFO localizer.LocalizedResource
> (LocalizedResource.java:handle(203)) - Resource
> hdfs://zsexp/user/yarn/.slider/cluster/storm1/tmp/application_1428575950531_0021/am/lib/jackson-core-asl-1.9.13.jar(->/grid/6/hadoop/yarn/local/usercache/yarn/appcache/application_1428575950531_0021/filecache/26/jackson-core-asl-1.9.13.jar)
> transitioned from DOWNLOADING to LOCALIZED
> 2015-04-29 00:41:11,250 INFO localizer.LocalizedResource
> (LocalizedResource.java:handle(203)) - Resource
> hdfs://zsexp/user/yarn/.slider/cluster/storm1/tmp/application_1428575950531_0021/am/lib/metrics-jvm-3.0.1.jar(->/grid/1/hadoop/yarn/local/usercache/yarn/appcache/application_1428575950531_0021/filecache/27/metrics-jvm-3.0.1.jar)
> transitioned from DOWNLOADING to LOCALIZED
> 2015-04-29 00:41:11,276 INFO localizer.LocalizedResource
> (LocalizedResource.java:handle(203)) - Resource
> hdfs://zsexp/user/yarn/.slider/cluster/storm1/tmp/application_1428575950531_0021/am/lib/paranamer-2.3.jar(->/grid/2/hadoop/yarn/local/usercache/yarn/appcache/application_1428575950531_0021/filecache/28/paranamer-2.3.jar)
> transitioned from DOWNLOADING to LOCALIZED
> 2015-04-29 00:41:11,320 INFO localizer.LocalizedResource
> (LocalizedResource.java:handle(203)) - Resource
> hdfs://zsexp/user/yarn/.slider/cluster/storm1/tmp/application_1428575950531_0021/am/lib/slider-core-0.70.1-incubating.jar(->/grid/3/hadoop/yarn/local/usercache/yarn/appcache/application_1428575950531_0021/filecache/29/slider-core-0.70.1-incubating.jar)
> transitioned from DOWNLOADING to LOCALIZED
> 2015-04-29 00:41:11,355 INFO localizer.LocalizedResource
> (LocalizedResource.java:handle(203)) - Resource
> hdfs://zsexp/user/yarn/.slider/cluster/storm1/tmp/application_1428575950531_0021/am/lib/log4j-1.2.17.jar(->/grid/4/hadoop/yarn/local/usercache/yarn/appcache/application_1428575950531_0021/filecache/30/log4j-1.2.17.jar)
> transitioned from DOWNLOADING to LOCALIZED
> 2015-04-29 00:41:11,381 INFO localizer.LocalizedResource
> (LocalizedResource.java:handle(203)) - Resource
> hdfs://zsexp/user/yarn/.slider/cluster/storm1/confdir/slider-client.xml(->/grid/5/hadoop/yarn/local/usercache/yarn/appcache/application_1428575950531_0021/filecache/31/slider-client.xml)
> transitioned from DOWNLOADING to LOCALIZED
> 2015-04-29 00:41:11,414 INFO localizer.LocalizedResource
> (LocalizedResource.java:handle(203)) - Resource
> hdfs://zsexp/user/yarn/.slider/cluster/storm1/tmp/application_1428575950531_0021/am/lib/jackson-databind-2.2.2.jar(->/grid/6/hadoop/yarn/local/usercache/yarn/appcache/application_1428575950531_0021/filecache/32/jackson-databind-2.2.2.jar)
> transitioned from DOWNLOADING to LOCALIZED
> 2015-04-29 00:41:11,441 INFO localizer.LocalizedResource
> (LocalizedResource.java:handle(203)) - Resource
> hdfs://zsexp/user/yarn/.slider/cluster/storm1/tmp/application_1428575950531_0021/am/lib/guice-servlet-3.0.jar(->/grid/1/hadoop/yarn/local/usercache/yarn/appcache/application_1428575950531_0021/filecache/33/guice-servlet-3.0.jar)
> transitioned from DOWNLOADING to LOCALIZED
> 2015-04-29 00:41:11,468 INFO localizer.LocalizedResource
> (LocalizedResource.java:handle(203)) - Resource
> hdfs://zsexp/user/yarn/.slider/cluster/storm1/tmp/application_1428575950531_0021/am/lib/xml-apis-1.3.04.jar(->/grid/2/hadoop/yarn/local/usercache/yarn/appcache/application_1428575950531_0021/filecache/34/xml-apis-1.3.04.jar)
> transitioned from DOWNLOADING to LOCALIZED
> 2015-04-29 00:41:11,494 INFO localizer.LocalizedResource
> (LocalizedResource.java:handle(203)) - Resource
> hdfs://zsexp/user/yarn/.slider/cluster/storm1/confdir/log4j.properties(->/grid/3/hadoop/yarn/local/usercache/yarn/appcache/application_1428575950531_0021/filecache/35/log4j.properties)
> transitioned from DOWNLOADING to LOCALIZED
> 2015-04-29 00:41:11,519 INFO localizer.LocalizedResource
> (LocalizedResource.java:handle(203)) - Resource
> hdfs://zsexp/user/yarn/.slider/cluster/storm1/confdir/slider-server.xml(->/grid/4/hadoop/yarn/local/usercache/yarn/appcache/application_1428575950531_0021/filecache/36/slider-server.xml)
> transitioned from DOWNLOADING to LOCALIZED
> 2015-04-29 00:41:11,558 INFO localizer.LocalizedResource
> (LocalizedResource.java:handle(203)) - Resource
> hdfs://zsexp/user/yarn/.slider/cluster/storm1/tmp/application_1428575950531_0021/am/lib/jaxb-impl-2.2.3-1.jar(->/grid/5/hadoop/yarn/local/usercache/yarn/appcache/application_1428575950531_0021/filecache/37/jaxb-impl-2.2.3-1.jar)
> transitioned from DOWNLOADING to LOCALIZED
> 2015-04-29 00:41:11,585 INFO localizer.LocalizedResource
> (LocalizedResource.java:handle(203)) - Resource
> hdfs://zsexp/user/yarn/.slider/cluster/storm1/tmp/application_1428575950531_0021/am/lib/hadoop-yarn-server-web-proxy-2.6.0.jar(->/grid/6/hadoop/yarn/local/usercache/yarn/appcache/application_1428575950531_0021/filecache/38/hadoop-yarn-server-web-proxy-2.6.0.jar)
> transitioned from DOWNLOADING to LOCALIZED
> 2015-04-29 00:41:11,620 INFO localizer.LocalizedResource
> (LocalizedResource.java:handle(203)) - Resource
> hdfs://zsexp/user/yarn/.slider/cluster/storm1/tmp/application_1428575950531_0021/am/lib/hadoop-mapreduce-client-core-2.6.0.jar(->/grid/1/hadoop/yarn/local/usercache/yarn/appcache/application_1428575950531_0021/filecache/39/hadoop-mapreduce-client-core-2.6.0.jar)
> transitioned from DOWNLOADING to LOCALIZED
> 2015-04-29 00:41:11,648 INFO localizer.LocalizedResource
> (LocalizedResource.java:handle(203)) - Resource
> hdfs://zsexp/user/yarn/.slider/cluster/storm1/tmp/application_1428575950531_0021/am/lib/hadoop-yarn-client-2.6.0.jar(->/grid/2/hadoop/yarn/local/usercache/yarn/appcache/application_1428575950531_0021/filecache/40/hadoop-yarn-client-2.6.0.jar)
> transitioned from DOWNLOADING to LOCALIZED
> 2015-04-29 00:41:11,685 INFO localizer.LocalizedResource
> (LocalizedResource.java:handle(203)) - Resource
> hdfs://zsexp/user/yarn/.slider/cluster/storm1/tmp/application_1428575950531_0021/am/lib/jackson-mapper-asl-1.9.13.jar(->/grid/3/hadoop/yarn/local/usercache/yarn/appcache/application_1428575950531_0021/filecache/41/jackson-mapper-asl-1.9.13.jar)
> transitioned from DOWNLOADING to LOCALIZED
> 2015-04-29 00:41:11,712 INFO localizer.LocalizedResource
> (LocalizedResource.java:handle(203)) - Resource
> hdfs://zsexp/user/yarn/.slider/cluster/storm1/tmp/application_1428575950531_0021/am/lib/asm-3.1.jar(->/grid/4/hadoop/yarn/local/usercache/yarn/appcache/application_1428575950531_0021/filecache/42/asm-3.1.jar)
> transitioned from DOWNLOADING to LOCALIZED
> 2015-04-29 00:41:11,740 INFO localizer.LocalizedResource
> (LocalizedResource.java:handle(203)) - Resource
> hdfs://zsexp/user/yarn/.slider/cluster/storm1/tmp/application_1428575950531_0021/am/lib/jetty-sslengine-6.1.26.jar(->/grid/5/hadoop/yarn/local/usercache/yarn/appcache/application_1428575950531_0021/filecache/43/jetty-sslengine-6.1.26.jar)
> transitioned from DOWNLOADING to LOCALIZED
> 2015-04-29 00:41:11,779 INFO localizer.LocalizedResource
> (LocalizedResource.java:handle(203)) - Resource
> hdfs://zsexp/user/yarn/.slider/cluster/storm1/tmp/application_1428575950531_0021/am/lib/zookeeper-3.4.6.jar(->/grid/6/hadoop/yarn/local/usercache/yarn/appcache/application_1428575950531_0021/filecache/44/zookeeper-3.4.6.jar)
> transitioned from DOWNLOADING to LOCALIZED
> 2015-04-29 00:41:11,811 INFO localizer.LocalizedResource
> (LocalizedResource.java:handle(203)) - Resource
> hdfs://zsexp/user/yarn/.slider/cluster/storm1/tmp/application_1428575950531_0021/am/lib/hadoop-mapreduce-client-common-2.6.0.jar(->/grid/1/hadoop/yarn/local/usercache/yarn/appcache/application_1428575950531_0021/filecache/45/hadoop-mapreduce-client-common-2.6.0.jar)
> transitioned from DOWNLOADING to LOCALIZED
> 2015-04-29 00:41:11,839 INFO localizer.LocalizedResource
> (LocalizedResource.java:handle(203)) - Resource
> hdfs://zsexp/user/yarn/.slider/cluster/storm1/tmp/application_1428575950531_0021/am/lib/jsp-api-2.1.jar(->/grid/2/hadoop/yarn/local/usercache/yarn/appcache/application_1428575950531_0021/filecache/46/jsp-api-2.1.jar)
> transitioned from DOWNLOADING to LOCALIZED
> 2015-04-29 00:41:11,873 INFO localizer.LocalizedResource
> (LocalizedResource.java:handle(203)) - Resource
> hdfs://zsexp/user/yarn/.slider/cluster/storm1/tmp/application_1428575950531_0021/am/lib/hadoop-auth-2.6.0.jar(->/grid/3/hadoop/yarn/local/usercache/yarn/appcache/application_1428575950531_0021/filecache/47/hadoop-auth-2.6.0.jar)
> transitioned from DOWNLOADING to LOCALIZED
> 2015-04-29 00:41:11,909 INFO localizer.LocalizedResource
> (LocalizedResource.java:handle(203)) - Resource
> hdfs://zsexp/user/yarn/.slider/cluster/storm1/tmp/application_1428575950531_0021/am/lib/commons-math3-3.1.1.jar(->/grid/4/hadoop/yarn/local/usercache/yarn/appcache/application_1428575950531_0021/filecache/48/commons-math3-3.1.1.jar)
> transitioned from DOWNLOADING to LOCALIZED
> 2015-04-29 00:41:11,943 INFO localizer.LocalizedResource
> (LocalizedResource.java:handle(203)) - Resource
> hdfs://zsexp/user/yarn/.slider/cluster/storm1/tmp/application_1428575950531_0021/am/lib/jersey-core-1.9.jar(->/grid/5/hadoop/yarn/local/usercache/yarn/appcache/application_1428575950531_0021/filecache/49/jersey-core-1.9.jar)
> transitioned from DOWNLOADING to LOCALIZED
> 2015-04-29 00:41:11,982 INFO localizer.LocalizedResource
> (LocalizedResource.java:handle(203)) - Resource
> hdfs://zsexp/user/yarn/.slider/cluster/storm1/tmp/application_1428575950531_0021/am/lib/hadoop-yarn-api-2.6.0.jar(->/grid/6/hadoop/yarn/local/usercache/yarn/appcache/application_1428575950531_0021/filecache/50/hadoop-yarn-api-2.6.0.jar)
> transitioned from DOWNLOADING to LOCALIZED
> 2015-04-29 00:41:12,015 INFO localizer.LocalizedResource
> (LocalizedResource.java:handle(203)) - Resource
> hdfs://zsexp/user/yarn/.slider/cluster/storm1/tmp/application_1428575950531_0021/am/lib/avro-1.7.4.jar(->/grid/1/hadoop/yarn/local/usercache/yarn/appcache/application_1428575950531_0021/filecache/51/avro-1.7.4.jar)
> transitioned from DOWNLOADING to LOCALIZED
> 2015-04-29 00:41:12,042 INFO localizer.LocalizedResource
> (LocalizedResource.java:handle(203)) - Resource
> hdfs://zsexp/user/yarn/.slider/cluster/storm1/tmp/application_1428575950531_0021/am/lib/hadoop-client-2.6.0.jar(->/grid/2/hadoop/yarn/local/usercache/yarn/appcache/application_1428575950531_0021/filecache/52/hadoop-client-2.6.0.jar)
> transitioned from DOWNLOADING to LOCALIZED
> 2015-04-29 00:41:12,069 INFO localizer.LocalizedResource
> (LocalizedResource.java:handle(203)) - Resource
> hdfs://zsexp/user/yarn/.slider/cluster/storm1/tmp/application_1428575950531_0021/am/lib/jsr311-api-1.1.1.jar(->/grid/3/hadoop/yarn/local/usercache/yarn/appcache/application_1428575950531_0021/filecache/53/jsr311-api-1.1.1.jar)
> transitioned from DOWNLOADING to LOCALIZED
> 2015-04-29 00:41:12,097 INFO localizer.LocalizedResource
> (LocalizedResource.java:handle(203)) - Resource
> hdfs://zsexp/user/yarn/.slider/cluster/storm1/tmp/application_1428575950531_0021/am/lib/jackson-core-2.2.2.jar(->/grid/4/hadoop/yarn/local/usercache/yarn/appcache/application_1428575950531_0021/filecache/54/jackson-core-2.2.2.jar)
> transitioned from DOWNLOADING to LOCALIZED
> 2015-04-29 00:41:12,127 INFO localizer.LocalizedResource
> (LocalizedResource.java:handle(203)) - Resource
> hdfs://zsexp/user/yarn/.slider/cluster/storm1/tmp/application_1428575950531_0021/am/lib/curator-framework-2.4.1.jar(->/grid/5/hadoop/yarn/local/usercache/yarn/appcache/application_1428575950531_0021/filecache/55/curator-framework-2.4.1.jar)
> transitioned from DOWNLOADING to LOCALIZED
> 2015-04-29 00:41:12,172 INFO localizer.LocalizedResource
> (LocalizedResource.java:handle(203)) - Resource
> hdfs://zsexp/user/yarn/.slider/cluster/storm1/tmp/application_1428575950531_0021/am/lib/netty-3.7.0.Final.jar(->/grid/6/hadoop/yarn/local/usercache/yarn/appcache/application_1428575950531_0021/filecache/56/netty-3.7.0.Final.jar)
> transitioned from DOWNLOADING to LOCALIZED
> 2015-04-29 00:41:12,218 INFO localizer.LocalizedResource
> (LocalizedResource.java:handle(203)) - Resource
> hdfs://zsexp/user/yarn/.slider/cluster/storm1/tmp/application_1428575950531_0021/am/lib/commons-logging-1.1.3.jar(->/grid/1/hadoop/yarn/local/usercache/yarn/appcache/application_1428575950531_0021/filecache/57/commons-logging-1.1.3.jar)
> transitioned from DOWNLOADING to LOCALIZED
> 2015-04-29 00:41:12,247 INFO localizer.LocalizedResource
> (LocalizedResource.java:handle(203)) - Resource
> hdfs://zsexp/user/yarn/.slider/cluster/storm1/tmp/application_1428575950531_0021/am/lib/commons-lang-2.6.jar(->/grid/2/hadoop/yarn/local/usercache/yarn/appcache/application_1428575950531_0021/filecache/58/commons-lang-2.6.jar)
> transitioned from DOWNLOADING to LOCALIZED
> 2015-04-29 00:41:12,276 INFO localizer.LocalizedResource
> (LocalizedResource.java:handle(203)) - Resource
> hdfs://zsexp/user/yarn/.slider/cluster/storm1/tmp/application_1428575950531_0021/am/lib/curator-recipes-2.6.0.jar(->/grid/3/hadoop/yarn/local/usercache/yarn/appcache/application_1428575950531_0021/filecache/59/curator-recipes-2.6.0.jar)
> transitioned from DOWNLOADING to LOCALIZED
> 2015-04-29 00:41:12,304 INFO localizer.LocalizedResource
> (LocalizedResource.java:handle(203)) - Resource
> hdfs://zsexp/user/yarn/.slider/cluster/storm1/tmp/application_1428575950531_0021/am/lib/jackson-annotations-2.2.2.jar(->/grid/4/hadoop/yarn/local/usercache/yarn/appcache/application_1428575950531_0021/filecache/60/jackson-annotations-2.2.2.jar)
> transitioned from DOWNLOADING to LOCALIZED
> 2015-04-29 00:41:12,332 INFO localizer.LocalizedResource
> (LocalizedResource.java:handle(203)) - Resource
> hdfs://zsexp/user/yarn/.slider/cluster/storm1/tmp/application_1428575950531_0021/am/lib/jsr305-1.3.9.jar(->/grid/5/hadoop/yarn/local/usercache/yarn/appcache/application_1428575950531_0021/filecache/61/jsr305-1.3.9.jar)
> transitioned from DOWNLOADING to LOCALIZED
> 2015-04-29 00:41:12,359 INFO localizer.LocalizedResource
> (LocalizedResource.java:handle(203)) - Resource
> hdfs://zsexp/user/yarn/.slider/cluster/storm1/tmp/application_1428575950531_0021/am/lib/slf4j-api-1.7.5.jar(->/grid/6/hadoop/yarn/local/usercache/yarn/appcache/application_1428575950531_0021/filecache/62/slf4j-api-1.7.5.jar)
> transitioned from DOWNLOADING to LOCALIZED
> 2015-04-29 00:41:12,386 INFO localizer.LocalizedResource
> (LocalizedResource.java:handle(203)) - Resource
> hdfs://zsexp/user/yarn/.slider/cluster/storm1/tmp/application_1428575950531_0021/am/lib/aopalliance-1.0.jar(->/grid/1/hadoop/yarn/local/usercache/yarn/appcache/application_1428575950531_0021/filecache/63/aopalliance-1.0.jar)
> transitioned from DOWNLOADING to LOCALIZED
> 2015-04-29 00:41:12,415 INFO localizer.LocalizedResource
> (LocalizedResource.java:handle(203)) - Resource
> hdfs://zsexp/user/yarn/.slider/cluster/storm1/tmp/application_1428575950531_0021/am/lib/commons-digester-1.8.jar(->/grid/2/hadoop/yarn/local/usercache/yarn/appcache/application_1428575950531_0021/filecache/64/commons-digester-1.8.jar)
> transitioned from DOWNLOADING to LOCALIZED
> 2015-04-29 00:41:12,442 INFO localizer.LocalizedResource
> (LocalizedResource.java:handle(203)) - Resource
> hdfs://zsexp/user/yarn/.slider/cluster/storm1/tmp/application_1428575950531_0021/am/lib/metrics-json-3.0.1.jar(->/grid/3/hadoop/yarn/local/usercache/yarn/appcache/application_1428575950531_0021/filecache/65/metrics-json-3.0.1.jar)
> transitioned from DOWNLOADING to LOCALIZED
> 2015-04-29 00:41:12,473 INFO localizer.LocalizedResource
> (LocalizedResource.java:handle(203)) - Resource
> hdfs://zsexp/user/yarn/.slider/cluster/storm1/tmp/application_1428575950531_0021/am/lib/commons-compress-1.4.1.jar(->/grid/4/hadoop/yarn/local/usercache/yarn/appcache/application_1428575950531_0021/filecache/66/commons-compress-1.4.1.jar)
> transitioned from DOWNLOADING to LOCALIZED
> 2015-04-29 00:41:12,506 INFO localizer.LocalizedResource
> (LocalizedResource.java:handle(203)) - Resource
> hdfs://zsexp/user/yarn/.slider/cluster/storm1/tmp/application_1428575950531_0021/am/lib/hadoop-mapreduce-client-jobclient-2.6.0.jar(->/grid/5/hadoop/yarn/local/usercache/yarn/appcache/application_1428575950531_0021/filecache/67/hadoop-mapreduce-client-jobclient-2.6.0.jar)
> transitioned from DOWNLOADING to LOCALIZED
> 2015-04-29 00:41:12,536 INFO localizer.LocalizedResource
> (LocalizedResource.java:handle(203)) - Resource
> hdfs://zsexp/user/yarn/.slider/cluster/storm1/tmp/application_1428575950531_0021/am/lib/commons-net-3.1.jar(->/grid/6/hadoop/yarn/local/usercache/yarn/appcache/application_1428575950531_0021/filecache/68/commons-net-3.1.jar)
> transitioned from DOWNLOADING to LOCALIZED
> 2015-04-29 00:41:12,565 INFO localizer.LocalizedResource
> (LocalizedResource.java:handle(203)) - Resource
> hdfs://zsexp/user/yarn/.slider/cluster/storm1/tmp/application_1428575950531_0021/am/lib/hadoop-yarn-server-common-2.6.0.jar(->/grid/1/hadoop/yarn/local/usercache/yarn/appcache/application_1428575950531_0021/filecache/69/hadoop-yarn-server-common-2.6.0.jar)
> transitioned from DOWNLOADING to LOCALIZED
> 2015-04-29 00:41:12,601 INFO localizer.LocalizedResource
> (LocalizedResource.java:handle(203)) - Resource
> hdfs://zsexp/user/yarn/.slider/cluster/storm1/tmp/application_1428575950531_0021/am/lib/jetty-6.1.26.jar(->/grid/2/hadoop/yarn/local/usercache/yarn/appcache/application_1428575950531_0021/filecache/70/jetty-6.1.26.jar)
> transitioned from DOWNLOADING to LOCALIZED
> 2015-04-29 00:41:12,629 INFO localizer.LocalizedResource
> (LocalizedResource.java:handle(203)) - Resource
> hdfs://zsexp/user/yarn/.slider/cluster/storm1/tmp/application_1428575950531_0021/am/lib/jcommander-1.30.jar(->/grid/3/hadoop/yarn/local/usercache/yarn/appcache/application_1428575950531_0021/filecache/71/jcommander-1.30.jar)
> transitioned from DOWNLOADING to LOCALIZED
> 2015-04-29 00:41:12,659 INFO localizer.LocalizedResource
> (LocalizedResource.java:handle(203)) - Resource
> hdfs://zsexp/user/yarn/.slider/cluster/storm1/tmp/application_1428575950531_0021/am/lib/httpclient-4.2.5.jar(->/grid/4/hadoop/yarn/local/usercache/yarn/appcache/application_1428575950531_0021/filecache/72/httpclient-4.2.5.jar)
> transitioned from DOWNLOADING to LOCALIZED
> 2015-04-29 00:41:12,696 INFO localizer.LocalizedResource
> (LocalizedResource.java:handle(203)) - Resource
> hdfs://zsexp/user/yarn/.slider/cluster/storm1/tmp/application_1428575950531_0021/am/lib/hadoop-yarn-common-2.6.0.jar(->/grid/5/hadoop/yarn/local/usercache/yarn/appcache/application_1428575950531_0021/filecache/73/hadoop-yarn-common-2.6.0.jar)
> transitioned from DOWNLOADING to LOCALIZED
> 2015-04-29 00:41:12,727 INFO localizer.LocalizedResource
> (LocalizedResource.java:handle(203)) - Resource
> hdfs://zsexp/user/yarn/.slider/cluster/storm1/tmp/application_1428575950531_0021/am/lib/xz-1.0.jar(->/grid/6/hadoop/yarn/local/usercache/yarn/appcache/application_1428575950531_0021/filecache/74/xz-1.0.jar)
> transitioned from DOWNLOADING to LOCALIZED
> 2015-04-29 00:41:12,765 INFO localizer.LocalizedResource
> (LocalizedResource.java:handle(203)) - Resource
> hdfs://zsexp/user/yarn/.slider/cluster/storm1/tmp/application_1428575950531_0021/am/lib/apacheds-kerberos-codec-2.0.0-M15.jar(->/grid/1/hadoop/yarn/local/usercache/yarn/appcache/application_1428575950531_0021/filecache/75/apacheds-kerberos-codec-2.0.0-M15.jar)
> transitioned from DOWNLOADING to LOCALIZED
> 2015-04-29 00:41:12,794 INFO localizer.LocalizedResource
> (LocalizedResource.java:handle(203)) - Resource
> hdfs://zsexp/user/yarn/.slider/cluster/storm1/tmp/application_1428575950531_0021/am/lib/commons-beanutils-core-1.8.0.jar(->/grid/2/hadoop/yarn/local/usercache/yarn/appcache/application_1428575950531_0021/filecache/76/commons-beanutils-core-1.8.0.jar)
> transitioned from DOWNLOADING to LOCALIZED
> 2015-04-29 00:41:12,822 INFO localizer.LocalizedResource
> (LocalizedResource.java:handle(203)) - Resource
> hdfs://zsexp/user/yarn/.slider/cluster/storm1/tmp/application_1428575950531_0021/am/lib/jackson-xc-1.9.13.jar(->/grid/3/hadoop/yarn/local/usercache/yarn/appcache/application_1428575950531_0021/filecache/77/jackson-xc-1.9.13.jar)
> transitioned from DOWNLOADING to LOCALIZED
> 2015-04-29 00:41:12,850 INFO localizer.LocalizedResource
> (LocalizedResource.java:handle(203)) - Resource
> hdfs://zsexp/user/yarn/.slider/cluster/storm1/tmp/application_1428575950531_0021/am/lib/metrics-healthchecks-3.0.1.jar(->/grid/4/hadoop/yarn/local/usercache/yarn/appcache/application_1428575950531_0021/filecache/78/metrics-healthchecks-3.0.1.jar)
> transitioned from DOWNLOADING to LOCALIZED
> 2015-04-29 00:41:12,879 INFO localizer.LocalizedResource
> (LocalizedResource.java:handle(203)) - Resource
> hdfs://zsexp/user/yarn/.slider/cluster/storm1/tmp/application_1428575950531_0021/am/lib/commons-io-2.4.jar(->/grid/5/hadoop/yarn/local/usercache/yarn/appcache/application_1428575950531_0021/filecache/79/commons-io-2.4.jar)
> transitioned from DOWNLOADING to LOCALIZED
> 2015-04-29 00:41:12,927 INFO localizer.LocalizedResource
> (LocalizedResource.java:handle(203)) - Resource
> hdfs://zsexp/user/yarn/.slider/cluster/storm1/tmp/application_1428575950531_0021/am/lib/hadoop-common-2.6.0.jar(->/grid/6/hadoop/yarn/local/usercache/yarn/appcache/application_1428575950531_0021/filecache/80/hadoop-common-2.6.0.jar)
> transitioned from DOWNLOADING to LOCALIZED
> 2015-04-29 00:41:12,964 INFO localizer.LocalizedResource
> (LocalizedResource.java:handle(203)) - Resource
> hdfs://zsexp/user/yarn/.slider/cluster/storm1/tmp/application_1428575950531_0021/am/lib/guava-11.0.2.jar(->/grid/1/hadoop/yarn/local/usercache/yarn/appcache/application_1428575950531_0021/filecache/81/guava-11.0.2.jar)
> transitioned from DOWNLOADING to LOCALIZED
> 2015-04-29 00:41:13,001 INFO localizer.LocalizedResource
> (LocalizedResource.java:handle(203)) - Resource
> hdfs://zsexp/user/yarn/.slider/cluster/storm1/tmp/application_1428575950531_0021/am/lib/commons-collections-3.2.1.jar(->/grid/2/hadoop/yarn/local/usercache/yarn/appcache/application_1428575950531_0021/filecache/82/commons-collections-3.2.1.jar)
> transitioned from DOWNLOADING to LOCALIZED
> 2015-04-29 00:41:13,028 INFO localizer.LocalizedResource
> (LocalizedResource.java:handle(203)) - Resource
> hdfs://zsexp/user/yarn/.slider/cluster/storm1/tmp/application_1428575950531_0021/am/lib/jersey-client-1.9.jar(->/grid/3/hadoop/yarn/local/usercache/yarn/appcache/application_1428575950531_0021/filecache/83/jersey-client-1.9.jar)
> transitioned from DOWNLOADING to LOCALIZED
> 2015-04-29 00:41:13,057 INFO localizer.LocalizedResource
> (LocalizedResource.java:handle(203)) - Resource
> hdfs://zsexp/user/yarn/.slider/cluster/storm1/tmp/application_1428575950531_0021/am/lib/servlet-api-2.5.jar(->/grid/4/hadoop/yarn/local/usercache/yarn/appcache/application_1428575950531_0021/filecache/84/servlet-api-2.5.jar)
> transitioned from DOWNLOADING to LOCALIZED
> 2015-04-29 00:41:13,093 INFO localizer.LocalizedResource
> (LocalizedResource.java:handle(203)) - Resource
> hdfs://zsexp/user/yarn/.slider/cluster/storm1/tmp/application_1428575950531_0021/am/lib/protobuf-java-2.5.0.jar(->/grid/5/hadoop/yarn/local/usercache/yarn/appcache/application_1428575950531_0021/filecache/85/protobuf-java-2.5.0.jar)
> transitioned from DOWNLOADING to LOCALIZED
> 2015-04-29 00:41:13,133 INFO localizer.LocalizedResource
> (LocalizedResource.java:handle(203)) - Resource
> hdfs://zsexp/user/yarn/.slider/cluster/storm1/tmp/application_1428575950531_0021/am/lib/snappy-java-1.0.4.1.jar(->/grid/6/hadoop/yarn/local/usercache/yarn/appcache/application_1428575950531_0021/filecache/86/snappy-java-1.0.4.1.jar)
> transitioned from DOWNLOADING to LOCALIZED
> 2015-04-29 00:41:13,166 INFO localizer.LocalizedResource
> (LocalizedResource.java:handle(203)) - Resource
> hdfs://zsexp/user/yarn/.slider/cluster/storm1/tmp/application_1428575950531_0021/am/lib/jline-0.9.94.jar(->/grid/1/hadoop/yarn/local/usercache/yarn/appcache/application_1428575950531_0021/filecache/87/jline-0.9.94.jar)
> transitioned from DOWNLOADING to LOCALIZED
> 2015-04-29 00:41:13,194 INFO localizer.LocalizedResource
> (LocalizedResource.java:handle(203)) - Resource
> hdfs://zsexp/user/yarn/.slider/cluster/storm1/tmp/application_1428575950531_0021/am/lib/apacheds-i18n-2.0.0-M15.jar(->/grid/2/hadoop/yarn/local/usercache/yarn/appcache/application_1428575950531_0021/filecache/88/apacheds-i18n-2.0.0-M15.jar)
> transitioned from DOWNLOADING to LOCALIZED
> 2015-04-29 00:41:13,223 INFO localizer.LocalizedResource
> (LocalizedResource.java:handle(203)) - Resource
> hdfs://zsexp/user/yarn/.slider/cluster/storm1/tmp/application_1428575950531_0021/am/lib/jaxb-api-2.2.7.jar(->/grid/3/hadoop/yarn/local/usercache/yarn/appcache/application_1428575950531_0021/filecache/89/jaxb-api-2.2.7.jar)
> transitioned from DOWNLOADING to LOCALIZED
> 2015-04-29 00:41:13,265 INFO localizer.LocalizedResource
> (LocalizedResource.java:handle(203)) - Resource
> hdfs://zsexp/user/yarn/.slider/cluster/storm1/tmp/application_1428575950531_0021/am/lib/leveldbjni-all-1.8.jar(->/grid/4/hadoop/yarn/local/usercache/yarn/appcache/application_1428575950531_0021/filecache/90/leveldbjni-all-1.8.jar)
> transitioned from DOWNLOADING to LOCALIZED
> 2015-04-29 00:41:13,296 INFO localizer.LocalizedResource
> (LocalizedResource.java:handle(203)) - Resource
> hdfs://zsexp/user/yarn/.slider/cluster/storm1/tmp/application_1428575950531_0021/am/lib/gson-2.2.2.jar(->/grid/5/hadoop/yarn/local/usercache/yarn/appcache/application_1428575950531_0021/filecache/91/gson-2.2.2.jar)
> transitioned from DOWNLOADING to LOCALIZED
> 2015-04-29 00:41:13,333 INFO localizer.LocalizedResource
> (LocalizedResource.java:handle(203)) - Resource
> hdfs://zsexp/user/yarn/.slider/cluster/storm1/tmp/application_1428575950531_0021/am/lib/hadoop-mapreduce-client-app-2.6.0.jar(->/grid/6/hadoop/yarn/local/usercache/yarn/appcache/application_1428575950531_0021/filecache/92/hadoop-mapreduce-client-app-2.6.0.jar)
> transitioned from DOWNLOADING to LOCALIZED
> 2015-04-29 00:41:13,369 INFO localizer.LocalizedResource
> (LocalizedResource.java:handle(203)) - Resource
> hdfs://zsexp/user/yarn/.slider/cluster/storm1/tmp/application_1428575950531_0021/am/lib/slider.jar(->/grid/1/hadoop/yarn/local/usercache/yarn/appcache/application_1428575950531_0021/filecache/93/slider.jar)
> transitioned from DOWNLOADING to LOCALIZED
> 2015-04-29 00:41:13,397 INFO localizer.LocalizedResource
> (LocalizedResource.java:handle(203)) - Resource
> hdfs://zsexp/user/yarn/.slider/cluster/storm1/tmp/application_1428575950531_0021/am/lib/jackson-jaxrs-1.9.13.jar(->/grid/2/hadoop/yarn/local/usercache/yarn/appcache/application_1428575950531_0021/filecache/94/jackson-jaxrs-1.9.13.jar)
> transitioned from DOWNLOADING to LOCALIZED
> 2015-04-29 00:41:13,427 INFO localizer.LocalizedResource
> (LocalizedResource.java:handle(203)) - Resource
> hdfs://zsexp/user/yarn/.slider/cluster/storm1/tmp/application_1428575950531_0021/am/lib/hadoop-annotations-2.6.0.jar(->/grid/3/hadoop/yarn/local/usercache/yarn/appcache/application_1428575950531_0021/filecache/95/hadoop-annotations-2.6.0.jar)
> transitioned from DOWNLOADING to LOCALIZED
> 2015-04-29 00:41:13,457 INFO localizer.LocalizedResource
> (LocalizedResource.java:handle(203)) - Resource
> hdfs://zsexp/user/yarn/.slider/cluster/storm1/tmp/application_1428575950531_0021/am/lib/jersey-json-1.9.jar(->/grid/4/hadoop/yarn/local/usercache/yarn/appcache/application_1428575950531_0021/filecache/96/jersey-json-1.9.jar)
> transitioned from DOWNLOADING to LOCALIZED
> 2015-04-29 00:41:13,487 INFO localizer.LocalizedResource
> (LocalizedResource.java:handle(203)) - Resource
> hdfs://zsexp/user/yarn/.slider/cluster/storm1/tmp/application_1428575950531_0021/am/lib/commons-httpclient-3.1.jar(->/grid/5/hadoop/yarn/local/usercache/yarn/appcache/application_1428575950531_0021/filecache/97/commons-httpclient-3.1.jar)
> transitioned from DOWNLOADING to LOCALIZED
> 2015-04-29 00:41:13,516 INFO localizer.LocalizedResource
> (LocalizedResource.java:handle(203)) - Resource
> hdfs://zsexp/user/yarn/.slider/cluster/storm1/tmp/application_1428575950531_0021/am/lib/jetty-util-6.1.26.jar(->/grid/6/hadoop/yarn/local/usercache/yarn/appcache/application_1428575950531_0021/filecache/98/jetty-util-6.1.26.jar)
> transitioned from DOWNLOADING to LOCALIZED
> 2015-04-29 00:41:13,544 INFO localizer.LocalizedResource
> (LocalizedResource.java:handle(203)) - Resource
> hdfs://zsexp/user/yarn/.slider/cluster/storm1/tmp/application_1428575950531_0021/am/lib/api-asn1-api-1.0.0-M20.jar(->/grid/1/hadoop/yarn/local/usercache/yarn/appcache/application_1428575950531_0021/filecache/99/api-asn1-api-1.0.0-M20.jar)
> transitioned from DOWNLOADING to LOCALIZED
> 2015-04-29 00:41:13,576 INFO localizer.LocalizedResource
> (LocalizedResource.java:handle(203)) - Resource
> hdfs://zsexp/user/yarn/.slider/cluster/storm1/tmp/application_1428575950531_0021/am/lib/jersey-server-1.9.jar(->/grid/2/hadoop/yarn/local/usercache/yarn/appcache/application_1428575950531_0021/filecache/100/jersey-server-1.9.jar)
> transitioned from DOWNLOADING to LOCALIZED
> 2015-04-29 00:41:13,606 INFO localizer.LocalizedResource
> (LocalizedResource.java:handle(203)) - Resource
> hdfs://zsexp/user/yarn/.slider/cluster/storm1/tmp/application_1428575950531_0021/am/lib/commons-cli-1.2.jar(->/grid/3/hadoop/yarn/local/usercache/yarn/appcache/application_1428575950531_0021/filecache/101/commons-cli-1.2.jar)
> transitioned from DOWNLOADING to LOCALIZED
> 2015-04-29 00:41:13,634 INFO localizer.LocalizedResource
> (LocalizedResource.java:handle(203)) - Resource
> hdfs://zsexp/user/yarn/.slider/cluster/storm1/tmp/application_1428575950531_0021/am/lib/metrics-servlets-3.0.1.jar(->/grid/4/hadoop/yarn/local/usercache/yarn/appcache/application_1428575950531_0021/filecache/102/metrics-servlets-3.0.1.jar)
> transitioned from DOWNLOADING to LOCALIZED
> 2015-04-29 00:41:13,663 INFO localizer.LocalizedResource
> (LocalizedResource.java:handle(203)) - Resource
> hdfs://zsexp/user/yarn/.slider/cluster/storm1/tmp/application_1428575950531_0021/am/lib/commons-configuration-1.6.jar(->/grid/5/hadoop/yarn/local/usercache/yarn/appcache/application_1428575950531_0021/filecache/103/commons-configuration-1.6.jar)
> transitioned from DOWNLOADING to LOCALIZED
> 2015-04-29 00:41:13,692 INFO localizer.LocalizedResource
> (LocalizedResource.java:handle(203)) - Resource
> hdfs://zsexp/user/yarn/.slider/cluster/storm1/tmp/application_1428575950531_0021/am/lib/commons-codec-1.6.jar(->/grid/6/hadoop/yarn/local/usercache/yarn/appcache/application_1428575950531_0021/filecache/104/commons-codec-1.6.jar)
> transitioned from DOWNLOADING to LOCALIZED
> 2015-04-29 00:41:13,721 INFO localizer.LocalizedResource
> (LocalizedResource.java:handle(203)) - Resource
> hdfs://zsexp/user/yarn/.slider/cluster/storm1/tmp/application_1428575950531_0021/am/lib/javax.inject-1.jar(->/grid/1/hadoop/yarn/local/usercache/yarn/appcache/application_1428575950531_0021/filecache/105/javax.inject-1.jar)
> transitioned from DOWNLOADING to LOCALIZED
> 2015-04-29 00:41:13,750 INFO localizer.LocalizedResource
> (LocalizedResource.java:handle(203)) - Resource
> hdfs://zsexp/user/yarn/.slider/cluster/storm1/tmp/application_1428575950531_0021/am/lib/jersey-guice-1.9.jar(->/grid/2/hadoop/yarn/local/usercache/yarn/appcache/application_1428575950531_0021/filecache/106/jersey-guice-1.9.jar)
> transitioned from DOWNLOADING to LOCALIZED
> 2015-04-29 00:41:13,784 INFO localizer.LocalizedResource
> (LocalizedResource.java:handle(203)) - Resource
> hdfs://zsexp/user/yarn/.slider/cluster/storm1/tmp/application_1428575950531_0021/am/lib/curator-client-2.4.1.jar(->/grid/3/hadoop/yarn/local/usercache/yarn/appcache/application_1428575950531_0021/filecache/107/curator-client-2.4.1.jar)
> transitioned from DOWNLOADING to LOCALIZED
> 2015-04-29 00:41:13,816 INFO localizer.LocalizedResource
> (LocalizedResource.java:handle(203)) - Resource
> hdfs://zsexp/user/yarn/.slider/cluster/storm1/tmp/application_1428575950531_0021/am/lib/guice-3.0.jar(->/grid/4/hadoop/yarn/local/usercache/yarn/appcache/application_1428575950531_0021/filecache/108/guice-3.0.jar)
> transitioned from DOWNLOADING to LOCALIZED
> 2015-04-29 00:41:13,816 INFO container.Container
> (ContainerImpl.java:handle(999)) - Container
> container_1428575950531_0021_01_000001 transitioned from LOCALIZING to
> LOCALIZED
> 2015-04-29 00:41:13,862 INFO container.Container
> (ContainerImpl.java:handle(999)) - Container
> container_1428575950531_0021_01_000001 transitioned from LOCALIZED to RUNNING
> 2015-04-29 00:41:13,870 INFO nodemanager.DefaultContainerExecutor
> (DefaultContainerExecutor.java:buildCommandExecutor(267)) - launchContainer:
> [bash,
> /grid/4/hadoop/yarn/local/usercache/yarn/appcache/application_1428575950531_0021/container_1428575950531_0021_01_000001/default_container_executor.sh]
> 2015-04-29 00:41:15,618 INFO monitor.ContainersMonitorImpl
> (ContainersMonitorImpl.java:run(346)) - Starting resource-monitoring for
> container_1428575950531_0021_01_000001
> 2015-04-29 00:41:15,664 INFO monitor.ContainersMonitorImpl
> (ContainersMonitorImpl.java:run(408)) - Memory usage of ProcessTree 41169 for
> container-id container_1428575950531_0021_01_000001: 68.0 MB of 3.5 GB
> physical memory used; 739.0 MB of 7.3 GB virtual memory used
> 2015-04-29 00:41:18,681 INFO monitor.ContainersMonitorImpl
> (ContainersMonitorImpl.java:run(408)) - Memory usage of ProcessTree 41169 for
> container-id container_1428575950531_0021_01_000001: 172.5 MB of 3.5 GB
> physical memory used; 774.3 MB of 7.3 GB virtual memory used
> 2015-04-29 00:41:21,704 INFO monitor.ContainersMonitorImpl
> (ContainersMonitorImpl.java:run(408)) - Memory usage of ProcessTree 41169 for
> container-id container_1428575950531_0021_01_000001: 190.4 MB of 3.5 GB
> physical memory used; 799.8 MB of 7.3 GB virtual memory used
> 2015-04-29 00:41:23,617 INFO ipc.Server (Server.java:saslProcess(1306)) -
> Auth successful for appattempt_1428575950531_0021_000001 (auth:SIMPLE)
> 2015-04-29 00:41:23,627 INFO containermanager.ContainerManagerImpl
> (ContainerManagerImpl.java:startContainerInternal(803)) - Start request for
> container_1428575950531_0021_01_000005 by user yarn
> 2015-04-29 00:41:23,629 INFO application.Application
> (ApplicationImpl.java:transition(304)) - Adding
> container_1428575950531_0021_01_000005 to application
> application_1428575950531_0021
> 2015-04-29 00:41:23,629 INFO nodemanager.NMAuditLogger
> (NMAuditLogger.java:logSuccess(89)) - USER=yarn IP=10.84.104.129
> OPERATION=Start Container Request TARGET=ContainerManageImpl
> RESULT=SUCCESS APPID=application_1428575950531_0021
> CONTAINERID=container_1428575950531_0021_01_000005
> 2015-04-29 00:41:23,629 INFO container.Container
> (ContainerImpl.java:handle(999)) - Container
> container_1428575950531_0021_01_000005 transitioned from NEW to LOCALIZING
> 2015-04-29 00:41:23,630 INFO containermanager.AuxServices
> (AuxServices.java:handle(196)) - Got event CONTAINER_INIT for appId
> application_1428575950531_0021
> 2015-04-29 00:41:23,630 INFO localizer.LocalizedResource
> (LocalizedResource.java:handle(203)) - Resource
> hdfs://zsexp/user/yarn/.slider/package/STORM/slider-storm-app-package-0.9.3.2.2.0.0-2041.zip
> transitioned from INIT to DOWNLOADING
> 2015-04-29 00:41:23,631 INFO localizer.ResourceLocalizationService
> (ResourceLocalizationService.java:handle(694)) - Created localizer for
> container_1428575950531_0021_01_000005
> 2015-04-29 00:41:23,633 INFO localizer.ResourceLocalizationService
> (ResourceLocalizationService.java:writeCredentials(1148)) - Writing
> credentials to the nmPrivate file
> /grid/4/hadoop/yarn/local/nmPrivate/container_1428575950531_0021_01_000005.tokens.
> Credentials list:
> 2015-04-29 00:41:23,755 INFO nodemanager.DefaultContainerExecutor
> (DefaultContainerExecutor.java:createUserCacheDirs(606)) - Initializing user
> yarn
> 2015-04-29 00:41:23,761 INFO nodemanager.DefaultContainerExecutor
> (DefaultContainerExecutor.java:startLocalizer(116)) - Copying from
> /grid/4/hadoop/yarn/local/nmPrivate/container_1428575950531_0021_01_000005.tokens
> to
> /grid/6/hadoop/yarn/local/usercache/yarn/appcache/application_1428575950531_0021/container_1428575950531_0021_01_000005.tokens
> 2015-04-29 00:41:23,761 INFO nodemanager.DefaultContainerExecutor
> (DefaultContainerExecutor.java:startLocalizer(123)) - Localizer CWD set to
> /grid/6/hadoop/yarn/local/usercache/yarn/appcache/application_1428575950531_0021
> =
> file:/grid/6/hadoop/yarn/local/usercache/yarn/appcache/application_1428575950531_0021
> 2015-04-29 00:41:23,777 INFO ipc.Server (Server.java:saslProcess(1306)) -
> Auth successful for appattempt_1428575950531_0021_000001 (auth:SIMPLE)
> 2015-04-29 00:41:23,782 INFO containermanager.ContainerManagerImpl
> (ContainerManagerImpl.java:getContainerStatusInternal(1008)) - Getting
> container-status for container_1428575950531_0021_01_000005
> 2015-04-29 00:41:23,782 INFO containermanager.ContainerManagerImpl
> (ContainerManagerImpl.java:getContainerStatusInternal(1022)) - Returning
> ContainerStatus: [ContainerId: container_1428575950531_0021_01_000005, State:
> RUNNING, Diagnostics: , ExitStatus: -1000, ]
> 2015-04-29 00:41:24,251 INFO localizer.LocalizedResource
> (LocalizedResource.java:handle(203)) - Resource
> hdfs://zsexp/user/yarn/.slider/package/STORM/slider-storm-app-package-0.9.3.2.2.0.0-2041.zip(->/grid/4/hadoop/yarn/local/usercache/yarn/appcache/application_1428575950531_0021/filecache/109/slider-storm-app-package-0.9.3.2.2.0.0-2041.zip)
> transitioned from DOWNLOADING to LOCALIZED
> 2015-04-29 00:41:24,251 INFO container.Container
> (ContainerImpl.java:handle(999)) - Container
> container_1428575950531_0021_01_000005 transitioned from LOCALIZING to
> LOCALIZED
> 2015-04-29 00:41:24,299 INFO container.Container
> (ContainerImpl.java:handle(999)) - Container
> container_1428575950531_0021_01_000005 transitioned from LOCALIZED to RUNNING
> 2015-04-29 00:41:24,307 INFO nodemanager.DefaultContainerExecutor
> (DefaultContainerExecutor.java:buildCommandExecutor(267)) - launchContainer:
> [bash,
> /grid/3/hadoop/yarn/local/usercache/yarn/appcache/application_1428575950531_0021/container_1428575950531_0021_01_000005/default_container_executor.sh]
> 2015-04-29 00:41:24,704 INFO monitor.ContainersMonitorImpl
> (ContainersMonitorImpl.java:run(346)) - Starting resource-monitoring for
> container_1428575950531_0021_01_000005
> 2015-04-29 00:41:24,747 INFO monitor.ContainersMonitorImpl
> (ContainersMonitorImpl.java:run(408)) - Memory usage of ProcessTree 41169 for
> container-id container_1428575950531_0021_01_000001: 210.6 MB of 3.5 GB
> physical memory used; 823.9 MB of 7.3 GB virtual memory used
> 2015-04-29 00:41:24,795 INFO monitor.ContainersMonitorImpl
> (ContainersMonitorImpl.java:run(408)) - Memory usage of ProcessTree 41585 for
> container-id container_1428575950531_0021_01_000005: 14.3 MB of 3.5 GB
> physical memory used; 279.9 MB of 7.3 GB virtual memory used
> 2015-04-29 00:41:27,837 INFO monitor.ContainersMonitorImpl
> (ContainersMonitorImpl.java:run(408)) - Memory usage of ProcessTree 41169 for
> container-id container_1428575950531_0021_01_000001: 211.4 MB of 3.5 GB
> physical memory used; 824.9 MB of 7.3 GB virtual memory used
> 2015-04-29 00:41:27,884 INFO monitor.ContainersMonitorImpl
> (ContainersMonitorImpl.java:run(408)) - Memory usage of ProcessTree 41585 for
> container-id container_1428575950531_0021_01_000005: 15.0 MB of 3.5 GB
> physical memory used; 280.0 MB of 7.3 GB virtual memory used
> .
> .
> .
> 2015-04-29 00:55:55,558 INFO monitor.ContainersMonitorImpl
> (ContainersMonitorImpl.java:run(408)) - Memory usage of ProcessTree 41169 for
> container-id container_1428575950531_0021_01_000001: 222.8 MB of 3.5 GB
> physical memory used; 830.9 MB of 7.3 GB virtual memory used
> 2015-04-29 00:55:55,605 INFO monitor.ContainersMonitorImpl
> (ContainersMonitorImpl.java:run(408)) - Memory usage of ProcessTree 41585 for
> container-id container_1428575950531_0021_01_000005: 15.4 MB of 3.5 GB
> physical memory used; 280.3 MB of 7.3 GB virtual memory used
> 2015-04-29 00:55:58,646 INFO monitor.ContainersMonitorImpl
> (ContainersMonitorImpl.java:run(408)) - Memory usage of ProcessTree 41169 for
> container-id container_1428575950531_0021_01_000001: 222.8 MB of 3.5 GB
> physical memory used; 830.9 MB of 7.3 GB virtual memory used
> 2015-04-29 00:55:58,693 INFO monitor.ContainersMonitorImpl
> (ContainersMonitorImpl.java:run(408)) - Memory usage of ProcessTree 41585 for
> container-id container_1428575950531_0021_01_000005: 15.4 MB of 3.5 GB
> physical memory used; 280.3 MB of 7.3 GB virtual memory used
> 2015-04-29 00:56:00,463 INFO ipc.Server (Server.java:saslProcess(1306)) -
> Auth successful for appattempt_1428575950531_0021_000001 (auth:SIMPLE)
> 2015-04-29 00:56:00,467 INFO containermanager.ContainerManagerImpl
> (ContainerManagerImpl.java:stopContainerInternal(953)) - Stopping container
> with container Id: container_1428575950531_0021_01_000005
> 2015-04-29 00:56:00,468 INFO nodemanager.NMAuditLogger
> (NMAuditLogger.java:logSuccess(89)) - USER=yarn IP=10.84.104.129
> OPERATION=Stop Container Request TARGET=ContainerManageImpl
> RESULT=SUCCESS APPID=application_1428575950531_0021
> CONTAINERID=container_1428575950531_0021_01_000005
> 2015-04-29 00:56:00,468 INFO container.Container
> (ContainerImpl.java:handle(999)) - Container
> container_1428575950531_0021_01_000005 transitioned from RUNNING to KILLING
> 2015-04-29 00:56:00,469 INFO launcher.ContainerLaunch
> (ContainerLaunch.java:cleanupContainer(370)) - Cleaning up container
> container_1428575950531_0021_01_000005
> 2015-04-29 00:56:01,741 INFO monitor.ContainersMonitorImpl
> (ContainersMonitorImpl.java:run(408)) - Memory usage of ProcessTree 41169 for
> container-id container_1428575950531_0021_01_000001: 1.4 MB of 3.5 GB
> physical memory used; 10.9 MB of 7.3 GB virtual memory used
> 2015-04-29 00:56:01,763 INFO launcher.ContainerLaunch
> (ContainerLaunch.java:call(346)) - Container
> container_1428575950531_0021_01_000001 succeeded
> 2015-04-29 00:56:01,763 INFO container.Container
> (ContainerImpl.java:handle(999)) - Container
> container_1428575950531_0021_01_000001 transitioned from RUNNING to
> EXITED_WITH_SUCCESS
> 2015-04-29 00:56:01,764 INFO launcher.ContainerLaunch
> (ContainerLaunch.java:cleanupContainer(370)) - Cleaning up container
> container_1428575950531_0021_01_000001
> 2015-04-29 00:56:01,782 INFO monitor.ContainersMonitorImpl
> (ContainersMonitorImpl.java:run(408)) - Memory usage of ProcessTree 41585 for
> container-id container_1428575950531_0021_01_000005: 15.4 MB of 3.5 GB
> physical memory used; 280.3 MB of 7.3 GB virtual memory used
> 2015-04-29 00:56:01,816 INFO nodemanager.DefaultContainerExecutor
> (DefaultContainerExecutor.java:deleteAsUser(457)) - Deleting absolute path :
> /grid/1/hadoop/yarn/local/usercache/yarn/appcache/application_1428575950531_0021/container_1428575950531_0021_01_000001
> 2015-04-29 00:56:01,816 INFO nodemanager.DefaultContainerExecutor
> (DefaultContainerExecutor.java:deleteAsUser(457)) - Deleting absolute path :
> /grid/2/hadoop/yarn/local/usercache/yarn/appcache/application_1428575950531_0021/container_1428575950531_0021_01_000001
> 2015-04-29 00:56:01,818 INFO nodemanager.DefaultContainerExecutor
> (DefaultContainerExecutor.java:deleteAsUser(457)) - Deleting absolute path :
> /grid/3/hadoop/yarn/local/usercache/yarn/appcache/application_1428575950531_0021/container_1428575950531_0021_01_000001
> 2015-04-29 00:56:01,819 INFO nodemanager.DefaultContainerExecutor
> (DefaultContainerExecutor.java:deleteAsUser(457)) - Deleting absolute path :
> /grid/4/hadoop/yarn/local/usercache/yarn/appcache/application_1428575950531_0021/container_1428575950531_0021_01_000001
> 2015-04-29 00:56:01,819 INFO nodemanager.DefaultContainerExecutor
> (DefaultContainerExecutor.java:deleteAsUser(457)) - Deleting absolute path :
> /grid/5/hadoop/yarn/local/usercache/yarn/appcache/application_1428575950531_0021/container_1428575950531_0021_01_000001
> 2015-04-29 00:56:01,820 INFO nodemanager.DefaultContainerExecutor
> (DefaultContainerExecutor.java:deleteAsUser(457)) - Deleting absolute path :
> /grid/6/hadoop/yarn/local/usercache/yarn/appcache/application_1428575950531_0021/container_1428575950531_0021_01_000001
> 2015-04-29 00:56:01,820 INFO nodemanager.NMAuditLogger
> (NMAuditLogger.java:logSuccess(89)) - USER=yarn OPERATION=Container
> Finished - Succeeded TARGET=ContainerImpl RESULT=SUCCESS
> APPID=application_1428575950531_0021
> CONTAINERID=container_1428575950531_0021_01_000001
> 2015-04-29 00:56:01,821 INFO container.Container
> (ContainerImpl.java:handle(999)) - Container
> container_1428575950531_0021_01_000001 transitioned from EXITED_WITH_SUCCESS
> to DONE
> 2015-04-29 00:56:01,821 INFO application.Application
> (ApplicationImpl.java:transition(347)) - Removing
> container_1428575950531_0021_01_000001 from application
> application_1428575950531_0021
> 2015-04-29 00:56:01,822 INFO logaggregation.AppLogAggregatorImpl
> (AppLogAggregatorImpl.java:startContainerLogAggregation(488)) - Considering
> container container_1428575950531_0021_01_000001 for log-aggregation
> 2015-04-29 00:56:01,822 INFO containermanager.AuxServices
> (AuxServices.java:handle(196)) - Got event CONTAINER_STOP for appId
> application_1428575950531_0021
> 2015-04-29 00:56:02,490 INFO ipc.Server (Server.java:saslProcess(1306)) -
> Auth successful for appattempt_1428575950531_0021_000001 (auth:SIMPLE)
> 2015-04-29 00:56:02,496 INFO containermanager.ContainerManagerImpl
> (ContainerManagerImpl.java:stopContainerInternal(953)) - Stopping container
> with container Id: container_1428575950531_0021_01_000001
> 2015-04-29 00:56:02,497 INFO nodemanager.NMAuditLogger
> (NMAuditLogger.java:logSuccess(89)) - USER=yarn IP=10.84.105.162
> OPERATION=Stop Container Request TARGET=ContainerManageImpl
> RESULT=SUCCESS APPID=application_1428575950531_0021
> CONTAINERID=container_1428575950531_0021_01_000001
> 2015-04-29 00:56:02,499 INFO application.Application
> (ApplicationImpl.java:handle(464)) - Application
> application_1428575950531_0021 transitioned from RUNNING to
> FINISHING_CONTAINERS_WAIT
> 2015-04-29 00:56:04,782 INFO monitor.ContainersMonitorImpl
> (ContainersMonitorImpl.java:run(356)) - Stopping resource-monitoring for
> container_1428575950531_0021_01_000001
> 2015-04-29 00:56:04,824 INFO monitor.ContainersMonitorImpl
> (ContainersMonitorImpl.java:run(408)) - Memory usage of ProcessTree 41585 for
> container-id container_1428575950531_0021_01_000005: 15.4 MB of 3.5 GB
> physical memory used; 280.3 MB of 7.3 GB virtual memory used
> {noformat}
> *NM log from host-03 where NIMBUS container was running:*
> {noformat}
> 2015-04-29 00:41:23,619 INFO ipc.Server (Server.java:saslProcess(1306)) -
> Auth successful for appattempt_1428575950531_0021_000001 (auth:SIMPLE)
> 2015-04-29 00:41:23,630 INFO containermanager.ContainerManagerImpl
> (ContainerManagerImpl.java:startContainerInternal(803)) - Start request for
> container_1428575950531_0021_01_000002 by user yarn
> 2015-04-29 00:41:23,631 INFO containermanager.ContainerManagerImpl
> (ContainerManagerImpl.java:startContainerInternal(843)) - Creating a new
> application reference for app application_1428575950531_0021
> 2015-04-29 00:41:23,631 INFO application.Application
> (ApplicationImpl.java:handle(464)) - Application
> application_1428575950531_0021 transitioned from NEW to INITING
> 2015-04-29 00:41:23,632 INFO nodemanager.NMAuditLogger
> (NMAuditLogger.java:logSuccess(89)) - USER=yarn IP=10.84.104.129
> OPERATION=Start Container Request TARGET=ContainerManageImpl
> RESULT=SUCCESS APPID=application_1428575950531_0021
> CONTAINERID=container_1428575950531_0021_01_000002
> 2015-04-29 00:41:23,635 WARN logaggregation.LogAggregationService
> (LogAggregationService.java:verifyAndCreateRemoteLogDir(195)) - Remote Root
> Log Dir [/app-logs] already exist, but with incorrect permissions. Expected:
> [rwxrwxrwt], Found: [rwxrwxrwx]. The cluster may have problems with multiple
> users.
> 2015-04-29 00:41:23,636 WARN logaggregation.AppLogAggregatorImpl
> (AppLogAggregatorImpl.java:<init>(182)) - rollingMonitorInterval is set as
> -1. The log rolling mornitoring interval is disabled. The logs will be
> aggregated after this application is finished.
> 2015-04-29 00:41:23,646 INFO application.Application
> (ApplicationImpl.java:transition(304)) - Adding
> container_1428575950531_0021_01_000002 to application
> application_1428575950531_0021
> 2015-04-29 00:41:23,647 INFO application.Application
> (ApplicationImpl.java:handle(464)) - Application
> application_1428575950531_0021 transitioned from INITING to RUNNING
> 2015-04-29 00:41:23,647 INFO container.Container
> (ContainerImpl.java:handle(999)) - Container
> container_1428575950531_0021_01_000002 transitioned from NEW to LOCALIZING
> 2015-04-29 00:41:23,648 INFO containermanager.AuxServices
> (AuxServices.java:handle(196)) - Got event CONTAINER_INIT for appId
> application_1428575950531_0021
> 2015-04-29 00:41:23,648 INFO localizer.LocalizedResource
> (LocalizedResource.java:handle(203)) - Resource
> hdfs://zsexp/user/yarn/.slider/cluster/storm1/tmp/application_1428575950531_0021/agent/slider-agent.tar.gz
> transitioned from INIT to DOWNLOADING
> 2015-04-29 00:41:23,648 INFO localizer.LocalizedResource
> (LocalizedResource.java:handle(203)) - Resource
> hdfs://zsexp/user/yarn/.slider/package/STORM/slider-storm-app-package-0.9.3.2.2.0.0-2041.zip
> transitioned from INIT to DOWNLOADING
> 2015-04-29 00:41:23,648 INFO localizer.ResourceLocalizationService
> (ResourceLocalizationService.java:handle(694)) - Created localizer for
> container_1428575950531_0021_01_000002
> 2015-04-29 00:41:23,651 INFO localizer.ResourceLocalizationService
> (ResourceLocalizationService.java:writeCredentials(1148)) - Writing
> credentials to the nmPrivate file
> /grid/2/hadoop/yarn/local/nmPrivate/container_1428575950531_0021_01_000002.tokens.
> Credentials list:
> 2015-04-29 00:41:23,766 INFO nodemanager.DefaultContainerExecutor
> (DefaultContainerExecutor.java:createUserCacheDirs(606)) - Initializing user
> yarn
> 2015-04-29 00:41:23,773 INFO nodemanager.DefaultContainerExecutor
> (DefaultContainerExecutor.java:startLocalizer(116)) - Copying from
> /grid/2/hadoop/yarn/local/nmPrivate/container_1428575950531_0021_01_000002.tokens
> to
> /grid/5/hadoop/yarn/local/usercache/yarn/appcache/application_1428575950531_0021/container_1428575950531_0021_01_000002.tokens
> 2015-04-29 00:41:23,774 INFO nodemanager.DefaultContainerExecutor
> (DefaultContainerExecutor.java:startLocalizer(123)) - Localizer CWD set to
> /grid/5/hadoop/yarn/local/usercache/yarn/appcache/application_1428575950531_0021
> =
> file:/grid/5/hadoop/yarn/local/usercache/yarn/appcache/application_1428575950531_0021
> 2015-04-29 00:41:23,807 INFO ipc.Server (Server.java:saslProcess(1306)) -
> Auth successful for appattempt_1428575950531_0021_000001 (auth:SIMPLE)
> 2015-04-29 00:41:23,812 INFO containermanager.ContainerManagerImpl
> (ContainerManagerImpl.java:getContainerStatusInternal(1008)) - Getting
> container-status for container_1428575950531_0021_01_000002
> 2015-04-29 00:41:23,812 INFO containermanager.ContainerManagerImpl
> (ContainerManagerImpl.java:getContainerStatusInternal(1022)) - Returning
> ContainerStatus: [ContainerId: container_1428575950531_0021_01_000002, State:
> RUNNING, Diagnostics: , ExitStatus: -1000, ]
> 2015-04-29 00:41:23,991 INFO localizer.LocalizedResource
> (LocalizedResource.java:handle(203)) - Resource
> hdfs://zsexp/user/yarn/.slider/cluster/storm1/tmp/application_1428575950531_0021/agent/slider-agent.tar.gz(->/grid/2/hadoop/yarn/local/usercache/yarn/appcache/application_1428575950531_0021/filecache/10/slider-agent.tar.gz)
> transitioned from DOWNLOADING to LOCALIZED
> 2015-04-29 00:41:24,344 INFO localizer.LocalizedResource
> (LocalizedResource.java:handle(203)) - Resource
> hdfs://zsexp/user/yarn/.slider/package/STORM/slider-storm-app-package-0.9.3.2.2.0.0-2041.zip(->/grid/3/hadoop/yarn/local/usercache/yarn/appcache/application_1428575950531_0021/filecache/11/slider-storm-app-package-0.9.3.2.2.0.0-2041.zip)
> transitioned from DOWNLOADING to LOCALIZED
> 2015-04-29 00:41:24,344 INFO container.Container
> (ContainerImpl.java:handle(999)) - Container
> container_1428575950531_0021_01_000002 transitioned from LOCALIZING to
> LOCALIZED
> 2015-04-29 00:41:24,388 INFO container.Container
> (ContainerImpl.java:handle(999)) - Container
> container_1428575950531_0021_01_000002 transitioned from LOCALIZED to RUNNING
> 2015-04-29 00:41:24,396 INFO nodemanager.DefaultContainerExecutor
> (DefaultContainerExecutor.java:buildCommandExecutor(267)) - launchContainer:
> [bash,
> /grid/5/hadoop/yarn/local/usercache/yarn/appcache/application_1428575950531_0021/container_1428575950531_0021_01_000002/default_container_executor.sh]
> 2015-04-29 00:41:26,947 INFO monitor.ContainersMonitorImpl
> (ContainersMonitorImpl.java:run(346)) - Starting resource-monitoring for
> container_1428575950531_0021_01_000002
> 2015-04-29 00:41:26,996 INFO monitor.ContainersMonitorImpl
> (ContainersMonitorImpl.java:run(408)) - Memory usage of ProcessTree 21259 for
> container-id container_1428575950531_0021_01_000002: 15.0 MB of 3.5 GB
> physical memory used; 280.0 MB of 7.3 GB virtual memory used
> 2015-04-29 00:41:30,038 INFO monitor.ContainersMonitorImpl
> (ContainersMonitorImpl.java:run(408)) - Memory usage of ProcessTree 21259 for
> container-id container_1428575950531_0021_01_000002: 15.0 MB of 3.5 GB
> physical memory used; 280.0 MB of 7.3 GB virtual memory used
> 2015-04-29 00:41:33,087 INFO monitor.ContainersMonitorImpl
> (ContainersMonitorImpl.java:run(408)) - Memory usage of ProcessTree 21259 for
> container-id container_1428575950531_0021_01_000002: 15.0 MB of 3.5 GB
> physical memory used; 280.0 MB of 7.3 GB virtual memory used
> 2015-04-29 00:41:36,129 INFO monitor.ContainersMonitorImpl
> (ContainersMonitorImpl.java:run(408)) - Memory usage of ProcessTree 21259 for
> container-id container_1428575950531_0021_01_000002: 28.2 MB of 3.5 GB
> physical memory used; 325.5 MB of 7.3 GB virtual memory used
> 2015-04-29 00:41:39,179 INFO monitor.ContainersMonitorImpl
> (ContainersMonitorImpl.java:run(408)) - Memory usage of ProcessTree 21259 for
> container-id container_1428575950531_0021_01_000002: 86.0 MB of 3.5 GB
> physical memory used; 63.3 GB of 7.3 GB virtual memory used
> 2015-04-29 00:41:42,197 INFO monitor.ContainersMonitorImpl
> (ContainersMonitorImpl.java:run(408)) - Memory usage of ProcessTree 21259 for
> container-id container_1428575950531_0021_01_000002: 100.1 MB of 3.5 GB
> physical memory used; 31.8 GB of 7.3 GB virtual memory used
> 2015-04-29 00:41:45,243 INFO monitor.ContainersMonitorImpl
> (ContainersMonitorImpl.java:run(408)) - Memory usage of ProcessTree 21259 for
> container-id container_1428575950531_0021_01_000002: 167.1 MB of 3.5 GB
> physical memory used; 31.8 GB of 7.3 GB virtual memory used
> 2015-04-29 00:41:48,287 INFO monitor.ContainersMonitorImpl
> (ContainersMonitorImpl.java:run(408)) - Memory usage of ProcessTree 21259 for
> container-id container_1428575950531_0021_01_000002: 256.8 MB of 3.5 GB
> physical memory used; 1.8 GB of 7.3 GB virtual memory used
> 2015-04-29 00:41:51,336 INFO monitor.ContainersMonitorImpl
> (ContainersMonitorImpl.java:run(408)) - Memory usage of ProcessTree 21259 for
> container-id container_1428575950531_0021_01_000002: 15.3 MB of 3.5 GB
> physical memory used; 280.3 MB of 7.3 GB virtual memory used
> 2015-04-29 00:41:54,379 INFO monitor.ContainersMonitorImpl
> (ContainersMonitorImpl.java:run(408)) - Memory usage of ProcessTree 21259 for
> container-id container_1428575950531_0021_01_000002: 15.3 MB of 3.5 GB
> physical memory used; 280.3 MB of 7.3 GB virtual memory used
> .
> .
> .
> 2015-04-29 00:55:51,675 INFO monitor.ContainersMonitorImpl
> (ContainersMonitorImpl.java:run(408)) - Memory usage of ProcessTree 21259 for
> container-id container_1428575950531_0021_01_000002: 15.4 MB of 3.5 GB
> physical memory used; 280.3 MB of 7.3 GB virtual memory used
> 2015-04-29 00:55:54,718 INFO monitor.ContainersMonitorImpl
> (ContainersMonitorImpl.java:run(408)) - Memory usage of ProcessTree 21259 for
> container-id container_1428575950531_0021_01_000002: 15.4 MB of 3.5 GB
> physical memory used; 280.3 MB of 7.3 GB virtual memory used
> 2015-04-29 00:55:57,760 INFO monitor.ContainersMonitorImpl
> (ContainersMonitorImpl.java:run(408)) - Memory usage of ProcessTree 21259 for
> container-id container_1428575950531_0021_01_000002: 15.4 MB of 3.5 GB
> physical memory used; 280.3 MB of 7.3 GB virtual memory used
> 2015-04-29 00:56:00,482 INFO ipc.Server (Server.java:saslProcess(1306)) -
> Auth successful for appattempt_1428575950531_0021_000001 (auth:SIMPLE)
> 2015-04-29 00:56:00,486 INFO containermanager.ContainerManagerImpl
> (ContainerManagerImpl.java:stopContainerInternal(953)) - Stopping container
> with container Id: container_1428575950531_0021_01_000002
> 2015-04-29 00:56:00,487 INFO nodemanager.NMAuditLogger
> (NMAuditLogger.java:logSuccess(89)) - USER=yarn IP=10.84.104.129
> OPERATION=Stop Container Request TARGET=ContainerManageImpl
> RESULT=SUCCESS APPID=application_1428575950531_0021
> CONTAINERID=container_1428575950531_0021_01_000002
> 2015-04-29 00:56:00,487 INFO container.Container
> (ContainerImpl.java:handle(999)) - Container
> container_1428575950531_0021_01_000002 transitioned from RUNNING to KILLING
> 2015-04-29 00:56:00,489 INFO launcher.ContainerLaunch
> (ContainerLaunch.java:cleanupContainer(370)) - Cleaning up container
> container_1428575950531_0021_01_000002
> 2015-04-29 00:56:00,802 INFO monitor.ContainersMonitorImpl
> (ContainersMonitorImpl.java:run(408)) - Memory usage of ProcessTree 21259 for
> container-id container_1428575950531_0021_01_000002: 15.4 MB of 3.5 GB
> physical memory used; 280.3 MB of 7.3 GB virtual memory used
> 2015-04-29 00:56:02,494 INFO application.Application
> (ApplicationImpl.java:handle(464)) - Application
> application_1428575950531_0021 transitioned from RUNNING to
> FINISHING_CONTAINERS_WAIT
> 2015-04-29 00:56:03,849 INFO monitor.ContainersMonitorImpl
> (ContainersMonitorImpl.java:run(408)) - Memory usage of ProcessTree 21259 for
> container-id container_1428575950531_0021_01_000002: 15.5 MB of 3.5 GB
> physical memory used; 280.3 MB of 7.3 GB virtual memory used
> 2015-04-29 00:56:06,892 INFO monitor.ContainersMonitorImpl
> (ContainersMonitorImpl.java:run(408)) - Memory usage of ProcessTree 21259 for
> container-id container_1428575950531_0021_01_000002: 15.5 MB of 3.5 GB
> physical memory used; 280.3 MB of 7.3 GB virtual memory used
> 2015-04-29 00:56:09,940 INFO monitor.ContainersMonitorImpl
> (ContainersMonitorImpl.java:run(408)) - Memory usage of ProcessTree 21259 for
> container-id container_1428575950531_0021_01_000002: 15.5 MB of 3.5 GB
> physical memory used; 280.3 MB of 7.3 GB virtual memory used
> 2015-04-29 00:56:12,983 INFO monitor.ContainersMonitorImpl
> (ContainersMonitorImpl.java:run(408)) - Memory usage of ProcessTree 21259 for
> container-id container_1428575950531_0021_01_000002: 15.5 MB of 3.5 GB
> physical memory used; 280.3 MB of 7.3 GB virtual memory used
> 2015-04-29 00:56:16,032 INFO monitor.ContainersMonitorImpl
> (ContainersMonitorImpl.java:run(408)) - Memory usage of ProcessTree 21259 for
> container-id container_1428575950531_0021_01_000002: 15.5 MB of 3.5 GB
> physical memory used; 280.3 MB of 7.3 GB virtual memory used
> 2015-04-29 00:56:19,075 INFO monitor.ContainersMonitorImpl
> (ContainersMonitorImpl.java:run(408)) - Memory usage of ProcessTree 21259 for
> container-id container_1428575950531_0021_01_000002: 15.5 MB of 3.5 GB
> physical memory used; 280.3 MB of 7.3 GB virtual memory used
> 2015-04-29 00:56:22,122 INFO monitor.ContainersMonitorImpl
> (ContainersMonitorImpl.java:run(408)) - Memory usage of ProcessTree 21259 for
> container-id container_1428575950531_0021_01_000002: 15.6 MB of 3.5 GB
> physical memory used; 280.5 MB of 7.3 GB virtual memory used
> 2015-04-29 00:56:25,164 INFO monitor.ContainersMonitorImpl
> (ContainersMonitorImpl.java:run(408)) - Memory usage of ProcessTree 21259 for
> container-id container_1428575950531_0021_01_000002: 15.6 MB of 3.5 GB
> physical memory used; 280.5 MB of 7.3 GB virtual memory used
> 2015-04-29 00:56:28,211 INFO monitor.ContainersMonitorImpl
> (ContainersMonitorImpl.java:run(408)) - Memory usage of ProcessTree 21259 for
> container-id container_1428575950531_0021_01_000002: 15.6 MB of 3.5 GB
> physical memory used; 280.5 MB of 7.3 GB virtual memory used
> 2015-04-29 00:56:31,253 INFO monitor.ContainersMonitorImpl
> (ContainersMonitorImpl.java:run(408)) - Memory usage of ProcessTree 21259 for
> container-id container_1428575950531_0021_01_000002: 15.6 MB of 3.5 GB
> physical memory used; 280.5 MB of 7.3 GB virtual memory used
> 2015-04-29 00:56:34,302 INFO monitor.ContainersMonitorImpl
> (ContainersMonitorImpl.java:run(408)) - Memory usage of ProcessTree 21259 for
> container-id container_1428575950531_0021_01_000002: 15.6 MB of 3.5 GB
> physical memory used; 280.5 MB of 7.3 GB virtual memory used
> 2015-04-29 00:56:37,344 INFO monitor.ContainersMonitorImpl
> (ContainersMonitorImpl.java:run(408)) - Memory usage of ProcessTree 21259 for
> container-id container_1428575950531_0021_01_000002: 15.6 MB of 3.5 GB
> physical memory used; 280.5 MB of 7.3 GB virtual memory used
> 2015-04-29 00:56:40,392 INFO monitor.ContainersMonitorImpl
> (ContainersMonitorImpl.java:run(408)) - Memory usage of ProcessTree 21259 for
> container-id container_1428575950531_0021_01_000002: 15.6 MB of 3.5 GB
> physical memory used; 280.5 MB of 7.3 GB virtual memory used
> 2015-04-29 00:56:43,434 INFO monitor.ContainersMonitorImpl
> (ContainersMonitorImpl.java:run(408)) - Memory usage of ProcessTree 21259 for
> container-id container_1428575950531_0021_01_000002: 15.6 MB of 3.5 GB
> physical memory used; 280.5 MB of 7.3 GB virtual memory used
> 2015-04-29 00:56:46,482 INFO monitor.ContainersMonitorImpl
> (ContainersMonitorImpl.java:run(408)) - Memory usage of ProcessTree 21259 for
> container-id container_1428575950531_0021_01_000002: 15.6 MB of 3.5 GB
> physical memory used; 280.5 MB of 7.3 GB virtual memory used
> 2015-04-29 00:56:49,523 INFO monitor.ContainersMonitorImpl
> (ContainersMonitorImpl.java:run(408)) - Memory usage of ProcessTree 21259 for
> container-id container_1428575950531_0021_01_000002: 15.6 MB of 3.5 GB
> physical memory used; 280.5 MB of 7.3 GB virtual memory used
> 2015-04-29 00:56:52,570 INFO monitor.ContainersMonitorImpl
> (ContainersMonitorImpl.java:run(408)) - Memory usage of ProcessTree 21259 for
> container-id container_1428575950531_0021_01_000002: 15.6 MB of 3.5 GB
> physical memory used; 280.5 MB of 7.3 GB virtual memory used
> 2015-04-29 00:56:55,613 INFO monitor.ContainersMonitorImpl
> (ContainersMonitorImpl.java:run(408)) - Memory usage of ProcessTree 21259 for
> container-id container_1428575950531_0021_01_000002: 15.6 MB of 3.5 GB
> physical memory used; 280.5 MB of 7.3 GB virtual memory used
> 2015-04-29 00:56:58,661 INFO monitor.ContainersMonitorImpl
> (ContainersMonitorImpl.java:run(408)) - Memory usage of ProcessTree 21259 for
> container-id container_1428575950531_0021_01_000002: 15.6 MB of 3.5 GB
> physical memory used; 280.5 MB of 7.3 GB virtual memory used
> 2015-04-29 00:57:01,704 INFO monitor.ContainersMonitorImpl
> (ContainersMonitorImpl.java:run(408)) - Memory usage of ProcessTree 21259 for
> container-id container_1428575950531_0021_01_000002: 15.6 MB of 3.5 GB
> physical memory used; 280.5 MB of 7.3 GB virtual memory used
> 2015-04-29 00:57:04,752 INFO monitor.ContainersMonitorImpl
> (ContainersMonitorImpl.java:run(408)) - Memory usage of ProcessTree 21259 for
> container-id container_1428575950531_0021_01_000002: 15.6 MB of 3.5 GB
> physical memory used; 280.5 MB of 7.3 GB virtual memory used
> 2015-04-29 00:57:07,794 INFO monitor.ContainersMonitorImpl
> (ContainersMonitorImpl.java:run(408)) - Memory usage of ProcessTree 21259 for
> container-id container_1428575950531_0021_01_000002: 15.6 MB of 3.5 GB
> physical memory used; 280.5 MB of 7.3 GB virtual memory used
> 2015-04-29 00:57:10,843 INFO monitor.ContainersMonitorImpl
> (ContainersMonitorImpl.java:run(408)) - Memory usage of ProcessTree 21259 for
> container-id container_1428575950531_0021_01_000002: 15.6 MB of 3.5 GB
> physical memory used; 280.5 MB of 7.3 GB virtual memory used
> 2015-04-29 00:57:13,886 INFO monitor.ContainersMonitorImpl
> (ContainersMonitorImpl.java:run(408)) - Memory usage of ProcessTree 21259 for
> container-id container_1428575950531_0021_01_000002: 15.6 MB of 3.5 GB
> physical memory used; 280.5 MB of 7.3 GB virtual memory used
> 2015-04-29 00:57:16,935 INFO monitor.ContainersMonitorImpl
> (ContainersMonitorImpl.java:run(408)) - Memory usage of ProcessTree 21259 for
> container-id container_1428575950531_0021_01_000002: 15.6 MB of 3.5 GB
> physical memory used; 296.5 MB of 7.3 GB virtual memory used
> 2015-04-29 00:57:19,977 INFO monitor.ContainersMonitorImpl
> (ContainersMonitorImpl.java:run(408)) - Memory usage of ProcessTree 21259 for
> container-id container_1428575950531_0021_01_000002: 15.6 MB of 3.5 GB
> physical memory used; 296.5 MB of 7.3 GB virtual memory used
> 2015-04-29 00:57:23,025 INFO monitor.ContainersMonitorImpl
> (ContainersMonitorImpl.java:run(408)) - Memory usage of ProcessTree 21259 for
> container-id container_1428575950531_0021_01_000002: 15.6 MB of 3.5 GB
> physical memory used; 296.5 MB of 7.3 GB virtual memory used
> 2015-04-29 00:57:26,067 INFO monitor.ContainersMonitorImpl
> (ContainersMonitorImpl.java:run(408)) - Memory usage of ProcessTree 21259 for
> container-id container_1428575950531_0021_01_000002: 15.7 MB of 3.5 GB
> physical memory used; 296.5 MB of 7.3 GB virtual memory used
> {noformat}
> *YARN properties of the cluster:*
> {code}
> {
> "description": "Complete slider application settings",
> "updated": 0,
> "entries": {
> "dfs.datanode.data.dir":
> "/grid/1/dfs/data,/grid/2/dfs/data,/grid/3/dfs/data,/grid/4/dfs/data,/grid/5/dfs/data,/grid/6/dfs/data",
>
> "dfs.namenode.checkpoint.txns": "1000000",
> "s3.replication": "3",
> "mapreduce.output.fileoutputformat.compress.type": "BLOCK",
> "mapreduce.jobtracker.jobhistory.lru.cache.size": "5",
> "dfs.datanode.failed.volumes.tolerated": "0",
> "hadoop.http.filter.initializers":
> "org.apache.hadoop.yarn.server.webproxy.amfilter.AmFilterInitializer",
> "mapreduce.cluster.temp.dir":
> "/tmp/hadoop-yarn-${hue.suffix}/mapred/temp",
> "mapreduce.reduce.shuffle.memory.limit.percent": "0.25",
> "yarn.nodemanager.keytab": "/etc/krb5.keytab",
> "dfs.namenode.checkpoint.max-retries": "3",
> "nfs.mountd.port": "4242",
> "hadoop.registry.zk.retry.times": "5",
> "yarn.resourcemanager.zk-acl": "world:anyone:rwcda",
> "mapreduce.reduce.skip.maxgroups": "0",
> "dfs.https.server.keystore.resource": "ssl-server.xml",
> "yarn.app.mapreduce.task.container.log.backups": "0",
> "dfs.domain.socket.path": "/var/lib/hadoop-hdfs/dn_socket",
> "hadoop.http.authentication.kerberos.keytab":
> "/home/yarn/hadoop.keytab",
> "yarn.timeline-service.generic-application-history.store-class":
> "org.apache.hadoop.yarn.server.applicationhistoryservice.NullApplicationHistoryStore",
>
>
> "yarn.nodemanager.disk-health-checker.max-disk-utilization-per-disk-percentage":
> "90",
> "mapreduce.cluster.administrators": " hadoop",
> "dfs.client.block.write.replace-datanode-on-failure.best-effort":
> "false",
> "mapreduce.jobhistory.done-dir": "/mr-history/done",
> "yarn.nodemanager.localizer.client.thread-count": "5",
> "ha.failover-controller.new-active.rpc-timeout.ms": "60000",
> "mapreduce.framework.name": "yarn",
> "ha.health-monitor.check-interval.ms": "1000",
> "io.file.buffer.size": "131072",
> "mapreduce.shuffle.max.connections": "0",
> "dfs.namenode.resource.check.interval": "5000",
> "dfs.namenode.path.based.cache.block.map.allocation.percent": "0.25",
> "dfs.namenode.checkpoint.period": "21600",
> "mapreduce.task.tmp.dir": "./tmp",
> "ipc.client.kill.max": "10",
> "yarn.nodemanager.log-aggregation.debug-enabled": "false",
> "dfs.client.mmap.cache.timeout.ms": "3600000",
> "yarn.resourcemanager.scheduler.class":
> "org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacityScheduler",
>
> "mapreduce.jobtracker.taskcache.levels": "2",
> "s3.stream-buffer-size": "4096",
> "dfs.namenode.secondary.http-address": "host2:50090",
> "yarn.client.nodemanager-connect.max-wait-ms": "900000",
> "dfs.namenode.decommission.interval": "30",
> "dfs.namenode.http-address": "host1:50070",
> "dfs.encrypt.data.transfer": "false",
> "mapreduce.task.files.preserve.failedtasks": "false",
> "yarn.resourcemanager.bind-host": "0.0.0.0",
> "yarn.resourcemanager.ha.enabled": "false",
> "dfs.datanode.address": "0.0.0.0:50010",
> "dfs.namenode.avoid.write.stale.datanode": "true",
> "hadoop.http.authentication.token.validity": "36000",
> "yarn.resourcemanager.nodes.exclude-path":
> "/etc/hadoop/conf/yarn.exclude",
> "hadoop.security.group.mapping.ldap.search.filter.group":
> "(objectClass=group)",
> "dfs.client.failover.max.attempts": "15",
> "yarn.resourcemanager.scheduler.monitor.policies":
> "org.apache.hadoop.yarn.server.resourcemanager.monitor.capacity.ProportionalCapacityPreemptionPolicy",
>
> "hadoop.registry.zk.connection.timeout.ms": "15000",
> "hadoop.security.crypto.cipher.suite": "AES/CTR/NoPadding",
> "yarn.timeline-service.http-authentication.simple.anonymous.allowed":
> "true",
> "mapreduce.task.profile.params":
> "-agentlib:hprof=cpu=samples,heap=sites,force=n,thread=y,verbose=n,file=%s",
> "yarn.resourcemanager.fs.state-store.retry-policy-spec": "2000, 500",
> "yarn.admin.acl": "*",
> "yarn.nodemanager.local-cache.max-files-per-directory": "8192",
> "yarn.client.failover-retries-on-socket-timeouts": "0",
> "dfs.namenode.retrycache.expirytime.millis": "600000",
> "yarn.resourcemanager.nodemanagers.heartbeat-interval-ms": "1000",
> "dfs.client.failover.connection.retries.on.timeouts": "0",
> "yarn.client.failover-proxy-provider":
> "org.apache.hadoop.yarn.client.ConfiguredRMFailoverProxyProvider",
> "mapreduce.map.sort.spill.percent": "0.7",
> "file.stream-buffer-size": "4096",
> "dfs.webhdfs.enabled": "true",
> "ipc.client.connection.maxidletime": "0",
> "mapreduce.task.combine.progress.records": "10000",
> "mapreduce.jobtracker.persist.jobstatus.hours": "1",
> "dfs.image.transfer.chunksize": "65536",
> "yarn.nodemanager.address": "0.0.0.0:45454",
> "dfs.datanode.ipc.address": "0.0.0.0:8010",
> "yarn.resourcemanager.ha.automatic-failover.embedded": "true",
> "mapreduce.jobhistory.recovery.store.fs.uri":
> "/tmp/hadoop-yarn-${hue.suffix}/mapred/history/recoverystore",
> "dfs.namenode.http-address.$cluster_name.nn1": "host1:50070",
> "yarn.resourcemanager.zk-state-store.parent-path": "/rmstore",
> "dfs.namenode.http-address.$cluster_name.nn2": "host2:50070",
> "yarn.app.mapreduce.am.job.task.listener.thread-count": "30",
> "nfs.dump.dir": "/tmp/.hdfs-nfs",
> "dfs.namenode.list.cache.pools.num.responses": "100",
> "dfs.client.read.shortcircuit": "true",
> "dfs.namenode.shared.edits.dir":
> "qjournal://host2:8485;host3:8485;host1:8485/$cluster_name",
> "dfs.namenode.safemode.extension": "30000",
> "ha.zookeeper.parent-znode": "/hadoop-ha",
> "yarn.nodemanager.container-executor.class":
> "org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor",
> "slider.config.loaded": "true",
> "io.skip.checksum.errors": "false",
> "dfs.namenode.path.based.cache.refresh.interval.ms": "30000",
> "dfs.encrypt.data.transfer.cipher.key.bitlength": "128",
> "yarn.resourcemanager.scheduler.client.thread-count": "50",
> "yarn.nodemanager.recovery.dir":
> "/var/log/hadoop-yarn/nodemanager/recovery-state",
> "mapreduce.job.emit-timeline-data": "false",
> "hadoop.http.authentication.kerberos.principal":
> "HTTP/_HOST@LOCALHOST",
> "mapreduce.reduce.log.level": "INFO",
>
> "yarn.nodemanager.linux-container-executor.nonsecure-mode.user-pattern":
> "^[_.A-Za-z0-9][-@_.A-Za-z0-9]{0,255}?[$]?$",
> "fs.s3.maxRetries": "4",
> "yarn.nodemanager.log-aggregation.num-log-files-per-app": "30",
> "mapreduce.admin.reduce.child.java.opts": "-server -XX:NewRatio=8
> -Djava.net.preferIPv4Stack=true -Dhdp.version=2.2.0.0-2041",
> "yarn.nodemanager.resourcemanager.minimum.version": "NONE",
> "yarn.log-aggregation.retain-check-interval-seconds": "-1",
> "hadoop.kerberos.kinit.command": "kinit",
> "yarn.node-labels.fs-store.root-dir": "/system/yarn/node-labels",
> "yarn.nodemanager.linux-container-executor.cgroups.mount": "false",
> "yarn.nodemanager.process-kill-wait.ms": "2000",
> "mapreduce.jobtracker.handler.count": "10",
> "dfs.namenode.name.dir.restore": "true",
> "mapreduce.jobhistory.admin.address": "0.0.0.0:10033",
> "yarn.app.mapreduce.client-am.ipc.max-retries": "3",
> "yarn.app.mapreduce.am.admin-command-opts":
> "-Dhdp.version=2.2.0.0-2041",
> "hadoop.proxyuser.hue.hosts": "*",
> "dfs.client.use.datanode.hostname": "false",
>
> "dfs.datanode.available-space-volume-choosing-policy.balanced-space-preference-fraction":
> "0.75f",
> "hadoop.util.hash.type": "murmur",
> "io.seqfile.lazydecompress": "true",
> "dfs.datanode.dns.interface": "default",
> "dfs.namenode.lazypersist.file.scrub.interval.sec": "300",
> "yarn.client.max-cached-nodemanagers-proxies": "0",
> "yarn.nodemanager.disk-health-checker.min-healthy-disks": "0.25",
> "mapreduce.job.maxtaskfailures.per.tracker": "3",
> "mapreduce.tasktracker.healthchecker.script.timeout": "600000",
> "hadoop.security.group.mapping.ldap.search.attr.group.name": "cn",
> "hadoop.security.crypto.buffer.size": "8192",
> "fs.df.interval": "60000",
> "dfs.client.cached.conn.retry": "3",
> "dfs.namenode.kerberos.internal.spnego.principal":
> "${dfs.web.authentication.kerberos.principal}",
> "mapreduce.job.reduce.shuffle.consumer.plugin.class":
> "org.apache.hadoop.mapreduce.task.reduce.Shuffle",
> "mapreduce.jobtracker.address": "local",
> "mapreduce.tasktracker.tasks.sleeptimebeforesigkill": "5000",
> "dfs.journalnode.rpc-address": "0.0.0.0:8485",
> "dfs.namenode.fs-limits.max-blocks-per-file": "1048576",
> "mapreduce.job.acl-view-job": " ",
> "dfs.client.block.write.replace-datanode-on-failure.policy":
> "DEFAULT",
> "yarn.app.mapreduce.am.job.committer.cancel-timeout": "60000",
> "mapreduce.shuffle.connection-keep-alive.enable": "false",
> "dfs.namenode.replication.interval": "3",
> "dfs.namenode.num.checkpoints.retained": "2",
> "mapreduce.jobhistory.minicluster.fixed.ports": "false",
> "mapreduce.jobhistory.admin.acl": "*",
> "mapreduce.tasktracker.http.address": "0.0.0.0:50060",
> "yarn.resourcemanager.scheduler.address": "host2:8030",
> "dfs.datanode.directoryscan.threads": "1",
> "hadoop.security.group.mapping.ldap.ssl": "false",
> "mapreduce.reduce.memory.mb": "3584",
> "dfs.http.policy": "HTTP_ONLY",
> "mapreduce.task.merge.progress.records": "10000",
> "yarn.resourcemanager.system-metrics-publisher.dispatcher.pool-size":
> "10",
> "dfs.heartbeat.interval": "3",
> "yarn.resourcemanager.recovery.enabled": "false",
> "dfs.hosts.exclude": "/etc/hadoop/conf/dfs.exclude",
> "net.topology.script.number.args": "100",
> "mapreduce.local.clientfactory.class.name":
> "org.apache.hadoop.mapred.LocalClientFactory",
> "dfs.client-write-packet-size": "65536",
> "hadoop.security.group.mapping.ldap.directory.search.timeout":
> "10000",
> "dfs.nameservices": "$cluster_name",
> "io.native.lib.available": "true",
> "dfs.client.failover.connection.retries": "0",
> "yarn.nodemanager.disk-health-checker.interval-ms": "120000",
> "dfs.blocksize": "134217728",
> "dfs.client.use.legacy.blockreader.local": "false",
>
> "yarn.resourcemanager.container-tokens.master-key-rolling-interval-secs":
> "86400",
> "fs.s3a.connection.ssl.enabled": "true",
> "mapreduce.jobhistory.webapp.address": "host2:19888",
> "yarn.client.failover-retries": "0",
> "yarn.resourcemanager.resource-tracker.client.thread-count": "50",
> "hadoop.registry.jaas.context": "Client",
> "dfs.blockreport.initialDelay": "120",
> "yarn.resourcemanager.zk-timeout-ms": "10000",
> "ha.health-monitor.rpc-timeout.ms": "45000",
> "yarn.nodemanager.aux-services.mapreduce_shuffle.class":
> "org.apache.hadoop.mapred.ShuffleHandler",
> "mapreduce.reduce.markreset.buffer.percent": "0.0",
> "dfs.ha.tail-edits.period": "60",
>
> "yarn.timeline-service.leveldb-timeline-store.start-time-read-cache-size":
> "10000",
> "mapreduce.admin.user.env":
> "LD_LIBRARY_PATH=/usr/hdp/2.2.0.0-2041/hadoop/lib/native:/usr/hdp/2.2.0.0-2041/hadoop/lib/native/Linux-amd64-64",
>
> "yarn.nodemanager.health-checker.script.timeout-ms": "60000",
> "yarn.resourcemanager.client.thread-count": "50",
> "file.bytes-per-checksum": "512",
> "dfs.replication.max": "50",
> "dfs.namenode.max.extra.edits.segments.retained": "10000",
> "yarn.nodemanager.linux-container-executor.group": "hadoop",
> "io.map.index.skip": "0",
> "mapreduce.jobhistory.bind-host": "0.0.0.0",
> "yarn.timeline-service.client.retry-interval-ms": "1000",
> "mapreduce.task.timeout": "300000",
> "mapreduce.reduce.cpu.vcores": "1",
> "dfs.datanode.du.reserved": "1073741824",
> "dfs.support.append": "true",
> "ftp.blocksize": "67108864",
> "dfs.client.file-block-storage-locations.num-threads": "10",
> "yarn.nodemanager.container-manager.thread-count": "20",
> "ipc.server.listen.queue.size": "128",
> "hadoop.ssl.hostname.verifier": "DEFAULT",
> "yarn.resourcemanager.ha.automatic-failover.enabled": "true",
> "nfs.server.port": "2049",
> "mapreduce.tasktracker.dns.interface": "default",
> "hadoop.security.group.mapping.ldap.search.attr.member": "member",
> "mapreduce.job.userlog.retain.hours": "24",
> "mapreduce.tasktracker.outofband.heartbeat": "false",
> "fs.s3a.impl": "org.apache.hadoop.fs.s3a.S3AFileSystem",
> "yarn.log.server.url": "http://host2:19888/jobhistory/logs";,
> "hadoop.registry.system.acls": "sasl:yarn@, sasl:mapred@,
> sasl:mapred@hdfs@",
> "yarn.nodemanager.resource.memory-mb": "96768",
> "yarn.nodemanager.log-aggregation.roll-monitoring-interval-seconds":
> "-1",
> "dfs.webhdfs.user.provider.user.pattern":
> "^[A-Za-z_][A-Za-z0-9._-]*[$]?$",
> "dfs.namenode.delegation.token.renew-interval": "86400000",
> "hadoop.ssl.keystores.factory.class":
> "org.apache.hadoop.security.ssl.FileBasedKeyStoresFactory",
> "hadoop.registry.zk.retry.ceiling.ms": "60000",
> "yarn.http.policy": "HTTP_ONLY",
> "dfs.datanode.sync.behind.writes": "false",
> "nfs.wtmax": "1048576",
> "fs.AbstractFileSystem.har.impl": "org.apache.hadoop.fs.HarFs",
> "dfs.client.read.shortcircuit.skip.checksum": "false",
> "hadoop.security.random.device.file.path": "/dev/urandom",
> "mapreduce.map.maxattempts": "4",
> "yarn.timeline-service.webapp.address": "host2:8188",
> "dfs.datanode.handler.count": "10",
> "hadoop.ssl.require.client.cert": "false",
> "ftp.client-write-packet-size": "65536",
> "dfs.client.write.exclude.nodes.cache.expiry.interval.millis":
> "600000",
> "ipc.server.tcpnodelay": "true",
> "mapreduce.jobhistory.cleaner.enable": "true",
> "fs.du.interval": "600000",
> "mapreduce.reduce.shuffle.retry-delay.max.ms": "60000",
> "mapreduce.task.profile.reduces": "0-2",
> "ha.health-monitor.connect-retry-interval.ms": "1000",
> "hadoop.fuse.connection.timeout": "300",
> "dfs.permissions.superusergroup": "hdfs",
> "mapreduce.jobtracker.jobhistory.task.numberprogresssplits": "12",
> "fs.ftp.host.port": "21",
> "mapreduce.map.speculative": "false",
> "dfs.datanode.data.dir.perm": "750",
> "mapreduce.client.submit.file.replication": "10",
> "dfs.namenode.startup.delay.block.deletion.sec": "3600",
> "s3native.blocksize": "67108864",
> "mapreduce.job.ubertask.maxmaps": "9",
> "dfs.namenode.replication.min": "1",
> "mapreduce.cluster.acls.enabled": "false",
> "hadoop.security.uid.cache.secs": "14400",
> "nfs.allow.insecure.ports": "true",
> "yarn.nodemanager.localizer.fetch.thread-count": "4",
> "map.sort.class": "org.apache.hadoop.util.QuickSort",
> "hadoop.proxyuser.hue.groups": "*",
> "fs.trash.checkpoint.interval": "0",
> "hadoop.proxyuser.hcat.groups": "users",
> "dfs.image.transfer.timeout": "60000",
> "dfs.namenode.name.dir":
> "/grid/1/dfs/nn,/grid/2/dfs/nn,/grid/3/dfs/nn,/grid/4/dfs/nn,/grid/5/dfs/nn,/grid/6/dfs/nn",
>
> "ipc.client.connect.timeout": "20000",
> "yarn.app.mapreduce.am.staging-dir": "/user",
> "fs.AbstractFileSystem.file.impl":
> "org.apache.hadoop.fs.local.LocalFs",
> "yarn.nodemanager.env-whitelist":
> "JAVA_HOME,HADOOP_COMMON_HOME,HADOOP_HDFS_HOME,HADOOP_CONF_DIR,HADOOP_YARN_HOME",
>
> "hadoop.registry.zk.retry.interval.ms": "1000",
>
> "yarn.nodemanager.linux-container-executor.cgroups.strict-resource-usage":
> "false",
> "yarn.timeline-service.keytab": "/etc/krb5.keytab",
> "dfs.image.compression.codec":
> "org.apache.hadoop.io.compress.DefaultCodec",
> "mapreduce.job.reduces": "1",
> "mapreduce.job.complete.cancel.delegation.tokens": "true",
> "mapreduce.jobhistory.recovery.store.class":
> "org.apache.hadoop.mapreduce.v2.hs.HistoryServerFileSystemStateStoreService",
> "hadoop.security.group.mapping.ldap.search.filter.user":
> "(&(objectClass=user)(sAMAccountName={0}))",
> "dfs.namenode.enable.retrycache": "true",
> "yarn.nodemanager.sleep-delay-before-sigkill.ms": "250",
> "mapreduce.jobhistory.joblist.cache.size": "20000",
> "mapreduce.tasktracker.healthchecker.interval": "60000",
> "mapreduce.jobtracker.heartbeats.in.second": "100",
> "hadoop.security.auth_to_local": " RULE:[2:$1@$0]([rn]m@.*)s/.*/yarn/
> RULE:[2:$1@$0](jhs@.*)s/.*/mapred/ RULE:[2:$1@$0]([nd]n@.*)s/.*/hdfs/
> RULE:[2:$1@$0](hm@.*)s/.*/hbase/ RULE:[2:$1@$0](rs@.*)s/.*/hbase/ DEFAULT",
> "mapreduce.admin.map.child.java.opts": "-server -XX:NewRatio=8
> -Djava.net.preferIPv4Stack=true -Dhdp.version=2.2.0.0-2041",
> "mapreduce.jobtracker.persist.jobstatus.dir": "/jobtracker/jobsInfo",
> "dfs.namenode.backup.http-address": "0.0.0.0:50105",
> "hadoop.rpc.protection": "authentication",
> "dfs.client.mmap.enabled": "true",
> "yarn.app.mapreduce.am.container.log.backups": "0",
> "ftp.stream-buffer-size": "4096",
> "dfs.namenode.https-address": "host1:50470",
> "yarn.timeline-service.address": "host2:10200",
> "dfs.ha.log-roll.period": "120",
> "yarn.nodemanager.recovery.enabled": "true",
> "hadoop.security.groups.negative-cache.secs": "30",
> "yarn.resourcemanager.admin.client.thread-count": "1",
> "dfs.datanode.fsdatasetcache.max.threads.per.volume": "4",
> "file.client-write-packet-size": "65536",
> "hadoop.http.authentication.simple.anonymous.allowed": "true",
> "yarn.timeline-service.leveldb-timeline-store.path":
> "/grid/1/hadoop/yarn/timeline",
> "dfs.namenode.https-address.$cluster_name.nn1": "host1:50470",
> "yarn.resourcemanager.proxy-user-privileges.enabled": "false",
> "dfs.datanode.drop.cache.behind.reads": "false",
> "yarn.nodemanager.log.retain-seconds": "10800",
> "dfs.image.transfer.bandwidthPerSec": "0",
> "yarn.resourcemanager.work-preserving-recovery.scheduling-wait-ms":
> "10000",
> "hadoop.registry.zk.session.timeout.ms": "60000",
> "dfs.datanode.slow.io.warning.threshold.ms": "300",
> "mapreduce.tasktracker.instrumentation":
> "org.apache.hadoop.mapred.TaskTrackerMetricsInst",
> "ha.failover-controller.cli-check.rpc-timeout.ms": "20000",
> "dfs.namenode.https-address.$cluster_name.nn2": "host2:50470",
> "yarn.nodemanager.linux-container-executor.cgroups.hierarchy":
> "hadoop-yarn",
> "dfs.namenode.write.stale.datanode.ratio": "1.0f",
> "hadoop.security.groups.cache.warn.after.ms": "5000",
> "mapreduce.reduce.shuffle.fetch.retry.timeout-ms": "30000",
> "mapreduce.jobhistory.client.thread-count": "10",
> "io.mapfile.bloom.size": "1048576",
> "yarn.resourcemanager.work-preserving-recovery.enabled": "true",
> "dfs.ha.fencing.ssh.connect-timeout": "30000",
> "yarn.resourcemanager.zk-num-retries": "1000",
> "hadoop.registry.zk.root": "/registry",
> "s3.bytes-per-checksum": "512",
> "yarn.app.mapreduce.am.container.log.limit.kb": "0",
> "dfs.namenode.edit.log.autoroll.check.interval.ms": "300000",
> "fs.automatic.close": "true",
> "yarn.node-labels.fs-store.retry-policy-spec": "2000, 500",
> "fs.trash.interval": "360",
> "dfs.journalnode.https-address": "0.0.0.0:8481",
> "yarn.timeline-service.ttl-ms": "2678400000",
> "hadoop.security.authentication": "simple",
> "fs.defaultFS": "hdfs://$cluster_name",
> "nfs.rtmax": "1048576",
> "hadoop.ssl.server.conf": "ssl-server.xml",
> "ipc.client.connect.max.retries": "50",
> "yarn.resourcemanager.delayed.delegation-token.removal-interval-ms":
> "30000",
> "dfs.journalnode.http-address": "0.0.0.0:8480",
> "dfs.namenode.xattrs.enabled": "true",
> "dfs.datanode.shared.file.descriptor.paths": "/dev/shm,/tmp",
> "mapreduce.jobtracker.taskscheduler":
> "org.apache.hadoop.mapred.JobQueueTaskScheduler",
> "mapreduce.job.speculative.speculativecap": "0.1",
> "yarn.timeline-service.store-class":
> "org.apache.hadoop.yarn.server.timeline.LeveldbTimelineStore",
> "yarn.am.liveness-monitor.expiry-interval-ms": "600000",
> "mapreduce.output.fileoutputformat.compress": "false",
> "yarn.timeline-service.bind-host": "0.0.0.0",
> "dfs.user.home.dir.prefix": "/user",
> "yarn.app.mapreduce.am.log.level": "INFO",
> "net.topology.node.switch.mapping.impl":
> "org.apache.hadoop.net.ScriptBasedMapping",
> "dfs.namenode.replication.considerLoad": "true",
> "dfs.namenode.fs-limits.min-block-size": "1048576",
> "fs.swift.impl":
> "org.apache.hadoop.fs.swift.snative.SwiftNativeFileSystem",
> "dfs.namenode.audit.loggers": "default",
> "yarn.nodemanager.bind-host": "0.0.0.0",
> "mapreduce.job.max.split.locations": "10",
> "yarn.resourcemanager.address": "host2:8050",
> "mapreduce.job.counters.max": "120",
> "mapreduce.reduce.shuffle.fetch.retry.enabled": "1",
> "dfs.client.block.write.retries": "3",
> "dfs.short.circuit.shared.memory.watcher.interrupt.check.ms":
> "60000",
> "dfs.namenode.resource.checked.volumes.minimum": "1",
> "io.map.index.interval": "128",
> "mapred.child.java.opts": "-Xmx200m",
> "mapreduce.tasktracker.local.dir.minspacestart": "0",
> "mapreduce.client.progressmonitor.pollinterval": "1000",
> "dfs.client.https.keystore.resource": "ssl-client.xml",
> "mapreduce.task.profile.map.params":
> "-agentlib:hprof=cpu=samples,heap=sites,force=n,thread=y,verbose=n,file=%s",
> "mapreduce.jobtracker.tasktracker.maxblacklists": "4",
> "mapreduce.job.queuename": "default",
> "hadoop.registry.zk.quorum": "host2:2181",
> "yarn.app.mapreduce.client-am.ipc.max-retries-on-timeouts": "3",
> "yarn.nodemanager.localizer.address": "0.0.0.0:8040",
> "io.mapfile.bloom.error.rate": "0.005",
> "yarn.nodemanager.delete.thread-count": "4",
> "mapreduce.job.split.metainfo.maxsize": "10000000",
> "yarn.scheduler.maximum-allocation-vcores": "32",
> "dfs.https.port": "50470",
> "yarn.app.mapreduce.am.resource.mb": "3584",
> "dfs.datanode.dns.nameserver": "default",
> "dfs.client.slow.io.warning.threshold.ms": "30000",
> "mapreduce.job.reducer.preempt.delay.sec": "0",
> "yarn.nodemanager.disk-health-checker.min-free-space-per-disk-mb":
> "1000",
> "mapreduce.map.output.compress.codec":
> "org.apache.hadoop.io.compress.DefaultCodec",
> "dfs.namenode.accesstime.precision": "0",
> "mapreduce.map.log.level": "INFO",
> "fs.s3a.connection.maximum": "15",
> "io.seqfile.compress.blocksize": "1000000",
> "mapreduce.tasktracker.taskcontroller":
> "org.apache.hadoop.mapred.DefaultTaskController",
> "hadoop.security.groups.cache.secs": "300",
> "dfs.datanode.cache.revocation.timeout.ms": "900000",
> "dfs.client.context": "default",
> "hadoop.proxyuser.hive.groups": "users",
> "mapreduce.input.lineinputformat.linespermap": "1",
> "mapreduce.job.end-notification.max.attempts": "5",
>
> "yarn.nodemanager.linux-container-executor.nonsecure-mode.local-user":
> "nobody",
> "yarn.nodemanager.webapp.address": "0.0.0.0:8042",
> "mapreduce.jobhistory.recovery.enable": "false",
> "mapreduce.jobtracker.expire.trackers.interval": "600000",
> "yarn.resourcemanager.webapp.address": "host2:8088",
> "hadoop.security.kms.client.encrypted.key.cache.num.refill.threads":
> "2",
> "yarn.nodemanager.health-checker.interval-ms": "135000",
> "mapreduce.jobhistory.loadedjobs.cache.size": "5",
> "hadoop.security.authorization": "false",
> "mapreduce.job.map.output.collector.class":
> "org.apache.hadoop.mapred.MapTask$MapOutputBuffer",
> "mapreduce.am.max-attempts": "2",
> "fs.ftp.host": "0.0.0.0",
> "fs.s3a.attempts.maximum": "10",
> "yarn.app.mapreduce.am.scheduler.heartbeat.interval-ms": "1000",
> "mapreduce.ifile.readahead": "true",
> "yarn.resourcemanager.scheduler.monitor.enable": "false",
> "yarn.resourcemanager.zk-retry-interval-ms": "1000",
> "ha.zookeeper.session-timeout.ms": "5000",
> "rpc.engine.org.apache.hadoop.ipc.ProtocolMetaInfoPB":
> "org.apache.hadoop.ipc.ProtobufRpcEngine",
> "mapreduce.tasktracker.taskmemorymanager.monitoringinterval": "5000",
> "mapreduce.reduce.shuffle.parallelcopies": "30",
> "mapreduce.map.skip.maxrecords": "0",
> "dfs.client.mmap.retry.timeout.ms": "300000",
> "dfs.namenode.avoid.read.stale.datanode": "true",
> "yarn.timeline-service.webapp.https.address": "host2:8190",
> "dfs.https.enable": "false",
> "mapreduce.reduce.shuffle.read.timeout": "180000",
> "dfs.namenode.list.encryption.zones.num.responses": "100",
> "mapreduce.jobtracker.instrumentation":
> "org.apache.hadoop.mapred.JobTrackerMetricsInst",
> "mapreduce.output.fileoutputformat.compress.codec":
> "org.apache.hadoop.io.compress.DefaultCodec",
> "yarn.nodemanager.remote-app-log-dir-suffix": "logs",
> "ipc.client.connect.retry.interval": "1000",
> "dfs.blockreport.intervalMsec": "21600000",
> "mapreduce.reduce.speculative": "false",
> "mapreduce.jobhistory.keytab":
> "/etc/security/keytab/jhs.service.keytab",
> "mapreduce.jobhistory.datestring.cache.size": "200000",
> "dfs.datanode.balance.bandwidthPerSec": "6250000",
> "file.blocksize": "67108864",
> "yarn.resourcemanager.admin.address": "host2:8141",
> "mapreduce.map.cpu.vcores": "1",
>
> "yarn.nodemanager.container-monitor.procfs-tree.smaps-based-rss.enabled":
> "false",
> "yarn.resourcemanager.resource-tracker.address": "host2:8025",
> "yarn.resourcemanager.configuration.provider-class":
> "org.apache.hadoop.yarn.LocalConfigurationProvider",
> "mapreduce.tasktracker.local.dir.minspacekill": "0",
> "mapreduce.jobtracker.staging.root.dir":
> "/tmp/hadoop-yarn-${hue.suffix}/mapred/staging",
> "mapreduce.jobtracker.retiredjobs.cache.size": "1000",
> "hadoop.registry.rm.enabled": "true",
> "dfs.ha.fencing.methods": "shell(/bin/true)",
> "ipc.client.connect.max.retries.on.timeouts": "45",
> "hadoop.security.crypto.codec.classes.aes.ctr.nopadding":
> "org.apache.hadoop.crypto.OpensslAesCtrCryptoCodec,org.apache.hadoop.crypto.JceAesCtrCryptoCodec",
>
> "ha.zookeeper.acl": "world:anyone:rwcda",
> "mapreduce.app-submission.cross-platform": "false",
> "yarn.nodemanager.local-dirs":
> "/grid/1/hadoop/yarn/local,/grid/2/hadoop/yarn/local,/grid/3/hadoop/yarn/local,/grid/4/hadoop/yarn/local,/grid/5/hadoop/yarn/local,/grid/6/hadoop/yarn/local",
>
> "rpc.metrics.quantile.enable": "false",
> "dfs.block.access.key.update.interval": "600",
> "mapreduce.reduce.shuffle.connect.timeout": "180000",
> "dfs.block.access.token.lifetime": "600",
> "mapreduce.job.end-notification.retry.attempts": "0",
> "dfs.namenode.fs-limits.max-xattrs-per-inode": "32",
> "mapreduce.jobtracker.system.dir":
> "/tmp/hadoop-yarn-${hue.suffix}/mapred/system",
> "dfs.client.file-block-storage-locations.timeout.millis": "1000",
> "yarn.nodemanager.admin-env": "MALLOC_ARENA_MAX=$MALLOC_ARENA_MAX",
> "yarn.log-aggregation.retain-seconds": "2592000",
> "mapreduce.jobtracker.jobhistory.block.size": "3145728",
> "yarn.timeline-service.handler-thread-count": "10",
> "mapreduce.tasktracker.indexcache.mb": "10",
> "dfs.namenode.checkpoint.check.period": "60",
> "dfs.client.block.write.replace-datanode-on-failure.enable": "true",
> "yarn.resourcemanager.hostname": "host2",
> "dfs.datanode.directoryscan.interval": "21600",
> "net.topology.impl": "org.apache.hadoop.net.NetworkTopology",
> "fs.s3a.multipart.purge.age": "86400",
> "dfs.client.failover.proxy.provider.$cluster_name":
> "org.apache.hadoop.hdfs.server.namenode.ha.ConfiguredFailoverProxyProvider",
> "hadoop.security.java.secure.random.algorithm": "SHA1PRNG",
> "yarn.nodemanager.container-monitor.interval-ms": "3000",
> "dfs.default.chunk.view.size": "32768",
> "fs.s3a.multipart.threshold": "2147483647",
> "mapreduce.job.speculative.slownodethreshold": "1.0",
> "mapreduce.job.reduce.slowstart.completedmaps": "0.05",
> "hadoop.security.instrumentation.requires.admin": "false",
> "io.compression.codec.bzip2.library": "system-native",
> "dfs.namenode.safemode.min.datanodes": "0",
> "hadoop.registry.secure": "false",
> "hadoop.http.authentication.signature.secret.file":
> "/home/yarn/hadoop-http-auth-signature-secret",
> "mapreduce.reduce.maxattempts": "4",
> "yarn.nodemanager.localizer.cache.target-size-mb": "10240",
> "s3native.replication": "3",
> "dfs.datanode.https.address": "0.0.0.0:50475",
> "dfs.journalnode.edits.dir":
> "/grid/1/dfs/journal,/grid/2/dfs/journal,/grid/3/dfs/journal,/grid/4/dfs/journal,/grid/5/dfs/journal,/grid/6/dfs/journal",
>
> "dfs.namenode.path.based.cache.retry.interval.ms": "30000",
> "dfs.namenode.inotify.max.events.per.rpc": "1000",
> "dfs.datanode.cache.revocation.polling.ms": "500",
> "mapreduce.reduce.skip.proc.count.autoincr": "true",
> "file.replication": "1",
> "mapreduce.jobhistory.cleaner.interval-ms": "86400000",
> "hadoop.hdfs.configuration.version": "1",
> "ipc.client.idlethreshold": "8000",
> "yarn.resourcemanager.store.class":
> "org.apache.hadoop.yarn.server.resourcemanager.recovery.ZKRMStateStore",
> "hadoop.tmp.dir": "/tmp/hadoop-yarn-${hue.suffix}",
> "mapreduce.jobtracker.restart.recover": "false",
> "mapreduce.jobhistory.address": "host2:10020",
> "mapreduce.cluster.local.dir":
> "/tmp/hadoop-yarn-${hue.suffix}/mapred/local",
> "yarn.client.nodemanager-client-async.thread-pool-max-size": "500",
> "proxyuser_group": "users",
> "dfs.namenode.decommission.nodes.per.interval": "5",
> "dfs.namenode.reject-unresolved-dn-topology-mapping": "false",
> "yarn.nodemanager.resource.cpu-vcores": "20",
> "dfs.namenode.delegation.key.update-interval": "86400000",
> "dfs.client.read.shortcircuit.streams.cache.expiry.ms": "300000",
> "fs.s3.buffer.dir": "/tmp/hadoop-yarn-${hue.suffix}/s3",
> "dfs.namenode.support.allow.format": "true",
> "yarn.nodemanager.remote-app-log-dir": "/app-logs",
> "io.compression.codecs":
> "org.apache.hadoop.io.compress.GzipCodec,org.apache.hadoop.io.compress.DefaultCodec,org.apache.hadoop.io.compress.SnappyCodec",
>
> "yarn.nodemanager.aux-services": "mapreduce_shuffle",
> "dfs.namenode.edit.log.autoroll.multiplier.threshold": "2.0",
> "mapreduce.map.memory.mb": "3584",
> "hadoop.work.around.non.threadsafe.getpwuid": "false",
> "mapreduce.task.profile.reduce.params":
> "-agentlib:hprof=cpu=samples,heap=sites,force=n,thread=y,verbose=n,file=%s",
> "dfs.ha.automatic-failover.enabled": "true",
> "yarn.timeline-service.client.max-retries": "30",
> "dfs.namenode.stale.datanode.interval": "30000",
> "dfs.namenode.edits.noeditlogchannelflush": "false",
> "mapreduce.shuffle.transfer.buffer.size": "131072",
> "dfs.namenode.logging.level": "info",
> "mapreduce.jobtracker.persist.jobstatus.active": "true",
> "yarn.nodemanager.log-dirs": "/var/log/hadoop-yarn",
> "yarn.resourcemanager.am-rm-tokens.master-key-rolling-interval-secs":
> "86400",
> "ha.health-monitor.sleep-after-disconnect.ms": "1000",
> "dfs.namenode.checkpoint.edits.dir":
> "/grid/1/dfs/snn,/grid/2/dfs/snn,/grid/3/dfs/snn,/grid/4/dfs/snn,/grid/5/dfs/snn,/grid/6/dfs/snn",
>
> "yarn.resourcemanager.fs.state-store.uri": " ",
> "hadoop.rpc.socket.factory.class.default":
> "org.apache.hadoop.net.StandardSocketFactory",
> "yarn.resourcemanager.keytab": "/etc/krb5.keytab",
> "dfs.datanode.http.address": "0.0.0.0:50075",
> "mapreduce.task.profile": "false",
> "mapreduce.jobhistory.move.interval-ms": "180000",
> "dfs.namenode.edits.dir":
> "/grid/1/dfs/nn,/grid/2/dfs/nn,/grid/3/dfs/nn,/grid/4/dfs/nn,/grid/5/dfs/nn,/grid/6/dfs/nn",
>
> "dfs.storage.policy.enabled": "true",
> "hadoop.security.kms.client.encrypted.key.cache.size": "500",
> "hadoop.fuse.timer.period": "5",
> "mapreduce.jobhistory.http.policy": "HTTP_ONLY",
> "mapreduce.jobhistory.intermediate-done-dir": "/mr-history/tmp",
> "mapreduce.map.skip.proc.count.autoincr": "true",
> "dfs.cluster.administrators": " hdfs",
> "fs.AbstractFileSystem.viewfs.impl":
> "org.apache.hadoop.fs.viewfs.ViewFs",
> "mapreduce.job.speculative.slowtaskthreshold": "1.0",
> "yarn.resourcemanager.webapp.delegation-token-auth-filter.enabled":
> "false",
> "s3native.stream-buffer-size": "4096",
> "yarn.nodemanager.delete.debug-delay-sec": "0",
> "dfs.secondary.namenode.kerberos.internal.spnego.principal":
> "${dfs.web.authentication.kerberos.principal}",
>
> "dfs.datanode.available-space-volume-choosing-policy.balanced-space-threshold":
> "10737418240",
> "fs.s3n.multipart.uploads.block.size": "67108864",
> "mapreduce.ifile.readahead.bytes": "4194304",
> "dfs.namenode.safemode.threshold-pct": "0.99f",
> "yarn.scheduler.maximum-allocation-mb": "96768",
> "ipc.client.fallback-to-simple-auth-allowed": "false",
> "yarn.timeline-service.leveldb-timeline-store.read-cache-size":
> "104857600",
> "fs.har.impl.disable.cache": "true",
> "s3native.bytes-per-checksum": "512",
> "yarn.timeline-service.hostname": "0.0.0.0",
> "mapreduce.job.committer.setup.cleanup.needed": "true",
> "fs.s3a.paging.maximum": "5000",
> "yarn.timeline-service.leveldb-timeline-store.ttl-interval-ms":
> "300000",
> "yarn.client.nodemanager-connect.retry-interval-ms": "10000",
> "yarn.nodemanager.log-aggregation.compression-type": "gz",
> "yarn.app.mapreduce.am.job.committer.commit-window": "10000",
> "hadoop.http.authentication.type": "simple",
> "dfs.client.failover.sleep.base.millis": "500",
> "dfs.ha.namenodes.$cluster_name": "nn1,nn2",
> "yarn.nodemanager.vmem-check-enabled": "false",
> "hadoop.jetty.logs.serve.aliases": "true",
> "ha.failover-controller.graceful-fence.rpc-timeout.ms": "5000",
> "mapreduce.reduce.shuffle.input.buffer.percent": "0.7",
> "dfs.datanode.max.transfer.threads": "4096",
> "mapreduce.task.io.sort.mb": "1024",
> "mapreduce.reduce.merge.inmem.threshold": "1000",
> "hadoop.security.kms.client.authentication.retry-count": "1",
> "yarn.client.application-client-protocol.poll-interval-ms": "200",
> "dfs.namenode.acls.enabled": "false",
> "yarn.resourcemanager.connect.max-wait.ms": "900000",
> "dfs.namenode.handler.count": "40",
> "yarn.timeline-service.enabled": "true",
> "dfs.namenode.retrycache.heap.percent": "0.03f",
> "yarn.nodemanager.log.retain-second": "604800",
>
> "yarn.nodemanager.linux-container-executor.nonsecure-mode.limit-users":
> "true",
> "yarn.resourcemanager.container.liveness-monitor.interval-ms":
> "600000",
> "hadoop.ssl.client.conf": "ssl-client.xml",
> "mapreduce.client.completion.pollinterval": "5000",
> "yarn.nodemanager.vmem-pmem-ratio": "2.1",
> "yarn.app.mapreduce.client.max-retries": "3",
> "hadoop.ssl.enabled": "false",
> "fs.AbstractFileSystem.hdfs.impl": "org.apache.hadoop.fs.Hdfs",
> "fs.client.resolve.remote.symlinks": "true",
> "mapreduce.reduce.java.opts": "-Xmx2867m",
> "mapreduce.map.java.opts": "-Xmx2867m",
> "mapreduce.tasktracker.reduce.tasks.maximum": "2",
> "yarn.nodemanager.hostname": "0.0.0.0",
> "mapreduce.reduce.input.buffer.percent": "0.0",
> "fs.s3a.multipart.purge": "false",
> "dfs.namenode.invalidate.work.pct.per.iteration": "0.32f",
> "yarn.app.mapreduce.am.command-opts": "-Xmx2867m
> -Dhdp.version=2.2.0.0-2041",
> "dfs.bytes-per-checksum": "512",
> "dfs.replication": "3",
> "yarn.resourcemanager.webapp.https.address": "host2:8090",
> "mapreduce.shuffle.ssl.file.buffer.size": "65536",
> "dfs.datanode.block.id.layout.upgrade.threads": "12",
> "dfs.namenode.list.cache.directives.num.responses": "100",
> "dfs.permissions.enabled": "true",
> "mapreduce.jobtracker.maxtasks.perjob": "-1",
> "dfs.datanode.use.datanode.hostname": "false",
> "mapreduce.task.userlog.limit.kb": "0",
> "dfs.namenode.fs-limits.max-directory-items": "1048576",
> "s3.client-write-packet-size": "65536",
> "fs.s3a.buffer.dir": "/tmp/hadoop-yarn-${hue.suffix}/s3a",
> "hadoop.security.kms.client.encrypted.key.cache.low-watermark":
> "0.3f",
> "hadoop.user.group.static.mapping.overrides": "dr.who=;",
> "slider.provider.agent":
> "org.apache.slider.providers.agent.AgentProviderFactory",
> "mapreduce.shuffle.max.threads": "0",
> "dfs.client.failover.sleep.max.millis": "15000",
> "hadoop.security.kms.client.encrypted.key.cache.expiry": "43200000",
> "mapreduce.job.maps": "2",
> "dfs.namenode.fs-limits.max-component-length": "255",
> "hadoop.ssl.enabled.protocols": "TLSv1",
> "mapreduce.map.output.compress": "false",
> "s3.blocksize": "67108864",
> "dfs.namenode.edits.journal-plugin.qjournal":
> "org.apache.hadoop.hdfs.qjournal.client.QuorumJournalManager",
> "dfs.namenode.datanode.registration.ip-hostname-check": "true",
> "yarn.node-labels.manager-class":
> "org.apache.hadoop.yarn.server.resourcemanager.nodelabels.MemoryRMNodeLabelsManager",
>
> "yarn.nodemanager.pmem-check-enabled": "true",
> "dfs.client.https.need-auth": "false",
> "dfs.client.short.circuit.replica.stale.threshold.ms": "1800000",
> "ha.zookeeper.quorum": "host1:2181,host2:2181,host3:2181",
> "yarn.scheduler.minimum-allocation-mb": "3584",
> "hadoop.proxyuser.hive.hosts": "host1",
> "yarn.timeline-service.http-authentication.type": "simple",
> "mapreduce.jobhistory.max-age-ms": "604800000",
> "ftp.replication": "3",
> "dfs.blockreport.split.threshold": "1000000",
> "dfs.namenode.secondary.https-address": "0.0.0.0:50091",
> "mapreduce.input.fileinputformat.split.minsize": "0",
> "fs.s3n.block.size": "67108864",
> "mapreduce.job.token.tracking.ids.enabled": "false",
> "mapreduce.jobtracker.webinterface.trusted": "false",
> "yarn.ipc.rpc.class":
> "org.apache.hadoop.yarn.ipc.HadoopYarnProtoRPC",
> "dfs.namenode.num.extra.edits.retained": "1000000",
> "hadoop.http.staticuser.user": "dr.who",
> "yarn.nodemanager.localizer.cache.cleanup.interval-ms": "600000",
> "mapreduce.job.jvm.numtasks": "1",
> "fs.s3a.multipart.size": "104857600",
> "mapreduce.jobhistory.move.thread-count": "3",
> "mapreduce.task.profile.maps": "0-2",
> "dfs.datanode.max.locked.memory": "0",
> "dfs.cachereport.intervalMsec": "10000",
> "mapreduce.shuffle.port": "13562",
> "mapreduce.shuffle.connection-keep-alive.timeout": "5",
> "yarn.resourcemanager.nodemanager.minimum.version": "NONE",
> "mapreduce.jobtracker.http.address": "0.0.0.0:50030",
> "mapreduce.reduce.shuffle.merge.percent": "0.66",
> "yarn.resourcemanager.connect.retry-interval.ms": "30000",
> "mapreduce.task.skip.start.attempts": "2",
> "yarn.scheduler.minimum-allocation-vcores": "1",
> "mapreduce.task.io.sort.factor": "100",
> "dfs.namenode.checkpoint.dir":
> "/grid/1/dfs/snn,/grid/2/dfs/snn,/grid/3/dfs/snn,/grid/4/dfs/snn,/grid/5/dfs/snn,/grid/6/dfs/snn",
>
> "nfs.exports.allowed.hosts": "* rw",
> "tfile.fs.input.buffer.size": "262144",
> "tfile.io.chunk.size": "1048576",
> "fs.s3.block.size": "67108864",
> "fs.s3n.multipart.copy.block.size": "5368709120",
> "io.serializations":
> "org.apache.hadoop.io.serializer.WritableSerialization",
> "yarn.resourcemanager.max-completed-applications": "10000",
> "mapreduce.jobhistory.principal": "jhs/_h...@realm.tld",
> "hadoop.proxyuser.hcat.hosts": "host1",
> "yarn.resourcemanager.ha.automatic-failover.zk-base-path":
> "/yarn-leader-election",
> "mapreduce.reduce.shuffle.fetch.retry.interval-ms": "1000",
> "mapreduce.job.end-notification.retry.interval": "1000",
> "mapreduce.application.framework.path":
> "/hdp/apps/2.2.0.0-2041/mapreduce/mapreduce.tar.gz#mr-framework",
> "dfs.namenode.backup.address": "0.0.0.0:50100",
> "fs.s3n.multipart.uploads.enabled": "false",
> "s3native.client-write-packet-size": "65536",
> "dfs.block.access.token.enable": "true",
> "io.seqfile.sorter.recordlimit": "1000000",
> "hadoop.security.group.mapping":
> "org.apache.hadoop.security.JniBasedUnixGroupsMappingWithFallback",
> "ftp.bytes-per-checksum": "512",
> "dfs.namenode.fs-limits.max-xattr-size": "16384",
> "dfs.client.read.shortcircuit.streams.cache.size": "4096",
> "dfs.client.domain.socket.data.traffic": "false",
> "fs.s3a.connection.timeout": "5000",
> "mapreduce.job.end-notification.max.retry.interval": "5000",
> "dfs.namenode.rpc-address.$cluster_name.nn1": "host1:8020",
> "yarn.acl.enable": "false",
> "mapreduce.application.classpath":
> "$PWD/mr-framework/hadoop/share/hadoop/mapreduce/*:$PWD/mr-framework/hadoop/share/hadoop/mapreduce/lib/*:$PWD/mr-framework/hadoop/share/hadoop/common/*:$PWD/mr-framework/hadoop/share/hadoop/common/lib/*:$PWD/mr-framework/hadoop/share/hadoop/yarn/*:$PWD/mr-framework/hadoop/share/hadoop/yarn/lib/*:$PWD/mr-framework/hadoop/share/hadoop/hdfs/*:$PWD/mr-framework/hadoop/share/hadoop/hdfs/lib/*:/usr/hdp/2.2.0.0-2041/hadoop/lib/hadoop-lzo-0.6.0.2.2.0.0-2041.jar:/etc/hadoop/conf/secure",
>
> "yarn.nm.liveness-monitor.expiry-interval-ms": "600000",
> "dfs.namenode.rpc-address.$cluster_name.nn2": "host2:8020",
> "dfs.client.mmap.cache.size": "256",
> "mapreduce.input.fileinputformat.list-status.num-threads": "1",
> "mapreduce.tasktracker.map.tasks.maximum": "2",
> "yarn.nodemanager.linux-container-executor.resources-handler.class":
> "org.apache.hadoop.yarn.server.nodemanager.util.DefaultLCEResourcesHandler",
> "yarn.timeline-service.ttl-enable": "true",
> "yarn.resourcemanager.zk-address": "localhost:2181",
> "dfs.namenode.max.objects": "0",
> "yarn.resourcemanager.state-store.max-completed-applications":
> "10000",
> "dfs.namenode.delegation.token.max-lifetime": "604800000",
> "mapreduce.job.classloader": "false",
>
> "yarn.timeline-service.leveldb-timeline-store.start-time-write-cache-size":
> "10000",
> "mapreduce.job.hdfs-servers": "hdfs://$cluster_name",
> "yarn.application.classpath":
> "$HADOOP_CONF_DIR,/usr/hdp/current/hadoop-client/*,/usr/hdp/current/hadoop-client/lib/*,/usr/hdp/current/hadoop-hdfs-client/*,/usr/hdp/current/hadoop-hdfs-client/lib/*,/usr/hdp/current/hadoop-yarn-client/*,/usr/hdp/current/hadoop-yarn-client/lib/*",
>
> "mapreduce.tasktracker.dns.nameserver": "default",
> "dfs.datanode.hdfs-blocks-metadata.enabled": "false",
> "dfs.datanode.readahead.bytes": "4193404",
> "dfs.image.compress": "false",
> "mapreduce.job.ubertask.maxreduces": "1",
> "mapreduce.tasktracker.report.address": "127.0.0.1:0",
> "yarn.log-aggregation-enable": "true",
> "mapreduce.shuffle.ssl.enabled": "false",
>
> "rpc.engine.org.apache.slider.server.appmaster.rpc.SliderClusterProtocolPB":
> "org.apache.hadoop.ipc.ProtobufRpcEngine",
> "mapreduce.tasktracker.http.threads": "40",
> "dfs.stream-buffer-size": "4096",
> "tfile.fs.output.buffer.size": "262144",
> "fs.permissions.umask-mode": "022",
> "yarn.resourcemanager.am.max-attempts": "2",
> "dfs.namenode.resource.du.reserved": "104857600",
> "dfs.client.datanode-restart.timeout": "30",
> "yarn.nodemanager.resource.percentage-physical-cpu-limit": "100",
> "ha.failover-controller.graceful-fence.connection.retries": "1",
> "dfs.datanode.drop.cache.behind.writes": "false",
> "yarn.app.mapreduce.am.resource.cpu-vcores": "1",
> "mapreduce.job.ubertask.enable": "false",
> "hadoop.common.configuration.version": "0.23.0",
> "dfs.namenode.replication.work.multiplier.per.iteration": "2",
> "mapreduce.job.acl-modify-job": " ",
> "io.seqfile.local.dir": "/tmp/hadoop-yarn-${hue.suffix}/io/local",
> "fs.s3.sleepTimeSeconds": "10",
> "yarn.resourcemanager.system-metrics-publisher.enabled": "true",
> "mapreduce.client.output.filter": "FAILED"
> },
> "empty": false
> }
> {code}
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
