Hi Robert, I noticed that before, but forgot to push a fix. All we need is a fallback url when we download Hadoop. I will push the fix tomorrow morning to tp32 and master and then also rebase my PR.
Cheers, Daniel On Oct 1, 2017 10:01 AM, "Robert Dale" <[email protected]> wrote: > So I commented out that section and it appears that the processing got > past implementations-hadoop-start.asciidoc > and implementations-spark.asciidoc but looks like it's hung > on implementations-giraph.asciidoc. > > > > > Robert Dale > > On Sun, Oct 1, 2017 at 11:19 AM, Robert Dale <[email protected]> wrote: > > > > > docs/preprocessor/preprocess.sh is looking for all of "NameNode" > > "DataNode" "ResourceManager" "NodeManager" > > > > jps shows only these running: > > > > 305 DataNode > > 164 NameNode > > 494 SecondaryNameNode > > > > > > > > > > Robert Dale > > > > On Sun, Oct 1, 2017 at 11:04 AM, Robert Dale <[email protected]> wrote: > > > >> > >> Trying to build and test TINKERPOP-1661 - > https://github.com/apache/tink > >> erpop/pull/725 > >> > >> First, I did not see a mention that docker images needed to be rebuilt > >> for DOT NET. Should it be assumed that docker images should be rebuilt > for > >> each release? > >> > >> Next, I tried rebuilding the images. I ran into an issue: > >> > >> ppa:webupd8team/java > >> Please check that the PPA name or format is correct. > >> > >> That may have been some intermittent issue because it cleared up > >> overnight. > >> > >> Then, I ran into a hadoop issue where the version used by TinkerPop, > >> 2.7.2, is no longer available on the mirrors. So I updated the pom to > use > >> the latest, 2.7.4. > >> > >> Now, I run `docker/build.sh -d` and hadoop isn't seen as running... > >> > >> > >> [INFO] ------------------------------------------------------------ > >> ------------ > >> [INFO] Reactor Summary: > >> [INFO] > >> [INFO] Apache TinkerPop ................................... SUCCESS [ > >> 8.437 s] > >> [INFO] Apache TinkerPop :: Gremlin Shaded ................. SUCCESS [ > >> 2.091 s] > >> [INFO] Apache TinkerPop :: Gremlin Core ................... SUCCESS [ > >> 8.996 s] > >> [INFO] Apache TinkerPop :: Gremlin Test ................... SUCCESS [ > >> 3.180 s] > >> [INFO] Apache TinkerPop :: TinkerGraph Gremlin ............ SUCCESS [ > >> 0.878 s] > >> [INFO] Apache TinkerPop :: Gremlin Groovy ................. SUCCESS [ > >> 4.003 s] > >> [INFO] Apache TinkerPop :: Gremlin Driver ................. SUCCESS [ > >> 3.352 s] > >> [INFO] Apache TinkerPop :: Neo4j Gremlin .................. SUCCESS [ > >> 0.547 s] > >> [INFO] Apache TinkerPop :: Gremlin Server ................. SUCCESS [ > >> 2.556 s] > >> [INFO] Apache TinkerPop :: Gremlin Python ................. SUCCESS [ > >> 47.899 s] > >> [INFO] Apache TinkerPop :: Gremlin.Net .................... SUCCESS [ > >> 2.058 s] > >> [INFO] Apache TinkerPop :: Gremlin.Net - Source ........... SUCCESS [ > >> 26.997 s] > >> [INFO] Apache TinkerPop :: Gremlin.Net - Tests ............ SUCCESS [ > >> 0.548 s] > >> [INFO] Apache TinkerPop :: Hadoop Gremlin ................. SUCCESS [ > >> 7.207 s] > >> [INFO] Apache TinkerPop :: Spark Gremlin .................. SUCCESS [ > >> 7.732 s] > >> [INFO] Apache TinkerPop :: Giraph Gremlin ................. SUCCESS [ > >> 6.627 s] > >> [INFO] Apache TinkerPop :: Gremlin Console ................ SUCCESS [ > >> 3.292 s] > >> [INFO] Apache TinkerPop :: Gremlin Archetype .............. SUCCESS [ > >> 0.055 s] > >> [INFO] Apache TinkerPop :: Archetype - TinkerGraph ........ SUCCESS [ > >> 0.497 s] > >> [INFO] Apache TinkerPop :: Archetype - Server ............. SUCCESS [ > >> 0.183 s] > >> [INFO] Apache TinkerPop :: Archetype - DSL ................ SUCCESS [ > >> 0.089 s] > >> [INFO] Apache TinkerPop :: Gremlin Tools .................. SUCCESS [ > >> 0.081 s] > >> [INFO] Apache TinkerPop :: Gremlin Benchmark .............. SUCCESS [ > >> 1.750 s] > >> [INFO] Apache TinkerPop :: Gremlin Coverage ............... SUCCESS [ > >> 0.321 s] > >> [INFO] Apache TinkerPop :: Gremlin IO Test ................ SUCCESS [ > >> 0.571 s] > >> [INFO] ------------------------------------------------------------ > >> ------------ > >> [INFO] BUILD SUCCESS > >> [INFO] ------------------------------------------------------------ > >> ------------ > >> [INFO] Total time: 02:21 min > >> [INFO] Finished at: 2017-10-01T14:46:30+00:00 > >> [INFO] Final Memory: 286M/3167M > >> [INFO] ------------------------------------------------------------ > >> ------------ > >> * Starting OpenBSD Secure Shell server sshd > >> > >> [ OK ] > >> 17/10/01 14:46:32 INFO namenode.NameNode: STARTUP_MSG: > >> /************************************************************ > >> STARTUP_MSG: Starting NameNode > >> STARTUP_MSG: host = 55a815f3171d/172.17.0.2 > >> STARTUP_MSG: args = [-format] > >> STARTUP_MSG: version = 2.7.4 > >> STARTUP_MSG: classpath = /usr/local/lib/hadoop-2.7.4/et > >> c/hadoop:/usr/local/lib/hadoop-2.7.4/share/hadoop/common/ > >> lib/activation-1.1.jar:/usr/local/lib/hadoop-2.7.4/share/ > >> hadoop/common/lib/apacheds-i18n-2.0.0-M15.jar:/usr/local/ > >> lib/hadoop-2.7.4/share/hadoop/common/lib/apacheds-kerberos- > >> codec-2.0.0-M15.jar:/usr/local/lib/hadoop-2.7.4/share/ > >> hadoop/common/lib/api-asn1-api-1.0.0-M20.jar:/usr/local/ > >> lib/hadoop-2.7.4/share/hadoop/common/lib/api-util-1.0.0-M20. > >> jar:/usr/local/lib/hadoop-2.7.4/share/hadoop/common/lib/asm- > >> 3.2.jar:/usr/local/lib/hadoop-2.7.4/share/hadoop/common/lib/ > >> avro-1.7.4.jar:/usr/local/lib/hadoop-2.7.4/share/hadoop/ > >> common/lib/commons-beanutils-1.7.0.jar:/usr/local/lib/ > >> hadoop-2.7.4/share/hadoop/common/lib/commons-beanutils- > >> core-1.8.0.jar:/usr/local/lib/hadoop-2.7.4/share/hadoop/ > >> common/lib/commons-cli-1.2.jar:/usr/local/lib/hadoop-2.7. > >> 4/share/hadoop/common/lib/commons-codec-1.4.jar:/usr/ > >> local/lib/hadoop-2.7.4/share/hadoop/common/lib/commons-coll > >> ections-3.2.2.jar:/usr/local/lib/hadoop-2.7.4/share/hadoop/ > >> common/lib/commons-compress-1.4.1.jar:/usr/local/lib/hadoop- > >> 2.7.4/share/hadoop/common/lib/commons-configuration-1.6.jar: > >> /usr/local/lib/hadoop-2.7.4/share/hadoop/common/lib/ > >> commons-digester-1.8.jar:/usr/local/lib/hadoop-2.7.4/share/ > >> hadoop/common/lib/commons-httpclient-3.1.jar:/usr/local/ > >> lib/hadoop-2.7.4/share/hadoop/common/lib/commons-io-2.4.jar: > >> /usr/local/lib/hadoop-2.7.4/share/hadoop/common/lib/ > >> commons-lang-2.6.jar:/usr/local/lib/hadoop-2.7.4/share/ > >> hadoop/common/lib/commons-logging-1.1.3.jar:/usr/local/ > >> lib/hadoop-2.7.4/share/hadoop/common/lib/commons-math3-3.1. > >> 1.jar:/usr/local/lib/hadoop-2.7.4/share/hadoop/common/lib/ > >> commons-net-3.1.jar:/usr/local/lib/hadoop-2.7.4/share/ > >> hadoop/common/lib/curator-client-2.7.1.jar:/usr/local/ > >> lib/hadoop-2.7.4/share/hadoop/common/lib/curator-framework- > >> 2.7.1.jar:/usr/local/lib/hadoop-2.7.4/share/hadoop/ > >> common/lib/curator-recipes-2.7.1.jar:/usr/local/lib/hadoop- > >> 2.7.4/share/hadoop/common/lib/gson-2.2.4.jar:/usr/local/lib/ > >> hadoop-2.7.4/share/hadoop/common/lib/guava-11.0.2.jar:/ > >> usr/local/lib/hadoop-2.7.4/share/hadoop/common/lib/ > >> hadoop-annotations-2.7.4.jar:/usr/local/lib/hadoop-2.7.4/ > >> share/hadoop/common/lib/hadoop-auth-2.7.4.jar:/usr/ > >> local/lib/hadoop-2.7.4/share/hadoop/common/lib/hamcrest- > >> core-1.3.jar:/usr/local/lib/hadoop-2.7.4/share/hadoop/ > >> common/lib/htrace-core-3.1.0-incubating.jar:/usr/local/lib/ > >> hadoop-2.7.4/share/hadoop/common/lib/httpclient-4.2.5. > >> jar:/usr/local/lib/hadoop-2.7.4/share/hadoop/common/lib/ > >> httpcore-4.2.5.jar:/usr/local/lib/hadoop-2.7.4/share/hadoop/ > >> common/lib/jackson-core-asl-1.9.13.jar:/usr/local/lib/ > >> hadoop-2.7.4/share/hadoop/common/lib/jackson-jaxrs-1.9. > >> 13.jar:/usr/local/lib/hadoop-2.7.4/share/hadoop/common/lib/ > >> jackson-mapper-asl-1.9.13.jar:/usr/local/lib/hadoop-2.7.4/ > >> share/hadoop/common/lib/jackson-xc-1.9.13.jar:/usr/ > >> local/lib/hadoop-2.7.4/share/hadoop/common/lib/java- > >> xmlbuilder-0.4.jar:/usr/local/lib/hadoop-2.7.4/share/hadoop/ > >> common/lib/jaxb-api-2.2.2.jar:/usr/local/lib/hadoop-2.7.4/ > >> share/hadoop/common/lib/jaxb-impl-2.2.3-1.jar:/usr/local/ > >> lib/hadoop-2.7.4/share/hadoop/common/lib/jersey-core-1.9. > >> jar:/usr/local/lib/hadoop-2.7.4/share/hadoop/common/lib/ > >> jersey-json-1.9.jar:/usr/local/lib/hadoop-2.7.4/share/ > >> hadoop/common/lib/jersey-server-1.9.jar:/usr/local/lib/ > >> hadoop-2.7.4/share/hadoop/common/lib/jets3t-0.9.0.jar:/ > >> usr/local/lib/hadoop-2.7.4/share/hadoop/common/lib/jettis > >> on-1.1.jar:/usr/local/lib/hadoop-2.7.4/share/hadoop/comm > >> on/lib/jetty-6.1.26.jar:/usr/local/lib/hadoop-2.7.4/share/ > >> hadoop/common/lib/jetty-sslengine-6.1.26.jar:/usr/local/lib/ > >> hadoop-2.7.4/share/hadoop/common/lib/jetty-util-6.1.26. > >> jar:/usr/local/lib/hadoop-2.7.4/share/hadoop/common/lib/ > >> jsch-0.1.54.jar:/usr/local/lib/hadoop-2.7.4/share/hadoop/ > >> common/lib/jsp-api-2.1.jar:/usr/local/lib/hadoop-2.7.4/ > >> share/hadoop/common/lib/jsr305-3.0.0.jar:/usr/local/ > >> lib/hadoop-2.7.4/share/hadoop/common/lib/junit-4.11.jar:/ > >> usr/local/lib/hadoop-2.7.4/share/hadoop/common/lib/log4j- > >> 1.2.17.jar:/usr/local/lib/hadoop-2.7.4/share/hadoop/ > >> common/lib/mockito-all-1.8.5.jar:/usr/local/lib/hadoop-2.7. > >> 4/share/hadoop/common/lib/netty-3.6.2.Final.jar:/usr/ > >> local/lib/hadoop-2.7.4/share/hadoop/common/lib/paranamer-2. > >> 3.jar:/usr/local/lib/hadoop-2.7.4/share/hadoop/common/lib/pr > >> otobuf-java-2.5.0.jar:/usr/local/lib/hadoop-2.7.4/share/hado > >> op/common/lib/servlet-api-2.5.jar:/usr/local/lib/hadoop-2.7. > >> 4/share/hadoop/common/lib/slf4j-api-1.7.10.jar:/usr/local/ > >> lib/hadoop-2.7.4/share/hadoop/common/lib/slf4j-log4j12-1.7. > >> 10.jar:/usr/local/lib/hadoop-2.7.4/share/hadoop/common/lib/ > >> snappy-java-1.0.4.1.jar:/usr/local/lib/hadoop-2.7.4/share/ > >> hadoop/common/lib/stax-api-1.0-2.jar:/usr/local/lib/hadoop- > >> 2.7.4/share/hadoop/common/lib/xmlenc-0.52.jar:/usr/local/ > >> lib/hadoop-2.7.4/share/hadoop/common/lib/xz-1.0.jar:/usr/ > >> local/lib/hadoop-2.7.4/share/hadoop/common/lib/zookeeper-3. > >> 4.6.jar:/usr/local/lib/hadoop-2.7.4/share/hadoop/common/ > >> hadoop-common-2.7.4-tests.jar:/usr/local/lib/hadoop-2.7.4/ > >> share/hadoop/common/hadoop-common-2.7.4.jar:/usr/local/ > >> lib/hadoop-2.7.4/share/hadoop/common/hadoop-nfs-2.7.4.jar:/ > >> usr/local/lib/hadoop-2.7.4/share/hadoop/hdfs:/usr/local/ > >> lib/hadoop-2.7.4/share/hadoop/hdfs/lib/asm-3.2.jar:/usr/ > >> local/lib/hadoop-2.7.4/share/hadoop/hdfs/lib/commons-cli-1. > >> 2.jar:/usr/local/lib/hadoop-2.7.4/share/hadoop/hdfs/lib/ > >> commons-codec-1.4.jar:/usr/local/lib/hadoop-2.7.4/share/ > >> hadoop/hdfs/lib/commons-daemon-1.0.13.jar:/usr/local/ > >> lib/hadoop-2.7.4/share/hadoop/hdfs/lib/commons-io-2.4.jar:/ > >> usr/local/lib/hadoop-2.7.4/share/hadoop/hdfs/lib/commons- > >> lang-2.6.jar:/usr/local/lib/hadoop-2.7.4/share/hadoop/ > >> hdfs/lib/commons-logging-1.1.3.jar:/usr/local/lib/hadoop-2. > >> 7.4/share/hadoop/hdfs/lib/guava-11.0.2.jar:/usr/local/ > >> lib/hadoop-2.7.4/share/hadoop/hdfs/lib/htrace-core-3.1.0- > >> incubating.jar:/usr/local/lib/hadoop-2.7.4/share/hadoop/ > >> hdfs/lib/jackson-core-asl-1.9.13.jar:/usr/local/lib/hadoop- > >> 2.7.4/share/hadoop/hdfs/lib/jackson-mapper-asl-1.9.13.jar: > >> /usr/local/lib/hadoop-2.7.4/share/hadoop/hdfs/lib/jersey- > >> core-1.9.jar:/usr/local/lib/hadoop-2.7.4/share/hadoop/ > >> hdfs/lib/jersey-server-1.9.jar:/usr/local/lib/hadoop-2.7. > >> 4/share/hadoop/hdfs/lib/jetty-6.1.26.jar:/usr/local/lib/ > >> hadoop-2.7.4/share/hadoop/hdfs/lib/jetty-util-6.1.26. > >> jar:/usr/local/lib/hadoop-2.7.4/share/hadoop/hdfs/lib/ > >> jsr305-3.0.0.jar:/usr/local/lib/hadoop-2.7.4/share/hadoop/ > >> hdfs/lib/leveldbjni-all-1.8.jar:/usr/local/lib/hadoop-2.7. > >> 4/share/hadoop/hdfs/lib/log4j-1.2.17.jar:/usr/local/lib/ > >> hadoop-2.7.4/share/hadoop/hdfs/lib/netty-3.6.2.Final. > >> jar:/usr/local/lib/hadoop-2.7.4/share/hadoop/hdfs/lib/netty- > >> all-4.0.23.Final.jar:/usr/local/lib/hadoop-2.7.4/share/ > >> hadoop/hdfs/lib/protobuf-java-2.5.0.jar:/usr/local/lib/ > >> hadoop-2.7.4/share/hadoop/hdfs/lib/servlet-api-2.5.jar:/ > >> usr/local/lib/hadoop-2.7.4/share/hadoop/hdfs/lib/ > >> xercesImpl-2.9.1.jar:/usr/local/lib/hadoop-2.7.4/share/ > >> hadoop/hdfs/lib/xml-apis-1.3.04.jar:/usr/local/lib/hadoop- > >> 2.7.4/share/hadoop/hdfs/lib/xmlenc-0.52.jar:/usr/local/ > >> lib/hadoop-2.7.4/share/hadoop/hdfs/hadoop-hdfs-2.7.4-tests. > >> jar:/usr/local/lib/hadoop-2.7.4/share/hadoop/hdfs/hadoop- > >> hdfs-2.7.4.jar:/usr/local/lib/hadoop-2.7.4/share/hadoop/ > >> hdfs/hadoop-hdfs-nfs-2.7.4.jar:/usr/local/lib/hadoop-2.7. > >> 4/share/hadoop/yarn/lib/activation-1.1.jar:/usr/local/ > >> lib/hadoop-2.7.4/share/hadoop/yarn/lib/aopalliance-1.0.jar:/ > >> usr/local/lib/hadoop-2.7.4/share/hadoop/yarn/lib/asm-3.2. > >> jar:/usr/local/lib/hadoop-2.7.4/share/hadoop/yarn/lib/ > >> commons-cli-1.2.jar:/usr/local/lib/hadoop-2.7.4/share/ > >> hadoop/yarn/lib/commons-codec-1.4.jar:/usr/local/lib/hadoop- > >> 2.7.4/share/hadoop/yarn/lib/commons-collections-3.2.2.jar:/ > >> usr/local/lib/hadoop-2.7.4/share/hadoop/yarn/lib/commons-com > >> press-1.4.1.jar:/usr/local/lib/hadoop-2.7.4/share/hadoop/yar > >> n/lib/commons-io-2.4.jar:/usr/local/lib/hadoop-2.7.4/share/ > >> hadoop/yarn/lib/commons-lang-2.6.jar:/usr/local/lib/hadoop- > >> 2.7.4/share/hadoop/yarn/lib/commons-logging-1.1.3.jar:/ > >> usr/local/lib/hadoop-2.7.4/share/hadoop/yarn/lib/guava- > >> 11.0.2.jar:/usr/local/lib/hadoop-2.7.4/share/hadoop/yarn > >> /lib/guice-3.0.jar:/usr/local/lib/hadoop-2.7.4/share/hadoop/ > >> yarn/lib/guice-servlet-3.0.jar:/usr/local/lib/hadoop-2.7. > >> 4/share/hadoop/yarn/lib/jackson-core-asl-1.9.13.jar:/usr/ > >> local/lib/hadoop-2.7.4/share/hadoop/yarn/lib/jackson-jaxrs- > >> 1.9.13.jar:/usr/local/lib/hadoop-2.7.4/share/hadoop/yarn > >> /lib/jackson-mapper-asl-1.9.13.jar:/usr/local/lib/hadoop- > >> 2.7.4/share/hadoop/yarn/lib/jackson-xc-1.9.13.jar:/usr/ > >> local/lib/hadoop-2.7.4/share/hadoop/yarn/lib/javax.inject- > >> 1.jar:/usr/local/lib/hadoop-2.7.4/share/hadoop/yarn/lib/ > >> jaxb-api-2.2.2.jar:/usr/local/lib/hadoop-2.7.4/share/hadoop/ > >> yarn/lib/jaxb-impl-2.2.3-1.jar:/usr/local/lib/hadoop-2.7. > >> 4/share/hadoop/yarn/lib/jersey-client-1.9.jar:/usr/ > >> local/lib/hadoop-2.7.4/share/hadoop/yarn/lib/jersey-core-1. > >> 9.jar:/usr/local/lib/hadoop-2.7.4/share/hadoop/yarn/lib/ > >> jersey-guice-1.9.jar:/usr/local/lib/hadoop-2.7.4/share/ > >> hadoop/yarn/lib/jersey-json-1.9.jar:/usr/local/lib/hadoop-2. > >> 7.4/share/hadoop/yarn/lib/jersey-server-1.9.jar:/usr/ > >> local/lib/hadoop-2.7.4/share/hadoop/yarn/lib/jettison-1.1. > >> jar:/usr/local/lib/hadoop-2.7.4/share/hadoop/yarn/lib/jetty- > >> 6.1.26.jar:/usr/local/lib/hadoop-2.7.4/share/hadoop/ > >> yarn/lib/jetty-util-6.1.26.jar:/usr/local/lib/hadoop-2.7. > >> 4/share/hadoop/yarn/lib/jsr305-3.0.0.jar:/usr/local/ > >> lib/hadoop-2.7.4/share/hadoop/yarn/lib/leveldbjni-all-1.8. > >> jar:/usr/local/lib/hadoop-2.7.4/share/hadoop/yarn/lib/log4j- > >> 1.2.17.jar:/usr/local/lib/hadoop-2.7.4/share/hadoop/ > >> yarn/lib/netty-3.6.2.Final.jar:/usr/local/lib/hadoop-2.7. > >> 4/share/hadoop/yarn/lib/protobuf-java-2.5.0.jar:/usr/ > >> local/lib/hadoop-2.7.4/share/hadoop/yarn/lib/servlet-api-2. > >> 5.jar:/usr/local/lib/hadoop-2.7.4/share/hadoop/yarn/lib/ > >> stax-api-1.0-2.jar:/usr/local/lib/hadoop-2.7.4/share/hadoop/ > >> yarn/lib/xz-1.0.jar:/usr/local/lib/hadoop-2.7.4/share/ > >> hadoop/yarn/lib/zookeeper-3.4.6-tests.jar:/usr/local/lib/ > >> hadoop-2.7.4/share/hadoop/yarn/lib/zookeeper-3.4.6.jar:/ > >> usr/local/lib/hadoop-2.7.4/share/hadoop/yarn/hadoop-yarn- > >> api-2.7.4.jar:/usr/local/lib/hadoop-2.7.4/share/hadoop/ > >> yarn/hadoop-yarn-applications-distributedshell-2.7.4.jar:/us > >> r/local/lib/hadoop-2.7.4/share/hadoop/yarn/hadoop-yarn-appli > >> cations-unmanaged-am-launcher-2.7.4.jar:/usr/local/lib/ > >> hadoop-2.7.4/share/hadoop/yarn/hadoop-yarn-client-2.7.4.jar: > >> /usr/local/lib/hadoop-2.7.4/share/hadoop/yarn/hadoop-yarn- > >> common-2.7.4.jar:/usr/local/lib/hadoop-2.7.4/share/hadoop/ > >> yarn/hadoop-yarn-registry-2.7.4.jar:/usr/local/lib/hadoop-2. > >> 7.4/share/hadoop/yarn/hadoop-yarn-server-applicationhistory > >> service-2.7.4.jar:/usr/local/lib/hadoop-2.7.4/share/hadoop/ > >> yarn/hadoop-yarn-server-common-2.7.4.jar:/usr/local/ > >> lib/hadoop-2.7.4/share/hadoop/yarn/hadoop-yarn-server- > >> nodemanager-2.7.4.jar:/usr/local/lib/hadoop-2.7.4/share/ > >> hadoop/yarn/hadoop-yarn-server-resourcemanager-2.7.4.jar:/ > >> usr/local/lib/hadoop-2.7.4/share/hadoop/yarn/hadoop-yarn- > >> server-sharedcachemanager-2.7.4.jar:/usr/local/lib/hadoop-2. > >> 7.4/share/hadoop/yarn/hadoop-yarn-server-tests-2.7.4.jar:/ > >> usr/local/lib/hadoop-2.7.4/share/hadoop/yarn/hadoop-yarn- > >> server-web-proxy-2.7.4.jar:/usr/local/lib/hadoop-2.7.4/share > >> /hadoop/mapreduce/lib/aopalliance-1.0.jar:/usr/local/lib/ > >> hadoop-2.7.4/share/hadoop/mapreduce/lib/asm-3.2.jar:/ > >> usr/local/lib/hadoop-2.7.4/share/hadoop/mapreduce/lib/avr > >> o-1.7.4.jar:/usr/local/lib/hadoop-2.7.4/share/hadoop/mapredu > >> ce/lib/commons-compress-1.4.1.jar:/usr/local/lib/hadoop-2.7. > >> 4/share/hadoop/mapreduce/lib/commons-io-2.4.jar:/usr/local/ > >> lib/hadoop-2.7.4/share/hadoop/mapreduce/lib/guice-3.0.jar:/ > >> usr/local/lib/hadoop-2.7.4/share/hadoop/mapreduce/lib/ > >> guice-servlet-3.0.jar:/usr/local/lib/hadoop-2.7.4/share/ > >> hadoop/mapreduce/lib/hadoop-annotations-2.7.4.jar:/usr/ > >> local/lib/hadoop-2.7.4/share/hadoop/mapreduce/lib/hamcrest- > >> core-1.3.jar:/usr/local/lib/hadoop-2.7.4/share/hadoop/ > >> mapreduce/lib/jackson-core-asl-1.9.13.jar:/usr/local/lib/ > >> hadoop-2.7.4/share/hadoop/mapreduce/lib/jackson-mapper- > >> asl-1.9.13.jar:/usr/local/lib/hadoop-2.7.4/share/hadoop/ > >> mapreduce/lib/javax.inject-1.jar:/usr/local/lib/hadoop-2.7. > >> 4/share/hadoop/mapreduce/lib/jersey-core-1.9.jar:/usr/ > >> local/lib/hadoop-2.7.4/share/hadoop/mapreduce/lib/jersey- > >> guice-1.9.jar:/usr/local/lib/hadoop-2.7.4/share/hadoop/ > >> mapreduce/lib/jersey-server-1.9.jar:/usr/local/lib/hadoop-2. > >> 7.4/share/hadoop/mapreduce/lib/junit-4.11.jar:/usr/local/ > >> lib/hadoop-2.7.4/share/hadoop/mapreduce/lib/leveldbjni-all- > >> 1.8.jar:/usr/local/lib/hadoop-2.7.4/share/hadoop/mapreduce/ > >> lib/log4j-1.2.17.jar:/usr/local/lib/hadoop-2.7.4/share/ > >> hadoop/mapreduce/lib/netty-3.6.2.Final.jar:/usr/local/lib/h > >> adoop-2.7.4/share/hadoop/mapreduce/lib/paranamer-2.3.jar:/ > >> usr/local/lib/hadoop-2.7.4/share/hadoop/mapreduce/lib/pro > >> tobuf-java-2.5.0.jar:/usr/local/lib/hadoop-2.7.4/share/hadoo > >> p/mapreduce/lib/snappy-java-1.0.4.1.jar:/usr/local/lib/ > >> hadoop-2.7.4/share/hadoop/mapreduce/lib/xz-1.0.jar:/usr/loca > >> l/lib/hadoop-2.7.4/share/hadoop/mapreduce/hadoop-mapreduce- > >> client-app-2.7.4.jar:/usr/local/lib/hadoop-2.7.4/share/ > >> hadoop/mapreduce/hadoop-mapreduce-client-common-2.7.4. > >> jar:/usr/local/lib/hadoop-2.7.4/share/hadoop/mapreduce/ > >> hadoop-mapreduce-client-core-2.7.4.jar:/usr/local/lib/ > >> hadoop-2.7.4/share/hadoop/mapreduce/hadoop-mapreduce- > >> client-hs-2.7.4.jar:/usr/local/lib/hadoop-2.7.4/share/ > >> hadoop/mapreduce/hadoop-mapreduce-client-hs-plugins-2.7.4. > >> jar:/usr/local/lib/hadoop-2.7.4/share/hadoop/mapreduce/hadoo > >> p-mapreduce-client-jobclient-2.7.4-tests.jar:/usr/local/ > >> lib/hadoop-2.7.4/share/hadoop/mapreduce/hadoop-mapreduce- > >> client-jobclient-2.7.4.jar:/usr/local/lib/hadoop-2.7.4/ > >> share/hadoop/mapreduce/hadoop-mapreduce-client-shuffle-2.7. > >> 4.jar:/usr/local/lib/hadoop-2.7.4/share/hadoop/mapreduce/ > >> hadoop-mapreduce-examples-2.7.4.jar:/contrib/capacity-scheduler/*.jar > >> STARTUP_MSG: build = https://[email protected]. > >> org/repos/asf/hadoop.git -r cd915e1e8d9d0131462a0b7301586c175728a282; > >> compiled by 'kshvachk' on 2017-08-01T00:29Z > >> STARTUP_MSG: java = 1.8.0_144 > >> ************************************************************/ > >> 17/10/01 14:46:32 INFO namenode.NameNode: registered UNIX signal > handlers > >> for [TERM, HUP, INT] > >> 17/10/01 14:46:32 INFO namenode.NameNode: createNameNode [-format] > >> Formatting using clusterid: CID-8aadd5be-34cf-4d32-bcc3-5ad941ccc703 > >> 17/10/01 14:46:32 INFO namenode.FSNamesystem: No KeyProvider found. > >> 17/10/01 14:46:32 INFO namenode.FSNamesystem: fsLock is fair: true > >> 17/10/01 14:46:32 INFO namenode.FSNamesystem: Detailed lock hold time > >> metrics enabled: false > >> 17/10/01 14:46:32 INFO blockmanagement.DatanodeManager: > >> dfs.block.invalidate.limit=1000 > >> 17/10/01 14:46:32 INFO blockmanagement.DatanodeManager: > >> dfs.namenode.datanode.registration.ip-hostname-check=true > >> 17/10/01 14:46:32 INFO blockmanagement.BlockManager: > >> dfs.namenode.startup.delay.block.deletion.sec is set to > 000:00:00:00.000 > >> 17/10/01 14:46:32 INFO blockmanagement.BlockManager: The block deletion > >> will start around 2017 Oct 01 14:46:32 > >> 17/10/01 14:46:32 INFO util.GSet: Computing capacity for map BlocksMap > >> 17/10/01 14:46:32 INFO util.GSet: VM type = 64-bit > >> 17/10/01 14:46:32 INFO util.GSet: 2.0% max memory 889 MB = 17.8 MB > >> 17/10/01 14:46:32 INFO util.GSet: capacity = 2^21 = 2097152 entries > >> 17/10/01 14:46:32 INFO blockmanagement.BlockManager: > >> dfs.block.access.token.enable=false > >> 17/10/01 14:46:32 INFO blockmanagement.BlockManager: defaultReplication > >> = 1 > >> 17/10/01 14:46:32 INFO blockmanagement.BlockManager: maxReplication > >> = 512 > >> 17/10/01 14:46:32 INFO blockmanagement.BlockManager: minReplication > >> = 1 > >> 17/10/01 14:46:32 INFO blockmanagement.BlockManager: > >> maxReplicationStreams = 2 > >> 17/10/01 14:46:32 INFO blockmanagement.BlockManager: > >> replicationRecheckInterval = 3000 > >> 17/10/01 14:46:32 INFO blockmanagement.BlockManager: encryptDataTransfer > >> = false > >> 17/10/01 14:46:32 INFO blockmanagement.BlockManager: maxNumBlocksToLog > >> = 1000 > >> 17/10/01 14:46:32 INFO namenode.FSNamesystem: fsOwner = root > >> (auth:SIMPLE) > >> 17/10/01 14:46:32 INFO namenode.FSNamesystem: supergroup = > >> supergroup > >> 17/10/01 14:46:32 INFO namenode.FSNamesystem: isPermissionEnabled = true > >> 17/10/01 14:46:32 INFO namenode.FSNamesystem: HA Enabled: false > >> 17/10/01 14:46:32 INFO namenode.FSNamesystem: Append Enabled: true > >> 17/10/01 14:46:32 INFO util.GSet: Computing capacity for map INodeMap > >> 17/10/01 14:46:32 INFO util.GSet: VM type = 64-bit > >> 17/10/01 14:46:32 INFO util.GSet: 1.0% max memory 889 MB = 8.9 MB > >> 17/10/01 14:46:32 INFO util.GSet: capacity = 2^20 = 1048576 entries > >> 17/10/01 14:46:32 INFO namenode.FSDirectory: ACLs enabled? false > >> 17/10/01 14:46:32 INFO namenode.FSDirectory: XAttrs enabled? true > >> 17/10/01 14:46:32 INFO namenode.FSDirectory: Maximum size of an xattr: > >> 16384 > >> 17/10/01 14:46:32 INFO namenode.NameNode: Caching file names occuring > >> more than 10 times > >> 17/10/01 14:46:32 INFO util.GSet: Computing capacity for map > cachedBlocks > >> 17/10/01 14:46:32 INFO util.GSet: VM type = 64-bit > >> 17/10/01 14:46:32 INFO util.GSet: 0.25% max memory 889 MB = 2.2 MB > >> 17/10/01 14:46:32 INFO util.GSet: capacity = 2^18 = 262144 entries > >> 17/10/01 14:46:32 INFO namenode.FSNamesystem: > >> dfs.namenode.safemode.threshold-pct = 0.9990000128746033 > >> 17/10/01 14:46:32 INFO namenode.FSNamesystem: > >> dfs.namenode.safemode.min.datanodes = 0 > >> 17/10/01 14:46:32 INFO namenode.FSNamesystem: > >> dfs.namenode.safemode.extension = 30000 > >> 17/10/01 14:46:32 INFO metrics.TopMetrics: NNTop conf: > >> dfs.namenode.top.window.num.buckets = 10 > >> 17/10/01 14:46:32 INFO metrics.TopMetrics: NNTop conf: > >> dfs.namenode.top.num.users = 10 > >> 17/10/01 14:46:32 INFO metrics.TopMetrics: NNTop conf: > >> dfs.namenode.top.windows.minutes = 1,5,25 > >> 17/10/01 14:46:32 INFO namenode.FSNamesystem: Retry cache on namenode is > >> enabled > >> 17/10/01 14:46:32 INFO namenode.FSNamesystem: Retry cache will use 0.03 > >> of total heap and retry cache entry expiry time is 600000 millis > >> 17/10/01 14:46:32 INFO util.GSet: Computing capacity for map > >> NameNodeRetryCache > >> 17/10/01 14:46:32 INFO util.GSet: VM type = 64-bit > >> 17/10/01 14:46:32 INFO util.GSet: 0.029999999329447746% max memory 889 > MB > >> = 273.1 KB > >> 17/10/01 14:46:32 INFO util.GSet: capacity = 2^15 = 32768 entries > >> 17/10/01 14:46:32 INFO namenode.FSImage: Allocated new BlockPoolId: > >> BP-1073458684-172.17.0.2-1506869192720 > >> 17/10/01 14:46:32 INFO common.Storage: Storage directory > >> /tmp/hadoop-root/dfs/name has been successfully formatted. > >> 17/10/01 14:46:32 INFO namenode.FSImageFormatProtobuf: Saving image > file > >> /tmp/hadoop-root/dfs/name/current/fsimage.ckpt_0000000000000000000 > using > >> no compression > >> 17/10/01 14:46:32 INFO namenode.FSImageFormatProtobuf: Image file > >> /tmp/hadoop-root/dfs/name/current/fsimage.ckpt_0000000000000000000 of > >> size 321 bytes saved in 0 seconds. > >> 17/10/01 14:46:32 INFO namenode.NNStorageRetentionManager: Going to > >> retain 1 images with txid >= 0 > >> 17/10/01 14:46:32 INFO util.ExitUtil: Exiting with status 0 > >> 17/10/01 14:46:32 INFO namenode.NameNode: SHUTDOWN_MSG: > >> /************************************************************ > >> SHUTDOWN_MSG: Shutting down NameNode at 55a815f3171d/172.17.0.2 > >> ************************************************************/ > >> Starting namenodes on [localhost] > >> localhost: Warning: Permanently added 'localhost' (ECDSA) to the list of > >> known hosts. > >> localhost: starting namenode, logging to /usr/local/lib/hadoop-2.7.4/lo > >> gs/hadoop-root-namenode-55a815f3171d.out > >> localhost: Warning: Permanently added 'localhost' (ECDSA) to the list of > >> known hosts. > >> localhost: starting datanode, logging to /usr/local/lib/hadoop-2.7.4/lo > >> gs/hadoop-root-datanode-55a815f3171d.out > >> Starting secondary namenodes [0.0.0.0] > >> 0.0.0.0: Warning: Permanently added '0.0.0.0' (ECDSA) to the list of > >> known hosts. > >> 0.0.0.0: starting secondarynamenode, logging to > >> /usr/local/lib/hadoop-2.7.4/logs/hadoop-root-secondarynameno > >> de-55a815f3171d.out > >> starting yarn daemons > >> starting resourcemanager, logging to /usr/local/lib/hadoop-2.7.4/lo > >> gs/yarn-root-resourcemanager-55a815f3171d.out > >> localhost: Warning: Permanently added 'localhost' (ECDSA) to the list of > >> known hosts. > >> localhost: starting nodemanager, logging to > /usr/local/lib/hadoop-2.7.4/lo > >> gs/yarn-root-nodemanager-55a815f3171d.out > >> Hadoop is not running, be sure to start it before processing the docs. > >> > >> > >> *Here are the contents of those hadoop log files:* > >> > >> root@1bf1210b9327:/usr/src/tinkermem# more > /usr/local/lib/hadoop-2.7.4/lo > >> gs/hadoop-root-namenode-55a815f3171d.out > >> ulimit -a for user root > >> core file size (blocks, -c) 0 > >> data seg size (kbytes, -d) unlimited > >> scheduling priority (-e) 0 > >> file size (blocks, -f) unlimited > >> pending signals (-i) 128360 > >> max locked memory (kbytes, -l) 64 > >> max memory size (kbytes, -m) unlimited > >> open files (-n) 65536 > >> pipe size (512 bytes, -p) 8 > >> POSIX message queues (bytes, -q) 819200 > >> real-time priority (-r) 0 > >> stack size (kbytes, -s) 8192 > >> cpu time (seconds, -t) unlimited > >> max user processes (-u) 128360 > >> virtual memory (kbytes, -v) unlimited > >> file locks (-x) unlimited > >> root@1bf1210b9327:/usr/src/tinkermem# more > /usr/local/lib/hadoop-2.7.4/lo > >> gs/hadoop-root-datanode-55a815f3171d.out > >> ulimit -a for user root > >> core file size (blocks, -c) 0 > >> data seg size (kbytes, -d) unlimited > >> scheduling priority (-e) 0 > >> file size (blocks, -f) unlimited > >> pending signals (-i) 128360 > >> max locked memory (kbytes, -l) 64 > >> max memory size (kbytes, -m) unlimited > >> open files (-n) 65536 > >> pipe size (512 bytes, -p) 8 > >> POSIX message queues (bytes, -q) 819200 > >> real-time priority (-r) 0 > >> stack size (kbytes, -s) 8192 > >> cpu time (seconds, -t) unlimited > >> max user processes (-u) 128360 > >> virtual memory (kbytes, -v) unlimited > >> file locks (-x) unlimited > >> root@1bf1210b9327:/usr/src/tinkermem# more > /usr/local/lib/hadoop-2.7.4/lo > >> gs/hadoop-root-secondarynamenode-55a815f3171d.out > >> ulimit -a for user root > >> core file size (blocks, -c) 0 > >> data seg size (kbytes, -d) unlimited > >> scheduling priority (-e) 0 > >> file size (blocks, -f) unlimited > >> pending signals (-i) 128360 > >> max locked memory (kbytes, -l) 64 > >> max memory size (kbytes, -m) unlimited > >> open files (-n) 65536 > >> pipe size (512 bytes, -p) 8 > >> POSIX message queues (bytes, -q) 819200 > >> real-time priority (-r) 0 > >> stack size (kbytes, -s) 8192 > >> cpu time (seconds, -t) unlimited > >> max user processes (-u) 128360 > >> virtual memory (kbytes, -v) unlimited > >> file locks (-x) unlimited > >> root@1bf1210b9327:/usr/src/tinkermem# more > /usr/local/lib/hadoop-2.7.4/lo > >> gs/yarn-root-resourcemanager-55a815f3171d.out > >> Oct 01, 2017 2:46:52 PM com.sun.jersey.guice.spi.conta > >> iner.GuiceComponentProviderFactory register > >> INFO: Registering org.apache.hadoop.yarn.server. > >> resourcemanager.webapp.JAXBContextResolver as a provider class > >> Oct 01, 2017 2:46:52 PM com.sun.jersey.guice.spi.conta > >> iner.GuiceComponentProviderFactory register > >> INFO: Registering org.apache.hadoop.yarn.server. > >> resourcemanager.webapp.RMWebServices as a root resource class > >> Oct 01, 2017 2:46:52 PM com.sun.jersey.guice.spi.conta > >> iner.GuiceComponentProviderFactory register > >> INFO: Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler > >> as a provider class > >> Oct 01, 2017 2:46:52 PM com.sun.jersey.server.impl. > application.WebApplicationImpl > >> _initiate > >> INFO: Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 > >> 11:17 AM' > >> Oct 01, 2017 2:46:52 PM com.sun.jersey.guice.spi.conta > >> iner.GuiceComponentProviderFactory getComponentProvider > >> INFO: Binding org.apache.hadoop.yarn.server. > >> resourcemanager.webapp.JAXBContextResolver to > >> GuiceManagedComponentProvider with the scope "Singleton" > >> Oct 01, 2017 2:46:53 PM com.sun.jersey.guice.spi.conta > >> iner.GuiceComponentProviderFactory getComponentProvider > >> INFO: Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to > >> GuiceManagedComponentProvider with the scope "Singleton" > >> Oct 01, 2017 2:46:53 PM com.sun.jersey.guice.spi.conta > >> iner.GuiceComponentProviderFactory getComponentProvider > >> INFO: Binding org.apache.hadoop.yarn.server. > >> resourcemanager.webapp.RMWebServices to GuiceManagedComponentProvider > >> with the scope "Singleton" > >> root@1bf1210b9327:/usr/src/tinkermem# more > /usr/local/lib/hadoop-2.7.4/lo > >> gs/yarn-root-nodemanager-55a815f3171d.out > >> Oct 01, 2017 2:46:54 PM com.sun.jersey.guice.spi.conta > >> iner.GuiceComponentProviderFactory register > >> INFO: Registering org.apache.hadoop.yarn.server. > >> nodemanager.webapp.NMWebServices as a root resource class > >> Oct 01, 2017 2:46:54 PM com.sun.jersey.guice.spi.conta > >> iner.GuiceComponentProviderFactory register > >> INFO: Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler > >> as a provider class > >> Oct 01, 2017 2:46:54 PM com.sun.jersey.guice.spi.conta > >> iner.GuiceComponentProviderFactory register > >> INFO: Registering org.apache.hadoop.yarn.server. > >> nodemanager.webapp.JAXBContextResolver as a provider class > >> Oct 01, 2017 2:46:54 PM com.sun.jersey.server.impl. > application.WebApplicationImpl > >> _initiate > >> INFO: Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 > >> 11:17 AM' > >> Oct 01, 2017 2:46:54 PM com.sun.jersey.guice.spi.conta > >> iner.GuiceComponentProviderFactory getComponentProvider > >> INFO: Binding org.apache.hadoop.yarn.server. > >> nodemanager.webapp.JAXBContextResolver to GuiceManagedComponentProvider > >> with the scope "Singleton" > >> Oct 01, 2017 2:46:54 PM com.sun.jersey.guice.spi.conta > >> iner.GuiceComponentProviderFactory getComponentProvider > >> INFO: Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to > >> GuiceManagedComponentProvider with the scope "Singleton" > >> Oct 01, 2017 2:46:54 PM com.sun.jersey.guice.spi.conta > >> iner.GuiceComponentProviderFactory getComponentProvider > >> INFO: Binding org.apache.hadoop.yarn.server. > >> nodemanager.webapp.NMWebServices to GuiceManagedComponentProvider with > >> the scope "Singleton" > >> > >> > >> > >> Robert Dale > >> > > > > >
