[
https://issues.apache.org/jira/browse/HDDS-1513?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16837146#comment-16837146
]
Elek, Marton commented on HDDS-1513:
------------------------------------
Seems to be working for me:
{code}
hadoop-ozone/dist/target/ozone-0.5.0-SNAPSHOT/blockade> python -m pytest -s
test_blockade_client_failure.py
====================================================================================
test session starts
=====================================================================================
platform linux2 -- Python 2.7.12, pytest-2.8.7, py-1.8.0, pluggy-0.3.1
rootdir:
/home/elek/projects/hadoop/hadoop-ozone/dist/target/ozone-0.5.0-SNAPSHOT/blockade,
inifile:
collected 2 items
test_blockade_client_failure.py 2019-05-10
12:20:52,589|INFO|MainThread|blockade.py:33 - blockade_destroy()|Running
blockade destroy
Error:
No blockade exists in this context
2019-05-10 12:20:52,777|INFO|MainThread|cluster_utils.py:40 -
cluster_setup()|compose file
:/home/elek/projects/hadoop/hadoop-ozone/dist/target/ozone-0.5.0-SNAPSHOT/compose/ozoneblockade/docker-compose.yaml
2019-05-10 12:20:52,777|INFO|MainThread|cluster_utils.py:41 -
cluster_setup()|number of DNs :3
Removing ozoneblockade_ozone_client_1 ... done
Removing ozoneblockade_datanode_3 ... done
Removing ozoneblockade_datanode_1 ... done
Removing ozoneblockade_scm_1 ... done
Removing ozoneblockade_om_1 ... done
Removing ozoneblockade_datanode_2 ... done
Removing network ozoneblockade_default
Creating network "ozoneblockade_default" with the default driver
Creating ozoneblockade_ozone_client_1 ... done
Creating ozoneblockade_scm_1 ... done
Creating ozoneblockade_om_1 ... done
Creating ozoneblockade_datanode_1 ... done
Creating ozoneblockade_datanode_2 ... done
Creating ozoneblockade_datanode_3 ... done
2019-05-10 12:20:56,011|INFO|MainThread|cluster_utils.py:47 -
cluster_setup()|Waiting 30s for cluster start up...
{code}
{code}
CONTAINER ID IMAGE COMMAND CREATED
STATUS PORTS NAMES
c74488064a39 vimagick/iptables:latest "sleep 3600" 1
second ago Up 1 second
blockade-helper-5a5c39e4e8ea408ba8a5463b1908d2ce
1f4a6bcbfdc1 apache/hadoop-runner "/usr/local/bin/dumb…" About a
minute ago Up About a minute 0.0.0.0:32811->9864/tcp
ozoneblockade_datanode_1
6822cf1ee620 apache/hadoop-runner "/usr/local/bin/dumb…" About a
minute ago Up About a minute 0.0.0.0:32810->9864/tcp
ozoneblockade_datanode_2
12b8b4c996c1 apache/hadoop-runner "/usr/local/bin/dumb…" About a
minute ago Up About a minute 0.0.0.0:9874->9874/tcp ozoneblockade_om_1
94c5dc959192 apache/hadoop-runner "/usr/local/bin/dumb…" About a
minute ago Up About a minute 0.0.0.0:9876->9876/tcp ozoneblockade_scm_1
3ebd900ea719 apache/hadoop-runner "/usr/local/bin/dumb…" About a
minute ago Up About a minute 0.0.0.0:32809->9864/tcp
ozoneblockade_datanode_3
21903f552c33 apache/hadoop-runner "/usr/local/bin/dumb…" About a
minute ago Up About a minute 0.0.0.0:32808->9869/tcp
ozoneblockade_ozone_client_1
{code}
{code}
docker logs 1f4a6bcbfdc1 | head -n 20
2019-05-10 10:20:58 INFO HddsDatanodeService:51 - STARTUP_MSG:
/************************************************************
STARTUP_MSG: Starting HddsDatanodeService
STARTUP_MSG: host = 1f4a6bcbfdc1/192.168.160.7
STARTUP_MSG: args = []
STARTUP_MSG: version = 3.2.0
STARTUP_MSG: classpath =
/opt/hadoop/etc/hadoop:/opt/hadoop/share/hadoop/common/*:/opt/hadoop/share/ozone/lib/kerb-simplekdc-1.0.1.jar:/opt/hadoop/share/ozone/lib/jackson-core-2.9.5.jar:/opt/hadoop/share/ozone/lib/ratis-netty-0.4.0-fe2b15d-SNAPSHOT.jar:/opt/hadoop/share/ozone/lib/protobuf-java-2.5.0.jar:/opt/hadoop/share/ozone/lib/bcpkix-jdk15on-1.60.jar:/opt/hadoop/share/ozone/lib/sqlite-jdbc-3.25.2.jar:/opt/hadoop/share/ozone/lib/netty-3.10.5.Final.jar:/opt/hadoop/share/ozone/lib/commons-validator-1.6.jar:/opt/hadoop/share/ozone/lib/jaxb-impl-2.3.0.1.jar:/opt/hadoop/share/ozone/lib/commons-beanutils-1.9.3.jar:/opt/hadoop/share/ozone/lib/kerb-core-1.0.1.jar:/opt/hadoop/share/ozone/lib/jaeger-thrift-0.33.1.jar:/opt/hadoop/share/ozone/lib/hadoop-ozone-common-0.5.0-SNAPSHOT.jar:/opt/hadoop/share/ozone/lib/jsr305-3.0.0.jar:/opt/hadoop/share/ozone/lib/ratis-thirdparty-misc-0.2.0.jar:/opt/hadoop/share/ozone/lib/leveldbjni-all-1.8.jar:/opt/hadoop/share/ozone/lib/htrace-core4-4.1.0-incubating.jar:/opt/hadoop/share/ozone/lib/ratis-client-0.4.0-fe2b15d-SNAPSHOT.jar:/opt/hadoop/share/ozone/lib/jaeger-tracerresolver-0.33.1.jar:/opt/hadoop/share/ozone/lib/jaxb-api-2.3.0.jar:/opt/hadoop/share/ozone/lib/hadoop-annotations-3.2.0.jar:/opt/hadoop/share/ozone/lib/kerb-util-1.0.1.jar:/opt/hadoop/share/ozone/lib/hadoop-hdds-tools-0.5.0-SNAPSHOT.jar:/opt/hadoop/share/ozone/lib/jackson-jaxrs-1.9.13.jar:/opt/hadoop/share/ozone/lib/ratis-server-0.4.0-fe2b15d-SNAPSHOT.jar:/opt/hadoop/share/ozone/lib/kerby-xdr-1.0.1.jar:/opt/hadoop/share/ozone/lib/jetty-xml-9.3.24.v20180605.jar:/opt/hadoop/share/ozone/lib/jackson-core-asl-1.9.13.jar:/opt/hadoop/share/ozone/lib/jetty-io-9.3.24.v20180605.jar:/opt/hadoop/share/ozone/lib/commons-net-3.6.jar:/opt/hadoop/share/ozone/lib/jetty-http-9.3.24.v20180605.jar:/opt/hadoop/share/ozone/lib/log4j-api-2.11.0.jar:/opt/hadoop/share/ozone/lib/netty-all-4.0.52.Final.jar:/opt/hadoop/share/ozone/lib/hamcrest-all-1.3.jar:/opt/hadoop/share/ozone/lib/jetty-security-9.3.24.v20180605.jar:/opt/hadoop/share/ozone/lib/hadoop-hdfs-3.2.0.jar:/opt/hadoop/share/ozone/lib/opentracing-api-0.31.0.jar:/opt/hadoop/share/ozone/lib/hadoop-hdds-server-framework-0.5.0-SNAPSHOT.jar:/opt/hadoop/share/ozone/lib/slf4j-log4j12-1.7.25.jar:/opt/hadoop/share/ozone/lib/hadoop-hdfs-client-3.2.0.jar:/opt/hadoop/share/ozone/lib/kerby-config-1.0.1.jar:/opt/hadoop/share/ozone/lib/jaeger-client-0.33.1.jar:/opt/hadoop/share/ozone/lib/ratis-proto-0.4.0-fe2b15d-SNAPSHOT.jar:/opt/hadoop/share/ozone/lib/metrics-core-3.2.4.jar:/opt/hadoop/share/ozone/lib/kerby-pkix-1.0.1.jar:/opt/hadoop/share/ozone/lib/hadoop-ozone-objectstore-service-0.5.0-SNAPSHOT.jar:/opt/hadoop/share/ozone/lib/xz-1.0.jar:/opt/hadoop/share/ozone/lib/hadoop-hdds-config-0.5.0-SNAPSHOT.jar:/opt/hadoop/share/ozone/lib/nimbus-jose-jwt-4.41.1.jar:/opt/hadoop/share/ozone/lib/rocksdbjni-5.14.2.jar:/opt/hadoop/share/ozone/lib/activation-1.1.1.jar:/opt/hadoop/share/ozone/lib/ratis-grpc-0.4.0-fe2b15d-SNAPSHOT.jar:/opt/hadoop/share/ozone/lib/jsr311-api-1.1.1.jar:/opt/hadoop/share/ozone/lib/jackson-annotations-2.9.5.jar:/opt/hadoop/share/ozone/lib/javax.servlet-api-3.1.0.jar:/opt/hadoop/share/ozone/lib/kerb-server-1.0.1.jar:/opt/hadoop/share/ozone/lib/zookeeper-3.4.13.jar:/opt/hadoop/share/ozone/lib/avro-1.7.7.jar:/opt/hadoop/share/ozone/lib/kerb-client-1.0.1.jar:/opt/hadoop/share/ozone/lib/jackson-xc-1.9.13.jar:/opt/hadoop/share/ozone/lib/disruptor-3.4.2.jar:/opt/hadoop/share/ozone/lib/guava-11.0.2.jar:/opt/hadoop/share/ozone/lib/jetty-util-ajax-9.3.24.v20180605.jar:/opt/hadoop/share/ozone/lib/jetty-servlet-9.3.24.v20180605.jar:/opt/hadoop/share/ozone/lib/curator-framework-2.12.0.jar:/opt/hadoop/share/ozone/lib/jackson-databind-2.9.5.jar:/opt/hadoop/share/ozone/lib/hadoop-hdds-common-0.5.0-SNAPSHOT.jar:/opt/hadoop/share/ozone/lib/dnsjava-2.1.7.jar:/opt/hadoop/share/ozone/lib/commons-configuration2-2.1.1.jar:/opt/hadoop/share/ozone/lib/json-smart-2.3.jar:/opt/hadoop/share/ozone/lib/token-provider-1.0.1.jar:/opt/hadoop/share/ozone/lib/log4j-1.2.17.jar:/opt/hadoop/share/ozone/lib/commons-daemon-1.0.13.jar:/opt/hadoop/share/ozone/lib/picocli-3.5.2.jar:/opt/hadoop/share/ozone/lib/bcprov-jdk15on-1.60.jar:/opt/hadoop/share/ozone/lib/commons-lang3-3.7.jar:/opt/hadoop/share/ozone/lib/commons-compress-1.4.1.jar:/opt/hadoop/share/ozone/lib/accessors-smart-1.2.jar:/opt/hadoop/share/ozone/lib/re2j-1.1.jar:/opt/hadoop/share/ozone/lib/curator-recipes-2.12.0.jar:/opt/hadoop/share/ozone/lib/commons-math3-3.1.1.jar:/opt/hadoop/share/ozone/lib/opentracing-noop-0.31.0.jar:/opt/hadoop/share/ozone/lib/httpclient-4.5.2.jar:/opt/hadoop/share/ozone/lib/asm-5.0.4.jar:/opt/hadoop/share/ozone/lib/curator-client-2.12.0.jar:/opt/hadoop/share/ozone/lib/audience-annotations-0.5.0.jar:/opt/hadoop/share/ozone/lib/kerby-util-1.0.1.jar:/opt/hadoop/share/ozone/lib/jackson-mapper-asl-1.9.13.jar:/opt/hadoop/share/ozone/lib/jsp-api-2.1.jar:/opt/hadoop/share/ozone/lib/libthrift-0.11.0.jar:/opt/hadoop/share/ozone/lib/jsch-0.1.54.jar:/opt/hadoop/share/ozone/lib/opentracing-tracerresolver-0.1.5.jar:/opt/hadoop/share/ozone/lib/jetty-webapp-9.3.24.v20180605.jar:/opt/hadoop/share/ozone/lib/paranamer-2.3.jar:/opt/hadoop/share/ozone/lib/log4j-core-2.11.0.jar:/opt/hadoop/share/ozone/lib/commons-codec-1.11.jar:/opt/hadoop/share/ozone/lib/commons-pool2-2.6.0.jar:/opt/hadoop/share/ozone/lib/gson-2.2.4.jar:/opt/hadoop/share/ozone/lib/jcip-annotations-1.0-1.jar:/opt/hadoop/share/ozone/lib/kerb-admin-1.0.1.jar:/opt/hadoop/share/ozone/lib/jaeger-core-0.33.1.jar:/opt/hadoop/share/ozone/lib/commons-io-2.5.jar:/opt/hadoop/share/ozone/lib/okio-1.13.0.jar:/opt/hadoop/share/ozone/lib/snakeyaml-1.16.jar:/opt/hadoop/share/ozone/lib/hadoop-ozone-client-0.5.0-SNAPSHOT.jar:/opt/hadoop/share/ozone/lib/jersey-core-1.19.jar:/opt/hadoop/share/ozone/lib/ratis-common-0.4.0-fe2b15d-SNAPSHOT.jar:/opt/hadoop/share/ozone/lib/hadoop-hdds-container-service-0.5.0-SNAPSHOT.jar:/opt/hadoop/share/ozone/lib/jetty-server-9.3.24.v20180605.jar:/opt/hadoop/share/ozone/lib/commons-cli-1.2.jar:/opt/hadoop/share/ozone/lib/hadoop-hdds-docs-0.5.0-SNAPSHOT.jar:/opt/hadoop/share/ozone/lib/woodstox-core-5.0.3.jar:/opt/hadoop/share/ozone/lib/snappy-java-1.0.5.jar:/opt/hadoop/share/ozone/lib/javax.annotation-api-1.2.jar:/opt/hadoop/share/ozone/lib/kerby-asn1-1.0.1.jar:/opt/hadoop/share/ozone/lib/okhttp-3.9.0.jar:/opt/hadoop/share/ozone/lib/jetty-util-9.3.24.v20180605.jar:/opt/hadoop/share/ozone/lib/stax2-api-3.1.4.jar:/opt/hadoop/share/ozone/lib/commons-collections-3.2.2.jar:/opt/hadoop/share/ozone/lib/commons-digester-1.8.1.jar:/opt/hadoop/share/ozone/lib/jettison-1.1.jar:/opt/hadoop/share/ozone/lib/commons-text-1.4.jar:/opt/hadoop/share/ozone/lib/jersey-servlet-1.19.jar:/opt/hadoop/share/ozone/lib/jersey-json-1.19.jar:/opt/hadoop/share/ozone/lib/slf4j-api-1.7.25.jar:/opt/hadoop/share/ozone/lib/commons-logging-1.1.3.jar:/opt/hadoop/share/ozone/lib/kerb-identity-1.0.1.jar:/opt/hadoop/share/ozone/lib/hadoop-hdds-client-0.5.0-SNAPSHOT.jar:/opt/hadoop/share/ozone/lib/opentracing-util-0.31.0.jar:/opt/hadoop/share/ozone/lib/hadoop-common-3.2.0.jar:/opt/hadoop/share/ozone/lib/hadoop-auth-3.2.0.jar:/opt/hadoop/share/ozone/lib/kerb-common-1.0.1.jar:/opt/hadoop/share/ozone/lib/jaxb-core-2.3.0.1.jar:/opt/hadoop/share/ozone/lib/jersey-server-1.19.jar:/opt/hadoop/share/ozone/lib/kerb-crypto-1.0.1.jar:/opt/hadoop/share/ozone/lib/httpcore-4.4.4.jar:/opt/hadoop/share/ozone/lib/hadoop-hdds-server-scm-0.5.0-SNAPSHOT.jar:/opt/hadoop/share/ozone/web:/opt/hadoop/share/ozone/lib/hadoop-ozone-datanode-0.5.0-SNAPSHOT.jar
STARTUP_MSG: build = Unknown -r Unknown; compiled by 'elek' on
2018-11-30T12:32Z
STARTUP_MSG: java = 1.8.0_201
************************************************************/
2019-05-10 10:20:58 INFO HddsDatanodeService:51 - registered UNIX signal
handlers for [TERM, HUP, INT]
2019-05-10 10:20:59 INFO MetricsConfig:118 - Loaded properties from
hadoop-metrics2.properties
2019-05-10 10:20:59 INFO MetricsSystemImpl:374 - Scheduled Metric snapshot
period at 10 second(s).
2019-05-10 10:20:59 INFO MetricsSystemImpl:191 - HddsDatanode metrics system
started
2019-05-10 10:20:59 INFO HddsDatanodeService:184 - HddsDatanodeService
host:1f4a6bcbfdc1 ip:192.168.160.7
2019-05-10 10:21:00 INFO HddsVolume:172 - Creating Volume: /data/hdds/hdds of
storage type : DISK and capacity : 491630870528
2019-05-10 10:21:00 INFO VolumeSet:170 - Added Volume : /data/hdds/hdds to
VolumeSet
2019-05-10 10:21:00 INFO ThrottledAsyncChecker:140 - Scheduling a check for
org.apache.hadoop.ozone.container.common.volume.HddsVolume@8c3b9d
2019-05-10 10:21:00 INFO HddsVolumeChecker:203 - Scheduled health check for
volume org.apache.hadoop.ozone.container.common.volume.HddsVolume@8c3b9d
2019-05-10 10:21:03 WARN HddsServerUtil:370 - Storage directory for Ratis is
not configured. It is a good idea to map this to an SSD disk. Falling back to
ozone.metadata.dirs
May 10, 2019 10:21:05 AM
com.sun.jersey.server.impl.application.WebApplicationImpl _initiate
INFO: Initiating Jersey application, version 'Jersey: 1.19 02/11/2015 03:25 AM'
{code}
> Blockade tests can't be executed
> --------------------------------
>
> Key: HDDS-1513
> URL: https://issues.apache.org/jira/browse/HDDS-1513
> Project: Hadoop Distributed Data Store
> Issue Type: Bug
> Components: test
> Reporter: Elek, Marton
> Assignee: Elek, Marton
> Priority: Major
>
> This issue is reporeted by [~eyang] offline. I am creating this issue to
> track the progress:
> Python output:
> {code}
> python -m pytest -s blockade
> ====================================================================== test
> session starts
> =======================================================================
> platform linux2 -- Python 2.7.5 -- py-1.4.32 -- pytest-2.7.0
> rootdir: /home/eyang/test/hadoop/hadoop-ozone/dist/src/main/blockade,
> inifile:
> collected 17 items
> blockade/test_blockade_client_failure.py 2019-05-09
> 14:15:01,062|INFO|MainThread|blockade.py:33 - blockade_destroy()|Running
> blockade destroy
> Error:
> No blockade exists in this context
> 2019-05-09 14:15:01,506|INFO|MainThread|cluster_utils.py:40 -
> cluster_setup()|compose file
> :/home/eyang/test/hadoop/hadoop-ozone/dist/src/main/compose/ozoneblockade/docker-compose.yaml
> 2019-05-09 14:15:01,506|INFO|MainThread|cluster_utils.py:41 -
> cluster_setup()|number of DNs :3
> Removing network ozoneblockade_default
> WARNING: Network ozoneblockade_default not found.
> Creating network "ozoneblockade_default" with the default driver
> Creating ozoneblockade_om_1 ... done
> Creating ozoneblockade_scm_1 ... done
> Creating ozoneblockade_ozone_client_1 ... done
> Creating ozoneblockade_datanode_1 ... done
> Creating ozoneblockade_datanode_2 ... done
> Creating ozoneblockade_datanode_3 ... done
> 2019-05-09 14:15:05,705|INFO|MainThread|cluster_utils.py:47 -
> cluster_setup()|Waiting 30s for cluster start up...
> {code}
> Docker ps -a output:
> {code}
> $ docker ps -a
> CONTAINER ID IMAGE COMMAND
> CREATED STATUS PORTS NAMES
> 0b161b5de31b apache/hadoop-runner "/usr/local/bin/dumb…" 8
> seconds ago Exited (1) 4 seconds ago
> ozoneblockade_datanode_1
> 2c093a264ba0 apache/hadoop-runner "/usr/local/bin/dumb…" 8
> seconds ago Exited (1) 4 seconds ago
> ozoneblockade_datanode_3
> a8b3d280e3a7 apache/hadoop-runner "/usr/local/bin/dumb…" 8
> seconds ago Exited (1) 5 seconds ago
> ozoneblockade_datanode_2
> 14d763fa51fd apache/hadoop-runner "/usr/local/bin/dumb…" 8
> seconds ago Exited (1) 5 seconds ago
> ozoneblockade_scm_1
> e3955aa4b99c apache/hadoop-runner "/usr/local/bin/dumb…" 8
> seconds ago Exited (1) 5 seconds ago
> ozoneblockade_ozone_client_1
> ac2ab9ec2742 apache/hadoop-runner "/usr/local/bin/dumb…" 8
> seconds ago Exited (1) 6 seconds ago
> ozoneblockade_om_1```
> {code}
> Docker logs:
> {code}
> $ docker logs 0b161b5de31b
> Traceback (most recent call last):
> File "/opt/envtoconf.py", line 115, in <module>
> Simple(sys.argv[1:]).main()
> File "/opt/envtoconf.py", line 102, in main
> self.process_envs()
> File "/opt/envtoconf.py", line 71, in process_envs
> with open(self.destination_file_path(name, extension) + ".raw", "w") as
> myfile:
> IOError: [Errno 2] No such file or directory:
> '/opt/hadoop/etc/hadoop/log4j.properties.raw'```
> {code}
> We found that this test is executed from the wrong directory as
> blockade/smoketest tests should be executed from the distribution folder
> (hadoop-ozone/dist/target/ozone-0.5.0-SNAPSHOT/smoketest and
> hadoop-ozone/dist/target/ozone-0.5.0-SNAPSHOT/blockade)
> [~eyang] confirmed that it was failed from the good directories, too.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
