This is an automated email from the ASF dual-hosted git repository.
zhangduo pushed a change to branch HDFS-13572
in repository https://gitbox.apache.org/repos/asf/hadoop.git.
discard edd741d HDFS-13643. Implement basic async rpc client
add 041e7a7 HDFS-14598. Findbugs warning caused by HDFS-12487.
Contributed by He Xiaoqiao.
add 366f3de HADOOP-16390. escape javadoc in S3AUtils public methods
add 48d7f00 HDFS-14590. [SBN Read] Add the document link to the top page.
Contributed by Takanobu Asanuma.
add ab0b180 HDFS-12345 Add Dynamometer to hadoop-tools, a tool for scale
testing the HDFS NameNode with real metadata and workloads. Contributed by Erik
Krogen.
add 049bb42 HDDS-1723. Create new OzoneManagerLock class. (#1006)
add 4b50981 HDDS-1709. TestScmSafeNode is flaky. Contributed by Elek,
Marton.
add a79bdf7 HDDS-1727. Use generation of resourceName for locks in
OzoneManagerLock. (#1014)
add 062eb60 YARN-9477. Implement VE discovery using libudev. Contributed
by Peter Bacsko.
add 0a37ccf HDDS-1691 : RDBTable#isExist should use Rocksdb#keyMayExist
(#1013)
add 1ac967a YARN-6055. ContainersMonitorImpl need be adjusted when NM
resource changed. Contributed by Inigo Goiri.
add 4848280 HDDS-1638. Implement Key Write Requests to use Cache and
DoubleBuffer. (#956)
add be80334 YARN-9639. DecommissioningNodesWatcher cause memory leak.
Contributed by Bilwa S T.
add 041e0c0 HDFS-14036. RBF: Add hdfs-rbf-default.xml to
HdfsConfiguration by default. Contributed by Takanobu Asanuma.
add 4a21224 HDFS-14599. HDFS-12487 breaks test
TestDiskBalancer.testDiskBalancerWithFedClusterWithOneNameServiceEmpty.
Contributed by He Xiaoqiao.
add cbae241 YARN-9623. Auto adjust max queue length of app activities to
make sure activities on all nodes can be covered. Contributed by Tao Yang.
add 5e7caf1 YARN-9655. AllocateResponse in FederationInterceptor lost
applicationPriority. (hunshenshi via wwei) closes apache/hadoop#1023
add f09c31a Revert "YARN-9655. AllocateResponse in FederationInterceptor
lost applicationPriority. (hunshenshi via wwei) closes apache/hadoop#1023"
add 9fd3c70 HDDS-1639. Restructure documentation pages for better
understanding
add f02b0e1 YARN-9581. Add support for get multiple RM webapp URLs.
Contributed by Prabhu Joseph
add 49c5e8a HDDS-1672. Improve locking in OzoneManager. (#1016)
add 29465bf YARN-9560. Restructure DockerLinuxContainerRuntime to extend
OCIContainerRuntime. Contributed by Eric Badger, Jim Brennan, Craig
Condit
add da56899 HDDS-1733. Fix Ozone documentation (#1031)
add d203045 HDFS-14618. Incorrect synchronization of ArrayList field
(ArrayList is thread-unsafe). Contributed by Paul Ward.
add 1e727cf HDDS-1730. Implement File CreateDirectory Request to use
Cache and Do… (#1026)
add 9df6275 HDDS-1555. Disable install snapshot for
ContainerStateMachine. Contributed by Siddharth Wagle. (#846)
add 1f75660 HDDS-373. Genconf tool must generate ozone-site.xml with
sample values (#1025)
add b1dafc3 YARN-9661:Fix typo in LocalityMulticastAMRMProxyPolicy.java
and AbstractConfigurableFederationPolicy.java (#1042)
add f8d62a9 HDDS-1258. Fix error propagation for SCM protocol
add db674a0 HDDS-1685. Recon: Add support for "start" query param to
containers and containers/{id} endpoints.
add d8bac50 HDFS-14610. HashMap is not thread safe. Field storageMap is
typically synchronized by storageMap. However, in one place, field storageMap
is not protected with synchronized. (#1015)
add 2f4b37b HDDS-1667. Docker compose file may referring to incorrect
docker image name. Contributed by Eric Yang.
add 570eee3 YARN-9655. AllocateResponse in FederationInterceptor lost
applicationPriority. Contributed by hunshenshi.
new f324188 HDFS-13643. Implement basic async rpc client
This update added new revisions after undoing existing revisions.
That is to say, some revisions that were in the old version of the
branch are not in the new version. This situation occurs
when a user --force pushes a change and generates a repository
containing something like this:
* -- * -- B -- O -- O -- O (edd741d)
\
N -- N -- N refs/heads/HDFS-13572 (f324188)
You should already have received notification emails for all of the O
revisions, and so the following emails describe only the N revisions
from the common base, B.
Any revisions marked "omit" are not gone; other references still
refer to them. Any revisions marked "discard" are gone forever.
The 1 revisions listed above as "new" are entirely new to this
repository and will be described in separate emails. The revisions
listed as "add" were already present in the repository and have only
been added to this reference.
Summary of changes:
dev-support/bin/dist-layout-stitching | 1 +
.../assemblies/hadoop-dynamometer-blockgen.xml | 35 +
.../assemblies/hadoop-dynamometer-infra.xml | 35 +
.../assemblies/hadoop-dynamometer-workload.xml | 35 +
.../resources/assemblies/hadoop-dynamometer.xml | 73 ++
.../src/main/resources/assemblies/hadoop-tools.xml | 24 +-
hadoop-dist/pom.xml | 1 +
.../apache/hadoop/hdds/scm/XceiverClientRatis.java | 72 +-
.../org/apache/hadoop/hdds/scm/ScmConfigKeys.java | 7 +-
.../hadoop/hdds/scm/exceptions/SCMException.java | 6 +-
.../hadoop/hdds/scm/exceptions/package-info.java | 4 +-
...lockLocationProtocolClientSideTranslatorPB.java | 94 +-
.../org/apache/hadoop/ozone/OzoneConfigKeys.java | 6 +
.../java/org/apache/hadoop/ozone/OzoneConsts.java | 6 +
.../org/apache/hadoop/ozone/lock/LockManager.java | 5 +-
...lockLocationProtocolServerSideTranslatorPB.java | 155 ++-
.../java/org/apache/hadoop/utils/db/RDBTable.java | 6 +-
.../java/org/apache/hadoop/utils/db/Table.java | 8 +
.../org/apache/hadoop/utils/db/TypedTable.java | 5 +
.../src/main/proto/ScmBlockLocationProtocol.proto | 36 +-
.../common/src/main/resources/ozone-default.xml | 8 +
.../exceptions/TestSCMExceptionResultCodes.java | 52 +
.../org/apache/hadoop/ozone/audit/DummyAction.java | 1 -
.../org/apache/hadoop/utils/db/TestRDBStore.java | 36 +
.../server/ratis/ContainerStateMachine.java | 28 +-
.../transport/server/ratis/XceiverServerRatis.java | 51 +-
hadoop-hdds/docs/config.yaml | 26 +-
hadoop-hdds/docs/content/Concepts.md | 108 --
hadoop-hdds/docs/content/Hdds.md | 65 --
hadoop-hdds/docs/content/OzoneManager.md | 77 --
.../docs/content/OzoneSecurityArchitecture.md | 110 --
hadoop-hdds/docs/content/RealCluster.md | 74 --
hadoop-hdds/docs/content/SetupSecureOzone.md | 98 --
hadoop-hdds/docs/content/_index.md | 28 +-
hadoop-hdds/docs/content/beyond/Containers.md | 218 ++++
.../{Dozone.md => beyond/DockerCheatSheet.md} | 46 +-
.../docs/content/{ => beyond}/RunningWithHDFS.md | 17 +-
.../content/{CommandShell.md => beyond/Tools.md} | 62 +-
.../docs/content/{genconf.md => beyond/_index.md} | 20 +-
.../docs/content/concept/ContainerMetadata.png | Bin 0 -> 98493 bytes
hadoop-hdds/docs/content/concept/Datanodes.md | 75 ++
.../docs/content/concept/FunctionalOzone.png | Bin 0 -> 55334 bytes
hadoop-hdds/docs/content/concept/Hdds.md | 52 +
hadoop-hdds/docs/content/concept/Overview.md | 81 ++
hadoop-hdds/docs/content/concept/OzoneBlock.png | Bin 0 -> 4650 bytes
hadoop-hdds/docs/content/concept/OzoneManager.md | 87 ++
.../docs/content/{genconf.md => concept/_index.md} | 21 +-
.../docs/content/concept/ozoneBlockDiagram.png | Bin 0 -> 45218 bytes
.../docs/content/{ => interface}/JavaApi.md | 12 +-
.../docs/content/{ => interface}/OzoneFS.md | 30 +-
hadoop-hdds/docs/content/{ => interface}/S3.md | 9 +-
.../content/{genconf.md => interface/_index.md} | 13 +-
.../docs/content/{ => recipe}/Prometheus.md | 11 +-
.../docs/content/{ => recipe}/SparkOzoneFSK8S.md | 12 +-
.../docs/content/{genconf.md => recipe/_index.md} | 16 +-
.../recipe}/prometheus-key-allocate.png | Bin
.../docs/{static => content/recipe}/prometheus.png | Bin
.../docs/content/security/SecuityWithRanger.md | 43 +
hadoop-hdds/docs/content/security/SecureOzone.md | 177 +++
.../docs/content/security/SecuringDatanodes.md | 70 ++
hadoop-hdds/docs/content/security/SecuringS3.md | 61 ++
hadoop-hdds/docs/content/security/SecuringTDE.md | 66 ++
hadoop-hdds/docs/content/security/SecurityAcls.md | 85 ++
hadoop-hdds/docs/content/security/_index.md | 36 +
.../docs/content/{ => shell}/BucketCommands.md | 6 +-
hadoop-hdds/docs/content/shell/Format.md | 69 ++
.../docs/content/{ => shell}/KeyCommands.md | 11 +-
.../docs/content/{ => shell}/VolumeCommands.md | 6 +-
.../docs/content/{genconf.md => shell/_index.md} | 12 +-
.../{BuildingSources.md => start/FromSource.md} | 27 +-
hadoop-hdds/docs/content/start/Kubernetes.md | 52 +
hadoop-hdds/docs/content/start/Minikube.md | 69 ++
.../docs/content/{Settings.md => start/OnPrem.md} | 73 +-
.../docs/content/{ => start}/RunningViaDocker.md | 29 +-
.../docs/content/start/StartFromDockerHub.md | 111 ++
hadoop-hdds/docs/content/start/_index.md | 88 ++
hadoop-hdds/docs/content/start/docker.png | Bin 0 -> 7002 bytes
hadoop-hdds/docs/content/start/hadoop.png | Bin 0 -> 4923 bytes
hadoop-hdds/docs/content/start/k8s.png | Bin 0 -> 6270 bytes
hadoop-hdds/docs/content/start/minikube.png | Bin 0 -> 5764 bytes
.../docs/content/{ => tools}/AuditParser.md | 4 +-
hadoop-hdds/docs/content/{ => tools}/Freon.md | 4 +-
.../docs/content/{genconf.md => tools/Genconf.md} | 4 +-
hadoop-hdds/docs/content/{ => tools}/SCMCLI.md | 4 +-
hadoop-hdds/docs/content/tools/TestTools.md | 228 ++++
.../docs/content/{genconf.md => tools/Tools.md} | 13 +-
.../{ozone-logo.png => ozone-logo-small.png} | Bin
hadoop-hdds/docs/static/ozone-usage.png | Bin 0 -> 108376 bytes
.../themes/ozonedoc/layouts/_default/section.html | 60 ++
.../themes/ozonedoc/layouts/_default/single.html | 47 +-
.../docs/themes/ozonedoc/layouts/index.html | 2 +-
.../themes/ozonedoc/layouts/partials/header.html | 4 +-
.../themes/ozonedoc/layouts/partials/sidebar.html | 13 +-
.../ozonedoc/layouts/shortcodes/buttonlink.html} | 16 +-
.../{_default/single.html => shortcodes/card.html} | 36 +-
.../ozonedoc/layouts/shortcodes/jumbotron.html} | 19 +-
.../ozonedoc/layouts/shortcodes/requirements.html} | 18 +-
.../docs/themes/ozonedoc/static/css/ozonedoc.css | 17 +
hadoop-hdds/pom.xml | 2 +-
.../org/apache/hadoop/hdfs/HdfsConfiguration.java | 1 +
.../federation/router/RouterClientProtocol.java | 2 +-
.../fs/contract/router/RouterHDFSContract.java | 1 -
.../contract/router/web/RouterWebHDFSContract.java | 1 -
.../server/federation/MiniRouterDFSCluster.java | 11 +-
.../server/blockmanagement/DatanodeDescriptor.java | 7 +-
.../PendingReconstructionBlocks.java | 4 +-
.../hadoop/hdfs/server/datanode/DiskBalancer.java | 31 +-
.../hdfs/server/diskbalancer/TestDiskBalancer.java | 11 +-
.../org/apache/hadoop/ozone/audit/OMAction.java | 1 -
.../apache/hadoop/ozone/om/OMMetadataManager.java | 12 +
.../apache/hadoop/ozone/om/OzoneManagerLock.java | 269 -----
.../hadoop/ozone/om/S3SecretManagerImpl.java | 9 +-
.../apache/hadoop/ozone/om/helpers/OmKeyInfo.java | 17 +-
.../hadoop/ozone/om/helpers/OmKeyLocationInfo.java | 25 +
.../hadoop/ozone/om/lock/OzoneManagerLock.java | 378 +++++++
.../hadoop/ozone/om/lock/OzoneManagerLockUtil.java | 75 ++
.../apache/hadoop/ozone/om/lock}/package-info.java | 7 +-
...OzoneManagerProtocolClientSideTranslatorPB.java | 13 +-
.../src/main/proto/OzoneManagerProtocol.proto | 7 +
.../hadoop/ozone/om/lock/TestOzoneManagerLock.java | 348 ++++++
.../apache/hadoop/ozone/om/lock}/package-info.java | 12 +-
hadoop-ozone/dist/pom.xml | 4 -
.../src/test/compose/docker-compose.yaml | 8 +-
.../hadoop/ozone/MiniOzoneHAClusterImpl.java | 2 +-
.../apache/hadoop/ozone/om/TestOzoneManager.java | 63 ++
.../apache/hadoop/ozone/om/TestOzoneManagerHA.java | 4 +-
.../apache/hadoop/ozone/om/TestScmSafeMode.java | 18 +-
.../apache/hadoop/ozone/om/BucketManagerImpl.java | 47 +-
.../org/apache/hadoop/ozone/om/KeyManagerImpl.java | 112 +-
.../hadoop/ozone/om/OmMetadataManagerImpl.java | 71 +-
.../org/apache/hadoop/ozone/om/OzoneManager.java | 98 +-
.../apache/hadoop/ozone/om/PrefixManagerImpl.java | 21 +-
.../apache/hadoop/ozone/om/S3BucketManager.java | 6 +
.../hadoop/ozone/om/S3BucketManagerImpl.java | 21 +-
.../java/org/apache/hadoop/ozone/om/ScmClient.java | 6 +-
.../apache/hadoop/ozone/om/VolumeManagerImpl.java | 88 +-
.../ozone/om/ratis/OzoneManagerDoubleBuffer.java | 7 +
.../ozone/om/ratis/OzoneManagerRatisClient.java | 59 +-
.../ozone/om/ratis/OzoneManagerRatisServer.java | 8 +-
.../ozone/om/ratis/OzoneManagerStateMachine.java | 114 --
.../om/ratis/utils/OzoneManagerRatisUtils.java | 18 +
.../hadoop/ozone/om/request/OMClientRequest.java | 2 +-
.../hadoop/ozone/om/request/RequestAuditor.java | 37 +-
.../om/request/bucket/OMBucketCreateRequest.java | 17 +-
.../om/request/bucket/OMBucketDeleteRequest.java | 8 +-
.../request/bucket/OMBucketSetPropertyRequest.java | 8 +-
.../om/request/file/OMDirectoryCreateRequest.java | 282 +++++
.../ozone/om/request/file}/package-info.java | 14 +-
.../om/request/key/OMAllocateBlockRequest.java | 248 +++++
.../ozone/om/request/key/OMKeyCommitRequest.java | 192 ++++
.../ozone/om/request/key/OMKeyCreateRequest.java | 378 +++++++
.../ozone/om/request/key/OMKeyDeleteRequest.java | 166 +++
.../ozone/om/request/key/OMKeyRenameRequest.java | 205 ++++
.../hadoop/ozone/om/request/key/OMKeyRequest.java | 205 ++++
.../hadoop/ozone/om/request/key}/package-info.java | 14 +-
.../om/request/volume/OMVolumeCreateRequest.java | 18 +-
.../om/request/volume/OMVolumeDeleteRequest.java | 44 +-
.../om/request/volume/OMVolumeSetOwnerRequest.java | 29 +-
.../om/request/volume/OMVolumeSetQuotaRequest.java | 6 +-
.../response/file/OMDirectoryCreateResponse.java | 67 ++
.../ozone/om/response/file}/package-info.java | 14 +-
.../om/response/key/OMAllocateBlockResponse.java | 59 +
.../ozone/om/response/key/OMKeyCommitResponse.java | 66 ++
.../ozone/om/response/key/OMKeyCreateResponse.java | 61 ++
.../ozone/om/response/key/OMKeyDeleteResponse.java | 78 ++
.../ozone/om/response/key/OMKeyRenameResponse.java | 67 ++
.../ozone/om/response/key}/package-info.java | 14 +-
.../OzoneManagerHARequestHandlerImpl.java | 6 +
...OzoneManagerProtocolServerSideTranslatorPB.java | 60 +-
.../hadoop/ozone/om/TestOzoneManagerLock.java | 193 ----
.../om/ratis/TestOzoneManagerStateMachine.java | 292 -----
.../ozone/om/request/TestOMRequestUtils.java | 69 ++
.../request/bucket/TestOMBucketCreateRequest.java | 1 +
.../request/file/TestOMDirectoryCreateRequest.java | 327 ++++++
.../ozone/om/request/file}/package-info.java | 14 +-
.../om/request/key/TestOMAllocateBlockRequest.java | 241 +++++
.../om/request/key/TestOMKeyCommitRequest.java | 300 ++++++
.../om/request/key/TestOMKeyCreateRequest.java | 325 ++++++
.../om/request/key/TestOMKeyDeleteRequest.java | 166 +++
.../om/request/key/TestOMKeyRenameRequest.java | 225 ++++
.../ozone/om/request/key/TestOMKeyRequest.java | 151 +++
.../hadoop/ozone/om/request/key}/package-info.java | 14 +-
.../file/TestOMDirectoryCreateResponse.java | 123 +++
.../ozone/om/response/file}/package-info.java | 14 +-
.../response/key/TestOMAllocateBlockResponse.java | 93 ++
.../om/response/key/TestOMKeyCommitResponse.java | 108 ++
.../om/response/key/TestOMKeyCreateResponse.java | 92 ++
.../om/response/key/TestOMKeyDeleteResponse.java | 163 +++
.../om/response/key/TestOMKeyRenameResponse.java | 148 +++
.../ozone/om/response/key/TestOMKeyResponse.java | 75 ++
.../ozone/om/response/key}/package-info.java | 14 +-
.../apache/hadoop/ozone/recon/ReconConstants.java | 4 +
.../ozone/recon/api/ContainerKeyService.java | 34 +-
.../recon/spi/ContainerDBServiceProvider.java | 23 +-
.../spi/impl/ContainerDBServiceProviderImpl.java | 90 +-
.../ozone/recon/api/TestContainerKeyService.java | 119 +-
.../impl/TestContainerDBServiceProviderImpl.java | 108 ++
hadoop-ozone/pom.xml | 9 +-
.../GenerateOzoneRequiredConfigurations.java | 16 +-
.../TestGenerateOzoneRequiredConfigurations.java | 16 +
hadoop-project/pom.xml | 8 +-
hadoop-project/src/site/site.xml | 1 +
.../java/org/apache/hadoop/fs/s3a/S3AUtils.java | 4 +-
.../hadoop-dynamometer-blockgen/pom.xml | 131 +++
.../src/main/bash/generate-block-lists.sh | 38 +
.../dynamometer/blockgenerator/BlockInfo.java | 136 +++
.../blockgenerator/GenerateBlockImagesDriver.java | 140 +++
.../GenerateDNBlockInfosReducer.java | 99 ++
.../dynamometer/blockgenerator/XMLParser.java | 154 +++
.../blockgenerator/XMLParserMapper.java | 81 ++
.../dynamometer/blockgenerator}/package-info.java | 13 +-
.../dynamometer/blockgenerator/TestBlockGen.java | 89 ++
.../dynamometer/blockgenerator/TestXMLParser.java | 70 ++
.../test/resources/fsimage_0000000000000061740.xml | 553 ++++++++++
.../hadoop-dynamometer-dist/pom.xml | 128 +++
.../hadoop-dynamometer-infra/pom.xml | 201 ++++
.../src/main/bash/create-slim-hadoop-tar.sh | 53 +
.../src/main/bash/parse-metrics.sh | 84 ++
.../src/main/bash/start-dynamometer-cluster.sh | 41 +
.../src/main/bash/upload-fsimage.sh | 84 ++
.../apache/hadoop/tools/dynamometer/AMOptions.java | 316 ++++++
.../dynamometer/AllowAllImpersonationProvider.java | 24 +-
.../tools/dynamometer/ApplicationMaster.java | 885 +++++++++++++++
.../BlockPlacementPolicyAlwaysSatisfied.java | 53 +
.../apache/hadoop/tools/dynamometer/Client.java | 1132 ++++++++++++++++++++
.../hadoop/tools/dynamometer/DynoConstants.java | 130 +++
.../hadoop/tools/dynamometer/DynoInfraUtils.java | 584 ++++++++++
.../hadoop/tools/dynamometer/DynoResource.java | 72 ++
.../tools/dynamometer/SimulatedDataNodes.java | 182 ++++
.../hadoop/tools/dynamometer}/package-info.java | 16 +-
.../src/main/resources/start-component.sh | 344 ++++++
.../tools/dynamometer/TestDynamometerInfra.java | 542 ++++++++++
.../tools/dynamometer/TestDynoInfraUtils.java | 66 ++
.../src/test/resources/blocks/dn0-a-0-r-00000 | 34 +
.../src/test/resources/blocks/dn1-a-0-r-00001 | 33 +
.../src/test/resources/blocks/dn2-a-0-r-00002 | 33 +
.../test/resources/conf/etc/hadoop/core-site.xml | 20 +
.../test/resources/conf/etc/hadoop/hdfs-site.xml | 20 +
.../resources/conf/etc/hadoop/log4j.properties | 40 +-
.../src/test/resources/hadoop_3_1/VERSION | 7 +
.../hadoop_3_1/fsimage_0000000000000061740 | Bin 0 -> 13795 bytes
.../hadoop_3_1/fsimage_0000000000000061740.md5 | 1 +
.../src/test/resources/yarn-site.xml | 19 +
.../hadoop-dynamometer-workload/pom.xml | 146 +++
.../src/main/bash/parse-start-timestamp.sh | 52 +
.../src/main/bash/start-workload.sh | 42 +
.../workloadgenerator/CreateFileMapper.java | 146 +++
.../workloadgenerator/VirtualInputFormat.java | 57 +
.../workloadgenerator/VirtualInputSplit.java | 37 +-
.../workloadgenerator/VirtualRecordReader.java | 78 ++
.../workloadgenerator/WorkloadDriver.java | 208 ++++
.../workloadgenerator/WorkloadMapper.java | 59 +
.../audit/AuditCommandParser.java | 57 +
.../audit/AuditLogDirectParser.java | 145 +++
.../audit/AuditLogHiveTableParser.java | 70 ++
.../audit/AuditReplayCommand.java | 163 +++
.../workloadgenerator/audit/AuditReplayMapper.java | 290 +++++
.../workloadgenerator/audit/AuditReplayThread.java | 310 ++++++
.../audit/NoSplitTextInputFormat.java | 47 +
.../workloadgenerator/audit}/package-info.java | 14 +-
.../workloadgenerator}/package-info.java | 15 +-
.../workloadgenerator/TestWorkloadGenerator.java | 136 +++
.../audit/TestAuditLogDirectParser.java | 143 +++
.../src/test/resources/audit_trace_direct/audit0 | 6 +
.../src/test/resources/audit_trace_hive/audit0 | 6 +
hadoop-tools/{ => hadoop-dynamometer}/pom.xml | 33 +-
hadoop-tools/pom.xml | 1 +
.../hadoop-yarn/dev-support/findbugs-exclude.xml | 6 +
.../apache/hadoop/yarn/conf/YarnConfiguration.java | 2 +-
.../hadoop/yarn/webapp/util/WebAppUtils.java | 12 +-
.../src/main/resources/yarn-default.xml | 2 +-
.../hadoop-yarn/hadoop-yarn-csi/pom.xml | 2 -
.../AbstractConfigurableFederationPolicy.java | 2 +-
.../LocalityMulticastAMRMProxyPolicy.java | 6 +-
.../hadoop-yarn-server-nodemanager/pom.xml | 4 +
.../server/nodemanager/LinuxContainerExecutor.java | 5 +-
.../server/nodemanager/NodeStatusUpdaterImpl.java | 5 +
.../yarn/server/nodemanager/ResourceView.java | 8 +
.../amrmproxy/FederationInterceptor.java | 5 +
.../launcher/ContainerCleanup.java | 4 +-
.../resources/gpu/GpuResourceHandlerImpl.java | 4 +-
.../linux/runtime/DockerLinuxContainerRuntime.java | 351 +-----
.../linux/runtime/OCIContainerRuntime.java | 374 +++++++
.../monitor/ContainersMonitor.java | 6 +
.../monitor/ContainersMonitorImpl.java | 49 +-
.../resourceplugin/com/nec/NECVEPlugin.java | 56 +-
.../resourceplugin/com/nec/UdevUtil.java | 100 ++
.../resourceplugin/com/nec/VEDeviceDiscoverer.java | 143 +++
.../deviceframework/DeviceResourceHandlerImpl.java | 4 +-
.../server/nodemanager/TestNodeStatusUpdater.java | 103 ++
.../amrmproxy/TestFederationInterceptor.java | 1 +
.../linux/runtime/TestDockerContainerRuntime.java | 41 +-
.../resourceplugin/com/nec/TestNECVEPlugin.java | 58 +-
.../com/nec/TestVEDeviceDiscoverer.java | 283 +++++
.../DecommissioningNodesWatcher.java | 5 +
.../resourcemanager/ResourceTrackerService.java | 1 +
.../scheduler/activities/ActivitiesManager.java | 52 +-
.../scheduler/capacity/CapacityScheduler.java | 8 +
.../activities/TestActivitiesManager.java | 63 ++
299 files changed, 19508 insertions(+), 2868 deletions(-)
create mode 100644
hadoop-assemblies/src/main/resources/assemblies/hadoop-dynamometer-blockgen.xml
create mode 100644
hadoop-assemblies/src/main/resources/assemblies/hadoop-dynamometer-infra.xml
create mode 100644
hadoop-assemblies/src/main/resources/assemblies/hadoop-dynamometer-workload.xml
create mode 100644
hadoop-assemblies/src/main/resources/assemblies/hadoop-dynamometer.xml
create mode 100644
hadoop-hdds/common/src/test/java/org/apache/hadoop/hdds/scm/exceptions/TestSCMExceptionResultCodes.java
delete mode 100644 hadoop-hdds/docs/content/Concepts.md
delete mode 100644 hadoop-hdds/docs/content/Hdds.md
delete mode 100644 hadoop-hdds/docs/content/OzoneManager.md
delete mode 100644 hadoop-hdds/docs/content/OzoneSecurityArchitecture.md
delete mode 100644 hadoop-hdds/docs/content/RealCluster.md
delete mode 100644 hadoop-hdds/docs/content/SetupSecureOzone.md
create mode 100644 hadoop-hdds/docs/content/beyond/Containers.md
rename hadoop-hdds/docs/content/{Dozone.md => beyond/DockerCheatSheet.md} (60%)
rename hadoop-hdds/docs/content/{ => beyond}/RunningWithHDFS.md (83%)
rename hadoop-hdds/docs/content/{CommandShell.md => beyond/Tools.md} (55%)
copy hadoop-hdds/docs/content/{genconf.md => beyond/_index.md} (69%)
create mode 100644 hadoop-hdds/docs/content/concept/ContainerMetadata.png
create mode 100644 hadoop-hdds/docs/content/concept/Datanodes.md
create mode 100644 hadoop-hdds/docs/content/concept/FunctionalOzone.png
create mode 100644 hadoop-hdds/docs/content/concept/Hdds.md
create mode 100644 hadoop-hdds/docs/content/concept/Overview.md
create mode 100644 hadoop-hdds/docs/content/concept/OzoneBlock.png
create mode 100644 hadoop-hdds/docs/content/concept/OzoneManager.md
copy hadoop-hdds/docs/content/{genconf.md => concept/_index.md} (67%)
create mode 100644 hadoop-hdds/docs/content/concept/ozoneBlockDiagram.png
rename hadoop-hdds/docs/content/{ => interface}/JavaApi.md (95%)
rename hadoop-hdds/docs/content/{ => interface}/OzoneFS.md (90%)
rename hadoop-hdds/docs/content/{ => interface}/S3.md (95%)
copy hadoop-hdds/docs/content/{genconf.md => interface/_index.md} (77%)
rename hadoop-hdds/docs/content/{ => recipe}/Prometheus.md (91%)
rename hadoop-hdds/docs/content/{ => recipe}/SparkOzoneFSK8S.md (98%)
copy hadoop-hdds/docs/content/{genconf.md => recipe/_index.md} (76%)
rename hadoop-hdds/docs/{static => content/recipe}/prometheus-key-allocate.png
(100%)
rename hadoop-hdds/docs/{static => content/recipe}/prometheus.png (100%)
create mode 100644 hadoop-hdds/docs/content/security/SecuityWithRanger.md
create mode 100644 hadoop-hdds/docs/content/security/SecureOzone.md
create mode 100644 hadoop-hdds/docs/content/security/SecuringDatanodes.md
create mode 100644 hadoop-hdds/docs/content/security/SecuringS3.md
create mode 100644 hadoop-hdds/docs/content/security/SecuringTDE.md
create mode 100644 hadoop-hdds/docs/content/security/SecurityAcls.md
create mode 100644 hadoop-hdds/docs/content/security/_index.md
rename hadoop-hdds/docs/content/{ => shell}/BucketCommands.md (98%)
create mode 100644 hadoop-hdds/docs/content/shell/Format.md
rename hadoop-hdds/docs/content/{ => shell}/KeyCommands.md (98%)
rename hadoop-hdds/docs/content/{ => shell}/VolumeCommands.md (98%)
copy hadoop-hdds/docs/content/{genconf.md => shell/_index.md} (77%)
rename hadoop-hdds/docs/content/{BuildingSources.md => start/FromSource.md}
(81%)
create mode 100644 hadoop-hdds/docs/content/start/Kubernetes.md
create mode 100644 hadoop-hdds/docs/content/start/Minikube.md
rename hadoop-hdds/docs/content/{Settings.md => start/OnPrem.md} (73%)
rename hadoop-hdds/docs/content/{ => start}/RunningViaDocker.md (76%)
create mode 100644 hadoop-hdds/docs/content/start/StartFromDockerHub.md
create mode 100644 hadoop-hdds/docs/content/start/_index.md
create mode 100644 hadoop-hdds/docs/content/start/docker.png
create mode 100644 hadoop-hdds/docs/content/start/hadoop.png
create mode 100644 hadoop-hdds/docs/content/start/k8s.png
create mode 100644 hadoop-hdds/docs/content/start/minikube.png
rename hadoop-hdds/docs/content/{ => tools}/AuditParser.md (98%)
rename hadoop-hdds/docs/content/{ => tools}/Freon.md (98%)
copy hadoop-hdds/docs/content/{genconf.md => tools/Genconf.md} (96%)
rename hadoop-hdds/docs/content/{ => tools}/SCMCLI.md (97%)
create mode 100644 hadoop-hdds/docs/content/tools/TestTools.md
copy hadoop-hdds/docs/content/{genconf.md => tools/Tools.md} (75%)
rename hadoop-hdds/docs/static/{ozone-logo.png => ozone-logo-small.png} (100%)
create mode 100644 hadoop-hdds/docs/static/ozone-usage.png
create mode 100644
hadoop-hdds/docs/themes/ozonedoc/layouts/_default/section.html
copy hadoop-hdds/docs/{content/genconf.md =>
themes/ozonedoc/layouts/shortcodes/buttonlink.html} (75%)
copy hadoop-hdds/docs/themes/ozonedoc/layouts/{_default/single.html =>
shortcodes/card.html} (55%)
copy hadoop-hdds/docs/{content/genconf.md =>
themes/ozonedoc/layouts/shortcodes/jumbotron.html} (75%)
rename hadoop-hdds/docs/{content/genconf.md =>
themes/ozonedoc/layouts/shortcodes/requirements.html} (75%)
delete mode 100644
hadoop-ozone/common/src/main/java/org/apache/hadoop/ozone/om/OzoneManagerLock.java
create mode 100644
hadoop-ozone/common/src/main/java/org/apache/hadoop/ozone/om/lock/OzoneManagerLock.java
create mode 100644
hadoop-ozone/common/src/main/java/org/apache/hadoop/ozone/om/lock/OzoneManagerLockUtil.java
copy {hadoop-hdds/common/src/main/java/org/apache/hadoop/hdds/scm/exceptions
=>
hadoop-ozone/common/src/main/java/org/apache/hadoop/ozone/om/lock}/package-info.java
(89%)
create mode 100644
hadoop-ozone/common/src/test/java/org/apache/hadoop/ozone/om/lock/TestOzoneManagerLock.java
copy {hadoop-hdds/common/src/main/java/org/apache/hadoop/hdds/scm/exceptions
=>
hadoop-ozone/common/src/test/java/org/apache/hadoop/ozone/om/lock}/package-info.java
(83%)
create mode 100644
hadoop-ozone/ozone-manager/src/main/java/org/apache/hadoop/ozone/om/request/file/OMDirectoryCreateRequest.java
copy {hadoop-hdds/common/src/main/java/org/apache/hadoop/hdds/scm/exceptions
=>
hadoop-ozone/ozone-manager/src/main/java/org/apache/hadoop/ozone/om/request/file}/package-info.java
(75%)
create mode 100644
hadoop-ozone/ozone-manager/src/main/java/org/apache/hadoop/ozone/om/request/key/OMAllocateBlockRequest.java
create mode 100644
hadoop-ozone/ozone-manager/src/main/java/org/apache/hadoop/ozone/om/request/key/OMKeyCommitRequest.java
create mode 100644
hadoop-ozone/ozone-manager/src/main/java/org/apache/hadoop/ozone/om/request/key/OMKeyCreateRequest.java
create mode 100644
hadoop-ozone/ozone-manager/src/main/java/org/apache/hadoop/ozone/om/request/key/OMKeyDeleteRequest.java
create mode 100644
hadoop-ozone/ozone-manager/src/main/java/org/apache/hadoop/ozone/om/request/key/OMKeyRenameRequest.java
create mode 100644
hadoop-ozone/ozone-manager/src/main/java/org/apache/hadoop/ozone/om/request/key/OMKeyRequest.java
copy {hadoop-hdds/common/src/main/java/org/apache/hadoop/hdds/scm/exceptions
=>
hadoop-ozone/ozone-manager/src/main/java/org/apache/hadoop/ozone/om/request/key}/package-info.java
(75%)
create mode 100644
hadoop-ozone/ozone-manager/src/main/java/org/apache/hadoop/ozone/om/response/file/OMDirectoryCreateResponse.java
copy {hadoop-hdds/common/src/main/java/org/apache/hadoop/hdds/scm/exceptions
=>
hadoop-ozone/ozone-manager/src/main/java/org/apache/hadoop/ozone/om/response/file}/package-info.java
(75%)
create mode 100644
hadoop-ozone/ozone-manager/src/main/java/org/apache/hadoop/ozone/om/response/key/OMAllocateBlockResponse.java
create mode 100644
hadoop-ozone/ozone-manager/src/main/java/org/apache/hadoop/ozone/om/response/key/OMKeyCommitResponse.java
create mode 100644
hadoop-ozone/ozone-manager/src/main/java/org/apache/hadoop/ozone/om/response/key/OMKeyCreateResponse.java
create mode 100644
hadoop-ozone/ozone-manager/src/main/java/org/apache/hadoop/ozone/om/response/key/OMKeyDeleteResponse.java
create mode 100644
hadoop-ozone/ozone-manager/src/main/java/org/apache/hadoop/ozone/om/response/key/OMKeyRenameResponse.java
copy {hadoop-hdds/common/src/main/java/org/apache/hadoop/hdds/scm/exceptions
=>
hadoop-ozone/ozone-manager/src/main/java/org/apache/hadoop/ozone/om/response/key}/package-info.java
(75%)
delete mode 100644
hadoop-ozone/ozone-manager/src/test/java/org/apache/hadoop/ozone/om/TestOzoneManagerLock.java
delete mode 100644
hadoop-ozone/ozone-manager/src/test/java/org/apache/hadoop/ozone/om/ratis/TestOzoneManagerStateMachine.java
create mode 100644
hadoop-ozone/ozone-manager/src/test/java/org/apache/hadoop/ozone/om/request/file/TestOMDirectoryCreateRequest.java
copy {hadoop-hdds/common/src/main/java/org/apache/hadoop/hdds/scm/exceptions
=>
hadoop-ozone/ozone-manager/src/test/java/org/apache/hadoop/ozone/om/request/file}/package-info.java
(75%)
create mode 100644
hadoop-ozone/ozone-manager/src/test/java/org/apache/hadoop/ozone/om/request/key/TestOMAllocateBlockRequest.java
create mode 100644
hadoop-ozone/ozone-manager/src/test/java/org/apache/hadoop/ozone/om/request/key/TestOMKeyCommitRequest.java
create mode 100644
hadoop-ozone/ozone-manager/src/test/java/org/apache/hadoop/ozone/om/request/key/TestOMKeyCreateRequest.java
create mode 100644
hadoop-ozone/ozone-manager/src/test/java/org/apache/hadoop/ozone/om/request/key/TestOMKeyDeleteRequest.java
create mode 100644
hadoop-ozone/ozone-manager/src/test/java/org/apache/hadoop/ozone/om/request/key/TestOMKeyRenameRequest.java
create mode 100644
hadoop-ozone/ozone-manager/src/test/java/org/apache/hadoop/ozone/om/request/key/TestOMKeyRequest.java
copy {hadoop-hdds/common/src/main/java/org/apache/hadoop/hdds/scm/exceptions
=>
hadoop-ozone/ozone-manager/src/test/java/org/apache/hadoop/ozone/om/request/key}/package-info.java
(75%)
create mode 100644
hadoop-ozone/ozone-manager/src/test/java/org/apache/hadoop/ozone/om/response/file/TestOMDirectoryCreateResponse.java
copy {hadoop-hdds/common/src/main/java/org/apache/hadoop/hdds/scm/exceptions
=>
hadoop-ozone/ozone-manager/src/test/java/org/apache/hadoop/ozone/om/response/file}/package-info.java
(75%)
create mode 100644
hadoop-ozone/ozone-manager/src/test/java/org/apache/hadoop/ozone/om/response/key/TestOMAllocateBlockResponse.java
create mode 100644
hadoop-ozone/ozone-manager/src/test/java/org/apache/hadoop/ozone/om/response/key/TestOMKeyCommitResponse.java
create mode 100644
hadoop-ozone/ozone-manager/src/test/java/org/apache/hadoop/ozone/om/response/key/TestOMKeyCreateResponse.java
create mode 100644
hadoop-ozone/ozone-manager/src/test/java/org/apache/hadoop/ozone/om/response/key/TestOMKeyDeleteResponse.java
create mode 100644
hadoop-ozone/ozone-manager/src/test/java/org/apache/hadoop/ozone/om/response/key/TestOMKeyRenameResponse.java
create mode 100644
hadoop-ozone/ozone-manager/src/test/java/org/apache/hadoop/ozone/om/response/key/TestOMKeyResponse.java
copy {hadoop-hdds/common/src/main/java/org/apache/hadoop/hdds/scm/exceptions
=>
hadoop-ozone/ozone-manager/src/test/java/org/apache/hadoop/ozone/om/response/key}/package-info.java
(75%)
create mode 100644
hadoop-tools/hadoop-dynamometer/hadoop-dynamometer-blockgen/pom.xml
create mode 100755
hadoop-tools/hadoop-dynamometer/hadoop-dynamometer-blockgen/src/main/bash/generate-block-lists.sh
create mode 100644
hadoop-tools/hadoop-dynamometer/hadoop-dynamometer-blockgen/src/main/java/org/apache/hadoop/tools/dynamometer/blockgenerator/BlockInfo.java
create mode 100644
hadoop-tools/hadoop-dynamometer/hadoop-dynamometer-blockgen/src/main/java/org/apache/hadoop/tools/dynamometer/blockgenerator/GenerateBlockImagesDriver.java
create mode 100644
hadoop-tools/hadoop-dynamometer/hadoop-dynamometer-blockgen/src/main/java/org/apache/hadoop/tools/dynamometer/blockgenerator/GenerateDNBlockInfosReducer.java
create mode 100644
hadoop-tools/hadoop-dynamometer/hadoop-dynamometer-blockgen/src/main/java/org/apache/hadoop/tools/dynamometer/blockgenerator/XMLParser.java
create mode 100644
hadoop-tools/hadoop-dynamometer/hadoop-dynamometer-blockgen/src/main/java/org/apache/hadoop/tools/dynamometer/blockgenerator/XMLParserMapper.java
copy {hadoop-hdds/common/src/main/java/org/apache/hadoop/hdds/scm/exceptions
=>
hadoop-tools/hadoop-dynamometer/hadoop-dynamometer-blockgen/src/main/java/org/apache/hadoop/tools/dynamometer/blockgenerator}/package-info.java
(72%)
create mode 100644
hadoop-tools/hadoop-dynamometer/hadoop-dynamometer-blockgen/src/test/java/org/apache/hadoop/tools/dynamometer/blockgenerator/TestBlockGen.java
create mode 100644
hadoop-tools/hadoop-dynamometer/hadoop-dynamometer-blockgen/src/test/java/org/apache/hadoop/tools/dynamometer/blockgenerator/TestXMLParser.java
create mode 100644
hadoop-tools/hadoop-dynamometer/hadoop-dynamometer-blockgen/src/test/resources/fsimage_0000000000000061740.xml
create mode 100644
hadoop-tools/hadoop-dynamometer/hadoop-dynamometer-dist/pom.xml
create mode 100644
hadoop-tools/hadoop-dynamometer/hadoop-dynamometer-infra/pom.xml
create mode 100755
hadoop-tools/hadoop-dynamometer/hadoop-dynamometer-infra/src/main/bash/create-slim-hadoop-tar.sh
create mode 100755
hadoop-tools/hadoop-dynamometer/hadoop-dynamometer-infra/src/main/bash/parse-metrics.sh
create mode 100755
hadoop-tools/hadoop-dynamometer/hadoop-dynamometer-infra/src/main/bash/start-dynamometer-cluster.sh
create mode 100755
hadoop-tools/hadoop-dynamometer/hadoop-dynamometer-infra/src/main/bash/upload-fsimage.sh
create mode 100644
hadoop-tools/hadoop-dynamometer/hadoop-dynamometer-infra/src/main/java/org/apache/hadoop/tools/dynamometer/AMOptions.java
copy
hadoop-hdds/common/src/main/java/org/apache/hadoop/hdds/scm/exceptions/package-info.java
=>
hadoop-tools/hadoop-dynamometer/hadoop-dynamometer-infra/src/main/java/org/apache/hadoop/tools/dynamometer/AllowAllImpersonationProvider.java
(57%)
create mode 100644
hadoop-tools/hadoop-dynamometer/hadoop-dynamometer-infra/src/main/java/org/apache/hadoop/tools/dynamometer/ApplicationMaster.java
create mode 100644
hadoop-tools/hadoop-dynamometer/hadoop-dynamometer-infra/src/main/java/org/apache/hadoop/tools/dynamometer/BlockPlacementPolicyAlwaysSatisfied.java
create mode 100644
hadoop-tools/hadoop-dynamometer/hadoop-dynamometer-infra/src/main/java/org/apache/hadoop/tools/dynamometer/Client.java
create mode 100644
hadoop-tools/hadoop-dynamometer/hadoop-dynamometer-infra/src/main/java/org/apache/hadoop/tools/dynamometer/DynoConstants.java
create mode 100644
hadoop-tools/hadoop-dynamometer/hadoop-dynamometer-infra/src/main/java/org/apache/hadoop/tools/dynamometer/DynoInfraUtils.java
create mode 100644
hadoop-tools/hadoop-dynamometer/hadoop-dynamometer-infra/src/main/java/org/apache/hadoop/tools/dynamometer/DynoResource.java
create mode 100644
hadoop-tools/hadoop-dynamometer/hadoop-dynamometer-infra/src/main/java/org/apache/hadoop/tools/dynamometer/SimulatedDataNodes.java
copy {hadoop-hdds/common/src/main/java/org/apache/hadoop/hdds/scm/exceptions
=>
hadoop-tools/hadoop-dynamometer/hadoop-dynamometer-infra/src/main/java/org/apache/hadoop/tools/dynamometer}/package-info.java
(61%)
create mode 100644
hadoop-tools/hadoop-dynamometer/hadoop-dynamometer-infra/src/main/resources/start-component.sh
create mode 100644
hadoop-tools/hadoop-dynamometer/hadoop-dynamometer-infra/src/test/java/org/apache/hadoop/tools/dynamometer/TestDynamometerInfra.java
create mode 100644
hadoop-tools/hadoop-dynamometer/hadoop-dynamometer-infra/src/test/java/org/apache/hadoop/tools/dynamometer/TestDynoInfraUtils.java
create mode 100644
hadoop-tools/hadoop-dynamometer/hadoop-dynamometer-infra/src/test/resources/blocks/dn0-a-0-r-00000
create mode 100644
hadoop-tools/hadoop-dynamometer/hadoop-dynamometer-infra/src/test/resources/blocks/dn1-a-0-r-00001
create mode 100644
hadoop-tools/hadoop-dynamometer/hadoop-dynamometer-infra/src/test/resources/blocks/dn2-a-0-r-00002
create mode 100644
hadoop-tools/hadoop-dynamometer/hadoop-dynamometer-infra/src/test/resources/conf/etc/hadoop/core-site.xml
create mode 100644
hadoop-tools/hadoop-dynamometer/hadoop-dynamometer-infra/src/test/resources/conf/etc/hadoop/hdfs-site.xml
copy hadoop-hdds/docs/config.yaml =>
hadoop-tools/hadoop-dynamometer/hadoop-dynamometer-infra/src/test/resources/conf/etc/hadoop/log4j.properties
(57%)
create mode 100644
hadoop-tools/hadoop-dynamometer/hadoop-dynamometer-infra/src/test/resources/hadoop_3_1/VERSION
create mode 100644
hadoop-tools/hadoop-dynamometer/hadoop-dynamometer-infra/src/test/resources/hadoop_3_1/fsimage_0000000000000061740
create mode 100644
hadoop-tools/hadoop-dynamometer/hadoop-dynamometer-infra/src/test/resources/hadoop_3_1/fsimage_0000000000000061740.md5
create mode 100644
hadoop-tools/hadoop-dynamometer/hadoop-dynamometer-infra/src/test/resources/yarn-site.xml
create mode 100644
hadoop-tools/hadoop-dynamometer/hadoop-dynamometer-workload/pom.xml
create mode 100755
hadoop-tools/hadoop-dynamometer/hadoop-dynamometer-workload/src/main/bash/parse-start-timestamp.sh
create mode 100755
hadoop-tools/hadoop-dynamometer/hadoop-dynamometer-workload/src/main/bash/start-workload.sh
create mode 100644
hadoop-tools/hadoop-dynamometer/hadoop-dynamometer-workload/src/main/java/org/apache/hadoop/tools/dynamometer/workloadgenerator/CreateFileMapper.java
create mode 100644
hadoop-tools/hadoop-dynamometer/hadoop-dynamometer-workload/src/main/java/org/apache/hadoop/tools/dynamometer/workloadgenerator/VirtualInputFormat.java
copy
hadoop-hdds/common/src/main/java/org/apache/hadoop/hdds/scm/exceptions/package-info.java
=>
hadoop-tools/hadoop-dynamometer/hadoop-dynamometer-workload/src/main/java/org/apache/hadoop/tools/dynamometer/workloadgenerator/VirtualInputSplit.java
(51%)
create mode 100644
hadoop-tools/hadoop-dynamometer/hadoop-dynamometer-workload/src/main/java/org/apache/hadoop/tools/dynamometer/workloadgenerator/VirtualRecordReader.java
create mode 100644
hadoop-tools/hadoop-dynamometer/hadoop-dynamometer-workload/src/main/java/org/apache/hadoop/tools/dynamometer/workloadgenerator/WorkloadDriver.java
create mode 100644
hadoop-tools/hadoop-dynamometer/hadoop-dynamometer-workload/src/main/java/org/apache/hadoop/tools/dynamometer/workloadgenerator/WorkloadMapper.java
create mode 100644
hadoop-tools/hadoop-dynamometer/hadoop-dynamometer-workload/src/main/java/org/apache/hadoop/tools/dynamometer/workloadgenerator/audit/AuditCommandParser.java
create mode 100644
hadoop-tools/hadoop-dynamometer/hadoop-dynamometer-workload/src/main/java/org/apache/hadoop/tools/dynamometer/workloadgenerator/audit/AuditLogDirectParser.java
create mode 100644
hadoop-tools/hadoop-dynamometer/hadoop-dynamometer-workload/src/main/java/org/apache/hadoop/tools/dynamometer/workloadgenerator/audit/AuditLogHiveTableParser.java
create mode 100644
hadoop-tools/hadoop-dynamometer/hadoop-dynamometer-workload/src/main/java/org/apache/hadoop/tools/dynamometer/workloadgenerator/audit/AuditReplayCommand.java
create mode 100644
hadoop-tools/hadoop-dynamometer/hadoop-dynamometer-workload/src/main/java/org/apache/hadoop/tools/dynamometer/workloadgenerator/audit/AuditReplayMapper.java
create mode 100644
hadoop-tools/hadoop-dynamometer/hadoop-dynamometer-workload/src/main/java/org/apache/hadoop/tools/dynamometer/workloadgenerator/audit/AuditReplayThread.java
create mode 100644
hadoop-tools/hadoop-dynamometer/hadoop-dynamometer-workload/src/main/java/org/apache/hadoop/tools/dynamometer/workloadgenerator/audit/NoSplitTextInputFormat.java
copy {hadoop-hdds/common/src/main/java/org/apache/hadoop/hdds/scm/exceptions
=>
hadoop-tools/hadoop-dynamometer/hadoop-dynamometer-workload/src/main/java/org/apache/hadoop/tools/dynamometer/workloadgenerator/audit}/package-info.java
(67%)
copy {hadoop-hdds/common/src/main/java/org/apache/hadoop/hdds/scm/exceptions
=>
hadoop-tools/hadoop-dynamometer/hadoop-dynamometer-workload/src/main/java/org/apache/hadoop/tools/dynamometer/workloadgenerator}/package-info.java
(66%)
create mode 100644
hadoop-tools/hadoop-dynamometer/hadoop-dynamometer-workload/src/test/java/org/apache/hadoop/tools/dynamometer/workloadgenerator/TestWorkloadGenerator.java
create mode 100644
hadoop-tools/hadoop-dynamometer/hadoop-dynamometer-workload/src/test/java/org/apache/hadoop/tools/dynamometer/workloadgenerator/audit/TestAuditLogDirectParser.java
create mode 100644
hadoop-tools/hadoop-dynamometer/hadoop-dynamometer-workload/src/test/resources/audit_trace_direct/audit0
create mode 100644
hadoop-tools/hadoop-dynamometer/hadoop-dynamometer-workload/src/test/resources/audit_trace_hive/audit0
copy hadoop-tools/{ => hadoop-dynamometer}/pom.xml (60%)
create mode 100644
hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/src/main/java/org/apache/hadoop/yarn/server/nodemanager/containermanager/linux/runtime/OCIContainerRuntime.java
create mode 100644
hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/src/main/java/org/apache/hadoop/yarn/server/nodemanager/containermanager/resourceplugin/com/nec/UdevUtil.java
create mode 100644
hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/src/main/java/org/apache/hadoop/yarn/server/nodemanager/containermanager/resourceplugin/com/nec/VEDeviceDiscoverer.java
create mode 100644
hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/src/test/java/org/apache/hadoop/yarn/server/nodemanager/containermanager/resourceplugin/com/nec/TestVEDeviceDiscoverer.java
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
