This is an automated email from the ASF dual-hosted git repository.
rakeshr pushed a change to branch HDDS-2939
in repository https://gitbox.apache.org/repos/asf/hadoop-ozone.git.
discard 61100d0 HDDS-4266: CreateFile : store parent dir entries into
DirTable and file entry into separate FileTable (#1473)
omit e32552b HDDS-2949: mkdir : store directory entries in a separate
table (#1404)
add 55c9df8 HDDS-4290. Enable insight point for SCM heartbeat protocol
(#1453)
add 60d2bcc HDDS-4274. Change the log level of the SCM Delete block to
improve performance. (#1446)
add f8a62d6 HDDS-3810. Add the logic to distribute open containers among
the pipelines of a datanode. (#1274)
add 5719615 HDDS-4304. Close Container event can fail if pipeline is
removed first. (#1471)
add 8cd86a6 HDDS-4299. Display Ratis version with ozone version (#1464)
add cfff097 HDDS-4271. Avoid logging chunk content in Ozone Insight
(#1466)
add 4ad0318 HDDS-4264. Uniform naming conventions of Ozone Shell Options.
(#1447)
add d6d27e4 HDDS-4242. Copy PrefixInfo proto to new project
hadoop-ozone/interface-storage (#1444)
add 19cb481 HDDS-4156. add hierarchical layout to Chinese doc (#1368)
add b6efb95 HDDS-4280. Document notable configurations for Recon. (#1448)
add 0d7d1e2 HDDS-4298. Use an interface in Ozone client instead of
XceiverClientManager (#1460)
add f9b1ca4 HDDS-4310: Ozone getconf broke the compatibility (#1475)
add efaa4fc HDDS-4309. Fix inconsistency in recon config keys starting
with recon and not ozone (#1478)
add e0a3baf HDDS-4325. Incompatible return codes from Ozone getconf
-confKey (#1485). Contributed by Doroszlai, Attila.
add 55d1e91 HDDS-4316. Upgrade to angular 1.8.0 due to CVE-2020-7676
(#1481)
add d08a4c1 HDDS-3728. Bucket space: check quotaUsageInBytes when write
key and allocate block. (#1458)
add 7704cb5 HDDS-3814. Drop a column family through debug cli tool (#1083)
add a1d53b0 HDDS-4311. Type-safe config design doc points to OM HA (#1477)
add 5c5d8cb HDDS-4312. findbugs check succeeds despite compile error
(#1476)
add 35cc6b0 HDDS-4285. Read is slow due to frequent calls to
UGI.getCurrentUser() and getTokens() (#1454)
add c956ce6 HDDS-4262. Use ClientID and CallID from Rpc Client to detect
retry requests (#1436)
add dc889b4 Remove extra serialization from getBlockID (#1470)
add 7ae037e HDDS-4336. ContainerInfo does not persist BCSID (sequenceId)
leading to failed replica reports (#1488)
add 7db0ea8 HDDS-4122. Implement OM Delete Expired Open Key Request and
Response (#1435)
new 6f2fa22 HDDS-2949: mkdir : store directory entries in a separate
table (#1404)
new 51bb909 HDDS-4266: CreateFile : store parent dir entries into
DirTable and file entry into separate FileTable (#1473)
This update added new revisions after undoing existing revisions.
That is to say, some revisions that were in the old version of the
branch are not in the new version. This situation occurs
when a user --force pushes a change and generates a repository
containing something like this:
* -- * -- B -- O -- O -- O (61100d0)
\
N -- N -- N refs/heads/HDDS-2939 (51bb909)
You should already have received notification emails for all of the O
revisions, and so the following emails describe only the N revisions
from the common base, B.
Any revisions marked "omit" are not gone; other references still
refer to them. Any revisions marked "discard" are gone forever.
The 2 revisions listed above as "new" are entirely new to this
repository and will be described in separate emails. The revisions
listed as "add" were already present in the repository and have only
been added to this reference.
Summary of changes:
LICENSE.txt | 4 +-
.../hadoop/hdds/scm/XceiverClientFactory.java} | 24 +-
.../hadoop/hdds/scm/XceiverClientManager.java | 40 +-
.../hadoop/hdds/scm/storage/BlockInputStream.java | 62 ++-
.../hadoop/hdds/scm/storage/BlockOutputStream.java | 37 +-
.../apache/hadoop/hdds/scm/storage/BufferPool.java | 2 +-
.../hadoop/hdds/scm/storage/ChunkInputStream.java | 10 +-
.../hdds/scm/storage/DummyChunkInputStream.java | 2 +-
.../storage/TestBlockOutputStreamCorrectness.java | 2 +-
.../hadoop/hdds/scm/ByteStringConversion.java | 18 +-
.../org/apache/hadoop/hdds/scm/ScmConfigKeys.java | 4 +
.../hadoop/hdds/scm/container/ContainerInfo.java | 2 +
.../hdds/scm/storage/ContainerProtocolCalls.java | 139 +++----
.../{VersionInfo.java => RatisVersionInfo.java} | 66 +---
.../org/apache/hadoop/hdds/utils/VersionInfo.java | 9 +-
.../common/src/main/resources/ozone-default.xml | 19 +-
.../container/common/helpers/ContainerUtils.java | 66 +++-
.../container/common/impl/HddsDispatcher.java | 4 +-
.../ozone/container/keyvalue/KeyValueHandler.java | 14 +-
.../container/keyvalue/impl/BlockManagerImpl.java | 15 +-
.../main/resources/webapps/hddsDatanode/index.html | 4 +-
hadoop-hdds/docs/content/concept/Datanodes.zh.md | 3 +
hadoop-hdds/docs/content/concept/Overview.zh.md | 5 +
.../docs/content/concept/OzoneManager.zh.md | 3 +
.../content/concept/StorageContainerManager.zh.md | 3 +
hadoop-hdds/docs/content/concept/_index.zh.md | 2 +-
hadoop-hdds/docs/content/design/typesafeconfig.md | 10 +-
hadoop-hdds/docs/content/feature/Recon.md | 18 +-
hadoop-hdds/docs/content/interface/CSI.zh.md | 3 +
hadoop-hdds/docs/content/interface/JavaApi.zh.md | 3 +
hadoop-hdds/docs/content/interface/O3fs.zh.md | 3 +
hadoop-hdds/docs/content/interface/S3.zh.md | 3 +
.../docs/content/security/SecureOzone.zh.md | 3 +
hadoop-hdds/docs/content/security/SecuringS3.zh.md | 3 +
.../docs/content/security/SecuringTDE.zh.md | 3 +
.../docs/content/security/SecurityAcls.zh.md | 3 +
.../docs/content/security/SecurityWithRanger.zh.md | 3 +
hadoop-hdds/docs/content/tools/TestTools.md | 2 +-
hadoop-hdds/docs/content/tools/TestTools.zh.md | 2 +-
.../server/OzoneProtocolMessageDispatcher.java | 32 +-
.../resources/webapps/static/angular-1.7.9.min.js | 350 -----------------
.../resources/webapps/static/angular-1.8.0.min.js | 350 +++++++++++++++++
...ute-1.7.9.min.js => angular-route-1.8.0.min.js} | 6 +-
hadoop-hdds/pom.xml | 4 +-
.../hdds/scm/container/SCMContainerManager.java | 23 +-
.../apache/hadoop/hdds/scm/node/DatanodeInfo.java | 33 ++
.../apache/hadoop/hdds/scm/node/NodeManager.java | 6 +-
.../hadoop/hdds/scm/node/SCMNodeManager.java | 53 ++-
.../hadoop/hdds/scm/pipeline/PipelineManager.java | 4 +-
.../hdds/scm/pipeline/PipelinePlacementPolicy.java | 7 +-
.../hdds/scm/pipeline/RatisPipelineProvider.java | 6 +-
.../hdds/scm/pipeline/SCMPipelineManager.java | 16 +-
.../hdds/scm/server/SCMBlockProtocolServer.java | 6 +-
.../src/main/resources/webapps/scm/index.html | 4 +-
.../hadoop/hdds/scm/block/TestBlockManager.java | 69 ++++
.../hadoop/hdds/scm/container/MockNodeManager.java | 28 +-
.../hadoop/hdds/scm/node/TestSCMNodeManager.java | 4 +-
.../scm/pipeline/TestPipelinePlacementPolicy.java | 4 +-
.../hdds/scm/pipeline/TestSCMPipelineManager.java | 74 ++++
.../testutils/ReplicationNodeManagerMock.java | 12 +-
.../scm/cli/pipeline/CreatePipelineSubcommand.java | 10 +-
.../ozone/client/io/BlockOutputStreamEntry.java | 30 +-
.../client/io/BlockOutputStreamEntryPool.java | 34 +-
.../hadoop/ozone/client/io/KeyInputStream.java | 36 +-
.../hadoop/ozone/client/io/KeyOutputStream.java | 56 +--
.../apache/hadoop/ozone/client/rpc/RpcClient.java | 6 +
.../main/java/org/apache/hadoop/ozone/OmUtils.java | 1 +
.../hadoop/ozone/om/helpers/OmKeyLocationInfo.java | 6 +-
.../apache/hadoop/ozone/util/OzoneVersionInfo.java | 15 +-
hadoop-ozone/dev-support/checks/findbugs.sh | 7 +-
.../dist/src/main/compose/ozone/docker-config | 2 +-
.../main/compose/ozonesecure-om-ha/docker-config | 4 +-
.../src/main/compose/ozonesecure/docker-config | 4 +-
.../dist/src/main/compose/upgrade/docker-config | 2 +-
.../main/k8s/definitions/ozone/freon/freon.yaml | 2 +-
.../getting-started/freon/freon-deployment.yaml | 2 +-
.../examples/minikube/freon/freon-deployment.yaml | 2 +-
.../examples/ozone-dev/freon/freon-deployment.yaml | 2 +-
.../k8s/examples/ozone/freon/freon-deployment.yaml | 2 +-
hadoop-ozone/dist/src/main/license/bin/LICENSE.txt | 4 +-
.../main/smoketest/auditparser/auditparser.robot | 2 +-
.../dist/src/main/smoketest/basic/basic.robot | 2 +-
.../dist/src/main/smoketest/basic/getconf.robot | 37 +-
.../src/main/smoketest/basic/ozone-shell-lib.robot | 2 +-
.../dist/src/main/smoketest/freon/freon.robot | 2 +-
.../dist/src/main/smoketest/recon/recon-api.robot | 2 +-
.../dist/src/main/smoketest/spnego/web.robot | 2 +-
.../hadoop/ozone/TestMiniChaosOzoneCluster.java | 40 +-
.../src/test/blockade/ozone/client.py | 10 +-
.../ozone/insight/BaseInsightSubCommand.java | 3 +
.../java/org/apache/hadoop/ozone/TestDataUtil.java | 13 +-
.../hadoop/ozone/TestOzoneConfigurationFields.java | 11 +-
.../client/rpc/TestOzoneRpcClientAbstract.java | 67 +++-
.../hadoop/ozone/client/rpc/TestReadRetries.java | 40 +-
.../hadoop/ozone/fsck/TestContainerMapper.java | 3 +
.../ozone/om/TestOzoneManagerHAMetadataOnly.java | 76 ++++
.../ozone/recon/TestReconWithOzoneManager.java | 32 +-
.../hadoop/ozone/scm/TestCloseContainer.java | 148 ++++++++
.../hadoop/ozone/scm/TestContainerSmallFile.java | 20 +-
.../scm/TestGetCommittedBlockLengthAndPutKey.java | 4 +-
.../hadoop/ozone/scm/TestXceiverClientGrpc.java | 6 +-
.../src/main/proto/OmClientProtocol.proto | 17 +
.../dev-support/findbugsExcludeFile.xml | 2 +-
hadoop-ozone/interface-storage/pom.xml | 39 +-
.../hadoop/ozone/om/codec/OmPrefixInfoCodec.java | 5 +-
.../hadoop/ozone/om/helpers/OmPrefixInfo.java | 13 +-
.../hadoop/ozone/om/helpers/OzoneAclStorage.java | 63 ++++
.../ozone/om/helpers/OzoneAclStorageUtil.java | 62 +++
.../hadoop/ozone/om/helpers}/package-info.java | 4 +-
.../src/main/proto/OmStorageProtocol.proto | 60 +++
.../hadoop/ozone/om/helpers/TestOmPrefixInfo.java | 0
.../hadoop/ozone/om/helpers}/package-info.java | 4 +-
.../java/org/apache/hadoop/ozone/om/OMMetrics.java | 37 ++
.../ozone/om/ratis/OzoneManagerRatisServer.java | 11 +-
.../ozone/om/request/file/OMFileCreateRequest.java | 3 +-
.../om/request/key/OMAllocateBlockRequest.java | 3 +-
.../ozone/om/request/key/OMKeyCreateRequest.java | 3 +-
.../ozone/om/request/key/OMKeyDeleteRequest.java | 11 +-
.../hadoop/ozone/om/request/key/OMKeyRequest.java | 56 ++-
.../ozone/om/request/key/OMKeysDeleteRequest.java | 12 +-
.../om/request/volume/OMVolumeCreateRequest.java | 6 +
...ponse.java => AbstractOMKeyDeleteResponse.java} | 68 ++--
.../ozone/om/response/key/OMKeyDeleteResponse.java | 73 +---
.../om/response/key/OMKeysDeleteResponse.java | 38 +-
.../om/response/key/OMOpenKeysDeleteRequest.java | 192 ++++++++++
...Response.java => OMOpenKeysDeleteResponse.java} | 57 ++-
.../main/resources/webapps/ozoneManager/index.html | 4 +-
.../ozone/om/request/TestOMRequestUtils.java | 48 ++-
.../request/key/TestOMOpenKeysDeleteRequest.java | 419 +++++++++++++++++++++
.../om/response/key/TestOMKeysDeleteResponse.java | 12 +-
.../response/key/TestOMOpenKeysDeleteResponse.java | 185 +++++++++
hadoop-ozone/pom.xml | 4 +-
.../hadoop/ozone/recon/ReconServerConfigKeys.java | 48 ++-
.../spi/impl/OzoneManagerServiceProviderImpl.java | 52 ++-
.../spi/impl/PrometheusServiceProviderImpl.java | 17 +-
.../ozone/conf/OzoneManagersCommandHandler.java | 1 +
.../ozone/conf/PrintConfKeyCommandHandler.java | 5 +-
.../StorageContainerManagersCommandHandler.java | 1 +
.../apache/hadoop/ozone/debug/ChunkKeyHandler.java | 11 +-
.../org/apache/hadoop/ozone/debug/DBScanner.java | 18 +-
.../org/apache/hadoop/ozone/debug/DropTable.java | 81 ++++
.../GetAclHandler.java => debug/RocksDBUtils.java} | 33 +-
.../hadoop/ozone/freon/HadoopDirTreeGenerator.java | 15 +-
.../ozone/freon/HadoopNestedDirGenerator.java | 5 +-
.../hadoop/ozone/freon/RandomKeyGenerator.java | 40 +-
.../hadoop/ozone/conf/TestGetConfOptions.java | 90 +++++
146 files changed, 3199 insertions(+), 1187 deletions(-)
copy
hadoop-hdds/{container-service/src/main/java/org/apache/hadoop/ozone/container/common/interfaces/ContainerLocationManagerMXBean.java
=> client/src/main/java/org/apache/hadoop/hdds/scm/XceiverClientFactory.java}
(63%)
copy
hadoop-hdds/common/src/main/java/org/apache/hadoop/hdds/utils/{VersionInfo.java
=> RatisVersionInfo.java} (50%)
delete mode 100644
hadoop-hdds/framework/src/main/resources/webapps/static/angular-1.7.9.min.js
create mode 100644
hadoop-hdds/framework/src/main/resources/webapps/static/angular-1.8.0.min.js
rename
hadoop-hdds/framework/src/main/resources/webapps/static/{angular-route-1.7.9.min.js
=> angular-route-1.8.0.min.js} (97%)
create mode 100644
hadoop-ozone/integration-test/src/test/java/org/apache/hadoop/ozone/scm/TestCloseContainer.java
copy {hadoop-hdds/interface-server =>
hadoop-ozone/interface-storage}/dev-support/findbugsExcludeFile.xml (93%)
rename hadoop-ozone/{common =>
interface-storage}/src/main/java/org/apache/hadoop/ozone/om/helpers/OmPrefixInfo.java
(92%)
create mode 100644
hadoop-ozone/interface-storage/src/main/java/org/apache/hadoop/ozone/om/helpers/OzoneAclStorage.java
create mode 100644
hadoop-ozone/interface-storage/src/main/java/org/apache/hadoop/ozone/om/helpers/OzoneAclStorageUtil.java
copy
hadoop-ozone/interface-storage/src/{test/java/org/apache/hadoop/ozone/om/codec
=> main/java/org/apache/hadoop/ozone/om/helpers}/package-info.java (91%)
create mode 100644
hadoop-ozone/interface-storage/src/main/proto/OmStorageProtocol.proto
rename hadoop-ozone/{common =>
interface-storage}/src/test/java/org/apache/hadoop/ozone/om/helpers/TestOmPrefixInfo.java
(100%)
copy hadoop-ozone/interface-storage/src/{main/java/org/apache/hadoop/ozone/om
=> test/java/org/apache/hadoop/ozone/om/helpers}/package-info.java (92%)
copy
hadoop-ozone/ozone-manager/src/main/java/org/apache/hadoop/ozone/om/response/key/{OMKeyDeleteResponse.java
=> AbstractOMKeyDeleteResponse.java} (64%)
create mode 100644
hadoop-ozone/ozone-manager/src/main/java/org/apache/hadoop/ozone/om/response/key/OMOpenKeysDeleteRequest.java
copy
hadoop-ozone/ozone-manager/src/main/java/org/apache/hadoop/ozone/om/response/key/{OMKeyRenameResponse.java
=> OMOpenKeysDeleteResponse.java} (55%)
create mode 100644
hadoop-ozone/ozone-manager/src/test/java/org/apache/hadoop/ozone/om/request/key/TestOMOpenKeysDeleteRequest.java
create mode 100644
hadoop-ozone/ozone-manager/src/test/java/org/apache/hadoop/ozone/om/response/key/TestOMOpenKeysDeleteResponse.java
create mode 100644
hadoop-ozone/tools/src/main/java/org/apache/hadoop/ozone/debug/DropTable.java
copy
hadoop-ozone/tools/src/main/java/org/apache/hadoop/ozone/{shell/acl/GetAclHandler.java
=> debug/RocksDBUtils.java} (54%)
create mode 100644
hadoop-ozone/tools/src/test/java/org/apache/hadoop/ozone/conf/TestGetConfOptions.java
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
