This is an automated email from the ASF dual-hosted git repository.
nanda pushed a change to branch HDDS-2823
in repository https://gitbox.apache.org/repos/asf/hadoop-ozone.git.
discard 927c58a HDDS-4365: SCMBlockLocationFailoverProxyProvider should use
ScmBlockLocationProtocolPB.class in RPC.setProtocolEngine. (#1512)
omit 7ddaa07 HDDS-4192: enable SCM Raft Group based on config
ozone.scm.names (#1428)
omit 138d33e HDDS-3188 Add failover proxy for SCM block location. (#1340)
omit 1c2a950 HDDS-4115. CLI command to show current SCM leader and
follower status. (#1346)
omit 0f64aab HDDS-3895. Implement container related operations in
ContainerManagerImpl. (#1145)
omit ccbf5b3 HDDS-4130: remove the 1st edition of RatisServer of SCM HA
which is copied from OM HA (#1341)
omit 1b2ac22 HDDS-4093: Update RATIS version from 1.0.0 to
1.1.0-85281b2-SNAPSHOT. (#1307)
omit fb32aa7 HDDS-4125: Pipeline is not removed when a datanode goes stale
(#1334)
omit e4a2a3d HDDS-4059: SCMStateMachine::applyTransaction() should not
invoke TransactionContext.getClientRequest() (#1287)
omit a92a2f7 Update PipelineManagerV2 with getNumHealthyVolumes interface.
omit 4d186d4 HDDS-3994. Make retry policy can be set by configuration.
(#1231)
omit 040577c HDDS-3446. Enable TestOzoneManagerRestart and address any
failure. (#1279)
omit dd28dc9 HDDS-4058. Wrong use of AtomicBoolean in HddsDatanodeService
(#1284)
omit 979faa7 HDDS-4029. Recon unable to add a new container which is in
CLOSED state. (#1258)
omit 26ffe01 HDDS-4021. Organize Recon DBs into a 'DBDefinition'. (#1255)
omit da4fccb HDDS-4052. Remove master/slave terminology from Ozone (#1281)
omit 036c142 HDDS-4047. OzoneManager met NPE exception while
getServiceList (#1277)
omit f511340 HDDS-3990. Test Kubernetes examples with acceptance tests
(#1223)
omit 19eaad1 HDDS-4045. Add more ignore rules to the RAT ignore list
(#1273)
omit 8b7e0d3 HDDS-3970. Enabling TestStorageContainerManager with all
failures addressed (#1257)
omit 00afc8d HDDS-4033. Make the acceptance test reports hierarchical
(#1263)
omit c17504b HDDS-3423. Enabling TestContainerReplicationEndToEnd and
addressing failures (#1260)
omit 7537e34 HDDS-4027. Suppress ERROR message when SCM attempt to create
additional pipelines. (#1265)
omit acd3480 HDDS-4024. Avoid while loop too soon when exception happen
(#1253)
omit 52fc2ac HDDS-3809. Make number of open containers on a datanode a
function of no of volumes reported by it. (#1081)
omit 08c6512 HDDS-4019. Show the storageDir while need init om or scm
(#1248)
omit dc72bb9 HDDS-3511. Fix javadoc comment in OmMetadataManager (#1247)
omit 91a43ec HDDS-4041. Ozone /conf endpoint triggers kerberos replay
error when SPNEGO is enabled. (#1267)
omit 6b36e21 HDDS-4031. Run shell tests in CI (#1261)
omit d80f873 HDDS-4038. Eliminate GitHub check warnings (#1268)
omit d6d7d81 HDDS-4011. Update S3 related documentation. (#1245)
omit dd7eaf1 HDDS-4030. Remember the selected columns and make the X-axis
scrollable in recon datanodes UI (#1259)
omit 2b78046 HDDS-4032. Run author check without docker (#1262)
omit 1fa9e78 HDDS-4026. Dir rename failed when sets
'ozone.om.enable.filesystem.paths' to true (#1256)
omit 64d76ed HDDS-4017. Acceptance check may run against wrong commit
(#1249)
omit 5dd1015 HDDS-4000. Split acceptance tests to reduce CI feedback time
(#1236)
omit 2286ee5 HDDS-3905. Show status of OM in the OM web ui (#1152)
omit 749d874 HDDS-4022. Ozone s3 API return 400 Bad Request for
head-bucket for non existing bucket. (#1251)
omit 7545f18 HDDS-3975. Use Duration for time in RatisClientConfig (#1217)
omit 60b328b HDDS-3877. Do not fail CI check for log upload failure (#1209)
omit d757253 HDDS-3973. Update main feature design status. (#1207)
omit e41edd6 HDDS-4025. Add test for creating encrypted key (#1254)
omit c059c83 HDDS-4007. Generate encryption info for the bucket outside
bucket lock. (#1242)
omit c884133 HDDS-3997. Ozone certificate needs additional flags and SAN
extension… (#1235)
omit b8b1f01 HDDS-3996. Missing TLS client configurations to allow
ozone.grpc.tls.… (#1234)
omit 5486793 HDDS-3999. OM Shutdown when Commit part tries to commit the
part, after abort upload. (#1244)
omit 7ff95c0 HDDS-4018. Datanode log spammed by NPE (#1250)
omit 829143e HDDS-3658. Stop to persist container related pipeline info of
each ke… (#1012)
omit eff1f43 HDDS-4008. Recon should fallback to ozone.om.service.ids when
the internal service id is not defined. (#1243)
omit 83bff20 HDDS-4006. Disallow MPU on encrypted buckets. (#1241)
omit 51a0c93 HDDS-3998. Shorten Ozone FS Hadoop compatibility module names
(#1237)
omit a5b2093 HDDS-3827. Intermittent failure in
TestKeyManagerUnit#listMultipartUploads (#1239)
omit 0d61e47 HDDS-4003. Delete the redundant word of the description
(#1240)
omit 12d1d35 HDDS-3969. Add validName check for FileSystem requests (#1211)
omit d144473 HDDS-3993. Create volume required for S3G during OM startup.
(#1227)
omit 8cb1e85 Remove optional jersey-json dependency (#1238)
omit 5c541bc HDDS-3718: Improve OmKeyLocationInfoGroup internal data
structure (#1023)
omit afe9988 HDDS-2770. security/SecurityAcls.md (#1190)
omit 364468c HDDS-3933. Fix memory leak because of too many Datanode State
Machine Thread (#1185)
omit 7f699fa HDDS-3991. Ignore protobuf lock files (#1224)
omit 4ff513f HDDS-3980. Correct the toString of RangeHeader (#1213)
omit a0dcdd3 HDDS-3989. Addendum: revert proto.lock file (#1226)
omit 093cea1 HDDS-3892. Datanode initialization is too slow when there are
thousan… (#1147)
omit 7e8f2ee HDDS-3992. Remove project skeleton of in-place upgrade
feature (#1225)
omit eb765fe HDDS-3989. Display revision and build date of DN in recon UI
(#1226)
omit a265f7f HDDS-3986. Frequent failure in
TestCommitWatcher#testReleaseBuffersOnException (#1220)
omit 8d8c5cc HDDS-3813. Upgrade Ratis third-party, too (#1229)
omit c53c0e0 Update ratis to 1.0.0 (#1222)
omit fb3cfe9 HDDS-3982. Disable moveToTrash in o3fs and ofs temporarily
(#1215)
omit 26a38a2 HDDS-3987. Encrypted bucket creation failed with
INVALID_REQUEST Encryption cannot be set for bucket links (#1221)
omit 23dafc5 HDDS-3984. Support filter and search the columns in recon UI
(#1218)
omit 5d6f832 HDDS-3806. Support recognize aws v2 Authorization header.
(#1098)
omit 51a3582 HDDS-3955. Unable to list intermediate paths on keys created
using S3G. (#1196)
omit db3cef0 HDDS-3741. Reload old OM state if Install Snapshot from
Leader fails (#1129)
omit 888abde HDDS-3965. SCM failed to start up for duplicated pipeline
detected. (#1210)
omit ed8df6b HDDS-3855. Add upgrade smoketest (#1142)
omit d3dda10 HDDS-3964. Ratis config key mismatch (#1204)
omit 97fdf92 HDDS-3612. Allow mounting bucket under other volume (#1104)
omit e7cac9a HDDS-3926. OM Token Identifier table should use in-house
serialization. (#1182)
omit 168ba19 HDDS-3824: OM read requests should make SCM#refreshPipeline
outside BUCKET_LOCK (#1164)
omit 82c402e HDDS-3966. Disable flaky TestOMRatisSnapshots
omit e9eb482 HDDS-3807. Propagate raft log disks info to SCM from
datanode. (#1107)
omit f13a221 HDDS-3923. Display the safemode status on scm page (#1165)
omit c4f1446 HDDS-3958. Intermittent failure in Recon acceptance test due
to mixed stdout and stderr (#1200)
omit dddc85d HDDS-2767. security/SecuringTDE.md (#1184)
omit d19f322 HDDS-3968. LDB scan fails to read from transactionInfoTable.
(#1205)
omit f322918 HDDS-3967. Remove leftover debug setting (#1202)
omit c219647 HDDS-3765. Fluentd writing to secure Ozone S3 API fails with
500 Error. (#1179)
omit ad71958 HDDS-3798. Display more accurate timestamp in recon Web
(#1201)
omit 2e3e064 HDDS-3837 Add isLeader check in SCMHAManager. (#1191)
add da49ca6 HDDS-3798. Display more accurate timestamp in recon Web
(#1201)
add d6c7f28 HDDS-3765. Fluentd writing to secure Ozone S3 API fails with
500 Error. (#1179)
add fadc7f1 HDDS-3967. Remove leftover debug setting (#1202)
add 6f1fba4 HDDS-3968. LDB scan fails to read from transactionInfoTable.
(#1205)
add 22d03f6 HDDS-2767. security/SecuringTDE.md (#1184)
add d3e54fb HDDS-3958. Intermittent failure in Recon acceptance test due
to mixed stdout and stderr (#1200)
add 7266bf8 HDDS-3923. Display the safemode status on scm page (#1165)
add de02785 HDDS-3807. Propagate raft log disks info to SCM from
datanode. (#1107)
add 16dba63 HDDS-3966. Disable flaky TestOMRatisSnapshots
add 46e7b2f HDDS-3824: OM read requests should make SCM#refreshPipeline
outside BUCKET_LOCK (#1164)
add 7e37f7b HDDS-3926. OM Token Identifier table should use in-house
serialization. (#1182)
add 7aff2f0 HDDS-3612. Allow mounting bucket under other volume (#1104)
add f15b011 HDDS-3964. Ratis config key mismatch (#1204)
add 9b13ab6 HDDS-3855. Add upgrade smoketest (#1142)
add ca4c5a1 HDDS-3965. SCM failed to start up for duplicated pipeline
detected. (#1210)
add 3571d7e HDDS-3741. Reload old OM state if Install Snapshot from
Leader fails (#1129)
add 715aed2 HDDS-3955. Unable to list intermediate paths on keys created
using S3G. (#1196)
add c64d226 HDDS-3806. Support recognize aws v2 Authorization header.
(#1098)
add caf4711 HDDS-3984. Support filter and search the columns in recon UI
(#1218)
add 8339b38 HDDS-3987. Encrypted bucket creation failed with
INVALID_REQUEST Encryption cannot be set for bucket links (#1221)
add fbd125c HDDS-3982. Disable moveToTrash in o3fs and ofs temporarily
(#1215)
add fb2649e Update ratis to 1.0.0 (#1222)
add 798e00c HDDS-3813. Upgrade Ratis third-party, too (#1229)
add 402a427 HDDS-3986. Frequent failure in
TestCommitWatcher#testReleaseBuffersOnException (#1220)
add 76a9883 HDDS-3989. Display revision and build date of DN in recon UI
(#1226)
add 937f36f HDDS-3992. Remove project skeleton of in-place upgrade
feature (#1225)
add 783a18c HDDS-3892. Datanode initialization is too slow when there are
thousan… (#1147)
add fd7e05c HDDS-3989. Addendum: revert proto.lock file (#1226)
add c3bbe18 HDDS-3980. Correct the toString of RangeHeader (#1213)
add 404ec6d HDDS-3991. Ignore protobuf lock files (#1224)
add ff7b5a3 HDDS-3933. Fix memory leak because of too many Datanode State
Machine Thread (#1185)
add 05dccfd HDDS-2770. security/SecurityAcls.md (#1190)
add 40b3f13 HDDS-3718: Improve OmKeyLocationInfoGroup internal data
structure (#1023)
add 8e300bc Remove optional jersey-json dependency (#1238)
add 7dac140 HDDS-3993. Create volume required for S3G during OM startup.
(#1227)
add 854f5d3 HDDS-3969. Add validName check for FileSystem requests (#1211)
add f96b8fc HDDS-4003. Delete the redundant word of the description
(#1240)
add 5264b24 HDDS-3827. Intermittent failure in
TestKeyManagerUnit#listMultipartUploads (#1239)
add 1ae0378 HDDS-3998. Shorten Ozone FS Hadoop compatibility module names
(#1237)
add 6ca82b8 HDDS-4006. Disallow MPU on encrypted buckets. (#1241)
add cf7a583 HDDS-4008. Recon should fallback to ozone.om.service.ids when
the internal service id is not defined. (#1243)
add 71cc33d HDDS-3658. Stop to persist container related pipeline info of
each ke… (#1012)
add a4f7e32 HDDS-4018. Datanode log spammed by NPE (#1250)
add 32ac7bf HDDS-3999. OM Shutdown when Commit part tries to commit the
part, after abort upload. (#1244)
add facf36e HDDS-3996. Missing TLS client configurations to allow
ozone.grpc.tls.… (#1234)
add 0bb3e24 HDDS-3997. Ozone certificate needs additional flags and SAN
extension… (#1235)
add ac2769e HDDS-4007. Generate encryption info for the bucket outside
bucket lock. (#1242)
add 093f556 HDDS-4025. Add test for creating encrypted key (#1254)
add e643ab2 HDDS-3973. Update main feature design status. (#1207)
add 78875bb HDDS-3877. Do not fail CI check for log upload failure (#1209)
add 18552c1 HDDS-3975. Use Duration for time in RatisClientConfig (#1217)
add a123b4e HDDS-4022. Ozone s3 API return 400 Bad Request for
head-bucket for non existing bucket. (#1251)
add 2ba43d0 HDDS-3905. Show status of OM in the OM web ui (#1152)
add a7fe726 HDDS-4000. Split acceptance tests to reduce CI feedback time
(#1236)
add fd47f91 HDDS-4017. Acceptance check may run against wrong commit
(#1249)
add ddd3211 HDDS-4026. Dir rename failed when sets
'ozone.om.enable.filesystem.paths' to true (#1256)
add 99c273f HDDS-4032. Run author check without docker (#1262)
add 0869cce HDDS-4030. Remember the selected columns and make the X-axis
scrollable in recon datanodes UI (#1259)
add 182c344 HDDS-4011. Update S3 related documentation. (#1245)
add a77d9ea HDDS-4038. Eliminate GitHub check warnings (#1268)
add 829b860 HDDS-4031. Run shell tests in CI (#1261)
add 21c08ee HDDS-4041. Ozone /conf endpoint triggers kerberos replay
error when SPNEGO is enabled. (#1267)
add 1613726 HDDS-3511. Fix javadoc comment in OmMetadataManager (#1247)
add 0993d12 HDDS-4019. Show the storageDir while need init om or scm
(#1248)
add 1346f49 HDDS-3809. Make number of open containers on a datanode a
function of no of volumes reported by it. (#1081)
add a96553e HDDS-4024. Avoid while loop too soon when exception happen
(#1253)
add 0892fab HDDS-4027. Suppress ERROR message when SCM attempt to create
additional pipelines. (#1265)
add 93ac9ac HDDS-3423. Enabling TestContainerReplicationEndToEnd and
addressing failures (#1260)
add 5837e86 HDDS-4033. Make the acceptance test reports hierarchical
(#1263)
add 9f46fb8 HDDS-3970. Enabling TestStorageContainerManager with all
failures addressed (#1257)
add 025f458 HDDS-4045. Add more ignore rules to the RAT ignore list
(#1273)
add 30ec0e2 HDDS-3990. Test Kubernetes examples with acceptance tests
(#1223)
add a95b0b8 HDDS-4047. OzoneManager met NPE exception while
getServiceList (#1277)
add 0651be8 HDDS-4052. Remove master/slave terminology from Ozone (#1281)
add e219aae HDDS-4021. Organize Recon DBs into a 'DBDefinition'. (#1255)
add c07ccd7 HDDS-4029. Recon unable to add a new container which is in
CLOSED state. (#1258)
add 12e9a26 HDDS-4058. Wrong use of AtomicBoolean in HddsDatanodeService
(#1284)
add aad9c27 HDDS-3446. Enable TestOzoneManagerRestart and address any
failure. (#1279)
add ff621c6 HDDS-3994. Make retry policy can be set by configuration.
(#1231)
add c7ae9fe HDDS-4035. Update logs of HadoopDirGenerator. (#1264)
add cc5901f HDDS-4063. Fix InstallSnapshot in OM HA (#1294)
add d7ea496 HDDS-4044. Deprecate ozone.s3g.volume.name. #1270
add 99b693e HDDS-4073. Remove leftover robot.robot (#1297)
add db31571 HDDS-4066. Add core-site.xml to intellij configuration (#1292)
add 5ce6f0e HDDS-4042. Update documentation for the GA release (#1269)
add ca8eb40 HDDS-4055. Cleanup GitHub workflow (#1282)
add d418f00 HDDS-4051. Remove whitelist/blacklist terminology from Ozone
(#1306)
add 76c448f HDDS-4046. Extensible subcommands for CLI applications (#1276)
add 43471f7 HDDS-4076. Translate CSI.md into Chinese (#1299)
add 3fc8cf2 HDDS-4034. Add Unit Test for HadoopNestedDirGenerator. (#1266)
add cfc023a HDDS-4078. Use HDDS InterfaceAudience/Stability annotations
(#1302)
add 2da809e HDDS-4048. Show more information while SCM version info
mismatch (#1278)
add 9a702e5 HDDS-3979. Make bufferSize configurable for stream copy
(#1212)
add a79dfae HDDS-3833. Use Pipeline choose policy to choose pipeline from
exist pipeline list (#1096)
add cee43e9 HDDS-3878. Make OMHA serviceID optional if one (but only one)
is defined in the config (#1149)
add 9c22180 HDDS-4067. Implement toString for OMTransactionInfo (#1300)
add 0f23b22 HDDS-4061. Pending delete blocks are not always included in
#BLOCKCOUNT metadata (#1288)
add b186b90 HDDS-4040. [OFS] BasicRootedOzoneFileSystem to support
batchDelete (#1286)
add 7ab53b5 HDDS-4057. Failed acceptance test missing from bundle (#1283)
add d758f30 HDDS-4095. Byteman script to debug HCFS performance (#1311)
add 4ec1087 HDDS-3232. Include the byteman scripts in the distribution
tar file (#1309)
add 83697f9 HDDS-4037. Incorrect container numberOfKeys and usedBytes in
SCM after key deletion (#1295)
add eb70d9e HDDS-4009. Recon Overview page: The volume, bucket and key
counts are not accurate (#1305)
add 2c102bd HDDS-4108. ozone debug ldb scan without arguments results in
core dump (#1317)
add b8d1e3d HDDS-4099. No Log4j 2 configuration file found error appears
in CLI (#1318)
add e5e89e0 HDDS-4114. Bump log4j2 version (#1325)
add 59fc0bb HDDS-4127. Components with web interface should depend on
hdds-docs. (#1335)
add 1abbfed HDDS-4094. Support byte-level write in Freon
HadoopFsGenerator (#1310)
add 1c7003e HDDS-4139. Update version number in upgrade tests (#1347)
add c656feb HDDS-4144. Update version info in hadoop client dependency
readme (#1348)
add 122eac5 HDDS-4074. [OFS] Implement AbstractFileSystem for
RootedOzoneFileSystem (#1330)
add 854fdc4 HDDS-4112. Improve SCM webui page performance (#1323)
add c0084a1 HDDS-3654. Let backgroundCreator create pipeline for the
support replication factors alternately (#984)
add a2080cf HDDS-4111. Keep the CSI.zh.md consistent with CSI.md (#1320)
add 8102ac7 HDDS-4062. Non rack aware pipelines should not be created if
multiple racks are alive. (#1291)
add 9292b39 HDDS-4068. Client should not retry same OM on network
connection failure (#1324)
add 7f674fd HDDS-3972. Add option to limit number of items displaying
through ldb tool. (#1206)
add bc7786a HDDS-4056. Convert OzoneAdmin to pluggable model (#1285)
add 5fab834 HDDS-4152. Archive container logs for kubernetes check (#1355)
add 5523636 HDDS-4140. Auto-close /pending pull requests after 21 days of
inactivity (#1344)
add dcb1c6e HDDS-2411. add a datanode chunk validator fo datanode chunk
generator (#1312)
add 2f3edd9 HDDS-4153. Increase default timeout in kubernetes tests
(#1357)
add da61c4a HDDS-4149. Implement OzoneFileStatus#toString (#1356)
add d064230 HDDS-4109. Tests in TestOzoneFileSystem should use the
existing MiniOzoneCluster (#1316)
add f6e4417 HDDS-4145. Bump version to 1.1.0-SNAPSHOT on master (#1349)
add 02289ce HDDS-4146. Show the ScmId and ClusterId in the scm web ui.
(#1350)
add f64bc6e HDDS-4137. Turn on the verbose mode of safe mode check on
testlib (#1343)
add 44acf78 HDDS-4147. Add OFS to FileSystem META-INF (#1352)
add 8e98977 HDDS-4151. Skip the inputstream while offset larger than zero
in s3g (#1354)
add d34ab29 HDDS-3903. OzoneRpcClient support batch rename keys. (#1150)
add 78ca8bf HDDS-4077. Incomplete OzoneFileSystem statistics (#1329)
add 0ec1a8a HDDS-3867. Extend the chunkinfo tool to display information
from all nodes in the pipeline. (#1154)
add 34ee831 HDDS-4121. Implement OmMetadataMangerImpl#getExpiredOpenKeys.
(#1351)
add 13fe31b HDDS-4167. Acceptance test logs missing if fails during
cluster startup (#1366)
add 9cef3f6 HDDS-4176. Fix failed UT: test2WayCommitForTimeoutException
(#1370)
add 199512b HDDS-4131. Container report should update container key count
and bytes used if they differ in SCM (#1339)
add 77d56e6 HDDS-4165. GitHub Actions cache does not work outside of
workspace (#1364)
add c77e7ba HDDS-3804. Recon start fails with SQL exception with MySQL
DB. (#1377)
add b58054e HDDS-4169. Fix some minor errors in
StorageContainerManager.md (#1367)
add d2fb937 HDDS-4200. Fix missing right bracket in HA doc (#1380)
add dc5a997 HDDS-1889. Add support for verifying multiline log entry
(#1308)
add 79f9fab HDDS-3762. Intermittent failure in TestDeleteWithSlowFollower
(#1376)
add fd63aac HDDS-4150. Disabling flaky unit test until HDDS-4150 is fixed.
add b2fca43 HDDS-4189. Add alias `roles` for `ozone admin om` subcommand
`getserviceroles` (#1375)
add c8d5334 HDDS-4199. Fix failed UT:
TestOMAllocateBlockRequest#testValidateAndUpdateCache (#1379)
add ead6371 HDDS-3840. Use OFS in MapReduce acceptance test (#1365)
add ceeca92 HDDS-4201. Improve the performance of OmKeyLocationInfoGroup
(#1381)
add 642d660 HDDS-4186: Adjust RetryPolicy of SCMConnectionManager for
SCM/Recon (#1373)
add f254183 HDDS-3725. Ozone sh volume client support quota option.
(#1233)
add acfef2d HDDS-4205. Disable coverage upload to codecov for pull
requests (#1394)
add 549a1a0 HDDS-4197. Failed to load existing service definition files:
...SubcommandWithParent (#1386)
add 7bf205c Removing an archaic reference to Skaffold in the README and
other little improvements (#1360)
add 157864a HDDS-4208. Fix table rendering and logo display in docs
(#1391)
add b12f6b6 HDDS-4161. Set fs.defaultFS in docker compose cluster config
to OFS (#1362)
add dc49daa HDDS-4198. Compile Ozone with multiple Java versions (#1387)
add 4b325a8 HDDS-4193. Range used by S3 MultipartUpload copy-from-source
should be incusive (#1384)
add ce02172 HDDS-4202. Upgrade ratis to 1.1.0-ea949f1-SNAPSHOT (#1382)
add 53353c0 HDDS-4204. upgrade docker environment does not work with
KEEP_RUNNING=true (#1388)
add 0a490cb HDDS-3441. Enable TestKeyManagerImpl test cases. (#1326)
add d2c0470 HDDS-4213. Log when a datanode has become dead in the
DeadNodeHandler (#1402)
add 9a4cb9e HDDS-3151. TestCloseContainerHandlingByClient
Enable-testMultiBlockW… (#1333)
add 49e3a1a HDDS-4064. Show container verbose info with verbose option
(#1290)
add 22e4288 HDDS-4170 - Fix typo in method description. (#1406)
add 971a36e HDDS-4150. recon.api.TestEndpoints test is flaky (#1396)
add bfa2801 HDDS-4211. [OFS] Better owner and group display for listing
Ozone volumes and buckets (#1397)
add a7c72fb HDDS-4196. Add an endpoint in Recon to query Prometheus
(#1390)
add 4b96d83 HDDS-4228: add field 'num' to ALLOCATE_BLOCK of scm audit
log. (#1413)
add 04ac1ef HDDS-4129. change MAX_QUOTA_IN_BYTES to Long.MAX_VALUE.
(#1337)
add 2134c2e HDDS-4218.Remove test TestRatisManager (#1409)
add ab7481d HDDS-4217.Remove test TestOzoneContainerRatis (#1408)
add 72e3215 HDDS-4119. Improve performance of the BufferPool management
of Ozone client (#1336)
add 48e8e50 HDDS-3927. Rename Ozone OM,DN,SCM runtime options to conform
to naming conventions (#1401)
add 68869d1 HDDS-4155. Directory and filename can end up with same name
in a path. (#1361)
add def697f HDDS-4039. Reduce the number of fields in hdds.proto to
improve performance (#1289)
add 8e71e81 HDDS-4166. Documentation index page redirects to the wrong
address (#1372)
add 045aa71 HDDS-4075. Retry request on different OM on
AccessControlException (#1303)
add e84f5ce HDDS-4210. ResolveBucket during checkAcls fails. (#1398)
add 7beb2d0 HDDS-4053. Volume space: add quotaUsageInBytes and update it
when write and delete key. (#1296)
add 570d34c HDDS-4244. Container deleted wrong replica cause
mis-replicated. (#1423)
add 69c3e0e HDDS-4250. Fix wrong logger name (#1429)
add 079ee7f HDDS-4104. Provide a way to get the default value and key of
java-based-configuration easily (#1369)
add 241de5a HDDS-4241. Support HADOOP_TOKEN_FILE_LOCATION for Ozone token
CLI. (#1422)
add 0da6cfd HDDS-4247. Fixed log4j usage in some places (#1426)
add 410a246 HDDS-4255. Remove unused Ant and Jdiff dependency versions
(#1433)
add 68d1ab0 HDDS-3981. Add more debug level log to XceiverClientGrpc for
debug purpose (#1214)
add ce0c072 HDDS-3102. ozone getconf command should use the GenericCli
parent class (#1410)
add 1e9ff6c HDDS-3947: Sort DNs for client when the key is a file for
#getFileStatus #listStatus APIs (#1385)
add f3a60dc HDDS-4233. Interrupted exeception printed out from
DatanodeStateMachine (#1416)
add b281d62 HDDS-4206. Attempt pipeline creation more frequently in
acceptance tests (#1389)
add 0eceb4c HDDS-2766. security/SecuringDataNodes.md (#1175)
add a78a4b7 HDDS-4254. Bucket space: add usedBytes and update it when
create and delete key. (#1431)
add 8ca694a HDDS-4236. Move "Om*Codec.java" to new project
hadoop-ozone/interface-storage (#1424)
add 8899ff7 HDDS-4324. Add important comment to ListVolumes logic (#1417)
add 261d34d HDDS-3297. Enable TestOzoneClientKeyGenerator. (#1442)
add 64026dd HDDS-2660. Create insight point for datanode container
protocol (#1272)
add 5f1900a HDDS-4270. Add more reusable byteman scripts to debug
ofs/o3fs performance (#1443)
add c955729 HDDS-4194. Create a script to check AWS S3 compatibility
(#1383)
add 7d0d330 HDDS-4282. Improve the emptyDir syntax (#1450)
add f1cdbe7 HDDS-4263. ReplicatiomManager shouldn't consider origin node
Id for CLOSED containers. (#1438)
add 004dd3f HDDS-4102. Normalize Keypath for lookupKey. (#1328)
add 525ecbb HDDS-3727. Volume space: check quotaUsageInBytes when write
key. (#1434)
add 6267a39 HDDS-4231. Background Service blocks on task results. (#1414)
add 34f3b91 HDDS-4232. Use single thread for KeyDeletingService. (#1415)
add 68642c2 HDDS-4023. Delete closed container after all blocks have been
deleted. (#1338)
add 3ad1034 HDDS-4215. Update Freon doc in source tree. (#1403)
add 2420ee8 HDDS-4288. the icon of hadoop-ozone is bigger than ever
(#1452)
add fdcc696 HDDS-4287: Exclude protobuff classes from
ozone-filesystem-hadoop3 jars (#1455). Contributed by Uma Maheswara Rao G.
add d1ac423 HDDS-3751. Ozone sh client support bucket quota option.
(#1412)
add be25991 HDDS-4292. Ozone Client not working with Hadoop Version < 3.2
(#1463)
add d6a1836 HDDS-4251. Update Ratis version to latest snapshot (#1462)
add 275653e HDDS-3869. Use different column families for datanode block
and metadata (#1298)
add 819b455 HDDS-4302 : Shade the org.apache.common.lang3 package as this
is coming from other hadoop packages as well. (#1469). Contributed by Uma
Maheswara Rao G.
add 7216e3c HDDS-3966. Enable TestOMRatisSnapshots. (#1441)
add 55c9df8 HDDS-4290. Enable insight point for SCM heartbeat protocol
(#1453)
add 60d2bcc HDDS-4274. Change the log level of the SCM Delete block to
improve performance. (#1446)
add f8a62d6 HDDS-3810. Add the logic to distribute open containers among
the pipelines of a datanode. (#1274)
add 5719615 HDDS-4304. Close Container event can fail if pipeline is
removed first. (#1471)
add 8cd86a6 HDDS-4299. Display Ratis version with ozone version (#1464)
add cfff097 HDDS-4271. Avoid logging chunk content in Ozone Insight
(#1466)
add 4ad0318 HDDS-4264. Uniform naming conventions of Ozone Shell Options.
(#1447)
add d6d27e4 HDDS-4242. Copy PrefixInfo proto to new project
hadoop-ozone/interface-storage (#1444)
add 19cb481 HDDS-4156. add hierarchical layout to Chinese doc (#1368)
add b6efb95 HDDS-4280. Document notable configurations for Recon. (#1448)
add 0d7d1e2 HDDS-4298. Use an interface in Ozone client instead of
XceiverClientManager (#1460)
add f9b1ca4 HDDS-4310: Ozone getconf broke the compatibility (#1475)
add efaa4fc HDDS-4309. Fix inconsistency in recon config keys starting
with recon and not ozone (#1478)
add e0a3baf HDDS-4325. Incompatible return codes from Ozone getconf
-confKey (#1485). Contributed by Doroszlai, Attila.
add 55d1e91 HDDS-4316. Upgrade to angular 1.8.0 due to CVE-2020-7676
(#1481)
add d08a4c1 HDDS-3728. Bucket space: check quotaUsageInBytes when write
key and allocate block. (#1458)
add 7704cb5 HDDS-3814. Drop a column family through debug cli tool (#1083)
add a1d53b0 HDDS-4311. Type-safe config design doc points to OM HA (#1477)
add 5c5d8cb HDDS-4312. findbugs check succeeds despite compile error
(#1476)
add 35cc6b0 HDDS-4285. Read is slow due to frequent calls to
UGI.getCurrentUser() and getTokens() (#1454)
add c956ce6 HDDS-4262. Use ClientID and CallID from Rpc Client to detect
retry requests (#1436)
add dc889b4 Remove extra serialization from getBlockID (#1470)
add 7ae037e HDDS-4336. ContainerInfo does not persist BCSID (sequenceId)
leading to failed replica reports (#1488)
add 7db0ea8 HDDS-4122. Implement OM Delete Expired Open Key Request and
Response (#1435)
add 2650723 HDDS-4343. ReplicationManager.handleOverReplicatedContainer()
does not handle unhealthyReplicas properly. (#1495)
add 814428e HDDS-3995. Fix s3g met NPE exception while write file by
multiPartUpload (#1499)
add 342bf6d HDDS-4327. Potential resource leakage using BatchOperation.
(#1493)
add aff7c52 HDDS-4269. Ozone DataNode thinks a volume is failed if an
unexpected file is in the HDDS root directory. (#1490)
add 8fab5f2 HDDS-2922. Balance ratis leader distribution in datanodes
(#1371)
add 25e2046 HDDS-4297. Allow multiple transactions per container to be
sent for deletion by SCM.
add 9baaf64 HDDS-4158. Provide a class type for Java based configuration
(#1407)
add 049793d HDDS-4301. SCM CA certificate does not encode KeyUsage
extension properly (#1468)
add 10df489 HDDS-4328. Provide fallback cache restore key (#1505)
new 6de98c6 Merge branch 'master' into HDDS-2823
new 58394eb HDDS-3837. Add isLeader check in SCMHAManager.
new 3ed29d8 HDDS-4059. SCMStateMachine::applyTransaction() should not
invoke TransactionContext.getClientRequest().
new d482abf HDDS-4125. Pipeline is not removed when a datanode goes stale.
new a70964e HDDS-4130. remove the 1st edition of RatisServer of SCM HA
which is copied from OM HA.
new 9e0dd84 HDDS-3895. Implement container related operations in
ContainerManagerImpl.
new 5f3981c HDDS-4115. CLI command to show current SCM leader and
follower status.
new 9f7ab46 HDDS-3188. Add failover proxy for SCM block location.
new 5111126 HDDS-4192. enable SCM Raft Group based on config
ozone.scm.names.
new 43b87fe HDDS-4365. SCMBlockLocationFailoverProxyProvider should use
ScmBlockLocationProtocolPB.class in RPC.setProtocolEngine.
new 782057a Resolving master merge conflict.
This update added new revisions after undoing existing revisions.
That is to say, some revisions that were in the old version of the
branch are not in the new version. This situation occurs
when a user --force pushes a change and generates a repository
containing something like this:
* -- * -- B -- O -- O -- O (927c58a)
\
N -- N -- N refs/heads/HDDS-2823 (782057a)
You should already have received notification emails for all of the O
revisions, and so the following emails describe only the N revisions
from the common base, B.
Any revisions marked "omit" are not gone; other references still
refer to them. Any revisions marked "discard" are gone forever.
The 11 revisions listed above as "new" are entirely new to this
repository and will be described in separate emails. The revisions
listed as "add" were already present in the repository and have only
been added to this reference.
Summary of changes:
.github/close-pending.sh | 41 ++
.github/closing-message.txt | 7 +
.github/comment-commands/close.sh | 10 +-
.github/comment-commands/pending.sh | 1 +
.../workflows/close-pending.yaml | 18 +-
.github/workflows/post-commit.yml | 317 +++++----
LICENSE.txt | 4 +-
.../byteman/appendlog.btm | 14 +-
dev-support/byteman/hcfs-read.btm | 67 ++
dev-support/byteman/hcfs-write.btm | 111 ++++
.../byteman/ratis-flush.btm | 28 +-
.../byteman/ratis-no-flush.btm | 11 +-
.../byteman/watchforcommit.btm | 29 +-
dev-support/byteman/watchforcommit_all.btm | 47 ++
hadoop-hdds/client/pom.xml | 15 +-
.../hadoop/hdds/scm/XceiverClientFactory.java | 23 +-
.../apache/hadoop/hdds/scm/XceiverClientGrpc.java | 48 +-
.../hadoop/hdds/scm/XceiverClientManager.java | 40 +-
.../apache/hadoop/hdds/scm/XceiverClientRatis.java | 11 +-
.../hadoop/hdds/scm/client/HddsClientUtils.java | 8 +-
.../hadoop/hdds/scm/storage/BlockInputStream.java | 62 +-
.../hadoop/hdds/scm/storage/BlockOutputStream.java | 158 +++--
.../apache/hadoop/hdds/scm/storage/BufferPool.java | 49 +-
.../hadoop/hdds/scm/storage/ChunkInputStream.java | 10 +-
.../hadoop/hdds/scm/storage/CommitWatcher.java | 37 +-
.../hdds/scm/storage/DummyChunkInputStream.java | 2 +-
.../storage/TestBlockOutputStreamCorrectness.java | 224 +++++++
.../hadoop/hdds/scm/storage/TestBufferPool.java | 46 +-
hadoop-hdds/common/pom.xml | 14 +-
hadoop-hdds/common/src/main/conf/hadoop-env.sh | 13 +-
.../org/apache/hadoop/hdds/cli/GenericCli.java | 21 +
.../hadoop/hdds/cli/SubcommandWithParent.java} | 13 +-
.../org/apache/hadoop/hdds/cli/package-info.java | 4 +-
.../org/apache/hadoop/hdds/client/OzoneQuota.java | 240 ++++---
.../hadoop/hdds/protocol/DatanodeDetails.java | 83 ++-
.../org/apache/hadoop/hdds/ratis/RatisHelper.java | 19 +
.../RequestTypeDependentRetryPolicyCreator.java | 8 +-
.../apache/hadoop/hdds/recon/ReconConfigKeys.java | 4 +
.../hadoop/hdds/scm/ByteStringConversion.java | 18 +-
.../PipelineChoosePolicy.java} | 19 +-
.../PipelineRequestInformation.java} | 49 +-
.../java/org/apache/hadoop/hdds/scm/ScmConfig.java | 23 +
.../org/apache/hadoop/hdds/scm/ScmConfigKeys.java | 13 +
.../apache/hadoop/hdds/scm/XceiverClientSpi.java | 15 +-
.../hadoop/hdds/scm/container/ContainerInfo.java | 2 +
.../hadoop/hdds/scm/exceptions/SCMException.java | 2 +
.../hadoop/hdds/scm/net/NetworkTopologyImpl.java | 2 +-
.../apache/hadoop/hdds/scm/pipeline/Pipeline.java | 42 +-
.../hdds/scm/storage/ContainerProtocolCalls.java | 229 ++++---
.../x509/certificate/utils/CertificateCodec.java | 2 +-
.../hadoop/hdds/utils/BackgroundService.java | 73 +--
.../apache/hadoop/hdds/utils/BackgroundTask.java | 4 +-
.../hadoop/hdds/utils/BackgroundTaskQueue.java | 5 +-
.../{VersionInfo.java => RatisVersionInfo.java} | 66 +-
.../org/apache/hadoop/hdds/utils/Scheduler.java | 2 +-
.../org/apache/hadoop/hdds/utils/VersionInfo.java | 9 +-
.../org/apache/hadoop/ozone/OzoneConfigKeys.java | 1 +
.../java/org/apache/hadoop/ozone/OzoneConsts.java | 57 +-
.../apache/hadoop/ozone/common/ChunkBuffer.java | 14 +-
.../common/ChunkBufferImplWithByteBuffer.java | 10 +-
.../org/apache/hadoop/ozone/common/Storage.java | 2 +-
.../container/common/helpers/ChunkInfoList.java | 56 ++
.../common/src/main/resources/ozone-default.xml | 55 +-
.../hadoop/hdds/conf/SimpleConfiguration.java | 13 +
.../hadoop/hdds/conf/TestOzoneConfiguration.java | 7 +-
.../hadoop/hdds/protocol/MockDatanodeDetails.java | 2 +-
.../hadoop/hdds/scm/pipeline/MockPipeline.java | 29 +-
.../hadoop/ozone/audit/TestOzoneAuditLogger.java | 62 +-
.../hadoop/ozone/common/TestChunkBuffer.java | 16 +-
hadoop-hdds/config/pom.xml | 4 +-
.../org/apache/hadoop/hdds/conf/ConfigType.java | 3 +-
.../hdds/conf/ConfigurationReflectionUtil.java | 57 ++
...{ConfigType.java => InMemoryConfiguration.java} | 50 +-
.../hdds/conf/TestConfigurationReflectionUtil.java | 111 ++++
hadoop-hdds/container-service/pom.xml | 11 +-
.../container/common/helpers/ContainerUtils.java | 66 +-
.../container/common/impl/ContainerDataYaml.java | 3 +
.../container/common/impl/HddsDispatcher.java | 61 +-
.../container/common/interfaces/BlockIterator.java | 5 +-
.../container/common/interfaces/Container.java | 7 -
.../common/statemachine/DatanodeStateMachine.java | 7 +-
.../common/statemachine/SCMConnectionManager.java | 9 +-
.../CloseContainerCommandHandler.java | 2 +-
.../CreatePipelineCommandHandler.java | 12 +-
.../commandhandler/DeleteBlocksCommandHandler.java | 92 +--
.../states/endpoint/RegisterEndpointTask.java | 6 +-
.../common/transport/server/XceiverServerSpi.java | 10 +-
.../server/ratis/ContainerStateMachine.java | 2 +-
.../transport/server/ratis/XceiverServerRatis.java | 33 +-
.../container/common/utils/ContainerCache.java | 34 +-
.../container/common/utils/HddsVolumeUtil.java | 7 +-
.../container/common/utils/ReferenceCountedDB.java | 10 +-
.../container/keyvalue/KeyValueBlockIterator.java | 156 -----
.../container/keyvalue/KeyValueContainer.java | 29 +-
.../container/keyvalue/KeyValueContainerCheck.java | 12 +-
.../container/keyvalue/KeyValueContainerData.java | 48 +-
.../ozone/container/keyvalue/KeyValueHandler.java | 18 +-
.../container/keyvalue/helpers/BlockUtils.java | 2 +-
.../keyvalue/helpers/KeyValueContainerUtil.java | 184 ++++--
.../container/keyvalue/impl/BlockManagerImpl.java | 124 ++--
.../keyvalue/interfaces/BlockManager.java | 12 +
.../background/BlockDeletingService.java | 75 ++-
.../metadata/AbstractDatanodeDBDefinition.java | 74 +++
.../container/metadata/AbstractDatanodeStore.java | 297 +++++++++
.../ozone/container/metadata/BlockDataCodec.java | 47 ++
.../container/metadata/ChunkInfoListCodec.java | 45 ++
.../metadata/DatanodeSchemaOneDBDefinition.java | 91 +++
.../metadata/DatanodeSchemaTwoDBDefinition.java | 81 +++
.../ozone/container/metadata/DatanodeStore.java | 94 +++
.../metadata/DatanodeStoreSchemaOneImpl.java | 49 ++
.../metadata/DatanodeStoreSchemaTwoImpl.java | 44 ++
.../ozone/container/metadata/DatanodeTable.java | 130 ++++
.../metadata/SchemaOneChunkInfoListCodec.java | 68 ++
.../metadata/SchemaOneDeletedBlocksTable.java | 180 +++++
.../container/metadata/SchemaOneKeyCodec.java | 106 +++
.../ozone/container/metadata}/package-info.java | 8 +-
.../protocol/StorageContainerDatanodeProtocol.java | 14 +-
.../protocol/commands/CreatePipelineCommand.java | 46 +-
...inerDatanodeProtocolClientSideTranslatorPB.java | 12 +-
...inerDatanodeProtocolServerSideTranslatorPB.java | 4 +-
.../main/resources/webapps/hddsDatanode/index.html | 4 +-
.../ozone/container/ContainerTestHelper.java | 5 +
.../hadoop/ozone/container/common/ScmTestMock.java | 9 +-
.../container/common/TestBlockDeletingService.java | 113 +++-
.../ozone/container/common/TestContainerCache.java | 25 +-
.../common/TestKeyValueContainerData.java | 3 +
.../TestSchemaOneBackwardsCompatibility.java | 626 ++++++++++++++++++
.../common/impl/TestContainerDataYaml.java | 3 +
.../TestCreatePipelineCommandHandler.java | 7 +-
.../keyvalue/TestKeyValueBlockIterator.java | 340 ++++++----
.../container/keyvalue/TestKeyValueContainer.java | 75 +--
.../keyvalue/TestKeyValueContainerCheck.java | 18 +-
.../container/ozoneimpl/TestContainerReader.java | 59 +-
.../container/ozoneimpl/TestOzoneContainer.java | 14 +-
.../test/resources/123-dn-container.db/000024.sst | Bin 0 -> 1022 bytes
.../test/resources/123-dn-container.db/000026.sst | Bin 0 -> 827 bytes
.../test/resources/123-dn-container.db/000032.sst | Bin 0 -> 896 bytes
.../test/resources/123-dn-container.db/000034.log | 0
.../src/test/resources/123-dn-container.db/CURRENT | 1 +
.../test/resources/123-dn-container.db/IDENTITY | 1 +
.../resources/123-dn-container.db/MANIFEST-000033 | Bin 0 -> 297 bytes
.../resources/123-dn-container.db/OPTIONS-000033 | 165 +++++
.../resources/123-dn-container.db/OPTIONS-000036 | 165 +++++
.../src/test/resources/123.container | 10 +
hadoop-hdds/docs/content/_index.md | 5 +-
hadoop-hdds/docs/content/_index.zh.md | 2 +-
hadoop-hdds/docs/content/beyond/Containers.md | 234 -------
hadoop-hdds/docs/content/beyond/Containers.zh.md | 203 ------
.../docs/content/beyond/DockerCheatSheet.md | 88 ---
.../docs/content/beyond/DockerCheatSheet.zh.md | 85 ---
hadoop-hdds/docs/content/beyond/_index.md | 30 -
hadoop-hdds/docs/content/beyond/_index.zh.md | 27 -
hadoop-hdds/docs/content/concept/Containers.md | 47 ++
hadoop-hdds/docs/content/concept/Containers.png | Bin 0 -> 24775 bytes
hadoop-hdds/docs/content/concept/Datanodes.md | 5 +-
hadoop-hdds/docs/content/concept/Datanodes.zh.md | 3 +
hadoop-hdds/docs/content/concept/Hdds.md | 52 --
hadoop-hdds/docs/content/concept/Overview.md | 7 +-
hadoop-hdds/docs/content/concept/Overview.zh.md | 7 +-
.../docs/content/concept/OzoneManager-ReadPath.png | Bin 0 -> 81030 bytes
.../content/concept/OzoneManager-WritePath.png | Bin 0 -> 96696 bytes
hadoop-hdds/docs/content/concept/OzoneManager.md | 63 +-
hadoop-hdds/docs/content/concept/OzoneManager.png | Bin 0 -> 13327 bytes
.../docs/content/concept/OzoneManager.zh.md | 9 +
.../content/concept/StorageContainerManager.md | 99 +++
.../content/concept/StorageContainerManager.png | Bin 0 -> 13336 bytes
.../{Hdds.zh.md => StorageContainerManager.zh.md} | 9 +
hadoop-hdds/docs/content/concept/_index.md | 4 +-
hadoop-hdds/docs/content/concept/_index.zh.md | 2 +-
hadoop-hdds/docs/content/design/ec.md | 39 ++
.../docs/content/design/namespace-support.md | 6 +-
hadoop-hdds/docs/content/design/ofs.md | 135 ----
.../docs/content/design/storage-class.md | 17 +-
.../design/{namespace-support.md => topology.md} | 18 +-
hadoop-hdds/docs/content/design/typesafeconfig.md | 10 +-
...e-volume-management.md => volume-management.md} | 0
hadoop-hdds/docs/content/feature/GDPR.md | 80 +++
.../GDPR in Ozone.zh.md => feature/GDPR.zh.md} | 5 +
.../docs/content/feature/HA-OM-doublebuffer.png | Bin 0 -> 77661 bytes
hadoop-hdds/docs/content/feature/HA-OM.png | Bin 0 -> 60888 bytes
hadoop-hdds/docs/content/feature/HA.md | 115 ++++
hadoop-hdds/docs/content/feature/Observability.md | 224 +++++++
hadoop-hdds/docs/content/feature/Recon.md | 47 ++
hadoop-hdds/docs/content/feature/Topology.md | 108 +++
.../docs/content/{gdpr => feature}/_index.md | 12 +-
.../docs/content/{gdpr => feature}/_index.zh.md | 0
hadoop-hdds/docs/content/gdpr/GDPR in Ozone.md | 42 --
hadoop-hdds/docs/content/interface/CSI.md | 15 +-
hadoop-hdds/docs/content/interface/CSI.png | Bin 0 -> 27210 bytes
hadoop-hdds/docs/content/interface/CSI.zh.md | 92 +++
hadoop-hdds/docs/content/interface/Cli.md | 208 ++++++
hadoop-hdds/docs/content/interface/JavaApi.md | 5 +-
hadoop-hdds/docs/content/interface/JavaApi.zh.md | 3 +
.../docs/content/interface/{OzoneFS.md => O3fs.md} | 79 +--
.../interface/{OzoneFS.zh.md => O3fs.zh.md} | 14 +-
.../content/{design/ofs.md => interface/Ofs.md} | 121 +++-
hadoop-hdds/docs/content/interface/S3.md | 23 +-
hadoop-hdds/docs/content/interface/S3.zh.md | 3 +
hadoop-hdds/docs/content/interface/_index.md | 4 +-
hadoop-hdds/docs/content/recipe/Prometheus.md | 5 +-
hadoop-hdds/docs/content/recipe/Prometheus.zh.md | 7 +-
hadoop-hdds/docs/content/security/SecureOzone.md | 3 +
.../docs/content/security/SecureOzone.zh.md | 6 +-
.../docs/content/security/SecuringDatanodes.md | 39 +-
.../docs/content/security/SecuringDatanodes.zh.md | 53 ++
.../docs/content/security/SecuringOzoneHTTP.md | 7 +-
hadoop-hdds/docs/content/security/SecuringS3.md | 5 +-
hadoop-hdds/docs/content/security/SecuringS3.zh.md | 3 +
hadoop-hdds/docs/content/security/SecuringTDE.md | 5 +-
.../docs/content/security/SecuringTDE.zh.md | 3 +
hadoop-hdds/docs/content/security/SecurityAcls.md | 3 +
.../docs/content/security/SecurityAcls.zh.md | 3 +
...{SecuityWithRanger.md => SecurityWithRanger.md} | 5 +-
...tyWithRanger.zh.md => SecurityWithRanger.zh.md} | 3 +
hadoop-hdds/docs/content/shell/BucketCommands.md | 100 ---
.../docs/content/shell/BucketCommands.zh.md | 98 ---
hadoop-hdds/docs/content/shell/Format.md | 69 --
hadoop-hdds/docs/content/shell/Format.zh.md | 65 --
hadoop-hdds/docs/content/shell/KeyCommands.md | 177 -----
hadoop-hdds/docs/content/shell/KeyCommands.zh.md | 176 -----
hadoop-hdds/docs/content/shell/VolumeCommands.md | 114 ----
.../docs/content/shell/VolumeCommands.zh.md | 108 ---
hadoop-hdds/docs/content/shell/_index.md | 28 -
hadoop-hdds/docs/content/shell/_index.zh.md | 27 -
hadoop-hdds/docs/content/start/FromSource.md | 38 +-
hadoop-hdds/docs/content/start/FromSource.zh.md | 7 +-
hadoop-hdds/docs/content/tools/TestTools.md | 14 +-
hadoop-hdds/docs/content/tools/TestTools.zh.md | 14 +-
hadoop-hdds/docs/content/tools/_index.md | 6 +-
hadoop-hdds/docs/pom.xml | 4 +-
.../themes/ozonedoc/layouts/_default/single.html | 2 +-
.../themes/ozonedoc/layouts/design/section.html | 2 +-
.../ozonedoc/layouts/partials/languages.html | 3 +-
.../themes/ozonedoc/layouts/partials/navbar.html | 6 +-
.../themes/ozonedoc/layouts/partials/sidebar.html | 14 +-
.../docs/themes/ozonedoc/static/css/ozonedoc.css | 23 +-
hadoop-hdds/framework/pom.xml | 4 +-
.../x509/certificate/authority/BaseApprover.java | 2 +-
.../certificates/utils/CertificateSignRequest.java | 2 +-
.../certificates/utils/SelfSignedCertificate.java | 4 +-
.../server/OzoneProtocolMessageDispatcher.java | 41 +-
.../apache/hadoop/hdds/utils/HddsServerUtil.java | 13 +
.../hadoop/hdds/utils/MetadataKeyFilters.java | 42 +-
.../apache/hadoop/hdds/utils/db/DBDefinition.java | 41 +-
.../org/apache/hadoop/hdds/utils/db/DBStore.java | 8 +-
.../hadoop/hdds/utils/db/DBStoreBuilder.java | 41 +-
.../org/apache/hadoop/hdds/utils/db/RDBStore.java | 17 +-
.../org/apache/hadoop/hdds/utils/db/RDBTable.java | 105 +++
.../org/apache/hadoop/hdds/utils/db/Table.java | 69 ++
.../apache/hadoop/hdds/utils/db/TypedTable.java | 59 ++
.../resources/webapps/static/angular-1.7.9.min.js | 350 ----------
.../resources/webapps/static/angular-1.8.0.min.js | 350 ++++++++++
...ute-1.7.9.min.js => angular-route-1.8.0.min.js} | 6 +-
.../apache/hadoop/hdds/server/TestJsonUtils.java | 5 +-
hadoop-hdds/hadoop-dependency-client/README.md | 18 +-
hadoop-hdds/hadoop-dependency-client/pom.xml | 4 +-
hadoop-hdds/hadoop-dependency-server/pom.xml | 4 +-
hadoop-hdds/hadoop-dependency-test/pom.xml | 4 +-
hadoop-hdds/interface-admin/pom.xml | 4 +-
hadoop-hdds/interface-client/pom.xml | 4 +-
.../src/main/proto/DatanodeClientProtocol.proto | 4 +
.../interface-client/src/main/proto/hdds.proto | 18 +-
.../interface-client/src/main/resources/proto.lock | 40 +-
hadoop-hdds/interface-server/pom.xml | 4 +-
.../proto/ScmServerDatanodeHeartbeatProtocol.proto | 3 +-
.../src/main/proto/ScmServerProtocol.proto | 4 +-
.../interface-server/src/main/resources/proto.lock | 104 +--
hadoop-hdds/pom.xml | 10 +-
hadoop-hdds/server-scm/pom.xml | 5 +-
.../hadoop/hdds/scm/block/BlockManagerImpl.java | 16 +-
.../block/DatanodeDeletedBlockTransactions.java | 32 +-
.../hadoop/hdds/scm/block/DeletedBlockLogImpl.java | 24 +-
.../hdds/scm/block/SCMBlockDeletingService.java | 7 +-
.../container/AbstractContainerReportHandler.java | 101 ++-
.../scm/container/CloseContainerEventHandler.java | 2 +-
.../hdds/scm/container/ContainerReplica.java | 43 +-
.../hdds/scm/container/ContainerReportHandler.java | 14 +-
.../IncrementalContainerReportHandler.java | 2 +-
.../hdds/scm/container/ReplicationManager.java | 133 +++-
.../hdds/scm/container/SCMContainerManager.java | 66 +-
.../apache/hadoop/hdds/scm/ha/SCMHAManager.java | 2 +-
.../hadoop/hdds/scm/ha/SCMHAManagerImpl.java | 2 +-
.../apache/hadoop/hdds/scm/node/DatanodeInfo.java | 33 +
.../hadoop/hdds/scm/node/DeadNodeHandler.java | 2 +-
.../hadoop/hdds/scm/node/NewNodeHandler.java | 2 +-
.../apache/hadoop/hdds/scm/node/NodeManager.java | 6 +-
.../hadoop/hdds/scm/node/NodeStateManager.java | 30 +-
.../scm/node/NonHealthyToHealthyNodeHandler.java | 2 +-
.../hadoop/hdds/scm/node/SCMNodeManager.java | 53 +-
.../scm/pipeline/BackgroundPipelineCreator.java | 35 +-
.../hadoop/hdds/scm/pipeline/PipelineFactory.java | 3 +-
.../hadoop/hdds/scm/pipeline/PipelineManager.java | 6 +-
.../hdds/scm/pipeline/PipelineManagerMXBean.java | 2 +-
.../hdds/scm/pipeline/PipelineManagerV2Impl.java | 24 +-
.../hdds/scm/pipeline/PipelinePlacementPolicy.java | 42 +-
.../hdds/scm/pipeline/PipelineReportHandler.java | 2 +-
.../hdds/scm/pipeline/PipelineStateManager.java | 5 -
.../scm/pipeline/PipelineStateManagerV2Impl.java | 5 -
.../hdds/scm/pipeline/RatisPipelineProvider.java | 39 +-
.../hdds/scm/pipeline/RatisPipelineUtils.java | 2 +-
.../hdds/scm/pipeline/SCMPipelineManager.java | 16 +-
.../hadoop/hdds/scm/pipeline/StateManager.java | 1 -
.../algorithms/HealthyPipelineChoosePolicy.java} | 28 +-
.../algorithms/PipelineChoosePolicyFactory.java | 106 +++
.../algorithms/RandomPipelineChoosePolicy.java} | 20 +-
.../pipeline/choose/algorithms/package-info.java} | 14 +-
.../algorithms/DefaultLeaderChoosePolicy.java} | 24 +-
.../choose/algorithms/LeaderChoosePolicy.java | 55 ++
.../algorithms/LeaderChoosePolicyFactory.java | 75 +++
.../algorithms/MinLeaderCountChoosePolicy.java | 91 +++
.../leader/choose/algorithms/package-info.java} | 13 +-
.../SCMSecurityProtocolServerSideTranslatorPB.java | 17 +-
...lockLocationProtocolServerSideTranslatorPB.java | 2 +-
...inerLocationProtocolServerSideTranslatorPB.java | 17 +-
.../hdds/scm/safemode/ContainerSafeModeRule.java | 4 +-
.../hdds/scm/server/SCMBlockProtocolServer.java | 7 +-
.../hdds/scm/server/SCMDatanodeProtocolServer.java | 4 +-
.../apache/hadoop/hdds/scm/server/SCMMXBean.java | 4 +
.../hdds/scm/server/StorageContainerManager.java | 16 +
.../src/main/resources/webapps/scm/index.html | 4 +-
.../main/resources/webapps/scm/scm-overview.html | 18 +-
.../src/main/resources/webapps/scm/scm.js | 4 -
.../java/org/apache/hadoop/hdds/scm/TestUtils.java | 1 +
.../hadoop/hdds/scm/block/TestBlockManager.java | 69 ++
.../hadoop/hdds/scm/block/TestDeletedBlockLog.java | 17 +-
.../hadoop/hdds/scm/container/MockNodeManager.java | 41 +-
.../scm/container/TestContainerReportHandler.java | 197 +++++-
.../hdds/scm/container/TestReplicationManager.java | 92 +++
.../hadoop/hdds/scm/ha/MockSCMHAManager.java | 4 +-
.../hadoop/hdds/scm/ha/TestSCMRatisResponse.java | 4 +-
.../hadoop/hdds/scm/node/TestDeadNodeHandler.java | 5 +-
.../hadoop/hdds/scm/node/TestSCMNodeManager.java | 4 +-
.../hdds/scm/pipeline/MockPipelineManager.java | 15 +-
.../scm/pipeline/MockRatisPipelineProvider.java | 9 +-
.../scm/pipeline/TestPipelineActionHandler.java | 2 +-
.../hdds/scm/pipeline/TestPipelineManagerImpl.java | 2 +-
.../scm/pipeline/TestPipelinePlacementPolicy.java | 85 ++-
.../hdds/scm/pipeline/TestSCMPipelineManager.java | 74 +++
.../TestPipelineChoosePolicyFactory.java | 94 +++
.../choose/algorithms/TestLeaderChoosePolicy.java | 74 +++
.../ozone/container/common/TestEndPoint.java | 2 +-
.../testutils/ReplicationNodeManagerMock.java | 12 +-
hadoop-hdds/test-utils/pom.xml | 4 +-
hadoop-hdds/tools/pom.xml | 12 +-
.../org/apache/hadoop/hdds/cli/OzoneAdmin.java | 67 ++
.../org/apache/hadoop/hdds/cli/package-info.java | 6 +-
.../hdds/scm/cli/ReplicationManagerCommands.java | 23 +-
.../scm/cli/ReplicationManagerStartSubcommand.java | 21 +-
.../cli/ReplicationManagerStatusSubcommand.java | 32 +-
.../scm/cli/ReplicationManagerStopSubcommand.java | 25 +-
.../hdds/scm/cli/SafeModeCheckSubcommand.java | 40 +-
.../hadoop/hdds/scm/cli/SafeModeCommands.java | 27 +-
.../hdds/scm/cli/SafeModeExitSubcommand.java | 22 +-
.../hdds/scm/cli/SafeModeWaitSubcommand.java | 13 +-
.../org/apache/hadoop/hdds/scm/cli/ScmOption.java | 72 ++
.../WithScmClient.java => ScmSubcommand.java} | 24 +-
.../hadoop/hdds/scm/cli/TopologySubcommand.java | 65 +-
.../hdds/scm/cli/container/CloseSubcommand.java | 20 +-
.../hdds/scm/cli/container/ContainerCommands.java | 21 +-
.../hdds/scm/cli/container/CreateSubcommand.java | 26 +-
.../hdds/scm/cli/container/DeleteSubcommand.java | 20 +-
.../hdds/scm/cli/container/InfoSubcommand.java | 48 +-
.../hdds/scm/cli/container/ListSubcommand.java | 32 +-
.../hdds/scm/cli/datanode/DatanodeCommands.java | 21 +-
.../hdds/scm/cli/datanode/ListInfoSubcommand.java | 48 +-
.../cli/pipeline/ActivatePipelineSubcommand.java | 19 +-
.../scm/cli/pipeline/ClosePipelineSubcommand.java | 19 +-
.../scm/cli/pipeline/CreatePipelineSubcommand.java | 48 +-
.../cli/pipeline/DeactivatePipelineSubcommand.java | 19 +-
.../scm/cli/pipeline/ListPipelinesSubcommand.java | 40 +-
.../hdds/scm/cli/pipeline/PipelineCommands.java | 22 +-
hadoop-ozone/client/pom.xml | 4 +-
.../org/apache/hadoop/ozone/client/BucketArgs.java | 43 +-
.../apache/hadoop/ozone/client/ObjectStore.java | 3 +
.../apache/hadoop/ozone/client/OzoneBucket.java | 103 +++
.../hadoop/ozone/client/OzoneClientFactory.java | 8 +-
.../apache/hadoop/ozone/client/OzoneVolume.java | 103 ++-
.../org/apache/hadoop/ozone/client/VolumeArgs.java | 45 +-
.../ozone/client/io/BlockOutputStreamEntry.java | 30 +-
.../client/io/BlockOutputStreamEntryPool.java | 34 +-
.../hadoop/ozone/client/io/KeyInputStream.java | 98 +--
.../hadoop/ozone/client/io/KeyOutputStream.java | 60 +-
.../hadoop/ozone/client/io/OzoneInputStream.java | 5 +
.../ozone/client/protocol/ClientProtocol.java | 29 +-
.../apache/hadoop/ozone/client/rpc/RpcClient.java | 110 +++-
hadoop-ozone/common/pom.xml | 4 +-
.../main/java/org/apache/hadoop/ozone/OmUtils.java | 28 +
.../org/apache/hadoop/ozone/audit/OMAction.java | 1 +
.../apache/hadoop/ozone/freon/OzoneGetConf.java | 278 --------
.../hadoop/ozone/om/exceptions/OMException.java | 7 +-
.../ozone/om/exceptions/OMNotLeaderException.java | 2 +-
.../ozone/om/ha/OMFailoverProxyProvider.java | 253 ++++++--
.../hadoop/ozone/om/helpers/OmBucketArgs.java | 50 +-
.../hadoop/ozone/om/helpers/OmBucketInfo.java | 78 ++-
.../hadoop/ozone/om/helpers/OmKeyLocationInfo.java | 6 +-
.../ozone/om/helpers/OmKeyLocationInfoGroup.java | 8 +-
.../hadoop/ozone/om/helpers/OmRenameKeys.java | 59 ++
.../hadoop/ozone/om/helpers/OmVolumeArgs.java | 64 +-
.../hadoop/ozone/om/helpers/OzoneFileStatus.java | 18 +
.../ozone/om/protocol/OzoneManagerProtocol.java | 15 +-
.../ozone/om/protocolPB/Hadoop3OmTransport.java | 175 +----
...OzoneManagerProtocolClientSideTranslatorPB.java | 44 +-
.../ozone/security/OzoneTokenIdentifier.java | 5 +-
.../apache/hadoop/ozone/util/OzoneVersionInfo.java | 15 +-
.../hadoop/ozone/om/helpers/TestOmVolumeArgs.java | 4 +-
hadoop-ozone/csi/pom.xml | 4 +-
hadoop-ozone/datanode/pom.xml | 4 +-
hadoop-ozone/dev-support/checks/build.sh | 2 +-
hadoop-ozone/dev-support/checks/findbugs.sh | 7 +-
hadoop-ozone/dev-support/checks/kubernetes.sh | 2 +-
hadoop-ozone/dev-support/intellij/core-site.xml | 27 +
hadoop-ozone/dist/README.md | 52 +-
.../dist/dev-support/bin/dist-layout-stitching | 3 +
hadoop-ozone/dist/pom.xml | 4 +-
hadoop-ozone/dist/src/main/compose/failing1/.env | 1 +
.../src/main/compose/failing1/docker-compose.yaml | 1 +
.../dist/src/main/compose/failing1/docker-config | 1 +
.../compose/{ozone-om-ha-s3 => failing1}/test.sh | 10 +-
hadoop-ozone/dist/src/main/compose/failing2/.env | 1 +
.../src/main/compose/failing2/docker-compose.yaml | 1 +
.../dist/src/main/compose/failing2/docker-config | 1 +
.../compose/{ozone-om-ha-s3 => failing2}/test.sh | 10 +-
.../dist/src/main/compose/ozone-csi/docker-config | 3 +
.../dist/src/main/compose/{ozone => ozone-ha}/.env | 0
.../src/main/compose/ozone-ha/docker-compose.yaml | 93 +++
.../compose/{ozone-csi => ozone-ha}/docker-config | 19 +-
.../compose/{ozone-om-ha-s3 => ozone-ha}/test.sh | 7 +-
.../dist/src/main/compose/ozone-mr/common-config | 3 +-
.../main/compose/ozone-mr/hadoop27/docker-config | 1 +
.../src/main/compose/ozone-mr/hadoop27/test.sh | 7 +-
.../main/compose/ozone-mr/hadoop31/docker-config | 1 +
.../src/main/compose/ozone-mr/hadoop31/test.sh | 7 +-
.../main/compose/ozone-mr/hadoop32/docker-config | 1 +
.../src/main/compose/ozone-mr/hadoop32/test.sh | 7 +-
.../dist/src/main/compose/ozone-mr/test.sh | 22 +-
.../src/main/compose/ozone-om-ha-s3/docker-config | 5 +-
.../dist/src/main/compose/ozone-om-ha-s3/test.sh | 2 +
.../src/main/compose/ozone-om-ha/docker-config | 4 +-
.../src/main/compose/ozone-topology/docker-config | 7 +-
.../dist/src/main/compose/ozone/docker-config | 7 +-
.../src/main/compose/ozoneblockade/docker-config | 2 +
.../src/main/compose/ozones3-haproxy/docker-config | 3 +
.../src/main/compose/ozonesecure-mr/docker-config | 4 +-
.../dist/src/main/compose/ozonesecure-mr/test.sh | 5 +-
.../main/compose/ozonesecure-om-ha/docker-config | 11 +-
.../src/main/compose/ozonesecure-om-ha/test.sh | 2 +
.../src/main/compose/ozonesecure/docker-config | 9 +-
hadoop-ozone/dist/src/main/compose/test-all.sh | 21 +-
hadoop-ozone/dist/src/main/compose/testlib.sh | 48 +-
.../dist/src/main/compose/upgrade/README.md | 2 +-
.../dist/src/main/compose/upgrade/docker-config | 3 +-
hadoop-ozone/dist/src/main/compose/upgrade/test.sh | 5 +-
.../src/main/compose/upgrade/versions/README.md | 2 +-
.../main/compose/upgrade/versions/ozone-0.5.0.sh | 1 +
.../versions/{ozone-0.6.0.sh => ozone-1.0.0.sh} | 1 +
.../main/k8s/definitions/ozone/freon/freon.yaml | 2 +-
.../getting-started/freon/freon-deployment.yaml | 2 +-
.../src/main/k8s/examples/getting-started/test.sh | 2 +
.../examples/minikube/freon/freon-deployment.yaml | 2 +-
.../dist/src/main/k8s/examples/minikube/test.sh | 2 +
.../ozone-dev/csi/csi-provisioner-deployment.yaml | 2 +-
.../examples/ozone-dev/freon/freon-deployment.yaml | 2 +-
.../dist/src/main/k8s/examples/ozone-dev/test.sh | 2 +
.../ozone/csi/csi-provisioner-deployment.yaml | 2 +-
.../k8s/examples/ozone/freon/freon-deployment.yaml | 2 +-
.../dist/src/main/k8s/examples/ozone/test.sh | 2 +
.../dist/src/main/k8s/examples/test-all.sh | 11 +-
hadoop-ozone/dist/src/main/k8s/examples/testlib.sh | 11 +-
hadoop-ozone/dist/src/main/license/bin/LICENSE.txt | 4 +-
.../loaddata.robot => admincli/admin.robot} | 23 +-
.../src/main/smoketest/admincli/container.robot | 73 +++
.../src/main/smoketest/admincli/datanode.robot | 19 +-
.../src/main/smoketest/admincli/pipeline.robot | 49 +-
.../smoketest/admincli/replicationmanager.robot | 53 ++
.../src/main/smoketest/admincli/safemode.robot | 45 ++
.../main/smoketest/auditparser/auditparser.robot | 2 +-
.../dist/src/main/smoketest/basic/basic.robot | 2 +-
.../dist/src/main/smoketest/basic/getconf.robot | 46 ++
.../{ozone-shell.robot => ozone-shell-lib.robot} | 78 ++-
.../ozone-shell-single.robot} | 11 +-
.../src/main/smoketest/basic/ozone-shell.robot | 121 +---
.../dist/src/main/smoketest/createbucketenv.robot | 2 +-
.../dist/src/main/smoketest/createmrenv.robot | 15 +-
.../src/main/smoketest/debug/ozone-debug.robot | 6 +-
.../src/main/smoketest/failing/test1.robot} | 7 +-
.../src/main/smoketest/failing/test2.robot} | 7 +-
.../dist/src/main/smoketest/freon/freon.robot | 2 +-
.../dist/src/main/smoketest/gdpr/gdpr.robot | 2 +-
.../dist/src/main/smoketest/mapreduce.robot | 11 +-
.../main/smoketest/om-ratis/testOMAdminCmd.robot | 2 +-
.../dist/src/main/smoketest/omha/testOMHA.robot | 2 +-
.../src/main/smoketest/ozonefs/hadoopo3fs.robot | 12 +-
.../dist/src/main/smoketest/ozonefs/setup.robot | 8 +-
.../dist/src/main/smoketest/recon/recon-api.robot | 2 +-
hadoop-ozone/dist/src/main/smoketest/robot.robot | 81 ---
.../src/main/smoketest/s3/MultipartUpload.robot | 130 ++--
.../dist/src/main/smoketest/s3/commonawslib.robot | 5 +
.../dist/src/main/smoketest/s3/objectcopy.robot | 23 +-
.../dist/src/main/smoketest/s3/objectdelete.robot | 28 +-
.../src/main/smoketest/s3/objectmultidelete.robot | 24 +-
.../dist/src/main/smoketest/s3/objectputget.robot | 40 +-
.../src/main/smoketest/s3/s3_compatbility_check.sh | 47 ++
.../smoketest/security/ozone-secure-token.robot | 16 +-
.../dist/src/main/smoketest/spnego/web.robot | 2 +-
.../src/main/smoketest/topology/loaddata.robot | 2 +-
hadoop-ozone/dist/src/shell/ozone/ozone | 17 +-
hadoop-ozone/dist/src/shell/ozone/stop-ozone.sh | 8 +-
.../dist/src/shell/upgrade/{0.6.0.sh => 1.0.0.sh} | 2 +-
.../upgrade/{0.6.0 => 1.0.0}/01-migrate-scm-db.sh | 0
.../fault-injection-test/mini-chaos-tests/pom.xml | 4 +-
.../hadoop/ozone/TestMiniChaosOzoneCluster.java | 40 +-
.../services/org.apache.hadoop.fs.FileSystem | 1 +
.../fault-injection-test/network-tests/pom.xml | 2 +-
.../src/test/blockade/ozone/client.py | 10 +-
hadoop-ozone/fault-injection-test/pom.xml | 4 +-
hadoop-ozone/insight/pom.xml | 4 +-
.../hadoop/ozone/insight/BaseInsightPoint.java | 34 +-
.../ozone/insight/BaseInsightSubCommand.java | 6 +
.../org/apache/hadoop/ozone/insight/Insight.java | 4 +
.../apache/hadoop/ozone/insight/InsightPoint.java | 4 +-
.../hadoop/ozone/insight/MetricGroupDisplay.java | 4 +-
.../hadoop/ozone/insight/MetricsSubCommand.java | 33 +-
.../datanode/DatanodeDispatcherInsight.java | 107 +++
.../insight/datanode/PipelineComponentUtil.java | 78 +++
.../ozone/insight/datanode/RatisInsight.java | 45 +-
.../hadoop/ozone/insight/om/KeyManagerInsight.java | 2 +-
.../hadoop/ozone/insight/om/OmProtocolInsight.java | 2 +-
.../ozone/insight/scm/NodeManagerInsight.java | 2 +-
.../ozone/insight/scm/ReplicaManagerInsight.java | 2 +-
.../scm/ScmProtocolBlockLocationInsight.java | 2 +-
.../scm/ScmProtocolContainerLocationInsight.java | 2 +-
.../insight/scm/ScmProtocolDatanodeInsight.java | 2 +-
.../insight/scm/ScmProtocolSecurityInsight.java | 2 +-
hadoop-ozone/integration-test/pom.xml | 4 +-
.../fs/ozone/TestOzoneFSWithObjectStoreCreate.java | 160 +++++
.../hadoop/fs/ozone/TestOzoneFileInterfaces.java | 15 +-
.../hadoop/fs/ozone/TestOzoneFileSystem.java | 28 +-
.../hadoop/fs/ozone/TestRootedOzoneFileSystem.java | 212 ++++--
.../ozone/contract/rooted/RootedOzoneContract.java | 7 +-
.../hdds/scm/pipeline/TestLeaderChoosePolicy.java | 216 ++++++
.../TestRatisPipelineCreateAndDestroy.java | 2 +-
.../org/apache/hadoop/ozone/OzoneTestUtils.java | 20 +-
.../java/org/apache/hadoop/ozone/TestDataUtil.java | 13 +-
.../apache/hadoop/ozone/TestMiniOzoneCluster.java | 4 +-
.../hadoop/ozone/TestOzoneConfigurationFields.java | 11 +-
.../ozone/TestStorageContainerManagerHelper.java | 31 +-
.../rpc/TestBlockOutputStreamWithFailures.java | 4 +-
...estBlockOutputStreamWithFailuresFlushDelay.java | 4 +-
.../rpc/TestCloseContainerHandlingByClient.java | 55 --
.../hadoop/ozone/client/rpc/TestCommitWatcher.java | 39 +-
.../rpc/TestContainerStateMachineFailures.java | 20 +-
.../client/rpc/TestDiscardPreallocatedBlocks.java | 186 ++++++
.../ozone/client/rpc/TestKeyInputStream.java | 119 ++--
.../rpc/TestOzoneClientRetriesOnException.java | 2 +-
...estOzoneClientRetriesOnExceptionFlushDelay.java | 2 +-
.../client/rpc/TestOzoneRpcClientAbstract.java | 721 ++++++++++++++++++++-
.../hadoop/ozone/client/rpc/TestReadRetries.java | 40 +-
.../client/rpc/TestValidateBCSIDOnRestart.java | 8 +-
.../ozone/client/rpc/TestWatchForCommit.java | 7 +-
.../commandhandler/TestBlockDeletion.java | 171 ++++-
.../ozoneimpl/TestOzoneContainerRatis.java | 138 ----
.../container/ozoneimpl/TestRatisManager.java | 124 ----
.../ozone/freon/TestFreonWithDatanodeRestart.java | 1 -
.../ozone/freon/TestHadoopNestedDirGenerator.java | 203 ++++++
.../ozone/freon/TestOzoneClientKeyGenerator.java | 2 -
.../hadoop/ozone/fsck/TestContainerMapper.java | 3 +
.../apache/hadoop/ozone/om/TestKeyManagerImpl.java | 18 +-
.../hadoop/ozone/om/TestOMRatisSnapshots.java | 2 -
.../org/apache/hadoop/ozone/om/TestOmLDBCli.java | 120 ++++
.../org/apache/hadoop/ozone/om/TestOmSQLCli.java | 235 -------
.../ozone/om/TestOzoneManagerHAMetadataOnly.java | 76 +++
.../ozone/om/TestOzoneManagerRocksDBLogging.java | 2 +-
.../ozone/recon/TestReconWithOzoneManager.java | 32 +-
.../hadoop/ozone/scm/TestCloseContainer.java | 148 +++++
.../hadoop/ozone/scm/TestContainerSmallFile.java | 20 +-
.../scm/TestGetCommittedBlockLengthAndPutKey.java | 4 +-
.../hadoop/ozone/scm/TestXceiverClientGrpc.java | 6 +-
.../hadoop/ozone/shell/TestOzoneDatanodeShell.java | 2 +-
.../hadoop/ozone/shell/TestOzoneShellHA.java | 48 +-
.../apache/hadoop/ozone/shell/TestScmAdminHA.java | 3 +-
hadoop-ozone/interface-client/pom.xml | 4 +-
.../src/main/proto/OmClientProtocol.proto | 54 ++
.../dev-support/findbugsExcludeFile.xml | 21 +
.../pom.xml | 54 +-
.../apache/hadoop/ozone/om/OMMetadataManager.java | 10 +-
.../ozone/om/codec/OMTransactionInfoCodec.java | 0
.../hadoop/ozone/om/codec/OmBucketInfoCodec.java | 0
.../hadoop/ozone/om/codec/OmKeyInfoCodec.java | 0
.../ozone/om/codec/OmMultipartKeyInfoCodec.java | 0
.../hadoop/ozone/om/codec/OmPrefixInfoCodec.java | 5 +-
.../hadoop/ozone/om/codec/OmVolumeArgsCodec.java | 0
.../ozone/om/codec/RepeatedOmKeyInfoCodec.java | 0
.../hadoop/ozone/om/codec/S3SecretValueCodec.java | 0
.../ozone/om/codec/TokenIdentifierCodec.java | 0
.../hadoop/ozone/om/codec/UserVolumeInfoCodec.java | 0
.../apache/hadoop/ozone/om/codec/package-info.java | 2 +-
.../hadoop/ozone/om/helpers/OmPrefixInfo.java | 13 +-
.../hadoop/ozone/om/helpers/OzoneAclStorage.java | 63 ++
.../ozone/om/helpers/OzoneAclStorageUtil.java | 62 ++
.../hadoop/ozone/om/helpers}/package-info.java | 4 +-
.../org/apache/hadoop/ozone/om}/package-info.java | 4 +-
.../hadoop/ozone/om/ratis/OMTransactionInfo.java | 7 +-
.../hadoop/ozone/om/ratis}/package-info.java | 4 +-
.../src/main/proto/OmStorageProtocol.proto | 60 ++
.../ozone/om/codec/TestOMTransactionInfoCodec.java | 0
.../hadoop/ozone/om/codec/TestOmKeyInfoCodec.java | 0
.../om/codec/TestOmMultipartKeyInfoCodec.java | 0
.../ozone/om/codec/TestOmPrefixInfoCodec.java | 0
.../ozone/om/codec/TestRepeatedOmKeyInfoCodec.java | 0
.../ozone/om/codec/TestS3SecretValueCodec.java | 0
.../apache/hadoop/ozone/om/codec/package-info.java | 0
.../hadoop/ozone/om/helpers/TestOmPrefixInfo.java | 0
.../hadoop/ozone/om/helpers}/package-info.java | 4 +-
hadoop-ozone/ozone-manager/pom.xml | 10 +-
.../apache/hadoop/ozone/om/BucketManagerImpl.java | 4 +-
.../apache/hadoop/ozone/om/KeyDeletingService.java | 9 +-
.../org/apache/hadoop/ozone/om/KeyManager.java | 11 +-
.../org/apache/hadoop/ozone/om/KeyManagerImpl.java | 86 ++-
.../java/org/apache/hadoop/ozone/om/OMMetrics.java | 37 ++
.../hadoop/ozone/om/OmMetadataManagerImpl.java | 38 +-
.../hadoop/ozone/om/OpenKeyCleanupService.java | 45 +-
.../org/apache/hadoop/ozone/om/OzoneManager.java | 127 ++--
.../org/apache/hadoop/ozone/om/VolumeManager.java | 9 -
.../apache/hadoop/ozone/om/VolumeManagerImpl.java | 39 --
.../apache/hadoop/ozone/om/codec/package-info.java | 3 +
.../apache/hadoop/ozone/om/fs/OzoneManagerFS.java | 53 +-
.../ozone/om/ratis/OzoneManagerRatisServer.java | 18 +-
.../ozone/om/ratis/OzoneManagerStateMachine.java | 20 +-
.../om/ratis/utils/OzoneManagerRatisUtils.java | 3 +
.../hadoop/ozone/om/request/OMClientRequest.java | 18 +-
.../om/request/bucket/OMBucketCreateRequest.java | 38 ++
.../request/bucket/OMBucketSetPropertyRequest.java | 64 ++
.../bucket/acl/OMBucketRemoveAclRequest.java | 2 +-
.../request/bucket/acl/OMBucketSetAclRequest.java | 2 +-
.../ozone/om/request/file/OMFileCreateRequest.java | 47 +-
.../om/request/key/OMAllocateBlockRequest.java | 46 +-
.../ozone/om/request/key/OMKeyCommitRequest.java | 48 +-
.../ozone/om/request/key/OMKeyCreateRequest.java | 49 +-
.../ozone/om/request/key/OMKeyDeleteRequest.java | 26 +-
.../hadoop/ozone/om/request/key/OMKeyRequest.java | 124 +++-
.../ozone/om/request/key/OMKeysDeleteRequest.java | 20 +-
.../ozone/om/request/key/OMKeysRenameRequest.java | 271 ++++++++
.../om/request/key/OMTrashRecoverRequest.java | 2 +-
.../om/request/key/acl/OMKeyRemoveAclRequest.java | 2 +-
.../om/request/key/acl/OMKeySetAclRequest.java | 2 +-
.../key/acl/prefix/OMPrefixRemoveAclRequest.java | 2 +-
.../key/acl/prefix/OMPrefixSetAclRequest.java | 2 +-
.../multipart/S3MultipartUploadAbortRequest.java | 41 +-
.../S3MultipartUploadCommitPartRequest.java | 22 +-
.../S3MultipartUploadCompleteRequest.java | 10 +
.../om/request/volume/OMVolumeCreateRequest.java | 6 +
.../om/request/volume/OMVolumeSetQuotaRequest.java | 52 +-
.../hadoop/ozone/om/response/CleanupTableInfo.java | 3 +-
.../om/response/file/OMFileCreateResponse.java | 10 +-
...ponse.java => AbstractOMKeyDeleteResponse.java} | 52 +-
.../om/response/key/OMAllocateBlockResponse.java | 18 +-
.../ozone/om/response/key/OMKeyCommitResponse.java | 18 +-
.../ozone/om/response/key/OMKeyCreateResponse.java | 20 +-
.../ozone/om/response/key/OMKeyDeleteResponse.java | 73 +--
.../om/response/key/OMKeysDeleteResponse.java | 56 +-
...mmitResponse.java => OMKeysRenameResponse.java} | 51 +-
.../om/response/key/OMOpenKeysDeleteRequest.java | 192 ++++++
...Response.java => OMOpenKeysDeleteResponse.java} | 48 +-
.../multipart/S3MultipartUploadAbortResponse.java | 20 +-
.../S3MultipartUploadCommitPartResponse.java | 18 +-
...OzoneManagerProtocolServerSideTranslatorPB.java | 4 +-
.../OzoneDelegationTokenSecretManager.java | 2 +-
.../main/resources/webapps/ozoneManager/index.html | 4 +-
.../hadoop/ozone/om/TestOmMetadataManager.java | 77 +++
.../hadoop/ozone/om/failover/TestOMFailovers.java | 151 +++++
.../ozone/om/request/TestOMRequestUtils.java | 130 +++-
.../bucket/TestOMBucketSetPropertyRequest.java | 41 +-
.../request/file/TestOMDirectoryCreateRequest.java | 4 +-
.../om/request/key/TestOMAllocateBlockRequest.java | 22 +-
.../key/TestOMKeyPurgeRequestAndResponse.java | 15 +-
.../ozone/om/request/key/TestOMKeyRequest.java | 7 +-
.../om/request/key/TestOMKeysRenameRequest.java | 160 +++++
.../request/key/TestOMOpenKeysDeleteRequest.java | 419 ++++++++++++
.../s3/multipart/TestS3MultipartRequest.java | 4 +-
.../volume/TestOMVolumeSetOwnerRequest.java | 2 +-
.../volume/TestOMVolumeSetQuotaRequest.java | 69 +-
.../bucket/TestOMBucketCreateResponse.java | 8 +
.../bucket/TestOMBucketDeleteResponse.java | 8 +
.../bucket/TestOMBucketSetPropertyResponse.java | 9 +
.../file/TestOMDirectoryCreateResponse.java | 8 +
.../response/key/TestOMAllocateBlockResponse.java | 27 +-
.../om/response/key/TestOMKeyCommitResponse.java | 19 +-
.../om/response/key/TestOMKeyCreateResponse.java | 23 +-
.../om/response/key/TestOMKeyDeleteResponse.java | 27 +-
.../ozone/om/response/key/TestOMKeyResponse.java | 3 +
.../om/response/key/TestOMKeysDeleteResponse.java | 38 +-
.../om/response/key/TestOMKeysRenameResponse.java | 131 ++++
.../response/key/TestOMOpenKeysDeleteResponse.java | 185 ++++++
.../s3/multipart/TestS3MultipartResponse.java | 16 +-
.../TestS3MultipartUploadAbortResponse.java | 21 +-
.../security/TestOMDelegationTokenResponse.java | 8 +
.../volume/TestOMVolumeCreateResponse.java | 8 +
.../volume/TestOMVolumeDeleteResponse.java | 8 +
.../volume/TestOMVolumeSetOwnerResponse.java | 9 +
.../volume/TestOMVolumeSetQuotaResponse.java | 9 +
hadoop-ozone/ozonefs-common/pom.xml | 4 +-
.../fs/ozone/BasicOzoneClientAdapterImpl.java | 23 +-
.../hadoop/fs/ozone/BasicOzoneFileSystem.java | 98 ++-
.../ozone/BasicRootedOzoneClientAdapterImpl.java | 138 ++--
.../fs/ozone/BasicRootedOzoneFileSystem.java | 151 ++++-
.../hadoop/fs/ozone/OzoneClientAdapterImpl.java | 4 +-
.../fs/ozone/RootedOzoneClientAdapterImpl.java | 4 +-
.../services/org.apache.hadoop.fs.FileSystem | 1 +
hadoop-ozone/ozonefs-hadoop2/pom.xml | 4 +-
.../org/apache/hadoop/fs/ozone/RootedOzFs.java | 36 +-
.../services/org.apache.hadoop.fs.FileSystem | 1 +
hadoop-ozone/ozonefs-hadoop3/pom.xml | 4 +-
.../apache/hadoop/fs/ozone/OzoneFileSystem.java | 4 +-
.../org/apache/hadoop/fs/ozone/RootedOzFs.java | 33 +-
.../hadoop/fs/ozone/RootedOzoneFileSystem.java | 4 +-
.../services/org.apache.hadoop.fs.FileSystem | 1 +
hadoop-ozone/ozonefs-shaded/pom.xml | 9 +-
hadoop-ozone/ozonefs/pom.xml | 4 +-
.../apache/hadoop/fs/ozone/OzoneFileSystem.java | 4 +-
.../org/apache/hadoop/fs/ozone/RootedOzFs.java | 33 +-
.../hadoop/fs/ozone/RootedOzoneFileSystem.java | 4 +-
.../services/org.apache.hadoop.fs.FileSystem | 1 +
hadoop-ozone/pom.xml | 17 +-
hadoop-ozone/recon-codegen/pom.xml | 2 +-
.../recon/schema/ContainerSchemaDefinition.java | 4 +-
.../recon/schema/ReconTaskSchemaDefinition.java | 2 +-
.../ozone/recon/schema/StatsSchemaDefinition.java | 14 +-
.../recon/schema/UtilizationSchemaDefinition.java | 23 +-
hadoop-ozone/recon/pom.xml | 2 +-
.../ozone/recon/MetricsServiceProviderFactory.java | 86 +++
.../apache/hadoop/ozone/recon/ReconConstants.java | 8 +-
.../hadoop/ozone/recon/ReconControllerModule.java | 3 +
.../hadoop/ozone/recon/ReconSchemaManager.java | 2 +-
.../hadoop/ozone/recon/ReconServerConfigKeys.java | 50 +-
.../org/apache/hadoop/ozone/recon/ReconUtils.java | 47 +-
.../ozone/recon/api/ClusterStateEndpoint.java | 47 +-
.../hadoop/ozone/recon/api/ContainerEndpoint.java | 2 +-
.../ozone/recon/api/MetricsProxyEndpoint.java | 118 ++++
.../hadoop/ozone/recon/api/PipelineEndpoint.java | 59 +-
.../ozone/recon/codec/DatanodeDetailsCodec.java | 5 +-
.../apache/hadoop/ozone/recon/metrics/Metric.java | 34 +-
.../ReconIncrementalContainerReportHandler.java | 4 +-
.../ozone/recon/spi/MetricsServiceProvider.java | 60 ++
.../spi/impl/ContainerDBServiceProviderImpl.java | 33 +-
.../spi/impl/OzoneManagerServiceProviderImpl.java | 54 +-
.../spi/impl/PrometheusServiceProviderImpl.java | 213 ++++++
.../ozone/recon/tasks/FileSizeCountTask.java | 4 +-
.../hadoop/ozone/recon/tasks/OMDBUpdateEvent.java | 2 +-
.../ozone/recon/tasks/OMDBUpdatesHandler.java | 92 ++-
.../ozone/recon/tasks/ReconTaskControllerImpl.java | 10 +-
.../hadoop/ozone/recon/tasks/TableCountTask.java | 185 ++++++
.../webapps/recon/ozone-recon-web/pnpm-lock.yaml | 66 +-
.../src/views/overview/overview.tsx | 2 +-
.../hadoop/ozone/recon/ReconTestInjector.java | 3 +
.../apache/hadoop/ozone/recon/TestReconUtils.java | 6 +-
.../hadoop/ozone/recon/api/TestEndpoints.java | 151 ++++-
.../impl/TestOzoneManagerServiceProviderImpl.java | 9 +-
.../ozone/recon/tasks/TestOMDBUpdatesHandler.java | 54 +-
.../recon/tasks/TestReconTaskControllerImpl.java | 6 +-
.../ozone/recon/tasks/TestTableCountTask.java | 178 +++++
.../test/resources/prometheus-test-response.txt | 21 +
hadoop-ozone/s3gateway/pom.xml | 9 +-
.../hadoop/ozone/s3/S3GatewayConfigKeys.java | 6 +
.../hadoop/ozone/s3/endpoint/ObjectEndpoint.java | 69 +-
.../hadoop/ozone/s3/io/S3WrapperInputStream.java | 36 +-
.../hadoop/ozone/client/ObjectStoreStub.java | 5 +-
.../hadoop/ozone/client/OzoneVolumeStub.java | 6 +-
.../s3/endpoint/TestMultipartUploadWithCopy.java | 15 +-
hadoop-ozone/tools/pom.xml | 14 +-
.../org/apache/hadoop/ozone/admin/OzoneAdmin.java | 122 ----
.../ozone/admin/om/GetServiceRolesSubcommand.java | 4 +-
.../org/apache/hadoop/ozone/admin/om/OMAdmin.java | 12 +-
.../admin/scm/GetScmRatisRolesSubcommand.java | 9 +-
.../apache/hadoop/ozone/admin/scm/ScmAdmin.java | 6 +-
.../org/apache/hadoop/ozone/conf/OzoneGetConf.java | 86 +++
.../ozone/conf/OzoneManagersCommandHandler.java | 53 ++
.../ozone/conf/PrintConfKeyCommandHandler.java | 52 ++
.../StorageContainerManagersCommandHandler.java | 52 ++
.../org/apache/hadoop/ozone/conf/package-info.java | 11 +-
.../apache/hadoop/ozone/debug/ChunkKeyHandler.java | 165 +++--
.../hadoop/ozone/debug/ContainerChunkInfo.java | 21 +-
.../org/apache/hadoop/ozone/debug/DBScanner.java | 116 +++-
.../org/apache/hadoop/ozone/debug/DropTable.java | 81 +++
.../org/apache/hadoop/ozone/debug/ListTables.java | 19 +-
.../org/apache/hadoop/ozone/debug/OzoneDebug.java | 11 +-
.../org/apache/hadoop/ozone/debug/RDBParser.java | 38 +-
.../debug/{ListTables.java => RocksDBUtils.java} | 36 +-
.../hadoop/ozone/freon/BaseFreonGenerator.java | 22 +
.../hadoop/ozone/freon/ContentGenerator.java | 31 +-
.../hadoop/ozone/freon/DatanodeChunkValidator.java | 244 +++++++
.../java/org/apache/hadoop/ozone/freon/Freon.java | 5 +
.../hadoop/ozone/freon/HadoopDirTreeGenerator.java | 55 +-
.../hadoop/ozone/freon/HadoopFsGenerator.java | 12 +-
.../ozone/freon/HadoopNestedDirGenerator.java | 27 +-
.../hadoop/ozone/freon/RandomKeyGenerator.java | 53 +-
.../hadoop/ozone/segmentparser/RatisLogParser.java | 12 +-
.../hadoop/ozone/shell/ClearSpaceQuotaOptions.java | 26 +-
.../apache/hadoop/ozone/shell/OzoneAddress.java | 103 ++-
.../org/apache/hadoop/ozone/shell/OzoneShell.java | 14 +-
.../hadoop/ozone/shell/SetSpaceQuotaOptions.java | 27 +-
.../java/org/apache/hadoop/ozone/shell/Shell.java | 8 +-
.../hadoop/ozone/shell/bucket/BucketCommands.java | 16 +-
.../ClearQuotaHandler.java} | 32 +-
.../ozone/shell/bucket/CreateBucketHandler.java | 13 +
.../hadoop/ozone/shell/bucket/SetQuotaHandler.java | 62 ++
.../hadoop/ozone/shell/keys/KeyCommands.java | 12 +-
.../hadoop/ozone/shell/token/GetTokenHandler.java | 8 +-
.../ozone/shell/token/PrintTokenHandler.java | 3 +-
.../ozone/shell/token/RenewTokenHandler.java | 4 +-
.../hadoop/ozone/shell/token/TokenCommands.java | 16 +-
.../hadoop/ozone/shell/token/TokenOption.java | 38 +-
.../ClearQuotaHandler.java} | 30 +-
.../ozone/shell/volume/CreateVolumeHandler.java | 18 +-
...dateVolumeHandler.java => SetQuotaHandler.java} | 47 +-
.../ozone/shell/volume/UpdateVolumeHandler.java | 11 -
.../hadoop/ozone/shell/volume/VolumeCommands.java | 16 +-
.../services/org.apache.hadoop.fs.FileSystem | 1 +
.../hadoop/ozone/conf/TestGetConfOptions.java | 90 +++
.../hadoop/ozone/freon/TestContentGenerator.java | 82 +++
.../TestGenerateOzoneRequiredConfigurations.java | 5 +-
.../hadoop/ozone/shell/TestOzoneAddress.java | 6 +-
.../shell/TestOzoneAddressClientCreation.java | 172 +++++
pom.xml | 36 +-
823 files changed, 21890 insertions(+), 8817 deletions(-)
create mode 100755 .github/close-pending.sh
create mode 100644 .github/closing-message.txt
copy
hadoop-ozone/fault-injection-test/mini-chaos-tests/src/test/resources/META-INF/services/org.apache.hadoop.fs.FileSystem
=> .github/workflows/close-pending.yaml (65%)
copy
hadoop-ozone/fault-injection-test/mini-chaos-tests/src/test/resources/META-INF/services/org.apache.hadoop.fs.FileSystem
=> dev-support/byteman/appendlog.btm (66%)
create mode 100644 dev-support/byteman/hcfs-read.btm
create mode 100644 dev-support/byteman/hcfs-write.btm
copy hadoop-ozone/dist/src/main/smoketest/admincli/datanode.robot =>
dev-support/byteman/ratis-flush.btm (57%)
copy
hadoop-ozone/fault-injection-test/mini-chaos-tests/src/test/resources/META-INF/services/org.apache.hadoop.fs.FileSystem
=> dev-support/byteman/ratis-no-flush.btm (78%)
copy hadoop-ozone/dist/src/main/smoketest/admincli/datanode.robot =>
dev-support/byteman/watchforcommit.btm (56%)
create mode 100644 dev-support/byteman/watchforcommit_all.btm
rename
hadoop-ozone/common/src/main/java/org/apache/hadoop/ozone/freon/package-info.java
=>
hadoop-hdds/client/src/main/java/org/apache/hadoop/hdds/scm/XceiverClientFactory.java
(60%)
create mode 100644
hadoop-hdds/client/src/test/java/org/apache/hadoop/hdds/scm/storage/TestBlockOutputStreamCorrectness.java
copy
hadoop-ozone/tools/src/main/java/org/apache/hadoop/ozone/debug/RDBParser.java
=>
hadoop-hdds/client/src/test/java/org/apache/hadoop/hdds/scm/storage/TestBufferPool.java
(56%)
copy
hadoop-hdds/{tools/src/main/java/org/apache/hadoop/hdds/scm/cli/container/WithScmClient.java
=> common/src/main/java/org/apache/hadoop/hdds/cli/SubcommandWithParent.java}
(77%)
copy
hadoop-hdds/common/src/main/java/org/apache/hadoop/hdds/{utils/BackgroundTask.java
=> scm/PipelineChoosePolicy.java} (62%)
copy
hadoop-hdds/common/src/main/java/org/apache/hadoop/hdds/{recon/ReconConfigKeys.java
=> scm/PipelineRequestInformation.java} (54%)
copy
hadoop-hdds/common/src/main/java/org/apache/hadoop/hdds/utils/{VersionInfo.java
=> RatisVersionInfo.java} (50%)
create mode 100644
hadoop-hdds/common/src/main/java/org/apache/hadoop/ozone/container/common/helpers/ChunkInfoList.java
copy
hadoop-hdds/config/src/main/java/org/apache/hadoop/hdds/conf/{ConfigType.java
=> InMemoryConfiguration.java} (51%)
create mode 100644
hadoop-hdds/config/src/test/java/org/apache/hadoop/hdds/conf/TestConfigurationReflectionUtil.java
delete mode 100644
hadoop-hdds/container-service/src/main/java/org/apache/hadoop/ozone/container/keyvalue/KeyValueBlockIterator.java
create mode 100644
hadoop-hdds/container-service/src/main/java/org/apache/hadoop/ozone/container/metadata/AbstractDatanodeDBDefinition.java
create mode 100644
hadoop-hdds/container-service/src/main/java/org/apache/hadoop/ozone/container/metadata/AbstractDatanodeStore.java
create mode 100644
hadoop-hdds/container-service/src/main/java/org/apache/hadoop/ozone/container/metadata/BlockDataCodec.java
create mode 100644
hadoop-hdds/container-service/src/main/java/org/apache/hadoop/ozone/container/metadata/ChunkInfoListCodec.java
create mode 100644
hadoop-hdds/container-service/src/main/java/org/apache/hadoop/ozone/container/metadata/DatanodeSchemaOneDBDefinition.java
create mode 100644
hadoop-hdds/container-service/src/main/java/org/apache/hadoop/ozone/container/metadata/DatanodeSchemaTwoDBDefinition.java
create mode 100644
hadoop-hdds/container-service/src/main/java/org/apache/hadoop/ozone/container/metadata/DatanodeStore.java
create mode 100644
hadoop-hdds/container-service/src/main/java/org/apache/hadoop/ozone/container/metadata/DatanodeStoreSchemaOneImpl.java
create mode 100644
hadoop-hdds/container-service/src/main/java/org/apache/hadoop/ozone/container/metadata/DatanodeStoreSchemaTwoImpl.java
create mode 100644
hadoop-hdds/container-service/src/main/java/org/apache/hadoop/ozone/container/metadata/DatanodeTable.java
create mode 100644
hadoop-hdds/container-service/src/main/java/org/apache/hadoop/ozone/container/metadata/SchemaOneChunkInfoListCodec.java
create mode 100644
hadoop-hdds/container-service/src/main/java/org/apache/hadoop/ozone/container/metadata/SchemaOneDeletedBlocksTable.java
create mode 100644
hadoop-hdds/container-service/src/main/java/org/apache/hadoop/ozone/container/metadata/SchemaOneKeyCodec.java
copy hadoop-hdds/{common/src/main/java/org/apache/hadoop/hdds/cli =>
container-service/src/main/java/org/apache/hadoop/ozone/container/metadata}/package-info.java
(81%)
create mode 100644
hadoop-hdds/container-service/src/test/java/org/apache/hadoop/ozone/container/common/TestSchemaOneBackwardsCompatibility.java
create mode 100644
hadoop-hdds/container-service/src/test/resources/123-dn-container.db/000024.sst
create mode 100644
hadoop-hdds/container-service/src/test/resources/123-dn-container.db/000026.sst
create mode 100644
hadoop-hdds/container-service/src/test/resources/123-dn-container.db/000032.sst
create mode 100644
hadoop-hdds/container-service/src/test/resources/123-dn-container.db/000034.log
create mode 100644
hadoop-hdds/container-service/src/test/resources/123-dn-container.db/CURRENT
create mode 100644
hadoop-hdds/container-service/src/test/resources/123-dn-container.db/IDENTITY
create mode 100644
hadoop-hdds/container-service/src/test/resources/123-dn-container.db/MANIFEST-000033
create mode 100644
hadoop-hdds/container-service/src/test/resources/123-dn-container.db/OPTIONS-000033
create mode 100644
hadoop-hdds/container-service/src/test/resources/123-dn-container.db/OPTIONS-000036
create mode 100644
hadoop-hdds/container-service/src/test/resources/123.container
delete mode 100644 hadoop-hdds/docs/content/beyond/Containers.md
delete mode 100644 hadoop-hdds/docs/content/beyond/Containers.zh.md
delete mode 100644 hadoop-hdds/docs/content/beyond/DockerCheatSheet.md
delete mode 100644 hadoop-hdds/docs/content/beyond/DockerCheatSheet.zh.md
delete mode 100644 hadoop-hdds/docs/content/beyond/_index.md
delete mode 100644 hadoop-hdds/docs/content/beyond/_index.zh.md
create mode 100644 hadoop-hdds/docs/content/concept/Containers.md
create mode 100644 hadoop-hdds/docs/content/concept/Containers.png
delete mode 100644 hadoop-hdds/docs/content/concept/Hdds.md
create mode 100644 hadoop-hdds/docs/content/concept/OzoneManager-ReadPath.png
create mode 100644 hadoop-hdds/docs/content/concept/OzoneManager-WritePath.png
create mode 100644 hadoop-hdds/docs/content/concept/OzoneManager.png
create mode 100644 hadoop-hdds/docs/content/concept/StorageContainerManager.md
create mode 100644 hadoop-hdds/docs/content/concept/StorageContainerManager.png
rename hadoop-hdds/docs/content/concept/{Hdds.zh.md =>
StorageContainerManager.zh.md} (91%)
create mode 100644 hadoop-hdds/docs/content/design/ec.md
copy hadoop-ozone/dist/src/main/compose/upgrade/versions/README.md =>
hadoop-hdds/docs/content/design/storage-class.md (59%)
copy hadoop-hdds/docs/content/design/{namespace-support.md => topology.md}
(58%)
rename hadoop-hdds/docs/content/design/{ozone-volume-management.md =>
volume-management.md} (100%)
create mode 100644 hadoop-hdds/docs/content/feature/GDPR.md
rename hadoop-hdds/docs/content/{gdpr/GDPR in Ozone.zh.md =>
feature/GDPR.zh.md} (90%)
create mode 100644 hadoop-hdds/docs/content/feature/HA-OM-doublebuffer.png
create mode 100644 hadoop-hdds/docs/content/feature/HA-OM.png
create mode 100644 hadoop-hdds/docs/content/feature/HA.md
create mode 100644 hadoop-hdds/docs/content/feature/Observability.md
create mode 100644 hadoop-hdds/docs/content/feature/Recon.md
create mode 100644 hadoop-hdds/docs/content/feature/Topology.md
rename hadoop-hdds/docs/content/{gdpr => feature}/_index.md (80%)
rename hadoop-hdds/docs/content/{gdpr => feature}/_index.zh.md (100%)
delete mode 100644 hadoop-hdds/docs/content/gdpr/GDPR in Ozone.md
create mode 100644 hadoop-hdds/docs/content/interface/CSI.png
create mode 100644 hadoop-hdds/docs/content/interface/CSI.zh.md
create mode 100644 hadoop-hdds/docs/content/interface/Cli.md
rename hadoop-hdds/docs/content/interface/{OzoneFS.md => O3fs.md} (65%)
rename hadoop-hdds/docs/content/interface/{OzoneFS.zh.md => O3fs.zh.md} (91%)
copy hadoop-hdds/docs/content/{design/ofs.md => interface/Ofs.md} (53%)
create mode 100644 hadoop-hdds/docs/content/security/SecuringDatanodes.zh.md
rename hadoop-hdds/docs/content/security/{SecuityWithRanger.md =>
SecurityWithRanger.md} (97%)
rename hadoop-hdds/docs/content/security/{SecuityWithRanger.zh.md =>
SecurityWithRanger.zh.md} (97%)
delete mode 100644 hadoop-hdds/docs/content/shell/BucketCommands.md
delete mode 100644 hadoop-hdds/docs/content/shell/BucketCommands.zh.md
delete mode 100644 hadoop-hdds/docs/content/shell/Format.md
delete mode 100644 hadoop-hdds/docs/content/shell/Format.zh.md
delete mode 100644 hadoop-hdds/docs/content/shell/KeyCommands.md
delete mode 100644 hadoop-hdds/docs/content/shell/KeyCommands.zh.md
delete mode 100644 hadoop-hdds/docs/content/shell/VolumeCommands.md
delete mode 100644 hadoop-hdds/docs/content/shell/VolumeCommands.zh.md
delete mode 100644 hadoop-hdds/docs/content/shell/_index.md
delete mode 100644 hadoop-hdds/docs/content/shell/_index.zh.md
delete mode 100644
hadoop-hdds/framework/src/main/resources/webapps/static/angular-1.7.9.min.js
create mode 100644
hadoop-hdds/framework/src/main/resources/webapps/static/angular-1.8.0.min.js
rename
hadoop-hdds/framework/src/main/resources/webapps/static/{angular-route-1.7.9.min.js
=> angular-route-1.8.0.min.js} (97%)
copy
hadoop-hdds/{common/src/main/java/org/apache/hadoop/hdds/utils/BackgroundTask.java
=>
server-scm/src/main/java/org/apache/hadoop/hdds/scm/pipeline/choose/algorithms/HealthyPipelineChoosePolicy.java}
(50%)
create mode 100644
hadoop-hdds/server-scm/src/main/java/org/apache/hadoop/hdds/scm/pipeline/choose/algorithms/PipelineChoosePolicyFactory.java
copy
hadoop-hdds/{common/src/main/java/org/apache/hadoop/hdds/utils/BackgroundTask.java
=>
server-scm/src/main/java/org/apache/hadoop/hdds/scm/pipeline/choose/algorithms/RandomPipelineChoosePolicy.java}
(54%)
copy
hadoop-hdds/{common/src/main/java/org/apache/hadoop/hdds/utils/BackgroundTask.java
=>
server-scm/src/main/java/org/apache/hadoop/hdds/scm/pipeline/choose/algorithms/package-info.java}
(78%)
copy
hadoop-hdds/{common/src/main/java/org/apache/hadoop/hdds/utils/BackgroundTask.java
=>
server-scm/src/main/java/org/apache/hadoop/hdds/scm/pipeline/leader/choose/algorithms/DefaultLeaderChoosePolicy.java}
(51%)
create mode 100644
hadoop-hdds/server-scm/src/main/java/org/apache/hadoop/hdds/scm/pipeline/leader/choose/algorithms/LeaderChoosePolicy.java
create mode 100644
hadoop-hdds/server-scm/src/main/java/org/apache/hadoop/hdds/scm/pipeline/leader/choose/algorithms/LeaderChoosePolicyFactory.java
create mode 100644
hadoop-hdds/server-scm/src/main/java/org/apache/hadoop/hdds/scm/pipeline/leader/choose/algorithms/MinLeaderCountChoosePolicy.java
copy
hadoop-hdds/{common/src/main/java/org/apache/hadoop/hdds/utils/BackgroundTask.java
=>
server-scm/src/main/java/org/apache/hadoop/hdds/scm/pipeline/leader/choose/algorithms/package-info.java}
(78%)
create mode 100644
hadoop-hdds/server-scm/src/test/java/org/apache/hadoop/hdds/scm/pipeline/choose/algorithms/TestPipelineChoosePolicyFactory.java
create mode 100644
hadoop-hdds/server-scm/src/test/java/org/apache/hadoop/hdds/scm/pipeline/leader/choose/algorithms/TestLeaderChoosePolicy.java
create mode 100644
hadoop-hdds/tools/src/main/java/org/apache/hadoop/hdds/cli/OzoneAdmin.java
copy hadoop-hdds/{common =>
tools}/src/main/java/org/apache/hadoop/hdds/cli/package-info.java (88%)
create mode 100644
hadoop-hdds/tools/src/main/java/org/apache/hadoop/hdds/scm/cli/ScmOption.java
copy
hadoop-hdds/tools/src/main/java/org/apache/hadoop/hdds/scm/cli/{container/WithScmClient.java
=> ScmSubcommand.java} (60%)
delete mode 100644
hadoop-ozone/common/src/main/java/org/apache/hadoop/ozone/freon/OzoneGetConf.java
create mode 100644
hadoop-ozone/common/src/main/java/org/apache/hadoop/ozone/om/helpers/OmRenameKeys.java
create mode 100644 hadoop-ozone/dev-support/intellij/core-site.xml
create mode 120000 hadoop-ozone/dist/src/main/compose/failing1/.env
create mode 120000
hadoop-ozone/dist/src/main/compose/failing1/docker-compose.yaml
create mode 120000 hadoop-ozone/dist/src/main/compose/failing1/docker-config
copy hadoop-ozone/dist/src/main/compose/{ozone-om-ha-s3 => failing1}/test.sh
(88%)
mode change 100644 => 100755
create mode 120000 hadoop-ozone/dist/src/main/compose/failing2/.env
create mode 120000
hadoop-ozone/dist/src/main/compose/failing2/docker-compose.yaml
create mode 120000 hadoop-ozone/dist/src/main/compose/failing2/docker-config
copy hadoop-ozone/dist/src/main/compose/{ozone-om-ha-s3 => failing2}/test.sh
(88%)
mode change 100644 => 100755
copy hadoop-ozone/dist/src/main/compose/{ozone => ozone-ha}/.env (100%)
create mode 100644
hadoop-ozone/dist/src/main/compose/ozone-ha/docker-compose.yaml
copy hadoop-ozone/dist/src/main/compose/{ozone-csi => ozone-ha}/docker-config
(71%)
copy hadoop-ozone/dist/src/main/compose/{ozone-om-ha-s3 => ozone-ha}/test.sh
(92%)
mode change 100644 => 100755
rename hadoop-ozone/dist/src/main/compose/upgrade/versions/{ozone-0.6.0.sh =>
ozone-1.0.0.sh} (91%)
copy hadoop-ozone/dist/src/main/smoketest/{topology/loaddata.robot =>
admincli/admin.robot} (58%)
create mode 100644
hadoop-ozone/dist/src/main/smoketest/admincli/container.robot
create mode 100644
hadoop-ozone/dist/src/main/smoketest/admincli/replicationmanager.robot
create mode 100644 hadoop-ozone/dist/src/main/smoketest/admincli/safemode.robot
create mode 100644 hadoop-ozone/dist/src/main/smoketest/basic/getconf.robot
copy hadoop-ozone/dist/src/main/smoketest/basic/{ozone-shell.robot =>
ozone-shell-lib.robot} (70%)
copy hadoop-ozone/dist/src/main/smoketest/{om-ratis/testOMAdminCmd.robot =>
basic/ozone-shell-single.robot} (72%)
copy
hadoop-ozone/{ozonefs-hadoop2/src/main/resources/META-INF/services/org.apache.hadoop.fs.FileSystem
=> dist/src/main/smoketest/failing/test1.robot} (88%)
copy
hadoop-ozone/{ozonefs-hadoop2/src/main/resources/META-INF/services/org.apache.hadoop.fs.FileSystem
=> dist/src/main/smoketest/failing/test2.robot} (88%)
delete mode 100644 hadoop-ozone/dist/src/main/smoketest/robot.robot
create mode 100755
hadoop-ozone/dist/src/main/smoketest/s3/s3_compatbility_check.sh
rename hadoop-ozone/dist/src/shell/upgrade/{0.6.0.sh => 1.0.0.sh} (94%)
rename hadoop-ozone/dist/src/shell/upgrade/{0.6.0 =>
1.0.0}/01-migrate-scm-db.sh (100%)
create mode 100644
hadoop-ozone/insight/src/main/java/org/apache/hadoop/ozone/insight/datanode/DatanodeDispatcherInsight.java
create mode 100644
hadoop-ozone/insight/src/main/java/org/apache/hadoop/ozone/insight/datanode/PipelineComponentUtil.java
create mode 100644
hadoop-ozone/integration-test/src/test/java/org/apache/hadoop/hdds/scm/pipeline/TestLeaderChoosePolicy.java
create mode 100644
hadoop-ozone/integration-test/src/test/java/org/apache/hadoop/ozone/client/rpc/TestDiscardPreallocatedBlocks.java
delete mode 100644
hadoop-ozone/integration-test/src/test/java/org/apache/hadoop/ozone/container/ozoneimpl/TestOzoneContainerRatis.java
delete mode 100644
hadoop-ozone/integration-test/src/test/java/org/apache/hadoop/ozone/container/ozoneimpl/TestRatisManager.java
create mode 100644
hadoop-ozone/integration-test/src/test/java/org/apache/hadoop/ozone/freon/TestHadoopNestedDirGenerator.java
create mode 100644
hadoop-ozone/integration-test/src/test/java/org/apache/hadoop/ozone/om/TestOmLDBCli.java
delete mode 100644
hadoop-ozone/integration-test/src/test/java/org/apache/hadoop/ozone/om/TestOmSQLCli.java
create mode 100644
hadoop-ozone/integration-test/src/test/java/org/apache/hadoop/ozone/scm/TestCloseContainer.java
create mode 100644
hadoop-ozone/interface-storage/dev-support/findbugsExcludeFile.xml
copy hadoop-ozone/{interface-client => interface-storage}/pom.xml (63%)
rename hadoop-ozone/{ozone-manager =>
interface-storage}/src/main/java/org/apache/hadoop/ozone/om/OMMetadataManager.java
(97%)
rename hadoop-ozone/{ozone-manager =>
interface-storage}/src/main/java/org/apache/hadoop/ozone/om/codec/OMTransactionInfoCodec.java
(100%)
rename hadoop-ozone/{ozone-manager =>
interface-storage}/src/main/java/org/apache/hadoop/ozone/om/codec/OmBucketInfoCodec.java
(100%)
rename hadoop-ozone/{ozone-manager =>
interface-storage}/src/main/java/org/apache/hadoop/ozone/om/codec/OmKeyInfoCodec.java
(100%)
rename hadoop-ozone/{ozone-manager =>
interface-storage}/src/main/java/org/apache/hadoop/ozone/om/codec/OmMultipartKeyInfoCodec.java
(100%)
rename hadoop-ozone/{ozone-manager =>
interface-storage}/src/main/java/org/apache/hadoop/ozone/om/codec/OmPrefixInfoCodec.java
(91%)
rename hadoop-ozone/{ozone-manager =>
interface-storage}/src/main/java/org/apache/hadoop/ozone/om/codec/OmVolumeArgsCodec.java
(100%)
rename hadoop-ozone/{ozone-manager =>
interface-storage}/src/main/java/org/apache/hadoop/ozone/om/codec/RepeatedOmKeyInfoCodec.java
(100%)
rename hadoop-ozone/{ozone-manager =>
interface-storage}/src/main/java/org/apache/hadoop/ozone/om/codec/S3SecretValueCodec.java
(100%)
rename hadoop-ozone/{ozone-manager =>
interface-storage}/src/main/java/org/apache/hadoop/ozone/om/codec/TokenIdentifierCodec.java
(100%)
rename hadoop-ozone/{ozone-manager =>
interface-storage}/src/main/java/org/apache/hadoop/ozone/om/codec/UserVolumeInfoCodec.java
(100%)
copy hadoop-ozone/{ozone-manager =>
interface-storage}/src/main/java/org/apache/hadoop/ozone/om/codec/package-info.java
(95%)
rename hadoop-ozone/{common =>
interface-storage}/src/main/java/org/apache/hadoop/ozone/om/helpers/OmPrefixInfo.java
(92%)
create mode 100644
hadoop-ozone/interface-storage/src/main/java/org/apache/hadoop/ozone/om/helpers/OzoneAclStorage.java
create mode 100644
hadoop-ozone/interface-storage/src/main/java/org/apache/hadoop/ozone/om/helpers/OzoneAclStorageUtil.java
copy
hadoop-ozone/{ozone-manager/src/test/java/org/apache/hadoop/ozone/om/codec =>
interface-storage/src/main/java/org/apache/hadoop/ozone/om/helpers}/package-info.java
(91%)
copy
hadoop-ozone/{ozone-manager/src/test/java/org/apache/hadoop/ozone/om/codec =>
interface-storage/src/main/java/org/apache/hadoop/ozone/om}/package-info.java
(92%)
rename hadoop-ozone/{ozone-manager =>
interface-storage}/src/main/java/org/apache/hadoop/ozone/om/ratis/OMTransactionInfo.java
(98%)
copy
hadoop-ozone/{ozone-manager/src/test/java/org/apache/hadoop/ozone/om/codec =>
interface-storage/src/main/java/org/apache/hadoop/ozone/om/ratis}/package-info.java
(92%)
create mode 100644
hadoop-ozone/interface-storage/src/main/proto/OmStorageProtocol.proto
rename hadoop-ozone/{ozone-manager =>
interface-storage}/src/test/java/org/apache/hadoop/ozone/om/codec/TestOMTransactionInfoCodec.java
(100%)
rename hadoop-ozone/{ozone-manager =>
interface-storage}/src/test/java/org/apache/hadoop/ozone/om/codec/TestOmKeyInfoCodec.java
(100%)
rename hadoop-ozone/{ozone-manager =>
interface-storage}/src/test/java/org/apache/hadoop/ozone/om/codec/TestOmMultipartKeyInfoCodec.java
(100%)
rename hadoop-ozone/{ozone-manager =>
interface-storage}/src/test/java/org/apache/hadoop/ozone/om/codec/TestOmPrefixInfoCodec.java
(100%)
rename hadoop-ozone/{ozone-manager =>
interface-storage}/src/test/java/org/apache/hadoop/ozone/om/codec/TestRepeatedOmKeyInfoCodec.java
(100%)
rename hadoop-ozone/{ozone-manager =>
interface-storage}/src/test/java/org/apache/hadoop/ozone/om/codec/TestS3SecretValueCodec.java
(100%)
copy hadoop-ozone/{ozone-manager =>
interface-storage}/src/test/java/org/apache/hadoop/ozone/om/codec/package-info.java
(100%)
rename hadoop-ozone/{common =>
interface-storage}/src/test/java/org/apache/hadoop/ozone/om/helpers/TestOmPrefixInfo.java
(100%)
rename
hadoop-ozone/{ozone-manager/src/test/java/org/apache/hadoop/ozone/om/codec =>
interface-storage/src/test/java/org/apache/hadoop/ozone/om/helpers}/package-info.java
(92%)
create mode 100644
hadoop-ozone/ozone-manager/src/main/java/org/apache/hadoop/ozone/om/request/key/OMKeysRenameRequest.java
copy
hadoop-ozone/ozone-manager/src/main/java/org/apache/hadoop/ozone/om/response/key/{OMKeyDeleteResponse.java
=> AbstractOMKeyDeleteResponse.java} (69%)
copy
hadoop-ozone/ozone-manager/src/main/java/org/apache/hadoop/ozone/om/response/key/{OMKeyCommitResponse.java
=> OMKeysRenameResponse.java} (55%)
create mode 100644
hadoop-ozone/ozone-manager/src/main/java/org/apache/hadoop/ozone/om/response/key/OMOpenKeysDeleteRequest.java
copy
hadoop-ozone/ozone-manager/src/main/java/org/apache/hadoop/ozone/om/response/key/{OMAllocateBlockResponse.java
=> OMOpenKeysDeleteResponse.java} (58%)
create mode 100644
hadoop-ozone/ozone-manager/src/test/java/org/apache/hadoop/ozone/om/failover/TestOMFailovers.java
create mode 100644
hadoop-ozone/ozone-manager/src/test/java/org/apache/hadoop/ozone/om/request/key/TestOMKeysRenameRequest.java
create mode 100644
hadoop-ozone/ozone-manager/src/test/java/org/apache/hadoop/ozone/om/request/key/TestOMOpenKeysDeleteRequest.java
create mode 100644
hadoop-ozone/ozone-manager/src/test/java/org/apache/hadoop/ozone/om/response/key/TestOMKeysRenameResponse.java
create mode 100644
hadoop-ozone/ozone-manager/src/test/java/org/apache/hadoop/ozone/om/response/key/TestOMOpenKeysDeleteResponse.java
copy
hadoop-hdds/server-scm/src/main/java/org/apache/hadoop/hdds/scm/pipeline/PipelineManagerMXBean.java
=>
hadoop-ozone/ozonefs-hadoop2/src/main/java/org/apache/hadoop/fs/ozone/RootedOzFs.java
(52%)
copy
hadoop-hdds/server-scm/src/main/java/org/apache/hadoop/hdds/scm/pipeline/PipelineManagerMXBean.java
=>
hadoop-ozone/ozonefs-hadoop3/src/main/java/org/apache/hadoop/fs/ozone/RootedOzFs.java
(54%)
copy
hadoop-hdds/server-scm/src/main/java/org/apache/hadoop/hdds/scm/pipeline/PipelineManagerMXBean.java
=>
hadoop-ozone/ozonefs/src/main/java/org/apache/hadoop/fs/ozone/RootedOzFs.java
(54%)
create mode 100644
hadoop-ozone/recon/src/main/java/org/apache/hadoop/ozone/recon/MetricsServiceProviderFactory.java
create mode 100644
hadoop-ozone/recon/src/main/java/org/apache/hadoop/ozone/recon/api/MetricsProxyEndpoint.java
copy
hadoop-hdds/server-scm/src/main/java/org/apache/hadoop/hdds/scm/pipeline/PipelineManagerMXBean.java
=>
hadoop-ozone/recon/src/main/java/org/apache/hadoop/ozone/recon/metrics/Metric.java
(57%)
create mode 100644
hadoop-ozone/recon/src/main/java/org/apache/hadoop/ozone/recon/spi/MetricsServiceProvider.java
create mode 100644
hadoop-ozone/recon/src/main/java/org/apache/hadoop/ozone/recon/spi/impl/PrometheusServiceProviderImpl.java
create mode 100644
hadoop-ozone/recon/src/main/java/org/apache/hadoop/ozone/recon/tasks/TableCountTask.java
create mode 100644
hadoop-ozone/recon/src/test/java/org/apache/hadoop/ozone/recon/tasks/TestTableCountTask.java
create mode 100644
hadoop-ozone/recon/src/test/resources/prometheus-test-response.txt
delete mode 100644
hadoop-ozone/tools/src/main/java/org/apache/hadoop/ozone/admin/OzoneAdmin.java
create mode 100644
hadoop-ozone/tools/src/main/java/org/apache/hadoop/ozone/conf/OzoneGetConf.java
create mode 100644
hadoop-ozone/tools/src/main/java/org/apache/hadoop/ozone/conf/OzoneManagersCommandHandler.java
create mode 100644
hadoop-ozone/tools/src/main/java/org/apache/hadoop/ozone/conf/PrintConfKeyCommandHandler.java
create mode 100644
hadoop-ozone/tools/src/main/java/org/apache/hadoop/ozone/conf/StorageContainerManagersCommandHandler.java
copy
hadoop-hdds/common/src/main/java/org/apache/hadoop/hdds/utils/BackgroundTask.java
=>
hadoop-ozone/tools/src/main/java/org/apache/hadoop/ozone/conf/package-info.java
(79%)
create mode 100644
hadoop-ozone/tools/src/main/java/org/apache/hadoop/ozone/debug/DropTable.java
copy
hadoop-ozone/tools/src/main/java/org/apache/hadoop/ozone/debug/{ListTables.java
=> RocksDBUtils.java} (58%)
create mode 100644
hadoop-ozone/tools/src/main/java/org/apache/hadoop/ozone/freon/DatanodeChunkValidator.java
copy
hadoop-hdds/tools/src/main/java/org/apache/hadoop/hdds/scm/cli/container/WithScmClient.java
=>
hadoop-ozone/tools/src/main/java/org/apache/hadoop/ozone/shell/ClearSpaceQuotaOptions.java
(60%)
rename
hadoop-hdds/tools/src/main/java/org/apache/hadoop/hdds/scm/cli/container/WithScmClient.java
=>
hadoop-ozone/tools/src/main/java/org/apache/hadoop/ozone/shell/SetSpaceQuotaOptions.java
(55%)
copy
hadoop-ozone/tools/src/main/java/org/apache/hadoop/ozone/shell/{token/RenewTokenHandler.java
=> bucket/ClearQuotaHandler.java} (57%)
create mode 100644
hadoop-ozone/tools/src/main/java/org/apache/hadoop/ozone/shell/bucket/SetQuotaHandler.java
copy
hadoop-ozone/tools/src/main/java/org/apache/hadoop/ozone/shell/{token/RenewTokenHandler.java
=> volume/ClearQuotaHandler.java} (59%)
copy
hadoop-ozone/tools/src/main/java/org/apache/hadoop/ozone/shell/volume/{UpdateVolumeHandler.java
=> SetQuotaHandler.java} (58%)
create mode 100644
hadoop-ozone/tools/src/test/java/org/apache/hadoop/ozone/conf/TestGetConfOptions.java
create mode 100644
hadoop-ozone/tools/src/test/java/org/apache/hadoop/ozone/freon/TestContentGenerator.java
create mode 100644
hadoop-ozone/tools/src/test/java/org/apache/hadoop/ozone/shell/TestOzoneAddressClientCreation.java
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
