This is an automated email from the ASF dual-hosted git repository.
msingh pushed a change to branch HDDS-3630
in repository https://gitbox.apache.org/repos/asf/ozone.git.
omit 84afcf3 Merge remote-tracking branch 'apache/master' into HDDS-3630
omit 71b0471 HDDS-6337. [FSO] Disable recursive access check flag for
directories with no children. (#3134)
omit 1e74cb1 HDDS-6374. Fix incorrect queueTime metrics of ReplicationTask
(#3135)
omit ff06807 HDDS-6369. PARTIAL_RENAME does not update OM DB (#3126)
omit d2b832e HDDS-6361. Modify docs build flow to replace image tags with
shortcodes. (#3122)
omit 84a2a67 HDDS-6334. Remove ContainerID to Proto to ContainerID
conversion in ContainerStateManagerImpl (#3110)
omit 9b6a0e8 HDDS-5194. Provide kustomize descriptors for Ozone kubernetes
examples (#2221)
omit 192ef6f HDDS-6235. Empty KeyValueContainers are replicated without
chunks directory. (#3052)
omit 1197e6d HDDS-6349. IncompleteReadError on get MPU key from TDE bucket
(#3116)
omit 7b6baaa HDDS-5359. Incorrect BLOCKCOUNT and BYTESUSED in container
DB. (#3034)
omit 7ce1b55 HDDS-6221. Update versions covered by cross-compatibility
test (#3017)
omit 07a3eb4 HDDS-6363. Update checkstyle version to 9.3 (#3123)
omit aebdb6b HDDS-5267. Full Container Report can remove replicas added by
an Incremental Report (#2963)
omit 9cb1191 HDDS-6351. [Docs] Update prefix-based FSO documentation.
(#3115)
omit 7de53c4 HDDS-6327. Upgrade acceptance test doesn't collect logs when
the test fails (#3106)
omit 1aefd7e HDDS-6328. Add metrics - number of FSO bucket deletes (#3107)
omit 86b8a9b HDDS-6350. Rename TestStandardOutputUtil to observe naming
conventions (#3114)
omit 9629f0b HDDS-6329. New checkstyle: AvoidStarImport (#3096)
omit 742b0bd HDDS-6292. Ensure immutable ContainerReplica set is returned
from ContainerStateManagerImpl (#3071)
omit 8cb93b5 HDDS-6212. SCM Container DB bootstrap on Recon startup for
secure cluster (#3027)
omit b4ac55b HDDS-6234. Repair containers affected by incorrect used bytes
and block count. (#3042)
omit cbb51c1 HDDS-6262. ozone insight log stops working after OM DBUpdates
message (#3044)
omit a33c31d HDDS-6290. operational-state and node-state options in
datanode list CLI not working correctly (#3105)
omit cf06445 HDDS-6314. ConcurrentModificationException getting
SCMContainerMetrics (#3101)
omit fd6b2c6 HDDS-6284. Add BlockDeletingService worker size config (#3056)
omit 56ea9b4 HDDS-6324. Do not trigger CI by reopening PR (#3092)
omit 5b1b276 HDDS-6283. Change ContainerStateMachine ContainerOpExecutor
name (#3055)
omit 8a326a8 HDDS-6331. Remove toString in debug log parameters within
SCMCommonPlacementPolicy (#3098)
omit 9ae9a57 HDDS-6330. Remove unnecessary duplicate semicolons (#3097)
omit 5222300 HDDS-6305: Add metrics - number of FSO bucket creates (#3077)
omit a849fd7 HDDS-6311. Fix number of keys displayed in Recon Overview.
(#3081)
omit 4a50c86 HDDS-6325. Fix interface ClientProtocol methods typo
setThreadLocalS3Auth and clearThreadLocalS3Auth (#3093)
omit 97692e3 HDDS-6322. Fix Recon getting inccorrect sequenceNumber from
OM (#3090)
omit 3ce111d HDDS-5913. Avoid integer overflow when setting
dfs.container.ratis.lo… (#2785)
omit 7f027a1 HDDS-6313. Remove replicas in ContainerStateMap when a
container is deleted (#3086)
omit fbbfacc HDDS-6186. Selective checks: skip integration check for unit
test changes (#3061)
omit 5eb8d9e HDDS-6310. Update json-smart to 2.4.7. (#3080)
omit 67821c0 HDDS-6190. Cleanup unnecessary datanode id path checks.
(#2993)
omit 834949a HDDS-6304. Add enforcer to make sure ozone.version equals
project.version (#3075)
omit dbab846 HDDS-6309. Update ozone-runner version to 20220212-1 (#3079)
omit 7613306 HDDS-6293. Allow using custom ozone-runner image (#3072)
omit 3ecfcb0 HDDS-4126. Freon key generator should support >2GB files.
(#3054)
omit a016b52 HDDS-6088. Implement O3FS/OFS getFileChecksum() using file
checksum helpers - addendum: fix checkstyle
omit e3cc9d1 HDDS-6088. Implement O3FS/OFS getFileChecksum() using file
checksum helpers. (#2935)
omit 1e2a819 HDDS-6257. Wrong stack trace for S3 errors (#3066)
omit e12ad2d HDDS-6278 Improve memory profile for listStatus API call.
(#3053)
omit d9eced2 HDDS-6285. ozonesecure-mr intermittently failing with timeout
downloading packages (#3057)
omit 53e6aea HDDS-6291. Do not let slf4j-log4j12 leak into Ozone FS shaded
jar (#3064)
omit 58a0cac HDDS-6289. Upgrade acceptance test log flooded with parse
error (#3063)
omit 85816df HDDS-6208. New checkstyle: WhitespaceAround (#3003)
omit a441f04 HDDS-6247. Avoid logging stack trace for user input problems
(#3039)
omit 1c60c12 HDDS-6226. Run tests for selective CI checks in CI (#3019)
omit 8585e8d HDDS-6215. Recon get limited delta updates from OM (#3009)
omit 17db563 HDDS-6140. Selective checks: skip unit check for
integration-test changes (#2948)
omit d4ea29e HDDS-6273. Amend doc SecuringTDE.md (#3047)
omit 79e9046 HDDS-6270. Use a dedicated file instead of /etc/passwd for
xcompat acceptance test (#3050)
omit faa1577 HDDS-6169. Selective checks: skip junit tests on ozone-runner
image update (#2974)
omit 50d49ba HDDS-6204. Cleanup handling malformed authorization header
(#2999)
omit 0576d59 HDDS-6253. Unnecessary duplicate smoketest after defaulting
to FSO (#3036)
omit ccfc01e HDDS-2919. Intermittent failure in TestRDBStore (#3028)
omit d13381b HDDS-6238 Reduce memory requirements for list keys. (#3032)
omit a4636cf HDDS-6245. Add BucketLayout logging to Audit Logs (#3040)
omit 37f5c4e HDDS-6206. Application errors must not flood system log
(#3001)
omit a911276 HDDS-6181. Change SCMHAInvocationHandler#invokeRatis()
logging to TRACE (#2992)
omit dbfb1f9 HDDS-5529. For any IOexception from @Replicated method we
should throw it (#2788)
omit 4994a39 HDDS-6201. Fix NPE for DataScanner with scanned container
deleted by others. (#3005)
omit b1f8f63 HDDS-6239. ozonesecure-mr failing with No URLs in mirrorlist
(#3029)
omit ae1d283 HDDS-6227. Test helpers should observe naming conditions
(#3020)
omit 0833ee3 HDDS-6205. Add CLI command to display the latest Replication
Manager report (#3013)
omit 25e99a0 HDDS-6192. feature/Observability.md translated to Chinese
(#2994)
omit 7369ead HDDS-6219. Switch to RATIS ReplicationType from STAND_ALONE
in our tests. (#3014)
omit 572251b HDDS-6211. [Docs] Image styling on deployed site does not
replicate local builds. (#3007)
omit 46eff76 HDDS-6177. Extend container info command to include replica
details (#2995)
omit 066b79d HDDS-6128. CLI tool that downloads all the block replicas and
creates a manifest file (#2987)
omit fae9b2a HDDS-6191. Intermittent failure in TestDeleteWithSlowFollower
(#3015)
omit 834cb1a HDDS-6216. Move OMOpenKeysDeleteRequest to package
om.request.key (#3011)
omit 94f59e5 HDDS-6203. CleanUp incomplete gz files during Container move
(#3000)
omit 6fc732c HDDS-3408. Rename ChunkLayOutVersion to
ContainerLayoutVersion. (#2983)
omit ce6054a HDDS-6109. Preserve the underlying exception raised in client
lib. (#2989)
omit 0032f6e HDDS-6135. SCM Container DB bootstrap on Recon startup for
SCM HA. (#2972)
omit 408e7a8 HDDS-6202. Avoid using jmh-generator-annprocess since it is
GPL2.0. (#2998)
omit f061a42 HDDS-6163. Fix PATH in docker image (#2967)
omit e5e5abc HDDS-6171. Create an API to change Bucket Owner (#2988)
omit a182eb9 HDDS-6167. Update ozone-runner version to 20211202-1 (#2969)
omit 3017c8d HDDS-6195. Remove unused jmh-core dependency. (#2997)
omit 2aacf6c HDDS-6147. Add ability in OM to get limited delta updates
(#2956)
omit da819e5 HDDS-6120. Compute block checksum using chunk checksums
(#2930)
omit d3e8617 HDDS-4190. Intermittent failure in
TestOMVolumeSetOwnerRequest and TestOMVolumeSetQuotaRequest. (#2982)
omit 57e24aa HDDS-6183. Intermittent failure in
TestKeyDeletingService.checkIfDeleteServiceWithFailingSCM. (#2991)
omit d63d398 HDDS-5740. Enable ratis by default for SCM. (#2637)
omit a9dac96 HDDS-6175. Use s3Auth during proxy during decrypt in
RpcClient. (#2981)
omit 1b8c570 HDDS-6114. Intermittent error due to Failed to init RocksDB
(#2947)
omit 41be11a HDDS-4743. [FSO] Add FSO variant of ITestOzoneContractDistcp.
(#2980)
omit e2249e8 HDDS-6157. More consistent synchronization in InputStreams
(#2965)
omit 20a9b1c HDDS-5927. Improve defaults in ContainerBalancerConfiguration
(#2892)
omit 6333ddb HDDS-3231. Cleanup KeyManagerImpl (#2961)
omit d037b68 HDDS-6170. Add metrics to replication manager to track
container health states (#2975)
omit b838906 HDDS-4010. S3G startup fails when multiple service ids are
configured. (#2976)
omit caeeed8 HDDS-6134. Move replication-specific config to
ReplicationServer (#2943)
omit 65722cc HDDS-6161. SCM StateMachine failing to reinitialize doesn't
terminate the process. (#2971)
omit 1f3fa6b HDDS-6148. Validate ContainerBalancerConfiguration before
start ContainerBalancer (#2957)
omit 5728511 HDDS-6086. Compute MD5MD5CRC file checksum using chunk
checksums from DataNodes (#2919)
omit 90f5c8c HDDS-4177. SCM Container DB bootstrap on Recon startup (#2942)
omit 529b596 HDDS-6075. OzoneConfiguration constructor overrides input
configuration keys. (#2921)
omit af3e985 HDDS-6094. Some unit tests are skipped due to using JUnit4
runner (#2909)
omit bcd8fd0 HDDS-6149. Remove unused keytabs (#2960)
omit ce0a81f HDDS-6123. Disable system exit in integration tests (#2959)
omit 8d586a2 HDDS-6145. Include docker-compose output in acceptance test
output.log (#2958)
omit 14a036e HDDS-6103. Avoid refresh pipeline for key override in
Key/File Create. (#2926)
omit 799c5f0 HDDS-6146. TestDefaultCAServer#testIntermediaryCA failure
(#2955)
omit 4043682 HDDS-6108. Add slf4j and log4j.properties for tests in
hadoop-ozone/client (#2925)
omit 6004246 HDDS-6118. Documentation missing settings to secure S3g with
Kerberos (#2950)
omit 9d0328f HDDS-6119. Reset the property name to configure the datanode
kerberos keytab (#2949)
omit 4e6be1f HDDS-6142. Remove unused dependency: jdom (#2951)
omit 600bda6 HDDS-6143. Update log4j version to 2.17.1 (#2952)
omit 0dc4905 HDDS-5319 Intermittent failure in
TestSCMUpdateServiceGrpcServer (#2558)
omit f7b9c36 HDDS-5993. Disable flaky
TestRandomKeyGenerator#cleanObjectsTest
omit 0825e35 HDDS-6121. DatanodeAdminMonitor should log detailed
information for a limited number of containers (#2932)
omit ecc49d7 HDDS-6070. ContainerBalancerConfig doesn't read config from
ozone-site.xml (#2893)
omit d3c6b4a HDDS-6129. OM has thread unsafe issues that can cause OM
shutdown. (#2938)
omit 8f1d5b2 HDDS-5807. [FSO] Merge HDDS-4653 changes to support TDE for
MPU Keys in FSO bucket layout. (#2941)
omit b80319c HDDS-5975. Serve url-encoded key and prefix name for
ListObjectResponse (#2834)
omit 13ad5db HDDS-6101. use FileUtils.moveDirectory instead of Files.move
when installing snapshot (#2918)
omit 860f904 HDDS-5602. make it configurable to choose the nearest one as
the target in the candidates according to networkTopology (#2756)
omit 1740598 HDDS-6125. Support Hugo 0.91.0. (#2934)
omit 1df5931 HDDS-6124. Update log4j version to 2.17.0 version (#2933)
omit 8c0ec9d HDDS-5490. Remove (Decommission) an OM node from HA ring
(#2886)
omit 5455fac HDDS-5795. [FSO] Add unit test case with mpu open key during
abort. (#2931)
omit c923508 HDDS-6110. Add hugo lock file to gitignore (#2928)
omit 73c6201 HDDS-5912. Add description of hdds.datanode.dir in Getting
Started (#2783)
omit ca4ddd8 HDDS-6105. remove db cache size config (#2922)
omit f129671 HDDS-6072. Fix increased integration test execution time
(#2900)
omit bda049b HDDS-6089. Remove OMClientResponse#getBucketLayout override
in subclasses - part2 (#2915)
omit 310cdec HDDS-6107. Exclude hugo lock file from source tarball (#2923)
omit 75c72df HDDS-6080. Simplify the logic in
SimpleContainerDownloader.getContainerDataFromReplicas (#2903)
omit 6624532 HDDS-6053. Fix too short container scrubber data scan
interval. (#2875)
omit b1c23fa HDDS-6104. Update log4j version to 2.16.0 version. (#2920)
omit a9b4467 HDDS-6018 Closing state to quasiclosed (#2854)
omit 2a5d7a7 HDDS-6096. S3 copy object fails for source key with special
char (#2912)
omit 1b76294 HDDS-6090. Collect output.log from acceptance tests (#2908)
omit 458b654 HDDS-6066. Cleanup OmService injection. (#2896)
omit ef5cf76 HDDS-6085. Update log4j to 2.15 (#2906)
omit ff63767 HDDS-5974. Remove OMClientResponse#getBucketLayout override
in subclasses - part1 (#2894)
omit 1fd6101 HDDS-6078. Move BucketManagerImpl#resolveLinkBucketLayout
into utilit… (#2902)
omit 5445334 HDDS-6046. Multi-threaded validator for freon
RandomKeyGenerator. (#2869)
omit d08011a HDDS-6069: Fix XmlRootElement for CopyObjectResponse (#2891)
omit aa0c69d HDDS-6073. Document: Fix images alignment in the doc pages
(#2898)
omit 0470930 HDDS-5385. [FSO] Remove ozone.om.metadata.layout config in OM
(#2887)
omit 5229537 HDDS-6071. ResourceLimitCache leaks permits (#2895)
omit 95865b0 HDDS-6067. Improve Debugging around unhealthy container state
on Datanode. (#2888)
omit 841d3ec HDDS-3227. Ensure eviction of stateMachineData from cache
only when both followers catch up (#2704)
omit d66ad70 HDDS-6059. Change Cannot close container log message from
WARN to DEBUG (#2890)
omit fbd6b59 HDDS-5903. Add Support for Bucket Owner Acls (#2826)
omit c743865 HDDS-5973. Changed sequence of steps during pipeline close.
(#2847)
omit 90be5f7 HDDS-5965. Recon should be able to distinguish between
containers that have no replicas and those have all replicas as UNHEALTHY.
(#2874)
omit 4869766 HDDS-6061. Peer datanode cannot add group for pipeline in
secure env (#2882)
omit ea50f88 HDDS-6041. [FSO] Revisit robot test cases related to
prefix/simple me… (#2885)
omit 15c0c5a HDDS-6058. Bump aws-java-sdk to latest 1.12 (#2881)
omit 5be0778 HDDS-5997 Centralize string based replication config
validation via ReplicationConfigValidator (#2871)
omit 57d17c1 HDDS-5962. Limit grpc threads in XceiverServerGrpc. (#2824)
omit 53818cc HDDS-6014. Add proto.lock files from ozone-1.2 release branch
to master (#2865)
omit 6a00d27 HDDS-5999. Freon datanode chunk validator does not find
pipeline from param (#2879)
omit 1ddac15 HDDS-5959. Handles bucket layout validation logic in ofs/o3fs
client. (#2837)
omit 1186262 HDDS-6055. Refactor isFileSystemOptimized usage in
OzoneManagerUtils (#2877)
omit 0f54c90 HDDS-6000. Freon datanode chunk validator fails checksum
validation (#2850)
omit 5091bdd HDDS-6054. Fix resource leak due to OzoneManager.createOm
(#2876)
omit aad2bd0 HDDS-5936. Duplicate Test Ozone Shell invocation (#2803)
omit 432c146 HDDS-5702. SCM remote benchmark tool. (#2600)
omit ccf68ea HDDS-5917. S3 acceptance test failure due to too wide
assertion (#2789)
omit c8b3000 HDDS-5804. SCMContainerPlacementCapacity to choose lower
utilized node (#2784)
omit 0db7930 HDDS-5497. Save log from init containers (#2547)
omit d8f32a6 HDDS-6011. Freon datanode chunk generator fails with NPE in
secure cluster (#2853)
omit 58ceddf HDDS-5989. Binary content printed for failed chunk write
(#2846)
omit a1a3bd9 HDDS-5897. Support configuration for including/excluding
datanodes for balancing (#2786)
omit b887b89 HDDS-6043. Buckets created via link command do not mirror
layout of s… (#2867)
omit a9ecaf0 HDDS-6003. Update Ozone master branch version after 1.2.0
release (#2863)
omit a6f0bec HDDS-6019. Fix s3g create key error in cluster with
replication one. (#2855)
omit 8a6b5e4 [FSO] Allow existing/old buckets with any layout during OM
startup (#2571)
omit 40e0473 HDDS-5976. add raftlog IOException notifier for SCM HA (#2840)
omit 2585ece HDDS-5517. Support multiple container moves from a source
datanode in one balance iteration (#2808)
omit 0baa42e HDDS-5898 S3G in secure mode checks OM version. (#2822)
omit 3d92b3b HDDS-5534. Verify config is updated on all OMs before
proceeding with Bootstrap (#2491)
omit 47b5be5 HDDS-5870. Make Datanode usageinfo command output more
readable (#2816)
omit b518a47 HDDS-5969. TestRootedOzoneFileSystem parameterized test is
not initialized properly (#2843)
omit 23fe5b1 HDDS-5980. Get on a key which is created/overwrite through
MPU on a TDE bucket, the data does not match with uploaded data. (#2844)
omit f134072 HDDS-5848. Introduce more replication metrics (#2758)
omit 8f3fa92 HDDS-5964. [S3-TDE] Range Reads not working on encrypted
buckets (#2827)
omit 2e2f7f0 HDDS-5891. OFS mkdir -p does not work as expected for bucket
creation when volume exists due to volume create ACL check (#2814)
omit c9592d3 HDDS-5957. Bump proto-backwards-compatibility from 1.0.5 to
1.0.7 (#2821)
omit 2f52203 HDDS-5983. Prefix Parser tool should only work for FSO
buckets. (#2839)
omit 9bc29ed HDDS-5906. Fix DBScanner to support Datanode DB (#2781)
omit 3ceaf8a HDDS-5982. Remove isBucketFSOptimized flag. (#2838)
omit ea19c6b HDDS-5981. Refactor usage of bucket type. (#2836)
omit 3475993 HDDS-5872. Do not failover on some RpcExceptions (#2772)
omit a5127b7 HDDS-5937. Inaccurate bucket info returned from bucket list
command in Shell (#2832)
omit 1cef2be HDDS-5958. Refine container scrub log message. (#2823)
omit 23bae65 HDDS-5820. Intermittent failure in
TestPipelinePlacementPolicy#testPickLowestLoadAnchor (#2757)
omit 2eea2eb HDDS-5970. Remove OMKeyRequest#getBucketLayout overridden
method in subclasses (#2830)
omit f3d1b9a HDDS-5960. Change option name to bucketlayout instead of type
(#2825)
omit 93f0fb0 HDDS-5929. Make FSO and OBS bucket layouts independent of
normalization config flag (#2819)
omit a6f96e9 HDDS-5956. Speed up
TestOzoneRpcClientAbstract#testZReadKeyWithUnhealthyContainerReplica (#2820)
omit bd04099 HDDS-5910 Add additional verification for S3 Auth. (#2817)
omit e851c8a HDDS-5947. Remove unused mina-core and sshd-core dependencies
(#2811)
omit 09227e5 HDDS-5839. Make sure buckets created from OFS are in
FILE_SYSTEM_OPTIMIZED layout (#2730)
omit 45fd4e1 HDDS-5922. ignore deletetransaction when container is not
found (#2793)
omit c0f387e HDDS-5935. Bump Spring to 5.2.18 (#2801)
omit 90a2076 HDDS-5945. bump rocksdb version to 6.25.3 (#2809)
omit 0948456 HDDS-5944. Fix typo in OzoneManagerServiceProviderImpl.java
(#2807)
omit bcca116 HDDS-5943. Shutdown ResultHandlerExecutorService for
StorageVolumeChecker. (#2806)
omit 57ee2d7 HDDS-5925. Fix SecuringOzoneHTTP doc (#2796)
omit 249fb30 HDDS-3369. Cleanup old write-path of volume in OM. (#2780)
omit 78ddb68 HDDS-5933. Ozone Filesystem shaded jars include unnecessary
dependencies (#2798)
omit 7af8b98 HDDS-5931. Broken link in dist/README (#2799)
omit 57ad3ca Support more detailed error log when handleFlush in Ozone
client (#2795)
omit c110da3 HDDS-3983 Ozone RocksDB Iterator wrapper should not expose
key() and value() API. (#2402)
omit 4526820 HDDS-5736. Update navbar from Hadoop to Ozone on doc page
(#2792)
omit f54a110 HDDS-5864. Retry when DN connection issue during
getBlock/ReadChunk call during Ozone key Read (#2746)
omit 82ed79c HDDS-5883 Change S3G client to set S3 Auth per req (#2775)
omit 88db753 HDDS-5908. MPU getKey can fail, if completeMPU result is
still in cache. (#2787)
omit 04b4603 HDDS-5885. OM Auth Validate for read requests and handle non
ratis enabled code. (#2779)
omit e314ccb HDDS-5863. Error message having null fields on volume
creation (#2752)
omit cbecfe6 HDDS-5920. Allow to add ColumnFamilyOptions to tables. (#2790)
add 31b415e HDDS-5920. Allow to add ColumnFamilyOptions to tables. (#2790)
This update added new revisions after undoing existing revisions.
That is to say, some revisions that were in the old version of the
branch are not in the new version. This situation occurs
when a user --force pushes a change and generates a repository
containing something like this:
* -- * -- B -- O -- O -- O (84afcf3)
\
N -- N -- N refs/heads/HDDS-3630 (31b415e)
You should already have received notification emails for all of the O
revisions, and so the following emails describe only the N revisions
from the common base, B.
Any revisions marked "omit" are not gone; other references still
refer to them. Any revisions marked "discard" are gone forever.
No new revisions were added by this update.
Summary of changes:
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
