[
https://issues.apache.org/jira/browse/HDDS-8646?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Sumit Agrawal reassigned HDDS-8646:
-----------------------------------
Assignee: Sumit Agrawal
> [Quota] Ozone key put fails during parallel writes with space quota set
> -----------------------------------------------------------------------
>
> Key: HDDS-8646
> URL: https://issues.apache.org/jira/browse/HDDS-8646
> Project: Apache Ozone
> Issue Type: Bug
> Components: Ozone Manager
> Reporter: Arun Sarin
> Assignee: Sumit Agrawal
> Priority: Major
>
> Ozone key put fails during parallel write with space quota set
> Files being written - 10 No 's
> File Size - 768 MB
> Quota set of volume & bucket : 12.08 GB
> Volume
> {code:java}
> [root@quasar-tebynh-1 ~]# ozone sh volume info
> o3://ozone1/vol-quota-1684404995/
> {
> "metadata" : { },
> "name" : "vol-quota-1684404995",
> "admin" : "hrt_qa",
> "owner" : "root",
> "quotaInBytes" : 12079595520,
> "quotaInNamespace" : -1,
> "usedNamespace" : 1,
> "creationTime" : "2023-05-18T10:16:40.765Z",
> "modificationTime" : "2023-05-18T10:16:59.288Z",
> "acls" : [ {
> "type" : "USER",
> "name" : "root",
> "aclScope" : "ACCESS",
> "aclList" : [ "ALL" ]
> }, {
> "type" : "GROUP",
> "name" : "root",
> "aclScope" : "ACCESS",
> "aclList" : [ "ALL" ]
> } ],
> "refCount" : 0
> } {code}
> Bucket
> {code:java}
> [root@quasar-tebynh-1 ~]# ozone sh bucket info
> o3://ozone1/vol-quota-1684404995/buck-quota-1684404995
> {
> "metadata" : { },
> "volumeName" : "vol-quota-1684404995",
> "name" : "buck-quota-1684404995",
> "storageType" : "DISK",
> "versioning" : false,
> "usedBytes" : 11513364480,
> "usedNamespace" : 5,
> "creationTime" : "2023-05-18T10:16:44.333Z",
> "modificationTime" : "2023-05-18T10:16:51.701Z",
> "quotaInBytes" : 12079595520,
> "quotaInNamespace" : -1,
> "bucketLayout" : "FILE_SYSTEM_OPTIMIZED",
> "link" : false
> } {code}
> Keys successfully written
> {code:java}
> [root@quasar-tebynh-1 ~]# ozone fs -ls -r
> ofs://ozone1/vol-quota-1684404995/buck-quota-1684404995/
> Found 5 items
> -rw-rw-rw- 3 hdfs hdfs 767557632 2023-05-18 10:20
> ofs://ozone1/vol-quota-1684404995/buck-quota-1684404995/quota9_1684405023
> -rw-rw-rw- 3 hdfs hdfs 767557632 2023-05-18 10:20
> ofs://ozone1/vol-quota-1684404995/buck-quota-1684404995/quota6_1684405023
> -rw-rw-rw- 3 hdfs hdfs 767557632 2023-05-18 10:20
> ofs://ozone1/vol-quota-1684404995/buck-quota-1684404995/quota5_1684405023
> -rw-rw-rw- 3 hdfs hdfs 767557632 2023-05-18 10:20
> ofs://ozone1/vol-quota-1684404995/buck-quota-1684404995/quota3_1684405023
> -rw-rw-rw- 3 hdfs hdfs 767557632 2023-05-18 10:20
> ofs://ozone1/vol-quota-1684404995/buck-quota-1684404995/quota2_1684405023
> {code}
> While the parallel writes are happening 5 keys are getting written and other
> 5 are failing with Quota exceeded error.
> Error Message for failing put's:
> {code:java}
> AssertionError: Ozone put Key failed with output=[23/05/18 10:19:17 INFO
> metrics.MetricRegistries: Loaded MetricRegistries class
> org.apache.ratis.metrics.impl.MetricRegistriesImpl
> QUOTA_EXCEEDED The DiskSpace quota of bucket:buck-quota-1684404995 exceeded
> quotaInBytes: 12079595520 Bytes but diskspace consumed: 13816037376 Bytes.]
> {code}
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
