Arun Sarin created HDDS-8646:
--------------------------------
Summary: [Quota] Ozone key put fails during parallel writes with
space quota set
Key: HDDS-8646
URL: https://issues.apache.org/jira/browse/HDDS-8646
Project: Apache Ozone
Issue Type: Bug
Components: Ozone Manager
Reporter: Arun Sarin
Ozone key put fails during parallel write with space quota set
Files being written - 10 No 's
File Size - 768 MB
Quota set of volume & bucket : 12.08 GB
Volume
{code:java}
[root@quasar-tebynh-1 ~]# ozone sh volume info o3://ozone1/vol-quota-1684404995/
{
"metadata" : { },
"name" : "vol-quota-1684404995",
"admin" : "hrt_qa",
"owner" : "root",
"quotaInBytes" : 12079595520,
"quotaInNamespace" : -1,
"usedNamespace" : 1,
"creationTime" : "2023-05-18T10:16:40.765Z",
"modificationTime" : "2023-05-18T10:16:59.288Z",
"acls" : [ {
"type" : "USER",
"name" : "root",
"aclScope" : "ACCESS",
"aclList" : [ "ALL" ]
}, {
"type" : "GROUP",
"name" : "root",
"aclScope" : "ACCESS",
"aclList" : [ "ALL" ]
} ],
"refCount" : 0
} {code}
Bucket
{code:java}
[root@quasar-tebynh-1 ~]# ozone sh bucket info
o3://ozone1/vol-quota-1684404995/buck-quota-1684404995
{
"metadata" : { },
"volumeName" : "vol-quota-1684404995",
"name" : "buck-quota-1684404995",
"storageType" : "DISK",
"versioning" : false,
"usedBytes" : 11513364480,
"usedNamespace" : 5,
"creationTime" : "2023-05-18T10:16:44.333Z",
"modificationTime" : "2023-05-18T10:16:51.701Z",
"quotaInBytes" : 12079595520,
"quotaInNamespace" : -1,
"bucketLayout" : "FILE_SYSTEM_OPTIMIZED",
"link" : false
} {code}
Keys successfully written
{code:java}
[root@quasar-tebynh-1 ~]# ozone fs -ls -r
ofs://ozone1/vol-quota-1684404995/buck-quota-1684404995/
Found 5 items
-rw-rw-rw- 3 hdfs hdfs 767557632 2023-05-18 10:20
ofs://ozone1/vol-quota-1684404995/buck-quota-1684404995/quota9_1684405023
-rw-rw-rw- 3 hdfs hdfs 767557632 2023-05-18 10:20
ofs://ozone1/vol-quota-1684404995/buck-quota-1684404995/quota6_1684405023
-rw-rw-rw- 3 hdfs hdfs 767557632 2023-05-18 10:20
ofs://ozone1/vol-quota-1684404995/buck-quota-1684404995/quota5_1684405023
-rw-rw-rw- 3 hdfs hdfs 767557632 2023-05-18 10:20
ofs://ozone1/vol-quota-1684404995/buck-quota-1684404995/quota3_1684405023
-rw-rw-rw- 3 hdfs hdfs 767557632 2023-05-18 10:20
ofs://ozone1/vol-quota-1684404995/buck-quota-1684404995/quota2_1684405023 {code}
While the parallel writes are happening 5 keys are getting written and other 5
are failing with Quota exceeded error.
Error Message for failing put's:
{code:java}
AssertionError: Ozone put Key failed with output=[23/05/18 10:19:17 INFO
metrics.MetricRegistries: Loaded MetricRegistries class
org.apache.ratis.metrics.impl.MetricRegistriesImpl
QUOTA_EXCEEDED The DiskSpace quota of bucket:buck-quota-1684404995 exceeded
quotaInBytes: 12079595520 Bytes but diskspace consumed: 13816037376 Bytes.]
{code}
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
