[
https://issues.apache.org/jira/browse/HDDS-7444?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dave Teng updated HDDS-7444:
----------------------------
Description:
This is an umbrella jira for Ozones's du/df functionalities improvement:
Current Status of the du/df functionality in Ozone file system:
- Related found issues: HDDS-7260, HDDS-7443
- What is supported currently:
du:
- du supports _admin_ user to query on
{_}volume{_}/{_}bucket{_}/{_}directory{_} level (only supported in _FSO_ type
of bucket)
with command
{code:java}
ozone admin namespace du -r /vol1/bucket1/dir{code}
df:
- df supports _admin_ user to query quota on _bucket_ level (need _FSO_ type)
{code:java}
ozone admin namespace quota /vol1/bucket1 {code}
- What Not-Supported currently:
du:
- not supported for _non-admin_ users
df:
- not supported for _non-admin_ user
- not supported on *directory* level for _admin_ user
- Proposal:
In order to enable du/df to work for both admin/non-admin users,
We'd like to improve the integration between Recon & Ozone.
Though another potential solution is to use SCM reports disk usage back to OM,,
but this requires OM to traverse all keys of the target directory, which might
have performance issue.(could be further discussed)
Thus we think using _Recon_ might be a better solution.
What work would be required:
1. Currently there is no ACL management in Recon.
We have to firstly integrate ACL management into Recon.(For example, Ranger)
2. Utilize Recon API for ozone du command on volume/bucket/ directory level,
with ACL integrated.
3. Utilize Recon API for ozone df command on volume/bucket/ directory level,
with ACL integrated.
was:
This is an umbrella jira for Ozones's du/df functionalities improvement:
Current Status of the du/df functionality in Ozone file system:
- Related found issues: HDDS-7260, HDDS-7443
- What is supported currently:
du:
- du supports _admin_ user to query on
{_}volume{_}/{_}bucket{_}/{_}directory{_} level (only supported in _FSO_ type
of bucket)
with command
{code:java}
ozone admin namespace du -r /vol1/bucket1/dir{code}
df:
- df supports _admin_ user to query quota on _bucket_ level (need _FSO_ type)
{code:java}
ozone admin namespace quota /vol1/bucket1 {code}
- What Not-Supported currently:
du:
- not supported for _non-admin_ users
df:
- not supported for _non-admin_ user
- not supported on *directory* level for _admin_ user
- Proposal:
In order to enable du/df to work for both admin/non-admin users,
We'd like to improve the integration between Recon & Ozone.
Though another potential solution is to use SCM reports disk usage back to OM,,
but this requires OM to traverse all keys of the target directory, which might
have performance issue.(could be further discussed)
Thus we think using _Recon_ might be a better solution.
What work would be required:
1. Currently there is no ACL management in Recon.
We have to firstly integrate ACL management into Recon.(For example, Ranger)
2. Utilize Recon API for ozone du command on volume/bucket/ directory level,
with ACL integrated.
3. Utilize Recon API for ozone df command on volume/bucket/ directory level,
with ACL integrated.
> Improvement for ozone -du/df functionalities
> --------------------------------------------
>
> Key: HDDS-7444
> URL: https://issues.apache.org/jira/browse/HDDS-7444
> Project: Apache Ozone
> Issue Type: Improvement
> Components: Ozone Filesystem
> Reporter: Dave Teng
> Priority: Major
> Labels: file-system, ozone
>
> This is an umbrella jira for Ozones's du/df functionalities improvement:
> Current Status of the du/df functionality in Ozone file system:
> - Related found issues: HDDS-7260, HDDS-7443
> - What is supported currently:
> du:
> - du supports _admin_ user to query on
> {_}volume{_}/{_}bucket{_}/{_}directory{_} level (only supported in _FSO_ type
> of bucket)
> with command
> {code:java}
> ozone admin namespace du -r /vol1/bucket1/dir{code}
> df:
> - df supports _admin_ user to query quota on _bucket_ level (need _FSO_ type)
> {code:java}
> ozone admin namespace quota /vol1/bucket1 {code}
> - What Not-Supported currently:
> du:
> - not supported for _non-admin_ users
> df:
> - not supported for _non-admin_ user
> - not supported on *directory* level for _admin_ user
>
> - Proposal:
> In order to enable du/df to work for both admin/non-admin users,
> We'd like to improve the integration between Recon & Ozone.
> Though another potential solution is to use SCM reports disk usage back to
> OM,,
> but this requires OM to traverse all keys of the target directory, which
> might have performance issue.(could be further discussed)
> Thus we think using _Recon_ might be a better solution.
>
> What work would be required:
> 1. Currently there is no ACL management in Recon.
> We have to firstly integrate ACL management into Recon.(For example, Ranger)
> 2. Utilize Recon API for ozone du command on volume/bucket/ directory level,
> with ACL integrated.
> 3. Utilize Recon API for ozone df command on volume/bucket/ directory level,
> with ACL integrated.
>
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
