Jyotinder Singh created HDDS-6907:
-------------------------------------
Summary: OFS should create buckets with FILE_SYSTEM_OPTIMIZED
layout.
Key: HDDS-6907
URL: https://issues.apache.org/jira/browse/HDDS-6907
Project: Apache Ozone
Issue Type: Sub-task
Reporter: Jyotinder Singh
Assignee: Jyotinder Singh
As the config {{ozone.default.bucket.layout}} governs the further created
bucket layout type, if the default layout type is changed to OBJECT_STORE and
the bucket indirectly created via {{mkdir -p}} command also results in an OBS
bucket that doesn't support further FS operations.
{code:java}
[root@quasar-kykadl-1 ~]# hdfs dfs -mkdir -p ofs://ozone1/vol/buck1
22/06/16 12:23:07 INFO rpc.RpcClient: Creating Bucket: vol/buck1, with om as
owner and Versioning false and Storage Type set to DISK and Encryption set to
false
[root@quasar-kykadl-1 ~]# ozone sh bucket info vol/buck1
{
"metadata" : { },
"volumeName" : "vol",
"name" : "buck1",
"storageType" : "DISK",
"versioning" : false,
"usedBytes" : 0,
"usedNamespace" : 0,
"creationTime" : "2022-06-16T12:23:07.538Z",
"modificationTime" : "2022-06-16T12:23:07.538Z",
"quotaInBytes" : -1,
"quotaInNamespace" : -1,
"bucketLayout" : "OBJECT_STORE",
"owner" : "om",
"link" : false
}
[root@quasar-kykadl-1 ~]# hdfs dfs -ls ofs://ozone1/vol/buck1
-ls: Bucket: buck1 has layout: OBJECT_STORE, which does not support file system
semantics. Bucket Layout must be FILE_SYSTEM_OPTIMIZED or LEGACY.
{code}
*Problems that may arise :*
In case the user adds a component later after changing the default to OBS, the
component's first run of DFS directory creation will be with OBS layout type
which doesn't support Filesystem semantics.
Might see issues with Hive/Spark using Ozone FS.
Bucket created from fs cli should always be FSO not depending on the default
type.
--
This message was sent by Atlassian Jira
(v8.20.7#820007)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
