[
https://issues.apache.org/jira/browse/HDDS-11828?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Attila Doroszlai updated HDDS-11828:
------------------------------------
Description:
Ozone debug chunkinfo command showing incorrect block path
Debug chunkinfo output -
{code:java}
# ozone debug chunkinfo
o3://ozone1732647180/testvol-1732703176/buckecfso/file_1732708663
{
"KeyLocations": [
[
{
"Datanode-HostName": "node3",
"Datanode-IP": "ip3",
"Container-ID": 2048,
"Block-ID": 113750153625602308,
"Locations": {
"files": [
"/data/1/hadoop-ozone/datanode/data/hdds/CID-3ff4197e-8f90-496f-bbaa-40ecf8bbb437/current/containerDir4/2048/chunks/113750153625602308.block"
],
"pipelineID": "24c391f5-1349-48a2-b200-796d76e6ecbd",
"chunkType": "PARITY"
}
},
{
"Datanode-HostName": "node2",
"Datanode-IP": "ip2",
"Container-ID": 2048,
"Block-ID": 113750153625602308,
"Locations": {
"files": [
"/data/1/hadoop-ozone/datanode/data/hdds/CID-3ff4197e-8f90-496f-bbaa-40ecf8bbb437/current/containerDir4/2048/chunks/113750153625602308.block"
],
"pipelineID": "24c391f5-1349-48a2-b200-796d76e6ecbd",
"chunkType": "PARITY"
}
},
{
"Datanode-HostName": "node7",
"Datanode-IP": "ip7",
"Container-ID": 2048,
"Block-ID": 113750153625602308,
"Locations": {
"files": [
"/data/1/hadoop-ozone/datanode/data/hdds/CID-3ff4197e-8f90-496f-bbaa-40ecf8bbb437/current/containerDir4/2048/chunks/113750153625602308.block"
],
"pipelineID": "24c391f5-1349-48a2-b200-796d76e6ecbd",
"chunkType": "DATA"
}
},
{
"Datanode-HostName": "node8",
"Datanode-IP": "ip8",
"Container-ID": 2048,
"Block-ID": 113750153625602308,
"Locations": {
"files": [
"/data/1/hadoop-ozone/datanode/data/hdds/CID-3ff4197e-8f90-496f-bbaa-40ecf8bbb437/current/containerDir4/2048/chunks/113750153625602308.block"
],
"pipelineID": "24c391f5-1349-48a2-b200-796d76e6ecbd",
"chunkType": "DATA"
}
},
{
"Datanode-HostName": "node6",
"Datanode-IP": "ip6",
"Container-ID": 2048,
"Block-ID": 113750153625602308,
"Locations": {
"files": [
"/data/1/hadoop-ozone/datanode/data/hdds/CID-3ff4197e-8f90-496f-bbaa-40ecf8bbb437/current/containerDir4/2048/chunks/113750153625602308.block"
],
"pipelineID": "24c391f5-1349-48a2-b200-796d76e6ecbd",
"chunkType": "DATA"
}
}
]
]
} {code}
According to above output block path for node *node8* is
_/data/1/hadoop-ozone/datanode/data/hdds/CID-3ff4197e-8f90-496f-bbaa-40ecf8bbb437/current/containerDir4/2048/chunks/113750153625602308.block_
But on checking the actual node the block path found is -
{code:java}
# find /data -name 2048
/data/2/hadoop-ozone/datanode/data/hdds/CID-3ff4197e-8f90-496f-bbaa-40ecf8bbb437/current/containerDir4/2048
# ls
/data/2/hadoop-ozone/datanode/data/hdds/CID-3ff4197e-8f90-496f-bbaa-40ecf8bbb437/current/containerDir4/2048
chunks metadata {code}
It is found in partition _/data/2_ instead of chunkinfo output _/data/1_
Cluster has 3 partitions - /data/\{1..3}
was:
Ozone debug chunkinfo command showing incorrect block path in phatcat cluster
Debug chunkinfo output -
{code:java}
# ozone debug chunkinfo
o3://ozone1732647180/testvol-1732703176/buckecfso/file_1732708663
{
"KeyLocations": [
[
{
"Datanode-HostName": "node3",
"Datanode-IP": "ip3",
"Container-ID": 2048,
"Block-ID": 113750153625602308,
"Locations": {
"files": [
"/data/1/hadoop-ozone/datanode/data/hdds/CID-3ff4197e-8f90-496f-bbaa-40ecf8bbb437/current/containerDir4/2048/chunks/113750153625602308.block"
],
"pipelineID": "24c391f5-1349-48a2-b200-796d76e6ecbd",
"chunkType": "PARITY"
}
},
{
"Datanode-HostName": "node2",
"Datanode-IP": "ip2",
"Container-ID": 2048,
"Block-ID": 113750153625602308,
"Locations": {
"files": [
"/data/1/hadoop-ozone/datanode/data/hdds/CID-3ff4197e-8f90-496f-bbaa-40ecf8bbb437/current/containerDir4/2048/chunks/113750153625602308.block"
],
"pipelineID": "24c391f5-1349-48a2-b200-796d76e6ecbd",
"chunkType": "PARITY"
}
},
{
"Datanode-HostName": "node7",
"Datanode-IP": "ip7",
"Container-ID": 2048,
"Block-ID": 113750153625602308,
"Locations": {
"files": [
"/data/1/hadoop-ozone/datanode/data/hdds/CID-3ff4197e-8f90-496f-bbaa-40ecf8bbb437/current/containerDir4/2048/chunks/113750153625602308.block"
],
"pipelineID": "24c391f5-1349-48a2-b200-796d76e6ecbd",
"chunkType": "DATA"
}
},
{
"Datanode-HostName": "node8",
"Datanode-IP": "ip8",
"Container-ID": 2048,
"Block-ID": 113750153625602308,
"Locations": {
"files": [
"/data/1/hadoop-ozone/datanode/data/hdds/CID-3ff4197e-8f90-496f-bbaa-40ecf8bbb437/current/containerDir4/2048/chunks/113750153625602308.block"
],
"pipelineID": "24c391f5-1349-48a2-b200-796d76e6ecbd",
"chunkType": "DATA"
}
},
{
"Datanode-HostName": "node6",
"Datanode-IP": "ip6",
"Container-ID": 2048,
"Block-ID": 113750153625602308,
"Locations": {
"files": [
"/data/1/hadoop-ozone/datanode/data/hdds/CID-3ff4197e-8f90-496f-bbaa-40ecf8bbb437/current/containerDir4/2048/chunks/113750153625602308.block"
],
"pipelineID": "24c391f5-1349-48a2-b200-796d76e6ecbd",
"chunkType": "DATA"
}
}
]
]
} {code}
According to above output block path for node *node8* is
_/data/1/hadoop-ozone/datanode/data/hdds/CID-3ff4197e-8f90-496f-bbaa-40ecf8bbb437/current/containerDir4/2048/chunks/113750153625602308.block_
But on checking the actual node the block path found is -
{code:java}
# find /data -name 2048
/data/2/hadoop-ozone/datanode/data/hdds/CID-3ff4197e-8f90-496f-bbaa-40ecf8bbb437/current/containerDir4/2048
# ls
/data/2/hadoop-ozone/datanode/data/hdds/CID-3ff4197e-8f90-496f-bbaa-40ecf8bbb437/current/containerDir4/2048
chunks metadata {code}
It is found in partition _/data/2_ instead of chunkinfo output _/data/1_
Cluster has 3 partitions - /data/\{1..3}
> Ozone debug chunkinfo command showing incorrect block path
> ----------------------------------------------------------
>
> Key: HDDS-11828
> URL: https://issues.apache.org/jira/browse/HDDS-11828
> Project: Apache Ozone
> Issue Type: Bug
> Components: Ozone CLI
> Reporter: Jyotirmoy Sinha
> Priority: Major
>
> Ozone debug chunkinfo command showing incorrect block path
> Debug chunkinfo output -
> {code:java}
> # ozone debug chunkinfo
> o3://ozone1732647180/testvol-1732703176/buckecfso/file_1732708663
> {
> "KeyLocations": [
> [
> {
> "Datanode-HostName": "node3",
> "Datanode-IP": "ip3",
> "Container-ID": 2048,
> "Block-ID": 113750153625602308,
> "Locations": {
> "files": [
>
> "/data/1/hadoop-ozone/datanode/data/hdds/CID-3ff4197e-8f90-496f-bbaa-40ecf8bbb437/current/containerDir4/2048/chunks/113750153625602308.block"
> ],
> "pipelineID": "24c391f5-1349-48a2-b200-796d76e6ecbd",
> "chunkType": "PARITY"
> }
> },
> {
> "Datanode-HostName": "node2",
> "Datanode-IP": "ip2",
> "Container-ID": 2048,
> "Block-ID": 113750153625602308,
> "Locations": {
> "files": [
>
> "/data/1/hadoop-ozone/datanode/data/hdds/CID-3ff4197e-8f90-496f-bbaa-40ecf8bbb437/current/containerDir4/2048/chunks/113750153625602308.block"
> ],
> "pipelineID": "24c391f5-1349-48a2-b200-796d76e6ecbd",
> "chunkType": "PARITY"
> }
> },
> {
> "Datanode-HostName": "node7",
> "Datanode-IP": "ip7",
> "Container-ID": 2048,
> "Block-ID": 113750153625602308,
> "Locations": {
> "files": [
>
> "/data/1/hadoop-ozone/datanode/data/hdds/CID-3ff4197e-8f90-496f-bbaa-40ecf8bbb437/current/containerDir4/2048/chunks/113750153625602308.block"
> ],
> "pipelineID": "24c391f5-1349-48a2-b200-796d76e6ecbd",
> "chunkType": "DATA"
> }
> },
> {
> "Datanode-HostName": "node8",
> "Datanode-IP": "ip8",
> "Container-ID": 2048,
> "Block-ID": 113750153625602308,
> "Locations": {
> "files": [
>
> "/data/1/hadoop-ozone/datanode/data/hdds/CID-3ff4197e-8f90-496f-bbaa-40ecf8bbb437/current/containerDir4/2048/chunks/113750153625602308.block"
> ],
> "pipelineID": "24c391f5-1349-48a2-b200-796d76e6ecbd",
> "chunkType": "DATA"
> }
> },
> {
> "Datanode-HostName": "node6",
> "Datanode-IP": "ip6",
> "Container-ID": 2048,
> "Block-ID": 113750153625602308,
> "Locations": {
> "files": [
>
> "/data/1/hadoop-ozone/datanode/data/hdds/CID-3ff4197e-8f90-496f-bbaa-40ecf8bbb437/current/containerDir4/2048/chunks/113750153625602308.block"
> ],
> "pipelineID": "24c391f5-1349-48a2-b200-796d76e6ecbd",
> "chunkType": "DATA"
> }
> }
> ]
> ]
> } {code}
> According to above output block path for node *node8* is
> _/data/1/hadoop-ozone/datanode/data/hdds/CID-3ff4197e-8f90-496f-bbaa-40ecf8bbb437/current/containerDir4/2048/chunks/113750153625602308.block_
> But on checking the actual node the block path found is -
> {code:java}
> # find /data -name 2048
> /data/2/hadoop-ozone/datanode/data/hdds/CID-3ff4197e-8f90-496f-bbaa-40ecf8bbb437/current/containerDir4/2048
> # ls
> /data/2/hadoop-ozone/datanode/data/hdds/CID-3ff4197e-8f90-496f-bbaa-40ecf8bbb437/current/containerDir4/2048
> chunks metadata {code}
> It is found in partition _/data/2_ instead of chunkinfo output _/data/1_
> Cluster has 3 partitions - /data/\{1..3}
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
