[
https://issues.apache.org/jira/browse/HIVE-29444?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
László Bodor updated HIVE-29444:
--------------------------------
Description:
With MiniHS2, which utilizes a MiniDFSCluster it's hard to easily find how to
connect to namenode to e.g. run hdfs commands:
{code}
2026-02-06T04:43:54,925 INFO [IPC Server handler 2 on 57080] hdfs.StateChange:
BLOCK* registerDatanode: from DatanodeRegistration(127.0.0.1:57082,
datanodeUuid=d4abf8c2-0479-4073-a091-9638db8850b9, infoPort=57084,
infoSecurePort=0, ipcPort=57085,
storageInfo=lv=-57;cid=testClusterID;nsid=1809166803;c=1770381832559) storage
d4abf8c2-0479-4073-a091-9638db8850b9
2026-02-06T04:43:54,932 INFO [IPC Server handler 2 on 57080]
net.NetworkTopology: Adding a new node: /default-rack/127.0.0.1:57082
2026-02-06T04:43:54,936 INFO [IPC Server handler 0 on 57080] hdfs.StateChange:
BLOCK* registerDatanode: from DatanodeRegistration(127.0.0.1:57087,
datanodeUuid=bfaf3b33-5d78-453d-8d0b-c2f6c41d63f8, infoPort=57089,
infoSecurePort=0, ipcPort=57090,
storageInfo=lv=-57;cid=testClusterID;nsid=1809166803;c=1770381832559) storage
bfaf3b33-5d78-453d-8d0b-c2f6c41d63f8
2026-02-06T04:43:54,937 INFO [IPC Server handler 0 on 57080]
net.NetworkTopology: Adding a new node: /default-rack/127.0.0.1:57087
2026-02-06T04:43:55,056 INFO [IPC Server handler 4 on 57080] hdfs.StateChange:
BLOCK* registerDatanode: from DatanodeRegistration(127.0.0.1:57091,
datanodeUuid=947923d2-1b0c-4f0b-bc7a-d68911987f73, infoPort=57093,
infoSecurePort=0, ipcPort=57094,
storageInfo=lv=-57;cid=testClusterID;nsid=1809166803;c=1770381832559) storage
947923d2-1b0c-4f0b-bc7a-d68911987f73
2026-02-06T04:43:55,064 INFO [IPC Server handler 4 on 57080]
net.NetworkTopology: Adding a new node: /default-rack/127.0.0.1:57091
2026-02-06T04:43:55,087 INFO
[org.apache.hadoop.util.JvmPauseMonitor$Monitor@526b2f3e] util.JvmPauseMonitor:
Starting JVM pause monitor
2026-02-06T04:43:55,120 WARN [main] common.MetricsLoggerTask: Metrics logging
will not be async since the logger is not log4j
2026-02-06T04:43:55,153 DEBUG [main] retry.RetryUtils:
multipleLinearRandomRetry = MultipleLinearRandomRetry[6x10000ms, 10x60000ms]
2026-02-06T04:43:55,318 INFO [IPC Server handler 0 on 57080] hdfs.StateChange:
BLOCK* registerDatanode: from DatanodeRegistration(127.0.0.1:57095,
datanodeUuid=01cdc654-b96e-4c49-b20a-05851f44b49a, infoPort=57097,
infoSecurePort=0, ipcPort=57098,
storageInfo=lv=-57;cid=testClusterID;nsid=1809166803;c=1770381832559) storage
01cdc654-b96e-4c49-b20a-05851f44b49a
2026-02-06T04:43:55,321 INFO [IPC Server handler 0 on 57080]
net.NetworkTopology: Adding a new node: /default-rack/127.0.0.1:57095
{code}
A more convenient logging message would be:
{code}
2026-02-06T04:43:55,552 INFO [main] shims.HadoopShimsSecure: Namenode address:
localhost/127.0.0.1:57080
{code}
was:
With MiniHS2, it's hard to easily find how to connect to namenode to e.g. run
hdfs commands:
{code}
2026-02-06T04:43:54,925 INFO [IPC Server handler 2 on 57080] hdfs.StateChange:
BLOCK* registerDatanode: from DatanodeRegistration(127.0.0.1:57082,
datanodeUuid=d4abf8c2-0479-4073-a091-9638db8850b9, infoPort=57084,
infoSecurePort=0, ipcPort=57085,
storageInfo=lv=-57;cid=testClusterID;nsid=1809166803;c=1770381832559) storage
d4abf8c2-0479-4073-a091-9638db8850b9
2026-02-06T04:43:54,932 INFO [IPC Server handler 2 on 57080]
net.NetworkTopology: Adding a new node: /default-rack/127.0.0.1:57082
2026-02-06T04:43:54,936 INFO [IPC Server handler 0 on 57080] hdfs.StateChange:
BLOCK* registerDatanode: from DatanodeRegistration(127.0.0.1:57087,
datanodeUuid=bfaf3b33-5d78-453d-8d0b-c2f6c41d63f8, infoPort=57089,
infoSecurePort=0, ipcPort=57090,
storageInfo=lv=-57;cid=testClusterID;nsid=1809166803;c=1770381832559) storage
bfaf3b33-5d78-453d-8d0b-c2f6c41d63f8
2026-02-06T04:43:54,937 INFO [IPC Server handler 0 on 57080]
net.NetworkTopology: Adding a new node: /default-rack/127.0.0.1:57087
2026-02-06T04:43:55,056 INFO [IPC Server handler 4 on 57080] hdfs.StateChange:
BLOCK* registerDatanode: from DatanodeRegistration(127.0.0.1:57091,
datanodeUuid=947923d2-1b0c-4f0b-bc7a-d68911987f73, infoPort=57093,
infoSecurePort=0, ipcPort=57094,
storageInfo=lv=-57;cid=testClusterID;nsid=1809166803;c=1770381832559) storage
947923d2-1b0c-4f0b-bc7a-d68911987f73
2026-02-06T04:43:55,064 INFO [IPC Server handler 4 on 57080]
net.NetworkTopology: Adding a new node: /default-rack/127.0.0.1:57091
2026-02-06T04:43:55,087 INFO
[org.apache.hadoop.util.JvmPauseMonitor$Monitor@526b2f3e] util.JvmPauseMonitor:
Starting JVM pause monitor
2026-02-06T04:43:55,120 WARN [main] common.MetricsLoggerTask: Metrics logging
will not be async since the logger is not log4j
2026-02-06T04:43:55,153 DEBUG [main] retry.RetryUtils:
multipleLinearRandomRetry = MultipleLinearRandomRetry[6x10000ms, 10x60000ms]
2026-02-06T04:43:55,318 INFO [IPC Server handler 0 on 57080] hdfs.StateChange:
BLOCK* registerDatanode: from DatanodeRegistration(127.0.0.1:57095,
datanodeUuid=01cdc654-b96e-4c49-b20a-05851f44b49a, infoPort=57097,
infoSecurePort=0, ipcPort=57098,
storageInfo=lv=-57;cid=testClusterID;nsid=1809166803;c=1770381832559) storage
01cdc654-b96e-4c49-b20a-05851f44b49a
2026-02-06T04:43:55,321 INFO [IPC Server handler 0 on 57080]
net.NetworkTopology: Adding a new node: /default-rack/127.0.0.1:57095
{code}
A more convenient logging message would be:
{code}
2026-02-06T04:43:55,552 INFO [main] shims.HadoopShimsSecure: Namenode address:
localhost/127.0.0.1:57080
{code}
> Log namenode address in testing scenarios
> -----------------------------------------
>
> Key: HIVE-29444
> URL: https://issues.apache.org/jira/browse/HIVE-29444
> Project: Hive
> Issue Type: Improvement
> Reporter: László Bodor
> Assignee: László Bodor
> Priority: Major
>
> With MiniHS2, which utilizes a MiniDFSCluster it's hard to easily find how to
> connect to namenode to e.g. run hdfs commands:
> {code}
> 2026-02-06T04:43:54,925 INFO [IPC Server handler 2 on 57080]
> hdfs.StateChange: BLOCK* registerDatanode: from
> DatanodeRegistration(127.0.0.1:57082,
> datanodeUuid=d4abf8c2-0479-4073-a091-9638db8850b9, infoPort=57084,
> infoSecurePort=0, ipcPort=57085,
> storageInfo=lv=-57;cid=testClusterID;nsid=1809166803;c=1770381832559) storage
> d4abf8c2-0479-4073-a091-9638db8850b9
> 2026-02-06T04:43:54,932 INFO [IPC Server handler 2 on 57080]
> net.NetworkTopology: Adding a new node: /default-rack/127.0.0.1:57082
> 2026-02-06T04:43:54,936 INFO [IPC Server handler 0 on 57080]
> hdfs.StateChange: BLOCK* registerDatanode: from
> DatanodeRegistration(127.0.0.1:57087,
> datanodeUuid=bfaf3b33-5d78-453d-8d0b-c2f6c41d63f8, infoPort=57089,
> infoSecurePort=0, ipcPort=57090,
> storageInfo=lv=-57;cid=testClusterID;nsid=1809166803;c=1770381832559) storage
> bfaf3b33-5d78-453d-8d0b-c2f6c41d63f8
> 2026-02-06T04:43:54,937 INFO [IPC Server handler 0 on 57080]
> net.NetworkTopology: Adding a new node: /default-rack/127.0.0.1:57087
> 2026-02-06T04:43:55,056 INFO [IPC Server handler 4 on 57080]
> hdfs.StateChange: BLOCK* registerDatanode: from
> DatanodeRegistration(127.0.0.1:57091,
> datanodeUuid=947923d2-1b0c-4f0b-bc7a-d68911987f73, infoPort=57093,
> infoSecurePort=0, ipcPort=57094,
> storageInfo=lv=-57;cid=testClusterID;nsid=1809166803;c=1770381832559) storage
> 947923d2-1b0c-4f0b-bc7a-d68911987f73
> 2026-02-06T04:43:55,064 INFO [IPC Server handler 4 on 57080]
> net.NetworkTopology: Adding a new node: /default-rack/127.0.0.1:57091
> 2026-02-06T04:43:55,087 INFO
> [org.apache.hadoop.util.JvmPauseMonitor$Monitor@526b2f3e]
> util.JvmPauseMonitor: Starting JVM pause monitor
> 2026-02-06T04:43:55,120 WARN [main] common.MetricsLoggerTask: Metrics
> logging will not be async since the logger is not log4j
> 2026-02-06T04:43:55,153 DEBUG [main] retry.RetryUtils:
> multipleLinearRandomRetry = MultipleLinearRandomRetry[6x10000ms, 10x60000ms]
> 2026-02-06T04:43:55,318 INFO [IPC Server handler 0 on 57080]
> hdfs.StateChange: BLOCK* registerDatanode: from
> DatanodeRegistration(127.0.0.1:57095,
> datanodeUuid=01cdc654-b96e-4c49-b20a-05851f44b49a, infoPort=57097,
> infoSecurePort=0, ipcPort=57098,
> storageInfo=lv=-57;cid=testClusterID;nsid=1809166803;c=1770381832559) storage
> 01cdc654-b96e-4c49-b20a-05851f44b49a
> 2026-02-06T04:43:55,321 INFO [IPC Server handler 0 on 57080]
> net.NetworkTopology: Adding a new node: /default-rack/127.0.0.1:57095
> {code}
> A more convenient logging message would be:
> {code}
> 2026-02-06T04:43:55,552 INFO [main] shims.HadoopShimsSecure: Namenode
> address: localhost/127.0.0.1:57080
> {code}
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
