sravani-revuri opened a new pull request, #10056: URL: https://github.com/apache/ozone/pull/10056
## What changes were proposed in this pull request? The following configuration property control tracing: ozone.tracing.enabled ozone.tracing.endpoint ozone.tracing.sampler ozone.tracing.span.sampling These Ozone.tracing configurations can be dynamically updated for Ozone Manager (OM), Storage Container Manager (SCM), and DataNode (DN) via the Ozone CLI. Note: Dynamic updates are not feasible for the Ozone client as it is part of application code. ## What is the link to the Apache JIRA https://issues.apache.org/jira/browse/HDDS-13804 ## How was this patch tested? Manual Testing. ### **1) When nothing is originally set in ozone-site.xml and reconfiguration is triggered:** #### No tracing initiated message visible: ``` vrevuri@KJ3K6CH6Q1 ozone % docker compose exec scm bash bash-5.1$ ozone freon rk --numOfVolumes=2 --numOfBuckets=2 --numOfKeys=2 2026-04-06 15:25:04,081 [main] INFO freon.RandomKeyGenerator: Number of Threads: 10 2026-04-06 15:25:04,089 [main] INFO freon.RandomKeyGenerator: Number of Volumes: 2. 2026-04-06 15:25:04,089 [main] INFO freon.RandomKeyGenerator: Number of Buckets per Volume: 2. 2026-04-06 15:25:04,089 [main] INFO freon.RandomKeyGenerator: Number of Keys per Bucket: 2. 2026-04-06 15:25:04,089 [main] INFO freon.RandomKeyGenerator: Key size: 10240 bytes 2026-04-06 15:25:04,089 [main] INFO freon.RandomKeyGenerator: Buffer size: 4096 bytes 2026-04-06 15:25:04,089 [main] INFO freon.RandomKeyGenerator: validateWrites : false 2026-04-06 15:25:04,089 [main] INFO freon.RandomKeyGenerator: Number of Validate Threads: 1 2026-04-06 15:25:04,090 [main] INFO freon.RandomKeyGenerator: cleanObjects : false 2026-04-06 15:25:04,092 [main] INFO freon.RandomKeyGenerator: Starting progress bar Thread. ``` #### **Command:** ``` vrevuri@KJ3K6CH6Q1 ozone % docker compose exec -u root om bash -c "sed -i 's/<\/configuration>//' /etc/hadoop/ozone-site.xml && cat >> /etc/hadoop/ozone-site.xml <<EOF <property><name>ozone.tracing.enabled</name><value>true</value></property> <property><name>ozone.tracing.endpoint</name><value>http://jaeger:4317</value></property> <property><name>ozone.tracing.sampler</name><value>1.0</value></property> <property><name>ozone.tracing.span.sampling</name><value>createKey:0.5</value></property> </configuration> EOF" vrevuri@KJ3K6CH6Q1 ozone % docker compose exec -u root scm bash -c "sed -i 's/<\/configuration>//' /etc/hadoop/ozone-site.xml && cat >> /etc/hadoop/ozone-site.xml <<EOF <property><name>ozone.tracing.enabled</name><value>true</value></property> <property><name>ozone.tracing.endpoint</name><value>http://jaeger:4317/</value></property> <property><name>ozone.tracing.sampler</name><value>1.0</value></property> <property><name>ozone.tracing.span.sampling</name><value>createKey:0.5</value></property> </configuration> EOF" vrevuri@KJ3K6CH6Q1 ozone % docker compose exec -u root datanode bash -c "sed -i 's/<\/configuration>//' /etc/hadoop/ozone-site.xml && cat >> /etc/hadoop/ozone-site.xml <<EOF <property><name>ozone.tracing.enabled</name><value>true</value></property> <property><name>ozone.tracing.endpoint</name><value>http://jaeger:4317/</value></property> <property><name>ozone.tracing.sampler</name><value>1.0</value></property> <property><name>ozone.tracing.span.sampling</name><value>createKey:0.5</value></property> </configuration> EOF" vrevuri@KJ3K6CH6Q1 ozone % docker compose exec om ozone admin reconfig --service=OM --address=om:9862 start docker compose exec om ozone admin reconfig --service=OM --address=om:9862 status docker compose exec scm ozone admin reconfig --service=SCM --address=scm:9860 start docker compose exec scm ozone admin reconfig --service=SCM --address=scm:9860 status docker compose exec om ozone admin reconfig --service=DATANODE --address=datanode:19864 start docker compose exec om ozone admin reconfig --service=DATANODE --address=datanode:19864 status ``` #### **Output:** ``` OM: Started reconfiguration task on node [om:9862]. OM: Reconfiguring status for node [om:9862]: started at Mon Apr 06 15:26:46 UTC 2026 and finished at Mon Apr 06 15:26:46 UTC 2026. SUCCESS: Changed property ozone.tracing.sampler From: "-1" To: "1.0" SUCCESS: Changed property ozone.tracing.enabled From: "false" To: "true" SUCCESS: Changed property ozone.tracing.span.sampling From: "" To: "createKey:0.5" SUCCESS: Changed property ozone.tracing.endpoint From: "" To: "http://jaeger:4317/"; SCM: Started reconfiguration task on node [scm:9860]. SCM: Reconfiguring status for node [scm:9860]: started at Mon Apr 06 15:26:48 UTC 2026 and finished at Mon Apr 06 15:26:48 UTC 2026. SUCCESS: Changed property ozone.tracing.span.sampling From: "" To: "createKey:0.5" SUCCESS: Changed property ozone.tracing.enabled From: "false" To: "true" SUCCESS: Changed property ozone.tracing.endpoint From: "" To: "http://jaeger:4317/"; SUCCESS: Changed property ozone.tracing.sampler From: "-1" To: "1.0" DN: Started reconfiguration task on node [datanode:19864]. DN: Reconfiguring status for node [datanode:19864]: started at Mon Apr 06 15:26:50 UTC 2026 and finished at Mon Apr 06 15:26:50 UTC 2026. SUCCESS: Changed property ozone.tracing.span.sampling From: "" To: "createKey:0.5" SUCCESS: Changed property ozone.tracing.enabled From: "false" To: "true" SUCCESS: Changed property ozone.tracing.sampler From: "-1" To: "1.0" SUCCESS: Changed property ozone.tracing.endpoint From: "" To: "http://jaeger:4317/"; ``` #### **initiated tracing:** ``` 2026-04-06 15:27:40,002 [main] INFO tracing.TracingUtil: Sampling Trace Config = '1.0' 2026-04-06 15:27:40,002 [main] INFO tracing.TracingUtil: Sampling Span Config = 'createKey:0.5' 2026-04-06 15:27:40,070 [main] INFO tracing.TracingUtil: Initialized tracing service: freon 2026-04-06 15:27:40,697 [main] INFO freon.RandomKeyGenerator: Number of Threads: 10 2026-04-06 15:27:40,710 [main] INFO freon.RandomKeyGenerator: Number of Volumes: 2. 2026-04-06 15:27:40,710 [main] INFO freon.RandomKeyGenerator: Number of Buckets per Volume: 4. 2026-04-06 15:27:40,710 [main] INFO freon.RandomKeyGenerator: Number of Keys per Bucket: 1. 2026-04-06 15:27:40,710 [main] INFO freon.RandomKeyGenerator: Key size: 10240 bytes 2026-04-06 15:27:40,710 [main] INFO freon.RandomKeyGenerator: Buffer size: 4096 bytes 2026-04-06 15:27:40,710 [main] INFO freon.RandomKeyGenerator: validateWrites : false 2026-04-06 15:27:40,710 [main] INFO freon.RandomKeyGenerator: Number of Validate Threads: 1 2026-04-06 15:27:40,710 [main] INFO freon.RandomKeyGenerator: cleanObjects : false 2026-04-06 15:27:40,714 [main] INFO freon.RandomKeyGenerator: Starting progress bar Thread. ``` <img width="2554" height="322" alt="image" src="https://github.com/user-attachments/assets/cf3b656b-cfdc-4621-89e6-ef237de1cfce"; /> ### **2) When values are already set in ozone-site.xml and reconfiguration is triggered.** #### values set: ``` OZONE-SITE.XML_ozone.tracing.enabled=true OZONE-SITE.XML_ozone.tracing.endpoint=http://jaeger:4317 OZONE-SITE.XML_ozone.tracing.sampler=0.5 OZONE-SITE.XML_ozone.tracing.span.sampling=createKey:0.5 ``` #### **command:** ``` vrevuri@KJ3K6CH6Q1 ozone % docker compose exec -u root om bash -c "sed -i 's/<\/configuration>//' /etc/hadoop/ozone-site.xml && cat >> /etc/hadoop/ozone-site.xml <<EOF <property><name>ozone.tracing.enabled</name><value>true</value></property> <property><name>ozone.tracing.endpoint</name><value>http://jaeger:4317/</value></property> <property><name>ozone.tracing.sampler</name><value>1.0</value></property> <property><name>ozone.tracing.span.sampling</name><value>createKey:0.5</value></property> </configuration> dquote> EOF" vrevuri@KJ3K6CH6Q1 ozone % docker compose exec -u root scm bash -c "sed -i 's/<\/configuration>//' /etc/hadoop/ozone-site.xml && cat >> /etc/hadoop/ozone-site.xml <<EOF <property><name>ozone.tracing.enabled</name><value>true</value></property> <property><name>ozone.tracing.endpoint</name><value>http://jaeger:4317/</value></property> <property><name>ozone.tracing.sampler</name><value>1.0</value></property> <property><name>ozone.tracing.span.sampling</name><value>createKey:0.5</value></property> </configuration> EOF" vrevuri@KJ3K6CH6Q1 ozone % docker compose exec -u root datanode bash -c "sed -i 's/<\/configuration>//' /etc/hadoop/ozone-site.xml && cat >> /etc/hadoop/ozone-site.xml <<EOF <property><name>ozone.tracing.enabled</name><value>true</value></property> <property><name>ozone.tracing.endpoint</name><value>http://jaeger:4317/</value></property> <property><name>ozone.tracing.sampler</name><value>1.0</value></property> <property><name>ozone.tracing.span.sampling</name><value>createKey:0.5</value></property> </configuration> EOF" vrevuri@KJ3K6CH6Q1 ozone % docker compose exec om ozone admin reconfig --service=OM --address=om:9862 start docker compose exec om ozone admin reconfig --service=OM --address=om:9862 status docker compose exec scm ozone admin reconfig --service=SCM --address=scm:9860 start docker compose exec scm ozone admin reconfig --service=SCM --address=scm:9860 status docker compose exec om ozone admin reconfig --service=DATANODE --address=datanode:19864 start docker compose exec om ozone admin reconfig --service=DATANODE --address=datanode:19864 status ``` #### **Output:** ``` OM: Started reconfiguration task on node [om:9862]. OM: Reconfiguring status for node [om:9862]: started at Mon Apr 06 15:00:02 UTC 2026 and finished at Mon Apr 06 15:00:02 UTC 2026. SUCCESS: Changed property ozone.tracing.sampler From: "0.5" To: "1.0" SCM: Started reconfiguration task on node [scm:9860]. SCM: Reconfiguring status for node [scm:9860]: started at Mon Apr 06 15:00:05 UTC 2026 and finished at Mon Apr 06 15:00:05 UTC 2026. SUCCESS: Changed property ozone.tracing.sampler From: "0.5" To: "1.0" DN: Started reconfiguration task on node [datanode:19864]. DN: Reconfiguring status for node [datanode:19864]: started at Mon Apr 06 15:00:07 UTC 2026 and finished at Mon Apr 06 15:00:07 UTC 2026. SUCCESS: Changed property ozone.tracing.sampler From: "0.5" To: "1.0" ``` ### **3) only scm has config set:** #### **commands:** ``` vrevuri@KJ3K6CH6Q1 ozone % docker compose exec -u root scm bash -c "sed -i 's/<\/configuration>//' /etc/hadoop/ozone-site.xml && cat >> /etc/hadoop/ozone-site.xml <<EOF <property><name>ozone.tracing.enabled</name><value>true</value></property> <property><name>ozone.tracing.endpoint</name><value>http://jaeger:4317/</value></property> <property><name>ozone.tracing.sampler</name><value>1.0</value></property> <property><name>ozone.tracing.span.sampling</name><value>createKey:0.5</value></property> </configuration> EOF" vrevuri@KJ3K6CH6Q1 ozone % docker compose exec scm ozone admin reconfig --service=SCM --address=scm:9860 start docker compose exec scm ozone admin reconfig --service=SCM --address=scm:9860 status 15:41:13 UTC 2026. SCM: Started reconfiguration task on node [scm:9860]. SCM: Reconfiguring status for node [scm:9860]: started at Mon Apr 06 15:41:15 UTC 2026 and finished at Mon Apr 06 15:41:15 UTC 2026. SUCCESS: Changed property ozone.tracing.enabled From: "false" To: "true" SUCCESS: Changed property ozone.tracing.sampler From: "-1" To: "1.0" SUCCESS: Changed property ozone.tracing.span.sampling From: "" To: "createKey:0.5" SUCCESS: Changed property ozone.tracing.endpoint From: "" To: "http://jaeger:4317/"; ``` #### **Output:** <img width="1128" height="1176" alt="image" src="https://github.com/user-attachments/assets/0ba1435e-366e-45a0-bdca-4eeab690c5f6"; /> -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
