[
https://issues.apache.org/jira/browse/HADOOP-15566?focusedWorklogId=651891&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-651891
]
ASF GitHub Bot logged work on HADOOP-15566:
-------------------------------------------
Author: ASF GitHub Bot
Created on: 16/Sep/21 17:12
Start Date: 16/Sep/21 17:12
Worklog Time Spent: 10m
Work Description: ArkenKiran edited a comment on pull request #3445:
URL: https://github.com/apache/hadoop/pull/3445#issuecomment-921081392
How to Test locally. (Instructions for linux)
1. Add the following maven dependency to hadoop-common/pom.xml
```
<dependency>
<groupId>io.opentelemetry.javaagent</groupId>
<artifactId>opentelemetry-javaagent</artifactId>
<version>${opentelemetry-instrumentation.version}</version>
<classifier>all</classifier>
</dependency>
```
2. Build using the following command
```
mvn install -Pdist -DskipTests -Dtar -Dmaven.javadoc.skip=true
```
3. Extract the tar from the location `hadoop-dist/target/` (Ex tar -xvf
hadoop-dist/target/hadoop-3.4.0-SNAPSHOT.tar.gz -C ~/)
4. cd ~/hadoop-3.4.0-SNAPSHOT/
5. uncomment the following lines in hadoop-env.sh (location:
etc/hadoop/hadoop-env.sh)
```
# export OPENTELEMETRY_JAVAAGENT_PATH="$(find
$HADOOP_HOME/share/hadoop/common/lib/ -name opentelemetry-javaagent*)"
# export HADOOP_TRACE_OPTS="-javaagent:$OPENTELEMETRY_JAVAAGENT_PATH
-Dotel.traces.exporter=jaeger -Dotel.metrics.exporter=none"
# export HDFS_NAMENODE_OPTS="$HDFS_NAMENODE_OPTS $HADOOP_TRACE_OPTS
-Dotel.resource.attributes=service.name=HDFS_NAMENODE"
# export HDFS_DATANODE_OPTS="$HDFS_DATANODE_OPTS $HADOOP_TRACE_OPTS
-Dotel.resource.attributes=service.name=HDFS_DATANODE"
# export HDFS_SECONDARYNAMENODE_OPTS="$HDFS_SECONDARYNAMENODE_OPTS
$HADOOP_TRACE_OPTS
-Dotel.resource.attributes=service.name=HDFS_SECONDARYNAMENODE"
```
6. Make sure `share/hadoop/common/lib/ ` has the maven dependency
(opentelemetry-javaagent-1.3.0-all.jar) that you have added in step 1.
7. Start Jaeger following the instructions
https://www.jaegertracing.io/docs/1.26/getting-started/
8. Setup Single Node cluster following the instructions
https://hadoop.apache.org/docs/stable/hadoop-project-dist/hadoop-common/SingleCluster.html#Pseudo-Distributed_Operation
9. You should be able to see the traces in the jaeger UI
(http://localhost:16686/search)
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
Issue Time Tracking
-------------------
Worklog Id: (was: 651891)
Time Spent: 3h 50m (was: 3h 40m)
> Support OpenTelemetry
> ---------------------
>
> Key: HADOOP-15566
> URL: https://issues.apache.org/jira/browse/HADOOP-15566
> Project: Hadoop Common
> Issue Type: New Feature
> Components: metrics, tracing
> Affects Versions: 3.1.0
> Reporter: Todd Lipcon
> Assignee: Siyao Meng
> Priority: Major
> Labels: pull-request-available, security
> Attachments: HADOOP-15566-WIP.1.patch, HADOOP-15566.000.WIP.patch,
> OpenTelemetry Support Scope Doc v2.pdf, OpenTracing Support Scope Doc.pdf,
> Screen Shot 2018-06-29 at 11.59.16 AM.png, ss-trace-s3a.png
>
> Time Spent: 3h 50m
> Remaining Estimate: 0h
>
> The HTrace incubator project has voted to retire itself and won't be making
> further releases. The Hadoop project currently has various hooks with HTrace.
> It seems in some cases (eg HDFS-13702) these hooks have had measurable
> performance overhead. Given these two factors, I think we should consider
> removing the HTrace integration. If there is someone willing to do the work,
> replacing it with OpenTracing might be a better choice since there is an
> active community.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
