[
https://issues.apache.org/jira/browse/YARN-7190?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16196262#comment-16196262
]
Varun Saxena commented on YARN-7190:
------------------------------------
Changed folder structure for branch-2 would look as under:
{noformat}
varun@e7450:~/Projects/ATS-branch2/hadoop-dist/target/hadoop-2.9.0-SNAPSHOT/share/hadoop/yarn$
ll
total 9572
-rw-rw-r-- 1 varun varun 2774490 Oct 8 23:23 hadoop-yarn-api-2.9.0-SNAPSHOT.jar
-rw-rw-r-- 1 varun varun 83233 Oct 8 23:23
hadoop-yarn-applications-distributedshell-2.9.0-SNAPSHOT.jar
-rw-rw-r-- 1 varun varun 42143 Oct 8 23:23
hadoop-yarn-applications-unmanaged-am-launcher-2.9.0-SNAPSHOT.jar
-rw-rw-r-- 1 varun varun 269898 Oct 8 23:23
hadoop-yarn-client-2.9.0-SNAPSHOT.jar
-rw-rw-r-- 1 varun varun 1995806 Oct 8 23:23
hadoop-yarn-common-2.9.0-SNAPSHOT.jar
-rw-rw-r-- 1 varun varun 125884 Oct 8 23:23
hadoop-yarn-registry-2.9.0-SNAPSHOT.jar
-rw-rw-r-- 1 varun varun 540644 Oct 8 23:23
hadoop-yarn-server-applicationhistoryservice-2.9.0-SNAPSHOT.jar
-rw-rw-r-- 1 varun varun 741271 Oct 8 23:23
hadoop-yarn-server-common-2.9.0-SNAPSHOT.jar
-rw-rw-r-- 1 varun varun 1070035 Oct 8 23:23
hadoop-yarn-server-nodemanager-2.9.0-SNAPSHOT.jar
-rw-rw-r-- 1 varun varun 1856851 Oct 8 23:23
hadoop-yarn-server-resourcemanager-2.9.0-SNAPSHOT.jar
-rw-rw-r-- 1 varun varun 80793 Oct 8 23:23
hadoop-yarn-server-sharedcachemanager-2.9.0-SNAPSHOT.jar
-rw-rw-r-- 1 varun varun 30614 Oct 8 23:23
hadoop-yarn-server-tests-2.9.0-SNAPSHOT.jar
-rw-rw-r-- 1 varun varun 79618 Oct 8 23:23
hadoop-yarn-server-timeline-pluginstorage-2.9.0-SNAPSHOT.jar
-rw-rw-r-- 1 varun varun 66129 Oct 8 23:23
hadoop-yarn-server-web-proxy-2.9.0-SNAPSHOT.jar
drwxrwxr-x 2 varun varun 4096 Oct 8 23:23 lib
drwxrwxr-x 2 varun varun 4096 Oct 8 23:23 sources
drwxrwxr-x 2 varun varun 4096 Oct 8 23:23 test
drwxrwxr-x 4 varun varun 4096 Oct 8 23:23 timelineservice
varun@e7450:~/Projects/ATS-branch2/hadoop-dist/target/hadoop-2.9.0-SNAPSHOT/share/hadoop/yarn$
cd timelineservice/
varun@e7450:~/Projects/ATS-branch2/hadoop-dist/target/hadoop-2.9.0-SNAPSHOT/share/hadoop/yarn/timelineservice$
ll -R
.:
total 424
-rw-rw-r-- 1 varun varun 195336 Oct 8 23:23
hadoop-yarn-server-timelineservice-2.9.0-SNAPSHOT.jar
-rw-rw-r-- 1 varun varun 227488 Oct 8 23:23
hadoop-yarn-server-timelineservice-hbase-2.9.0-SNAPSHOT.jar
drwxrwxr-x 2 varun varun 4096 Oct 8 23:23 lib
drwxrwxr-x 2 varun varun 4096 Oct 8 23:23 test
./lib:
total 10948
-rw-rw-r-- 1 varun varun 34827 Oct 8 23:23 commons-csv-1.0.jar
-rw-rw-r-- 1 varun varun 20865 Oct 8 23:23 hbase-annotations-1.2.6.jar
-rw-rw-r-- 1 varun varun 1306445 Oct 8 23:23 hbase-client-1.2.6.jar
-rw-rw-r-- 1 varun varun 582558 Oct 8 23:23 hbase-common-1.2.6.jar
-rw-rw-r-- 1 varun varun 4378437 Oct 8 23:23 hbase-protocol-1.2.6.jar
-rw-rw-r-- 1 varun varun 1475955 Oct 8 23:23 htrace-core-3.1.0-incubating.jar
-rw-rw-r-- 1 varun varun 1291164 Oct 8 23:23 jcodings-1.0.8.jar
-rw-rw-r-- 1 varun varun 187292 Oct 8 23:23 joni-2.1.2.jar
-rw-rw-r-- 1 varun varun 46367 Oct 8 23:23 jsr311-api-1.1.1.jar
-rw-rw-r-- 1 varun varun 82123 Oct 8 23:23 metrics-core-2.2.0.jar
-rw-rw-r-- 1 varun varun 1779991 Oct 8 23:23 netty-all-4.0.23.Final.jar
./test:
total 32
-rw-rw-r-- 1 varun varun 31091 Oct 8 23:23
hadoop-yarn-server-timelineservice-hbase-tests-2.9.0-SNAPSHOT.jar
{noformat}
> Ensure only NM classpath in 2.x gets TSv2 related hbase jars, not the user
> classpath
> ------------------------------------------------------------------------------------
>
> Key: YARN-7190
> URL: https://issues.apache.org/jira/browse/YARN-7190
> Project: Hadoop YARN
> Issue Type: Sub-task
> Components: timelineclient, timelinereader, timelineserver
> Reporter: Vrushali C
> Assignee: Varun Saxena
>
> [~jlowe] had a good observation about the user classpath getting extra jars
> in hadoop 2.x brought in with TSv2. If users start picking up Hadoop 2,x's
> version of HBase jars instead of the ones they shipped with their job, it
> could be a problem.
> So when TSv2 is to be used in 2,x, the hbase related jars should come into
> only the NM classpath not the user classpath.
> Here is a list of some jars
> {code}
> commons-csv-1.0.jar
> commons-el-1.0.jar
> commons-httpclient-3.1.jar
> disruptor-3.3.0.jar
> findbugs-annotations-1.3.9-1.jar
> hbase-annotations-1.2.6.jar
> hbase-client-1.2.6.jar
> hbase-common-1.2.6.jar
> hbase-hadoop2-compat-1.2.6.jar
> hbase-hadoop-compat-1.2.6.jar
> hbase-prefix-tree-1.2.6.jar
> hbase-procedure-1.2.6.jar
> hbase-protocol-1.2.6.jar
> hbase-server-1.2.6.jar
> htrace-core-3.1.0-incubating.jar
> jamon-runtime-2.4.1.jar
> jasper-compiler-5.5.23.jar
> jasper-runtime-5.5.23.jar
> jcodings-1.0.8.jar
> joni-2.1.2.jar
> jsp-2.1-6.1.14.jar
> jsp-api-2.1-6.1.14.jar
> jsr311-api-1.1.1.jar
> metrics-core-2.2.0.jar
> servlet-api-2.5-6.1.14.jar
> {code}
--
This message was sent by Atlassian JIRA
(v6.4.14#64029)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
