[
https://issues.apache.org/jira/browse/YARN-7919?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16362143#comment-16362143
]
Rohith Sharma K S commented on YARN-7919:
-----------------------------------------
I did testing as well by applying this patch, some of the observations are
# Good news is that table created with old jar in hbase and Hadoop using new
jars perfectly works fine.
# Sad news is that FlowRunTable creation always excepts co-processor jar to be
present yarn.timeline-service.hbase.coprocessor.jar.hdfs.location location.
This seems to be an issue during upgrade since it add that location in table
descriptor. RS start failing with exception
{code:java}
2018-02-13 12:27:06,239 ERROR [RS_OPEN_REGION-10.200.4.200:16020-1]
handler.OpenRegionHandler: Failed open of
region=prod.timelineservice.flowrun,,1518501821250.1e108e74a1f96a1fc799842720d78f4f.,
starting to roll back the global memstore size.
java.io.FileNotFoundException: File
file:/Users/rsharmaks/Cluster/atsv2/hadoop/share/hadoop/yarn/timelineservice/hadoop-yarn-server-timelineservice-hbase-3.1.0-SNAPSHOT.jar
does not exist
{code}
On otherside, this was added to keep in co-processor jar in shared storage
place so that all the RegionServer can load it dynamically. Given the condition
where this jar is located in local filesystem or in hdfs, then we might need to
provide additional steps to upgrade. Otherwise, RS can't be started.
# Co processors are dynamically loaded after fix YARN-6094. But it is allowed
only one jar file. Seems like HBASE-14548 is *NOT* fixed in HBase-1.2.x release
line. But issue is with after refactoring code, we can't add single
co-processor jar into flow run table. I am not sure is there any other way to
achieve this from HBase-1.2.x release lines. Looks like after this refactoring,
dynamic loading of co processor would be a problem. [~vrushalic] do you have
any other way to solve this?
[~haibochen] did you test this patch in fresh cluster by creating a table? Am I
missing any steps for table creation?
Comments
# hadoop-yarn-server-timelineservice-hbase module as src folder structure. This
can be removed.
# FlowScanner#resetState java doc has params which are not in method. Params
cell currentAggOp collectedButNotEmitted can be removed.
> Split timelineservice-hbase module to make YARN-7346 easier
> -----------------------------------------------------------
>
> Key: YARN-7919
> URL: https://issues.apache.org/jira/browse/YARN-7919
> Project: Hadoop YARN
> Issue Type: Sub-task
> Components: timelineservice
> Affects Versions: 3.0.0
> Reporter: Haibo Chen
> Assignee: Haibo Chen
> Priority: Major
> Attachments: YARN-7919.00.patch, YARN-7919.01.patch
>
>
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
