[ 
https://issues.apache.org/jira/browse/YARN-7919?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16362143#comment-16362143
 ] 

Rohith Sharma K S commented on YARN-7919:
-----------------------------------------

I did testing as well by applying this patch, some of the observations are
 # Good news is that table created with old jar in hbase and Hadoop using new 
jars perfectly works fine.
 # Sad news is that FlowRunTable creation always excepts co-processor jar to be 
present yarn.timeline-service.hbase.coprocessor.jar.hdfs.location location. 
This seems to be an issue during upgrade since it add that location in table 
descriptor. RS start failing with exception
{code:java}
2018-02-13 12:27:06,239 ERROR [RS_OPEN_REGION-10.200.4.200:16020-1] 
handler.OpenRegionHandler: Failed open of 
region=prod.timelineservice.flowrun,,1518501821250.1e108e74a1f96a1fc799842720d78f4f.,
 starting to roll back the global memstore size.
java.io.FileNotFoundException: File 
file:/Users/rsharmaks/Cluster/atsv2/hadoop/share/hadoop/yarn/timelineservice/hadoop-yarn-server-timelineservice-hbase-3.1.0-SNAPSHOT.jar
 does not exist
{code}
On otherside, this was added to keep in co-processor jar in shared storage 
place so that all the RegionServer can load it dynamically. Given the condition 
where this jar is located in local filesystem or in hdfs, then we might need to 
provide additional steps to upgrade. Otherwise, RS can't be started. 
# Co processors are dynamically loaded after fix YARN-6094. But it is allowed 
only one jar file. Seems like HBASE-14548 is *NOT* fixed in HBase-1.2.x release 
line. But issue is with after refactoring code, we can't add single 
co-processor jar into flow run table. I am not sure is there any other way to 
achieve this from HBase-1.2.x release lines. Looks like after this refactoring, 
dynamic loading of co processor would be a problem. [~vrushalic] do you have 
any other way to solve this? 
[~haibochen] did you test this patch in fresh cluster by creating a table? Am I 
missing any steps for table creation? 

Comments
# hadoop-yarn-server-timelineservice-hbase module as src folder structure. This 
can be removed.
# FlowScanner#resetState java doc has params which are not in method. Params 
cell currentAggOp collectedButNotEmitted can be removed.

> Split timelineservice-hbase module to make YARN-7346 easier
> -----------------------------------------------------------
>
>                 Key: YARN-7919
>                 URL: https://issues.apache.org/jira/browse/YARN-7919
>             Project: Hadoop YARN
>          Issue Type: Sub-task
>          Components: timelineservice
>    Affects Versions: 3.0.0
>            Reporter: Haibo Chen
>            Assignee: Haibo Chen
>            Priority: Major
>         Attachments: YARN-7919.00.patch, YARN-7919.01.patch
>
>




--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

---------------------------------------------------------------------
To unsubscribe, e-mail: yarn-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: yarn-issues-h...@hadoop.apache.org

Reply via email to