Ivan Martynov commented on AMBARI-25505:

I managed to test the case with manual install (case #3 "Customer installs new 
mpack with fix and selects hbase service in the installation wizard")

1. I created a HDFS cluster with command  without HDP and MPack.:

conductor -b onefs-hdp3.1-4clients-ranger-kms-nohbase.json --onefs 
onefs19.west.isilon.com --ducttape-owner=imartynov --skip-hdp --no-mpack 

2. I installed mpack 1.0.3 with fix 

3. I ran Ambari, started wizard, selected to create HBASE service. Opened 
service settings (Custom hbase-site) and see the property
hbase.wal.provider is set.

4. I installed the HBASE service, run HDP cluster - OK.

5. Checked hbase.wal.provider property after running - it is there.

Now all cases have tested, I'm working on publishing the project to Open Source.

> New version of isilon-onefs-mpack (1.0.3)
> -----------------------------------------
>                 Key: AMBARI-25505
>                 URL: https://issues.apache.org/jira/browse/AMBARI-25505
>             Project: Ambari
>          Issue Type: Improvement
>          Components: contrib
>    Affects Versions: trunk, 2.7.0
>         Environment: HDP versions started from  "2.6"
> Ambari started from version "2.7"
>            Reporter: Ivan Martynov
>            Priority: Critical
>              Labels: performance
>             Fix For: trunk, 2.7.0
>   Original Estimate: 168h
>  Remaining Estimate: 168h
> This issue is going under the direction of Dell Technologies.
> We are going to change the code of isilon-onefs-mpack 
> (+[https://github.com/apache/ambari/tree/trunk/contrib/management-packs/isilon-onefs-mpack]+).
> The problem is that a new feature of HBase 2 (AsyncFSWAL) causes worse 
> performance with OneFS. We need to disable this in the Ambari management pack 
> by setting the property name: "hbase.wal.provider" with value: "filesystem" 
> for HBASE. The way to change the property has been already introduced at:
> [https://jira.apache.org/jira/browse/HBASE-15536]
> In section about how to disable AsyncFSWAL:
> {quote}> ...add this in hbase-site.xml
> > \{code}
> >  <property>
> >   <name>hbase.wal.provider</name>
> >   <value>filesystem</value>
> >  </property>
> > \{code}
> {quote}
>  We are going to issue a new version of isilon-onefs-mpack (1.0.3) where we 
> will have some code lines which add this property to HBASE settings. Change 
> of property is applied automatically after installation of HBASE service and 
> installing a new version of mpack.
> Now our code change relates to one file of code: service_advisor.py, other 
> changes are cosmetic (version numbering and comments).
> As well we are going to port the code to all necessary branches of Ambari of 
> older versions which support isilon-onefs-mpack.
> Business Justification: The problem we are working on is that a new feature 
> of HBase 2 (AsyncFSWAL) causes worse performance with OneFS.
> Some Isilon customers which use HBASE with Ambari with OneFS suffer from this 
> problem. The fix should help these customers.
> Available Maintenance Resources: HDFS team of Dell Isilon supports Ambari 
> mpack project.
> Impact: Improve interaction of Isilon with Hadoop

This message was sent by Atlassian Jira

Reply via email to