[ https://issues.apache.org/jira/browse/AMBARI-25505?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17110049#comment-17110049 ]
Ivan Martynov commented on AMBARI-25505: ---------------------------------------- I ran local unit test. Tests are located at: ~/ambari/contrib/management-packs/isilon-onefs-mpack/src/test/python Ran "python unitTests.py" Results: test_core_site_validation_error_on_host_mismatch (TestServiceAdvisor.TestUri) ... ok test_fix_host (TestServiceAdvisor.TestUri) ... ok test_hdfs_site_no_validation_error (TestServiceAdvisor.TestUri) ... ok test_skip_fixing_invalid_host (TestServiceAdvisor.TestUri) ... ok test_skip_replacing_to_empty_host (TestServiceAdvisor.TestUri) ... ok ---------------------------------------------------------------------- Ran 5 tests in 0.003s OK ---------------------------------------------------------------------- Total run:5 Total errors:0 Total failures:0 OK although I got the error before test ran, it is not connected with failed test-cases. So, local unit testing succeeded > New version of isilon-onefs-mpack (1.0.3) > ----------------------------------------- > > Key: AMBARI-25505 > URL: https://issues.apache.org/jira/browse/AMBARI-25505 > Project: Ambari > Issue Type: Improvement > Components: contrib > Affects Versions: trunk, 2.7.0 > Environment: HDP versions started from "2.6" > Ambari started from version "2.7" > Reporter: Ivan Martynov > Priority: Critical > Labels: performance > Fix For: trunk, 2.7.0 > > Original Estimate: 168h > Remaining Estimate: 168h > > This issue is going under the direction of Dell Technologies. > We are going to change the code of isilon-onefs-mpack > (+[https://github.com/apache/ambari/tree/trunk/contrib/management-packs/isilon-onefs-mpack]+). > The problem is that a new feature of HBase 2 (AsyncFSWAL) causes worse > performance with OneFS. We need to disable this in the Ambari management pack > by setting the property name: "hbase.wal.provider" with value: "filesystem" > for HBASE. The way to change the property has been already introduced at: > [https://jira.apache.org/jira/browse/HBASE-15536] > In section about how to disable AsyncFSWAL: > {quote}> ...add this in hbase-site.xml > > \{code} > > <property> > > <name>hbase.wal.provider</name> > > <value>filesystem</value> > > </property> > > \{code} > {quote} > We are going to issue a new version of isilon-onefs-mpack (1.0.3) where we > will have some code lines which add this property to HBASE settings. Change > of property is applied automatically after installation of HBASE service and > installing a new version of mpack. > Now our code change relates to one file of code: service_advisor.py, other > changes are cosmetic (version numbering and comments). > As well we are going to port the code to all necessary branches of Ambari of > older versions which support isilon-onefs-mpack. > Business Justification: The problem we are working on is that a new feature > of HBase 2 (AsyncFSWAL) causes worse performance with OneFS. > Some Isilon customers which use HBASE with Ambari with OneFS suffer from this > problem. The fix should help these customers. > Available Maintenance Resources: HDFS team of Dell Isilon supports Ambari > mpack project. > Impact: Improve interaction of Isilon with Hadoop -- This message was sent by Atlassian Jira (v8.3.4#803005)