[
https://issues.apache.org/jira/browse/AMBARI-25505?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17110049#comment-17110049
]
Ivan Martynov commented on AMBARI-25505:
----------------------------------------
I ran local unit test.
Tests are located at:
~/ambari/contrib/management-packs/isilon-onefs-mpack/src/test/python
Ran "python unitTests.py"
Results:
test_core_site_validation_error_on_host_mismatch (TestServiceAdvisor.TestUri)
... ok
test_fix_host (TestServiceAdvisor.TestUri) ... ok
test_hdfs_site_no_validation_error (TestServiceAdvisor.TestUri) ... ok
test_skip_fixing_invalid_host (TestServiceAdvisor.TestUri) ... ok
test_skip_replacing_to_empty_host (TestServiceAdvisor.TestUri) ... ok
----------------------------------------------------------------------
Ran 5 tests in 0.003s
OK
----------------------------------------------------------------------
Total run:5
Total errors:0
Total failures:0
OK
although I got the error before test ran, it is not connected with failed
test-cases.
So, local unit testing succeeded
> New version of isilon-onefs-mpack (1.0.3)
> -----------------------------------------
>
> Key: AMBARI-25505
> URL: https://issues.apache.org/jira/browse/AMBARI-25505
> Project: Ambari
> Issue Type: Improvement
> Components: contrib
> Affects Versions: trunk, 2.7.0
> Environment: HDP versions started from "2.6"
> Ambari started from version "2.7"
> Reporter: Ivan Martynov
> Priority: Critical
> Labels: performance
> Fix For: trunk, 2.7.0
>
> Original Estimate: 168h
> Remaining Estimate: 168h
>
> This issue is going under the direction of Dell Technologies.
> We are going to change the code of isilon-onefs-mpack
> (+[https://github.com/apache/ambari/tree/trunk/contrib/management-packs/isilon-onefs-mpack]+).
> The problem is that a new feature of HBase 2 (AsyncFSWAL) causes worse
> performance with OneFS. We need to disable this in the Ambari management pack
> by setting the property name: "hbase.wal.provider" with value: "filesystem"
> for HBASE. The way to change the property has been already introduced at:
> [https://jira.apache.org/jira/browse/HBASE-15536]
> In section about how to disable AsyncFSWAL:
> {quote}> ...add this in hbase-site.xml
> > \{code}
> > <property>
> > <name>hbase.wal.provider</name>
> > <value>filesystem</value>
> > </property>
> > \{code}
> {quote}
> We are going to issue a new version of isilon-onefs-mpack (1.0.3) where we
> will have some code lines which add this property to HBASE settings. Change
> of property is applied automatically after installation of HBASE service and
> installing a new version of mpack.
> Now our code change relates to one file of code: service_advisor.py, other
> changes are cosmetic (version numbering and comments).
> As well we are going to port the code to all necessary branches of Ambari of
> older versions which support isilon-onefs-mpack.
> Business Justification: The problem we are working on is that a new feature
> of HBase 2 (AsyncFSWAL) causes worse performance with OneFS.
> Some Isilon customers which use HBASE with Ambari with OneFS suffer from this
> problem. The fix should help these customers.
> Available Maintenance Resources: HDFS team of Dell Isilon supports Ambari
> mpack project.
> Impact: Improve interaction of Isilon with Hadoop
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
