GitHub user nickwallen opened a pull request:
https://github.com/apache/metron/pull/799
METRON-1249 Improve Metron MPack service checks
This PR enhances the Metron 'Service Check' functionality in the MPack.
The Service Check is an easy way for a user to know if their Metron cluster is
healthy. The Service Check can be run manually from within Ambari. It is also
automatically executed after kerberization.
In the current version of the Service Check, healthy means the Parser and
Indexing topologies are running. This PR enhances that to validate all of the
install actions that occur across each of the Metron services. These checks
include the following.
* Kafka topics, user permissions, group permissions
* HBase tables, column families, and user permissions
* HDFS resources like the grok patterns and geo database
* Ensures all Metron topologies are running
* Ensures the web-based resources are responding
I added considerable logging so that if a check does fail, a user will have
a reasonable chance to understand why. Ambari doesn't give me an easy way to
tell a user "hey, this is the problem!", so the user still has to go through
the output of the Service Check in the Operations Panel to know why the Service
Check failed.
## Testing
* I manually tested each of the checks by, for example, deleting a Kafka
topic then running the Service Check. This can be repeated for all of the
different types of checks that I outlined above.
* I tested the Service Check on a fresh deployment of Full Dev.
* I then kerberized Full Dev and again validated the Service Check
## Pull Request Checklist
- [ ] Is there a JIRA ticket associated with this PR? If not one needs to
be created at [Metron
Jira](https://issues.apache.org/jira/browse/METRON/?selectedTab=com.atlassian.jira.jira-projects-plugin:summary-panel).
- [ ] Does your PR title start with METRON-XXXX where XXXX is the JIRA
number you are trying to resolve? Pay particular attention to the hyphen "-"
character.
- [ ] Has your PR been rebased against the latest commit within the target
branch (typically master)?
- [ ] Have you included steps to reproduce the behavior or problem that is
being changed or addressed?
- [ ] Have you included steps or a guide to how the change may be verified
and tested manually?
- [ ] Have you ensured that the full suite of tests and checks have been
executed in the root metron folder via:
- [ ] Have you written or updated unit tests and or integration tests to
verify your changes?
- [ ] If adding new dependencies to the code, are these dependencies
licensed in a way that is compatible for inclusion under [ASF
2.0](http://www.apache.org/legal/resolved.html#category-a)?
- [ ] Have you verified the basic functionality of the build by building
and running locally with Vagrant full-dev environment or the equivalent?
You can merge this pull request into a Git repository by running:
$ git pull https://github.com/nickwallen/metron METRON-1249
Alternatively you can review and apply these changes as the patch at:
https://github.com/apache/metron/pull/799.patch
To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:
This closes #799
----
commit 9619bad0ae9b2afa203fc376fec1856009ca02db
Author: Nick Allen <[email protected]>
Date: 2017-09-21T18:09:28Z
METRON-1249 Improve Metron MPack service checks
----
---
