GitHub user nickwallen opened a pull request:
https://github.com/apache/incubator-metron/pull/236
METRON-389 Create Java API to Read Profile Data During Model Scoring
[METRON-389](https://issues.apache.org/jira/browse/METRON-389)
### Changes
* Created a Java API for reading profile data written by the Profiler.
This is contained within a new project
`metron-analytics/metron-profiler-client`.
* Altered the Profiler to use deterministic row keys so that multiple Gets
can fetch the data. This should scale much better at high volumes.
### Points of Interest
* `ProfileMeasurement` - Represents a single data point within a Profile.
A Profile is effectively a time series. To this end a Profile is composed of
many ProfileMeasurement values which in aggregate form a time series.
* `ProfilePeriod` - The Profiler captures one `ProfileMeasurement` each
`ProfilePeriod`. A `ProfilePeriod` will occur at fixed, deterministic points
in time. This allows for efficient retrieval of profile data.
* `RowKeyBuilder` - Builds row keys that can be used to read or write
profile data to HBase.
* `ColumnBuilder` - Defines the columns of data stored with a profile
measurement.
* `ProfileHBaseMapper` - Defines for the `HBaseBolt` how profile
measurements are stored in HBase. This class leverages a `RowKeyBuilder` and
`ColumnBuilder`.
### Testing
Spin up a Metron install and write some Profile data to HBase. Read the
profile data using `metron-profiler-client`.
You can merge this pull request into a Git repository by running:
$ git pull https://github.com/nickwallen/incubator-metron METRON-389-FINAL
Alternatively you can review and apply these changes as the patch at:
https://github.com/apache/incubator-metron/pull/236.patch
To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:
This closes #236
----
commit e2bd987f1df94174ec60f33c30efa09a0a3c4ace
Author: Nick Allen <[email protected]>
Date: 2016-08-23T17:03:15Z
METRON-389 Create Java API to Read Profile Data During Model Scoring
----
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at [email protected] or file a JIRA ticket
with INFRA.
---
