[ 
https://issues.apache.org/jira/browse/METRON-529?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15626742#comment-15626742
 ] 

ASF GitHub Bot commented on METRON-529:
---------------------------------------

Github user mattf-horton commented on a diff in the pull request:

    https://github.com/apache/incubator-metron/pull/334#discussion_r86030164
  
    --- Diff: metron-analytics/metron-profiler/README.md ---
    @@ -219,9 +219,11 @@ The Profiler topology also accepts the following 
configuration settings.
     | profiler.workers | The number of worker processes to create for the 
topology.   |
     | profiler.executors | The number of executors to spawn per component.  |
     | profiler.input.topic | The name of the Kafka topic from which to consume 
data.  |
    -| profiler.flush.interval.seconds | The duration of a profile's sliding 
window before it is flushed. |
    +| profiler.period.duration | The duration of each profile period.  This 
value should be defined along with `profiler.period.duration.units`.  |
    +| profiler.period.duration.units | The units used to specify the profile 
period duration.  This value should be defined along with 
`profiler.period.duration`. |
     | profiler.hbase.salt.divisor  |  A salt is prepended to the row key to 
help prevent hotspotting.  This constant is used to generate the salt.  
Ideally, this constant should be roughly equal to the number of nodes in the 
Hbase cluster.  |
     | profiler.hbase.table | The name of the HBase table that profiles are 
written to.  |
    +| profiler.hbase.column.family | The column family used to store profiles. 
|
    --- End diff --
    
    Great!


> Allow Configurable Periods for Profiler Client
> ----------------------------------------------
>
>                 Key: METRON-529
>                 URL: https://issues.apache.org/jira/browse/METRON-529
>             Project: Metron
>          Issue Type: Improvement
>            Reporter: Nick Allen
>            Assignee: Nick Allen
>
> By default, the Profiler creates Profiles with a period duration of 15 
> minutes. This means that data is accumulated, summarized and flushed every 15 
> minutes. The Client API must also have knowledge of this duration to 
> correctly retrieve the profile data. If the client API is expecting 15 minute 
> periods, it will not be able to read data generated by a Profiler that has 
> been configured with a 1 hour period.
> The period duration can be configured in the Profiler by altering the 
> Profiler topology's static properties file. The Stellar Client API currently 
> provides no means to configure the period duration and defaults also to 15 
> minutes. This means that the Stellar Client API can only read profiles with a 
> period duration of 15 minutes. This is a known limitation that has not yet 
> been addressed.
> https://github.com/apache/incubator-metron/blob/e31705029fd7518bd03c22eece0c2a8eb1187abf/metron-analytics/metron-profiler-client/README.md#period-duration



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Reply via email to