Casey Stella created METRON-690:
-----------------------------------
Summary: Create a DSL-based timestamp lookup for profiler to
enable sparse windows
Key: METRON-690
URL: https://issues.apache.org/jira/browse/METRON-690
Project: Metron
Issue Type: New Feature
Reporter: Casey Stella
I propose that we support the following features:
* A starting point that is not current time
* Sparse bins (i.e. the last hour for every tuesday for the last month)
* The ability to skip events (e.g. weekends, holidays)
This would result in a new function with the following arguments:
from - The lookback starting point (default to now)
fromUnits - The units for the lookback starting point
to - The ending point for the lookback window (default to from + binSize)
toUnits - The units for the lookback ending point
including - A list of conditions which we would skip.
weekend
holiday
sunday through saturday
excluding - A list of conditions which we would skip.
weekend
holiday
sunday through saturday
binSize - The size of the lookback bin
binUnits - The units of the lookback bin
Given the number of arguments and their complexity and the fact that many, many
are optional,
PROFILE_LOOKBACK accept a string backed by a DSL to express these criteria
Base Case: A lookback of 1 hour ago
PROFILE_LOOKBACK( '1 hour bins from now')
Example 1: The same time window every tuesday for the last month starting one
hour ago
Just to make this as clear as possible, if this is run at 3PM on Monday January
23rd, 2017, it would include the following bins:
January 17th, 2PM - 3PM
January 10th, 2PM - 3PM
January 3rd, 2PM - 3PM
December 27th, 2PM - 3PM
PROFILE_LOOKBACK( '1 hour bins from 1 hour to 1 month including tuesdays')
Example 2: The same time window every sunday for the last month starting one
hour ago skipping holidays
Just to make this as clear as possible, if this is run at 3PM on Monday January
22rd, 2017, it would include the following bins:
January 16th, 2PM - 3PM
January 9th, 2PM - 3PM
January 2rd, 2PM - 3PM
NOT December 25th
PROFILE_LOOKBACK( '1 hour bins from 1 hour to 1 month including tuesdays
excluding holidays')
--
This message was sent by Atlassian JIRA
(v6.3.15#6346)
