[ 
https://issues.apache.org/jira/browse/BEAM-2953?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17301358#comment-17301358
 ] 

Reza ardeshir rokni commented on BEAM-2953:
-------------------------------------------

This is being worked on in sample library external to beam repo:

 

https://github.com/GoogleCloudPlatform/dataflow-sample-applications/tree/master/timeseries-streaming

> Timeseries processing extensions using state API
> ------------------------------------------------
>
>                 Key: BEAM-2953
>                 URL: https://issues.apache.org/jira/browse/BEAM-2953
>             Project: Beam
>          Issue Type: Improvement
>          Components: sdk-ideas
>    Affects Versions: 2.7.0
>            Reporter: Reza ardeshir rokni
>            Priority: P3
>          Time Spent: 4h 40m
>  Remaining Estimate: 0h
>
> A general set of timeseries transforms that abstract the user from the 
> process of dealing with some of the common problems when dealing with 
> timeseries using BEAM (in stream or batch mode).
> BEAM can be used to build out some very interesting pre-processing stages for 
> time series data. Some examples that will be useful:
>  - Downsampling time series based on simple MIN, MAX, COUNT, SUM, LAST, FIRST
>  - Creating a value for each downsampled window even if no value has been 
> emitted for the specific key. 
>  - Loading the value of a downsample with the previous value (used in FX with 
> previous close being brought into current open value)
>  



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

Reply via email to