Hello, As anyone used streaming sql pattern matching as shown in this email thread to count certain transitions on a stream? Is it feasible?
Thank you, Pedro Silva > On 13 Sep 2021, at 11:16, Pedro Silva <[email protected]> wrote: > > > Hello Seth, > > Thank you very much for your reply. I've taken a look at MATCH_RECOGNIZE but > I have the following doubt. Can I implement a state machine that detect > patterns with multiple end states? > To give you a concrete example: > > I'm trying to count the number of Jobs that have been cancelled and > completed. The state machine associated with this Job concept is as follows: > Started -> On-Going (Multiple Progress messages) -> Closed -> Completed ----\ > > \--------------\--------------------------------------------------------\----------------\------------- > > Cancelled > > At any point the Job can be cancelled from the previous state. > This cancel message can take anywhere from 1-2 weeks to be received. > The duration of this state machine (Job lifecycle) is roughly 6 months. > > How can I keep a count of the number of Jobs that have been completed but not > cancelled such that when a cancel appears on a previously (completed | > closed) I decrease my counter but not when a cancel appears after a started > or progress state (no counter increment or decrement) ? > > I hope this example was clear. > > Thank you for your time! > Pedro Silva > > >> Em sex., 10 de set. de 2021 às 20:18, Seth Wiesman <[email protected]> >> escreveu: >> Hi Pedro, >> >> The DataStream CEP library is not available in Python but you can use >> `MATCH_RECOGNIZE` in the table API which is implemented on-top of the CEP >> library from Python. >> >> https://nightlies.apache.org/flink/flink-docs-release-1.13/docs/dev/table/sql/queries/match_recognize/ >> >> >> Seth >> >>> On Fri, Sep 10, 2021 at 11:34 AM Pedro Silva <[email protected]> wrote: >>> Hello, >>> >>> Is Flink's CEP library available in python? From the documentation I see no >>> references so I'm guessing the answer is no but wanted some confirmation >>> from the community or developers. >>> >>> Are there plans to support this library in python or alternatively, another >>> library altogether that can be used in python? >>> >>> Thank you and have a nice weekend, >>> Pedro Silva
