Re: assign time attribute after first window group when using Flink SQL

2018-04-17 Thread Ivan Wang
0 Fabian Hueske <fhue...@gmail.com>: > >> Hi, >> >> Assuming you are using event time, the right function to generate a row >> time attribute from a window would be "w1.rowtime" instead of "w1.start". >> >> The reason why Flink is picky

Re: Is Flink able to do real time stock market analysis?

2018-04-12 Thread Ivan Wang
the code hard to read. I’m thinking about watermark, but not sure how to do this. -- Thanks Ivan From: TechnoMage <mla...@technomage.com> Date: Thursday, 12 April 2018 at 3:21 AM To: Ivan Wang <ivan.wang2...@gmail.com> Cc: "user@flink.apache.org" <user@flink.apache.org>

Is Flink able to do real time stock market analysis?

2018-04-10 Thread Ivan Wang
Hi all, I've spent nearly 2 weeks trying to figure a solution to my requirement as below. If anyone can advise, that would be great. 1. There're going to be 2000 transactions per second as StreamRaw, I'm going to tumbleWindow them as StreamA, let's say every 15 seconds. Then I'm going to

assign time attribute after first window group when using Flink SQL

2018-04-08 Thread Ivan Wang
Hi all, I'd like to use 2 window group in a chain in my program as below. Table myTable = cTable .window(Tumble.*over*("15.seconds").on("timeMill").as("w1")) .groupBy("symbol, w1").select("w1.start as start, w1.end as end, symbol, price.max as p_max, price.min as p_min")