Re: rowTime from json nested timestamp field in SQL-Client

2018-07-17 Thread Timo Walther
Hi Ashwin, if you quickly want to make this work you can look into org.apache.flink.table.descriptors.RowtimeValidator#getRowtimeComponents. This is the component that converts the string property into a org.apache.flink.table.sources.tsextractors.TimestampExtractor. You can implement your

Re: rowTime from json nested timestamp field in SQL-Client

2018-07-17 Thread Ashwin Sinha
Hi Timo, We want to add this functionality in a forked branch. Can you guide us with steps to quickly apply a patch/fix for the same? On Mon, Jul 16, 2018 at 9:06 PM Ashwin Sinha wrote: > Thanks Timo for the clarification, but our processing actually involves > aggregations on huge past data

Re: rowTime from json nested timestamp field in SQL-Client

2018-07-16 Thread Ashwin Sinha
Thanks Timo for the clarification, but our processing actually involves aggregations on huge past data also, which won't be served by processing time. Is this a WIP feature? On Mon, Jul 16, 2018 at 7:29 PM Timo Walther wrote: > Hi Ashwin, > > the SQL Client is in an early development stage

Re: rowTime from json nested timestamp field in SQL-Client

2018-07-16 Thread Timo Walther
Hi Ashwin, the SQL Client is in an early development stage right now and has some limitations. Your problem is one of them. I files an issue for this: https://issues.apache.org/jira/browse/FLINK-9864 There is no easy solution to fix this problem. Maybe you can use processing-time for your

rowTime from json nested timestamp field in SQL-Client

2018-07-16 Thread Ashwin Sinha
Hi Users, In Flink1.5 SQL CLient , we are trying to define rowTime from a nested JSON element, but struggling with syntax. JSON data format: https://pastebin.com/ByCLhEnF YML table config: