RE: StreamSQL procTime granularity

2017-04-06 Thread Stefano Bortoli
procTime granularity Hi Stefano, thanks for starting this discussion. I think treating processing time with a nanosecond resolution might be difficult for a few reasons: - We would need to treat it in all operators as nanotime (joins, etc.) - Flink does not provide tooling for nanotime resolution

Re: StreamSQL procTime granularity

2017-04-06 Thread Fabian Hueske
Hi Stefano, thanks for starting this discussion. I think treating processing time with a nanosecond resolution might be difficult for a few reasons: - We would need to treat it in all operators as nanotime (joins, etc.) - Flink does not provide tooling for nanotime resolution. The internal timer

StreamSQL procTime granularity

2017-04-04 Thread Stefano Bortoli
Hi guys, Based on the discussion about time management in https://github.com/apache/flink/pull/3641 , does it make sense to use nanoTime for procTime semantic aggregation processing? This way we will not have the possibility of events falling in the same "millisecond" processing bucket and