Re: Handling defaults and windowed aggregates in stream queries

2015-03-01 Thread Yi Pan
Hi, Milinda, Sorry to reply late on this. Here are some of my comments: 1) In Calcite's model, it seems that there is no stream-to-relation conversion step. In the first example where the window specification is missing, I like your solution to add the default LogicalNowWindow operator s.t. it

Re: Reprocessing and windowing

2015-02-23 Thread Yi Pan
Hey, Geoffry, We have started some work in SAMZA-552 to create a window operator API in samza, as part of effort to implement support for a high-level language. I will probably be able to have something to share in a few days and would love to get feedbacks regarding to the window operator.

Re: Terminology: Tumbling and sliding windows

2015-02-17 Thread Yi Pan
+1 on consolidating the terminology as well. Azure's definition looks good to me. On Tue, Feb 17, 2015 at 9:13 AM, Chris Riccomini criccom...@apache.org wrote: Hey Julian, +1 I'm not sure if we actually *are* using the right terminology, but I agree that Azure's terminology is what we should

Re: Review Request 29754: StreamSQL operator API draft

2015-01-30 Thread Yi Pan (Data Infrastructure)
/task/sql/StreamSqlTask.java PRE-CREATION settings.gradle 3a01fd66359b8c79954ae8f34eeaf4b2e3fdc0b4 Diff: https://reviews.apache.org/r/29754/diff/ Testing --- run ./bin/check-all.sh passed Thanks, Yi Pan (Data Infrastructure)

Re: Streaming SQL - object models, ASTs and algebras

2015-01-29 Thread Yi Pan
of work and 90% of the functionality is identical in a streaming and non-streaming system. Lastly, building a stack based on extended standard SQL does not preclude adding other high-level languages on top of the algebra at a later date. Julian On Jan 28, 2015, at 5:36 PM, Yi Pan nickpa

Re: Streaming SQL - object models, ASTs and algebras

2015-01-29 Thread Yi Pan
Hyde jul...@hydromatic.net wrote: On Jan 29, 2015, at 3:04 PM, Yi Pan nickpa...@gmail.com wrote: Hi, Julian, Thanks for sharing your idea! It is interesting and well organized. Let me try to summarize the main difference between yours and the current proposal are: - removing

Re: Review Request 30287: Stream SQL Object Model Draft

2015-01-27 Thread Yi Pan (Data Infrastructure)
and join expression are expressions that all generate a table-type data source entity. - Yi Pan (Data Infrastructure) On Jan. 26, 2015, 10:04 p.m., Milinda Pathirage wrote: --- This is an automatically generated e-mail. To reply, visit

<    3   4   5   6   7   8