Re: FW: [DISCUSS] Table API / SQL indicators for event and processing time

2017-03-27 Thread Fabian Hueske
:twal...@apache.org] > Sent: Monday, March 20, 2017 2:05 PM > To: dev@flink.apache.org > Subject: Re: FW: [DISCUSS] Table API / SQL indicators for event and > processing time > > Yes, you are right. In the current design the user cannot assign > timestamp and watermarks in a table pr

RE: FW: [DISCUSS] Table API / SQL indicators for event and processing time

2017-03-20 Thread Radu Tudoran
To: dev@flink.apache.org Subject: Re: FW: [DISCUSS] Table API / SQL indicators for event and processing time Yes, you are right. In the current design the user cannot assign timestamp and watermarks in a table program. Operators (such as windows) might adapt the metatimestamp, if this is the

Re: FW: [DISCUSS] Table API / SQL indicators for event and processing time

2017-03-20 Thread Timo Walther
: Radu Tudoran Subject: Re: [DISCUSS] Table API / SQL indicators for event and processing time You are not bothering me, it is very interesting to compare the design with real world use cases. In your use case we would create table like: tEnv.toTable('date, 'time1, 'time2, 'data,

FW: [DISCUSS] Table API / SQL indicators for event and processing time

2017-03-20 Thread Radu Tudoran
h 20, 2017 12:29 PM To: Radu Tudoran Subject: Re: [DISCUSS] Table API / SQL indicators for event and processing time You are not bothering me, it is very interesting to compare the design with real world use cases. In your use case we would create table like: tEnv.toTable('date, 'time1,

RE: [DISCUSS] Table API / SQL indicators for event and processing time

2017-03-20 Thread Radu Tudoran
> > -Original Message- > From: Timo Walther [mailto:twal...@apache.org] > Sent: Monday, March 20, 2017 10:08 AM > To: dev@flink.apache.org > Subject: Re: [DISCUSS] Table API / SQL indicators for event and processing > time > > Hi everyone, > > for the last

Re: [DISCUSS] Table API / SQL indicators for event and processing time

2017-03-20 Thread Timo Walther
ve SUM, MAX, MIN, AVG, COUNT implemented but I could test it just on simple queries such as the one above. Is there any specific case I should be looking at? Regards, Stefano -Original Message- From: jincheng sun [mailto:sunjincheng...@gmail.com] Sent: Tuesday, February 28, 2017 12:26 PM To

RE: [DISCUSS] Table API / SQL indicators for event and processing time

2017-03-20 Thread Radu Tudoran
would be defined based on cardinality of elements. -Original Message- From: Timo Walther [mailto:twal...@apache.org] Sent: Monday, March 20, 2017 10:08 AM To: dev@flink.apache.org Subject: Re: [DISCUSS] Table API / SQL indicators for event and processing time Hi everyone, for the la

Re: [DISCUSS] Table API / SQL indicators for event and processing time

2017-03-20 Thread Timo Walther
simple queries such as the one above. Is there any specific case I should be looking at? Regards, Stefano -Original Message- From: jincheng sun [mailto:sunjincheng...@gmail.com] Sent: Tuesday, February 28, 2017 12:26 PM To: dev@flink.apache.org Subject: Re: [DISCUSS] Table API / SQL indic

Re: [DISCUSS] Table API / SQL indicators for event and processing time

2017-03-01 Thread jincheng sun
> > > >>>> > > > > > >>>>> we should make them system attributes; esp. to relate them > to a > > > > > >>>>>> corresponding table in case of multiple tables. Logically > they > > >

Re: [DISCUSS] Table API / SQL indicators for event and processing time

2017-03-01 Thread Fabian Hueske
;>>> This is not possible with a parameterless scalar function. > > > > >>>>> > > > > >>>>> I'd like to comment on the concerns regarding the performance: > > > > >>>>> In fact, the columns could be completel

Re: [DISCUSS] Table API / SQL indicators for event and processing time

2017-03-01 Thread Timo Walther
c case I should be looking at? Regards, Stefano -Original Message----- From: jincheng sun [mailto:sunjincheng...@gmail.com] Sent: Tuesday, February 28, 2017 12:26 PM To: dev@flink.apache.org Subject: Re: [DISCUSS] Table API / SQL indicators for event and processing time Hi everyone, thanks

Re: [DISCUSS] Table API / SQL indicators for event and processing time

2017-02-28 Thread jincheng sun
gt; > > > > I have SUM, MAX, MIN, AVG, COUNT implemented but I could test it just > on > > > simple queries such as the one above. Is there any specific case I > should > > > be looking at? > > > > > > Regards, > > > Stefano > > &

Re: [DISCUSS] Table API / SQL indicators for event and processing time

2017-02-28 Thread Xingcan Cui
gards, > > Stefano > > > > -----Original Message----- > > From: jincheng sun [mailto:sunjincheng...@gmail.com] > > Sent: Tuesday, February 28, 2017 12:26 PM > > To: dev@flink.apache.org > > Subject: Re: [DISCUSS] Table API / SQL indicators for event and > pr

Re: [DISCUSS] Table API / SQL indicators for event and processing time

2017-02-28 Thread Fabian Hueske
be looking at? > > Regards, > Stefano > > -Original Message- > From: jincheng sun [mailto:sunjincheng...@gmail.com] > Sent: Tuesday, February 28, 2017 12:26 PM > To: dev@flink.apache.org > Subject: Re: [DISCUSS] Table API / SQL indicators for event and processing > ti

RE: [DISCUSS] Table API / SQL indicators for event and processing time

2017-02-28 Thread Stefano Bortoli
any specific case I should be looking at? Regards, Stefano -Original Message- From: jincheng sun [mailto:sunjincheng...@gmail.com] Sent: Tuesday, February 28, 2017 12:26 PM To: dev@flink.apache.org Subject: Re: [DISCUSS] Table API / SQL indicators for event and processing time Hi

Re: [DISCUSS] Table API / SQL indicators for event and processing time

2017-02-28 Thread jincheng sun
gt;>>> and rowTime() only as functions which in fact are to be used as >>>>>> >>>>> markers. >>> >>>> Having the value (even from special system attributes does not make >>>>>> >>>>> sense >>>&g

Re: [DISCUSS] Table API / SQL indicators for event and processing time

2017-02-22 Thread Timo Walther
Original Message- From: Timo Walther [mailto:twal...@apache.org] Sent: Wednesday, February 15, 2017 9:33 AM To: dev@flink.apache.org Subject: Re: [DISCUSS] Table API / SQL indicators for event and processing time Hi all, at first I also thought that built-in functions (rowtime() and p

Re: [DISCUSS] Table API / SQL indicators for event and processing time

2017-02-21 Thread Fabian Hueske
T R&D Division > > >> > > >> > > >> HUAWEI TECHNOLOGIES Duesseldorf GmbH > > >> European Research Center > > >> Riesstrasse 25, 80992 München > > >> > > >> E-mail: radu.tudo...@huawei.com > > >> M

Re: [DISCUSS] Table API / SQL indicators for event and processing time

2017-02-20 Thread Xingcan Cui
>> >>> The table would also have another system attribute called "rowtime" > >> >>> which would be used to indicate event time semantics. > >> >>> These attributes would always be present in tables which are derived > >> >>>

Re: [DISCUSS] Table API / SQL indicators for event and processing time

2017-02-20 Thread Fabian Hueske
s contain confidential information from >> HUAWEI, which is intended only for the person or entity whose address is >> listed above. Any use of the information contained herein in any way >> (including, but not limited to, total or partial disclosure, reproduction, >> or dissem

Re: [DISCUSS] Table API / SQL indicators for event and processing time

2017-02-15 Thread Fabian Hueske
osure, reproduction, > or dissemination) by persons other than the intended recipient(s) is > prohibited. If you receive this e-mail in error, please notify the sender > by phone or email immediately and delete it! > > -----Original Message- > From: Timo Walther [mailto:twal...@a

RE: [DISCUSS] Table API / SQL indicators for event and processing time

2017-02-15 Thread Radu Tudoran
and delete it! -Original Message- From: Timo Walther [mailto:twal...@apache.org] Sent: Wednesday, February 15, 2017 9:33 AM To: dev@flink.apache.org Subject: Re: [DISCUSS] Table API / SQL indicators for event and processing time Hi all, at first I also thought that built-in functions

Re: [DISCUSS] Table API / SQL indicators for event and processing time

2017-02-15 Thread Timo Walther
sons other than the intended recipient(s) is prohibited. If you receive this e-mail in error, please notify the sender by phone or email immediately and delete it! -Original Message- From: Fabian Hueske [mailto:fhue...@gmail.com] Sent: Tuesday, February 14, 2017 1:01 AM To: dev@flink.apach

Re: [DISCUSS] Table API / SQL indicators for event and processing time

2017-02-14 Thread Xingcan Cui
, HRB 56063, > > > Geschäftsführer: Bo PENG, Wanzhou MENG, Lifang CHEN > > > This e-mail and its attachments contain confidential information from > > > HUAWEI, which is intended only for the person or entity whose address > is > > > listed above. Any use of the inform

Re: [DISCUSS] Table API / SQL indicators for event and processing time

2017-02-14 Thread Haohui Mai
ity whose address is > > listed above. Any use of the information contained herein in any way > > (including, but not limited to, total or partial disclosure, > reproduction, > > or dissemination) by persons other than the intended recipient(s) is > > prohibited

Re: [DISCUSS] Table API / SQL indicators for event and processing time

2017-02-14 Thread Fabian Hueske
y phone or email immediately and delete it! > > -----Original Message----- > From: Fabian Hueske [mailto:fhue...@gmail.com] > Sent: Tuesday, February 14, 2017 1:01 AM > To: dev@flink.apache.org > Subject: [DISCUSS] Table API / SQL indicators for event and processing time >

RE: [DISCUSS] Table API / SQL indicators for event and processing time

2017-02-13 Thread Radu Tudoran
Fabian Hueske [mailto:fhue...@gmail.com] Sent: Tuesday, February 14, 2017 1:01 AM To: dev@flink.apache.org Subject: [DISCUSS] Table API / SQL indicators for event and processing time Hi, I'd like to start an discussion about how Table API / SQL queries indicate whether an operation is done in

[DISCUSS] Table API / SQL indicators for event and processing time

2017-02-13 Thread Fabian Hueske
Hi, I'd like to start an discussion about how Table API / SQL queries indicate whether an operation is done in event or processing time. 1) Why do we need to indicate the time mode? We need to distinguish event time and processing time mode for operations in queries in order to have the semantic