Yes, in fact I anticipated this. There is one central place where we
can insert a copy step, in OperatorCollector in OutputHandler.
On Wed, May 20, 2015 at 11:17 AM, Paris Carbone par...@kth.se wrote:
I guess it was not intended ^^.
Chaining should be transparent and not break the
Copy before putting it into a window buffer and any other group buffer.
Exactly my point. Any stateful operator should be able to implement
something like this without having to worry about copying the object (and
at this point the user would need to know whether it comes from the network
to
I am curious why the copying is actually needed.
In the batch API, we chain and do not copy and it is rather predictable.
The cornerpoints of that design is to follow these rules:
1) Objects read from the network or any buffer are always new objects.
That comes naturally when they are
I guess it was not intended ^^.
Chaining should be transparent and not break the correct/expected behaviour.
Paris?
On 20 May 2015, at 11:02, Márton Balassi mbala...@apache.org wrote:
+1 for copying.
On May 20, 2015 10:50 AM, Gyula Fóra gyf...@apache.org wrote:
Hey,
The latest streaming
+1 for copying.
On May 20, 2015 10:50 AM, Gyula Fóra gyf...@apache.org wrote:
Hey,
The latest streaming operator rework removed the copying of the outputs
before passing them to chained operators. This is a major break for the
previous operator semantics which guaranteed immutability.
I
, 2015 2:06 PM
To: dev@flink.apache.org
Subject: Re: [DISCUSS] Re-add record copy to chained operator calls
Copy before putting it into a window buffer and any other group buffer.
Exactly my point. Any stateful operator should be able to implement
something like this without having to worry about
: Gyula Fóra gyf...@apache.org
Sent: Wednesday, May 20, 2015 2:06 PM
To: dev@flink.apache.org
Subject: Re: [DISCUSS] Re-add record copy to chained operator calls
Copy before putting it into a window buffer and any other group buffer.
Exactly my point. Any stateful operator should be able
.
From: Gyula Fóra gyf...@apache.org
Sent: Wednesday, May 20, 2015 2:06 PM
To: dev@flink.apache.org
Subject: Re: [DISCUSS] Re-add record copy to chained operator calls
Copy before putting it into a window buffer and any other group buffer.
Exactly
.
From: Gyula Fóra gyf...@apache.org
Sent: Wednesday, May 20, 2015 2:06 PM
To: dev@flink.apache.org
Subject: Re: [DISCUSS] Re-add record copy to chained operator calls
Copy before putting it into a window buffer and any other group
buffer.
Exactly my
to evaluate them.
From: Gyula Fóra gyf...@apache.org
Sent: Wednesday, May 20, 2015 2:06 PM
To: dev@flink.apache.org
Subject: Re: [DISCUSS] Re-add record copy to chained operator calls
Copy before putting it into a window buffer and any
chained) operators that need to evaluate them.
From: Gyula Fóra gyf...@apache.org
Sent: Wednesday, May 20, 2015 2:06 PM
To: dev@flink.apache.org
Subject: Re: [DISCUSS] Re-add record copy to chained operator calls
Copy before
.
From: Gyula Fóra gyf...@apache.org
Sent: Wednesday, May 20, 2015 2:06 PM
To: dev@flink.apache.org
Subject: Re: [DISCUSS] Re-add record copy to chained operator
calls
Copy before putting it into a window buffer and any other group
buffer
To: dev@flink.apache.org
Subject: Re: [DISCUSS] Re-add record copy to chained operator
calls
Copy before putting it into a window buffer and any other
group
buffer.
Exactly my point. Any stateful operator should be able to
implement
something like
to
other (possibly chained) operators that need to evaluate them.
From: Gyula Fóra gyf...@apache.org
Sent: Wednesday, May 20, 2015 2:06 PM
To: dev@flink.apache.org
Subject: Re: [DISCUSS] Re-add record copy to chained
: Wednesday, May 20, 2015 2:06 PM
To: dev@flink.apache.org
Subject: Re: [DISCUSS] Re-add record copy to chained operator calls
Copy before putting it into a window buffer and any other group
buffer.
Exactly my point. Any stateful operator should be able to implement
to
other (possibly chained) operators that need to evaluate
them.
From: Gyula Fóra gyf...@apache.org
Sent: Wednesday, May 20, 2015 2:06 PM
To: dev@flink.apache.org
Subject: Re: [DISCUSS] Re-add record copy to chained
Subject: Re: [DISCUSS] Re-add record copy to chained
operator
calls
Copy before putting it into a window buffer and any
other
group
buffer.
Exactly my point. Any stateful operator should be able to
implement
something like
17 matches
Mail list logo
