Re: [DISCUSSION] IEP-102: Data Streamer for Ignite 3.x

2023-06-05 Thread Pavel Tupitsyn
> 1. How will partition awareness be achieved? Is the plan to consume the stream and then partition and transmit the data to where it needs to go? Yes, the client performs partitioning. I'm not aware of custom affinity plans for Ignite 3.x > 2. Is the plan to use consistent key/thread assignment t

Re: [DISCUSSION] IEP-102: Data Streamer for Ignite 3.x

2023-06-04 Thread Colin Cassidy
This looks great. A couple of questions: 1. How will partition awareness be achieved? Is the plan to consume the stream and then partition and transmit the data to where it needs to go? Or will there be some way to work with 3rd party event streams to ensure that events are delivered to the rig

Re: [DISCUSSION] IEP-102: Data Streamer for Ignite 3.x

2023-06-01 Thread Pavel Tupitsyn
Basic streamer in Java client is ready for review: https://issues.apache.org/jira/browse/IGNITE-19540 https://github.com/apache/ignite-3/pull/2128 On Tue, May 23, 2023 at 1:48 PM Pavel Tupitsyn wrote: > Igniters, > > Please review Ignite 3.x Data Streamer proposal > > https://cwiki.apache.org/c

[DISCUSSION] IEP-102: Data Streamer for Ignite 3.x

2023-05-23 Thread Pavel Tupitsyn
Igniters, Please review Ignite 3.x Data Streamer proposal https://cwiki.apache.org/confluence/display/IGNITE/IEP-102%3A+Data+Streamer