Stephan Ewen created FLINK-20049:
------------------------------------

             Summary: Simplify handling of "request split".
                 Key: FLINK-20049
                 URL: https://issues.apache.org/jira/browse/FLINK-20049
             Project: Flink
          Issue Type: Improvement
          Components: API / Core
            Reporter: Stephan Ewen
            Assignee: Stephan Ewen
             Fix For: 1.12.0


This issue is similar to FLINK-19265

Split assignment events are treated specially by the source API. Users do not 
create them directly but call methods on the contexts to assign splits.

The {{RequestSplitEvent}} is in contrast to that a custom user event and needs 
to be handled like a custom event, when sent by enumerators and received by the 
readers.

That seems a bit confusing and inconsistent, given that {{RequestSplitEvent}} 
is essential for all use cases with pull-based split assignment, which is 
pretty much any batch use case and various streaming use cases. The event 
should be on the same level as the AddSplitEvent.

I suggest that we add a {{SourceReaderContext.requestSplit()}} and 
{{SplitEnumerator.handleSplitRequest()}}, to have split requests and responses 
symmetrical.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

Reply via email to