Junyao Huang created FLINK-34659:
------------------------------------
Summary: How to implement global sort in latest flink datastream
API
Key: FLINK-34659
URL: https://issues.apache.org/jira/browse/FLINK-34659
Project: Flink
Issue Type: Bug
Components: API / DataStream
Affects Versions: 1.18.1
Reporter: Junyao Huang
Attachments: image-2024-03-13-11-21-57-846.png
[https://nightlies.apache.org/flink/flink-docs-master/zh/docs/dev/datastream/dataset_migration/#%E7%AC%AC%E4%B8%89%E7%B1%BB]
{{DataStream<Integer> dataStream = // [...]// assign subtask ID to all
recordsDataStream<Tuple2<String, Integer>> dataStream1 = dataStream.map(new
AddSubtaskIDMapFunction());dataStream1.keyBy(value -> value.f0)
.window(EndOfStreamWindows.get()) .apply(new WindowFunction<>(){
// implement user-defined map partition or sort partition logic
});}}
{{}}
{{will this cause OOM in streaming execution mode?}}
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
