[
https://issues.apache.org/jira/browse/FLINK-15634?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17019478#comment-17019478
]
Aljoscha Krettek commented on FLINK-15634:
------------------------------------------
Ah, I think the root of the problem is that we use our own public API in the
implementation. Here, we know that the mappers don't really need a UID because
they don't have state. We could set a dummy UID here to fix the bug but I
somehow feel that's a bit "dirty".
> disableAutoGeneratedUIDs fails with coGroup and join
> ----------------------------------------------------
>
> Key: FLINK-15634
> URL: https://issues.apache.org/jira/browse/FLINK-15634
> Project: Flink
> Issue Type: Bug
> Components: API / DataStream
> Affects Versions: 1.10.0
> Reporter: Jürgen Kreileder
> Priority: Major
>
> coGroup/join seems to generate two Map operators for which you can't set the
> UID.
> Here's a test case:
> {code:java}
> @Test
> public void testDisablingAutoUidsWorksWithCoGroup() throws Exception {
> StreamExecutionEnvironment env =
> StreamExecutionEnvironment.getExecutionEnvironment();
> env.getConfig().disableAutoGeneratedUIDs();
> env
> .addSource(new
> NoOpSourceFunction()).setUidHash("aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa")
> .coGroup(env.addSource(new
> NoOpSourceFunction()).setUidHash("bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"))
> .where(o -> o).equalTo(o -> o)
> .window(TumblingEventTimeWindows.of(Time.days(1)))
> .with(new CoGroupFunction<String, String, Object>() {
> @Override
> public void coGroup(Iterable<String> first, Iterable<String> second,
> Collector<Object> out) throws Exception {
> }
> }).setUidHash("cccccccccccccccccccccccccccccccc")
> .addSink(new
> DiscardingSink<>()).setUidHash("dddddddddddddddddddddddddddddddd");
> env.execute();
> }
> {code}
>
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
