[
https://issues.apache.org/jira/browse/FLINK-24279?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17414864#comment-17414864
]
Dawid Wysakowicz commented on FLINK-24279:
------------------------------------------
Have you looked at the broadcast state?
https://nightlies.apache.org/flink/flink-docs-master/docs/dev/datastream/fault-tolerance/broadcast_state/
or the {{broadcast}} partitioning?
https://nightlies.apache.org/flink/flink-docs-master/docs/dev/datastream/operators/overview/#broadcasting
> Support withBroadcast in DataStream API
> ---------------------------------------
>
> Key: FLINK-24279
> URL: https://issues.apache.org/jira/browse/FLINK-24279
> Project: Flink
> Issue Type: New Feature
> Components: Library / Machine Learning
> Reporter: ZHANG ZHIPENG
> Priority: Major
>
> When doing machine learning using DataStream API, we found that DataStream
> lacks withBroadcast() function, which could be useful in machine learning.
>
> A DataSet-based demo is like:
>
> DataSet<?> d1 = ...;
> DataSet<?> d2 = ...;
> d1.map(new RichMapFunction <?, ?>() {
> @Override
> public Object map(Object aLong) throws Exception {
> List<?> elements = getRuntimeContext().getBroadcastVariable("d2");
> ...
> }
> }).withBroadcastSet(d2, "d2")
>
>
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
