[
https://issues.apache.org/jira/browse/FLINK-24279?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
ZHANG ZHIPENG updated FLINK-24279:
----------------------------------
Description:
When doing machine learning using DataStream API, we found that DataStream
lacks withBroadcast() function, which could be useful in machine learning.
A DataSet-based demo is like:
DataSet<?> d1 = ...;
DataSet<?> d2 = ...;
d1.map(new RichMapFunction <?, ?>() {
@Override
public Object map(Object aLong) throws Exception {
List<?> elements = getRuntimeContext().getBroadcastVariable("d2");
...
}
}).withBroadcastSet(d2, "d2")
was:
When doing machine learning using DataStream API, we found that DataStream
lacks withBroadcast() function, which could be useful in machine learning.
A DataSet-based demo is like:
DataSet<?> d1 = ...;
DataSet<?> d2 = ...;
d1.map(new RichMapFunction <?, ?>() {
@Override
public Object map(Object aLong) throws Exception {
List<?> elements = getRuntimeContext().getBroadcastVariable("d1");
...
}
}).withBroadcastSet(d2, "d2")
> Support withBroadcast in DataStream API
> ---------------------------------------
>
> Key: FLINK-24279
> URL: https://issues.apache.org/jira/browse/FLINK-24279
> Project: Flink
> Issue Type: New Feature
> Components: Library / Machine Learning
> Reporter: ZHANG ZHIPENG
> Priority: Major
>
> When doing machine learning using DataStream API, we found that DataStream
> lacks withBroadcast() function, which could be useful in machine learning.
>
> A DataSet-based demo is like:
>
> DataSet<?> d1 = ...;
> DataSet<?> d2 = ...;
> d1.map(new RichMapFunction <?, ?>() {
> @Override
> public Object map(Object aLong) throws Exception {
> List<?> elements = getRuntimeContext().getBroadcastVariable("d2");
> ...
> }
> }).withBroadcastSet(d2, "d2")
>
>
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
