[
https://issues.apache.org/jira/browse/FLINK-1459?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Stephan Ewen resolved FLINK-1459.
---------------------------------
Resolution: Fixed
Fix Version/s: 0.9
Assignee: Stephan Ewen
This has been implemented a while back, actually. Sorry for the late update.
Implemented in 3dc2fe1dc300146e5209023274c0b0d04277f9ee
> Collect DataSet to client
> -------------------------
>
> Key: FLINK-1459
> URL: https://issues.apache.org/jira/browse/FLINK-1459
> Project: Flink
> Issue Type: Improvement
> Reporter: John Sandiford
> Assignee: Stephan Ewen
> Fix For: 0.9
>
>
> Hi, I may well have missed something obvious here but I cannot find an easy
> way to extract the values in a DataSet to the client. Spark has collect,
> collectAsMap etc...
> (I need to pass the values from a small aggregated DataSet back to a machine
> learning library which is controlling the iterations.)
> The only way I could find to do this was to implement my own in memory
> OutputFormat. This is not ideal, but does work.
> Many thanks, John
>
> val env = ExecutionEnvironment.getExecutionEnvironment
> val data: DataSet[Double] = env.fromElements(1.0, 2.0, 3.0, 4.0)
> val result = data.reduce((a, b) => a)
> val valuesOnClient = result.???
> env.execute("Simple example")
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
