[
https://issues.apache.org/jira/browse/FLINK-4391?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15571577#comment-15571577
]
ASF GitHub Bot commented on FLINK-4391:
---------------------------------------
GitHub user bjlovegithub opened a pull request:
https://github.com/apache/flink/pull/2629
[FLINK-4391] Provide support for asynchronous operations over streams
PR for [FLIP
12](https://cwiki.apache.org/confluence/pages/viewpage.action?pageId=65870673)
- Implementation for Async I/O in FLINK.
Basically, the newly added operator supports async operation while
streaming. By implementing AsyncFunction, we can easily do i/o access, like
fetching data from HBase, in async way.
Please refer to AsyncIOExample.java about how to use it.
You can merge this pull request into a Git repository by running:
$ git pull https://github.com/bjlovegithub/flink master
Alternatively you can review and apply these changes as the patch at:
https://github.com/apache/flink/pull/2629.patch
To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:
This closes #2629
----
commit f352d0a8b879164baa8e4922f63ad8dde13c7c9b
Author: yushi.wxg <[email protected]>
Date: 2016-10-12T06:31:43Z
Add async wait operator
commit 139902396e1c30d88671ac67a54afea145ab7651
Author: yushi.wxg <[email protected]>
Date: 2016-10-13T10:13:32Z
1. add an example job 2. fix a bug in state serialization in async wait
operator; 3. move broadcast barrier after snapshot operator states
commit fc41eedcd48d2dd7d940e744dec86a51b24e4ac5
Author: yushi.wxg <[email protected]>
Date: 2016-10-13T10:25:36Z
update IT case
commit 9855f071f04b6efcfc4e10a9f6ef1c38ae264637
Author: yushi.wxg <[email protected]>
Date: 2016-10-13T10:28:39Z
adjust the whitespace in IT
----
> Provide support for asynchronous operations over streams
> --------------------------------------------------------
>
> Key: FLINK-4391
> URL: https://issues.apache.org/jira/browse/FLINK-4391
> Project: Flink
> Issue Type: New Feature
> Components: DataStream API
> Reporter: Jamie Grier
> Assignee: david.wang
>
> Many Flink users need to do asynchronous processing driven by data from a
> DataStream. The classic example would be joining against an external
> database in order to enrich a stream with extra information.
> It would be nice to add general support for this type of operation in the
> Flink API. Ideally this could simply take the form of a new operator that
> manages async operations, keeps so many of them in flight, and then emits
> results to downstream operators as the async operations complete.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
