ASF GitHub Bot commented on FLINK-4391:

GitHub user bjlovegithub opened a pull request:


    [FLINK-4391] Provide support for asynchronous operations over streams

    PR for [FLIP 
- Implementation for Async I/O in FLINK.
    Basically, the newly added operator supports async operation while 
streaming. By implementing AsyncFunction, we can easily do i/o access, like 
fetching data from HBase, in async way.
    Please refer to AsyncIOExample.java about how to use it.

You can merge this pull request into a Git repository by running:

    $ git pull https://github.com/bjlovegithub/flink master

Alternatively you can review and apply these changes as the patch at:


To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

    This closes #2629
commit f352d0a8b879164baa8e4922f63ad8dde13c7c9b
Author: yushi.wxg <yushi....@taobao.com>
Date:   2016-10-12T06:31:43Z

    Add async wait operator

commit 139902396e1c30d88671ac67a54afea145ab7651
Author: yushi.wxg <yushi....@taobao.com>
Date:   2016-10-13T10:13:32Z

    1. add an example job 2. fix a bug in state serialization in async wait 
operator; 3. move broadcast barrier after snapshot operator states

commit fc41eedcd48d2dd7d940e744dec86a51b24e4ac5
Author: yushi.wxg <yushi....@taobao.com>
Date:   2016-10-13T10:25:36Z

    update IT case

commit 9855f071f04b6efcfc4e10a9f6ef1c38ae264637
Author: yushi.wxg <yushi....@taobao.com>
Date:   2016-10-13T10:28:39Z

    adjust the whitespace in IT


> Provide support for asynchronous operations over streams
> --------------------------------------------------------
>                 Key: FLINK-4391
>                 URL: https://issues.apache.org/jira/browse/FLINK-4391
>             Project: Flink
>          Issue Type: New Feature
>          Components: DataStream API
>            Reporter: Jamie Grier
>            Assignee: david.wang
> Many Flink users need to do asynchronous processing driven by data from a 
> DataStream.  The classic example would be joining against an external 
> database in order to enrich a stream with extra information.
> It would be nice to add general support for this type of operation in the 
> Flink API.  Ideally this could simply take the form of a new operator that 
> manages async operations, keeps so many of them in flight, and then emits 
> results to downstream operators as the async operations complete.

This message was sent by Atlassian JIRA

Reply via email to