GitHub user uce opened a pull request:

    https://github.com/apache/flink/pull/1439

    [contrib, connector-wikiedits] Add WikipediaEditsSource

    A non-parallel source that parses a live stream of Wikipedia edits.
    
    Meta data about the edits is mirrored to the IRC channel `#en.wikipedia`. 
The source establishes a connection to this IRC channel and parses the messages 
into `WikipediaEditEvent` instances.
    
    The purpose of this source is to ease the setup of demos of the 
`DataStream` API with live data.
    
    The original idea is from the [Hello 
Samza](https://samza.apache.org/startup/hello-samza/latest/) project of [Apache 
Samza](http://samza.apache.org). The Samza code for this is located in the 
[samza-hello-samza](https://github.com/apache/samza-hello-samza) repository.
    
    ## Example
    
    Add the following dependency to your project:
    
    ```xml
    <dependency>
      <groupId>org.apache.flink</groupId>
      <artifactId>flink-connector-wikiedits</artifactId>
      <version>1.0-SNAPSHOT</version>
    </dependency>
    ```
    
    You can use the source like regular sources:
    
    ```java
    StreamExecutionEnvironment env = StreamExecutionEnvironment
        .getExecutionEnvironment();
    
    DataStream<WikipediaEditEvent> edits = env
        .addSource(new WikipediaEditsSource());
    ```

You can merge this pull request into a Git repository by running:

    $ git pull https://github.com/uce/flink wikiedits

Alternatively you can review and apply these changes as the patch at:

    https://github.com/apache/flink/pull/1439.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

    This closes #1439
    
----
commit 2c6aa8c874e8e89b12e56af7e8f415b6f4cf49ff
Author: Ufuk Celebi <u...@apache.org>
Date:   2015-12-06T20:45:00Z

    [contrib, connector-wikiedits] Add WikipediaEditsSource

----


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

Reply via email to