GitHub user uce opened a pull request:
https://github.com/apache/flink/pull/1439
[contrib, connector-wikiedits] Add WikipediaEditsSource
A non-parallel source that parses a live stream of Wikipedia edits.
Meta data about the edits is mirrored to the IRC channel `#en.wikipedia`.
The source establishes a connection to this IRC channel and parses the messages
into `WikipediaEditEvent` instances.
The purpose of this source is to ease the setup of demos of the
`DataStream` API with live data.
The original idea is from the [Hello
Samza](https://samza.apache.org/startup/hello-samza/latest/) project of [Apache
Samza](http://samza.apache.org). The Samza code for this is located in the
[samza-hello-samza](https://github.com/apache/samza-hello-samza) repository.
## Example
Add the following dependency to your project:
```xml
<dependency>
<groupId>org.apache.flink</groupId>
<artifactId>flink-connector-wikiedits</artifactId>
<version>1.0-SNAPSHOT</version>
</dependency>
```
You can use the source like regular sources:
```java
StreamExecutionEnvironment env = StreamExecutionEnvironment
.getExecutionEnvironment();
DataStream<WikipediaEditEvent> edits = env
.addSource(new WikipediaEditsSource());
```
You can merge this pull request into a Git repository by running:
$ git pull https://github.com/uce/flink wikiedits
Alternatively you can review and apply these changes as the patch at:
https://github.com/apache/flink/pull/1439.patch
To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:
This closes #1439
----
commit 2c6aa8c874e8e89b12e56af7e8f415b6f4cf49ff
Author: Ufuk Celebi <[email protected]>
Date: 2015-12-06T20:45:00Z
[contrib, connector-wikiedits] Add WikipediaEditsSource
----
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at [email protected] or file a JIRA ticket
with INFRA.
---
