[1/5] incubator-beam git commit: [BEAM-196] provide PipelineOptions in DoFn

2016-06-08 Thread mxm
Repository: incubator-beam Updated Branches: refs/heads/master ffbfc66e1 -> cc448e976 [BEAM-196] provide PipelineOptions in DoFn - fixes NPE when accessing the PipelineOptions - adds a test to verify that the PipelineOptions are available Project:

[4/5] incubator-beam git commit: [BEAM-287] adjust README to changed Maven layout

2016-06-08 Thread mxm
[BEAM-287] adjust README to changed Maven layout Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/1fd0dfc7 Tree: http://git-wip-us.apache.org/repos/asf/incubator-beam/tree/1fd0dfc7 Diff:

[2/5] incubator-beam git commit: [flink] improve lifecycle of ParDoBoundWrapper

2016-06-08 Thread mxm
[flink] improve lifecycle of ParDoBoundWrapper Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/d10ae23c Tree: http://git-wip-us.apache.org/repos/asf/incubator-beam/tree/d10ae23c Diff:

[3/5] incubator-beam git commit: This closes #432

2016-06-08 Thread mxm
This closes #432 Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/f5583cfa Tree: http://git-wip-us.apache.org/repos/asf/incubator-beam/tree/f5583cfa Diff:

[5/5] incubator-beam git commit: This closes #415

2016-06-08 Thread mxm
This closes #415 Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/cc448e97 Tree: http://git-wip-us.apache.org/repos/asf/incubator-beam/tree/cc448e97 Diff:

[GitHub] incubator-beam pull request #432: [BEAM-196] Additional fix to ensure the Pi...

2016-06-08 Thread mxm
GitHub user mxm opened a pull request: https://github.com/apache/incubator-beam/pull/432 [BEAM-196] Additional fix to ensure the PipelineOptions are available in DoFns. Fixes a NullPointException if `PipelineOptions` are acceessed inside a DoFn and backs it up with a test. You

[GitHub] incubator-beam pull request #450: [flink] fix potential NPE in ParDoWrapper

2016-06-13 Thread mxm
GitHub user mxm opened a pull request: https://github.com/apache/incubator-beam/pull/450 [flink] fix potential NPE in ParDoWrapper Just discovered this while checking for correct execution of the bundle life cycle. This fixes potential NPEs in the ParDo translation wrapper

[1/2] incubator-beam git commit: [flink] fix potential NPE in ParDoWrapper

2016-06-13 Thread mxm
Repository: incubator-beam Updated Branches: refs/heads/master 60964b611 -> be05942da [flink] fix potential NPE in ParDoWrapper Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/a2abc6a2 Tree:

[2/2] incubator-beam git commit: This closes #450

2016-06-13 Thread mxm
This closes #450 Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/be05942d Tree: http://git-wip-us.apache.org/repos/asf/incubator-beam/tree/be05942d Diff:

[GitHub] incubator-beam pull request: [Beam-312] don't checkpoint if Checkp...

2016-05-28 Thread mxm
GitHub user mxm opened a pull request: https://github.com/apache/incubator-beam/pull/395 [Beam-312] don't checkpoint if CheckpointCoder not available This skips the checkpoint logic in the UnboundedSourceWrapper if the UnboundedSource doesn't supply a CheckpointMarkCoder. You

[GitHub] incubator-beam pull request: [BEAM-235] use streaming mode on unbo...

2016-05-28 Thread mxm
GitHub user mxm opened a pull request: https://github.com/apache/incubator-beam/pull/394 [BEAM-235] use streaming mode on unbounded sources This change automatically discovers the execution mode of the Pipeline during a preliminary "optimization" translation of th

[1/4] incubator-beam git commit: [Beam-312] don't checkpoint if CheckpointCoder not available

2016-05-30 Thread mxm
Repository: incubator-beam Updated Branches: refs/heads/master cca2577c6 -> 36a27f538 [Beam-312] don't checkpoint if CheckpointCoder not available This skips the checkpoint logic in the UnboundedSourceWrapper if the UnboundedSource doesn't supply a CheckpointMarkCoder. Project:

[2/4] incubator-beam git commit: [BEAM-235] use streaming mode on unbounded sources

2016-05-30 Thread mxm
[BEAM-235] use streaming mode on unbounded sources This change automatically discovers the execution mode of the Pipeline during a preliminary "optimization" translation of the pipeline. When unbounded sources are discovered, the pipeline translation mode is switched to streaming. Users may

[3/4] incubator-beam git commit: This closes #395

2016-05-30 Thread mxm
This closes #395 Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/5d2f9cd2 Tree: http://git-wip-us.apache.org/repos/asf/incubator-beam/tree/5d2f9cd2 Diff:

[4/4] incubator-beam git commit: This closes #394

2016-05-30 Thread mxm
This closes #394 Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/36a27f53 Tree: http://git-wip-us.apache.org/repos/asf/incubator-beam/tree/36a27f53 Diff:

[2/2] incubator-beam git commit: This closes #398

2016-05-31 Thread mxm
This closes #398 Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/2ffecfda Tree: http://git-wip-us.apache.org/repos/asf/incubator-beam/tree/2ffecfda Diff:

[1/3] incubator-beam-site git commit: [BEAM-103] update capability matrix

2016-05-27 Thread mxm
Repository: incubator-beam-site Updated Branches: refs/heads/asf-site 92fc27503 -> 657701378 [BEAM-103] update capability matrix This reflects the changes of BEAM-103 in the Capability Matrix. Project: http://git-wip-us.apache.org/repos/asf/incubator-beam-site/repo Commit:

[3/3] incubator-beam-site git commit: This closes #19

2016-05-27 Thread mxm
This closes #19 Project: http://git-wip-us.apache.org/repos/asf/incubator-beam-site/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam-site/commit/65770137 Tree: http://git-wip-us.apache.org/repos/asf/incubator-beam-site/tree/65770137 Diff:

[2/3] incubator-beam-site git commit: [BEAM-103] rebuild capability matrix

2016-05-27 Thread mxm
[BEAM-103] rebuild capability matrix Project: http://git-wip-us.apache.org/repos/asf/incubator-beam-site/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam-site/commit/15dd578f Tree: http://git-wip-us.apache.org/repos/asf/incubator-beam-site/tree/15dd578f Diff:

incubator-beam git commit: [BEAM-126] remove strict job name check

2016-03-18 Thread mxm
Repository: incubator-beam Updated Branches: refs/heads/master 5b5c0e28f -> 81d5ff5a5 [BEAM-126] remove strict job name check Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/81d5ff5a Tree:

incubator-beam git commit: [BEAM-107] [flink] support multiple Scala versions

2016-03-11 Thread mxm
Repository: incubator-beam Updated Branches: refs/heads/master de91b8014 -> 45309caec [BEAM-107] [flink] support multiple Scala versions - introduces a Maven property to support different Scala major versions Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo Commit:

[06/13] incubator-beam git commit: [flink] restructure and cleanup Maven layout

2016-03-15 Thread mxm
http://git-wip-us.apache.org/repos/asf/incubator-beam/blob/071e4dd6/runners/flink/src/main/java/org/apache/beam/runners/flink/FlinkPipelineExecutionEnvironment.java -- diff --git

[12/13] incubator-beam git commit: [flink] restructure and cleanup Maven layout

2016-03-15 Thread mxm
http://git-wip-us.apache.org/repos/asf/incubator-beam/blob/071e4dd6/runners/flink/pom.xml -- diff --git a/runners/flink/pom.xml b/runners/flink/pom.xml index c8c5d84..31713cd 100644 --- a/runners/flink/pom.xml +++

[04/13] incubator-beam git commit: [flink] restructure and cleanup Maven layout

2016-03-15 Thread mxm
http://git-wip-us.apache.org/repos/asf/incubator-beam/blob/071e4dd6/runners/flink/src/main/java/org/apache/beam/runners/flink/translation/functions/FlinkDoFnFunction.java -- diff --git

[05/13] incubator-beam git commit: [flink] restructure and cleanup Maven layout

2016-03-15 Thread mxm
http://git-wip-us.apache.org/repos/asf/incubator-beam/blob/071e4dd6/runners/flink/src/main/java/org/apache/beam/runners/flink/io/ConsoleIO.java -- diff --git

[09/13] incubator-beam git commit: [flink] restructure and cleanup Maven layout

2016-03-15 Thread mxm
http://git-wip-us.apache.org/repos/asf/incubator-beam/blob/071e4dd6/runners/flink/runner/src/main/java/org/apache/beam/runners/flink/translation/wrappers/streaming/FlinkAbstractParDoWrapper.java -- diff --git

[03/13] incubator-beam git commit: [flink] restructure and cleanup Maven layout

2016-03-15 Thread mxm
http://git-wip-us.apache.org/repos/asf/incubator-beam/blob/071e4dd6/runners/flink/src/main/java/org/apache/beam/runners/flink/translation/wrappers/SourceInputFormat.java -- diff --git

[07/13] incubator-beam git commit: [flink] restructure and cleanup Maven layout

2016-03-15 Thread mxm
http://git-wip-us.apache.org/repos/asf/incubator-beam/blob/071e4dd6/runners/flink/runner/src/test/java/org/apache/beam/runners/flink/WordCountJoin2ITCase.java -- diff --git

[10/13] incubator-beam git commit: [flink] restructure and cleanup Maven layout

2016-03-15 Thread mxm
http://git-wip-us.apache.org/repos/asf/incubator-beam/blob/071e4dd6/runners/flink/runner/src/main/java/org/apache/beam/runners/flink/translation/functions/FlinkMultiOutputDoFnFunction.java -- diff --git

[11/13] incubator-beam git commit: [flink] restructure and cleanup Maven layout

2016-03-15 Thread mxm
http://git-wip-us.apache.org/repos/asf/incubator-beam/blob/071e4dd6/runners/flink/runner/src/main/java/org/apache/beam/runners/flink/translation/FlinkBatchTransformTranslators.java -- diff --git

[1/3] incubator-beam git commit: [flink] improve lifecycle handling of GroupAlsoByWindowWrapper

2016-03-31 Thread mxm
Repository: incubator-beam Updated Branches: refs/heads/master 0c47cad48 -> 96e286fec [flink] improve lifecycle handling of GroupAlsoByWindowWrapper Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo Commit:

[3/3] incubator-beam git commit: This closes #94.

2016-03-31 Thread mxm
This closes #94. Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/96e286fe Tree: http://git-wip-us.apache.org/repos/asf/incubator-beam/tree/96e286fe Diff:

incubator-beam git commit: [flink] fix UnboundedFlinkSource wrapper

2016-03-19 Thread mxm
Repository: incubator-beam Updated Branches: refs/heads/master a9c46057e -> 0f137169e [flink] fix UnboundedFlinkSource wrapper - remove unnecessary PipelineOptions cache - use the correct interface types - improve Kafka example Project:

[GitHub] incubator-beam pull request: [BEAM-116] change runners artifactId ...

2016-03-19 Thread mxm
GitHub user mxm opened a pull request: https://github.com/apache/incubator-beam/pull/59 [BEAM-116] change runners artifactId to runners-parent You can merge this pull request into a Git repository by running: $ git pull https://github.com/mxm/incubator-beam BEAM-116

[06/10] incubator-beam git commit: [BEAM-116] change runners artifactId to runners-parent

2016-03-23 Thread mxm
[BEAM-116] change runners artifactId to runners-parent Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/a20e0b64 Tree: http://git-wip-us.apache.org/repos/asf/incubator-beam/tree/a20e0b64 Diff:

[07/10] incubator-beam git commit: [flink] add test case for Runner registration

2016-03-23 Thread mxm
[flink] add test case for Runner registration Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/cb5d6c2b Tree: http://git-wip-us.apache.org/repos/asf/incubator-beam/tree/cb5d6c2b Diff:

[10/10] incubator-beam git commit: This closes #69

2016-03-23 Thread mxm
This closes #69 Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/2f902582 Tree: http://git-wip-us.apache.org/repos/asf/incubator-beam/tree/2f902582 Diff:

[03/10] incubator-beam git commit: Add DisplayData builder API to SDK

2016-03-23 Thread mxm
Add DisplayData builder API to SDK This allows generating the display data which will be attached to PTransforms. Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/5ecb7aa7 Tree:

[02/10] incubator-beam git commit: Implement InProcessPipelineRunner#run

2016-03-23 Thread mxm
Implement InProcessPipelineRunner#run Appropriately construct an evaluation context and executor, and start the pipeline when run is called. Implement InProcessPipelineResult. Apply PTransform overrides. Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo Commit:

[01/10] incubator-beam git commit: make BigtableIO#Read#withRowFilter public

2016-03-23 Thread mxm
Repository: incubator-beam Updated Branches: refs/heads/master 8d87ee02b -> 2f902582c make BigtableIO#Read#withRowFilter public Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/e39b5d9a Tree:

[05/10] incubator-beam git commit: Update AutoComplete.java

2016-03-23 Thread mxm
Update AutoComplete.java Allow for the Datastore dependency of this test to be in a different project than the main project for the job. Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/834d0710 Tree:

[09/10] incubator-beam git commit: [BEAM-143] [flink] add test for UnboundedSourceWrapper

2016-03-23 Thread mxm
[BEAM-143] [flink] add test for UnboundedSourceWrapper The test ensures serialization and execution of the wrapper works as expected. Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/1504ba7b Tree:

[04/10] incubator-beam git commit: [flink] Add FlinkRunnerRegistrar

2016-03-23 Thread mxm
[flink] Add FlinkRunnerRegistrar Expose Flink runner and options via AuteService. AuteService will at compile time populate META-INF/services so that Dataflow sdk can seamlessly pick up FlinkRunner. This closes #40. Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo Commit:

[GitHub] incubator-beam pull request: [BEAM-149] move language source confi...

2016-03-24 Thread mxm
GitHub user mxm opened a pull request: https://github.com/apache/incubator-beam/pull/73 [BEAM-149] move language source config to pluginManagement This fixes issues with the source/target level in IntelliJ. You can merge this pull request into a Git repository by running

[1/3] incubator-beam git commit: [flink] add test case for Runner registration

2016-03-21 Thread mxm
Repository: incubator-beam Updated Branches: refs/heads/master fcc6f3cfd -> c984f3ae2 [flink] add test case for Runner registration Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/ba7b7a04 Tree:

[2/3] incubator-beam git commit: [flink] Add FlinkRunnerRegistrar

2016-03-21 Thread mxm
[flink] Add FlinkRunnerRegistrar Expose Flink runner and options via AuteService. AuteService will at compile time populate META-INF/services so that Dataflow sdk can seamlessly pick up FlinkRunner. This closes #40. Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo Commit:

[1/2] incubator-beam git commit: [BEAM-116] change runners artifactId to runners-parent

2016-03-20 Thread mxm
Repository: incubator-beam Updated Branches: refs/heads/master f7aaee2ea -> fcc6f3cfd [BEAM-116] change runners artifactId to runners-parent Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/447c8af2 Tree:

[2/2] incubator-beam git commit: [BEAM-116] This closes #59

2016-03-20 Thread mxm
[BEAM-116] This closes #59 Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/fcc6f3cf Tree: http://git-wip-us.apache.org/repos/asf/incubator-beam/tree/fcc6f3cf Diff:

incubator-beam git commit: [flink] improvements to the Kafka Example

2016-03-19 Thread mxm
Repository: incubator-beam Updated Branches: refs/heads/master 0f137169e -> ef1e32dee [flink] improvements to the Kafka Example - use timestamp extractor after ingestion - fix coder runtime exception - correct logging Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo

[07/27] incubator-beam-site git commit: Initial add

2016-03-07 Thread mxm
http://git-wip-us.apache.org/repos/asf/incubator-beam-site/blob/e340562d/_sass/bootstrap/_forms.scss -- diff --git a/_sass/bootstrap/_forms.scss b/_sass/bootstrap/_forms.scss new file mode 100755 index 000..11ba109 ---

[21/27] incubator-beam-site git commit: generate web site in content directory

2016-03-07 Thread mxm
http://git-wip-us.apache.org/repos/asf/incubator-beam-site/blob/1043f953/content/styles/site.css -- diff --git a/content/styles/site.css b/content/styles/site.css new file mode 100644 index 000..667079a --- /dev/null +++

[20/27] incubator-beam-site git commit: generate web site in content directory

2016-03-07 Thread mxm
ogle.com;>k...@google.com + Google + committer, PPMC + -8 + + + + Luke Cwik + + mailto:lc...@google.com;>lc...@google.com + Google + committer, PPMC + -8 + + + +

[11/27] incubator-beam-site git commit: Merge pull request #1 from stefanobaghino/mails-fix

2016-03-07 Thread mxm
Merge pull request #1 from stefanobaghino/mails-fix Mails fix Project: http://git-wip-us.apache.org/repos/asf/incubator-beam-site/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam-site/commit/45126174 Tree:

incubator-beam git commit: [hotfix] correct line length to let Checkstyle pass

2016-03-07 Thread mxm
Repository: incubator-beam Updated Branches: refs/heads/master 22ff05c49 -> 9931638d9 [hotfix] correct line length to let Checkstyle pass Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/9931638d Tree:

[12/27] incubator-beam-site git commit: Fix for timezone

2016-03-07 Thread mxm
Fix for timezone Project: http://git-wip-us.apache.org/repos/asf/incubator-beam-site/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam-site/commit/d0d63fdb Tree: http://git-wip-us.apache.org/repos/asf/incubator-beam-site/tree/d0d63fdb Diff:

[19/27] incubator-beam-site git commit: change output directory to "content"

2016-03-07 Thread mxm
change output directory to "content" - this is required by the Apache infrastructure Project: http://git-wip-us.apache.org/repos/asf/incubator-beam-site/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam-site/commit/0a694ddf Tree:

[14/27] incubator-beam-site git commit: Add apache ID 'kenn' for Kenneth Knowles

2016-03-07 Thread mxm
Add apache ID 'kenn' for Kenneth Knowles Project: http://git-wip-us.apache.org/repos/asf/incubator-beam-site/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam-site/commit/44f06cd1 Tree: http://git-wip-us.apache.org/repos/asf/incubator-beam-site/tree/44f06cd1 Diff:

[10/27] incubator-beam-site git commit: Fix broken mailto

2016-03-07 Thread mxm
Fix broken mailto Project: http://git-wip-us.apache.org/repos/asf/incubator-beam-site/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam-site/commit/82f2de26 Tree: http://git-wip-us.apache.org/repos/asf/incubator-beam-site/tree/82f2de26 Diff:

[16/27] incubator-beam-site git commit: New blog post; changes to logos.

2016-03-07 Thread mxm
New blog post; changes to logos. Project: http://git-wip-us.apache.org/repos/asf/incubator-beam-site/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam-site/commit/8d898e7d Tree: http://git-wip-us.apache.org/repos/asf/incubator-beam-site/tree/8d898e7d Diff:

[13/27] incubator-beam-site git commit: Addition of Twitter and Blog details to index.

2016-03-07 Thread mxm
Addition of Twitter and Blog details to index. Project: http://git-wip-us.apache.org/repos/asf/incubator-beam-site/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam-site/commit/fc73e2af Tree: http://git-wip-us.apache.org/repos/asf/incubator-beam-site/tree/fc73e2af Diff:

[2/2] incubator-beam-site git commit: regenerate website

2016-03-08 Thread mxm
212,8 +212,8 @@ Luke Cwik - lcwik - mailto:lc...@google.com;>lc...@google.com + + lcwik [at] google [dot] com Google committer, PPMC -8 @@ -222,7 +222,7 @@ Maximilian Michels

[3/3] incubator-beam git commit: [docs] update README Runner section

2016-03-08 Thread mxm
[docs] update README Runner section This closes #29. Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/5a817d11 Tree: http://git-wip-us.apache.org/repos/asf/incubator-beam/tree/5a817d11 Diff:

[GitHub] incubator-beam pull request: [BEAM-5] Add Flink Runner

2016-03-02 Thread mxm
GitHub user mxm opened a pull request: https://github.com/apache/incubator-beam/pull/12 [BEAM-5] Add Flink Runner As of [BEAM-5](https://issues.apache.org/jira/browse/BEAM-5) and the previous mailing list discussion, I would like to contribute the Flink Runner to Beam

[GitHub] incubator-beam pull request: [flink] improve lifecycle handling of...

2016-03-30 Thread mxm
GitHub user mxm opened a pull request: https://github.com/apache/incubator-beam/pull/94 [flink] improve lifecycle handling of GroupAlsoByWindowWrapper Could someone have a look if these minor changes are good to merge? @davorbonaci @kennknowles Note, that there are two

[GitHub] incubator-beam pull request: [BEAM-158] add support for bounded so...

2016-03-31 Thread mxm
GitHub user mxm opened a pull request: https://github.com/apache/incubator-beam/pull/104 [BEAM-158] add support for bounded sources in streaming Apart from a few improvements, this PR introduces bounded sources in streaming. The BoundedSource wrapper (`SourceInputFormat

[GitHub] incubator-beam pull request: Add option to use Flink's Kafka Write...

2016-04-29 Thread mxm
GitHub user mxm opened a pull request: https://github.com/apache/incubator-beam/pull/266 Add option to use Flink's Kafka Write IO This pull request adds the counterpart of the UnboundedFlinkSource, the `UnboundedFlinkSink` which uses the `Write` API. Users have requested

[1/4] incubator-beam git commit: add Kafka IO examples

2016-04-29 Thread mxm
Repository: incubator-beam Updated Branches: refs/heads/master 4fd9d74df -> 661a4a893 add Kafka IO examples Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/63bce07d Tree:

[4/4] incubator-beam git commit: This closes #266

2016-04-29 Thread mxm
This closes #266 Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/661a4a89 Tree: http://git-wip-us.apache.org/repos/asf/incubator-beam/tree/661a4a89 Diff:

[2/4] incubator-beam git commit: fix Flink source coder handling

2016-04-29 Thread mxm
fix Flink source coder handling Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/aead96ff Tree: http://git-wip-us.apache.org/repos/asf/incubator-beam/tree/aead96ff Diff:

[3/4] incubator-beam git commit: Flink sink implementation

2016-04-29 Thread mxm
Flink sink implementation Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/bc847a95 Tree: http://git-wip-us.apache.org/repos/asf/incubator-beam/tree/bc847a95 Diff:

[GitHub] incubator-beam pull request: [BEAM-272][flink] remove dependency o...

2016-05-11 Thread mxm
GitHub user mxm opened a pull request: https://github.com/apache/incubator-beam/pull/324 [BEAM-272][flink] remove dependency on Dataflow Runner Be sure to do all of the following to help us incorporate your contribution quickly and easily: - [X] Make sure the PR title

[2/2] incubator-beam git commit: This closes #324

2016-05-12 Thread mxm
This closes #324 Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/123674f4 Tree: http://git-wip-us.apache.org/repos/asf/incubator-beam/tree/123674f4 Diff:

[GitHub] incubator-beam pull request: [flink] replace obsolete reflection c...

2016-05-17 Thread mxm
GitHub user mxm opened a pull request: https://github.com/apache/incubator-beam/pull/344 [flink] replace obsolete reflection call Be sure to do all of the following to help us incorporate your contribution quickly and easily: - [X] Make sure the PR title is formatted

[1/2] incubator-beam git commit: [flink] replace obsolete reflection call

2016-05-17 Thread mxm
Repository: incubator-beam Updated Branches: refs/heads/master d627266d8 -> cc64d654c [flink] replace obsolete reflection call Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/9f630002 Tree:

[2/2] incubator-beam git commit: This closes #344

2016-05-17 Thread mxm
This closes #344 Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/cc64d654 Tree: http://git-wip-us.apache.org/repos/asf/incubator-beam/tree/cc64d654 Diff:

[GitHub] incubator-beam pull request: [BEAM-196] Pipeline options must be a...

2016-04-18 Thread mxm
GitHub user mxm opened a pull request: https://github.com/apache/incubator-beam/pull/200 [BEAM-196] Pipeline options must be available Context in DoFn.startBundle This gets rid of the custom Java serialization code by defaulting to serialization of the `PipelineOptions` to a byte

[2/4] incubator-beam git commit: [flink] improvements to UnboundedSource translation

2016-04-18 Thread mxm
[flink] improvements to UnboundedSource translation Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/7c4f2dc1 Tree: http://git-wip-us.apache.org/repos/asf/incubator-beam/tree/7c4f2dc1 Diff:

[1/2] incubator-beam git commit: [BEAM-207] Flink test flake in ReadSourceStreamingITCase

2016-04-20 Thread mxm
Repository: incubator-beam Updated Branches: refs/heads/master b8951c231 -> d5b1d5135 [BEAM-207] Flink test flake in ReadSourceStreamingITCase Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/dd8bc93e

[GitHub] incubator-beam pull request: [BEAM-207] Flink test flake in ReadSo...

2016-04-19 Thread mxm
GitHub user mxm opened a pull request: https://github.com/apache/incubator-beam/pull/209 [BEAM-207] Flink test flake in ReadSourceStreamingITCase The `configure(..)` life cycle method is only called on the master but not on the worker nodes. This may lead to an incorrect

[3/3] incubator-beam git commit: This closes #200

2016-04-19 Thread mxm
This closes #200 Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/70e6a131 Tree: http://git-wip-us.apache.org/repos/asf/incubator-beam/tree/70e6a131 Diff:

[2/3] incubator-beam git commit: [BEAM-196] abstraction for PipelineOptions serialization

2016-04-19 Thread mxm
[BEAM-196] abstraction for PipelineOptions serialization Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/81577b31 Tree: http://git-wip-us.apache.org/repos/asf/incubator-beam/tree/81577b31 Diff:

[3/4] incubator-beam git commit: [flink] improve InputFormat wrapper and ReadSourceITCase

2016-04-18 Thread mxm
[flink] improve InputFormat wrapper and ReadSourceITCase Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/6eac35e8 Tree: http://git-wip-us.apache.org/repos/asf/incubator-beam/tree/6eac35e8 Diff:

[GitHub] incubator-beam pull request #724: [flink] improve example section in README

2016-07-25 Thread mxm
GitHub user mxm opened a pull request: https://github.com/apache/incubator-beam/pull/724 [flink] improve example section in README - updates the README - repairs broken exec configuration You can merge this pull request into a Git repository by running: $ git pull https

[1/2] incubator-beam git commit: [flink] improve example section in README

2016-07-26 Thread mxm
Repository: incubator-beam Updated Branches: refs/heads/master 267136fb6 -> d02d2de09 [flink] improve example section in README - updates the README - repairs broken exec configuration Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo Commit:

[2/2] incubator-beam git commit: This closes #724

2016-07-26 Thread mxm
This closes #724 Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/d02d2de0 Tree: http://git-wip-us.apache.org/repos/asf/incubator-beam/tree/d02d2de0 Diff:

[GitHub] incubator-beam pull request #821: [flink] add missing maven config to exampl...

2016-08-12 Thread mxm
GitHub user mxm opened a pull request: https://github.com/apache/incubator-beam/pull/821 [flink] add missing maven config to example pom You can merge this pull request into a Git repository by running: $ git pull https://github.com/mxm/incubator-beam fix Alternatively you

[GitHub] incubator-beam-site pull request #39: [BEAM-102] update capability matrix

2016-09-05 Thread mxm
GitHub user mxm opened a pull request: https://github.com/apache/incubator-beam-site/pull/39 [BEAM-102] update capability matrix This updates the matrix to the most recent development status. CC @aljoscha You can merge this pull request into a Git repository by running

[GitHub] incubator-beam pull request #924: [BEAM-333][flink] make unbounded sources s...

2016-09-06 Thread mxm
GitHub user mxm opened a pull request: https://github.com/apache/incubator-beam/pull/924 [BEAM-333][flink] make unbounded sources stoppable You can merge this pull request into a Git repository by running: $ git pull https://github.com/mxm/incubator-beam BEAM-333

[GitHub] incubator-beam pull request #923: [BEAM-617][flink] introduce option to set ...

2016-09-06 Thread mxm
GitHub user mxm opened a pull request: https://github.com/apache/incubator-beam/pull/923 [BEAM-617][flink] introduce option to set state backend CC @aljoscha You can merge this pull request into a Git repository by running: $ git pull https://github.com/mxm/incubator-beam

[GitHub] incubator-beam pull request #928: [flink] use exploded WindowValue in FlinkD...

2016-09-07 Thread mxm
GitHub user mxm opened a pull request: https://github.com/apache/incubator-beam/pull/928 [flink] use exploded WindowValue in FlinkDoFnFunction CC @aljoscha You can merge this pull request into a Git repository by running: $ git pull https://github.com/mxm/incubator-beam fix

[1/3] incubator-beam-site git commit: [BEAM-102] update capability matrix

2016-09-08 Thread mxm
Repository: incubator-beam-site Updated Branches: refs/heads/asf-site e2430eb4d -> dcdd8b742 [BEAM-102] update capability matrix Project: http://git-wip-us.apache.org/repos/asf/incubator-beam-site/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam-site/commit/8459da13 Tree:

[3/3] incubator-beam-site git commit: This closes #39

2016-09-08 Thread mxm
This closes #39 Project: http://git-wip-us.apache.org/repos/asf/incubator-beam-site/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam-site/commit/dcdd8b74 Tree: http://git-wip-us.apache.org/repos/asf/incubator-beam-site/tree/dcdd8b74 Diff:

[GitHub] incubator-beam pull request #929: [flink] initialize watermarkTimeQueue with...

2016-09-07 Thread mxm
GitHub user mxm opened a pull request: https://github.com/apache/incubator-beam/pull/929 [flink] initialize watermarkTimeQueue with Comparator This mitigates a ClassCastException with Comparable. CC @aljoscha You can merge this pull request into a Git repository

[1/2] incubator-beam git commit: [flink] initialize watermarkTimeQueue with Comparator

2016-09-09 Thread mxm
Repository: incubator-beam Updated Branches: refs/heads/master b6205ffa3 -> e9326c8b1 [flink] initialize watermarkTimeQueue with Comparator Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/de6ec823 Tree:

[2/2] incubator-beam git commit: This closes #929

2016-09-09 Thread mxm
This closes #929 Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/e9326c8b Tree: http://git-wip-us.apache.org/repos/asf/incubator-beam/tree/e9326c8b Diff:

[4/5] incubator-beam git commit: [BEAM-619] extend test case to be parameterized

2016-09-09 Thread mxm
[BEAM-619] extend test case to be parameterized - extend test case with number of tasks and splits parameters Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/4afd25a7 Tree:

[3/5] incubator-beam git commit: This closes #924

2016-09-09 Thread mxm
This closes #924 Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/c78db9ad Tree: http://git-wip-us.apache.org/repos/asf/incubator-beam/tree/c78db9ad Diff:

[1/5] incubator-beam git commit: [BEAM-619] keep track of local split sources in UnboundedSourceWrapper

2016-09-09 Thread mxm
Repository: incubator-beam Updated Branches: refs/heads/master a96ea98a4 -> b6205ffa3 [BEAM-619] keep track of local split sources in UnboundedSourceWrapper Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo Commit:

[5/5] incubator-beam git commit: This closes #927

2016-09-09 Thread mxm
This closes #927 Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/b6205ffa Tree: http://git-wip-us.apache.org/repos/asf/incubator-beam/tree/b6205ffa Diff:

[2/5] incubator-beam git commit: [BEAM-333][flink] make bounded/unbounded sources stoppable

2016-09-09 Thread mxm
[BEAM-333][flink] make bounded/unbounded sources stoppable Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/7e2820b0 Tree: http://git-wip-us.apache.org/repos/asf/incubator-beam/tree/7e2820b0 Diff:

  1   2   >