[GitHub] incubator-beam pull request #1283: [BEAM-896] adjust ReadSourceITCase to exc...

2016-11-04 Thread mxm
Github user mxm closed the pull request at: https://github.com/apache/incubator-beam/pull/1283 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature

[GitHub] incubator-beam pull request #1283: [BEAM-896] adjust ReadSourceITCase to exc...

2016-11-04 Thread mxm
GitHub user mxm opened a pull request: https://github.com/apache/incubator-beam/pull/1283 [BEAM-896] adjust ReadSourceITCase to exclude Beam temporary files This should fix the test failures in `ReadSourceITCase` caused by #1050. @dhalperi Wouldn't it be nice to have

[2/2] incubator-beam git commit: This closes #1093

2016-10-18 Thread mxm
This closes #1093 Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/6b5ff4c4 Tree: http://git-wip-us.apache.org/repos/asf/incubator-beam/tree/6b5ff4c4 Diff:

[1/2] incubator-beam git commit: [BEAM-593] avoid throwing Exception in waitUntilFinish

2016-10-18 Thread mxm
Repository: incubator-beam Updated Branches: refs/heads/master a2c342cfd -> 6b5ff4c4a [BEAM-593] avoid throwing Exception in waitUntilFinish The current implementation of Flink's PipelineResult assumes that the pipeline has already been processed. Hence, we can return State.Done when

[GitHub] incubator-beam pull request #1093: [BEAM-593] avoid throwing Exception in wa...

2016-10-13 Thread mxm
GitHub user mxm opened a pull request: https://github.com/apache/incubator-beam/pull/1093 [BEAM-593] avoid throwing Exception in waitUntilFinish The current implementation of Flink's `PipelineResult` assumes that the pipeline has already been processed. Hence, we can return

[1/2] incubator-beam git commit: Fix inconsistent in formatting logs: leaveCompositeTransform always decrement depth, but enterCompositeTransform increment depth only on ENTER_TRANSFORM

2016-10-13 Thread mxm
Repository: incubator-beam Updated Branches: refs/heads/master 13b45895e -> 73226168a Fix inconsistent in formatting logs: leaveCompositeTransform always decrement depth, but enterCompositeTransform increment depth only on ENTER_TRANSFORM Project:

[2/2] incubator-beam git commit: This closes #908

2016-10-13 Thread mxm
This closes #908 Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/73226168 Tree: http://git-wip-us.apache.org/repos/asf/incubator-beam/tree/73226168 Diff:

[2/2] incubator-beam git commit: This closes #1021

2016-09-28 Thread mxm
This closes #1021 Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/a1ac Tree: http://git-wip-us.apache.org/repos/asf/incubator-beam/tree/a1ac Diff:

[1/2] incubator-beam git commit: [BEAM-615] Add Support for Processing-Time Timers in FlinkRunner Window Operator

2016-09-28 Thread mxm
Repository: incubator-beam Updated Branches: refs/heads/master b5853a624 -> a1acd [BEAM-615] Add Support for Processing-Time Timers in FlinkRunner Window Operator Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo Commit:

[3/3] incubator-beam git commit: This closes #967

2016-09-28 Thread mxm
This closes #967 Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/3879db03 Tree: http://git-wip-us.apache.org/repos/asf/incubator-beam/tree/3879db03 Diff:

[2/3] incubator-beam git commit: fix potential NPE in checkpointing of UnboundedSourceWrapper

2016-09-28 Thread mxm
fix potential NPE in checkpointing of UnboundedSourceWrapper This moves all the initialization code to the open() method which ensures that no snapshot can occur before the state has been initialized correctly. Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo Commit:

[1/3] incubator-beam git commit: [BEAM-283] finalize CheckpointMarks upon completed checkpoint

2016-09-28 Thread mxm
Repository: incubator-beam Updated Branches: refs/heads/master db47c63ab -> 3879db036 [BEAM-283] finalize CheckpointMarks upon completed checkpoint Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo Commit:

[1/2] incubator-beam git commit: [BEAM-642] Support Flink Detached Mode for JOB execution

2016-09-22 Thread mxm
Repository: incubator-beam Updated Branches: refs/heads/master f62d04e22 -> 843275210 [BEAM-642] Support Flink Detached Mode for JOB execution Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/dc69bc48

[GitHub] incubator-beam pull request #967: [BEAM-283] finalize CheckpointMarks upon c...

2016-09-16 Thread mxm
GitHub user mxm opened a pull request: https://github.com/apache/incubator-beam/pull/967 [BEAM-283] finalize CheckpointMarks upon completed checkpoint See the first commit for an addition to the `UnboundedSourceWrapper` to call `finalizeCheckpoint()` on `CheckpointMark`s upon

[2/2] incubator-beam git commit: This closes #929

2016-09-09 Thread mxm
This closes #929 Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/e9326c8b Tree: http://git-wip-us.apache.org/repos/asf/incubator-beam/tree/e9326c8b Diff:

[1/2] incubator-beam git commit: [flink] initialize watermarkTimeQueue with Comparator

2016-09-09 Thread mxm
Repository: incubator-beam Updated Branches: refs/heads/master b6205ffa3 -> e9326c8b1 [flink] initialize watermarkTimeQueue with Comparator Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/de6ec823 Tree:

[2/5] incubator-beam git commit: [BEAM-333][flink] make bounded/unbounded sources stoppable

2016-09-09 Thread mxm
[BEAM-333][flink] make bounded/unbounded sources stoppable Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/7e2820b0 Tree: http://git-wip-us.apache.org/repos/asf/incubator-beam/tree/7e2820b0 Diff:

[1/5] incubator-beam git commit: [BEAM-619] keep track of local split sources in UnboundedSourceWrapper

2016-09-09 Thread mxm
Repository: incubator-beam Updated Branches: refs/heads/master a96ea98a4 -> b6205ffa3 [BEAM-619] keep track of local split sources in UnboundedSourceWrapper Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo Commit:

[5/5] incubator-beam git commit: This closes #927

2016-09-09 Thread mxm
This closes #927 Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/b6205ffa Tree: http://git-wip-us.apache.org/repos/asf/incubator-beam/tree/b6205ffa Diff:

[4/5] incubator-beam git commit: [BEAM-619] extend test case to be parameterized

2016-09-09 Thread mxm
[BEAM-619] extend test case to be parameterized - extend test case with number of tasks and splits parameters Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/4afd25a7 Tree:

[3/5] incubator-beam git commit: This closes #924

2016-09-09 Thread mxm
This closes #924 Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/c78db9ad Tree: http://git-wip-us.apache.org/repos/asf/incubator-beam/tree/c78db9ad Diff:

[2/4] incubator-beam git commit: [BEAM-617][flink] introduce option to set state backend

2016-09-09 Thread mxm
[BEAM-617][flink] introduce option to set state backend Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/d4f85912 Tree: http://git-wip-us.apache.org/repos/asf/incubator-beam/tree/d4f85912 Diff:

[1/4] incubator-beam git commit: [flink] use exploded WindowValue in FlinkDoFnFunction

2016-09-09 Thread mxm
Repository: incubator-beam Updated Branches: refs/heads/master 817515fe4 -> a96ea98a4 [flink] use exploded WindowValue in FlinkDoFnFunction Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/3461ce21 Tree:

[3/4] incubator-beam git commit: This closes #923

2016-09-09 Thread mxm
This closes #923 Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/0399dbc7 Tree: http://git-wip-us.apache.org/repos/asf/incubator-beam/tree/0399dbc7 Diff:

[4/4] incubator-beam git commit: This closes #928

2016-09-09 Thread mxm
This closes #928 Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/a96ea98a Tree: http://git-wip-us.apache.org/repos/asf/incubator-beam/tree/a96ea98a Diff:

[1/3] incubator-beam-site git commit: [BEAM-102] update capability matrix

2016-09-08 Thread mxm
Repository: incubator-beam-site Updated Branches: refs/heads/asf-site e2430eb4d -> dcdd8b742 [BEAM-102] update capability matrix Project: http://git-wip-us.apache.org/repos/asf/incubator-beam-site/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam-site/commit/8459da13 Tree:

[3/3] incubator-beam-site git commit: This closes #39

2016-09-08 Thread mxm
This closes #39 Project: http://git-wip-us.apache.org/repos/asf/incubator-beam-site/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam-site/commit/dcdd8b74 Tree: http://git-wip-us.apache.org/repos/asf/incubator-beam-site/tree/dcdd8b74 Diff:

[GitHub] incubator-beam pull request #929: [flink] initialize watermarkTimeQueue with...

2016-09-07 Thread mxm
GitHub user mxm opened a pull request: https://github.com/apache/incubator-beam/pull/929 [flink] initialize watermarkTimeQueue with Comparator This mitigates a ClassCastException with Comparable. CC @aljoscha You can merge this pull request into a Git repository

[GitHub] incubator-beam pull request #928: [flink] use exploded WindowValue in FlinkD...

2016-09-07 Thread mxm
GitHub user mxm opened a pull request: https://github.com/apache/incubator-beam/pull/928 [flink] use exploded WindowValue in FlinkDoFnFunction CC @aljoscha You can merge this pull request into a Git repository by running: $ git pull https://github.com/mxm/incubator-beam fix

[GitHub] incubator-beam pull request #924: [BEAM-333][flink] make unbounded sources s...

2016-09-06 Thread mxm
GitHub user mxm opened a pull request: https://github.com/apache/incubator-beam/pull/924 [BEAM-333][flink] make unbounded sources stoppable You can merge this pull request into a Git repository by running: $ git pull https://github.com/mxm/incubator-beam BEAM-333

[GitHub] incubator-beam pull request #923: [BEAM-617][flink] introduce option to set ...

2016-09-06 Thread mxm
GitHub user mxm opened a pull request: https://github.com/apache/incubator-beam/pull/923 [BEAM-617][flink] introduce option to set state backend CC @aljoscha You can merge this pull request into a Git repository by running: $ git pull https://github.com/mxm/incubator-beam

[GitHub] incubator-beam-site pull request #39: [BEAM-102] update capability matrix

2016-09-05 Thread mxm
GitHub user mxm opened a pull request: https://github.com/apache/incubator-beam-site/pull/39 [BEAM-102] update capability matrix This updates the matrix to the most recent development status. CC @aljoscha You can merge this pull request into a Git repository by running

[GitHub] incubator-beam pull request #821: [flink] add missing maven config to exampl...

2016-08-12 Thread mxm
GitHub user mxm opened a pull request: https://github.com/apache/incubator-beam/pull/821 [flink] add missing maven config to example pom You can merge this pull request into a Git repository by running: $ git pull https://github.com/mxm/incubator-beam fix Alternatively you

[1/2] incubator-beam git commit: [flink] improve example section in README

2016-07-26 Thread mxm
Repository: incubator-beam Updated Branches: refs/heads/master 267136fb6 -> d02d2de09 [flink] improve example section in README - updates the README - repairs broken exec configuration Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo Commit:

[2/2] incubator-beam git commit: This closes #724

2016-07-26 Thread mxm
This closes #724 Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/d02d2de0 Tree: http://git-wip-us.apache.org/repos/asf/incubator-beam/tree/d02d2de0 Diff:

[GitHub] incubator-beam pull request #724: [flink] improve example section in README

2016-07-25 Thread mxm
GitHub user mxm opened a pull request: https://github.com/apache/incubator-beam/pull/724 [flink] improve example section in README - updates the README - repairs broken exec configuration You can merge this pull request into a Git repository by running: $ git pull https

[2/2] incubator-beam git commit: This closes #450

2016-06-13 Thread mxm
This closes #450 Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/be05942d Tree: http://git-wip-us.apache.org/repos/asf/incubator-beam/tree/be05942d Diff:

[1/2] incubator-beam git commit: [flink] fix potential NPE in ParDoWrapper

2016-06-13 Thread mxm
Repository: incubator-beam Updated Branches: refs/heads/master 60964b611 -> be05942da [flink] fix potential NPE in ParDoWrapper Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/a2abc6a2 Tree:

[GitHub] incubator-beam pull request #450: [flink] fix potential NPE in ParDoWrapper

2016-06-13 Thread mxm
GitHub user mxm opened a pull request: https://github.com/apache/incubator-beam/pull/450 [flink] fix potential NPE in ParDoWrapper Just discovered this while checking for correct execution of the bundle life cycle. This fixes potential NPEs in the ParDo translation wrapper

[1/5] incubator-beam git commit: [BEAM-196] provide PipelineOptions in DoFn

2016-06-08 Thread mxm
Repository: incubator-beam Updated Branches: refs/heads/master ffbfc66e1 -> cc448e976 [BEAM-196] provide PipelineOptions in DoFn - fixes NPE when accessing the PipelineOptions - adds a test to verify that the PipelineOptions are available Project:

[4/5] incubator-beam git commit: [BEAM-287] adjust README to changed Maven layout

2016-06-08 Thread mxm
[BEAM-287] adjust README to changed Maven layout Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/1fd0dfc7 Tree: http://git-wip-us.apache.org/repos/asf/incubator-beam/tree/1fd0dfc7 Diff:

[2/5] incubator-beam git commit: [flink] improve lifecycle of ParDoBoundWrapper

2016-06-08 Thread mxm
[flink] improve lifecycle of ParDoBoundWrapper Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/d10ae23c Tree: http://git-wip-us.apache.org/repos/asf/incubator-beam/tree/d10ae23c Diff:

[5/5] incubator-beam git commit: This closes #415

2016-06-08 Thread mxm
This closes #415 Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/cc448e97 Tree: http://git-wip-us.apache.org/repos/asf/incubator-beam/tree/cc448e97 Diff:

[3/5] incubator-beam git commit: This closes #432

2016-06-08 Thread mxm
This closes #432 Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/f5583cfa Tree: http://git-wip-us.apache.org/repos/asf/incubator-beam/tree/f5583cfa Diff:

[GitHub] incubator-beam pull request #432: [BEAM-196] Additional fix to ensure the Pi...

2016-06-08 Thread mxm
GitHub user mxm opened a pull request: https://github.com/apache/incubator-beam/pull/432 [BEAM-196] Additional fix to ensure the PipelineOptions are available in DoFns. Fixes a NullPointException if `PipelineOptions` are acceessed inside a DoFn and backs it up with a test. You

[2/2] incubator-beam git commit: This closes #398

2016-05-31 Thread mxm
This closes #398 Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/2ffecfda Tree: http://git-wip-us.apache.org/repos/asf/incubator-beam/tree/2ffecfda Diff:

[2/4] incubator-beam git commit: [BEAM-235] use streaming mode on unbounded sources

2016-05-30 Thread mxm
[BEAM-235] use streaming mode on unbounded sources This change automatically discovers the execution mode of the Pipeline during a preliminary "optimization" translation of the pipeline. When unbounded sources are discovered, the pipeline translation mode is switched to streaming. Users may

[1/4] incubator-beam git commit: [Beam-312] don't checkpoint if CheckpointCoder not available

2016-05-30 Thread mxm
Repository: incubator-beam Updated Branches: refs/heads/master cca2577c6 -> 36a27f538 [Beam-312] don't checkpoint if CheckpointCoder not available This skips the checkpoint logic in the UnboundedSourceWrapper if the UnboundedSource doesn't supply a CheckpointMarkCoder. Project:

[3/4] incubator-beam git commit: This closes #395

2016-05-30 Thread mxm
This closes #395 Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/5d2f9cd2 Tree: http://git-wip-us.apache.org/repos/asf/incubator-beam/tree/5d2f9cd2 Diff:

[4/4] incubator-beam git commit: This closes #394

2016-05-30 Thread mxm
This closes #394 Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/36a27f53 Tree: http://git-wip-us.apache.org/repos/asf/incubator-beam/tree/36a27f53 Diff:

[GitHub] incubator-beam pull request: [Beam-312] don't checkpoint if Checkp...

2016-05-28 Thread mxm
GitHub user mxm opened a pull request: https://github.com/apache/incubator-beam/pull/395 [Beam-312] don't checkpoint if CheckpointCoder not available This skips the checkpoint logic in the UnboundedSourceWrapper if the UnboundedSource doesn't supply a CheckpointMarkCoder. You

[GitHub] incubator-beam pull request: [BEAM-235] use streaming mode on unbo...

2016-05-28 Thread mxm
GitHub user mxm opened a pull request: https://github.com/apache/incubator-beam/pull/394 [BEAM-235] use streaming mode on unbounded sources This change automatically discovers the execution mode of the Pipeline during a preliminary "optimization" translation of th

[2/3] incubator-beam-site git commit: [BEAM-103] rebuild capability matrix

2016-05-27 Thread mxm
[BEAM-103] rebuild capability matrix Project: http://git-wip-us.apache.org/repos/asf/incubator-beam-site/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam-site/commit/15dd578f Tree: http://git-wip-us.apache.org/repos/asf/incubator-beam-site/tree/15dd578f Diff:

[3/3] incubator-beam-site git commit: This closes #19

2016-05-27 Thread mxm
This closes #19 Project: http://git-wip-us.apache.org/repos/asf/incubator-beam-site/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam-site/commit/65770137 Tree: http://git-wip-us.apache.org/repos/asf/incubator-beam-site/tree/65770137 Diff:

[1/3] incubator-beam-site git commit: [BEAM-103] update capability matrix

2016-05-27 Thread mxm
Repository: incubator-beam-site Updated Branches: refs/heads/asf-site 92fc27503 -> 657701378 [BEAM-103] update capability matrix This reflects the changes of BEAM-103 in the Capability Matrix. Project: http://git-wip-us.apache.org/repos/asf/incubator-beam-site/repo Commit:

[2/2] incubator-beam git commit: This closes #344

2016-05-17 Thread mxm
This closes #344 Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/cc64d654 Tree: http://git-wip-us.apache.org/repos/asf/incubator-beam/tree/cc64d654 Diff:

[1/2] incubator-beam git commit: [flink] replace obsolete reflection call

2016-05-17 Thread mxm
Repository: incubator-beam Updated Branches: refs/heads/master d627266d8 -> cc64d654c [flink] replace obsolete reflection call Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/9f630002 Tree:

[GitHub] incubator-beam pull request: [flink] replace obsolete reflection c...

2016-05-17 Thread mxm
GitHub user mxm opened a pull request: https://github.com/apache/incubator-beam/pull/344 [flink] replace obsolete reflection call Be sure to do all of the following to help us incorporate your contribution quickly and easily: - [X] Make sure the PR title is formatted

[2/2] incubator-beam git commit: This closes #324

2016-05-12 Thread mxm
This closes #324 Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/123674f4 Tree: http://git-wip-us.apache.org/repos/asf/incubator-beam/tree/123674f4 Diff:

[GitHub] incubator-beam pull request: [BEAM-272][flink] remove dependency o...

2016-05-11 Thread mxm
GitHub user mxm opened a pull request: https://github.com/apache/incubator-beam/pull/324 [BEAM-272][flink] remove dependency on Dataflow Runner Be sure to do all of the following to help us incorporate your contribution quickly and easily: - [X] Make sure the PR title

[2/4] incubator-beam git commit: fix Flink source coder handling

2016-04-29 Thread mxm
fix Flink source coder handling Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/aead96ff Tree: http://git-wip-us.apache.org/repos/asf/incubator-beam/tree/aead96ff Diff:

[3/4] incubator-beam git commit: Flink sink implementation

2016-04-29 Thread mxm
Flink sink implementation Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/bc847a95 Tree: http://git-wip-us.apache.org/repos/asf/incubator-beam/tree/bc847a95 Diff:

[4/4] incubator-beam git commit: This closes #266

2016-04-29 Thread mxm
This closes #266 Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/661a4a89 Tree: http://git-wip-us.apache.org/repos/asf/incubator-beam/tree/661a4a89 Diff:

[1/4] incubator-beam git commit: add Kafka IO examples

2016-04-29 Thread mxm
Repository: incubator-beam Updated Branches: refs/heads/master 4fd9d74df -> 661a4a893 add Kafka IO examples Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/63bce07d Tree:

[GitHub] incubator-beam pull request: Add option to use Flink's Kafka Write...

2016-04-29 Thread mxm
GitHub user mxm opened a pull request: https://github.com/apache/incubator-beam/pull/266 Add option to use Flink's Kafka Write IO This pull request adds the counterpart of the UnboundedFlinkSource, the `UnboundedFlinkSink` which uses the `Write` API. Users have requested

[1/2] incubator-beam git commit: [BEAM-207] Flink test flake in ReadSourceStreamingITCase

2016-04-20 Thread mxm
Repository: incubator-beam Updated Branches: refs/heads/master b8951c231 -> d5b1d5135 [BEAM-207] Flink test flake in ReadSourceStreamingITCase Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/dd8bc93e

[GitHub] incubator-beam pull request: [BEAM-207] Flink test flake in ReadSo...

2016-04-19 Thread mxm
GitHub user mxm opened a pull request: https://github.com/apache/incubator-beam/pull/209 [BEAM-207] Flink test flake in ReadSourceStreamingITCase The `configure(..)` life cycle method is only called on the master but not on the worker nodes. This may lead to an incorrect

[2/3] incubator-beam git commit: [BEAM-196] abstraction for PipelineOptions serialization

2016-04-19 Thread mxm
[BEAM-196] abstraction for PipelineOptions serialization Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/81577b31 Tree: http://git-wip-us.apache.org/repos/asf/incubator-beam/tree/81577b31 Diff:

[3/3] incubator-beam git commit: This closes #200

2016-04-19 Thread mxm
This closes #200 Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/70e6a131 Tree: http://git-wip-us.apache.org/repos/asf/incubator-beam/tree/70e6a131 Diff:

[GitHub] incubator-beam pull request: [BEAM-196] Pipeline options must be a...

2016-04-18 Thread mxm
GitHub user mxm opened a pull request: https://github.com/apache/incubator-beam/pull/200 [BEAM-196] Pipeline options must be available Context in DoFn.startBundle This gets rid of the custom Java serialization code by defaulting to serialization of the `PipelineOptions` to a byte

[3/4] incubator-beam git commit: [flink] improve InputFormat wrapper and ReadSourceITCase

2016-04-18 Thread mxm
[flink] improve InputFormat wrapper and ReadSourceITCase Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/6eac35e8 Tree: http://git-wip-us.apache.org/repos/asf/incubator-beam/tree/6eac35e8 Diff:

[2/4] incubator-beam git commit: [flink] improvements to UnboundedSource translation

2016-04-18 Thread mxm
[flink] improvements to UnboundedSource translation Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/7c4f2dc1 Tree: http://git-wip-us.apache.org/repos/asf/incubator-beam/tree/7c4f2dc1 Diff:

[GitHub] incubator-beam pull request: [BEAM-158] add support for bounded so...

2016-03-31 Thread mxm
GitHub user mxm opened a pull request: https://github.com/apache/incubator-beam/pull/104 [BEAM-158] add support for bounded sources in streaming Apart from a few improvements, this PR introduces bounded sources in streaming. The BoundedSource wrapper (`SourceInputFormat

[3/3] incubator-beam git commit: This closes #94.

2016-03-31 Thread mxm
This closes #94. Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/96e286fe Tree: http://git-wip-us.apache.org/repos/asf/incubator-beam/tree/96e286fe Diff:

[1/3] incubator-beam git commit: [flink] improve lifecycle handling of GroupAlsoByWindowWrapper

2016-03-31 Thread mxm
Repository: incubator-beam Updated Branches: refs/heads/master 0c47cad48 -> 96e286fec [flink] improve lifecycle handling of GroupAlsoByWindowWrapper Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo Commit:

[GitHub] incubator-beam pull request: [flink] improve lifecycle handling of...

2016-03-30 Thread mxm
GitHub user mxm opened a pull request: https://github.com/apache/incubator-beam/pull/94 [flink] improve lifecycle handling of GroupAlsoByWindowWrapper Could someone have a look if these minor changes are good to merge? @davorbonaci @kennknowles Note, that there are two

[GitHub] incubator-beam pull request: [BEAM-149] move language source confi...

2016-03-24 Thread mxm
GitHub user mxm opened a pull request: https://github.com/apache/incubator-beam/pull/73 [BEAM-149] move language source config to pluginManagement This fixes issues with the source/target level in IntelliJ. You can merge this pull request into a Git repository by running

[05/10] incubator-beam git commit: Update AutoComplete.java

2016-03-23 Thread mxm
Update AutoComplete.java Allow for the Datastore dependency of this test to be in a different project than the main project for the job. Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/834d0710 Tree:

[10/10] incubator-beam git commit: This closes #69

2016-03-23 Thread mxm
This closes #69 Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/2f902582 Tree: http://git-wip-us.apache.org/repos/asf/incubator-beam/tree/2f902582 Diff:

[03/10] incubator-beam git commit: Add DisplayData builder API to SDK

2016-03-23 Thread mxm
Add DisplayData builder API to SDK This allows generating the display data which will be attached to PTransforms. Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/5ecb7aa7 Tree:

[02/10] incubator-beam git commit: Implement InProcessPipelineRunner#run

2016-03-23 Thread mxm
Implement InProcessPipelineRunner#run Appropriately construct an evaluation context and executor, and start the pipeline when run is called. Implement InProcessPipelineResult. Apply PTransform overrides. Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo Commit:

[01/10] incubator-beam git commit: make BigtableIO#Read#withRowFilter public

2016-03-23 Thread mxm
Repository: incubator-beam Updated Branches: refs/heads/master 8d87ee02b -> 2f902582c make BigtableIO#Read#withRowFilter public Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/e39b5d9a Tree:

[09/10] incubator-beam git commit: [BEAM-143] [flink] add test for UnboundedSourceWrapper

2016-03-23 Thread mxm
[BEAM-143] [flink] add test for UnboundedSourceWrapper The test ensures serialization and execution of the wrapper works as expected. Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/1504ba7b Tree:

[04/10] incubator-beam git commit: [flink] Add FlinkRunnerRegistrar

2016-03-23 Thread mxm
[flink] Add FlinkRunnerRegistrar Expose Flink runner and options via AuteService. AuteService will at compile time populate META-INF/services so that Dataflow sdk can seamlessly pick up FlinkRunner. This closes #40. Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo Commit:

[06/10] incubator-beam git commit: [BEAM-116] change runners artifactId to runners-parent

2016-03-23 Thread mxm
[BEAM-116] change runners artifactId to runners-parent Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/a20e0b64 Tree: http://git-wip-us.apache.org/repos/asf/incubator-beam/tree/a20e0b64 Diff:

[07/10] incubator-beam git commit: [flink] add test case for Runner registration

2016-03-23 Thread mxm
[flink] add test case for Runner registration Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/cb5d6c2b Tree: http://git-wip-us.apache.org/repos/asf/incubator-beam/tree/cb5d6c2b Diff:

[2/3] incubator-beam git commit: [flink] Add FlinkRunnerRegistrar

2016-03-21 Thread mxm
[flink] Add FlinkRunnerRegistrar Expose Flink runner and options via AuteService. AuteService will at compile time populate META-INF/services so that Dataflow sdk can seamlessly pick up FlinkRunner. This closes #40. Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo Commit:

[1/3] incubator-beam git commit: [flink] add test case for Runner registration

2016-03-21 Thread mxm
Repository: incubator-beam Updated Branches: refs/heads/master fcc6f3cfd -> c984f3ae2 [flink] add test case for Runner registration Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/ba7b7a04 Tree:

[1/2] incubator-beam git commit: [BEAM-116] change runners artifactId to runners-parent

2016-03-20 Thread mxm
Repository: incubator-beam Updated Branches: refs/heads/master f7aaee2ea -> fcc6f3cfd [BEAM-116] change runners artifactId to runners-parent Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/447c8af2 Tree:

[2/2] incubator-beam git commit: [BEAM-116] This closes #59

2016-03-20 Thread mxm
[BEAM-116] This closes #59 Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/fcc6f3cf Tree: http://git-wip-us.apache.org/repos/asf/incubator-beam/tree/fcc6f3cf Diff:

[GitHub] incubator-beam pull request: [BEAM-116] change runners artifactId ...

2016-03-19 Thread mxm
GitHub user mxm opened a pull request: https://github.com/apache/incubator-beam/pull/59 [BEAM-116] change runners artifactId to runners-parent You can merge this pull request into a Git repository by running: $ git pull https://github.com/mxm/incubator-beam BEAM-116

incubator-beam git commit: [flink] improvements to the Kafka Example

2016-03-19 Thread mxm
Repository: incubator-beam Updated Branches: refs/heads/master 0f137169e -> ef1e32dee [flink] improvements to the Kafka Example - use timestamp extractor after ingestion - fix coder runtime exception - correct logging Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo

incubator-beam git commit: [flink] fix UnboundedFlinkSource wrapper

2016-03-19 Thread mxm
Repository: incubator-beam Updated Branches: refs/heads/master a9c46057e -> 0f137169e [flink] fix UnboundedFlinkSource wrapper - remove unnecessary PipelineOptions cache - use the correct interface types - improve Kafka example Project:

incubator-beam git commit: [BEAM-126] remove strict job name check

2016-03-18 Thread mxm
Repository: incubator-beam Updated Branches: refs/heads/master 5b5c0e28f -> 81d5ff5a5 [BEAM-126] remove strict job name check Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/81d5ff5a Tree:

[09/13] incubator-beam git commit: [flink] restructure and cleanup Maven layout

2016-03-15 Thread mxm
http://git-wip-us.apache.org/repos/asf/incubator-beam/blob/071e4dd6/runners/flink/runner/src/main/java/org/apache/beam/runners/flink/translation/wrappers/streaming/FlinkAbstractParDoWrapper.java -- diff --git

[03/13] incubator-beam git commit: [flink] restructure and cleanup Maven layout

2016-03-15 Thread mxm
http://git-wip-us.apache.org/repos/asf/incubator-beam/blob/071e4dd6/runners/flink/src/main/java/org/apache/beam/runners/flink/translation/wrappers/SourceInputFormat.java -- diff --git

[07/13] incubator-beam git commit: [flink] restructure and cleanup Maven layout

2016-03-15 Thread mxm
http://git-wip-us.apache.org/repos/asf/incubator-beam/blob/071e4dd6/runners/flink/runner/src/test/java/org/apache/beam/runners/flink/WordCountJoin2ITCase.java -- diff --git

[10/13] incubator-beam git commit: [flink] restructure and cleanup Maven layout

2016-03-15 Thread mxm
http://git-wip-us.apache.org/repos/asf/incubator-beam/blob/071e4dd6/runners/flink/runner/src/main/java/org/apache/beam/runners/flink/translation/functions/FlinkMultiOutputDoFnFunction.java -- diff --git

[05/13] incubator-beam git commit: [flink] restructure and cleanup Maven layout

2016-03-15 Thread mxm
http://git-wip-us.apache.org/repos/asf/incubator-beam/blob/071e4dd6/runners/flink/src/main/java/org/apache/beam/runners/flink/io/ConsoleIO.java -- diff --git

[12/13] incubator-beam git commit: [flink] restructure and cleanup Maven layout

2016-03-15 Thread mxm
http://git-wip-us.apache.org/repos/asf/incubator-beam/blob/071e4dd6/runners/flink/pom.xml -- diff --git a/runners/flink/pom.xml b/runners/flink/pom.xml index c8c5d84..31713cd 100644 --- a/runners/flink/pom.xml +++

  1   2   >