GitHub user mxm opened a pull request:
https://github.com/apache/incubator-beam/pull/69
[BEAM-143] add test for UnboundedSourceWrapper
So far the `UnboundedSourceWrapper` has not been tested systematically
which led to a bunch of regression issues. This PR fixes the
UnboundedSourceWrapper and adds a test case. The test case ensures that the
wrapper works as expected. In particular, a full integration test is run to
check whether serialization and instantiation of the wrapper works in a cluster
setup.
You can merge this pull request into a Git repository by running:
$ git pull https://github.com/mxm/incubator-beam BEAM-143
Alternatively you can review and apply these changes as the patch at:
https://github.com/apache/incubator-beam/pull/69.patch
To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:
This closes #69
----
commit 8d36d5dcd55b827f23a22f8acdff455a9c21ffa5
Author: Thomas Groh <[email protected]>
Date: 2016-03-07T21:47:30Z
Filter Synthetic Methods in PipelineOptionsFactory
commit 25409464a27b1cbb7adffe90aa7e49e3b1bce4cb
Author: Thomas Groh <[email protected]>
Date: 2016-02-27T01:30:13Z
Implement InProcessPipelineRunner#run
Appropriately construct an evaluation context and executor, and start
the pipeline when run is called.
Implement InProcessPipelineResult.
Apply PTransform overrides.
commit 4c21708c574d5d08db6c7bac5fca1ce09780b730
Author: Rafal Wojdyla <[email protected]>
Date: 2016-03-11T18:39:55Z
[flink] Add FlinkRunnerRegistrar
Expose Flink runner and options via AuteService. AuteService will
at compile time populate META-INF/services so that Dataflow sdk
can seamlessly pick up FlinkRunner.
This closes #40.
commit cb3081da383e6de88a04fd5e190ef69849e1f586
Author: Maximilian Michels <[email protected]>
Date: 2016-03-16T11:03:07Z
[BEAM-116] change runners artifactId to runners-parent
commit 066e6ce518be869b424aa283967956de8cb0c495
Author: Scott Wegner <[email protected]>
Date: 2016-03-17T17:22:42Z
Add DisplayData builder API to SDK
This allows generating the display data which will be attached to
PTransforms.
commit 28e13f2ae73941404ade8ca2c3e64af43fefc85d
Author: Maximilian Michels <[email protected]>
Date: 2016-03-21T10:36:35Z
[flink] add test case for Runner registration
commit d1fcc6645837998176dffbc61464046ec17dbb1f
Author: sammcveety <[email protected]>
Date: 2016-03-22T18:58:19Z
Update AutoComplete.java
Allow for the Datastore dependency of this test to be in a different
project than the main project for the job.
commit 63a2d5447b050b2a7e9e8201ec7bcc287849420e
Author: Neville Li <[email protected]>
Date: 2016-03-22T22:05:51Z
make BigtableIO#Read#withRowFilter public
commit 73bbb1c523548b34a8b8403785c68094a5995a51
Author: Maximilian Michels <[email protected]>
Date: 2016-03-23T15:18:04Z
[BEAM-144] solve reader serialization issue
Now, we initialize the UnboundedSourceReader at runtime which requires
us to keep a copy of the PipelineOptions. This should be fine here
because we are at the lowest point of the execution stack.
commit f491b424483d7c21f4fdc7b21f489762d0ef964b
Author: Maximilian Michels <[email protected]>
Date: 2016-03-23T15:19:27Z
[BEAM-143] [flink] add test for UnboundedSourceWrapper
The test ensures serialization and execution of the wrapper works as
expected.
----
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at [email protected] or file a JIRA ticket
with INFRA.
---
