GitHub user manuzhang opened a pull request:
https://github.com/apache/beam/pull/2241
Sync gearpump-runner branch with master
Be sure to do all of the following to help us incorporate your contribution
quickly and easily:
- [ ] Make sure the PR title is formatted like:
`[BEAM-<Jira issue #>] Description of pull request`
- [ ] Make sure tests pass via `mvn clean verify`. (Even better, enable
Travis-CI on your fork and ensure the whole test matrix passes).
- [ ] Replace `<Jira issue #>` in the title with the actual Jira issue
number, if there is one.
- [ ] If this contribution is large, please file an Apache
[Individual Contributor License
Agreement](https://www.apache.org/licenses/icla.txt).
---
You can merge this pull request into a Git repository by running:
$ git pull https://github.com/manuzhang/incubator-beam gearpump-runner-merge
Alternatively you can review and apply these changes as the patch at:
https://github.com/apache/beam/pull/2241.patch
To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:
This closes #2241
----
commit 3120fd9a499b01b08659edc4e045f5abbcc3ae07
Author: Kenneth Knowles <[email protected]>
Date: 2017-02-24T02:06:56Z
Condense FunctionSpec and remove SdkFunctionSpec, merging data and params
commit 49c9de1e84e0f322dfd4426d8f1d523aee1529e9
Author: Kenneth Knowles <[email protected]>
Date: 2017-02-24T22:39:19Z
This closes #2094: Concretize generic bits of the Runner API graph structure
Condense FunctionSpec and remove SdkFunctionSpec, merging data and params
Inline PTransform to GraphNode, removing generic design
commit 8a06134c6543394849a5f8856418dd699fd2e2a7
Author: Kenneth Knowles <[email protected]>
Date: 2017-02-24T23:07:35Z
This closes #2103: Ignore HBaseIOTest temporarily
commit 1b1bb0b9aeb8f4b131fbcf62b117ef3f55db2f61
Author: Ahmet Altay <[email protected]>
Date: 2017-02-24T21:29:01Z
Change the package name to apache-beam
Also, allow direct installations from PyPI (once the package is
published.) This will eventually make sdk_location an optional argument.
commit b1fd55f0c0a10c9376ee084582532df1e6fd7359
Author: Ahmet Altay <[email protected]>
Date: 2017-02-24T23:13:25Z
This closes #2102
commit fa13c7b9362c65d8d61e914d3822dea025400d5b
Author: Vikas Kedigehalli <[email protected]>
Date: 2017-02-24T19:04:55Z
Ignore undeclared outputs in the java fn harness
commit d79fb3e06ddc8ff7d06645d0c4a2c685a90c250b
Author: Dan Halperin <[email protected]>
Date: 2017-02-24T23:16:15Z
This closes #2100
commit 7162964f058002db76232fd04d720ce9c3e75585
Author: Ahmet Altay <[email protected]>
Date: 2017-02-24T23:43:17Z
Update python sdk readme
commit 639f9f4b7195eee3528acabc358f3790f4549c57
Author: Ahmet Altay <[email protected]>
Date: 2017-02-24T23:55:43Z
This closes #2105
commit a5b8cb1e11deee7fe7ed152a4718a1f971f58eab
Author: Pablo <[email protected]>
Date: 2017-02-15T23:16:12Z
Making metrics queriable in Python SDK.
commit 415546eda7916f6f43b5d101ef5c15aa7948dac9
Author: Ahmet Altay <[email protected]>
Date: 2017-02-25T01:39:06Z
This closes #2016
commit 2736c4ae901ad428f8e05fb7a80ad72f0318735e
Author: Ismaël MejÃa <[email protected]>
Date: 2017-02-24T15:46:17Z
[BEAM-1554] Add verification of Coder structural equality after enc/dec
This also improves the class documentation.
commit 437ba250525f5b611a3e3c31bee782aea24a16ce
Author: Kenneth Knowles <[email protected]>
Date: 2017-02-25T03:23:13Z
This closes #2098: Add verification of Coder structural equality after
encoding/decoding
commit 32cd4836d2441c10fa71df4344c6b546c2c0ca3a
Author: Ahmet Altay <[email protected]>
Date: 2017-02-25T04:19:49Z
Disable newly added tests, that is failing is post-commits.
commit 38a01e9cf8d959ace3baa1593f8dc17d4f12954d
Author: Ahmet Altay <[email protected]>
Date: 2017-02-26T02:30:50Z
This closes #2107
commit acc10130982168ad5c4f29b2af3be67e53f7c967
Author: Stas Levin <[email protected]>
Date: 2017-02-23T22:02:14Z
Updated TestPipeline's javadoc.
commit 4bba380cb011e38bd78c1ec899a6672a6b02fd05
Author: Stas Levin <[email protected]>
Date: 2017-02-26T15:28:26Z
This closes #2089
commit b74f8fa30aea130f990c152a1c91a509c3b6d6c9
Author: Aviem Zur <[email protected]>
Date: 2017-02-23T05:09:55Z
Remove periods from step name in SparkBeamMetric to avoid inconsistent
hierarchies in Graphite metric sink
commit 3082178b3a35143573caa2b3d9afbf2babb5b2b5
Author: Stas Levin <[email protected]>
Date: 2017-02-27T12:16:55Z
This closes #2083
commit 0ae2a3851cbfe1ec2f2c7237954b18c9951c76a3
Author: JingsongLi <[email protected]>
Date: 2017-02-27T10:08:34Z
[BEAM-1560] Use provided Function Runners in Flink Batch Runner
commit b261d489061e9a92b7df28ca71bce00844f7dfa6
Author: Aljoscha Krettek <[email protected]>
Date: 2017-02-27T12:22:49Z
This closes #2112: Use provided Function Runners in Flink Batch Runner
commit d1f6a8af12d7db01c45c269551b1e3ec92a8afa0
Author: Ismaël MejÃa <[email protected]>
Date: 2017-02-23T20:13:19Z
[BEAM-1541] Create hadoop-common and refactor HdfsIO and HBaseIO to use it
commit 9e4b140ed5351ee437520ff9485a38747b07d9b5
Author: Dan Halperin <[email protected]>
Date: 2017-02-27T16:43:37Z
This closes #2087
commit a6cd8c3842cc1e3f72e02b5a9d1332bc6cddd35c
Author: Thomas Groh <[email protected]>
Date: 2017-02-16T21:57:21Z
Get DataflowRunner out of the #apply()
Use Pipeline Surgery in the Dataflow Runner
Add additional override factories for Dataflow overrides.
commit f5c04e1566ab3b743494a8e58577262344a9c47b
Author: Thomas Groh <[email protected]>
Date: 2017-02-23T23:24:10Z
Update Dataflow Container Version
commit aaf0884d50eae620fc76e906ef4591c514ccb4d7
Author: Thomas Groh <[email protected]>
Date: 2017-02-27T17:06:13Z
This closes #2039
commit 63035de82d5e484804e0cf3160a788041e6fe3d3
Author: Neville Li <[email protected]>
Date: 2017-02-21T16:34:22Z
Add DEFLATE to CompressedSource and TextIO
* add DEFLATE to CompressedSource
* update docs in CompressedSource.java
* update CompressedSourceTest
* add DELATE to TextIO
* update TextIOTest
* add DEFLATE to FileBasedSink
* update FileBasedSinkTest
commit 0b7515e5e56c56e89aa75889ec4c08fba9645b8e
Author: Dan Halperin <[email protected]>
Date: 2017-02-27T17:37:58Z
This closes #2056
commit c183a7bd172044459e5f0255c447b882d5586409
Author: Aviem Zur <[email protected]>
Date: 2017-02-24T09:18:02Z
Add Create#withTypeDescriptor
This permits creates that cannot infer a coder based on the input
elements to pass a Type Descriptor and use Coder Inference, rather than
requiring a coder be provided.
commit 063fbd4ed4ed34dece6490e791f0e5c91ec52895
Author: Thomas Groh <[email protected]>
Date: 2017-02-27T17:39:47Z
This closes #2095
----
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at [email protected] or file a JIRA ticket
with INFRA.
---
