[
https://issues.apache.org/jira/browse/BEAM-79?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15996155#comment-15996155
]
ASF GitHub Bot commented on BEAM-79:
------------------------------------
GitHub user manuzhang opened a pull request:
https://github.com/apache/beam/pull/2888
[BEAM-79] Merge master into gearpump-runner branch
Be sure to do all of the following to help us incorporate your contribution
quickly and easily:
- [ ] Make sure the PR title is formatted like:
`[BEAM-<Jira issue #>] Description of pull request`
- [ ] Make sure tests pass via `mvn clean verify`.
- [ ] Replace `<Jira issue #>` in the title with the actual Jira issue
number, if there is one.
- [ ] If this contribution is large, please file an Apache
[Individual Contributor License
Agreement](https://www.apache.org/licenses/icla.pdf).
---
You can merge this pull request into a Git repository by running:
$ git pull https://github.com/manuzhang/incubator-beam sync-master
Alternatively you can review and apply these changes as the patch at:
https://github.com/apache/beam/pull/2888.patch
To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:
This closes #2888
----
commit d9595d35176d2572423f6be069982b05eea204dd
Author: Maria Garcia Herrero <[email protected]>
Date: 2017-04-26T23:22:09Z
Add extra message to deprecated annotation
commit 42e3a6f8588046f257e5c780dec12d16d0314a66
Author: Ahmet Altay <[email protected]>
Date: 2017-04-27T18:25:18Z
This closes #2719
commit 9174ebf48391f393761b2ce085d2f165ebb2c7bb
Author: Tibor Kiss <[email protected]>
Date: 2017-04-27T12:12:13Z
[BEAM-1695] Improve Python-SDK's programming guide
commit 884935cb98f0e29bd965fda9182970423d111d7e
Author: Ahmet Altay <[email protected]>
Date: 2017-04-27T19:03:22Z
This closes #2738
commit e047b69efab9c988011303cf2eda86ac408b38c2
Author: Dan Halperin <[email protected]>
Date: 2017-04-27T15:30:47Z
[BEAM-2096] Make DataflowMetrics more resilient
DataflowMetrics seems to have many hard-coded assumptions about what will be
returned by the Dataflow service that, which will likely break when users
use new types of metrics or if the Dataflow service makes minor adjustments
in our it sends metrics back to the user.
In order for code to continue working in these cases, handle errors by
logging
and skipping.
commit fdf2de9994268f5e1d704aa30a4504ac6ee624b8
Author: Dan Halperin <[email protected]>
Date: 2017-04-27T20:10:32Z
This closes #2739
commit f93a27755921e73141fd97de042e6dcd04e10a47
Author: Dan Halperin <[email protected]>
Date: 2017-04-26T00:29:02Z
[BEAM-59] Add FileSystems#matchNewResource
The new FileSystems API needs a way to generate a ResourceId for a
resource that does not exist. This does not come up in sources, because
we typically are just matching existing files. However, sinks need the
ability to reference a new directory (say, in order to create it).
Couldn't think of anything better than a simple function that says
"treat this string as a full resource path with the specified type",
which is what FileSystems#matchNewResource is.
commit 14a90d7c5196d96de66e897687d28202d790439f
Author: Dan Halperin <[email protected]>
Date: 2017-04-27T21:56:24Z
This closes #2728
commit d3b399fa84bff45b0960368d32d4c69e433f4c94
Author: Thomas Groh <[email protected]>
Date: 2017-04-26T22:12:54Z
Remove Coder Encoding IDs
These were never safe to use, and will not be used once Coders have been
migrated to the Runner API representation.
commit c4936958834aa55f0f1fcb73fe9b8419c4c9eb9b
Author: Thomas Groh <[email protected]>
Date: 2017-04-27T22:22:55Z
This closes #2717
commit 1925a50d860b7b8f8422f1c2f251d0ea11def736
Author: Aviem Zur <[email protected]>
Date: 2017-04-27T20:48:02Z
[BEAM-2029] NullPointerException when using multi output ParDo in Spark
runner in streaming mode.
commit a46eb1a80074dc9c382da4d71725ffc61f2e65ba
Author: Dan Halperin <[email protected]>
Date: 2017-04-27T22:33:39Z
This closes #2746
commit 9a3b830c8737859c6afaa6e6e1922b037a78741f
Author: Dan Halperin <[email protected]>
Date: 2017-04-27T22:35:10Z
[BEAM-59] LocalResources: helper utility to create LocalResourceId
Primarily for testing.
commit f71395bfd8f94cbe8d78098f5bb66a1dce65e74b
Author: Dan Halperin <[email protected]>
Date: 2017-04-27T23:30:50Z
This closes #2751
commit 95fdb8f4dbb6bb8ec6d80152aa85cc970ab13366
Author: Dan Halperin <[email protected]>
Date: 2017-04-27T20:51:53Z
WriteFiles: trivial message fix
commit 674ae9a475f1f236230697d5cb1c33d36fec49db
Author: Dan Halperin <[email protected]>
Date: 2017-04-28T00:20:54Z
This closes #2755
commit 06f4ef40bec7d6d3c5826fb9e0c164eb9c05efe7
Author: Ahmet Altay <[email protected]>
Date: 2017-04-28T00:14:41Z
Add a simple snippet for a composite transform.
commit 948f7ef2fc37b30809cf1adb2631eeb6a1e5eff3
Author: Ahmet Altay <[email protected]>
Date: 2017-04-28T00:35:37Z
This closes #2756
commit e1d5174eaffef3b2ac7df6187c43ffbccce32b09
Author: Luke Cwik <[email protected]>
Date: 2017-04-27T23:24:57Z
[BEAM-2031] Add support to PipelineOptionsFactory/ProxyInvocationHandler
for auto registration of Jackson modules
This is towards adding a mixin module for Hadoop Configuration so that it
can live on a PipelineOptions object.
commit 185dc47982078124abf6e851ad1c66ebc4ae8c54
Author: Lukasz Cwik <[email protected]>
Date: 2017-04-28T03:15:40Z
[BEAM-2031] Add support to PipelineOptionsFactory/ProxyInvocationHandler
for auto registration of Jackson modules
This closes #2752
commit 34c3ee7bfe0e0b6b95d0e9ec421a061116fc19b0
Author: Vikas Kedigehalli <[email protected]>
Date: 2017-04-27T21:58:24Z
[BEAM-59] Remove IOChannelFactory usage from
NumberedShardedFile/ExplicitShardedFile
commit 47aaf11250e61d61c0bb3616063dbd5b7f2adb88
Author: Dan Halperin <[email protected]>
Date: 2017-04-28T06:03:12Z
This closes #2749
commit f37d954873ae03cdae854837570b62e334be9022
Author: Thomas Weise <[email protected]>
Date: 2017-04-27T09:06:50Z
BEAM-1981 Fix ApexTimerInternals serialization error.
commit 40a924d8d4e06ecbd7252ddbd6558415f899c123
Author: Luke Cwik <[email protected]>
Date: 2017-04-27T18:34:01Z
[BEAM-1871] Remove irrelevant runtime dependencies.
Confirmed that sdks/java/io/gcp uses 1.22 for the removed libraries.
commit 849e39dfcf28a6edbf3f4c0469229778e0a52cb3
Author: Luke Cwik <[email protected]>
Date: 2017-04-28T15:14:46Z
[BEAM-1871] Remove irrelevant runtime dependencies
This closes #2748
commit ce88c88b14e963ac17fac83dd19495c835c1f6cb
Author: Luke Cwik <[email protected]>
Date: 2017-04-28T01:13:43Z
[BEAM-2005] Move getScheme from FileSystemRegistrar to FileSystem
Note that I needed to update FileSystems to instantiate the FileSystem(s)
upfront instead of remembering the mapping from scheme to registrar.
commit ddabab3faded59e782455486fedf74b2ff60b60c
Author: Luke Cwik <[email protected]>
Date: 2017-04-28T16:00:26Z
[BEAM-2005] Move getScheme from FileSystemRegistrar to FileSystem
This closes #2757
commit fa422b9a81c303616786e8198d22c70df983d28e
Author: Ismaël Mejía <[email protected]>
Date: 2017-04-28T15:25:30Z
Remove missing references to the flink examples package after refactor
commit d08b72892bf900995667a37239e610bc2cd960d0
Author: Ismaël Mejía <[email protected]>
Date: 2017-04-28T16:26:08Z
This closes #2760
commit 594705d717dd6e5b81c08dcf4c56f8f6e7422737
Author: Peter Gergo Barna <[email protected]>
Date: 2017-04-27T12:37:26Z
[BEAM-2094] WordCount examples produce garbage for non-English input text
----
> Gearpump runner
> ---------------
>
> Key: BEAM-79
> URL: https://issues.apache.org/jira/browse/BEAM-79
> Project: Beam
> Issue Type: New Feature
> Components: runner-gearpump
> Reporter: Tyler Akidau
> Assignee: Manu Zhang
>
> Intel is submitting Gearpump (http://www.gearpump.io) to ASF
> (https://wiki.apache.org/incubator/GearpumpProposal). Appears to be a mix of
> low-level primitives a la MillWheel, with some higher level primitives like
> non-merging windowing mixed in. Seems like it would make a nice Beam runner.
--
This message was sent by Atlassian JIRA
(v6.3.15#6346)
