[
https://issues.apache.org/jira/browse/BEAM-79?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16077824#comment-16077824
]
ASF GitHub Bot commented on BEAM-79:
------------------------------------
GitHub user manuzhang opened a pull request:
https://github.com/apache/beam/pull/3515
[BEAM-79] Sync gearpump-runner with master and upgrade to gearpump 0.8.4
Be sure to do all of the following to help us incorporate your contribution
quickly and easily:
- [ ] Make sure the PR title is formatted like:
`[BEAM-<Jira issue #>] Description of pull request`
- [ ] Make sure tests pass via `mvn clean verify`.
- [ ] Replace `<Jira issue #>` in the title with the actual Jira issue
number, if there is one.
- [ ] If this contribution is large, please file an Apache
[Individual Contributor License
Agreement](https://www.apache.org/licenses/icla.pdf).
---
You can merge this pull request into a Git repository by running:
$ git pull https://github.com/manuzhang/beam sync-master
Alternatively you can review and apply these changes as the patch at:
https://github.com/apache/beam/pull/3515.patch
To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:
This closes #3515
----
commit 7b8cd6401cb5ed6e184ed36571a89d3ae324dd5f
Author: Jeremie Lenfant-Engelmann <[email protected]>
Date: 2017-06-29T01:32:56Z
Properly convert milliseconds whether there's less than 3/more than 9
digits.
TimeUtil did not properly convert (and returned null) when the number of
digits for fractions of seconds was less than 3 digits or more than 9
digits.
The solution is to pad with zeros when there is less than 3 digits and to
truncate when there is more than 3.
commit f75dfe711b357800762a93dc5059d9a19da9ee61
Author: Luke Cwik <[email protected]>
Date: 2017-06-30T16:00:13Z
Properly convert milliseconds whether there's less than 3/more than 9
digits.
This closes #3469
commit 56cb6c51748fde6ad56522733ab10edca062e802
Author: Kenneth Knowles <[email protected]>
Date: 2017-06-13T17:29:50Z
Add support for PipelineOptions parameters
This is a step towards eliminating catch-all context parameters and
making DoFns express their fine-grained data needs.
commit 0e429b33ff85eba08da5018c9febd0b99b44f720
Author: Kenneth Knowles <[email protected]>
Date: 2017-06-30T22:39:20Z
This closes #3355: Add support for PipelineOptions parameters
commit f99ab1a472868e4ce175a86e5d76823b1c09c10b
Author: Kenneth Knowles <[email protected]>
Date: 2017-07-01T04:42:17Z
Fix DoFn javadoc: StateSpec does not require a key
commit ce4e51747501111ae2c4b1691c6994bd0f92e161
Author: Ismaël Mejía <[email protected]>
Date: 2017-06-04T20:55:05Z
Make modules that depend on Hadoop and Spark use the same version property
commit 11010cf08ec9ca90a843cc15ea8f0fd4910f7fab
Author: Jean-Baptiste Onofré <[email protected]>
Date: 2017-07-03T07:26:40Z
This closes #3291
commit 75475ef3dc23a09fa9bbba478d6fdbc468f7dd2e
Author: Ismaël Mejía <[email protected]>
Date: 2017-06-28T14:58:55Z
[BEAM-2530] Fix compilation of modules with Java 9 that depend on jdk.tools
commit 0bd47c07659909c6b3c2d04fbdb96cc30a6e0243
Author: Jean-Baptiste Onofré <[email protected]>
Date: 2017-07-03T12:23:18Z
[BEAM-2530] This closes #3460
commit 68f1fb64fd2565e287e322d715ca778d01e7137b
Author: Ahmet Altay <[email protected]>
Date: 2017-07-01T00:37:33Z
For GCS operations use an http client with a default timeout value.
commit b8ac32641183b06a87517a169c8ecc5371996aed
Author: Ahmet Altay <[email protected]>
Date: 2017-07-04T18:07:31Z
This closes #3486
commit 51877a3405dbf778c3bb88f19bb194e54c3b3def
Author: Jean-Baptiste Onofré <[email protected]>
Date: 2017-07-05T14:47:29Z
[maven-release-plugin] prepare branch release-2.1.0
commit 7f0723cf7fd587c4f8dbe8a8b1c9d298a7b1e5e3
Author: Jean-Baptiste Onofré <[email protected]>
Date: 2017-07-05T14:47:38Z
[maven-release-plugin] prepare for next development iteration
commit 14fa7f79f0830739122b7573e032ad0aea172a98
Author: Jean-Baptiste Onofré <[email protected]>
Date: 2017-07-05T14:52:48Z
Update Python SDK version
commit 06897b1cc142f658437ac7779c849e5182e331f1
Author: Jason Kuster <[email protected]>
Date: 2017-06-09T08:39:15Z
Website Mergebot Job
Signed-off-by: Jason Kuster <[email protected]>
commit f0549b464737d0d11ae1da8e0534622b10247208
Author: Thomas Groh <[email protected]>
Date: 2017-07-05T16:22:20Z
This closes #3485
commit 6ca410a908f1f4e7ac1e141ee1335f7a537bb150
Author: Luke Cwik <[email protected]>
Date: 2017-07-05T17:38:44Z
[BEAM-2553] Update Maven exec plugin to 1.6.0 to incorporate messaging
improvements
commit 39c80f640749fed5f55a0c8f25c849e5f7c3d179
Author: Luke Cwik <[email protected]>
Date: 2017-07-05T19:26:28Z
[BEAM-2553] Update Maven exec plugin to 1.6.0 to incorporate messaging
improvements
This closes #3494
commit 29c2bca4649317f2ebb1c89f92bf97fbb27602ca
Author: Thomas Groh <[email protected]>
Date: 2017-07-05T21:16:50Z
Disallow Combiner Lifting for multi-window WindowFns
commit 63f66d6d81652dba5a7804648cde0e7debffd0f6
Author: Kenneth Knowles <[email protected]>
Date: 2017-07-05T22:00:09Z
This closes #3489: Fix DoFn javadoc: StateSpec does not require a key
commit 23e385faa193a00f9b10e3f8f0afe832087bff06
Author: Ahmet Altay <[email protected]>
Date: 2017-07-05T21:34:07Z
Update SDK dependencies
commit ea9f7fbdde5ede5e5f5060da5dfe2749992a2fa7
Author: Ahmet Altay <[email protected]>
Date: 2017-07-05T23:11:46Z
This closes #3497
commit e8fdd373c7b86652fda94ff76ef7246357e6288c
Author: Kenneth Knowles <[email protected]>
Date: 2017-07-05T23:41:16Z
This closes #3496: Disallow Combiner Lifting for multi-window WindowFns
commit a75202f344f22be5c5fdf62b3eb54a151ad29af6
Author: Charles Chen <[email protected]>
Date: 2017-07-05T23:18:51Z
Fix PValue input in _PubSubReadEvaluator
commit bf6dda32047e0bfba18de5aa27b1b6a593f86fc9
Author: Ahmet Altay <[email protected]>
Date: 2017-07-06T01:09:05Z
This closes #3499
commit 2259c309c5b81a5d1e32732dd35e1102766401fa
Author: Raghu Angadi <[email protected]>
Date: 2017-06-28T19:07:06Z
[BEAM-2534] Handle offset gaps in Kafka messages.
KafkaIO logged a warning when there is a gap in offstes for messages.
Kafka also support 'KV' store style topics where some of the messages
are deleted leading gaps in offsets. This PR removes the log and
accounts for offset gaps in backlog estimate.
commit 85a99e29448670ae6728a8ee2e4cd3ef95877c3e
Author: JingsongLi <[email protected]>
Date: 2017-07-06T16:48:36Z
This closes #3461
commit 526037b6786315b9f9fdca6edb636baeb6f83e3f
Author: Raghu Angadi <[email protected]>
Date: 2017-07-04T06:54:10Z
Add timeout to initialization of partition in KafkaIO
commit b8f8d18ae2cdbb4874d9a0f45038037ecc2381d1
Author: Kenneth Knowles <[email protected]>
Date: 2017-07-06T18:59:18Z
This closes #3492: [BEAM-2551] KafkaIO reader blocks indefinitely in case
of network issues
Add timeout to initialization of partition in KafkaIO
commit bd631b89a8434f0756e1596875e89013fb623ab5
Author: Kenneth Knowles <[email protected]>
Date: 2017-06-23T01:09:11Z
Ignore processing time timers in expired windows
----
> Gearpump runner
> ---------------
>
> Key: BEAM-79
> URL: https://issues.apache.org/jira/browse/BEAM-79
> Project: Beam
> Issue Type: New Feature
> Components: runner-gearpump
> Reporter: Tyler Akidau
> Assignee: Manu Zhang
>
> Intel is submitting Gearpump (http://www.gearpump.io) to ASF
> (https://wiki.apache.org/incubator/GearpumpProposal). Appears to be a mix of
> low-level primitives a la MillWheel, with some higher level primitives like
> non-merging windowing mixed in. Seems like it would make a nice Beam runner.
--
This message was sent by Atlassian JIRA
(v6.4.14#64029)
