[
https://issues.apache.org/jira/browse/BEAM-4376?focusedWorklogId=108679&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-108679
]
ASF GitHub Bot logged work on BEAM-4376:
----------------------------------------
Author: ASF GitHub Bot
Created on: 04/Jun/18 17:44
Start Date: 04/Jun/18 17:44
Worklog Time Spent: 10m
Work Description: kennknowles commented on issue #5549: [BEAM-4376] Add
Nexmark events generation based on ParDo
URL: https://github.com/apache/beam/pull/5549#issuecomment-394439399
The Result column appears to be querying a counter metric. So perhaps the
new runner does not implement them quite right? Also, it may be that the actual
things counted there are nondeterministic in various ways.
Query3 - uses an event count trigger, so is nondeterministic generally
Query4 - should be deterministic, uses hot key fanout FWIW
Query5 - ditto, uses hot key fanout too
Query6 - trigger nondeterminism
Query7 - fanout and side input (maybe weird?)
...
These are just guesses. Ultimately the least trustworthy bit seems most
likely to be the metrics / counters implementation. I would do direct counts
with a Count transform and compare.
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
[email protected]
Issue Time Tracking
-------------------
Worklog Id: (was: 108679)
Time Spent: 40m (was: 0.5h)
> Add Nexmark events generation based on ParDo
> --------------------------------------------
>
> Key: BEAM-4376
> URL: https://issues.apache.org/jira/browse/BEAM-4376
> Project: Beam
> Issue Type: Improvement
> Components: examples-nexmark
> Reporter: Ismaël Mejía
> Assignee: Ismaël Mejía
> Priority: Minor
> Time Spent: 40m
> Remaining Estimate: 0h
>
> Currently Nexmark generates events using the Source API. Having a ParDo based
> generator will allow us to use Nexmark quickly with the Portable runners.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
