[
https://issues.apache.org/jira/browse/BEAM-4376?focusedWorklogId=108515&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-108515
]
ASF GitHub Bot logged work on BEAM-4376:
----------------------------------------
Author: ASF GitHub Bot
Created on: 04/Jun/18 11:31
Start Date: 04/Jun/18 11:31
Worklog Time Spent: 10m
Work Description: iemejia opened a new pull request #5549: [BEAM-4376]
Add Nexmark events generation based on ParDo
URL: https://github.com/apache/beam/pull/5549
R: @kennknowles
CC: @jkff
Hi, I ping you guys because I found something weird and I am not sure if it
is a direct runner issue or a issue with ParDo (or a Nexmark thing that I
didn't identify). I added this new generation mode for Nexmark to be able to
test the PortableRunner. However when the Nexmark executions produce different
results.
I print the generated events (the input of the different queries) and both
(the ParDo based and the Source generator) produce exactly the same output (I
validate this in `EventGeneratorDoFnTest#testGeneratesSameEvents`).
Do you have any idea why this can be wrong? am I missing something that can
change the results?
As a reference to execute this I do:
```
./gradlew :beam-sdks-java-nexmark:run \
-Pnexmark.runner=":beam-runners-direct-java" \
-Pnexmark.args="
--runner=DirectRunner
--streaming=false
--suite=SMOKE
--manageResources=false
--monitorJobs=true
--enforceEncodability=true
--enforceImmutability=true --useParDoGenerator=true"
```
You can change useParDoGenerator to false to see the different results.
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
[email protected]
Issue Time Tracking
-------------------
Worklog Id: (was: 108515)
Time Spent: 10m
Remaining Estimate: 0h
> Add Nexmark events generation based on ParDo
> --------------------------------------------
>
> Key: BEAM-4376
> URL: https://issues.apache.org/jira/browse/BEAM-4376
> Project: Beam
> Issue Type: Improvement
> Components: examples-nexmark
> Reporter: Ismaël Mejía
> Assignee: Ismaël Mejía
> Priority: Minor
> Time Spent: 10m
> Remaining Estimate: 0h
>
> Currently Nexmark generates events using the Source API. Having a ParDo based
> generator will allow us to use Nexmark quickly with the Portable runners.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
