[
https://issues.apache.org/jira/browse/BEAM-8474?focusedWorklogId=335682&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-335682
]
ASF GitHub Bot logged work on BEAM-8474:
----------------------------------------
Author: ASF GitHub Bot
Created on: 29/Oct/19 18:35
Start Date: 29/Oct/19 18:35
Worklog Time Spent: 10m
Work Description: pabloem commented on issue #9891: [BEAM-8474] A
microbenchmark for Python FnApiRunner:
URL: https://github.com/apache/beam/pull/9891#issuecomment-547568976
I've added documentation, but to answer your question Boyuan, what the docs
say:
This microbenchmark attempts to measure the overhead of the main data paths
for the FnApiRunner. Specifically state, timers, and shuffling of data.
I am planning to make changes to how stages and bundled get scheduled for
execution, and I want to make sure that I am not increasing the overhead of
scheduling bundles / data exchange in the runner.
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org
Issue Time Tracking
-------------------
Worklog Id: (was: 335682)
Time Spent: 2h 10m (was: 2h)
> A microbenchmark that exercises the FnAPI runner functionality
> --------------------------------------------------------------
>
> Key: BEAM-8474
> URL: https://issues.apache.org/jira/browse/BEAM-8474
> Project: Beam
> Issue Type: Improvement
> Components: sdk-py-core
> Reporter: Pablo Estrada
> Assignee: Pablo Estrada
> Priority: Major
> Time Spent: 2h 10m
> Remaining Estimate: 0h
>
> The main data paths for the Fn API runner are exercised by:
> * Side inputs
> * GBK
> * State
> * Timers
> * SDF?
> A microbenchmark would have a number of stages that exercise one or more of
> these data paths.
> A microbenchmark suite may have more than one pipeline.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
