[
https://issues.apache.org/jira/browse/BEAM-6335?focusedWorklogId=346832&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-346832
]
ASF GitHub Bot logged work on BEAM-6335:
----------------------------------------
Author: ASF GitHub Bot
Created on: 20/Nov/19 16:01
Start Date: 20/Nov/19 16:01
Worklog Time Spent: 10m
Work Description: Ardagan commented on pull request #10029: [BEAM-6335]
Test GBK streaming reading SyntheticSources
URL: https://github.com/apache/beam/pull/10029
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
[email protected]
Issue Time Tracking
-------------------
Worklog Id: (was: 346832)
Time Spent: 50m (was: 40m)
> GroupByKey uses data insertion pipeline in streaming tests
> ----------------------------------------------------------
>
> Key: BEAM-6335
> URL: https://issues.apache.org/jira/browse/BEAM-6335
> Project: Beam
> Issue Type: Sub-task
> Components: testing
> Reporter: Kasia Kucharczyk
> Assignee: Kasia Kucharczyk
> Priority: Major
> Time Spent: 50m
> Remaining Estimate: 0h
>
> Uses prepared Java Data Insertion Pipeline to update GroupByKey in Python to
> load test streaming.
> This task contains following steps:
> # Create GroupByKey streaming test that accepts bytes
> # To stop test after arrived messages it is required to add a matcher. The
> matcher should work on number of messages because in case of load testing it
> would be difficult to compare big load of bytes (also casting bytes to string
> to compare load would be difficult).
> # All data is generated by SyntheticDataPublisher.java, which is sending
> bytes produced by synthetic source to PubSub. PubSub is used as a streaming
> source for the Python test.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
