[
https://issues.apache.org/jira/browse/BEAM-9188?focusedWorklogId=379598&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-379598
]
ASF GitHub Bot logged work on BEAM-9188:
----------------------------------------
Author: ASF GitHub Bot
Created on: 30/Jan/20 21:12
Start Date: 30/Jan/20 21:12
Worklog Time Spent: 10m
Work Description: boyuanzz commented on issue #10701: [BEAM-9188]
CassandraIO split performance improvement - cache size of the table
URL: https://github.com/apache/beam/pull/10701#issuecomment-580462046
Java_Examples_Dataflow is broken probably because of dataflow service.
Please fix Spotless.
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org
Issue Time Tracking
-------------------
Worklog Id: (was: 379598)
Time Spent: 3.5h (was: 3h 20m)
> Improving speed of splitting for Custom Sources
> -----------------------------------------------
>
> Key: BEAM-9188
> URL: https://issues.apache.org/jira/browse/BEAM-9188
> Project: Beam
> Issue Type: Improvement
> Components: runner-dataflow
> Reporter: Radosław Stankiewicz
> Assignee: Radosław Stankiewicz
> Priority: Minor
> Time Spent: 3.5h
> Remaining Estimate: 0h
>
> At this moment Custom Source in being split and serialized in sequence. If
> there are many splits, it takes time to process all splits.
>
> Example: it takes 2s to calculate size and serialize CassandraSource due to
> connection setup and teardown. With 100+ splits, it's a lot of time spent in
> 1 worker.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
