[
https://issues.apache.org/jira/browse/BEAM-3819?focusedWorklogId=81127&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-81127
]
ASF GitHub Bot logged work on BEAM-3819:
----------------------------------------
Author: ASF GitHub Bot
Created on: 16/Mar/18 10:08
Start Date: 16/Mar/18 10:08
Worklog Time Spent: 10m
Work Description: aromanenko-dev commented on issue #4851: [BEAM-3819]
Add withLimit() option to KinesisIO
URL: https://github.com/apache/beam/pull/4851#issuecomment-373664555
@jbonofre Potentially, we can collect some statistics of how many records
were read and what is total data size. Then, we can calculate the average size
of record and set this `limit` accordingly. From time to time we have to
recalculate the average size and adjust new `limit` value if this size has beed
changed significantly. But in this case, we need to close old jira and open new
one and create new PR because originally, if I understand correctly, the idea
was to allow user to configure this parameter by itself. WDYT?
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org
Issue Time Tracking
-------------------
Worklog Id: (was: 81127)
Time Spent: 1h 20m (was: 1h 10m)
> Add withLimit() option to KinesisIO
> -----------------------------------
>
> Key: BEAM-3819
> URL: https://issues.apache.org/jira/browse/BEAM-3819
> Project: Beam
> Issue Type: Improvement
> Components: io-java-kinesis
> Reporter: Jean-Baptiste Onofré
> Assignee: Alexey Romanenko
> Priority: Major
> Time Spent: 1h 20m
> Remaining Estimate: 0h
>
> In some cases, the user might need to set the {{limit}} on the
> {{SimplifiedKinesisClient}}, especially for performance reason, depending of
> the number of records.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
