[
https://issues.apache.org/jira/browse/GOBBLIN-1956?focusedWorklogId=891021&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-891021
]
ASF GitHub Bot logged work on GOBBLIN-1956:
-------------------------------------------
Author: ASF GitHub Bot
Created on: 16/Nov/23 23:19
Start Date: 16/Nov/23 23:19
Worklog Time Spent: 10m
Work Description: ZihanLi58 merged PR #3827:
URL: https://github.com/apache/gobblin/pull/3827
Issue Time Tracking
-------------------
Worklog Id: (was: 891021)
Time Spent: 1h 10m (was: 1h)
> Make Kafka streaming pipeline be able to config the max poll records during
> runtime
> -----------------------------------------------------------------------------------
>
> Key: GOBBLIN-1956
> URL: https://issues.apache.org/jira/browse/GOBBLIN-1956
> Project: Apache Gobblin
> Issue Type: Improvement
> Reporter: Zihan Li
> Priority: Major
> Time Spent: 1h 10m
> Remaining Estimate: 0h
>
> Kafka max.poll.records affect the performance of the Kafka consumer.
> Config it to be a lower number means it take more time to process each
> record. While config it to be a higher number means we need more memory to
> hold the records. So we should use the avg record size to determine the value
> for different topics.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
