[
https://issues.apache.org/jira/browse/BEAM-3925?focusedWorklogId=397964&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-397964
]
ASF GitHub Bot logged work on BEAM-3925:
----------------------------------------
Author: ASF GitHub Bot
Created on: 04/Mar/20 23:25
Start Date: 04/Mar/20 23:25
Worklog Time Spent: 10m
Work Description: rangadi commented on issue #6636: [BEAM-3925] [DO NOT
MERGE] KafkaIO : Value provider support for reader configuration.
URL: https://github.com/apache/beam/pull/6636#issuecomment-594928908
It might be a bit more than than 'just' :)
We can't shrink the splits since the compute graph is already constructed, I
think. We would know only inside the reader during reader initialization what
the total number of partitions we need to consumer. Each reader has to decide
which partitions to consume based on reader id.
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
[email protected]
Issue Time Tracking
-------------------
Worklog Id: (was: 397964)
Time Spent: 8h 10m (was: 8h)
> Support ValueProviders in KafkaIO
> ---------------------------------
>
> Key: BEAM-3925
> URL: https://issues.apache.org/jira/browse/BEAM-3925
> Project: Beam
> Issue Type: Improvement
> Components: io-java-kafka
> Reporter: Sameer Abhyankar
> Assignee: Pramod Upamanyu
> Priority: Major
> Time Spent: 8h 10m
> Remaining Estimate: 0h
>
> Add ValueProvider support for the various methods in KafkaIO. This would
> allow us to use KafkaIO in reusable pipeline templates.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
