[
https://issues.apache.org/jira/browse/BEAM-13532?focusedWorklogId=738325&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-738325
]
ASF GitHub Bot logged work on BEAM-13532:
-----------------------------------------
Author: ASF GitHub Bot
Created on: 08/Mar/22 20:53
Start Date: 08/Mar/22 20:53
Worklog Time Spent: 10m
Work Description: chamikaramj commented on pull request #16366:
URL: https://github.com/apache/beam/pull/16366#issuecomment-1062198173
I think the main point here is that this feature will not be available to
Dataflow by default since Dataflow overrides the Beam Pub/Sub I/O with a native
connector. So additional work will need be to be done by the Dataflow team to
fully enable this feature to all runners. I think vast majority of Beam Pub/Sub
I/O users use Dataflow, hence if this PR is merged without additional Dataflow
changes (or at least a timeline for such changes) many Beam Pub/Sub IO users
will end up with a connector that is in an inconsistent state.
Also noting that Dataflow users can choose to use the Beam Pub/Sub I/O
connector by using the experiment "enable_custom_pubsub_source" but this has
known limitations for Dataflow and currently not supported by that runner.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
Issue Time Tracking
-------------------
Worklog Id: (was: 738325)
Time Spent: 1h 40m (was: 1.5h)
> Pubsub-IO dynamic destination
> -----------------------------
>
> Key: BEAM-13532
> URL: https://issues.apache.org/jira/browse/BEAM-13532
> Project: Beam
> Issue Type: New Feature
> Components: io-java-gcp
> Reporter: tamir
> Assignee: tamir
> Priority: P2
> Time Spent: 1h 40m
> Remaining Estimate: 0h
>
> Change topic name to be part of the PubsubMessage and pass it using dynamic
> destinations (like in BigQuery-IO). This will allow writing to new topics
> without restart the job.
--
This message was sent by Atlassian Jira
(v8.20.1#820001)
