kennknowles opened a new issue, #18939: URL: https://github.com/apache/beam/issues/18939
At least for publishing (and maybe pulling) messages, non-Dataflow-based sources and sinks for Pub/Sub use the [public API](https://cloud.google.com/pubsub/docs/publisher) for Pub/Sub, which doesn't support id_label and timestamp_attribute settings. Publishing: id_label - add an attribute to each message with a unique value timestamp_attribute - add an attribute to each message with the publishing time as its value Pulling: id_label - use the value of this message attribute to deduplicate messages timestamp_attribute - use the value of this message attribute as the element's timestamp Implementation details: could probably create a pubsubio.py module, for reuse with other runners (i.e. implement Pub/Sub IO as PTransforms and not NativeSinks and Sources). Imported from Jira [BEAM-4275](https://issues.apache.org/jira/browse/BEAM-4275). Original Jira may contain additional context. Reported by: udim. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
