candlerb opened a new issue #5538: Pulsar function to read compacted topics URL: https://github.com/apache/pulsar/issues/5538 **Is your feature request related to a problem? Please describe.** Pulsar functions cannot currently be configured to read the compacted version of a topic. **Describe the solution you'd like** An option to `pulsar-admin functions create/update`, and/or setting in `--function-config-file`, to request subscribing to the compacted version of a topic. Note: a function can have multiple topics as inputs. There are already other options which are on a per-input basis (e.g. `custom-schema-inputs`, `custom-serde-inputs`) so it ought to work like those. **Describe alternatives you've considered** It occurred to me that subscription options could be part of the topic URI, e.g. ``` persistent://public/default/my-topic?compacted=yes ``` ... but that would be a major change if deployed everywhere that subscriptions are used. **Additional context** A similar option might be required for sinks. PR #5532 adds a similar feature to start a sink from "earliest" rather than "latest" message. If that's just for sinks then it would be useful for functions too. Hence there seems to be a more general case use around setting initial subscription options for both functions and sinks.
---------------------------------------------------------------- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: [email protected] With regards, Apache Git Services
