hpvd opened a new issue, #31078: URL: https://github.com/apache/beam/issues/31078
### What needs to happen? Since there is a continious demand for it, just an overview for current state of Support for Apache Pulsar: - when looking into beams i/o connector matrix pulsar is not listed yet: https://beam.apache.org/documentation/io/connectors/ - but there is a sdk package Package org.apache.beam.sdk.io.pulsar https://beam.apache.org/releases/javadoc/current/org/apache/beam/sdk/io/pulsar/package-summary.html -in v2.39 of beam a relatively basic pulsar io was introduced: Implemented Apache PulsarIO https://beam.apache.org/blog/beam-2.39.0/ for details see: https://issues.apache.org/jira/browse/BEAM-8218 - there are some open issues in beam for pulsar: https://github.com/apache/beam/issues?q=is%3Aissue+pulsar+is%3Aopen - [Bug]: PulsarIO.read() is failing with java.lang.RuntimeException: Could not find a way to create AutoValue class class com.idfy.beam.pulsar.PulsarSourceDescriptor #30688 - [Bug]: PulsarIO write() complains of missing ClientUrl even when provided with withClientUrl #30152 - [Feature Request]: Set option for acknowledge the messages in PulsarIO reader #22054 - [Feature Request]: Pulsar Connector should accept auth parameters to connect #22027 - [Feature Request]: Make Pulsar IO connector publish messages asynchronously #22025 - [Bug] PulsarIOTest.testReadFromSimpleTopic is very flaky #21714 - [Bug] org.apache.beam.sdk.io.pulsar.PulsarIOTest.testReadFromSimpleTopic flaky #21560 ### Issue Priority Priority: 3 (nice-to-have improvement) ### Issue Components - [ ] Component: Python SDK - [ ] Component: Java SDK - [ ] Component: Go SDK - [ ] Component: Typescript SDK - [ ] Component: IO connector - [ ] Component: Beam YAML - [ ] Component: Beam examples - [ ] Component: Beam playground - [ ] Component: Beam katas - [ ] Component: Website - [ ] Component: Spark Runner - [ ] Component: Flink Runner - [ ] Component: Samza Runner - [ ] Component: Twister2 Runner - [ ] Component: Hazelcast Jet Runner - [ ] Component: Google Cloud Dataflow Runner -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
