ppawel opened a new issue, #32107:
URL: https://github.com/apache/beam/issues/32107

   ### What would you like to happen?
   
   Currently, there is no public API in SolaceIO to configure watermark 
behavior - classes like WatermarkPolicy and WatermarkParameters are 
package-private.
   
   In effect, the user is required to use the default/hardcoded watermark idle 
threshold of 30 seconds (see 
`org.apache.beam.sdk.io.solace.read.WatermarkParameters#STANDARD_WATERMARK_IDLE_DURATION_THRESHOLD`).
 This is too long for my use case as a stuck watermark causes downstream 
windows to be stuck.
   
   Example: I have a 10-second session window right after the SolaceIO.Read 
transform which needs the watermark to be moving more often than 30 seconds, 
otherwise the elements are not moving through the whole pipeline as expected if 
there are no incoming Solace messages.
   
   CC @bzablocki 
   
   ### Issue Priority
   
   Priority: 2 (default / most feature requests should be filed as P2)
   
   ### Issue Components
   
   - [ ] Component: Python SDK
   - [X] Component: Java SDK
   - [ ] Component: Go SDK
   - [ ] Component: Typescript SDK
   - [X] Component: IO connector
   - [ ] Component: Beam YAML
   - [ ] Component: Beam examples
   - [ ] Component: Beam playground
   - [ ] Component: Beam katas
   - [ ] Component: Website
   - [ ] Component: Infrastructure
   - [ ] Component: Spark Runner
   - [ ] Component: Flink Runner
   - [ ] Component: Samza Runner
   - [ ] Component: Twister2 Runner
   - [ ] Component: Hazelcast Jet Runner
   - [ ] Component: Google Cloud Dataflow Runner


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: [email protected]

For queries about this service, please contact Infrastructure at:
[email protected]

Reply via email to