Morning! First of all, thanks for all the incredible work you do, is amazing. Then, secondly, I reach you for some help or guidance to manually commit records. I want to do this so I can commit the record and the end of the pipeline, and not in the read() of the KafkaIO.
Bearing in mind what I have read in this post: https://lists.apache.org/[email protected]:2021-9:[email protected]%20kafka%20commit , and thinking of a pipeline similar to the one described, I understand we can use commitOffsetsInFinalize() to commit offsets in the read(). What I don't understand is how this helps to commit the offset if we want to do this at the end, not in the reading. Thanks. All comments and suggestions are more than welcome. :) *Juan Calvo Ferrándiz* Data Engineer Go to LINKEDIN <https://www.linkedin.com/in/juan-calvo-ferrandiz/> Go to GITHUB <https://github.com/juancalvof> Go to MEDIUM <https://medium.com/@juancalvoferrandiz>
