From my understanding:
- ENABLE_AUTO_COMMIT_CONFIG will say to Kafka consumer (used inside KafkaIO to
read messages) to commit periodically offsets in the background;
- on the other hand, if "commitOffsetsInFinalize()” is used, then Beam
Checkpoint mechanism will be leveraged to restart from
Hey Teodor,
Copying is the default behavior. This is tunable via the pipeline option
'objectReuse', i.e. 'objectReuse=true'.
The option is disabled by default because users may not be aware of
object reuse and recycle objects in their process functions which will
have unexpected side
