turcsanyip commented on issue #3439: NIFI-6218 Support setting transactional.id 
in PublishKafka/PublishKaf…
URL: https://github.com/apache/nifi/pull/3439#issuecomment-489528652
 
 
   I am new to Kafka Transactional Id too, but as it seemed interesting, I 
looked into it too.
   
   @ijokarumawak You are right that the Transactional Id has to be unique but 
the cluster/host/processor uniqueness is not enough because the same processor 
can have multiple 
   threads configured (Concurrent Tasks > 1).
   
   The thread id could be appended to the Transactional Id but it would 
identify the thread the Kafka producer running on, not the producer instance 
itself, so maybe not the best solution. Generating an id for the producer in 
```PublisherLease``` might be better.
   
   The trivial solution would be to add ```@TriggerSerially``` but I think this 
is not we want due to performance reasons.

----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
[email protected]


With regards,
Apache Git Services

Reply via email to