Hello Bryan ,

I have read about the enforce order processor and have timestamp part in my
files which are unique and actually files are created in the order of events
happening.
I can read the flow file and extract this timestamp , convert this to unix
timestamp and make it as an attribute for Nifi.
But once all the flow reached till queue before publish kafka, actual
problem/confusion comes.

So If i have 12 files which are sorted with timestamp they are in queue just
before the Publish Kafka .

As I understood correctly each publish kafka processor is unique
publisher.So if my cluster is having 3 nodes and with 2 threads,
I believe Nifi will spawn 6 publishers .[Correct me if i am wrong.]

Lets say if each will get 2 files , there is no way to enfore order ,
publisher 1 may publish its records 
before publisher 2 .

I believe running on primary node is the only was for these scenarios I
guess so far untill some global order kind of concept is introduced in Nifi.





--
Sent from: http://apache-nifi-developer-list.39713.n7.nabble.com/

Reply via email to