Adding to Zlatko anwser,
You definitely need a queuing system (or probably is using it already).
That is because it's a long running job from what I understand (as you
mentioned magnitude of hours). The queuing system can be a simple custom
solution based on a database or even plain filesystem
Hi MrNode,
This is way too generic task description to be node-specific. We don't know
how is the file processed. We don't know how is this CSV processing needs
to be atomic or not - it seems yes, but not clear. We don't know if you can
abort it or not. We don't know if you want to block the
