Maybe you could store the version number in kafka by publishing it to a topic with compaction mode. You could then consume the messages and do a version comparison. But for me such a simple task should be made easier.
2015-09-20 0:25 GMT+02:00 Richard Lee <rd...@tivo.com>: > Hi there- > > How do people track which version of a samza job is running in yarn? The > job name and job id can’t be used, as they are used to create the > checkpoint topic, etc. I’m looking for a way of determining if the current > job running in yarn is the latest version, and if not, kill it and launch a > newer version, picking up where the previous version left off. > > There seems to be no ‘job version’ field anywhere obvious in either samza > or yarn. > > Is there another approach I should use? > > Richard > >
