Lakshmi Manasa Gaduputi created SAMZA-2604:
----------------------------------------------

             Summary: Job coordinator High availability - Data model change to 
write/read physical execution container id mapping to logical Samza processor Id
                 Key: SAMZA-2604
                 URL: https://issues.apache.org/jira/browse/SAMZA-2604
             Project: Samza
          Issue Type: New Feature
            Reporter: Lakshmi Manasa Gaduputi
            Assignee: Lakshmi Manasa Gaduputi


Job coordinator (AM) High availability (HA) will bring up a new AM which can 
connect to already running containers of the job. This ticket is to capture the 
physical execution environment container id (ex:yarn container id 
"container_123") mapping to samza logical processor id (ex: 0,1,..).

Each container should write its mapping of physical id to logical id and AM 
should read this mapping. This mapping will be written to coordinator stream.

New AM coming up under HA will use this mapping to associate the already 
running yarn containers list handed to it from the ResourceManager. New AM 
using this mapping is part of future work and not a deliverable for this task.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

Reply via email to