Lakshmi Manasa Gaduputi created SAMZA-2604:
----------------------------------------------
Summary: Job coordinator High availability - Data model change to
write/read physical execution container id mapping to logical Samza processor Id
Key: SAMZA-2604
URL: https://issues.apache.org/jira/browse/SAMZA-2604
Project: Samza
Issue Type: New Feature
Reporter: Lakshmi Manasa Gaduputi
Assignee: Lakshmi Manasa Gaduputi
Job coordinator (AM) High availability (HA) will bring up a new AM which can
connect to already running containers of the job. This ticket is to capture the
physical execution environment container id (ex:yarn container id
"container_123") mapping to samza logical processor id (ex: 0,1,..).
Each container should write its mapping of physical id to logical id and AM
should read this mapping. This mapping will be written to coordinator stream.
New AM coming up under HA will use this mapping to associate the already
running yarn containers list handed to it from the ResourceManager. New AM
using this mapping is part of future work and not a deliverable for this task.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)