Re: How are samza.container.id generated in yarn?

2021-04-22 Thread Yi Pan
Hi, Debraj,

In YARN environment, Samza uses YARN generated containerIds as
environmental variables to set each container process's samza.container.id.
i.e. when containers are requested by Samza AM process in YARN, YARN RM
will reply with a set of allocated container objects, which is of class
org.apache.hadoop.yarn.api.records.Container. That's the resource class to
uniquely identify a container in YARN and Container#getId().toString() is
the container ID string we set to samza.container.id.

Best,

-Yi

On Wed, Apr 21, 2021 at 11:28 PM Debraj Manna 
wrote:

> The same has been asked in stackoverflow
> <
> https://stackoverflow.com/questions/67207850/how-does-samza-generate-the-container-id-when-the-application-is-deployed-in-yar
> >
> also. Anyone any thoughts on this?
>
>
> https://stackoverflow.com/questions/67207850/how-does-samza-generate-the-container-id-when-the-application-is-deployed-in-yar
>
> On Wed, Apr 21, 2021 at 6:08 PM Debraj Manna 
> wrote:
>
> > Hi
> >
> > Can someone let me know how is "samza.container.id" generated when a
> > samza app is running in yarn?
> >
> > Thanks,
> >
> >
>


Re: How are samza.container.id generated in yarn?

2021-04-22 Thread Debraj Manna
The same has been asked in stackoverflow

also. Anyone any thoughts on this?

https://stackoverflow.com/questions/67207850/how-does-samza-generate-the-container-id-when-the-application-is-deployed-in-yar

On Wed, Apr 21, 2021 at 6:08 PM Debraj Manna 
wrote:

> Hi
>
> Can someone let me know how is "samza.container.id" generated when a
> samza app is running in yarn?
>
> Thanks,
>
>