Re: Runtime Execution Model

Yes, I was expecting a separate thread for each task, which is not the case. I am not looking at scaling beyond a single machine though for a single job. Lukas -Original Message- From: Yi Pan Sent: Wednesday, September 16, 2015 5:04 PM To: dev@samza.apache.org Subject: Re: Runtime Ex

Re: Runtime Execution Model

Hi, Lukas, I currently use one process in a Docker container. My assumption was that > it already spawned multiple processes so I was comfortable with that > solution until we have to scale some job beyond one machine. > > I assume that you are referring "spawned multiple *threads*" instead of "s

Re: Runtime Execution Model

Hi, Yan, I put my thoughts below. On Wed, Sep 16, 2015 at 3:45 PM, Yan Fang wrote: > * Any progress in your side, in terms of the standalone job? (Chris' patch > is big, :) > > Yeah, we have paused on it for a quarter and will try to pick it up in Q4. > * Invert the JobCoordinator to the st

Re: Runtime Execution Model

Hi Yan, I currently use one process in a Docker container. My assumption was that it already spawned multiple processes so I was comfortable with that solution until we have to scale some job beyond one machine. Docker containers are restarted automatically on failure and we collect metrics

Re: Runtime Execution Model

-- Hi Lukas, I want to learn more from your production environment. How do you use ProcessJobFactory in Docker containers? Do you use one ProcessJobFactory process all the tasks, or spawn out as many threads as the task number? How is the fault-tolerance? -- Hi Yi, * Any progress in your side,

Re: Review Request 38049: SAMZA-769 Replace deprecated method call and fix warnings

--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/38049/ --- (Updated Sept. 16, 2015, 1:06 p.m.) Review request for samza. Changes ---

Re: Review Request 37817: SAMZA-619 - Modify SamzaAppMaster to enable host-affinity

--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/37817/ --- (Updated Sept. 16, 2015, 8:28 a.m.) Review request for samza, Yan Fang, Chinmay

Re: Review Request 37817: SAMZA-619 - Modify SamzaAppMaster to enable host-affinity

> On Sept. 11, 2015, 1:47 a.m., Yan Fang wrote: > > samza-core/src/main/java/org/apache/samza/job/model/JobModel.java, lines > > 65-72 > > > > > > duplicated code with line 116 - 122 Ok. Fixed it. > On Sept. 11, 2