Hi Ramesh, Currently the only way to run in Distributed mode is to use Yarn. But, we're working on re-designing the JobCoordinator to be pluggable so that we can put in multiple implementations. After the re-design I expect users to be able to run Samza with Yarn, Mesos, ECS (containerized environments), or even processes on EC2 instances.
SAMZA-516 was a first step to run stand-alone Samza without Yarn. https://github.com/eliaslevy/samza_kubernetes talks about using Kubernetes as a scheduler. Thanks Jagadish On Fri, Feb 12, 2016 at 3:17 PM, Ramesh Bhojan <rbhojan.soc...@gmail.com> wrote: > Hi All, > For running Samza jobs on scale, are there other ways (if we are not using > YARN yet), to configure a samza job/task to run on multiple containers to > achieve parallelism? > > Regards, > Ramesh > -- Jagadish V, Graduate Student, Department of Computer Science, Stanford University
