That's great, so is there support to pin task managers to sockets as well? On Sat, Jul 2, 2016 at 11:08 AM, Ufuk Celebi <u...@apache.org> wrote:
> Regarding 2) if you don't manually configure something else, that > should happen always. > > Yes, you can run more than one task manager per node depending on the > process isolation you want. Within a task manager, there are multiple > threads for each slot. For example, if you have 2 task managers with 2 > slots each and submit a job with parallelism 4, each task manager will > execute 2 sub tasks in separate Threads. > > > On Sat, Jul 2, 2016 at 3:26 AM, Saliya Ekanayake <esal...@gmail.com> > wrote: > > Hi Ufuk, > > > > Looking at the document you sent it seems only 1 task manager per node > exist > > and within that you have multiple slots. Is it possible to run more than > 1 > > task manager per node? Also, within a task manager is the parallelism > done > > through threads or processes? > > > > Thank you, > > Saliya > > > > On Thu, Jun 30, 2016 at 5:27 PM, Saliya Ekanayake <esal...@gmail.com> > wrote: > >> > >> Thank you, I'll check these. > >> > >> In 2.) you said they are likely to exchange through memory. Is there a > >> case why they wouldn't? > >> > >> On Thu, Jun 30, 2016 at 5:03 AM, Ufuk Celebi <u...@apache.org> wrote: > >>> > >>> On Thu, Jun 30, 2016 at 1:44 AM, Saliya Ekanayake <esal...@gmail.com> > >>> wrote: > >>> > 1. What parameters are available to control parallelism within a > node? > >>> > >>> Task Manager processing slots: > >>> > >>> > https://ci.apache.org/projects/flink/flink-docs-release-1.0/setup/config.html#configuring-taskmanager-processing-slots > >>> > >>> > 2. Does Flink support shared memory-based messaging within a node > >>> > (without > >>> > doing TCP calls)? > >>> > >>> Yes, local exchanges happen via memory and not TCP, for example if you > >>> have a map-reduce, map subtask 1 and reduce subtask 1 are likely to > >>> exchange data locally. > >>> > >>> > 3. Is there support for Infiniband interconnect? > >>> > >>> No, not that I'm aware of. > >>> > >>> – Ufuk > >> > >> > >> > >> > >> -- > >> Saliya Ekanayake > >> Ph.D. Candidate | Research Assistant > >> School of Informatics and Computing | Digital Science Center > >> Indiana University, Bloomington > >> > > > > > > > > -- > > Saliya Ekanayake > > Ph.D. Candidate | Research Assistant > > School of Informatics and Computing | Digital Science Center > > Indiana University, Bloomington > > > -- Saliya Ekanayake Ph.D. Candidate | Research Assistant School of Informatics and Computing | Digital Science Center Indiana University, Bloomington
