Hi - >Hello, > > > >I'm running the hpl benchmark with the latest Chapel release 1.15 on >multi-locale. It's running OK on 2,4,8,16 nodes, until 32 nodes, where it >reports the error: >*** FATAL ERROR: GASNet Extended API: Too many simultaneous local client >threads (limit=256). To raise this limit, configure GASNet using >--with-max-pthreads-per-node=N. > > >Is it reasonable to have this error when running on 32 nodes?
I'm not familiar with that error but it sounds like something to do with the number of threads you are running per locale. How many cores do the compute nodes have? Is it possible that all of the tasks are accidentally running on 1 node? Have you tried running the Chapel program with the -v option to observe the job launcher? Does hello6-taskpar-dist.chpl print out different machine names for each locale when you run it? > I read this > >http://chapel.cray.com/docs/1.15/usingchapel/tasks.html#id2 ><http://chapel.cray.com/docs/1.15/usingchapel/tasks.html#id2> In order >to run it on 32 nodes, shall I set >CHPL_RT_NUM_THREADS_PER_LOCALE >and rebuild Chapel? Or in what other way? Thanks > > >Here's my env: > >CHPL_TARGET_PLATFORM: linux64 >CHPL_TARGET_COMPILER: gnu >CHPL_TARGET_ARCH: native * >CHPL_LOCALE_MODEL: flat >CHPL_COMM: gasnet * > CHPL_COMM_SUBSTRATE: ibv * > CHPL_GASNET_SEGMENT: large >CHPL_TASKS: fifo * >CHPL_LAUNCHER: gasnetrun_ibv * >CHPL_TIMERS: generic >CHPL_UNWIND: none >CHPL_MEM: jemalloc >CHPL_MAKE: gmake >CHPL_ATOMICS: intrinsics > CHPL_NETWORK_ATOMICS: none >CHPL_GMP: gmp >CHPL_HWLOC: none >CHPL_REGEXP: re2 >CHPL_WIDE_POINTERS: struct >CHPL_AUX_FILESYS: none > > > >​Besides, I'm a little confused of "local" statement. According to >http://chapel.cray.com/docs/1.15/technotes/local.html?highlight=local, is >it just used to assert the communication free statements in the block? Or >it's used as an performance > optimization? local blocks are a performance optimization. They do assert that the operations are local but might not do so with --fast. -michael > > > >Thanks > > >-- >Best regards > > >Hui Zhang > > ------------------------------------------------------------------------------ Check out the vibrant tech community on one of the world's most engaging tech sites, Slashdot.org! http://sdm.link/slashdot _______________________________________________ Chapel-developers mailing list [email protected] https://lists.sourceforge.net/lists/listinfo/chapel-developers
