set the following contents in /etc/security/limits.d/90-nproc.conf hadoop-user soft nproc 32000 hadoop-user hard nproc 32000 hadoop-user soft nofile 65535 hadoop-user hard nofile 65535
2013/12/18 Viswanathan J <[email protected]> > Hi, > > I have the ulimit of 999999, should be a problem? If yes what prob will > arise? > On Dec 18, 2013 12:05 AM, "rtejac" <[email protected]> wrote: > >> Depends on various factors like number of users, number of tasks like >> size of MR jobs etc.. 32K-64K is a safe bet. 128K is a bad number, but >> shouldn't harm. >> >> On Dec 17, 2013, at 9:10 AM, Viswanathan J <[email protected]> >> wrote: >> >> Hi, >> >> What value(ulimit) will be fair enough for jobtracker node. If it's too >> high will that cause thread block or any issue in jobtracker. >> >> Please help. >> >> >>
