When running application with lots of physical operators, Application master went down as it was not able to open any new connection because of limit on file handles. Do we open connection per containers or per operator partition. Also there were some failure, may be connection close is not happening when some containers are failing, (RPC timeout is set to high value) The user have soft limit set to 1024 and hard limit set to 4096 which is also low.
Is there any way (apex configuration property) for running container with increased soft limit. Or use need tos change system configuration to allow more open files per process. - Tushar. On Mon, Mar 7, 2016 at 9:17 PM, Munagala Ramanath <[email protected]> wrote: > *sysctl fs.file-max* > should show you the kernel limit. > > *ulimit -n* > shows the per-user limit > > You can see the list of open files used by a process with (where <pid> is > the process id): > *ls -l /proc/<pid>/fd* > > You can also use the *lsof* command described here: > http://www.thegeekstuff.com/2012/08/lsof-command-examples/ > > Are you running into the limit ? Can you share some details of the error > you're seeing ? > > Ram > > On Mon, Mar 7, 2016 at 12:25 AM, Kottapalli, Venkatesh < > [email protected]> wrote: > > > Hi, > > > > Is there a limit set by DT application by default on the > > number of files the application is working on? If so, is there a way to > > increase the soft limit set? > > > > -Venkatesh. > > > > >
