Re: Large number of used ports from tserver

2018-01-24 Thread Josh Elser
+1 to looking at the remote end of the socket and see where they're going/coming to/from. I've seen a few HDFS JIRA issues filed about sockets left in CLOSED_WAIT. Lucky you, this is a fun Linux rabbit hole to go down :)

Re: Large number of used ports from tserver

2018-01-24 Thread Christopher
I haven't seen that, but I'm curious what OS, Hadoop, ZooKeeper, and Accumulo version you're running. I'm assuming you verified that it was the TabletServer process holding these TCP sockets open using `netstat -p` and cross-referencing the PID with `jps -ml` (or similar)? Are you able to confirm

Large number of used ports from tserver

2018-01-24 Thread Adam J. Shook
Hello all, Has anyone come across an issue with a TabletServer occupying a large number of ports in a CLOSED_WAIT state? 'Normal' number of used ports on a 12-node cluster are around 12,000 to 20,000 ports. In one instance, there were over 68k and it was affecting other applications from