Hello Mike Percy, Adar Dembo, Todd Lipcon,
I'd like you to do a code review. Please visit
http://gerrit.cloudera.org:8080/4958
to review the following change.
Change subject: [rpc] Close socket on non-linux platforms during RPC shutdown
......................................................................
[rpc] Close socket on non-linux platforms during RPC shutdown
While using a MiniTabletServer::Restart() functionality, it was observed
that tablet server was not able to bind to same socket again on OS X.
It turns out non-linux platforms can leave the stale sockets behind
when we shutdown the RPC server. While shutdown() is not available on
platforms other than linux, we should be able to close() the socket on
other platforms to make sure stale fds are not left behind.
NOTE: This change is expected to impact non-linux platforms only.
Traces from the log which originally observed the issue:
W1104 14:58:36.040030 1953316864 net_util.cc:293] Failed to bind to
0.0.0.0:56021. Trying to use lsof to find any processes listening on the same
port:
I1104 14:58:36.040457 1953316864 net_util.cc:296] $ lsof -n -i 'TCP:56021'
-sTCP:LISTEN ; for pid in $(lsof -F p -n -i 'TCP:56021' -sTCP:LISTEN | cut -f 2
-dp) ; do pstree $pid || ps h -p $pid;done
W1104 14:58:36.147557 1953316864 net_util.cc:303] COMMAND PID USER FD
TYPE DEVICE SIZE/OFF NODE NAME
rpc-test 38600 dinesh 8u IPv4 0xcf92530d59e2332d 0t0 TCP *:56021
(LISTEN)
-+= 38600 dinesh ./bin/rpc-test
--gtest_filter=TestRpc.TestAcceptorPoolSocketShutDown
\-+- 38601 dinesh bash -c lsof -n -i 'TCP:56021' -sTCP:LISTEN ; for pid in
$(lsof -F p -n -i 'TCP:56021' -sTCP:LISTEN | cut -f 2 -dp) ; do pstree $pid ||
ps h -p $pid;done
\-+- 38608 dinesh pstree 38600
\--- 38609 root ps -axwwo user,pid,ppid,pgid,command
../../src/kudu/rpc/rpc-test.cc:106: Failure
Failed
Bad status: Network error: error binding socket to 0.0.0.0:56021:
Address already in use (error 48)
Change-Id: I1ed12bd5e4be5ee932196e77ce2f0ecd3810c992
---
M src/kudu/rpc/acceptor_pool.cc
M src/kudu/rpc/rpc-test.cc
2 files changed, 21 insertions(+), 1 deletion(-)
git pull ssh://gerrit.cloudera.org:29418/kudu refs/changes/58/4958/1
--
To view, visit http://gerrit.cloudera.org:8080/4958
To unsubscribe, visit http://gerrit.cloudera.org:8080/settings
Gerrit-MessageType: newchange
Gerrit-Change-Id: I1ed12bd5e4be5ee932196e77ce2f0ecd3810c992
Gerrit-PatchSet: 1
Gerrit-Project: kudu
Gerrit-Branch: master
Gerrit-Owner: Dinesh Bhat <[email protected]>
Gerrit-Reviewer: Adar Dembo <[email protected]>
Gerrit-Reviewer: Mike Percy <[email protected]>
Gerrit-Reviewer: Todd Lipcon <[email protected]>
