Todd Lipcon has submitted this change and it was merged. Change subject: Proper handling of 'Too many open files' errors ......................................................................
Proper handling of 'Too many open files' errors When using file block manager, it is possible to get 'Too many open files' error. When this error caused FlushMRS op to fail, new MRS is already created and old MRS is put into tablet components rowset tree, the old MRS will stay there forever (until maybe rowset compaction). Those MRS consume lots of memory, which causes write request to be throttled. Also not sure whether records in those MRS are properly persisted or log is not GCed when TS is restarted. Currently it is better to just FATAL on FlushMRS failure. Also we see ton of logs about accept failed, this patch also throttle those logs. Change-Id: I17135a68d34e5b0c56c628546f3ab2d7faa863ae Reviewed-on: http://gerrit.cloudera.org:8080/2606 Tested-by: Kudu Jenkins Reviewed-by: Todd Lipcon <[email protected]> --- M src/kudu/rpc/acceptor_pool.cc M src/kudu/tablet/tablet_peer_mm_ops.cc 2 files changed, 7 insertions(+), 4 deletions(-) Approvals: Todd Lipcon: Looks good to me, approved Kudu Jenkins: Verified -- To view, visit http://gerrit.cloudera.org:8080/2606 To unsubscribe, visit http://gerrit.cloudera.org:8080/settings Gerrit-MessageType: merged Gerrit-Change-Id: I17135a68d34e5b0c56c628546f3ab2d7faa863ae Gerrit-PatchSet: 2 Gerrit-Project: kudu Gerrit-Branch: master Gerrit-Owner: Binglin Chang <[email protected]> Gerrit-Reviewer: Kudu Jenkins Gerrit-Reviewer: Todd Lipcon <[email protected]>
