Binglin Chang has uploaded a new change for review. http://gerrit.cloudera.org:8080/2606
Change subject: Proper handling of 'Too many open files' errors ...................................................................... Proper handling of 'Too many open files' errors When using file block manager, it is possible to get 'Too many open files' error. When this error caused FlushMRS op to fail, new MRS is already created and old MRS is put into tablet components rowset tree, the old MRS will stay there forever (until maybe rowset compaction). Those MRS consume lots of memory, which causes write request to be throttled. Also not sure whether records in those MRS are properly persisted or log is not GCed when TS is restarted. Currently it is better to just FATAL on FlushMRS failure. Also we see ton of logs about accept failed, this patch also throttle those logs. Change-Id: I17135a68d34e5b0c56c628546f3ab2d7faa863ae --- M src/kudu/rpc/acceptor_pool.cc M src/kudu/tablet/tablet_peer_mm_ops.cc 2 files changed, 7 insertions(+), 4 deletions(-) git pull ssh://gerrit.cloudera.org:29418/kudu refs/changes/06/2606/1 -- To view, visit http://gerrit.cloudera.org:8080/2606 To unsubscribe, visit http://gerrit.cloudera.org:8080/settings Gerrit-MessageType: newchange Gerrit-Change-Id: I17135a68d34e5b0c56c628546f3ab2d7faa863ae Gerrit-PatchSet: 1 Gerrit-Project: kudu Gerrit-Branch: master Gerrit-Owner: Binglin Chang <[email protected]>
