Hi kuer, Comments inline...
2009/7/21 kuer <[email protected]> > [...] > I found some files opened many times before close : > $ grep -n 'fd=7398' dfs.log > 14310:2009-07-15 03:28:06,774 1156786496 kosmosBroker [INFO] (kosmos/ > KosmosBroker.cc:86) open( /hypertable/tables/storage_se/default/ > 75C73F17368096C166F0DC49/cs46 ) fd=7398 local_fd=1370 > 29715:2009-07-18 07:57:12,230 1216268608 kosmosBroker [INFO] (kosmos/ > KosmosBroker.cc:86) open( /hypertable/tables/storage_se/default/ > C8A2F2AC3B035CE469808D05/cs5 ) fd=7398 local_fd=1703 > 32123:2009-07-18 12:17:11,049 1153329472 kosmosBroker [INFO] (kosmos/ > KosmosBroker.cc:148) close fd=7398 If you have cronolog installed, each successive run of Hypertable will append log data to the same set of log files. I suspect that these two open lines were from two different runs of the RangeServer. I also found some files opened but never close : > $ grep -n 'fd=7350' dfs.log > 14221:2009-07-15 01:31:19,662 1261685056 kosmosBroker [INFO] (kosmos/ > KosmosBroker.cc:131) create( /hypertable/tables/storage_se/default/ > 06825ADA6690593E88E09C91/cs53 ) fd=7350 local_fd=1372 > 14233:2009-07-15 01:31:21,995 1272174912 kosmosBroker [INFO] (kosmos/ > KosmosBroker.cc:148) close fd=7350 > 29631:2009-07-18 07:42:17,139 1237248320 kosmosBroker [INFO] (kosmos/ > KosmosBroker.cc:86) open( /hypertable/tables/storage_se/default/ > D9AFD0F87BF44F88B676BCC1/cs77 ) fd=7350 local_fd=1358 Currently when the RangeServer opens a cell store, it leaves it open. This seems to work fine on HDFS. You should check on the KFS mailing list to see if there is any limitation on the number of file handles that can be open or if there is some penalty to having an open file handle. - Doug --~--~---------~--~----~------------~-------~--~----~ You received this message because you are subscribed to the Google Groups "Hypertable Development" group. To post to this group, send email to [email protected] To unsubscribe from this group, send email to [email protected] For more options, visit this group at http://groups.google.com/group/hypertable-dev?hl=en -~----------~----~----~----~------~----~------~--~---
