Hi, Doug, > If you have cronolog installed, each successive run of Hypertable will > append log data to the same set of log files. I suspect that these two open > lines were from two different runs of the RangeServer.
I have no cronolog running. The log files was generated by one process only. Maybe there are multiple threads in it, but the files were opened in one process. > Currently when the RangeServer opens a cell store, it leaves it open. This > seems to work fine on HDFS. You should check on the KFS mailing list to see > if there is any limitation on the number of file handles that can be open or > if there is some penalty to having an open file handle. I think overhead of chunk-buffer is a somehow penalty if too many files were left open in KFS. -- kuer On 7月21日, 下午9时27分, Doug Judd <[email protected]> wrote: > Hi kuer, > > Comments inline... > > 2009/7/21 kuer <[email protected]> > > > [...] > > I found some files opened many times before close : > > $ grep -n 'fd=7398' dfs.log > > 14310:2009-07-15 03:28:06,774 1156786496 kosmosBroker [INFO] (kosmos/ > > KosmosBroker.cc:86) open( /hypertable/tables/storage_se/default/ > > 75C73F17368096C166F0DC49/cs46 ) fd=7398 local_fd=1370 > > 29715:2009-07-18 07:57:12,230 1216268608 kosmosBroker [INFO] (kosmos/ > > KosmosBroker.cc:86) open( /hypertable/tables/storage_se/default/ > > C8A2F2AC3B035CE469808D05/cs5 ) fd=7398 local_fd=1703 > > 32123:2009-07-18 12:17:11,049 1153329472 kosmosBroker [INFO] (kosmos/ > > KosmosBroker.cc:148) close fd=7398 > > If you have cronolog installed, each successive run of Hypertable will > append log data to the same set of log files. I suspect that these two open > lines were from two different runs of the RangeServer. > > I also found some files opened but never close : > > > $ grep -n 'fd=7350' dfs.log > > 14221:2009-07-15 01:31:19,662 1261685056 kosmosBroker [INFO] (kosmos/ > > KosmosBroker.cc:131) create( /hypertable/tables/storage_se/default/ > > 06825ADA6690593E88E09C91/cs53 ) fd=7350 local_fd=1372 > > 14233:2009-07-15 01:31:21,995 1272174912 kosmosBroker [INFO] (kosmos/ > > KosmosBroker.cc:148) close fd=7350 > > 29631:2009-07-18 07:42:17,139 1237248320 kosmosBroker [INFO] (kosmos/ > > KosmosBroker.cc:86) open( /hypertable/tables/storage_se/default/ > > D9AFD0F87BF44F88B676BCC1/cs77 ) fd=7350 local_fd=1358 > > Currently when the RangeServer opens a cell store, it leaves it open. This > seems to work fine on HDFS. You should check on the KFS mailing list to see > if there is any limitation on the number of file handles that can be open or > if there is some penalty to having an open file handle. > > - Doug --~--~---------~--~----~------------~-------~--~----~ You received this message because you are subscribed to the Google Groups "Hypertable Development" group. To post to this group, send email to [email protected] To unsubscribe from this group, send email to [email protected] For more options, visit this group at http://groups.google.com/group/hypertable-dev?hl=en -~----------~----~----~----~------~----~------~--~---
