There is a close of connections-handlers,
1391754021 INFO qfsBroker : (/root/src/hypertable/src/cc/DfsBroker/Lib/OpenFileMap.h:88) Removing handle 3 from open file map because of lost owning client connection follow is the RangeServer fs failures. the error happens just around the same time! When does the OpenFileMap decide actually to remove the handler. Thanks, Kashirin Alex On Friday, February 7, 2014 12:59:21 AM UTC+2, Alex Kashirin wrote: > > FIXED, the FD's id assignment (now, it is with the std::map managed) > > NOW, What was the FIX for the permission denied Issue on the QFSBroker > that was fix ? > > Current outputs: > > root@www-dev:/opt/hypertable/0.9.7.15/fs# du > 4 ./local/hypertable/tables/2/1/default/qyoNKN5rd__dbHKv > 8 ./local/hypertable/tables/2/1/default > 12 ./local/hypertable/tables/2/1 > 13540 ./local/hypertable/tables/2/0/default/qyoNKN5rd__dbHKv > 8 ./local/hypertable/tables/2/0/default/nOkqBfmTLuX1NEv6 > 13552 ./local/hypertable/tables/2/0/default > 4 ./local/hypertable/tables/2/0/_xfer/nOkqBfmTLuX1NEv6/1391726922 > 8 ./local/hypertable/tables/2/0/_xfer/nOkqBfmTLuX1NEv6 > 12 ./local/hypertable/tables/2/0/_xfer > 13568 ./local/hypertable/tables/2/0 > 13584 ./local/hypertable/tables/2 > 4 ./local/hypertable/tables/0/1/range/qyoNKN5rd__dbHKv > 8 ./local/hypertable/tables/0/1/range > 4 ./local/hypertable/tables/0/1/server/qyoNKN5rd__dbHKv > 8 ./local/hypertable/tables/0/1/server > 20 ./local/hypertable/tables/0/1 > 4 ./local/hypertable/tables/0/0/default/qyoNKN5rd__dbHKv > 4 ./local/hypertable/tables/0/0/default/4MmZEeUI1pJuk6SA > 12 ./local/hypertable/tables/0/0/default > 4 ./local/hypertable/tables/0/0/logging/qyoNKN5rd__dbHKv > 4 ./local/hypertable/tables/0/0/logging/4MmZEeUI1pJuk6SA > 12 ./local/hypertable/tables/0/0/logging > 4 ./local/hypertable/tables/0/0/location/qyoNKN5rd__dbHKv > 4 ./local/hypertable/tables/0/0/location/4MmZEeUI1pJuk6SA > 12 ./local/hypertable/tables/0/0/location > 40 ./local/hypertable/tables/0/0 > 64 ./local/hypertable/tables/0 > 13652 ./local/hypertable/tables > 13656 ./local/hypertable > 13660 ./local > 13740 . > root@www-dev:/opt/hypertable/0.9.7.15/fs# tail -n 17 > ../log/DfsBroker.qfs.log > 1391726923 INFO qfsBroker : > (/root/src/hypertable/src/cc/DfsBroker/qfs/QfsBroker.h:82) close( > /hypertable/tables/2/0/_xfer/nOkqBfmTLuX1NEv6/1391726922/0 , 23 ) > 1391726924 INFO qfsBroker : > (/root/src/hypertable/src/cc/DfsBroker/qfs/QfsBroker.cc:62) close(7) file: > /hypertable/tables/2/0/default/qyoNKN5rd__dbHKv/cs4 > 1391726928 INFO qfsBroker : > (/root/src/hypertable/src/cc/DfsBroker/qfs/QfsBroker.h:82) close( > /hypertable/tables/2/0/default/qyoNKN5rd__dbHKv/cs4 , 24 ) > 1391726928 INFO qfsBroker : > (/root/src/hypertable/src/cc/DfsBroker/qfs/QfsBroker.cc:171) > open(/hypertable/tables/2/0/default/qyoNKN5rd__dbHKv/cs4) = 7 > 1391726928 INFO qfsBroker : > (/root/src/hypertable/src/cc/DfsBroker/qfs/QfsBroker.cc:62) close(6) file: > /hypertable/tables/2/0/_xfer/nOkqBfmTLuX1NEv6/1391726922/0 > 1391726928 INFO qfsBroker : > (/root/src/hypertable/src/cc/DfsBroker/qfs/QfsBroker.cc:262) > create(/hypertable/tables/2/0/default/nOkqBfmTLuX1NEv6/hints) = 6 > 1391726928 INFO qfsBroker : > (/root/src/hypertable/src/cc/DfsBroker/qfs/QfsBroker.cc:62) close(6) file: > /hypertable/tables/2/0/default/nOkqBfmTLuX1NEv6/hints > 1391726928 INFO qfsBroker : > (/root/src/hypertable/src/cc/DfsBroker/qfs/QfsBroker.h:82) close( > /hypertable/tables/2/0/default/nOkqBfmTLuX1NEv6/hints , 25 ) > 1391726928 ERROR qfsBroker : > (/root/src/hypertable/src/cc/DfsBroker/qfs/QfsBroker.cc:259) > open(/hypertable/tables/2/0/default/qyoNKN5rd__dbHKv/hints) failure (15) - > Permission denied 13 > ERROR Permission denied 13 > 1391726928 ERROR qfsBroker : > (/root/src/hypertable/src/cc/DfsBroker/qfs/QfsBroker.cc:259) > open(/hypertable/tables/2/0/default/qyoNKN5rd__dbHKv/hints) failure (18) - > Permission denied 13 > ERROR Permission denied 13 > 1391726928 INFO qfsBroker : > (/root/src/hypertable/src/cc/DfsBroker/qfs/QfsBroker.cc:171) > open(/hypertable/tables/2/0/default/qyoNKN5rd__dbHKv/hints) = 6 > 1391726928 INFO qfsBroker : > (/root/src/hypertable/src/cc/DfsBroker/qfs/QfsBroker.h:82) close( > /hypertable/tables/2/0/default/qyoNKN5rd__dbHKv/hints , 32 ) > 1391726928 INFO qfsBroker : > (/root/src/hypertable/src/cc/DfsBroker/qfs/QfsBroker.cc:62) close(6) file: > /hypertable/tables/2/0/default/qyoNKN5rd__dbHKv/hints > 1391726928 INFO qfsBroker : > (/root/src/hypertable/src/cc/DfsBroker/qfs/QfsBroker.h:82) close( > /hypertable/tables/2/0/default/qyoNKN5rd__dbHKv/hints , 34 ) > 1391726928 INFO qfsBroker : > (/root/src/hypertable/src/cc/DfsBroker/qfs/QfsBroker.cc:171) > open(/hypertable/tables/2/0/default/qyoNKN5rd__dbHKv/cs4) = 6 > root@www-dev:/opt/hypertable/0.9.7.15/fs# > > > > QfsShell> cd 0/default/qyoNKN5rd__dbHKv/ > QfsShell> ls > cs4 > hints > QfsShell> ls -l > cs4 <r 3> rw-r--r-- root root 13857280 Feb 6 15:48 > hints <r 3> rw-r--r-- root root 163 Feb 6 15:46 > > QfsShell> ls -l > servers/ <dir> rwxr-xr-x root root 2682 Feb 6 15:44 > tables/ <dir> rwxr-xr-x root root 13857732 Feb 6 15:44 > > > > root@www-dev:/opt/hypertable/ > 0.9.7.15/fs/local/hypertable/tables/2/0/default/qyoNKN5rd__dbHKv# ls -l > total 13536 > -rw-r--r-- 1 root root 13857280 Feb 6 15:48 cs4 > -rw-r--r-- 1 root root 0 Feb 6 15:48 hints > > Thanks, need help with the Permission Denied QFS issue! > > Kashirin Alex > > > On Wednesday, February 5, 2014 3:26:20 AM UTC+2, Alex Kashirin wrote: >> >> Before I ruin the copy. >> >> This copy, >> >> m_open_file_map assigned with ID of pairs- while the ID-fd is an >> generated num grow by 2 (eg. 1 as DFS 2 as local the connection resources >> fd) >> >> still to work out a more proper ID to use, as might the loop is >> out-breaking. >> >> on the request of fd, and it is RS-data , it's open_file_map is fd+1 (the >> meta is the fd) >> >> the fd key , get assigned at open/create as well with file type. >> >> 1 > for Meta >> >> 2 > for RS-data(table) >> >> if(filePath == "Fsrv") fileType[USE_openFilesCount] = 1; >> else fileType[USE_openFilesCount] = 2; >> >> USE_openFilesCount --- Is the key for file_map, while for the local data >> it is the USE_openFilesCount+1 >> >> addr is the same for both new file_map >> >> >> >> Let me know, if you think there is an issue of such way around. >> >> By the way, with the key assigned for fd, it is a way around to manage >> the number of open_file_descriptors on the system. >> >> >> >> Thanks, >> >> Kashirin Alex >> >> >> >> On Tuesday, February 4, 2014 8:11:03 AM UTC+2, Alex Kashirin wrote: >>> >>> the QFSbroker combined with local FS. >>> >>> m_open_file_map get assigned predefined IDs to store by. >>> >>> >>> It's now a more better version, Doug you can just download it from the >>> server , the log details on the older email. >>> >>> >>> Thanks, >>> >>> Kashirin Alex >>> >>> >>> >>> >>> On Monday, February 3, 2014 7:33:42 PM UTC+2, Alex Kashirin wrote: >>>> >>>> Why the localbroker use FileUtils and not Filesystem.h (the FileSystem >>>> has close file descriptor while the FileUtils do not!) >>>> >>>> >>>> the localBroker, might not closing the open file descriptors >>>> >>>> >>>> Thanks, >>>> >>>> Kashirin Alex >>>> >>>> >>>> >>>> On Sunday, February 2, 2014 3:32:50 AM UTC+2, Alex Kashirin wrote: >>>>> >>>>> Will be good to have opinions on the built and run. >>>>> >>>>> cmake file needs to be updated. >>>>> >>>>> does not contain Java related. >>>>> >>>>> Thanks, >>>>> >>>>> Kashirin Alex >>>>> >>>>> >>>>> -- You received this message because you are subscribed to the Google Groups "Hypertable Development" group. To unsubscribe from this group and stop receiving emails from it, send an email to [email protected]. To post to this group, send email to [email protected]. Visit this group at http://groups.google.com/group/hypertable-dev. For more options, visit https://groups.google.com/groups/opt_out.
