Those messages are innocuous as well. The garbage collector is written in such a way that it sometimes tries to delete CellStores that do not exist.
- Doug On Fri, May 6, 2011 at 7:48 PM, Pany Yue <[email protected]> wrote: > Thanks for you reply. It seems ok, because application programs have no > scan or write error. > > But DfsBroker has many 'unlink error', Does it matter? > > > > 2011/5/7 Doug Judd <[email protected]> > >> Hi Pany, >> >> Those messages are normal (notice that they're INFO, not ERROR). This >> happens when ranges split and the writing clients METADATA cache gets stale. >> The client will re-scan the METADATA table to refresh its cache upon >> encountering these exceptions. This all happens transparently and your >> loading clients will handle them properly and re-submit any updates that >> were mis-directed. >> >> - Doug >> >> On Fri, May 6, 2011 at 7:07 PM, Pany Yue <[email protected]> wrote: >> >>> hi, >>> I deploy allservers on one machine, used localBroker. There are 50 client >>> scaning and writing concurrently. >>> The cluster has two tables, about 100 columns per table; >>> >>> As the time goes on (after running 1 days), there are many 'range not >>> found' exception in RangeServer log: >>> >>> 1304733259 INFO Hypertable.RangeServer : >>> (/home/itlanger/hypertable/src_for_build/hypertable-0.9.4.3-alpha/src/cc/Hypertable/RangeServer/RangeServer.cc:853) >>> Hypertable::Exception: (a) 1/0[..00245_ >>> http://www.mianjinhuo.com/-product-9412.html] - RANGE SERVER range not >>> found >>> 1304733259 INFO Hypertable.RangeServer : >>> (/home/itlanger/hypertable/src_for_build/hypertable-0.9.4.3-alpha/src/cc/Hypertable/RangeServer/RangeServer.cc:853) >>> Hypertable::Exception: (a) 1/0[..00245_ >>> http://www.mianjinhuo.com/-product-9412.html] - RANGE SERVER range not >>> found >>> 1304733300 INFO Hypertable.RangeServer : >>> (/home/itlanger/hypertable/src_for_build/hypertable-0.9.4.3-alpha/src/cc/Hypertable/RangeServer/RangeServer.cc:853) >>> Hypertable::Exception: (a) 1/0[..00245_ >>> http://www.mianjinhuo.com/-product-9412.html] - RANGE SERVER range not >>> found >>> 1304733301 INFO Hypertable.RangeServer : >>> (/home/itlanger/hypertable/src_for_build/hypertable-0.9.4.3-alpha/src/cc/Hypertable/RangeServer/RangeServer.cc:853) >>> Hypertable::Exception: (a) 1/0[..00245_ >>> http://www.mianjinhuo.com/-product-9412.html] - RANGE SERVER range not >>> found >>> 1304733536 INFO Hypertable.RangeServer : >>> (/home/itlanger/hypertable/src_for_build/hypertable-0.9.4.3-alpha/src/cc/Hypertable/RangeServer/RangeServer.cc:853) >>> Hypertable::Exception: (a) 1/0[01484_ >>> http://pic.onlylady.com/pic-128664.shtml..01730_http://www.yfdmt.cn/company_id.aspx-ID-33] >>> - RANGE SERVER range not found >>> 1304733537 INFO Hypertable.RangeServer : >>> (/home/itlanger/hypertable/src_for_build/hypertable-0.9.4.3-alpha/src/cc/Hypertable/RangeServer/RangeServer.cc:853) >>> Hypertable::Exception: (a) 1/0[01484_ >>> http://pic.onlylady.com/pic-128664.shtml..01730_http://www.yfdmt.cn/company_id.aspx-ID-33] >>> - RANGE SERVER range not found >>> 1304733538 INFO Hypertable.RangeServer : >>> (/home/itlanger/hypertable/src_for_build/hypertable-0.9.4.3-alpha/src/cc/Hypertable/RangeServer/RangeServer.cc:853) >>> Hypertable::Exception: (a) 1/0[01484_ >>> http://pic.onlylady.com/pic-128664.shtml..01730_http://www.yfdmt.cn/company_id.aspx-ID-33] >>> - RANGE SERVER range not found >>> 1304733538 INFO Hypertable.RangeServer : >>> (/home/itlanger/hypertable/src_for_build/hypertable-0.9.4.3-alpha/src/cc/Hypertable/RangeServer/RangeServer.cc:853) >>> Hypertable::Exception: (a) 1/0[01484_ >>> http://pic.onlylady.com/pic-128664.shtml..01730_http://www.yfdmt.cn/company_id.aspx-ID-33] >>> - RANGE SERVER range not found >>> 1304733538 INFO Hypertable.RangeServer : >>> (/home/itlanger/hypertable/src_for_build/hypertable-0.9.4.3-alpha/src/cc/Hypertable/RangeServer/RangeServer.cc:853) >>> Hypertable::Exception: (a) 1/0[01484_ >>> http://pic.onlylady.com/pic-128664.shtml..01730_http://www.yfdmt.cn/company_id.aspx-ID-33] >>> - RANGE SERVER range not found >>> 1304733539 INFO Hypertable.RangeServer : >>> (/home/itlanger/hypertable/src_for_build/hypertable-0.9.4.3-alpha/src/cc/Hypertable/RangeServer/RangeServer.cc:853) >>> Hypertable::Exception: (a) 1/0[01484_ >>> http://pic.onlylady.com/pic-128664.shtml..01730_http://www.yfdmt.cn/company_id.aspx-ID-33] >>> - RANGE SERVER range not found >>> >>> grep "range not found" Hypertable.RangeServer.log |wc -l >>> 2638 >>> >>> >>> DfsBroker has many 'unlink failed:' error: >>> >>> 1304733379 ERROR localBroker : >>> (/home/itlanger/hypertable/src_for_build/hypertable-0.9.4.3-alpha/src/cc/DfsBroker/local/LocalBroker.cc:339) >>> unlink failed: file='/home/itlanger/hypertable/install/ >>> 0.9.4.3/fs/local/hypertable/tables/1/0/default/zWEHsrXyNQ2hXOZU/cs11' - >>> No such file or directory >>> 1304733379 ERROR localBroker : >>> (/home/itlanger/hypertable/src_for_build/hypertable-0.9.4.3-alpha/src/cc/DfsBroker/local/LocalBroker.cc:339) >>> unlink failed: file='/home/itlanger/hypertable/install/ >>> 0.9.4.3/fs/local/hypertable/tables/1/0/default/zWEHsrXyNQ2hXOZU/cs17' - >>> No such file or directory >>> 1304733379 ERROR localBroker : >>> (/home/itlanger/hypertable/src_for_build/hypertable-0.9.4.3-alpha/src/cc/DfsBroker/local/LocalBroker.cc:339) >>> unlink failed: file='/home/itlanger/hypertable/install/ >>> 0.9.4.3/fs/local/hypertable/tables/1/0/default/zWEHsrXyNQ2hXOZU/cs18' - >>> No such file or directory >>> 1304733379 ERROR localBroker : >>> (/home/itlanger/hypertable/src_for_build/hypertable-0.9.4.3-alpha/src/cc/DfsBroker/local/LocalBroker.cc:339) >>> unlink failed: file='/home/itlanger/hypertable/install/ >>> 0.9.4.3/fs/local/hypertable/tables/1/0/default/zWEHsrXyNQ2hXOZU/cs19' - >>> No such file or directory >>> 1304733379 ERROR localBroker : >>> (/home/itlanger/hypertable/src_for_build/hypertable-0.9.4.3-alpha/src/cc/DfsBroker/local/LocalBroker.cc:339) >>> unlink failed: file='/home/itlanger/hypertable/install/ >>> 0.9.4.3/fs/local/hypertable/tables/1/0/default/gXoC7r0CFdES54oC/cs6' - >>> No such file or directory >>> >>> grep "unlink failed:" DfsBroker.local.log |wc -l >>> 6613 >>> >>> here is the rsstat: >>> >>> RangeServerStats = {timestamp=1304733913325175000, >>> measurement_period=-741723592, disk_available KB=706542, disk_used >>> KB=680086, disk_read_KBps=0, disk_write_KBps=0, disk_read_rate=0, >>> disk_write_rate=0, mem_total KB=16058304, mem_used KB=15114304, vm_size >>> KB=8688023, vm_resident KB=7043636, net_recv_KBps=0, net_send_KBps=0, >>> loadavg_0=1.72, loadavg_1=1.89, loadavg_2=2.02, cpu_pct=0.00, num_cores=8, >>> clock_mhz=2493, num_ranges=145, scans=11146, cells_read=25058, >>> bytes_read=52026501, updates=15212, syncs=15212, cells_written=22414, >>> bytes_written=5763379, query_cache_max_memory=50000000, >>> query_cache_available_memory=31059521, query_cache_accesses=2385, >>> query_cache_hits=5, block_cache_max_memory=4000000000, >>> block_cache_available_memory=189998, block_cache_accesses=3012, >>> block_cache_hits=2790RangeStats= {RangeId=007E499DB17F710CD15A540F96D4F636, >>> TableId=1/0, SchemaGeneration=1, scans=14, cells_read=50, bytes_read=9519, >>> cells_written=26, bytes_written=4233, bloom_filter_accesses=112, >>> bloom_filter_maybes=14, bloom_filter_false_positives=0, >>> bloom_filter_memory53760, shadow_cache_memory=0, block_index_memory=556760, >>> memory_allocated=1048576, memory_used=730159, disk_used=258017548} >>> RangeStats= {RangeId=033C4BF4650605228C54C47E3B48B4D8, TableId=1/0, >>> SchemaGeneration=1, scans=21, cells_read=62, bytes_read=87861, >>> cells_written=62, bytes_written=332026, bloom_filter_accesses=126, >>> bloom_filter_maybes=18, bloom_filter_false_positives=0, >>> bloom_filter_memory55296, shadow_cache_memory=0, block_index_memory=548778, >>> memory_allocated=1048576, memory_used=887224, disk_used=256125360} >>> RangeStats= {RangeId=03AEDE16F994E807B8D2E557AD5F4186, TableId=1/0, >>> SchemaGeneration=1, scans=12, cells_read=46, bytes_read=13129, >>> cells_written=20, bytes_written=2812, bloom_filter_accesses=96, >>> bloom_filter_maybes=12, bloom_filter_false_positives=0, >>> bloom_filter_memory52224, shadow_cache_memory=16674365650213660900, >>> block_index_memory=546384, memory_allocated=524288, memory_used=418360, >>> disk_used=256325695} >>> RangeStats= {RangeId=041E6226BA81966CDD79CB79D027BE9B, TableId=1/0, >>> SchemaGeneration=1, scans=17, cells_read=55, bytes_read=35009, >>> cells_written=34, bytes_written=5739, bloom_filter_accesses=119, >>> bloom_filter_maybes=17, bloom_filter_false_positives=0, >>> bloom_filter_memory53248, shadow_cache_memory=0, block_index_memory=538352, >>> memory_allocated=1048576, memory_used=815328, disk_used=246599399} >>> ... >>> >>> >>> >>> Does it matter? what goes wrong in rangeserver? >>> >>> >>> -- >>> You received this message because you are subscribed to the Google Groups >>> "Hypertable Development" group. >>> To post to this group, send email to [email protected]. >>> To unsubscribe from this group, send email to >>> [email protected]. >>> For more options, visit this group at >>> http://groups.google.com/group/hypertable-dev?hl=en. >>> >> >> -- >> You received this message because you are subscribed to the Google Groups >> "Hypertable Development" group. >> To post to this group, send email to [email protected]. >> To unsubscribe from this group, send email to >> [email protected]. >> For more options, visit this group at >> http://groups.google.com/group/hypertable-dev?hl=en. >> > > -- > You received this message because you are subscribed to the Google Groups > "Hypertable Development" group. > To post to this group, send email to [email protected]. > To unsubscribe from this group, send email to > [email protected]. > For more options, visit this group at > http://groups.google.com/group/hypertable-dev?hl=en. > -- You received this message because you are subscribed to the Google Groups "Hypertable Development" group. To post to this group, send email to [email protected]. To unsubscribe from this group, send email to [email protected]. For more options, visit this group at http://groups.google.com/group/hypertable-dev?hl=en.
