Thanks for you reply. It seems ok, because application programs have no scan
or write error.

But DfsBroker has many 'unlink error', Does it matter?


2011/5/7 Doug Judd <[email protected]>

> Hi Pany,
>
> Those messages are normal (notice that they're INFO, not ERROR).  This
> happens when ranges split and the writing clients METADATA cache gets stale.
>  The client will re-scan the METADATA table to refresh its cache upon
> encountering these exceptions.  This all happens transparently and your
> loading clients will handle them properly and re-submit any updates that
> were mis-directed.
>
> - Doug
>
> On Fri, May 6, 2011 at 7:07 PM, Pany Yue <[email protected]> wrote:
>
>> hi,
>> I deploy allservers on one machine, used localBroker. There are 50 client
>> scaning and writing concurrently.
>> The cluster has two tables, about 100 columns per table;
>>
>> As the time goes on (after running 1 days), there are many 'range not
>> found' exception in RangeServer log:
>>
>> 1304733259 INFO Hypertable.RangeServer :
>> (/home/itlanger/hypertable/src_for_build/hypertable-0.9.4.3-alpha/src/cc/Hypertable/RangeServer/RangeServer.cc:853)
>> Hypertable::Exception: (a) 1/0[..00245_
>> http://www.mianjinhuo.com/-product-9412.html] - RANGE SERVER range not
>> found
>> 1304733259 INFO Hypertable.RangeServer :
>> (/home/itlanger/hypertable/src_for_build/hypertable-0.9.4.3-alpha/src/cc/Hypertable/RangeServer/RangeServer.cc:853)
>> Hypertable::Exception: (a) 1/0[..00245_
>> http://www.mianjinhuo.com/-product-9412.html] - RANGE SERVER range not
>> found
>> 1304733300 INFO Hypertable.RangeServer :
>> (/home/itlanger/hypertable/src_for_build/hypertable-0.9.4.3-alpha/src/cc/Hypertable/RangeServer/RangeServer.cc:853)
>> Hypertable::Exception: (a) 1/0[..00245_
>> http://www.mianjinhuo.com/-product-9412.html] - RANGE SERVER range not
>> found
>> 1304733301 INFO Hypertable.RangeServer :
>> (/home/itlanger/hypertable/src_for_build/hypertable-0.9.4.3-alpha/src/cc/Hypertable/RangeServer/RangeServer.cc:853)
>> Hypertable::Exception: (a) 1/0[..00245_
>> http://www.mianjinhuo.com/-product-9412.html] - RANGE SERVER range not
>> found
>> 1304733536 INFO Hypertable.RangeServer :
>> (/home/itlanger/hypertable/src_for_build/hypertable-0.9.4.3-alpha/src/cc/Hypertable/RangeServer/RangeServer.cc:853)
>> Hypertable::Exception: (a) 1/0[01484_
>> http://pic.onlylady.com/pic-128664.shtml..01730_http://www.yfdmt.cn/company_id.aspx-ID-33]
>> - RANGE SERVER range not found
>> 1304733537 INFO Hypertable.RangeServer :
>> (/home/itlanger/hypertable/src_for_build/hypertable-0.9.4.3-alpha/src/cc/Hypertable/RangeServer/RangeServer.cc:853)
>> Hypertable::Exception: (a) 1/0[01484_
>> http://pic.onlylady.com/pic-128664.shtml..01730_http://www.yfdmt.cn/company_id.aspx-ID-33]
>> - RANGE SERVER range not found
>> 1304733538 INFO Hypertable.RangeServer :
>> (/home/itlanger/hypertable/src_for_build/hypertable-0.9.4.3-alpha/src/cc/Hypertable/RangeServer/RangeServer.cc:853)
>> Hypertable::Exception: (a) 1/0[01484_
>> http://pic.onlylady.com/pic-128664.shtml..01730_http://www.yfdmt.cn/company_id.aspx-ID-33]
>> - RANGE SERVER range not found
>> 1304733538 INFO Hypertable.RangeServer :
>> (/home/itlanger/hypertable/src_for_build/hypertable-0.9.4.3-alpha/src/cc/Hypertable/RangeServer/RangeServer.cc:853)
>> Hypertable::Exception: (a) 1/0[01484_
>> http://pic.onlylady.com/pic-128664.shtml..01730_http://www.yfdmt.cn/company_id.aspx-ID-33]
>> - RANGE SERVER range not found
>> 1304733538 INFO Hypertable.RangeServer :
>> (/home/itlanger/hypertable/src_for_build/hypertable-0.9.4.3-alpha/src/cc/Hypertable/RangeServer/RangeServer.cc:853)
>> Hypertable::Exception: (a) 1/0[01484_
>> http://pic.onlylady.com/pic-128664.shtml..01730_http://www.yfdmt.cn/company_id.aspx-ID-33]
>> - RANGE SERVER range not found
>> 1304733539 INFO Hypertable.RangeServer :
>> (/home/itlanger/hypertable/src_for_build/hypertable-0.9.4.3-alpha/src/cc/Hypertable/RangeServer/RangeServer.cc:853)
>> Hypertable::Exception: (a) 1/0[01484_
>> http://pic.onlylady.com/pic-128664.shtml..01730_http://www.yfdmt.cn/company_id.aspx-ID-33]
>> - RANGE SERVER range not found
>>
>> grep "range not found" Hypertable.RangeServer.log |wc -l
>> 2638
>>
>>
>> DfsBroker has many 'unlink failed:' error:
>>
>> 1304733379 ERROR localBroker :
>> (/home/itlanger/hypertable/src_for_build/hypertable-0.9.4.3-alpha/src/cc/DfsBroker/local/LocalBroker.cc:339)
>> unlink failed: file='/home/itlanger/hypertable/install/
>> 0.9.4.3/fs/local/hypertable/tables/1/0/default/zWEHsrXyNQ2hXOZU/cs11' -
>> No such file or directory
>> 1304733379 ERROR localBroker :
>> (/home/itlanger/hypertable/src_for_build/hypertable-0.9.4.3-alpha/src/cc/DfsBroker/local/LocalBroker.cc:339)
>> unlink failed: file='/home/itlanger/hypertable/install/
>> 0.9.4.3/fs/local/hypertable/tables/1/0/default/zWEHsrXyNQ2hXOZU/cs17' -
>> No such file or directory
>> 1304733379 ERROR localBroker :
>> (/home/itlanger/hypertable/src_for_build/hypertable-0.9.4.3-alpha/src/cc/DfsBroker/local/LocalBroker.cc:339)
>> unlink failed: file='/home/itlanger/hypertable/install/
>> 0.9.4.3/fs/local/hypertable/tables/1/0/default/zWEHsrXyNQ2hXOZU/cs18' -
>> No such file or directory
>> 1304733379 ERROR localBroker :
>> (/home/itlanger/hypertable/src_for_build/hypertable-0.9.4.3-alpha/src/cc/DfsBroker/local/LocalBroker.cc:339)
>> unlink failed: file='/home/itlanger/hypertable/install/
>> 0.9.4.3/fs/local/hypertable/tables/1/0/default/zWEHsrXyNQ2hXOZU/cs19' -
>> No such file or directory
>> 1304733379 ERROR localBroker :
>> (/home/itlanger/hypertable/src_for_build/hypertable-0.9.4.3-alpha/src/cc/DfsBroker/local/LocalBroker.cc:339)
>> unlink failed: file='/home/itlanger/hypertable/install/
>> 0.9.4.3/fs/local/hypertable/tables/1/0/default/gXoC7r0CFdES54oC/cs6' - No
>> such file or directory
>>
>> grep "unlink failed:" DfsBroker.local.log |wc -l
>> 6613
>>
>> here is the rsstat:
>>
>> RangeServerStats = {timestamp=1304733913325175000,
>> measurement_period=-741723592, disk_available KB=706542, disk_used
>> KB=680086, disk_read_KBps=0, disk_write_KBps=0, disk_read_rate=0,
>> disk_write_rate=0, mem_total KB=16058304, mem_used KB=15114304, vm_size
>> KB=8688023, vm_resident KB=7043636, net_recv_KBps=0, net_send_KBps=0,
>> loadavg_0=1.72, loadavg_1=1.89, loadavg_2=2.02, cpu_pct=0.00, num_cores=8,
>> clock_mhz=2493, num_ranges=145, scans=11146, cells_read=25058,
>> bytes_read=52026501, updates=15212, syncs=15212, cells_written=22414,
>> bytes_written=5763379, query_cache_max_memory=50000000,
>> query_cache_available_memory=31059521, query_cache_accesses=2385,
>> query_cache_hits=5, block_cache_max_memory=4000000000,
>> block_cache_available_memory=189998, block_cache_accesses=3012,
>> block_cache_hits=2790RangeStats= {RangeId=007E499DB17F710CD15A540F96D4F636,
>> TableId=1/0, SchemaGeneration=1, scans=14, cells_read=50, bytes_read=9519,
>> cells_written=26, bytes_written=4233, bloom_filter_accesses=112,
>> bloom_filter_maybes=14, bloom_filter_false_positives=0,
>> bloom_filter_memory53760, shadow_cache_memory=0, block_index_memory=556760,
>> memory_allocated=1048576, memory_used=730159, disk_used=258017548}
>> RangeStats= {RangeId=033C4BF4650605228C54C47E3B48B4D8, TableId=1/0,
>> SchemaGeneration=1, scans=21, cells_read=62, bytes_read=87861,
>> cells_written=62, bytes_written=332026, bloom_filter_accesses=126,
>> bloom_filter_maybes=18, bloom_filter_false_positives=0,
>> bloom_filter_memory55296, shadow_cache_memory=0, block_index_memory=548778,
>> memory_allocated=1048576, memory_used=887224, disk_used=256125360}
>> RangeStats= {RangeId=03AEDE16F994E807B8D2E557AD5F4186, TableId=1/0,
>> SchemaGeneration=1, scans=12, cells_read=46, bytes_read=13129,
>> cells_written=20, bytes_written=2812, bloom_filter_accesses=96,
>> bloom_filter_maybes=12, bloom_filter_false_positives=0,
>> bloom_filter_memory52224, shadow_cache_memory=16674365650213660900,
>> block_index_memory=546384, memory_allocated=524288, memory_used=418360,
>> disk_used=256325695}
>> RangeStats= {RangeId=041E6226BA81966CDD79CB79D027BE9B, TableId=1/0,
>> SchemaGeneration=1, scans=17, cells_read=55, bytes_read=35009,
>> cells_written=34, bytes_written=5739, bloom_filter_accesses=119,
>> bloom_filter_maybes=17, bloom_filter_false_positives=0,
>> bloom_filter_memory53248, shadow_cache_memory=0, block_index_memory=538352,
>> memory_allocated=1048576, memory_used=815328, disk_used=246599399}
>> ...
>>
>>
>>
>> Does it matter?  what goes wrong in rangeserver?
>>
>>
>>  --
>> You received this message because you are subscribed to the Google Groups
>> "Hypertable Development" group.
>> To post to this group, send email to [email protected].
>> To unsubscribe from this group, send email to
>> [email protected].
>> For more options, visit this group at
>> http://groups.google.com/group/hypertable-dev?hl=en.
>>
>
>  --
> You received this message because you are subscribed to the Google Groups
> "Hypertable Development" group.
> To post to this group, send email to [email protected].
> To unsubscribe from this group, send email to
> [email protected].
> For more options, visit this group at
> http://groups.google.com/group/hypertable-dev?hl=en.
>

-- 
You received this message because you are subscribed to the Google Groups 
"Hypertable Development" group.
To post to this group, send email to [email protected].
To unsubscribe from this group, send email to 
[email protected].
For more options, visit this group at 
http://groups.google.com/group/hypertable-dev?hl=en.

Reply via email to