[
https://issues.apache.org/jira/browse/HADOOP-2674?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12561240#action_12561240
]
Billy Pearson commented on HADOOP-2674:
---------------------------------------
I did not add but these look a little off too just grabed from my logs
{code}
008-01-22 01:04:20,793 DEBUG org.apache.hadoop.hbase.HRegion: Started memcache
flush for region webdata,,1200970130265. Size 304.4k
2008-01-22 01:04:21,075 DEBUG org.apache.hadoop.hbase.HStore: Added
540402979/size/6230649109575734270 with 68 entries, sequence id 48515457, and
size 1.3k for 540402979/size
2008-01-22 01:04:21,331 DEBUG org.apache.hadoop.hbase.HStore: Added
540402979/rank_total/5609118940996104019 with 0 entries, sequence id 48515457,
and size 153.0 for 540402979/rank_total
2008-01-22 01:04:21,570 DEBUG org.apache.hadoop.hbase.HStore: Added
540402979/first_seen/8170862466467432960 with 0 entries, sequence id 48515457,
and size 153.0 for 540402979/first_seen
2008-01-22 01:04:21,959 DEBUG org.apache.hadoop.hbase.HStore: Added
540402979/anchor/1537062421512096566 with 945 entries, sequence id 48515457,
and size 21.0k for 540402979/anchor
2008-01-22 01:04:22,356 DEBUG org.apache.hadoop.hbase.HStore: Added
540402979/last_seen/2502601058079523401 with 945 entries, sequence id 48515457,
and size 12.3k for 540402979/last_seen
2008-01-22 01:04:22,548 DEBUG org.apache.hadoop.hbase.HStore: Added
540402979/source/6012598200718976874 with 0 entries, sequence id 48515457, and
size 153.0 for 540402979/source
2008-01-22 01:04:22,829 DEBUG org.apache.hadoop.hbase.HStore: Added
540402979/stime/8725573379052363178 with 68 entries, sequence id 48515457, and
size 1.1k for 540402979/stime
2008-01-22 01:04:23,204 DEBUG org.apache.hadoop.hbase.HStore: Added
540402979/in_rank/5816604222284977079 with 945 entries, sequence id 48515457,
and size 12.6k for 540402979/in_rank
2008-01-22 01:04:23,399 DEBUG org.apache.hadoop.hbase.HStore: Added
540402979/rank_visual/7441251515706951111 with 0 entries, sequence id 48515457,
and size 153.0 for 540402979/rank_visual
2008-01-22 01:04:23,399 DEBUG org.apache.hadoop.hbase.HRegion: Finished
memcache flush for region webdata,,1200970130265 in 2606ms, sequenceid=48515457
2008-01-22 01:04:24,278 DEBUG org.apache.hadoop.hbase.HRegion: Started memcache
flush for region webdata,,1200970130265. Size 250.9k
2008-01-22 01:04:24,575 DEBUG org.apache.hadoop.hbase.HStore: Added
540402979/size/4830269185924615719 with 51 entries, sequence id 48517774, and
size 1.1k for 540402979/size
2008-01-22 01:04:24,763 DEBUG org.apache.hadoop.hbase.HStore: Added
540402979/rank_total/4223075765082776321 with 0 entries, sequence id 48517774,
and size 153.0 for 540402979/rank_total
2008-01-22 01:04:24,946 DEBUG org.apache.hadoop.hbase.HStore: Added
540402979/first_seen/3720135038785996071 with 0 entries, sequence id 48517774,
and size 153.0 for 540402979/first_seen
2008-01-22 01:04:25,380 DEBUG org.apache.hadoop.hbase.HStore: Added
540402979/anchor/1924141248792633979 with 738 entries, sequence id 48517774,
and size 14.7k for 540402979/anchor
2008-01-22 01:04:25,678 DEBUG org.apache.hadoop.hbase.HStore: Added
540402979/last_seen/6728438795739264885 with 738 entries, sequence id 48517774,
and size 8.6k for 540402979/last_seen
2008-01-22 01:04:25,869 DEBUG org.apache.hadoop.hbase.HStore: Added
540402979/source/5524570731605631503 with 0 entries, sequence id 48517774, and
size 153.0 for 540402979/source
2008-01-22 01:04:26,144 DEBUG org.apache.hadoop.hbase.HStore: Added
540402979/stime/7586215370994183120 with 51 entries, sequence id 48517774, and
size 969.0 for 540402979/stime
2008-01-22 01:04:26,435 DEBUG org.apache.hadoop.hbase.HStore: Added
540402979/in_rank/8128019865411987566 with 738 entries, sequence id 48517774,
and size 8.9k for 540402979/in_rank
2008-01-22 01:04:26,631 DEBUG org.apache.hadoop.hbase.HStore: Added
540402979/rank_visual/4245403769696937261 with 0 entries, sequence id 48517774,
and size 153.0 for 540402979/rank_visual
2008-01-22 01:04:26,631 DEBUG org.apache.hadoop.hbase.HRegion: Finished
memcache flush for region webdata,,1200970130265 in 2353ms, sequenceid=48517774
2008-01-22 01:04:27,252 DEBUG org.apache.hadoop.hbase.HRegion: Started memcache
flush for region webdata,,1200970130265. Size 185.0k
2008-01-22 01:04:27,533 DEBUG org.apache.hadoop.hbase.HStore: Added
540402979/size/6207446360073685210 with 58 entries, sequence id 48519625, and
size 1.1k for 540402979/size
2008-01-22 01:04:27,724 DEBUG org.apache.hadoop.hbase.HStore: Added
540402979/rank_total/3439076482022402357 with 0 entries, sequence id 48519625,
and size 153.0 for 540402979/rank_total
2008-01-22 01:04:27,921 DEBUG org.apache.hadoop.hbase.HStore: Added
540402979/first_seen/8606165413164762311 with 0 entries, sequence id 48519625,
and size 153.0 for 540402979/first_seen
2008-01-22 01:04:28,220 DEBUG org.apache.hadoop.hbase.HStore: Added
540402979/anchor/7159683683067183944 with 578 entries, sequence id 48519625,
and size 16.2k for 540402979/anchor
2008-01-22 01:04:28,581 DEBUG org.apache.hadoop.hbase.HStore: Added
540402979/last_seen/5641592202640518389 with 578 entries, sequence id 48519625,
and size 7.8k for 540402979/last_seen
2008-01-22 01:04:28,834 DEBUG org.apache.hadoop.hbase.HStore: Added
540402979/source/401560331058780705 with 0 entries, sequence id 48519625, and
size 153.0 for 540402979/source
2008-01-22 01:04:29,133 DEBUG org.apache.hadoop.hbase.HStore: Added
540402979/stime/5928472410509762482 with 58 entries, sequence id 48519625, and
size 1017.0 for 540402979/stime
2008-01-22 01:04:29,482 DEBUG org.apache.hadoop.hbase.HStore: Added
540402979/in_rank/6566434859463781445 with 578 entries, sequence id 48519625,
and size 8.0k for 540402979/in_rank
2008-01-22 01:04:29,680 DEBUG org.apache.hadoop.hbase.HStore: Added
540402979/rank_visual/8531159463028639518 with 0 entries, sequence id 48519625,
and size 153.0 for 540402979/rank_visual
2008-01-22 01:04:29,680 DEBUG org.apache.hadoop.hbase.HRegion: Finished
memcache flush for region webdata,,1200970130265 in 2428ms, sequenceid=48519625
2008-01-22 01:04:30,413 DEBUG org.apache.hadoop.hbase.HRegion: Started memcache
flush for region webdata,,1200970130265. Size 219.2k
2008-01-22 01:04:30,689 DEBUG org.apache.hadoop.hbase.HStore: Added
540402979/size/5981458943062760870 with 49 entries, sequence id 48521653, and
size 1.0k for 540402979/size
2008-01-22 01:04:30,907 DEBUG org.apache.hadoop.hbase.HStore: Added
540402979/rank_total/419753419859708754 with 0 entries, sequence id 48521653,
and size 153.0 for 540402979/rank_total
2008-01-22 01:04:31,129 DEBUG org.apache.hadoop.hbase.HStore: Added
540402979/first_seen/6123331922733696105 with 0 entries, sequence id 48521653,
and size 153.0 for 540402979/first_seen
2008-01-22 01:04:31,444 DEBUG org.apache.hadoop.hbase.HStore: Added
540402979/anchor/8458911919598664922 with 643 entries, sequence id 48521653,
and size 14.2k for 540402979/anchor
2008-01-22 01:04:31,851 DEBUG org.apache.hadoop.hbase.HStore: Added
540402979/last_seen/5456714013028708782 with 643 entries, sequence id 48521653,
and size 8.6k for 540402979/last_seen
2008-01-22 01:04:32,044 DEBUG org.apache.hadoop.hbase.HStore: Added
540402979/source/7249422487032922861 with 0 entries, sequence id 48521653, and
size 153.0 for 540402979/source
2008-01-22 01:04:32,326 DEBUG org.apache.hadoop.hbase.HStore: Added
540402979/stime/514250975517557528 with 49 entries, sequence id 48521653, and
size 915.0 for 540402979/stime
2008-01-22 01:04:32,634 DEBUG org.apache.hadoop.hbase.HStore: Added
540402979/in_rank/5117180382861468328 with 643 entries, sequence id 48521653,
and size 8.8k for 540402979/in_rank
2008-01-22 01:04:32,825 DEBUG org.apache.hadoop.hbase.HStore: Added
540402979/rank_visual/4596510226882923087 with 0 entries, sequence id 48521653,
and size 153.0 for 540402979/rank_visual
2008-01-22 01:04:32,825 DEBUG org.apache.hadoop.hbase.HRegion: Finished
memcache flush for region webdata,,1200970130265 in 2412ms, sequenceid=48521653
2008-01-22 01:04:33,704 DEBUG org.apache.hadoop.hbase.HRegion: Started memcache
flush for region webdata,,1200970130265. Size 214.3k
2008-01-22 01:04:33,972 DEBUG org.apache.hadoop.hbase.HStore: Added
540402979/size/4739524184209117079 with 81 entries, sequence id 48523706, and
size 1.5k for 540402979/size
2008-01-22 01:04:34,160 DEBUG org.apache.hadoop.hbase.HStore: Added
540402979/rank_total/5885018542026556169 with 0 entries, sequence id 48523706,
and size 153.0 for 540402979/rank_total
2008-01-22 01:04:34,349 DEBUG org.apache.hadoop.hbase.HStore: Added
540402979/first_seen/1966219656943331530 with 0 entries, sequence id 48523706,
and size 153.0 for 540402979/first_seen
2008-01-22 01:04:34,663 DEBUG org.apache.hadoop.hbase.HStore: Added
540402979/anchor/4442300861169127478 with 630 entries, sequence id 48523706,
and size 13.1k for 540402979/anchor
2008-01-22 01:04:34,978 DEBUG org.apache.hadoop.hbase.HStore: Added
540402979/last_seen/7752167304733978574 with 630 entries, sequence id 48523706,
and size 8.9k for 540402979/last_seen
2008-01-22 01:04:35,160 DEBUG org.apache.hadoop.hbase.HStore: Added
540402979/source/6470630784570214516 with 0 entries, sequence id 48523706, and
size 153.0 for 540402979/source
2008-01-22 01:04:35,433 DEBUG org.apache.hadoop.hbase.HStore: Added
540402979/stime/8918343732025803262 with 81 entries, sequence id 48523706, and
size 1.3k for 540402979/stime
2008-01-22 01:04:35,748 DEBUG org.apache.hadoop.hbase.HStore: Added
540402979/in_rank/3881912761924419231 with 630 entries, sequence id 48523706,
and size 9.1k for 540402979/in_rank
2008-01-22 01:04:35,954 DEBUG org.apache.hadoop.hbase.HStore: Added
540402979/rank_visual/4766710550905778780 with 0 entries, sequence id 48523706,
and size 153.0 for 540402979/rank_visual
2008-01-22 01:04:35,954 DEBUG org.apache.hadoop.hbase.HRegion: Finished
memcache flush for region webdata,,1200970130265 in 2250ms, sequenceid=48523706
{code}
> memcache size reported in debug log doesn ot add up
> ---------------------------------------------------
>
> Key: HADOOP-2674
> URL: https://issues.apache.org/jira/browse/HADOOP-2674
> Project: Hadoop
> Issue Type: Bug
> Components: contrib/hbase
> Environment: hadoop svn 613782
> Reporter: Billy Pearson
> Priority: Minor
> Fix For: 0.16.0
>
>
> below shows a memcache size of 64M but when you add up the regions I get
> 149.3K = 152883.2B
> 153B = 153B
> 153B = 153B
> 3.8M = 3984588.8B
> 2.6M = 2726297.6B
> 153B = 153B
> 129K = 132096B
> 2.6M = 2726297.6B
> 153B = 153B
> total = 9569891.4B = 9.12M not 64M
> {code}
> 2008-01-21 23:51:30,812 DEBUG org.apache.hadoop.hbase.HRegion: Started
> memcache flush for region webdata,,1200970130265. Size 64.0m
> 2008-01-21 23:51:31,694 DEBUG org.apache.hadoop.hbase.HStore: Added
> 540402979/size/2337100008775916241 with 11004 entries, sequence id 32535827,
> and size 149.3k for 540402979/size
> 2008-01-21 23:51:31,956 DEBUG org.apache.hadoop.hbase.HStore: Added
> 540402979/rank_total/6511354828803004572 with 0 entries, sequence id
> 32535827, and size 153.0 for 540402979/rank_total
> 2008-01-21 23:51:32,210 DEBUG org.apache.hadoop.hbase.HStore: Added
> 540402979/first_seen/116626538562002170 with 0 entries, sequence id 32535827,
> and size 153.0 for 540402979/first_seen
> 2008-01-21 23:51:40,084 DEBUG org.apache.hadoop.hbase.HStore: Added
> 540402979/anchor/5635668875929221096 with 189726 entries, sequence id
> 32535827, and size 3.8m for 540402979/anchor
> 2008-01-21 23:51:48,134 DEBUG org.apache.hadoop.hbase.HStore: Added
> 540402979/last_seen/5152520466951569025 with 189726 entries, sequence id
> 32535827, and size 2.6m for 540402979/last_seen
> 2008-01-21 23:51:48,400 DEBUG org.apache.hadoop.hbase.HStore: Added
> 540402979/source/7366562139108336733 with 0 entries, sequence id 32535827,
> and size 153.0 for 540402979/source
> 2008-01-21 23:51:49,075 DEBUG org.apache.hadoop.hbase.HStore: Added
> 540402979/stime/5227996581170475543 with 11004 entries, sequence id 32535827,
> and size 129.6k for 540402979/stime
> 2008-01-21 23:51:55,944 DEBUG org.apache.hadoop.hbase.HStore: Added
> 540402979/in_rank/7235419568042410782 with 189726 entries, sequence id
> 32535827, and size 2.6m for 540402979/in_rank
> 2008-01-21 23:51:56,217 DEBUG org.apache.hadoop.hbase.HStore: Added
> 540402979/rank_visual/5975562391477267376 with 0 entries, sequence id
> 32535827, and size 153.0 for 540402979/rank_visual
> 2008-01-21 23:51:56,217 DEBUG org.apache.hadoop.hbase.HRegion: Finished
> memcache flush for region webdata,,1200970130265 in 25405ms,
> sequenceid=32535827
> {code}
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
