[jira] [Commented] (HBASE-7764) [snapshot 130201 merge] Fix TestSnapshotCloneIndependence failure
[
https://issues.apache.org/jira/browse/HBASE-7764?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13574593#comment-13574593
]
Jonathan Hsieh commented on HBASE-7764:
---
I'm fine with the patch but I really want an explanation of why split affects
snapshot/clone unit tests. The connection is non-obvious to me.
I believe the story roughly goes like this:
The online snapshotting (until we use table locks) can fail if splits/balances
occur while snapshotting. We've changed the split policy so the failure likely
has to do with split policies.
The fix changes to the ConstantSizeRegionSplitPolicy -- a policy that does not
split until the specified size is reached. In this case 10GB (or 64MB). These
tests write a few thousand rows which are for sake of argument roughly 100MB.
With this split policy, splitting doesn't occurs when snapshotting in the unit
test so snapshots succeed.
The as-of-0.94 splititng algo default is
IncreasingToUpperBoundRegionSplitPolicy. From its comments:
{code}
/**
* Split size is the number of regions that are on this server that all are
* of the same table, squared, times the region flush size OR the maximum
* region split size, whichever is smaller. For example, if the flush size
* is 128M, then on first flush we will split which will make two regions
* that will split when their size is 2 * 2 * 128M = 512M. If one of these
* regions splits, then there are three regions and now the split size is
* 3 * 3 * 128M = 1152M, and so on until we reach the configured
* maximum filesize and then from there on out, we'll use that.
*/
{code}
The key point is *on the first flush*. Since the online snapshot mechanism
forces a flush, it seems that from the description it would also trigger a
split. Since this is a cause of valid online snapshot failures, it is the
likely cause of these unit test failures.
Do you buy the story?
[snapshot 130201 merge] Fix TestSnapshotCloneIndependence failure
-
Key: HBASE-7764
URL: https://issues.apache.org/jira/browse/HBASE-7764
Project: HBase
Issue Type: Sub-task
Reporter: Ted Yu
Assignee: Ted Yu
Attachments: 7764.txt, 7764-v2.txt, 7764-v3.txt
Here is log snippet for
TestSnapshotCloneIndependence#testOnlineSnapshotRegionOperationsIndependent
(pay attention to region 1360020297284.2e43e47a882d3cff601eb222cad41f20.):
{code}
2013-02-04 15:24:58,369 INFO
[MASTER_SERVER_OPERATIONS-10.11.2.194,61955,1360020289835-0]
handler.SplitRegionHandler(115): Handled SPLIT event;
parent=test1360020295791,,1360020295793.794d37c0445b61619b5056623228827d.
daughter
a=test1360020295791,,1360020297284.2e43e47a882d3cff601eb222cad41f20.daughter
b=test1360020295791,dgb,1360020297284.b87834cee60702d883aa287df6aaeaef.
...
2013-02-04 15:25:02,005 DEBUG
[rs(10.11.2.194,61958,1360020290064)-snapshot-pool5-thread-1]
snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(78): Starting region
operation on
test1360020295791,,1360020297284.2e43e47a882d3cff601eb222cad41f20.
2013-02-04 15:25:02,005 DEBUG
[rs(10.11.2.194,61958,1360020290064)-snapshot-pool5-thread-1]
snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(81): Flush Snapshotting
region test1360020295791,,1360020297284.2e43e47a882d3cff601eb222cad41f20.
started...
2013-02-04 15:25:02,005 DEBUG [member:
apos;10.11.2.194,61958,1360020290064apos; subprocedure-pool3-thread-1]
snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(318): Completed
2/3 local region snapshots.
2013-02-04 15:25:02,005 DEBUG
[rs(10.11.2.194,61958,1360020290064)-snapshot-pool5-thread-1]
regionserver.HRegion(2485): Storing region-info for snapshot.
2013-02-04 15:25:02,006 DEBUG
[rs(10.11.2.194,61958,1360020290064)-snapshot-pool5-thread-1]
util.FSUtils(166): Creating
file=hdfs://localhost:61942/user/tyu/hbase/.snapshot/.tmp/snapshot_test1360020295791/2e43e47a882d3cff601eb222cad41f20/.tmp/.regioninfo
with permission=rwxrwxrwx
2013-02-04 15:25:02,014 DEBUG
[rs(10.11.2.194,61958,1360020290064)-snapshot-pool5-thread-1]
regionserver.HRegion(2489): Creating references for hfiles
2013-02-04 15:25:02,014 DEBUG
[rs(10.11.2.194,61958,1360020290064)-snapshot-pool5-thread-1]
regionserver.HRegion(2502): Adding snapshot references for
[hdfs://localhost:61942/user/tyu/hbase/test1360020295791/2e43e47a882d3cff601eb222cad41f20/fam/946b75e5f0ba445aa1c646b8cbc87e02]
hfiles
2013-02-04 15:25:02,015 DEBUG
[rs(10.11.2.194,61958,1360020290064)-snapshot-pool5-thread-1]
regionserver.HRegion(2516): Creating reference for file (1/1) :
hdfs://localhost:61942/user/tyu/hbase/test1360020295791/2e43e47a882d3cff601eb222cad41f20/fam/946b75e5f0ba445aa1c646b8cbc87e02
2013-02-04 15:25:02,017 DEBUG
[jira] [Commented] (HBASE-7764) [snapshot 130201 merge] Fix TestSnapshotCloneIndependence failure
[
https://issues.apache.org/jira/browse/HBASE-7764?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13574594#comment-13574594
]
Jonathan Hsieh commented on HBASE-7764:
---
Moreover, if it is the case, this means we should change the other online
snapshotting tests so that they don't encounter this split conflict (since we
aren't testing for that).
[snapshot 130201 merge] Fix TestSnapshotCloneIndependence failure
-
Key: HBASE-7764
URL: https://issues.apache.org/jira/browse/HBASE-7764
Project: HBase
Issue Type: Sub-task
Reporter: Ted Yu
Assignee: Ted Yu
Attachments: 7764.txt, 7764-v2.txt, 7764-v3.txt
Here is log snippet for
TestSnapshotCloneIndependence#testOnlineSnapshotRegionOperationsIndependent
(pay attention to region 1360020297284.2e43e47a882d3cff601eb222cad41f20.):
{code}
2013-02-04 15:24:58,369 INFO
[MASTER_SERVER_OPERATIONS-10.11.2.194,61955,1360020289835-0]
handler.SplitRegionHandler(115): Handled SPLIT event;
parent=test1360020295791,,1360020295793.794d37c0445b61619b5056623228827d.
daughter
a=test1360020295791,,1360020297284.2e43e47a882d3cff601eb222cad41f20.daughter
b=test1360020295791,dgb,1360020297284.b87834cee60702d883aa287df6aaeaef.
...
2013-02-04 15:25:02,005 DEBUG
[rs(10.11.2.194,61958,1360020290064)-snapshot-pool5-thread-1]
snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(78): Starting region
operation on
test1360020295791,,1360020297284.2e43e47a882d3cff601eb222cad41f20.
2013-02-04 15:25:02,005 DEBUG
[rs(10.11.2.194,61958,1360020290064)-snapshot-pool5-thread-1]
snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(81): Flush Snapshotting
region test1360020295791,,1360020297284.2e43e47a882d3cff601eb222cad41f20.
started...
2013-02-04 15:25:02,005 DEBUG [member:
apos;10.11.2.194,61958,1360020290064apos; subprocedure-pool3-thread-1]
snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(318): Completed
2/3 local region snapshots.
2013-02-04 15:25:02,005 DEBUG
[rs(10.11.2.194,61958,1360020290064)-snapshot-pool5-thread-1]
regionserver.HRegion(2485): Storing region-info for snapshot.
2013-02-04 15:25:02,006 DEBUG
[rs(10.11.2.194,61958,1360020290064)-snapshot-pool5-thread-1]
util.FSUtils(166): Creating
file=hdfs://localhost:61942/user/tyu/hbase/.snapshot/.tmp/snapshot_test1360020295791/2e43e47a882d3cff601eb222cad41f20/.tmp/.regioninfo
with permission=rwxrwxrwx
2013-02-04 15:25:02,014 DEBUG
[rs(10.11.2.194,61958,1360020290064)-snapshot-pool5-thread-1]
regionserver.HRegion(2489): Creating references for hfiles
2013-02-04 15:25:02,014 DEBUG
[rs(10.11.2.194,61958,1360020290064)-snapshot-pool5-thread-1]
regionserver.HRegion(2502): Adding snapshot references for
[hdfs://localhost:61942/user/tyu/hbase/test1360020295791/2e43e47a882d3cff601eb222cad41f20/fam/946b75e5f0ba445aa1c646b8cbc87e02]
hfiles
2013-02-04 15:25:02,015 DEBUG
[rs(10.11.2.194,61958,1360020290064)-snapshot-pool5-thread-1]
regionserver.HRegion(2516): Creating reference for file (1/1) :
hdfs://localhost:61942/user/tyu/hbase/test1360020295791/2e43e47a882d3cff601eb222cad41f20/fam/946b75e5f0ba445aa1c646b8cbc87e02
2013-02-04 15:25:02,017 DEBUG
[rs(10.11.2.194,61958,1360020290064)-snapshot-pool5-thread-1]
snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(84): ... Flush
Snapshotting region
test1360020295791,,1360020297284.2e43e47a882d3cff601eb222cad41f20. completed.
2013-02-04 15:25:02,017 DEBUG
[rs(10.11.2.194,61958,1360020290064)-snapshot-pool5-thread-1]
snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(86): Closing region
operation on
test1360020295791,,1360020297284.2e43e47a882d3cff601eb222cad41f20.
...
2013-02-04 15:25:03,836 INFO [PRI IPC Server handler 7 on 61958]
regionserver.HRegionServer(3600): Splitting
test1360020295791,,1360020297284.2e43e47a882d3cff601eb222cad41f20.
2013-02-04 15:25:03,836 DEBUG [PRI IPC Server handler 7 on 61958]
regionserver.HStore(1686): cannot split because midkey is the same as first
or last row
2013-02-04 15:25:03,836 DEBUG [PRI IPC Server handler 7 on 61958]
regionserver.CompactSplitThread(172): Region
test1360020295791,,1360020297284.2e43e47a882d3cff601eb222cad41f20. not
splittable because midkey=null
2013-02-04 15:25:03,837 DEBUG [main] catalog.CatalogTracker(231): Stopping
catalog tracker org.apache.hadoop.hbase.catalog.CatalogTracker@5c602d9d
2013-02-04 15:25:03,838 INFO [main]
client.TestSnapshotCloneIndependence(307): split requested for
test1360020295791,,1360020297284.2e43e47a882d3cff601eb222cad41f20.
2013-02-04 15:25:03,892 DEBUG [main] client.MetaScanner(199): Scanning .META.
starting at row=test1360020295791,,00 for max=2147483647 rows
using hconnection 0x53d9f80
2013-02-04
[jira] [Commented] (HBASE-7764) [snapshot 130201 merge] Fix TestSnapshotCloneIndependence failure
[
https://issues.apache.org/jira/browse/HBASE-7764?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13574603#comment-13574603
]
Jonathan Hsieh commented on HBASE-7764:
---
hm.. also since it was default in 0.94 -- the HBASE-7412 change effectively
lowered the region split max value so it probably made the number of splits go
up significantly.
[snapshot 130201 merge] Fix TestSnapshotCloneIndependence failure
-
Key: HBASE-7764
URL: https://issues.apache.org/jira/browse/HBASE-7764
Project: HBase
Issue Type: Sub-task
Reporter: Ted Yu
Assignee: Ted Yu
Attachments: 7764.txt, 7764-v2.txt, 7764-v3.txt
Here is log snippet for
TestSnapshotCloneIndependence#testOnlineSnapshotRegionOperationsIndependent
(pay attention to region 1360020297284.2e43e47a882d3cff601eb222cad41f20.):
{code}
2013-02-04 15:24:58,369 INFO
[MASTER_SERVER_OPERATIONS-10.11.2.194,61955,1360020289835-0]
handler.SplitRegionHandler(115): Handled SPLIT event;
parent=test1360020295791,,1360020295793.794d37c0445b61619b5056623228827d.
daughter
a=test1360020295791,,1360020297284.2e43e47a882d3cff601eb222cad41f20.daughter
b=test1360020295791,dgb,1360020297284.b87834cee60702d883aa287df6aaeaef.
...
2013-02-04 15:25:02,005 DEBUG
[rs(10.11.2.194,61958,1360020290064)-snapshot-pool5-thread-1]
snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(78): Starting region
operation on
test1360020295791,,1360020297284.2e43e47a882d3cff601eb222cad41f20.
2013-02-04 15:25:02,005 DEBUG
[rs(10.11.2.194,61958,1360020290064)-snapshot-pool5-thread-1]
snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(81): Flush Snapshotting
region test1360020295791,,1360020297284.2e43e47a882d3cff601eb222cad41f20.
started...
2013-02-04 15:25:02,005 DEBUG [member:
apos;10.11.2.194,61958,1360020290064apos; subprocedure-pool3-thread-1]
snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(318): Completed
2/3 local region snapshots.
2013-02-04 15:25:02,005 DEBUG
[rs(10.11.2.194,61958,1360020290064)-snapshot-pool5-thread-1]
regionserver.HRegion(2485): Storing region-info for snapshot.
2013-02-04 15:25:02,006 DEBUG
[rs(10.11.2.194,61958,1360020290064)-snapshot-pool5-thread-1]
util.FSUtils(166): Creating
file=hdfs://localhost:61942/user/tyu/hbase/.snapshot/.tmp/snapshot_test1360020295791/2e43e47a882d3cff601eb222cad41f20/.tmp/.regioninfo
with permission=rwxrwxrwx
2013-02-04 15:25:02,014 DEBUG
[rs(10.11.2.194,61958,1360020290064)-snapshot-pool5-thread-1]
regionserver.HRegion(2489): Creating references for hfiles
2013-02-04 15:25:02,014 DEBUG
[rs(10.11.2.194,61958,1360020290064)-snapshot-pool5-thread-1]
regionserver.HRegion(2502): Adding snapshot references for
[hdfs://localhost:61942/user/tyu/hbase/test1360020295791/2e43e47a882d3cff601eb222cad41f20/fam/946b75e5f0ba445aa1c646b8cbc87e02]
hfiles
2013-02-04 15:25:02,015 DEBUG
[rs(10.11.2.194,61958,1360020290064)-snapshot-pool5-thread-1]
regionserver.HRegion(2516): Creating reference for file (1/1) :
hdfs://localhost:61942/user/tyu/hbase/test1360020295791/2e43e47a882d3cff601eb222cad41f20/fam/946b75e5f0ba445aa1c646b8cbc87e02
2013-02-04 15:25:02,017 DEBUG
[rs(10.11.2.194,61958,1360020290064)-snapshot-pool5-thread-1]
snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(84): ... Flush
Snapshotting region
test1360020295791,,1360020297284.2e43e47a882d3cff601eb222cad41f20. completed.
2013-02-04 15:25:02,017 DEBUG
[rs(10.11.2.194,61958,1360020290064)-snapshot-pool5-thread-1]
snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(86): Closing region
operation on
test1360020295791,,1360020297284.2e43e47a882d3cff601eb222cad41f20.
...
2013-02-04 15:25:03,836 INFO [PRI IPC Server handler 7 on 61958]
regionserver.HRegionServer(3600): Splitting
test1360020295791,,1360020297284.2e43e47a882d3cff601eb222cad41f20.
2013-02-04 15:25:03,836 DEBUG [PRI IPC Server handler 7 on 61958]
regionserver.HStore(1686): cannot split because midkey is the same as first
or last row
2013-02-04 15:25:03,836 DEBUG [PRI IPC Server handler 7 on 61958]
regionserver.CompactSplitThread(172): Region
test1360020295791,,1360020297284.2e43e47a882d3cff601eb222cad41f20. not
splittable because midkey=null
2013-02-04 15:25:03,837 DEBUG [main] catalog.CatalogTracker(231): Stopping
catalog tracker org.apache.hadoop.hbase.catalog.CatalogTracker@5c602d9d
2013-02-04 15:25:03,838 INFO [main]
client.TestSnapshotCloneIndependence(307): split requested for
test1360020295791,,1360020297284.2e43e47a882d3cff601eb222cad41f20.
2013-02-04 15:25:03,892 DEBUG [main] client.MetaScanner(199): Scanning .META.
starting at row=test1360020295791,,00 for max=2147483647 rows
using hconnection 0x53d9f80
2013-02-04 15:25:03,895
[jira] [Commented] (HBASE-7764) [snapshot 130201 merge] Fix TestSnapshotCloneIndependence failure
[
https://issues.apache.org/jira/browse/HBASE-7764?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13574619#comment-13574619
]
Ted Yu commented on HBASE-7764:
---
@Jon:
I agree with the analysis outlined at 08/Feb/13 16:23.
When I apply same change to TestFlushSnapshotFromClient, it fails with:
{code}
Failed tests:
testFlushTableSnapshot(org.apache.hadoop.hbase.snapshot.TestFlushSnapshotFromClient):
Have some previous snapshots expected:0 but was:5
testSnapshotFailsOnNonExistantTable(org.apache.hadoop.hbase.snapshot.TestFlushSnapshotFromClient):
Have some previous snapshots expected:0 but was:5
testAsyncFlushSnapshot(org.apache.hadoop.hbase.snapshot.TestFlushSnapshotFromClient):
Should only have 1 snapshot expected:1 but was:6
{code}
I think we can handle the test failures on a case by case basis.
[snapshot 130201 merge] Fix TestSnapshotCloneIndependence failure
-
Key: HBASE-7764
URL: https://issues.apache.org/jira/browse/HBASE-7764
Project: HBase
Issue Type: Sub-task
Reporter: Ted Yu
Assignee: Ted Yu
Attachments: 7764.txt, 7764-v2.txt, 7764-v3.txt
Here is log snippet for
TestSnapshotCloneIndependence#testOnlineSnapshotRegionOperationsIndependent
(pay attention to region 1360020297284.2e43e47a882d3cff601eb222cad41f20.):
{code}
2013-02-04 15:24:58,369 INFO
[MASTER_SERVER_OPERATIONS-10.11.2.194,61955,1360020289835-0]
handler.SplitRegionHandler(115): Handled SPLIT event;
parent=test1360020295791,,1360020295793.794d37c0445b61619b5056623228827d.
daughter
a=test1360020295791,,1360020297284.2e43e47a882d3cff601eb222cad41f20.daughter
b=test1360020295791,dgb,1360020297284.b87834cee60702d883aa287df6aaeaef.
...
2013-02-04 15:25:02,005 DEBUG
[rs(10.11.2.194,61958,1360020290064)-snapshot-pool5-thread-1]
snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(78): Starting region
operation on
test1360020295791,,1360020297284.2e43e47a882d3cff601eb222cad41f20.
2013-02-04 15:25:02,005 DEBUG
[rs(10.11.2.194,61958,1360020290064)-snapshot-pool5-thread-1]
snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(81): Flush Snapshotting
region test1360020295791,,1360020297284.2e43e47a882d3cff601eb222cad41f20.
started...
2013-02-04 15:25:02,005 DEBUG [member:
apos;10.11.2.194,61958,1360020290064apos; subprocedure-pool3-thread-1]
snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(318): Completed
2/3 local region snapshots.
2013-02-04 15:25:02,005 DEBUG
[rs(10.11.2.194,61958,1360020290064)-snapshot-pool5-thread-1]
regionserver.HRegion(2485): Storing region-info for snapshot.
2013-02-04 15:25:02,006 DEBUG
[rs(10.11.2.194,61958,1360020290064)-snapshot-pool5-thread-1]
util.FSUtils(166): Creating
file=hdfs://localhost:61942/user/tyu/hbase/.snapshot/.tmp/snapshot_test1360020295791/2e43e47a882d3cff601eb222cad41f20/.tmp/.regioninfo
with permission=rwxrwxrwx
2013-02-04 15:25:02,014 DEBUG
[rs(10.11.2.194,61958,1360020290064)-snapshot-pool5-thread-1]
regionserver.HRegion(2489): Creating references for hfiles
2013-02-04 15:25:02,014 DEBUG
[rs(10.11.2.194,61958,1360020290064)-snapshot-pool5-thread-1]
regionserver.HRegion(2502): Adding snapshot references for
[hdfs://localhost:61942/user/tyu/hbase/test1360020295791/2e43e47a882d3cff601eb222cad41f20/fam/946b75e5f0ba445aa1c646b8cbc87e02]
hfiles
2013-02-04 15:25:02,015 DEBUG
[rs(10.11.2.194,61958,1360020290064)-snapshot-pool5-thread-1]
regionserver.HRegion(2516): Creating reference for file (1/1) :
hdfs://localhost:61942/user/tyu/hbase/test1360020295791/2e43e47a882d3cff601eb222cad41f20/fam/946b75e5f0ba445aa1c646b8cbc87e02
2013-02-04 15:25:02,017 DEBUG
[rs(10.11.2.194,61958,1360020290064)-snapshot-pool5-thread-1]
snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(84): ... Flush
Snapshotting region
test1360020295791,,1360020297284.2e43e47a882d3cff601eb222cad41f20. completed.
2013-02-04 15:25:02,017 DEBUG
[rs(10.11.2.194,61958,1360020290064)-snapshot-pool5-thread-1]
snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(86): Closing region
operation on
test1360020295791,,1360020297284.2e43e47a882d3cff601eb222cad41f20.
...
2013-02-04 15:25:03,836 INFO [PRI IPC Server handler 7 on 61958]
regionserver.HRegionServer(3600): Splitting
test1360020295791,,1360020297284.2e43e47a882d3cff601eb222cad41f20.
2013-02-04 15:25:03,836 DEBUG [PRI IPC Server handler 7 on 61958]
regionserver.HStore(1686): cannot split because midkey is the same as first
or last row
2013-02-04 15:25:03,836 DEBUG [PRI IPC Server handler 7 on 61958]
regionserver.CompactSplitThread(172): Region
test1360020295791,,1360020297284.2e43e47a882d3cff601eb222cad41f20. not
splittable because midkey=null
2013-02-04 15:25:03,837 DEBUG [main]
[jira] [Commented] (HBASE-7764) [snapshot 130201 merge] Fix TestSnapshotCloneIndependence failure
[
https://issues.apache.org/jira/browse/HBASE-7764?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13574625#comment-13574625
]
Jonathan Hsieh commented on HBASE-7764:
---
Sure, let's handle that one separately -- I have a fix for the 08/Feb/1308:59
comment here
https://github.com/jmhsieh/hbase/commit/8f31e21895a9f343d6dea1aa3aa18077fc7bcc41
. I'll file and submit it (it depends on this region split policy piece that
I didn't understand until yesterday, so I didn't submit it.)
I have a few other fixes from my working branch from yesterday
https://github.com/jmhsieh/hbase/commits/snapshot-work-0207b
I believe only TestMultiParallel is unsolved.
[snapshot 130201 merge] Fix TestSnapshotCloneIndependence failure
-
Key: HBASE-7764
URL: https://issues.apache.org/jira/browse/HBASE-7764
Project: HBase
Issue Type: Sub-task
Reporter: Ted Yu
Assignee: Ted Yu
Attachments: 7764.txt, 7764-v2.txt, 7764-v3.txt
Here is log snippet for
TestSnapshotCloneIndependence#testOnlineSnapshotRegionOperationsIndependent
(pay attention to region 1360020297284.2e43e47a882d3cff601eb222cad41f20.):
{code}
2013-02-04 15:24:58,369 INFO
[MASTER_SERVER_OPERATIONS-10.11.2.194,61955,1360020289835-0]
handler.SplitRegionHandler(115): Handled SPLIT event;
parent=test1360020295791,,1360020295793.794d37c0445b61619b5056623228827d.
daughter
a=test1360020295791,,1360020297284.2e43e47a882d3cff601eb222cad41f20.daughter
b=test1360020295791,dgb,1360020297284.b87834cee60702d883aa287df6aaeaef.
...
2013-02-04 15:25:02,005 DEBUG
[rs(10.11.2.194,61958,1360020290064)-snapshot-pool5-thread-1]
snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(78): Starting region
operation on
test1360020295791,,1360020297284.2e43e47a882d3cff601eb222cad41f20.
2013-02-04 15:25:02,005 DEBUG
[rs(10.11.2.194,61958,1360020290064)-snapshot-pool5-thread-1]
snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(81): Flush Snapshotting
region test1360020295791,,1360020297284.2e43e47a882d3cff601eb222cad41f20.
started...
2013-02-04 15:25:02,005 DEBUG [member:
apos;10.11.2.194,61958,1360020290064apos; subprocedure-pool3-thread-1]
snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(318): Completed
2/3 local region snapshots.
2013-02-04 15:25:02,005 DEBUG
[rs(10.11.2.194,61958,1360020290064)-snapshot-pool5-thread-1]
regionserver.HRegion(2485): Storing region-info for snapshot.
2013-02-04 15:25:02,006 DEBUG
[rs(10.11.2.194,61958,1360020290064)-snapshot-pool5-thread-1]
util.FSUtils(166): Creating
file=hdfs://localhost:61942/user/tyu/hbase/.snapshot/.tmp/snapshot_test1360020295791/2e43e47a882d3cff601eb222cad41f20/.tmp/.regioninfo
with permission=rwxrwxrwx
2013-02-04 15:25:02,014 DEBUG
[rs(10.11.2.194,61958,1360020290064)-snapshot-pool5-thread-1]
regionserver.HRegion(2489): Creating references for hfiles
2013-02-04 15:25:02,014 DEBUG
[rs(10.11.2.194,61958,1360020290064)-snapshot-pool5-thread-1]
regionserver.HRegion(2502): Adding snapshot references for
[hdfs://localhost:61942/user/tyu/hbase/test1360020295791/2e43e47a882d3cff601eb222cad41f20/fam/946b75e5f0ba445aa1c646b8cbc87e02]
hfiles
2013-02-04 15:25:02,015 DEBUG
[rs(10.11.2.194,61958,1360020290064)-snapshot-pool5-thread-1]
regionserver.HRegion(2516): Creating reference for file (1/1) :
hdfs://localhost:61942/user/tyu/hbase/test1360020295791/2e43e47a882d3cff601eb222cad41f20/fam/946b75e5f0ba445aa1c646b8cbc87e02
2013-02-04 15:25:02,017 DEBUG
[rs(10.11.2.194,61958,1360020290064)-snapshot-pool5-thread-1]
snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(84): ... Flush
Snapshotting region
test1360020295791,,1360020297284.2e43e47a882d3cff601eb222cad41f20. completed.
2013-02-04 15:25:02,017 DEBUG
[rs(10.11.2.194,61958,1360020290064)-snapshot-pool5-thread-1]
snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(86): Closing region
operation on
test1360020295791,,1360020297284.2e43e47a882d3cff601eb222cad41f20.
...
2013-02-04 15:25:03,836 INFO [PRI IPC Server handler 7 on 61958]
regionserver.HRegionServer(3600): Splitting
test1360020295791,,1360020297284.2e43e47a882d3cff601eb222cad41f20.
2013-02-04 15:25:03,836 DEBUG [PRI IPC Server handler 7 on 61958]
regionserver.HStore(1686): cannot split because midkey is the same as first
or last row
2013-02-04 15:25:03,836 DEBUG [PRI IPC Server handler 7 on 61958]
regionserver.CompactSplitThread(172): Region
test1360020295791,,1360020297284.2e43e47a882d3cff601eb222cad41f20. not
splittable because midkey=null
2013-02-04 15:25:03,837 DEBUG [main] catalog.CatalogTracker(231): Stopping
catalog tracker org.apache.hadoop.hbase.catalog.CatalogTracker@5c602d9d
2013-02-04 15:25:03,838 INFO [main]
[jira] [Commented] (HBASE-7764) [snapshot 130201 merge] Fix TestSnapshotCloneIndependence failure
[
https://issues.apache.org/jira/browse/HBASE-7764?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13574628#comment-13574628
]
Ted Yu commented on HBASE-7764:
---
Can I interpret the above as +1 to patch v3 ?
[snapshot 130201 merge] Fix TestSnapshotCloneIndependence failure
-
Key: HBASE-7764
URL: https://issues.apache.org/jira/browse/HBASE-7764
Project: HBase
Issue Type: Sub-task
Reporter: Ted Yu
Assignee: Ted Yu
Attachments: 7764.txt, 7764-v2.txt, 7764-v3.txt
Here is log snippet for
TestSnapshotCloneIndependence#testOnlineSnapshotRegionOperationsIndependent
(pay attention to region 1360020297284.2e43e47a882d3cff601eb222cad41f20.):
{code}
2013-02-04 15:24:58,369 INFO
[MASTER_SERVER_OPERATIONS-10.11.2.194,61955,1360020289835-0]
handler.SplitRegionHandler(115): Handled SPLIT event;
parent=test1360020295791,,1360020295793.794d37c0445b61619b5056623228827d.
daughter
a=test1360020295791,,1360020297284.2e43e47a882d3cff601eb222cad41f20.daughter
b=test1360020295791,dgb,1360020297284.b87834cee60702d883aa287df6aaeaef.
...
2013-02-04 15:25:02,005 DEBUG
[rs(10.11.2.194,61958,1360020290064)-snapshot-pool5-thread-1]
snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(78): Starting region
operation on
test1360020295791,,1360020297284.2e43e47a882d3cff601eb222cad41f20.
2013-02-04 15:25:02,005 DEBUG
[rs(10.11.2.194,61958,1360020290064)-snapshot-pool5-thread-1]
snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(81): Flush Snapshotting
region test1360020295791,,1360020297284.2e43e47a882d3cff601eb222cad41f20.
started...
2013-02-04 15:25:02,005 DEBUG [member:
apos;10.11.2.194,61958,1360020290064apos; subprocedure-pool3-thread-1]
snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(318): Completed
2/3 local region snapshots.
2013-02-04 15:25:02,005 DEBUG
[rs(10.11.2.194,61958,1360020290064)-snapshot-pool5-thread-1]
regionserver.HRegion(2485): Storing region-info for snapshot.
2013-02-04 15:25:02,006 DEBUG
[rs(10.11.2.194,61958,1360020290064)-snapshot-pool5-thread-1]
util.FSUtils(166): Creating
file=hdfs://localhost:61942/user/tyu/hbase/.snapshot/.tmp/snapshot_test1360020295791/2e43e47a882d3cff601eb222cad41f20/.tmp/.regioninfo
with permission=rwxrwxrwx
2013-02-04 15:25:02,014 DEBUG
[rs(10.11.2.194,61958,1360020290064)-snapshot-pool5-thread-1]
regionserver.HRegion(2489): Creating references for hfiles
2013-02-04 15:25:02,014 DEBUG
[rs(10.11.2.194,61958,1360020290064)-snapshot-pool5-thread-1]
regionserver.HRegion(2502): Adding snapshot references for
[hdfs://localhost:61942/user/tyu/hbase/test1360020295791/2e43e47a882d3cff601eb222cad41f20/fam/946b75e5f0ba445aa1c646b8cbc87e02]
hfiles
2013-02-04 15:25:02,015 DEBUG
[rs(10.11.2.194,61958,1360020290064)-snapshot-pool5-thread-1]
regionserver.HRegion(2516): Creating reference for file (1/1) :
hdfs://localhost:61942/user/tyu/hbase/test1360020295791/2e43e47a882d3cff601eb222cad41f20/fam/946b75e5f0ba445aa1c646b8cbc87e02
2013-02-04 15:25:02,017 DEBUG
[rs(10.11.2.194,61958,1360020290064)-snapshot-pool5-thread-1]
snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(84): ... Flush
Snapshotting region
test1360020295791,,1360020297284.2e43e47a882d3cff601eb222cad41f20. completed.
2013-02-04 15:25:02,017 DEBUG
[rs(10.11.2.194,61958,1360020290064)-snapshot-pool5-thread-1]
snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(86): Closing region
operation on
test1360020295791,,1360020297284.2e43e47a882d3cff601eb222cad41f20.
...
2013-02-04 15:25:03,836 INFO [PRI IPC Server handler 7 on 61958]
regionserver.HRegionServer(3600): Splitting
test1360020295791,,1360020297284.2e43e47a882d3cff601eb222cad41f20.
2013-02-04 15:25:03,836 DEBUG [PRI IPC Server handler 7 on 61958]
regionserver.HStore(1686): cannot split because midkey is the same as first
or last row
2013-02-04 15:25:03,836 DEBUG [PRI IPC Server handler 7 on 61958]
regionserver.CompactSplitThread(172): Region
test1360020295791,,1360020297284.2e43e47a882d3cff601eb222cad41f20. not
splittable because midkey=null
2013-02-04 15:25:03,837 DEBUG [main] catalog.CatalogTracker(231): Stopping
catalog tracker org.apache.hadoop.hbase.catalog.CatalogTracker@5c602d9d
2013-02-04 15:25:03,838 INFO [main]
client.TestSnapshotCloneIndependence(307): split requested for
test1360020295791,,1360020297284.2e43e47a882d3cff601eb222cad41f20.
2013-02-04 15:25:03,892 DEBUG [main] client.MetaScanner(199): Scanning .META.
starting at row=test1360020295791,,00 for max=2147483647 rows
using hconnection 0x53d9f80
2013-02-04 15:25:03,895 DEBUG [main] client.MetaScanner(252): Current INFO
from scan results = {NAME =gt;
[jira] [Commented] (HBASE-7764) [snapshot 130201 merge] Fix TestSnapshotCloneIndependence failure
[
https://issues.apache.org/jira/browse/HBASE-7764?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13574632#comment-13574632
]
Jonathan Hsieh commented on HBASE-7764:
---
yea, +1 but please add a comment about forcing a less aggressive splitting.
[snapshot 130201 merge] Fix TestSnapshotCloneIndependence failure
-
Key: HBASE-7764
URL: https://issues.apache.org/jira/browse/HBASE-7764
Project: HBase
Issue Type: Sub-task
Reporter: Ted Yu
Assignee: Ted Yu
Attachments: 7764.txt, 7764-v2.txt, 7764-v3.txt
Here is log snippet for
TestSnapshotCloneIndependence#testOnlineSnapshotRegionOperationsIndependent
(pay attention to region 1360020297284.2e43e47a882d3cff601eb222cad41f20.):
{code}
2013-02-04 15:24:58,369 INFO
[MASTER_SERVER_OPERATIONS-10.11.2.194,61955,1360020289835-0]
handler.SplitRegionHandler(115): Handled SPLIT event;
parent=test1360020295791,,1360020295793.794d37c0445b61619b5056623228827d.
daughter
a=test1360020295791,,1360020297284.2e43e47a882d3cff601eb222cad41f20.daughter
b=test1360020295791,dgb,1360020297284.b87834cee60702d883aa287df6aaeaef.
...
2013-02-04 15:25:02,005 DEBUG
[rs(10.11.2.194,61958,1360020290064)-snapshot-pool5-thread-1]
snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(78): Starting region
operation on
test1360020295791,,1360020297284.2e43e47a882d3cff601eb222cad41f20.
2013-02-04 15:25:02,005 DEBUG
[rs(10.11.2.194,61958,1360020290064)-snapshot-pool5-thread-1]
snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(81): Flush Snapshotting
region test1360020295791,,1360020297284.2e43e47a882d3cff601eb222cad41f20.
started...
2013-02-04 15:25:02,005 DEBUG [member:
apos;10.11.2.194,61958,1360020290064apos; subprocedure-pool3-thread-1]
snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(318): Completed
2/3 local region snapshots.
2013-02-04 15:25:02,005 DEBUG
[rs(10.11.2.194,61958,1360020290064)-snapshot-pool5-thread-1]
regionserver.HRegion(2485): Storing region-info for snapshot.
2013-02-04 15:25:02,006 DEBUG
[rs(10.11.2.194,61958,1360020290064)-snapshot-pool5-thread-1]
util.FSUtils(166): Creating
file=hdfs://localhost:61942/user/tyu/hbase/.snapshot/.tmp/snapshot_test1360020295791/2e43e47a882d3cff601eb222cad41f20/.tmp/.regioninfo
with permission=rwxrwxrwx
2013-02-04 15:25:02,014 DEBUG
[rs(10.11.2.194,61958,1360020290064)-snapshot-pool5-thread-1]
regionserver.HRegion(2489): Creating references for hfiles
2013-02-04 15:25:02,014 DEBUG
[rs(10.11.2.194,61958,1360020290064)-snapshot-pool5-thread-1]
regionserver.HRegion(2502): Adding snapshot references for
[hdfs://localhost:61942/user/tyu/hbase/test1360020295791/2e43e47a882d3cff601eb222cad41f20/fam/946b75e5f0ba445aa1c646b8cbc87e02]
hfiles
2013-02-04 15:25:02,015 DEBUG
[rs(10.11.2.194,61958,1360020290064)-snapshot-pool5-thread-1]
regionserver.HRegion(2516): Creating reference for file (1/1) :
hdfs://localhost:61942/user/tyu/hbase/test1360020295791/2e43e47a882d3cff601eb222cad41f20/fam/946b75e5f0ba445aa1c646b8cbc87e02
2013-02-04 15:25:02,017 DEBUG
[rs(10.11.2.194,61958,1360020290064)-snapshot-pool5-thread-1]
snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(84): ... Flush
Snapshotting region
test1360020295791,,1360020297284.2e43e47a882d3cff601eb222cad41f20. completed.
2013-02-04 15:25:02,017 DEBUG
[rs(10.11.2.194,61958,1360020290064)-snapshot-pool5-thread-1]
snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(86): Closing region
operation on
test1360020295791,,1360020297284.2e43e47a882d3cff601eb222cad41f20.
...
2013-02-04 15:25:03,836 INFO [PRI IPC Server handler 7 on 61958]
regionserver.HRegionServer(3600): Splitting
test1360020295791,,1360020297284.2e43e47a882d3cff601eb222cad41f20.
2013-02-04 15:25:03,836 DEBUG [PRI IPC Server handler 7 on 61958]
regionserver.HStore(1686): cannot split because midkey is the same as first
or last row
2013-02-04 15:25:03,836 DEBUG [PRI IPC Server handler 7 on 61958]
regionserver.CompactSplitThread(172): Region
test1360020295791,,1360020297284.2e43e47a882d3cff601eb222cad41f20. not
splittable because midkey=null
2013-02-04 15:25:03,837 DEBUG [main] catalog.CatalogTracker(231): Stopping
catalog tracker org.apache.hadoop.hbase.catalog.CatalogTracker@5c602d9d
2013-02-04 15:25:03,838 INFO [main]
client.TestSnapshotCloneIndependence(307): split requested for
test1360020295791,,1360020297284.2e43e47a882d3cff601eb222cad41f20.
2013-02-04 15:25:03,892 DEBUG [main] client.MetaScanner(199): Scanning .META.
starting at row=test1360020295791,,00 for max=2147483647 rows
using hconnection 0x53d9f80
2013-02-04 15:25:03,895 DEBUG [main] client.MetaScanner(252): Current INFO
from scan results = {NAME =gt;
[jira] [Commented] (HBASE-7764) [snapshot 130201 merge] Fix TestSnapshotCloneIndependence failure
[
https://issues.apache.org/jira/browse/HBASE-7764?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13574640#comment-13574640
]
Ted Yu commented on HBASE-7764:
---
Integrated to snapshots branch with comment added.
Thanks for the review, Jon.
BTW the above mentioned fix makes TestFlushSnapshotFromClient pass.
[snapshot 130201 merge] Fix TestSnapshotCloneIndependence failure
-
Key: HBASE-7764
URL: https://issues.apache.org/jira/browse/HBASE-7764
Project: HBase
Issue Type: Sub-task
Reporter: Ted Yu
Assignee: Ted Yu
Attachments: 7764.txt, 7764-v2.txt, 7764-v3.txt
Here is log snippet for
TestSnapshotCloneIndependence#testOnlineSnapshotRegionOperationsIndependent
(pay attention to region 1360020297284.2e43e47a882d3cff601eb222cad41f20.):
{code}
2013-02-04 15:24:58,369 INFO
[MASTER_SERVER_OPERATIONS-10.11.2.194,61955,1360020289835-0]
handler.SplitRegionHandler(115): Handled SPLIT event;
parent=test1360020295791,,1360020295793.794d37c0445b61619b5056623228827d.
daughter
a=test1360020295791,,1360020297284.2e43e47a882d3cff601eb222cad41f20.daughter
b=test1360020295791,dgb,1360020297284.b87834cee60702d883aa287df6aaeaef.
...
2013-02-04 15:25:02,005 DEBUG
[rs(10.11.2.194,61958,1360020290064)-snapshot-pool5-thread-1]
snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(78): Starting region
operation on
test1360020295791,,1360020297284.2e43e47a882d3cff601eb222cad41f20.
2013-02-04 15:25:02,005 DEBUG
[rs(10.11.2.194,61958,1360020290064)-snapshot-pool5-thread-1]
snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(81): Flush Snapshotting
region test1360020295791,,1360020297284.2e43e47a882d3cff601eb222cad41f20.
started...
2013-02-04 15:25:02,005 DEBUG [member:
apos;10.11.2.194,61958,1360020290064apos; subprocedure-pool3-thread-1]
snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(318): Completed
2/3 local region snapshots.
2013-02-04 15:25:02,005 DEBUG
[rs(10.11.2.194,61958,1360020290064)-snapshot-pool5-thread-1]
regionserver.HRegion(2485): Storing region-info for snapshot.
2013-02-04 15:25:02,006 DEBUG
[rs(10.11.2.194,61958,1360020290064)-snapshot-pool5-thread-1]
util.FSUtils(166): Creating
file=hdfs://localhost:61942/user/tyu/hbase/.snapshot/.tmp/snapshot_test1360020295791/2e43e47a882d3cff601eb222cad41f20/.tmp/.regioninfo
with permission=rwxrwxrwx
2013-02-04 15:25:02,014 DEBUG
[rs(10.11.2.194,61958,1360020290064)-snapshot-pool5-thread-1]
regionserver.HRegion(2489): Creating references for hfiles
2013-02-04 15:25:02,014 DEBUG
[rs(10.11.2.194,61958,1360020290064)-snapshot-pool5-thread-1]
regionserver.HRegion(2502): Adding snapshot references for
[hdfs://localhost:61942/user/tyu/hbase/test1360020295791/2e43e47a882d3cff601eb222cad41f20/fam/946b75e5f0ba445aa1c646b8cbc87e02]
hfiles
2013-02-04 15:25:02,015 DEBUG
[rs(10.11.2.194,61958,1360020290064)-snapshot-pool5-thread-1]
regionserver.HRegion(2516): Creating reference for file (1/1) :
hdfs://localhost:61942/user/tyu/hbase/test1360020295791/2e43e47a882d3cff601eb222cad41f20/fam/946b75e5f0ba445aa1c646b8cbc87e02
2013-02-04 15:25:02,017 DEBUG
[rs(10.11.2.194,61958,1360020290064)-snapshot-pool5-thread-1]
snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(84): ... Flush
Snapshotting region
test1360020295791,,1360020297284.2e43e47a882d3cff601eb222cad41f20. completed.
2013-02-04 15:25:02,017 DEBUG
[rs(10.11.2.194,61958,1360020290064)-snapshot-pool5-thread-1]
snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(86): Closing region
operation on
test1360020295791,,1360020297284.2e43e47a882d3cff601eb222cad41f20.
...
2013-02-04 15:25:03,836 INFO [PRI IPC Server handler 7 on 61958]
regionserver.HRegionServer(3600): Splitting
test1360020295791,,1360020297284.2e43e47a882d3cff601eb222cad41f20.
2013-02-04 15:25:03,836 DEBUG [PRI IPC Server handler 7 on 61958]
regionserver.HStore(1686): cannot split because midkey is the same as first
or last row
2013-02-04 15:25:03,836 DEBUG [PRI IPC Server handler 7 on 61958]
regionserver.CompactSplitThread(172): Region
test1360020295791,,1360020297284.2e43e47a882d3cff601eb222cad41f20. not
splittable because midkey=null
2013-02-04 15:25:03,837 DEBUG [main] catalog.CatalogTracker(231): Stopping
catalog tracker org.apache.hadoop.hbase.catalog.CatalogTracker@5c602d9d
2013-02-04 15:25:03,838 INFO [main]
client.TestSnapshotCloneIndependence(307): split requested for
test1360020295791,,1360020297284.2e43e47a882d3cff601eb222cad41f20.
2013-02-04 15:25:03,892 DEBUG [main] client.MetaScanner(199): Scanning .META.
starting at row=test1360020295791,,00 for max=2147483647 rows
using hconnection 0x53d9f80
2013-02-04 15:25:03,895 DEBUG [main] client.MetaScanner(252):
[jira] [Commented] (HBASE-7764) [snapshot 130201 merge] Fix TestSnapshotCloneIndependence failure
[
https://issues.apache.org/jira/browse/HBASE-7764?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13573723#comment-13573723
]
Ted Yu commented on HBASE-7764:
---
I applied Enis' HBASE-7721 patch to see if the new split logic makes a
difference.
TestSnapshotCloneIndependence still failed.
Specifying ConstantSizeRegionSplitPolicy made the test pass.
[snapshot 130201 merge] Fix TestSnapshotCloneIndependence failure
-
Key: HBASE-7764
URL: https://issues.apache.org/jira/browse/HBASE-7764
Project: HBase
Issue Type: Sub-task
Reporter: Ted Yu
Assignee: Ted Yu
Attachments: 7764.txt, 7764-v2.txt
Here is log snippet for
TestSnapshotCloneIndependence#testOnlineSnapshotRegionOperationsIndependent
(pay attention to region 1360020297284.2e43e47a882d3cff601eb222cad41f20.):
{code}
2013-02-04 15:24:58,369 INFO
[MASTER_SERVER_OPERATIONS-10.11.2.194,61955,1360020289835-0]
handler.SplitRegionHandler(115): Handled SPLIT event;
parent=test1360020295791,,1360020295793.794d37c0445b61619b5056623228827d.
daughter
a=test1360020295791,,1360020297284.2e43e47a882d3cff601eb222cad41f20.daughter
b=test1360020295791,dgb,1360020297284.b87834cee60702d883aa287df6aaeaef.
...
2013-02-04 15:25:02,005 DEBUG
[rs(10.11.2.194,61958,1360020290064)-snapshot-pool5-thread-1]
snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(78): Starting region
operation on
test1360020295791,,1360020297284.2e43e47a882d3cff601eb222cad41f20.
2013-02-04 15:25:02,005 DEBUG
[rs(10.11.2.194,61958,1360020290064)-snapshot-pool5-thread-1]
snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(81): Flush Snapshotting
region test1360020295791,,1360020297284.2e43e47a882d3cff601eb222cad41f20.
started...
2013-02-04 15:25:02,005 DEBUG [member:
apos;10.11.2.194,61958,1360020290064apos; subprocedure-pool3-thread-1]
snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(318): Completed
2/3 local region snapshots.
2013-02-04 15:25:02,005 DEBUG
[rs(10.11.2.194,61958,1360020290064)-snapshot-pool5-thread-1]
regionserver.HRegion(2485): Storing region-info for snapshot.
2013-02-04 15:25:02,006 DEBUG
[rs(10.11.2.194,61958,1360020290064)-snapshot-pool5-thread-1]
util.FSUtils(166): Creating
file=hdfs://localhost:61942/user/tyu/hbase/.snapshot/.tmp/snapshot_test1360020295791/2e43e47a882d3cff601eb222cad41f20/.tmp/.regioninfo
with permission=rwxrwxrwx
2013-02-04 15:25:02,014 DEBUG
[rs(10.11.2.194,61958,1360020290064)-snapshot-pool5-thread-1]
regionserver.HRegion(2489): Creating references for hfiles
2013-02-04 15:25:02,014 DEBUG
[rs(10.11.2.194,61958,1360020290064)-snapshot-pool5-thread-1]
regionserver.HRegion(2502): Adding snapshot references for
[hdfs://localhost:61942/user/tyu/hbase/test1360020295791/2e43e47a882d3cff601eb222cad41f20/fam/946b75e5f0ba445aa1c646b8cbc87e02]
hfiles
2013-02-04 15:25:02,015 DEBUG
[rs(10.11.2.194,61958,1360020290064)-snapshot-pool5-thread-1]
regionserver.HRegion(2516): Creating reference for file (1/1) :
hdfs://localhost:61942/user/tyu/hbase/test1360020295791/2e43e47a882d3cff601eb222cad41f20/fam/946b75e5f0ba445aa1c646b8cbc87e02
2013-02-04 15:25:02,017 DEBUG
[rs(10.11.2.194,61958,1360020290064)-snapshot-pool5-thread-1]
snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(84): ... Flush
Snapshotting region
test1360020295791,,1360020297284.2e43e47a882d3cff601eb222cad41f20. completed.
2013-02-04 15:25:02,017 DEBUG
[rs(10.11.2.194,61958,1360020290064)-snapshot-pool5-thread-1]
snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(86): Closing region
operation on
test1360020295791,,1360020297284.2e43e47a882d3cff601eb222cad41f20.
...
2013-02-04 15:25:03,836 INFO [PRI IPC Server handler 7 on 61958]
regionserver.HRegionServer(3600): Splitting
test1360020295791,,1360020297284.2e43e47a882d3cff601eb222cad41f20.
2013-02-04 15:25:03,836 DEBUG [PRI IPC Server handler 7 on 61958]
regionserver.HStore(1686): cannot split because midkey is the same as first
or last row
2013-02-04 15:25:03,836 DEBUG [PRI IPC Server handler 7 on 61958]
regionserver.CompactSplitThread(172): Region
test1360020295791,,1360020297284.2e43e47a882d3cff601eb222cad41f20. not
splittable because midkey=null
2013-02-04 15:25:03,837 DEBUG [main] catalog.CatalogTracker(231): Stopping
catalog tracker org.apache.hadoop.hbase.catalog.CatalogTracker@5c602d9d
2013-02-04 15:25:03,838 INFO [main]
client.TestSnapshotCloneIndependence(307): split requested for
test1360020295791,,1360020297284.2e43e47a882d3cff601eb222cad41f20.
2013-02-04 15:25:03,892 DEBUG [main] client.MetaScanner(199): Scanning .META.
starting at row=test1360020295791,,00 for max=2147483647 rows
using hconnection 0x53d9f80
2013-02-04 15:25:03,895 DEBUG [main]
[jira] [Commented] (HBASE-7764) [snapshot 130201 merge] Fix TestSnapshotCloneIndependence failure
[
https://issues.apache.org/jira/browse/HBASE-7764?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13573745#comment-13573745
]
Jonathan Hsieh commented on HBASE-7764:
---
Can you give a quick summary of why this policy vs the new default cause this
to fail/succeed? I can read the code but future readers it would be really
helpful.
[snapshot 130201 merge] Fix TestSnapshotCloneIndependence failure
-
Key: HBASE-7764
URL: https://issues.apache.org/jira/browse/HBASE-7764
Project: HBase
Issue Type: Sub-task
Reporter: Ted Yu
Assignee: Ted Yu
Attachments: 7764.txt, 7764-v2.txt
Here is log snippet for
TestSnapshotCloneIndependence#testOnlineSnapshotRegionOperationsIndependent
(pay attention to region 1360020297284.2e43e47a882d3cff601eb222cad41f20.):
{code}
2013-02-04 15:24:58,369 INFO
[MASTER_SERVER_OPERATIONS-10.11.2.194,61955,1360020289835-0]
handler.SplitRegionHandler(115): Handled SPLIT event;
parent=test1360020295791,,1360020295793.794d37c0445b61619b5056623228827d.
daughter
a=test1360020295791,,1360020297284.2e43e47a882d3cff601eb222cad41f20.daughter
b=test1360020295791,dgb,1360020297284.b87834cee60702d883aa287df6aaeaef.
...
2013-02-04 15:25:02,005 DEBUG
[rs(10.11.2.194,61958,1360020290064)-snapshot-pool5-thread-1]
snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(78): Starting region
operation on
test1360020295791,,1360020297284.2e43e47a882d3cff601eb222cad41f20.
2013-02-04 15:25:02,005 DEBUG
[rs(10.11.2.194,61958,1360020290064)-snapshot-pool5-thread-1]
snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(81): Flush Snapshotting
region test1360020295791,,1360020297284.2e43e47a882d3cff601eb222cad41f20.
started...
2013-02-04 15:25:02,005 DEBUG [member:
apos;10.11.2.194,61958,1360020290064apos; subprocedure-pool3-thread-1]
snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(318): Completed
2/3 local region snapshots.
2013-02-04 15:25:02,005 DEBUG
[rs(10.11.2.194,61958,1360020290064)-snapshot-pool5-thread-1]
regionserver.HRegion(2485): Storing region-info for snapshot.
2013-02-04 15:25:02,006 DEBUG
[rs(10.11.2.194,61958,1360020290064)-snapshot-pool5-thread-1]
util.FSUtils(166): Creating
file=hdfs://localhost:61942/user/tyu/hbase/.snapshot/.tmp/snapshot_test1360020295791/2e43e47a882d3cff601eb222cad41f20/.tmp/.regioninfo
with permission=rwxrwxrwx
2013-02-04 15:25:02,014 DEBUG
[rs(10.11.2.194,61958,1360020290064)-snapshot-pool5-thread-1]
regionserver.HRegion(2489): Creating references for hfiles
2013-02-04 15:25:02,014 DEBUG
[rs(10.11.2.194,61958,1360020290064)-snapshot-pool5-thread-1]
regionserver.HRegion(2502): Adding snapshot references for
[hdfs://localhost:61942/user/tyu/hbase/test1360020295791/2e43e47a882d3cff601eb222cad41f20/fam/946b75e5f0ba445aa1c646b8cbc87e02]
hfiles
2013-02-04 15:25:02,015 DEBUG
[rs(10.11.2.194,61958,1360020290064)-snapshot-pool5-thread-1]
regionserver.HRegion(2516): Creating reference for file (1/1) :
hdfs://localhost:61942/user/tyu/hbase/test1360020295791/2e43e47a882d3cff601eb222cad41f20/fam/946b75e5f0ba445aa1c646b8cbc87e02
2013-02-04 15:25:02,017 DEBUG
[rs(10.11.2.194,61958,1360020290064)-snapshot-pool5-thread-1]
snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(84): ... Flush
Snapshotting region
test1360020295791,,1360020297284.2e43e47a882d3cff601eb222cad41f20. completed.
2013-02-04 15:25:02,017 DEBUG
[rs(10.11.2.194,61958,1360020290064)-snapshot-pool5-thread-1]
snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(86): Closing region
operation on
test1360020295791,,1360020297284.2e43e47a882d3cff601eb222cad41f20.
...
2013-02-04 15:25:03,836 INFO [PRI IPC Server handler 7 on 61958]
regionserver.HRegionServer(3600): Splitting
test1360020295791,,1360020297284.2e43e47a882d3cff601eb222cad41f20.
2013-02-04 15:25:03,836 DEBUG [PRI IPC Server handler 7 on 61958]
regionserver.HStore(1686): cannot split because midkey is the same as first
or last row
2013-02-04 15:25:03,836 DEBUG [PRI IPC Server handler 7 on 61958]
regionserver.CompactSplitThread(172): Region
test1360020295791,,1360020297284.2e43e47a882d3cff601eb222cad41f20. not
splittable because midkey=null
2013-02-04 15:25:03,837 DEBUG [main] catalog.CatalogTracker(231): Stopping
catalog tracker org.apache.hadoop.hbase.catalog.CatalogTracker@5c602d9d
2013-02-04 15:25:03,838 INFO [main]
client.TestSnapshotCloneIndependence(307): split requested for
test1360020295791,,1360020297284.2e43e47a882d3cff601eb222cad41f20.
2013-02-04 15:25:03,892 DEBUG [main] client.MetaScanner(199): Scanning .META.
starting at row=test1360020295791,,00 for max=2147483647 rows
using hconnection 0x53d9f80
2013-02-04 15:25:03,895 DEBUG [main]
[jira] [Commented] (HBASE-7764) [snapshot 130201 merge] Fix TestSnapshotCloneIndependence failure
[
https://issues.apache.org/jira/browse/HBASE-7764?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13573766#comment-13573766
]
Ted Yu commented on HBASE-7764:
---
After reverting HBASE-7412, the test passed.
Here is hbase.hregion.max.filesize entry from
hbase-server/src/test/resources/hbase-site.xml:
{code}
property
namehbase.hregion.max.filesize/name
value67108864/value
{code}
Here is the default value:
{code}
namehbase.hregion.max.filesize/name
value10737418240/value
{code}
Jimmy's change made the custom value (67MB) effective.
[snapshot 130201 merge] Fix TestSnapshotCloneIndependence failure
-
Key: HBASE-7764
URL: https://issues.apache.org/jira/browse/HBASE-7764
Project: HBase
Issue Type: Sub-task
Reporter: Ted Yu
Assignee: Ted Yu
Attachments: 7764.txt, 7764-v2.txt
Here is log snippet for
TestSnapshotCloneIndependence#testOnlineSnapshotRegionOperationsIndependent
(pay attention to region 1360020297284.2e43e47a882d3cff601eb222cad41f20.):
{code}
2013-02-04 15:24:58,369 INFO
[MASTER_SERVER_OPERATIONS-10.11.2.194,61955,1360020289835-0]
handler.SplitRegionHandler(115): Handled SPLIT event;
parent=test1360020295791,,1360020295793.794d37c0445b61619b5056623228827d.
daughter
a=test1360020295791,,1360020297284.2e43e47a882d3cff601eb222cad41f20.daughter
b=test1360020295791,dgb,1360020297284.b87834cee60702d883aa287df6aaeaef.
...
2013-02-04 15:25:02,005 DEBUG
[rs(10.11.2.194,61958,1360020290064)-snapshot-pool5-thread-1]
snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(78): Starting region
operation on
test1360020295791,,1360020297284.2e43e47a882d3cff601eb222cad41f20.
2013-02-04 15:25:02,005 DEBUG
[rs(10.11.2.194,61958,1360020290064)-snapshot-pool5-thread-1]
snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(81): Flush Snapshotting
region test1360020295791,,1360020297284.2e43e47a882d3cff601eb222cad41f20.
started...
2013-02-04 15:25:02,005 DEBUG [member:
apos;10.11.2.194,61958,1360020290064apos; subprocedure-pool3-thread-1]
snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(318): Completed
2/3 local region snapshots.
2013-02-04 15:25:02,005 DEBUG
[rs(10.11.2.194,61958,1360020290064)-snapshot-pool5-thread-1]
regionserver.HRegion(2485): Storing region-info for snapshot.
2013-02-04 15:25:02,006 DEBUG
[rs(10.11.2.194,61958,1360020290064)-snapshot-pool5-thread-1]
util.FSUtils(166): Creating
file=hdfs://localhost:61942/user/tyu/hbase/.snapshot/.tmp/snapshot_test1360020295791/2e43e47a882d3cff601eb222cad41f20/.tmp/.regioninfo
with permission=rwxrwxrwx
2013-02-04 15:25:02,014 DEBUG
[rs(10.11.2.194,61958,1360020290064)-snapshot-pool5-thread-1]
regionserver.HRegion(2489): Creating references for hfiles
2013-02-04 15:25:02,014 DEBUG
[rs(10.11.2.194,61958,1360020290064)-snapshot-pool5-thread-1]
regionserver.HRegion(2502): Adding snapshot references for
[hdfs://localhost:61942/user/tyu/hbase/test1360020295791/2e43e47a882d3cff601eb222cad41f20/fam/946b75e5f0ba445aa1c646b8cbc87e02]
hfiles
2013-02-04 15:25:02,015 DEBUG
[rs(10.11.2.194,61958,1360020290064)-snapshot-pool5-thread-1]
regionserver.HRegion(2516): Creating reference for file (1/1) :
hdfs://localhost:61942/user/tyu/hbase/test1360020295791/2e43e47a882d3cff601eb222cad41f20/fam/946b75e5f0ba445aa1c646b8cbc87e02
2013-02-04 15:25:02,017 DEBUG
[rs(10.11.2.194,61958,1360020290064)-snapshot-pool5-thread-1]
snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(84): ... Flush
Snapshotting region
test1360020295791,,1360020297284.2e43e47a882d3cff601eb222cad41f20. completed.
2013-02-04 15:25:02,017 DEBUG
[rs(10.11.2.194,61958,1360020290064)-snapshot-pool5-thread-1]
snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(86): Closing region
operation on
test1360020295791,,1360020297284.2e43e47a882d3cff601eb222cad41f20.
...
2013-02-04 15:25:03,836 INFO [PRI IPC Server handler 7 on 61958]
regionserver.HRegionServer(3600): Splitting
test1360020295791,,1360020297284.2e43e47a882d3cff601eb222cad41f20.
2013-02-04 15:25:03,836 DEBUG [PRI IPC Server handler 7 on 61958]
regionserver.HStore(1686): cannot split because midkey is the same as first
or last row
2013-02-04 15:25:03,836 DEBUG [PRI IPC Server handler 7 on 61958]
regionserver.CompactSplitThread(172): Region
test1360020295791,,1360020297284.2e43e47a882d3cff601eb222cad41f20. not
splittable because midkey=null
2013-02-04 15:25:03,837 DEBUG [main] catalog.CatalogTracker(231): Stopping
catalog tracker org.apache.hadoop.hbase.catalog.CatalogTracker@5c602d9d
2013-02-04 15:25:03,838 INFO [main]
client.TestSnapshotCloneIndependence(307): split requested for
test1360020295791,,1360020297284.2e43e47a882d3cff601eb222cad41f20.
2013-02-04
[jira] [Commented] (HBASE-7764) [snapshot 130201 merge] Fix TestSnapshotCloneIndependence failure
[
https://issues.apache.org/jira/browse/HBASE-7764?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13572618#comment-13572618
]
Jonathan Hsieh commented on HBASE-7764:
---
I actually avoided this by doing something similar to HBASE-7739 (without
completely undrestanding why it works). Are these related? Since this affect
several tests, I'd really like to better understand *why* in more depth than
the specified there. What patch(es) introduced to trunk between 12/18/12 and
2/1/13 potentially caused these split related complications?
[snapshot 130201 merge] Fix TestSnapshotCloneIndependence failure
-
Key: HBASE-7764
URL: https://issues.apache.org/jira/browse/HBASE-7764
Project: HBase
Issue Type: Sub-task
Reporter: Ted Yu
Assignee: Ted Yu
Attachments: 7764.txt, 7764-v2.txt
Here is log snippet for
TestSnapshotCloneIndependence#testOnlineSnapshotRegionOperationsIndependent
(pay attention to region 1360020297284.2e43e47a882d3cff601eb222cad41f20.):
{code}
2013-02-04 15:24:58,369 INFO
[MASTER_SERVER_OPERATIONS-10.11.2.194,61955,1360020289835-0]
handler.SplitRegionHandler(115): Handled SPLIT event;
parent=test1360020295791,,1360020295793.794d37c0445b61619b5056623228827d.
daughter
a=test1360020295791,,1360020297284.2e43e47a882d3cff601eb222cad41f20.daughter
b=test1360020295791,dgb,1360020297284.b87834cee60702d883aa287df6aaeaef.
...
2013-02-04 15:25:02,005 DEBUG
[rs(10.11.2.194,61958,1360020290064)-snapshot-pool5-thread-1]
snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(78): Starting region
operation on
test1360020295791,,1360020297284.2e43e47a882d3cff601eb222cad41f20.
2013-02-04 15:25:02,005 DEBUG
[rs(10.11.2.194,61958,1360020290064)-snapshot-pool5-thread-1]
snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(81): Flush Snapshotting
region test1360020295791,,1360020297284.2e43e47a882d3cff601eb222cad41f20.
started...
2013-02-04 15:25:02,005 DEBUG [member:
apos;10.11.2.194,61958,1360020290064apos; subprocedure-pool3-thread-1]
snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(318): Completed
2/3 local region snapshots.
2013-02-04 15:25:02,005 DEBUG
[rs(10.11.2.194,61958,1360020290064)-snapshot-pool5-thread-1]
regionserver.HRegion(2485): Storing region-info for snapshot.
2013-02-04 15:25:02,006 DEBUG
[rs(10.11.2.194,61958,1360020290064)-snapshot-pool5-thread-1]
util.FSUtils(166): Creating
file=hdfs://localhost:61942/user/tyu/hbase/.snapshot/.tmp/snapshot_test1360020295791/2e43e47a882d3cff601eb222cad41f20/.tmp/.regioninfo
with permission=rwxrwxrwx
2013-02-04 15:25:02,014 DEBUG
[rs(10.11.2.194,61958,1360020290064)-snapshot-pool5-thread-1]
regionserver.HRegion(2489): Creating references for hfiles
2013-02-04 15:25:02,014 DEBUG
[rs(10.11.2.194,61958,1360020290064)-snapshot-pool5-thread-1]
regionserver.HRegion(2502): Adding snapshot references for
[hdfs://localhost:61942/user/tyu/hbase/test1360020295791/2e43e47a882d3cff601eb222cad41f20/fam/946b75e5f0ba445aa1c646b8cbc87e02]
hfiles
2013-02-04 15:25:02,015 DEBUG
[rs(10.11.2.194,61958,1360020290064)-snapshot-pool5-thread-1]
regionserver.HRegion(2516): Creating reference for file (1/1) :
hdfs://localhost:61942/user/tyu/hbase/test1360020295791/2e43e47a882d3cff601eb222cad41f20/fam/946b75e5f0ba445aa1c646b8cbc87e02
2013-02-04 15:25:02,017 DEBUG
[rs(10.11.2.194,61958,1360020290064)-snapshot-pool5-thread-1]
snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(84): ... Flush
Snapshotting region
test1360020295791,,1360020297284.2e43e47a882d3cff601eb222cad41f20. completed.
2013-02-04 15:25:02,017 DEBUG
[rs(10.11.2.194,61958,1360020290064)-snapshot-pool5-thread-1]
snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(86): Closing region
operation on
test1360020295791,,1360020297284.2e43e47a882d3cff601eb222cad41f20.
...
2013-02-04 15:25:03,836 INFO [PRI IPC Server handler 7 on 61958]
regionserver.HRegionServer(3600): Splitting
test1360020295791,,1360020297284.2e43e47a882d3cff601eb222cad41f20.
2013-02-04 15:25:03,836 DEBUG [PRI IPC Server handler 7 on 61958]
regionserver.HStore(1686): cannot split because midkey is the same as first
or last row
2013-02-04 15:25:03,836 DEBUG [PRI IPC Server handler 7 on 61958]
regionserver.CompactSplitThread(172): Region
test1360020295791,,1360020297284.2e43e47a882d3cff601eb222cad41f20. not
splittable because midkey=null
2013-02-04 15:25:03,837 DEBUG [main] catalog.CatalogTracker(231): Stopping
catalog tracker org.apache.hadoop.hbase.catalog.CatalogTracker@5c602d9d
2013-02-04 15:25:03,838 INFO [main]
client.TestSnapshotCloneIndependence(307): split requested for
test1360020295791,,1360020297284.2e43e47a882d3cff601eb222cad41f20.
2013-02-04 15:25:03,892
[jira] [Commented] (HBASE-7764) [snapshot 130201 merge] Fix TestSnapshotCloneIndependence failure
[
https://issues.apache.org/jira/browse/HBASE-7764?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13572653#comment-13572653
]
Ted Yu commented on HBASE-7764:
---
{code}
tyu$ svn log
hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/IncreasingToUpperBoundRegionSplitPolicy.java
| head
r1426657 | jxiang | 2012-12-28 15:12:12 -0800 (Fri, 28 Dec 2012) | 1 line
HBASE-7412 Fix how HTableDescriptor handles default max file size and flush size
{code}
Need to dig deeper to see if the above change is related.
[snapshot 130201 merge] Fix TestSnapshotCloneIndependence failure
-
Key: HBASE-7764
URL: https://issues.apache.org/jira/browse/HBASE-7764
Project: HBase
Issue Type: Sub-task
Reporter: Ted Yu
Assignee: Ted Yu
Attachments: 7764.txt, 7764-v2.txt
Here is log snippet for
TestSnapshotCloneIndependence#testOnlineSnapshotRegionOperationsIndependent
(pay attention to region 1360020297284.2e43e47a882d3cff601eb222cad41f20.):
{code}
2013-02-04 15:24:58,369 INFO
[MASTER_SERVER_OPERATIONS-10.11.2.194,61955,1360020289835-0]
handler.SplitRegionHandler(115): Handled SPLIT event;
parent=test1360020295791,,1360020295793.794d37c0445b61619b5056623228827d.
daughter
a=test1360020295791,,1360020297284.2e43e47a882d3cff601eb222cad41f20.daughter
b=test1360020295791,dgb,1360020297284.b87834cee60702d883aa287df6aaeaef.
...
2013-02-04 15:25:02,005 DEBUG
[rs(10.11.2.194,61958,1360020290064)-snapshot-pool5-thread-1]
snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(78): Starting region
operation on
test1360020295791,,1360020297284.2e43e47a882d3cff601eb222cad41f20.
2013-02-04 15:25:02,005 DEBUG
[rs(10.11.2.194,61958,1360020290064)-snapshot-pool5-thread-1]
snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(81): Flush Snapshotting
region test1360020295791,,1360020297284.2e43e47a882d3cff601eb222cad41f20.
started...
2013-02-04 15:25:02,005 DEBUG [member:
apos;10.11.2.194,61958,1360020290064apos; subprocedure-pool3-thread-1]
snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(318): Completed
2/3 local region snapshots.
2013-02-04 15:25:02,005 DEBUG
[rs(10.11.2.194,61958,1360020290064)-snapshot-pool5-thread-1]
regionserver.HRegion(2485): Storing region-info for snapshot.
2013-02-04 15:25:02,006 DEBUG
[rs(10.11.2.194,61958,1360020290064)-snapshot-pool5-thread-1]
util.FSUtils(166): Creating
file=hdfs://localhost:61942/user/tyu/hbase/.snapshot/.tmp/snapshot_test1360020295791/2e43e47a882d3cff601eb222cad41f20/.tmp/.regioninfo
with permission=rwxrwxrwx
2013-02-04 15:25:02,014 DEBUG
[rs(10.11.2.194,61958,1360020290064)-snapshot-pool5-thread-1]
regionserver.HRegion(2489): Creating references for hfiles
2013-02-04 15:25:02,014 DEBUG
[rs(10.11.2.194,61958,1360020290064)-snapshot-pool5-thread-1]
regionserver.HRegion(2502): Adding snapshot references for
[hdfs://localhost:61942/user/tyu/hbase/test1360020295791/2e43e47a882d3cff601eb222cad41f20/fam/946b75e5f0ba445aa1c646b8cbc87e02]
hfiles
2013-02-04 15:25:02,015 DEBUG
[rs(10.11.2.194,61958,1360020290064)-snapshot-pool5-thread-1]
regionserver.HRegion(2516): Creating reference for file (1/1) :
hdfs://localhost:61942/user/tyu/hbase/test1360020295791/2e43e47a882d3cff601eb222cad41f20/fam/946b75e5f0ba445aa1c646b8cbc87e02
2013-02-04 15:25:02,017 DEBUG
[rs(10.11.2.194,61958,1360020290064)-snapshot-pool5-thread-1]
snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(84): ... Flush
Snapshotting region
test1360020295791,,1360020297284.2e43e47a882d3cff601eb222cad41f20. completed.
2013-02-04 15:25:02,017 DEBUG
[rs(10.11.2.194,61958,1360020290064)-snapshot-pool5-thread-1]
snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(86): Closing region
operation on
test1360020295791,,1360020297284.2e43e47a882d3cff601eb222cad41f20.
...
2013-02-04 15:25:03,836 INFO [PRI IPC Server handler 7 on 61958]
regionserver.HRegionServer(3600): Splitting
test1360020295791,,1360020297284.2e43e47a882d3cff601eb222cad41f20.
2013-02-04 15:25:03,836 DEBUG [PRI IPC Server handler 7 on 61958]
regionserver.HStore(1686): cannot split because midkey is the same as first
or last row
2013-02-04 15:25:03,836 DEBUG [PRI IPC Server handler 7 on 61958]
regionserver.CompactSplitThread(172): Region
test1360020295791,,1360020297284.2e43e47a882d3cff601eb222cad41f20. not
splittable because midkey=null
2013-02-04 15:25:03,837 DEBUG [main] catalog.CatalogTracker(231): Stopping
catalog tracker org.apache.hadoop.hbase.catalog.CatalogTracker@5c602d9d
2013-02-04 15:25:03,838 INFO [main]
client.TestSnapshotCloneIndependence(307): split requested for
