[jira] [Updated] (HBASE-5659) TestAtomicOperation.testMultiRowMutationMultiThreads is still failing occasionally
[
https://issues.apache.org/jira/browse/HBASE-5659?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Lars Hofhansl updated HBASE-5659:
-
Attachment: 5659-addendum.txt
Here's the addendum I have in mind.
Makes TestAtomicOperation pass even with a low open files setting (256, which
previously would always fail).
The previous changes are still valid.
TestAtomicOperation.testMultiRowMutationMultiThreads is still failing
occasionally
--
Key: HBASE-5659
URL: https://issues.apache.org/jira/browse/HBASE-5659
Project: HBase
Issue Type: Sub-task
Reporter: Lars Hofhansl
Assignee: Lars Hofhansl
Priority: Minor
Fix For: 0.96.0, 0.94.1
Attachments: 5659-addendum.txt, 5659-v2.txt, 5659.txt
See run here:
https://builds.apache.org/job/PreCommit-HBASE-Build/1318//testReport/org.apache.hadoop.hbase.regionserver/TestAtomicOperation/testMultiRowMutationMultiThreads/
{quote}
2012-03-27 04:36:12,627 DEBUG [Thread-118] regionserver.StoreScanner(499):
Storescanner.peek() is changed where before =
rowB/colfamily11:qual1/7202/Put/vlen=6/ts=7922,and after =
rowB/colfamily11:qual1/7199/DeleteColumn/vlen=0/ts=0
2012-03-27 04:36:12,629 INFO [Thread-121] regionserver.HRegion(1558):
Finished memstore flush of ~2.9k/2952, currentsize=1.6k/1640 for region
testtable,,1332822963417.7cd30e219714cfc5e91f69def66e7f81. in 14ms,
sequenceid=7927, compaction requested=true
2012-03-27 04:36:12,629 DEBUG [Thread-126]
regionserver.TestAtomicOperation$2(362): flushing
2012-03-27 04:36:12,630 DEBUG [Thread-126] regionserver.HRegion(1426):
Started memstore flush for
testtable,,1332822963417.7cd30e219714cfc5e91f69def66e7f81., current region
memstore size 1.9k
2012-03-27 04:36:12,630 DEBUG [Thread-126] regionserver.HRegion(1474):
Finished snapshotting
testtable,,1332822963417.7cd30e219714cfc5e91f69def66e7f81., commencing wait
for mvcc, flushsize=1968
2012-03-27 04:36:12,630 DEBUG [Thread-126] regionserver.HRegion(1484):
Finished snapshotting, commencing flushing stores
2012-03-27 04:36:12,630 DEBUG [Thread-126] util.FSUtils(153): Creating
file=/home/jenkins/jenkins-slave/workspace/PreCommit-HBASE-Build/trunk/target/test-data/b9091c3c-961e-4035-850a-83ad14d517cc/TestAtomicOperationtestMultiRowMutationMultiThreads/testtable/7cd30e219714cfc5e91f69def66e7f81/.tmp/61954619003e469baf1a34be5ff2ec57
with permission=rwxrwxrwx
2012-03-27 04:36:12,631 DEBUG [Thread-126] hfile.HFileWriterV2(143):
Initialized with CacheConfig:enabled [cacheDataOnRead=true]
[cacheDataOnWrite=false] [cacheIndexesOnWrite=false]
[cacheBloomsOnWrite=false] [cacheEvictOnClose=false] [cacheCompressed=false]
2012-03-27 04:36:12,631 INFO [Thread-126]
regionserver.StoreFile$Writer(997): Delete Family Bloom filter type for
/home/jenkins/jenkins-slave/workspace/PreCommit-HBASE-Build/trunk/target/test-data/b9091c3c-961e-4035-850a-83ad14d517cc/TestAtomicOperationtestMultiRowMutationMultiThreads/testtable/7cd30e219714cfc5e91f69def66e7f81/.tmp/61954619003e469baf1a34be5ff2ec57:
CompoundBloomFilterWriter
2012-03-27 04:36:12,632 INFO [Thread-126]
regionserver.StoreFile$Writer(1220): NO General Bloom and NO DeleteFamily was
added to HFile
(/home/jenkins/jenkins-slave/workspace/PreCommit-HBASE-Build/trunk/target/test-data/b9091c3c-961e-4035-850a-83ad14d517cc/TestAtomicOperationtestMultiRowMutationMultiThreads/testtable/7cd30e219714cfc5e91f69def66e7f81/.tmp/61954619003e469baf1a34be5ff2ec57)
2012-03-27 04:36:12,632 INFO [Thread-126] regionserver.Store(770): Flushed ,
sequenceid=7934, memsize=1.9k, into tmp file
/home/jenkins/jenkins-slave/workspace/PreCommit-HBASE-Build/trunk/target/test-data/b9091c3c-961e-4035-850a-83ad14d517cc/TestAtomicOperationtestMultiRowMutationMultiThreads/testtable/7cd30e219714cfc5e91f69def66e7f81/.tmp/61954619003e469baf1a34be5ff2ec57
2012-03-27 04:36:12,632 DEBUG [Thread-126] regionserver.Store(795): Renaming
flushed file at
/home/jenkins/jenkins-slave/workspace/PreCommit-HBASE-Build/trunk/target/test-data/b9091c3c-961e-4035-850a-83ad14d517cc/TestAtomicOperationtestMultiRowMutationMultiThreads/testtable/7cd30e219714cfc5e91f69def66e7f81/.tmp/61954619003e469baf1a34be5ff2ec57
to
/home/jenkins/jenkins-slave/workspace/PreCommit-HBASE-Build/trunk/target/test-data/b9091c3c-961e-4035-850a-83ad14d517cc/TestAtomicOperationtestMultiRowMutationMultiThreads/testtable/7cd30e219714cfc5e91f69def66e7f81/colfamily11/61954619003e469baf1a34be5ff2ec57
2012-03-27 04:36:12,634 INFO [Thread-126] regionserver.Store(818): Added
[jira] [Updated] (HBASE-5659) TestAtomicOperation.testMultiRowMutationMultiThreads is still failing occasionally
[
https://issues.apache.org/jira/browse/HBASE-5659?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Lars Hofhansl updated HBASE-5659:
-
Attachment: 5659-addendum-v2.txt
The reader being closed in commitFile was a dud, I think.
Here's a patch that throws in some compactions during the test. With that I can
reliably run TestAtomicOperation with open files set to 512 (which would
other reliably fail the test).
The test machines have open files = 1024, so that would provide enough buffer.
Addendum-v2 is not contentious I think. Will commit soon, unless there are
objections.
TestAtomicOperation.testMultiRowMutationMultiThreads is still failing
occasionally
--
Key: HBASE-5659
URL: https://issues.apache.org/jira/browse/HBASE-5659
Project: HBase
Issue Type: Sub-task
Reporter: Lars Hofhansl
Assignee: Lars Hofhansl
Priority: Minor
Fix For: 0.96.0, 0.94.1
Attachments: 5659-addendum-v2.txt, 5659-addendum.txt, 5659-v2.txt,
5659.txt
See run here:
https://builds.apache.org/job/PreCommit-HBASE-Build/1318//testReport/org.apache.hadoop.hbase.regionserver/TestAtomicOperation/testMultiRowMutationMultiThreads/
{quote}
2012-03-27 04:36:12,627 DEBUG [Thread-118] regionserver.StoreScanner(499):
Storescanner.peek() is changed where before =
rowB/colfamily11:qual1/7202/Put/vlen=6/ts=7922,and after =
rowB/colfamily11:qual1/7199/DeleteColumn/vlen=0/ts=0
2012-03-27 04:36:12,629 INFO [Thread-121] regionserver.HRegion(1558):
Finished memstore flush of ~2.9k/2952, currentsize=1.6k/1640 for region
testtable,,1332822963417.7cd30e219714cfc5e91f69def66e7f81. in 14ms,
sequenceid=7927, compaction requested=true
2012-03-27 04:36:12,629 DEBUG [Thread-126]
regionserver.TestAtomicOperation$2(362): flushing
2012-03-27 04:36:12,630 DEBUG [Thread-126] regionserver.HRegion(1426):
Started memstore flush for
testtable,,1332822963417.7cd30e219714cfc5e91f69def66e7f81., current region
memstore size 1.9k
2012-03-27 04:36:12,630 DEBUG [Thread-126] regionserver.HRegion(1474):
Finished snapshotting
testtable,,1332822963417.7cd30e219714cfc5e91f69def66e7f81., commencing wait
for mvcc, flushsize=1968
2012-03-27 04:36:12,630 DEBUG [Thread-126] regionserver.HRegion(1484):
Finished snapshotting, commencing flushing stores
2012-03-27 04:36:12,630 DEBUG [Thread-126] util.FSUtils(153): Creating
file=/home/jenkins/jenkins-slave/workspace/PreCommit-HBASE-Build/trunk/target/test-data/b9091c3c-961e-4035-850a-83ad14d517cc/TestAtomicOperationtestMultiRowMutationMultiThreads/testtable/7cd30e219714cfc5e91f69def66e7f81/.tmp/61954619003e469baf1a34be5ff2ec57
with permission=rwxrwxrwx
2012-03-27 04:36:12,631 DEBUG [Thread-126] hfile.HFileWriterV2(143):
Initialized with CacheConfig:enabled [cacheDataOnRead=true]
[cacheDataOnWrite=false] [cacheIndexesOnWrite=false]
[cacheBloomsOnWrite=false] [cacheEvictOnClose=false] [cacheCompressed=false]
2012-03-27 04:36:12,631 INFO [Thread-126]
regionserver.StoreFile$Writer(997): Delete Family Bloom filter type for
/home/jenkins/jenkins-slave/workspace/PreCommit-HBASE-Build/trunk/target/test-data/b9091c3c-961e-4035-850a-83ad14d517cc/TestAtomicOperationtestMultiRowMutationMultiThreads/testtable/7cd30e219714cfc5e91f69def66e7f81/.tmp/61954619003e469baf1a34be5ff2ec57:
CompoundBloomFilterWriter
2012-03-27 04:36:12,632 INFO [Thread-126]
regionserver.StoreFile$Writer(1220): NO General Bloom and NO DeleteFamily was
added to HFile
(/home/jenkins/jenkins-slave/workspace/PreCommit-HBASE-Build/trunk/target/test-data/b9091c3c-961e-4035-850a-83ad14d517cc/TestAtomicOperationtestMultiRowMutationMultiThreads/testtable/7cd30e219714cfc5e91f69def66e7f81/.tmp/61954619003e469baf1a34be5ff2ec57)
2012-03-27 04:36:12,632 INFO [Thread-126] regionserver.Store(770): Flushed ,
sequenceid=7934, memsize=1.9k, into tmp file
/home/jenkins/jenkins-slave/workspace/PreCommit-HBASE-Build/trunk/target/test-data/b9091c3c-961e-4035-850a-83ad14d517cc/TestAtomicOperationtestMultiRowMutationMultiThreads/testtable/7cd30e219714cfc5e91f69def66e7f81/.tmp/61954619003e469baf1a34be5ff2ec57
2012-03-27 04:36:12,632 DEBUG [Thread-126] regionserver.Store(795): Renaming
flushed file at
/home/jenkins/jenkins-slave/workspace/PreCommit-HBASE-Build/trunk/target/test-data/b9091c3c-961e-4035-850a-83ad14d517cc/TestAtomicOperationtestMultiRowMutationMultiThreads/testtable/7cd30e219714cfc5e91f69def66e7f81/.tmp/61954619003e469baf1a34be5ff2ec57
to
/home/jenkins/jenkins-slave/workspace/PreCommit-HBASE-Build/trunk/target/test-data/b9091c3c-961e-4035-850a-83ad14d517cc/TestAtomicOperationtestMultiRowMutationMultiThreads/testtable/7cd30e219714cfc5e91f69def66e7f81/colfamily11/61954619003e469baf1a34be5ff2ec57
2012-03-27 04:36:12,634 INFO
[jira] [Updated] (HBASE-5659) TestAtomicOperation.testMultiRowMutationMultiThreads is still failing occasionally
[
https://issues.apache.org/jira/browse/HBASE-5659?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Lars Hofhansl updated HBASE-5659:
-
Attachment: 5659-v2.txt
Patch that only compares rows when top KV is changed and also reduces the
number of ops/thread to 500 in testMultiRowMutationMultiThreads (same value now
as in testRowMutationMultiThreads).
I will commit this soon, if no objections.
TestAtomicOperation.testMultiRowMutationMultiThreads is still failing
occasionally
--
Key: HBASE-5659
URL: https://issues.apache.org/jira/browse/HBASE-5659
Project: HBase
Issue Type: Sub-task
Reporter: Lars Hofhansl
Assignee: Lars Hofhansl
Priority: Minor
Fix For: 0.96.0, 0.94.2
Attachments: 5659-v2.txt, 5659.txt
See run here:
https://builds.apache.org/job/PreCommit-HBASE-Build/1318//testReport/org.apache.hadoop.hbase.regionserver/TestAtomicOperation/testMultiRowMutationMultiThreads/
{quote}
2012-03-27 04:36:12,627 DEBUG [Thread-118] regionserver.StoreScanner(499):
Storescanner.peek() is changed where before =
rowB/colfamily11:qual1/7202/Put/vlen=6/ts=7922,and after =
rowB/colfamily11:qual1/7199/DeleteColumn/vlen=0/ts=0
2012-03-27 04:36:12,629 INFO [Thread-121] regionserver.HRegion(1558):
Finished memstore flush of ~2.9k/2952, currentsize=1.6k/1640 for region
testtable,,1332822963417.7cd30e219714cfc5e91f69def66e7f81. in 14ms,
sequenceid=7927, compaction requested=true
2012-03-27 04:36:12,629 DEBUG [Thread-126]
regionserver.TestAtomicOperation$2(362): flushing
2012-03-27 04:36:12,630 DEBUG [Thread-126] regionserver.HRegion(1426):
Started memstore flush for
testtable,,1332822963417.7cd30e219714cfc5e91f69def66e7f81., current region
memstore size 1.9k
2012-03-27 04:36:12,630 DEBUG [Thread-126] regionserver.HRegion(1474):
Finished snapshotting
testtable,,1332822963417.7cd30e219714cfc5e91f69def66e7f81., commencing wait
for mvcc, flushsize=1968
2012-03-27 04:36:12,630 DEBUG [Thread-126] regionserver.HRegion(1484):
Finished snapshotting, commencing flushing stores
2012-03-27 04:36:12,630 DEBUG [Thread-126] util.FSUtils(153): Creating
file=/home/jenkins/jenkins-slave/workspace/PreCommit-HBASE-Build/trunk/target/test-data/b9091c3c-961e-4035-850a-83ad14d517cc/TestAtomicOperationtestMultiRowMutationMultiThreads/testtable/7cd30e219714cfc5e91f69def66e7f81/.tmp/61954619003e469baf1a34be5ff2ec57
with permission=rwxrwxrwx
2012-03-27 04:36:12,631 DEBUG [Thread-126] hfile.HFileWriterV2(143):
Initialized with CacheConfig:enabled [cacheDataOnRead=true]
[cacheDataOnWrite=false] [cacheIndexesOnWrite=false]
[cacheBloomsOnWrite=false] [cacheEvictOnClose=false] [cacheCompressed=false]
2012-03-27 04:36:12,631 INFO [Thread-126]
regionserver.StoreFile$Writer(997): Delete Family Bloom filter type for
/home/jenkins/jenkins-slave/workspace/PreCommit-HBASE-Build/trunk/target/test-data/b9091c3c-961e-4035-850a-83ad14d517cc/TestAtomicOperationtestMultiRowMutationMultiThreads/testtable/7cd30e219714cfc5e91f69def66e7f81/.tmp/61954619003e469baf1a34be5ff2ec57:
CompoundBloomFilterWriter
2012-03-27 04:36:12,632 INFO [Thread-126]
regionserver.StoreFile$Writer(1220): NO General Bloom and NO DeleteFamily was
added to HFile
(/home/jenkins/jenkins-slave/workspace/PreCommit-HBASE-Build/trunk/target/test-data/b9091c3c-961e-4035-850a-83ad14d517cc/TestAtomicOperationtestMultiRowMutationMultiThreads/testtable/7cd30e219714cfc5e91f69def66e7f81/.tmp/61954619003e469baf1a34be5ff2ec57)
2012-03-27 04:36:12,632 INFO [Thread-126] regionserver.Store(770): Flushed ,
sequenceid=7934, memsize=1.9k, into tmp file
/home/jenkins/jenkins-slave/workspace/PreCommit-HBASE-Build/trunk/target/test-data/b9091c3c-961e-4035-850a-83ad14d517cc/TestAtomicOperationtestMultiRowMutationMultiThreads/testtable/7cd30e219714cfc5e91f69def66e7f81/.tmp/61954619003e469baf1a34be5ff2ec57
2012-03-27 04:36:12,632 DEBUG [Thread-126] regionserver.Store(795): Renaming
flushed file at
/home/jenkins/jenkins-slave/workspace/PreCommit-HBASE-Build/trunk/target/test-data/b9091c3c-961e-4035-850a-83ad14d517cc/TestAtomicOperationtestMultiRowMutationMultiThreads/testtable/7cd30e219714cfc5e91f69def66e7f81/.tmp/61954619003e469baf1a34be5ff2ec57
to
/home/jenkins/jenkins-slave/workspace/PreCommit-HBASE-Build/trunk/target/test-data/b9091c3c-961e-4035-850a-83ad14d517cc/TestAtomicOperationtestMultiRowMutationMultiThreads/testtable/7cd30e219714cfc5e91f69def66e7f81/colfamily11/61954619003e469baf1a34be5ff2ec57
2012-03-27 04:36:12,634 INFO [Thread-126] regionserver.Store(818): Added
[jira] [Updated] (HBASE-5659) TestAtomicOperation.testMultiRowMutationMultiThreads is still failing occasionally
[
https://issues.apache.org/jira/browse/HBASE-5659?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Lars Hofhansl updated HBASE-5659:
-
Resolution: Fixed
Fix Version/s: (was: 0.94.2)
0.94.1
Status: Resolved (was: Patch Available)
Committed to 0.94 and 0.96. I'll watch the test results.
TestAtomicOperation.testMultiRowMutationMultiThreads is still failing
occasionally
--
Key: HBASE-5659
URL: https://issues.apache.org/jira/browse/HBASE-5659
Project: HBase
Issue Type: Sub-task
Reporter: Lars Hofhansl
Assignee: Lars Hofhansl
Priority: Minor
Fix For: 0.96.0, 0.94.1
Attachments: 5659-v2.txt, 5659.txt
See run here:
https://builds.apache.org/job/PreCommit-HBASE-Build/1318//testReport/org.apache.hadoop.hbase.regionserver/TestAtomicOperation/testMultiRowMutationMultiThreads/
{quote}
2012-03-27 04:36:12,627 DEBUG [Thread-118] regionserver.StoreScanner(499):
Storescanner.peek() is changed where before =
rowB/colfamily11:qual1/7202/Put/vlen=6/ts=7922,and after =
rowB/colfamily11:qual1/7199/DeleteColumn/vlen=0/ts=0
2012-03-27 04:36:12,629 INFO [Thread-121] regionserver.HRegion(1558):
Finished memstore flush of ~2.9k/2952, currentsize=1.6k/1640 for region
testtable,,1332822963417.7cd30e219714cfc5e91f69def66e7f81. in 14ms,
sequenceid=7927, compaction requested=true
2012-03-27 04:36:12,629 DEBUG [Thread-126]
regionserver.TestAtomicOperation$2(362): flushing
2012-03-27 04:36:12,630 DEBUG [Thread-126] regionserver.HRegion(1426):
Started memstore flush for
testtable,,1332822963417.7cd30e219714cfc5e91f69def66e7f81., current region
memstore size 1.9k
2012-03-27 04:36:12,630 DEBUG [Thread-126] regionserver.HRegion(1474):
Finished snapshotting
testtable,,1332822963417.7cd30e219714cfc5e91f69def66e7f81., commencing wait
for mvcc, flushsize=1968
2012-03-27 04:36:12,630 DEBUG [Thread-126] regionserver.HRegion(1484):
Finished snapshotting, commencing flushing stores
2012-03-27 04:36:12,630 DEBUG [Thread-126] util.FSUtils(153): Creating
file=/home/jenkins/jenkins-slave/workspace/PreCommit-HBASE-Build/trunk/target/test-data/b9091c3c-961e-4035-850a-83ad14d517cc/TestAtomicOperationtestMultiRowMutationMultiThreads/testtable/7cd30e219714cfc5e91f69def66e7f81/.tmp/61954619003e469baf1a34be5ff2ec57
with permission=rwxrwxrwx
2012-03-27 04:36:12,631 DEBUG [Thread-126] hfile.HFileWriterV2(143):
Initialized with CacheConfig:enabled [cacheDataOnRead=true]
[cacheDataOnWrite=false] [cacheIndexesOnWrite=false]
[cacheBloomsOnWrite=false] [cacheEvictOnClose=false] [cacheCompressed=false]
2012-03-27 04:36:12,631 INFO [Thread-126]
regionserver.StoreFile$Writer(997): Delete Family Bloom filter type for
/home/jenkins/jenkins-slave/workspace/PreCommit-HBASE-Build/trunk/target/test-data/b9091c3c-961e-4035-850a-83ad14d517cc/TestAtomicOperationtestMultiRowMutationMultiThreads/testtable/7cd30e219714cfc5e91f69def66e7f81/.tmp/61954619003e469baf1a34be5ff2ec57:
CompoundBloomFilterWriter
2012-03-27 04:36:12,632 INFO [Thread-126]
regionserver.StoreFile$Writer(1220): NO General Bloom and NO DeleteFamily was
added to HFile
(/home/jenkins/jenkins-slave/workspace/PreCommit-HBASE-Build/trunk/target/test-data/b9091c3c-961e-4035-850a-83ad14d517cc/TestAtomicOperationtestMultiRowMutationMultiThreads/testtable/7cd30e219714cfc5e91f69def66e7f81/.tmp/61954619003e469baf1a34be5ff2ec57)
2012-03-27 04:36:12,632 INFO [Thread-126] regionserver.Store(770): Flushed ,
sequenceid=7934, memsize=1.9k, into tmp file
/home/jenkins/jenkins-slave/workspace/PreCommit-HBASE-Build/trunk/target/test-data/b9091c3c-961e-4035-850a-83ad14d517cc/TestAtomicOperationtestMultiRowMutationMultiThreads/testtable/7cd30e219714cfc5e91f69def66e7f81/.tmp/61954619003e469baf1a34be5ff2ec57
2012-03-27 04:36:12,632 DEBUG [Thread-126] regionserver.Store(795): Renaming
flushed file at
/home/jenkins/jenkins-slave/workspace/PreCommit-HBASE-Build/trunk/target/test-data/b9091c3c-961e-4035-850a-83ad14d517cc/TestAtomicOperationtestMultiRowMutationMultiThreads/testtable/7cd30e219714cfc5e91f69def66e7f81/.tmp/61954619003e469baf1a34be5ff2ec57
to
/home/jenkins/jenkins-slave/workspace/PreCommit-HBASE-Build/trunk/target/test-data/b9091c3c-961e-4035-850a-83ad14d517cc/TestAtomicOperationtestMultiRowMutationMultiThreads/testtable/7cd30e219714cfc5e91f69def66e7f81/colfamily11/61954619003e469baf1a34be5ff2ec57
2012-03-27 04:36:12,634 INFO [Thread-126] regionserver.Store(818): Added
[jira] [Updated] (HBASE-5659) TestAtomicOperation.testMultiRowMutationMultiThreads is still failing occasionally
[
https://issues.apache.org/jira/browse/HBASE-5659?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Lars Hofhansl updated HBASE-5659:
-
Attachment: 5659.txt
While this (probably) won't fix the problem I would like to propose this simple
change to the logic introduced in HBASE-5121.
The observation is that a change top KV is only a problem when the KV's row has
changed from the previous one.
TestAtomicOperation.testMultiRowMutationMultiThreads is still failing
occasionally
--
Key: HBASE-5659
URL: https://issues.apache.org/jira/browse/HBASE-5659
Project: HBase
Issue Type: Sub-task
Reporter: Lars Hofhansl
Assignee: Lars Hofhansl
Priority: Minor
Fix For: 0.96.0, 0.94.2
Attachments: 5659.txt
See run here:
https://builds.apache.org/job/PreCommit-HBASE-Build/1318//testReport/org.apache.hadoop.hbase.regionserver/TestAtomicOperation/testMultiRowMutationMultiThreads/
{quote}
2012-03-27 04:36:12,627 DEBUG [Thread-118] regionserver.StoreScanner(499):
Storescanner.peek() is changed where before =
rowB/colfamily11:qual1/7202/Put/vlen=6/ts=7922,and after =
rowB/colfamily11:qual1/7199/DeleteColumn/vlen=0/ts=0
2012-03-27 04:36:12,629 INFO [Thread-121] regionserver.HRegion(1558):
Finished memstore flush of ~2.9k/2952, currentsize=1.6k/1640 for region
testtable,,1332822963417.7cd30e219714cfc5e91f69def66e7f81. in 14ms,
sequenceid=7927, compaction requested=true
2012-03-27 04:36:12,629 DEBUG [Thread-126]
regionserver.TestAtomicOperation$2(362): flushing
2012-03-27 04:36:12,630 DEBUG [Thread-126] regionserver.HRegion(1426):
Started memstore flush for
testtable,,1332822963417.7cd30e219714cfc5e91f69def66e7f81., current region
memstore size 1.9k
2012-03-27 04:36:12,630 DEBUG [Thread-126] regionserver.HRegion(1474):
Finished snapshotting
testtable,,1332822963417.7cd30e219714cfc5e91f69def66e7f81., commencing wait
for mvcc, flushsize=1968
2012-03-27 04:36:12,630 DEBUG [Thread-126] regionserver.HRegion(1484):
Finished snapshotting, commencing flushing stores
2012-03-27 04:36:12,630 DEBUG [Thread-126] util.FSUtils(153): Creating
file=/home/jenkins/jenkins-slave/workspace/PreCommit-HBASE-Build/trunk/target/test-data/b9091c3c-961e-4035-850a-83ad14d517cc/TestAtomicOperationtestMultiRowMutationMultiThreads/testtable/7cd30e219714cfc5e91f69def66e7f81/.tmp/61954619003e469baf1a34be5ff2ec57
with permission=rwxrwxrwx
2012-03-27 04:36:12,631 DEBUG [Thread-126] hfile.HFileWriterV2(143):
Initialized with CacheConfig:enabled [cacheDataOnRead=true]
[cacheDataOnWrite=false] [cacheIndexesOnWrite=false]
[cacheBloomsOnWrite=false] [cacheEvictOnClose=false] [cacheCompressed=false]
2012-03-27 04:36:12,631 INFO [Thread-126]
regionserver.StoreFile$Writer(997): Delete Family Bloom filter type for
/home/jenkins/jenkins-slave/workspace/PreCommit-HBASE-Build/trunk/target/test-data/b9091c3c-961e-4035-850a-83ad14d517cc/TestAtomicOperationtestMultiRowMutationMultiThreads/testtable/7cd30e219714cfc5e91f69def66e7f81/.tmp/61954619003e469baf1a34be5ff2ec57:
CompoundBloomFilterWriter
2012-03-27 04:36:12,632 INFO [Thread-126]
regionserver.StoreFile$Writer(1220): NO General Bloom and NO DeleteFamily was
added to HFile
(/home/jenkins/jenkins-slave/workspace/PreCommit-HBASE-Build/trunk/target/test-data/b9091c3c-961e-4035-850a-83ad14d517cc/TestAtomicOperationtestMultiRowMutationMultiThreads/testtable/7cd30e219714cfc5e91f69def66e7f81/.tmp/61954619003e469baf1a34be5ff2ec57)
2012-03-27 04:36:12,632 INFO [Thread-126] regionserver.Store(770): Flushed ,
sequenceid=7934, memsize=1.9k, into tmp file
/home/jenkins/jenkins-slave/workspace/PreCommit-HBASE-Build/trunk/target/test-data/b9091c3c-961e-4035-850a-83ad14d517cc/TestAtomicOperationtestMultiRowMutationMultiThreads/testtable/7cd30e219714cfc5e91f69def66e7f81/.tmp/61954619003e469baf1a34be5ff2ec57
2012-03-27 04:36:12,632 DEBUG [Thread-126] regionserver.Store(795): Renaming
flushed file at
/home/jenkins/jenkins-slave/workspace/PreCommit-HBASE-Build/trunk/target/test-data/b9091c3c-961e-4035-850a-83ad14d517cc/TestAtomicOperationtestMultiRowMutationMultiThreads/testtable/7cd30e219714cfc5e91f69def66e7f81/.tmp/61954619003e469baf1a34be5ff2ec57
to
/home/jenkins/jenkins-slave/workspace/PreCommit-HBASE-Build/trunk/target/test-data/b9091c3c-961e-4035-850a-83ad14d517cc/TestAtomicOperationtestMultiRowMutationMultiThreads/testtable/7cd30e219714cfc5e91f69def66e7f81/colfamily11/61954619003e469baf1a34be5ff2ec57
2012-03-27 04:36:12,634 INFO [Thread-126] regionserver.Store(818): Added
[jira] [Updated] (HBASE-5659) TestAtomicOperation.testMultiRowMutationMultiThreads is still failing occasionally
[
https://issues.apache.org/jira/browse/HBASE-5659?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Lars Hofhansl updated HBASE-5659:
-
Status: Patch Available (was: Open)
TestAtomicOperation.testMultiRowMutationMultiThreads is still failing
occasionally
--
Key: HBASE-5659
URL: https://issues.apache.org/jira/browse/HBASE-5659
Project: HBase
Issue Type: Sub-task
Reporter: Lars Hofhansl
Assignee: Lars Hofhansl
Priority: Minor
Fix For: 0.96.0, 0.94.2
Attachments: 5659.txt
See run here:
https://builds.apache.org/job/PreCommit-HBASE-Build/1318//testReport/org.apache.hadoop.hbase.regionserver/TestAtomicOperation/testMultiRowMutationMultiThreads/
{quote}
2012-03-27 04:36:12,627 DEBUG [Thread-118] regionserver.StoreScanner(499):
Storescanner.peek() is changed where before =
rowB/colfamily11:qual1/7202/Put/vlen=6/ts=7922,and after =
rowB/colfamily11:qual1/7199/DeleteColumn/vlen=0/ts=0
2012-03-27 04:36:12,629 INFO [Thread-121] regionserver.HRegion(1558):
Finished memstore flush of ~2.9k/2952, currentsize=1.6k/1640 for region
testtable,,1332822963417.7cd30e219714cfc5e91f69def66e7f81. in 14ms,
sequenceid=7927, compaction requested=true
2012-03-27 04:36:12,629 DEBUG [Thread-126]
regionserver.TestAtomicOperation$2(362): flushing
2012-03-27 04:36:12,630 DEBUG [Thread-126] regionserver.HRegion(1426):
Started memstore flush for
testtable,,1332822963417.7cd30e219714cfc5e91f69def66e7f81., current region
memstore size 1.9k
2012-03-27 04:36:12,630 DEBUG [Thread-126] regionserver.HRegion(1474):
Finished snapshotting
testtable,,1332822963417.7cd30e219714cfc5e91f69def66e7f81., commencing wait
for mvcc, flushsize=1968
2012-03-27 04:36:12,630 DEBUG [Thread-126] regionserver.HRegion(1484):
Finished snapshotting, commencing flushing stores
2012-03-27 04:36:12,630 DEBUG [Thread-126] util.FSUtils(153): Creating
file=/home/jenkins/jenkins-slave/workspace/PreCommit-HBASE-Build/trunk/target/test-data/b9091c3c-961e-4035-850a-83ad14d517cc/TestAtomicOperationtestMultiRowMutationMultiThreads/testtable/7cd30e219714cfc5e91f69def66e7f81/.tmp/61954619003e469baf1a34be5ff2ec57
with permission=rwxrwxrwx
2012-03-27 04:36:12,631 DEBUG [Thread-126] hfile.HFileWriterV2(143):
Initialized with CacheConfig:enabled [cacheDataOnRead=true]
[cacheDataOnWrite=false] [cacheIndexesOnWrite=false]
[cacheBloomsOnWrite=false] [cacheEvictOnClose=false] [cacheCompressed=false]
2012-03-27 04:36:12,631 INFO [Thread-126]
regionserver.StoreFile$Writer(997): Delete Family Bloom filter type for
/home/jenkins/jenkins-slave/workspace/PreCommit-HBASE-Build/trunk/target/test-data/b9091c3c-961e-4035-850a-83ad14d517cc/TestAtomicOperationtestMultiRowMutationMultiThreads/testtable/7cd30e219714cfc5e91f69def66e7f81/.tmp/61954619003e469baf1a34be5ff2ec57:
CompoundBloomFilterWriter
2012-03-27 04:36:12,632 INFO [Thread-126]
regionserver.StoreFile$Writer(1220): NO General Bloom and NO DeleteFamily was
added to HFile
(/home/jenkins/jenkins-slave/workspace/PreCommit-HBASE-Build/trunk/target/test-data/b9091c3c-961e-4035-850a-83ad14d517cc/TestAtomicOperationtestMultiRowMutationMultiThreads/testtable/7cd30e219714cfc5e91f69def66e7f81/.tmp/61954619003e469baf1a34be5ff2ec57)
2012-03-27 04:36:12,632 INFO [Thread-126] regionserver.Store(770): Flushed ,
sequenceid=7934, memsize=1.9k, into tmp file
/home/jenkins/jenkins-slave/workspace/PreCommit-HBASE-Build/trunk/target/test-data/b9091c3c-961e-4035-850a-83ad14d517cc/TestAtomicOperationtestMultiRowMutationMultiThreads/testtable/7cd30e219714cfc5e91f69def66e7f81/.tmp/61954619003e469baf1a34be5ff2ec57
2012-03-27 04:36:12,632 DEBUG [Thread-126] regionserver.Store(795): Renaming
flushed file at
/home/jenkins/jenkins-slave/workspace/PreCommit-HBASE-Build/trunk/target/test-data/b9091c3c-961e-4035-850a-83ad14d517cc/TestAtomicOperationtestMultiRowMutationMultiThreads/testtable/7cd30e219714cfc5e91f69def66e7f81/.tmp/61954619003e469baf1a34be5ff2ec57
to
/home/jenkins/jenkins-slave/workspace/PreCommit-HBASE-Build/trunk/target/test-data/b9091c3c-961e-4035-850a-83ad14d517cc/TestAtomicOperationtestMultiRowMutationMultiThreads/testtable/7cd30e219714cfc5e91f69def66e7f81/colfamily11/61954619003e469baf1a34be5ff2ec57
2012-03-27 04:36:12,634 INFO [Thread-126] regionserver.Store(818): Added
/home/jenkins/jenkins-slave/workspace/PreCommit-HBASE-Build/trunk/target/test-data/b9091c3c-961e-4035-850a-83ad14d517cc/TestAtomicOperationtestMultiRowMutationMultiThreads/testtable/7cd30e219714cfc5e91f69def66e7f81/colfamily11/61954619003e469baf1a34be5ff2ec57,
entries=12, sequenceid=7934, filesize=1.3k
2012-03-27 04:36:12,642 DEBUG [Thread-118]
regionserver.TestAtomicOperation$2(392): []
Exception in thread Thread-118
[jira] [Updated] (HBASE-5659) TestAtomicOperation.testMultiRowMutationMultiThreads is still failing occasionally
[
https://issues.apache.org/jira/browse/HBASE-5659?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Lars Hofhansl updated HBASE-5659:
-
Fix Version/s: 0.94.2
TestAtomicOperation.testMultiRowMutationMultiThreads is still failing
occasionally
--
Key: HBASE-5659
URL: https://issues.apache.org/jira/browse/HBASE-5659
Project: HBase
Issue Type: Sub-task
Reporter: Lars Hofhansl
Priority: Minor
Fix For: 0.96.0, 0.94.2
See run here:
https://builds.apache.org/job/PreCommit-HBASE-Build/1318//testReport/org.apache.hadoop.hbase.regionserver/TestAtomicOperation/testMultiRowMutationMultiThreads/
{quote}
2012-03-27 04:36:12,627 DEBUG [Thread-118] regionserver.StoreScanner(499):
Storescanner.peek() is changed where before =
rowB/colfamily11:qual1/7202/Put/vlen=6/ts=7922,and after =
rowB/colfamily11:qual1/7199/DeleteColumn/vlen=0/ts=0
2012-03-27 04:36:12,629 INFO [Thread-121] regionserver.HRegion(1558):
Finished memstore flush of ~2.9k/2952, currentsize=1.6k/1640 for region
testtable,,1332822963417.7cd30e219714cfc5e91f69def66e7f81. in 14ms,
sequenceid=7927, compaction requested=true
2012-03-27 04:36:12,629 DEBUG [Thread-126]
regionserver.TestAtomicOperation$2(362): flushing
2012-03-27 04:36:12,630 DEBUG [Thread-126] regionserver.HRegion(1426):
Started memstore flush for
testtable,,1332822963417.7cd30e219714cfc5e91f69def66e7f81., current region
memstore size 1.9k
2012-03-27 04:36:12,630 DEBUG [Thread-126] regionserver.HRegion(1474):
Finished snapshotting
testtable,,1332822963417.7cd30e219714cfc5e91f69def66e7f81., commencing wait
for mvcc, flushsize=1968
2012-03-27 04:36:12,630 DEBUG [Thread-126] regionserver.HRegion(1484):
Finished snapshotting, commencing flushing stores
2012-03-27 04:36:12,630 DEBUG [Thread-126] util.FSUtils(153): Creating
file=/home/jenkins/jenkins-slave/workspace/PreCommit-HBASE-Build/trunk/target/test-data/b9091c3c-961e-4035-850a-83ad14d517cc/TestAtomicOperationtestMultiRowMutationMultiThreads/testtable/7cd30e219714cfc5e91f69def66e7f81/.tmp/61954619003e469baf1a34be5ff2ec57
with permission=rwxrwxrwx
2012-03-27 04:36:12,631 DEBUG [Thread-126] hfile.HFileWriterV2(143):
Initialized with CacheConfig:enabled [cacheDataOnRead=true]
[cacheDataOnWrite=false] [cacheIndexesOnWrite=false]
[cacheBloomsOnWrite=false] [cacheEvictOnClose=false] [cacheCompressed=false]
2012-03-27 04:36:12,631 INFO [Thread-126]
regionserver.StoreFile$Writer(997): Delete Family Bloom filter type for
/home/jenkins/jenkins-slave/workspace/PreCommit-HBASE-Build/trunk/target/test-data/b9091c3c-961e-4035-850a-83ad14d517cc/TestAtomicOperationtestMultiRowMutationMultiThreads/testtable/7cd30e219714cfc5e91f69def66e7f81/.tmp/61954619003e469baf1a34be5ff2ec57:
CompoundBloomFilterWriter
2012-03-27 04:36:12,632 INFO [Thread-126]
regionserver.StoreFile$Writer(1220): NO General Bloom and NO DeleteFamily was
added to HFile
(/home/jenkins/jenkins-slave/workspace/PreCommit-HBASE-Build/trunk/target/test-data/b9091c3c-961e-4035-850a-83ad14d517cc/TestAtomicOperationtestMultiRowMutationMultiThreads/testtable/7cd30e219714cfc5e91f69def66e7f81/.tmp/61954619003e469baf1a34be5ff2ec57)
2012-03-27 04:36:12,632 INFO [Thread-126] regionserver.Store(770): Flushed ,
sequenceid=7934, memsize=1.9k, into tmp file
/home/jenkins/jenkins-slave/workspace/PreCommit-HBASE-Build/trunk/target/test-data/b9091c3c-961e-4035-850a-83ad14d517cc/TestAtomicOperationtestMultiRowMutationMultiThreads/testtable/7cd30e219714cfc5e91f69def66e7f81/.tmp/61954619003e469baf1a34be5ff2ec57
2012-03-27 04:36:12,632 DEBUG [Thread-126] regionserver.Store(795): Renaming
flushed file at
/home/jenkins/jenkins-slave/workspace/PreCommit-HBASE-Build/trunk/target/test-data/b9091c3c-961e-4035-850a-83ad14d517cc/TestAtomicOperationtestMultiRowMutationMultiThreads/testtable/7cd30e219714cfc5e91f69def66e7f81/.tmp/61954619003e469baf1a34be5ff2ec57
to
/home/jenkins/jenkins-slave/workspace/PreCommit-HBASE-Build/trunk/target/test-data/b9091c3c-961e-4035-850a-83ad14d517cc/TestAtomicOperationtestMultiRowMutationMultiThreads/testtable/7cd30e219714cfc5e91f69def66e7f81/colfamily11/61954619003e469baf1a34be5ff2ec57
2012-03-27 04:36:12,634 INFO [Thread-126] regionserver.Store(818): Added
/home/jenkins/jenkins-slave/workspace/PreCommit-HBASE-Build/trunk/target/test-data/b9091c3c-961e-4035-850a-83ad14d517cc/TestAtomicOperationtestMultiRowMutationMultiThreads/testtable/7cd30e219714cfc5e91f69def66e7f81/colfamily11/61954619003e469baf1a34be5ff2ec57,
entries=12, sequenceid=7934, filesize=1.3k
2012-03-27 04:36:12,642 DEBUG [Thread-118]
regionserver.TestAtomicOperation$2(392): []
Exception in thread Thread-118 junit.framework.AssertionFailedError at
junit.framework.Assert.fail(Assert.java:48)
[jira] [Updated] (HBASE-5659) TestAtomicOperation.testMultiRowMutationMultiThreads is still failing occasionally
[
https://issues.apache.org/jira/browse/HBASE-5659?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Lars Hofhansl updated HBASE-5659:
-
Fix Version/s: (was: 0.94.0)
TestAtomicOperation.testMultiRowMutationMultiThreads is still failing
occasionally
--
Key: HBASE-5659
URL: https://issues.apache.org/jira/browse/HBASE-5659
Project: HBase
Issue Type: Sub-task
Reporter: Lars Hofhansl
Priority: Minor
Fix For: 0.96.0
See run here:
https://builds.apache.org/job/PreCommit-HBASE-Build/1318//testReport/org.apache.hadoop.hbase.regionserver/TestAtomicOperation/testMultiRowMutationMultiThreads/
{quote}
2012-03-27 04:36:12,627 DEBUG [Thread-118] regionserver.StoreScanner(499):
Storescanner.peek() is changed where before =
rowB/colfamily11:qual1/7202/Put/vlen=6/ts=7922,and after =
rowB/colfamily11:qual1/7199/DeleteColumn/vlen=0/ts=0
2012-03-27 04:36:12,629 INFO [Thread-121] regionserver.HRegion(1558):
Finished memstore flush of ~2.9k/2952, currentsize=1.6k/1640 for region
testtable,,1332822963417.7cd30e219714cfc5e91f69def66e7f81. in 14ms,
sequenceid=7927, compaction requested=true
2012-03-27 04:36:12,629 DEBUG [Thread-126]
regionserver.TestAtomicOperation$2(362): flushing
2012-03-27 04:36:12,630 DEBUG [Thread-126] regionserver.HRegion(1426):
Started memstore flush for
testtable,,1332822963417.7cd30e219714cfc5e91f69def66e7f81., current region
memstore size 1.9k
2012-03-27 04:36:12,630 DEBUG [Thread-126] regionserver.HRegion(1474):
Finished snapshotting
testtable,,1332822963417.7cd30e219714cfc5e91f69def66e7f81., commencing wait
for mvcc, flushsize=1968
2012-03-27 04:36:12,630 DEBUG [Thread-126] regionserver.HRegion(1484):
Finished snapshotting, commencing flushing stores
2012-03-27 04:36:12,630 DEBUG [Thread-126] util.FSUtils(153): Creating
file=/home/jenkins/jenkins-slave/workspace/PreCommit-HBASE-Build/trunk/target/test-data/b9091c3c-961e-4035-850a-83ad14d517cc/TestAtomicOperationtestMultiRowMutationMultiThreads/testtable/7cd30e219714cfc5e91f69def66e7f81/.tmp/61954619003e469baf1a34be5ff2ec57
with permission=rwxrwxrwx
2012-03-27 04:36:12,631 DEBUG [Thread-126] hfile.HFileWriterV2(143):
Initialized with CacheConfig:enabled [cacheDataOnRead=true]
[cacheDataOnWrite=false] [cacheIndexesOnWrite=false]
[cacheBloomsOnWrite=false] [cacheEvictOnClose=false] [cacheCompressed=false]
2012-03-27 04:36:12,631 INFO [Thread-126]
regionserver.StoreFile$Writer(997): Delete Family Bloom filter type for
/home/jenkins/jenkins-slave/workspace/PreCommit-HBASE-Build/trunk/target/test-data/b9091c3c-961e-4035-850a-83ad14d517cc/TestAtomicOperationtestMultiRowMutationMultiThreads/testtable/7cd30e219714cfc5e91f69def66e7f81/.tmp/61954619003e469baf1a34be5ff2ec57:
CompoundBloomFilterWriter
2012-03-27 04:36:12,632 INFO [Thread-126]
regionserver.StoreFile$Writer(1220): NO General Bloom and NO DeleteFamily was
added to HFile
(/home/jenkins/jenkins-slave/workspace/PreCommit-HBASE-Build/trunk/target/test-data/b9091c3c-961e-4035-850a-83ad14d517cc/TestAtomicOperationtestMultiRowMutationMultiThreads/testtable/7cd30e219714cfc5e91f69def66e7f81/.tmp/61954619003e469baf1a34be5ff2ec57)
2012-03-27 04:36:12,632 INFO [Thread-126] regionserver.Store(770): Flushed ,
sequenceid=7934, memsize=1.9k, into tmp file
/home/jenkins/jenkins-slave/workspace/PreCommit-HBASE-Build/trunk/target/test-data/b9091c3c-961e-4035-850a-83ad14d517cc/TestAtomicOperationtestMultiRowMutationMultiThreads/testtable/7cd30e219714cfc5e91f69def66e7f81/.tmp/61954619003e469baf1a34be5ff2ec57
2012-03-27 04:36:12,632 DEBUG [Thread-126] regionserver.Store(795): Renaming
flushed file at
/home/jenkins/jenkins-slave/workspace/PreCommit-HBASE-Build/trunk/target/test-data/b9091c3c-961e-4035-850a-83ad14d517cc/TestAtomicOperationtestMultiRowMutationMultiThreads/testtable/7cd30e219714cfc5e91f69def66e7f81/.tmp/61954619003e469baf1a34be5ff2ec57
to
/home/jenkins/jenkins-slave/workspace/PreCommit-HBASE-Build/trunk/target/test-data/b9091c3c-961e-4035-850a-83ad14d517cc/TestAtomicOperationtestMultiRowMutationMultiThreads/testtable/7cd30e219714cfc5e91f69def66e7f81/colfamily11/61954619003e469baf1a34be5ff2ec57
2012-03-27 04:36:12,634 INFO [Thread-126] regionserver.Store(818): Added
/home/jenkins/jenkins-slave/workspace/PreCommit-HBASE-Build/trunk/target/test-data/b9091c3c-961e-4035-850a-83ad14d517cc/TestAtomicOperationtestMultiRowMutationMultiThreads/testtable/7cd30e219714cfc5e91f69def66e7f81/colfamily11/61954619003e469baf1a34be5ff2ec57,
entries=12, sequenceid=7934, filesize=1.3k
2012-03-27 04:36:12,642 DEBUG [Thread-118]
regionserver.TestAtomicOperation$2(392): []
Exception in thread Thread-118 junit.framework.AssertionFailedError at
junit.framework.Assert.fail(Assert.java:48)
