[jira] [Commented] (HBASE-11017) TestHRegionBusyWait.testWritesWhileScanning fails frequently in 0.94
[ https://issues.apache.org/jira/browse/HBASE-11017?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13973417#comment-13973417 ] Lars Hofhansl commented on HBASE-11017: --- [~stack], do you think this is normal? I know we had to fix some other test after this change went it. TestHRegionBusyWait.testWritesWhileScanning fails frequently in 0.94 Key: HBASE-11017 URL: https://issues.apache.org/jira/browse/HBASE-11017 Project: HBase Issue Type: Bug Reporter: Lars Hofhansl Fix For: 0.94.19 Have seen a few of these: {code} Error Message Failed clearing memory after 6 attempts on region: testWritesWhileScanning,,1397727647509.2c968a587c4cb7e84a52c7aa8d2afcac. Stacktrace org.apache.hadoop.hbase.DroppedSnapshotException: Failed clearing memory after 6 attempts on region: testWritesWhileScanning,,1397727647509.2c968a587c4cb7e84a52c7aa8d2afcac. at org.apache.hadoop.hbase.regionserver.HRegion.doClose(HRegion.java:1087) at org.apache.hadoop.hbase.regionserver.HRegion.close(HRegion.java:1024) at org.apache.hadoop.hbase.regionserver.HRegion.close(HRegion.java:989) at org.apache.hadoop.hbase.regionserver.HRegion.closeHRegion(HRegion.java:4346) at org.apache.hadoop.hbase.regionserver.TestHRegion.testWritesWhileScanning(TestHRegion.java:3406) {code} -- This message was sent by Atlassian JIRA (v6.2#6252)
[jira] [Commented] (HBASE-11017) TestHRegionBusyWait.testWritesWhileScanning fails frequently in 0.94
[ https://issues.apache.org/jira/browse/HBASE-11017?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13973464#comment-13973464 ] Lars Hofhansl commented on HBASE-11017: --- This is what I see in the logs: {code} 2014-04-17 09:41:02,037 INFO [pool-1-thread-1] regionserver.HRegion(1776): Finished memstore flush of ~9.7m/10168960, currentsize=7.0m/7383120 for region testWritesWhileScanning,,1397727647509.2c968a587c4cb7e84a52c7aa8d2afcac. in 278ms, sequenceid=50, compaction requested=true 2014-04-17 09:41:02,038 INFO [pool-1-thread-1] regionserver.HRegion(1090): Running extra flush, 1 (carrying snapshot?) testWritesWhileScanning,,1397727647509.2c968a587c4cb7e84a52c7aa8d2afcac. 2014-04-17 09:41:02,038 DEBUG [pool-1-thread-1] regionserver.HRegion(1636): Started memstore flush for testWritesWhileScanning,,1397727647509.2c968a587c4cb7e84a52c7aa8d2afcac., current region memstore size 7.0m 2014-04-17 09:41:02,038 DEBUG [pool-1-thread-1] regionserver.HRegion(1686): Finished snapshotting testWritesWhileScanning,,1397727647509.2c968a587c4cb7e84a52c7aa8d2afcac., syncing WAL and waiting on mvcc, flushsize=0 2014-04-17 09:41:02,038 DEBUG [pool-1-thread-1] regionserver.HRegion(1702): Finished snapshotting, commencing flushing stores 2014-04-17 09:41:02,038 INFO [pool-1-thread-1] regionserver.HRegion(1776): Finished memstore flush of ~0.0/0, currentsize=7.0m/7383120 for region testWritesWhileScanning,,1397727647509.2c968a587c4cb7e84a52c7aa8d2afcac. in 0ms, sequenceid=51, compaction requested=false 2014-04-17 09:41:02,038 INFO [pool-1-thread-1] regionserver.HRegion(1090): Running extra flush, 2 (carrying snapshot?) testWritesWhileScanning,,1397727647509.2c968a587c4cb7e84a52c7aa8d2afcac. 2014-04-17 09:41:02,039 DEBUG [pool-1-thread-1] regionserver.HRegion(1636): Started memstore flush for testWritesWhileScanning,,1397727647509.2c968a587c4cb7e84a52c7aa8d2afcac., current region memstore size 7.0m 2014-04-17 09:41:02,039 DEBUG [pool-1-thread-1] regionserver.HRegion(1686): Finished snapshotting testWritesWhileScanning,,1397727647509.2c968a587c4cb7e84a52c7aa8d2afcac., syncing WAL and waiting on mvcc, flushsize=0 2014-04-17 09:41:02,039 DEBUG [pool-1-thread-1] regionserver.HRegion(1702): Finished snapshotting, commencing flushing stores 2014-04-17 09:41:02,039 INFO [pool-1-thread-1] regionserver.HRegion(1776): Finished memstore flush of ~0.0/0, currentsize=7.0m/7383120 for region testWritesWhileScanning,,1397727647509.2c968a587c4cb7e84a52c7aa8d2afcac. in 1ms, sequenceid=52, compaction requested=false 2014-04-17 09:41:02,039 INFO [pool-1-thread-1] regionserver.HRegion(1090): Running extra flush, 3 (carrying snapshot?) testWritesWhileScanning,,1397727647509.2c968a587c4cb7e84a52c7aa8d2afcac. 2014-04-17 09:41:02,039 DEBUG [pool-1-thread-1] regionserver.HRegion(1636): Started memstore flush for testWritesWhileScanning,,1397727647509.2c968a587c4cb7e84a52c7aa8d2afcac., current region memstore size 7.0m 2014-04-17 09:41:02,039 DEBUG [pool-1-thread-1] regionserver.HRegion(1686): Finished snapshotting testWritesWhileScanning,,1397727647509.2c968a587c4cb7e84a52c7aa8d2afcac., syncing WAL and waiting on mvcc, flushsize=0 {code} So somehow it is not making progress once it gets into this state. TestHRegionBusyWait.testWritesWhileScanning fails frequently in 0.94 Key: HBASE-11017 URL: https://issues.apache.org/jira/browse/HBASE-11017 Project: HBase Issue Type: Bug Reporter: Lars Hofhansl Assignee: stack Fix For: 0.94.19 Have seen a few of these: {code} Error Message Failed clearing memory after 6 attempts on region: testWritesWhileScanning,,1397727647509.2c968a587c4cb7e84a52c7aa8d2afcac. Stacktrace org.apache.hadoop.hbase.DroppedSnapshotException: Failed clearing memory after 6 attempts on region: testWritesWhileScanning,,1397727647509.2c968a587c4cb7e84a52c7aa8d2afcac. at org.apache.hadoop.hbase.regionserver.HRegion.doClose(HRegion.java:1087) at org.apache.hadoop.hbase.regionserver.HRegion.close(HRegion.java:1024) at org.apache.hadoop.hbase.regionserver.HRegion.close(HRegion.java:989) at org.apache.hadoop.hbase.regionserver.HRegion.closeHRegion(HRegion.java:4346) at org.apache.hadoop.hbase.regionserver.TestHRegion.testWritesWhileScanning(TestHRegion.java:3406) {code} -- This message was sent by Atlassian JIRA (v6.2#6252)
[jira] [Commented] (HBASE-11017) TestHRegionBusyWait.testWritesWhileScanning fails frequently in 0.94
[ https://issues.apache.org/jira/browse/HBASE-11017?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13973479#comment-13973479 ] Lars Hofhansl commented on HBASE-11017: --- Is the same as HBASE-10751? TestHRegionBusyWait.testWritesWhileScanning fails frequently in 0.94 Key: HBASE-11017 URL: https://issues.apache.org/jira/browse/HBASE-11017 Project: HBase Issue Type: Bug Reporter: Lars Hofhansl Assignee: stack Fix For: 0.94.19 Have seen a few of these: {code} Error Message Failed clearing memory after 6 attempts on region: testWritesWhileScanning,,1397727647509.2c968a587c4cb7e84a52c7aa8d2afcac. Stacktrace org.apache.hadoop.hbase.DroppedSnapshotException: Failed clearing memory after 6 attempts on region: testWritesWhileScanning,,1397727647509.2c968a587c4cb7e84a52c7aa8d2afcac. at org.apache.hadoop.hbase.regionserver.HRegion.doClose(HRegion.java:1087) at org.apache.hadoop.hbase.regionserver.HRegion.close(HRegion.java:1024) at org.apache.hadoop.hbase.regionserver.HRegion.close(HRegion.java:989) at org.apache.hadoop.hbase.regionserver.HRegion.closeHRegion(HRegion.java:4346) at org.apache.hadoop.hbase.regionserver.TestHRegion.testWritesWhileScanning(TestHRegion.java:3406) {code} -- This message was sent by Atlassian JIRA (v6.2#6252)
[jira] [Commented] (HBASE-11017) TestHRegionBusyWait.testWritesWhileScanning fails frequently in 0.94
[ https://issues.apache.org/jira/browse/HBASE-11017?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13973609#comment-13973609 ] stack commented on HBASE-11017: --- It is the same. In HBASE-10751 I claim I backported the patch but must have not. stack added a comment - 14/Mar/14 13:39 Committed to 0.94 too after HBASE-10514 went in. Then if I look on the 0.94 branch I see: r1577784 | stack | 2014-03-14 21:30:20 -0700 (Fri, 14 Mar 2014) | 1 line HBASE-10751 TestHRegion testWritesWhileScanning occasional fail since HBASE-10514 went in But when I look at the commit, it is only the addendum import fix. Sorry about that Lars. Let me fix on this issue. TestHRegionBusyWait.testWritesWhileScanning fails frequently in 0.94 Key: HBASE-11017 URL: https://issues.apache.org/jira/browse/HBASE-11017 Project: HBase Issue Type: Bug Reporter: Lars Hofhansl Assignee: stack Fix For: 0.94.19 Have seen a few of these: {code} Error Message Failed clearing memory after 6 attempts on region: testWritesWhileScanning,,1397727647509.2c968a587c4cb7e84a52c7aa8d2afcac. Stacktrace org.apache.hadoop.hbase.DroppedSnapshotException: Failed clearing memory after 6 attempts on region: testWritesWhileScanning,,1397727647509.2c968a587c4cb7e84a52c7aa8d2afcac. at org.apache.hadoop.hbase.regionserver.HRegion.doClose(HRegion.java:1087) at org.apache.hadoop.hbase.regionserver.HRegion.close(HRegion.java:1024) at org.apache.hadoop.hbase.regionserver.HRegion.close(HRegion.java:989) at org.apache.hadoop.hbase.regionserver.HRegion.closeHRegion(HRegion.java:4346) at org.apache.hadoop.hbase.regionserver.TestHRegion.testWritesWhileScanning(TestHRegion.java:3406) {code} -- This message was sent by Atlassian JIRA (v6.2#6252)
[jira] [Commented] (HBASE-11017) TestHRegionBusyWait.testWritesWhileScanning fails frequently in 0.94
[ https://issues.apache.org/jira/browse/HBASE-11017?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13973630#comment-13973630 ] Lars Hofhansl commented on HBASE-11017: --- Thanks [~stack]! TestHRegionBusyWait.testWritesWhileScanning fails frequently in 0.94 Key: HBASE-11017 URL: https://issues.apache.org/jira/browse/HBASE-11017 Project: HBase Issue Type: Bug Reporter: Lars Hofhansl Assignee: stack Fix For: 0.94.19 Attachments: 11017.txt Have seen a few of these: {code} Error Message Failed clearing memory after 6 attempts on region: testWritesWhileScanning,,1397727647509.2c968a587c4cb7e84a52c7aa8d2afcac. Stacktrace org.apache.hadoop.hbase.DroppedSnapshotException: Failed clearing memory after 6 attempts on region: testWritesWhileScanning,,1397727647509.2c968a587c4cb7e84a52c7aa8d2afcac. at org.apache.hadoop.hbase.regionserver.HRegion.doClose(HRegion.java:1087) at org.apache.hadoop.hbase.regionserver.HRegion.close(HRegion.java:1024) at org.apache.hadoop.hbase.regionserver.HRegion.close(HRegion.java:989) at org.apache.hadoop.hbase.regionserver.HRegion.closeHRegion(HRegion.java:4346) at org.apache.hadoop.hbase.regionserver.TestHRegion.testWritesWhileScanning(TestHRegion.java:3406) {code} -- This message was sent by Atlassian JIRA (v6.2#6252)
[jira] [Commented] (HBASE-11017) TestHRegionBusyWait.testWritesWhileScanning fails frequently in 0.94
[ https://issues.apache.org/jira/browse/HBASE-11017?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13973742#comment-13973742 ] Hudson commented on HBASE-11017: SUCCESS: Integrated in HBase-0.94-security #472 (See [https://builds.apache.org/job/HBase-0.94-security/472/]) HBASE-11017 TestHRegionBusyWait.testWritesWhileScanning fails frequently in 0.94 (stack: rev 1588392) * /hbase/branches/0.94/src/test/java/org/apache/hadoop/hbase/regionserver/TestHRegion.java TestHRegionBusyWait.testWritesWhileScanning fails frequently in 0.94 Key: HBASE-11017 URL: https://issues.apache.org/jira/browse/HBASE-11017 Project: HBase Issue Type: Bug Reporter: Lars Hofhansl Assignee: stack Fix For: 0.94.19 Attachments: 11017.txt Have seen a few of these: {code} Error Message Failed clearing memory after 6 attempts on region: testWritesWhileScanning,,1397727647509.2c968a587c4cb7e84a52c7aa8d2afcac. Stacktrace org.apache.hadoop.hbase.DroppedSnapshotException: Failed clearing memory after 6 attempts on region: testWritesWhileScanning,,1397727647509.2c968a587c4cb7e84a52c7aa8d2afcac. at org.apache.hadoop.hbase.regionserver.HRegion.doClose(HRegion.java:1087) at org.apache.hadoop.hbase.regionserver.HRegion.close(HRegion.java:1024) at org.apache.hadoop.hbase.regionserver.HRegion.close(HRegion.java:989) at org.apache.hadoop.hbase.regionserver.HRegion.closeHRegion(HRegion.java:4346) at org.apache.hadoop.hbase.regionserver.TestHRegion.testWritesWhileScanning(TestHRegion.java:3406) {code} -- This message was sent by Atlassian JIRA (v6.2#6252)
[jira] [Commented] (HBASE-11017) TestHRegionBusyWait.testWritesWhileScanning fails frequently in 0.94
[ https://issues.apache.org/jira/browse/HBASE-11017?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13973747#comment-13973747 ] Hudson commented on HBASE-11017: FAILURE: Integrated in HBase-0.94-on-Hadoop-2 #75 (See [https://builds.apache.org/job/HBase-0.94-on-Hadoop-2/75/]) HBASE-11017 TestHRegionBusyWait.testWritesWhileScanning fails frequently in 0.94 (stack: rev 1588392) * /hbase/branches/0.94/src/test/java/org/apache/hadoop/hbase/regionserver/TestHRegion.java TestHRegionBusyWait.testWritesWhileScanning fails frequently in 0.94 Key: HBASE-11017 URL: https://issues.apache.org/jira/browse/HBASE-11017 Project: HBase Issue Type: Bug Reporter: Lars Hofhansl Assignee: stack Fix For: 0.94.19 Attachments: 11017.txt Have seen a few of these: {code} Error Message Failed clearing memory after 6 attempts on region: testWritesWhileScanning,,1397727647509.2c968a587c4cb7e84a52c7aa8d2afcac. Stacktrace org.apache.hadoop.hbase.DroppedSnapshotException: Failed clearing memory after 6 attempts on region: testWritesWhileScanning,,1397727647509.2c968a587c4cb7e84a52c7aa8d2afcac. at org.apache.hadoop.hbase.regionserver.HRegion.doClose(HRegion.java:1087) at org.apache.hadoop.hbase.regionserver.HRegion.close(HRegion.java:1024) at org.apache.hadoop.hbase.regionserver.HRegion.close(HRegion.java:989) at org.apache.hadoop.hbase.regionserver.HRegion.closeHRegion(HRegion.java:4346) at org.apache.hadoop.hbase.regionserver.TestHRegion.testWritesWhileScanning(TestHRegion.java:3406) {code} -- This message was sent by Atlassian JIRA (v6.2#6252)
[jira] [Commented] (HBASE-11017) TestHRegionBusyWait.testWritesWhileScanning fails frequently in 0.94
[ https://issues.apache.org/jira/browse/HBASE-11017?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13973775#comment-13973775 ] Hudson commented on HBASE-11017: SUCCESS: Integrated in HBase-0.94 #1353 (See [https://builds.apache.org/job/HBase-0.94/1353/]) HBASE-11017 TestHRegionBusyWait.testWritesWhileScanning fails frequently in 0.94 (stack: rev 1588392) * /hbase/branches/0.94/src/test/java/org/apache/hadoop/hbase/regionserver/TestHRegion.java TestHRegionBusyWait.testWritesWhileScanning fails frequently in 0.94 Key: HBASE-11017 URL: https://issues.apache.org/jira/browse/HBASE-11017 Project: HBase Issue Type: Bug Reporter: Lars Hofhansl Assignee: stack Fix For: 0.94.19 Attachments: 11017.txt Have seen a few of these: {code} Error Message Failed clearing memory after 6 attempts on region: testWritesWhileScanning,,1397727647509.2c968a587c4cb7e84a52c7aa8d2afcac. Stacktrace org.apache.hadoop.hbase.DroppedSnapshotException: Failed clearing memory after 6 attempts on region: testWritesWhileScanning,,1397727647509.2c968a587c4cb7e84a52c7aa8d2afcac. at org.apache.hadoop.hbase.regionserver.HRegion.doClose(HRegion.java:1087) at org.apache.hadoop.hbase.regionserver.HRegion.close(HRegion.java:1024) at org.apache.hadoop.hbase.regionserver.HRegion.close(HRegion.java:989) at org.apache.hadoop.hbase.regionserver.HRegion.closeHRegion(HRegion.java:4346) at org.apache.hadoop.hbase.regionserver.TestHRegion.testWritesWhileScanning(TestHRegion.java:3406) {code} -- This message was sent by Atlassian JIRA (v6.2#6252)
[jira] [Commented] (HBASE-11017) TestHRegionBusyWait.testWritesWhileScanning fails frequently in 0.94
[ https://issues.apache.org/jira/browse/HBASE-11017?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13973782#comment-13973782 ] Hudson commented on HBASE-11017: SUCCESS: Integrated in HBase-0.94-JDK7 #120 (See [https://builds.apache.org/job/HBase-0.94-JDK7/120/]) HBASE-11017 TestHRegionBusyWait.testWritesWhileScanning fails frequently in 0.94 (stack: rev 1588392) * /hbase/branches/0.94/src/test/java/org/apache/hadoop/hbase/regionserver/TestHRegion.java TestHRegionBusyWait.testWritesWhileScanning fails frequently in 0.94 Key: HBASE-11017 URL: https://issues.apache.org/jira/browse/HBASE-11017 Project: HBase Issue Type: Bug Reporter: Lars Hofhansl Assignee: stack Fix For: 0.94.19 Attachments: 11017.txt Have seen a few of these: {code} Error Message Failed clearing memory after 6 attempts on region: testWritesWhileScanning,,1397727647509.2c968a587c4cb7e84a52c7aa8d2afcac. Stacktrace org.apache.hadoop.hbase.DroppedSnapshotException: Failed clearing memory after 6 attempts on region: testWritesWhileScanning,,1397727647509.2c968a587c4cb7e84a52c7aa8d2afcac. at org.apache.hadoop.hbase.regionserver.HRegion.doClose(HRegion.java:1087) at org.apache.hadoop.hbase.regionserver.HRegion.close(HRegion.java:1024) at org.apache.hadoop.hbase.regionserver.HRegion.close(HRegion.java:989) at org.apache.hadoop.hbase.regionserver.HRegion.closeHRegion(HRegion.java:4346) at org.apache.hadoop.hbase.regionserver.TestHRegion.testWritesWhileScanning(TestHRegion.java:3406) {code} -- This message was sent by Atlassian JIRA (v6.2#6252)