[jira] [Commented] (HBASE-13192) IntegrationTestBulkLoad doesn't wait for table modification sometimes leading to spurious test failures
[ https://issues.apache.org/jira/browse/HBASE-13192?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14355461#comment-14355461 ] Enis Soztutar commented on HBASE-13192: --- what is the difference between getFirst() != 0 and getSecond() != null ? IntegrationTestBulkLoad doesn't wait for table modification sometimes leading to spurious test failures --- Key: HBASE-13192 URL: https://issues.apache.org/jira/browse/HBASE-13192 Project: HBase Issue Type: Bug Reporter: Devaraj Das Assignee: Devaraj Das Attachments: 13192-1.txt, 13192-2.txt Noticed this issue in our internal test runs. It shows up when the test is run with replicas turned on. After the bulk load is complete, the test tries to modify the table with an intention of having the replicas load the new region files. But due to a bug in the way the test was waiting for the modifyTable operation to complete, it would not actually wait. Sometimes a replica wouldn't have loaded the new files yet and it might happen that the 'check' step of the test would go to that replica asking for data. It would give empty results back, and the test would fail. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (HBASE-13192) IntegrationTestBulkLoad doesn't wait for table modification sometimes leading to spurious test failures
[ https://issues.apache.org/jira/browse/HBASE-13192?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14357741#comment-14357741 ] Hudson commented on HBASE-13192: SUCCESS: Integrated in HBase-TRUNK #6243 (See [https://builds.apache.org/job/HBase-TRUNK/6243/]) HBASE-13192. IntegrationTestBulkLoad doesn't wait for table modification sometimes leading to spurious test failures. (ddas: rev 2adec36b2f57fea7006036e5a1f4d5979737ab34) * hbase-server/src/test/java/org/apache/hadoop/hbase/HBaseTestingUtility.java IntegrationTestBulkLoad doesn't wait for table modification sometimes leading to spurious test failures --- Key: HBASE-13192 URL: https://issues.apache.org/jira/browse/HBASE-13192 Project: HBase Issue Type: Bug Reporter: Devaraj Das Assignee: Devaraj Das Fix For: 1.0.1 Attachments: 13192-1.txt, 13192-2.txt Noticed this issue in our internal test runs. It shows up when the test is run with replicas turned on. After the bulk load is complete, the test tries to modify the table with an intention of having the replicas load the new region files. But due to a bug in the way the test was waiting for the modifyTable operation to complete, it would not actually wait. Sometimes a replica wouldn't have loaded the new files yet and it might happen that the 'check' step of the test would go to that replica asking for data. It would give empty results back, and the test would fail. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (HBASE-13192) IntegrationTestBulkLoad doesn't wait for table modification sometimes leading to spurious test failures
[ https://issues.apache.org/jira/browse/HBASE-13192?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14357751#comment-14357751 ] Hudson commented on HBASE-13192: FAILURE: Integrated in HBase-1.1 #280 (See [https://builds.apache.org/job/HBase-1.1/280/]) HBASE-13192. IntegrationTestBulkLoad doesn't wait for table modification sometimes leading to spurious test failures. (ddas: rev e864dd0520dd62e95a98b0e9c92891c546aff999) * hbase-server/src/test/java/org/apache/hadoop/hbase/HBaseTestingUtility.java IntegrationTestBulkLoad doesn't wait for table modification sometimes leading to spurious test failures --- Key: HBASE-13192 URL: https://issues.apache.org/jira/browse/HBASE-13192 Project: HBase Issue Type: Bug Reporter: Devaraj Das Assignee: Devaraj Das Fix For: 1.0.1 Attachments: 13192-1.txt, 13192-2.txt Noticed this issue in our internal test runs. It shows up when the test is run with replicas turned on. After the bulk load is complete, the test tries to modify the table with an intention of having the replicas load the new region files. But due to a bug in the way the test was waiting for the modifyTable operation to complete, it would not actually wait. Sometimes a replica wouldn't have loaded the new files yet and it might happen that the 'check' step of the test would go to that replica asking for data. It would give empty results back, and the test would fail. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (HBASE-13192) IntegrationTestBulkLoad doesn't wait for table modification sometimes leading to spurious test failures
[ https://issues.apache.org/jira/browse/HBASE-13192?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14357764#comment-14357764 ] Hudson commented on HBASE-13192: SUCCESS: Integrated in HBase-1.0 #799 (See [https://builds.apache.org/job/HBase-1.0/799/]) HBASE-13192. IntegrationTestBulkLoad doesn't wait for table modification sometimes leading to spurious test failures. (ddas: rev f4794bd2cb4996989603f3054e20c6cb86a1f2d6) * hbase-server/src/test/java/org/apache/hadoop/hbase/HBaseTestingUtility.java IntegrationTestBulkLoad doesn't wait for table modification sometimes leading to spurious test failures --- Key: HBASE-13192 URL: https://issues.apache.org/jira/browse/HBASE-13192 Project: HBase Issue Type: Bug Reporter: Devaraj Das Assignee: Devaraj Das Fix For: 1.0.1 Attachments: 13192-1.txt, 13192-2.txt Noticed this issue in our internal test runs. It shows up when the test is run with replicas turned on. After the bulk load is complete, the test tries to modify the table with an intention of having the replicas load the new region files. But due to a bug in the way the test was waiting for the modifyTable operation to complete, it would not actually wait. Sometimes a replica wouldn't have loaded the new files yet and it might happen that the 'check' step of the test would go to that replica asking for data. It would give empty results back, and the test would fail. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (HBASE-13192) IntegrationTestBulkLoad doesn't wait for table modification sometimes leading to spurious test failures
[ https://issues.apache.org/jira/browse/HBASE-13192?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14355649#comment-14355649 ] Hadoop QA commented on HBASE-13192: --- {color:red}-1 overall{color}. Here are the results of testing the latest attachment http://issues.apache.org/jira/secure/attachment/12703712/13192-2.txt against master branch at commit ed93ddd94f6264ca246477bece4bf2c895706a22. ATTACHMENT ID: 12703712 {color:green}+1 @author{color}. The patch does not contain any @author tags. {color:green}+1 tests included{color}. The patch appears to include 3 new or modified tests. {color:green}+1 hadoop versions{color}. The patch compiles with all supported hadoop versions (2.4.1 2.5.2 2.6.0) {color:green}+1 javac{color}. The applied patch does not increase the total number of javac compiler warnings. {color:green}+1 javac{color}. The applied patch does not increase the total number of javac compiler warnings. {color:green}+1 javadoc{color}. The javadoc tool did not generate any warning messages. {color:green}+1 checkstyle{color}. The applied patch does not increase the total number of checkstyle errors {color:green}+1 findbugs{color}. The patch does not introduce any new Findbugs (version 2.0.3) warnings. {color:green}+1 release audit{color}. The applied patch does not increase the total number of release audit warnings. {color:green}+1 lineLengths{color}. The patch does not introduce lines longer than 100 {color:red}-1 site{color}. The patch appears to cause mvn site goal to fail. {color:red}-1 core tests{color}. The patch failed these unit tests: Test results: https://builds.apache.org/job/PreCommit-HBASE-Build/13161//testReport/ Findbugs warnings: https://builds.apache.org/job/PreCommit-HBASE-Build/13161//artifact/patchprocess/newPatchFindbugsWarningshbase-annotations.html Findbugs warnings: https://builds.apache.org/job/PreCommit-HBASE-Build/13161//artifact/patchprocess/newPatchFindbugsWarningshbase-hadoop2-compat.html Findbugs warnings: https://builds.apache.org/job/PreCommit-HBASE-Build/13161//artifact/patchprocess/newPatchFindbugsWarningshbase-common.html Findbugs warnings: https://builds.apache.org/job/PreCommit-HBASE-Build/13161//artifact/patchprocess/newPatchFindbugsWarningshbase-hadoop-compat.html Findbugs warnings: https://builds.apache.org/job/PreCommit-HBASE-Build/13161//artifact/patchprocess/newPatchFindbugsWarningshbase-protocol.html Findbugs warnings: https://builds.apache.org/job/PreCommit-HBASE-Build/13161//artifact/patchprocess/newPatchFindbugsWarningshbase-prefix-tree.html Findbugs warnings: https://builds.apache.org/job/PreCommit-HBASE-Build/13161//artifact/patchprocess/newPatchFindbugsWarningshbase-client.html Findbugs warnings: https://builds.apache.org/job/PreCommit-HBASE-Build/13161//artifact/patchprocess/newPatchFindbugsWarningshbase-examples.html Findbugs warnings: https://builds.apache.org/job/PreCommit-HBASE-Build/13161//artifact/patchprocess/newPatchFindbugsWarningshbase-thrift.html Findbugs warnings: https://builds.apache.org/job/PreCommit-HBASE-Build/13161//artifact/patchprocess/newPatchFindbugsWarningshbase-rest.html Findbugs warnings: https://builds.apache.org/job/PreCommit-HBASE-Build/13161//artifact/patchprocess/newPatchFindbugsWarningshbase-server.html Checkstyle Errors: https://builds.apache.org/job/PreCommit-HBASE-Build/13161//artifact/patchprocess/checkstyle-aggregate.html Console output: https://builds.apache.org/job/PreCommit-HBASE-Build/13161//console This message is automatically generated. IntegrationTestBulkLoad doesn't wait for table modification sometimes leading to spurious test failures --- Key: HBASE-13192 URL: https://issues.apache.org/jira/browse/HBASE-13192 Project: HBase Issue Type: Bug Reporter: Devaraj Das Assignee: Devaraj Das Attachments: 13192-1.txt, 13192-2.txt Noticed this issue in our internal test runs. It shows up when the test is run with replicas turned on. After the bulk load is complete, the test tries to modify the table with an intention of having the replicas load the new region files. But due to a bug in the way the test was waiting for the modifyTable operation to complete, it would not actually wait. Sometimes a replica wouldn't have loaded the new files yet and it might happen that the 'check' step of the test would go to that replica asking for data. It would give empty results back, and the test would fail. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (HBASE-13192) IntegrationTestBulkLoad doesn't wait for table modification sometimes leading to spurious test failures
[ https://issues.apache.org/jira/browse/HBASE-13192?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14355643#comment-14355643 ] Hadoop QA commented on HBASE-13192: --- {color:red}-1 overall{color}. Here are the results of testing the latest attachment http://issues.apache.org/jira/secure/attachment/12703703/13192-1.txt against master branch at commit ed93ddd94f6264ca246477bece4bf2c895706a22. ATTACHMENT ID: 12703703 {color:green}+1 @author{color}. The patch does not contain any @author tags. {color:green}+1 tests included{color}. The patch appears to include 3 new or modified tests. {color:green}+1 hadoop versions{color}. The patch compiles with all supported hadoop versions (2.4.1 2.5.2 2.6.0) {color:green}+1 javac{color}. The applied patch does not increase the total number of javac compiler warnings. {color:green}+1 javac{color}. The applied patch does not increase the total number of javac compiler warnings. {color:green}+1 javadoc{color}. The javadoc tool did not generate any warning messages. {color:green}+1 checkstyle{color}. The applied patch does not increase the total number of checkstyle errors {color:green}+1 findbugs{color}. The patch does not introduce any new Findbugs (version 2.0.3) warnings. {color:green}+1 release audit{color}. The applied patch does not increase the total number of release audit warnings. {color:green}+1 lineLengths{color}. The patch does not introduce lines longer than 100 {color:red}-1 site{color}. The patch appears to cause mvn site goal to fail. {color:green}+1 core tests{color}. The patch passed unit tests in . Test results: https://builds.apache.org/job/PreCommit-HBASE-Build/13158//testReport/ Findbugs warnings: https://builds.apache.org/job/PreCommit-HBASE-Build/13158//artifact/patchprocess/newPatchFindbugsWarningshbase-rest.html Findbugs warnings: https://builds.apache.org/job/PreCommit-HBASE-Build/13158//artifact/patchprocess/newPatchFindbugsWarningshbase-common.html Findbugs warnings: https://builds.apache.org/job/PreCommit-HBASE-Build/13158//artifact/patchprocess/newPatchFindbugsWarningshbase-client.html Findbugs warnings: https://builds.apache.org/job/PreCommit-HBASE-Build/13158//artifact/patchprocess/newPatchFindbugsWarningshbase-annotations.html Findbugs warnings: https://builds.apache.org/job/PreCommit-HBASE-Build/13158//artifact/patchprocess/newPatchFindbugsWarningshbase-hadoop-compat.html Findbugs warnings: https://builds.apache.org/job/PreCommit-HBASE-Build/13158//artifact/patchprocess/newPatchFindbugsWarningshbase-server.html Findbugs warnings: https://builds.apache.org/job/PreCommit-HBASE-Build/13158//artifact/patchprocess/newPatchFindbugsWarningshbase-prefix-tree.html Findbugs warnings: https://builds.apache.org/job/PreCommit-HBASE-Build/13158//artifact/patchprocess/newPatchFindbugsWarningshbase-protocol.html Findbugs warnings: https://builds.apache.org/job/PreCommit-HBASE-Build/13158//artifact/patchprocess/newPatchFindbugsWarningshbase-thrift.html Findbugs warnings: https://builds.apache.org/job/PreCommit-HBASE-Build/13158//artifact/patchprocess/newPatchFindbugsWarningshbase-examples.html Findbugs warnings: https://builds.apache.org/job/PreCommit-HBASE-Build/13158//artifact/patchprocess/newPatchFindbugsWarningshbase-hadoop2-compat.html Checkstyle Errors: https://builds.apache.org/job/PreCommit-HBASE-Build/13158//artifact/patchprocess/checkstyle-aggregate.html Console output: https://builds.apache.org/job/PreCommit-HBASE-Build/13158//console This message is automatically generated. IntegrationTestBulkLoad doesn't wait for table modification sometimes leading to spurious test failures --- Key: HBASE-13192 URL: https://issues.apache.org/jira/browse/HBASE-13192 Project: HBase Issue Type: Bug Reporter: Devaraj Das Assignee: Devaraj Das Attachments: 13192-1.txt, 13192-2.txt Noticed this issue in our internal test runs. It shows up when the test is run with replicas turned on. After the bulk load is complete, the test tries to modify the table with an intention of having the replicas load the new region files. But due to a bug in the way the test was waiting for the modifyTable operation to complete, it would not actually wait. Sometimes a replica wouldn't have loaded the new files yet and it might happen that the 'check' step of the test would go to that replica asking for data. It would give empty results back, and the test would fail. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (HBASE-13192) IntegrationTestBulkLoad doesn't wait for table modification sometimes leading to spurious test failures
[ https://issues.apache.org/jira/browse/HBASE-13192?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14355408#comment-14355408 ] Enis Soztutar commented on HBASE-13192: --- +1. IntegrationTestBulkLoad doesn't wait for table modification sometimes leading to spurious test failures --- Key: HBASE-13192 URL: https://issues.apache.org/jira/browse/HBASE-13192 Project: HBase Issue Type: Bug Reporter: Devaraj Das Assignee: Devaraj Das Attachments: 13192-1.txt Noticed this issue in our internal test runs. It shows up when the test is run with replicas turned on. After the bulk load is complete, the test tries to modify the table with an intention of having the replicas load the new region files. But due to a bug in the way the test was waiting for the modifyTable operation to complete, it would not actually wait. Sometimes a replica wouldn't have loaded the new files yet and it might happen that the 'check' step of the test would go to that replica asking for data. It would give empty results back, and the test would fail. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (HBASE-13192) IntegrationTestBulkLoad doesn't wait for table modification sometimes leading to spurious test failures
[ https://issues.apache.org/jira/browse/HBASE-13192?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14355472#comment-14355472 ] Devaraj Das commented on HBASE-13192: - bq. what is the difference between getFirst() != 0 and getSecond() != 0 ? The latter is always non-zero (it is the total number of regions). The former is the pending regions to be altered. That should drop to zero as the regions are altered.. IntegrationTestBulkLoad doesn't wait for table modification sometimes leading to spurious test failures --- Key: HBASE-13192 URL: https://issues.apache.org/jira/browse/HBASE-13192 Project: HBase Issue Type: Bug Reporter: Devaraj Das Assignee: Devaraj Das Attachments: 13192-1.txt, 13192-2.txt Noticed this issue in our internal test runs. It shows up when the test is run with replicas turned on. After the bulk load is complete, the test tries to modify the table with an intention of having the replicas load the new region files. But due to a bug in the way the test was waiting for the modifyTable operation to complete, it would not actually wait. Sometimes a replica wouldn't have loaded the new files yet and it might happen that the 'check' step of the test would go to that replica asking for data. It would give empty results back, and the test would fail. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (HBASE-13192) IntegrationTestBulkLoad doesn't wait for table modification sometimes leading to spurious test failures
[ https://issues.apache.org/jira/browse/HBASE-13192?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14355930#comment-14355930 ] Enis Soztutar commented on HBASE-13192: --- bq. That should drop to zero as the regions are altered.. Ok, thank. +1 for v2 as well. IntegrationTestBulkLoad doesn't wait for table modification sometimes leading to spurious test failures --- Key: HBASE-13192 URL: https://issues.apache.org/jira/browse/HBASE-13192 Project: HBase Issue Type: Bug Reporter: Devaraj Das Assignee: Devaraj Das Attachments: 13192-1.txt, 13192-2.txt Noticed this issue in our internal test runs. It shows up when the test is run with replicas turned on. After the bulk load is complete, the test tries to modify the table with an intention of having the replicas load the new region files. But due to a bug in the way the test was waiting for the modifyTable operation to complete, it would not actually wait. Sometimes a replica wouldn't have loaded the new files yet and it might happen that the 'check' step of the test would go to that replica asking for data. It would give empty results back, and the test would fail. -- This message was sent by Atlassian JIRA (v6.3.4#6332)