[jira] [Commented] (HBASE-23056) Block count is 0 when BucketCache using persistent IOEngine and retrieve from file
[ https://issues.apache.org/jira/browse/HBASE-23056?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16950187#comment-16950187 ] Hudson commented on HBASE-23056: Results for branch branch-2 [build #2321 on builds.a.o|https://builds.apache.org/job/HBase%20Nightly/job/branch-2/2321/]: (/) *{color:green}+1 overall{color}* details (if available): (/) {color:green}+1 general checks{color} -- For more information [see general report|https://builds.apache.org/job/HBase%20Nightly/job/branch-2/2321//General_Nightly_Build_Report/] (/) {color:green}+1 jdk8 hadoop2 checks{color} -- For more information [see jdk8 (hadoop2) report|https://builds.apache.org/job/HBase%20Nightly/job/branch-2/2321//JDK8_Nightly_Build_Report_(Hadoop2)/] (/) {color:green}+1 jdk8 hadoop3 checks{color} -- For more information [see jdk8 (hadoop3) report|https://builds.apache.org/job/HBase%20Nightly/job/branch-2/2321//JDK8_Nightly_Build_Report_(Hadoop3)/] (/) {color:green}+1 source release artifact{color} -- See build output for details. (/) {color:green}+1 client integration test{color} > Block count is 0 when BucketCache using persistent IOEngine and retrieve from > file > --- > > Key: HBASE-23056 > URL: https://issues.apache.org/jira/browse/HBASE-23056 > Project: HBase > Issue Type: Bug > Components: BucketCache >Affects Versions: 1.5.0, 1.4.10, 2.2.1, master >Reporter: Baiqiang Zhao >Assignee: Baiqiang Zhao >Priority: Minor > Fix For: 3.0.0, 2.3.0, 1.4.11, 1.5.1 > > Attachments: HBASE-23056-branch-1.0001.patch, > HBASE-23056.master.0001.patch, after_RS_restart.png, before_RS_restart.png > > > We use FileIOEngine to store and read block data in BucketCache. Before stop > RS, the BucketCache metrics in WebUI is like before_RS_restart.png, the block > count is 3. When stop RS, the backing map is persistent to file. And then > start RS, the metrics is like after_RS_restart.png, the block count is 0, but > the size of blocks is correct. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Commented] (HBASE-23056) Block count is 0 when BucketCache using persistent IOEngine and retrieve from file
[ https://issues.apache.org/jira/browse/HBASE-23056?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16950124#comment-16950124 ] Hudson commented on HBASE-23056: Results for branch branch-1.4 [build #1054 on builds.a.o|https://builds.apache.org/job/HBase%20Nightly/job/branch-1.4/1054/]: (x) *{color:red}-1 overall{color}* details (if available): (/) {color:green}+1 general checks{color} -- For more information [see general report|https://builds.apache.org/job/HBase%20Nightly/job/branch-1.4/1054//General_Nightly_Build_Report/] (x) {color:red}-1 jdk7 checks{color} -- For more information [see jdk7 report|https://builds.apache.org/job/HBase%20Nightly/job/branch-1.4/1054//JDK7_Nightly_Build_Report/] (/) {color:green}+1 jdk8 hadoop2 checks{color} -- For more information [see jdk8 (hadoop2) report|https://builds.apache.org/job/HBase%20Nightly/job/branch-1.4/1054//JDK8_Nightly_Build_Report_(Hadoop2)/] (/) {color:green}+1 source release artifact{color} -- See build output for details. > Block count is 0 when BucketCache using persistent IOEngine and retrieve from > file > --- > > Key: HBASE-23056 > URL: https://issues.apache.org/jira/browse/HBASE-23056 > Project: HBase > Issue Type: Bug > Components: BucketCache >Affects Versions: 1.5.0, 1.4.10, 2.2.1, master >Reporter: Baiqiang Zhao >Assignee: Baiqiang Zhao >Priority: Minor > Fix For: 3.0.0, 2.3.0, 1.4.11, 1.5.1 > > Attachments: HBASE-23056-branch-1.0001.patch, > HBASE-23056.master.0001.patch, after_RS_restart.png, before_RS_restart.png > > > We use FileIOEngine to store and read block data in BucketCache. Before stop > RS, the BucketCache metrics in WebUI is like before_RS_restart.png, the block > count is 3. When stop RS, the backing map is persistent to file. And then > start RS, the metrics is like after_RS_restart.png, the block count is 0, but > the size of blocks is correct. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Commented] (HBASE-23056) Block count is 0 when BucketCache using persistent IOEngine and retrieve from file
[ https://issues.apache.org/jira/browse/HBASE-23056?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16950053#comment-16950053 ] Hudson commented on HBASE-23056: Results for branch master [build #1503 on builds.a.o|https://builds.apache.org/job/HBase%20Nightly/job/master/1503/]: (/) *{color:green}+1 overall{color}* details (if available): (/) {color:green}+1 general checks{color} -- For more information [see general report|https://builds.apache.org/job/HBase%20Nightly/job/master/1503//General_Nightly_Build_Report/] (/) {color:green}+1 jdk8 hadoop2 checks{color} -- For more information [see jdk8 (hadoop2) report|https://builds.apache.org/job/HBase%20Nightly/job/master/1503//JDK8_Nightly_Build_Report_(Hadoop2)/] (/) {color:green}+1 jdk8 hadoop3 checks{color} -- For more information [see jdk8 (hadoop3) report|https://builds.apache.org/job/HBase%20Nightly/job/master/1503//JDK8_Nightly_Build_Report_(Hadoop3)/] (/) {color:green}+1 source release artifact{color} -- See build output for details. (/) {color:green}+1 client integration test{color} > Block count is 0 when BucketCache using persistent IOEngine and retrieve from > file > --- > > Key: HBASE-23056 > URL: https://issues.apache.org/jira/browse/HBASE-23056 > Project: HBase > Issue Type: Bug > Components: BucketCache >Affects Versions: 1.5.0, 1.4.10, 2.2.1, master >Reporter: Baiqiang Zhao >Assignee: Baiqiang Zhao >Priority: Minor > Fix For: 3.0.0, 2.3.0, 1.4.11, 1.5.1 > > Attachments: HBASE-23056-branch-1.0001.patch, > HBASE-23056.master.0001.patch, after_RS_restart.png, before_RS_restart.png > > > We use FileIOEngine to store and read block data in BucketCache. Before stop > RS, the BucketCache metrics in WebUI is like before_RS_restart.png, the block > count is 3. When stop RS, the backing map is persistent to file. And then > start RS, the metrics is like after_RS_restart.png, the block count is 0, but > the size of blocks is correct. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Commented] (HBASE-23056) Block count is 0 when BucketCache using persistent IOEngine and retrieve from file
[ https://issues.apache.org/jira/browse/HBASE-23056?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16950004#comment-16950004 ] Hudson commented on HBASE-23056: Results for branch branch-1 [build #1104 on builds.a.o|https://builds.apache.org/job/HBase%20Nightly/job/branch-1/1104/]: (x) *{color:red}-1 overall{color}* details (if available): (/) {color:green}+1 general checks{color} -- For more information [see general report|https://builds.apache.org/job/HBase%20Nightly/job/branch-1/1104//General_Nightly_Build_Report/] (x) {color:red}-1 jdk7 checks{color} -- For more information [see jdk7 report|https://builds.apache.org/job/HBase%20Nightly/job/branch-1/1104//JDK7_Nightly_Build_Report/] (x) {color:red}-1 jdk8 hadoop2 checks{color} -- For more information [see jdk8 (hadoop2) report|https://builds.apache.org/job/HBase%20Nightly/job/branch-1/1104//JDK8_Nightly_Build_Report_(Hadoop2)/] (/) {color:green}+1 source release artifact{color} -- See build output for details. > Block count is 0 when BucketCache using persistent IOEngine and retrieve from > file > --- > > Key: HBASE-23056 > URL: https://issues.apache.org/jira/browse/HBASE-23056 > Project: HBase > Issue Type: Bug > Components: BucketCache >Affects Versions: 1.5.0, 1.4.10, 2.2.1, master >Reporter: Baiqiang Zhao >Assignee: Baiqiang Zhao >Priority: Minor > Fix For: 3.0.0, 2.3.0, 1.4.11, 1.5.1 > > Attachments: HBASE-23056-branch-1.0001.patch, > HBASE-23056.master.0001.patch, after_RS_restart.png, before_RS_restart.png > > > We use FileIOEngine to store and read block data in BucketCache. Before stop > RS, the BucketCache metrics in WebUI is like before_RS_restart.png, the block > count is 3. When stop RS, the backing map is persistent to file. And then > start RS, the metrics is like after_RS_restart.png, the block count is 0, but > the size of blocks is correct. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Commented] (HBASE-23056) Block count is 0 when BucketCache using persistent IOEngine and retrieve from file
[ https://issues.apache.org/jira/browse/HBASE-23056?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16949938#comment-16949938 ] Baiqiang Zhao commented on HBASE-23056: --- Thanks! [~reidchan] > Block count is 0 when BucketCache using persistent IOEngine and retrieve from > file > --- > > Key: HBASE-23056 > URL: https://issues.apache.org/jira/browse/HBASE-23056 > Project: HBase > Issue Type: Bug > Components: BucketCache >Affects Versions: 1.5.0, 1.4.10, 2.2.1, master >Reporter: Baiqiang Zhao >Assignee: Baiqiang Zhao >Priority: Minor > Fix For: 3.0.0, 2.3.0, 1.4.11, 1.5.1 > > Attachments: HBASE-23056-branch-1.0001.patch, > HBASE-23056.master.0001.patch, after_RS_restart.png, before_RS_restart.png > > > We use FileIOEngine to store and read block data in BucketCache. Before stop > RS, the BucketCache metrics in WebUI is like before_RS_restart.png, the block > count is 3. When stop RS, the backing map is persistent to file. And then > start RS, the metrics is like after_RS_restart.png, the block count is 0, but > the size of blocks is correct. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Commented] (HBASE-23056) Block count is 0 when BucketCache using persistent IOEngine and retrieve from file
[ https://issues.apache.org/jira/browse/HBASE-23056?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16949929#comment-16949929 ] Reid Chan commented on HBASE-23056: --- Applied to branch-1, branch-1.4, branch-2, master. > Block count is 0 when BucketCache using persistent IOEngine and retrieve from > file > --- > > Key: HBASE-23056 > URL: https://issues.apache.org/jira/browse/HBASE-23056 > Project: HBase > Issue Type: Bug > Components: BucketCache >Affects Versions: 1.5.0, 1.4.10, 2.2.1, master >Reporter: Baiqiang Zhao >Assignee: Baiqiang Zhao >Priority: Minor > Attachments: HBASE-23056-branch-1.0001.patch, > HBASE-23056.master.0001.patch, after_RS_restart.png, before_RS_restart.png > > > We use FileIOEngine to store and read block data in BucketCache. Before stop > RS, the BucketCache metrics in WebUI is like before_RS_restart.png, the block > count is 3. When stop RS, the backing map is persistent to file. And then > start RS, the metrics is like after_RS_restart.png, the block count is 0, but > the size of blocks is correct. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Commented] (HBASE-23056) Block count is 0 when BucketCache using persistent IOEngine and retrieve from file
[ https://issues.apache.org/jira/browse/HBASE-23056?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16949926#comment-16949926 ] Reid Chan commented on HBASE-23056: --- +1 > Block count is 0 when BucketCache using persistent IOEngine and retrieve from > file > --- > > Key: HBASE-23056 > URL: https://issues.apache.org/jira/browse/HBASE-23056 > Project: HBase > Issue Type: Bug > Components: BucketCache >Affects Versions: 1.5.0, 1.4.10, 2.2.1, master >Reporter: Baiqiang Zhao >Assignee: Baiqiang Zhao >Priority: Minor > Attachments: HBASE-23056-branch-1.0001.patch, > HBASE-23056.master.0001.patch, after_RS_restart.png, before_RS_restart.png > > > We use FileIOEngine to store and read block data in BucketCache. Before stop > RS, the BucketCache metrics in WebUI is like before_RS_restart.png, the block > count is 3. When stop RS, the backing map is persistent to file. And then > start RS, the metrics is like after_RS_restart.png, the block count is 0, but > the size of blocks is correct. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Commented] (HBASE-23056) Block count is 0 when BucketCache using persistent IOEngine and retrieve from file
[ https://issues.apache.org/jira/browse/HBASE-23056?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16949405#comment-16949405 ] HBase QA commented on HBASE-23056: -- | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem || Runtime || Comment || | {color:blue}0{color} | {color:blue} reexec {color} | {color:blue} 1m 36s{color} | {color:blue} Docker mode activated. {color} | || || || || {color:brown} Prechecks {color} || | {color:green}+1{color} | {color:green} dupname {color} | {color:green} 0m 1s{color} | {color:green} No case conflicting files found. {color} | | {color:green}+1{color} | {color:green} hbaseanti {color} | {color:green} 0m 0s{color} | {color:green} Patch does not have any anti-patterns. {color} | | {color:green}+1{color} | {color:green} @author {color} | {color:green} 0m 0s{color} | {color:green} The patch does not contain any @author tags. {color} | | {color:orange}-0{color} | {color:orange} test4tests {color} | {color:orange} 0m 0s{color} | {color:orange} The patch doesn't appear to include any new or modified tests. Please justify why no new tests are needed for this patch. Also please list what manual steps were performed to verify this patch. {color} | || || || || {color:brown} master Compile Tests {color} || | {color:green}+1{color} | {color:green} mvninstall {color} | {color:green} 5m 11s{color} | {color:green} master passed {color} | | {color:green}+1{color} | {color:green} compile {color} | {color:green} 0m 53s{color} | {color:green} master passed {color} | | {color:green}+1{color} | {color:green} checkstyle {color} | {color:green} 1m 15s{color} | {color:green} master passed {color} | | {color:green}+1{color} | {color:green} shadedjars {color} | {color:green} 4m 34s{color} | {color:green} branch has no errors when building our shaded downstream artifacts. {color} | | {color:green}+1{color} | {color:green} javadoc {color} | {color:green} 0m 34s{color} | {color:green} master passed {color} | | {color:blue}0{color} | {color:blue} spotbugs {color} | {color:blue} 4m 0s{color} | {color:blue} Used deprecated FindBugs config; considering switching to SpotBugs. {color} | | {color:green}+1{color} | {color:green} findbugs {color} | {color:green} 3m 58s{color} | {color:green} master passed {color} | || || || || {color:brown} Patch Compile Tests {color} || | {color:green}+1{color} | {color:green} mvninstall {color} | {color:green} 4m 52s{color} | {color:green} the patch passed {color} | | {color:green}+1{color} | {color:green} compile {color} | {color:green} 0m 53s{color} | {color:green} the patch passed {color} | | {color:green}+1{color} | {color:green} javac {color} | {color:green} 0m 53s{color} | {color:green} the patch passed {color} | | {color:green}+1{color} | {color:green} checkstyle {color} | {color:green} 1m 16s{color} | {color:green} the patch passed {color} | | {color:green}+1{color} | {color:green} whitespace {color} | {color:green} 0m 0s{color} | {color:green} The patch has no whitespace issues. {color} | | {color:green}+1{color} | {color:green} shadedjars {color} | {color:green} 4m 30s{color} | {color:green} patch has no errors when building our shaded downstream artifacts. {color} | | {color:green}+1{color} | {color:green} hadoopcheck {color} | {color:green} 15m 37s{color} | {color:green} Patch does not cause any errors with Hadoop 2.8.5 2.9.2 or 3.1.2. {color} | | {color:green}+1{color} | {color:green} javadoc {color} | {color:green} 0m 34s{color} | {color:green} the patch passed {color} | | {color:green}+1{color} | {color:green} findbugs {color} | {color:green} 4m 5s{color} | {color:green} the patch passed {color} | || || || || {color:brown} Other Tests {color} || | {color:green}+1{color} | {color:green} unit {color} | {color:green}164m 31s{color} | {color:green} hbase-server in the patch passed. {color} | | {color:green}+1{color} | {color:green} asflicense {color} | {color:green} 0m 32s{color} | {color:green} The patch does not generate ASF License warnings. {color} | | {color:black}{color} | {color:black} {color} | {color:black}220m 31s{color} | {color:black} {color} | \\ \\ || Subsystem || Report/Notes || | Docker | Client=19.03.3 Server=19.03.3 base: https://builds.apache.org/job/PreCommit-HBASE-Build/949/artifact/patchprocess/Dockerfile | | JIRA Issue | HBASE-23056 | | JIRA Patch URL | https://issues.apache.org/jira/secure/attachment/12981438/HBASE-23056.master.0001.patch | | Optional Tests | dupname asflicense javac javadoc unit spotbugs findbugs shadedjars hadoopcheck hbaseanti checkstyle compile | | uname | Linux 2f3b446b8de6 4.15.0-58-generic #64-Ubuntu SMP Tue Aug 6 11:12:41 UTC 2019 x86_64 GNU/Linux | | Build tool | maven | | Personality | dev-support/hbase-personality.sh | | git revision | master / 2f0b3ac91c | | Default Java | 1.8.0_181 | | Test Results | https://builds.apache.org/job/PreCommit-HBASE-Build/949/testReport/
[jira] [Commented] (HBASE-23056) Block count is 0 when BucketCache using persistent IOEngine and retrieve from file
[ https://issues.apache.org/jira/browse/HBASE-23056?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16949295#comment-16949295 ] Baiqiang Zhao commented on HBASE-23056: --- [~reidchan]Thanks for guiding! > Block count is 0 when BucketCache using persistent IOEngine and retrieve from > file > --- > > Key: HBASE-23056 > URL: https://issues.apache.org/jira/browse/HBASE-23056 > Project: HBase > Issue Type: Bug > Components: BucketCache >Affects Versions: 1.5.0, 1.4.10, 2.2.1, master >Reporter: Baiqiang Zhao >Assignee: Baiqiang Zhao >Priority: Major > Attachments: HBASE-23056-branch-1.0001.patch, > HBASE-23056.master.0001.patch, after_RS_restart.png, before_RS_restart.png > > > We use FileIOEngine to store and read block data in BucketCache. Before stop > RS, the BucketCache metrics in WebUI is like before_RS_restart.png, the block > count is 3. When stop RS, the backing map is persistent to file. And then > start RS, the metrics is like after_RS_restart.png, the block count is 0, but > the size of blocks is correct. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Commented] (HBASE-23056) Block count is 0 when BucketCache using persistent IOEngine and retrieve from file
[ https://issues.apache.org/jira/browse/HBASE-23056?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16949283#comment-16949283 ] Reid Chan commented on HBASE-23056: --- Press "Submit patch" to run QA, FYI [~DeanZ] > Block count is 0 when BucketCache using persistent IOEngine and retrieve from > file > --- > > Key: HBASE-23056 > URL: https://issues.apache.org/jira/browse/HBASE-23056 > Project: HBase > Issue Type: Bug > Components: BucketCache >Affects Versions: 1.5.0, 1.4.10, 2.2.1, master >Reporter: Baiqiang Zhao >Assignee: Baiqiang Zhao >Priority: Major > Attachments: HBASE-23056-branch-1.0001.patch, > HBASE-23056.master.0001.patch, after_RS_restart.png, before_RS_restart.png > > > We use FileIOEngine to store and read block data in BucketCache. Before stop > RS, the BucketCache metrics in WebUI is like before_RS_restart.png, the block > count is 3. When stop RS, the backing map is persistent to file. And then > start RS, the metrics is like after_RS_restart.png, the block count is 0, but > the size of blocks is correct. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Commented] (HBASE-23056) Block count is 0 when BucketCache using persistent IOEngine and retrieve from file
[ https://issues.apache.org/jira/browse/HBASE-23056?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16934452#comment-16934452 ] zbq.dean commented on HBASE-23056: -- [~vjasani] I have observe this count about one minute, and refresh the UI several times. > Block count is 0 when BucketCache using persistent IOEngine and retrieve from > file > --- > > Key: HBASE-23056 > URL: https://issues.apache.org/jira/browse/HBASE-23056 > Project: HBase > Issue Type: Bug > Components: BucketCache >Affects Versions: 1.5.0, 1.4.10, 2.2.1, master >Reporter: zbq.dean >Priority: Major > Attachments: after_RS_restart.png, before_RS_restart.png > > > We use FileIOEngine to store and read block data in BucketCache. Before stop > RS, the BucketCache metrics in WebUI is like before_RS_restart.png, the block > count is 3. When stop RS, the backing map is persistent to file. And then > start RS, the metrics is like after_RS_restart.png, the block count is 0, but > the size of blocks is correct. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Commented] (HBASE-23056) Block count is 0 when BucketCache using persistent IOEngine and retrieve from file
[ https://issues.apache.org/jira/browse/HBASE-23056?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16934309#comment-16934309 ] Viraj Jasani commented on HBASE-23056: -- [~DeanZ] just out of curiosity, how long do you observe this count as 0? Does it come back to correct count(3) in 5-10 sec after refreshing UI? > Block count is 0 when BucketCache using persistent IOEngine and retrieve from > file > --- > > Key: HBASE-23056 > URL: https://issues.apache.org/jira/browse/HBASE-23056 > Project: HBase > Issue Type: Bug > Components: BucketCache >Affects Versions: 1.5.0, 1.4.10, 2.2.1, master >Reporter: zbq.dean >Priority: Major > Attachments: after_RS_restart.png, before_RS_restart.png > > > We use FileIOEngine to store and read block data in BucketCache. Before stop > RS, the BucketCache metrics in WebUI is like before_RS_restart.png, the block > count is 3. When stop RS, the backing map is persistent to file. And then > start RS, the metrics is like after_RS_restart.png, the block count is 0, but > the size of blocks is correct. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Commented] (HBASE-23056) Block count is 0 when BucketCache using persistent IOEngine and retrieve from file
[ https://issues.apache.org/jira/browse/HBASE-23056?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16934182#comment-16934182 ] zbq.dean commented on HBASE-23056: -- Ping [~reidchan] [~anoop.hbase]. > Block count is 0 when BucketCache using persistent IOEngine and retrieve from > file > --- > > Key: HBASE-23056 > URL: https://issues.apache.org/jira/browse/HBASE-23056 > Project: HBase > Issue Type: Bug > Components: BucketCache >Affects Versions: 1.5.0, 2.2.1, master >Reporter: zbq.dean >Priority: Major > Attachments: after_RS_restart.png, before_RS_restart.png > > > We use FileIOEngine to store and read block data in BucketCache. Before stop > RS, the BucketCache metrics in WebUI is like before_RS_restart.png, the block > count is 3. When stop RS, the backing map is persistent to file. And then > start RS, the metrics is like after_RS_restart.png, the block count is 0, but > the size of blocks is correct. -- This message was sent by Atlassian Jira (v8.3.4#803005)