[jira] [Commented] (HBASE-17969) Balance by table using SimpleLoadBalancer could end up imbalance
[ https://issues.apache.org/jira/browse/HBASE-17969?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15990558#comment-15990558 ] Ted Yu commented on HBASE-17969: Sounds fine - we just need a QA run for your branch-1 patch. > Balance by table using SimpleLoadBalancer could end up imbalance > > > Key: HBASE-17969 > URL: https://issues.apache.org/jira/browse/HBASE-17969 > Project: HBase > Issue Type: Improvement >Affects Versions: 1.1.10 >Reporter: Allan Yang >Assignee: Allan Yang > Attachments: HBASE-17969-branch-1.patch, > HBASE-17969-branch-1.v2.patch, HBASE-17969.patch > > > This really happens in our production env. > Here is a example: > Say we have three RS named r1, r2, r3. A table named table1 with 3 regions > distributes on these rs like this: > r1 1 > r2 1 > r3 1 > Each rs have one region, it means table1 is balanced. So balancer will not > run. > If the region on r3 splits, then it becomes: > r1 1 > r2 1 > r3 2 > For table1, in average, each rs will have min=1, max=2 regions. So still it > is balanced, balancer will not run. > Then a region on r3 splits again, the distribution becomes: > r1 1 > r2 1 > r3 3 > In average, each rs will have min=1, max=2 regions. So balancer will run. > For r1 and r2, they have already have min=1 regions. Balancer won't do any > operation on them. > But for r3, it exceed max=3, so balancer will remove one region from r3 and > choose one rs from r1, r2 to move to. > But r1 and r2 have the same load, so balancer will always choose r1 since > servername r1 < r2(alphabet order, sorted by ServerAndLoad's compareTo > method). It is OK for table1 itself. But if every table in the cluster have > similar situations like table1, then the load in the cluster will always be > like r1 > r2 > r3. > So, the solution here is when each rs reach min regions (min=total region / > servers), but there still some region need to move, shuffle the regionservers > before move. -- This message was sent by Atlassian JIRA (v6.3.15#6346)
[jira] [Commented] (HBASE-17969) Balance by table using SimpleLoadBalancer could end up imbalance
[
https://issues.apache.org/jira/browse/HBASE-17969?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15990557#comment-15990557
]
Allan Yang commented on HBASE-17969:
{quote}
The test is with
hbase-server/src/test/java/org/apache/hadoop/hbase/master/balancer/TestDefaultLoadBalancer.java
which doesn't apply to master branch.
Can you modify the test to suit master branch (make sure SimpleLoadBalancer is
used) ?
{quote}
Attached a patch for master branch, but seems like HBASE-17110 has resolved
this issue in master branch. IMHO, I think we can commit this issue to branch-1
first, even if HBASE-17110 backport to branch-1 later, it is totally OK.
> Balance by table using SimpleLoadBalancer could end up imbalance
>
>
> Key: HBASE-17969
> URL: https://issues.apache.org/jira/browse/HBASE-17969
> Project: HBase
> Issue Type: Improvement
>Affects Versions: 1.1.10
>Reporter: Allan Yang
>Assignee: Allan Yang
> Attachments: HBASE-17969-branch-1.patch,
> HBASE-17969-branch-1.v2.patch, HBASE-17969.patch
>
>
> This really happens in our production env.
> Here is a example:
> Say we have three RS named r1, r2, r3. A table named table1 with 3 regions
> distributes on these rs like this:
> r1 1
> r2 1
> r3 1
> Each rs have one region, it means table1 is balanced. So balancer will not
> run.
> If the region on r3 splits, then it becomes:
> r1 1
> r2 1
> r3 2
> For table1, in average, each rs will have min=1, max=2 regions. So still it
> is balanced, balancer will not run.
> Then a region on r3 splits again, the distribution becomes:
> r1 1
> r2 1
> r3 3
> In average, each rs will have min=1, max=2 regions. So balancer will run.
> For r1 and r2, they have already have min=1 regions. Balancer won't do any
> operation on them.
> But for r3, it exceed max=3, so balancer will remove one region from r3 and
> choose one rs from r1, r2 to move to.
> But r1 and r2 have the same load, so balancer will always choose r1 since
> servername r1 < r2(alphabet order, sorted by ServerAndLoad's compareTo
> method). It is OK for table1 itself. But if every table in the cluster have
> similar situations like table1, then the load in the cluster will always be
> like r1 > r2 > r3.
> So, the solution here is when each rs reach min regions (min=total region /
> servers), but there still some region need to move, shuffle the regionservers
> before move.
--
This message was sent by Atlassian JIRA
(v6.3.15#6346)
[jira] [Updated] (HBASE-17969) Balance by table using SimpleLoadBalancer could end up imbalance
[ https://issues.apache.org/jira/browse/HBASE-17969?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allan Yang updated HBASE-17969: --- Attachment: HBASE-17969.patch > Balance by table using SimpleLoadBalancer could end up imbalance > > > Key: HBASE-17969 > URL: https://issues.apache.org/jira/browse/HBASE-17969 > Project: HBase > Issue Type: Improvement >Affects Versions: 1.1.10 >Reporter: Allan Yang >Assignee: Allan Yang > Attachments: HBASE-17969-branch-1.patch, > HBASE-17969-branch-1.v2.patch, HBASE-17969.patch > > > This really happens in our production env. > Here is a example: > Say we have three RS named r1, r2, r3. A table named table1 with 3 regions > distributes on these rs like this: > r1 1 > r2 1 > r3 1 > Each rs have one region, it means table1 is balanced. So balancer will not > run. > If the region on r3 splits, then it becomes: > r1 1 > r2 1 > r3 2 > For table1, in average, each rs will have min=1, max=2 regions. So still it > is balanced, balancer will not run. > Then a region on r3 splits again, the distribution becomes: > r1 1 > r2 1 > r3 3 > In average, each rs will have min=1, max=2 regions. So balancer will run. > For r1 and r2, they have already have min=1 regions. Balancer won't do any > operation on them. > But for r3, it exceed max=3, so balancer will remove one region from r3 and > choose one rs from r1, r2 to move to. > But r1 and r2 have the same load, so balancer will always choose r1 since > servername r1 < r2(alphabet order, sorted by ServerAndLoad's compareTo > method). It is OK for table1 itself. But if every table in the cluster have > similar situations like table1, then the load in the cluster will always be > like r1 > r2 > r3. > So, the solution here is when each rs reach min regions (min=total region / > servers), but there still some region need to move, shuffle the regionservers > before move. -- This message was sent by Atlassian JIRA (v6.3.15#6346)
[jira] [Updated] (HBASE-17969) Balance by table using SimpleLoadBalancer could end up imbalance
[ https://issues.apache.org/jira/browse/HBASE-17969?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allan Yang updated HBASE-17969: --- Attachment: (was: UTForMasterBranch.patch) > Balance by table using SimpleLoadBalancer could end up imbalance > > > Key: HBASE-17969 > URL: https://issues.apache.org/jira/browse/HBASE-17969 > Project: HBase > Issue Type: Improvement >Affects Versions: 1.1.10 >Reporter: Allan Yang >Assignee: Allan Yang > Attachments: HBASE-17969-branch-1.patch, HBASE-17969-branch-1.v2.patch > > > This really happens in our production env. > Here is a example: > Say we have three RS named r1, r2, r3. A table named table1 with 3 regions > distributes on these rs like this: > r1 1 > r2 1 > r3 1 > Each rs have one region, it means table1 is balanced. So balancer will not > run. > If the region on r3 splits, then it becomes: > r1 1 > r2 1 > r3 2 > For table1, in average, each rs will have min=1, max=2 regions. So still it > is balanced, balancer will not run. > Then a region on r3 splits again, the distribution becomes: > r1 1 > r2 1 > r3 3 > In average, each rs will have min=1, max=2 regions. So balancer will run. > For r1 and r2, they have already have min=1 regions. Balancer won't do any > operation on them. > But for r3, it exceed max=3, so balancer will remove one region from r3 and > choose one rs from r1, r2 to move to. > But r1 and r2 have the same load, so balancer will always choose r1 since > servername r1 < r2(alphabet order, sorted by ServerAndLoad's compareTo > method). It is OK for table1 itself. But if every table in the cluster have > similar situations like table1, then the load in the cluster will always be > like r1 > r2 > r3. > So, the solution here is when each rs reach min regions (min=total region / > servers), but there still some region need to move, shuffle the regionservers > before move. -- This message was sent by Atlassian JIRA (v6.3.15#6346)
[jira] [Updated] (HBASE-17969) Balance by table using SimpleLoadBalancer could end up imbalance
[ https://issues.apache.org/jira/browse/HBASE-17969?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allan Yang updated HBASE-17969: --- Attachment: UTForMasterBranch.patch > Balance by table using SimpleLoadBalancer could end up imbalance > > > Key: HBASE-17969 > URL: https://issues.apache.org/jira/browse/HBASE-17969 > Project: HBase > Issue Type: Improvement >Affects Versions: 1.1.10 >Reporter: Allan Yang >Assignee: Allan Yang > Attachments: HBASE-17969-branch-1.patch, > HBASE-17969-branch-1.v2.patch, UTForMasterBranch.patch > > > This really happens in our production env. > Here is a example: > Say we have three RS named r1, r2, r3. A table named table1 with 3 regions > distributes on these rs like this: > r1 1 > r2 1 > r3 1 > Each rs have one region, it means table1 is balanced. So balancer will not > run. > If the region on r3 splits, then it becomes: > r1 1 > r2 1 > r3 2 > For table1, in average, each rs will have min=1, max=2 regions. So still it > is balanced, balancer will not run. > Then a region on r3 splits again, the distribution becomes: > r1 1 > r2 1 > r3 3 > In average, each rs will have min=1, max=2 regions. So balancer will run. > For r1 and r2, they have already have min=1 regions. Balancer won't do any > operation on them. > But for r3, it exceed max=3, so balancer will remove one region from r3 and > choose one rs from r1, r2 to move to. > But r1 and r2 have the same load, so balancer will always choose r1 since > servername r1 < r2(alphabet order, sorted by ServerAndLoad's compareTo > method). It is OK for table1 itself. But if every table in the cluster have > similar situations like table1, then the load in the cluster will always be > like r1 > r2 > r3. > So, the solution here is when each rs reach min regions (min=total region / > servers), but there still some region need to move, shuffle the regionservers > before move. -- This message was sent by Atlassian JIRA (v6.3.15#6346)
[jira] [Commented] (HBASE-8486) IS_ROOT isnt needed in HTableDescriptor.
[ https://issues.apache.org/jira/browse/HBASE-8486?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15990480#comment-15990480 ] Hudson commented on HBASE-8486: --- ABORTED: Integrated in Jenkins build HBase-HBASE-14614 #190 (See [https://builds.apache.org/job/HBase-HBASE-14614/190/]) HBASE-8486 remove references to -ROOT- table from table descriptors (busbey: rev 923508c9de065b99b4721acfb582e5a476f48acd) * (edit) hbase-client/src/main/java/org/apache/hadoop/hbase/HTableDescriptor.java * (edit) hbase-client/src/main/java/org/apache/hadoop/hbase/client/TableDescriptor.java * (edit) hbase-client/src/main/java/org/apache/hadoop/hbase/client/TableDescriptorBuilder.java > IS_ROOT isnt needed in HTableDescriptor. > > > Key: HBASE-8486 > URL: https://issues.apache.org/jira/browse/HBASE-8486 > Project: HBase > Issue Type: Improvement >Affects Versions: 2.0.0 >Reporter: Elliott Clark >Assignee: Chia-Ping Tsai >Priority: Minor > Labels: patch > Fix For: 2.0.0 > > Attachments: HBASE-8486.v0.patch, HBASE-8486.v1.patch, > hlogptr-v1.patch > > > HTableDescriptor has several vestigial references to the root region. We > should clean these up. -- This message was sent by Atlassian JIRA (v6.3.15#6346)
[jira] [Commented] (HBASE-17835) Spelling mistakes in the Java source
[ https://issues.apache.org/jira/browse/HBASE-17835?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15990478#comment-15990478 ] Hudson commented on HBASE-17835: ABORTED: Integrated in Jenkins build HBase-HBASE-14614 #190 (See [https://builds.apache.org/job/HBase-HBASE-14614/190/]) HBASE-17835 Spelling mistakes in the Java source (busbey: rev 03e8f6b56ec184d0bbcff765b1b8f353b853fb0f) * (edit) hbase-client/src/main/java/org/apache/hadoop/hbase/client/Admin.java * (edit) hbase-server/src/test/java/org/apache/hadoop/hbase/wal/WALPerformanceEvaluation.java * (edit) hbase-server/src/test/java/org/apache/hadoop/hbase/master/TestClockSkewDetection.java * (edit) hbase-server/src/main/java/org/apache/hadoop/hbase/procedure/ZKProcedureMemberRpcs.java * (edit) hbase-client/src/main/java/org/apache/hadoop/hbase/client/AsyncAdmin.java > Spelling mistakes in the Java source > > > Key: HBASE-17835 > URL: https://issues.apache.org/jira/browse/HBASE-17835 > Project: HBase > Issue Type: Improvement > Components: documentation >Affects Versions: 2.0.0 >Reporter: Qilin Cao >Assignee: Qilin Cao >Priority: Trivial > Fix For: 2.0.0, 1.4.0 > > Attachments: HBASE-17835-001.patch > > > I found spelling mistakes in the hbase java source files viz. recieved > instead of received, and SpanReciever instead of SpanReceiver -- This message was sent by Atlassian JIRA (v6.3.15#6346)
[jira] [Commented] (HBASE-17962) Improve documentation on Rest interface
[ https://issues.apache.org/jira/browse/HBASE-17962?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15990479#comment-15990479 ] Hudson commented on HBASE-17962: ABORTED: Integrated in Jenkins build HBase-HBASE-14614 #190 (See [https://builds.apache.org/job/HBase-HBASE-14614/190/]) HBASE-17962 Improve documentation on Rest interface (busbey: rev fc68f23a4889271888ca8ba3fde1f6f86d3f0fce) * (edit) src/main/asciidoc/_chapters/external_apis.adoc * (edit) hbase-rest/src/main/java/org/apache/hadoop/hbase/rest/RowResource.java > Improve documentation on Rest interface > --- > > Key: HBASE-17962 > URL: https://issues.apache.org/jira/browse/HBASE-17962 > Project: HBase > Issue Type: Improvement > Components: documentation, REST >Reporter: Niels Basjes >Assignee: Niels Basjes >Priority: Trivial > Labels: documentation > Fix For: 2.0.0, 1.4.0 > > Attachments: HBASE-17962-1.patch, HBASE-17962-2.patch, > HBASE-17962.3.patch > > > The part of the documentation on the rest interface 'hides' the fact that you > can retrieve the entire row in one request. > It also does not clearly state that it only works for certain mime types. -- This message was sent by Atlassian JIRA (v6.3.15#6346)
[jira] [Commented] (HBASE-17875) Document why objects over 10MB are not well-suited for hbase
[ https://issues.apache.org/jira/browse/HBASE-17875?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15990483#comment-15990483 ] Hudson commented on HBASE-17875: ABORTED: Integrated in Jenkins build HBase-HBASE-14614 #190 (See [https://builds.apache.org/job/HBase-HBASE-14614/190/]) HBASE-17875 Document why objects over 10MB are not well-suited for (busbey: rev 6edb8f82178f1da4b29dc4ee1a1d8ea8dd2484a4) * (edit) src/main/asciidoc/_chapters/hbase_mob.adoc * (edit) src/main/asciidoc/_chapters/faq.adoc > Document why objects over 10MB are not well-suited for hbase > > > Key: HBASE-17875 > URL: https://issues.apache.org/jira/browse/HBASE-17875 > Project: HBase > Issue Type: Improvement > Components: documentation, mob >Reporter: stack >Assignee: Jingcheng Du > Fix For: 2.0.0 > > Attachments: HBASE-17875.patch, HBASE-17875-V2.patch > > > A new-user who has patently done their homework is unable to find in doc why > objects above 10MB are not recommended for hbase. Lets add explanation that > has a link from MOB on what happens when objects this size are requested form > HBase. -- This message was sent by Atlassian JIRA (v6.3.15#6346)
[jira] [Commented] (HBASE-17879) Avoid NPE in snapshot.jsp when accessing without any request parameter
[ https://issues.apache.org/jira/browse/HBASE-17879?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15990484#comment-15990484 ] Hudson commented on HBASE-17879: ABORTED: Integrated in Jenkins build HBase-HBASE-14614 #190 (See [https://builds.apache.org/job/HBase-HBASE-14614/190/]) HBASE-17879: Avoid NPE in snapshot.jsp when accessing without any (chia7712: rev 1848353fd60b2c51282552e9d0ad284be601cca5) * (edit) hbase-server/src/main/resources/hbase-webapps/master/snapshot.jsp > Avoid NPE in snapshot.jsp when accessing without any request parameter > -- > > Key: HBASE-17879 > URL: https://issues.apache.org/jira/browse/HBASE-17879 > Project: HBase > Issue Type: Bug > Components: UI >Affects Versions: 2.0.0 >Reporter: Abhishek Kumar >Priority: Trivial > Fix For: 2.0.0 > > Attachments: HBASE-17879-master.patch, HBASE-17879-master-v1.patch, > HBASE-17879.patch, HBASE-17879-V1.patch, NPE_screenshot.png, > patched_screenshot.png > > > When accessing snapshot jsp with below url inadvertently NPE comes in UI: > Requested URL: > http://:/snapshot.jsp? > Response: > java.lang.NullPointerException > at > org.apache.hadoop.hbase.generated.master.snapshot_jsp._jspService(snapshot_jsp.java:66) > at org.apache.jasper.runtime.HttpJspBase.service(HttpJspBase.java:98) > at javax.servlet.http.HttpServlet.service(HttpServlet.java:820) > at > org.mortbay.jetty.servlet.ServletHolder.handle(ServletHolder.java:511) -- This message was sent by Atlassian JIRA (v6.3.15#6346)
[jira] [Commented] (HBASE-17975) TokenUtil.obtainToken squashes remote exceptions
[
https://issues.apache.org/jira/browse/HBASE-17975?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15990482#comment-15990482
]
Hudson commented on HBASE-17975:
ABORTED: Integrated in Jenkins build HBase-HBASE-14614 #190 (See
[https://builds.apache.org/job/HBase-HBASE-14614/190/])
HBASE-17975 TokenUtil should throw remote exception rather than squash (busbey:
rev ba12cdf1388a467a0bca5074c9b8b5c022962131)
* (edit)
hbase-server/src/main/java/org/apache/hadoop/hbase/security/token/TokenUtil.java
> TokenUtil.obtainToken squashes remote exceptions
>
>
> Key: HBASE-17975
> URL: https://issues.apache.org/jira/browse/HBASE-17975
> Project: HBase
> Issue Type: Bug
> Components: mapreduce, security
>Affects Versions: 2.0.0
>Reporter: Sean Busbey
>Assignee: Sean Busbey
>Priority: Blocker
> Fix For: 2.0.0
>
> Attachments: HBASE-17975.0.patch
>
>
> In the changes to protobuf handling in HBASE-15638, our TokenUtil class went
> from handling remote exception via a method that would throw IOException to
> one that simply returned it. In doing so, we ended up ignoring the results.
> This causes the obtainToken method to start returning null where it would
> have previously thrown an IOException. It also causes obtainTokenForJob to
> still fail with an IOException, but instead of being the underlying remote
> problem now it's a generic "I didn't get a user token for some reason."
> found via testing Pig with errors.
> {code}
> Caused by: java.io.IOException: No token returned for user
> testu...@example.com
> at
> org.apache.hadoop.hbase.security.token.TokenUtil.obtainTokenForJob(TokenUtil.java:175)
> at
> org.apache.pig.backend.hadoop.hbase.HBaseStorage.addHBaseDelegationToken(HBaseStorage.java:887)
> {code}
--
This message was sent by Atlassian JIRA
(v6.3.15#6346)
[jira] [Commented] (HBASE-17970) Set yarn.app.mapreduce.am.staging-dir when starting MiniMRCluster
[
https://issues.apache.org/jira/browse/HBASE-17970?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15990481#comment-15990481
]
Hudson commented on HBASE-17970:
ABORTED: Integrated in Jenkins build HBase-HBASE-14614 #190 (See
[https://builds.apache.org/job/HBase-HBASE-14614/190/])
HBASE-17970 Set yarn.app.mapreduce.am.staging-dir when starting (busbey: rev
73d80bb416dba867bab2f7c21333d443cf090883)
* (edit)
hbase-server/src/test/java/org/apache/hadoop/hbase/HBaseTestingUtility.java
* (edit)
hbase-server/src/test/java/org/apache/hadoop/hbase/snapshot/TestMobSecureExportSnapshot.java
* (edit)
hbase-server/src/test/java/org/apache/hadoop/hbase/snapshot/TestExportSnapshotNoCluster.java
* (edit)
hbase-server/src/test/java/org/apache/hadoop/hbase/snapshot/TestSecureExportSnapshot.java
* (edit)
hbase-server/src/test/java/org/apache/hadoop/hbase/snapshot/TestExportSnapshot.java
* (edit)
hbase-server/src/test/java/org/apache/hadoop/hbase/snapshot/TestMobExportSnapshot.java
> Set yarn.app.mapreduce.am.staging-dir when starting MiniMRCluster
> -
>
> Key: HBASE-17970
> URL: https://issues.apache.org/jira/browse/HBASE-17970
> Project: HBase
> Issue Type: Bug
> Components: mapreduce, snapshots, test
>Reporter: Duo Zhang
>Assignee: Duo Zhang
> Fix For: 2.0.0
>
> Attachments: HBASE-17970.patch, HBASE-17970-v1.patch,
> HBASE-17970-v1.patch
>
>
> As discussed in mailing-list
> https://builds.apache.org/job/HBASE-Flaky-Tests/15333/artifact/hbase-server/target/surefire-reports/org.apache.hadoop.hbase.snapshot.TestMobExportSnapshot-output.txt/*view*/
> Test*ExportSnapshot will fail if they are executed concurrently because of
> they share the same staging directory.
> {noformat}
> java.io.FileNotFoundException: File
> file:/tmp/hadoop-yarn/staging/jenkins/.staging/job_1492809330233_0001/job.split
> does not exist
> at
> org.apache.hadoop.fs.RawLocalFileSystem.deprecatedGetFileStatus(RawLocalFileSystem.java:606)
> at
> org.apache.hadoop.fs.RawLocalFileSystem.getFileLinkStatusInternal(RawLocalFileSystem.java:819)
> at
> org.apache.hadoop.fs.RawLocalFileSystem.getFileStatus(RawLocalFileSystem.java:596)
> at
> org.apache.hadoop.fs.FilterFileSystem.getFileStatus(FilterFileSystem.java:421)
> at org.apache.hadoop.yarn.util.FSDownload.copy(FSDownload.java:253)
> at
> org.apache.hadoop.yarn.util.FSDownload.access$000(FSDownload.java:63)
> at org.apache.hadoop.yarn.util.FSDownload$2.run(FSDownload.java:361)
> at org.apache.hadoop.yarn.util.FSDownload$2.run(FSDownload.java:359)
> at java.security.AccessController.doPrivileged(Native Method)
> at javax.security.auth.Subject.doAs(Subject.java:422)
> at
> org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1657)
> at org.apache.hadoop.yarn.util.FSDownload.call(FSDownload.java:359)
> at org.apache.hadoop.yarn.util.FSDownload.call(FSDownload.java:62)
> at java.util.concurrent.FutureTask.run(FutureTask.java:266)
> at
> java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
> at java.util.concurrent.FutureTask.run(FutureTask.java:266)
> at
> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
> at
> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
> at java.lang.Thread.run(Thread.java:745)
> {noformat}
> We need to set yarn.app.mapreduce.am.staging-dir to let hem use different
> directories.
--
This message was sent by Atlassian JIRA
(v6.3.15#6346)
[jira] [Commented] (HBASE-17865) Implement async listSnapshot/deleteSnapshot methods.
[ https://issues.apache.org/jira/browse/HBASE-17865?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15990471#comment-15990471 ] Hudson commented on HBASE-17865: ABORTED: Integrated in Jenkins build HBase-HBASE-14614 #190 (See [https://builds.apache.org/job/HBase-HBASE-14614/190/]) HBASE-17865: Implement async listSnapshot/deleteSnapshot methods. (zghao: rev 4bc0eb31c36475d51b1ab3ec6652bcdf40dc2cac) * (edit) hbase-client/src/main/java/org/apache/hadoop/hbase/client/AsyncAdmin.java * (edit) hbase-client/src/main/java/org/apache/hadoop/hbase/client/AsyncHBaseAdmin.java * (edit) hbase-client/src/main/java/org/apache/hadoop/hbase/client/HBaseAdmin.java * (edit) hbase-common/src/main/java/org/apache/hadoop/hbase/HConstants.java * (edit) hbase-server/src/test/java/org/apache/hadoop/hbase/client/TestAsyncSnapshotAdminApi.java > Implement async listSnapshot/deleteSnapshot methods. > > > Key: HBASE-17865 > URL: https://issues.apache.org/jira/browse/HBASE-17865 > Project: HBase > Issue Type: Sub-task > Components: Client >Reporter: Zheng Hu >Assignee: Zheng Hu > Fix For: 2.0.0 > > Attachments: HBASE-17865.v1.patch, HBASE-17865.v2.patch, > HBASE-17865.v2.patch > > -- This message was sent by Atlassian JIRA (v6.3.15#6346)
[jira] [Commented] (HBASE-17965) Canary tool should print the regionserver name on failure
[ https://issues.apache.org/jira/browse/HBASE-17965?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15990469#comment-15990469 ] Hudson commented on HBASE-17965: ABORTED: Integrated in Jenkins build HBase-HBASE-14614 #190 (See [https://builds.apache.org/job/HBase-HBASE-14614/190/]) HBASE-17965 Canary tool should print the regionserver name on failure (apurtell: rev 880db3eee4f1908854f4ac9f778758213eaab20a) * (edit) hbase-server/src/test/java/org/apache/hadoop/hbase/tool/TestCanaryTool.java * (edit) hbase-server/src/main/java/org/apache/hadoop/hbase/tool/Canary.java > Canary tool should print the regionserver name on failure > - > > Key: HBASE-17965 > URL: https://issues.apache.org/jira/browse/HBASE-17965 > Project: HBase > Issue Type: Task >Reporter: churro morales >Assignee: Karan Mehta >Priority: Minor > Fix For: 2.0.0, 1.4.0 > > Attachments: HBASE-17965.001.patch, HBASE-17965-branch-1.patch > > > It would be nice when we have a canary failure for a region to print the > associated regionserver's name in the log as well. -- This message was sent by Atlassian JIRA (v6.3.15#6346)
[jira] [Commented] (HBASE-17947) Location of Examples.proto is wrong in comment of RowCountEndPoint.java
[
https://issues.apache.org/jira/browse/HBASE-17947?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15990463#comment-15990463
]
Hudson commented on HBASE-17947:
ABORTED: Integrated in Jenkins build HBase-HBASE-14614 #190 (See
[https://builds.apache.org/job/HBase-HBASE-14614/190/])
HBASE-17947 Location of Examples.proto is wrong in comment of (tedyu: rev
1367519cd0545c2854108cffab03ae7c79b6ef2c)
* (edit)
hbase-examples/src/main/java/org/apache/hadoop/hbase/coprocessor/example/RowCountEndpoint.java
> Location of Examples.proto is wrong in comment of RowCountEndPoint.java
> ---
>
> Key: HBASE-17947
> URL: https://issues.apache.org/jira/browse/HBASE-17947
> Project: HBase
> Issue Type: Bug
> Components: Coprocessors
>Reporter: Xiang Li
>Assignee: Xiang Li
>Priority: Trivial
> Labels: easyfix
> Fix For: 2.0.0
>
> Attachments: HBASE-17947.master.000.patch,
> HBASE-17947.master.001.patch
>
>
> In the comment of RowCountEndpoint.java
> {code}
> /**
> * Sample coprocessor endpoint exposing a Service interface for counting rows
> and key values.
> *
> *
> * For the protocol buffer definition of the RowCountService, see the source
> file located under
> * hbase-server/src/main/protobuf/Examples.proto.
> *
> */
> {code}
> Examples.proto is not under hbase-server/src/main/protobuf/, but under
> hbase-examples/src/main/protobuf/
--
This message was sent by Atlassian JIRA
(v6.3.15#6346)
[jira] [Commented] (HBASE-17972) Remove mergePool from CompactSplitThread
[ https://issues.apache.org/jira/browse/HBASE-17972?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15990475#comment-15990475 ] Hudson commented on HBASE-17972: ABORTED: Integrated in Jenkins build HBase-HBASE-14614 #190 (See [https://builds.apache.org/job/HBase-HBASE-14614/190/]) HBASE-17972 Remove mergePool from CompactSplitThread (Guangxu Cheng) (tedyu: rev 5411d3ecb156a5128b9045bdb4e58850a10968fb) * (edit) hbase-server/src/test/java/org/apache/hadoop/hbase/regionserver/TestCompactSplitThread.java * (edit) hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/CompactSplitThread.java > Remove mergePool from CompactSplitThread > > > Key: HBASE-17972 > URL: https://issues.apache.org/jira/browse/HBASE-17972 > Project: HBase > Issue Type: Task > Components: regionserver >Affects Versions: 2.0.0 >Reporter: Guangxu Cheng >Assignee: Guangxu Cheng >Priority: Minor > Fix For: 2.0.0 > > Attachments: HBASE-17972-v1.patch > > > mergePool is not in use, we should remove it from CompactSplitThread -- This message was sent by Atlassian JIRA (v6.3.15#6346)
[jira] [Commented] (HBASE-17757) Unify blocksize after encoding to decrease memory fragment
[ https://issues.apache.org/jira/browse/HBASE-17757?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15990472#comment-15990472 ] Hudson commented on HBASE-17757: ABORTED: Integrated in Jenkins build HBase-HBASE-14614 #190 (See [https://builds.apache.org/job/HBase-HBASE-14614/190/]) HBASE-17757 Unify blocksize after encoding to decrease memory fragment (anoopsamjohn: rev c4cbb419a35043c3397476d32b8197cbacd21863) * (edit) hbase-server/src/main/java/org/apache/hadoop/hbase/io/hfile/HFileBlock.java * (edit) hbase-server/src/main/java/org/apache/hadoop/hbase/io/hfile/HFileWriterImpl.java > Unify blocksize after encoding to decrease memory fragment > --- > > Key: HBASE-17757 > URL: https://issues.apache.org/jira/browse/HBASE-17757 > Project: HBase > Issue Type: New Feature >Reporter: Allan Yang >Assignee: Allan Yang > Fix For: 2.0.0 > > Attachments: HBASE-17757.patch, HBASE-17757v2.patch, > HBASE-17757v3.patch, HBASE-17757v4-branch-1.patch, HBASE-17757v4.patch > > > Usually, we store encoded block(uncompressed) in blockcache/bucketCache. > Though we have set the blocksize, after encoding, blocksize is varied. Varied > blocksize will cause memory fragment problem, which will result in more FGC > finally.In order to relief the memory fragment, This issue adjusts the > encoded block to a unified size. -- This message was sent by Atlassian JIRA (v6.3.15#6346)
[jira] [Commented] (HBASE-14925) Develop HBase shell command/tool to list table's region info through command line
[ https://issues.apache.org/jira/browse/HBASE-14925?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15990473#comment-15990473 ] Hudson commented on HBASE-14925: ABORTED: Integrated in Jenkins build HBase-HBASE-14614 #190 (See [https://builds.apache.org/job/HBase-HBASE-14614/190/]) HBase-14925 Develop HBase shell command/tool to list table's region info (ashishsinghi: rev 68b2e0f7d94c02aa82ac89f2ec2f052bdcd58704) * (edit) hbase-shell/src/main/ruby/shell.rb * (add) hbase-shell/src/main/ruby/shell/commands/list_regions.rb > Develop HBase shell command/tool to list table's region info through command > line > - > > Key: HBASE-14925 > URL: https://issues.apache.org/jira/browse/HBASE-14925 > Project: HBase > Issue Type: Improvement > Components: shell >Reporter: Romil Choksi >Assignee: Karan Mehta > Fix For: 2.0.0, 1.4.0 > > Attachments: HBASE-14925.002.patch, HBASE-14925.003.patch, > HBASE-14925.patch > > > I am going through the hbase shell commands to see if there is anything I can > use to get all the regions info just for a particular table. I don’t see any > such command that provides me that information. > It would be better to have a command that provides region info, start key, > end key etc taking a table name as the input parameter. This is available > through HBase UI on clicking on a particular table's link > A tool/shell command to get a list of regions for a table or all tables in a > tabular structured output (that is machine readable) -- This message was sent by Atlassian JIRA (v6.3.15#6346)
[jira] [Commented] (HBASE-17956) Raw scan should ignore TTL
[ https://issues.apache.org/jira/browse/HBASE-17956?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15990465#comment-15990465 ] Hudson commented on HBASE-17956: ABORTED: Integrated in Jenkins build HBase-HBASE-14614 #190 (See [https://builds.apache.org/job/HBase-HBASE-14614/190/]) HBASE-17956 Raw scan should ignore TTL (zhangduo: rev 8973582bc67a8a759310876e41a0348a1e26c89c) * (edit) hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/StoreScanner.java * (edit) hbase-server/src/test/java/org/apache/hadoop/hbase/client/TestScannersFromClientSide.java > Raw scan should ignore TTL > -- > > Key: HBASE-17956 > URL: https://issues.apache.org/jira/browse/HBASE-17956 > Project: HBase > Issue Type: Improvement > Components: scan >Affects Versions: 2.0.0, 1.4.0 >Reporter: Duo Zhang >Assignee: Duo Zhang > Fix For: 2.0.0, 1.4.0 > > Attachments: HBASE-17956.patch > > > For now we will also test TTL to check if a cell is expired for raw scan. > Since we can even return delete marker for a raw scan, I think it is also > reasonable to eliminate the TTL check. -- This message was sent by Atlassian JIRA (v6.3.15#6346)
[jira] [Commented] (HBASE-17920) TestFSHDFSUtils always fails against hadoop 3.0.0-alpha2
[ https://issues.apache.org/jira/browse/HBASE-17920?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15990477#comment-15990477 ] Hudson commented on HBASE-17920: ABORTED: Integrated in Jenkins build HBase-HBASE-14614 #190 (See [https://builds.apache.org/job/HBase-HBASE-14614/190/]) HBASE-17920 TestFSHDFSUtils always fails against hadoop 3.0.0-alpha2 (busbey: rev 43f3fccb7b24d1433434d983e8e60914d8905f8d) * (edit) hbase-server/src/test/java/org/apache/hadoop/hbase/util/TestFSHDFSUtils.java > TestFSHDFSUtils always fails against hadoop 3.0.0-alpha2 > > > Key: HBASE-17920 > URL: https://issues.apache.org/jira/browse/HBASE-17920 > Project: HBase > Issue Type: Sub-task > Components: hadoop3 >Affects Versions: 2.0.0 >Reporter: Jonathan Hsieh >Assignee: Jonathan Hsieh > Fix For: 2.0.0 > > Attachments: hbase-17920.patch > > > TestFSHDFSUtils always fails against hadoop-3.0.0-alpha1 and > hadoop-3.0.0-alpha2. This is because HDFS-9427 in those versions change the > default nn port from 8020 to 9820. -- This message was sent by Atlassian JIRA (v6.3.15#6346)
[jira] [Commented] (HBASE-17933) [hbase-spark] Support Java api for bulkload
[ https://issues.apache.org/jira/browse/HBASE-17933?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15990461#comment-15990461 ] Hudson commented on HBASE-17933: ABORTED: Integrated in Jenkins build HBase-HBASE-14614 #190 (See [https://builds.apache.org/job/HBase-HBASE-14614/190/]) HBASE-17933: [hbase-spark] Support Java api for bulkload (busbey: rev 49f707fba7c6a9f0210f387e31d1be9f108991f8) * (edit) hbase-spark/src/main/scala/org/apache/hadoop/hbase/spark/JavaHBaseContext.scala * (edit) hbase-spark/src/main/scala/org/apache/hadoop/hbase/spark/FamiliesQualifiersValues.scala * (edit) hbase-spark/src/test/java/org/apache/hadoop/hbase/spark/TestJavaHBaseContext.java * (add) hbase-spark/src/main/java/org/apache/hadoop/hbase/spark/example/hbasecontext/JavaHBaseBulkLoadExample.java > [hbase-spark] Support Java api for bulkload > > > Key: HBASE-17933 > URL: https://issues.apache.org/jira/browse/HBASE-17933 > Project: HBase > Issue Type: New Feature > Components: spark >Affects Versions: 2.0.0 >Reporter: Yi Liang >Assignee: Yi Liang > Fix For: 2.0.0 > > Attachments: HBase-17933-V1.patch, HBase-17933-V2.patch, > HBase-17933-V3.patch, HBase-17933-V4.patch > > > In JavaHBaseContext, there are java api for bulkPut, bulkDelete , but no > Java api for bulkload. And this jira will add bulkload java api to hbase-spark -- This message was sent by Atlassian JIRA (v6.3.15#6346)
[jira] [Commented] (HBASE-15583) Any HTableDescriptor we give out should be immutable
[ https://issues.apache.org/jira/browse/HBASE-15583?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15990466#comment-15990466 ] Hudson commented on HBASE-15583: ABORTED: Integrated in Jenkins build HBase-HBASE-14614 #190 (See [https://builds.apache.org/job/HBase-HBASE-14614/190/]) HBASE-15583 Any HTableDescriptor we give out should be immutable (chia7712: rev 053e61541e6f45bbd2866faf4fe6c766a3f0c245) * (edit) hbase-client/src/main/java/org/apache/hadoop/hbase/client/HBaseAdmin.java * (edit) hbase-client/src/main/java/org/apache/hadoop/hbase/client/AsyncHBaseAdmin.java * (edit) hbase-server/src/test/java/org/apache/hadoop/hbase/snapshot/SnapshotTestingUtils.java * (edit) hbase-rsgroup/src/test/java/org/apache/hadoop/hbase/rsgroup/TestRSGroups.java * (edit) hbase-server/src/test/java/org/apache/hadoop/hbase/client/TestAsyncTableBatch.java * (delete) hbase-client/src/main/java/org/apache/hadoop/hbase/client/UnmodifyableHTableDescriptor.java * (edit) hbase-client/src/main/java/org/apache/hadoop/hbase/shaded/protobuf/RequestConverter.java * (edit) hbase-rsgroup/src/main/java/org/apache/hadoop/hbase/rsgroup/RSGroupInfoManagerImpl.java * (edit) hbase-server/src/test/java/org/apache/hadoop/hbase/HBaseTestingUtility.java * (edit) hbase-client/src/main/java/org/apache/hadoop/hbase/client/AsyncAdmin.java * (edit) hbase-client/src/main/java/org/apache/hadoop/hbase/shaded/protobuf/ProtobufUtil.java * (add) hbase-client/src/main/java/org/apache/hadoop/hbase/client/TableDescriptorBuilder.java * (edit) hbase-server/src/test/java/org/apache/hadoop/hbase/util/TestHBaseFsckEncryption.java * (edit) hbase-server/src/test/java/org/apache/hadoop/hbase/util/TestHBaseFsckOneRS.java * (edit) hbase-client/src/main/java/org/apache/hadoop/hbase/HTableDescriptor.java * (edit) hbase-client/src/main/java/org/apache/hadoop/hbase/client/HTable.java * (edit) hbase-rest/src/test/java/org/apache/hadoop/hbase/rest/client/TestRemoteAdminRetries.java * (edit) hbase-rsgroup/src/main/java/org/apache/hadoop/hbase/rsgroup/RSGroupInfoManager.java * (edit) hbase-shell/src/main/ruby/shell/commands/alter_async.rb * (edit) hbase-server/src/test/java/org/apache/hadoop/hbase/regionserver/TestEncryptionRandomKeying.java * (add) hbase-client/src/test/java/org/apache/hadoop/hbase/client/TestImmutableHTableDescriptor.java * (add) hbase-client/src/test/java/org/apache/hadoop/hbase/client/TestTableDescriptorBuilder.java * (delete) hbase-client/src/test/java/org/apache/hadoop/hbase/client/TestUnmodifyableHTableDescriptor.java * (add) hbase-client/src/main/java/org/apache/hadoop/hbase/client/ImmutableHTableDescriptor.java * (add) hbase-client/src/main/java/org/apache/hadoop/hbase/client/TableDescriptor.java * (edit) hbase-server/src/test/java/org/apache/hadoop/hbase/client/TestAsyncTableAdminApi.java * (edit) bin/region_status.rb * (edit) hbase-server/src/test/java/org/apache/hadoop/hbase/security/access/TestCoprocessorWhitelistMasterObserver.java * (edit) hbase-server/src/test/java/org/apache/hadoop/hbase/snapshot/MobSnapshotTestingUtils.java * (edit) hbase-server/src/test/java/org/apache/hadoop/hbase/TestFSTableDescriptorForceCreation.java * (edit) hbase-server/src/test/java/org/apache/hadoop/hbase/regionserver/TestEncryptionKeyRotation.java * (edit) hbase-server/src/test/java/org/apache/hadoop/hbase/regionserver/TestHRegion.java * (edit) hbase-rest/src/test/java/org/apache/hadoop/hbase/rest/RowResourceBase.java * (edit) hbase-server/src/main/java/org/apache/hadoop/hbase/backup/util/RestoreTool.java * (edit) hbase-server/src/test/java/org/apache/hadoop/hbase/master/normalizer/TestSimpleRegionNormalizerOnCluster.java * (edit) hbase-server/src/test/java/org/apache/hadoop/hbase/client/replication/TestReplicationAdminWithClusters.java * (edit) hbase-server/src/test/java/org/apache/hadoop/hbase/util/TestFSTableDescriptors.java * (edit) hbase-client/src/main/java/org/apache/hadoop/hbase/client/Admin.java * (edit) hbase-server/src/main/java/org/apache/hadoop/hbase/util/FSTableDescriptors.java * (edit) hbase-shell/src/main/ruby/hbase/admin.rb > Any HTableDescriptor we give out should be immutable > > > Key: HBASE-15583 > URL: https://issues.apache.org/jira/browse/HBASE-15583 > Project: HBase > Issue Type: Sub-task >Affects Versions: 2.0.0 >Reporter: Gabor Liptak >Assignee: Chia-Ping Tsai >Priority: Minor > Fix For: 2.0.0 > > Attachments: HBASE-15583.v0.patch, HBASE-15583.v1.patch, > HBASE-15583.v2.patch, HBASE-15583.v3.patch, HBASE-15583.v4.patch, > HBASE-15583.v5.patch, HBASE-15583.v6.patch, HBASE-15583.v7.patch > > > From [~enis] in https://issues.apache.org/jira/browse/HBASE-15505: > PS Should UnmodifyableHTableDescriptor be renamed to > UnmodifiableHTableDescriptor? > It should be named
[jira] [Commented] (HBASE-17448) Export metrics from RecoverableZooKeeper
[ https://issues.apache.org/jira/browse/HBASE-17448?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15990468#comment-15990468 ] Hudson commented on HBASE-17448: ABORTED: Integrated in Jenkins build HBase-HBASE-14614 #190 (See [https://builds.apache.org/job/HBase-HBASE-14614/190/]) HBASE-17448 Export metrics from RecoverableZooKeeper (apurtell: rev eb6ded4849adfc33d68e97a0bc689e7b4ac8c355) * (add) hbase-hadoop-compat/src/main/java/org/apache/hadoop/hbase/zookeeper/MetricsZooKeeperSource.java * (add) hbase-hadoop-compat/src/test/java/org/apache/hadoop/hbase/zookeeper/TestMetricsZooKeeperSource.java * (edit) hbase-metrics-api/src/main/java/org/apache/hadoop/hbase/metrics/PackageMarker.java * (edit) hbase-client/pom.xml * (add) hbase-client/src/main/java/org/apache/hadoop/hbase/zookeeper/ZooKeeperMetricsListener.java * (add) hbase-client/src/test/java/org/apache/hadoop/hbase/zookeeper/TestMetricsZooKeeper.java * (add) hbase-client/src/main/java/org/apache/hadoop/hbase/zookeeper/MetricsZooKeeper.java * (edit) hbase-client/src/main/java/org/apache/hadoop/hbase/zookeeper/RecoverableZooKeeper.java * (add) hbase-hadoop2-compat/src/main/resources/META-INF/services/org.apache.hadoop.hbase.zookeeper.MetricsZooKeeperSource * (add) hbase-hadoop2-compat/src/test/java/org/apache/hadoop/hbase/zookeeper/TestMetricsZooKeeperSourceImpl.java * (add) hbase-hadoop2-compat/src/main/java/org/apache/hadoop/hbase/zookeeper/MetricsZooKeeperSourceImpl.java > Export metrics from RecoverableZooKeeper > > > Key: HBASE-17448 > URL: https://issues.apache.org/jira/browse/HBASE-17448 > Project: HBase > Issue Type: Improvement > Components: Zookeeper >Affects Versions: 1.3.1 >Reporter: Andrew Purtell >Assignee: Chinmay Kulkarni > Labels: patch > Fix For: 2.0.0, 1.4.0 > > Attachments: HBASE-17448-branch-1.patch, HBASE-17448.patch, > HBASE-17448.patch > > > Consider adding instrumentation to RecoverableZooKeeper that exposes metrics > on the performance and health of the embedded ZooKeeper client: latency > histograms for each op type, number of reconnections, number of ops where a > reconnection was necessary to proceed, number of failed ops due to > CONNECTIONLOSS, number of failed ops due to SESSIONEXIPRED, number of failed > ops due to OPERATIONTIMEOUT. > RecoverableZooKeeper is a class in hbase-client so we can hook up the new > metrics to both client- and server-side metrics reporters. Probably this > metrics source should be a process singleton. -- This message was sent by Atlassian JIRA (v6.3.15#6346)
[jira] [Commented] (HBASE-17950) Write the chunkId also as Int instead of long into the first byte of the chunk
[ https://issues.apache.org/jira/browse/HBASE-17950?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15990474#comment-15990474 ] Hudson commented on HBASE-17950: ABORTED: Integrated in Jenkins build HBase-HBASE-14614 #190 (See [https://builds.apache.org/job/HBase-HBASE-14614/190/]) HBASE-17950 Write the chunkId also as Int instead of long into the first (ramkrishna: rev b401a35fdc883c74847bc41131e5900939558dab) * (edit) hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/OffheapChunk.java * (edit) hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/Chunk.java * (edit) hbase-server/src/test/java/org/apache/hadoop/hbase/regionserver/TestMemstoreLABWithoutPool.java * (edit) hbase-server/src/test/java/org/apache/hadoop/hbase/regionserver/TestMemStoreLAB.java * (edit) hbase-server/src/test/java/org/apache/hadoop/hbase/regionserver/TestMemStoreChunkPool.java * (edit) hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/OnheapChunk.java * (edit) hbase-server/src/test/java/org/apache/hadoop/hbase/regionserver/TestDefaultMemStore.java > Write the chunkId also as Int instead of long into the first byte of the chunk > -- > > Key: HBASE-17950 > URL: https://issues.apache.org/jira/browse/HBASE-17950 > Project: HBase > Issue Type: Bug >Affects Versions: 2.0.0 >Reporter: ramkrishna.s.vasudevan >Assignee: ramkrishna.s.vasudevan > Fix For: 2.0.0 > > Attachments: HBASE-17950_1.patch, HBASE-17950_1.patch, > HBASE-17950_1.patch, HBASE-17950_1.patch, HBASE-17950_1.patch, > HBASE-17950_2.patch, HBASE-17950.patch > > > I think some issue happened while updating the patch. The chunkId was > converted to int every where but while writing it has been written as a long. > Will push a small patch to change it. -- This message was sent by Atlassian JIRA (v6.3.15#6346)
[jira] [Commented] (HBASE-17817) Make Regionservers log which tables it removed coprocessors from when aborting
[
https://issues.apache.org/jira/browse/HBASE-17817?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15990476#comment-15990476
]
Hudson commented on HBASE-17817:
ABORTED: Integrated in Jenkins build HBase-HBASE-14614 #190 (See
[https://builds.apache.org/job/HBase-HBASE-14614/190/])
HBASE-17817 add table name to output (if available) when removing (busbey: rev
635c9db81556f7b3a89c76d3be40d9989496d151)
* (edit)
hbase-server/src/main/java/org/apache/hadoop/hbase/coprocessor/CoprocessorHost.java
> Make Regionservers log which tables it removed coprocessors from when aborting
> --
>
> Key: HBASE-17817
> URL: https://issues.apache.org/jira/browse/HBASE-17817
> Project: HBase
> Issue Type: Improvement
> Components: Coprocessors, regionserver
>Affects Versions: 1.1.2
>Reporter: Steen Manniche
>Assignee: Steen Manniche
> Labels: logging
> Fix For: 2.0.0, 1.4.0, 1.2.6, 1.3.2, 1.1.11
>
> Attachments: HBASE-17817.master.001.patch,
> HBASE-17817.master.002.patch, HBASE-17817.master.003.patch,
> HBASE-17817.master.004.patch
>
>
> When a coprocessor throws a runtime exception (e.g. NPE), the regionserver
> handles this according to {{hbase.coprocessor.abortonerror}}.
> If the coprocessor was loaded on a specific table, the output in the logs
> give no indication as to which table the coprocessor was removed from (or
> which version, or jarfile is the culprit). This causes longer debugging and
> recovery times.
--
This message was sent by Atlassian JIRA
(v6.3.15#6346)
[jira] [Commented] (HBASE-17873) Change the IA.Public annotation to IA.Private for unstable API
[ https://issues.apache.org/jira/browse/HBASE-17873?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15990467#comment-15990467 ] Hudson commented on HBASE-17873: ABORTED: Integrated in Jenkins build HBase-HBASE-14614 #190 (See [https://builds.apache.org/job/HBase-HBASE-14614/190/]) HBASE-17873 Change the IA.Public annotation to IA.Private for unstable (busbey: rev 177344cdbf8a08a6d225312b2327ff1ea8a21067) * (edit) hbase-client/src/main/java/org/apache/hadoop/hbase/client/AsyncAdmin.java > Change the IA.Public annotation to IA.Private for unstable API > -- > > Key: HBASE-17873 > URL: https://issues.apache.org/jira/browse/HBASE-17873 > Project: HBase > Issue Type: Sub-task > Components: API >Affects Versions: 2.0.0 >Reporter: Duo Zhang >Assignee: Duo Zhang >Priority: Blocker > Fix For: 2.0.0 > > Attachments: HBASE-17873.patch > > > As discussed in mailing list and HBASE-17857. -- This message was sent by Atlassian JIRA (v6.3.15#6346)
[jira] [Commented] (HBASE-17952) The new options for PE tool do not work
[ https://issues.apache.org/jira/browse/HBASE-17952?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15990462#comment-15990462 ] Hudson commented on HBASE-17952: ABORTED: Integrated in Jenkins build HBase-HBASE-14614 #190 (See [https://builds.apache.org/job/HBase-HBASE-14614/190/]) HBASE-17952 The new options for PE tool do not work (zhangduo: rev 72fac379815d79fdeac1452b36cd12fb5492f627) * (edit) hbase-server/src/test/java/org/apache/hadoop/hbase/PerformanceEvaluation.java > The new options for PE tool do not work > --- > > Key: HBASE-17952 > URL: https://issues.apache.org/jira/browse/HBASE-17952 > Project: HBase > Issue Type: Sub-task > Components: Performance, test >Affects Versions: 2.0.0 >Reporter: Duo Zhang >Assignee: Duo Zhang > Labels: trivial > Fix For: 2.0.0 > > Attachments: HBASE-17952.patch > > -- This message was sent by Atlassian JIRA (v6.3.15#6346)
[jira] [Commented] (HBASE-15143) Procedure v2 - Web UI displaying queues
[ https://issues.apache.org/jira/browse/HBASE-15143?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15990464#comment-15990464 ] Hudson commented on HBASE-15143: ABORTED: Integrated in Jenkins build HBase-HBASE-14614 #190 (See [https://builds.apache.org/job/HBase-HBASE-14614/190/]) HBASE-15143 Procedure v2 - Web UI displaying queues (stack: rev 25575064154fe1cc7ff8970e8f15a3cff648f37a) * (edit) hbase-server/src/test/java/org/apache/hadoop/hbase/coprocessor/TestMasterObserver.java * (edit) hbase-protocol-shaded/src/main/protobuf/Master.proto * (edit) hbase-procedure/src/main/java/org/apache/hadoop/hbase/procedure2/LockStatus.java * (add) hbase-shell/src/test/ruby/shell/list_locks_test.rb * (edit) hbase-shell/src/main/ruby/hbase/admin.rb * (edit) hbase-procedure/src/main/java/org/apache/hadoop/hbase/procedure2/ProcedureScheduler.java * (edit) hbase-server/src/main/resources/hbase-webapps/master/procedures.jsp * (edit) hbase-server/src/main/resources/hbase-webapps/master/snapshot.jsp * (edit) hbase-server/src/main/java/org/apache/hadoop/hbase/coprocessor/MasterObserver.java * (edit) hbase-client/src/main/java/org/apache/hadoop/hbase/client/ShortCircuitMasterConnection.java * (edit) hbase-procedure/src/main/java/org/apache/hadoop/hbase/procedure2/SimpleProcedureScheduler.java * (edit) hbase-server/src/main/resources/hbase-webapps/master/zk.jsp * (edit) hbase-protocol-shaded/src/main/java/org/apache/hadoop/hbase/shaded/protobuf/generated/MasterProtos.java * (edit) hbase-protocol-shaded/src/main/protobuf/LockService.proto * (edit) hbase-server/src/main/resources/hbase-webapps/master/tablesDetailed.jsp * (edit) hbase-server/src/main/java/org/apache/hadoop/hbase/master/HMaster.java * (add) hbase-server/src/test/java/org/apache/hadoop/hbase/shaded/protobuf/TestProtobufUtil.java * (edit) hbase-server/src/main/resources/hbase-webapps/master/snapshotsStats.jsp * (edit) hbase-client/src/main/java/org/apache/hadoop/hbase/client/ConnectionImplementation.java * (edit) hbase-procedure/src/main/java/org/apache/hadoop/hbase/procedure2/LockAndQueue.java * (edit) hbase-server/src/main/java/org/apache/hadoop/hbase/master/procedure/MasterProcedureScheduler.java * (edit) hbase-shell/src/main/ruby/shell/formatter.rb * (edit) hbase-protocol-shaded/src/main/java/org/apache/hadoop/hbase/shaded/protobuf/generated/LockServiceProtos.java * (edit) hbase-server/src/main/resources/hbase-webapps/master/table.jsp * (edit) hbase-server/src/main/java/org/apache/hadoop/hbase/master/MasterRpcServices.java * (edit) hbase-client/src/main/java/org/apache/hadoop/hbase/client/HBaseAdmin.java * (edit) hbase-client/src/main/java/org/apache/hadoop/hbase/shaded/protobuf/ProtobufUtil.java * (add) hbase-shell/src/main/ruby/shell/commands/list_locks.rb * (edit) hbase-procedure/src/main/java/org/apache/hadoop/hbase/procedure2/ProcedureUtil.java * (edit) hbase-shell/src/main/ruby/shell.rb * (add) hbase-common/src/main/java/org/apache/hadoop/hbase/procedure2/LockInfo.java * (edit) hbase-server/src/main/java/org/apache/hadoop/hbase/master/MasterCoprocessorHost.java * (edit) hbase-server/src/main/java/org/apache/hadoop/hbase/master/MasterServices.java * (edit) hbase-client/src/main/java/org/apache/hadoop/hbase/client/Admin.java * (edit) hbase-server/src/test/java/org/apache/hadoop/hbase/master/MockNoopMasterServices.java * (edit) hbase-server/src/main/java/org/apache/hadoop/hbase/master/locking/LockProcedure.java * (edit) hbase-shell/src/main/ruby/shell/commands.rb * (edit) hbase-server/src/test/java/org/apache/hadoop/hbase/master/procedure/TestMasterProcedureScheduler.java * (edit) hbase-server/src/test/java/org/apache/hadoop/hbase/protobuf/TestProtobufUtil.java * (edit) hbase-server/src/main/jamon/org/apache/hadoop/hbase/tmpl/master/MasterStatusTmpl.jamon > Procedure v2 - Web UI displaying queues > --- > > Key: HBASE-15143 > URL: https://issues.apache.org/jira/browse/HBASE-15143 > Project: HBase > Issue Type: Sub-task > Components: proc-v2, UI >Reporter: Matteo Bertozzi >Assignee: Balazs Meszaros >Priority: Minor > Fix For: 2.0.0 > > Attachments: HBASE-15143-BM-0001.patch, HBASE-15143-BM-0002.patch, > HBASE-15143-BM-0003.patch, HBASE-15143-BM-0004.patch, > HBASE-15143-BM-0005.patch, HBASE-15143-BM-0006.patch, > HBASE-15143-BM-0006.patch, HBASE-15143-BM-0006.patch, > HBASE-15143-BM-0007.patch, HBASE-15143-BM-0008.patch, > HBASE-15143-BM-0009.patch, HBASE-15143-BM-0010.patch, > HBASE-15143-BM-0011.patch, HBASE-15143-BM-0011.patch, > HBASE-15143-BM-0012.patch, screenshot.png > > > We can query MasterProcedureScheduler to display the various procedures and > who is holding table/region locks. > Each procedure is in a TableQueue or ServerQueue, so it is easy to display > the procedures in its own group. -- This
[jira] [Commented] (HBASE-17877) Improve HBase's byte[] comparator
[ https://issues.apache.org/jira/browse/HBASE-17877?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15990470#comment-15990470 ] Hudson commented on HBASE-17877: ABORTED: Integrated in Jenkins build HBase-HBASE-14614 #190 (See [https://builds.apache.org/job/HBase-HBASE-14614/190/]) HBASE-17877 Improve HBase's byte[] comparator. (larsh: rev b81e00f5eabe8d99fd77d74f60e3754add8205da) * (edit) hbase-common/src/main/java/org/apache/hadoop/hbase/util/ByteBufferUtils.java * (edit) NOTICE.txt * (edit) hbase-common/src/main/java/org/apache/hadoop/hbase/util/Bytes.java > Improve HBase's byte[] comparator > - > > Key: HBASE-17877 > URL: https://issues.apache.org/jira/browse/HBASE-17877 > Project: HBase > Issue Type: Improvement > Components: util >Reporter: Lars Hofhansl >Assignee: Vikas Vishwakarma > Fix For: 2.0.0, 1.4.0, 1.3.2 > > Attachments: 17877-1.2.patch, 17877-v2-1.3.patch, 17877-v3-1.3.patch, > 17877-v4-1.3.patch, ByteComparatorJiraHBASE-17877.pdf, > HBASE-17877.branch-1.3.001.patch, HBASE-17877.branch-1.3.002.patch, > HBASE-17877.branch-1.3.003.patch, HBASE-17877.master.001.patch, > HBASE-17877.master.002.patch, HBASE-17877.master.003.patch > > > [~vik.karma] did some extensive tests and found that Hadoop's version is > faster - dramatically faster in some cases. > Patch forthcoming. -- This message was sent by Atlassian JIRA (v6.3.15#6346)
[jira] [Commented] (HBASE-17943) The in-memory flush size is different for each CompactingMemStore located in the same region
[
https://issues.apache.org/jira/browse/HBASE-17943?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15990453#comment-15990453
]
Hudson commented on HBASE-17943:
ABORTED: Integrated in Jenkins build HBase-HBASE-14614 #190 (See
[https://builds.apache.org/job/HBase-HBASE-14614/190/])
HBASE-17943 The in-memory flush size is different for each (chia7712: rev
ea3a27b18df875284899b04fbc5fb58a3120e6c7)
* (edit)
hbase-server/src/test/java/org/apache/hadoop/hbase/regionserver/TestWalAndCompactingMemStoreFlush.java
* (edit)
hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/CompactingMemStore.java
* (edit)
hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/RegionServicesForStores.java
HBASE-17943 Addendum increases the threshold value of in-memory (chia7712: rev
9053ec6fe6505eba4f14adfdd83329511e4a77f0)
* (edit)
hbase-server/src/test/java/org/apache/hadoop/hbase/regionserver/TestWalAndCompactingMemStoreFlush.java
> The in-memory flush size is different for each CompactingMemStore located in
> the same region
> -
>
> Key: HBASE-17943
> URL: https://issues.apache.org/jira/browse/HBASE-17943
> Project: HBase
> Issue Type: Bug
> Components: regionserver
>Affects Versions: 2.0.0
>Reporter: Chia-Ping Tsai
>Assignee: Chia-Ping Tsai
> Fix For: 2.0.0
>
> Attachments: HBASE-17943.addendum.patch, HBASE-17943.v0.patch
>
>
> {noformat}
> private void initInmemoryFlushSize(Configuration conf) {
> long memstoreFlushSize = getRegionServices().getMemstoreFlushSize();
> int numStores = getRegionServices().getNumStores();
> if (numStores <= 1) {
> // Family number might also be zero in some of our unit test case
> numStores = 1;
> }
> inmemoryFlushSize = memstoreFlushSize / numStores;
> {noformat}
> We initialize each store in parallel, so the return value from getNumStores()
> may be different for each CompactingMemStore.
--
This message was sent by Atlassian JIRA
(v6.3.15#6346)
[jira] [Commented] (HBASE-13288) Fix naming of parameter in Delete constructor
[
https://issues.apache.org/jira/browse/HBASE-13288?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15990452#comment-15990452
]
Hudson commented on HBASE-13288:
ABORTED: Integrated in Jenkins build HBase-HBASE-14614 #190 (See
[https://builds.apache.org/job/HBase-HBASE-14614/190/])
HBASE-13288 Fix naming of parameter in Delete constructor (chia7712: rev
87f2bb5796bd2a05f2c9db559ddd13a33fc80e36)
* (edit) hbase-client/src/main/java/org/apache/hadoop/hbase/client/Delete.java
> Fix naming of parameter in Delete constructor
> -
>
> Key: HBASE-13288
> URL: https://issues.apache.org/jira/browse/HBASE-13288
> Project: HBase
> Issue Type: Bug
> Components: API
>Affects Versions: 2.0.0
>Reporter: Lars George
>Assignee: Ashish Singhi
>Priority: Trivial
> Labels: beginner
> Fix For: 2.0.0
>
> Attachments: HBASE-13288.patch
>
>
> We have these two variants:
> {code}
> Delete(byte[] row, long timestamp)
> Delete(final byte[] rowArray, final int rowOffset, final int rowLength, long
> ts)
> {code}
> Both should use {{timestamp}} as the parameter name, not this mix.
--
This message was sent by Atlassian JIRA
(v6.3.15#6346)
[jira] [Commented] (HBASE-17937) Memstore size becomes negative in case of expensive postPut/Delete Coprocessor call
[ https://issues.apache.org/jira/browse/HBASE-17937?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15990451#comment-15990451 ] Hudson commented on HBASE-17937: ABORTED: Integrated in Jenkins build HBase-HBASE-14614 #190 (See [https://builds.apache.org/job/HBase-HBASE-14614/190/]) HBASE-17937 Memstore size becomes negative in case of expensive (zhangduo: rev 49cba2c237ecc1b3285d942f1ad176ea50c44cd1) * (add) hbase-server/src/test/java/org/apache/hadoop/hbase/coprocessor/TestNegativeMemstoreSizeWithSlowCoprocessor.java * (edit) hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/HRegion.java > Memstore size becomes negative in case of expensive postPut/Delete > Coprocessor call > --- > > Key: HBASE-17937 > URL: https://issues.apache.org/jira/browse/HBASE-17937 > Project: HBase > Issue Type: Bug > Components: regionserver >Affects Versions: 2.0.0, 1.3.1, 0.98.24 >Reporter: Abhishek Singh Chouhan >Assignee: Abhishek Singh Chouhan > Fix For: 2.0.0, 1.4.0, 1.2.6, 1.3.2, 1.1.11 > > Attachments: HBASE-17937.branch-1.001.patch, > HBASE-17937.branch-1.002.patch, HBASE-17937.master.001.patch, > HBASE-17937.master.002.patch, HBASE-17937.master.002.patch, > HBASE-17937.master.003.patch, HBASE-17937.master.003.patch > > > We ran into a situation where the memstore size became negative due to > expensive postPut/Delete Coprocessor calls in doMiniBatchMutate. We update > the memstore size in the finally block of doMiniBatchMutate, however a queued > flush can be triggered during the coprocessor calls(if they are taking time > eg. index updates) since we have released the locks and advanced mvcc at this > point. The flush will turn the memstore size negative since the value > subtracted is the actual value flushed from stores. The negative value > impacts the future flushes amongst others that depend on memstore size. -- This message was sent by Atlassian JIRA (v6.3.15#6346)
[jira] [Commented] (HBASE-17941) CellArrayMap#getCell may throw IndexOutOfBoundsException
[
https://issues.apache.org/jira/browse/HBASE-17941?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15990454#comment-15990454
]
Hudson commented on HBASE-17941:
ABORTED: Integrated in Jenkins build HBase-HBASE-14614 #190 (See
[https://builds.apache.org/job/HBase-HBASE-14614/190/])
HBASE-17941 CellArrayMap#getCell may throw IndexOutOfBoundsException (chia7712:
rev 33dadc1a941a536742799a46444c67a1ed66d124)
* (edit)
hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/CellArrayMap.java
> CellArrayMap#getCell may throw IndexOutOfBoundsException
>
>
> Key: HBASE-17941
> URL: https://issues.apache.org/jira/browse/HBASE-17941
> Project: HBase
> Issue Type: Bug
>Affects Versions: 2.0.0
>Reporter: Chia-Ping Tsai
>Assignee: Hsin-Ying Lee
>Priority: Minor
> Labels: beginner
> Fix For: 2.0.0
>
> Attachments: HBASE-17941.v0.patch
>
>
> {noformat}
> @Override
> protected Cell getCell(int i) {
> if( (i < minCellIdx) && (i >= maxCellIdx) ) return null;
> return block[i];
> }
> {noformat}
> && -> ||
> We have checked the index of bound before calling this method, so the
> exception doesn't happen at current trunk.
--
This message was sent by Atlassian JIRA
(v6.3.15#6346)
[jira] [Commented] (HBASE-17864) Implement async snapshot/cloneSnapshot/restoreSnapshot methods
[ https://issues.apache.org/jira/browse/HBASE-17864?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15990455#comment-15990455 ] Hudson commented on HBASE-17864: ABORTED: Integrated in Jenkins build HBase-HBASE-14614 #190 (See [https://builds.apache.org/job/HBase-HBASE-14614/190/]) HBASE-17864: Implement async snapshot/cloneSnapshot/restoreSnapshot (zghao: rev d39f40e787ecab54ee597ac4463bbbd2f5e944d9) * (add) hbase-server/src/test/java/org/apache/hadoop/hbase/client/TestAsyncSnapshotAdminApi.java * (edit) hbase-client/src/main/java/org/apache/hadoop/hbase/client/AsyncAdmin.java * (edit) hbase-client/src/main/java/org/apache/hadoop/hbase/client/AsyncHBaseAdmin.java * (edit) hbase-common/src/main/java/org/apache/hadoop/hbase/HConstants.java * (edit) hbase-client/src/main/java/org/apache/hadoop/hbase/client/HBaseAdmin.java > Implement async snapshot/cloneSnapshot/restoreSnapshot methods > -- > > Key: HBASE-17864 > URL: https://issues.apache.org/jira/browse/HBASE-17864 > Project: HBase > Issue Type: Sub-task > Components: Client >Reporter: Zheng Hu >Assignee: Zheng Hu > Fix For: 2.0.0 > > Attachments: HBASE-17864.v1.patch, HBASE-17864.v2.patch, > HBASE-17864.v3.patch > > -- This message was sent by Atlassian JIRA (v6.3.15#6346)
[jira] [Commented] (HBASE-16314) Retry on table snapshot failure during full backup
[ https://issues.apache.org/jira/browse/HBASE-16314?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15990458#comment-15990458 ] Hudson commented on HBASE-16314: ABORTED: Integrated in Jenkins build HBase-HBASE-14614 #190 (See [https://builds.apache.org/job/HBase-HBASE-14614/190/]) HBASE-16314 Retry on table snapshot failure during full backup (Vladimir (tedyu: rev e95cf479c7615ae160a6ba963cc7689f3b440efd) * (edit) hbase-server/src/main/java/org/apache/hadoop/hbase/backup/impl/FullTableBackupClient.java * (edit) hbase-server/src/main/java/org/apache/hadoop/hbase/backup/BackupRestoreConstants.java > Retry on table snapshot failure during full backup > -- > > Key: HBASE-16314 > URL: https://issues.apache.org/jira/browse/HBASE-16314 > Project: HBase > Issue Type: Sub-task >Reporter: Vladimir Rodionov >Assignee: Vladimir Rodionov > Labels: backup > Fix For: 2.0.0 > > Attachments: HBASE-16314-v1.patch, HBASE-16314-v2.patch, > HBASE-16314-v3.patch, HBASE-16314-v4.patch, HBASE-16314-v5.patch, > HBASE-16314-v6.patch > > > Table snapshot (during full backup) can fail with NotServingRegionException > (splits, AM region moves). We need to add retry logic here. -- This message was sent by Atlassian JIRA (v6.3.15#6346)
[jira] [Commented] (HBASE-17944) Removed unused JDK version parsing from ClassSize.
[ https://issues.apache.org/jira/browse/HBASE-17944?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15990457#comment-15990457 ] Hudson commented on HBASE-17944: ABORTED: Integrated in Jenkins build HBase-HBASE-14614 #190 (See [https://builds.apache.org/job/HBase-HBASE-14614/190/]) HBASE-17944 - Removed unused JDK version parsing from ClassSize. (busbey: rev a3b6f4addc7ec90cbebe681e75e4e60f3e6940a5) * (edit) hbase-common/src/main/java/org/apache/hadoop/hbase/util/ClassSize.java > Removed unused JDK version parsing from ClassSize. > -- > > Key: HBASE-17944 > URL: https://issues.apache.org/jira/browse/HBASE-17944 > Project: HBase > Issue Type: Improvement > Components: build >Reporter: Colm O hEigeartaigh >Assignee: Colm O hEigeartaigh >Priority: Minor > Fix For: 2.0.0, 1.4.0, 1.2.6, 1.3.2, 1.1.11 > > Attachments: 0001-HBASE-17944-ClassSize-fails-with-Java-9.patch > > > ClassSize fails when run with Java 9. The static block assumes that the java > version contains "." which is not necessarily the case with Java 9: > Caused by: java.lang.RuntimeException: Unexpected version format: 9-ea > at org.apache.hadoop.hbase.util.ClassSize.(ClassSize.java:119) -- This message was sent by Atlassian JIRA (v6.3.15#6346)
[jira] [Commented] (HBASE-16215) clean up references for EOM release lines
[ https://issues.apache.org/jira/browse/HBASE-16215?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15990445#comment-15990445 ] Hudson commented on HBASE-16215: ABORTED: Integrated in Jenkins build HBase-HBASE-14614 #190 (See [https://builds.apache.org/job/HBase-HBASE-14614/190/]) HBASE-16215 clean up of ref guide and site for EOM versions. (busbey: rev a8e6f33791d787eaf9c1bfe63aa7f3266f25268b) * (edit) src/main/asciidoc/_chapters/community.adoc * (edit) src/main/asciidoc/_chapters/cp.adoc * (edit) src/main/asciidoc/_chapters/upgrading.adoc * (edit) src/main/asciidoc/_chapters/configuration.adoc * (edit) src/main/site/site.xml * (edit) src/main/asciidoc/_chapters/developer.adoc > clean up references for EOM release lines > - > > Key: HBASE-16215 > URL: https://issues.apache.org/jira/browse/HBASE-16215 > Project: HBase > Issue Type: Task > Components: community, website >Reporter: Sean Busbey >Assignee: Sean Busbey > Fix For: 2.0.0 > > Attachments: HBASE-16215.0.patch, HBASE-16215.1.patch > > > I've seen us state a few places that 1.0.z is EOM. We should clean up > remaining references > * remove 1.0.z artifact from dist.apache > * remove it from the ref guide (java prereqs, hadoop prereqs, RM list) > * remove unreleased 1.0.z versions from JIRA > * archive released 1.0.z versions in JIRA > edit: expanded to include > * 0.94.y [first EOM > DISCUSS|https://lists.apache.org/thread.html/547058fc59cb48130b35c80f86d41c28038195c99f5ed94e834e291c@%3Cdev.hbase.apache.org%3E], > [second EOM > DISCUSS|https://lists.apache.org/thread.html/5ed4ae42ee9be61f963dd0a49f6896fb7771cd8d319d2d86b3c3cc76@%3Cdev.hbase.apache.org%3E] > * 0.98.y [EOM > DISCUSS|https://lists.apache.org/thread.html/fa968458e0f7f224cf906a259448a207b1230548ce6f2c0d50ceeb12@%3Cdev.hbase.apache.org%3E] -- This message was sent by Atlassian JIRA (v6.3.15#6346)
[jira] [Commented] (HBASE-17946) Shell command compact_rs don't work
[
https://issues.apache.org/jira/browse/HBASE-17946?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15990456#comment-15990456
]
Hudson commented on HBASE-17946:
ABORTED: Integrated in Jenkins build HBase-HBASE-14614 #190 (See
[https://builds.apache.org/job/HBase-HBASE-14614/190/])
HBASE-17946 Shell command compact_rs don't work (Guangxu Cheng) (tedyu: rev
68e48c456dc018775df792507087bf275bf3304f)
* (edit) hbase-shell/src/main/ruby/shell/commands/compact_rs.rb
> Shell command compact_rs don't work
> ---
>
> Key: HBASE-17946
> URL: https://issues.apache.org/jira/browse/HBASE-17946
> Project: HBase
> Issue Type: Bug
> Components: shell
>Affects Versions: 2.0.0
>Reporter: Guangxu Cheng
>Assignee: Guangxu Cheng
> Fix For: 2.0.0
>
> Attachments: HBASE-17946-master-v1.patch
>
>
> error as the following:
> {code}
> hbase(main):001:0> compact_rs 'rs-host-1,16020,1492681533814'
> ERROR: undefined method `compactRegionserver' for #
> Compact all regions on passed regionserver.
> Examples:
> Compact all regions on a regionserver:
> hbase> compact_rs 'host187.example.com,60020'
> or
> hbase> compact_rs 'host187.example.com,60020,1289493121758'
> Major compact all regions on a regionserver:
> hbase> compact_rs 'host187.example.com,60020,1289493121758', true
> Took 0.0240 seconds
> {code}
--
This message was sent by Atlassian JIRA
(v6.3.15#6346)
[jira] [Commented] (HBASE-17302) The region flush request disappeared from flushQueue
[
https://issues.apache.org/jira/browse/HBASE-17302?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15990459#comment-15990459
]
Hudson commented on HBASE-17302:
ABORTED: Integrated in Jenkins build HBase-HBASE-14614 #190 (See
[https://builds.apache.org/job/HBase-HBASE-14614/190/])
HBASE-17302 The region flush request disappeared from flushQueue - (tedyu: rev
435104af70232076145df4211da297c9235cd58f)
* (edit)
hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/MemStoreFlusher.java
> The region flush request disappeared from flushQueue
>
>
> Key: HBASE-17302
> URL: https://issues.apache.org/jira/browse/HBASE-17302
> Project: HBase
> Issue Type: Bug
>Affects Versions: 2.0.0, 0.98.23, 1.2.4
>Reporter: Guangxu Cheng
>Assignee: Guangxu Cheng
> Fix For: 2.0.0, 1.4.0
>
> Attachments: HBASE-17302-branch-1.2-v1.patch,
> HBASE-17302-branch-1-addendum.patch, HBASE-17302-branch-1-addendum-v1.patch,
> HBASE-17302-branch-master-v1.patch, HBASE-17302-master-addendum.patch,
> HBASE-17302-master-addendum-v1.patch
>
>
> Region has too many store files delaying flush up to blockingWaitTime ms, and
> the region flush request is requeued into the flushQueue.
> When the region flush request is requeued into the flushQueue frequently, the
> request is inexplicably disappeared sometimes.
> But regionsInQueue still contains the information of the region request,
> which leads to new flush request can not be inserted into the flushQueue.
> Then, the region will not do flush anymore.
> In order to locate the problem, I added a lot of log in the code.
> {code:title=MemStoreFlusher.java|borderStyle=solid}
> private boolean flushRegion(final HRegion region, final boolean
> emergencyFlush) {
> long startTime = 0;
> synchronized (this.regionsInQueue) {
> FlushRegionEntry fqe = this.regionsInQueue.remove(region);
> // Use the start time of the FlushRegionEntry if available
> if (fqe != null) {
> startTime = fqe.createTime;
> }
> if (fqe != null && emergencyFlush) {
> // Need to remove from region from delay queue. When NOT an
> // emergencyFlush, then item was removed via a flushQueue.poll.
> flushQueue.remove(fqe);
> }
> }
> {code}
> When encountered emergencyFlush, the region flusher will be removed from the
> flushQueue.
> By comparing the flushQueue content before and after remove, RegionA should
> have been removed, it is possible to remove RegionB.
> {code:title=MemStoreFlusher.java|borderStyle=solid}
> public boolean equals(Object obj) {
> if (this == obj) {
> return true;
> }
> if (obj == null || getClass() != obj.getClass()) {
> return false;
> }
> Delayed other = (Delayed) obj;
> return compareTo(other) == 0;
> }
> {code}
> FlushRegionEntry in achieving the equals function, only comparison of the
> delay time, if different regions of the same delay time, it is possible that
> A wrong B.
--
This message was sent by Atlassian JIRA
(v6.3.15#6346)
[jira] [Commented] (HBASE-17914) Create a new reader instead of cloning a new StoreFile when compaction
[ https://issues.apache.org/jira/browse/HBASE-17914?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15990447#comment-15990447 ] Hudson commented on HBASE-17914: ABORTED: Integrated in Jenkins build HBase-HBASE-14614 #190 (See [https://builds.apache.org/job/HBase-HBASE-14614/190/]) HBASE-17914 Create a new reader instead of cloning a new StoreFile when (zhangduo: rev 66b616d7a3d6f4ad6d20962e2dfc0c82a4092ddb) * (edit) hbase-server/src/main/java/org/apache/hadoop/hbase/mob/compactions/PartitionedMobCompactor.java * (edit) hbase-server/src/test/java/org/apache/hadoop/hbase/regionserver/TestReversibleScanners.java * (edit) hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/StoreFileScanner.java * (edit) hbase-server/src/test/java/org/apache/hadoop/hbase/io/hfile/TestSeekBeforeWithInlineBlocks.java * (edit) hbase-server/src/test/java/org/apache/hadoop/hbase/regionserver/DataBlockEncodingTool.java * (edit) hbase-server/src/main/java/org/apache/hadoop/hbase/master/procedure/MergeTableRegionsProcedure.java * (edit) hbase-server/src/main/java/org/apache/hadoop/hbase/io/FSDataInputStreamWrapper.java * (edit) hbase-server/src/test/java/org/apache/hadoop/hbase/regionserver/TestCompoundBloomFilter.java * (edit) hbase-server/src/test/java/org/apache/hadoop/hbase/regionserver/TestStoreFile.java * (edit) hbase-server/src/test/java/org/apache/hadoop/hbase/io/hfile/TestReseekTo.java * (edit) hbase-server/src/test/java/org/apache/hadoop/hbase/util/TestHBaseFsckEncryption.java * (edit) hbase-server/src/test/java/org/apache/hadoop/hbase/mapreduce/TestLoadIncrementalHFiles.java * (edit) hbase-server/src/test/java/org/apache/hadoop/hbase/regionserver/TestMobStoreCompaction.java * (edit) hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/StoreFile.java * (edit) hbase-spark/src/test/scala/org/apache/hadoop/hbase/spark/BulkLoadSuite.scala * (edit) hbase-server/src/test/java/org/apache/hadoop/hbase/regionserver/TestFSErrorsExposed.java * (edit) hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/HRegionFileSystem.java * (edit) hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/StoreFileReader.java * (edit) hbase-server/src/test/java/org/apache/hadoop/hbase/io/hfile/TestHFile.java * (edit) hbase-server/src/test/java/org/apache/hadoop/hbase/mapreduce/TestImportTsv.java * (edit) hbase-server/src/test/java/org/apache/hadoop/hbase/regionserver/TestCompactionPolicy.java * (edit) hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/ReversedStoreScanner.java * (edit) hbase-server/src/test/java/org/apache/hadoop/hbase/mob/compactions/TestMobCompactor.java * (edit) hbase-server/src/main/java/org/apache/hadoop/hbase/io/hfile/HFilePrettyPrinter.java * (edit) hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/compactions/Compactor.java * (edit) hbase-server/src/test/java/org/apache/hadoop/hbase/io/hfile/TestCacheOnWrite.java * (edit) hbase-server/src/test/java/org/apache/hadoop/hbase/io/hfile/TestHFileEncryption.java * (edit) hbase-server/src/main/java/org/apache/hadoop/hbase/io/HalfStoreFileReader.java * (edit) hbase-server/src/test/java/org/apache/hadoop/hbase/HFilePerformanceEvaluation.java * (edit) hbase-server/src/main/java/org/apache/hadoop/hbase/io/FileLink.java * (edit) hbase-server/src/main/java/org/apache/hadoop/hbase/mob/CachedMobFile.java * (edit) hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/StoreScanner.java * (edit) hbase-server/src/test/java/org/apache/hadoop/hbase/mob/compactions/TestPartitionedMobCompactor.java * (edit) hbase-server/src/main/java/org/apache/hadoop/hbase/mob/MobFile.java * (edit) hbase-server/src/test/java/org/apache/hadoop/hbase/mob/TestMobFile.java * (edit) hbase-server/src/main/java/org/apache/hadoop/hbase/mob/MobUtils.java * (edit) hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/HMobStore.java * (edit) hbase-server/src/main/java/org/apache/hadoop/hbase/io/hfile/HFileReaderImpl.java * (edit) hbase-server/src/test/java/org/apache/hadoop/hbase/regionserver/compactions/TestCompactor.java * (edit) hbase-server/src/main/java/org/apache/hadoop/hbase/io/hfile/CacheConfig.java * (edit) hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/DefaultStoreFileManager.java * (edit) hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/StoreFileInfo.java * (edit) hbase-server/src/test/java/org/apache/hadoop/hbase/mapreduce/TestImportTSVWithVisibilityLabels.java * (edit) hbase-server/src/test/java/org/apache/hadoop/hbase/io/TestHalfStoreFileReader.java * (edit) hbase-server/src/test/java/org/apache/hadoop/hbase/io/hfile/TestHFileInlineToRootChunkConversion.java * (edit) hbase-server/src/test/java/org/apache/hadoop/hbase/regionserver/compactions/TestStripeCompactionPolicy.java * (edit) hbase-server/src/main/java/org/apache/hadoop/hbase/mapreduce/LoadIncrementalHFiles.java * (edit)
[jira] [Commented] (HBASE-17940) HMaster can not start due to Jasper related classes conflict
[
https://issues.apache.org/jira/browse/HBASE-17940?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15990448#comment-15990448
]
Hudson commented on HBASE-17940:
ABORTED: Integrated in Jenkins build HBase-HBASE-14614 #190 (See
[https://builds.apache.org/job/HBase-HBASE-14614/190/])
HBASE-17940 HMaster can not start due to Jasper related classes conflict
(zhangduo: rev 0953c144700c18b16f0d34de5ccec90e7c9cef3d)
* (edit) hbase-server/pom.xml
* (edit) pom.xml
> HMaster can not start due to Jasper related classes conflict
>
>
> Key: HBASE-17940
> URL: https://issues.apache.org/jira/browse/HBASE-17940
> Project: HBase
> Issue Type: Bug
> Components: dependencies, pom
>Affects Versions: 2.0.0
>Reporter: Duo Zhang
>Assignee: Duo Zhang
>Priority: Blocker
> Fix For: 2.0.0
>
> Attachments: HBASE-17940.patch
>
>
> I got this
> {noformat}
> java.lang.RuntimeException: Failed construction of Master: class
> org.apache.hadoop.hbase.master.HMaster.
> at
> org.apache.hadoop.hbase.master.HMaster.constructMaster(HMaster.java:2692)
> at
> org.apache.hadoop.hbase.master.HMasterCommandLine.startMaster(HMasterCommandLine.java:235)
> at
> org.apache.hadoop.hbase.master.HMasterCommandLine.run(HMasterCommandLine.java:139)
> at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:70)
> at
> org.apache.hadoop.hbase.util.ServerCommandLine.doMain(ServerCommandLine.java:127)
> at org.apache.hadoop.hbase.master.HMaster.main(HMaster.java:2703)
> Caused by: java.lang.NoSuchFieldError: IS_SECURITY_ENABLED
> at
> org.apache.jasper.compiler.JspRuntimeContext.(JspRuntimeContext.java:194)
> at org.apache.jasper.servlet.JspServlet.init(JspServlet.java:159)
> at
> org.eclipse.jetty.servlet.ServletHolder.initServlet(ServletHolder.java:640)
> at
> org.eclipse.jetty.servlet.ServletHolder.initialize(ServletHolder.java:419)
> at
> org.eclipse.jetty.servlet.ServletHandler.initialize(ServletHandler.java:875)
> at
> org.eclipse.jetty.servlet.ServletContextHandler.startContext(ServletContextHandler.java:348)
> at
> org.eclipse.jetty.webapp.WebAppContext.startWebapp(WebAppContext.java:1379)
> at
> org.eclipse.jetty.webapp.WebAppContext.startContext(WebAppContext.java:1341)
> at
> org.eclipse.jetty.server.handler.ContextHandler.doStart(ContextHandler.java:772)
> at
> org.eclipse.jetty.servlet.ServletContextHandler.doStart(ServletContextHandler.java:261)
> at
> org.eclipse.jetty.webapp.WebAppContext.doStart(WebAppContext.java:517)
> at
> org.eclipse.jetty.util.component.AbstractLifeCycle.start(AbstractLifeCycle.java:68)
> at
> org.eclipse.jetty.util.component.ContainerLifeCycle.start(ContainerLifeCycle.java:132)
> at
> org.eclipse.jetty.util.component.ContainerLifeCycle.doStart(ContainerLifeCycle.java:114)
> at
> org.eclipse.jetty.server.handler.AbstractHandler.doStart(AbstractHandler.java:61)
> at
> org.eclipse.jetty.util.component.AbstractLifeCycle.start(AbstractLifeCycle.java:68)
> at
> org.eclipse.jetty.util.component.ContainerLifeCycle.start(ContainerLifeCycle.java:132)
> at org.eclipse.jetty.server.Server.start(Server.java:405)
> at
> org.eclipse.jetty.util.component.ContainerLifeCycle.doStart(ContainerLifeCycle.java:106)
> at
> org.eclipse.jetty.server.handler.AbstractHandler.doStart(AbstractHandler.java:61)
> at org.eclipse.jetty.server.Server.doStart(Server.java:372)
> at
> org.eclipse.jetty.util.component.AbstractLifeCycle.start(AbstractLifeCycle.java:68)
> at org.apache.hadoop.hbase.http.HttpServer.start(HttpServer.java:969)
> at org.apache.hadoop.hbase.http.InfoServer.start(InfoServer.java:100)
> at
> org.apache.hadoop.hbase.regionserver.HRegionServer.putUpWebUI(HRegionServer.java:1887)
> at
> org.apache.hadoop.hbase.regionserver.HRegionServer.(HRegionServer.java:620)
> at org.apache.hadoop.hbase.master.HMaster.(HMaster.java:461)
> at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native
> Method)
> at
> sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62)
> at
> sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45)
> at java.lang.reflect.Constructor.newInstance(Constructor.java:423)
> at
> org.apache.hadoop.hbase.master.HMaster.constructMaster(HMaster.java:2685)
> ... 5 more
> {noformat}
> The problem is that, we have same classes in two jars,
> javax.servlet.jsp-2.3.2.jar and jasper-compiler-5.5.23.jar, such as
> org.apache.jasper.Constants and
[jira] [Commented] (HBASE-17514) Warn when Thrift Server 1 is configured for proxy users but not the HTTP transport
[
https://issues.apache.org/jira/browse/HBASE-17514?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15990460#comment-15990460
]
Hudson commented on HBASE-17514:
ABORTED: Integrated in Jenkins build HBase-HBASE-14614 #190 (See
[https://builds.apache.org/job/HBase-HBASE-14614/190/])
HBASE-17514 emit a warning if thrift1 proxy user is configured but (busbey: rev
9a1aff447e908c9de351a4f45b869b016ad7821b)
* (edit)
hbase-thrift/src/main/java/org/apache/hadoop/hbase/thrift/ThriftServerRunner.java
> Warn when Thrift Server 1 is configured for proxy users but not the HTTP
> transport
> --
>
> Key: HBASE-17514
> URL: https://issues.apache.org/jira/browse/HBASE-17514
> Project: HBase
> Issue Type: Improvement
> Components: Thrift, Usability
>Reporter: Sean Busbey
>Assignee: lv zehui
>Priority: Minor
> Labels: beginner
> Fix For: 2.0.0, 1.4.0, 1.2.6, 1.3.2, 1.1.11
>
> Attachments: HBASE-17514.master.001.patch
>
>
> The config {{hbase.thrift.support.proxyuser}} is ignored if the Thrift Server
> 1 isn't configured to use an HTTP transport with
> {{hbase.regionserver.thrift.http}}.
> We should emit a warning if our configs request proxy user support but don't
> specify that HTTP should be used for the transport.
--
This message was sent by Atlassian JIRA
(v6.3.15#6346)
[jira] [Commented] (HBASE-17915) Implement async replication admin methods
[ https://issues.apache.org/jira/browse/HBASE-17915?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15990450#comment-15990450 ] Hudson commented on HBASE-17915: ABORTED: Integrated in Jenkins build HBase-HBASE-14614 #190 (See [https://builds.apache.org/job/HBase-HBASE-14614/190/]) HBASE-17915 Implement async replication admin methods (zghao: rev 40cc666ac984e846a8c7105b771ce6bec90c4ad3) * (edit) hbase-client/src/main/java/org/apache/hadoop/hbase/client/replication/ReplicationSerDeHelper.java * (edit) hbase-server/src/test/java/org/apache/hadoop/hbase/client/TestAsyncAdminBase.java * (edit) hbase-client/src/main/java/org/apache/hadoop/hbase/client/AsyncHBaseAdmin.java * (add) hbase-server/src/test/java/org/apache/hadoop/hbase/client/TestAsyncReplicationAdminApi.java * (edit) hbase-client/src/main/java/org/apache/hadoop/hbase/client/AsyncAdmin.java * (edit) hbase-client/src/main/java/org/apache/hadoop/hbase/client/HBaseAdmin.java > Implement async replication admin methods > - > > Key: HBASE-17915 > URL: https://issues.apache.org/jira/browse/HBASE-17915 > Project: HBase > Issue Type: Sub-task > Components: Client >Reporter: Guanghao Zhang >Assignee: Guanghao Zhang > Fix For: 2.0.0 > > Attachments: HBASE-17915.master.001.patch, > HBASE-17915.master.001.patch, HBASE-17915.master.001.patch, > HBASE-17915.master.002.patch, HBASE-17915.master.003.patch, > HBASE-17915.master.004.patch, HBASE-17915.master.005.patch, > HBASE-17915.master.005.patch > > -- This message was sent by Atlassian JIRA (v6.3.15#6346)
[jira] [Commented] (HBASE-17925) mvn assembly:single fails against hadoop3-alpha2
[
https://issues.apache.org/jira/browse/HBASE-17925?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15990446#comment-15990446
]
Hudson commented on HBASE-17925:
ABORTED: Integrated in Jenkins build HBase-HBASE-14614 #190 (See
[https://builds.apache.org/job/HBase-HBASE-14614/190/])
HBASE-17925 mvn assembly:single fails against hadoop3-alpha2 (jmhsieh: rev
719a30b11a7fddc5f8e5318064d8fb9ef5eab7cb)
* (edit) pom.xml
> mvn assembly:single fails against hadoop3-alpha2
>
>
> Key: HBASE-17925
> URL: https://issues.apache.org/jira/browse/HBASE-17925
> Project: HBase
> Issue Type: Sub-task
> Components: hadoop3
>Affects Versions: 2.0.0
>Reporter: Jonathan Hsieh
>Assignee: Jonathan Hsieh
> Fix For: 2.0.0, 1.4.0, 1.1.10, 1.2.6, 1.3.2
>
> Attachments: hbase-17925.patch
>
>
> generally to build tarballs against hadoop3 alpha2 we'd use
> {code}
> mvn -Dhadoop.profile=3.0 -Dhadoop.three-version=3.0.0-alpha2 assembly:single
> -DskipTests
> {code}
> This currently fails.
--
This message was sent by Atlassian JIRA
(v6.3.15#6346)
[jira] [Commented] (HBASE-17542) Move backup system table into separate namespace
[ https://issues.apache.org/jira/browse/HBASE-17542?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15990449#comment-15990449 ] Hudson commented on HBASE-17542: ABORTED: Integrated in Jenkins build HBase-HBASE-14614 #190 (See [https://builds.apache.org/job/HBase-HBASE-14614/190/]) HBASE-17542 Move backup system table into separate namespace (tedyu: rev b1ef8dd43aa0f0102f296ea9b3eb76b5623052f5) * (edit) hbase-server/src/main/java/org/apache/hadoop/hbase/backup/impl/BackupSystemTable.java * (edit) hbase-server/src/main/java/org/apache/hadoop/hbase/backup/BackupRestoreConstants.java * (edit) hbase-server/src/main/java/org/apache/hadoop/hbase/backup/BackupHFileCleaner.java > Move backup system table into separate namespace > > > Key: HBASE-17542 > URL: https://issues.apache.org/jira/browse/HBASE-17542 > Project: HBase > Issue Type: New Feature >Reporter: Vladimir Rodionov >Assignee: Vladimir Rodionov > Fix For: 2.0.0 > > Attachments: HBASE-17542-v1.patch > > -- This message was sent by Atlassian JIRA (v6.3.15#6346)
[jira] [Commented] (HBASE-17936) Refine sum endpoint example in ref guide
[ https://issues.apache.org/jira/browse/HBASE-17936?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15990444#comment-15990444 ] Hudson commented on HBASE-17936: ABORTED: Integrated in Jenkins build HBase-HBASE-14614 #190 (See [https://builds.apache.org/job/HBase-HBASE-14614/190/]) HBASE-17936 Refine sum endpoint example in ref guide (stack: rev d15f75b3cfc5de4def04e94cbb965fd7f578dc34) * (edit) src/main/asciidoc/_chapters/cp.adoc > Refine sum endpoint example in ref guide > > > Key: HBASE-17936 > URL: https://issues.apache.org/jira/browse/HBASE-17936 > Project: HBase > Issue Type: Bug > Components: documentation >Reporter: Xiang Li >Assignee: Xiang Li >Priority: Minor > Fix For: 2.0.0 > > Attachments: HBASE-17936.master.000.patch > > > Refine chapter 90.2, the example java code of sum endpoint of > http://hbase.apache.org/book.html#cp_example > - error > - typo > - genericity > - indent -- This message was sent by Atlassian JIRA (v6.3.15#6346)
[jira] [Commented] (HBASE-17903) Corrected the alias for the link of HBASE-6580
[
https://issues.apache.org/jira/browse/HBASE-17903?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15990435#comment-15990435
]
Hudson commented on HBASE-17903:
ABORTED: Integrated in Jenkins build HBase-HBASE-14614 #190 (See
[https://builds.apache.org/job/HBase-HBASE-14614/190/])
HBASE-17903 Corrected the alias for the link of HBASE-6580 (chia7712: rev
918aa4655c4109159f27b6d78460bd3681c11f06)
* (edit) src/main/asciidoc/_chapters/architecture.adoc
> Corrected the alias for the link of HBASE-6580
> --
>
> Key: HBASE-17903
> URL: https://issues.apache.org/jira/browse/HBASE-17903
> Project: HBase
> Issue Type: Bug
> Components: documentation
>Affects Versions: 2.0.0
>Reporter: Chia-Ping Tsai
>Assignee: Jan Hentschel
>Priority: Trivial
> Labels: beginner
> Fix For: 2.0.0
>
> Attachments: HBASE-17903.master.001.patch
>
>
> {noformat}
> Previous versions of this guide discussed `HTablePool`, which was deprecated
> in HBase 0.94, 0.95, and 0.96, and removed in 0.98.1, by
> link:https://issues.apache.org/jira/browse/HBASE-6580[HBASE-6500], or
> `HConnection`, which is deprecated in HBase 1.0 by `Connection`.
> Please use
> link:http://hbase.apache.org/apidocs/org/apache/hadoop/hbase/client/Connection.html[Connection]
> instead.
> {noformat}
> 6500 -> 6580
--
This message was sent by Atlassian JIRA
(v6.3.15#6346)
[jira] [Commented] (HBASE-17090) Procedure v2 - fast wake if nothing else is running
[ https://issues.apache.org/jira/browse/HBASE-17090?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15990431#comment-15990431 ] Hudson commented on HBASE-17090: ABORTED: Integrated in Jenkins build HBase-HBASE-14614 #190 (See [https://builds.apache.org/job/HBase-HBASE-14614/190/]) HBASE-17090 Redundant exclusion of jruby-complete in pom of hbase-spark (stack: rev e2a746152ca8c02c18214f0b5180ed8dcc84e947) * (edit) hbase-spark/pom.xml > Procedure v2 - fast wake if nothing else is running > --- > > Key: HBASE-17090 > URL: https://issues.apache.org/jira/browse/HBASE-17090 > Project: HBase > Issue Type: Sub-task > Components: proc-v2 >Reporter: Matteo Bertozzi >Assignee: Matteo Bertozzi > Fix For: 2.0.0 > > Attachments: HBASE-17090-v0.patch > > > We wait Nmsec to see if we can batch more procedures, but the pattern that we > have allows us to wait only for what we know is running and avoid waiting for > something that will never get there. -- This message was sent by Atlassian JIRA (v6.3.15#6346)
[jira] [Commented] (HBASE-17912) Avoid major compactions on region server startup
[ https://issues.apache.org/jira/browse/HBASE-17912?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15990442#comment-15990442 ] Hudson commented on HBASE-17912: ABORTED: Integrated in Jenkins build HBase-HBASE-14614 #190 (See [https://builds.apache.org/job/HBase-HBASE-14614/190/]) HBASE-17912 - Avoid major compactions on region server startup (tedyu: rev 5eda5fb9d7d7fd5ae77d862c2e1666787e72ead0) * (edit) hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/HRegionServer.java > Avoid major compactions on region server startup > > > Key: HBASE-17912 > URL: https://issues.apache.org/jira/browse/HBASE-17912 > Project: HBase > Issue Type: Improvement > Components: Compaction >Affects Versions: 2.0.0, 1.3.1, 0.98.24 >Reporter: Geoffrey Jacoby >Assignee: Geoffrey Jacoby > Fix For: 2.0.0, 1.4.0 > > Attachments: HBASE-17912.patch > > > The HRegionServer.CompactionChecker chore wakes up every 10s and for each > store in each region mods against a chore frequency (by default slightly > under 3 hours) to see if it's time to check if a major compaction is > necessary for that store. > The check to see if it needs to check for major compactions is calculated by > if (iteration % multiplier != 0) continue; > where iteration is the number of times the chore has woken up. > Because 0 % anything is 0, this will always check for necessary major > compactions on each store when this chore is first run after the region > server starts up. This can result in compaction storms when doing a rolling > restart, because, for example, the new instance of the region server might > get a lower jitter value than the old one had. -- This message was sent by Atlassian JIRA (v6.3.15#6346)
[jira] [Commented] (HBASE-17904) Get runs into NoSuchElementException when using Read Replica, with hbase. ipc.client.specificThreadForWriting to be true and hbase.rpc.client.impl to be org.apache.had
[
https://issues.apache.org/jira/browse/HBASE-17904?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15990433#comment-15990433
]
Hudson commented on HBASE-17904:
ABORTED: Integrated in Jenkins build HBase-HBASE-14614 #190 (See
[https://builds.apache.org/job/HBase-HBASE-14614/190/])
HBASE-17904 Get runs into NoSuchElementException when using Read (stack: rev
7678855fac011a9c02e5d6a42470c0178482a4ce)
* (edit)
hbase-client/src/main/java/org/apache/hadoop/hbase/ipc/BlockingRpcConnection.java
* (edit)
hbase-server/src/test/java/org/apache/hadoop/hbase/client/TestReplicaWithCluster.java
> Get runs into NoSuchElementException when using Read Replica, with hbase.
> ipc.client.specificThreadForWriting to be true and hbase.rpc.client.impl to
> be org.apache.hadoop.hbase.ipc.RpcClientImpl
> --
>
> Key: HBASE-17904
> URL: https://issues.apache.org/jira/browse/HBASE-17904
> Project: HBase
> Issue Type: Bug
> Components: Client, IPC/RPC
>Affects Versions: 2.0.0, 1.4.0
>Reporter: huaxiang sun
>Assignee: huaxiang sun
> Fix For: 2.0.0, 1.4.0
>
> Attachments: HBASE-17904-branch-1-v001.patch,
> HBASE-17904-master-v001.patch, HBASE-17904-master-v002.patch,
> HBASE-17904-master-v002.patch
>
>
> When testing read replica with 2.0.0 code, with the following config
> {code}
>
> hbase.ipc.client.specificThreadForWriting
> true
>
>
> hbase.rpc.client.impl
> org.apache.hadoop.hbase.ipc.RpcClientImpl
>
> {code}
> The hbase client runs into the following exception
> {code}
> Exception in thread "main" java.util.NoSuchElementException
> at java.util.ArrayDeque.removeFirst(ArrayDeque.java:280)
> at java.util.ArrayDeque.remove(ArrayDeque.java:447)
> at
> org.apache.hadoop.hbase.ipc.BlockingRpcConnection$CallSender.remove(BlockingRpcConnection.java:159)
> at
> org.apache.hadoop.hbase.ipc.BlockingRpcConnection$3.run(BlockingRpcConnection.java:760)
> at
> org.apache.hadoop.hbase.ipc.HBaseRpcControllerImpl.startCancel(HBaseRpcControllerImpl.java:229)
> at
> org.apache.hadoop.hbase.client.CancellableRegionServerCallable.cancel(CancellableRegionServerCallable.java:86)
> at
> org.apache.hadoop.hbase.client.ResultBoundedCompletionService$QueueingFuture.cancel(ResultBoundedCompletionService.java:106)
> at
> org.apache.hadoop.hbase.client.ResultBoundedCompletionService.cancelAll(ResultBoundedCompletionService.java:274)
> at
> org.apache.hadoop.hbase.client.RpcRetryingCallerWithReadReplicas.call(RpcRetryingCallerWithReadReplicas.java:224)
> at org.apache.hadoop.hbase.client.HTable.get(HTable.java:445)
> at org.apache.hadoop.hbase.client.HTable.get(HTable.java:409)
> at HBaseThreadedGet.doWork(HBaseThreadedGet.java:45)
> at HBaseThreadedGet.main(HBaseThreadedGet.java:19)
> {code}
--
This message was sent by Atlassian JIRA
(v6.3.15#6346)
[jira] [Commented] (HBASE-17929) Add more options for PE tool
[ https://issues.apache.org/jira/browse/HBASE-17929?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15990441#comment-15990441 ] Hudson commented on HBASE-17929: ABORTED: Integrated in Jenkins build HBase-HBASE-14614 #190 (See [https://builds.apache.org/job/HBase-HBASE-14614/190/]) HBASE-17929 Add more options for PE tool (zhangduo: rev 3c32032f5ce935eedd2b6d471f20b030c857acbc) * (edit) hbase-server/src/test/java/org/apache/hadoop/hbase/PerformanceEvaluation.java HBASE-17929 addendum add scan read type option (zhangduo: rev 6e962d6f65eebaa8b41e58368aa171a7d4b2910b) * (edit) hbase-server/src/test/java/org/apache/hadoop/hbase/PerformanceEvaluation.java HBASE-17929 addendum fix typo and modify printUsage (zhangduo: rev 3acd8e4644c111560502ecc06e10d04dd204a06a) * (edit) hbase-server/src/test/java/org/apache/hadoop/hbase/PerformanceEvaluation.java > Add more options for PE tool > > > Key: HBASE-17929 > URL: https://issues.apache.org/jira/browse/HBASE-17929 > Project: HBase > Issue Type: Sub-task > Components: Performance, test >Affects Versions: 2.0.0 >Reporter: Duo Zhang >Assignee: Duo Zhang > Fix For: 2.0.0 > > Attachments: HBASE-17929-addendum.patch, > HBASE-17929-addendum-v1.patch, HBASE-17929.patch > > > For better evaluating scan performance. -- This message was sent by Atlassian JIRA (v6.3.15#6346)
[jira] [Commented] (HBASE-17366) Run TestHFile#testReaderWithoutBlockCache failes
[ https://issues.apache.org/jira/browse/HBASE-17366?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15990438#comment-15990438 ] Hudson commented on HBASE-17366: ABORTED: Integrated in Jenkins build HBase-HBASE-14614 #190 (See [https://builds.apache.org/job/HBase-HBASE-14614/190/]) HBASE-17366 Run TestHFile#testReaderWithoutBlockCache failes (chia7712: rev c1ac3f7739f8c9e20f6aed428558128339467d04) * (edit) hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/StoreFileWriter.java * (edit) hbase-server/src/test/java/org/apache/hadoop/hbase/io/hfile/TestHFile.java > Run TestHFile#testReaderWithoutBlockCache failes > > > Key: HBASE-17366 > URL: https://issues.apache.org/jira/browse/HBASE-17366 > Project: HBase > Issue Type: Bug > Components: test >Affects Versions: 2.0.0 >Reporter: huaxiang sun >Assignee: huaxiang sun >Priority: Trivial > Fix For: 2.0.0 > > Attachments: HBASE-17366-master-001.patch, > HBASE-17366-master-002.patch > > > Running TestHFile#testReaderWithoutBlockCache failes because cacheConf is not > initialized. -- This message was sent by Atlassian JIRA (v6.3.15#6346)
[jira] [Commented] (HBASE-17906) When a huge amount of data writing to hbase through thrift2, there will be a deadlock error.
[ https://issues.apache.org/jira/browse/HBASE-17906?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15990430#comment-15990430 ] Hudson commented on HBASE-17906: ABORTED: Integrated in Jenkins build HBase-HBASE-14614 #190 (See [https://builds.apache.org/job/HBase-HBASE-14614/190/]) HBASE-17906 When a huge amount of data writing to hbase through thrift2, (stack: rev 9dd5cda01747ffb91ac084792fa4a8670859e810) * (edit) hbase-thrift/src/main/java/org/apache/hadoop/hbase/thrift2/ThriftServer.java Revert "HBASE-17906 When a huge amount of data writing to hbase through (stack: rev 0cd4cec5d24b5e7194a903e4d900f5558ed8b9a7) * (edit) hbase-thrift/src/main/java/org/apache/hadoop/hbase/thrift2/ThriftServer.java > When a huge amount of data writing to hbase through thrift2, there will be a > deadlock error. > > > Key: HBASE-17906 > URL: https://issues.apache.org/jira/browse/HBASE-17906 > Project: HBase > Issue Type: Bug > Components: Client >Affects Versions: 0.98.21, 0.98.22, 0.98.23, 0.98.24, 0.98.25 > Environment: hadoop 2.5.2, hbase 0.98.20 jdk1.8.0_77 >Reporter: Albert Lee > Labels: patch > Fix For: 0.98.21, 0.98.22, 0.98.23, 0.98.24, 0.98.25 > > Attachments: HBASE-17906.branch-0.98.004.patch, > HBASE-17906.master.001.patch, HBASE-17906.master.002.patch, > hbase-thrift-17906-ForRecurr.zip > > > When a huge amount of data writing to hbase through thrift2, there will be a > deadlock error. -- This message was sent by Atlassian JIRA (v6.3.15#6346)
[jira] [Commented] (HBASE-15535) Correct link to Trafodion
[ https://issues.apache.org/jira/browse/HBASE-15535?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15990437#comment-15990437 ] Hudson commented on HBASE-15535: ABORTED: Integrated in Jenkins build HBase-HBASE-14614 #190 (See [https://builds.apache.org/job/HBase-HBASE-14614/190/]) HBASE-15535 Correct link to Trafodion (chia7712: rev 363f62751c760cc8056a2b1be40a410281e634f7) * (edit) src/main/asciidoc/_chapters/sql.adoc * (edit) src/main/site/xdoc/supportingprojects.xml > Correct link to Trafodion > - > > Key: HBASE-15535 > URL: https://issues.apache.org/jira/browse/HBASE-15535 > Project: HBase > Issue Type: Bug > Components: documentation >Affects Versions: 2.0.0 >Reporter: Atanu Mishra >Assignee: Gabor Liptak >Priority: Blocker > Fix For: 2.0.0 > > Attachments: HBASE-15535.1.patch, HBASE-15535.2.patch > > > Appendix F in the HBase Reference Guide available here > (https://hbase.apache.org/book.html#sql) has an incorrect link to the site > for Trafodion. > The new Trafodion URL is: http://trafodion.incubator.apache.org/ -- This message was sent by Atlassian JIRA (v6.3.15#6346)
[jira] [Commented] (HBASE-17930) Avoid using Canary.sniff in HBaseTestingUtility
[ https://issues.apache.org/jira/browse/HBASE-17930?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15990443#comment-15990443 ] Hudson commented on HBASE-17930: ABORTED: Integrated in Jenkins build HBase-HBASE-14614 #190 (See [https://builds.apache.org/job/HBase-HBASE-14614/190/]) HBASE-17930 Avoid using Canary.sniff in HBaseTestingUtility (zhangduo: rev 75d1e0361ac0f7e88ebb330f32b0e62cde997d0c) * (edit) hbase-server/src/main/java/org/apache/hadoop/hbase/tool/Canary.java * (edit) hbase-server/src/test/java/org/apache/hadoop/hbase/HBaseTestingUtility.java > Avoid using Canary.sniff in HBaseTestingUtility > --- > > Key: HBASE-17930 > URL: https://issues.apache.org/jira/browse/HBASE-17930 > Project: HBase > Issue Type: Bug > Components: canary, test >Affects Versions: 2.0.0, 1.4.0 >Reporter: Duo Zhang >Assignee: Duo Zhang > Labels: trivial > Fix For: 2.0.0, 1.4.0 > > Attachments: HBASE-17930.patch > > > It will make it easier to rewrite Canary with async client in the future. > And it is also very easy to write a simple sniff method for > HBaseTestingUtility. -- This message was sent by Atlassian JIRA (v6.3.15#6346)
[jira] [Commented] (HBASE-17888) Add generic methods for updating metrics on start and end of a procedure execution
[ https://issues.apache.org/jira/browse/HBASE-17888?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15990432#comment-15990432 ] Hudson commented on HBASE-17888: ABORTED: Integrated in Jenkins build HBase-HBASE-14614 #190 (See [https://builds.apache.org/job/HBase-HBASE-14614/190/]) HBASE-17888: Added generic methods for updating metrics on submit and (stack: rev c8461456d0ae81b90d67d36e1e077ae1d01102e5) * (edit) hbase-procedure/src/main/java/org/apache/hadoop/hbase/procedure2/Procedure.java * (edit) hbase-protocol-shaded/src/main/java/org/apache/hadoop/hbase/shaded/protobuf/generated/MasterProtos.java * (edit) hbase-protocol-shaded/src/main/protobuf/Procedure.proto * (edit) hbase-shell/src/main/ruby/shell/commands/list_procedures.rb * (edit) hbase-procedure/src/main/java/org/apache/hadoop/hbase/procedure2/ProcedureExecutor.java * (edit) hbase-procedure/src/main/java/org/apache/hadoop/hbase/procedure2/ProcedureUtil.java * (add) hbase-procedure/src/test/java/org/apache/hadoop/hbase/procedure2/TestProcedureMetrics.java * (edit) hbase-procedure/src/test/java/org/apache/hadoop/hbase/procedure2/TestStateMachineProcedure.java * (edit) hbase-server/src/main/java/org/apache/hadoop/hbase/master/MasterRpcServices.java * (edit) hbase-server/src/main/resources/hbase-webapps/master/procedures.jsp * (edit) hbase-client/src/main/java/org/apache/hadoop/hbase/client/HBaseAdmin.java * (edit) hbase-hadoop2-compat/src/main/java/org/apache/hadoop/hbase/master/MetricsAssignmentManagerSourceImpl.java * (edit) hbase-protocol-shaded/src/main/protobuf/Master.proto * (edit) hbase-server/src/main/java/org/apache/hadoop/hbase/master/procedure/ServerCrashProcedure.java * (edit) hbase-common/src/main/java/org/apache/hadoop/hbase/ProcedureInfo.java * (edit) hbase-protocol-shaded/src/main/java/org/apache/hadoop/hbase/shaded/protobuf/generated/ProcedureProtos.java * (edit) hbase-hadoop-compat/src/main/java/org/apache/hadoop/hbase/master/MetricsAssignmentManagerSource.java > Add generic methods for updating metrics on start and end of a procedure > execution > -- > > Key: HBASE-17888 > URL: https://issues.apache.org/jira/browse/HBASE-17888 > Project: HBase > Issue Type: Improvement > Components: proc-v2 >Reporter: Umesh Agashe >Assignee: Umesh Agashe > Fix For: 2.0.0 > > Attachments: HBASE-17888.v1.patch, HBASE-17888.v2.patch, > HBASE-17888.v3.patch, HBASE-17888.v3.patch > > > For all procedures in Procv2 framework, Procedure class can have generic > methods to update metrics on start and end of a procedure execution. Specific > procedure can override these and implement/ update respective metrics. > Default implementation needs to be provided so override and implementation is > optional. -- This message was sent by Atlassian JIRA (v6.3.15#6346)
[jira] [Commented] (HBASE-17897) StripeStoreFileManager#nonOpenRowCompare use the wrong comparison function
[
https://issues.apache.org/jira/browse/HBASE-17897?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15990428#comment-15990428
]
Hudson commented on HBASE-17897:
ABORTED: Integrated in Jenkins build HBase-HBASE-14614 #190 (See
[https://builds.apache.org/job/HBase-HBASE-14614/190/])
HBASE-17897 StripeStoreFileManager#nonOpenRowCompare use the wrong (chia7712:
rev cf3215d343d5c412735f51c68dc3686087736a86)
* (edit)
hbase-server/src/test/java/org/apache/hadoop/hbase/regionserver/TestStripeStoreFileManager.java
* (edit)
hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/StripeStoreFileManager.java
> StripeStoreFileManager#nonOpenRowCompare use the wrong comparison function
> --
>
> Key: HBASE-17897
> URL: https://issues.apache.org/jira/browse/HBASE-17897
> Project: HBase
> Issue Type: Sub-task
>Affects Versions: 2.0.0
>Reporter: Chia-Ping Tsai
>Assignee: Chia-Ping Tsai
> Fix For: 2.0.0
>
> Attachments: HBASE-17897.failed.patch, HBASE-17897.v0.patch,
> HBASE-17897.v0.patch, HBASE-17897.v0.patch
>
>
> {noformat}
> private final int nonOpenRowCompare(byte[] k1, byte[] k2) {
> assert !isOpen(k1) && !isOpen(k2);
> return cellComparator.compareRows(new KeyOnlyKeyValue(k1), k2, 0,
> k2.length);
> }
> {noformat}
> The inputs aren't KeyValue format, so it is wrong to use KeyOnlyKeyValue to
> parse the row.
--
This message was sent by Atlassian JIRA
(v6.3.15#6346)
[jira] [Commented] (HBASE-16775) Flakey test with TestExportSnapshot#testExportRetry and TestMobExportSnapshot#testExportRetry
[
https://issues.apache.org/jira/browse/HBASE-16775?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15990429#comment-15990429
]
Hudson commented on HBASE-16775:
ABORTED: Integrated in Jenkins build HBase-HBASE-14614 #190 (See
[https://builds.apache.org/job/HBase-HBASE-14614/190/])
HBASE-16775 Fix flaky TestExportSnapshot#testExportRetry. (appy: rev
da5fb27eabed4a4b4d251be973ee945fb52895bf)
* (edit)
hbase-server/src/test/java/org/apache/hadoop/hbase/snapshot/TestExportSnapshotNoCluster.java
* (edit)
hbase-server/src/test/java/org/apache/hadoop/hbase/snapshot/TestMobExportSnapshot.java
* (edit)
hbase-server/src/test/java/org/apache/hadoop/hbase/snapshot/TestMobSecureExportSnapshot.java
* (edit)
hbase-server/src/main/java/org/apache/hadoop/hbase/snapshot/ExportSnapshot.java
* (edit)
hbase-server/src/test/java/org/apache/hadoop/hbase/snapshot/TestExportSnapshot.java
* (edit)
hbase-server/src/test/java/org/apache/hadoop/hbase/snapshot/TestSecureExportSnapshot.java
> Flakey test with TestExportSnapshot#testExportRetry and
> TestMobExportSnapshot#testExportRetry
> --
>
> Key: HBASE-16775
> URL: https://issues.apache.org/jira/browse/HBASE-16775
> Project: HBase
> Issue Type: Bug
>Affects Versions: 2.0.0
>Reporter: huaxiang sun
>Assignee: Appy
> Attachments: disable.patch, HBASE-16775.master.001.patch,
> HBASE-16775.master.002.patch, HBASE-16775.master.003.patch,
> HBASE-16775.master.004.patch, HBASE-16775.master.005.patch,
> HBASE-16775.master.006.patch, HBASE-16775.master.007.patch
>
>
> The root cause is that conf.setInt("mapreduce.map.maxattempts", 10) is not
> taken by the mapper job, so the retry is actually 0. Debugging to see why
> this is the case.
--
This message was sent by Atlassian JIRA
(v6.3.15#6346)
[jira] [Commented] (HBASE-16438) Create a cell type so that chunk id is embedded in it
[ https://issues.apache.org/jira/browse/HBASE-16438?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15990440#comment-15990440 ] Hudson commented on HBASE-16438: ABORTED: Integrated in Jenkins build HBase-HBASE-14614 #190 (See [https://builds.apache.org/job/HBase-HBASE-14614/190/]) HBASE-16438 Create a cell type so that chunk id is embedded in it (Ram) (ramkrishna: rev c2c2178b2eebe4439eadec6b37fae2566944c16b) * (edit) hbase-server/src/test/java/org/apache/hadoop/hbase/coprocessor/TestCoprocessorInterface.java * (edit) hbase-server/src/test/java/org/apache/hadoop/hbase/regionserver/TestDefaultMemStore.java * (add) hbase-server/src/test/java/org/apache/hadoop/hbase/regionserver/TestMemstoreLABWithoutPool.java * (add) hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/ByteBufferChunkCell.java * (edit) hbase-common/src/main/java/org/apache/hadoop/hbase/ExtendedCell.java * (edit) hbase-server/src/test/java/org/apache/hadoop/hbase/regionserver/TestCellFlatSet.java * (edit) hbase-server/src/test/java/org/apache/hadoop/hbase/regionserver/TestStore.java * (edit) hbase-server/src/test/java/org/apache/hadoop/hbase/regionserver/TestFailedAppendAndSync.java * (edit) hbase-server/src/test/java/org/apache/hadoop/hbase/regionserver/TestWALLockup.java * (edit) hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/MemStoreLABImpl.java * (add) hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/ChunkCreator.java * (add) hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/NoTagByteBufferChunkCell.java * (edit) hbase-server/src/main/java/org/apache/hadoop/hbase/master/HMaster.java * (edit) hbase-server/src/test/java/org/apache/hadoop/hbase/regionserver/TestHRegionReplayEvents.java * (edit) hbase-server/src/test/java/org/apache/hadoop/hbase/io/hfile/TestScannerFromBucketCache.java * (edit) hbase-server/src/test/java/org/apache/hadoop/hbase/regionserver/TestWALMonotonicallyIncreasingSeqId.java * (edit) hbase-server/src/test/java/org/apache/hadoop/hbase/HBaseTestingUtility.java * (edit) hbase-server/src/test/java/org/apache/hadoop/hbase/regionserver/TestCompactingToCellArrayMapMemStore.java * (edit) hbase-server/src/test/java/org/apache/hadoop/hbase/regionserver/TestMemStoreLAB.java * (edit) hbase-server/src/test/java/org/apache/hadoop/hbase/coprocessor/TestRegionObserverScannerOpenHook.java * (edit) hbase-server/src/test/java/org/apache/hadoop/hbase/regionserver/TestBulkLoad.java * (edit) hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/HRegionServer.java * (edit) hbase-server/src/test/java/org/apache/hadoop/hbase/regionserver/TestHRegion.java * (edit) hbase-server/src/test/java/org/apache/hadoop/hbase/regionserver/TestCompactingMemStore.java * (edit) hbase-server/src/test/java/org/apache/hadoop/hbase/regionserver/TestRecoveredEdits.java * (edit) hbase-server/src/test/java/org/apache/hadoop/hbase/regionserver/TestStoreFileRefresherChore.java * (edit) hbase-server/src/test/java/org/apache/hadoop/hbase/regionserver/TestHMobStore.java * (edit) hbase-server/src/test/java/org/apache/hadoop/hbase/regionserver/TestCompactionArchiveConcurrentClose.java * (edit) hbase-server/src/test/java/org/apache/hadoop/hbase/regionserver/wal/TestDurability.java * (edit) hbase-server/src/test/java/org/apache/hadoop/hbase/regionserver/TestRegionIncrement.java * (edit) hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/Chunk.java * (edit) hbase-server/src/test/java/org/apache/hadoop/hbase/regionserver/TestCompactionArchiveIOException.java * (edit) hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/OffheapChunk.java * (edit) hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/OnheapChunk.java * (edit) hbase-server/src/test/java/org/apache/hadoop/hbase/master/TestCatalogJanitor.java * (edit) hbase-server/src/test/java/org/apache/hadoop/hbase/coprocessor/TestRegionObserverStacking.java * (delete) hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/MemStoreChunkPool.java * (edit) hbase-server/src/test/java/org/apache/hadoop/hbase/regionserver/TestMemStoreChunkPool.java * (edit) hbase-server/src/test/java/org/apache/hadoop/hbase/regionserver/TestCompactionPolicy.java * (edit) hbase-common/src/main/java/org/apache/hadoop/hbase/CellUtil.java * (edit) hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/MemStoreLAB.java Revert "HBASE-16438 Create a cell type so that chunk id is embedded in (ramkrishna: rev ecdfb82326035ad8221940919bbeb3fe16ec2658) * (edit) hbase-server/src/test/java/org/apache/hadoop/hbase/regionserver/TestMemStoreChunkPool.java * (edit) hbase-server/src/test/java/org/apache/hadoop/hbase/HBaseTestingUtility.java * (edit) hbase-server/src/test/java/org/apache/hadoop/hbase/regionserver/TestDefaultMemStore.java * (edit) hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/HRegionServer.java * (delete)
[jira] [Commented] (HBASE-16875) Changed try-with-resources in the docs to recommended way
[ https://issues.apache.org/jira/browse/HBASE-16875?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15990439#comment-15990439 ] Hudson commented on HBASE-16875: ABORTED: Integrated in Jenkins build HBase-HBASE-14614 #190 (See [https://builds.apache.org/job/HBase-HBASE-14614/190/]) HBASE-16875 Changed try-with-resources in the docs to recommended way (chia7712: rev c8cd921bededa67b2b0de823005830d750534d93) * (edit) src/main/asciidoc/_chapters/security.adoc * (edit) src/main/asciidoc/_chapters/architecture.adoc > Changed try-with-resources in the docs to recommended way > - > > Key: HBASE-16875 > URL: https://issues.apache.org/jira/browse/HBASE-16875 > Project: HBase > Issue Type: Bug > Components: documentation >Affects Versions: 2.0.0 >Reporter: Dima Spivak >Assignee: Jan Hentschel >Priority: Trivial > Labels: beginner > Fix For: 2.0.0 > > Attachments: HBASE-16875.master.001.patch, > HBASE-16875.master.002.patch, HBASE-16875.master.003.patch, > HBASE-16875.master.004.patch > > > In a > [number|https://github.com/apache/hbase/blame/bb3d9ccd489fb64e3cb2020583935a393382a678/src/main/asciidoc/_chapters/security.adoc#L205-L206] > > [of|https://github.com/apache/hbase/blame/bb3d9ccd489fb64e3cb2020583935a393382a678/src/main/asciidoc/_chapters/security.adoc#L1019-L1020] > > [places|https://github.com/apache/hbase/blame/bb3d9ccd489fb64e3cb2020583935a393382a678/src/main/asciidoc/_chapters/architecture.adoc#L222-L223], > we show examples that lend themselves to using Java 7's try-with-resources > statement, but we use the statement in a less-than-ideal nested way. Let's > change our docs throughout to do it [the recommended > way|https://docs.oracle.com/javase/tutorial/essential/exceptions/tryResourceClose.html]. -- This message was sent by Atlassian JIRA (v6.3.15#6346)
[jira] [Commented] (HBASE-6580) Deprecate HTablePool in favor of HConnection.getTable(...)
[ https://issues.apache.org/jira/browse/HBASE-6580?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15990436#comment-15990436 ] Hudson commented on HBASE-6580: --- ABORTED: Integrated in Jenkins build HBase-HBASE-14614 #190 (See [https://builds.apache.org/job/HBase-HBASE-14614/190/]) HBASE-17903 Corrected the alias for the link of HBASE-6580 (chia7712: rev 918aa4655c4109159f27b6d78460bd3681c11f06) * (edit) src/main/asciidoc/_chapters/architecture.adoc > Deprecate HTablePool in favor of HConnection.getTable(...) > -- > > Key: HBASE-6580 > URL: https://issues.apache.org/jira/browse/HBASE-6580 > Project: HBase > Issue Type: Improvement >Affects Versions: 0.94.6, 0.95.0 >Reporter: Lars Hofhansl >Assignee: Lars Hofhansl > Fix For: 0.98.0, 0.95.2, 0.94.11 > > Attachments: 6580-0.94.txt, 6580-0.94-v2.txt, 6580-trunk.txt, > 6580-trunk-v2.txt, 6580-trunk-v3.txt, 6580-trunk-v4.txt, 6580-trunk-v5.txt, > 6580-trunk-v6.txt, HBASE-6580_v1.patch, HBASE-6580_v2.patch > > > Update: > I now propose deprecating HTablePool and instead introduce a getTable method > on HConnection and allow HConnection to manage the ThreadPool. > Initial proposal: > Here I propose a very simple TablePool. > It could be called LightHTablePool (or something - if you have a better name). > Internally it would maintain an HConnection and an Executor service and each > invocation of getTable(...) would create a new HTable and close() would just > close it. > In testing I find this more light weight than HTablePool and easier to > monitor in terms of resources used. > It would hardly be more than a few dozen lines of code. -- This message was sent by Atlassian JIRA (v6.3.15#6346)
[jira] [Commented] (HBASE-17866) Implement async setQuota/getQuota methods.
[ https://issues.apache.org/jira/browse/HBASE-17866?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15990434#comment-15990434 ] Hudson commented on HBASE-17866: ABORTED: Integrated in Jenkins build HBase-HBASE-14614 #190 (See [https://builds.apache.org/job/HBase-HBASE-14614/190/]) HBASE-17866: Implement async setQuota/getQuota methods (zghao: rev 8db9760363890d4d0bfaba25ae6797d45aaf7fec) * (edit) hbase-client/src/main/java/org/apache/hadoop/hbase/quotas/QuotaTableUtil.java * (edit) hbase-client/src/main/java/org/apache/hadoop/hbase/quotas/QuotaRetriever.java * (edit) hbase-client/src/main/java/org/apache/hadoop/hbase/client/AsyncAdmin.java * (edit) hbase-client/src/main/java/org/apache/hadoop/hbase/client/AsyncHBaseAdmin.java * (add) hbase-server/src/test/java/org/apache/hadoop/hbase/client/TestAsyncQuotaAdminApi.java > Implement async setQuota/getQuota methods. > -- > > Key: HBASE-17866 > URL: https://issues.apache.org/jira/browse/HBASE-17866 > Project: HBase > Issue Type: Sub-task > Components: Client >Reporter: Zheng Hu >Assignee: Zheng Hu > Fix For: 2.0.0 > > Attachments: HBASE-17866.v1.patch, HBASE-17866.v2.patch > > -- This message was sent by Atlassian JIRA (v6.3.15#6346)
[jira] [Commented] (HBASE-17785) RSGroupBasedLoadBalancer fails to assign new table regions when cloning snapshot
[
https://issues.apache.org/jira/browse/HBASE-17785?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15990413#comment-15990413
]
Hudson commented on HBASE-17785:
ABORTED: Integrated in Jenkins build HBase-HBASE-14614 #190 (See
[https://builds.apache.org/job/HBase-HBASE-14614/190/])
HBASE-17785 RSGroupBasedLoadBalancer fails to assign new table regions
(apurtell: rev 029fa297129f7ced276d19c4877d19bf32dcfde0)
* (edit)
hbase-rsgroup/src/main/java/org/apache/hadoop/hbase/rsgroup/RSGroupAdminEndpoint.java
* (edit)
hbase-rsgroup/src/test/java/org/apache/hadoop/hbase/rsgroup/TestRSGroups.java
> RSGroupBasedLoadBalancer fails to assign new table regions when cloning
> snapshot
>
>
> Key: HBASE-17785
> URL: https://issues.apache.org/jira/browse/HBASE-17785
> Project: HBase
> Issue Type: Bug
>Reporter: Andrew Purtell
>Assignee: Andrew Purtell
> Fix For: 2.0.0
>
> Attachments: HBASE-17785.patch
>
>
> A novice starting out with RSGroupBasedLoadBalancer will want to enable it
> and, before assigning tables to groups, may want to create some test tables.
> Currently that does not work when creating a table by cloning a snapshot, in
> a surprising way. All regions of the table fail to open yet it is moved into
> ENABLED state. The client hangs indefinitely.
> {noformat}
> 2017-03-14 19:25:49,833 INFO [MASTER_TABLE_OPERATIONS-ip-172-31-5-95:8100-0]
> snapshot.CloneSnapshotHandler: Clone snapshot=seed on table=test_1 completed!
> 2017-03-14 19:25:49,871 INFO [MASTER_TABLE_OPERATIONS-ip-172-31-5-95:8100-0]
> hbase.MetaTableAccessor: Added 25
> 2017-03-14 19:25:49,875 WARN [MASTER_TABLE_OPERATIONS-ip-172-31-5-95:8100-0]
> rsgroup.RSGroupBasedLoadBalancer: Group for table test_1 is null
> 2017-03-14 19:25:49,875 WARN [MASTER_TABLE_OPERATIONS-ip-172-31-5-95:8100-0]
> rsgroup.RSGroupBasedLoadBalancer: Group for table test_1 is null
> 2017-03-14 19:25:49,875 WARN [MASTER_TABLE_OPERATIONS-ip-172-31-5-95:8100-0]
> rsgroup.RSGroupBasedLoadBalancer: Group for table test_1 is null
> 2017-03-14 19:25:49,875 WARN [MASTER_TABLE_OPERATIONS-ip-172-31-5-95:8100-0]
> rsgroup.RSGroupBasedLoadBalancer: Group for table test_1 is null
> 2017-03-14 19:25:49,875 WARN [MASTER_TABLE_OPERATIONS-ip-172-31-5-95:8100-0]
> rsgroup.RSGroupBasedLoadBalancer: Group for table test_1 is null
> 2017-03-14 19:25:49,875 WARN [MASTER_TABLE_OPERATIONS-ip-172-31-5-95:8100-0]
> rsgroup.RSGroupBasedLoadBalancer: Group for table test_1 is null
> 2017-03-14 19:25:49,875 WARN [MASTER_TABLE_OPERATIONS-ip-172-31-5-95:8100-0]
> rsgroup.RSGroupBasedLoadBalancer: Group for table test_1 is null
> 2017-03-14 19:25:49,875 WARN [MASTER_TABLE_OPERATIONS-ip-172-31-5-95:8100-0]
> rsgroup.RSGroupBasedLoadBalancer: Group for table test_1 is null
> 2017-03-14 19:25:49,875 WARN [MASTER_TABLE_OPERATIONS-ip-172-31-5-95:8100-0]
> rsgroup.RSGroupBasedLoadBalancer: Group for table test_1 is null
> 2017-03-14 19:25:49,875 WARN [MASTER_TABLE_OPERATIONS-ip-172-31-5-95:8100-0]
> rsgroup.RSGroupBasedLoadBalancer: Group for table test_1 is null
> 2017-03-14 19:25:49,875 WARN [MASTER_TABLE_OPERATIONS-ip-172-31-5-95:8100-0]
> rsgroup.RSGroupBasedLoadBalancer: Group for table test_1 is null
> 2017-03-14 19:25:49,875 WARN [MASTER_TABLE_OPERATIONS-ip-172-31-5-95:8100-0]
> rsgroup.RSGroupBasedLoadBalancer: Group for table test_1 is null
> 2017-03-14 19:25:49,875 WARN [MASTER_TABLE_OPERATIONS-ip-172-31-5-95:8100-0]
> rsgroup.RSGroupBasedLoadBalancer: Group for table test_1 is null
> 2017-03-14 19:25:49,875 WARN [MASTER_TABLE_OPERATIONS-ip-172-31-5-95:8100-0]
> rsgroup.RSGroupBasedLoadBalancer: Group for table test_1 is null
> 2017-03-14 19:25:49,875 WARN [MASTER_TABLE_OPERATIONS-ip-172-31-5-95:8100-0]
> rsgroup.RSGroupBasedLoadBalancer: Group for table test_1 is null
> 2017-03-14 19:25:49,875 WARN [MASTER_TABLE_OPERATIONS-ip-172-31-5-95:8100-0]
> rsgroup.RSGroupBasedLoadBalancer: Group for table test_1 is null
> 2017-03-14 19:25:49,875 WARN [MASTER_TABLE_OPERATIONS-ip-172-31-5-95:8100-0]
> rsgroup.RSGroupBasedLoadBalancer: Group for table test_1 is null
> 2017-03-14 19:25:49,875 WARN [MASTER_TABLE_OPERATIONS-ip-172-31-5-95:8100-0]
> rsgroup.RSGroupBasedLoadBalancer: Group for table test_1 is null
> 2017-03-14 19:25:49,875 WARN [MASTER_TABLE_OPERATIONS-ip-172-31-5-95:8100-0]
> rsgroup.RSGroupBasedLoadBalancer: Group for table test_1 is null
> 2017-03-14 19:25:49,875 WARN [MASTER_TABLE_OPERATIONS-ip-172-31-5-95:8100-0]
> rsgroup.RSGroupBasedLoadBalancer: Group for table test_1 is null
> 2017-03-14 19:25:49,875 WARN [MASTER_TABLE_OPERATIONS-ip-172-31-5-95:8100-0]
> rsgroup.RSGroupBasedLoadBalancer: Group for table test_1 is null
> 2017-03-14 19:25:49,875 WARN [MASTER_TABLE_OPERATIONS-ip-172-31-5-95:8100-0]
>
[jira] [Commented] (HBASE-17857) Remove IS annotations from IA.Public classes
[ https://issues.apache.org/jira/browse/HBASE-17857?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15990411#comment-15990411 ] Hudson commented on HBASE-17857: ABORTED: Integrated in Jenkins build HBase-HBASE-14614 #190 (See [https://builds.apache.org/job/HBase-HBASE-14614/190/]) HBASE-17857 Remove IS annotations from IA.Public classes (zhangduo: rev a66d491892514fd4a188d6ca87d6260d8ae46184) * (edit) hbase-server/src/main/java/org/apache/hadoop/hbase/mapreduce/CellCounter.java * (edit) hbase-server/src/main/java/org/apache/hadoop/hbase/mapreduce/IdentityTableMapper.java * (edit) hbase-client/src/main/java/org/apache/hadoop/hbase/quotas/QuotaSettingsFactory.java * (edit) hbase-client/src/main/java/org/apache/hadoop/hbase/filter/NullComparator.java * (edit) hbase-common/src/main/java/org/apache/hadoop/hbase/io/crypto/Decryptor.java * (edit) hbase-common/src/main/java/org/apache/hadoop/hbase/types/OrderedBytesBase.java * (edit) hbase-client/src/main/java/org/apache/hadoop/hbase/KeepDeletedCells.java * (edit) hbase-common/src/main/java/org/apache/hadoop/hbase/types/StructIterator.java * (edit) hbase-common/src/main/java/org/apache/hadoop/hbase/io/crypto/KeyProvider.java * (edit) hbase-client/src/main/java/org/apache/hadoop/hbase/client/Scan.java * (edit) hbase-client/src/main/java/org/apache/hadoop/hbase/client/TableBuilder.java * (edit) hbase-server/src/main/java/org/apache/hadoop/hbase/errorhandling/TimeoutException.java * (edit) hbase-client/src/main/java/org/apache/hadoop/hbase/client/security/SecurityCapability.java * (edit) hbase-server/src/main/java/org/apache/hadoop/hbase/mapreduce/MutationSerialization.java * (edit) hbase-client/src/main/java/org/apache/hadoop/hbase/filter/ColumnPaginationFilter.java * (edit) hbase-client/src/main/java/org/apache/hadoop/hbase/client/ConnectionFactory.java * (edit) hbase-client/src/main/java/org/apache/hadoop/hbase/TableNotEnabledException.java * (edit) hbase-server/src/main/java/org/apache/hadoop/hbase/security/visibility/ScanLabelGenerator.java * (edit) hbase-server/src/main/java/org/apache/hadoop/hbase/zookeeper/MiniZooKeeperCluster.java * (edit) hbase-client/src/main/java/org/apache/hadoop/hbase/client/Operation.java * (edit) hbase-common/src/main/java/org/apache/hadoop/hbase/ProcedureInfo.java * (edit) hbase-client/src/main/java/org/apache/hadoop/hbase/TableExistsException.java * (edit) hbase-client/src/main/java/org/apache/hadoop/hbase/filter/IncompatibleFilterException.java * (edit) hbase-server/src/main/java/org/apache/hadoop/hbase/mapreduce/GroupingTableMapper.java * (edit) hbase-client/src/main/java/org/apache/hadoop/hbase/filter/Filter.java * (edit) hbase-client/src/main/java/org/apache/hadoop/hbase/filter/ParseFilter.java * (edit) hbase-common/src/main/java/org/apache/hadoop/hbase/types/RawBytesTerminated.java * (edit) hbase-spark/src/main/scala/org/apache/hadoop/hbase/spark/HBaseContext.scala * (edit) hbase-rest/src/main/java/org/apache/hadoop/hbase/rest/client/RemoteAdmin.java * (edit) hbase-client/src/main/java/org/apache/hadoop/hbase/filter/RegexStringComparator.java * (edit) hbase-client/src/main/java/org/apache/hadoop/hbase/filter/WhileMatchFilter.java * (edit) hbase-client/src/main/java/org/apache/hadoop/hbase/client/RowMutations.java * (edit) hbase-client/src/main/java/org/apache/hadoop/hbase/client/SnapshotType.java * (edit) hbase-common/src/main/java/org/apache/hadoop/hbase/types/OrderedBlob.java * (edit) hbase-client/src/main/java/org/apache/hadoop/hbase/HRegionLocation.java * (edit) hbase-server/src/main/java/org/apache/hadoop/hbase/mapreduce/KeyValueSortReducer.java * (edit) hbase-client/src/main/java/org/apache/hadoop/hbase/ipc/UnsupportedCryptoException.java * (edit) hbase-client/src/main/java/org/apache/hadoop/hbase/client/NoServerForRegionException.java * (edit) hbase-server/src/main/java/org/apache/hadoop/hbase/mapred/TableInputFormat.java * (edit) hbase-client/src/main/java/org/apache/hadoop/hbase/security/visibility/Authorizations.java * (edit) hbase-client/src/main/java/org/apache/hadoop/hbase/quotas/QuotaType.java * (edit) hbase-spark/src/main/scala/org/apache/spark/sql/datasources/hbase/HBaseTableCatalog.scala * (edit) hbase-client/src/main/java/org/apache/hadoop/hbase/snapshot/UnknownSnapshotException.java * (edit) hbase-common/src/main/java/org/apache/hadoop/hbase/util/MD5Hash.java * (edit) hbase-spark/src/main/scala/org/apache/hadoop/hbase/spark/KeyFamilyQualifier.scala * (edit) hbase-client/src/main/java/org/apache/hadoop/hbase/coprocessor/BypassCoprocessorException.java * (edit) hbase-client/src/main/java/org/apache/hadoop/hbase/client/CompactionState.java * (edit) hbase-client/src/main/java/org/apache/hadoop/hbase/client/HTableMultiplexer.java * (edit) hbase-server/src/main/java/org/apache/hadoop/hbase/mapreduce/TableSplit.java * (edit) hbase-common/src/main/java/org/apache/hadoop/hbase/HBaseConfiguration.java *
[jira] [Commented] (HBASE-17863) Procedure V2: Proc Executor cleanup. Split FINISHED state to two states: SUCCESS and FAILED.
[ https://issues.apache.org/jira/browse/HBASE-17863?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15990417#comment-15990417 ] Hudson commented on HBASE-17863: ABORTED: Integrated in Jenkins build HBase-HBASE-14614 #190 (See [https://builds.apache.org/job/HBase-HBASE-14614/190/]) HBASE-17863: Procedure V2: Some cleanup around Procedure.isFinished() (stack: rev 9109803891e256f8c047af72572f07695e604a3f) * (edit) hbase-procedure/src/test/java/org/apache/hadoop/hbase/procedure2/store/wal/ProcedureWALLoaderPerformanceEvaluation.java * (edit) hbase-procedure/src/main/java/org/apache/hadoop/hbase/procedure2/Procedure.java * (edit) hbase-procedure/src/main/java/org/apache/hadoop/hbase/procedure2/ProcedureExecutor.java * (edit) hbase-protocol-shaded/src/main/protobuf/Procedure.proto * (edit) hbase-procedure/src/main/java/org/apache/hadoop/hbase/procedure2/store/wal/ProcedureWALFormatReader.java * (edit) hbase-common/src/main/java/org/apache/hadoop/hbase/ProcedureState.java * (edit) hbase-procedure/src/test/java/org/apache/hadoop/hbase/procedure2/ProcedureTestingUtility.java * (edit) hbase-server/src/test/java/org/apache/hadoop/hbase/master/procedure/TestProcedureAdmin.java * (edit) hbase-procedure/src/main/java/org/apache/hadoop/hbase/procedure2/ProcedureUtil.java * (edit) hbase-procedure/src/main/java/org/apache/hadoop/hbase/procedure2/store/ProcedureStore.java * (edit) hbase-protocol-shaded/src/main/java/org/apache/hadoop/hbase/shaded/protobuf/generated/ProcedureProtos.java HBASE-17863-addendum: Reverted the order of updateStoreOnExec() and (appy: rev 59e8b8e2ba4d403d042fe4cc02f8f9f80aad67af) * (edit) hbase-procedure/src/test/java/org/apache/hadoop/hbase/procedure2/ProcedureTestingUtility.java * (edit) hbase-procedure/src/test/java/org/apache/hadoop/hbase/procedure2/store/wal/TestWALProcedureStore.java * (edit) hbase-procedure/src/main/java/org/apache/hadoop/hbase/procedure2/ProcedureExecutor.java > Procedure V2: Proc Executor cleanup. Split FINISHED state to two states: > SUCCESS and FAILED. > - > > Key: HBASE-17863 > URL: https://issues.apache.org/jira/browse/HBASE-17863 > Project: HBase > Issue Type: Bug > Components: proc-v2 >Reporter: Umesh Agashe >Assignee: Umesh Agashe > Fix For: 2.0.0 > > Attachments: HBASE-17863-addendum.v1.patch, HBASE-17863.v1.patch, > HBASE-17863.v2.patch, HBASE-17863.v3.patch, HBASE-17863.v3.patch, > HBASE-17863.v4.patch, HBASE-17863.v4.patch > > > Clean up around isFinished() and procedure executor -- This message was sent by Atlassian JIRA (v6.3.15#6346)
[jira] [Commented] (HBASE-17816) HRegion#mutateRowWithLocks should update writeRequestCount metric
[ https://issues.apache.org/jira/browse/HBASE-17816?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15990419#comment-15990419 ] Hudson commented on HBASE-17816: ABORTED: Integrated in Jenkins build HBase-HBASE-14614 #190 (See [https://builds.apache.org/job/HBase-HBASE-14614/190/]) HBASE-17816 HRegion#mutateRowWithLocks should update writeRequestCount (jerryjch: rev 48b2502a5fcd4d3cd954c3abf6703422da7cdc2f) * (edit) hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/HRegion.java * (edit) hbase-server/src/test/java/org/apache/hadoop/hbase/regionserver/TestHRegion.java > HRegion#mutateRowWithLocks should update writeRequestCount metric > - > > Key: HBASE-17816 > URL: https://issues.apache.org/jira/browse/HBASE-17816 > Project: HBase > Issue Type: Bug > Components: metrics >Reporter: Ashu Pachauri >Assignee: Weizhan Zeng > Fix For: 2.0.0, 1.4.0 > > Attachments: HBASE-17816.branch-1.patch, > HBASE-17816.master.001.patch, HBASE-17816.master.002.patch > > > Currently, all the calls that use HRegion#mutateRowWithLocks miss > writeRequestCount metric. The mutateRowWithLocks base method should update > the metric. > Examples are checkAndMutate calls through RSRpcServices#multi, > Region#mutateRow api , MultiRowMutationProcessor coprocessor endpoint. -- This message was sent by Atlassian JIRA (v6.3.15#6346)
[jira] [Commented] (HBASE-17886) Fix compatibility of ServerSideScanMetrics
[
https://issues.apache.org/jira/browse/HBASE-17886?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15990415#comment-15990415
]
Hudson commented on HBASE-17886:
ABORTED: Integrated in Jenkins build HBase-HBASE-14614 #190 (See
[https://builds.apache.org/job/HBase-HBASE-14614/190/])
HBASE-17886 Fix compatibility of ServerSideScanMetrics (liyu: rev
d7e3116a1744057359ca48d94aa50d7fdf0db974)
* (edit)
hbase-client/src/main/java/org/apache/hadoop/hbase/client/metrics/ServerSideScanMetrics.java
> Fix compatibility of ServerSideScanMetrics
> --
>
> Key: HBASE-17886
> URL: https://issues.apache.org/jira/browse/HBASE-17886
> Project: HBase
> Issue Type: Bug
>Affects Versions: 2.0.0, 1.4.0, 1.3.1, 1.2.5
>Reporter: Yu Li
>Assignee: Yu Li
>Priority: Blocker
> Fix For: 2.0.0, 1.4.0, 1.3.1, 1.2.6
>
> Attachments: compatibility_check_1.3.1RC0.png, HBASE-17886.patch,
> HBASE-17886.v2.patch
>
>
> In HBASE-17716 we have changed the public field name in
> {{ServerSideScanMetrics}} which is IA.Public, which causes source
> compatibility issue, and we propose to fix it in this JIRA.
--
This message was sent by Atlassian JIRA
(v6.3.15#6346)
[jira] [Commented] (HBASE-16469) Several log refactoring/improvement suggestions
[
https://issues.apache.org/jira/browse/HBASE-16469?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15990424#comment-15990424
]
Hudson commented on HBASE-16469:
ABORTED: Integrated in Jenkins build HBase-HBASE-14614 #190 (See
[https://builds.apache.org/job/HBase-HBASE-14614/190/])
HBASE-16469 Several log refactoring/improvement suggestions (busbey: rev
0b5bd78d6e7c51a5c1b6b30a1f385eafcdba8f7b)
* (edit)
hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/HRegion.java
* (edit)
hbase-server/src/test/java/org/apache/hadoop/hbase/util/MultiThreadedUpdater.java
* (edit) hbase-it/src/test/java/org/apache/hadoop/hbase/HBaseClusterManager.java
* (edit)
hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/handler/CloseRegionHandler.java
* (edit)
hbase-client/src/main/java/org/apache/hadoop/hbase/client/PreemptiveFastFailInterceptor.java
> Several log refactoring/improvement suggestions
> ---
>
> Key: HBASE-16469
> URL: https://issues.apache.org/jira/browse/HBASE-16469
> Project: HBase
> Issue Type: Improvement
> Components: Operability
>Affects Versions: 1.2.5
>Reporter: Nemo Chen
>Assignee: Nemo Chen
> Labels: easyfix, easytest
> Fix For: 2.0.0, 1.4.0
>
> Attachments: HBASE-16469.master.001.patch
>
>
> *method invocation replaced by variable*
> hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/handler/CloseRegionHandler.java
> {code}String name = regionInfo.getRegionNameAsString();{code}
> {code}LOG.warn("Can't close region: was already closed during close(): " +
> regionInfo.getRegionNameAsString()); {code}
> In the above two examples, the method invocations are assigned to the
> variables before the logging code. These method invocations should be
> replaced by variables in case of simplicity and readability
>
> *method invocation in return statement*
> hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/HRegion.java
> {code}
> public String toString() {
> return getRegionInfo().getRegionNameAsString();
> }
> {code}
> {code}
> LOG.debug("Region " + getRegionInfo().getRegionNameAsString()
> + " is not mergeable because it is closing or closed");
> {code}
> {code}
> LOG.debug("Region " + getRegionInfo().getRegionNameAsString()
> + " is not mergeable because it has references");
> {code}
> {code}
> LOG.info("Running close preflush of " +
> getRegionInfo().getRegionNameAsString());
> {code}
> In these above examples, the "getRegionInfo().getRegionNameAsString())" is
> the return statement of method "toString" in the same class. They should be
> replaced with “this” in case of simplicity and readability.
>
> *check the logged variable if it is null*
> hbase-it/src/test/java/org/apache/hadoop/hbase/HBaseClusterManager.java
> {code}
> if ((sshUserName != null && sshUserName.length() > 0) ||
> (sshOptions != null && sshOptions.length() > 0)) {
> LOG.info("Running with SSH user [" + sshUserName + "] and options [" +
> sshOptions + "]");
> }
> {code}
> hbase-server/src/main/java/org/apache/hadoop/hbase/master/AssignmentManager.java
> {code}
> if ((regionState == null && latestState != null)
> || (regionState != null && latestState == null)
> || (regionState != null && latestState != null
> && latestState.getState() != regionState.getState())) {
> LOG.warn("Region state changed from " + regionState + " to "
> + latestState + ", while acquiring lock");
> }
> {code}
> In the above example, the logging variable could null at run time. It is a
> bad practice to include null variables inside logs.
>
> *variable in byte printed directly*
> hbase-server/src/test/java/org/apache/hadoop/hbase/util/MultiThreadedUpdater.java
> {code}
> byte[] rowKey = dataGenerator.getDeterministicUniqueKey(rowKeyBase);
> {code}
> {code}
> LOG.error("Failed to update the row with key = [" + rowKey
> + "], since we could not get the original row");
> {code}
> rowKey should be printed as Bytes.toString(rowKey).
>
> *object toString contain mi*
> The toString method returns getServerName(), so the "server.getServerName()"
> should be replaced with "server" in case of simplicity and readability.
> hbase-client/src/main/java/org/apache/hadoop/hbase/client/PreemptiveFastFailInterceptor.java
> {code}
> LOG.info("Clearing out PFFE for server " + server.getServerName());
> return getServerName();
> {code}
--
This message was sent by Atlassian JIRA
(v6.3.15#6346)
[jira] [Commented] (HBASE-17872) The MSLABImpl generates the invaild cells when unsafe is not availble
[
https://issues.apache.org/jira/browse/HBASE-17872?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15990422#comment-15990422
]
Hudson commented on HBASE-17872:
ABORTED: Integrated in Jenkins build HBase-HBASE-14614 #190 (See
[https://builds.apache.org/job/HBase-HBASE-14614/190/])
HBASE-17872 The MSLABImpl generates the invaild cells when unsafe is not
(chia7712: rev df96d328fb9fa11f04f84607e9a23f254f513202)
* (add)
hbase-server/src/test/java/org/apache/hadoop/hbase/util/TestFromClientSide3WoUnsafe.java
* (edit)
hbase-common/src/main/java/org/apache/hadoop/hbase/util/ByteBufferUtils.java
* (edit)
hbase-common/src/test/java/org/apache/hadoop/hbase/util/TestByteBufferUtils.java
> The MSLABImpl generates the invaild cells when unsafe is not availble
> -
>
> Key: HBASE-17872
> URL: https://issues.apache.org/jira/browse/HBASE-17872
> Project: HBase
> Issue Type: Sub-task
>Reporter: Chia-Ping Tsai
>Assignee: Chia-Ping Tsai
>Priority: Critical
> Fix For: 2.0.0
>
> Attachments: HBASE-17872.v0.patch, HBASE-17872.v1.patch,
> HBASE-17872.v2.patch, HBASE-17872.v3.patch, HBASE-17872.v4.patch
>
>
> We will get the wrong position of buffer in multithreaded environment, so the
> method makes the invalid cell in MSLAB.
> {noformat}
> public static int copyFromBufferToBuffer(ByteBuffer in, ByteBuffer out, int
> sourceOffset,
> int destinationOffset, int length) {
> if (in.hasArray() && out.hasArray()) {
> // ...
> } else if (UNSAFE_AVAIL) {
> // ...
> } else {
> int outOldPos = out.position();
> out.position(destinationOffset);
> ByteBuffer inDup = in.duplicate();
> inDup.position(sourceOffset).limit(sourceOffset + length);
> out.put(inDup);
> out.position(outOldPos);
> }
> return destinationOffset + length;
> }
> {noformat}
--
This message was sent by Atlassian JIRA
(v6.3.15#6346)
[jira] [Commented] (HBASE-17905) [hbase-spark] bulkload does not work when table not exist
[ https://issues.apache.org/jira/browse/HBASE-17905?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15990425#comment-15990425 ] Hudson commented on HBASE-17905: ABORTED: Integrated in Jenkins build HBase-HBASE-14614 #190 (See [https://builds.apache.org/job/HBase-HBASE-14614/190/]) HBASE-17905: [hbase-spark] bulkload does not work when table not exist (tedyu: rev 22f602cab5e9739a650fc962f4b08a0ccc51a972) * (edit) hbase-spark/src/main/scala/org/apache/hadoop/hbase/spark/BulkLoadPartitioner.scala * (edit) hbase-spark/src/main/scala/org/apache/hadoop/hbase/spark/HBaseContext.scala HBASE-17905: [hbase-spark] bulkload does not work when table not exist - (tedyu: rev 02da5a6104d413570472ae4621e44fa7e75c0ca6) * (edit) hbase-spark/src/main/scala/org/apache/hadoop/hbase/spark/BulkLoadPartitioner.scala * (edit) hbase-spark/src/main/scala/org/apache/hadoop/hbase/spark/HBaseContext.scala HBASE-17905 [hbase-spark] bulkload does not work when table not exist (tedyu: rev d7ddc79198679d8c642e7d8ad5141ba518f8d9f3) * (edit) hbase-spark/src/main/scala/org/apache/hadoop/hbase/spark/HBaseContext.scala * (edit) hbase-spark/src/main/scala/org/apache/hadoop/hbase/spark/BulkLoadPartitioner.scala > [hbase-spark] bulkload does not work when table not exist > -- > > Key: HBASE-17905 > URL: https://issues.apache.org/jira/browse/HBASE-17905 > Project: HBase > Issue Type: Bug >Reporter: Yi Liang >Assignee: Yi Liang > Fix For: 2.0.0 > > Attachments: HBASE-17905-V1.patch, HBASE-17905-V2.patch > > > when using HBase-Spark bulkload api, an argument of tablename is needed, the > bulkload can run successfully only if table exist in HBase. If table not > exist, the bulkload can not run successfully and it even do not report any > errors or throw exception. -- This message was sent by Atlassian JIRA (v6.3.15#6346)
[jira] [Commented] (HBASE-17871) scan#setBatch(int) call leads wrong result of VerifyReplication
[
https://issues.apache.org/jira/browse/HBASE-17871?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15990416#comment-15990416
]
Hudson commented on HBASE-17871:
ABORTED: Integrated in Jenkins build HBase-HBASE-14614 #190 (See
[https://builds.apache.org/job/HBase-HBASE-14614/190/])
HBASE-17871 scan#setBatch(int) call leads wrong result of (tedyu: rev
ec5188df3090d42088b6f4cb8f0c2fd49425f8c1)
* (edit)
hbase-server/src/main/java/org/apache/hadoop/hbase/mapreduce/replication/VerifyReplication.java
> scan#setBatch(int) call leads wrong result of VerifyReplication
> ---
>
> Key: HBASE-17871
> URL: https://issues.apache.org/jira/browse/HBASE-17871
> Project: HBase
> Issue Type: Bug
>Affects Versions: 2.0.0, 1.4.0
>Reporter: Tomu Tsuruhara
>Assignee: Tomu Tsuruhara
>Priority: Minor
> Fix For: 2.0.0, 1.4.0
>
> Attachments: after.png, beforethepatch.png,
> HBASE-17871.master.001.patch, HBASE-17871.master.002.patch,
> HBASE-17871.master.003.patch, HBASE-17871.master.003.patch,
> HBASE-17871.master.004.patch
>
>
> VerifyReplication tool printed weird logs.
> {noformat}
> 2017-04-03 23:30:50,252 ERROR [main]
> org.apache.hadoop.hbase.mapreduce.replication.VerifyReplication:
> CONTENT_DIFFERENT_ROWS, rowkey=a100193
> 2017-04-03 23:30:50,280 ERROR [main]
> org.apache.hadoop.hbase.mapreduce.replication.VerifyReplication:
> ONLY_IN_PEER_TABLE_ROWS, rowkey=a100193
> 2017-04-03 23:30:50,387 ERROR [main]
> org.apache.hadoop.hbase.mapreduce.replication.VerifyReplication:
> CONTENT_DIFFERENT_ROWS, rowkey=a100385
> 2017-04-03 23:30:50,414 ERROR [main]
> org.apache.hadoop.hbase.mapreduce.replication.VerifyReplication:
> ONLY_IN_PEER_TABLE_ROWS, rowkey=a100385
> 2017-04-03 23:30:50,480 ERROR [main]
> org.apache.hadoop.hbase.mapreduce.replication.VerifyReplication:
> CONTENT_DIFFERENT_ROWS, rowkey=a100532
> 2017-04-03 23:30:50,508 ERROR [main]
> org.apache.hadoop.hbase.mapreduce.replication.VerifyReplication:
> ONLY_IN_PEER_TABLE_ROWS, rowkey=a100532
> {noformat}
> Here, each bad rows were marked as both {{CONTENT_DIFFERENT_ROWS}} and
> {{ONLY_IN_PEER_TABLE_ROWS}}.
> This should never happen so I took a look at code and found scan.setBatch
> call.
> {code}
> @Override
> public void map(ImmutableBytesWritable row, final Result value,
> Context context)
> throws IOException {
> if (replicatedScanner == null) {
> ...
> final Scan scan = new Scan();
> scan.setBatch(batch);
> {code}
> As stated in HBASE-16376, {{scan#setBatch(int)}} call implicitly allows scan
> results to be partial.
> Since {{VerifyReplication}} is assuming each {{scanner.next()}} call returns
> entire row,
> partial results break compare logic.
> We should avoid setBatch call here.
> Thanks to RPC chunking (explained in this blog
> https://blogs.apache.org/hbase/entry/scan_improvements_in_hbase_1),
> it's safe and acceptable I think.
--
This message was sent by Atlassian JIRA
(v6.3.15#6346)
[jira] [Commented] (HBASE-16477) Remove Writable interface and related code from WALEdit/WALKey
[ https://issues.apache.org/jira/browse/HBASE-16477?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15990423#comment-15990423 ] Hudson commented on HBASE-16477: ABORTED: Integrated in Jenkins build HBase-HBASE-14614 #190 (See [https://builds.apache.org/job/HBase-HBASE-14614/190/]) HBASE-16477 Remove Writable interface and related code from (enis: rev 82d554e3783372cc6b05489452c815b57c06f6cd) * (edit) hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/wal/WALEdit.java * (delete) hbase-server/src/test/java/org/apache/hadoop/hbase/regionserver/wal/TestKeyValueCompression.java * (delete) hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/wal/KeyValueCompression.java * (edit) hbase-server/src/main/java/org/apache/hadoop/hbase/wal/WALKey.java * (edit) hbase-server/src/main/java/org/apache/hadoop/hbase/wal/WAL.java > Remove Writable interface and related code from WALEdit/WALKey > -- > > Key: HBASE-16477 > URL: https://issues.apache.org/jira/browse/HBASE-16477 > Project: HBase > Issue Type: Sub-task > Components: wal >Reporter: Enis Soztutar >Assignee: Enis Soztutar > Fix For: 2.0.0 > > Attachments: hbase-16477_v1.patch, hbase-16477-v2.patch > > > Writables are gone, and SequenceFile based WAL will be gone in parent. -- This message was sent by Atlassian JIRA (v6.3.15#6346)
[jira] [Commented] (HBASE-17869) UnsafeAvailChecker wrongly returns false on ppc
[ https://issues.apache.org/jira/browse/HBASE-17869?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15990418#comment-15990418 ] Hudson commented on HBASE-17869: ABORTED: Integrated in Jenkins build HBase-HBASE-14614 #190 (See [https://builds.apache.org/job/HBase-HBASE-14614/190/]) HBASE-17869 UnsafeAvailChecker wrongly returns false on ppc (jerryjch: rev af604f0c0cf3c40c56746150ffa860aad07f128a) * (edit) hbase-common/src/main/java/org/apache/hadoop/hbase/util/UnsafeAvailChecker.java > UnsafeAvailChecker wrongly returns false on ppc > --- > > Key: HBASE-17869 > URL: https://issues.apache.org/jira/browse/HBASE-17869 > Project: HBase > Issue Type: Bug >Affects Versions: 1.2.4 >Reporter: Jerry He >Assignee: Jerry He >Priority: Minor > Fix For: 2.0.0, 1.4.0 > > Attachments: HBASE-17869.patch > > > On ppc64 arch, java.nio.Bits.unaligned() wrongly returns false due to a JDK > bug. > https://bugs.openjdk.java.net/browse/JDK-8165231 > This causes some problem for HBase. i.e. FuzzyRowFilter test fails. > Fix it by providing a hard-code workaround for the JDK bug. -- This message was sent by Atlassian JIRA (v6.3.15#6346)
[jira] [Commented] (HBASE-17896) The FIXED_OVERHEAD of Segment is incorrect
[
https://issues.apache.org/jira/browse/HBASE-17896?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15990426#comment-15990426
]
Hudson commented on HBASE-17896:
ABORTED: Integrated in Jenkins build HBase-HBASE-14614 #190 (See
[https://builds.apache.org/job/HBase-HBASE-14614/190/])
HBASE-17896 The FIXED_OVERHEAD of Segment is incorrect (chia7712: rev
3aadc675b0f02c3c13be625b40d72fbf6a844964)
* (edit) hbase-server/src/test/java/org/apache/hadoop/hbase/io/TestHeapSize.java
* (edit)
hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/Segment.java
* (edit) hbase-common/src/main/java/org/apache/hadoop/hbase/util/ClassSize.java
> The FIXED_OVERHEAD of Segment is incorrect
> --
>
> Key: HBASE-17896
> URL: https://issues.apache.org/jira/browse/HBASE-17896
> Project: HBase
> Issue Type: Sub-task
>Affects Versions: 2.0.0
>Reporter: Chia-Ping Tsai
>Assignee: Chia-Ping Tsai
>Priority: Minor
> Fix For: 2.0.0
>
> Attachments: HBASE-17896.v0.patch, HBASE-17896.v1.patch
>
>
> {noformat}
> 5 * ClassSize.REFERENCE // cellSet, comparator, memStoreLAB, size,
> timeRangeTracker
> {noformat}
> In fact, the Segment has 6 references.
> # cellSet
> # comparator
> # memStoreLAB
> # dataSize
> # heapSize
> # timeRangeTracker
--
This message was sent by Atlassian JIRA
(v6.3.15#6346)
[jira] [Commented] (HBASE-17881) Remove the ByteBufferCellImpl
[ https://issues.apache.org/jira/browse/HBASE-17881?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15990421#comment-15990421 ] Hudson commented on HBASE-17881: ABORTED: Integrated in Jenkins build HBase-HBASE-14614 #190 (See [https://builds.apache.org/job/HBase-HBASE-14614/190/]) HBASE-17881 Remove the ByteBufferCellImpl (chia7712: rev 18c5ecf6ed57e80b32568ca1a1a12c7af36bab46) * (edit) hbase-client/src/test/java/org/apache/hadoop/hbase/filter/TestComparators.java * (edit) hbase-common/src/test/java/org/apache/hadoop/hbase/TestCellUtil.java * (edit) hbase-client/src/test/java/org/apache/hadoop/hbase/filter/TestKeyOnlyFilter.java * (edit) hbase-common/src/test/java/org/apache/hadoop/hbase/TestCellComparator.java * (edit) hbase-server/src/test/java/org/apache/hadoop/hbase/filter/TestSingleColumnValueFilter.java > Remove the ByteBufferCellImpl > - > > Key: HBASE-17881 > URL: https://issues.apache.org/jira/browse/HBASE-17881 > Project: HBase > Issue Type: Sub-task > Components: test >Affects Versions: 2.0.0 >Reporter: Chia-Ping Tsai >Assignee: Chia-Ping Tsai >Priority: Minor > Fix For: 2.0.0 > > Attachments: HBASE-17881.v0.patch > > > We should substitute ByteBufferKeyValue for ByteBufferCellImpl -- This message was sent by Atlassian JIRA (v6.3.15#6346)
[jira] [Commented] (HBASE-14141) HBase Backup/Restore Phase 3: Filter WALs on backup to include only edits from backed up tables
[
https://issues.apache.org/jira/browse/HBASE-14141?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15990410#comment-15990410
]
Hudson commented on HBASE-14141:
ABORTED: Integrated in Jenkins build HBase-HBASE-14614 #190 (See
[https://builds.apache.org/job/HBase-HBASE-14614/190/])
HBASE-14141 HBase Backup/Restore Phase 3: Filter WALs on backup to (tedyu: rev
910b68082c8f200f0ba6395a76b7ee1c8917e401)
* (edit)
hbase-server/src/main/java/org/apache/hadoop/hbase/backup/impl/IncrementalBackupManager.java
* (edit)
hbase-server/src/main/java/org/apache/hadoop/hbase/backup/impl/IncrementalTableBackupClient.java
* (edit)
hbase-server/src/main/java/org/apache/hadoop/hbase/mapreduce/WALPlayer.java
* (edit)
hbase-server/src/main/java/org/apache/hadoop/hbase/backup/util/RestoreTool.java
* (edit)
hbase-server/src/main/java/org/apache/hadoop/hbase/wal/AbstractFSWALProvider.java
* (edit)
hbase-server/src/main/java/org/apache/hadoop/hbase/backup/mapreduce/HFileSplitterJob.java
* (edit)
hbase-server/src/main/java/org/apache/hadoop/hbase/backup/impl/BackupManager.java
* (edit)
hbase-server/src/main/java/org/apache/hadoop/hbase/backup/impl/TableBackupClient.java
* (edit)
hbase-server/src/main/java/org/apache/hadoop/hbase/backup/mapreduce/MapReduceRestoreJob.java
* (edit)
hbase-server/src/main/java/org/apache/hadoop/hbase/mapreduce/WALInputFormat.java
* (edit)
hbase-server/src/main/java/org/apache/hadoop/hbase/backup/impl/RestoreTablesClient.java
> HBase Backup/Restore Phase 3: Filter WALs on backup to include only edits
> from backed up tables
> ---
>
> Key: HBASE-14141
> URL: https://issues.apache.org/jira/browse/HBASE-14141
> Project: HBase
> Issue Type: New Feature
>Reporter: Vladimir Rodionov
>Assignee: Vladimir Rodionov
>Priority: Blocker
> Labels: backup
> Fix For: 2.0.0
>
> Attachments: HBASE-14141.HBASE-14123.v1.patch, HBASE-14141.v1.patch,
> HBASE-14141.v2.patch, HBASE-14141.v4.patch, HBASE-14141.v5.patch,
> HBASE-14141.v6.patch
>
>
> h2. High level design overview
> * When incremental backup request comes for tables {t} we select all the
> tables already registered in a backup system - {T} and union them with {t},
> which results in a new table set - U(t, T)
> * For every table K from U(t,T) we perform the following:
> ** Convert new WAL files into HFile applying table filter K (only edits for
> table T will pass the filter)
> ** Move these HFile(s) to backup destination
> During restore (incremental):
> * We run full restore first
> * Then collect all HFiles from intermediate incremental images and run them
> through HFileSplitterJob, which splits files into a current tables region
> boundaries
> * Load these files using LoadIncrementalHFiles tool
>
--
This message was sent by Atlassian JIRA
(v6.3.15#6346)
[jira] [Commented] (HBASE-17854) Use StealJobQueue in HFileCleaner after HBASE-17215
[
https://issues.apache.org/jira/browse/HBASE-17854?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15990412#comment-15990412
]
Hudson commented on HBASE-17854:
ABORTED: Integrated in Jenkins build HBase-HBASE-14614 #190 (See
[https://builds.apache.org/job/HBase-HBASE-14614/190/])
HBASE-17854 Use StealJobQueue in HFileCleaner after HBASE-17215 (liyu: rev
cbcbcf4dcd3401327cc36173f3ca8e5362da1e0c)
* (edit)
hbase-server/src/main/java/org/apache/hadoop/hbase/util/StealJobQueue.java
* (edit)
hbase-server/src/test/java/org/apache/hadoop/hbase/util/TestStealJobQueue.java
* (edit)
hbase-server/src/test/java/org/apache/hadoop/hbase/master/cleaner/TestHFileCleaner.java
* (edit)
hbase-server/src/main/java/org/apache/hadoop/hbase/master/cleaner/HFileCleaner.java
> Use StealJobQueue in HFileCleaner after HBASE-17215
> ---
>
> Key: HBASE-17854
> URL: https://issues.apache.org/jira/browse/HBASE-17854
> Project: HBase
> Issue Type: Improvement
>Affects Versions: 2.0.0
>Reporter: Yu Li
>Assignee: Yu Li
> Fix For: 2.0.0
>
> Attachments: HBASE-17854.patch, HBASE-17854.v2.patch,
> HBASE-17854.v3.patch, HBASE-17854.v4.patch, HBASE-17854.v5.patch,
> HBASE-17854.v5.patch
>
>
> In HBASE-17215 we use specific threads for deleting large/small (archived)
> hfiles, and will improve it from below aspects in this JIRA:
> 1. Using {{StealJobQueue}} to allow large file deletion thread to steal jobs
> from small queue, based on the experience that in real world there'll be much
> more small hfiles
> 2. {{StealJobQueue}} is a kind of {{PriorityQueue}}, so we could also delete
> from the larger file in the queues.
--
This message was sent by Atlassian JIRA
(v6.3.15#6346)
[jira] [Commented] (HBASE-17836) CellUtil#estimatedSerializedSizeOf is slow when input is ByteBufferCell
[ https://issues.apache.org/jira/browse/HBASE-17836?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15990420#comment-15990420 ] Hudson commented on HBASE-17836: ABORTED: Integrated in Jenkins build HBase-HBASE-14614 #190 (See [https://builds.apache.org/job/HBase-HBASE-14614/190/]) HBASE-17836 CellUtil#estimatedSerializedSizeOf is slow when input is (chia7712: rev 1a701ce44484f45a8a07ea9826b84f0df6f1518e) * (edit) hbase-server/src/main/java/org/apache/hadoop/hbase/SplitLogTask.java * (edit) hbase-common/src/main/java/org/apache/hadoop/hbase/CellUtil.java > CellUtil#estimatedSerializedSizeOf is slow when input is ByteBufferCell > --- > > Key: HBASE-17836 > URL: https://issues.apache.org/jira/browse/HBASE-17836 > Project: HBase > Issue Type: Improvement >Affects Versions: 2.0.0 >Reporter: Chia-Ping Tsai >Assignee: Chia-Ping Tsai >Priority: Minor > Fix For: 2.0.0 > > Attachments: HBASE-17836.v0.patch, HBASE-17836.v1.patch > > > We call CellUtil#estimatedSerializedSize to calculate the size of rows when > scanning. If the input is ByteBufferCell, the > CellUtil#estimatedSerializedSizeOf parses many length components to get the > qualifierLength stored in the backing buffer. > We should consider using the KeyValueUtil#getSerializedSize. -- This message was sent by Atlassian JIRA (v6.3.15#6346)
[jira] [Commented] (HBASE-17858) Update refguide about the IS annotation if necessary
[ https://issues.apache.org/jira/browse/HBASE-17858?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15990414#comment-15990414 ] Hudson commented on HBASE-17858: ABORTED: Integrated in Jenkins build HBase-HBASE-14614 #190 (See [https://builds.apache.org/job/HBase-HBASE-14614/190/]) HBASE-17858 Update refguide about the IS annotation if necessary (zhangduo: rev 17737b2710a2a1271eb791478eb99f7a573ecac1) * (edit) src/main/asciidoc/_chapters/upgrading.adoc > Update refguide about the IS annotation if necessary > > > Key: HBASE-17858 > URL: https://issues.apache.org/jira/browse/HBASE-17858 > Project: HBase > Issue Type: Sub-task > Components: API, documentation >Affects Versions: 2.0.0 >Reporter: Duo Zhang >Assignee: Duo Zhang > Fix For: 2.0.0 > > Attachments: HBASE-17858.patch > > -- This message was sent by Atlassian JIRA (v6.3.15#6346)
[jira] [Commented] (HBASE-17895) TestAsyncProcess#testAction fails if unsafe support is false
[
https://issues.apache.org/jira/browse/HBASE-17895?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15990427#comment-15990427
]
Hudson commented on HBASE-17895:
ABORTED: Integrated in Jenkins build HBase-HBASE-14614 #190 (See
[https://builds.apache.org/job/HBase-HBASE-14614/190/])
HBASE-17895 TestAsyncProcess#testAction fails if unsafe support is false
(chia7712: rev 23249eb0f5466b3608d80847b398b38b698fcf95)
* (edit)
hbase-client/src/test/java/org/apache/hadoop/hbase/client/TestAsyncProcess.java
> TestAsyncProcess#testAction fails if unsafe support is false
>
>
> Key: HBASE-17895
> URL: https://issues.apache.org/jira/browse/HBASE-17895
> Project: HBase
> Issue Type: Sub-task
> Components: test
>Affects Versions: 2.0.0
>Reporter: Chia-Ping Tsai
>Assignee: Wen-Hsiu,Chang
>Priority: Trivial
> Labels: beginner
> Fix For: 2.0.0
>
> Attachments: HBASE-17895-v0.patch, HBASE-17895-v1.patch
>
>
> {noformat}
> assertEquals(-1, action_0.compareTo(action_1));
> assertEquals(1, action_1.compareTo(action_0));
> {noformat}
> The correction is shown below.
> {noformat}
> assertTrue(action_0.compareTo(action_1) < 0);
> assertTrue(action_1.compareTo(action_0) > 0);
> {noformat}
--
This message was sent by Atlassian JIRA
(v6.3.15#6346)
[jira] [Commented] (HBASE-17668) Implement async assgin/offline/move/unassign methods
[ https://issues.apache.org/jira/browse/HBASE-17668?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15990407#comment-15990407 ] Hudson commented on HBASE-17668: ABORTED: Integrated in Jenkins build HBase-HBASE-14614 #190 (See [https://builds.apache.org/job/HBase-HBASE-14614/190/]) HBASE-17668: Implement async assgin/offline/move/unassign methods (zhangduo: rev 5f98ad2053ddc31e0abc6863478db594e4447cf8) * (edit) hbase-client/src/main/java/org/apache/hadoop/hbase/client/AsyncAdmin.java * (edit) hbase-server/src/test/java/org/apache/hadoop/hbase/client/TestAsyncRegionAdminApi.java * (edit) hbase-client/src/main/java/org/apache/hadoop/hbase/client/AsyncHBaseAdmin.java * (edit) hbase-server/src/test/java/org/apache/hadoop/hbase/client/TestAsyncAdminBase.java > Implement async assgin/offline/move/unassign methods > > > Key: HBASE-17668 > URL: https://issues.apache.org/jira/browse/HBASE-17668 > Project: HBase > Issue Type: Sub-task > Components: Admin, asyncclient, Client >Affects Versions: 2.0.0 >Reporter: Zheng Hu >Assignee: Zheng Hu > Fix For: 2.0.0 > > Attachments: HBASE-17668.v1.patch, HBASE-17668.v1.patch, > HBASE-17668.v2.patch, HBASE-17668.v3.patch, HBASE-17668.v4.patch > > > Implement following methods for async admin client: > 1. assign region; > 2. unassign region; > 3. offline region; > 4. move region; -- This message was sent by Atlassian JIRA (v6.3.15#6346)
[jira] [Commented] (HBASE-16755) Honor flush policy under global memstore pressure
[ https://issues.apache.org/jira/browse/HBASE-16755?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15990395#comment-15990395 ] Hudson commented on HBASE-16755: ABORTED: Integrated in Jenkins build HBase-HBASE-14614 #190 (See [https://builds.apache.org/job/HBase-HBASE-14614/190/]) HBASE-16755 Honor flush policy under global memstore pressure (garyh: rev 4b62a52ebcf401d872e6872cf25bdb4556758983) * (edit) hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/MemStoreFlusher.java > Honor flush policy under global memstore pressure > - > > Key: HBASE-16755 > URL: https://issues.apache.org/jira/browse/HBASE-16755 > Project: HBase > Issue Type: Improvement > Components: regionserver >Reporter: Ashu Pachauri >Assignee: Ashu Pachauri > Fix For: 1.3.1 > > Attachments: HBASE-16755.v0.patch > > > When global memstore reaches the low water mark, we pick the best flushable > region and flush all column families for it. This is a suboptimal approach in > the sense that it leads to an unnecessarily high file creation rate and IO > amplification due to compactions. We should still try to honor the underlying > FlushPolicy. -- This message was sent by Atlassian JIRA (v6.3.15#6346)
[jira] [Commented] (HBASE-14614) Procedure v2: Core Assignment Manager
[ https://issues.apache.org/jira/browse/HBASE-14614?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15990402#comment-15990402 ] Hudson commented on HBASE-14614: ABORTED: Integrated in Jenkins build HBase-HBASE-14614 #190 (See [https://builds.apache.org/job/HBase-HBASE-14614/190/]) HBASE-17844 Subset of HBASE-14614, Procedure v2: Core Assignment Manager (stack: rev d033cbb715aa6153c4b764ef6638b7a1cecee64e) * (edit) hbase-procedure/src/test/java/org/apache/hadoop/hbase/procedure2/util/TestDelayedUtil.java * (edit) hbase-server/src/main/java/org/apache/hadoop/hbase/ipc/SimpleRpcScheduler.java * (edit) hbase-server/src/main/java/org/apache/hadoop/hbase/master/LoadBalancer.java * (edit) hbase-procedure/src/main/java/org/apache/hadoop/hbase/procedure2/LockAndQueue.java * (edit) hbase-rsgroup/src/main/java/org/apache/hadoop/hbase/rsgroup/RSGroupBasedLoadBalancer.java * (edit) hbase-client/src/main/java/org/apache/hadoop/hbase/master/RegionState.java * (edit) hbase-procedure/src/test/java/org/apache/hadoop/hbase/procedure2/ProcedureTestingUtility.java * (edit) hbase-client/src/main/java/org/apache/hadoop/hbase/ipc/AbstractRpcClient.java * (edit) hbase-server/src/test/java/org/apache/hadoop/hbase/master/locking/TestLockProcedure.java * (edit) hbase-procedure/src/main/java/org/apache/hadoop/hbase/procedure2/StateMachineProcedure.java * (edit) hbase-procedure/src/main/java/org/apache/hadoop/hbase/procedure2/ProcedureEvent.java * (edit) hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/handler/OpenRegionHandler.java * (edit) hbase-server/src/main/java/org/apache/hadoop/hbase/master/procedure/CreateNamespaceProcedure.java * (edit) hbase-procedure/src/main/java/org/apache/hadoop/hbase/procedure2/util/DelayedUtil.java * (edit) hbase-client/src/main/java/org/apache/hadoop/hbase/shaded/protobuf/ProtobufUtil.java * (edit) hbase-common/src/main/java/org/apache/hadoop/hbase/HConstants.java * (edit) hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/throttle/PressureAwareCompactionThroughputController.java * (edit) hbase-client/src/main/java/org/apache/hadoop/hbase/ipc/ServerTooBusyException.java * (edit) hbase-procedure/src/main/java/org/apache/hadoop/hbase/procedure2/Procedure.java * (edit) hbase-procedure/src/main/java/org/apache/hadoop/hbase/procedure2/ProcedureScheduler.java * (edit) hbase-client/src/main/java/org/apache/hadoop/hbase/MetaTableAccessor.java * (edit) hbase-server/src/main/java/org/apache/hadoop/hbase/master/balancer/StochasticLoadBalancer.java * (edit) hbase-server/src/main/java/org/apache/hadoop/hbase/master/procedure/MasterProcedureScheduler.java * (edit) hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/HStore.java * (edit) hbase-server/src/test/java/org/apache/hadoop/hbase/io/encoding/TestChangingEncoding.java * (edit) hbase-client/src/main/java/org/apache/hadoop/hbase/ClusterStatus.java * (edit) hbase-server/src/test/java/org/apache/hadoop/hbase/regionserver/wal/TestAsyncLogRolling.java * (edit) hbase-server/src/test/java/org/apache/hadoop/hbase/ipc/TestSimpleRpcScheduler.java * (edit) hbase-client/src/main/java/org/apache/hadoop/hbase/protobuf/ProtobufUtil.java * (edit) hbase-server/src/main/java/org/apache/hadoop/hbase/master/MasterWalManager.java * (edit) hbase-server/src/test/java/org/apache/hadoop/hbase/client/TestMetaWithReplicas.java * (edit) hbase-common/src/main/java/org/apache/hadoop/hbase/TableName.java * (edit) hbase-server/src/main/java/org/apache/hadoop/hbase/ipc/SimpleRpcServer.java * (edit) hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/HRegion.java * (edit) hbase-procedure/src/main/java/org/apache/hadoop/hbase/procedure2/ProcedureExecutor.java * (edit) hbase-server/src/main/java/org/apache/hadoop/hbase/master/RegionStates.java * (edit) hbase-procedure/src/main/java/org/apache/hadoop/hbase/procedure2/AbstractProcedureScheduler.java * (edit) hbase-server/src/main/java/org/apache/hadoop/hbase/ipc/BalancedQueueRpcExecutor.java * (edit) hbase-server/src/test/java/org/apache/hadoop/hbase/TestStochasticBalancerJmxMetrics.java * (edit) hbase-server/src/test/java/org/apache/hadoop/hbase/regionserver/wal/AbstractTestWALReplay.java * (edit) hbase-common/src/main/java/org/apache/hadoop/hbase/ChoreService.java * (edit) hbase-server/src/main/java/org/apache/hadoop/hbase/master/locking/LockProcedure.java * (edit) hbase-server/src/main/java/org/apache/hadoop/hbase/master/procedure/AbstractStateMachineTableProcedure.java * (edit) hbase-server/src/main/java/org/apache/hadoop/hbase/wal/WALSplitter.java HBASE-14614 Procedure v2 - Core Assignment Manager (Matteo Bertozzi) (stack: rev ccbc9ec2774a76d9c6990f1a701aebc1d6d61323) > Procedure v2: Core Assignment Manager > - > > Key: HBASE-14614 > URL: https://issues.apache.org/jira/browse/HBASE-14614 > Project: HBase >
[jira] [Commented] (HBASE-17847) update documentation to include positions on recent Hadoop releases
[ https://issues.apache.org/jira/browse/HBASE-17847?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15990399#comment-15990399 ] Hudson commented on HBASE-17847: ABORTED: Integrated in Jenkins build HBase-HBASE-14614 #190 (See [https://builds.apache.org/job/HBase-HBASE-14614/190/]) HBASE-17847 update docs to cover guidance on recent Hadoop releases. (busbey: rev b290d14e1f7fffa3c06bb19770b53094c3d2459a) * (edit) src/main/asciidoc/_chapters/configuration.adoc > update documentation to include positions on recent Hadoop releases > --- > > Key: HBASE-17847 > URL: https://issues.apache.org/jira/browse/HBASE-17847 > Project: HBase > Issue Type: Task > Components: community, documentation >Affects Versions: 2.0.0 >Reporter: Sean Busbey >Assignee: Sean Busbey >Priority: Critical > Fix For: 2.0.0 > > Attachments: HBASE-17847.0.patch, HBASE-17847.1.patch > > > [per dev@hbase discussion on how to handle the most recent round of Hadoop > releases|https://lists.apache.org/thread.html/bb5591e3260f4e70d40c1f9cb30aa98d018fc145ab3aef8b3f6a4f5d@%3Cdev.hbase.apache.org%3E], > get our docs updated. -- This message was sent by Atlassian JIRA (v6.3.15#6346)
[jira] [Commented] (HBASE-13395) Remove HTableInterface
[ https://issues.apache.org/jira/browse/HBASE-13395?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15990393#comment-15990393 ] Hudson commented on HBASE-13395: ABORTED: Integrated in Jenkins build HBase-HBASE-14614 #190 (See [https://builds.apache.org/job/HBase-HBASE-14614/190/]) HBASE-13395 Removed HTableInterface (chia7712: rev 50e9825139d9abfd280eb7a930c8c6a96e9e68a6) * (edit) src/main/asciidoc/_chapters/cp.adoc * (edit) src/main/asciidoc/_chapters/architecture.adoc * (edit) hbase-client/src/main/java/org/apache/hadoop/hbase/client/ConnectionImplementation.java * (edit) src/main/asciidoc/_chapters/unit_testing.adoc * (delete) hbase-client/src/main/java/org/apache/hadoop/hbase/client/HTableInterface.java > Remove HTableInterface > -- > > Key: HBASE-13395 > URL: https://issues.apache.org/jira/browse/HBASE-13395 > Project: HBase > Issue Type: Sub-task > Components: API >Affects Versions: 2.0.0 >Reporter: Mikhail Antonov >Assignee: Jan Hentschel > Fix For: 2.0.0 > > Attachments: HBASE-13395.master.001.patch, > HBASE-13395.master.002.patch, HBASE-13395.master.003.patch, > HBASE-13395.master.004.patch > > > This class is marked as deprecated, probably can remove it, and if any > methods from this specific class are in active use, need to decide what to do > on callers' side. Should be able to replace with just Table interface usage. -- This message was sent by Atlassian JIRA (v6.3.15#6346)
[jira] [Commented] (HBASE-16780) Since move to protobuf3.1, Cells are limited to 64MB where previous they had no limit
[ https://issues.apache.org/jira/browse/HBASE-16780?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15990405#comment-15990405 ] Hudson commented on HBASE-16780: ABORTED: Integrated in Jenkins build HBase-HBASE-14614 #190 (See [https://builds.apache.org/job/HBase-HBASE-14614/190/]) HBASE-16780 Since move to protobuf3.1, Cells are limited to 64MB where (stack: rev 7700a7fac1262934fe538a96b040793c6ff171ce) * (edit) hbase-protocol-shaded/pom.xml * (edit) hbase-server/pom.xml HBASE-16780 Since move to protobuf3.1, Cells are limited to 64MB where (stack: rev e916b79db58bb9be806a833b2c0e675f1136c15a) * (edit) hbase-protocol-shaded/src/main/java/org/apache/hadoop/hbase/shaded/com/google/protobuf/ByteBufferWriter.java * (edit) hbase-protocol-shaded/src/main/java/org/apache/hadoop/hbase/shaded/com/google/protobuf/DoubleValue.java * (edit) hbase-protocol-shaded/src/main/java/org/apache/hadoop/hbase/shaded/protobuf/generated/ClusterStatusProtos.java * (edit) hbase-protocol-shaded/src/main/java/org/apache/hadoop/hbase/shaded/com/google/protobuf/EnumOrBuilder.java * (edit) hbase-protocol-shaded/src/main/java/org/apache/hadoop/hbase/shaded/com/google/protobuf/compiler/PluginProtos.java * (edit) hbase-protocol-shaded/src/main/java/org/apache/hadoop/hbase/shaded/com/google/protobuf/UnknownFieldSet.java * (edit) hbase-protocol-shaded/src/main/java/org/apache/hadoop/hbase/shaded/ipc/protobuf/generated/TestProcedureProtos.java * (edit) hbase-protocol-shaded/src/main/java/org/apache/hadoop/hbase/shaded/com/google/protobuf/GeneratedMessageV3.java * (edit) hbase-protocol-shaded/src/main/java/org/apache/hadoop/hbase/shaded/protobuf/generated/AdminProtos.java * (edit) hbase-protocol-shaded/src/main/java/org/apache/hadoop/hbase/shaded/protobuf/generated/WALProtos.java * (edit) hbase-protocol-shaded/src/main/java/org/apache/hadoop/hbase/shaded/com/google/protobuf/ExtensionRegistryLite.java * (edit) hbase-protocol-shaded/src/main/java/org/apache/hadoop/hbase/shaded/com/google/protobuf/LazyFieldLite.java * (edit) hbase-protocol-shaded/src/main/java/org/apache/hadoop/hbase/shaded/com/google/protobuf/FloatValueOrBuilder.java * (edit) hbase-protocol-shaded/src/main/java/org/apache/hadoop/hbase/shaded/com/google/protobuf/ListValue.java * (edit) hbase-protocol-shaded/src/main/java/org/apache/hadoop/hbase/shaded/com/google/protobuf/Type.java * (edit) hbase-protocol-shaded/src/main/java/org/apache/hadoop/hbase/shaded/com/google/protobuf/Value.java * (edit) hbase-protocol-shaded/src/main/java/org/apache/hadoop/hbase/shaded/com/google/protobuf/Duration.java * (edit) hbase-protocol-shaded/src/main/java/org/apache/hadoop/hbase/shaded/protobuf/generated/RegionNormalizerProtos.java * (edit) hbase-protocol-shaded/src/main/java/org/apache/hadoop/hbase/shaded/com/google/protobuf/UnknownFieldSetLite.java * (edit) hbase-protocol-shaded/src/main/java/org/apache/hadoop/hbase/shaded/protobuf/generated/SnapshotProtos.java * (edit) hbase-protocol-shaded/src/main/java/org/apache/hadoop/hbase/shaded/com/google/protobuf/FieldSet.java * (edit) hbase-protocol-shaded/src/main/java/org/apache/hadoop/hbase/shaded/com/google/protobuf/MapFieldLite.java * (edit) hbase-protocol-shaded/src/main/java/org/apache/hadoop/hbase/shaded/com/google/protobuf/Int32ValueOrBuilder.java * (edit) hbase-protocol-shaded/src/main/java/org/apache/hadoop/hbase/shaded/com/google/protobuf/MethodOrBuilder.java * (edit) hbase-protocol-shaded/src/main/java/org/apache/hadoop/hbase/shaded/com/google/protobuf/DurationOrBuilder.java * (edit) hbase-protocol-shaded/src/main/java/org/apache/hadoop/hbase/shaded/protobuf/generated/ClientProtos.java * (edit) hbase-protocol-shaded/src/main/java/org/apache/hadoop/hbase/shaded/protobuf/generated/FSProtos.java * (edit) hbase-protocol-shaded/src/main/java/org/apache/hadoop/hbase/shaded/protobuf/generated/QuotaProtos.java * (edit) hbase-protocol-shaded/src/main/java/org/apache/hadoop/hbase/shaded/protobuf/generated/TracingProtos.java * (edit) hbase-protocol-shaded/src/main/java/org/apache/hadoop/hbase/shaded/com/google/protobuf/TypeOrBuilder.java * (edit) hbase-protocol-shaded/src/main/java/org/apache/hadoop/hbase/shaded/com/google/protobuf/Api.java * (edit) hbase-protocol-shaded/src/main/java/org/apache/hadoop/hbase/shaded/protobuf/generated/EncryptionProtos.java * (edit) hbase-protocol-shaded/src/main/java/org/apache/hadoop/hbase/shaded/com/google/protobuf/SourceContextProto.java * (edit) hbase-protocol-shaded/src/main/java/org/apache/hadoop/hbase/shaded/com/google/protobuf/EnumValue.java * (edit) hbase-protocol-shaded/src/main/java/org/apache/hadoop/hbase/shaded/com/google/protobuf/Empty.java * (edit) hbase-protocol-shaded/src/main/java/org/apache/hadoop/hbase/shaded/com/google/protobuf/AbstractMessageLite.java * (edit) hbase-protocol-shaded/src/main/java/org/apache/hadoop/hbase/shaded/com/google/protobuf/Any.java * (edit)
[jira] [Commented] (HBASE-17859) ByteBufferUtils#compareTo is wrong
[
https://issues.apache.org/jira/browse/HBASE-17859?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15990409#comment-15990409
]
Hudson commented on HBASE-17859:
ABORTED: Integrated in Jenkins build HBase-HBASE-14614 #190 (See
[https://builds.apache.org/job/HBase-HBASE-14614/190/])
HBASE-17859 ByteBufferUtils#compareTo is wrong (chia7712: rev
73e1bcd33515061be2dc2e51e6ad19d9798a8ef6)
* (edit)
hbase-common/src/test/java/org/apache/hadoop/hbase/util/TestByteBufferUtils.java
* (edit)
hbase-common/src/main/java/org/apache/hadoop/hbase/util/ByteBufferUtils.java
> ByteBufferUtils#compareTo is wrong
> --
>
> Key: HBASE-17859
> URL: https://issues.apache.org/jira/browse/HBASE-17859
> Project: HBase
> Issue Type: Sub-task
>Reporter: Chia-Ping Tsai
>Assignee: Chia-Ping Tsai
>Priority: Critical
> Fix For: 2.0.0
>
> Attachments: HBASE-17859.v0.patch, HBASE-17859.v1.patch
>
>
> buf2.get( i ) & 0xFF; -> buf2.get(j) & 0xFF;
> {noformat}
> public static int compareTo(byte [] buf1, int o1, int l1, ByteBuffer buf2,
> int o2, int l2) {
>//
> int end1 = o1 + l1;
> int end2 = o2 + l2;
> for (int i = o1, j = o2; i < end1 && j < end2; i++, j++) {
> int a = buf1[i] & 0xFF;
> int b = buf2.get(i) & 0xFF;
> if (a != b) {
> return a - b;
> }
> }
> return l1 - l2;
> }
> {noformat}
--
This message was sent by Atlassian JIRA
(v6.3.15#6346)
[jira] [Commented] (HBASE-17698) ReplicationEndpoint choosing sinks
[ https://issues.apache.org/jira/browse/HBASE-17698?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15990406#comment-15990406 ] Hudson commented on HBASE-17698: ABORTED: Integrated in Jenkins build HBase-HBASE-14614 #190 (See [https://builds.apache.org/job/HBase-HBASE-14614/190/]) HBASE-17698 ReplicationEndpoint choosing sinks (apurtell: rev 80381f39446bab131f5b1f227c98bad97545c4c8) * (edit) hbase-server/src/main/java/org/apache/hadoop/hbase/replication/regionserver/HBaseInterClusterReplicationEndpoint.java > ReplicationEndpoint choosing sinks > -- > > Key: HBASE-17698 > URL: https://issues.apache.org/jira/browse/HBASE-17698 > Project: HBase > Issue Type: Bug > Components: Replication >Affects Versions: 2.0.0, 1.4.0 >Reporter: churro morales >Assignee: Karan Mehta > Fix For: 2.0.0, 1.4.0, 1.3.1, 1.1.10, 1.2.6 > > Attachments: HBASE-17698.patch > > > The only time we choose new sinks is when we have a ConnectException, but we > have encountered other exceptions where there is a problem contacting a > particular sink and replication gets backed up for any sources that try that > sink > HBASE-17675 occurred when there was a bad keytab refresh and the source was > stuck. > Another issue we recently had was a bad drive controller on the sink side and > replication was stuck again. > Is there any reason not to choose new sinks anytime we have a > RemoteException? I can understand TableNotFound we don't have to choose new > sinks, but for all other cases this seems like the safest approach. -- This message was sent by Atlassian JIRA (v6.3.15#6346)
[jira] [Commented] (HBASE-17520) Implement isTableEnabled/Disabled/Available methods
[ https://issues.apache.org/jira/browse/HBASE-17520?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15990400#comment-15990400 ] Hudson commented on HBASE-17520: ABORTED: Integrated in Jenkins build HBase-HBASE-14614 #190 (See [https://builds.apache.org/job/HBase-HBASE-14614/190/]) HBASE-17520 Implement isTableEnabled/Disabled/Available methods (zghao: rev 752b258b7c30aa375b5bb7a33abf435f37e8c877) * (edit) hbase-client/src/main/java/org/apache/hadoop/hbase/client/AsyncHBaseAdmin.java * (edit) hbase-server/src/test/java/org/apache/hadoop/hbase/client/TestAsyncTableAdminApi.java * (edit) hbase-client/src/main/java/org/apache/hadoop/hbase/client/AsyncAdmin.java * (edit) hbase-client/src/main/java/org/apache/hadoop/hbase/AsyncMetaTableAccessor.java > Implement isTableEnabled/Disabled/Available methods > --- > > Key: HBASE-17520 > URL: https://issues.apache.org/jira/browse/HBASE-17520 > Project: HBase > Issue Type: Sub-task > Components: Client >Reporter: Guanghao Zhang >Assignee: Guanghao Zhang > Fix For: 2.0.0 > > Attachments: HBASE-17520-v1.patch, HBASE-17520-v2.patch, > HBASE-17520-v3.patch, HBASE-17520-v4.patch, HBASE-17520-v5.patch, > HBASE-17520-v6.patch, HBASE-17520-v6.patch > > -- This message was sent by Atlassian JIRA (v6.3.15#6346)
[jira] [Commented] (HBASE-17623) Reuse the bytes array when building the hfile block
[
https://issues.apache.org/jira/browse/HBASE-17623?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15990392#comment-15990392
]
Hudson commented on HBASE-17623:
ABORTED: Integrated in Jenkins build HBase-HBASE-14614 #190 (See
[https://builds.apache.org/job/HBase-HBASE-14614/190/])
HBASE-17623 Reuse the bytes array when building the hfile block (chia7712: rev
6bd3109062060f735c73b268c44022c201e6072b)
* (edit)
hbase-common/src/main/java/org/apache/hadoop/hbase/io/encoding/HFileBlockEncodingContext.java
* (edit)
hbase-server/src/main/java/org/apache/hadoop/hbase/io/hfile/HFileBlock.java
* (edit)
hbase-server/src/test/java/org/apache/hadoop/hbase/io/hfile/TestHFileBlock.java
* (edit)
hbase-common/src/main/java/org/apache/hadoop/hbase/io/encoding/HFileBlockDefaultEncodingContext.java
> Reuse the bytes array when building the hfile block
> ---
>
> Key: HBASE-17623
> URL: https://issues.apache.org/jira/browse/HBASE-17623
> Project: HBase
> Issue Type: Improvement
> Components: HFile
>Affects Versions: 2.0.0, 1.4.0
>Reporter: Chia-Ping Tsai
>Assignee: Chia-Ping Tsai
> Fix For: 2.0.0, 1.4.0
>
> Attachments: after(snappy_hfilesize=5.04GB).png,
> after(snappy_hfilesize=755MB).png, before(snappy_hfilesize=5.04GB).png,
> before(snappy_hfilesize=755MB).png, GC measurement.xlsx,
> HBASE-17623.branch-1.v0.patch, HBASE-17623.branch-1.v1.patch,
> HBASE-17623.branch-1.v2.patch, HBASE-17623.branch-1.v2.patch,
> HBASE-17623.branch-1.v3.patch, HBASE-17623.branch-1.v3.patch,
> HBASE-17623.branch-1.v3.patch, HBASE-17623.v0.patch, HBASE-17623.v1.patch,
> HBASE-17623.v1.patch, HBASE-17623.v2.patch, HBASE-17623.v3.patch,
> HBASE-17623.v3.patch, memory allocation measurement.xlsx
>
>
> There are two improvements.
> # The onDiskBlockBytesWithHeader should maintain a bytes array which can be
> reused when building the hfile.
> # The onDiskBlockBytesWithHeader is copied to an new bytes array only when we
> need to cache the block.
> # If no block need to be cached, the uncompressedBlockBytesWithHeader will
> never be created.
> {code:title=HFileBlock.java|borderStyle=solid}
> private void finishBlock() throws IOException {
> if (blockType == BlockType.DATA) {
> this.dataBlockEncoder.endBlockEncoding(dataBlockEncodingCtx,
> userDataStream,
> baosInMemory.getBuffer(), blockType);
> blockType = dataBlockEncodingCtx.getBlockType();
> }
> userDataStream.flush();
> // This does an array copy, so it is safe to cache this byte array when
> cache-on-write.
> // Header is still the empty, 'dummy' header that is yet to be filled
> out.
> uncompressedBlockBytesWithHeader = baosInMemory.toByteArray();
> prevOffset = prevOffsetByType[blockType.getId()];
> // We need to set state before we can package the block up for
> cache-on-write. In a way, the
> // block is ready, but not yet encoded or compressed.
> state = State.BLOCK_READY;
> if (blockType == BlockType.DATA || blockType == BlockType.ENCODED_DATA)
> {
> onDiskBlockBytesWithHeader = dataBlockEncodingCtx.
> compressAndEncrypt(uncompressedBlockBytesWithHeader);
> } else {
> onDiskBlockBytesWithHeader = defaultBlockEncodingCtx.
> compressAndEncrypt(uncompressedBlockBytesWithHeader);
> }
> // Calculate how many bytes we need for checksum on the tail of the
> block.
> int numBytes = (int) ChecksumUtil.numBytes(
> onDiskBlockBytesWithHeader.length,
> fileContext.getBytesPerChecksum());
> // Put the header for the on disk bytes; header currently is
> unfilled-out
> putHeader(onDiskBlockBytesWithHeader, 0,
> onDiskBlockBytesWithHeader.length + numBytes,
> uncompressedBlockBytesWithHeader.length,
> onDiskBlockBytesWithHeader.length);
> // Set the header for the uncompressed bytes (for cache-on-write) --
> IFF different from
> // onDiskBlockBytesWithHeader array.
> if (onDiskBlockBytesWithHeader != uncompressedBlockBytesWithHeader) {
> putHeader(uncompressedBlockBytesWithHeader, 0,
> onDiskBlockBytesWithHeader.length + numBytes,
> uncompressedBlockBytesWithHeader.length,
> onDiskBlockBytesWithHeader.length);
> }
> if (onDiskChecksum.length != numBytes) {
> onDiskChecksum = new byte[numBytes];
> }
> ChecksumUtil.generateChecksums(
> onDiskBlockBytesWithHeader, 0, onDiskBlockBytesWithHeader.length,
> onDiskChecksum, 0, fileContext.getChecksumType(),
> fileContext.getBytesPerChecksum());
> }{code}
--
This message was sent by Atlassian JIRA
(v6.3.15#6346)
[jira] [Commented] (HBASE-17765) Reviving the merge possibility in the CompactingMemStore
[ https://issues.apache.org/jira/browse/HBASE-17765?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15990396#comment-15990396 ] Hudson commented on HBASE-17765: ABORTED: Integrated in Jenkins build HBase-HBASE-14614 #190 (See [https://builds.apache.org/job/HBase-HBASE-14614/190/]) HBASE-17765 Reviving the merge of the compacting pipeline (busbey: rev cb4fac1d18660094908afd6abaace6e441ec6a49) * (edit) hbase-server/src/test/java/org/apache/hadoop/hbase/regionserver/TestWalAndCompactingMemStoreFlush.java * (edit) hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/CompactingMemStore.java * (edit) hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/MemStoreCompactor.java * (edit) hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/ImmutableSegment.java * (edit) hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/CompactionPipeline.java > Reviving the merge possibility in the CompactingMemStore > > > Key: HBASE-17765 > URL: https://issues.apache.org/jira/browse/HBASE-17765 > Project: HBase > Issue Type: Sub-task >Reporter: Anastasia Braginsky >Assignee: Anastasia Braginsky > Fix For: 2.0.0 > > Attachments: HBASE-17765-V01.patch, HBASE-17765-V02.patch, > HBASE-17765-V03.patch, HBASE-17765-V04.patch, HBASE-17765-V05.patch > > > According to the new performance results presented in the HBASE-16417 we see > that the read latency of the 90th percentile of the BASIC policy is too big > due to the need to traverse through too many segments in the pipeline. In > this JIRA we correct the bug in the merge sizing calculations and allow > pipeline size threshold to be a configurable parameter. -- This message was sent by Atlassian JIRA (v6.3.15#6346)
[jira] [Commented] (HBASE-14417) Incremental backup and bulk loading
[ https://issues.apache.org/jira/browse/HBASE-14417?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15990397#comment-15990397 ] Hudson commented on HBASE-14417: ABORTED: Integrated in Jenkins build HBase-HBASE-14614 #190 (See [https://builds.apache.org/job/HBase-HBASE-14614/190/]) HBASE-14417 Incremental backup and bulk loading (tedyu: rev 0345fc87759a7d44ecc385327ebb586fc632fb65) * (edit) hbase-server/src/main/java/org/apache/hadoop/hbase/backup/mapreduce/MapReduceRestoreJob.java * (add) hbase-server/src/test/java/org/apache/hadoop/hbase/backup/TestIncrementalBackupWithBulkLoad.java * (add) hbase-server/src/main/java/org/apache/hadoop/hbase/backup/BackupHFileCleaner.java * (edit) hbase-server/src/main/java/org/apache/hadoop/hbase/backup/impl/BackupManager.java * (edit) hbase-server/src/test/java/org/apache/hadoop/hbase/backup/TestBackupBase.java * (edit) hbase-server/src/test/java/org/apache/hadoop/hbase/mapreduce/TestLoadIncrementalHFiles.java * (add) hbase-server/src/test/java/org/apache/hadoop/hbase/backup/TestBackupHFileCleaner.java * (edit) hbase-server/src/main/java/org/apache/hadoop/hbase/mapreduce/LoadIncrementalHFiles.java * (edit) hbase-server/src/main/java/org/apache/hadoop/hbase/backup/impl/IncrementalTableBackupClient.java * (edit) hbase-server/src/main/java/org/apache/hadoop/hbase/backup/impl/BackupSystemTable.java * (edit) hbase-server/src/main/java/org/apache/hadoop/hbase/backup/impl/BackupAdminImpl.java * (add) hbase-server/src/main/java/org/apache/hadoop/hbase/backup/BackupObserver.java * (edit) hbase-server/src/main/java/org/apache/hadoop/hbase/util/HFileArchiveUtil.java * (edit) hbase-server/src/main/java/org/apache/hadoop/hbase/backup/impl/RestoreTablesClient.java > Incremental backup and bulk loading > --- > > Key: HBASE-14417 > URL: https://issues.apache.org/jira/browse/HBASE-14417 > Project: HBase > Issue Type: New Feature >Reporter: Vladimir Rodionov >Assignee: Ted Yu >Priority: Blocker > Labels: backup > Fix For: 2.0.0 > > Attachments: 14417-tbl-ext.v10.txt, 14417-tbl-ext.v11.txt, > 14417-tbl-ext.v14.txt, 14417-tbl-ext.v18.txt, 14417-tbl-ext.v19.txt, > 14417-tbl-ext.v20.txt, 14417-tbl-ext.v21.txt, 14417-tbl-ext.v22.txt, > 14417-tbl-ext.v23.txt, 14417-tbl-ext.v24.txt, 14417-tbl-ext.v9.txt, > 14417.v11.txt, 14417.v13.txt, 14417.v1.txt, 14417.v21.txt, 14417.v23.txt, > 14417.v24.txt, 14417.v25.txt, 14417.v2.txt, 14417.v6.txt > > > Currently, incremental backup is based on WAL files. Bulk data loading > bypasses WALs for obvious reasons, breaking incremental backups. The only way > to continue backups after bulk loading is to create new full backup of a > table. This may not be feasible for customers who do bulk loading regularly > (say, every day). > Here is the review board (out of date): > https://reviews.apache.org/r/54258/ > In order not to miss the hfiles which are loaded into region directories in a > situation where postBulkLoadHFile() hook is not called (bulk load being > interrupted), we record hfile names thru preCommitStoreFile() hook. > At time of incremental backup, we check the presence of such hfiles. If they > are present, they become part of the incremental backup image. > Here is review board: > https://reviews.apache.org/r/57790/ > Google doc for design: > https://docs.google.com/document/d/1ACCLsecHDvzVSasORgqqRNrloGx4mNYIbvAU7lq5lJE -- This message was sent by Atlassian JIRA (v6.3.15#6346)
[jira] [Commented] (HBASE-17831) Support small scan in thrift2
[ https://issues.apache.org/jira/browse/HBASE-17831?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15990394#comment-15990394 ] Hudson commented on HBASE-17831: ABORTED: Integrated in Jenkins build HBase-HBASE-14614 #190 (See [https://builds.apache.org/job/HBase-HBASE-14614/190/]) HBASE-17831 Support small scan in thrift2 (Guangxu Cheng) (tedyu: rev 85fda44179c0afba74f52944ae9bb5a38266678c) * (edit) hbase-thrift/src/test/java/org/apache/hadoop/hbase/thrift2/TestThriftHBaseServiceHandler.java * (edit) hbase-thrift/src/main/resources/org/apache/hadoop/hbase/thrift2/hbase.thrift * (add) hbase-thrift/src/main/java/org/apache/hadoop/hbase/thrift2/generated/TReadType.java * (edit) hbase-thrift/src/main/java/org/apache/hadoop/hbase/thrift2/generated/TScan.java * (edit) hbase-thrift/src/main/java/org/apache/hadoop/hbase/thrift2/ThriftUtilities.java > Support small scan in thrift2 > - > > Key: HBASE-17831 > URL: https://issues.apache.org/jira/browse/HBASE-17831 > Project: HBase > Issue Type: Improvement > Components: Thrift >Reporter: Guangxu Cheng >Assignee: Guangxu Cheng > Fix For: 2.0.0, 1.4.0 > > Attachments: HBASE-17831-branch-1.patch, > HBASE-17831-branch-1-v1.patch, HBASE-17831-master.patch, > HBASE-17831-master-v1.patch > > > Support small scan in thrift2 -- This message was sent by Atlassian JIRA (v6.3.15#6346)
[jira] [Commented] (HBASE-17669) Implement async mergeRegion/splitRegion methods.
[ https://issues.apache.org/jira/browse/HBASE-17669?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15990391#comment-15990391 ] Hudson commented on HBASE-17669: ABORTED: Integrated in Jenkins build HBase-HBASE-14614 #190 (See [https://builds.apache.org/job/HBase-HBASE-14614/190/]) HBASE-17669: Implement async mergeRegion/splitRegion methods (zhangduo: rev faf81d5133393656a21ce8614447e4bb2b0d04e3) * (edit) hbase-client/src/main/java/org/apache/hadoop/hbase/HRegionInfo.java * (edit) hbase-client/src/main/java/org/apache/hadoop/hbase/client/AsyncAdmin.java * (edit) hbase-server/src/test/java/org/apache/hadoop/hbase/client/TestAsyncRegionAdminApi.java * (edit) hbase-client/src/main/java/org/apache/hadoop/hbase/client/AsyncHBaseAdmin.java * (edit) hbase-client/src/main/java/org/apache/hadoop/hbase/client/HBaseAdmin.java > Implement async mergeRegion/splitRegion methods. > > > Key: HBASE-17669 > URL: https://issues.apache.org/jira/browse/HBASE-17669 > Project: HBase > Issue Type: Sub-task > Components: Admin, asyncclient, Client >Affects Versions: 2.0.0 >Reporter: Zheng Hu >Assignee: Zheng Hu > Fix For: 2.0.0 > > Attachments: HBASE-17669.v1.patch, HBASE-17669.v2.patch, > HBASE-17669.v3.patch, HBASE-17669.v3.patch, HBASE-17669.v4.patch, > HBASE-17669.v5.patch, HBASE-17669.v5.patch, HBASE-17669.v6.patch > > > RT -- This message was sent by Atlassian JIRA (v6.3.15#6346)
[jira] [Commented] (HBASE-17821) The CompoundConfiguration#toString is wrong
[
https://issues.apache.org/jira/browse/HBASE-17821?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15990404#comment-15990404
]
Hudson commented on HBASE-17821:
ABORTED: Integrated in Jenkins build HBase-HBASE-14614 #190 (See
[https://builds.apache.org/job/HBase-HBASE-14614/190/])
HBASE-17821: The CompoundConfiguration#toString is wrong (chia7712: rev
a9682ca5dc46a74edca3da630560fbaf5d0cf38b)
* (edit)
hbase-common/src/main/java/org/apache/hadoop/hbase/CompoundConfiguration.java
> The CompoundConfiguration#toString is wrong
> ---
>
> Key: HBASE-17821
> URL: https://issues.apache.org/jira/browse/HBASE-17821
> Project: HBase
> Issue Type: Bug
>Reporter: Chia-Ping Tsai
>Assignee: Yi Liang
>Priority: Trivial
> Labels: beginner
> Fix For: 2.0.0, 1.4.0
>
> Attachments: HBase-17821-V1.patch, HBase-17821-V1.patch
>
>
> Find this bug when reading code. We dont use the API, so it is a trivial bug.
> sb.append(this.configs); -> sb.append(m);
> {noformat}
> @Override
> public String toString() {
> StringBuffer sb = new StringBuffer();
> sb.append("CompoundConfiguration: " + this.configs.size() + " configs");
> for (ImmutableConfigMap m : this.configs) {
> sb.append(this.configs);
> }
> return sb.toString();
> }
> {noformat}
--
This message was sent by Atlassian JIRA
(v6.3.15#6346)
[jira] [Commented] (HBASE-17215) Separate small/large file delete threads in HFileCleaner to accelerate archived hfile cleanup speed
[
https://issues.apache.org/jira/browse/HBASE-17215?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15990408#comment-15990408
]
Hudson commented on HBASE-17215:
ABORTED: Integrated in Jenkins build HBase-HBASE-14614 #190 (See
[https://builds.apache.org/job/HBase-HBASE-14614/190/])
HBASE-17215 Separate small/large file delete threads in HFileCleaner to (liyu:
rev 9facfa550f1e7386be3a04d84f7e8013f5002965)
* (edit)
hbase-server/src/test/java/org/apache/hadoop/hbase/master/cleaner/TestHFileCleaner.java
* (edit)
hbase-server/src/main/java/org/apache/hadoop/hbase/master/cleaner/HFileCleaner.java
* (edit)
hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/RSRpcServices.java
* (edit) hbase-server/src/main/java/org/apache/hadoop/hbase/master/HMaster.java
* (edit)
hbase-server/src/main/java/org/apache/hadoop/hbase/master/cleaner/CleanerChore.java
HBASE-17854 Use StealJobQueue in HFileCleaner after HBASE-17215 (liyu: rev
cbcbcf4dcd3401327cc36173f3ca8e5362da1e0c)
* (edit)
hbase-server/src/test/java/org/apache/hadoop/hbase/master/cleaner/TestHFileCleaner.java
* (edit)
hbase-server/src/main/java/org/apache/hadoop/hbase/master/cleaner/HFileCleaner.java
* (edit)
hbase-server/src/main/java/org/apache/hadoop/hbase/util/StealJobQueue.java
* (edit)
hbase-server/src/test/java/org/apache/hadoop/hbase/util/TestStealJobQueue.java
> Separate small/large file delete threads in HFileCleaner to accelerate
> archived hfile cleanup speed
> ---
>
> Key: HBASE-17215
> URL: https://issues.apache.org/jira/browse/HBASE-17215
> Project: HBase
> Issue Type: Improvement
>Reporter: Yu Li
>Assignee: Yu Li
> Fix For: 2.0.0
>
> Attachments: HBASE-17215.patch, HBASE-17215.v2.patch,
> HBASE-17215.v3.patch
>
>
> When using PCIe-SSD the flush speed will be really quick, and although we
> have per CF flush, we still have the
> {{hbase.regionserver.optionalcacheflushinterval}} setting and some other
> mechanism to avoid data kept in memory for too long to flush small hfiles. In
> our online environment we found the single thread cleaner kept cleaning
> earlier flushed small files while large files got no chance, which caused
> disk full then many other problems.
> Deleting hfiles in parallel with too many threads will also increase the
> workload of namenode, so here we propose to separate large/small hfile
> cleaner threads just like we do for compaction, and it turned out to work
> well in our cluster.
--
This message was sent by Atlassian JIRA
(v6.3.15#6346)
[jira] [Commented] (HBASE-17287) Master becomes a zombie if filesystem object closes
[
https://issues.apache.org/jira/browse/HBASE-17287?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15990398#comment-15990398
]
Hudson commented on HBASE-17287:
ABORTED: Integrated in Jenkins build HBase-HBASE-14614 #190 (See
[https://builds.apache.org/job/HBase-HBASE-14614/190/])
HBASE-17287 Master becomes a zombie if filesystem object closes (tedyu: rev
f159557eded160680e623b966350ea3442b5f35a)
* (edit)
hbase-server/src/main/java/org/apache/hadoop/hbase/master/MasterWalManager.java
* (add)
hbase-server/src/test/java/org/apache/hadoop/hbase/master/procedure/TestSafemodeBringsDownMaster.java
> Master becomes a zombie if filesystem object closes
> ---
>
> Key: HBASE-17287
> URL: https://issues.apache.org/jira/browse/HBASE-17287
> Project: HBase
> Issue Type: Bug
> Components: master
>Reporter: Clay B.
>Assignee: Ted Yu
>Priority: Blocker
> Fix For: 2.0.0, 1.4.0, 1.3.1, 1.1.10, 1.2.6
>
> Attachments: 17287.branch-1.1.v4.txt, 17287.branch-1.v3.txt,
> 17287.branch-1.v4.txt, 17287.master.v2.txt, 17287.master.v3.txt,
> 17287.master.v4.txt, 17287.master.v5.txt, 17287.v2.txt
>
>
> We have seen an issue whereby if the HDFS is unstable and the HBase master's
> HDFS client is unable to stabilize before
> {{dfs.client.failover.max.attempts}} then the master's filesystem object
> closes. This seems to result in an HBase master which will continue to run
> (process and znode exists) but no meaningful work can be done (e.g. assigning
> meta).What we saw in our HBase master logs was:{code}2016-12-01 19:19:08,192
> ERROR org.apache.hadoop.hbase.master.handler.MetaServerShutdownHandler:
> Caught M_META_SERVER_SHUTDOWN, count=1java.io.IOException: failed log
> splitting for cluster-r5n12.bloomberg.com,60200,1480632863218, will retryat
> org.apache.hadoop.hbase.master.handler.MetaServerShutdownHandler.process(MetaServerShutdownHandler.java:84)at
> org.apache.hadoop.hbase.executor.EventHandler.run(EventHandler.java:129)at
> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)at
>
> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)at
> java.lang.Thread.run(Thread.java:745)Caused by: java.io.IOException:
> Filesystem closed{code}
--
This message was sent by Atlassian JIRA
(v6.3.15#6346)
[jira] [Commented] (HBASE-17844) Subset of HBASE-14614, Procedure v2: Core Assignment Manager (non-critical related changes)
[ https://issues.apache.org/jira/browse/HBASE-17844?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15990401#comment-15990401 ] Hudson commented on HBASE-17844: ABORTED: Integrated in Jenkins build HBase-HBASE-14614 #190 (See [https://builds.apache.org/job/HBase-HBASE-14614/190/]) HBASE-17844 Subset of HBASE-14614, Procedure v2: Core Assignment Manager (stack: rev d033cbb715aa6153c4b764ef6638b7a1cecee64e) * (edit) hbase-client/src/main/java/org/apache/hadoop/hbase/ClusterStatus.java * (edit) hbase-client/src/main/java/org/apache/hadoop/hbase/MetaTableAccessor.java * (edit) hbase-client/src/main/java/org/apache/hadoop/hbase/ipc/ServerTooBusyException.java * (edit) hbase-server/src/test/java/org/apache/hadoop/hbase/client/TestMetaWithReplicas.java * (edit) hbase-server/src/main/java/org/apache/hadoop/hbase/master/procedure/AbstractStateMachineTableProcedure.java * (edit) hbase-procedure/src/main/java/org/apache/hadoop/hbase/procedure2/AbstractProcedureScheduler.java * (edit) hbase-server/src/main/java/org/apache/hadoop/hbase/master/MasterWalManager.java * (edit) hbase-server/src/test/java/org/apache/hadoop/hbase/regionserver/wal/AbstractTestWALReplay.java * (edit) hbase-client/src/main/java/org/apache/hadoop/hbase/master/RegionState.java * (edit) hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/HRegion.java * (edit) hbase-client/src/main/java/org/apache/hadoop/hbase/shaded/protobuf/ProtobufUtil.java * (edit) hbase-server/src/main/java/org/apache/hadoop/hbase/ipc/BalancedQueueRpcExecutor.java * (edit) hbase-server/src/main/java/org/apache/hadoop/hbase/ipc/SimpleRpcServer.java * (edit) hbase-procedure/src/main/java/org/apache/hadoop/hbase/procedure2/Procedure.java * (edit) hbase-server/src/main/java/org/apache/hadoop/hbase/master/procedure/CreateNamespaceProcedure.java * (edit) hbase-procedure/src/main/java/org/apache/hadoop/hbase/procedure2/ProcedureEvent.java * (edit) hbase-server/src/main/java/org/apache/hadoop/hbase/master/RegionStates.java * (edit) hbase-common/src/main/java/org/apache/hadoop/hbase/HConstants.java * (edit) hbase-server/src/main/java/org/apache/hadoop/hbase/wal/WALSplitter.java * (edit) hbase-server/src/test/java/org/apache/hadoop/hbase/io/encoding/TestChangingEncoding.java * (edit) hbase-client/src/main/java/org/apache/hadoop/hbase/ipc/AbstractRpcClient.java * (edit) hbase-procedure/src/main/java/org/apache/hadoop/hbase/procedure2/StateMachineProcedure.java * (edit) hbase-procedure/src/test/java/org/apache/hadoop/hbase/procedure2/util/TestDelayedUtil.java * (edit) hbase-server/src/test/java/org/apache/hadoop/hbase/master/locking/TestLockProcedure.java * (edit) hbase-server/src/main/java/org/apache/hadoop/hbase/master/LoadBalancer.java * (edit) hbase-server/src/main/java/org/apache/hadoop/hbase/master/balancer/StochasticLoadBalancer.java * (edit) hbase-server/src/test/java/org/apache/hadoop/hbase/ipc/TestSimpleRpcScheduler.java * (edit) hbase-server/src/main/java/org/apache/hadoop/hbase/ipc/SimpleRpcScheduler.java * (edit) hbase-procedure/src/main/java/org/apache/hadoop/hbase/procedure2/util/DelayedUtil.java * (edit) hbase-common/src/main/java/org/apache/hadoop/hbase/TableName.java * (edit) hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/handler/OpenRegionHandler.java * (edit) hbase-procedure/src/test/java/org/apache/hadoop/hbase/procedure2/ProcedureTestingUtility.java * (edit) hbase-server/src/test/java/org/apache/hadoop/hbase/regionserver/wal/TestAsyncLogRolling.java * (edit) hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/throttle/PressureAwareCompactionThroughputController.java * (edit) hbase-common/src/main/java/org/apache/hadoop/hbase/ChoreService.java * (edit) hbase-procedure/src/main/java/org/apache/hadoop/hbase/procedure2/ProcedureExecutor.java * (edit) hbase-client/src/main/java/org/apache/hadoop/hbase/protobuf/ProtobufUtil.java * (edit) hbase-server/src/test/java/org/apache/hadoop/hbase/TestStochasticBalancerJmxMetrics.java * (edit) hbase-server/src/main/java/org/apache/hadoop/hbase/master/procedure/MasterProcedureScheduler.java * (edit) hbase-rsgroup/src/main/java/org/apache/hadoop/hbase/rsgroup/RSGroupBasedLoadBalancer.java * (edit) hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/HStore.java * (edit) hbase-procedure/src/main/java/org/apache/hadoop/hbase/procedure2/LockAndQueue.java * (edit) hbase-procedure/src/main/java/org/apache/hadoop/hbase/procedure2/ProcedureScheduler.java * (edit) hbase-server/src/main/java/org/apache/hadoop/hbase/master/locking/LockProcedure.java > Subset of HBASE-14614, Procedure v2: Core Assignment Manager (non-critical > related changes) > --- > > Key: HBASE-17844 > URL: https://issues.apache.org/jira/browse/HBASE-17844 > Project: HBase >
[jira] [Commented] (HBASE-17855) Fix typo in async client implementation
[ https://issues.apache.org/jira/browse/HBASE-17855?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15990403#comment-15990403 ] Hudson commented on HBASE-17855: ABORTED: Integrated in Jenkins build HBase-HBASE-14614 #190 (See [https://builds.apache.org/job/HBase-HBASE-14614/190/]) HBASE-17855 Fix typo in async client implementation (zhangduo: rev 0ec1459467f280280630e5b597bef302ec43cedd) * (edit) hbase-client/src/main/java/org/apache/hadoop/hbase/client/AsyncRegionLocator.java * (edit) hbase-client/src/main/java/org/apache/hadoop/hbase/client/AsyncMetaRegionLocator.java * (edit) hbase-client/src/main/java/org/apache/hadoop/hbase/client/AsyncNonMetaRegionLocator.java * (edit) hbase-server/src/test/java/org/apache/hadoop/hbase/client/AbstractTestAsyncTableScan.java > Fix typo in async client implementation > --- > > Key: HBASE-17855 > URL: https://issues.apache.org/jira/browse/HBASE-17855 > Project: HBase > Issue Type: Sub-task > Components: asyncclient, Client >Affects Versions: 2.0.0 >Reporter: Duo Zhang >Assignee: Duo Zhang > Labels: trivial > Fix For: 2.0.0 > > Attachments: HBASE-17855.patch > > -- This message was sent by Atlassian JIRA (v6.3.15#6346)
[jira] [Commented] (HBASE-14614) Procedure v2: Core Assignment Manager
[ https://issues.apache.org/jira/browse/HBASE-14614?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15990390#comment-15990390 ] stack commented on HBASE-14614: --- Removed old HBASE-14614 branch a while back. Just added it back with latest state of this patch. Patch incorporates fixes testing up on cluster. Keeping state of this work up in https://docs.google.com/document/d/1eVKa7FHdeoJ1-9o8yZcOTAQbv0u0bblBlCCzVSIn69g/edit#heading=h.xp9zndoycwj Currently on an interesting issue where the Master WAL of procedures drops a procedure because it thinks the recording corrupted. Hopefully this is the last gnarly one. > Procedure v2: Core Assignment Manager > - > > Key: HBASE-14614 > URL: https://issues.apache.org/jira/browse/HBASE-14614 > Project: HBase > Issue Type: Sub-task > Components: proc-v2 >Affects Versions: 2.0.0 >Reporter: Stephen Yuan Jiang >Assignee: Matteo Bertozzi > Fix For: 2.0.0 > > Attachments: HBASE-14614.master.003.patch, > HBASE-14614.master.004.patch, HBASE-14614.master.005.patch, > HBASE-14614.master.006.patch, HBASE-14614.master.007.patch, > HBASE-14614.master.008.patch, HBASE-14614.master.009.patch, > HBASE-14614.master.010.patch, HBASE-14614.master.011.patch, > HBASE-14614.master.012.patch, HBASE-14614.master.012.patch, > HBASE-14614.master.013.patch, HBASE-14614.master.014.patch, > HBASE-14614.master.015.patch, HBASE-14614.master.017.patch, > HBASE-14614.master.018.patch, HBASE-14614.master.019.patch, > HBASE-14614.master.020.patch, HBASE-14614.master.021.patch, > HBASE-14614.master.022.patch, HBASE-14614.master.023.patch, > HBASE-14614.master.024.patch, HBASE-14614.master.025.patch, > HBASE-14614.master.026.patch, HBASE-14614.master.027.patch, > HBASE-14614.master.028.patch, HBASE-14614.master.029.patch, > HBASE-14614.master.030.patch, HBASE-14614.master.031.patch, > HBASE-14614.master.032.patch, HBASE-14614.master.033.patch, > HBASE-14614.master.034.patch, HBASE-14614.master.035.patch, > HBASE-14614.master.036.patch, HBASE-14614.master.037.patch, > HBASE-14614.master.038.patch, HBASE-14614.master.039.patch > > > New AssignmentManager implemented using proc-v2. > - AssignProcedure handle assignment operation > - UnassignProcedure handle unassign operation > - MoveRegionProcedure handle move/balance operation > Concurrent Assign operations are batched together and sent to the balancer > Concurrent Assign and Unassign operation ready to be sent to the RS are > batched together > This patch is an intermediate state where we add the new AM as > AssignmentManager2() to the master, to be reached by tests. but the new AM > will not be integrated with the rest of the system. Only new am unit-tests > will exercise the new assigment manager. The integration with the master code > is part of HBASE-14616 -- This message was sent by Atlassian JIRA (v6.3.15#6346)
