Re: Hbase Meetup -- Bangalore on 19th Jan

2024-01-13 Thread Mallikarjun
Unfortunately, we had to postpone the above event as we could not get enough traction to get minimum submissions for this event. You can continue submissions, once we can get enough of them, will organise this event. Will keep you posted. --- Mallikarjun On Sun, Dec 17, 2023 at 7:10 PM

Hbase Meetup -- Bangalore on 19th Jan

2023-12-17 Thread Mallikarjun
We are organising hbase-meetup in Bangalore, India on 19th Jan 2024. Reach out to me if you want to attend. I will arrange for entry passes. CALL FOR SPEAKERS is open https://sessionize.com/apache-hbase-meetup-bangalore/ Date: 19th Jan 2024 Venue: Flipkart Office, Bangalore. --- Mallikarjun

Re: [NOTICE] Going to cut 3.0.0-alpha-4

2023-05-22 Thread Mallikarjun
It would be good to include these 2 features Parallel Backups: https://issues.apache.org/jira/browse/HBASE-26034 RSGroup Support for Backups: https://issues.apache.org/jira/browse/HBASE-26322 CC: Bryan --- Mallikarjun On Sat, May 20, 2023 at 7:13 PM 张铎(Duo Zhang) wrote: > HBASE-27109

Re: [DISCUSS] Kubernetes Orchestration for ZK, HDFS, and HBase

2023-03-14 Thread Mallikarjun
tps://github.com/flipkart-incubator/hbase-k8s-operator --- Mallikarjun On Mon, Mar 13, 2023 at 3:58 PM Nick Dimiduk wrote: > Heya team, > > Over here at $dayjob, we have an increasing reliance on Kubernetes for > both development and production workloads. Our tools are maturing and

Re: Branching for 2.6 code line (branch-2.6)

2022-10-16 Thread Mallikarjun
On hbase-backup, we are using in production for more then 1 year. I can vouch for it to be stable enough to be in a release version so that more people can use it and polished it further. On Sun, Oct 16, 2022, 11:25 PM Andrew Purtell wrote: > My understanding is some folks evaluating and

Blog Posts on "How we solved for Hbase MultiTenancy"

2022-08-29 Thread Mallikarjun
t-i-37cad340c0fa Part II --> https://blog.flipkart.tech/hbase-multi-tenancy-part-ii-79488c19b03d Talk: https://www.youtube.com/watch?v=ttGI9Ma7Xos=26s_channel=LifeAtFlipkart Some of those can be contributed back upstream with modifications. Happy to hear thoughts. --- Mallikarjun

[jira] [Created] (HBASE-27238) Backport Backup/Restore to 2.x

2022-07-25 Thread Mallikarjun (Jira)
Mallikarjun created HBASE-27238: --- Summary: Backport Backup/Restore to 2.x Key: HBASE-27238 URL: https://issues.apache.org/jira/browse/HBASE-27238 Project: HBase Issue Type: New Feature

Re: [DISCUSS] Time for 3.0.0-alpha-3

2022-06-18 Thread Mallikarjun
Thanks Duo I have responded to the comments. On Fri, Jun 17, 2022, 6:07 PM 张铎(Duo Zhang) wrote: > I posted some comments on the issues. PTAL. > > Thanks. > > Mallikarjun 于2022年6月17日周五 17:03写道: > > > These 2 patches would be a good addition. They still need to be revie

Re: [DISCUSS] Time for 3.0.0-alpha-3

2022-06-17 Thread Mallikarjun
se/pull/4545 --- Mallikarjun On Thu, Jun 16, 2022 at 7:38 PM 张铎(Duo Zhang) wrote: > And also bump this one, feel free to reply here if you want to land > something in the final 3.0.0 release. > > Thanks. > > Andrew Purtell 于2022年6月13日周一 02:04写道: > > > +1, thanks for your effor

Re: [VOTE] First release candidate for hbase 3.0.0-alpha-2 is available for download

2021-12-15 Thread Mallikarjun
Thanks. Got the point. --- Mallikarjun On Tue, Dec 14, 2021 at 7:43 PM 张铎(Duo Zhang) wrote: > We could still add new big features before the last alpha-4 release. > > After alpha-4 is out, we will cut a branch-3 and then start to stabilize > it. For branch-3, we should treat it l

Re: [VOTE] First release candidate for hbase 3.0.0-alpha-2 is available for download

2021-12-13 Thread Mallikarjun
://issues.apache.org/jira/browse/HBASE-26322 Patch: https://github.com/apache/hbase/pull/3726 2. Add support to take parallel backups Details: https://issues.apache.org/jira/browse/HBASE-26034 Patch: https://github.com/apache/hbase/pull/3766 --- Mallikarjun On Tue, Dec 14, 2021 at 5:45 AM 张铎

Re: Need code review for a couple of Backup/Restore related Pull Requests

2021-11-18 Thread Mallikarjun
Bump. --- Mallikarjun On Tue, Nov 2, 2021 at 4:46 PM Mallikarjun wrote: > Hi, > > I have a couple of pull requests on Backup/Restore. Appreciate if someone > could have a look at them. > > https://github.com/apache/hbase/pull/3766 > https://github.com/apache/hbase/pul

Need code review for a couple of Backup/Restore related Pull Requests

2021-11-02 Thread Mallikarjun
Hi, I have a couple of pull requests on Backup/Restore. Appreciate if someone could have a look at them. https://github.com/apache/hbase/pull/3766 https://github.com/apache/hbase/pull/3726 I have put down the context in respective Jiras. Please ask if any clarity is needed. --- Mallikarjun

[jira] [Created] (HBASE-26346) Design support for rsgroup data isolation

2021-10-11 Thread Mallikarjun (Jira)
Mallikarjun created HBASE-26346: --- Summary: Design support for rsgroup data isolation Key: HBASE-26346 URL: https://issues.apache.org/jira/browse/HBASE-26346 Project: HBase Issue Type: New

[jira] [Created] (HBASE-26343) Extend RSGroup to support data isolation to achieve true multitenancy in Hbase

2021-10-09 Thread Mallikarjun (Jira)
Mallikarjun created HBASE-26343: --- Summary: Extend RSGroup to support data isolation to achieve true multitenancy in Hbase Key: HBASE-26343 URL: https://issues.apache.org/jira/browse/HBASE-26343 Project

[jira] [Created] (HBASE-26322) Add rsgroup support for Backup

2021-10-02 Thread Mallikarjun (Jira)
Mallikarjun created HBASE-26322: --- Summary: Add rsgroup support for Backup Key: HBASE-26322 URL: https://issues.apache.org/jira/browse/HBASE-26322 Project: HBase Issue Type: Improvement

[jira] [Created] (HBASE-26279) Merger of backup:system table with hbase:meta table

2021-09-12 Thread Mallikarjun (Jira)
Mallikarjun created HBASE-26279: --- Summary: Merger of backup:system table with hbase:meta table Key: HBASE-26279 URL: https://issues.apache.org/jira/browse/HBASE-26279 Project: HBase Issue Type

Re: Stuck Serial replication -- Need suggestions on recovery

2021-08-17 Thread Mallikarjun
Thanks for answering the queries. --- Mallikarjun On Wed, Aug 18, 2021 at 9:32 AM 张铎(Duo Zhang) wrote: > In hbase, the mvcc write number and wal sequence id are the same > thing, so when we just want to bump the mvcc number, we will not write > an actual WAL but the se

Re: Stuck Serial replication -- Need suggestions on recovery

2021-08-17 Thread Mallikarjun
Inline Reply On Wed, Aug 18, 2021 at 8:06 AM 张铎(Duo Zhang) wrote: > Mallikarjun 于2021年8月18日周三 上午10:19写道: > > > > Thanks for the response @Duo > > > > Inline reply > > > > On Wed, Aug 18, 2021 at 7:37 AM 张铎(Duo Zhang) > wrote: > > > > >

Re: Stuck Serial replication -- Need suggestions on recovery

2021-08-17 Thread Mallikarjun
n I expect *18775106 *is mandatory to be present? or there can be gaps. > > And on the fix, you can clear the range information for the given > regions in meta table, and then restart the clusters, I think the > replication could continue. > > If you mean removing some barriers so tha

Stuck Serial replication -- Need suggestions on recovery

2021-08-17 Thread Mallikarjun
and update checkpoints. --- Mallikarjun

[jira] [Created] (HBASE-26203) Minor cleanups to reduce checkstyle warnings on backup code

2021-08-16 Thread Mallikarjun (Jira)
Mallikarjun created HBASE-26203: --- Summary: Minor cleanups to reduce checkstyle warnings on backup code Key: HBASE-26203 URL: https://issues.apache.org/jira/browse/HBASE-26203 Project: HBase

[jira] [Created] (HBASE-26202) Review deprecated WALProcedureStore usage in Backup

2021-08-16 Thread Mallikarjun (Jira)
Mallikarjun created HBASE-26202: --- Summary: Review deprecated WALProcedureStore usage in Backup Key: HBASE-26202 URL: https://issues.apache.org/jira/browse/HBASE-26202 Project: HBase Issue Type

Re: [DISCUSS] Hbase Backup design changes

2021-07-25 Thread Mallikarjun
Thanks Duo. --- Mallikarjun On Sun, Jul 25, 2021 at 7:32 PM 张铎(Duo Zhang) wrote: > Replied on jira. Please give more details about what you are doing in the > PR... > > Thanks. > > Mallikarjun 于2021年7月25日周日 上午10:48写道: > > > > Can someone review this pull r

Re: [DISCUSS] Hbase Backup design changes

2021-07-24 Thread Mallikarjun
Can someone review this pull request? https://github.com/apache/hbase/pull/3359 This change changes meta information for backup, if not part of hbase 3.0.0. It might have a lot of additional work to be put into executing the above mentioned plan. --- Mallikarjun On Thu, Feb 11, 2021 at 5:36 PM

[jira] [Created] (HBASE-26034) Add support to take multiple parallel backup

2021-06-27 Thread Mallikarjun (Jira)
Mallikarjun created HBASE-26034: --- Summary: Add support to take multiple parallel backup Key: HBASE-26034 URL: https://issues.apache.org/jira/browse/HBASE-26034 Project: HBase Issue Type

Re: Time for 3.0.0 release

2021-05-21 Thread Mallikarjun
For multi tenancy with favoured nodes, timeline looks unreasonable for 3.0. Can it be part of later 3.x releases? Or should it wait for 4.0? On Fri, May 21, 2021, 7:30 PM 张铎(Duo Zhang) wrote: > We already have the below big feature/changes for 3.0.0. > > Synchronous Replication > OpenTelemetry

[jira] [Created] (HBASE-25891) Simplify backup table to be able to maintain it

2021-05-15 Thread Mallikarjun (Jira)
Mallikarjun created HBASE-25891: --- Summary: Simplify backup table to be able to maintain it Key: HBASE-25891 URL: https://issues.apache.org/jira/browse/HBASE-25891 Project: HBase Issue Type

Re: [DISCUSS] Next 2.x releases

2021-05-15 Thread Mallikarjun
Inline On Wed, May 5, 2021 at 4:51 AM Sean Busbey wrote: > My understanding is that backup work is not ready for inclusion in 2.x. > > The talk of removing it from the master branch and proposed adoption of the > feature through more involvement from some community members were not so > long

Re: DISCUSS: Remove hbase-backup from master?

2021-05-13 Thread Mallikarjun
Sure. I have assigned it to myself. Will look into it. Last time I checked, I did not find any failed tests and it was not hadoop3 --- Mallikarjun On Fri, May 14, 2021 at 2:34 AM Nick Dimiduk wrote: > Hi Mallikarjun, > > I just saw a bunch of backup tests fail on an unrelated PR

[jira] [Created] (HBASE-25870) Search only ancestors instead of entire history instead for a particular backup

2021-05-08 Thread Mallikarjun (Jira)
Mallikarjun created HBASE-25870: --- Summary: Search only ancestors instead of entire history instead for a particular backup Key: HBASE-25870 URL: https://issues.apache.org/jira/browse/HBASE-25870

Re: [SURVEY] The current usage of favor node balancer across the community

2021-04-26 Thread Mallikarjun
Inline reply On Tue, Apr 27, 2021 at 1:03 AM Stack wrote: > On Mon, Apr 26, 2021 at 12:30 PM Stack wrote: > > > On Mon, Apr 26, 2021 at 8:10 AM Mallikarjun > > wrote: > > > >> We use FavoredStochasticBalancer, which by description says the same > t

Re: [SURVEY] The current usage of favor node balancer across the community

2021-04-26 Thread Mallikarjun
ables Hosted: 87 Capacity: 250 TB (100TB used) --- Mallikarjun On Mon, Apr 26, 2021 at 9:15 AM 张铎(Duo Zhang) wrote: > As you all know, we always want to reduce the size of the hbase-server > module. This time we want to separate the balancer related code to another > sub modul

[jira] [Created] (HBASE-25784) Support for Parallel Backups enabling multi tenancy

2021-04-17 Thread Mallikarjun (Jira)
Mallikarjun created HBASE-25784: --- Summary: Support for Parallel Backups enabling multi tenancy Key: HBASE-25784 URL: https://issues.apache.org/jira/browse/HBASE-25784 Project: HBase Issue Type

Re: [DISCUSS] Hbase Backup design changes

2021-02-11 Thread Mallikarjun
Slight modification to previous version --> https://ibb.co/Nttx3J1 --- Mallikarjun On Thu, Feb 11, 2021 at 8:12 AM Mallikarjun wrote: > Inline Reply > > On Wed, Feb 3, 2021 at 6:44 AM Sean Busbey wrote: > >> Hi Mallikarjun, >> >> Those goals sound worthwhil

Re: [DISCUSS] Hbase Backup design changes

2021-02-10 Thread Mallikarjun
Inline Reply On Wed, Feb 3, 2021 at 6:44 AM Sean Busbey wrote: > Hi Mallikarjun, > > Those goals sound worthwhile. > > Do you have a flow chart similar to the one you posted for the current > system but for the proposed solution? > This is what I am thinking -->

Re: [DISCUSS] Hbase Backup design changes

2021-02-08 Thread Mallikarjun
Hi Sean, I will get back with the design changes and the answers to above questions in a few days time. --- Mallikarjun On Wed, Feb 3, 2021 at 6:44 AM Sean Busbey wrote: > Hi Mallikarjun, > > Those goals sound worthwhile. > > Do you have a flow chart similar to the

Re: [DISCUSS] Hbase Backup design changes

2021-01-31 Thread Mallikarjun
e to concrete conclusion with the reviewer, we > should open up a PR. Until then this thread is anyways up for discussion. > > > On Mon, 25 Jan 2021 at 1:58 PM, Mallikarjun > wrote: > > > Hope this link works --> https://ibb.co/hYjRpgP > > > > Inline reply > &

Re: [DISCUSS] Hbase Backup design changes

2021-01-25 Thread Mallikarjun
ntain existing design and new design diagrams and > talk about pros and cons etc once we have things finalized. > > Since I wanted to open this for discussion, did not consider placing it in *hbase/dev_support/design-docs*. > > On Mon, 25 Jan 2021 at 12:13 PM, Mallikarjun &

Re: [DISCUSS] Hbase Backup design changes

2021-01-24 Thread Mallikarjun
Attached as image. Please let me know if it is availabe now. --- Mallikarjun On Mon, Jan 25, 2021 at 10:32 AM Sean Busbey wrote: > Hi! > > Thanks for the write up. unfortunately, your image for the existing > design didn't come through. Could you post it to some host and li

[DISCUSS] Hbase Backup design changes

2021-01-24 Thread Mallikarjun
: *I can't think of anything better, but I see this can be a potential problem. Also, one can force full backup if required WAL files are missing for whatever other reasons not necessarily mentioned above. --- Mallikarjun

[jira] [Resolved] (HBASE-14414) HBase Backup/Restore Phase 3

2021-01-19 Thread Mallikarjun (Jira)
[ https://issues.apache.org/jira/browse/HBASE-14414?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mallikarjun resolved HBASE-14414. - Resolution: Done > HBase Backup/Restore Phas

[jira] [Resolved] (HBASE-18892) B testing

2021-01-19 Thread Mallikarjun (Jira)
[ https://issues.apache.org/jira/browse/HBASE-18892?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mallikarjun resolved HBASE-18892. - Resolution: Resolved > B testing > --- > > Key:

[jira] [Created] (HBASE-25501) Backup not using parameters such as bandwidth, workers, etc while exporting snapshot

2021-01-12 Thread Mallikarjun (Jira)
Mallikarjun created HBASE-25501: --- Summary: Backup not using parameters such as bandwidth, workers, etc while exporting snapshot Key: HBASE-25501 URL: https://issues.apache.org/jira/browse/HBASE-25501

Re: DISCUSS: Remove hbase-backup from master?

2020-12-23 Thread Mallikarjun
Yea. I have noticed that. I have some patches ready and have to add unit tests. Will start raising in a couple of weeks time. --- Mallikarjun On Thu, Dec 24, 2020 at 7:48 AM 张铎(Duo Zhang) wrote: > The UTs in the backup module are easy to fail with NPE, I've seen this in > several pre

[jira] [Created] (HBASE-24931) Candidate Generator helper Action method ignoring 0th index region

2020-08-23 Thread Mallikarjun (Jira)
Mallikarjun created HBASE-24931: --- Summary: Candidate Generator helper Action method ignoring 0th index region Key: HBASE-24931 URL: https://issues.apache.org/jira/browse/HBASE-24931 Project: HBase

[jira] [Created] (HBASE-24157) RSGroup Aware Export Snapshot

2020-04-09 Thread Mallikarjun (Jira)
Mallikarjun created HBASE-24157: --- Summary: RSGroup Aware Export Snapshot Key: HBASE-24157 URL: https://issues.apache.org/jira/browse/HBASE-24157 Project: HBase Issue Type: Improvement