CFP for Dataworks Summit, San Jose, 2018

2018-02-06 Thread Devaraj Das
All, Dataworks Summit San Jose 2018 is June 17-21. The call for abstracts is open through February 9th. Tracks like Datawarehousing and Operational Data Store might be a good fit for HBase & Phoenix talks. You can submit an abstract at https://dataworkssummit.com/san-jose-2018/​​ Thanks,

Re: [ANNOUNCE] Chunhui Shen joins the Apache HBase PMC

2017-07-06 Thread Devaraj Das
Congratulations, Chunhui! From: Yu Li Sent: Monday, July 03, 2017 10:24 PM To: dev@hbase.apache.org; Hbase-User Subject: [ANNOUNCE] Chunhui Shen joins the Apache HBase PMC On behalf of the Apache HBase PMC I am pleased to announce that

Re: [ANNOUNCE] Devaraj Das joins the Apache HBase PMC

2017-07-06 Thread Devaraj Das
Thanks, everyone!! From: Phil Yang <ud1...@gmail.com> Sent: Thursday, July 06, 2017 1:45 AM To: HBase Dev List Subject: Re: [ANNOUNCE] Devaraj Das joins the Apache HBase PMC Congratulations! Thanks, Phil 2017-07-06 15:39 GMT+08:00 Chia-Ping Tsai

Re: Problem with IntegrationTestRegionReplicaReplication

2017-06-18 Thread Devaraj Das
<mailto:psomo...@cloudera.com>> wrote: I'm using hbase based on 1.2 version. On Sat, Jun 17, 2017 at 4:00 PM, Devaraj Das wrote: > Peter which version of HBase are tou testing with? > > > > > On Thu, Jun 15, 2017 at 11:57 PM -0700, "Peter Somogyi" < > psomo...@

Re: Problem with IntegrationTestRegionReplicaReplication

2017-06-17 Thread Devaraj Das
ws were not replicated to the replicas just after I called flush manually. I think memstore replication is not working on my system even though it is enabled in the configuration. I will look into it today. On Fri, Jun 16, 2017 at 7:09 AM, Devaraj Das wrote: > Peter, do have a look at IntegrationTestRegi

Re: Problem with IntegrationTestRegionReplicaReplication

2017-06-14 Thread Devaraj Das
That sounds about right, Josh. Peter, in our internal testing we have seen this test failing and increasing timeouts (look at the test code options to do with increasing timeout) helped quite some. From: Josh Elser Sent: Wednesday,

[jira] [Created] (HBASE-18214) Replace the folly::AtomicHashMap usage in the RPC layer

2017-06-13 Thread Devaraj Das (JIRA)
Devaraj Das created HBASE-18214: --- Summary: Replace the folly::AtomicHashMap usage in the RPC layer Key: HBASE-18214 URL: https://issues.apache.org/jira/browse/HBASE-18214 Project: HBase Issue

Re: CFP for Dataworks Summit Sydney

2017-05-04 Thread Devaraj Das
I meant HBase. Oops :) From: Devaraj Das Sent: Thursday, May 04, 2017 12:51 PM To: u...@hbase.apache.org; dev@hbase.apache.org Subject: CFP for Dataworks Summit Sydney The Australia/Pacific version of Dataworks Summit is in Sydney this year, September 20

CFP for Dataworks Summit Sydney

2017-05-04 Thread Devaraj Das
The Australia/Pacific version of Dataworks Summit is in Sydney this year, September 20-21. This is a great place to talk about work you are doing in Apache Knox or how you are using Knox. Information on submitting an abstract is at

Re: [VOTE] Backup/Restore feature for HBase 2.0, vote closing 3/11/2017

2017-03-13 Thread Devaraj Das
Vlad, on the first point, I think what Stack is saying is that creating the new branch (as Ted did) ignores the feedback incorporated thus far in the iterations of the mega-patch. That's a wrong way to go. On the separation into a backup module, again, that was reverted to ease reviews of the

DataWorks Summit/Hadoop Summit - Call for abstracts

2017-02-07 Thread Devaraj Das
?Just a quick note on the DataWorks Summit / Hadoop Summit Should have sent this across earlier but anyway.. The DataWorks Summit/Hadoop Summit Organizing Committee invites you to submit an abstract to be considered for the summit in San Jose on June 13-15.

Re: [DISCUSSION] Merge Backup / Restore - Branch HBASE-7912

2016-11-22 Thread Devaraj Das
tools, especially to try to unify and make > > > simple the backup experience (simple example: in some case there is a > > > backup_id argument in others a backupId argument. or things like.. > > restore > > > is not clear if given an incremental id it will do the full restore > from > > > full up to that point or if i need to apply manually everything). > > > > > > in conclusion, I think we can open a merge vote. I'll be +1 on it, and > I > > > think we should try to reject -1 with just a "code cleanup" motivation, > > > since there will still be work going on on the code after the merge. > > > > > > Matteo > > > > > > > > > On Sun, Nov 6, 2016 at 10:54 PM, Devaraj Das <d...@hortonworks.com> > > wrote: > > > > > > > Stack and others, anything else on the patch? Merge to master now? > > > > > > > > > >

Re: [DISCUSS] hbase-spark module in branch-1 and branch-2

2016-11-21 Thread Devaraj Das
Hi Sean, I did a quick check with someone from the Spark team here and his opinion was that the hbase-spark module as it currently stands can be used by downstream users to do basic stuff and to try some simple things out, etc. The integration is improving. I think we should get what we have in

Re: Status of HBASE-4755?

2016-11-11 Thread Devaraj Das
Lars, the work to complete this is happening over in https://issues.apache.org/jira/browse/HBASE-15531. Thiruvel and Francis are bringing to Apache what they have deployed in prod at Yahoo. I believe RegionPlacementMaintainer is not being run in their prod. Correct me if I am wrong,

Re: [DISCUSSION] Merge Backup / Restore - Branch HBASE-7912

2016-11-06 Thread Devaraj Das
t 10, 2016 at 3:52 PM, Vladimir Rodionov > < > > > >>>> >>> >> > > > vladrodio...@gmail.com > > > >>>> >>> >> > > > > > > > > >>>> >>> >> > > > > wrote: > > > >>>> >>> >> > > > > > >

[jira] [Created] (HBASE-16849) Document for HBASE-14918 (in-memory flushes/compactions)

2016-10-14 Thread Devaraj Das (JIRA)
Devaraj Das created HBASE-16849: --- Summary: Document for HBASE-14918 (in-memory flushes/compactions) Key: HBASE-16849 URL: https://issues.apache.org/jira/browse/HBASE-16849 Project: HBase Issue

Re: [DISCUSSION] Merge Backup / Restore - Branch HBASE-7912

2016-10-12 Thread Devaraj Das
MR from command-line. >>> >> > > > > >> > > 5. Security was simplified and now only super-user is >>> >> allowed >>> >> > to >>> >> > > > run >>> >> > > > > >> > > backup/restores. >>> >> > > &g

Re: Issues while running HBase native client build (Ref: HBASE-14850)

2016-10-07 Thread Devaraj Das
Enis, the last time around, the RPC wasn't based on Folly... Sudeep is trying to POC an implementation of an async RPC based on Folly, and is facing issues with the Folly library. Elliott, any chance you could help here please. From: Enis Söztutar

Re: Backup Implementation (WAS => Re: [DISCUSSION] MR jobs started by Master or RS)

2016-10-05 Thread Devaraj Das
've developed them (like > the region mover and canary stuff). I suspect we will have some adoption of > this tooling and further refinement insofar it fits into a backup workflow > at 30kft view using snapshots, replication (or file shipping), and WAL > replay. > > > On Mon, Sep

Re: Backup Implementation (WAS => Re: [DISCUSSION] MR jobs started by Master or RS)

2016-09-26 Thread Devaraj Das
;>>>> reply) > > >>>>>>>>>>> over MR, because some cluster may not want or may have an > > >>>>>>>>>>> external/uncontrolled MR setup. > > >>>>>>>>>>> > > >>>

Re: [DISCUSSION] MR jobs started by Master or RS

2016-09-23 Thread Devaraj Das
Can > someone > > > > help > > > > > taking a simple look at it? This is what I mean, ugly code... > logout > > > and > > > > > destroy the credentials in a subject when it is still being used, > and > > > > > declared as Limit

Re: [DISCUSSION] MR jobs started by Master or RS

2016-09-22 Thread Devaraj Das
k for distributed operations is abstract and allows different implementations. MR is just one implementation we provide. -Vlad On Thu, Sep 22, 2016 at 9:38 PM, Devaraj Das <d...@hortonworks.com> wrote: > Guys, first off apologies for bringing in the topic of MR-based > com

Re: [DISCUSSION] MR jobs started by Master or RS

2016-09-22 Thread Devaraj Das
aunch > >>>>>> the jobs from outside manually or by other services. > >>>>>> > >>>>>> 2016-09-23 9:47 GMT+08:00 Andrew Purtell <andrew.purt...@gmail.com > >: > >>>>>> > >>>>>>> Ok, g

Re: [DISCUSSION] MR jobs started by Master or RS

2016-09-22 Thread Devaraj Das
t;> backups too, but don't want to bother having to install and configure > YARN > >> just for that, as well as removing resources from HBase to give it to > >> yarn > >> > >> JMS > >> > >> 2016-09-22 18:44 GMT-04:00 Matteo Bertozz

Re: [DISCUSSION] MR jobs started by Master or RS

2016-09-22 Thread Devaraj Das
R jobs from Master and RSs code?" since this will be the first time we do this Matteo On Thu, Sep 22, 2016 at 2:49 PM, Devaraj Das <d...@hortonworks.com> wrote: > Very much agree; for tools like ExportSnapshot / Backup / Restore, it's > fine to be dependent on MR. MR is the

Re: [DISCUSSION] MR jobs started by Master or RS

2016-09-22 Thread Devaraj Das
Very much agree; for tools like ExportSnapshot / Backup / Restore, it's fine to be dependent on MR. MR is the right framework for such. We should also do compactions using MR (just saying :) ) From: Ted Yu Sent: Thursday, September

Re: [DISCUSSION] Merge Backup / Restore - Branch HBASE-7912

2016-09-20 Thread Devaraj Das
Just reviving this thread. Thanks Sean, Stack, Dima, and others for the thorough reviews and testing. Thanks Ted and Vlad for taking care of the feedback. Are we all good to do the merge now? Rather do sooner than later. From: saint@gmail.com

Re: [DISCUSSION] Merge Backup / Restore - Branch HBASE-7912

2016-09-02 Thread Devaraj Das
+1 for merge of HBASE-7912 to master. I think this feature can go in in its present form and bake for sometime in the master. Work is continuing to harden it. From: Vladimir Rodionov Sent: Friday, September 02, 2016 8:51 AM To:

Re: Hangouts for C++ client discussions

2016-05-04 Thread Devaraj Das
The link is not working for me Enis Sent from Outlook Mobile On Tue, May 3, 2016 at 11:58 AM -0700, "Enis Söztutar" > wrote: Devs, If you have been following, we have two initiatives for writing a C++ client for HBase. We are

Re: What's going on? Two C++ clients being developed

2016-05-02 Thread Devaraj Das
(Meant to send this earlier but got delayed) Thanks Clay for the inputs. Would like to give a quick update on where we are at this point and solicit thoughts on how to proceed from here: 1. The patch (from Vamsi) that has been uploaded on RB last has the copyright and other license related

Re: What's going on? Two C++ clients being developed at the moment?

2016-04-18 Thread Devaraj Das
:57 PM, Devaraj Das <d...@hortonworks.com> wrote: > 1. Be able to do async RPC. Vamsi's current implementation does sync. I > know Vamsi is already looking at that aspect. Just to be clear, this in my > mind this doesn't qualify as a blocker - since we don't have an async > client API to

Re: [DISCUSS] Criteria for including MOB feature backport in branch-1

2016-03-03 Thread Devaraj Das
Thanks for chiming in Jincheng. Really appreciated. But from this thread, it's apparent that people don't have enough enthusiasm to see this backported in branch-1. So, maybe what would be really nice to instead do is to make sure that MOB is performant / reliable / releasable in the HBASE-2.0

Re: MOB in branch-1? (Re: [RESULT][VOTE] Merge branch hbase-11339 HBase MOB to trunk)

2016-03-02 Thread Devaraj Das
personally reproduce > afterward (I'm not volunteering to do Ted's necessary legwork) - done with > branch-1 with the proposed patch applied. We are not there yet though, > barely, into review, but this will be coming up very soon. > > > >>> On Mar 2, 2016

Re: MOB in branch-1? (Re: [RESULT][VOTE] Merge branch hbase-11339 HBase MOB to trunk)

2016-03-02 Thread Devaraj Das
Stack, as things stand, Ted Yu has a patch that is a backport of MOB. He told me offline he has taken a look at the jiras that went in in the master that is to do with MOB, and got them in the backport. Now, to your point, I agree that someone familiar with MOB code should do the backport but

[jira] [Reopened] (HBASE-8549) Integrate Favored Nodes into StochasticLoadBalancer

2015-12-22 Thread Devaraj Das (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-8549?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Devaraj Das reopened HBASE-8549: I was discussing this offline with [~toffer], and there is a patch that Yahoo has developed

[jira] [Created] (HBASE-14963) Remove Guava dependency from HBase client code

2015-12-10 Thread Devaraj Das (JIRA)
Devaraj Das created HBASE-14963: --- Summary: Remove Guava dependency from HBase client code Key: HBASE-14963 URL: https://issues.apache.org/jira/browse/HBASE-14963 Project: HBase Issue Type

[jira] [Created] (HBASE-14536) Balancer & SSH interfering with each other leading to unavailability

2015-10-01 Thread Devaraj Das (JIRA)
Devaraj Das created HBASE-14536: --- Summary: Balancer & SSH interfering with each other leading to unavailability Key: HBASE-14536 URL: https://issues.apache.org/jira/browse/HBASE-14536 Project: H

Re: Please welcome new HBase committer Stephen Yuan Jiang

2015-08-21 Thread Devaraj Das
Congratulations Stephen! On Aug 20, 2015, at 7:10 PM, Andrew Purtell apurt...@apache.org wrote: On behalf of the Apache HBase PMC, I am pleased to announce that Stephen Jiang has accepted the PMC's invitation to become a committer on the project. We appreciate all of Stephen's hard work and

[jira] [Created] (HBASE-13938) Deletes done during the region merge transaction may get eclipsed

2015-06-18 Thread Devaraj Das (JIRA)
Devaraj Das created HBASE-13938: --- Summary: Deletes done during the region merge transaction may get eclipsed Key: HBASE-13938 URL: https://issues.apache.org/jira/browse/HBASE-13938 Project: HBase

Re: HBCK question: Exception in checkRegionConsistency() would kill HBCK

2015-04-23 Thread Devaraj Das
I think it makes sense to continue to the other regions and eventually list out the regions that couldn't be fixed. From: Stephen Jiang syuanjiang...@gmail.com Sent: Wednesday, April 22, 2015 3:52 PM To: dev@hbase.apache.org Subject: HBCK question:

[jira] [Resolved] (HBASE-10491) RegionLocations::getRegionLocation can return unexpected replica

2015-04-16 Thread Devaraj Das (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-10491?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Devaraj Das resolved HBASE-10491. - Resolution: Later RegionLocations::getRegionLocation can return unexpected replica

[jira] [Resolved] (HBASE-11634) Disallow non-atomic update operations when TIMELINE consistency is enabled

2015-04-16 Thread Devaraj Das (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-11634?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Devaraj Das resolved HBASE-11634. - Resolution: Later Not clear what to do here. Please reopen when it is clearer. Disallow non

[jira] [Created] (HBASE-13460) Revise the MetaLookupPool executor-related defaults (introduced in HBASE-13036)

2015-04-13 Thread Devaraj Das (JIRA)
Devaraj Das created HBASE-13460: --- Summary: Revise the MetaLookupPool executor-related defaults (introduced in HBASE-13036) Key: HBASE-13460 URL: https://issues.apache.org/jira/browse/HBASE-13460

[jira] [Created] (HBASE-13375) Provide HBase superuser higher priority over other users in the RPC handling

2015-03-31 Thread Devaraj Das (JIRA)
Devaraj Das created HBASE-13375: --- Summary: Provide HBase superuser higher priority over other users in the RPC handling Key: HBASE-13375 URL: https://issues.apache.org/jira/browse/HBASE-13375 Project

[jira] [Resolved] (HBASE-9738) Delete table and loadbalancer interference

2015-03-30 Thread Devaraj Das (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-9738?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Devaraj Das resolved HBASE-9738. Resolution: Fixed Thanks for checking [~mantonov]. I think this got fixed by HBASE-10349. Delete

[jira] [Created] (HBASE-13330) Region left unassigned due to AM SSH each thinking the assignment would be done by the other

2015-03-24 Thread Devaraj Das (JIRA)
Devaraj Das created HBASE-13330: --- Summary: Region left unassigned due to AM SSH each thinking the assignment would be done by the other Key: HBASE-13330 URL: https://issues.apache.org/jira/browse/HBASE-13330

[jira] [Created] (HBASE-13192) IntegrationTestBulkLoad doesn't wait for table modification sometimes leading to spurious test failures

2015-03-10 Thread Devaraj Das (JIRA)
Devaraj Das created HBASE-13192: --- Summary: IntegrationTestBulkLoad doesn't wait for table modification sometimes leading to spurious test failures Key: HBASE-13192 URL: https://issues.apache.org/jira/browse/HBASE

[jira] [Created] (HBASE-13067) Fix caching of stubs to allow IP address changes of restarted remote servers

2015-02-18 Thread Devaraj Das (JIRA)
Devaraj Das created HBASE-13067: --- Summary: Fix caching of stubs to allow IP address changes of restarted remote servers Key: HBASE-13067 URL: https://issues.apache.org/jira/browse/HBASE-13067 Project

[jira] [Created] (HBASE-13036) Meta scanner should use its own threadpool

2015-02-12 Thread Devaraj Das (JIRA)
Devaraj Das created HBASE-13036: --- Summary: Meta scanner should use its own threadpool Key: HBASE-13036 URL: https://issues.apache.org/jira/browse/HBASE-13036 Project: HBase Issue Type: Bug

[jira] [Reopened] (HBASE-11568) Async WAL replication for region replicas

2015-02-04 Thread Devaraj Das (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-11568?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Devaraj Das reopened HBASE-11568: - Reopening for branch-1 commit Async WAL replication for region replicas

[jira] [Resolved] (HBASE-6006) TestDelayedRpc is flaky

2015-01-07 Thread Devaraj Das (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-6006?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Devaraj Das resolved HBASE-6006. Resolution: Not a Problem Haven't seen it failing in a while now. Resolving. TestDelayedRpc

[jira] [Reopened] (HBASE-10844) Coprocessor failure during batchmutation leaves the memstore datastructs in an inconsistent state

2014-11-21 Thread Devaraj Das (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-10844?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Devaraj Das reopened HBASE-10844: - Thinking about it (and in offline discussions with [~jeffreyz] and [~enis]), it seems we should

[jira] [Created] (HBASE-12548) Improve debuggability of IntegrationTestTimeBoundedRequestsWithRegionReplicas

2014-11-20 Thread Devaraj Das (JIRA)
Devaraj Das created HBASE-12548: --- Summary: Improve debuggability of IntegrationTestTimeBoundedRequestsWithRegionReplicas Key: HBASE-12548 URL: https://issues.apache.org/jira/browse/HBASE-12548 Project

[jira] [Created] (HBASE-12319) Inconsistencies during region recovery due to close/open of a region during recovery

2014-10-22 Thread Devaraj Das (JIRA)
Devaraj Das created HBASE-12319: --- Summary: Inconsistencies during region recovery due to close/open of a region during recovery Key: HBASE-12319 URL: https://issues.apache.org/jira/browse/HBASE-12319

[jira] [Created] (HBASE-12012) Improve cancellation for the scan RPCs

2014-09-17 Thread Devaraj Das (JIRA)
Devaraj Das created HBASE-12012: --- Summary: Improve cancellation for the scan RPCs Key: HBASE-12012 URL: https://issues.apache.org/jira/browse/HBASE-12012 Project: HBase Issue Type: Sub-task

Re: The 1st HBase 0.98.6.1 patch release candidate (RC0) is available, vote closing 9/16

2014-09-15 Thread Devaraj Das
+1 On Mon, Sep 15, 2014 at 8:31 AM, Andrew Purtell apurt...@apache.org wrote: HBASE-11972 came in after 0.98.6 was released, involving a fix committed to 0.98.6, where the fix is incomplete and table creation functionality is affected if security is active. I think it's necessary to push out

[jira] [Created] (HBASE-11972) The doAs user used in the update to hbase:acl table RPC is incorrect

2014-09-13 Thread Devaraj Das (JIRA)
Devaraj Das created HBASE-11972: --- Summary: The doAs user used in the update to hbase:acl table RPC is incorrect Key: HBASE-11972 URL: https://issues.apache.org/jira/browse/HBASE-11972 Project: HBase

[jira] [Created] (HBASE-11886) The creator of the table should have all permissions on the table

2014-09-02 Thread Devaraj Das (JIRA)
Devaraj Das created HBASE-11886: --- Summary: The creator of the table should have all permissions on the table Key: HBASE-11886 URL: https://issues.apache.org/jira/browse/HBASE-11886 Project: HBase

Re: ​The ​2nd HBase 0.98.6​ ​release candidate (RC​1) is available, vote closing 9/9/2014

2014-09-02 Thread Devaraj Das
I meant to send this mail earlier in the evening but wasn't able to.. Apologies. Andrew could you take a look at HBASE-11886 and see if it should be fixed in this release. I think it's a serious usability issue but will defer to your call. On Tue, Sep 2, 2014 at 10:17 PM, Andrew Purtell

Re: Dropping support for JDK6 in Apache Hadoop

2014-08-19 Thread Devaraj Das
I think we are good on HBase side, at least on the 1.x+ branches. We are dropping support for 1.6 from HBase-1.0 onwards. On Tue, Aug 19, 2014 at 10:52 AM, Arun C Murthy a...@hortonworks.com wrote: [Apologies for the wide distribution.] Dear HBase/Hive/Pig/Oozie communities, We, over at

Re: Failing region replica tests in trunk

2014-08-06 Thread Devaraj Das
Yeah the replica tests issues are due to turning on the zk-less assignment by default. If HBASE-11611 addresses the issues to do with zk-less assignments + replicas, let's wait for that. On Wed, Aug 6, 2014 at 3:10 PM, Stack st...@duboce.net wrote: Lets see if we see the above fail there where

[jira] [Reopened] (HBASE-11293) Master and Region servers fail to start when hbase.master.ipc.address=0.0.0.0, hbase.regionserver.ipc.address=0.0.0.0 and Kerberos is enabled

2014-07-07 Thread Devaraj Das (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-11293?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Devaraj Das reopened HBASE-11293: - [~miharp], this is not done yet. Trunk needs to have a patch. Master and Region servers fail

[jira] [Created] (HBASE-11344) Hide row keys and such from the web UIs

2014-06-13 Thread Devaraj Das (JIRA)
Devaraj Das created HBASE-11344: --- Summary: Hide row keys and such from the web UIs Key: HBASE-11344 URL: https://issues.apache.org/jira/browse/HBASE-11344 Project: HBase Issue Type

Re: [VOTE] Merge branch HBASE-10070 to trunk

2014-06-06 Thread Devaraj Das
+1 On Fri, Jun 6, 2014 at 2:13 PM, Andrew Purtell apurt...@apache.org wrote: +1, thanks Enis On Fri, Jun 6, 2014 at 1:46 PM, Enis Söztutar enis@gmail.com wrote: Sorry, I was mostly out for HadoopSummit. Yes, the git flow would be very similar to what you propose: $ git checkout

[jira] [Created] (HBASE-11261) Handle splitting of regions that have region_replication greater than one

2014-05-27 Thread Devaraj Das (JIRA)
Devaraj Das created HBASE-11261: --- Summary: Handle splitting of regions that have region_replication greater than one Key: HBASE-11261 URL: https://issues.apache.org/jira/browse/HBASE-11261 Project

[jira] [Resolved] (HBASE-10818) Add integration test for bulkload with replicas

2014-05-23 Thread Devaraj Das (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-10818?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Devaraj Das resolved HBASE-10818. - Resolution: Fixed Committed to the branch. Thanks Nick for the initial patches. Add

[jira] [Resolved] (HBASE-11214) Fixes for scans on a replicated table

2014-05-22 Thread Devaraj Das (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-11214?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Devaraj Das resolved HBASE-11214. - Resolution: Fixed Committed to hbase-10070 branch. Thanks for the review, Enis. Fixes

Re: [DISCUSSION] Update on HBASE-10070 / Merge into trunk

2014-05-21 Thread Devaraj Das
+1 for merge to trunk now. On Wed, May 21, 2014 at 5:08 PM, Enis Söztutar e...@apache.org wrote: Hi, We would like to give an update on the status of HBASE-10070 work, and open up discussion for how we can do further development. We seem to be at a point where we have the core functionality

[jira] [Created] (HBASE-11214) Fixes for scans on a replicated table

2014-05-20 Thread Devaraj Das (JIRA)
Devaraj Das created HBASE-11214: --- Summary: Fixes for scans on a replicated table Key: HBASE-11214 URL: https://issues.apache.org/jira/browse/HBASE-11214 Project: HBase Issue Type: Sub-task

[jira] [Created] (HBASE-11149) Wire encryption is broken

2014-05-16 Thread Devaraj Das (JIRA)
Devaraj Das created HBASE-11149: --- Summary: Wire encryption is broken Key: HBASE-11149 URL: https://issues.apache.org/jira/browse/HBASE-11149 Project: HBase Issue Type: Bug Components

[jira] [Created] (HBASE-10844) Coprocessor failure during batchmutation leaves the memstore datastructs in an inconsistent state

2014-03-26 Thread Devaraj Das (JIRA)
Devaraj Das created HBASE-10844: --- Summary: Coprocessor failure during batchmutation leaves the memstore datastructs in an inconsistent state Key: HBASE-10844 URL: https://issues.apache.org/jira/browse/HBASE-10844

[jira] [Created] (HBASE-10743) Replica map update is problematic in RegionStates

2014-03-13 Thread Devaraj Das (JIRA)
Devaraj Das created HBASE-10743: --- Summary: Replica map update is problematic in RegionStates Key: HBASE-10743 URL: https://issues.apache.org/jira/browse/HBASE-10743 Project: HBase Issue Type

[jira] [Resolved] (HBASE-10616) Integration test for multi-get calls

2014-03-13 Thread Devaraj Das (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-10616?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Devaraj Das resolved HBASE-10616. - Resolution: Fixed Integration test for multi-get calls

[jira] [Resolved] (HBASE-10743) Replica map update is problematic in RegionStates

2014-03-13 Thread Devaraj Das (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-10743?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Devaraj Das resolved HBASE-10743. - Resolution: Fixed Thanks for the quick review, Enis. Committed. Replica map update

[jira] [Created] (HBASE-10729) Enable table doesn't balance out replicas evenly if the replicas were unassigned earlier

2014-03-12 Thread Devaraj Das (JIRA)
Devaraj Das created HBASE-10729: --- Summary: Enable table doesn't balance out replicas evenly if the replicas were unassigned earlier Key: HBASE-10729 URL: https://issues.apache.org/jira/browse/HBASE-10729

[jira] [Created] (HBASE-10734) Fix RegionStates.getRegionAssignments to not add duplicate regions

2014-03-12 Thread Devaraj Das (JIRA)
Devaraj Das created HBASE-10734: --- Summary: Fix RegionStates.getRegionAssignments to not add duplicate regions Key: HBASE-10734 URL: https://issues.apache.org/jira/browse/HBASE-10734 Project: HBase

[jira] [Resolved] (HBASE-10729) Enable table doesn't balance out replicas evenly if the replicas were unassigned earlier

2014-03-12 Thread Devaraj Das (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-10729?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Devaraj Das resolved HBASE-10729. - Resolution: Fixed Enable table doesn't balance out replicas evenly if the replicas were

Re: Please welcome our newest committer, Mr. Honghua Feng

2014-03-12 Thread Devaraj Das
Congrats, Honghua. On Wed, Mar 12, 2014 at 3:38 PM, Enis Söztutar e...@apache.org wrote: Welcome! On Wed, Mar 12, 2014 at 3:33 PM, Nick Dimiduk ndimi...@gmail.com wrote: Well done! On Wed, Mar 12, 2014 at 3:30 PM, Elliott Clark ecl...@apache.org wrote: Welcome aboard. Congratulations

[jira] [Resolved] (HBASE-10734) Fix RegionStates.getRegionAssignments to not add duplicate regions

2014-03-12 Thread Devaraj Das (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-10734?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Devaraj Das resolved HBASE-10734. - Resolution: Fixed Committed. Fix RegionStates.getRegionAssignments to not add duplicate

[jira] [Resolved] (HBASE-10672) Table snapshot should handle tables whose REGION_REPLICATION is greater than one

2014-03-06 Thread Devaraj Das (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-10672?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Devaraj Das resolved HBASE-10672. - Resolution: Fixed Committed. Thanks for the reviews. Table snapshot should handle tables

[jira] [Resolved] (HBASE-10620) LoadBalancer.needsBalance() should check for co-located region replicas as well

2014-03-06 Thread Devaraj Das (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-10620?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Devaraj Das resolved HBASE-10620. - Resolution: Fixed Fix Version/s: hbase-10070 Committed. Thanks for the reviews

[jira] [Created] (HBASE-10672) Table snapshot should handle tables whose REGION_REPLICATION is greater than one

2014-03-04 Thread Devaraj Das (JIRA)
Devaraj Das created HBASE-10672: --- Summary: Table snapshot should handle tables whose REGION_REPLICATION is greater than one Key: HBASE-10672 URL: https://issues.apache.org/jira/browse/HBASE-10672

[jira] [Created] (HBASE-10674) HBCK should be updated to do replica related checks

2014-03-04 Thread Devaraj Das (JIRA)
Devaraj Das created HBASE-10674: --- Summary: HBCK should be updated to do replica related checks Key: HBASE-10674 URL: https://issues.apache.org/jira/browse/HBASE-10674 Project: HBase Issue Type

[jira] [Created] (HBASE-10633) StoreFileRefresherChore throws ConcurrentModificationException sometimes

2014-02-27 Thread Devaraj Das (JIRA)
Devaraj Das created HBASE-10633: --- Summary: StoreFileRefresherChore throws ConcurrentModificationException sometimes Key: HBASE-10633 URL: https://issues.apache.org/jira/browse/HBASE-10633 Project

[jira] [Created] (HBASE-10634) Multiget doesn't fully work

2014-02-27 Thread Devaraj Das (JIRA)
Devaraj Das created HBASE-10634: --- Summary: Multiget doesn't fully work Key: HBASE-10634 URL: https://issues.apache.org/jira/browse/HBASE-10634 Project: HBase Issue Type: Sub-task

[jira] [Resolved] (HBASE-10633) StoreFileRefresherChore throws ConcurrentModificationException sometimes

2014-02-27 Thread Devaraj Das (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-10633?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Devaraj Das resolved HBASE-10633. - Resolution: Fixed Fix Version/s: hbase-10070 Committed. Thanks for the quick review

[jira] [Resolved] (HBASE-10362) HBCK changes for supporting region replicas

2014-02-25 Thread Devaraj Das (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-10362?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Devaraj Das resolved HBASE-10362. - Resolution: Fixed Fix Version/s: (was: 0.99.0) hbase-10070 Thanks

[jira] [Created] (HBASE-10616) Integration test for multi-get calls

2014-02-25 Thread Devaraj Das (JIRA)
Devaraj Das created HBASE-10616: --- Summary: Integration test for multi-get calls Key: HBASE-10616 URL: https://issues.apache.org/jira/browse/HBASE-10616 Project: HBase Issue Type: Sub-task

[jira] [Resolved] (HBASE-10361) Enable/AlterTable support for region replicas

2014-02-19 Thread Devaraj Das (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-10361?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Devaraj Das resolved HBASE-10361. - Resolution: Fixed Fix Version/s: (was: 0.99.0) hbase-10070

Re: [PROPOSAL] HBASE-10070 branch

2014-01-15 Thread Devaraj Das
Some responses inline. Thanks for the inputs. On Wed, Jan 15, 2014 at 11:17 AM, Stack st...@duboce.net wrote: On Wed, Jan 15, 2014 at 12:44 AM, Enis Söztutar e...@hortonworks.comwrote: Hi, I just wanted to give some updates on the HBASE-10070 efforts from the technical side, and development

Re: [PROPOSAL] HBASE-10070 branch

2014-01-15 Thread Devaraj Das
On Wed, Jan 15, 2014 at 4:43 PM, Elliott Clark ecl...@apache.org wrote: On Wed, Jan 15, 2014 at 3:57 PM, Enis Söztutar enis@gmail.com wrote: I am afraid, it is not coprocessors or current set of plugins only. We need changes in the RPC, meta, region server, LB and master. Since we cannot

[jira] [Created] (HBASE-10333) Assignments are not retained on a cluster start

2014-01-13 Thread Devaraj Das (JIRA)
Devaraj Das created HBASE-10333: --- Summary: Assignments are not retained on a cluster start Key: HBASE-10333 URL: https://issues.apache.org/jira/browse/HBASE-10333 Project: HBase Issue Type

Re: Integration Test Slow Down

2013-12-05 Thread Devaraj Das
Elliott, do you know how much it takes without chaosmonkey (no failures at all). That would be another good data point I think. On Thu, Dec 5, 2013 at 2:52 PM, Elliott Clark ecl...@apache.org wrote: So I went and checked on the run times of Cloudera's internal integration test jenkins runs,

Re: [Shadow Regions / Read Replicas ] Wal per region?

2013-12-03 Thread Devaraj Das
On Mon, Dec 2, 2013 at 10:20 PM, Jonathan Hsieh j...@cloudera.com wrote: Deveraj: Jonathan Hsieh, WAL per region (WALpr) would give you the locality (and hence HDFS short circuit) of reads if you were to couple it with the favored nodes. The cost is of course more WAL files... In the

Re: [Shadow Regions / Read Replicas ]

2013-12-03 Thread Devaraj Das
On Tue, Dec 3, 2013 at 11:07 AM, Enis Söztutar e...@apache.org wrote: Thanks Jon for bringing this to dev@. On Mon, Dec 2, 2013 at 10:01 PM, Jonathan Hsieh j...@cloudera.com wrote: Fundamentally, I'd prefer focusing on making HBase HBasier instead of tackling a feature that other systems

Re: [Shadow Regions / Read Replicas ]

2013-12-03 Thread Devaraj Das
On Tue, Dec 3, 2013 at 12:31 PM, Vladimir Rodionov vladrodio...@gmail.comwrote: The downside: - Double/Triple memstore usage - Increased block cache usage (effectively, block cache will have 50% capacity may be less) These downsides are pretty serious ones. This will result: 1. in

Re: [Shadow Regions / Read Replicas ]

2013-12-03 Thread Devaraj Das
On Tue, Dec 3, 2013 at 6:47 PM, Jonathan Hsieh j...@cloudera.com wrote: On Tue, Dec 3, 2013 at 2:04 PM, Enis Söztutar enis@gmail.com wrote: On Tue, Dec 3, 2013 at 11:51 AM, Jonathan Hsieh j...@cloudera.com wrote: On Tue, Dec 3, 2013 at 11:07 AM, Enis Söztutar e...@apache.org

Re: [Shadow Regions / Read Replicas ] External replication disqualified?

2013-12-03 Thread Devaraj Das
On Tue, Dec 3, 2013 at 6:49 PM, Jonathan Hsieh j...@cloudera.com wrote: The read replicas doc mentions something a little more intrusive in the 3 options section but doesn't seem to disqualify it. I don't quite see what you are referring to actually... Can you please copy-paste a relevant

[jira] [Created] (HBASE-9866) Support the mode where REST server authorizes proxy users

2013-10-30 Thread Devaraj Das (JIRA)
Devaraj Das created HBASE-9866: -- Summary: Support the mode where REST server authorizes proxy users Key: HBASE-9866 URL: https://issues.apache.org/jira/browse/HBASE-9866 Project: HBase Issue

[jira] [Resolved] (HBASE-9777) Two consecutive RS crashes could lead to their SSH stepping on each other's toes and cause master abort

2013-10-16 Thread Devaraj Das (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-9777?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Devaraj Das resolved HBASE-9777. Resolution: Duplicate HBASE-9773 should fix this. Resolving. Two consecutive RS crashes could

  1   2   >