Re: Optimizing LoadIncrementalHFiles.java

2015-08-27 Thread Ted Yu
I looked at the code again. When number of HFiles to be loaded times number of column families is a big value, your suggestion may produce some speedup. If you have access to a cluster, you can measure potential savings in your approach. Cheers On Thu, Aug 27, 2015 at 5:08 PM, Ted Yu wrote: > A

Re: [VOTE] Third release candidate for HBase 1.0.2 (RC2) is available. Please vote by Aug 30 2015

2015-08-27 Thread Enis Söztutar
Here is my +1. Checked sigs, crcs, Checked files, layout and jars, Built with Hadoop-2.3+ Checked compat report Run local mode and simple smoke tests from shell Build with hbase-downstreamer Inspected logs, nothing out of ordinary Inspected the UI. Checked the compiled hadoop jar version Deployed

Re: [VOTE] Third release candidate for HBase 1.1.2 (RC2) is available

2015-08-27 Thread Enis Söztutar
Here is my +1. Checked sigs, crcs, Checked files, layout and jars, Built with Hadoop-2.3+ Checked compat report Run local mode and simple smoke tests from shell Build with hbase-downstreamer Inspected logs, nothing out of ordinary Inspected the UI. Checked the compiled hadoop jar version Deployed

Re: [VOTE] The 2nd HBase 0.98.14 release candidate (RC1) is available

2015-08-27 Thread Ted Yu
+1 built from the source ran test suite - passed exercised basic shell commands Cheers On Thu, Aug 27, 2015 at 4:03 PM, wrote: > +1 > - built from the source tag- installed with a one-node HDFS cluster > (2.4.1)- created a table, loaded 100m rows- checked an older 100m row table > that I had l

[jira] [Created] (HBASE-14330) Regular Expressions cause ipc.CallTimeoutException

2015-08-27 Thread JIRA
茂军王 created HBASE-14330: --- Summary: Regular Expressions cause ipc.CallTimeoutException Key: HBASE-14330 URL: https://issues.apache.org/jira/browse/HBASE-14330 Project: HBase Issue Type: Bug C

Re: Optimizing LoadIncrementalHFiles.java

2015-08-27 Thread Ted Yu
At roughly how many column families would this change show performance boost ? Cheers > On Aug 27, 2015, at 4:56 PM, Himanshu Verma > wrote: > > Hi, > > I was looking at following method: > > public void doBulkLoad(Path hfofDir, final Admin admin, Table table, >> >> RegionLocator reg

Optimizing LoadIncrementalHFiles.java

2015-08-27 Thread Himanshu Verma
Hi, I was looking at following method: public void doBulkLoad(Path hfofDir, final Admin admin, Table table, > > RegionLocator regionLocator) throws TableNotFoundException, > IOException { > We can optimize following part of this method: 353 ArrayList familyNames = new > ArrayLis

[jira] [Created] (HBASE-14329) Report region in transition only ever operates on one region

2015-08-27 Thread Elliott Clark (JIRA)
Elliott Clark created HBASE-14329: - Summary: Report region in transition only ever operates on one region Key: HBASE-14329 URL: https://issues.apache.org/jira/browse/HBASE-14329 Project: HBase

Re: [VOTE] The 2nd HBase 0.98.14 release candidate (RC1) is available

2015-08-27 Thread larsh
+1 - built from the source tag- installed with a one-node HDFS cluster (2.4.1)- created a table, loaded 100m rows- checked an older 100m row table that I had loaded with an earlier version - ran some tests, gets, large scans, etc, all checks out, correctness and performance wise. -- Lars

Re: Proposal: Matteo for 2.0.0 RM

2015-08-27 Thread larsh
+1 From: Stack To: HBase Dev List Sent: Thursday, August 27, 2015 10:22 AM Subject: Proposal: Matteo for 2.0.0 RM Last night at the HBase dev workshop, during discussion of 2.0.0 (what will be in it, when will it come out), it was noted that there is as yet no RM for hbase-2.0.0. A

[jira] [Resolved] (HBASE-13339) Update default Hadoop version to latest for master

2015-08-27 Thread Elliott Clark (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-13339?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Elliott Clark resolved HBASE-13339. --- Resolution: Fixed Fix Version/s: (was: 1.2.0) Release Note: Master/2.0.0 now b

Re: Notes from last nights HBase Dev Workshop

2015-08-27 Thread Stack
EXTRA! EXTRA! Ram and Anoop sent in this status on offheaping/cellify-ing the read-path: https://drive.google.com/file/d/0B4a3E58mCyOfc2s1MUg0eTlTeWxXOWVCZ25pcVN5R3lJZzl3/view?usp=sharing On Thu, Aug 27, 2015 at 10:19 AM, Stack wrote: > See here for notes on what we discussed last night at the d

Re: [VOTE] Third release candidate for HBase 1.1.2 (RC2) is available

2015-08-27 Thread Ted Yu
+1 based on the following: verified signatures ran unit test suite - pass loaded onto a small cluster and performed sanity checks (hbase shell, UI, etc) Cheers On Wed, Aug 26, 2015 at 9:16 PM, Nick Dimiduk wrote: > Hello again devs, > > This "third time's the charm" edition release candidate o

[jira] [Created] (HBASE-14328) WebUI error 500 table doesn't exist

2015-08-27 Thread Jean-Marc Spaggiari (JIRA)
Jean-Marc Spaggiari created HBASE-14328: --- Summary: WebUI error 500 table doesn't exist Key: HBASE-14328 URL: https://issues.apache.org/jira/browse/HBASE-14328 Project: HBase Issue Type:

[jira] [Created] (HBASE-14327) TestIOFencing#testFencingAroundCompactionAfterWALSync is flaky

2015-08-27 Thread Dima Spivak (JIRA)
Dima Spivak created HBASE-14327: --- Summary: TestIOFencing#testFencingAroundCompactionAfterWALSync is flaky Key: HBASE-14327 URL: https://issues.apache.org/jira/browse/HBASE-14327 Project: HBase

[jira] [Resolved] (HBASE-14263) ExploringCompactionPolicy logic around file selection is broken

2015-08-27 Thread Vladimir Rodionov (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-14263?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vladimir Rodionov resolved HBASE-14263. --- Resolution: Invalid Invalid. I will open doc JIRA instead. > ExploringCompactionPoli

Re: Question on hbase.client.scanner.timeout.period

2015-08-27 Thread Stack
On Thu, Aug 27, 2015 at 1:39 PM, Eric Owhadi wrote: > Oops, my bad, the related JIRA was : > https://issues.apache.org/jira/browse/HBASE-2161 > > I am suggesting that the special code client side in loadCache() of > ClientScanner that is trapping the UnknownScannerException, then on purpose > che

[jira] [Created] (HBASE-14326) HBase book: fix definition of max min size to compact

2015-08-27 Thread Vladimir Rodionov (JIRA)
Vladimir Rodionov created HBASE-14326: - Summary: HBase book: fix definition of max min size to compact Key: HBASE-14326 URL: https://issues.apache.org/jira/browse/HBASE-14326 Project: HBase

RE: Question on hbase.client.scanner.timeout.period

2015-08-27 Thread Eric Owhadi
Oops, my bad, the related JIRA was : https://issues.apache.org/jira/browse/HBASE-2161 I am suggesting that the special code client side in loadCache() of ClientScanner that is trapping the UnknownScannerException, then on purpose check if it is coming from a lease timeout (and not by a region move

Re: Question on hbase.client.scanner.timeout.period

2015-08-27 Thread Stack
On Tue, Aug 25, 2015 at 8:03 AM, Eric Owhadi wrote: > Hello St.Ack, > Thanks for your pointer, but I had already investigated JIRA > https://issues.apache.org/jira/browse/HBASE-13090 > Unfortunately, this heartbeat will protect against rpc timeout, not server > side lease timeout that we are expe

Re: Proposal: Matteo for 2.0.0 RM

2015-08-27 Thread Jerry He
Good work for you, Matteo. +1 On Thu, Aug 27, 2015 at 11:31 AM, Srikanth Srungarapu wrote: > +1 > > On Thu, Aug 27, 2015 at 11:29 AM Andrew Purtell > wrote: > > > +1 > > > > On Thu, Aug 27, 2015 at 10:22 AM, Stack wrote: > > > > > Last night at the HBase dev workshop, during discussion of 2.0

Re: Proposal: Matteo for 2.0.0 RM

2015-08-27 Thread Esteban Gutierrez
+1 -- Cloudera, Inc. On Thu, Aug 27, 2015 at 11:28 AM, Andrew Purtell wrote: > +1 > > On Thu, Aug 27, 2015 at 10:22 AM, Stack wrote: > > > Last night at the HBase dev workshop, during discussion of 2.0.0 (what > will > > be in it, when will it come out), it was noted that there is as yet no R

Re: Proposal: Matteo for 2.0.0 RM

2015-08-27 Thread Srikanth Srungarapu
+1 On Thu, Aug 27, 2015 at 11:29 AM Andrew Purtell wrote: > +1 > > On Thu, Aug 27, 2015 at 10:22 AM, Stack wrote: > > > Last night at the HBase dev workshop, during discussion of 2.0.0 (what > will > > be in it, when will it come out), it was noted that there is as yet no RM > > for hbase-2.0.0

Re: Proposal: Matteo for 2.0.0 RM

2015-08-27 Thread Andrew Purtell
+1 On Thu, Aug 27, 2015 at 10:22 AM, Stack wrote: > Last night at the HBase dev workshop, during discussion of 2.0.0 (what will > be in it, when will it come out), it was noted that there is as yet no RM > for hbase-2.0.0. > > A bunch of us suggested Matteo and he was up for it. > > Folks good w

Re: Proposal: Matteo for 2.0.0 RM

2015-08-27 Thread Nick Dimiduk
Sounds good to me. Have at it Matteo! On Thursday, August 27, 2015, Stack wrote: > Last night at the HBase dev workshop, during discussion of 2.0.0 (what will > be in it, when will it come out), it was noted that there is as yet no RM > for hbase-2.0.0. > > A bunch of us suggested Matteo and he

Re: Proposal: Matteo for 2.0.0 RM

2015-08-27 Thread Ted Yu
+1 as well > On Aug 27, 2015, at 10:50 AM, Elliott Clark wrote: > >> On Thu, Aug 27, 2015 at 10:22 AM, Stack wrote: >> >> Folks good with that? > > > +1 for Matteo for 2.0/Master RM

Re: Proposal: Matteo for 2.0.0 RM

2015-08-27 Thread Mikhail Antonov
+1 for Matteo (non-binding) On Thu, Aug 27, 2015 at 10:59 AM, Enis Söztutar wrote: > +1. > > Enis > > On Thu, Aug 27, 2015 at 10:50 AM, Elliott Clark wrote: > >> On Thu, Aug 27, 2015 at 10:22 AM, Stack wrote: >> >> > Folks good with that? >> >> >> +1 for Matteo for 2.0/Master RM >> -- Thank

Re: Proposal: Matteo for 2.0.0 RM

2015-08-27 Thread Enis Söztutar
+1. Enis On Thu, Aug 27, 2015 at 10:50 AM, Elliott Clark wrote: > On Thu, Aug 27, 2015 at 10:22 AM, Stack wrote: > > > Folks good with that? > > > +1 for Matteo for 2.0/Master RM >

Re: Proposal: Matteo for 2.0.0 RM

2015-08-27 Thread Elliott Clark
On Thu, Aug 27, 2015 at 10:22 AM, Stack wrote: > Folks good with that? +1 for Matteo for 2.0/Master RM

Proposal: Matteo for 2.0.0 RM

2015-08-27 Thread Stack
Last night at the HBase dev workshop, during discussion of 2.0.0 (what will be in it, when will it come out), it was noted that there is as yet no RM for hbase-2.0.0. A bunch of us suggested Matteo and he was up for it. Folks good with that? Anyone else interested in being RM? +1 on Matteo from

Notes from last nights HBase Dev Workshop

2015-08-27 Thread Stack
See here for notes on what we discussed last night at the dev workshop: https://docs.google.com/document/d/12ck4lXR1NYzNr2EN2-6l2MbLuGOejv8gyVG96SQ5Zq4/edit?usp=sharing Thanks to all those who showed up, St.Ack

[jira] [Created] (HBASE-14325) Add snapshotinfo command to hbase script

2015-08-27 Thread Samir Ahmic (JIRA)
Samir Ahmic created HBASE-14325: --- Summary: Add snapshotinfo command to hbase script Key: HBASE-14325 URL: https://issues.apache.org/jira/browse/HBASE-14325 Project: HBase Issue Type: Improvemen

[jira] [Created] (HBASE-14324) MetricSampleQuantiles maintains quantiles summary in a wrong way

2015-08-27 Thread Rafi Shachar (JIRA)
Rafi Shachar created HBASE-14324: Summary: MetricSampleQuantiles maintains quantiles summary in a wrong way Key: HBASE-14324 URL: https://issues.apache.org/jira/browse/HBASE-14324 Project: HBase

[jira] [Created] (HBASE-14323) Encoding rpc payload instead of compression

2015-08-27 Thread binlijin (JIRA)
binlijin created HBASE-14323: Summary: Encoding rpc payload instead of compression Key: HBASE-14323 URL: https://issues.apache.org/jira/browse/HBASE-14323 Project: HBase Issue Type: New Feature