[ANNOUNCE] New HBase committer Lars Francke

2017-10-25 Thread Lars George
On behalf of the Apache HBase PMC, I am pleased to announce that Lars Francke has accepted the PMC's invitation to become a committer on the project. We appreciate all of Lars' great work thus far and look forward to continued involvement. Please join me in congratulating LarsF! (Opting to use

HBase Backup Mode

2017-09-01 Thread Lars George
Hi, I stumbled across this: hbase-server/src/main/java/org/apache/hadoop/hbase/backup/example/HFileArchiveManager.java I am wondering what the state of this is. Also, why is this in an _example_ package, if it is usable code. Should be in `util` or so instead? If it isn't really used at all or

Max queue size in replication

2017-08-25 Thread Lars George
Hi, I am looking at the replication code, and it has this line: this.queueSizePerGroup = this.conf.getInt("hbase.regionserver.maxlogs", 32); This drives the queue size accepting more WAL files. But we have a different computation now, using the heap size instead, so often have a maxlogs > 32 in

Re: Tags class using wrong length?

2017-08-07 Thread Lars George
th); >>>pos = Bytes.putByte(bytes, pos, tagType); >>>Bytes.putBytes(bytes, pos, tag, 0, tag.length); >>>this.type = tagType; >>> } >>> The layout of the byte array should be: >>> |tag legnth (2 bytes)|tag type(1 byte)|tag| >>

Re: Tags class using wrong length?

2017-08-06 Thread Lars George
nth (2 bytes)|tag type(1 byte)|tag| > > It seems to me that the "bytes[offset + TYPE_LENGTH_SIZE]" is correct. > > On 2017-08-06 16:35, Lars George <lars.geo...@gmail.com> wrote: >> Hi, >> >> I found this reading through tags in 1.3, but checked in trunk as

Re: Bug in FIFOCompactionPolicy pre-checks?

2017-08-06 Thread Lars George
Cool, thanks Vlad. Filed https://issues.apache.org/jira/browse/HBASE-18526 On Fri, Aug 4, 2017 at 7:53 PM, Vladimir Rodionov <vladrodio...@gmail.com> wrote: > Yes, file a JIRA, Lars > > I will take a look > > -Vlad > > > On Thu, Aug 3, 2017 at 11:41 PM, Lars George

[jira] [Created] (HBASE-18526) FIFOCompactionPolicy pre-check uses wrong scope

2017-08-06 Thread Lars George (JIRA)
Lars George created HBASE-18526: --- Summary: FIFOCompactionPolicy pre-check uses wrong scope Key: HBASE-18526 URL: https://issues.apache.org/jira/browse/HBASE-18526 Project: HBase Issue Type

Tags class using wrong length?

2017-08-06 Thread Lars George
Hi, I found this reading through tags in 1.3, but checked in trunk as well. There is this code: public ArrayBackedTag(byte[] bytes, int offset, int length) { if (length > MAX_TAG_LENGTH) { throw new IllegalArgumentException( "Invalid tag data being passed. Its length can

Bug in FIFOCompactionPolicy pre-checks?

2017-08-04 Thread Lars George
Hi, See https://issues.apache.org/jira/browse/HBASE-14468 It adds this check to {{HMaster.checkCompactionPolicy()}}: {code} // 1. Check TTL if (hcd.getTimeToLive() == HColumnDescriptor.DEFAULT_TTL) { message = "Default TTL is not supported for FIFO compaction"; throw new

[jira] [Created] (HBASE-18473) VC.listLabels() erroneously closes any connection

2017-07-28 Thread Lars George (JIRA)
Lars George created HBASE-18473: --- Summary: VC.listLabels() erroneously closes any connection Key: HBASE-18473 URL: https://issues.apache.org/jira/browse/HBASE-18473 Project: HBase Issue Type

Re: user_permission output

2017-07-25 Thread Lars George
OK, found that no parameter is treated as asking for the ACLs table. Maybe the shell command should say so? Just a minor nit though, there are bigger tofu blocks to fry. Sent from my iPhone > On 21. Jul 2017, at 13:33, Lars George <lars.geo...@gmail.com> wrote: > > Hi, &g

Re: Ident String

2017-07-25 Thread Lars George
Don't think it is necessary, does not to any harm. Sent from my iPhone > On 21. Jul 2017, at 00:10, Stack <st...@duboce.net> wrote: > >> On Thu, Jul 20, 2017 at 9:20 PM, Lars George <lars.geo...@gmail.com> wrote: >> >> Ah ok, I missed that HBASE_IDEN

HBASE-11344

2017-07-24 Thread Lars George
Hi, I was looking at https://issues.apache.org/jira/browse/HBASE-11344 which in JIRA is flagged as 0.99 and 2.0. The comments talk about 0.98 and also 1.x. But looking at the commit logs, I cannot see this apart from 2.0. Has this never been committed anywhere else? Should the JIRA be adjusted,

user_permission output

2017-07-21 Thread Lars George
Hi, I am running the shell's "user_permission" command without any parameter, and with a ".*" wildcard epxression and get two different results back: hbase(main):003:0> user_permission User Namespace,Table,Family,Qualifier:Permission hbasebook hbase,hbase:acl,,:

Re: Ident String

2017-07-20 Thread Lars George
to be the case. Cheers, Lars Sent from my iPad > On 19. Jul 2017, at 22:42, Lars George <lars.geo...@gmail.com> wrote: > > It dates back to Hadoop: > > https://github.com/apache/hbase/commit/24b065cc91f7bcdab25fc3634699657ac2f27104 > > See this > https://github.com/apache/ha

Re: Ident String

2017-07-19 Thread Lars George
; > For hbase master process listing, you'll find this in the long line...: > -Dproc_master > > Etc: > > -Dproc_zookeeper > > -Dproc_resourcemanager > > St.Ack > > >> On Fri, Jul 14, 2017 at 11:55 AM, Lars George <lars.geo...@gmail.com> wrote: &

Re: Ident String

2017-07-19 Thread Lars George
s listing, you'll find this in the long line...: > -Dproc_master > > Etc: > > -Dproc_zookeeper > > -Dproc_resourcemanager > > St.Ack > > >> On Fri, Jul 14, 2017 at 11:55 AM, Lars George <lars.geo...@gmail.com> wrote: >> >> Hi, >&g

Re: Ident String

2017-07-16 Thread Lars George
Bueller? Anyone? :) On Fri, Jul 14, 2017 at 12:55 PM, Lars George <lars.geo...@gmail.com> wrote: > Hi, > > Was coming across `HBASE_IDENT_STR` (in hbase-env.sh) which sets > `hbase.id.str` as a command line parameter to the daemon. But I cannot > find where that is used. C

Re: RegionServer info page content

2017-07-16 Thread Lars George
I created https://issues.apache.org/jira/browse/HBASE-18388 On Fri, Jul 14, 2017 at 11:12 PM, Jean-Marc Spaggiari <jean-m...@spaggiari.org> wrote: > Good to know, thanks for the details ;) > > JM > > 2017-07-14 16:51 GMT-04:00 Lars George <lars.geo...

[jira] [Created] (HBASE-18388) Fix description on region page, explaining what a region name is made of

2017-07-16 Thread Lars George (JIRA)
Lars George created HBASE-18388: --- Summary: Fix description on region page, explaining what a region name is made of Key: HBASE-18388 URL: https://issues.apache.org/jira/browse/HBASE-18388 Project

[jira] [Created] (HBASE-18387) [Thrift] Make principal configurable in DemoClient.java

2017-07-16 Thread Lars George (JIRA)
Lars George created HBASE-18387: --- Summary: [Thrift] Make principal configurable in DemoClient.java Key: HBASE-18387 URL: https://issues.apache.org/jira/browse/HBASE-18387 Project: HBase Issue

Re: RegionServer info page content

2017-07-14 Thread Lars George
ot sure to get that's wrong :( Can you provide more dtails? > > JMS > > 2017-07-14 11:33 GMT-04:00 Lars George <lars.geo...@gmail.com>: > >> Hi, >> >> On the RS status page it has this: >> >> "Region names are made of the containing table's n

RegionServer info page content

2017-07-14 Thread Lars George
Hi, On the RS status page it has this: "Region names are made of the containing table's name, a comma, the start key, a comma, and a randomly generated region id. To illustrate, the region named domains,apache.org,5464829424211263407 is party to the table domains, has an id of

[jira] [Created] (HBASE-18382) [Thrift] Add transport type info to info server

2017-07-14 Thread Lars George (JIRA)
Lars George created HBASE-18382: --- Summary: [Thrift] Add transport type info to info server Key: HBASE-18382 URL: https://issues.apache.org/jira/browse/HBASE-18382 Project: HBase Issue Type

Ident String

2017-07-14 Thread Lars George
Hi, Was coming across `HBASE_IDENT_STR` (in hbase-env.sh) which sets `hbase.id.str` as a command line parameter to the daemon. But I cannot find where that is used. Could someone point me in the right direction? Cheers, Lars

Service-level AuthZ

2017-04-14 Thread Lars George
Hi, We have SLAs, implementing the Hadoop classes, in HBase that allow to grant or revoke global access to RPC services. What we do _not_ have is the matching `refreshServiceAcl` method, including the wiring into the shell script to trigger it. Is there a reason why? Should we not have the same

Re: Assigning regions after restart

2017-03-16 Thread Lars George
hether we are > doing a recovery or not has been there a long time so yeah, a single server > recovery could throw us off, but you make a practical point, that one > server should not destroy locality over the cluster. > > St.Ack > > On Tue, Mar 14, 2017 at 7:09 AM, Lars George

[jira] [Created] (HBASE-17791) Locality should not be affected for non-faulty region servers at startup

2017-03-15 Thread Lars George (JIRA)
Lars George created HBASE-17791: --- Summary: Locality should not be affected for non-faulty region servers at startup Key: HBASE-17791 URL: https://issues.apache.org/jira/browse/HBASE-17791 Project

Re: Assigning regions after restart

2017-03-14 Thread Lars George
PM, Lars George <lars.geo...@gmail.com> wrote: > Doh, https://issues.apache.org/jira/browse/HBASE-15251 addresses this > (though I am not sure exactly how, see below). This should be > backported to all 1.x branches! > > As for the patch, I see this > > if (!fa

[jira] [Resolved] (HBASE-14129) If any regionserver gets shutdown uncleanly during full cluster restart, locality looks to be lost

2017-03-14 Thread Lars George (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-14129?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lars George resolved HBASE-14129. - Resolution: Won't Fix Closing as "won't fix" as the hardcoded flag is too intrusive. T

Re: Assigning regions after restart

2017-03-14 Thread Lars George
n. On Tue, Mar 14, 2017 at 1:54 PM, Lars George <lars.geo...@gmail.com> wrote: > Hi, > > I had this happened at multiple clusters recently where after the > restart the locality dropped from close to or exactly 100% down to > single digits. The reason is that all regions

Assigning regions after restart

2017-03-14 Thread Lars George
Hi, I had this happened at multiple clusters recently where after the restart the locality dropped from close to or exactly 100% down to single digits. The reason is that all regions were completely shuffled and reassigned to random servers. Upon reading the (yet again non-trivial) assignment

Re: Assigning regions after restart

2017-03-14 Thread Lars George
eassigning the user regions. I would have assumed the "assignAllUserRegions()" would have to be called. On Tue, Mar 14, 2017 at 2:21 PM, Lars George <lars.geo...@gmail.com> wrote: > Looking at the code more... it seems the issue is here > > In Ass

[jira] [Created] (HBASE-17774) Improve locality info in table details page

2017-03-12 Thread Lars George (JIRA)
Lars George created HBASE-17774: --- Summary: Improve locality info in table details page Key: HBASE-17774 URL: https://issues.apache.org/jira/browse/HBASE-17774 Project: HBase Issue Type

Re: HDFS Balancer

2017-03-10 Thread Lars George
y wrong - information came about >> > >> > Maybe Sean / Misty can give some context. >> > >> > Cheers >> > >> > On Tue, Mar 7, 2017 at 6:37 AM, Lars George <lars.geo...@gmail.com> >> wrote: >> > >> > > Hey Ted, &g

[jira] [Resolved] (HBASE-17635) enable_table_replication script cannot handle replication scope

2017-03-07 Thread Lars George (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-17635?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lars George resolved HBASE-17635. - Resolution: Duplicate Sorry, this was opened just a few weeks earlier in HBASE-17460, closing

Re: HDFS Balancer

2017-03-07 Thread Lars George
aph came from: > > HBASE-15332 Document how to take advantage of HDFS-6133 in HBase > >> On Mon, Mar 6, 2017 at 6:38 PM, Lars George <lars.geo...@gmail.com> wrote: >> >> Hi, >> >> I am trying to grok what came out of all these issues about the

HDFS Balancer

2017-03-06 Thread Lars George
Hi, I am trying to grok what came out of all these issues about the HDFS balancer and being able to avoid it destroying HBase locality. There is this https://issues.apache.org/jira/browse/HBASE-13021 from JM, and the book http://hbase.apache.org/book.html#_hbase_and_hdfs refers to

Client SSL Authentication

2017-02-27 Thread Lars George
Hi, We have support for two-way authentication over TLS in the HttpServer class, but never use it, nor have a config property that could set it. Hadoop has the same option but exposes it via config. Should we not do the same? Lars

[jira] [Created] (HBASE-17636) Fix speling [sic] error in enable replication script output

2017-02-11 Thread Lars George (JIRA)
Lars George created HBASE-17636: --- Summary: Fix speling [sic] error in enable replication script output Key: HBASE-17636 URL: https://issues.apache.org/jira/browse/HBASE-17636 Project: HBase

[jira] [Created] (HBASE-17635) enable_table_replication script cannot handle replication scope

2017-02-11 Thread Lars George (JIRA)
Lars George created HBASE-17635: --- Summary: enable_table_replication script cannot handle replication scope Key: HBASE-17635 URL: https://issues.apache.org/jira/browse/HBASE-17635 Project: HBase

[jira] [Created] (HBASE-17632) Modify example health script to work on CentOS 6 etc.

2017-02-11 Thread Lars George (JIRA)
Lars George created HBASE-17632: --- Summary: Modify example health script to work on CentOS 6 etc. Key: HBASE-17632 URL: https://issues.apache.org/jira/browse/HBASE-17632 Project: HBase Issue

[jira] [Created] (HBASE-17631) Canary interval too low

2017-02-11 Thread Lars George (JIRA)
Lars George created HBASE-17631: --- Summary: Canary interval too low Key: HBASE-17631 URL: https://issues.apache.org/jira/browse/HBASE-17631 Project: HBase Issue Type: Bug Components

[jira] [Created] (HBASE-17630) Health Script not shutting down server process with certain script behavior

2017-02-11 Thread Lars George (JIRA)
Lars George created HBASE-17630: --- Summary: Health Script not shutting down server process with certain script behavior Key: HBASE-17630 URL: https://issues.apache.org/jira/browse/HBASE-17630 Project

Re: Health Script does not stop region server

2017-02-11 Thread Lars George
Will do, thanks On Sun, Feb 5, 2017 at 3:57 PM, Ted Yu <yuzhih...@gmail.com> wrote: > Yesterday I tried snmpwalk on CentOS as well - same behavior. > > Lars: > Can you file a JIRA to fix the bug ? > > Thanks > > On Sun, Feb 5, 2017 at 2:22 AM, Lars George <lars

Re: Canary Test Tool and write sniffing

2017-02-11 Thread Lars George
at 10:38 PM, Enis Söztutar <e...@apache.org> wrote: > Open an issue? > Enis > > On Mon, Feb 6, 2017 at 9:39 AM, Stack <st...@duboce.net> wrote: > >> On Sun, Feb 5, 2017 at 2:25 AM, Lars George <lars.geo...@gmail.com> wrote: >> >> > The next

Re: Canary Test Tool and write sniffing

2017-02-05 Thread Lars George
; (the first time). > > BTW There was a mismatch in the description for this command: (5 seconds > vs. 5 milliseconds) > > ${HBASE_HOME}/bin/hbase canary -daemon -interval 5 -f false > > > On Sat, Feb 4, 2017 at 8:21 AM, Lars George <lars.geo...@gmail.com> wrote: > &g

Re: Health Script does not stop region server

2017-02-05 Thread Lars George
-v 1 -c public localhost if > Timeout: No Response from localhost > $ echo $? > 1 > > Looks like the script should parse the output from snmpwalk and provide > some hint if unexpected result is reported. > > Cheers > > On Sat, Feb 4, 2017 at 6:40 AM, Lars George <lars

Re: Canary Test Tool and write sniffing

2017-02-04 Thread Lars George
Tue Apr 24 07:20:16 2012 > > FYI > > On Sat, Feb 4, 2017 at 4:06 AM, Lars George <lars.geo...@gmail.com> wrote: > >> Also, the default interval used to be 60 secs, but is now 6 secs. Does >> that make sense? Seems awfully short for a default, assuming you have >&

Health Script does not stop region server

2017-02-04 Thread Lars George
Hi, I tried the supplied `healthcheck.sh`, but did not have snmpd running. That caused the script to take a long time to error out, which exceed the 10 seconds the check was meant to run. That resets the check and it keeps reporting the error, but never stops the servers: 2017-02-04 05:55:08,962

Re: Canary Test Tool and write sniffing

2017-02-04 Thread Lars George
Also, the default interval used to be 60 secs, but is now 6 secs. Does that make sense? Seems awfully short for a default, assuming you have many regions or servers. On Sat, Feb 4, 2017 at 11:54 AM, Lars George <lars.geo...@gmail.com> wrote: > Hi, > > Looking at the Canary

Canary Test Tool and write sniffing

2017-02-04 Thread Lars George
Hi, Looking at the Canary tool, it tries to ensure that all canary test table regions are spread across all region servers. If that is not the case, it calls: if (numberOfCoveredServers < numberOfServers) { admin.balancer(); } I doubt this will help with the StochasticLoadBalancer, which is

Re: copy_table_desc.rb script

2017-02-03 Thread Lars George
1:/hbase >> instead? (Note the / in the front of HBase) >> >> JMS >> >> 2017-02-03 7:52 GMT-05:00 Lars George <lars.geo...@gmail.com>: >> >> > I have two local instances with two different ZK ports. Note that the >> > error occurs a

Re: copy_table_desc.rb script

2017-02-03 Thread Lars George
mber 2182 in the second parameter. > > Do you have two quorums running on the same machine ? > >> On Feb 3, 2017, at 3:05 AM, Lars George <lars.geo...@gmail.com> wrote: >> >> Hi, >> >> trying to run the `copy_table_desc.rb` script from the >> `bin

copy_table_desc.rb script

2017-02-03 Thread Lars George
Hi, trying to run the `copy_table_desc.rb` script from the `bin/replication` directory gives this: ``` $ bin/hbase org.jruby.Main bin/replication/copy_tables_desc.rb localhost:2181:hbase localhost:2182:hbase-2 testtable4 ... NativeException: java.io.IOException:

Re: HBase Service Level Authorization

2017-01-24 Thread Lars George
tery to me. Maybe we can start the discussion there? Lars On Tue, Jan 24, 2017 at 8:36 AM, Lars George <lars.geo...@gmail.com> wrote: > Hi, > > Looking at our `PolicyProvider` implementation I see this: > > /** > * Implementation of secure Hadoop policy provider for mappin

HBase Service Level Authorization

2017-01-23 Thread Lars George
Hi, Looking at our `PolicyProvider` implementation I see this: /** * Implementation of secure Hadoop policy provider for mapping * protocol interfaces to hbase-policy.xml entries. */ @InterfaceAudience.Private public class HBasePolicyProvider extends PolicyProvider { protected final static

Re: Merge and HMerge

2017-01-14 Thread Lars George
t, am a bit confused here. >>>>> @Enis, you seem to know everything about them, please educate me. >>>>> Thanks >>>>> - Appy >>>>> >>>>> >>>>> >>>>> On Thu, Sep 29, 2016 at 12:43 AM

Draining mode and graceful decommissioning

2017-01-01 Thread Lars George
Hi, This is along the lines of https://issues.apache.org/jira/browse/HBASE-10367 Since we have draining mode, should we not in the meantime at least replace the balancer stop/start step in graceful_stop.sh with simply setting the draining mode for the server? This would less impact any other

[jira] [Created] (HBASE-17399) region_mover.rb uses different default filename, also needs slight change

2016-12-31 Thread Lars George (JIRA)
Lars George created HBASE-17399: --- Summary: region_mover.rb uses different default filename, also needs slight change Key: HBASE-17399 URL: https://issues.apache.org/jira/browse/HBASE-17399 Project

Re: update_all_config and masters

2016-12-29 Thread Lars George
I also added this for convenience: https://issues.apache.org/jira/browse/HBASE-17391 On Thu, Dec 29, 2016 at 4:32 PM, Lars George <lars.geo...@gmail.com> wrote: > Done: https://issues.apache.org/jira/browse/HBASE-17390 > > > > On Thu, Dec 29, 2016 at 4:05 PM, Ted Yu <yu

[jira] [Created] (HBASE-17391) [Shell] Add shell command to get list of servers, with filters

2016-12-29 Thread Lars George (JIRA)
Lars George created HBASE-17391: --- Summary: [Shell] Add shell command to get list of servers, with filters Key: HBASE-17391 URL: https://issues.apache.org/jira/browse/HBASE-17391 Project: HBase

[jira] [Created] (HBASE-17390) Online update of configuration for all servers leaves out masters

2016-12-29 Thread Lars George (JIRA)
Lars George created HBASE-17390: --- Summary: Online update of configuration for all servers leaves out masters Key: HBASE-17390 URL: https://issues.apache.org/jira/browse/HBASE-17390 Project: HBase

Re: update_all_config and masters

2016-12-29 Thread Lars George
reating a JIRA ? > > On Thu, Dec 29, 2016 at 6:46 AM, Lars George <lars.geo...@gmail.com> wrote: > >> Hi, >> >> It seems that the update command is only iterating over the region servers: >> >> public void updateConfiguration() throws IOExce

update_all_config and masters

2016-12-29 Thread Lars George
Hi, It seems that the update command is only iterating over the region servers: public void updateConfiguration() throws IOException { for (ServerName server : this.getClusterStatus().getServers()) { updateConfiguration(server); } } This leaves out the masters, which you have to trigger

Status of HBASE-4755?

2016-11-09 Thread Lars George
Hi, I am wondering where https://issues.apache.org/jira/browse/HBASE-4755 is up to? Seeing this lasting many years now, why is it not closed? It seems the balancer is in place. What worries me is that the tool to recompute a missing region server location after a failover is having a comment

Balancer Cutoff

2016-11-09 Thread Lars George
Hi, In HMaster.java we have this code (added, mostly, in HBASE-3422): private int getBalancerCutoffTime() { int balancerCutoffTime = getConfiguration().getInt("hbase.balancer.max.balancing", -1); if (balancerCutoffTime == -1) { // No time period set so create one int

[jira] [Created] (HBASE-16815) Low scan ratio in RPC queue tuning triggers divide by zero exception

2016-10-12 Thread Lars George (JIRA)
Lars George created HBASE-16815: --- Summary: Low scan ratio in RPC queue tuning triggers divide by zero exception Key: HBASE-16815 URL: https://issues.apache.org/jira/browse/HBASE-16815 Project: HBase

Re: Merge and HMerge

2016-09-28 Thread Lars George
Just to save you from searching: https://issues.apache.org/jira/browse/HBASE-8219?focusedCommentId=13617529=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#comment-13617529 No one replied to Enis it seems? On Wed, Sep 28, 2016 at 4:32 PM, Lars George <lars.geo...@gmail.

Re: Merge and HMerge

2016-09-28 Thread Lars George
ff to >> put up multiple regions. This should be redone too (they are often >> first thing broke when major change and putting them back together is >> a headache since they do not follow the usual pattern). >> >> St.Ack >> >> On Sun, Jul 3, 2011 at 12:38 AM, L

Re: DiffKeyDeltaEncoder not fully efficient?

2016-09-20 Thread Lars George
uld achieve good efficiency. > > Cheers > > On Sun, Sep 18, 2016 at 9:37 AM, Lars George <lars.geo...@gmail.com> wrote: > >> Hi, >> >> Reading the key encoder code and noticed this in the DiffKeyDeltaEncoder: >> >> if ((flag & FLAG_TIMESTAMP

DiffKeyDeltaEncoder not fully efficient?

2016-09-18 Thread Lars George
Hi, Reading the key encoder code and noticed this in the DiffKeyDeltaEncoder: if ((flag & FLAG_TIMESTAMP_IS_DIFF) == 0) { ByteBufferUtils.putLong(out, timestamp, timestampFitsInBytes); } else { ByteBufferUtils.putLong(out, diffTimestamp, diffTimestampFitsInBytes); } So if the timestamp is

Re: hbase:meta blocks in L1?

2016-07-14 Thread Lars George
scriptors#createMetaTableDescriptor() , both column > families have the following: > > .setCacheDataInL1(true), > > Is there something else you were looking for ? > > Cheers > > On Thu, Jul 14, 2016 at 6:59 AM, Lars George <lars.geo...@gmail.com>

hbase:meta blocks in L1?

2016-07-14 Thread Lars George
Hey, HBASE-11364 did add `.setCacheDataInL1(true)`, but the later change to use `HTableDescriptor.metaTableDescriptor()` changes the layout of the `hbase:meta` to omit the L1 cache setting. Is this on purpose or an oversight? In other words, are the meta blocks currently never cached in L1?

Cache features in shell missing?

2016-07-14 Thread Lars George
Hi, Looking at `CacheConfig` and noticed that `CACHE_DATA_BLOCKS_COMPRESSED_KEY` and `DROP_BEHIND_CACHE_COMPACTION_KEY` both have no equivalent in `HColumnDescriptor` and hence cannot be set from the Shell or admin API. Is that not an oversight? Should we add this? Lars

[jira] [Resolved] (HBASE-13928) Correct doc bug introduced in HBASE-11735

2016-07-11 Thread Lars George (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-13928?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lars George resolved HBASE-13928. - Resolution: Duplicate Was fixed in HBASE-15528. > Correct doc bug introduced in HBASE-11

[jira] [Reopened] (HBASE-13928) Correct doc bug introduced in HBASE-11735

2016-07-11 Thread Lars George (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-13928?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lars George reopened HBASE-13928: - [~gsbiju] is right, the added {{hbase-default.xml}} key is wrong, and never used. It is missing

[jira] [Created] (HBASE-16188) Add EventCounter information to log4j properties file

2016-07-06 Thread Lars George (JIRA)
Lars George created HBASE-16188: --- Summary: Add EventCounter information to log4j properties file Key: HBASE-16188 URL: https://issues.apache.org/jira/browse/HBASE-16188 Project: HBase Issue

[jira] [Created] (HBASE-16187) Fix typo in blog post for metrics2

2016-07-06 Thread Lars George (JIRA)
Lars George created HBASE-16187: --- Summary: Fix typo in blog post for metrics2 Key: HBASE-16187 URL: https://issues.apache.org/jira/browse/HBASE-16187 Project: HBase Issue Type: Bug

[jira] [Created] (HBASE-16186) Fix AssignmentManager MBean name

2016-07-06 Thread Lars George (JIRA)
Lars George created HBASE-16186: --- Summary: Fix AssignmentManager MBean name Key: HBASE-16186 URL: https://issues.apache.org/jira/browse/HBASE-16186 Project: HBase Issue Type: Bug

Re: MutableQuantiles

2016-06-21 Thread Lars George
ses which were ports of hadoop's > classes) have been removed. They are no longer used. However the ones > hadoop supplies were very slow so instead we use MutableHistogram. > > See: HBASE-15222 > > On Mon, Jun 20, 2016 at 5:19 AM, Lars George <lars.geo...@gmail.com> wro

Re: MutableQuantiles

2016-06-20 Thread Lars George
BTW, I am looking at 1.2 branch, though here the Hadoop one does exactly the same as what the HBase one does. Where do I see the difference? Master looks the same too. Are you referring to the histogram classes? On Mon, Jun 20, 2016 at 1:36 PM, Lars George <lars.geo...@gmail.com> wrote

Re: MutableQuantiles

2016-06-20 Thread Lars George
lity to dump counts by latency bucket rather than > percentile measures at the moment. The former can be used to calculate > mathematically meaningful percentile measures over the whole fleet and over > longer timescales, the latter cannot. > > >> On Jun 19, 2016,

MutableQuantiles

2016-06-19 Thread Lars George
Hi, As per https://issues.apache.org/jira/browse/HBASE-6409 we rolled our own class. Is that still needed? Since 2012 lot's has changed and we should have all in place to use the Hadoop supplied one? Just curious. Cheers, Lars

[jira] [Created] (HBASE-15445) Add support for ACLs for web based UIs

2016-03-10 Thread Lars George (JIRA)
Lars George created HBASE-15445: --- Summary: Add support for ACLs for web based UIs Key: HBASE-15445 URL: https://issues.apache.org/jira/browse/HBASE-15445 Project: HBase Issue Type: Bug

Re: Where to set UI ACLs?

2016-03-10 Thread Lars George
ed access control for the UIs > before. IMHO, they are inherently unsafe except for operator use ("no user > serviceable parts inside") so random folks should not be given network > paths to them. > > On Wed, Mar 9, 2016 at 5:31 AM, Lars George <lars.geo...@gmail.com>

Where to set UI ACLs?

2016-03-09 Thread Lars George
Hi, Reading the whole HttpServer code base, and while this is a copy it seems from HttpServer2, including the ability to set ACLs with users who are allowed to access (admins), I cannot see this ever being set. Am I missing something, or is there a JIRA documenting that this needs adding?

Normalizer in 1.2+?

2016-01-13 Thread Lars George
Hi, Just looking through the new properties and seeing this hbase.normalizer.enabled false If set to true, Master will try to keep region size within each table approximately the same. Searching both branches 1.2 and master reveals it is only used in a test to enable it,

[jira] [Created] (HBASE-15098) Normalizer switch in configuration is not used

2016-01-13 Thread Lars George (JIRA)
Lars George created HBASE-15098: --- Summary: Normalizer switch in configuration is not used Key: HBASE-15098 URL: https://issues.apache.org/jira/browse/HBASE-15098 Project: HBase Issue Type: Bug

Re: Normalizer in 1.2+?

2016-01-13 Thread Lars George
se); > > try { > > // if data in ZK is null, use default of on. > > return upData == null || parseFrom(upData).getNormalizerOn(); > > So I guess the config parameter hbase.normalizer.enabled can be dropped. > > > Cheers > > On Wed, Jan 13, 201

[jira] [Created] (HBASE-14864) Add support for bucketing of keys into client library

2015-11-20 Thread Lars George (JIRA)
Lars George created HBASE-14864: --- Summary: Add support for bucketing of keys into client library Key: HBASE-14864 URL: https://issues.apache.org/jira/browse/HBASE-14864 Project: HBase Issue

[jira] [Created] (HBASE-14556) Make prefetchOnOpen configurable for index and/or data blocks

2015-10-05 Thread Lars George (JIRA)
Lars George created HBASE-14556: --- Summary: Make prefetchOnOpen configurable for index and/or data blocks Key: HBASE-14556 URL: https://issues.apache.org/jira/browse/HBASE-14556 Project: HBase

[jira] [Created] (HBASE-14367) Add normalization support to shell

2015-09-04 Thread Lars George (JIRA)
Lars George created HBASE-14367: --- Summary: Add normalization support to shell Key: HBASE-14367 URL: https://issues.apache.org/jira/browse/HBASE-14367 Project: HBase Issue Type: Bug

[jira] [Created] (HBASE-14342) Recursive call in RegionMergeTransactionImpl.getJournal()

2015-08-31 Thread Lars George (JIRA)
Lars George created HBASE-14342: --- Summary: Recursive call in RegionMergeTransactionImpl.getJournal() Key: HBASE-14342 URL: https://issues.apache.org/jira/browse/HBASE-14342 Project: HBase

[jira] [Created] (HBASE-14343) Fix debug message in SimpleRegionNormalizer for small regions

2015-08-31 Thread Lars George (JIRA)
Lars George created HBASE-14343: --- Summary: Fix debug message in SimpleRegionNormalizer for small regions Key: HBASE-14343 URL: https://issues.apache.org/jira/browse/HBASE-14343 Project: HBase

[jira] [Created] (HBASE-14287) Bootstrapping a cluster leaves temporary WAL directory laying around

2015-08-21 Thread Lars George (JIRA)
Lars George created HBASE-14287: --- Summary: Bootstrapping a cluster leaves temporary WAL directory laying around Key: HBASE-14287 URL: https://issues.apache.org/jira/browse/HBASE-14287 Project: HBase

[jira] [Created] (HBASE-14256) Flush task message may be confusing when region is recovered

2015-08-19 Thread Lars George (JIRA)
Lars George created HBASE-14256: --- Summary: Flush task message may be confusing when region is recovered Key: HBASE-14256 URL: https://issues.apache.org/jira/browse/HBASE-14256 Project: HBase

[jira] [Created] (HBASE-14255) Simplify Cell creation post 1.0

2015-08-19 Thread Lars George (JIRA)
Lars George created HBASE-14255: --- Summary: Simplify Cell creation post 1.0 Key: HBASE-14255 URL: https://issues.apache.org/jira/browse/HBASE-14255 Project: HBase Issue Type: Improvement

[jira] [Created] (HBASE-14257) Periodic flusher only handles hbase:meta, not other system tables

2015-08-19 Thread Lars George (JIRA)
Lars George created HBASE-14257: --- Summary: Periodic flusher only handles hbase:meta, not other system tables Key: HBASE-14257 URL: https://issues.apache.org/jira/browse/HBASE-14257 Project: HBase

[jira] [Created] (HBASE-14224) Fix coprocessor handling of duplicate classes

2015-08-14 Thread Lars George (JIRA)
Lars George created HBASE-14224: --- Summary: Fix coprocessor handling of duplicate classes Key: HBASE-14224 URL: https://issues.apache.org/jira/browse/HBASE-14224 Project: HBase Issue Type: Bug

  1   2   3   4   >