[jira] [Created] (HBASE-5739) Upgrade guava to 11.0.2
Upgrade guava to 11.0.2 --- Key: HBASE-5739 URL: https://issues.apache.org/jira/browse/HBASE-5739 Project: HBase Issue Type: Improvement Components: build Affects Versions: 0.96.0 Reporter: Todd Lipcon Assignee: Todd Lipcon Fix For: 0.96.0 Hadoop has upgraded to this new version of Guava. We should, too, so we don't have compatibility issues running on Hadoop 2.0+ -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Created] (HBASE-5446) Replace serialization for client-facing ZK data with PBs
Replace serialization for client-facing ZK data with PBs Key: HBASE-5446 URL: https://issues.apache.org/jira/browse/HBASE-5446 Project: HBase Issue Type: Sub-task Reporter: Todd Lipcon Assignee: stack -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Created] (HBASE-5445) Add PB-based calls to HMasterInterface
Add PB-based calls to HMasterInterface -- Key: HBASE-5445 URL: https://issues.apache.org/jira/browse/HBASE-5445 Project: HBase Issue Type: Sub-task Reporter: Todd Lipcon Assignee: Gregory Chanan -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Created] (HBASE-5444) Add PB-based calls to HMasterRegionInterface
Add PB-based calls to HMasterRegionInterface Key: HBASE-5444 URL: https://issues.apache.org/jira/browse/HBASE-5444 Project: HBase Issue Type: Sub-task Reporter: Todd Lipcon Assignee: Gregory Chanan -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Created] (HBASE-5443) Add PB-based calls to HRegionInterface
Add PB-based calls to HRegionInterface -- Key: HBASE-5443 URL: https://issues.apache.org/jira/browse/HBASE-5443 Project: HBase Issue Type: Sub-task Reporter: Todd Lipcon Assignee: Jimmy Xiang -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Created] (HBASE-5447) Support for custom filters with PB-based RPC
Support for custom filters with PB-based RPC Key: HBASE-5447 URL: https://issues.apache.org/jira/browse/HBASE-5447 Project: HBase Issue Type: Sub-task Reporter: Todd Lipcon Assignee: Todd Lipcon -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Created] (HBASE-5448) Support for dynamic coprocessor endpoints with PB-based RPC
Support for dynamic coprocessor endpoints with PB-based RPC --- Key: HBASE-5448 URL: https://issues.apache.org/jira/browse/HBASE-5448 Project: HBase Issue Type: Sub-task Reporter: Todd Lipcon Assignee: Enis Soztutar -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Created] (HBASE-5449) Support for wire-compatible security functionality
Support for wire-compatible security functionality -- Key: HBASE-5449 URL: https://issues.apache.org/jira/browse/HBASE-5449 Project: HBase Issue Type: Sub-task Reporter: Todd Lipcon Assignee: Lars Hofhansl -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Created] (HBASE-5450) Support for wire-compatibility in inter-cluster replication (ZK, etc)
Support for wire-compatibility in inter-cluster replication (ZK, etc) - Key: HBASE-5450 URL: https://issues.apache.org/jira/browse/HBASE-5450 Project: HBase Issue Type: Sub-task Reporter: Todd Lipcon Assignee: Chris Trezzo -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Created] (HBASE-5451) Switch RPC call envelope/headers to PBs
Switch RPC call envelope/headers to PBs --- Key: HBASE-5451 URL: https://issues.apache.org/jira/browse/HBASE-5451 Project: HBase Issue Type: Sub-task Reporter: Todd Lipcon Assignee: Devaraj Das -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Created] (HBASE-5452) Fixes for HBase shell with protobuf-based data
Fixes for HBase shell with protobuf-based data -- Key: HBASE-5452 URL: https://issues.apache.org/jira/browse/HBASE-5452 Project: HBase Issue Type: Sub-task Reporter: Todd Lipcon Assignee: Chris Trezzo -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Created] (HBASE-5453) Switch on-disk formats (reference files, HFile meta fields, etc) to PB
Switch on-disk formats (reference files, HFile meta fields, etc) to PB -- Key: HBASE-5453 URL: https://issues.apache.org/jira/browse/HBASE-5453 Project: HBase Issue Type: Sub-task Reporter: Todd Lipcon Assignee: stack -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Created] (HBASE-5238) Add a log4j category for all edits to META/ROOT
Add a log4j category for all edits to META/ROOT --- Key: HBASE-5238 URL: https://issues.apache.org/jira/browse/HBASE-5238 Project: HBase Issue Type: New Feature Components: regionserver Affects Versions: 0.94.0 Reporter: Todd Lipcon Priority: Minor Occasionally we run into bugs that have corrected META and written some bad data to META/ROOT but it's difficult to understand the order in which things happened. One option is to dump the HLog contents from the servers that hosted META at that time, but then it's interspersed with all other data. It would be nice to add a Log4j Logger to which we log all edits being applied to META and ROOT in textual form at DEBUG level. Then it would be easier to do a cluster-wide log grep to see what happened when. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Created] (HBASE-5221) bin/hbase script doesn't look for Hadoop jars in the right place in trunk layout
bin/hbase script doesn't look for Hadoop jars in the right place in trunk layout Key: HBASE-5221 URL: https://issues.apache.org/jira/browse/HBASE-5221 Project: HBase Issue Type: Bug Affects Versions: 0.92.0 Reporter: Todd Lipcon Running against an 0.24.0-SNAPSHOT hadoop: ls: cannot access /home/todd/ha-demo/hadoop-0.24.0-SNAPSHOT/hadoop-common*.jar: No such file or directory ls: cannot access /home/todd/ha-demo/hadoop-0.24.0-SNAPSHOT/hadoop-hdfs*.jar: No such file or directory ls: cannot access /home/todd/ha-demo/hadoop-0.24.0-SNAPSHOT/hadoop-mapred*.jar: No such file or directory The jars are rooted deeper in the heirarchy. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Created] (HBASE-4961) Lots of precommit builds hanging for days
Lots of precommit builds hanging for days - Key: HBASE-4961 URL: https://issues.apache.org/jira/browse/HBASE-4961 Project: HBase Issue Type: Bug Components: build, test Affects Versions: 0.92.0, 0.94.0 Reporter: Todd Lipcon Attachments: hbase-hung-builds.tar.gz I was logged into the ASF build machines and saw about 10-15 HBase precommit builds that have been hung for weeks. I took a jstack of each, which I'll attach here. I then kill -9ed them to free up the resources. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Created] (HBASE-4807) Use of Serializable in IPC makes an unnecessary copy
Use of Serializable in IPC makes an unnecessary copy Key: HBASE-4807 URL: https://issues.apache.org/jira/browse/HBASE-4807 Project: HBase Issue Type: Improvement Components: io, ipc Affects Versions: 0.92.0 Reporter: Todd Lipcon Priority: Minor This code path isn't used much, but in HbaseObjectWritable, the code to serialize and deserialize Serializables makes an unnecessary copy through ByteArrayOutputStream.toByteArray. Instead we could use DataOutputBuffer, perhaps. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Created] (HBASE-4717) More efficient age-off of old data during major compaction
More efficient age-off of old data during major compaction -- Key: HBASE-4717 URL: https://issues.apache.org/jira/browse/HBASE-4717 Project: HBase Issue Type: Improvement Components: regionserver Affects Versions: 0.94.0 Reporter: Todd Lipcon Many applications need to implement efficient age-off of old data. We currently only perform age-off during major compaction by scanning through all of the KVs. Instead, we could implement the following: - Set hbase.hstore.compaction.max.size reasonably small. Thus, older store files contain only smaller finite ranges of time. - Periodically run an age-off compaction. This compaction would scan the current list of storefiles. Any store file that falls entirely out of the TTL time range would be dropped. Store files completely within the time range would be un-altered. Those crossing the time-range boundary could either be left alone or compacted using the existing compaction code. I don't have a design in mind for how exactly this would be implemented, but hope to generate some discussion. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Created] (HBASE-4643) Consider reverting HBASE-451 (change HRI to remove HTD) in 0.92
Consider reverting HBASE-451 (change HRI to remove HTD) in 0.92 --- Key: HBASE-4643 URL: https://issues.apache.org/jira/browse/HBASE-4643 Project: HBase Issue Type: Brainstorming Affects Versions: 0.92.0 Reporter: Todd Lipcon I've been chatting with some folks recently about this thought: it seems like, if you enumerate the larger changes in 0.92, this is probably the one that is the most destabilizing that hasn't been through a lot of baking yet. You can see this evidenced by the very high number of followup commits it generated: looks like somewhere around 15 of them, plus some bugs still open. I've done a patch to revert this and the related followup changes on the 0.92 branch. Do we want to consider doing this? -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Created] (HBASE-4569) Simpler implementation for slab cache
Simpler implementation for slab cache - Key: HBASE-4569 URL: https://issues.apache.org/jira/browse/HBASE-4569 Project: HBase Issue Type: Improvement Components: regionserver Affects Versions: 0.92.0 Reporter: Todd Lipcon Attachments: hbase-4569.txt I spent a little bit of time last night hacking on the slab cache implementation to make it a little simpler. The change is: - no longer has the composition of SlabCache containing a SingleSizeCache per slab size. SlabCache holds its own slabs - no longer use guava's map implementations to handle a size-bounded cache. Instead, manages its own LRU linked list - significantly less clever about synchronization. since this is an L2 cache, it should be less contended than the L1 cache, and I think we can afford to be dumb. - should have less memory usage since there's only one map entry per key instead of several. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Created] (HBASE-4548) Client should not look on HDFS to list tables
Client should not look on HDFS to list tables - Key: HBASE-4548 URL: https://issues.apache.org/jira/browse/HBASE-4548 Project: HBase Issue Type: Bug Components: client Affects Versions: 0.92.0 Reporter: Todd Lipcon Priority: Critical Fix For: 0.92.0 In HBASE-4377, Jon noticed that HConnectionManager.listTable now looks on HDFS for the table list. This seems incorrect, since the client may not have access to the hbase directory on HDFS (eg in a secure cluster). At the least, it should RPC to the master to find a table list, and have the master do the list on HDFS. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Created] (HBASE-4551) Small fixes to compile against 0.23-SNAPSHOT
Small fixes to compile against 0.23-SNAPSHOT Key: HBASE-4551 URL: https://issues.apache.org/jira/browse/HBASE-4551 Project: HBase Issue Type: Bug Components: build Affects Versions: 0.92.0 Reporter: Todd Lipcon Assignee: Todd Lipcon Fix For: 0.92.0 Attachments: hbase-4551.txt - fix pom.xml to properly pull the test artifacts - fix TestHLog to not use the private cluster.getNameNode() API -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Created] (HBASE-4552) multi-CF bulk load is not atomic across column families
multi-CF bulk load is not atomic across column families --- Key: HBASE-4552 URL: https://issues.apache.org/jira/browse/HBASE-4552 Project: HBase Issue Type: Bug Components: regionserver Affects Versions: 0.92.0 Reporter: Todd Lipcon Fix For: 0.92.0 Currently the bulk load API simply imports one HFile at a time. With multi-column-family support, this is inappropriate, since different CFs show up separately. Instead, the IPC endpoint should take a of CF - HFiles, so we can online them all under a single region-wide lock. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
