Re: HBASE-4153

2011-09-16 Thread Todd Lipcon
It seems even though this JIRA is labeled as an improvement, it's really a stability fix / master bug. Is that not the case? If it's a bug or stability improvement, we can certainly integrate it after 0.92 is branched. Branching just means no new destabilizing features. (eg I am still +1 on

HBASE-4373

2011-09-16 Thread Ted Yu
Andy/Gary/Mingjie: HBASE-4373 touched certain coprocessor APIs. Please take a look when you have time. Thanks

Re: HBASE-4373

2011-09-16 Thread Gary Helmling
Thanks for the heads up Ted. On Thu, Sep 15, 2011 at 11:13 PM, Ted Yu yuzhih...@gmail.com wrote: Andy/Gary/Mingjie: HBASE-4373 touched certain coprocessor APIs. Please take a look when you have time. Thanks

Build failed in Jenkins: HBase-TRUNK #2218

2011-09-16 Thread Apache Jenkins Server
See https://builds.apache.org/job/HBase-TRUNK/2218/changes Changes: [Gary Helmling] HBASE-4414 Region splits by size not being triggered -- [...truncated 1598 lines...] Running org.apache.hadoop.hbase.filter.TestFilterList Tests run: 5, Failures: 0,

Build failed in Jenkins: HBase-TRUNK #2219

2011-09-16 Thread Apache Jenkins Server
See https://builds.apache.org/job/HBase-TRUNK/2219/ -- [...truncated 1595 lines...] Running org.apache.hadoop.hbase.filter.TestSingleColumnValueExcludeFilter Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.114 sec Running

Re: HBASE-4373

2011-09-16 Thread Ted Yu
If you think patch v2 is in good shape, I will commit it today. Thanks On Thu, Sep 15, 2011 at 11:38 PM, Gary Helmling ghelml...@gmail.com wrote: Thanks for the heads up Ted. On Thu, Sep 15, 2011 at 11:13 PM, Ted Yu yuzhih...@gmail.com wrote: Andy/Gary/Mingjie: HBASE-4373 touched certain

JIRAs whose patches are ready

2011-09-16 Thread Ted Yu
Hi, I think the patches for following JIRAs are ready to be integrated: HBASE-4417, HBASE-4373 Please comment. I plan to integrate this weekend. Thanks

Re: Hadoop and HBase to common Avro base

2011-09-16 Thread Andrew Purtell
Hi Konstantin, There was some discussion about the HBase Avro connector recently. We are going to remove the Avro gateway as unmaintained I expect, unless a maintainer materializes and completes the implementation.   Best regards,    - Andy Problems worthy of attack prove their worth by

Hadoop and HBase to common Avro base

2011-09-16 Thread Konstantin Shvachko
Guys, Joep is trying to converge Hadoop and HBase under the common Avro version. Seems like a reasonable direction. Could the specialists please take a look. https://issues.apache.org/jira/browse/HADOOP-7646 Thanks, --Konstantin

Build failed in Jenkins: HBase-TRUNK #2220

2011-09-16 Thread Apache Jenkins Server
See https://builds.apache.org/job/HBase-TRUNK/2220/changes Changes: [stack] HBASE-4322 [hbck] Update checkIntegrity/checkRegionChain to present more accurate region split problem [stack] HBASE-4322 [hbck] Update checkIntegrity/checkRegionChain to present more accurate region split problem

Build failed in Jenkins: HBase-TRUNK #2221

2011-09-16 Thread Apache Jenkins Server
See https://builds.apache.org/job/HBase-TRUNK/2221/changes Changes: [tedyu] HBASE-4373 HBaseAdmin.assign() does not use force flag (Ramkrishna) [stack] HBASE-4322 [hbck] Update checkIntegrity/checkRegionChain to present more accurate region split problem [stack] HBASE-4322 [hbck] Update

Build failed in Jenkins: HBase-TRUNK #2222

2011-09-16 Thread Apache Jenkins Server
See https://builds.apache.org/job/HBase-TRUNK//changes Changes: [stack] HBASE-4195 Possible inconsistency in a memstore read after a reseek, possible performance improvement [tedyu] HBASE-4417 HBaseAdmin.checkHBaseAvailable() doesn't close ZooKeeper connections (Stefan

Re: prefix compression implementation

2011-09-16 Thread Matt Corgan
Jacek, Thanks for helping out with this. I implemented most of the DeltaEncoder and DeltaEncoderSeeker. I haven't taken the time to generate a good set of test data for any of this, but it does pass on some very small input data that aims to cover the edge cases i can think of. Perhaps you

Re: prefix compression implementation

2011-09-16 Thread Ryan Rawson
Hey this stuff looks really interesting! On the ByteBuffer, the 'array' byte[] access to the underlying data is totally incompatible with the 'off heap' features that are implemented by DirectByteBuffer. While people talk about DBB in terms of nio performance, if you have to roundtrip the data

SVN commit branches/0.90@1171766

2011-09-16 Thread Andrew Purtell
https://svn.apache.org/repos/asf/hbase/branches/0.90@1171766 Looks like the wrong commit message. Talks about a test fix, but has HBASE-4195 changes.   Best regards, - Andy Problems worthy of attack prove their worth by hitting back. - Piet Hein (via Tom White)

Re: SVN commit branches/0.90@1171766

2011-09-16 Thread Todd Lipcon
Agree, looks like accidental commit of nkeywal's change. On Fri, Sep 16, 2011 at 6:26 PM, Andrew Purtell apurt...@apache.org wrote: https://svn.apache.org/repos/asf/hbase/branches/0.90@1171766 Looks like the wrong commit message. Talks about a test fix, but has HBASE-4195 changes. Best

Re: prefix compression implementation

2011-09-16 Thread Ryan Rawson
On Fri, Sep 16, 2011 at 6:47 PM, Matt Corgan mcor...@hotpads.com wrote: I'm a little confused over the direction of the DBBs in general, hence the lack of clarity in my code. I see value in doing fine-grained parsing of the DBB if you're going to have a large block of data and only want to

Re: prefix compression implementation

2011-09-16 Thread Matt Corgan
Ryan - thanks for the feedback. The situation I'm thinking of where it's useful to parse DirectBB without copying to heap is when you are serving small random values out of the block cache. At HotPads, we'd like to store hundreds of GB of real estate listing data in memory so it can be quickly

Re: prefix compression implementation

2011-09-16 Thread Ryan Rawson
On Fri, Sep 16, 2011 at 7:29 PM, Matt Corgan mcor...@hotpads.com wrote: Ryan - thanks for the feedback.  The situation I'm thinking of where it's useful to parse DirectBB without copying to heap is when you are serving small random values out of the block cache.  At HotPads, we'd like to store