Build failed in Jenkins: hbase-0.90 #119

2011-03-17 Thread Apache Hudson Server
See https://hudson.apache.org/hudson/job/hbase-0.90/119/changes Changes: [todd] Fix 0.90.2 release date to Unreleased in CHANGES.txt [todd] HBASE-3659 Fix TestHLog to pass on newer versions of Hadoop -- [...truncated 2688 lines...] [INFO]

Jenkins build is back to normal : HBase-TRUNK #1792

2011-03-17 Thread Apache Hudson Server
See https://hudson.apache.org/hudson/job/HBase-TRUNK/1792/changes

Build failed in Jenkins: hbase-0.90 #120

2011-03-17 Thread Apache Hudson Server
See https://hudson.apache.org/hudson/job/hbase-0.90/120/changes Changes: [todd] Some cleanup to CHANGES.txt -- [...truncated 2808 lines...] Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 2.048 sec Running

Avro Util and ServerLoad

2011-03-17 Thread Ted Yu
Hi, I didn't find any reference to the following method in trunk: static public ARegionLoad hrlToARL(HServerLoad.RegionLoad rl) throws IOException { Out of curiosity, can someone tell me who/how the above is used ? Thanks

Re: trimming RegionLoad fields

2011-03-17 Thread Ryan Rawson
How much memory does profiling indicating these objects use? How much are you expecting to save? Saving 4-8 bytes even on a 10k region cluster is still only 80k of ram, not really significant. On Thu, Mar 17, 2011 at 2:32 PM, Ted Yu yuzhih...@gmail.com wrote: Hi, See email thread 'One of the

Re: trimming RegionLoad fields

2011-03-17 Thread Ryan Rawson
Without solid evidence of we'll be saving X megabytes I don't see a compelling reason to hacking that stuff out yet. We sort of need a better out-of-the-box monitoring system. One idea I had was to embed OpenTSDB inside the HMaster. This way OpenTSDB would store info about a HBase cluster back in

Re: trimming RegionLoad fields

2011-03-17 Thread Ted Yu
I agree that it is useful information. Can we retrieve it from HRegion which is in HRegionServer.onlineRegions ? protected final MapString, HRegion onlineRegions = new HashMapString, HRegion(); Thanks On Thu, Mar 17, 2011 at 2:47 PM, Andrew Purtell apurt...@apache.org wrote:

Build failed in Jenkins: HBase-TRUNK #1793

2011-03-17 Thread Apache Hudson Server
See https://hudson.apache.org/hudson/job/HBase-TRUNK/1793/changes Changes: [nspiegelberg] add HBASE-3665 to CHANGES.txt [nspiegelberg] HBASE-3665 tighten assertions for testBloomFilterSize [nspiegelberg] HBASE-3653 : Parallelize Server Requests on HBase Client

Re: Avro Util and ServerLoad

2011-03-17 Thread Stack
Yeah, it looks unused. I'd guess that it an incomplete attempt at revealing cluster load over avro; haven't dug in though... St.Ack On Thu, Mar 17, 2011 at 2:21 PM, Ted Yu yuzhih...@gmail.com wrote: Hi, I didn't find any reference to the following method in trunk:  static public ARegionLoad

stargate doc

2011-03-17 Thread Ted Yu
Hi, What's the equivalent for the following in hbase 0.90.x and beyond ? http://hbase.apache.org/docs/r0.20.5/api/org/apache/hadoop/hbase/stargate/package-summary.html I don't find the module in http://hbase.apache.org/docs/current/api/ Thanks

Build failed in Jenkins: hbase-0.90 #121

2011-03-17 Thread Apache Hudson Server
See https://hudson.apache.org/hudson/job/hbase-0.90/121/changes Changes: [stack] HBASE-3595 get_counter broken in shell [nspiegelberg] HBASE-3665 tighten assertions for testBloomFilterSize -- [...truncated 2809 lines...] Tests run: 1, Failures: 0,

Jenkins build is back to normal : HBase-TRUNK #1794

2011-03-17 Thread Apache Hudson Server
See https://hudson.apache.org/hudson/job/HBase-TRUNK/1794/changes

Re: move meta table to ZK

2011-03-17 Thread Ryan Rawson
Is it possible to search a list of z nodes? That is what we do now with meta in hbase. I used to be a fan, but I think self hosting all important meta data is the best approach. It makes lots of things easier, like replication, snapshots, etc. On Mar 17, 2011 9:27 PM, jiangwen w

Re: move meta table to ZK

2011-03-17 Thread jiangwen w
yes , it is possible, only enhance zookeeper a little, and i have already implement it. On Fri, Mar 18, 2011 at 12:32 PM, Ryan Rawson ryano...@gmail.com wrote: Is it possible to search a list of z nodes? That is what we do now with meta in hbase. I used to be a fan, but I think self hosting

Re: move meta table to ZK

2011-03-17 Thread Ted Dunning
When does ZK plan to adopt this extension? In general, I agree with Ryan that ZK is a good coordination layer, but the data (and associated meta-data should be self-hosted to simplify the consistency problem). On Thu, Mar 17, 2011 at 9:54 PM, jiangwen w wjiang...@gmail.com wrote: yes , it is

Re: move meta table to ZK

2011-03-17 Thread jiangwen w
replication does not involve meta data. On Fri, Mar 18, 2011 at 12:32 PM, Ryan Rawson ryano...@gmail.com wrote: Is it possible to search a list of z nodes? That is what we do now with meta in hbase. I used to be a fan, but I think self hosting all important meta data is the best approach.