compile hbase in linux and windows problem

2011-03-21 Thread Zhoushuaifeng
I try to compile hbase in windows, got some problems, can someone help to find out what’s the problem? 1.in windows entironment,I try to compile the hbase (pom.xml) by the Maven's command line[mvn compile],but error happen. the ERROR information is : [INFO] Scanning for

Re: move meta table to ZK

2011-03-21 Thread harry_ding
I don't think it's a good idea. 1. Why we need -ROOT-? Because we are afraid .META. is larger than a region's size. So .META. can be larger and ZK is not suitable for too many data. 2. Even we put .META. into ZK, we still need a server to manage the data (now it's Master Server). And the server

Re: compile hbase in linux and windows problem

2011-03-21 Thread Suraj Varma
I think you may be running into an error while executing the saveVersion.sh under hbase-0.90.1/src directory - this fails if cygwin is not available on the windows PATH (e.g. if you do ls in windows command window, does it list files correctly?) Also - specifically, what command did you run to

Re: upsert case performance problem (doubts about ConcurrentSkipListMap)

2011-03-21 Thread Jean-Daniel Cryans
It does sound familiar to me. J-D On Sat, Mar 19, 2011 at 11:10 AM, Andrew Purtell apurt...@apache.org wrote: I have a mapreduce task put together for experimentation which does a lot of Increments over three tables and Puts to another. I set writeToWAL to false. My HBase includes the patch

gauging cost of region movement

2011-03-21 Thread Ted Yu
Can we add a counter for the number of InternalScanner's to HRegion ? We decrement this counter when close() is called. Such counter can be used to gauge the cost of moving the underlying region. Cheers

RE: gauging cost of region movement

2011-03-21 Thread Jonathan Gray
This is an interesting direction, and definitely file a JIRA as this could be an additional metric in the future, but it's not exactly what I had in mind. One of the hardest parts of load balancing based on request count and other dynamic/transient measures is that you can get some pretty

RE: gauging cost of region movement

2011-03-21 Thread Jonathan Gray
Also, using more stable measures of request count will help, such as 30 minute rolling averages. -Original Message- From: Jonathan Gray [mailto:jg...@fb.com] Sent: Monday, March 21, 2011 4:23 PM To: dev@hbase.apache.org Subject: RE: gauging cost of region movement This is an

Re: gauging cost of region movement

2011-03-21 Thread Ryan Rawson
it would make sense to avoid moving regions, so therefore the more recently a region was moved, the less likely we should move it. you could imagine a hypothetical perfect 'region move cost' function that might look like: F(r) = timeSinceMoved(r) + size(r) + loadAvg(r) The functions should

Re: gauging cost of region movement

2011-03-21 Thread Ted Yu
I opened HBASE-3679 and pasted comments there. Please continue on that JIRA. On Mon, Mar 21, 2011 at 4:32 PM, Ryan Rawson ryano...@gmail.com wrote: it would make sense to avoid moving regions, so therefore the more recently a region was moved, the less likely we should move it. you could

Build failed in Jenkins: hbase-0.90 #126

2011-03-21 Thread Apache Hudson Server
See https://hudson.apache.org/hudson/job/hbase-0.90/126/changes Changes: [jgray] HBASE-3641 LruBlockCache.CacheStats.getHitCount() is not using the correct variable -- [...truncated 2735 lines...] Running

Re: minor compaction bug (was: upsert case performance problem)

2011-03-21 Thread Andrew Purtell
Hi Dhruba, another bottleneck that I am seeing is that all transactions need to come to a halt when rolling hlogs, the reason being that all transactions need to be drained before we can close the hlog I didn't measure the rate but I'd expect quite often due to a constant

Build failed in Jenkins: HBase-TRUNK #1799

2011-03-21 Thread Apache Hudson Server
See https://hudson.apache.org/hudson/job/HBase-TRUNK/1799/changes Changes: [stack] HBASE-3052 Add ability to have multiple ZK servers in a quorum in MiniZooKeeperCluster for test writing -- BACKED IT OUT... NOT DONE YET [stack] HBASE-3052 Add ability to have multiple ZK servers in a quorum in

Re: compile hbase in linux and windows problem

2011-03-21 Thread Stack
2011/3/21 Zhoushuaifeng zhoushuaif...@huawei.com: My linux is behand a proxy and have some problem to access internet, linux and windows env is below: Can you get one of your network admins to help you w/ the hbase connection going via proxy? Its hard for us from here to give you help about

Jenkins build is back to normal : hbase-0.90 #127

2011-03-21 Thread Apache Hudson Server
See https://hudson.apache.org/hudson/job/hbase-0.90/127/changes