Re: scanner lease expired/region server shutdown

2010-01-27 Thread Stack
ng on new writes because of lack of resources? Was this the same server that was running atop a HDFS that was suffering "too many open files"? > > 3. <<< Is there a public folder some place you can post them so I can pull > them.>>> > > Stack: perhaps I'll email it to you offline as a start. Please do. St.Ack

Discussion: Move contribs out of hbase?

2010-01-28 Thread Stack
I'd like to start a discussion on moving src/contrib out of hbase. Keep reading if you have an opinion. I'd like to suggest that we undo the notion of hbase contribs for the following reasons: + In my experience, they present a friction on changes to core as any significant core change tends to r

Re: Discussion: Move contribs out of hbase?

2010-01-28 Thread Stack
On Thu, Jan 28, 2010 at 2:27 PM, Dhruba Borthakur wrote: >  Contribs are not first-class citizens. The build script can be setup to > ignore build failures in contrib modules. The hope is that when a release is > about to be cut, contrib owners will submit fixes to any build problems if > they wa

Re: Cannot locate root region

2010-01-29 Thread Stack
On Fri, Jan 29, 2010 at 11:29 AM, Joydeep Sarma wrote: > i meant even if we were using hostnames for RS registration (which i > think has lot of advantages - not necessarily in our environment > though) - Agreed, we should use hostnames for the advantages it gives listed earlier in this thread...

Re: HLog sync() questions

2010-01-29 Thread Stack
On Fri, Jan 29, 2010 at 5:17 AM, Lars George wrote: > �...@override >  public void sync() throws IOException { >    this.writer.sync(); >    if (this.writer_out != null) { >      this.writer_out.sync(); >    } >  } > > The first sync calls SequenceFile.Writer.sync() which is not at all > what we w

Re: HLog sync() questions

2010-01-30 Thread Stack
on implementing Writer classes. Just wondering. > That makes sense to me. Stack

Re: Discussion: Move contribs out of hbase?

2010-01-30 Thread Stack
. Then they must >> write a patch, submit it to a hbase committer, etc.  If the contrib >> was in a non-ASF repo, the author could fix it much faster. >> >> That's my theory at least? >> >> On Thu, Jan 28, 2010 at 2:27 PM, Dhruba Borthakur wrote: >>> Hi

Fwd: [VOTE] Commit HDFS-927 to both 0.20 and 0.21 branch?

2010-02-02 Thread Stack
Please vote on below. Be sure to put your vote up on hdfs-dev. Thanks all. St.Ack -- Forwarded message -- From: Stack Date: Tue, Feb 2, 2010 at 10:22 PM Subject: [VOTE] Commit HDFS-927 to both 0.20 and 0.21 branch? To: hdfs-...@hadoop.apache.org I'd like to open a vo

Re: IvyDE Usage

2010-02-04 Thread Stack
Did you get it to work Lars? How? Adding ivy/libraries.properties or ivy to your CLASSPATH? St.Ack On Thu, Feb 4, 2010 at 5:31 AM, Lars George wrote: > OOps, looks like I was on an older level. Didn't have the > ivy/libraries.properties. Sorry. > > On Thu, Feb 4, 2010 at 2:08 PM, Lars George w

Re: Discussion: Move contribs out of hbase?

2010-02-04 Thread Stack
Trying to summarize the above back and forth, how about going forward we do something like the following: + We keep contrib + Look into having build NOT go down to contrib dirs by default so broken contrib doesn't hold up core + Core devs no longer are required chase changes all the ways down into

Re: Discussion: Move contribs out of hbase?

2010-02-04 Thread Stack
ans no visibility from hbase and more steps to get it >> - directly into core, with a configuration variable that works the same way >> as dfs.append.enable >> >> J-D >> >> >> On Thu, Feb 4, 2010 at 1:50 PM, Stack wrote: >> >>> Trying to summarize the ab

Re: Discussion: Move contribs out of hbase?

2010-02-04 Thread Stack
On Thu, Feb 4, 2010 at 6:24 PM, Lars Francke wrote: > I've just seen your comment on HBASE-1402. It'll be no problem to keep > the two different API versions in the core. I'll just use two > different package names and rewrite the ThriftServer to accept a > parameter to chose between the old and n

Re: Discussion: Move contribs out of hbase?

2010-02-04 Thread Stack
s and then queries all to verify stuff works. Taking that out will cut build test times in half (smile). St.Ack On Thu, Feb 4, 2010 at 10:28 PM, Kay Kay wrote: > On 02/04/2010 06:32 PM, Stack wrote: >> >> On Thu, Feb 4, 2010 at 6:24 PM, Lars Francke >>  wrote: >> >>

Re: IvyDE Usage

2010-02-05 Thread Stack
That article was really helpful Lars. Thanks. St.Ack On Fri, Feb 5, 2010 at 12:25 PM, Lars George wrote: > Hi Stack, > > http://www.larsgeorge.com/2010/02/ivyde-and-hbase-021-trunk.html > > Hope that helps? > > Lars > > On Fri, Feb 5, 2010 at 9:21 AM, Lars George wr

Re: Stargate War - jetty.xml and dependencies

2010-02-06 Thread Stack
On Sat, Feb 6, 2010 at 3:03 AM, Paul Smith wrote: > > If someone could comment on where the jetty.xml should end up in a stargate > binary (and indeed, where it should appear in a general hbase binary tar > ball) I would appreciate it.    I'm guessing it's designed to be used with > Jetty to k

Re: Stargate War - jetty.xml and dependencies

2010-02-08 Thread Stack
The WAR has everything under WEB-INF (class files, etc.). The jar has it all at top-level. It looks like a WAR can't be used as a JAR as I suggested in my previous mail so, yeah, stargate contrib would seem to have WAR and JAR targets (unless someone knows better). St.Ack On Sun, Feb 7, 2010 at

Re: Stargate War - jetty.xml and dependencies

2010-02-08 Thread Stack
On Mon, Feb 8, 2010 at 6:05 PM, Paul Smith wrote: > >... > What I propose is then a directory structure change to stargate > > hbase/ >   contrib/ >        stargate/ >              web >              service (or something) > > and move the WEB-INF related stuff into the 'web' area, and move the ja

Re: Stargate War - jetty.xml and dependencies

2010-02-09 Thread Stack
On Tue, Feb 9, 2010 at 9:31 AM, Andrew Purtell wrote: > Stargate is > getting merged back into core. > > So this is why I haven't done something like the above. Is it worth > the time? You are right Andy. Stargate going up into core for 0.21 means the above contrib work is not needed. The WAR p

Re: thinking about HUG9

2010-02-11 Thread Stack
Can we do March 8th? I can't do March 9th. St.Ack On Thu, Feb 11, 2010 at 12:43 PM, Andrew Purtell wrote: > Hi all, > > Trend Micro would like to host HUG9 at our offices in Cupertino: > > http://maps.google.com/maps?f=q&source=s_q&hl=en&geocode=&q=10101+North+De+Anza+Blvd,+Cupertino,+CA&sll=37.

Re: thinking about HUG9

2010-02-11 Thread Stack
Either works for me. What about others? St.Ack On Thu, Feb 11, 2010 at 2:33 PM, Andrew Purtell wrote: > March 8 is ok -- afternoon/evening. > >   - Andy > > > >> From: Stack >> Can we do March 8th?  I can't do March 9th. >> St.Ack >> >> O

Re: Moving to Maven (HBASE-2099)

2010-02-12 Thread Stack
I'm +1 (I've used maven in past lives). Paul: Any chance of publishing the website up on your personal apache account and passing out the link to show folks what a mavenized hbase website would look like. In particular the reports you mention in the below. Good stuff, St.Ack On Fri, Feb 12, 20

Re: Moving to Maven (HBASE-2099)

2010-02-13 Thread Stack
On Sat, Feb 13, 2010 at 1:51 AM, Dhruba Borthakur wrote: > My personal experience is that the ivy-maven-stuff introduced into the > Hadoop build system has tremendously slowed down the Hadoop build process. I > am sure that this disadvantage is offet-ed by some advantages that I am not > aware of.

Re: Moving to Maven (HBASE-2099)

2010-02-13 Thread Stack
This sounds broke Andrew -- like its not working as advertised. Make an issue and the fellas w/ ivy-fu will fix it. St.Ack On Sat, Feb 13, 2010 at 9:48 AM, Andrew Purtell wrote: > Even with -Doffline=true Ivy still wants to connect to resolve dependencies > and fails the build if I'm disconnect

Heads-up: HBase is moving to Maven in next day or so (WAS --> Re: Moving to Maven (HBASE-2099))

2010-02-17 Thread Stack
I went over the "Moving to Maven (HBASE-2099)" thread and I see only +1s (a -1 was subsequently withdrawn). Other objections I heard were complaints that dev couldn't build without being net connected -- specifically on LA<->Singapore<->Taiwan flights -- with current ivy-based build but mavenites

Re: HBase trunk and Hadoop 0.21

2010-02-18 Thread Stack
the notion that when hbase TRUNK is baked, we'll make it run on hadoop 0.20/0.21/0.22. I'm against an hbase 1.0.0 just now. St.Ack On Wed, Feb 17, 2010 at 11:42 AM, Jean-Daniel Cryans wrote: > Hi devs, > > Yesterday Stack, Ryan, Todd (from cloudera) and me had a meeting with

Re: HBase trunk and Hadoop 0.21

2010-02-19 Thread Stack
need to backport cluster replication to 0.20. > Above sounds good. Lets wrap up a 0.20.4 soon. Lets see if we can get another one or two "performance" tweeks in there and put it up on hadoop 0.20.2 too since it looks imminent. St.Ack > J-D > > On Thu, Feb 18, 2010 at 12:53 PM, S

Re: HBase trunk and Hadoop 0.21

2010-02-19 Thread Stack
On Thu, Feb 18, 2010 at 2:48 PM, Lars Francke wrote: > > How about the new Thrift interface? I wasn't overly concerned with > timing as Hadoop 0.21 seemed to be some time off but if you decide to > put it into a 0.20.x version I'll spend some time on it to get another > patch out for review. It sh

Re: thinking about HUG9

2010-02-22 Thread Stack
Yeah, 29th seems good to me. Did you see the the meetup email where Daniel Einspanjer is suggesting a meetup 3/10 at mozilla. Thats the week you can't do, right? St.Ack On Mon, Feb 22, 2010 at 2:08 PM, Andrew Purtell wrote: > I talked with Stack over the weekend. We're thinking

Re: thinking about HUG9

2010-02-22 Thread Stack
ook a venue for that day soon unless someone votes it down. - Andy - Original Message From: Stack To: hbase-dev@hadoop.apache.org Cc: hbase-u...@hadoop.apache.org Sent: Mon, February 22, 2010 3:05:22 PM Subject: Re: thinking about HUG9 Yeah, 29th seems good to me. Did you see

Re: Build failed in Hudson: HBase-Patch #1122

2010-02-23 Thread Stack
Here is what I'm passing as mvn goals; clean package assembly:assembly St.Ack On Tue, Feb 23, 2010 at 1:28 PM, wrote: > Gents can you tell me what mvn command line args are used by Hudson? > > What seems to be happening is the test jar is not being produced and is > needed by one of the contri

Re: JIRA via email, it's about time

2010-03-04 Thread Stack
le to >> comment? > > Stack is. > > I think all we need is instead of having the reply-to to > hbase-...@apache.org, it should be j...@apache.org > > J-D >

New mailing list!, hbase-issues --> WAS: Re: JIRA via email, it's about time

2010-03-05 Thread Stack
Owen made a change so all jira issue emissions are now done on hbase-iss...@hadoop.apache.org so subscribe to pick up the jira emissions that used appear on hbase-dev. Send a mail to hbase-issues-subscr...@hadoop.apache.org. I'm trying to work on the reply-to issue now. St.Ack On Thu, Mar 4, 20

Re: New mailing list!, hbase-issues --> WAS: Re: JIRA via email, it's about time

2010-03-05 Thread Stack
Todd > > On Fri, Mar 5, 2010 at 12:48 PM, Ryan Rawson wrote: > >> Thanks stack! >> >> -ryan >> >> On Fri, Mar 5, 2010 at 12:14 PM, Stack wrote: >> > Owen made a change so all jira issue emissions are now done on >> > hbase-iss...@hadoop.apache

Re: New mailing list!, hbase-issues --> WAS: Re: JIRA via email, it's about time

2010-03-05 Thread Stack
ing that is disabled on the -issues list).  But still > seems nice to have the new issue notifications without seeing the full > volume of changes. > > > On Fri, Mar 5, 2010 at 4:34 PM, Stack wrote: > >> On Fri, Mar 5, 2010 at 1:24 PM, Todd Lipcon wrote: >> > Are n

Re: New mailing list!, hbase-issues --> WAS: Re: JIRA via email, it's about time

2010-03-05 Thread Stack
doop, and I find it handy. You find out about new ones on the -dev list > and then can Watch the ones that interest you. > > -Todd > > On Fri, Mar 5, 2010 at 12:48 PM, Ryan Rawson wrote: > >> Thanks stack! >> >> -ryan >> >> On Fri, Mar 5, 2010 a

Re: JIRA via email, it's about time

2010-03-05 Thread Stack
On Thu, Mar 4, 2010 at 2:37 PM, Lars Francke wrote: >> - JIRA should not start new threads (most of us use gmail) just "cuz" > > By the way: Is Apache's JIRA down (half the time) and slow (the rest > of the time) only for me? > Are you using chrome browser perchance? St.Ack

Re: New mailing list!, hbase-issues --> WAS: Re: JIRA via email, it's about time

2010-03-05 Thread Stack
I filed an issue w/ infrastructure asking if they can strip Reply-To per your suggestion Gary. Meantime, it seems like if you reply to an an issue and adjust the to so its j...@apache.org, that seems to work. St.Ack On Fri, Mar 5, 2010 at 2:20 PM, Gary Helmling wrote: > Yeah, thank you St

Re: Build failed in Hudson: HBase-Patch #1144

2010-03-06 Thread Stack
I'm messing with hudson trying to get javadoc, pmd, and findbugs reports showing per build hence the failures below. St.Ack On Sat, Mar 6, 2010 at 3:26 AM, Apache Hudson Server wrote: > See > > Changes: > > [jdcryans] HBASE-2293

Re: Build failed in Hudson: HBase-Patch #1146

2010-03-07 Thread Stack
ld to be sure. Lets see what happens. St.Ack On Sat, Mar 6, 2010 at 5:54 PM, Apache Hudson Server wrote: > See <http://hudson.zones.apache.org/hudson/job/HBase-Patch/1146/changes> > > Changes: > > [stack] HBASE-2261 The javadoc in WhileMatchFilter and it's tests in

Any objection if we up RPC version when we go from 0.20.3 to 0.20.4?

2010-03-08 Thread Stack
Are there objections to changing the RPC version number when we release 0.20.4? Changing the RPC version number will mean that a 0.20.4 and 0.20.3 version hbase cluster will not be able to talk to each other. Updating your cluster from 0.20.3 to 0.20.4 will require a restart. Currently our RPC i

Re: Any objection if we up RPC version when we go from 0.20.3 to 0.20.4?

2010-03-08 Thread Stack
rn. >>> >>> Meanwhile - it might be worthwhile to have a 'bold' mention w.r.t backward >>> incompatibility ( cold restart , as opposed to a rolling one) in the >>> documentation home page for 0.20.4 about this. Thanks. >>> >>> >>>

Re: Any objection if we up RPC version when we go from 0.20.3 to 0.20.4?

2010-03-08 Thread Stack
I think naming it hbase 0.21.x will confuse more since it implies hadoop 0.21.x (up to this we've aligned our versions). Its my sense that few rely on being able to upgrade using the rolling restart feature -- i.e. updating a daemon at a time letting the cluster run across the upgrade -- and that

Re: Build failed in Hudson: HBase-Patch #1153

2010-03-10 Thread Stack
This is my fault. Fixing (HBASE-2307). St.Ack On Tue, Mar 9, 2010 at 2:39 PM, Apache Hudson Server wrote: > See <http://hudson.zones.apache.org/hudson/job/HBase-Patch/1153/changes> > > Changes: > > [stack] HBASE-2295 Row locks may dea

Re: Build failed in Hudson: hbase-020-branch #1

2010-03-10 Thread Stack
Ignore the below. I'm trying to add to hudson building of hbase 0.20 branch. St.Ack On Wed, Mar 10, 2010 at 1:58 PM, Apache Hudson Server wrote: > See > > -- > [...truncated 876 lines...] > A

Google Summer of Code Startup

2010-03-12 Thread Stack
Its Google Summer of Code time again. Below is the note from the good crew running Apache participation. If anyone wants to mentor or if there are 'students' interested in an spending their summer hbase hacking (for money!) write me off list. Thanks, St.Ack -- Forwarded message ---

Re: Google Summer of Code Startup

2010-03-13 Thread Stack
On Fri, Mar 12, 2010 at 10:18 PM, Cosmin Lehene wrote: > Awesome! I wanted to ask you about this the other day. Also, is there > a way to determine interest for hbase support inside Google? I know > there is something for hadoop. > J-D did ask Jeff Dean to come to the HUG9 down at Moziilla last w

Re: Face Off?

2010-03-13 Thread Stack
I don't know of any committers going to SXSW. A bunch from SU headed out to Texas but they'll be out to enjoy themselves I'd say, given all thats going on. St.Ack On Sat, Mar 13, 2010 at 12:53 AM, Lars George wrote: > Hi, > > Not sure if that was discussed (was out of the loop the last few > da

Re: Build failed in Hudson: hbase-020-branch #10

2010-03-13 Thread Stack
This passes locally for me. Let me resubmit a build. St.Ack On Sat, Mar 13, 2010 at 3:31 PM, Apache Hudson Server wrote: > See <http://hudson.zones.apache.org/hudson/job/hbase-020-branch/10/changes> > > Changes: > > [stack] HBASE-2219  Stop using code mapping for me

Re: Maven assembly speed issue (from discussion with jdcryans on IRC)

2010-03-13 Thread Stack
I did this bit of the patch: @@ -308,10 +309,6 @@ src/assembly/bin.xml - -src -project - ... but as Lars says, there is a version up in the pluginManagement section. Should I downgrade from beta5 to be

Re: Maven assembly speed issue (from discussion with jdcryans on IRC)

2010-03-14 Thread Stack
I committed the change. Its much faster. Thanks lads. St.Ack On Sat, Mar 13, 2010 at 10:34 PM, wrote: > Yep i would downgrade to beta-1 in the pluginmanagement section it's way > faster. > > > > On 14/03/2010, at 14:35, Stack wrote: > >> I did this bit o

Re: Maven assembly speed issue (from discussion with jdcryans on IRC)

2010-03-14 Thread Stack
ter mvn package assembly:directory, this feels wrong: http://gist.github.com/332129 2) ./bin/hbase is completely broken because of the change in the target directory name (.dir suffix) On Sun, Mar 14, 2010 at 11:20 AM, Stack wrote: I committed the change. Its much faster. Thanks lads. St.Ack On Sat, Mar 13

Re: Maven assembly speed issue (from discussion with jdcryans on IRC)

2010-03-15 Thread Stack
base is completely broken because of the change in the >> target directory name (.dir suffix) >> >> On Sun, Mar 14, 2010 at 11:20 AM, Stack wrote: >>> I committed the change.  Its much faster.  Thanks lads. >>> St.Ack >>> >>> On Sat, Mar 13, 201

Re: Maven assembly speed issue (from discussion with jdcryans on IRC)

2010-03-15 Thread Stack
Yeah, only the bin.tar.gz was produced. St.Ack On Mon, Mar 15, 2010 at 2:28 PM, wrote: > Did assembly:directory not keep the directory? Or are you saying the other 2 > archives were not produced (this being because we removed the 2 descriptor > refs) > > > > On 16/03/2010,

Re: HBASE-2312 discussion

2010-03-16 Thread Stack
Karthik: Thanks for looking into this. Reading over the issue, you think option #2 "not clean" before Todd proposes changing overwrite to false. Do you still think it so? If not, then option #2 seems straight-forward. While option #3 is more code, its attractive in that its a pattern we might

Re: Maven assembly speed issue (from discussion with jdcryans on IRC)

2010-03-16 Thread Stack
Here is a list of things I found in lib that we don't need to run: -rwsrwsrwt 1 Stack staff 1034049 Mar 16 16:45 ant-1.6.5.jar -rwsrwsrwt 1 Stack staff 279781 Mar 16 16:45 commons-httpclient-3.0.1.jar -rwsrwsrwt 1 Stack staff 706710 Mar 16 16:45 hsqldb-1.8.0.10.jar -rwsrwsrw

Re: HBASE-2312 discussion

2010-03-16 Thread Stack
On Tue, Mar 16, 2010 at 5:08 PM, Todd Lipcon wrote: > > What do you think about the trick of making the RS do a ZK sync before any > meta op? This forces it to take at most one action after it's been > terminated. > ... where meta op is open of new WAL log? How would this work? RS would note in

Re: Build failed in Hudson: HBase-Patch #1167

2010-03-16 Thread Stack
t; > Changes: > > [stack] HBASE-2334 Slimming of Maven dependency tree - improves assembly build > > -- > [...truncated 405 lines...] > [WARNING] > <http://hudson.zones.apache.org/hudson/job/HBase-Patch/ws/trunk/cor

[DISCUSS] HBase as Apache top-level project?

2010-03-18 Thread Stack
I'd like to start a discussion about promoting HBase from a Hadoop sub-project to a top-level Apache project (TLP). This is not yet a vote. Once we have established general understanding and agreement, I'll call a vote. I propose we move HBase from hadoop.apache.org/hbase to hbase.apache.org. H

Re: [DISCUSS] HBase as Apache top-level project?

2010-03-18 Thread Stack
On Thu, Mar 18, 2010 at 10:15 AM, Andrew Purtell wrote: > > HBase is an integrated optional part of a Hadoop stack more > than a standalone component, but other ASF TLPs build on top > of other projects. I suppose HDFS and ZK are going to be TLPs > at some point also, is that true?

[MORE DISCUSSION] Moving hbase trunk (temporarily) back to hadoop 0.20.x (from head of the hadoop 0.21 branch)

2010-03-18 Thread Stack
Unless there is objection, in the next day or so, I'd like to revert the hadoop that is in hbase trunk and replace it with hadoop 0.20.2. Currently hbase trunk bundles the head of the 0.21 hadoop branch and will only run atop an hadoop built out of this hadoop 0.21 branch. Since the plan is that t

Re: [DISCUSS] HBase as Apache top-level project?

2010-03-18 Thread Stack
On Thu, Mar 18, 2010 at 11:08 AM, Dhruba Borthakur wrote: > Hi Stack, > > Can HBase (in theory) be used on filesystems/MR other than Hadoop? > In theory yes. > I see one primary disadvantage of moving away from the Hadoop project. > Please let me explain. In the Hadoop world,

Re: [DISCUSS] HBase as Apache top-level project?

2010-03-18 Thread Stack
relational database who is interested in fast >> read/write >> > random access might be able to choose a DFS more closely suited to >> that use >> > case.  Hopefully HDFS gets better at this so it could be the leader >> across >> > the board, but I don

Re: Build failed in Hudson: HBase-Patch #1174

2010-03-19 Thread Stack
Thanks Andrew for the below: pynchon-2:trunk stack$ svn log !$ svn log core/src/main/java/org/apache/hadoop/hbase/regionserver/wal/WALEdit.java r925519 | apurtell | 2010-03-19 18:42:09 -0700 (Fri, 19 Mar 2010) | 1 line

Re: JIRA via email, it's about time

2010-03-25 Thread Stack
rv handling.  I don't know ezmlm (though I'm > checking the docs now).  Any idea if there's a way to skip the Reply-To list > based on the message sender?  Maybe another question for Owen? > > > On Thu, Mar 4, 2010 at 12:03 PM, Stack wrote: > >> I don't have

Re: How to get list of all hbase test suites?

2010-03-27 Thread Stack
Does ant test not work on cygwin? Stack On Mar 27, 2010, at 8:14 PM, Zhimao Guo wrote: Hi, all I am in windows platform, trying to get some sense of hadoop/hbase. I have cygwin/sshd server there. And I even have setup up successfully 1-replica hdfs and hbase to run them together using

Re: Build failed in Hudson: HBase-Patch #1189

2010-03-29 Thread Stack
I'm on the deletes failure. St>Ack On Mon, Mar 29, 2010 at 1:29 PM, Andrew Purtell wrote: > I didn't change anything that would fail > org.apache.hadoop.hbase.client.TestFromClientSide.testDeletes . > > >> From: Apache Hudson Server >> Subject: Build failed in Hudson: HBase-Patch #1189 >> To: h

Re: JIRA via email, it's about time

2010-03-30 Thread Stack
On Fri, Mar 26, 2010 at 12:25 PM, Gary Helmling wrote: > Hey Stack, > > The emails I'm seeing on hbase-issues look good.  Replies are going to > j...@apache.org which is what we want.  Any replies should be appended by > jira as comments to the relevant issues. > > I t

Re: [ANNOUNCEMENT] Contributor Workshop at Yahoo!

2010-03-30 Thread Stack
What you all think? First we need figure who's going to do the hbase representing this year and make sure we get a paper in. Write me if interested so we can coordinate. If past years are anything to go by, there'll be good attendance and lots of paper submissions so we should get something in s

Re: [ANNOUNCEMENT] Contributor Workshop at Yahoo!

2010-03-30 Thread Stack
that they received my e-mail but nothing further yet. > > JG > >> -Original Message- >> From: saint@gmail.com [mailto:saint@gmail.com] On Behalf Of >> Stack >> Sent: Tuesday, March 30, 2010 2:46 PM >> To: hbase-dev@hadoop.apache.org >> S

Re: [DISCUSS] HBase as Apache top-level project?

2010-04-01 Thread Stack
On Thu, Mar 18, 2010 at 5:00 PM, Jonathan Gray wrote: > Annoyance has really not gotten us anywhere.  And I don't think it matters to > those in Hadoop whether we are a TLP or SP, they will not (or should not) be > offended if we break off.  Do you think they would take us (or our patches) > le

[VOTE] HBase as an Apache top-level project? Re: [DISCUSS] HBase as Apache top-level project?

2010-04-07 Thread Stack
Do we want to become an Apache top-level project? Please vote. (I'm +1) Thanks, St.Ack On Thu, Mar 18, 2010 at 9:58 AM, Stack wrote: > I'd like to start a discussion about promoting HBase from a Hadoop > sub-project to a top-level Apache project (TLP). > > This is no

Re: Vote on 0.20.3.1

2010-04-07 Thread Stack
On Tue, Apr 6, 2010 at 10:24 PM, Ryan Rawson wrote: > I don't get it - why did we commit all those things to 0.20 branch if > they are not suitable for the next release? > > If we did accidentally commit things that are not suitable for 0.20.4, > then we should revert them asap and make a 0.20.4 r

Re: Vote on 0.20.3.1

2010-04-07 Thread Stack
On Wed, Apr 7, 2010 at 11:34 AM, Todd Lipcon wrote: > ... > I agree with Ryan that branching the release branch can get pretty > confusing. I've only seen a version number like 0.20.3.1 once before, and > that was for a completely botched release, where the .1 was a very very > minor fix on top of

Re: Vote on 0.20.3.1

2010-04-07 Thread Stack
On Wed, Apr 7, 2010 at 1:35 PM, Ryan Rawson wrote: > What happens if we need to patch 0.20.4?  And make a new release based > on 0.20.4 but in 2 weeks but not before the 0.20 branch is ready? > The though is that we will fix in 0.20.5. We won't put fixes on the branch of branch. > How can we gu

Re: Vote on 0.20.3.1

2010-04-07 Thread Stack
I went through the list issues that we had filed against a 0.20.4. I moved out the issues that depend on hdfs-200, post rpc-version change, etc. Outstanding are ~15 issues: http://su.pr/1TLvb7 A good few are patch available. A couple of others are small doc issues. I'll take care of the easy o

[VOTE CLOSE, MOTION CARRIES] WAS -> Re: [VOTE] HBase as an Apache top-level project? Re: [DISCUSS] HBase as Apache top-level project?

2010-04-07 Thread Stack
t; JG >> >> On 4/7/10 10:11 AM, "Andrew Purtell" wrote: >> >>> +1 >>> >>> Thanks for taking the initiative Stack and taking on lead for the first >>> year. >>> >>>    - Andy >>> >>> >>> >>> >>> >> >> >

Parfait -> WAS -> Re: Should HTable.put() return a Future?

2010-04-07 Thread Stack
On Tue, Apr 6, 2010 at 6:10 PM, Paul Smith wrote: >> >> ... > anyway, some more ideas to kick around and discuss. > What do we have to do to get it running on one of our clusters Paul? St.Ack

Re: hbase export in cluster mode

2010-04-08 Thread Stack
Our doc. on this topic can be found here: http://hadoop.apache.org/hbase/docs/r0.20.3/api/org/apache/hadoop/hbase/mapreduce/package-summary.html#package_description St.Ack On Thu, Apr 8, 2010 at 9:40 PM, Todd Lipcon wrote: > On Thu, Apr 8, 2010 at 4:39 PM, Jean-Daniel Cryans wrote: > >> Ted, ple

Re: hbase export in cluster mode

2010-04-08 Thread Stack
On Thu, Apr 8, 2010 at 9:46 PM, Ted Yu wrote: > Feel free to comment in this JIRA: > https://issues.apache.org/jira/browse/HADOOP-6695 > Please read the documentation cited above. It discusses the three options including one which does not necessitate restart of MR cluster, the one Todd refers t

Re: shutdown order of hbase and hadoop

2010-04-09 Thread Stack
There is an outstanding issue over in the current down JIRA to address this, make it so hbase can ride over FS restart. St.Ack On Fri, Apr 9, 2010 at 4:31 PM, Ted Yu wrote: > If hadoop is restarted when hbase is still running, hbase table(s) would be > corrupted. > > Is it possible to make hbase

[VOTE] HBase as TLP?

2010-04-12 Thread Stack
Please vote as to whether you think HBase should become a top-level Apache project. I've included below a draft board resolution. It lists all current active HBase committers as initial members of the project management committee (PMC) and myself, Michael Stack, as the initial chair. D

Re: Build failed in Hudson: HBase-Patch #1210

2010-04-12 Thread Stack
t; > Changes: > > [apurtell] HBASE-2436 [stargate] update Jersey and JSON depedencies > > [stack] HBASE-1933  Upload Hbase jars to a public maven repository > > -- > [...truncated 1240 lines...] > [INFO] hbase-0.21.0-SNAPSHOT/lib/jetty-

hbase TRUNK hudson builds now are automatically deployed to the apache maven snapshot repository

2010-04-13 Thread Stack
When hudson, the apache hudson continuous integration box [1], successfully builds hbase TRUNK, it now automatically dumps the built artifacts -- jars and poms -- to the apache maven snapshot repository. You can navigate the repo using the nexus tool here, [2]. Seach for hbase. We've been publish

Re: Build failed in Hudson: HBase-Patch #1214

2010-04-14 Thread Stack
I just fixed this (forward porting a patch I missed an import). St.Ack On Tue, Apr 13, 2010 at 11:28 PM, Apache Hudson Server wrote: > See <http://hudson.zones.apache.org/hudson/job/HBase-Patch/1214/changes> > > Changes: > > [stack] HBASE-2440 Master UI should check

Re: [VOTE] HBase as TLP?

2010-04-14 Thread Stack
This passes, with 14 +1 votes and no -1 votes. Owen, can you please add this resolution to the agenda for next week's board meeting? Thanks, St.Ack On Tue, Apr 13, 2010 at 12:25 PM, Cosmin Lehene wrote: > +1 > > > On Apr 12, 2010, at 6:56 PM, Stack wrote: > >> Ple

0.20.4RC1? (WAS -> Re: Vote on 0.20.3.1)

2010-04-14 Thread Stack
we need to get in before I cut the candidate? Thanks, St.Ack On Wed, Apr 7, 2010 at 9:09 PM, Ryan Rawson wrote: > I like this. With no durability goal, we should be able to hit this in > short order.  HDFS is not ready for the claim as of yet. > > > > On Wed, Apr 7, 2010 at 5:2

Re: Dependency versions in HBase trunk

2010-04-15 Thread Stack
Good stuff Lars. All the below look good to me. We should just switch TRUNK and see how it goes. St.Ack On Thu, Apr 15, 2010 at 5:51 AM, Lars Francke wrote: > Hi guys, > > I've been working on the Maven build again and I've identified a few > "outdated" dependencies and trunk would be the place

Re: 0.20.4RC1? (WAS -> Re: Vote on 0.20.3.1)

2010-04-15 Thread Stack
se? > For sure. RCs are out for a week or so usually. Good on you Todd, St.Ack > -Todd > > On Wed, Apr 14, 2010 at 9:42 PM, Stack wrote: > >> Unless objection, I was going to put up a 0.20.4 Release Candidate 1 >> made from the tip of the 0.20_pre_durability branch t

Re: Build failed in Hudson: hbase-020-branch #62

2010-04-16 Thread Stack
This looks transient, unrelated to the commit. Will look into it. St.Ack On Thu, Apr 15, 2010 at 11:15 PM, Apache Hudson Server wrote: > See <http://hudson.zones.apache.org/hudson/job/hbase-020-branch/62/changes> > > Changes: > > [stack] HBASE-2456  deleteChangedReaderObser

Re: Re: volatile considered harmful

2010-04-17 Thread Stack
On Fri, Apr 16, 2010 at 6:00 PM, Ryan Rawson wrote: > Ok mystery solved, the Put thread was stuck in a wait() loop inside > HRegion which catches InterruptedException, eats it then goes back to > waiting for a condition that will never clear (memstore too big). > Sounds like we could run into thi

[VOTE] Shall we release hbase-0.20.4 Release Candidate 1 as hbase-0.20.4?

2010-04-17 Thread Stack
I've posted an hbase 0.20.4 release candidate here: http://people.apache.org/~stack/hbase-0.20.4-candidate-1/ Should we release this candidate as hbase 0.20.4? In includes some critical fixes and some performance enhancements (See CHANGES.txt or http://su.pr/4QEGFv for the list of ove

Re: [VOTE] Shall we release hbase-0.20.4 Release Candidate 1 as hbase-0.20.4?

2010-04-20 Thread Stack
ter Science Graduate Student >> University of California, Santa Cruz >> >> >> On Sat, Apr 17, 2010 at 10:14 PM, Stack wrote: >> >>> I've posted an hbase 0.20.4 release candidate here: >>> >>>  http://people.apache.org/~stack/hbase-0.20.4-c

Re: [VOTE] Shall we release hbase-0.20.4 Release Candidate 1 as hbase-0.20.4?

2010-04-20 Thread Stack
ks weird. You mean this page: http://people.apache.org/~stack/hbase-0.20.4-candidate-1/hbase-0.20.4/docs/ What is missing? >  - The client package and HTable javadoc are outdated/slightly wrt row > locks since 2248. Here's what Ryan told me after discussing with him: > > I di

Re: [VOTE] Shall we release hbase-0.20.4 Release Candidate 1 as hbase-0.20.4?

2010-04-20 Thread Stack
St.Ack On Tue, Apr 20, 2010 at 2:46 PM, Andrew Purtell wrote: > Ok, the RC is sunk. > > Let's make sure there is a unit test for whatever the issue found is. The > suite otherwise didn't catch it and neither did PE, at least not an obvious > failure. > > Hey Stack,

Re: [VOTE] Shall we release hbase-0.20.4 Release Candidate 1 as hbase-0.20.4?

2010-04-20 Thread Stack
check. Once we have 0.20.4 released I'll work on it more. On Tue, Apr 20, 2010 at 3:07 PM, Stack wrote: HBASE-2421, 2424 are multiput fixes. Multiput is not in 0.20_pre_durability. The others I'd like to do unit tests for first and IMO, they are ugly but not blockers. I'd

Re: [VOTE] Shall we release hbase-0.20.4 Release Candidate 1 as hbase-0.20.4?

2010-04-20 Thread Stack
On Tue, Apr 20, 2010 at 9:02 AM, Jean-Daniel Cryans wrote: >> You mean this page: >> >> http://people.apache.org/~stack/hbase-0.20.4-candidate-1/hbase-0.20.4/docs/ >> >> What is missing? > > Well the page has 4 items, on the left I see 9 items. Originally thos

[VOTE] Shall we release hbase-0.20.4 Release Candidate 2 as hbase-0.20.4? (WAS --> Re: [VOTE] Shall we release hbase-0.20.4 Release Candidate 1 as hbase-0.20.4?)

2010-04-20 Thread Stack
I've posted an hbase 0.20.4 release candidate 2 here:  http://people.apache.org/~stack/hbase-0.20.4-candidate-2/ Should we release this candidate as hbase 0.20.4? In includes some critical fixes and some performance enhancements (See CHANGES.txt or the release notes in the docs [1] fo

HBase move to Apache Top Level Project

2010-04-22 Thread Stack
The board yesterday passed a resolution making HBase a TLP. I filed an infrastructure issue to start the move: https://issues.apache.org/jira/browse/INFRA-2641 The primary disruption to developers will be when the subversion repository is renamed. We'll send out a note before we do this, then

Re: HBase move to Apache Top Level Project

2010-04-22 Thread Stack
On Thu, Apr 22, 2010 at 11:25 AM, tsuna wrote: > On Thu, Apr 22, 2010 at 10:32 AM, Stack wrote: >> The primary disruption to developers will be when the subversion >> repository is renamed.  We'll send out a note before we do this, then > > Technically, I don't th

Release killed... RC3 coming soon WAS -> Re: [VOTE] Shall we release hbase-0.20.4 Release Candidate 2 as hbase-0.20.4? (WAS --> Re: [VOTE] Shall we release hbase-0.20.4 Release Candidate 1 as hbase-

2010-04-22 Thread Stack
HBASE-2481 "Client is not getting UnknownScannerExceptions; they are being eaten" sinks this release candidate. Will fix and put up a new candidate this evening. St.Ack On Tue, Apr 20, 2010 at 11:54 PM, Stack wrote: > I've posted an hbase 0.20.4 release candidate

  1   2   3   4   5   6   7   8   9   10   >