/book.html#architecture
J-D
2011/8/26 周健雯 10210240...@fudan.edu.cn:
Hi, Dr. All
My name is Jianwen Zhou, a Master student from Fudan University. I am
studying HBase-0.90.1 source code but could not quite understand it. I wonder
if I could have some design documents from you. If I am honored
Hi, Dr. All
My name is Jianwen Zhou, a Master student from Fudan University. I am studying
HBase-0.90.1 source code but could not quite understand it. I wonder if I could
have some design documents from you. If I am honored enough to have one, I
promise that it's just for personal academic
wrote:
Hi,
I found there may be some problem with majorcompactchecker in 0.90.1:
In the function store.isMajorCompaction:
if (filesToCompact.size() == 1) {
// Single file
StoreFile sf = filesToCompact.get(0);
long oldest =
(sf.getReader().timeRangeTracker
jar which contains the changed APIs
(limited to our use cases) in 0.90.1
This way our code builds with both jars and we
can easily switch.
On Thu, Feb 17, 2011 at 7:33 PM, Stack st...@duboce.net
wrote:
Do you want to post your patch to an issue Ted?
Others might
In order to minimize maintenance, we produced an hbase-0.20.6 jar which
contains the changed APIs (limited to our use cases) in 0.90.1
This way our code builds with both jars and we can easily switch.
FYI
On Wed, Feb 16, 2011 at 3:29 PM, Ryan Rawson ryano...@gmail.com wrote:
Step 1 is to add
:
The HBase team is pleased to announce the second [zero-indexed] release
candidate for HBase 0.90.1, available for download at the following URL:
http://people.apache.org/~todd/hbase-0.90.1.rc1/http://people.apache.org/~todd/hbase-0.90.1.rc0/
This release candidate addresses a couple of bugs since
Yu yuzhih...@gmail.com wrote:
In order to minimize maintenance, we produced an hbase-0.20.6 jar which
contains the changed APIs (limited to our use cases) in 0.90.1
This way our code builds with both jars and we can easily switch.
FYI
On Wed, Feb 16, 2011 at 3:29 PM, Ryan Rawson ryano
From: Ted Yu yuzhih...@gmail.com
In order to minimize maintenance, we produced an
hbase-0.20.6 jar which contains the changed APIs
(limited to our use cases) in 0.90.1
This way our code builds with both jars and we
can easily switch.
On Thu, Feb 17, 2011 at 7:33 PM, Stack st
this in Hadoop and it's very
useful.
-Todd
On Tue, Feb 15, 2011 at 5:14 PM, Ted Yu yuzhih...@gmail.com wrote:
Can someone tell me which classes from the list below changed API between
0.20.6 and 0.90.1 ?
http://pastebin.com/TkZfPt52
Thanks
--
Todd Lipcon
Software Engineer, Cloudera
I ran jdiff by hand. See:
https://tm-files.s3.amazonaws.com/hbase/jdiff-hbase-0.90.1/changes.html
Best regards,
- Andy
Problems worthy of attack prove their worth by hitting back.
- Piet Hein (via Tom White)
--- On Wed, 2/16/11, Lars George lars.geo...@gmail.com wrote:
From: Lars
Well done Andrew.
People who want to know the API differences should probably mostly only read:
https://tm-files.s3.amazonaws.com/hbase/jdiff-hbase-0.90.1/changes/pkg_org.apache.hadoop.hbase.client.html
And specifically the HTable, Put, Get, Delete, Scan classes.
On Wed, Feb 16, 2011 at 7:19
this system over to HBase?
-Todd
On Wed, Feb 16, 2011 at 11:51 AM, Ryan Rawson ryano...@gmail.com wrote:
Well done Andrew.
People who want to know the API differences should probably mostly only
read:
https://tm-files.s3.amazonaws.com/hbase/jdiff-hbase-0.90.1/changes
:
https://tm-files.s3.amazonaws.com/hbase/jdiff-hbase-0.90.1/changes/pkg_org.apache.hadoop.hbase.client.html
And specifically the HTable, Put, Get, Delete, Scan classes.
On Wed, Feb 16, 2011 at 7:19 AM, Andrew Purtell apurt...@apache.org
wrote:
I ran jdiff by hand. See
://tm-files.s3.amazonaws.com/hbase/jdiff-hbase-0.90.1/changes/pkg_org.apache.hadoop.hbase.client.html
And specifically the HTable, Put, Get, Delete, Scan classes.
On Wed, Feb 16, 2011 at 7:19 AM, Andrew Purtell
apurt...@apache.org
wrote:
I ran jdiff by hand. See
Downloaded, reviewed doc., and checked it runs locally.
Put it up on cluster, ran some YCSBs -- I deployed a snapshot of RC1
to apache maven snapshot repo with name 0.90.1-20110215.213202-4 if
anyone needs it -- and all seemed to run fine in basic write and
read/write scenarios. Review of logs turned
it
makes
roll
forward/back as simple as doing a symlink switchover or
back.
I
have
to recommend this to everyone who doesnt have a management
scheme.
On Thu, Feb 10, 2011 at 4:20 PM, Ted Yu
yuzhih...@gmail.com
wrote:
hbase/hbase-0.90.1.jar leads lib
a management
scheme.
On Thu, Feb 10, 2011 at 4:20 PM, Ted Yu
yuzhih...@gmail.com
wrote:
hbase/hbase-0.90.1.jar leads lib/hbase-0.90.0.jar in the
classpath.
I wonder
1. why hbase jar is placed in two directories - 0.20.6
didn't use
The lock up happened before I shut down region server.
I had to get out of that situation so that I can continue 0.90.1 validation.
On Mon, Feb 14, 2011 at 12:59 PM, Todd Lipcon t...@cloudera.com wrote:
Hi Ted,
What was the reason for the region server shutdown? ie was it aborting
itself
, 2011 at 1:08 PM, Ted Yu yuzhih...@gmail.com wrote:
The lock up happened before I shut down region server.
I had to get out of that situation so that I can continue 0.90.1
validation.
On Mon, Feb 14, 2011 at 12:59 PM, Todd Lipcon t...@cloudera.com wrote:
Hi Ted,
What
in to our
production environment. With 0.90.1 + a number of our patches,
Hadoopw/347 I loaded 30gb in using YCSB.
Still working on getting VerifyingWorkload to run and verify this
data. But no exceptions.
-ryan
On Fri, Feb 11, 2011 at 7:10 PM, Andrew Purtell apurt...@apache.org
wrote:
Seems
:
The lock up happened before I shut down region server.
I had to get out of that situation so that I can continue 0.90.1
validation.
On Mon, Feb 14, 2011 at 12:59 PM, Todd Lipcon t...@cloudera.com wrote:
Hi Ted,
What was the reason for the region server shutdown? ie was it aborting
to get out of that situation so that I can continue 0.90.1
validation.
On Mon, Feb 14, 2011 at 12:59 PM, Todd Lipcon t...@cloudera.com
wrote:
Hi Ted,
What was the reason for the region server shutdown? ie was it
aborting
itself, or you send it a kill signal, or what
should block 0.90.1, unless the same test passes on
0.90.0. ie so long as 0.90.1 is better than our previous release, we should
release it, and then get to work on 0.90.2 :)
-Todd
On Mon, Feb 14, 2011 at 5:23 PM, Todd Lipcon t...@cloudera.com wrote:
Looks like it's just in the process
at 2:41 PM, Ted Yu yuzhih...@gmail.com wrote:
I replaced hbase jar with hbase-0.90.1.jar
I also upgraded client side jar to hbase-0.90.1.jar
Our map tasks were running faster than before for about 50 minutes.
However, map tasks then timed out calling flushCommits(). This happened even
after
Here is partial config I used:
http://pastebin.com/1Dpbb2LA
I verified that there is no hbase-0.90.1.jar in lib dir.
Thanks
On Sun, Feb 13, 2011 at 8:59 AM, Ted Yu yuzhih...@gmail.com wrote:
BTW
The timeout (when calling flushCommits) happened midnight, so I didn't
capture jstack
that right?)
0.90.1 makes that 'bug' more acute; if a hbase-default.xml is found
that is other than one bundled in the jar it'll throw an exception
(Its there to help folks by preventing them running w/ a
hbase-default.xml that is older than that of the version running --
configs tend
worthy of attack prove their worth by hitting back.
- Piet Hein (via Tom White)
--- On Fri, 2/11/11, Ryan Rawson ryano...@gmail.com wrote:
From: Ryan Rawson ryano...@gmail.com
Subject: Re: [VOTE] HBase 0.90.1 rc0 is available for download
To: dev@hbase.apache.org, apurt...@apache.org
Date
their worth by hitting back.
- Piet Hein (via Tom White)
--- On Fri, 2/11/11, Ryan Rawson ryano...@gmail.com wrote:
From: Ryan Rawson ryano...@gmail.com
Subject: Re: [VOTE] HBase 0.90.1 rc0 is available for download
To: dev@hbase.apache.org, apurt...@apache.org
Date: Friday, February 11, 2011
?)
0.90.1 makes that 'bug' more acute; if a hbase-default.xml is found
that is other than one bundled in the jar it'll throw an exception
(Its there to help folks by preventing them running w/ a
hbase-default.xml that is older than that of the version running --
configs tend to change between versions
Which straggler Andrew, the hbase-0.90.1.jar in lib? That should be
harmless, no?
Looks like our mvn lib building could do with a bit of weeding. Let
me file an issue for that.
St.Ack
On Fri, Feb 11, 2011 at 1:15 AM, Andrew Purtell apurt...@apache.org wrote:
Never mind, I read forward
, the hbase-0.90.1.jar in lib? That should be
harmless, no?
Looks like our mvn lib building could do with a bit of weeding. Let
me file an issue for that.
St.Ack
On Fri, Feb 11, 2011 at 1:15 AM, Andrew Purtell apurt...@apache.org
wrote:
Never mind, I read forward further in the thread.
Yes
straggler Andrew, the hbase-0.90.1.jar in lib? That should be
harmless, no?
Looks like our mvn lib building could do with a bit of weeding. Let
me file an issue for that.
St.Ack
On Fri, Feb 11, 2011 at 1:15 AM, Andrew Purtell apurt...@apache.org
wrote:
Never mind, I read
0.90.1 rc0 is available for download
To: dev@hbase.apache.org, apurt...@apache.org
Date: Friday, February 11, 2011, 7:36 AM
Which straggler Andrew, the
hbase-0.90.1.jar in lib? That should be
harmless, no?
Looks like our mvn lib building could do with a bit of
weeding. Let
me file an issue
before that I failed to delete while moving jars
around. So this is a user problem, but I forsee it coming up again and again.
Best regards,
- Andy
--- On Fri, 2/11/11, Stack st...@duboce.net wrote:
From: Stack st...@duboce.net
Subject: Re: [VOTE] HBase 0.90.1 rc0 is available
...@duboce.net
Subject: Re: [VOTE] HBase 0.90.1 rc0 is available for download
To: apurt...@apache.org
Cc: dev@hbase.apache.org
Date: Friday, February 11, 2011, 9:35 AM
Yes. We need to fix the assembly. Its going to trip folks up. I
don't think it a sinker on the RC though, especially as we
patched in with
HDFS-347. In uncontended YCSB runs this did improve much 'get'
numbers, but in a 15 thread contended test the average get time goes
from 12.1 ms - 6.9ms. We plan to test this more and roll in to our
production environment. With 0.90.1 + a number of our patches,
Hadoopw/347 I
Rawson ryano...@gmail.com wrote:
From: Ryan Rawson ryano...@gmail.com
Subject: Re: [VOTE] HBase 0.90.1 rc0 is available for download
To: dev@hbase.apache.org, apurt...@apache.org
Date: Friday, February 11, 2011, 9:59 PM
I am generally +1, but we'll need
another RC to address HBASE-3524.
Here
Given 0.90.0 RC3 installation, apart from replacing hbase-0.90.0.jar with
hbase-0.90.1.jar, what else do I need to upgrade ?
Thanks
On Wed, Feb 9, 2011 at 4:27 PM, Todd Lipcon t...@cloudera.com wrote:
The HBase team is pleased to announce the first release candidate for HBase
0.90.1
FYI I use cdh3b2. I put hadoop jar from cdh3b2 into $HBASE_HOME/lib
On Thu, Feb 10, 2011 at 2:41 PM, Ted Yu yuzhih...@gmail.com wrote:
I replaced hbase jar with hbase-0.90.1.jar
I also upgraded client side jar to hbase-0.90.1.jar
Our map tasks were running faster than before for about 50
On Thu, Feb 10, 2011 at 2:24 PM, Ted Dunning tdunn...@maprtech.com wrote:
Thanks for the plug.
Did you use the VerifyingWordload?
No.
I'd use that instead of com.yahoo.ycsb.workloads.CoreWorkload in a
workload spec?
Thanks Ted,
St.Ack
:41 PM, Ted Yu yuzhih...@gmail.com wrote:
I replaced hbase jar with hbase-0.90.1.jar
I also upgraded client side jar to hbase-0.90.1.jar
Our map tasks were running faster than before for about 50 minutes.
However,
map tasks then timed out calling flushCommits(). This happened even after
hbase/hbase-0.90.1.jar leads lib/hbase-0.90.0.jar in the classpath.
I wonder
1. why hbase jar is placed in two directories - 0.20.6 didn't use such
structure
2. what from lib/hbase-0.90.0.jar could be picked up and why there wasn't
exception in server log
I think a JIRA should be filed for item 2
scheme.
On Thu, Feb 10, 2011 at 4:20 PM, Ted Yu yuzhih...@gmail.com wrote:
hbase/hbase-0.90.1.jar leads lib/hbase-0.90.0.jar in the classpath.
I wonder
1. why hbase jar is placed in two directories - 0.20.6 didn't use such
structure
2. what from lib/hbase-0.90.0.jar could be picked up and why
, 2011 at 4:20 PM, Ted Yu yuzhih...@gmail.com wrote:
hbase/hbase-0.90.1.jar leads lib/hbase-0.90.0.jar in the classpath.
I wonder
1. why hbase jar is placed in two directories - 0.20.6 didn't use such
structure
2. what from lib/hbase-0.90.0.jar could be picked up and why there
wasn't
/). With symlink switchover it makes roll
forward/back as simple as doing a symlink switchover or back. I have
to recommend this to everyone who doesnt have a management scheme.
On Thu, Feb 10, 2011 at 4:20 PM, Ted Yu yuzhih...@gmail.com wrote:
hbase/hbase-0.90.1.jar leads lib/hbase-0.90.0.jar
The HBase team is pleased to announce the first release candidate for HBase
0.90.1, available for download at the following URL:
http://people.apache.org/~todd/hbase-0.90.1.rc0/
The following is the md5sum:
27ad96a62966ed217fb6600fa92e2ab4 hbase-0.90.1.tar.gz
and it corresponds to the 0.90.1RC0
Hey all,
What do you think about doing an 0.90.1 this week? We have a couple bug
fixes that are critical - in particular HBASE-2481 which caused my cluster
to stop archiving hlogs. Also would like to get HBASE-3483 (memstore
blocking behavior) and HBASE-3455 (the new anti-fragmentation option
you think about doing an 0.90.1 this week? We have a couple bug
fixes that are critical - in particular HBASE-2481 which caused my cluster
to stop archiving hlogs. Also would like to get HBASE-3483 (memstore
blocking behavior) and HBASE-3455 (the new anti-fragmentation option) in
users' hands
Oh, you have to use the release plugin if you want to get stuff into
Apache repository -- else I'd sidestep it.
St.Ack
On Tue, Feb 1, 2011 at 11:56 AM, Stack st...@duboce.net wrote:
On Tue, Feb 1, 2011 at 11:43 AM, Ryan Rawson ryano...@gmail.com wrote:
A mvn release (to maven central) is
Gary pointed this out on irc:
http://jira.codehaus.org/browse/SUREFIRE-656
When we were talking about making the tests faster.
Test-ng has this support ready to roll _now_.
Basically we could have a 'smoke test' run for the release... Do the
larger integration tests outside the mvn release
50 matches
Mail list logo
