[jira] Created: (HBASE-2580) Make the hlog file names unique

2010-05-19 Thread Jean-Daniel Cryans (JIRA)
Make the hlog file names unique --- Key: HBASE-2580 URL: https://issues.apache.org/jira/browse/HBASE-2580 Project: Hadoop HBase Issue Type: Improvement Reporter: Jean-Daniel Cryans

Re: Review Request: HBASE-2223

2010-05-26 Thread Jean-Daniel Cryans
--- This is an automatically generated e-mail. To reply, visit: http://review.hbase.org/r/76/ --- (Updated 2010-05-26 18:09:30.362592) Review request for hbase. Changes ---

Re: Review Request: HBASE-2223

2010-05-28 Thread Jean-Daniel Cryans
--- On 2010-05-26 18:09:30, Jean-Daniel Cryans wrote: --- This is an automatically generated e-mail. To reply, visit: http://review.hbase.org/r/76/ --- (Updated 2010-05-26 18:09

Review Request: LeaseStillHeldException totally ignored by RS, wrongly named

2010-06-08 Thread Jean-Daniel Cryans
--- This is an automatically generated e-mail. To reply, visit: http://review.hbase.org/r/164/ --- Review request for hbase. Summary --- Patch that first adds a new testing

Re: [VOTE] Shall we release hbase-0.20.5 Release Candidate 2 as hbase-0.20.5?

2010-06-09 Thread Jean-Daniel Cryans
I agree with Ryan, and what we actually need would be a Known Issues document shipped with all releases. For 0.20, lack of sync should be the top item. J-D On Wed, Jun 9, 2010 at 1:07 PM, Ryan Rawson ryano...@gmail.com wrote: Every release we ship has bugs, some known, most unknown.  I have

Re: Review Request: LeaseStillHeldException totally ignored by RS, wrongly named

2010-06-09 Thread Jean-Daniel Cryans
--- On 2010-06-08 16:04:06, Jean-Daniel Cryans wrote: --- This is an automatically generated e-mail. To reply, visit: http://review.hbase.org/r/164

Re: Review Request: HBASE-2223

2010-06-10 Thread Jean-Daniel Cryans
--- This is an automatically generated e-mail. To reply, visit: http://review.hbase.org/r/76/#review174 --- On 2010-06-08 17:54:19, Jean-Daniel Cryans wrote

Re: [VOTE] Shall we release hbase-0.20.5 Release Candidate 2 as hbase-0.20.5?

2010-06-11 Thread Jean-Daniel Cryans
I'm -1, we need HBASE-2712. The fix is super easy, I will do that today. J-D On Mon, Jun 7, 2010 at 1:09 PM, Stack st...@duboce.net wrote: I've posted an hbase 0.20.5 release candidate 2 here:  http://people.apache.org/~stack/hbase-0.20.5-candidate-2/ Should we release this candidate as

Review Request: Cached region location that went stale won't recover if asking for first row

2010-06-11 Thread Jean-Daniel Cryans
--- This is an automatically generated e-mail. To reply, visit: http://review.hbase.org/r/170/ --- Review request for hbase. Summary --- Patch against branch that does some

[Vote] Shall we release hbase-0.20.5 Release Candidate 3 as hbase-0.20.5?

2010-06-11 Thread Jean-Daniel Cryans
I've posted an hbase 0.20.5 release candidate 3 here: http://people.apache.org/~jdcryans/hbase-0.20.5-candidate-3/ Should we release this candidate as hbase 0.20.5? It has 20 fixes: http://su.pr/1prW9y Please take it for a test spin if you have a chance. Vote closes Wednesday, the 15th of

Re: Review Request: HBASE-2223

2010-06-14 Thread Jean-Daniel Cryans
--- This is an automatically generated e-mail. To reply, visit: http://review.hbase.org/r/76/#review191 --- On 2010-06-08 17:54:19, Jean-Daniel Cryans wrote: --- This is an automatically

Re: Review Request: Shutdown hook management is gone in trunk; restore

2010-06-16 Thread Jean-Daniel Cryans
--- This is an automatically generated e-mail. To reply, visit: http://review.hbase.org/r/187/#review244 --- Ship it! Looks good to me, nice cleanup compared to branch! -

Re: [VOTE] Shall we release hbase-0.20.5 Release Candidate 5 as hbase-0.20.5?

2010-06-23 Thread Jean-Daniel Cryans
Ran some imports and all unit tests, +1 J-D On Sat, Jun 19, 2010 at 12:41 PM, Stack st...@duboce.net wrote: I've posted an hbase 0.20.5 release candidate 5 here:  http://people.apache.org/~stack/hbase-0.20.5-candidate-5/ There have been 24 issues addressed since the release of hbase-0.20.4

Re: Review Request: HBASE-2223

2010-06-28 Thread Jean-Daniel Cryans
On 2010-06-25 15:07:35, stack wrote: src/main/java/org/apache/hadoop/hbase/replication/regionserver/ReplicationSink.java, line 149 http://review.hbase.org/r/76/diff/7/?file=1590#file1590line149 Duplicated code -- see up about ten lines. Jean-Daniel Cryans wrote: Not it's

Re: Review Request: HBASE-2223

2010-06-30 Thread Jean-Daniel Cryans
--- This is an automatically generated e-mail. To reply, visit: http://review.hbase.org/r/76/ --- (Updated 2010-06-30 15:36:59.081075) Review request for hbase. Changes ---

Re: Multi atomicIncreaments

2010-07-06 Thread Jean-Daniel Cryans
Please open a jira https://issues.apache.org/jira/browse/HBASE so that we can track the patch and review. Thanks! J-D On Tue, Jul 6, 2010 at 10:14 AM, Sebastian Bauer ad...@ugame.net.pl wrote: Hello, i have create small patch for thrift interface to increament many columns in many rows in

Re: Build failed in Hudson: HBase-TRUNK #1373

2010-07-06 Thread Jean-Daniel Cryans
TestReplication failed because it tripped on https://issues.apache.org/jira/browse/HBASE-2781 J-D On Tue, Jul 6, 2010 at 6:50 AM, Apache Hudson Server hud...@hudson.zones.apache.org wrote: See http://hudson.zones.apache.org/hudson/job/HBase-TRUNK/1373/changes Changes: [jgray] HBASE-2806

Re: Build failed in Hudson: HBase-TRUNK #1374

2010-07-07 Thread Jean-Daniel Cryans
merge stuff has been broken for a while. TestReplication can get stuck on HBASE-2781 (which fixes something from the master rewrite). J-D On Wed, Jul 7, 2010 at 9:55 PM, Ryan Rawson ryano...@gmail.com wrote: multiple failures in weird places, none of which happened when i ran mvn test before

Re: Review Request: HBASE-2803 remove remaining get code from Store.java etc

2010-07-08 Thread Jean-Daniel Cryans
--- This is an automatically generated e-mail. To reply, visit: http://review.hbase.org/r/278/#review318 --- Ship it! Few nits, commit if it passes all tests.

Re: OK if we roll a 0.20.6 candidate and next iteration on 0.89.x by friday?

2010-07-13 Thread Jean-Daniel Cryans
+1 on both, let's stabilize this. J-D On Tue, Jul 13, 2010 at 8:57 PM, Stack st...@duboce.net wrote: Any objections? Anything that needs to be added to either before we cut release candidates? 0.20 branch has a few NPE fixes and an RPC leak healed. TRUNK, from where we'll cut the next

Re: Build failed in Hudson: HBase-TRUNK #1395

2010-07-21 Thread Jean-Daniel Cryans
Just so it's clear, TestHRegion was also failing for http://hudson.zones.apache.org/hudson/job/HBase-TRUNK/1392/ J-D On Wed, Jul 21, 2010 at 7:44 PM, Apache Hudson Server hud...@hudson.zones.apache.org wrote: See http://hudson.zones.apache.org/hudson/job/HBase-TRUNK/1395/changes Changes:

Re: Review Request: HBASE-2866 Region permanently offlined

2010-07-23 Thread Jean-Daniel Cryans
--- This is an automatically generated e-mail. To reply, visit: http://review.hbase.org/r/380/#review471 --- Some nits, I'm also trying it out (with the update=true fix)

Re: Branching next 0.89 release tomorrow unless objection

2010-07-24 Thread Jean-Daniel Cryans
We still need to release something somewhat stabilized, that's unaffected by new features coming while we do that. Personally I'd like to see HBASE-2838 in that release, gives some insight into what's happening when replication is enabled. I posted a basic patch on RB yesterday, that's probably

Re: [VOTE] Shall we release hbase-0.20.6 Release Candidate 1 as hbase-0.20.6?

2010-07-27 Thread Jean-Daniel Cryans
+1, I downloaded the release, checked the documentation, ran a few YCSB, everything's fine. J-D On Mon, Jul 19, 2010 at 9:15 PM, Stack st...@duboce.net wrote: I've posted an hbase 0.20.6 release candidate 5 here:  http://people.apache.org/~stack/hbase-0.20.6-candidate-1/ There have been 8

Re: count of rows in table

2010-07-29 Thread Jean-Daniel Cryans
In 0.89 you can specify CACHE for the count command. Set it higher (it defaults to 10 rows per call). Also you can use the RowCounter MR job. J-D On Thu, Jul 29, 2010 at 2:22 PM, Ted Yu yuzhih...@gmail.com wrote: Hi, The count method in HBase shell is quite slow. Is there a way to obtain

Re: count of rows in table

2010-07-29 Thread Jean-Daniel Cryans
: select count(*) from table and not to launch M/R job for this purpose. Best regards, Vladimir Rodionov Principal Platform Engineer Carrier IQ, www.carrieriq.com From: jdcry...@gmail.com [jdcry...@gmail.com] On Behalf Of Jean-Daniel Cryans [jdcry

Re: [VOTE] Release 'development release' HBase 0.89.2010726 rc1?

2010-07-29 Thread Jean-Daniel Cryans
Although, I've been doing lots of tests on 0.89.2010726 patched with Kannan's fix and it works pretty well. Also replication was enabled, and was tested too. J-D On Thu, Jul 29, 2010 at 9:59 AM, Jean-Daniel Cryans jdcry...@apache.org wrote: -1 Because of HBASE-2755, I cannot even boot

Re: [VOTE] Release 'development release' HBase 0.89.2010726 rc2?

2010-08-02 Thread Jean-Daniel Cryans
Unless anyone thinks that what I listed is bad enough to sink, the testing I did today leads me to +1. J-D On Mon, Aug 2, 2010 at 1:14 PM, Jean-Daniel Cryans jdcry...@apache.org wrote: Some notes, no vote yet: - The images in the documentation aren't showing up, looks like the link is wrong

Re: Review Request: HBASE-2697 The master rewrite

2010-08-03 Thread Jean-Daniel Cryans
--- This is an automatically generated e-mail. To reply, visit: http://review.cloudera.org/r/484/#review636 --- First pass, still trying to understand what's going on

Re: HBASE-2502

2010-08-03 Thread Jean-Daniel Cryans
We have only 1 nic that we use per machine, problem solved on all 5 clusters :) J-D On Tue, Aug 3, 2010 at 2:45 PM, Ted Yu yuzhih...@gmail.com wrote: Hi, It has been very quiet on: https://issues.apache.org/jira/browse/HBASE-2502 I want to get your opinion on how this is handled in your

Re: about HBASE-2362

2010-08-03 Thread Jean-Daniel Cryans
Hi Joshua! Go for it! J-D On Tue, Aug 3, 2010 at 8:31 PM, Joshua Chia-Hsuan Ho joshuachiahsuan...@gmail.com wrote: Hello, My name is Joshua Ho, currently working as a software engineer at Trend Micro Inc. I would like to see if I can take this task after got assigned. Thanks a lot.

Re: irresponsive region server

2010-08-11 Thread Jean-Daniel Cryans
nope On Wed, Aug 11, 2010 at 10:29 AM, Ted Yu yuzhih...@gmail.com wrote: Here is jstack again See if it goes through this time. On Wed, Aug 11, 2010 at 10:25 AM, Jean-Daniel Cryans jdcry...@apache.org wrote: jstack wasn't attached, and something happened before the beginning of that log

Re: Build failed in Hudson: HBase-TRUNK #1430

2010-08-18 Thread Jean-Daniel Cryans
Since TestScanner was already timeout'ing when HBASE-2897 was committed, the new test never ran on Hudson until now. TestRowResource also fails on my machine. J-D On Wed, Aug 18, 2010 at 6:27 AM, Apache Hudson Server hud...@hudson.apache.org wrote: See

Review Request: HLog cleanup is done under the updateLock, major slowdown

2010-08-19 Thread Jean-Daniel Cryans
--- This is an automatically generated e-mail. To reply, visit: http://review.cloudera.org/r/694/ --- Review request for hbase. Summary --- Simply moves the LogActionListeners

Re: Review Request: HBASE-2915 Deadlock between HRegion.ICV and HRegion.close

2010-08-20 Thread Jean-Daniel Cryans
incrementColumnValue, thus missing the point of the title of the jira :S Uploading a new patch soon that addresses that, along with comments from the reviews. - Jean-Daniel On 2010-08-19 14:59:41, Jean-Daniel Cryans wrote

Re: Review Request: HLog cleanup is done under the updateLock, major slowdown

2010-08-20 Thread Jean-Daniel Cryans
--- This is an automatically generated e-mail. To reply, visit: http://review.cloudera.org/r/694/ --- (Updated 2010-08-20 15:51:17.366257) Review request for hbase. Changes ---

Re: Review Request: HLog cleanup is done under the updateLock, major slowdown

2010-08-20 Thread Jean-Daniel Cryans
--- This is an automatically generated e-mail. To reply, visit: http://review.cloudera.org/r/694/ --- (Updated 2010-08-20 15:58:27.771023) Review request for hbase. Summary

Re: Review Request: HBASE-2915 Deadlock between HRegion.ICV and HRegion.close

2010-08-20 Thread Jean-Daniel Cryans
--- This is an automatically generated e-mail. To reply, visit: http://review.cloudera.org/r/691/#review975 --- On 2010-08-19 14:59:41, Jean-Daniel Cryans wrote

Re: Review Request: HBASE-2915 Deadlock between HRegion.ICV and HRegion.close

2010-08-20 Thread Jean-Daniel Cryans
--- On 2010-08-19 14:59:41, Jean-Daniel Cryans wrote: --- This is an automatically generated e-mail. To reply, visit: http://review.cloudera.org/r/691

Re: 0.90 release date estimate

2010-08-23 Thread Jean-Daniel Cryans
11th sounds good to me. J-D On Mon, Aug 23, 2010 at 12:47 AM, Steven Noels stev...@outerthought.org wrote: On Mon, Aug 23, 2010 at 6:52 AM, Jonathan Gray jg...@facebook.com wrote: That sounds about right.  Hopefully early October, right around Hadoop World.  Good place for announcements.  

Review Request: RegionServer should refuse to be assigned a region that use LZO when LZO isn't available

2010-08-25 Thread Jean-Daniel Cryans
--- This is an automatically generated e-mail. To reply, visit: http://review.cloudera.org/r/719/ --- Review request for hbase. Summary --- Trying to make some progress on this

Re: Review Request: RegionServer should refuse to be assigned a region that use LZO when LZO isn't available

2010-08-25 Thread Jean-Daniel Cryans
:57 AM, Jean-Daniel Cryans jdcry...@apache.orgwrote: --- This is an automatically generated e-mail. To reply, visit: http://review.cloudera.org/r/719/ --- Review request for hbase

Re: Data loss due to region server failure

2010-08-26 Thread Jean-Daniel Cryans
, 2010 at 7:22 AM, Gagandeep Singh gagandeep.si...@paxcel.net wrote: HBase - 0.20.5 Hadoop - 0.20.2 Thanks, Gagan On Thu, Aug 26, 2010 at 7:11 PM, Jean-Daniel Cryans jdcry...@apache.orgwrote: Hadoop and HBase version? J-D On Aug 26, 2010 5:36 AM, Gagandeep Singh gagandeep.si

Re: Data loss due to region server failure

2010-08-26 Thread Jean-Daniel Cryans
That, or use CDH3b2. J-D On Thu, Aug 26, 2010 at 11:22 AM, Gagandeep Singh gagandeep.si...@paxcel.net wrote: Thanks Daniel It means I have to checkout the code from branch and build it on my local machine. Gagan On Thu, Aug 26, 2010 at 9:51 PM, Jean-Daniel Cryans jdcry

Re: intermittent diff (?)- testIncrementColumnValue_BumpSnapshot

2010-08-27 Thread Jean-Daniel Cryans
Anything obvious in the logs? Also how old is your branch? J-D On Fri, Aug 27, 2010 at 5:32 AM, Kannan Muthukkaruppan kan...@facebook.com wrote: Hi, Noticed this in our test run once. Didn't repro on a rerun though. But wanted to share with the list in case anyone was familiar with the

[VOTE] Release 'development release' HBase 0.89.2010830 rc1?

2010-08-30 Thread Jean-Daniel Cryans
It's time for another DR since the new master code is about to be merged in and we have a few fixes and improvements that'd beneficiate from more exposure. I branched from trunk this morning and created a new tag. (See http://wiki.apache.org/hadoop/Hbase/HBaseVersions for more on what these 0.89.x

Re: [VOTE] Release 'development release' HBase 0.89.2010830 rc1?

2010-08-30 Thread Jean-Daniel Cryans
BTW I'm +1, I ran the unit tests, did cluster testing with YCSB, and deployed it in almost all our environments here (this will be completed before the voting period ends). J-D On Mon, Aug 30, 2010 at 4:39 PM, Jean-Daniel Cryans jdcry...@apache.org wrote: It's time for another DR since the new

Re: Hfile - Storefile

2010-09-01 Thread Jean-Daniel Cryans
StoreFile is just a wrapper for HFile to add HBase-sugar on top of it. J-D On Wed, Sep 1, 2010 at 8:16 AM, Himanshu Vashishtha vashishth...@gmail.com wrote: It will be great if anyone point out the difference in their functionality. What I understand is Storefile is made persistent in fs,

[VOTE] Release 'development release' HBase 0.89.2010830 rc2?

2010-09-13 Thread Jean-Daniel Cryans
Second RC, new vote! Source binary and source tar balls are available here: http://people.apache.org/~jdcryans/hbase-0.89.20100830-candidate-2/ You can also browse the candidate documentation here: http://people.apache.org/~jdcryans/hbase-0.89.20100830-candidate-2/hbase-0.89.20100830/docs/

Re: [VOTE] Release 'development release' HBase 0.89.2010830 rc2?

2010-09-15 Thread Jean-Daniel Cryans
have insight for https://issues.apache.org/jira/browse/HBASE-2694 On Wed, Sep 15, 2010 at 4:35 PM, Jean-Daniel Cryans jdcry...@apache.orgwrote: After some discussions today here at SU between Todd and the team, it was suggested that this 0.89 release contains more of what we run in production

[VOTE] Release 'development release' HBase 0.89.2010924 rc1?

2010-09-24 Thread Jean-Daniel Cryans
The 0.89.20100830 DR branch was cancelled, here's the new RC off a new branch. As discussed, this release candidate contains a revert of HBASE-2694 which means that it is back on the very old master. It is also very similar to what we run here in production. Sources and binaries can be found

Re: [VOTE] Release 'development release' HBase 0.89.2010924 rc1?

2010-10-04 Thread Jean-Daniel Cryans
this is a blocker for a DR, as it only affects users doing only tons of ICVs on particular tables, but it should be disclosed somewhere. J-D On Fri, Sep 24, 2010 at 4:03 PM, Jean-Daniel Cryans jdcry...@apache.org wrote: The 0.89.20100830 DR branch was cancelled, here's the new RC off a new branch

Re: [VOTE] Release 'development release' HBase 0.89.2010924 rc1?

2010-10-04 Thread Jean-Daniel Cryans
the basic stuff.  No performance stuff but I think enough for my vote. JG -Original Message- From: jdcry...@gmail.com [mailto:jdcry...@gmail.com] On Behalf Of Jean- Daniel Cryans Sent: Monday, October 04, 2010 10:56 AM To: dev@hbase.apache.org Subject: Re: [VOTE] Release 'development

Re: dynamic RPC and coprocessor changes

2010-10-05 Thread Jean-Daniel Cryans
+1, looking forward to these changes. J-D On Tue, Oct 5, 2010 at 7:13 PM, Andrew Purtell apurt...@apache.org wrote: We've been nursing dynamic RPC and coprocessor changes for a couple of weeks now and don't see any failures beyond what are already on trunk with them applied. I was going

Re: Cannot add rows in an HBase Table

2010-10-06 Thread Jean-Daniel Cryans
Please don't cross-post on mailing lists, this is a question meant for user@ not d...@. J-D 2010/10/6 Petrucci Andreas petrucci_2...@hotmail.com: Hello there, i have compiled the HBase source code and i;m running locally the HMaster. However when i try to create a table and insert rows with

Re: HBaseAdmin.flush()

2010-10-14 Thread Jean-Daniel Cryans
If your Puts are using the WAL, and you are on 0.89, it's already as durable as it can be without forcing flushes. J-D On Thu, Oct 14, 2010 at 8:07 PM, Ted Yu yuzhih...@gmail.com wrote: Hi, HBaseAdmin.flush() is asynchronous. In order to achieve high durability, do I have a better choice ?

Re: HBaseAdmin.flush()

2010-10-14 Thread Jean-Daniel Cryans
: We're still using 0.20.6 :-) On Thu, Oct 14, 2010 at 5:19 PM, Jean-Daniel Cryans jdcry...@apache.orgwrote: If your Puts are using the WAL, and you are on 0.89, it's already as durable as it can be without forcing flushes. J-D On Thu, Oct 14, 2010 at 8:07 PM, Ted Yu yuzhih...@gmail.com wrote

Review Request: TOF doesn't take zk client port for remote clusters

2010-10-22 Thread Jean-Daniel Cryans
--- This is an automatically generated e-mail. To reply, visit: http://review.cloudera.org/r/1077/ --- Review request for hbase. Summary --- Does exactly what this jira is

Re: Review Request: Review compaction heuristic and move compaction code out so standalone and independently testable

2010-10-25 Thread Jean-Daniel Cryans
--- This is an automatically generated e-mail. To reply, visit: http://review.cloudera.org/r/1078/#review1655 ---

Re: Review Request: Tool to verify data in two clusters

2010-10-28 Thread Jean-Daniel Cryans
/#review1693 --- On 2010-10-28 16:42:25, Jean-Daniel Cryans wrote: --- This is an automatically generated e-mail. To reply, visit: http://review.cloudera.org/r/

Review Request: Tool to verify data in two clusters

2010-10-28 Thread Jean-Daniel Cryans
--- This is an automatically generated e-mail. To reply, visit: http://review.cloudera.org/r// --- Review request for hbase. Summary --- This new mapreduce job called

Review Request: Splitting logs, we'll make an output file though the region no longer exists

2010-11-02 Thread Jean-Daniel Cryans
--- This is an automatically generated e-mail. To reply, visit: http://review.cloudera.org/r/1149/ --- Review request for hbase. Summary --- Adds a small check if the directory

HBASE-2471's means you need to create region's folders for log splitting

2010-11-03 Thread Jean-Daniel Cryans
Hey guys, Now that I committed HBASE-2471, new unit tests that play with log splitting will need to create the region dirs _before_ using HLogSplitter or it will refuse to do it. I've done the changes in TestHLog, TestHLogSplit and TestWALReplay already. Thx, J-D

Review Request: HLog.findMemstoresWithEditsOlderThan needs to look for edits that are equal to too

2010-11-08 Thread Jean-Daniel Cryans
--- This is an automatically generated e-mail. To reply, visit: http://review.cloudera.org/r/1188/ --- Review request for hbase. Summary --- This patch simply adds the = in

Re: Review Request: hbase-3112 Enable and disable of table needs a bit of loving in new master

2010-11-09 Thread Jean-Daniel Cryans
--- This is an automatically generated e-mail. To reply, visit: http://review.cloudera.org/r/1187/#review1866 --- trunk/src/main/java/org/apache/hadoop/hbase/client/HBaseAdmin.java

Re: Build failed in Hudson: HBase-TRUNK #1650

2010-11-12 Thread Jean-Daniel Cryans
) changed the minidfscluster. Best regards,    - Andy - Original Message From: Jean-Daniel Cryans jdcry...@apache.org To: dev@hbase.apache.org Sent: Fri, November 12, 2010 4:20:40 PM Subject: Re: Build failed in Hudson: HBase-TRUNK #1650 I found the change that makes everything

Re: ANN: hbase 0.90.0 Release Candidate 0 available for download

2010-11-15 Thread Jean-Daniel Cryans
I think it's worth going at greater lengths to document that kind of breakage, maybe a page in the book? Stuff like What's new and Incompatibilities that we can easily link to. J-D On Mon, Nov 15, 2010 at 12:38 PM, Ryan Rawson ryano...@gmail.com wrote: That is correct, those classes were

Re: ANN: hbase 0.90.0 Release Candidate 0 available for download

2010-11-17 Thread Jean-Daniel Cryans
Currently both trunk and 0.90's pom.xml are incomplete, we were relying on Ryan's repo have the thrift pom but now that it was changed to Stack's new comers cannot compile the project since that pom is missing. Reported by kzk9 on IRC. So either we had Ryan's repo back in the pom, or Stack copies

Re: table not shown on master UI but creating same table fails

2010-11-19 Thread Jean-Daniel Cryans
Seems like a classic .META. issue from 0.20, I would suggest that you look at the master's state (regions in transition, etc), and that you scan .META. for that table. Also, looking at the code that lists the table, I see one case where a row would be in .META. but not listed: byte[]

Re: table not shown on master UI but creating same table fails

2010-11-19 Thread Jean-Daniel Cryans
Do you have them or not? If so, a normal deleteall from the shell does the work. J-D On Fri, Nov 19, 2010 at 10:08 AM, Ted Yu yuzhih...@gmail.com wrote: How do I delete the other regions for this table in .META. ? Thanks On Fri, Nov 19, 2010 at 10:01 AM, Jean-Daniel Cryans jdcry

Re: [jira] Updated: (HBASE-2002) Coprocessors: Client side support

2010-11-19 Thread Jean-Daniel Cryans
Woot! On Fri, Nov 19, 2010 at 1:19 PM, Andrew Purtell (JIRA) j...@apache.org wrote:     [ https://issues.apache.org/jira/browse/HBASE-2002?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Purtell updated HBASE-2002: --      

Re: problem starting HBase

2010-11-23 Thread Jean-Daniel Cryans
Is that really from the master log? Can we get the full log in a pastebin? J-D On Tue, Nov 23, 2010 at 7:40 AM, Ted Yu yuzhih...@gmail.com wrote: I backed up zookeeper dataDir to another location. After clearing zookeeper dataDir, HMaster still couldn't start: 2010-11-23 15:30:56,095 DEBUG

Re: problem starting HBase

2010-11-23 Thread Jean-Daniel Cryans
Can you dig up to where it started doing that? On Tue, Nov 23, 2010 at 10:27 AM, Ted Yu yuzhih...@gmail.com wrote: http://pastebin.com/E86iPnK4 On Tue, Nov 23, 2010 at 10:23 AM, Jean-Daniel Cryans jdcry...@apache.orgwrote: Is that really from the master log? Can we get the full log

Re: problem starting HBase

2010-11-23 Thread Jean-Daniel Cryans
So before that first line... everything was fine? What happened there? On Tue, Nov 23, 2010 at 10:48 AM, Ted Yu yuzhih...@gmail.com wrote: Here is relevant portion of master log: http://pastebin.com/HiembAxc On Tue, Nov 23, 2010 at 10:37 AM, Jean-Daniel Cryans jdcry...@apache.orgwrote

Re: HBase Coprocessor Hackathon on December 13th @ Facebook

2010-11-29 Thread Jean-Daniel Cryans
+1 J-D On Mon, Nov 29, 2010 at 11:30 AM, Jonathan Gray jg...@fb.com wrote: HBase Devs, We're in the final stages of planning an all-day HBase Hackathon on 12/13 at Facebook.  The focus will be on Coprocessors although we'll probably also spend some time talking about what's next for HBase

Review Request: Master passes IP and not hostname back to region server

2010-11-30 Thread Jean-Daniel Cryans
--- This is an automatically generated e-mail. To reply, visit: http://review.cloudera.org/r/1262/ --- Review request for hbase. Summary --- Changes: - In HMaster, instead of

Re: Please welcome two new hbase committers, Gary Helmling and Nicolas Spiegelberg

2010-12-02 Thread Jean-Daniel Cryans
Party On Thu, Dec 2, 2010 at 11:00 AM, Stack st...@duboce.net wrote: The two lads have been doing great work and earned their wings long ago.  Welcome them to the fold. St.Ack

Re: [jira] Created: (HBASE-3303) Lower hbase.regionserver.handler.count from 25 back to 10

2010-12-02 Thread Jean-Daniel Cryans
. Best regards,    - Andy --- On Thu, 12/2/10, Jean-Daniel Cryans (JIRA) j...@apache.org wrote: From: Jean-Daniel Cryans (JIRA) j...@apache.org Subject: [jira] Created: (HBASE-3303) Lower hbase.regionserver.handler.count from 25 back to 10 To: iss...@hbase.apache.org Date: Thursday

Re: Build failed in Hudson: HBase-TRUNK #1685

2010-12-06 Thread Jean-Daniel Cryans
Ooops, looking into it. J-D On Mon, Dec 6, 2010 at 3:26 PM, Apache Hudson Server hud...@hudson.apache.org wrote: See https://hudson.apache.org/hudson/job/HBase-TRUNK/1685/changes Changes: [jdcryans] HBASE-2467  Concurrent flushers in HLog sync using HDFS-895 [stack] If balancer doesn't

Review Request: SplitTransaction.splitStoreFiles slows splits a lot

2010-12-07 Thread Jean-Daniel Cryans
--- This is an automatically generated e-mail. To reply, visit: http://review.cloudera.org/r/1273/ --- Review request for hbase. Summary --- Patch that parallelizes the

Re: Review Request: SplitTransaction.splitStoreFiles slows splits a lot

2010-12-07 Thread Jean-Daniel Cryans
generated e-mail. To reply, visit: http://review.cloudera.org/r/1273/#review2043 --- On 2010-12-07 16:38:42, Jean-Daniel Cryans wrote: --- This is an automatically generated e-mail

Re: ANN: The second hbase 0.90.0 release candidate is available for download

2010-12-09 Thread Jean-Daniel Cryans
-1 A bunch of issues were found, on my part there would be HBASE-3318, 3321 and 3326. There's also Todd's OOME on the master that needs some care. J-D On Tue, Dec 7, 2010 at 9:25 AM, Stack st...@duboce.net wrote: The second hbase 0.90.0 release candidate is available for download:  

Re: region sizes for one table

2010-12-09 Thread Jean-Daniel Cryans
I guess I would do a dus on /hbase/tablename/* Not pretty but it works. J-D On Thu, Dec 9, 2010 at 3:23 PM, Ted Yu yuzhih...@gmail.com wrote: Hi, What's the quickest way to determine the size for each region in a give table ? Thanks

Re: Build failed in Hudson: hbase-0.90 #21

2010-12-10 Thread Jean-Daniel Cryans
On it. The TestHRegion passes a null server for tests and I forgot to add the check (which btw is ugly). J-D On Fri, Dec 10, 2010 at 12:29 AM, Apache Hudson Server hud...@hudson.apache.org wrote: See https://hudson.apache.org/hudson/job/hbase-0.90/21/changes Changes: [jdcryans] HBASE-3308  

Re: recent replication changes failing tests?

2010-12-16 Thread Jean-Daniel Cryans
Two reasons I saw that test failing: https://issues.apache.org/jira/browse/HBASE-3366 https://issues.apache.org/jira/browse/HBASE-3367 I discovered the second while testing the fix for the first one. J-D On Thu, Dec 16, 2010 at 11:19 AM, Andrew Purtell apurt...@apache.org wrote: The previous

Re: Build failed in Hudson: hbase-0.90 #37

2010-12-20 Thread Jean-Daniel Cryans
This test that hangs looks like HBASE-3343. I can only make TestMetaReaderEditor fail when running it on my laptop if I'm using the yes /dev/null trick. In all three logs I see this stack: 2010-12-20 16:41:53,328 WARN [PostOpenDeployTasks:3d9e86152e5e75258c19d64d4ddb1a4a]

Re: How about to give more flexibility to RowKey (customized comparator and serializer)

2011-01-03 Thread Jean-Daniel Cryans
This was ruled out when this jira was closed https://issues.apache.org/jira/browse/HBASE-661 See the comments on why, feel free to post there if you think we should include such a feature and more importantly how it can be implemented in a way that's not adding a lot of extra complexity. Thx,

Re: consistent KeeperException$ConnectionLossException

2011-01-04 Thread Jean-Daniel Cryans
It's a zookeeper setting, you cannot have by default more than 30 connections from the same IP per ZK peer. If HBase is starting ZK for you, do change hbase.zookeeper.property.maxClientCnxns J-D On Tue, Jan 4, 2011 at 11:09 AM, Ted Yu yuzhih...@gmail.com wrote: Hi, I am using HBase 0.90 and

Re: Build failed in Hudson: hbase-0.90 #48

2011-01-04 Thread Jean-Daniel Cryans
What happened is that the splitting failed after a region server was killed but was never retried, thus the logs weren't archived nor replicated. Looks like a bug in MasterFileSystem or something around that part of the code? Investigating. J-D On Mon, Jan 3, 2011 at 10:08 PM, Apache Hudson

Re: Build failed in Hudson: hbase-0.90 #48

2011-01-04 Thread Jean-Daniel Cryans
to see a FNFE instead, but it comes out as a lease problem. J-D On Tue, Jan 4, 2011 at 11:27 AM, Jean-Daniel Cryans jdcry...@apache.org wrote: What happened is that the splitting failed after a region server was killed but was never retried, thus the logs weren't archived nor replicated. Looks

Re: ANN: The fourth hbase 0.90.0 release candidate is available for download X

2011-01-18 Thread Jean-Daniel Cryans
+1, ran the tests, checked out the docs, gave it a ride. J-D On Fri, Jan 7, 2011 at 5:03 PM, Stack st...@duboce.net wrote: The fourth hbase 0.90.0 release candidate is available for download:  http://people.apache.org/~stack/hbase-0.90.0-candidate-3/ This is going to be the one! Should we

Re: HMaster won't die waiting for RegionServer that is already dead

2011-01-21 Thread Jean-Daniel Cryans
There's some sort of mismatch: RegionServer ephemeral node deleted, processing expiration [localhost.,60020,1295592845214] and Waiting on regionserver(s) to go down localhost,60020,1295592845214 Do you see the dot after localhost in the first line? I wonder how it got different in the znode

Re: parallelizing HBaseAdmin.flush()

2011-01-24 Thread Jean-Daniel Cryans
I'd guess so and the same could be done for splits and compactions since it's (almost) the same code. J-D On Sat, Jan 22, 2011 at 8:00 AM, Ted Yu yuzhih...@gmail.com wrote: In 0.90, HBaseAdmin.flush() uses a loop to go over ListPairHRegionInfo, HServerAddress Should executor service be used

Re: quick method for removing all rows in a table

2011-01-25 Thread Jean-Daniel Cryans
There's slower ways, but not quicker ways as far as I know. J-D On Tue, Jan 25, 2011 at 4:37 PM, Ted Yu yuzhih...@gmail.com wrote: HBase shell provides this command: truncate  Disables, drops and recreates the specified table Is there a quicker way of removing all rows ? Thanks

Re: HBASE-3234 and bad datanode error

2011-01-27 Thread Jean-Daniel Cryans
Ted, I don't see anything relating to hbase in that log so... how can we be of help? J-D On Thu, Jan 27, 2011 at 3:41 AM, Ted Yu yuzhih...@gmail.com wrote: This seems to be the last issue blocking hbase 0.90 upgrade. Please comment. On Mon, Jan 24, 2011 at 4:58 PM, Ted Yu

Re: HBASE-3234 and bad datanode error

2011-01-28 Thread Jean-Daniel Cryans
If you want to try to debug your issue, I suggest you take a look at those datanode logs. For example, using the data from your first email, here's what I would do: The first exception is WARN org.apache.hadoop.hdfs.DFSClient: DFSOutputStream ResponseProcessor exception for block

Re: submitting jobs from a webapp

2011-01-31 Thread Jean-Daniel Cryans
(moving this to the user mailing list where it belongs) You need to make sure that your webapp knows the address of the JobTracker, usually this is done by either putting mapred-site.xml on your app's classpath or you can set mapred.job.tracker correctly so that in createSubmittableJob you would

Re: IPC Server Responder out put error causing RegionServer down

2011-01-31 Thread Jean-Daniel Cryans
(moving to the user mailing list, where it belongs) My educated guess is that you had a GC pause that lasted for more than a minute while a file was being written to. Even if the write wasn't happening, your region server would have committed suicide anyways since it was probably past it's lease

Re: Can region be merged with others automatically when all data in the region has expired and removed ?

2011-02-08 Thread Jean-Daniel Cryans
There's an offline tool called Merge that you can use at your own risk, but nothing currently will do it automagically. J-D On Tue, Feb 8, 2011 at 6:14 PM, Zhou Shuaifeng zhoushuaif...@huawei.com wrote: If not, there may be many empty or very small regions, and it will cause meta data too

Re: Can region be merged with others automatically when all data in the region has expired and removed ?

2011-02-08 Thread Jean-Daniel Cryans
or email immediately and delete it! -邮件原件- 发件人: jdcry...@gmail.com [mailto:jdcry...@gmail.com] 代表 Jean-Daniel Cryans 发送时间: 2011年2月9日 10:16 收件人: dev@hbase.apache.org 主题: Re: Can region be merged with others automatically when all data in the region has expired and removed ? There's

  1   2   3   4   5   >