Re: Questions about HBase replication

2014-12-16 Thread Jean-Daniel Cryans
To add to what Jieshan said: On Fri, Nov 21, 2014 at 8:32 PM, Cliff cliffcheng...@gmail.com wrote: 1. Why does HBase replication need replicationSink? I think replicationSource can do replicationSink's work as well. And if we don't use replicationSink, we just need one time I/O. If you

Re: Replication terminology master-master

2014-11-25 Thread Jean-Daniel Cryans
On Mon, Nov 24, 2014 at 8:29 PM, lars hofhansl la...@apache.org wrote: Hmm... From that angle all we really have is master-slave replication, without limit as how it can be setup.A master can be slave too, and a slave a master, and cycles are allowed. I find cyclical replication more

[jira] [Resolved] (HBASE-11388) The order parameter is wrong when invoking the constructor of the ReplicationPeer In the method getPeer of the class ReplicationPeersZKImpl

2014-07-25 Thread Jean-Daniel Cryans (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-11388?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jean-Daniel Cryans resolved HBASE-11388. Resolution: Fixed Fix Version/s: (was: 0.99.0) Hadoop Flags

Re: jdk 1.7 trunk

2014-06-25 Thread Jean-Daniel Cryans
On Wed, Jun 25, 2014 at 11:48 AM, Nicolas Liochon nkey...@gmail.com wrote: Ok Enis I like the definition you put in the thread. Dropping support explicitly means that we stop building against JDK6 in jenkins, and won't try to fix issues if they are jdk6 only. Release testing and unit tests

[jira] [Created] (HBASE-11188) Inconsistent configuration for SchemaMetrics is always shown

2014-05-16 Thread Jean-Daniel Cryans (JIRA)
Jean-Daniel Cryans created HBASE-11188: -- Summary: Inconsistent configuration for SchemaMetrics is always shown Key: HBASE-11188 URL: https://issues.apache.org/jira/browse/HBASE-11188 Project

[jira] [Resolved] (HBASE-11188) Inconsistent configuration for SchemaMetrics is always shown

2014-05-16 Thread Jean-Daniel Cryans (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-11188?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jean-Daniel Cryans resolved HBASE-11188. Resolution: Fixed Release Note: Region servers with the default value

[jira] [Resolved] (HBASE-10946) hbase.metrics.showTableName cause run “hbase xxx.Hfile” report Inconsistent configuration

2014-05-16 Thread Jean-Daniel Cryans (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-10946?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jean-Daniel Cryans resolved HBASE-10946. Resolution: Duplicate I'm fixing this in HBASE-11188

[jira] [Resolved] (HBASE-10990) Running CompressionTest yields unrelated schema metrics configuration errors.

2014-05-16 Thread Jean-Daniel Cryans (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-10990?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jean-Daniel Cryans resolved HBASE-10990. Resolution: Duplicate I'm fixing this in HBASE-11188. Running CompressionTest

Re: Comparing the performance of 0.98.2 RC0 and 0.98.0 using YCSB

2014-05-15 Thread Jean-Daniel Cryans
Nice, thanks for running this. J-D On Tue, May 6, 2014 at 6:58 PM, Andrew Purtell apurt...@apache.org wrote: Comparing the relative performance of 0.98.2 RC0 and 0.98.0 on Hadoop 2.2.0 using YCSB. The hardware used is different than for the previous report comparing 0.98.1 to 0.98.0.

Re: Root and Meta removed in 0.96?

2014-04-28 Thread Jean-Daniel Cryans
Only ROOT https://issues.apache.org/jira/browse/HBASE-3171 On Mon, Apr 28, 2014 at 10:00 AM, Demai Ni nid...@gmail.com wrote: hi, a quick question. I remembered that these two are removed starting 0.96? not sure my memory serves me well on this. I googled but can't find the jira or

[jira] [Resolved] (HBASE-10932) Improve RowCounter to allow mapper number set/control

2014-04-25 Thread Jean-Daniel Cryans (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-10932?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jean-Daniel Cryans resolved HBASE-10932. Resolution: Won't Fix Resolving as won't fix. If you want to work on a more

[jira] [Created] (HBASE-11008) Align bulk load, flush, and compact to require Action.CREATE

2014-04-16 Thread Jean-Daniel Cryans (JIRA)
Jean-Daniel Cryans created HBASE-11008: -- Summary: Align bulk load, flush, and compact to require Action.CREATE Key: HBASE-11008 URL: https://issues.apache.org/jira/browse/HBASE-11008 Project

[jira] [Created] (HBASE-10967) CatalogTracker.waitForMeta should not wait indefinitely silently

2014-04-11 Thread Jean-Daniel Cryans (JIRA)
Jean-Daniel Cryans created HBASE-10967: -- Summary: CatalogTracker.waitForMeta should not wait indefinitely silently Key: HBASE-10967 URL: https://issues.apache.org/jira/browse/HBASE-10967 Project

[jira] [Created] (HBASE-10958) [dataloss] Bulk loading with seqids can prevent some log entries from being replayed

2014-04-10 Thread Jean-Daniel Cryans (JIRA)
Jean-Daniel Cryans created HBASE-10958: -- Summary: [dataloss] Bulk loading with seqids can prevent some log entries from being replayed Key: HBASE-10958 URL: https://issues.apache.org/jira/browse/HBASE-10958

[jira] [Resolved] (HBASE-5211) org.apache.hadoop.hbase.replication.TestMultiSlaveReplication#testMultiSlaveReplication is flakey

2014-03-31 Thread Jean-Daniel Cryans (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-5211?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jean-Daniel Cryans resolved HBASE-5211. --- Resolution: Cannot Reproduce Stale jira, closing

[jira] [Resolved] (HBASE-5222) Stopping replication via the stop_replication command in hbase shell on a slave cluster isn't acknowledged in the replication sink

2014-03-31 Thread Jean-Daniel Cryans (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-5222?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jean-Daniel Cryans resolved HBASE-5222. --- Resolution: Invalid The kill switch was completely removed, closing. Stopping

Re: [VOTE] The 1st hbase 0.94.18 release candidate is available for download

2014-03-21 Thread Jean-Daniel Cryans
Downloaded the non-secure tarball, checked the md5, ran some PE load, looked at the logs, made sure the rows were all there. +1 J-D On Fri, Mar 14, 2014 at 11:44 PM, lars hofhansl la...@apache.org wrote: The 1st 0.94.18 RC is available for download at

[jira] [Created] (HBASE-10755) MutableHistogram is capitalizing the metric names

2014-03-14 Thread Jean-Daniel Cryans (JIRA)
Jean-Daniel Cryans created HBASE-10755: -- Summary: MutableHistogram is capitalizing the metric names Key: HBASE-10755 URL: https://issues.apache.org/jira/browse/HBASE-10755 Project: HBase

Re: The 3rd HBase 0.98.0 release candidate (RC2) is available for download

2014-02-12 Thread Jean-Daniel Cryans
+1 Downloaded the hadoop2 tarball, ran some PE, everything looks good except for the annoying Failed to retrieve nio.BufferPool direct MemoryUsed debug line... J-D On Thu, Feb 6, 2014 at 6:14 PM, Andrew Purtell apurt...@apache.org wrote: The 3rd HBase 0.98.0 release candidate (RC2) is

[jira] [Created] (HBASE-10518) DirectMemoryUtils.getDirectMemoryUsage spams when none is configured

2014-02-12 Thread Jean-Daniel Cryans (JIRA)
Jean-Daniel Cryans created HBASE-10518: -- Summary: DirectMemoryUtils.getDirectMemoryUsage spams when none is configured Key: HBASE-10518 URL: https://issues.apache.org/jira/browse/HBASE-10518

[jira] [Created] (HBASE-10482) ReplicationSyncUp doesn't clean up its ZK, needed for tests

2014-02-06 Thread Jean-Daniel Cryans (JIRA)
Jean-Daniel Cryans created HBASE-10482: -- Summary: ReplicationSyncUp doesn't clean up its ZK, needed for tests Key: HBASE-10482 URL: https://issues.apache.org/jira/browse/HBASE-10482 Project

[jira] [Created] (HBASE-10271) [regression] Cannot use the wildcard address since HBASE-9593

2014-01-02 Thread Jean-Daniel Cryans (JIRA)
Jean-Daniel Cryans created HBASE-10271: -- Summary: [regression] Cannot use the wildcard address since HBASE-9593 Key: HBASE-10271 URL: https://issues.apache.org/jira/browse/HBASE-10271 Project

[jira] [Created] (HBASE-9898) Have a way to set a different default compression on HCD

2013-11-05 Thread Jean-Daniel Cryans (JIRA)
Jean-Daniel Cryans created HBASE-9898: - Summary: Have a way to set a different default compression on HCD Key: HBASE-9898 URL: https://issues.apache.org/jira/browse/HBASE-9898 Project: HBase

[jira] [Created] (HBASE-9744) Set io.serializations correctly in HFileOutputFormat.configureIncrementalLoad

2013-10-10 Thread Jean-Daniel Cryans (JIRA)
Jean-Daniel Cryans created HBASE-9744: - Summary: Set io.serializations correctly in HFileOutputFormat.configureIncrementalLoad Key: HBASE-9744 URL: https://issues.apache.org/jira/browse/HBASE-9744

Re: Upcoming HBase bay area user and dev meetups

2013-10-07 Thread Jean-Daniel Cryans
While we're on the topic of upcoming meetups, there's also a meetup at Facebook's NYC office the week of Strata/Hadoop World (10/28). There's still room for about 50 attendees. http://www.meetup.com/HBase-NYC/events/135434632/ J-D On Mon, Oct 7, 2013 at 2:10 PM, Enis Söztutar e...@apache.org

[jira] [Created] (HBASE-9707) [ref guide] make the client configurations easier to find

2013-10-03 Thread Jean-Daniel Cryans (JIRA)
Jean-Daniel Cryans created HBASE-9707: - Summary: [ref guide] make the client configurations easier to find Key: HBASE-9707 URL: https://issues.apache.org/jira/browse/HBASE-9707 Project: HBase

Re: [Replication] how ReplicationLogCleaner is triggered during hbase start up?

2013-10-02 Thread Jean-Daniel Cryans
Once hbase.replication is true it will get picked up by CleanerChore as set by Resplication.decorateMasterConfiguration J-D On Wed, Oct 2, 2013 at 12:39 PM, Demai Ni nid...@gmail.com wrote: hi, folks, I am trying to figure out this logic and probably leverage it. When HBase started, it

[jira] [Resolved] (HBASE-8711) Requests count is completely off

2013-09-26 Thread Jean-Daniel Cryans (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-8711?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jean-Daniel Cryans resolved HBASE-8711. --- Resolution: Fixed Fix Version/s: 0.98.0 Hadoop Flags: Reviewed Thanks

Re: [jira] [Commented] (HBASE-9647) Add a test in TestAsyncProcess to check the number of threads created

2013-09-25 Thread Jean-Daniel Cryans
TIL English :) On Wed, Sep 25, 2013 at 11:10 AM, Nick Dimiduk (JIRA) j...@apache.orgwrote: [ https://issues.apache.org/jira/browse/HBASE-9647?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13777833#comment-13777833] Nick Dimiduk commented on

Re: [VOTE] The 3rd hbase 0.94.12 release candidate is available for download

2013-09-23 Thread Jean-Daniel Cryans
+1 I'm currently using it as a store for opentsdb in a pseudo-distributed mode. I also did some PE testing on a cluster with 5 nodes when trying to compare thread and memory usage VS 0.96.0 J-D On Thu, Sep 19, 2013 at 11:19 PM, lars hofhansl la...@apache.org wrote: Third time's the charm...

Random reads are 5x faster in 0.96.0! Or not

2013-09-23 Thread Jean-Daniel Cryans
Hey devs, I was testing performance of 0.96.0RC3 vs 0.94.12 and found that random reads are 5x faster out of the box in the former, party! But wait, no, HBASE-7008 disabled Nagle's algo and it was only applied to 0.95, so if you configure that in 0.94 it becomes even faster than 0.96 by a small

[jira] [Created] (HBASE-9642) AM ZK Workers stuck doing 100% CPU on HashMap.put

2013-09-23 Thread Jean-Daniel Cryans (JIRA)
Jean-Daniel Cryans created HBASE-9642: - Summary: AM ZK Workers stuck doing 100% CPU on HashMap.put Key: HBASE-9642 URL: https://issues.apache.org/jira/browse/HBASE-9642 Project: HBase

Re: [VOTE] The 4th hbase-0.96.0 release candidate is available for download

2013-09-23 Thread Jean-Daniel Cryans
-1, HBASE-9642 seems like something that would kill clusters with a lot of region movements or just long running ones. J-D On Sat, Sep 21, 2013 at 3:50 PM, Stack st...@duboce.net wrote: hbase-0.96.0 will be our next major release. It is intended to supplant the 0.94.x series.

[jira] [Created] (HBASE-9602) Cannot show the master's web UI when splitting logs at start time

2013-09-20 Thread Jean-Daniel Cryans (JIRA)
Jean-Daniel Cryans created HBASE-9602: - Summary: Cannot show the master's web UI when splitting logs at start time Key: HBASE-9602 URL: https://issues.apache.org/jira/browse/HBASE-9602 Project

[jira] [Created] (HBASE-9601) Use a faster balancer when the imbalance is in the hundreds of regions

2013-09-20 Thread Jean-Daniel Cryans (JIRA)
Jean-Daniel Cryans created HBASE-9601: - Summary: Use a faster balancer when the imbalance is in the hundreds of regions Key: HBASE-9601 URL: https://issues.apache.org/jira/browse/HBASE-9601

Re: [VOTE] The 3rd hbase-0.96.0 release candidate is available for download

2013-09-19 Thread Jean-Daniel Cryans
On Wed, Sep 18, 2013 at 9:39 PM, Stack st...@duboce.net wrote: hbase-0.96.0 will be our next major release. It is intended to supplant the 0.94.x series. hbase-0.96.0RC2 is our third hbase-0.96.0 release candidate. The signed tarballs are available here:

[jira] [Created] (HBASE-9591) [replication] getting Current list of sinks is out of date all the time when a source is recovered

2013-09-19 Thread Jean-Daniel Cryans (JIRA)
Jean-Daniel Cryans created HBASE-9591: - Summary: [replication] getting Current list of sinks is out of date all the time when a source is recovered Key: HBASE-9591 URL: https://issues.apache.org/jira/browse

Re: [Question: Replication] how to detect whether there is a replication pending?

2013-09-18 Thread Jean-Daniel Cryans
Yeah, with HLog queue you can be a whole 64MB in the worst case :) Pretty hard to say for a single table what the status is, but if it was cluster-wide you'd just have to look at the shipped ops/batch rates (if it sits at 0, you're not replicating, unless there's some problem preventing

Re: src/test/ruby anyone?

2013-09-13 Thread Jean-Daniel Cryans
See TestShell. J-D On Fri, Sep 13, 2013 at 1:26 PM, Nick Dimiduk ndimi...@gmail.com wrote: I see we have ruby tests. How do I run those? I don't seem them included the regular mvn runs. Taking a wild guess, it looks like they've suffered some bit-rot: $ ./bin/hbase shell

[jira] [Created] (HBASE-9505) Enable replication by default

2013-09-11 Thread Jean-Daniel Cryans (JIRA)
Jean-Daniel Cryans created HBASE-9505: - Summary: Enable replication by default Key: HBASE-9505 URL: https://issues.apache.org/jira/browse/HBASE-9505 Project: HBase Issue Type: Task

Re: Please welcome our newest committer, Nick Dimiduk

2013-09-10 Thread Jean-Daniel Cryans
Welcome to the tribe, Nick! J-D On Tue, Sep 10, 2013 at 3:54 PM, Enis Söztutar e...@apache.org wrote: Hi, Please join me in welcoming Nick as our new addition to the list of committers. Nick is exceptionally good with user-facing issues, and has done major contributions in mapreduce

Re: 0.96.0 keep logging Memstore is above high water mark

2013-09-03 Thread Jean-Daniel Cryans
-packed the jar and ran it. So my config file is: configuration /configuration 2013/9/3 Jean-Daniel Cryans jdcry...@apache.org On Tue, Sep 3, 2013 at 10:35 AM, Jean-Marc Spaggiari jean-m...@spaggiari.org wrote: Your 10 clients are disconnecting from ZK, you're letting HBase manage

Re: 0.96.0 keep logging Memstore is above high water mark

2013-09-03 Thread Jean-Daniel Cryans
lot less log spam. Also, just to make sure I understand you, you say the warn is important for troubleshooting, but have you used it? It's only in 0.95+. On Sep 3, 2013 1:29 PM, Jean-Daniel Cryans jdcry...@apache.org wrote: On Mon, Sep 2, 2013 at 12:04 PM, Jean-Marc Spaggiari jean-m

Re: 0.96.0 keep logging Memstore is above high water mark

2013-09-03 Thread Jean-Daniel Cryans
don't remove the warn. It is important for troubleshooting and sizing. On Sep 3, 2013 1:29 PM, Jean-Daniel Cryans jdcry...@apache.org wrote: On Mon, Sep 2, 2013 at 12:04 PM, Jean-Marc Spaggiari jean-m...@spaggiari.org wrote: While running PE with 10 clients, server keep logging

Re: 0.96.0 keep logging Memstore is above high water mark

2013-09-03 Thread Jean-Daniel Cryans
exception. So it's not making any difference. 2013/9/3 Jean-Daniel Cryans jdcry...@apache.org Alright so your ZK is running inside the master and that's where you're seeing those lines, and they are normal if each thread has a different connection... Are you doing a --nomapred PE

Re: 0.96.0 keep logging Memstore is above high water mark

2013-09-03 Thread Jean-Daniel Cryans
but sound like it's one per client. I will re-run the test and wc the lines to see if it's really one for one... JM 2013/9/3 Jean-Daniel Cryans jdcry...@apache.org The reason I was asking is if you used --nomapred, all your clients would share the same connection so only one

[jira] [Created] (HBASE-9425) Starting a LocalHBaseCluster when 2181 is occupied results in Too many open files

2013-09-03 Thread Jean-Daniel Cryans (JIRA)
Jean-Daniel Cryans created HBASE-9425: - Summary: Starting a LocalHBaseCluster when 2181 is occupied results in Too many open files Key: HBASE-9425 URL: https://issues.apache.org/jira/browse/HBASE-9425

Re: 0.96.0 keep logging Memstore is above high water mark

2013-09-03 Thread Jean-Daniel Cryans
saying that it's normal to see a ZK warning each time a client disconnect? Or it's because PE is not disconnecting correctly? Le 2013-09-03 17:48, Jean-Daniel Cryans jdcry...@apache.org a écrit : I ran the command line you are using, it actually creates 100 clients and this is why you see ~100

[jira] [Created] (HBASE-9428) Regex filters are at least an order of magnitude slower since 0.94.3

2013-09-03 Thread Jean-Daniel Cryans (JIRA)
Jean-Daniel Cryans created HBASE-9428: - Summary: Regex filters are at least an order of magnitude slower since 0.94.3 Key: HBASE-9428 URL: https://issues.apache.org/jira/browse/HBASE-9428 Project

[jira] [Created] (HBASE-9394) [replication] size accounting is completely off in the source

2013-08-30 Thread Jean-Daniel Cryans (JIRA)
Jean-Daniel Cryans created HBASE-9394: - Summary: [replication] size accounting is completely off in the source Key: HBASE-9394 URL: https://issues.apache.org/jira/browse/HBASE-9394 Project: HBase

Re: [UPDATE] Finishing up 0.96 -- WAS Re: 0.95 and 0.96 remaining issues

2013-08-29 Thread Jean-Daniel Cryans
It looks like there's data loss in replication... My gut feeling is it has to do with how we detect when to switch from one log to another. Running more tests today. On Wed, Aug 28, 2013 at 10:35 PM, Stack st...@duboce.net wrote: Almost there. A bunch of stuff got resolved in the last few

[jira] [Created] (HBASE-9371) Eliminate log spam when tailing files

2013-08-28 Thread Jean-Daniel Cryans (JIRA)
Jean-Daniel Cryans created HBASE-9371: - Summary: Eliminate log spam when tailing files Key: HBASE-9371 URL: https://issues.apache.org/jira/browse/HBASE-9371 Project: HBase Issue Type

[jira] [Resolved] (HBASE-9371) Eliminate log spam when tailing files

2013-08-28 Thread Jean-Daniel Cryans (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-9371?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jean-Daniel Cryans resolved HBASE-9371. --- Resolution: Fixed Assignee: Jean-Daniel Cryans Hadoop Flags: Reviewed

[jira] [Created] (HBASE-9321) Contention getting the current user in RpcClient$Connection.writeRequest

2013-08-23 Thread Jean-Daniel Cryans (JIRA)
Jean-Daniel Cryans created HBASE-9321: - Summary: Contention getting the current user in RpcClient$Connection.writeRequest Key: HBASE-9321 URL: https://issues.apache.org/jira/browse/HBASE-9321

[jira] [Created] (HBASE-9322) Contention on the SoftValueSortedMap with multiple clients

2013-08-23 Thread Jean-Daniel Cryans (JIRA)
Jean-Daniel Cryans created HBASE-9322: - Summary: Contention on the SoftValueSortedMap with multiple clients Key: HBASE-9322 URL: https://issues.apache.org/jira/browse/HBASE-9322 Project: HBase

[jira] [Created] (HBASE-9326) ServerName is created using getLocalSocketAddress, breaks binding to the wildcard address

2013-08-23 Thread Jean-Daniel Cryans (JIRA)
Jean-Daniel Cryans created HBASE-9326: - Summary: ServerName is created using getLocalSocketAddress, breaks binding to the wildcard address Key: HBASE-9326 URL: https://issues.apache.org/jira/browse/HBASE-9326

[jira] [Created] (HBASE-9330) Refactor PE to create HTable the correct way

2013-08-23 Thread Jean-Daniel Cryans (JIRA)
Jean-Daniel Cryans created HBASE-9330: - Summary: Refactor PE to create HTable the correct way Key: HBASE-9330 URL: https://issues.apache.org/jira/browse/HBASE-9330 Project: HBase Issue

[jira] [Created] (HBASE-9333) hbase.hconnection.threads.max should not be configurable else you get RejectedExecutionException

2013-08-23 Thread Jean-Daniel Cryans (JIRA)
Jean-Daniel Cryans created HBASE-9333: - Summary: hbase.hconnection.threads.max should not be configurable else you get RejectedExecutionException Key: HBASE-9333 URL: https://issues.apache.org/jira/browse

[jira] [Created] (HBASE-9307) HalfStoreFileReader needs to handle the faked key else compactions go into infinite loops

2013-08-22 Thread Jean-Daniel Cryans (JIRA)
Jean-Daniel Cryans created HBASE-9307: - Summary: HalfStoreFileReader needs to handle the faked key else compactions go into infinite loops Key: HBASE-9307 URL: https://issues.apache.org/jira/browse/HBASE-9307

[jira] [Created] (HBASE-9309) The links in the backup masters template are bad

2013-08-22 Thread Jean-Daniel Cryans (JIRA)
Jean-Daniel Cryans created HBASE-9309: - Summary: The links in the backup masters template are bad Key: HBASE-9309 URL: https://issues.apache.org/jira/browse/HBASE-9309 Project: HBase

[jira] [Created] (HBASE-9312) Lower StochasticLoadBalancer's default max run time

2013-08-22 Thread Jean-Daniel Cryans (JIRA)
Jean-Daniel Cryans created HBASE-9312: - Summary: Lower StochasticLoadBalancer's default max run time Key: HBASE-9312 URL: https://issues.apache.org/jira/browse/HBASE-9312 Project: HBase

[jira] [Created] (HBASE-9314) Dropping a table always prints a TableInfoMissingException in the master log

2013-08-22 Thread Jean-Daniel Cryans (JIRA)
Jean-Daniel Cryans created HBASE-9314: - Summary: Dropping a table always prints a TableInfoMissingException in the master log Key: HBASE-9314 URL: https://issues.apache.org/jira/browse/HBASE-9314

Re: [question] command line to get replication metrics info

2013-08-21 Thread Jean-Daniel Cryans
nid...@gmail.com wrote: JD, thanks a lot. I will look into it Demai On Mon, Aug 19, 2013 at 2:44 PM, Jean-Daniel Cryans jdcry...@apache.org wrote: See what the status command calls in the shell, I would suggest following similar flows. Maybe you could also add to it, like

Re: [question] command line to get replication metrics info

2013-08-19 Thread Jean-Daniel Cryans
See what the status command calls in the shell, I would suggest following similar flows. Maybe you could also add to it, like a status 'replication' option, instead of having a different command. J-D On Mon, Aug 19, 2013 at 10:23 AM, Demai Ni nid...@gmail.com wrote: hi, folks Looking for

[jira] [Created] (HBASE-9267) StochasticLoadBalancer goes over its processing time limit

2013-08-19 Thread Jean-Daniel Cryans (JIRA)
Jean-Daniel Cryans created HBASE-9267: - Summary: StochasticLoadBalancer goes over its processing time limit Key: HBASE-9267 URL: https://issues.apache.org/jira/browse/HBASE-9267 Project: HBase

[jira] [Created] (HBASE-9268) Client doesn't recover from a stalled region server

2013-08-19 Thread Jean-Daniel Cryans (JIRA)
Jean-Daniel Cryans created HBASE-9268: - Summary: Client doesn't recover from a stalled region server Key: HBASE-9268 URL: https://issues.apache.org/jira/browse/HBASE-9268 Project: HBase

Re: VOTE: hbase-0.95.2 release candidate 0 is available for download

2013-08-19 Thread Jean-Daniel Cryans
I'm +1 on this release but there are definitely things we need to fix for 0.96: - https://issues.apache.org/jira/browse/HBASE-9267 StochasticLoadBalancer goes over its processing time limit I guess this has been present for a while, but it seems to imply you can't let a clusters run for too

Re: [VOTE] The 1st hbase 0.94.11 release candidate is available for download

2013-08-15 Thread Jean-Daniel Cryans
+1 Used both tars against each other, loaded some PE data, ran scans and reads, checked out the logs/UIs, did some jstack'ing to make sure nothing weird was in there. J-D On Tue, Aug 13, 2013 at 11:26 PM, lars hofhansl la...@apache.org wrote: The 1st 0.94.11 RC is available for download at

[jira] [Resolved] (HBASE-8919) TestReplicationQueueFailover (and Compressed) can fail because the recovered queue gets stuck on ClosedByInterruptException

2013-08-13 Thread Jean-Daniel Cryans (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-8919?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jean-Daniel Cryans resolved HBASE-8919. --- Resolution: Cannot Reproduce I'm closing as Cannot Repro because I haven't seen

[jira] [Created] (HBASE-9211) ERROR: undefined method `message' for nil:NilClass in the shell on error

2013-08-13 Thread Jean-Daniel Cryans (JIRA)
Jean-Daniel Cryans created HBASE-9211: - Summary: ERROR: undefined method `message' for nil:NilClass in the shell on error Key: HBASE-9211 URL: https://issues.apache.org/jira/browse/HBASE-9211

[jira] [Created] (HBASE-9172) Adapt the web UIs to namespaces

2013-08-09 Thread Jean-Daniel Cryans (JIRA)
Jean-Daniel Cryans created HBASE-9172: - Summary: Adapt the web UIs to namespaces Key: HBASE-9172 URL: https://issues.apache.org/jira/browse/HBASE-9172 Project: HBase Issue Type

[jira] [Resolved] (HBASE-8785) revise zookeeper session timeout setting

2013-08-07 Thread Jean-Daniel Cryans (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-8785?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jean-Daniel Cryans resolved HBASE-8785. --- Resolution: Fixed Fix Version/s: 0.98.0 Assignee: Jean-Daniel Cryans

[jira] [Created] (HBASE-9111) Put back TestReplicationKill* except for the MasterRSCompressed one

2013-08-01 Thread Jean-Daniel Cryans (JIRA)
Jean-Daniel Cryans created HBASE-9111: - Summary: Put back TestReplicationKill* except for the MasterRSCompressed one Key: HBASE-9111 URL: https://issues.apache.org/jira/browse/HBASE-9111 Project

Re: HBase read perfomnance and HBase client

2013-07-30 Thread Jean-Daniel Cryans
That's a tough one. One thing that comes to mind is socket reuse. It used to come up more more often but this is an issue that people hit when doing loads of random reads. Try enabling tcp_tw_recycle but I'm not guaranteeing anything :) Also if you _just_ want to saturate something, be it CPU or

Re: HBase read perfomnance and HBase client

2013-07-30 Thread Jean-Daniel Cryans
and 94.6 with respect to read performance? On Tue, Jul 30, 2013 at 12:06 PM, Jean-Daniel Cryans jdcry...@apache.orgwrote: That's a tough one. One thing that comes to mind is socket reuse. It used to come up more more often but this is an issue that people hit when doing loads of random

Re: HBase read perfomnance and HBase client

2013-07-30 Thread Jean-Daniel Cryans
PM, Jean-Daniel Cryans jdcry...@apache.orgwrote: Can you show us what the thread dump looks like when the threads are BLOCKED? There aren't that many locks on the read path when reading out of the block cache, and epoll would only happen if you need to hit HDFS, which you're saying

Re: [question about replication] how to apply delta from Master to Slave after crash ?

2013-07-26 Thread Jean-Daniel Cryans
As soon as you restart your master, it will continue replicating from where it was, so it will send that delta. J-D On Mon, Jul 22, 2013 at 4:42 PM, Demai Ni nid...@gmail.com wrote: hi, folks, I am trying to address a recovery scenario after Master crash. In a simple Master - Slave

Re: [question about replication] how to apply delta from Master to Slave after crash ?

2013-07-26 Thread Jean-Daniel Cryans
. Can you please give me some pointers to start with? many thanks Demai On Fri, Jul 26, 2013 at 10:08 AM, Jean-Daniel Cryans jdcry...@apache.orgwrote: As soon as you restart your master, it will continue replicating from where it was, so it will send that delta. J-D On Mon, Jul 22, 2013

Re: [question about replication] how to apply delta from Master to Slave after crash ?

2013-07-26 Thread Jean-Daniel Cryans
I guess I didn't explain my ideas clearly. So, first, replication in HBase is master-push, so you don't want to reverse the process. It means that this tool needs to run on the master cluster. Then I don't think you need to specify a timestamp since the replication state is in ZK. Basically that

Re: [question about replication] how to apply delta from Master to Slave after crash ?

2013-07-26 Thread Jean-Daniel Cryans
https://issues.apache.org/jira/browse/HBASE-9047 On Fri, Jul 26, 2013 at 12:59 PM, Jean-Daniel Cryans jdcry...@apache.org wrote: I guess I didn't explain my ideas clearly. So, first, replication in HBase is master-push, so you don't want to reverse the process. It means that this tool needs

[jira] [Created] (HBASE-9047) Tool to handle finishing replication when the cluster is offline

2013-07-26 Thread Jean-Daniel Cryans (JIRA)
Jean-Daniel Cryans created HBASE-9047: - Summary: Tool to handle finishing replication when the cluster is offline Key: HBASE-9047 URL: https://issues.apache.org/jira/browse/HBASE-9047 Project

Re: [question about replication] how to apply delta from Master to Slave after crash ?

2013-07-26 Thread Jean-Daniel Cryans
, 2013 at 1:08 PM, Jean-Daniel Cryans jdcry...@apache.orgwrote: https://issues.apache.org/jira/browse/HBASE-9047 On Fri, Jul 26, 2013 at 12:59 PM, Jean-Daniel Cryans jdcry...@apache.org wrote: I guess I didn't explain my ideas clearly. So, first, replication in HBase is master-push, so you

[jira] [Resolved] (HBASE-9040) TestReplicationKillMasterRSCompressed.killOneMasterRS

2013-07-25 Thread Jean-Daniel Cryans (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-9040?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jean-Daniel Cryans resolved HBASE-9040. --- Resolution: Duplicate This is the same as HBASE-8615. I'm trying to repro under

Re: [ANNOUNCE] The 1st hbase 0.94.10 release candidate is available for download

2013-07-24 Thread Jean-Daniel Cryans
Yeah AFAIK it's almost always been like this. J-D On Wed, Jul 24, 2013 at 11:17 AM, lars hofhansl la...@apache.org wrote: Thanks Stack! Hmm... That log message is not new. That's a pretty small block cache, so probably needs to evict often. Could be a little less verbose about it, or make

[jira] [Created] (HBASE-9038) Compaction WALEdit gives NPEs with Replication enabled

2013-07-24 Thread Jean-Daniel Cryans (JIRA)
Jean-Daniel Cryans created HBASE-9038: - Summary: Compaction WALEdit gives NPEs with Replication enabled Key: HBASE-9038 URL: https://issues.apache.org/jira/browse/HBASE-9038 Project: HBase

Re: [ANNOUNCE] The 1st hbase 0.94.10 release candidate is available for download

2013-07-23 Thread Jean-Daniel Cryans
Tried out the secure tar on a single node, ran some PE, +1 J-D On Fri, Jul 19, 2013 at 2:33 PM, lars hofhansl la...@apache.org wrote: The 1st 0.94.10 RC is available for download at http://people.apache.org/~larsh/hbase-0.94.10-rc0/ Signed with my code signing key: C7CFE328 Like the

[jira] [Created] (HBASE-9021) Create a unit test for ReplicationHLogReaderManager

2013-07-22 Thread Jean-Daniel Cryans (JIRA)
Jean-Daniel Cryans created HBASE-9021: - Summary: Create a unit test for ReplicationHLogReaderManager Key: HBASE-9021 URL: https://issues.apache.org/jira/browse/HBASE-9021 Project: HBase

[jira] [Resolved] (HBASE-8975) NPE/HTTP 500 when opening the master's web UI too early

2013-07-19 Thread Jean-Daniel Cryans (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-8975?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jean-Daniel Cryans resolved HBASE-8975. --- Resolution: Fixed Hadoop Flags: Reviewed Committed to 0.95 and trunk, thanks

[jira] [Created] (HBASE-8987) ProtobufUtil.toException doesn't handle plain RemoteException, gets a NoSuchMethodException

2013-07-18 Thread Jean-Daniel Cryans (JIRA)
Jean-Daniel Cryans created HBASE-8987: - Summary: ProtobufUtil.toException doesn't handle plain RemoteException, gets a NoSuchMethodException Key: HBASE-8987 URL: https://issues.apache.org/jira/browse/HBASE

[jira] [Created] (HBASE-8988) Reuse the thread pool in the shell to not run out of threads

2013-07-18 Thread Jean-Daniel Cryans (JIRA)
Jean-Daniel Cryans created HBASE-8988: - Summary: Reuse the thread pool in the shell to not run out of threads Key: HBASE-8988 URL: https://issues.apache.org/jira/browse/HBASE-8988 Project: HBase

[jira] [Resolved] (HBASE-8988) Reuse the thread pool in the shell to not run out of threads

2013-07-18 Thread Jean-Daniel Cryans (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-8988?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jean-Daniel Cryans resolved HBASE-8988. --- Resolution: Fixed Hadoop Flags: Reviewed Committed to trunk and branch, thanks

[jira] [Reopened] (HBASE-8983) HBaseConnection#deleteAllConnections does not always delete

2013-07-18 Thread Jean-Daniel Cryans (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-8983?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jean-Daniel Cryans reopened HBASE-8983: --- I attached a new patch where in MiniHBaseCluster I pass

[jira] [Resolved] (HBASE-8855) TestTableInputFormatScan1/2 fail semi-silently with the hadoop 2 profile

2013-07-18 Thread Jean-Daniel Cryans (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-8855?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jean-Daniel Cryans resolved HBASE-8855. --- Resolution: Fixed Assignee: Jean-Daniel Cryans Release Note: Unit tests

[jira] [Created] (HBASE-8975) NPE/HTTP 500 when opening the master's web UI too early

2013-07-17 Thread Jean-Daniel Cryans (JIRA)
Jean-Daniel Cryans created HBASE-8975: - Summary: NPE/HTTP 500 when opening the master's web UI too early Key: HBASE-8975 URL: https://issues.apache.org/jira/browse/HBASE-8975 Project: HBase

[jira] [Created] (HBASE-8961) Make TestReplicationQueueFailover less integration-y by splitting it up

2013-07-16 Thread Jean-Daniel Cryans (JIRA)
Jean-Daniel Cryans created HBASE-8961: - Summary: Make TestReplicationQueueFailover less integration-y by splitting it up Key: HBASE-8961 URL: https://issues.apache.org/jira/browse/HBASE-8961

Re: Error with hbase shell when building trunk or 0.95 against hadoop 2

2013-07-15 Thread Jean-Daniel Cryans
Have you tried install instead of package? J-D On Sat, Jul 13, 2013 at 10:42 AM, Rob Povey r...@maana.io wrote: hbase shell LoadError: no such file to load -- hbase require at org/jruby/RubyKernel.java:1062 (root) at /Users/rob/hbase-local/bin/hirb.rb:100 This is probably a

[jira] [Created] (HBASE-8919) TestReplicationQueueFailover (and Compressed) can fail because the recovered queue gets stuck on ClosedByInterruptException

2013-07-10 Thread Jean-Daniel Cryans (JIRA)
Jean-Daniel Cryans created HBASE-8919: - Summary: TestReplicationQueueFailover (and Compressed) can fail because the recovered queue gets stuck on ClosedByInterruptException Key: HBASE-8919 URL: https

[jira] [Resolved] (HBASE-7632) fail to create ReplicationSource if ReplicationPeer.startStateTracker checkExists(peerStateNode) and find not exist but fails in createAndWatch due to client/shell is do

2013-07-10 Thread Jean-Daniel Cryans (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-7632?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jean-Daniel Cryans resolved HBASE-7632. --- Resolution: Duplicate Fix Version/s: (was: 0.95.2) This was actually

[jira] [Created] (HBASE-8910) TestReplicationDisableInactivePeer fails if the master we shutdown comes back to life

2013-07-09 Thread Jean-Daniel Cryans (JIRA)
Jean-Daniel Cryans created HBASE-8910: - Summary: TestReplicationDisableInactivePeer fails if the master we shutdown comes back to life Key: HBASE-8910 URL: https://issues.apache.org/jira/browse/HBASE-8910

Re: [jira] [Updated] (HBASE-8861) Remove ReplicationState completely

2013-07-08 Thread Jean-Daniel Cryans
What the hell just happened?!? :) On Mon, Jul 8, 2013 at 6:02 PM, Jean-Daniel Cryans (JIRA) j...@apache.org wrote: [ https://issues.apache.org/jira/browse/HBASE-8861?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jean-Daniel Cryans updated HBASE-8861

  1   2   3   4   5   >