and HBase (i.e.
>> stabilize a protocol that withhold API changes in HBase client) Separation
>> of concerns - no need for the application to 'tame' the HBase driver in
>> terms of IO resources, memory and buffer size, connection pool size,
>> etc.Naturally - Language agonisticTesting - the proxy could hold a mock
>> connection to HBase or a mock HBase for easier testing
>> Your kind feedback on the idea, concept and usefulness is very welcomed
>> Thanks,
>> Amit Mor
>>
HBase or a mock HBase for easier testing
Your kind feedback on the idea, concept and usefulness is very welcomed
Thanks,
Amit Mor
nately just have 2 SSD disks. Perhaps
> they have benchmarks or can chime in as to whether they ventured to use EBS
> to supplement the 2 disks or what.
>
>
> On Tue, Jul 16, 2013 at 2:18 PM, Amit Mor wrote:
>
> > Hello, I am curious to hear the recommendations people have h
Hello, I am curious to hear the recommendations people have here for
running HBase on EC2 instances. I failed to find an instance that has a
good ratio/balance between CPU, # of disks and jvm acceptable heap Memory
to be used with (almost random) read intensive cluster. The major
bottleneck I found
>From hadooo shell man
"DU
Usage: hadoop fs -du URI [URI …]
Displays aggregate length of files contained in the directory or the length
of a file in case its just a file. Example: hadoop fs -du /user/hadoop/dir1
/user/hadoop/file1 hdfs://nn.example.com/user/hadoop/dir1 Exit Code:
Returns 0 on suc
Attachment of JMX requests metric showing bursts on RS
On Wed, Jun 19, 2013 at 12:48 AM, Amit Mor wrote:
> Hello,
>
> We use hbase 0.94.2 and we are seeing (mostly reading) latency issues, and
> with an interesting twist: client (100 threads) get stuck waiting on HBase,
> the
Hello,
We use hbase 0.94.2 and we are seeing (mostly reading) latency issues, and
with an interesting twist: client (100 threads) get stuck waiting on HBase,
then stops sending RPC's and then seems to be freed. When freed, while
trying to flush all request it had queued, it causes another vicious
What's your blockCacheHitCachingRatio ? It would tell you about the ratio
of scans requested from cache (default) to the scans actually served from
the block cache. You can get that from the RS web ui. What you are seeing
can almost map to anything, for example: is scanner caching (client side)
ena
Depends on so much environment related variables and on data as well.
But to give you a number after all:
One of our clusters is on EC2, 6 RS, on m1.xlarge machines (network
performance 'high' according to aws), with 90% of the time we do reads; our
avg data size is 2K, block cache at 20K, 100 rows
I have pasted most of the RS's logs just prior to their FATAL and
including. Would be very thankful if someone can take a look:
http://pastebin.com/qFzycXNS . Interestingly, some RS's experience an
IOException for not finding an .oldlogs/ file. The rest get
KeeperException$NoNodeException
w/o the I
way to start and
> stop replicating, and start_replication may put you in an inconsistent
> state:
>
> hbase(main):001:0> help 'stop_replication'
> Stops all the replication features. The state in which each
> stream stops in is undetermined.
> WARNING:
> start/stop repl
code with 8207; cdh4.2.1 doesn't
> have
> > > it.
> > > >
> > > > With hyphens in the name, ReplicationSource gets confused and tried
> to
> > > set
> > > > data in a znode which doesn't exist.
> > > >
> >
Yes, I have checked the source files of the 0.94.2-cdh4.2.1 jar and
HBASE-8207 issues are present in the source codes, namely:
String[] parts = peerClusterZnode.split("-");
On Thu, May 23, 2013 at 12:42 AM, Amit Mor wrote:
> yes, indeed - hyphens are part of the host name (an
ens
> in
> our paths. One way to get back up is to delete these nodes but then you
> lose data in these WAL(s)...
>
>
> On Wed, May 22, 2013 at 2:22 PM, Amit Mor wrote:
>
> > va-p-hbase-02-d,60020,1369249862401
> >
> >
> > On Thu, May 23, 2013 at 12:2
ache.zookeeper.KeeperException$SessionExpiredException:
> >>> KeeperErrorCode = Session expired for *
> >>>
> /hbase/replication/rs/va-p-hbase-01-c,60020,1369249873379/1-va-p-hbase-01-c,60020,1369042378287-va-p-hbase-02-c,60020,1369042377731-va-p-hbase-02-d,60020,1369233252475/va-p-
,60020,1369233268385-va-p-hbase-02-d,60020,1369233252475]
On Thu, May 23, 2013 at 12:09 AM, Amit Mor wrote:
> empty return:
>
> [zk: va-p-zookeeper-01-c:2181(CONNECTED) 10] ls
> /hbase/replication/rs/va-p-hbase-01-c,60020,1369249873379/1
> []
>
>
>
> On Thu, May 23, 2013 at 1
empty return:
[zk: va-p-zookeeper-01-c:2181(CONNECTED) 10] ls
/hbase/replication/rs/va-p-hbase-01-c,60020,1369249873379/1
[]
On Thu, May 23, 2013 at 12:05 AM, Varun Sharma wrote:
> Do an "ls" not a get here and give the output ?
>
> ls /hbase/replication/rs/va-p-hbase-01-c,60020,1369249873379
17 matches
Mail list logo
