On Wed, Aug 25, 2010 at 11:22 AM, Stuart Smith stu24m...@yahoo.com wrote:
Just curious, though, (if it happens again) - assume the regions were invalid
- I don't know, maybe it was halfway through splitting something and died -
but say they're invalid.
(See if a failed MR task associated
Hey,
Awesome. Well, this is a research project for work, so I have to ask the powers
that be if it's OK to publish the plumbing parts.
It's really just plumbing though, so from the techy perspective it's not the
interesting part. So hopefully I can sell it as such (selling my work to the
boss
Hi,
I'm doing an experiment on an 8 node cluster, each of which has 6GB of RAM
allocated to hbase region server. Basically, doing a bulk import processing
large files, but some imports require to do gets and scans as well. In the
master UI I see that the heap used gets very close to the 6GB
On Thu, Aug 26, 2010 at 8:07 AM, Martin Arnandze marnan...@gmail.com wrote:
Hi,
I'm doing an experiment on an 8 node cluster, each of which has 6GB of RAM
allocated to hbase region server. Basically, doing a bulk import processing
large files,
How large?
Unless very large, it should not
On Thu, Aug 26, 2010 at 8:16 AM, Andrey Timerbaev atimerb...@gmx.net wrote:
Dear experts,
Could you kindly suggest, how to help the RegionServer to complete
initialization in the following situation:
After a failure of one or RegionServers, which is running on a dedicated node
in
a
I provide the answers below.
Thanks!
Martin
On Aug 26, 2010, at 11:45 AM, Stack wrote:
On Thu, Aug 26, 2010 at 8:07 AM, Martin Arnandze marnan...@gmail.com wrote:
Hi,
I'm doing an experiment on an 8 node cluster, each of which has 6GB of RAM
allocated to hbase region server. Basically,
I'm going through the overiew-summary instructions for setting up and running
hbase. Right now I'm running hbase in pseudo-distributed mode, and looking to
go fully-distributed on 25 nodes.
Every time I restart hbase, I get:
Couldn't start ZK at requested address of n, instead got: n+1.
Use netstat to see who is occupying port n
Maybe HQuorumPeer wasn't stopped from previous run ?
On Thu, Aug 26, 2010 at 9:49 AM, Witteveen, Tim t...@pnl.gov wrote:
I'm going through the overiew-summary instructions for setting up and
running hbase. Right now I'm running hbase in
Thanks! Netstat revealed I was running zookeeper twice.
I stopped manually starting it, and things are working as expected.
TimW
-Original Message-
From: Ted Yu [mailto:yuzhih...@gmail.com]
Sent: Thursday, August 26, 2010 9:56 AM
To: user@hbase.apache.org
Subject: Re: hbase
Use
My hbase table issued a mass split after I loaded regions with greater sizes
than maxfilesize.. (my bad..)
Now, when I try accessing the master through the web interface, it just hangs...
And, if I scan the META, I get the parent regions set to offline.. And the
child regions have random byte
Without gc logs you cannot diagnose what you suspect are gc issues...
make sure you are logging and then check them out. If you are running
a recent JVM you can use -XX:+PrintGCDateStamps and get better log
entries.
Also you cannot swap at all, even 1 page of swapping in a java process
can be
Ok I didnt see your logs earlier - normally attachments are filtered
out and we use pastebin for logs.
I am not seeing any large pauses in your gc logs. Not sure if the log
is complete enough or what...
-ryan
On Thu, Aug 26, 2010 at 12:32 PM, Ryan Rawson ryano...@gmail.com wrote:
Without gc
Hi All
I am new to hbase client API and want to know how to get data from hbase
from cleint/remote machine. The target is to develop a java program which
should connect to hbase server and then get results from it.
Anyone have any example???
Thanks
--
Regards
Shuja-ur-Rehman Baig
Hey Vidhya,
Anything interesting in the logs on the master?
It's possible that the master is slowly assigning out all the daughter
regions, and it's just taking a really long time since you loaded so many.
-Todd
On Thu, Aug 26, 2010 at 11:59 AM, Vidhyashankar Venkataraman
It's possible that the master is slowly assigning out all the daughter
regions, and it's just taking a really long time since you loaded so many.
I forgot to add it the last time.. But I think that's what is happening..
Master getting choked up because of a flash crowd of splits..
(Anyways, I
Check the documentation:
http://hbase.apache.org/docs/r0.20.6/api/org/apache/hadoop/hbase/client/package-summary.html#overview
J-D
On Thu, Aug 26, 2010 at 12:41 PM, Shuja Rehman shujamug...@gmail.com wrote:
Hi All
I am new to hbase client API and want to know how to get data from hbase
from
I'm running map/reduce jobs from java app (table mapper reducer) in true
distributed
mode..I don't see anything in jobtracker page..Map/reduce job runs fine..Am I
missing some config?
thanks
venkatesh
So what's the log in your client side ?
On Thu, Aug 26, 2010 at 6:23 PM, Venkatesh vramanatha...@aol.com wrote:
I'm running map/reduce jobs from java app (table mapper reducer) in true
distributed
mode..I don't see anything in jobtracker page..Map/reduce job runs fine..Am I
missing
Another way,
By Rest
http://wiki.apache.org/hadoop/Hbase/Stargate
Xiujin Yang
Date: Thu, 26 Aug 2010 13:33:00 -0700
Subject: Re: Getting data from Hbase from client/remote computer
From: jdcry...@apache.org
To: user@hbase.apache.org
Check the documentation:
Hi
When I run Hbase performance, I met the same problem.
When job are run on local, it don't show up on job list.
Best
Xiujin Yang.
To: user@hbase.apache.org
Subject: Re: jobtracker.jsp
Date: Thu, 26 Aug 2010 22:30:09 -0400
From: vramanatha...@aol.com
yeah..log says it's running
Hi Martin,
Can you paste your conf?
Have you by any chance upped your handler count a lot? Each handler takes up
an amount of RAM equal to the largest Puts you do. With normal write buffer
sizes, you're looking at around 2MB per handler, so while it sounds nice to
bump the handler count up to a
Looking in RS log I see this:
#
2010-08-26 13:34:11,056 WARN
org.apache.hadoop.hbase.regionserver.HLog: IPC Server handler 36 on
60020 took 148265ms appending an edit to hlog; editcount=2990
#
2010-08-26 13:34:11,056 WARN
org.apache.hadoop.hbase.regionserver.HLog: IPC Server handler 86 on
60020
Thanks J-D
I figured I did n't have mapred-site.xml in my WEB-INF/classes directory
(classpth)
I copied that from the cluster ..that fixed part of it..Now i don't have
zookeper in hadoop-env.sh:HADOOP_CLASSPATH
I distinctly looked at this link a while ago.. it did n't have zookeper listed
23 matches
Mail list logo
