Can you try to flush you table from the shell and see how long it takes? Don't test in prod of course ;) Le 2015-05-08 11:40, "rahul malviya" <[email protected]> a écrit :
> We have 16000 regions with approx 70 regions per regionserver. > > Thanks, > Rahul > > On Fri, May 8, 2015 at 11:25 AM, Jean-Marc Spaggiari < > [email protected]> wrote: > > > How many regions do you have on this table, how many RS and how many > > regions per RS? > > > > JM > > > > 2015-05-08 14:21 GMT-04:00 Rahul Malviya <[email protected]>: > > > > > Hi, > > > > > > I want to run MR job on snapshot of large HBase table but I am getting > > > timeout errors while doing so. Can you tell me what I am doing wrong ? > > > > > > I am using hbase-0.98.6-cdh5.2.0. > > > > > > hbase-site.xml > > > <property> > > > <name>hbase.snapshot.master.timeoutMillis</name> > > > <value>1800000</value> > > > </property> > > > <property> > > > <name>hbase.snapshot.region.timeout</name> > > > <value>1800000</value> > > > </property> > > > <property> > > > <name>hbase.snapshot.enabled</name> > > > <value>true</value> > > > </property> > > > > > > Error : > > > $ hbase shell > > > HBase Shell; enter 'help<RETURN>' for list of supported commands. > > > Type "exit<RETURN>" to leave the HBase Shell > > > Version 0.98.6-cdh5.2.0, rUnknown, Sat Oct 11 15:14:25 PDT 2014 > > > > > > hbase(main):001:0> snapshot ’table','snapshot_test' > > > SLF4J: Class path contains multiple SLF4J bindings. > > > SLF4J: Found binding in > > > > > > [jar:file:/ngs/app/awdp/RELEASE-5.2/hbase-0.98.6-cdh5.2.0/lib/slf4j-log4j12-1.7.5.jar!/org/slf4j/impl/StaticLoggerBinder.class] > > > SLF4J: Found binding in > > > > > > [jar:file:/ngs/app/awdp/RELEASE-5.2/hadoop-2.5.0-cdh5.2.0/share/hadoop/mapreduce1/lib/slf4j-log4j12-1.7.5.jar!/org/slf4j/impl/StaticLoggerBinder.class] > > > SLF4J: Found binding in > > > > > > [jar:file:/ngs/app/awdp/RELEASE-5.2/hadoop-2.5.0-cdh5.2.0/share/hadoop/common/lib/slf4j-log4j12-1.7.5.jar!/org/slf4j/impl/StaticLoggerBinder.class] > > > SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings < > > > http://www.slf4j.org/codes.html#multiple_bindings> for an explanation. > > > SLF4J: Actual binding is of type [org.slf4j.impl.Log4jLoggerFactory] > > > > > > ERROR: Snapshot 'snapshot_test' wasn't completed in expectedTime:60000 > ms > > > > > > Here is some help for this command: > > > Take a snapshot of specified table. Examples: > > > > > > hbase> snapshot 'sourceTable', 'snapshotName' > > > hbase> snapshot 'namespace:sourceTable', 'snapshotName', {SKIP_FLUSH > => > > > true} > > > > > > > > > hbase(main):002:0> > > > > > > Thanks, > > > Rahul > > >
