The log you pasted was for taking snapshot.
Do you have log from ExportSnapshot ?
bq. What is the difference between below two commands?
This is the code that determines output FileSystem:
FileSystem outputFs = FileSystem.get(outputRoot.toUri(), conf);
For 'file:///tmp/hbase_backup' argument, outputFs would be an instance of
org.apache.hadoop.fs.LocalFileSystem.
Cheers
On Mon, Dec 2, 2013 at 9:06 PM, oc tsdb <[email protected]> wrote:
> We see same logs for both options
>
> 013-12-02 09:47:41,311 INFO
> org.apache.hadoop.hbase.master.snapshot.TakeSnapshotHandler: Running FLUSH
> table snapshot tsdb_snap_backup C_M_SNAPSHOT_TABLE on table tsdb
> 2013-12-02 09:47:41,312 INFO org.apache.hadoop.hbase.util.FSUtils:
> FileSystem doesn't support getDefaultReplication
> 2013-12-02 09:47:41,312 INFO org.apache.hadoop.hbase.util.FSUtils:
> FileSystem doesn't support getDefaultBlockSize
> 2013-12-02 09:47:41,337 INFO org.apache.hadoop.hbase.procedure.Procedure:
> Starting procedure 'tsdb_snap_backup'
> 2013-12-02 09:47:41,724 INFO org.apache.hadoop.hbase.procedure.Procedure:
> Procedure 'tsdb_snap_backup' execution completed
> 2013-12-02 09:47:41,724 INFO
> org.apache.hadoop.hbase.procedure.ZKProcedureUtil: Clearing all znodes for
> procedure tsdb_snap_backupincluding nodes /hbase/online-snapshot/acquired
> /hbase/online-snapshot/reached /hbase/online-snapshot/abort
> 2013-12-02 09:47:41,730 INFO
> org.apache.hadoop.hbase.master.snapshot.EnabledTableSnapshotHandler: Done
> waiting - snapshot for tsdb_snap_backup finished!
>
> It seems we can't export complete snapshot data directly to local file
> system using 'ExportSnapshot' command.
> If we want to copy to outside of cluster first we need to export it to hdfs
> and then use hadoop get command to copy to local file system.
> Is this correct?
>
> What is the difference between below two commands?
> hbase org.apache.hadoop.hbase.snapshot.ExportSnapshot -snapshot
> hbase_tbl_snapshot_name -copy-to file:///tmp/hbase_backup -mappers 16;
>
> hbase org.apache.hadoop.hbase.snapshot.ExportSnapshot -snapshot
> hbase_tbl_snapshot_name -copy-to hdfs:/hbase_backup -mappers 16;
>
> Thanks
> -OC
>
>
>
> On Mon, Dec 2, 2013 at 10:56 PM, Ted Yu <[email protected]> wrote:
>
> > Can you pastebin master log during operation #2 ?
> >
> > There have been at least two fixes since 0.94.10, listed below.
> > It would be nice if you can verify this behavior using 0.94.14
> >
> > Cheers
> >
> > r1515967 | mbertozzi | 2013-08-20 13:49:38 -0700 (Tue, 20 Aug 2013) | 1
> > line
> >
> > HBASE-8760 possible loss of data in snapshot taken after region split
> > ------------------------------------------------------------------------
> > r1507792 | mbertozzi | 2013-07-28 05:17:39 -0700 (Sun, 28 Jul 2013) | 1
> > line
> >
> > HBASE-9060 ExportSnapshot job fails if target path contains percentage
> > character (Jerry He)
> >
> >
> > On Mon, Dec 2, 2013 at 9:19 AM, oc tsdb <[email protected]> wrote:
> >
> > > Hi,
> > >
> > > We have cluster with 4 data nodes and HBase version is 0.94.10.
> > >
> > > We have created snapshot for all hbase tables and trying to export
> > snapshot
> > > in two ways.
> > >
> > > option 1.Export snapshot into same cluster hdfs
> > >
> > > hbase org.apache.hadoop.hbase.snapshot.ExportSnapshot -snapshot
> > > hbase_tbl_snapshot_name -copy-to *hdfs:/hbase_backup *-mappers 16;
> > >
> > > Here we are getting full data ( .archive + .hbase-snapshot) exported to
> > > hdfs:/hbase_backup
> > >
> > > option 2.Export snapshot to local filesystem
> > > command :
> > > hbase org.apache.hadoop.hbase.snapshot.ExportSnapshot -snapshot
> > > hbase_tbl_snapshot_name -copy-to *file:///tmp/hbase_backup* -mappers
> > 16;
> > >
> > > But with option 2 we only getting .hbase-snapshot exported to local dir
> > > (/tmp/hbase_backup) but .archive files are not exported.It is expected
> > > behavior or something wrong in option 2.
> > >
> > > Thanks
> > > OC
> > >
> >
>
