We see same logs for both options 013-12-02 09:47:41,311 INFO org.apache.hadoop.hbase.master.snapshot.TakeSnapshotHandler: Running FLUSH table snapshot tsdb_snap_backup C_M_SNAPSHOT_TABLE on table tsdb 2013-12-02 09:47:41,312 INFO org.apache.hadoop.hbase.util.FSUtils: FileSystem doesn't support getDefaultReplication 2013-12-02 09:47:41,312 INFO org.apache.hadoop.hbase.util.FSUtils: FileSystem doesn't support getDefaultBlockSize 2013-12-02 09:47:41,337 INFO org.apache.hadoop.hbase.procedure.Procedure: Starting procedure 'tsdb_snap_backup' 2013-12-02 09:47:41,724 INFO org.apache.hadoop.hbase.procedure.Procedure: Procedure 'tsdb_snap_backup' execution completed 2013-12-02 09:47:41,724 INFO org.apache.hadoop.hbase.procedure.ZKProcedureUtil: Clearing all znodes for procedure tsdb_snap_backupincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2013-12-02 09:47:41,730 INFO org.apache.hadoop.hbase.master.snapshot.EnabledTableSnapshotHandler: Done waiting - snapshot for tsdb_snap_backup finished!
It seems we can't export complete snapshot data directly to local file system using 'ExportSnapshot' command. If we want to copy to outside of cluster first we need to export it to hdfs and then use hadoop get command to copy to local file system. Is this correct? What is the difference between below two commands? hbase org.apache.hadoop.hbase.snapshot.ExportSnapshot -snapshot hbase_tbl_snapshot_name -copy-to file:///tmp/hbase_backup -mappers 16; hbase org.apache.hadoop.hbase.snapshot.ExportSnapshot -snapshot hbase_tbl_snapshot_name -copy-to hdfs:/hbase_backup -mappers 16; Thanks -OC On Mon, Dec 2, 2013 at 10:56 PM, Ted Yu <[email protected]> wrote: > Can you pastebin master log during operation #2 ? > > There have been at least two fixes since 0.94.10, listed below. > It would be nice if you can verify this behavior using 0.94.14 > > Cheers > > r1515967 | mbertozzi | 2013-08-20 13:49:38 -0700 (Tue, 20 Aug 2013) | 1 > line > > HBASE-8760 possible loss of data in snapshot taken after region split > ------------------------------------------------------------------------ > r1507792 | mbertozzi | 2013-07-28 05:17:39 -0700 (Sun, 28 Jul 2013) | 1 > line > > HBASE-9060 ExportSnapshot job fails if target path contains percentage > character (Jerry He) > > > On Mon, Dec 2, 2013 at 9:19 AM, oc tsdb <[email protected]> wrote: > > > Hi, > > > > We have cluster with 4 data nodes and HBase version is 0.94.10. > > > > We have created snapshot for all hbase tables and trying to export > snapshot > > in two ways. > > > > option 1.Export snapshot into same cluster hdfs > > > > hbase org.apache.hadoop.hbase.snapshot.ExportSnapshot -snapshot > > hbase_tbl_snapshot_name -copy-to *hdfs:/hbase_backup *-mappers 16; > > > > Here we are getting full data ( .archive + .hbase-snapshot) exported to > > hdfs:/hbase_backup > > > > option 2.Export snapshot to local filesystem > > command : > > hbase org.apache.hadoop.hbase.snapshot.ExportSnapshot -snapshot > > hbase_tbl_snapshot_name -copy-to *file:///tmp/hbase_backup* -mappers > 16; > > > > But with option 2 we only getting .hbase-snapshot exported to local dir > > (/tmp/hbase_backup) but .archive files are not exported.It is expected > > behavior or something wrong in option 2. > > > > Thanks > > OC > > >
