Hi HBase Team

Image can see here :

  *   Export with single regionserver: https://imgur.com/86wSUMV
  *   Export with two regionservers: https://imgur.com/a/XMovlZx

Log show about time was:

root@solaltiplano-track4-master:~/hbase-exporting/latest# cat 
hbase_export_compress_default.log | grep export
Starting hbase export at Fri Jun 11 12:22:46 UTC 2021
tsdb table exported in  6279 seconds
tsdb-meta table exported in  6 seconds
tsdb-tree table exported in  7 seconds
tsdb-uid table exported in  90 seconds
Ending hbase export at Fri Jun 11 14:09:08 UTC 2021


  *

Thanks,
Tai


________________________________
From: Mathews, Jacob 1. (Nokia - IN/Bangalore) <jacob.1.math...@nokia.com>
Sent: Monday, August 16, 2021 6:47 PM
To: Nguyen, Tai Van (EXT - VN) <tai_van.nguyen....@nokia.com>
Subject: FW: Hbase export is very slow - help needed






From: Mathews, Jacob 1. (Nokia - IN/Bangalore)
Sent: Friday, August 6, 2021 12:38 PM
To: user@hbase.apache.org
Subject: Hbase export is very slow - help needed



Hi HBase team,



We are trying to use Hbase export mentioned here: 
http://hbase.apache.org/book.html#export

But it is happening sequentially row by row as seen from the logs.

we tried many options of the Hbase export, but all were taking long time.



Backup folder contents size:



bash-4.2$ du -kh

16K         ./tsdb-tree

16K         ./tsdb-meta

60M       ./tsdb-uid

5.9G       ./tsdb

6.0G       .



took around 104 minutes for 6gb compressed data.



Is there a way we can parallelise this and improve the export time.



Below are the charts from Hbase .



Export with single regionserver:



[cid:image001.jpg@01D78ABF.E9E6C280]



Export with two regionservers:



[cid:image002.jpg@01D78ABF.E9E6C280]



Scaling the HBase Region server also did not help, the export still happens 
sequentially.



Thanks

Jacob Mathews

Reply via email to