Re: can we set a table to use a HDFS specific HSM Storage policy?

2018-04-16 Thread Anoop John
When creating table, user can set storage policy on column family. Each of the CF can have different policy. Pls see setStoragePolicy(String) API in HColumnDescriptor. -Anoop- On Tue, Apr 17, 2018 at 7:16 AM, Ming wrote: > Hi, all, > > > > HDFS support HSM, one can set a

HBase scans seem slow, compute bound. How to improve?

2018-04-16 Thread Marcell Ortutay
I'm new to HBase and looking at some performance testing for my use case. I've noticed that HBase scans seem "slow" compared to machine capabilities. Here is a bit more detail on the testing I am running. I have loaded 3 test tables into HBase and sqlite3 for comparison. I'm using sqlite3 as a

can we set a table to use a HDFS specific HSM Storage policy?

2018-04-16 Thread Ming
Hi, all, HDFS support HSM, one can set a file or dir storage policy to use different hardware disks. I am wondering is there a way in HBase, when create a table, specify the policy that that table uses? So that table can be put into SSD, or HDD defined by the storage policy. I read the HBase