Re: can we set a table to use a HDFS specific HSM Storage policy?

2018-04-21 Thread Yu Li
(Belated) All HSM related work has been backported into branch-1 through HBASE-19858, but not released yet (should be included in 1.5.0). Notice that the current commit breaks compatibility with hadoop 2.4/2.5 (the reason that the jira is reopened), so if you are on hadoop 2.6+ and need HSM

RE: can we set a table to use a HDFS specific HSM Storage policy?

2018-04-17 Thread Ming
Thank you Anoop for the answer, this is very helpful. Ming -Original Message- From: Anoop John Sent: Wednesday, April 18, 2018 12:50 AM To: user@hbase.apache.org Subject: Re: can we set a table to use a HDFS specific HSM Storage policy? Oh ya seems yes.. I was

Re: can we set a table to use a HDFS specific HSM Storage policy?

2018-04-17 Thread Anoop John
Oh ya seems yes.. I was under the impression that it is there in 1.x. Some HBase users use it. Might be, they back ported it. -Anoop- On Tue, Apr 17, 2018 at 5:38 PM, Ming wrote: > > Hi, Anoop, > > In which release this API is supported? From the JIRA >

RE: can we set a table to use a HDFS specific HSM Storage policy?

2018-04-17 Thread Ming
Hi, Anoop, In which release this API is supported? From the JIRA https://issues.apache.org/jira/browse/HBASE-14061, it seems this is only available in HBase 2.0? Thanks, Ming -Original Message- From: Anoop John Sent: Tuesday, April 17, 2018 1:42 PM To:

RE: can we set a table to use a HDFS specific HSM Storage policy?

2018-04-17 Thread Ming
Thank you Anoop! -Original Message- From: Anoop John Sent: Tuesday, April 17, 2018 1:42 PM To: user@hbase.apache.org Subject: Re: can we set a table to use a HDFS specific HSM Storage policy? When creating table, user can set storage policy on column family.

Re: can we set a table to use a HDFS specific HSM Storage policy?

2018-04-16 Thread Anoop John
When creating table, user can set storage policy on column family. Each of the CF can have different policy. Pls see setStoragePolicy(String) API in HColumnDescriptor. -Anoop- On Tue, Apr 17, 2018 at 7:16 AM, Ming wrote: > Hi, all, > > > > HDFS support HSM, one can set a

can we set a table to use a HDFS specific HSM Storage policy?

2018-04-16 Thread Ming
Hi, all, HDFS support HSM, one can set a file or dir storage policy to use different hardware disks. I am wondering is there a way in HBase, when create a table, specify the policy that that table uses? So that table can be put into SSD, or HDD defined by the storage policy. I read the HBase