as tested, it seems that the HIVE table will use lzo compression, and the cube table in HBase does't apply lzo compression
2015-03-26 13:03 GMT+08:00 dong wang <[email protected]>: > i c, what's more, if I configure the ALL the compression properties in > core-site.xml and mapred-site.xml, is it still neccessary for me to do the > change like "export > KYLIN_LD_LIBRARY_PATH=::/usr/lib/hadoop/lib/native/Linux-amd64-64:/usr/lib/hadoop/lib/native" > if I want to use the compression feature? > > 2015-03-25 21:17 GMT+08:00 hongbin ma <[email protected]>: > >> Usually it's not necessary to change hbase's configuration. >> >> However, we do have a place(*conf/kylin_job_conf.xml*) for users to modify >> MR jobs' configuration. One example would be adding lzo compression to >> Mappers' and Reducers' outputs. *This will reduce the final cube size a >> lot*. >> Take a look at >> >> https://github.com/KylinOLAP/Kylin/blob/master/docs/Operations/Advanced%20settings%20of%20Kylin%20environment.md >> for how to. >> >> In a word, as your data size grows, if your cube building is taking >> significant time or space, you'd better start to think about optimizing by >> adding parameters in kylin_job_conf.xml >> >> On Wed, Mar 25, 2015 at 5:33 PM, dong wang <[email protected]> >> wrote: >> >> > Is it necessary for user to do some configuration for hbase-site.xml >> when >> > deploy KYLIN? >> > >> >> >> >> -- >> Regards, >> >> *Bin Mahone | 马洪宾* >> Apache Kylin: http://kylin.io >> Github: https://github.com/binmahone >> > >
