Dear Wiki user, You have subscribed to a wiki page or wiki category on "Hadoop Wiki" for change notification.
The following page has been changed by RyanRawson: http://wiki.apache.org/hadoop/UsingLzoCompression ------------------------------------------------------------------------------ Download/patch the native connector library: * Download/checkout: [http://code.google.com/p/hadoop-gpl-compression/] * Apply the patch attached to this issue: [http://code.google.com/p/hadoop-gpl-compression/issues/detail?id=6] - * On Linux you may need to apply the patch: [http://code.google.com/p/hadoop-gpl-compression/issues/detail?id=5] + * On Linux you may need to apply the patch: [http://code.google.com/p/hadoop-gpl-compression/issues/detail?id=5] - * On Mac you may be interested in: [http://code.google.com/p/hadoop-gpl-compression/issues/detail?id=7] + * On Mac you may be interested in: [http://code.google.com/p/hadoop-gpl-compression/issues/detail?id=7] - ** Also you will probably have to add the line to build.xml just above the call to 'configure' in compile-native: + ** Also you will probably have to add the line to build.xml just above the call to 'configure' in compile-native: <env key="CFLAGS" value="-arch x86_64" /> Build the native connector library: - * ant compile-native + * ant compile-native - * ant jar + * ant jar Now you have the following results: + {{{ build/hadoop-gpl-compression-0.1.0-dev.jar build/native/Linux-amd64-64/lib/libgplcompression.* + }}} You might have Linux-i386-32 or Mac_OS_X-x86_64-64 or whatever platform you are actually using. Copy the results into the hbase lib directory: - * build/hadoop-gpl-compression-0.1.0-dev.jar -> hbase/lib/ + * build/hadoop-gpl-compression-0.1.0-dev.jar -> hbase/lib/ - * build/native/Linux-amd64-64/lib/libgplcompression.* -> hbase/lib/native/Linux-amd-amd64-64/ + * build/native/Linux-amd64-64/lib/libgplcompression.* -> hbase/lib/native/Linux-amd-amd64-64/ Note there is an extra 'lib' level in the build, which is not present in the hbase/lib/native/ tree. == Using Lzo == While creating tables in hbase shell, specify the per-column family compression flag: + {{{ create 'mytable', {NAME=>'colfam:', COMPRESSION=>'lzo'} + }}} That's it!
