Another solution worked, too. As suggested by http://code.google.com/p/hadoop-gpl-compression/issues/detail?id=23, we added the path "/usr/local/lib" into " /etc/ld.so.conf" and the LZO native library could be found since then :)
Xueling On Mon, Dec 21, 2009 at 9:32 AM, Edward Capriolo <edlinuxg...@gmail.com>wrote: > The entire /usr/lib rather than /usr/lib64 is mostly to blame on > distributions, RedHat took to the idea of putting 64 bit libraries in > /usr/lib64. I think the rational was a 32bit RPM and 64 bit RPM could > be installed to the same machine. > > Others argue that /usr/lib should be the libs for YOUR os. > > Some distro's are implemented > > /usr/lib should be 64 bit > /usr/lib-32-compat (or some other name) should be 32 bit > > This can confuse some processes when trying to take packages from other > distros. > > > On Mon, Dec 21, 2009 at 12:20 PM, Xueling Shu <x...@systemsbiology.org> > wrote: > > Thank you, Sammy. > > > > Xueling > > > > On Sun, Dec 20, 2009 at 11:09 PM, Sammy Yu <s...@brightedge.com> wrote: > > > >> Hi, > >> I ran into a similar issue recently. It was due to the fact that 64 > bit > >> lzo libraries were being installed in /usr/lib rather than /usr/lib64. > >> Even > >> though when I ran a standalone java application to load up the lzo > library > >> it could see it in /usr/lib, however when hadoop/hbase was running it > >> wouldn't take. Just copy the liblzo files over and make > >> the appropriate links. > >> > >> Hope this helps, > >> Sammy > >> > >> > >> > >> On Sat, Dec 19, 2009 at 10:06 AM, Xueling Shu <x...@systemsbiology.org > >> >wrote: > >> > >> > Thanks, Andrew: > >> > > >> > I will try that. > >> > > >> > Xueling > >> > > >> > On Fri, Dec 18, 2009 at 6:39 PM, Andrew Purtell <apurt...@apache.org> > >> > wrote: > >> > > >> > > Possibly I can make this easy for you. > >> > > > >> > > If you are using Hadoop 0.20.0 and HBase 0.20.x, just download this > >> file: > >> > > > >> > > wget -nv -O /tmp/lzo-linux-0.20.1.tar.gz \ > >> > > http://iridiant.s3.amazonaws.com/hbase/lzo-linux-0.20.1.tar.gz > >> > > > >> > > and extract it into HBase for LZO support for HBase: > >> > > > >> > > cd /path/to/hbase > >> > > tar xzf /tmp/lzo-linux-0.20.1.tar.gz > >> > > > >> > > and optionally also into your Hadoop library for LZO support for > >> > mapreduce: > >> > > > >> > > cd /path/to/hadoop > >> > > tar xzf /tmp/lzo-linux-0.20.1.tar.gz > >> > > > >> > > - Andy > >> > > > >> > > > >> > > ----- Original Message ---- > >> > > > From: Xueling Shu <x...@systemsbiology.org> > >> > > > To: hbase-user@hadoop.apache.org > >> > > > Sent: Fri, December 18, 2009 6:32:30 PM > >> > > > Subject: LZO Link problem > >> > > > > >> > > > Out system admin followed the instruction at > >> > > > http://wiki.apache.org/hadoop/UsingLzoCompression. But I still > got > >> the > >> > > > following error when HBase tried to flush the data: > >> > > > > >> > > > com.hadoop.compression.lzo.LzoCompressor: > >> > java.lang.UnsatisfiedLinkError: > >> > > > Cannot load liblzo2.so.2 (liblzo2.so.2: cannot open shared object > >> file: > >> > > No > >> > > > such file or directory)! > >> > > > ERROR com.hadoop.compression.lzo.LzoCodec: Failed to > load/initialize > >> > > > native-lzo library > >> > > > > >> > > > I am wondering if the libraries need to be installed into a > >> particular > >> > > > directory? Currently they are sitting at /usr/local/lib. > >> > > > > >> > > > Thanks, > >> > > > Xueling > >> > > > >> > > > >> > > > >> > > > >> > > > >> > > > >> > > >> > > >
