Hi Folks,
A coworker of mine recently setup a new CDH3 cluster with 4 machines (3
data nodes, one namenode that doubles as a jobtracker). I started
looking through it using "hadoop fs -ls," and that went fine with
everything displaying alright. Next, I decided to test out some simple
pig jobs. Each of these worked fine on my development pseudo cluster,
but failed on the new CDH3 cluster with the exact same erro:
*java.lang.IllegalArgumentException: Compression codec
org.apache.hadoop.io.compress.DeflateCodec not found.
*
This also only happened when trying to process .gz files, and it
happened even when I just tried to load and dump one. I figured this
could be a problem with compression configs being manually overwritten
in core-site.xml, but that file didn't have any mention of compressions
on any of the boxes in the CDH3 cluster. I looked at each box
individually, and all the proper jars seem to be there, so now I'm at a
bit of a loss. Any ideas what the problem could be?
Eli