Hi Subroto, It could be an installer/distro issue. You may need to redirect your question to the Hortonworks forums to get an answer on this.
But yes, you are right - the env needs to be setup correctly to load the required native libs. Out of curiosity, are you using Ambari to setup your cluster? thanks — Hitesh On Nov 17, 2014, at 11:07 AM, Subroto Sanyal <[email protected]> wrote: > Hi, > > With HDP-2.1.2 we are encountering the problem of: > 2014-09-11 10:14:42,881 ERROR [TezChild] > org.apache.tez.runtime.task.TezTaskRunner: Exception of type Error. Exiting > now > java.lang.UnsatisfiedLinkError: > org.apache.hadoop.util.NativeCodeLoader.buildSupportsSnappy()Z > at org.apache.hadoop.util.NativeCodeLoader.buildSupportsSnappy(Native > Method) > at > org.apache.hadoop.io.compress.SnappyCodec.checkNativeCodeLoaded(SnappyCodec.java:63) > at > org.apache.hadoop.io.compress.SnappyCodec.getCompressorType(SnappyCodec.java:132) > at > org.apache.hadoop.io.compress.CodecPool.getCompressor(CodecPool.java:148) > at > org.apache.hadoop.io.compress.CodecPool.getCompressor(CodecPool.java:163) > at > org.apache.hadoop.io.SequenceFile$Writer.init(SequenceFile.java:1198) > at > org.apache.hadoop.io.SequenceFile$Writer.<init>(SequenceFile.java:1091) > at > org.apache.hadoop.io.SequenceFile$BlockCompressWriter.<init>(SequenceFile.java:1441) > at > org.apache.hadoop.io.SequenceFile.createWriter(SequenceFile.java:274) > > > > To workaround the problem we have to set the properties explicitly: > tez.am.launch.env > > tez.task.launch.env > > > > Is this a problem with HDP installation? > > -- > Cheers, > Subroto Sanyal
