Hi,
With HDP-2.1.2 we are encountering the problem of:
2014-09-11 10:14:42,881 ERROR [TezChild]
org.apache.tez.runtime.task.TezTaskRunner: Exception of type Error.
Exiting now
java.lang.UnsatisfiedLinkError:
org.apache.hadoop.util.NativeCodeLoader.buildSupportsSnappy()Z
at org.apache.hadoop.util.NativeCodeLoader.buildSupportsSnappy(Native
Method)
at
org.apache.hadoop.io.compress.SnappyCodec.checkNativeCodeLoaded(SnappyCodec.java:63)
at
org.apache.hadoop.io.compress.SnappyCodec.getCompressorType(SnappyCodec.java:132)
at
org.apache.hadoop.io.compress.CodecPool.getCompressor(CodecPool.java:148)
at
org.apache.hadoop.io.compress.CodecPool.getCompressor(CodecPool.java:163)
at org.apache.hadoop.io.SequenceFile$Writer.init(SequenceFile.java:1198)
at
org.apache.hadoop.io.SequenceFile$Writer.<init>(SequenceFile.java:1091)
at
org.apache.hadoop.io.SequenceFile$BlockCompressWriter.<init>(SequenceFile.java:1441)
at org.apache.hadoop.io.SequenceFile.createWriter(SequenceFile.java:274)
To workaround the problem we have to set the properties explicitly:
tez.am.launch.env
tez.task.launch.env
Is this a problem with HDP installation?
--
Cheers,
*Subroto Sanyal*
