yes ,I use standalone mode,I have set the "spark.io.compression.codec"
with code :
conf.set("spark.io.compression.codec","org.apache.spark.io.LZ4CompressionCodec")
It seems have no influence on function "saveAsSequenceFile" which still
used snappy compression internal. Thanks.
--
View this message in context:
http://apache-spark-user-list.1001560.n3.nabble.com/How-to-avoid-use-snappy-compression-when-saveAsSequenceFile-tp17350p17456.html
Sent from the Apache Spark User List mailing list archive at Nabble.com.
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]