Github user MaxGekk commented on a diff in the pull request:
https://github.com/apache/spark/pull/21837#discussion_r204252552
--- Diff:
external/avro/src/main/scala/org/apache/spark/sql/avro/AvroFileFormat.scala ---
@@ -133,8 +134,7 @@ private[avro] class AvroFileFormat extends FileFormat
with DataSourceRegister {
job.getConfiguration.set(AvroJob.CONF_OUTPUT_CODEC,
DataFileConstants.SNAPPY_CODEC)
case "deflate" =>
- val deflateLevel = spark.conf.get(
- AVRO_DEFLATE_LEVEL, Deflater.DEFAULT_COMPRESSION.toString).toInt
--- End diff --
I changed it because I didn't have any ideas what `-1` means. Is it closer
to best compression `9` or fast compression `1`? Probably the level is
eventually set in `zlib` in which `-1` means `6`. @gengliangwang From your
point of view, `-1` means better or faster compression?
---
---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org
