[ https://issues.apache.org/jira/browse/HADOOP-15196?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17380549#comment-17380549 ]
Srinivasu Majeti commented on HADOOP-15196: ------------------------------------------- Hi [~brahmareddy], Are you going to get this code changes into production ? Or is there another fix for this situation. We might need to add another condition for message before ignoring trailing garbage. {code:java} message.contains("incorrect header check") along with message.contains("unknown compression method") {code} > Zlib decompression fails when file having trailing garbage > ---------------------------------------------------------- > > Key: HADOOP-15196 > URL: https://issues.apache.org/jira/browse/HADOOP-15196 > Project: Hadoop Common > Issue Type: Bug > Affects Versions: 2.7.0 > Reporter: Brahma Reddy Battula > Assignee: Brahma Reddy Battula > Priority: Major > Attachments: HADOOP-15196.patch > > > *When file has trailing garbage gzip will ignore.* > {noformat} > gzip -d 2018011309-js.rishenglipin.com.gz > gzip: 2018011309-js.rishenglipin.com.gz: decompression OK, trailing garbage > ignored > {noformat} > *when we use same file and decompress,we got following.* > {noformat} > 2018-01-13 14:23:43,151 | WARN | task-result-getter-3 | Lost task 0.0 in > stage 345.0 (TID 5686, node-core-gyVYT, executor 3): java.io.IOException: > unknown compression method > at > org.apache.hadoop.io.compress.zlib.ZlibDecompressor.inflateBytesDirect(Native > Method) > at > org.apache.hadoop.io.compress.zlib.ZlibDecompressor.decompress(ZlibDecompressor.java:225) > at > org.apache.hadoop.io.compress.DecompressorStream.decompress(DecompressorStream.java:91) > at > org.apache.hadoop.io.compress.DecompressorStream.read(DecompressorStream.java:85) > {noformat} -- This message was sent by Atlassian Jira (v8.3.4#803005) --------------------------------------------------------------------- To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: common-issues-h...@hadoop.apache.org