[
https://issues.apache.org/jira/browse/MAPREDUCE-7392?focusedWorklogId=784120&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-784120
]
ASF GitHub Bot logged work on MAPREDUCE-7392:
---------------------------------------------
Author: ASF GitHub Bot
Created on: 23/Jun/22 10:32
Start Date: 23/Jun/22 10:32
Worklog Time Spent: 10m
Work Description: cfg1234 opened a new pull request, #4494:
URL: https://github.com/apache/hadoop/pull/4494
I found that inflateReset is not called after inflate return
Z_STREAM_END.When Z_STREAM_END is returned after an inflate() method is
called,the next inflate() call does not consume any input data and dost not
produce any output data,thus the loop cannot exit(This bug is trigged by some
special compressed data).So I fix the problem.
Issue Time Tracking
-------------------
Worklog Id: (was: 784120)
Remaining Estimate: 0h
Time Spent: 10m
> bug for GzipCodec in native task
> --------------------------------
>
> Key: MAPREDUCE-7392
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-7392
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: nativetask
> Affects Versions: 3.1.1
> Reporter: chenfengge
> Priority: Major
> Time Spent: 10m
> Remaining Estimate: 0h
>
> perpare data command:
> yarn jar
> /usr/local/hadoop/share/hadoop/mapreduce/hadoop-mapreduce-examples-3.1.1.jar
> teragen -D mapreduce.job.maps=722 -D mapreduce.job.reduces=500 11000000000
> /testinput
> test command:
> yarn jar
> /usr/local/hadoop/share/hadoop/mapreduce/hadoop-mapreduce-examples-3.1.1.jar
> terasort -Dmapreduce.map.output.compress=true
> -Dmapreduce.map.output.compress.codec=org.apache.hadoop.io.compress.GzipCodec
> -Dmapreduce.job.map.output.collector.class=org.apache.hadoop.mapred.nativetask.NativeMapOutputCollectorDelegator
> -D mapreduce.job.reduces=500 /testinput /testoutput
> test will blocked.
>
--
This message was sent by Atlassian Jira
(v8.20.7#820007)
---------------------------------------------------------------------
To unsubscribe, e-mail: mapreduce-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: mapreduce-issues-h...@hadoop.apache.org
