[
https://issues.apache.org/jira/browse/MAPREDUCE-7083?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16442349#comment-16442349
]
Feng Yuan edited comment on MAPREDUCE-7083 at 4/20/18 10:55 AM:
----------------------------------------------------------------
[~tlipcon][~clockfly] [~owen.omalley]
Please have a look at this.
was (Author: feng yuan):
[~tlipcon][~clockfly]
Please have a look at this.
> Map native output collector hang on NativeBatchProcess.nativeFinsh
> ------------------------------------------------------------------
>
> Key: MAPREDUCE-7083
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-7083
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: nativetask
> Affects Versions: 3.0.0-alpha1
> Reporter: Feng Yuan
> Priority: Major
> Attachments: 4910BB94-7966-4BFB-B2EC-66FE42768F3A.png,
> 734822C1-F4CB-4B37-8F43-C598CB18F52D.png, js_1, js_native_1
>
>
> I run the benchmark test demo terasort app.
> Input size 100G and block size is 1g, so all is 100 files. One file have
> only one split.
> terasort have 100 map, this mean every map process 1g data
> everyone's jvm setting is:
> {code:java}
> -Xmx2048m -Xms2048m -Xmn256m -XX:MaxDirectMemorySize=128m -XX:SurvivorRatio=6
> -XX:MaxPermSize=128m -XX:ParallelGCThreads=10
> io.sort.mb is 512mb
> {code}
> This is Java stack
> [^js_1]
> This is native stack
> [^js_native_1]
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
