[ https://issues.apache.org/jira/browse/YARN-4322?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15301275#comment-15301275 ]
liyongjia commented on YARN-4322: --------------------------------- I have encountered this problem. > local framwork + io.ReadaheadPool is throwing Failed readahead on ifile > EBADF: Bad file descriptor > -------------------------------------------------------------------------------------------------- > > Key: YARN-4322 > URL: https://issues.apache.org/jira/browse/YARN-4322 > Project: Hadoop YARN > Issue Type: Bug > Affects Versions: 2.7.1 > Environment: Linux 2.6.32.12-0.7-default x86_64 > Reporter: Mohammad Shahid Khan > > run the pi job with 100 map and 2 reduce > io.ReadaheadPool is throwing Failed readahead on ifile EBADF: Bad file > descriptor > stacktrace > {code} > 15/10/30 16:47:23 INFO reduce.MergeManagerImpl: closeInMemoryFile -> > map-output of size: 24, inMemoryMapOutputs.size() -> 89, commitMemory -> > 2112, usedMemory ->2136 > 15/10/30 16:47:23 WARN io.ReadaheadPool: Failed readahead on ifile > EBADF: Bad file descriptor > at org.apache.hadoop.io.nativeio.NativeIO$POSIX.posix_fadvise(Native > Method) > at > org.apache.hadoop.io.nativeio.NativeIO$POSIX.posixFadviseIfPossible(NativeIO.java:267) > at > org.apache.hadoop.io.nativeio.NativeIO$POSIX$CacheManipulator.posixFadviseIfPossible(NativeIO.java:146) > at > org.apache.hadoop.io.ReadaheadPool$ReadaheadRequestImpl.run(ReadaheadPool.java:206) > at > java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142) > at > java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) > at java.lang.Thread.run(Thread.java:745) > 15/10/30 16:47:23 WARN io.ReadaheadPool: Failed readahead on ifile > EBADF: Bad file descriptor > at org.apache.hadoop.io.nativeio.NativeIO$POSIX.posix_fadvise(Native > Method) > at > org.apache.hadoop.io.nativeio.NativeIO$POSIX.posixFadviseIfPossible(NativeIO.java:267) > at > org.apache.hadoop.io.nativeio.NativeIO$POSIX$CacheManipulator.posixFadviseIfPossible(NativeIO.java:146) > at > org.apache.hadoop.io.ReadaheadPool$ReadaheadRequestImpl.run(ReadaheadPool.java:206) > at > java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142) > at > java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) > at java.lang.Thread.run(Thread.java:745) > 15/10/30 16:47:23 INFO reduce.LocalFetcher: localfetcher#1 about to shuffle > output of map attempt_local108678459_0001_m_000086_0 decomp: 24 len: 28 to > MEMORY > {code} -- This message was sent by Atlassian JIRA (v6.3.4#6332) --------------------------------------------------------------------- To unsubscribe, e-mail: yarn-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: yarn-issues-h...@hadoop.apache.org