Keuntae Park created TAJO-678:
---------------------------------
Summary: Too many open files error
Key: TAJO-678
URL: https://issues.apache.org/jira/browse/TAJO-678
Project: Tajo
Issue Type: Bug
Reporter: Keuntae Park
During the fetch phase, too many open file exception occurred.
{noformat}
2014-03-07 15:15:03,346 INFO worker.Task (Task.java:<init>(195)) - Table Id:
eb_1394170620737_0001_000001, url:
http://skt-rf-55:44134/?qid=q_1394170620737_0001&sid=1&p=428&type=h&ta=2690_0
148566 2014-03-07 15:15:03,346 INFO worker.Task (Task.java:<init>(195)) -
Table Id: eb_1394170620737_0001_000001, url:
http://skt-rf-82:37300/?qid=q_1394170620737_0001&sid=1&p=154&type=h&ta=1149_0,2679_0,2455_0
148567 2014-03-07 15:15:03,346 INFO worker.Task (Task.java:<init>(197)) - *
Local task dir: file:/data1/tajo/tajo-localdir/q_1394170620737_0001/output/2/0_1
148568 2014-03-07 15:15:03,346 INFO worker.Task (Task.java:<init>(202)) -
==================================
148569 2014-03-07 15:15:03,362 INFO worker.Task (Task.java:init(218)) - the
directory is created
file:/data3/tajo/tajo-localdir/q_1394170620737_0001/in/eb_1394170620737_0001_000002/0/1/eb_1394170620737_0001_000001
148570 2014-03-07 15:15:03,365 ERROR worker.TaskRunner
(TaskRunner.java:run(397)) - Failed to create a selector.
148571 org.jboss.netty.channel.ChannelException: Failed to create a selector.
148572 at
org.jboss.netty.channel.socket.nio.AbstractNioSelector.openSelector(AbstractNioSelector.java:337)
148573 at
org.jboss.netty.channel.socket.nio.AbstractNioSelector.<init>(AbstractNioSelector.java:95)
148574 at
org.jboss.netty.channel.socket.nio.NioClientBoss.<init>(NioClientBoss.java:63)
148575 at
org.jboss.netty.channel.socket.nio.NioClientBossPool.newBoss(NioClientBossPool.java:61)
148576 at
org.jboss.netty.channel.socket.nio.NioClientBossPool.newBoss(NioClientBossPool.java:27)
148577 at
org.jboss.netty.channel.socket.nio.AbstractNioBossPool.init(AbstractNioBossPool.java:65)
148578 at
org.jboss.netty.channel.socket.nio.NioClientBossPool.<init>(NioClientBossPool.java:45)
148579 at
org.apache.tajo.rpc.RpcChannelFactory.createClientChannelFactory(RpcChannelFactory.java:69)
148580 at org.apache.tajo.worker.Task.getFetchRunners(Task.java:626)
148581 at org.apache.tajo.worker.Task.localize(Task.java:236)
148582 at org.apache.tajo.worker.Task.init(Task.java:224)
148583 at org.apache.tajo.worker.TaskRunner$1.run(TaskRunner.java:390)
148584 at java.lang.Thread.run(Thread.java:662)
148585 Caused by: java.io.IOException: Too many open files
148586 at sun.nio.ch.IOUtil.initPipe(Native Method)
148587 at sun.nio.ch.EPollSelectorImpl.<init>(EPollSelectorImpl.java:49)
148588 at
sun.nio.ch.EPollSelectorProvider.openSelector(EPollSelectorProvider.java:18)
148589 at java.nio.channels.Selector.open(Selector.java:209)
148590 at
org.jboss.netty.channel.socket.nio.AbstractNioSelector.openSelector(AbstractNioSelector.java:335)
148591 ... 12 more
148592 2014-03-07 15:15:03,366 INFO worker.TaskRunner
(TaskRunner.java:run(336)) - Request GetTask:
eb_1394170620737_0001_000002,container_1394170620737_0001_01_000780
148593 2014-03-07 15:15:03,580 INFO worker.TaskRunner
(TaskRunner.java:run(374)) - Accumulated Received Task: 3
148594 2014-03-07 15:15:03,580 INFO worker.TaskRunner
(TaskRunner.java:run(383)) - Initializing:
ta_1394170620737_0001_000002_000000_02
148595 2014-03-07 15:15:03,583 INFO worker.Task (Task.java:<init>(182)) -
Output File Path:
hdfs://nameservice1/tmp/tajo-tajo/staging/q_1394170620737_0001/RESULT/part-02-000000
148596 2014-03-07 15:15:03,583 INFO worker.TaskAttemptContext
(TaskAttemptContext.java:setState(110)) - Query status of
ta_1394170620737_0001_000002_000000_02 is changed to TA_PENDING
{noformat}
--
This message was sent by Atlassian JIRA
(v6.2#6252)
