[
https://issues.apache.org/jira/browse/TAJO-118?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Jinho Kim updated TAJO-118:
---------------------------
Attachment: TAJO-118_3.patch
Hyunsik,
Thank you for your review.
I have a problem running integration tests on linux(CentOS 6.3).
So, I've changed thread configuration of MiniYARNCluster
Getting following error
{code}
2013-08-12 11:46:00,617 INFO pb.RpcServerFactoryPBImpl
(RpcServerFactoryPBImpl.java:createServer(172)) - Adding protocol
org.apache.hadoop.yarn.api.AMRMProtocolPB to the server
2013-08-12 11:46:00,617 INFO ipc.Server (Server.java:run(782)) - IPC Server
Responder: starting
2013-08-12 11:46:00,617 INFO ipc.Server (Server.java:run(613)) - IPC Server
listener on 55859: starting
2013-08-12 11:46:00,620 ERROR service.CompositeService
(CompositeService.java:start(72)) - Error starting services ResourceManager
java.lang.OutOfMemoryError: unable to create new native thread
at java.lang.Thread.start0(Native Method)
at java.lang.Thread.start(Thread.java:640)
at org.apache.hadoop.ipc.Server.start(Server.java:2045)
at
org.apache.hadoop.yarn.server.resourcemanager.ApplicationMasterService.start(ApplicationMasterService.java:119)
at
org.apache.hadoop.yarn.service.CompositeService.start(CompositeService.java:68)
at
org.apache.hadoop.yarn.server.resourcemanager.ResourceManager.start(ResourceManager.java:567)
at
org.apache.hadoop.yarn.server.MiniYARNCluster$ResourceManagerWrapper$2.run(MiniYARNCluster.java:164)
{code}
{code}
ulimit -a
max user processes (-u) 1024
{code}
For integration test
{code}
//default is 50
conf.setInt(YarnConfiguration.RM_CLIENT_THREAD_COUNT, 2);
conf.setInt(YarnConfiguration.RM_SCHEDULER_CLIENT_THREAD_COUNT, 2);
conf.setInt(YarnConfiguration.RM_RESOURCE_TRACKER_CLIENT_THREAD_COUNT, 2);
conf.setInt(YarnConfiguration.NM_CONTAINER_MGR_THREAD_COUNT, 2);
{code}
> Refactor and Improve text file Scanner
> --------------------------------------
>
> Key: TAJO-118
> URL: https://issues.apache.org/jira/browse/TAJO-118
> Project: Tajo
> Issue Type: Improvement
> Components: storage
> Reporter: Jinho Kim
> Assignee: Jinho Kim
> Fix For: 0.2-incubating
>
> Attachments: TAJO-118_2.patch, TAJO-118_3.patch, TAJO-118.patch
>
>
> This will be reduce the execution time
> * Implement column projection
> * Change the split function to the apache StringUtils
> * Improve slow codes
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
