[
https://issues.apache.org/jira/browse/PHOENIX-2690?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15151996#comment-15151996
]
James Taylor commented on PHOENIX-2690:
---------------------------------------
[~mujtabachohan] - are all clients running in the same JVM? Can you try dialing
down the phoenix.query.threadPoolSize if need be? You'd end up just having more
queueing of these smaller scans in that case. How's the CPU look?
> Exceeding OS limit for native threads with large number of guide posts
> ----------------------------------------------------------------------
>
> Key: PHOENIX-2690
> URL: https://issues.apache.org/jira/browse/PHOENIX-2690
> Project: Phoenix
> Issue Type: Bug
> Affects Versions: 4.7.0
> Reporter: Mujtaba Chohan
> Priority: Minor
>
> With >32K guidepost count for a table (which equates to a 320 GB table size
> with 10MB guidepost width), following OOM occurs on 64bit Linux client
> {code}
> select * from table_with_32k_guideposts limit 1000;
> java.lang.OutOfMemoryError: unable to create new native thread
> at java.lang.Thread.start0(Native Method)
> at java.lang.Thread.start(Thread.java:714)
> at
> java.util.concurrent.ThreadPoolExecutor.addWorker(ThreadPoolExecutor.java:949)
> at
> java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1360)
> at
> org.apache.phoenix.job.JobManager$InstrumentedThreadPoolExecutor.execute(JobManager.java:261)
> at
> java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:132)
> at
> org.apache.phoenix.iterate.ParallelIterators.submitWork(ParallelIterators.java:103)
> at
> org.apache.phoenix.iterate.BaseResultIterators.getIterators(BaseResultIterators.java:621)
> at
> org.apache.phoenix.iterate.BaseResultIterators.getIterators(BaseResultIterators.java:591)
> at
> org.apache.phoenix.iterate.RoundRobinResultIterator.getIterators(RoundRobinResultIterator.java:176)
> at
> org.apache.phoenix.iterate.RoundRobinResultIterator.next(RoundRobinResultIterator.java:91)
> at
> org.apache.phoenix.iterate.DelegateResultIterator.next(DelegateResultIterator.java:44)
> at
> org.apache.phoenix.iterate.LimitingResultIterator.next(LimitingResultIterator.java:47)
> {code}
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
