[
https://issues.apache.org/jira/browse/LIVY-800?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
mrpencil updated LIVY-800:
--------------------------
Description:
When the session is finished, Livy does not release resources and hold
/Python/lib resulting in the number of file handles exceeding. Please see the
attached picture.
Error content: *too many open files.*
This will cause an error to be reported after Livy has been running for a
period of time, and the session can no longer be created.
*Another problem is* that on my 8g memory, 4-core RedHat server, I tried many
parameter combinations, and finally found that I can only run 18 sessions at
the same time. Exceeding this value will cause more than half of the sessions
to die. Is there any way to increase the concurrency value?
was:
Livy does not release resources, resulting in the number of file handles
exceeding. Please see the attached picture.
Error content: *too many open files.*
This will cause an error to be reported after Livy has been running for a
period of time, and the session can no longer be created.
*Another problem is* that on my 8g memory, 4-core RedHat server, I tried many
parameter combinations, and finally found that I can only run 18 sessions at
the same time. Exceeding this value will cause more than half of the sessions
to die. Is there any way to increase the concurrency value?
> Livy does not release resources, resulting in the number of file handles
> exceeding
> ----------------------------------------------------------------------------------
>
> Key: LIVY-800
> URL: https://issues.apache.org/jira/browse/LIVY-800
> Project: Livy
> Issue Type: Bug
> Components: Server
> Affects Versions: 0.5.0
> Environment: Redhat_7.4 8memories,4cores
> Reporter: mrpencil
> Priority: Blocker
> Fix For: 0.5.0
>
> Attachments: 1.jpg, 2.jpg
>
>
> When the session is finished, Livy does not release resources and hold
> /Python/lib resulting in the number of file handles exceeding. Please see the
> attached picture.
> Error content: *too many open files.*
> This will cause an error to be reported after Livy has been running for a
> period of time, and the session can no longer be created.
>
> *Another problem is* that on my 8g memory, 4-core RedHat server, I tried many
> parameter combinations, and finally found that I can only run 18 sessions at
> the same time. Exceeding this value will cause more than half of the sessions
> to die. Is there any way to increase the concurrency value?
>
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
