[
https://issues.apache.org/jira/browse/PIG-1874?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13055422#comment-13055422
]
Thomas Memenga commented on PIG-1874:
-------------------------------------
Be aware that the current implementation seems to have a memory leak if you
reuse the threads.
I have executed 1000s of (very small) pig jobs in parallel using a
java.util.ExecutorService (fixed size thread pool)
and I ran into memory problems after 3-4 hours. (Statistics related ?)
My workaround: Spawning a new thread for each PigServer and let the garbage
collector do the clean up.
> Make PigServer work in a multithreading environment
> ---------------------------------------------------
>
> Key: PIG-1874
> URL: https://issues.apache.org/jira/browse/PIG-1874
> Project: Pig
> Issue Type: Improvement
> Components: impl
> Affects Versions: 0.8.0
> Reporter: Richard Ding
> Assignee: Richard Ding
> Fix For: 0.9.0
>
> Attachments: PIG-1874.patch, PIG-1874_1.patch
>
>
> This means that PigServers should work if one creates separate PigServer
> instances for each thread (PigServers are not synchronized).
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
