[
https://issues.apache.org/jira/browse/PIG-5217?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15967393#comment-15967393
]
bharatpattani commented on PIG-5217:
------------------------------------
Try with very large data in which python script at least take 300 seconds.When
I tried I got following error.
5mins, 17sec AttemptID:attempt_1465894929513_11243_r_000000_0 Timed out
after 300 secs
5mins, 27sec AttemptID:attempt_1465894929513_11243_r_000000_1 Timed out
after 300 secs
5mins, 27sec AttemptID:attempt_1465894929513_11243_r_000000_2 Timed out
after 300 secs
5mins, 27sec AttemptID:attempt_1465894929513_11243_r_000000_3 Timed out
after 300 secs
> Pig Streaming over python multiprocessing
> -----------------------------------------
>
> Key: PIG-5217
> URL: https://issues.apache.org/jira/browse/PIG-5217
> Project: Pig
> Issue Type: Bug
> Components: internal-udfs
> Affects Versions: 0.15.0
> Environment: python 2.7,pig 0.15.0,multi-core processor
> Reporter: bharatpattani
>
> python multiprocessing is not working with pig streaming.
> Following are the steps for that:
> 1. Create python script with "multiprocessing" which can utilise at least two
> cores of the processor.
> 2. Create an pig script which will call python script which mentioned in
> above step.
> Please have a look at it and do need full for the same.
--
This message was sent by Atlassian JIRA
(v6.3.15#6346)
