[
https://issues.apache.org/jira/browse/PIG-4164?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14149746#comment-14149746
]
Daniel Dai commented on PIG-4164:
---------------------------------
I check the code again and I cannot find a good answer. Ideally we can create a
Cluster object outside the loop, however, Cluster is hadoop 2 only and we can
only put in shims. That will inevitably make code much complex. Consider number
of cluster object created is linear to the number of jobs, it does not seems
too bad. I would like to check in the code as is, sounds ok?
> After Pig job finish, Pig client spend too much time retry to connect to AM
> ---------------------------------------------------------------------------
>
> Key: PIG-4164
> URL: https://issues.apache.org/jira/browse/PIG-4164
> Project: Pig
> Issue Type: Bug
> Components: impl
> Reporter: Daniel Dai
> Assignee: Daniel Dai
> Fix For: 0.14.0
>
> Attachments: PIG-4164-0.patch
>
>
> For some script, after job finish, Pig spend a lot time try to connect AM
> before get redirect to JobHistoryServer. Here is the message we saw:
> {code}
> 2014-09-10 15:13:55,370 [main] INFO org.apache.hadoop.ipc.Client - Retrying
> connect to server: daijymacpro-2.local/10.11.2.30:55223. Already tried 0
> time(s); retry policy is RetryUpToMaximumCountWithFixedSleep(maxRetries=3,
> sleepTime=1000 MILLISECONDS)
> 2014-09-10 15:13:56,371 [main] INFO org.apache.hadoop.ipc.Client - Retrying
> connect to server: daijymacpro-2.local/10.11.2.30:55223. Already tried 1
> time(s); retry policy is RetryUpToMaximumCountWithFixedSleep(maxRetries=3,
> sleepTime=1000 MILLISECONDS)
> 2014-09-10 15:13:57,372 [main] INFO org.apache.hadoop.ipc.Client - Retrying
> connect to server: daijymacpro-2.local/10.11.2.30:55223. Already tried 2
> time(s); retry policy is RetryUpToMaximumCountWithFixedSleep(maxRetries=3,
> sleepTime=1000 MILLISECONDS)
> 2014-09-10 15:13:57,476 [main] INFO
> org.apache.hadoop.mapred.ClientServiceDelegate - Application state is
> completed. FinalApplicationStatus=SUCCEEDED. Redirecting to job history server
> {code}
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
