[ https://issues.apache.org/jira/browse/PIG-4893?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
liyunzhang_intel reassigned PIG-4893: ------------------------------------- Assignee: liyunzhang_intel > Task deserialization time is too long for spark on yarn mode > ------------------------------------------------------------ > > Key: PIG-4893 > URL: https://issues.apache.org/jira/browse/PIG-4893 > Project: Pig > Issue Type: Sub-task > Components: spark > Reporter: liyunzhang_intel > Assignee: liyunzhang_intel > Fix For: spark-branch > > Attachments: PIG-4893.patch, time.PNG > > > I found the task deserialization time is a bit long when i run any scripts of > pigmix in spark on yarn mode. see the attachment picture. The duration time > is 3s but the task deserialization is 13s. > My env is hadoop2.6+spark1.6. -- This message was sent by Atlassian JIRA (v6.3.4#6332)