[
https://issues.apache.org/jira/browse/PIG-4941?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15367398#comment-15367398
]
liyunzhang_intel commented on PIG-4941:
---------------------------------------
[~mohitsabharwal],[~xuefuz] , [~pallavi.rao] and [~kexianda]: After upgrading
spark version to 1.6.1, TestRank3#testRankWithSplitInMap hangs and fails due to
timeout exception.
rank.pig
{code}
R1 = load './rank.txt' using PigStorage() as (a:int,b:int);
R2 = rank R1 by a;
R3 = rank R1;
R4 = union R2,R3;
store R4 into './rank.out';
{code}
The script runs successfully in spark1.4.1 but hangs in spark 1.6.1. I use
jstack -l $pid to export all the thread states when hangs and attached the
thread file(rank.jstack) but have no idea about how to figure out it. Can
anyone here help to see it?
> TestRank3#testRankWithSplitInMap hangs after upgrade to spark 1.6.1
> -------------------------------------------------------------------
>
> Key: PIG-4941
> URL: https://issues.apache.org/jira/browse/PIG-4941
> Project: Pig
> Issue Type: Sub-task
> Reporter: liyunzhang_intel
> Assignee: liyunzhang_intel
> Attachments: rank.jstack
>
>
> After upgrading spark version to 1.6.1, TestRank3#testRankWithSplitInMap
> hangs and fails due to timeout exception.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
