[ https://issues.apache.org/jira/browse/PIG-5171?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15967585#comment-15967585 ]
Nandor Kollar commented on PIG-5171: ------------------------------------ I took an other approach: turned SecondaryKeyOptimizerSpark off, and the test passed. Actually not just this test, but MultiQuery_Union_3 and Union_3 passed too without applying secondary key optimization on Spark plan. Not sure if this is a bug in MR like you told, or a bug in the Spark secondary key optimizer. > SecondarySort_7 is failing with spark exec type > ----------------------------------------------- > > Key: PIG-5171 > URL: https://issues.apache.org/jira/browse/PIG-5171 > Project: Pig > Issue Type: Sub-task > Components: spark > Reporter: Nandor Kollar > Fix For: spark-branch > > > different output produced -- This message was sent by Atlassian JIRA (v6.3.15#6346)