[
https://issues.apache.org/jira/browse/PIG-4568?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
liyunzhang_intel updated PIG-4568:
----------------------------------
Attachment: PIG-4568.patch
[~mohitsabharwal],[~xuefuz],[~praveenr019]:
PIG-4568.patch fixes following unit test failures:
1.TestSecondarySortSpark#testSecondarySortSpark#testNestedDistinctEndToEnd1
2.TestSecondarySortSpark#testSecondarySortSpark#testNestedDistinctEndToEnd2
Changes are:
Compare the sorted group by results and expected results.
> Fix unit test failure in TestSecondarySortSpark
> ------------------------------------------------
>
> Key: PIG-4568
> URL: https://issues.apache.org/jira/browse/PIG-4568
> Project: Pig
> Issue Type: Sub-task
> Components: spark
> Reporter: liyunzhang_intel
> Assignee: liyunzhang_intel
> Fix For: spark-branch
>
> Attachments: PIG-4568.patch
>
>
> In https://builds.apache.org/job/Pig-spark/191/, it shows that
> two regression unit test failures are added:
> 1.TestSecondarySortSpark#testSecondarySortSpark#testNestedDistinctEndToEnd1
> 2.TestSecondarySortSpark#testSecondarySortSpark#org.apache.pig.spark.TestSecondarySortSpark.testNestedDistinctEndToEnd2
> the reason why these two unit test fail is the result of group is not sorted
> in spark mode.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)