[
https://issues.apache.org/jira/browse/PIG-4846?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15205708#comment-15205708
]
liyunzhang_intel commented on PIG-4846:
---------------------------------------
The following is result comparing mr and spark mode:
||Script||MR||Spark||
|L_1|22|29|
|L_2|22|20|
|L_3|28|45|
|L_4|20|21|
|L_5|21|52|
|L_6|20|21|
|L_7|16|38|
|L_8|16|20|
|L_9|21|19|
|L_10|27|19|
|L_11|485|1768|
|L_12|21|26|
|L_13|16|42|
|L_14|54|21|
|L_15|21|37|
|L_16|21|38|
|L_17|21|20|
> Use pigmix to test the performance of pig on spark
> --------------------------------------------------
>
> Key: PIG-4846
> URL: https://issues.apache.org/jira/browse/PIG-4846
> Project: Pig
> Issue Type: Sub-task
> Components: spark
> Reporter: liyunzhang_intel
> Assignee: liyunzhang_intel
> Fix For: spark-branch
>
> Attachments: PIG-4846.patch
>
>
> We can compare the performance between mr and spark mode by pigmix.
> The introduction of pigmix is
> https://cwiki.apache.org/confluence/display/PIG/PigMix.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
