liyunzhang_intel created PIG-4952:
-------------------------------------
Summary: Parallism is not set as correct value in some physical
operator like GlobalRearrageParallism is not set as correct value in some
physical operator like POGlobalRearrange
Key: PIG-4952
URL: https://issues.apache.org/jira/browse/PIG-4952
Project: Pig
Issue Type: Sub-task
Components: spark
Reporter: liyunzhang_intel
Now the parallism value is always 1 in current spark job, this will cause the
we only have 1 partition in HashPartitioner in shuffle process. see
[code|https://github.com/apache/pig/blob/spark/src/org/apache/pig/backend/hadoop/executionengine/spark/converter/JoinGroupSparkConverter.java#L90].
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
