[
https://issues.apache.org/jira/browse/PIG-962?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Sriranjan Manjunath updated PIG-962:
------------------------------------
Description: The first job is a load / store job which loads the data from
PigStorage and stores it in BinStorage. This hampers performance. The desired
behavior is for the sampler to read from PigStorage instead of relying on the
first load/store job. Skewed join should thus be 2 M/R jobs and not 3. (was:
The first job is a load / store job which loads the data from PigStorage and
stores it in BinStorage. This hampers performance. The desired behavior is for
the sampler to read from PigStorage instead of relying on the first load/store
job.)
> Skewed join creates 3 map reduce jobs
> -------------------------------------
>
> Key: PIG-962
> URL: https://issues.apache.org/jira/browse/PIG-962
> Project: Pig
> Issue Type: Bug
> Reporter: Sriranjan Manjunath
>
> The first job is a load / store job which loads the data from PigStorage and
> stores it in BinStorage. This hampers performance. The desired behavior is
> for the sampler to read from PigStorage instead of relying on the first
> load/store job. Skewed join should thus be 2 M/R jobs and not 3.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.