[jira] Updated: (PIG-962) Skewed join creates 3 map reduce jobs
[ https://issues.apache.org/jira/browse/PIG-962?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Olga Natkovich updated PIG-962: --- Resolution: Fixed Status: Resolved (was: Patch Available) Patch committed. Thanks, Sri! > Skewed join creates 3 map reduce jobs > - > > Key: PIG-962 > URL: https://issues.apache.org/jira/browse/PIG-962 > Project: Pig > Issue Type: Bug >Affects Versions: 0.4.0 >Reporter: Sriranjan Manjunath >Assignee: Sriranjan Manjunath > Fix For: 0.5.0 > > Attachments: skewedjoin2job.patch > > > The first job is a load / store job which loads the data from PigStorage and > stores it in BinStorage. This hampers performance. The desired behavior is > for the sampler to read from PigStorage instead of relying on the first > load/store job. Skewed join should thus be 2 M/R jobs and not 3. -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online.
[jira] Updated: (PIG-962) Skewed join creates 3 map reduce jobs
[ https://issues.apache.org/jira/browse/PIG-962?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Olga Natkovich updated PIG-962: --- Affects Version/s: 0.4.0 Fix Version/s: 0.5.0 > Skewed join creates 3 map reduce jobs > - > > Key: PIG-962 > URL: https://issues.apache.org/jira/browse/PIG-962 > Project: Pig > Issue Type: Bug >Affects Versions: 0.4.0 >Reporter: Sriranjan Manjunath >Assignee: Sriranjan Manjunath > Fix For: 0.5.0 > > Attachments: skewedjoin2job.patch > > > The first job is a load / store job which loads the data from PigStorage and > stores it in BinStorage. This hampers performance. The desired behavior is > for the sampler to read from PigStorage instead of relying on the first > load/store job. Skewed join should thus be 2 M/R jobs and not 3. -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online.
[jira] Updated: (PIG-962) Skewed join creates 3 map reduce jobs
[ https://issues.apache.org/jira/browse/PIG-962?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sriranjan Manjunath updated PIG-962: Status: Patch Available (was: Open) > Skewed join creates 3 map reduce jobs > - > > Key: PIG-962 > URL: https://issues.apache.org/jira/browse/PIG-962 > Project: Pig > Issue Type: Bug >Reporter: Sriranjan Manjunath >Assignee: Sriranjan Manjunath > Attachments: skewedjoin2job.patch > > > The first job is a load / store job which loads the data from PigStorage and > stores it in BinStorage. This hampers performance. The desired behavior is > for the sampler to read from PigStorage instead of relying on the first > load/store job. Skewed join should thus be 2 M/R jobs and not 3. -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online.
[jira] Updated: (PIG-962) Skewed join creates 3 map reduce jobs
[ https://issues.apache.org/jira/browse/PIG-962?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sriranjan Manjunath updated PIG-962: Attachment: skewedjoin2job.patch The attached patch resolves this issue. > Skewed join creates 3 map reduce jobs > - > > Key: PIG-962 > URL: https://issues.apache.org/jira/browse/PIG-962 > Project: Pig > Issue Type: Bug >Reporter: Sriranjan Manjunath >Assignee: Sriranjan Manjunath > Attachments: skewedjoin2job.patch > > > The first job is a load / store job which loads the data from PigStorage and > stores it in BinStorage. This hampers performance. The desired behavior is > for the sampler to read from PigStorage instead of relying on the first > load/store job. Skewed join should thus be 2 M/R jobs and not 3. -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online.
[jira] Updated: (PIG-962) Skewed join creates 3 map reduce jobs
[ https://issues.apache.org/jira/browse/PIG-962?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sriranjan Manjunath updated PIG-962: Description: The first job is a load / store job which loads the data from PigStorage and stores it in BinStorage. This hampers performance. The desired behavior is for the sampler to read from PigStorage instead of relying on the first load/store job. Skewed join should thus be 2 M/R jobs and not 3. (was: The first job is a load / store job which loads the data from PigStorage and stores it in BinStorage. This hampers performance. The desired behavior is for the sampler to read from PigStorage instead of relying on the first load/store job.) > Skewed join creates 3 map reduce jobs > - > > Key: PIG-962 > URL: https://issues.apache.org/jira/browse/PIG-962 > Project: Pig > Issue Type: Bug >Reporter: Sriranjan Manjunath > > The first job is a load / store job which loads the data from PigStorage and > stores it in BinStorage. This hampers performance. The desired behavior is > for the sampler to read from PigStorage instead of relying on the first > load/store job. Skewed join should thus be 2 M/R jobs and not 3. -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online.
