[jira] Commented: (PIG-849) Local engine loses records in splits
[ https://issues.apache.org/jira/browse/PIG-849?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12720509#action_12720509 ] Hudson commented on PIG-849: Integrated in Pig-trunk #476 (See [http://hudson.zones.apache.org/hudson/job/Pig-trunk/476/]) : Local engine loses records in splits (hagleitn via olgan) > Local engine loses records in splits > > > Key: PIG-849 > URL: https://issues.apache.org/jira/browse/PIG-849 > Project: Pig > Issue Type: Bug >Reporter: Gunther Hagleitner > Attachments: local_engine.patch, local_engine.patch > > > When there is a split in the physical plan records can be dropped in certain > circumstances. > The local split operator puts all records in a databag and turns over > iterators to the POSplitOutput operators. The problem is that the local split > also adds STATUS_NULL records to the bag. That will cause the databag's > iterator to prematurely return false on the hasNext call (so a STATUS_NULL > becomes a STATUS_EOP in the split output operators). -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online.
[jira] Commented: (PIG-849) Local engine loses records in splits
[ https://issues.apache.org/jira/browse/PIG-849?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12720306#action_12720306 ] Gunther Hagleitner commented on PIG-849: Same errors as before. Ran manually and passed. The issue with the automated patch testing seems to be still there. > Local engine loses records in splits > > > Key: PIG-849 > URL: https://issues.apache.org/jira/browse/PIG-849 > Project: Pig > Issue Type: Bug >Reporter: Gunther Hagleitner > Attachments: local_engine.patch, local_engine.patch > > > When there is a split in the physical plan records can be dropped in certain > circumstances. > The local split operator puts all records in a databag and turns over > iterators to the POSplitOutput operators. The problem is that the local split > also adds STATUS_NULL records to the bag. That will cause the databag's > iterator to prematurely return false on the hasNext call (so a STATUS_NULL > becomes a STATUS_EOP in the split output operators). -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online.
[jira] Commented: (PIG-849) Local engine loses records in splits
[ https://issues.apache.org/jira/browse/PIG-849?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12720013#action_12720013 ] Hadoop QA commented on PIG-849: --- -1 overall. Here are the results of testing the latest attachment http://issues.apache.org/jira/secure/attachment/12410762/local_engine.patch against trunk revision 784333. +1 @author. The patch does not contain any @author tags. +1 tests included. The patch appears to include 3 new or modified tests. +1 javadoc. The javadoc tool did not generate any warning messages. +1 javac. The applied patch does not increase the total number of javac compiler warnings. +1 findbugs. The patch does not introduce any new Findbugs warnings. +1 release audit. The applied patch does not increase the total number of release audit warnings. -1 core tests. The patch failed core unit tests. +1 contrib tests. The patch passed contrib unit tests. Test results: http://hudson.zones.apache.org/hudson/job/Pig-Patch-minerva.apache.org/84/testReport/ Findbugs warnings: http://hudson.zones.apache.org/hudson/job/Pig-Patch-minerva.apache.org/84/artifact/trunk/build/test/findbugs/newPatchFindbugsWarnings.html Console output: http://hudson.zones.apache.org/hudson/job/Pig-Patch-minerva.apache.org/84/console This message is automatically generated. > Local engine loses records in splits > > > Key: PIG-849 > URL: https://issues.apache.org/jira/browse/PIG-849 > Project: Pig > Issue Type: Bug >Reporter: Gunther Hagleitner > Attachments: local_engine.patch, local_engine.patch > > > When there is a split in the physical plan records can be dropped in certain > circumstances. > The local split operator puts all records in a databag and turns over > iterators to the POSplitOutput operators. The problem is that the local split > also adds STATUS_NULL records to the bag. That will cause the databag's > iterator to prematurely return false on the hasNext call (so a STATUS_NULL > becomes a STATUS_EOP in the split output operators). -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online.
[jira] Commented: (PIG-849) Local engine loses records in splits
[ https://issues.apache.org/jira/browse/PIG-849?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12719968#action_12719968 ] Gunther Hagleitner commented on PIG-849: the new patch has a unit test - otherwise it's the same > Local engine loses records in splits > > > Key: PIG-849 > URL: https://issues.apache.org/jira/browse/PIG-849 > Project: Pig > Issue Type: Bug >Reporter: Gunther Hagleitner > Attachments: local_engine.patch, local_engine.patch > > > When there is a split in the physical plan records can be dropped in certain > circumstances. > The local split operator puts all records in a databag and turns over > iterators to the POSplitOutput operators. The problem is that the local split > also adds STATUS_NULL records to the bag. That will cause the databag's > iterator to prematurely return false on the hasNext call (so a STATUS_NULL > becomes a STATUS_EOP in the split output operators). -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online.
[jira] Commented: (PIG-849) Local engine loses records in splits
[ https://issues.apache.org/jira/browse/PIG-849?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12719790#action_12719790 ] Olga Natkovich commented on PIG-849: I rerun the tests manually and they all passed. Looks like an issue with automated patch testing as we so another case of it this morning. > Local engine loses records in splits > > > Key: PIG-849 > URL: https://issues.apache.org/jira/browse/PIG-849 > Project: Pig > Issue Type: Bug >Reporter: Gunther Hagleitner > Attachments: local_engine.patch > > > When there is a split in the physical plan records can be dropped in certain > circumstances. > The local split operator puts all records in a databag and turns over > iterators to the POSplitOutput operators. The problem is that the local split > also adds STATUS_NULL records to the bag. That will cause the databag's > iterator to prematurely return false on the hasNext call (so a STATUS_NULL > becomes a STATUS_EOP in the split output operators). -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online.
[jira] Commented: (PIG-849) Local engine loses records in splits
[ https://issues.apache.org/jira/browse/PIG-849?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12719611#action_12719611 ] Hadoop QA commented on PIG-849: --- -1 overall. Here are the results of testing the latest attachment http://issues.apache.org/jira/secure/attachment/12410627/local_engine.patch against trunk revision 784333. +1 @author. The patch does not contain any @author tags. -1 tests included. The patch doesn't appear to include any new or modified tests. Please justify why no tests are needed for this patch. +1 javadoc. The javadoc tool did not generate any warning messages. +1 javac. The applied patch does not increase the total number of javac compiler warnings. +1 findbugs. The patch does not introduce any new Findbugs warnings. +1 release audit. The applied patch does not increase the total number of release audit warnings. -1 core tests. The patch failed core unit tests. +1 contrib tests. The patch passed contrib unit tests. Test results: http://hudson.zones.apache.org/hudson/job/Pig-Patch-minerva.apache.org/81/testReport/ Findbugs warnings: http://hudson.zones.apache.org/hudson/job/Pig-Patch-minerva.apache.org/81/artifact/trunk/build/test/findbugs/newPatchFindbugsWarnings.html Console output: http://hudson.zones.apache.org/hudson/job/Pig-Patch-minerva.apache.org/81/console This message is automatically generated. > Local engine loses records in splits > > > Key: PIG-849 > URL: https://issues.apache.org/jira/browse/PIG-849 > Project: Pig > Issue Type: Bug >Reporter: Gunther Hagleitner > Attachments: local_engine.patch > > > When there is a split in the physical plan records can be dropped in certain > circumstances. > The local split operator puts all records in a databag and turns over > iterators to the POSplitOutput operators. The problem is that the local split > also adds STATUS_NULL records to the bag. That will cause the databag's > iterator to prematurely return false on the hasNext call (so a STATUS_NULL > becomes a STATUS_EOP in the split output operators). -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online.
