Build failed in Hudson: Pig-Patch-minerva.apache.org #105
See http://hudson.zones.apache.org/hudson/job/Pig-Patch-minerva.apache.org/105/ -- [...truncated 94487 lines...] [exec] [junit] 09/06/28 07:37:52 INFO dfs.DataNode: Received block blk_5576395903115811081_1011 of size 6 from /127.0.0.1 [exec] [junit] 09/06/28 07:37:52 INFO dfs.DataNode: PacketResponder 1 for block blk_5576395903115811081_1011 terminating [exec] [junit] 09/06/28 07:37:52 INFO dfs.DataNode: PacketResponder 2 for block blk_5576395903115811081_1011 terminating [exec] [junit] 09/06/28 07:37:52 INFO dfs.StateChange: BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:60661 is added to blk_5576395903115811081_1011 size 6 [exec] [junit] 09/06/28 07:37:52 INFO executionengine.HExecutionEngine: Connecting to hadoop file system at: hdfs://localhost:34558 [exec] [junit] 09/06/28 07:37:52 INFO executionengine.HExecutionEngine: Connecting to map-reduce job tracker at: localhost:33036 [exec] [junit] 09/06/28 07:37:52 INFO mapReduceLayer.MultiQueryOptimizer: MR plan size before optimization: 1 [exec] [junit] 09/06/28 07:37:52 INFO mapReduceLayer.MultiQueryOptimizer: MR plan size after optimization: 1 [exec] [junit] 09/06/28 07:37:52 INFO dfs.DataNode: Deleting block blk_164040432334202495_1005 file dfs/data/data1/current/blk_164040432334202495 [exec] [junit] 09/06/28 07:37:52 INFO dfs.DataNode: Deleting block blk_1788595682123796340_1006 file dfs/data/data2/current/blk_1788595682123796340 [exec] [junit] 09/06/28 07:37:52 INFO dfs.DataNode: Deleting block blk_6485399359575942269_1004 file dfs/data/data2/current/blk_6485399359575942269 [exec] [junit] 09/06/28 07:37:53 INFO dfs.StateChange: BLOCK* ask 127.0.0.1:60661 to delete blk_164040432334202495_1005 blk_6485399359575942269_1004 [exec] [junit] 09/06/28 07:37:53 INFO dfs.StateChange: BLOCK* ask 127.0.0.1:42903 to delete blk_1788595682123796340_1006 blk_6485399359575942269_1004 [exec] [junit] 09/06/28 07:37:53 INFO mapReduceLayer.JobControlCompiler: Setting up single store job [exec] [junit] 09/06/28 07:37:53 WARN mapred.JobClient: Use GenericOptionsParser for parsing the arguments. Applications should implement Tool for the same. [exec] [junit] 09/06/28 07:37:53 INFO dfs.StateChange: BLOCK* NameSystem.allocateBlock: /tmp/hadoop-hudson/mapred/system/job_200906280737_0002/job.jar. blk_7604233983985893457_1012 [exec] [junit] 09/06/28 07:37:53 INFO dfs.DataNode: Receiving block blk_7604233983985893457_1012 src: /127.0.0.1:50377 dest: /127.0.0.1:55479 [exec] [junit] 09/06/28 07:37:53 INFO dfs.DataNode: Receiving block blk_7604233983985893457_1012 src: /127.0.0.1:45014 dest: /127.0.0.1:42903 [exec] [junit] 09/06/28 07:37:53 INFO dfs.DataNode: Receiving block blk_7604233983985893457_1012 src: /127.0.0.1:33711 dest: /127.0.0.1:48779 [exec] [junit] 09/06/28 07:37:53 INFO dfs.DataNode: Received block blk_7604233983985893457_1012 of size 1427059 from /127.0.0.1 [exec] [junit] 09/06/28 07:37:53 INFO dfs.StateChange: BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:48779 is added to blk_7604233983985893457_1012 size 1427059 [exec] [junit] 09/06/28 07:37:53 INFO dfs.DataNode: PacketResponder 0 for block blk_7604233983985893457_1012 terminating [exec] [junit] 09/06/28 07:37:53 INFO dfs.DataNode: Received block blk_7604233983985893457_1012 of size 1427059 from /127.0.0.1 [exec] [junit] 09/06/28 07:37:53 INFO dfs.DataNode: PacketResponder 1 for block blk_7604233983985893457_1012 terminating [exec] [junit] 09/06/28 07:37:53 INFO dfs.StateChange: BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:42903 is added to blk_7604233983985893457_1012 size 1427059 [exec] [junit] 09/06/28 07:37:53 INFO dfs.DataNode: Received block blk_7604233983985893457_1012 of size 1427059 from /127.0.0.1 [exec] [junit] 09/06/28 07:37:53 INFO dfs.DataNode: PacketResponder 2 for block blk_7604233983985893457_1012 terminating [exec] [junit] 09/06/28 07:37:53 INFO dfs.StateChange: BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:55479 is added to blk_7604233983985893457_1012 size 1427059 [exec] [junit] 09/06/28 07:37:53 INFO fs.FSNamesystem: Increasing replication for file /tmp/hadoop-hudson/mapred/system/job_200906280737_0002/job.jar. New replication is 2 [exec] [junit] 09/06/28 07:37:53 INFO fs.FSNamesystem: Reducing replication for file /tmp/hadoop-hudson/mapred/system/job_200906280737_0002/job.jar. New replication is 2 [exec] [junit] 09/06/28 07:37:53 INFO dfs.StateChange: BLOCK* NameSystem.allocateBlock: /tmp/hadoop-hudson/mapred/system/job_200906280737_0002/job.split. blk_-3652869661695527847_1013 [exec] [junit] 09/06/28 07:37:53 INFO dfs.DataNode: Receiving block
[jira] Commented: (PIG-865) Performance: Unnnecessary computation in FRJoin
[ https://issues.apache.org/jira/browse/PIG-865?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12724929#action_12724929 ] Hadoop QA commented on PIG-865: --- -1 overall. Here are the results of testing the latest attachment http://issues.apache.org/jira/secure/attachment/12412006/pig-865.patch against trunk revision 788174. +1 @author. The patch does not contain any @author tags. -1 tests included. The patch doesn't appear to include any new or modified tests. Please justify why no tests are needed for this patch. +1 javadoc. The javadoc tool did not generate any warning messages. +1 javac. The applied patch does not increase the total number of javac compiler warnings. +1 findbugs. The patch does not introduce any new Findbugs warnings. +1 release audit. The applied patch does not increase the total number of release audit warnings. +1 core tests. The patch passed core unit tests. +1 contrib tests. The patch passed contrib unit tests. Test results: http://hudson.zones.apache.org/hudson/job/Pig-Patch-minerva.apache.org/105/testReport/ Findbugs warnings: http://hudson.zones.apache.org/hudson/job/Pig-Patch-minerva.apache.org/105/artifact/trunk/build/test/findbugs/newPatchFindbugsWarnings.html Console output: http://hudson.zones.apache.org/hudson/job/Pig-Patch-minerva.apache.org/105/console This message is automatically generated. Performance: Unnnecessary computation in FRJoin --- Key: PIG-865 URL: https://issues.apache.org/jira/browse/PIG-865 Project: Pig Issue Type: Improvement Components: impl Affects Versions: 0.3.0 Reporter: Ashutosh Chauhan Priority: Minor Fix For: 0.4.0 Attachments: pig-865.patch In POFRJoin implementation POLocalRearrange is used to extract join keys from the input tuples. If keys match then to perform actual join input tuples are fed to Foreach which does a cross on its inputs. After keys are extracted using POLocalRearrange output; function getValueTuple(POLocalRearrange lr, Tuple tuple) is called to reconstruct the input tuple. It seems that this function call is unnecessary since we already have input tuple at that time. This is not a bug, but since this function would get called for every tuple, if it is eliminated, it should certainly help to improve performance. -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online.
[jira] Updated: (PIG-773) Empty complex constants (empty bag, empty tuple and empty map) should be supported
[ https://issues.apache.org/jira/browse/PIG-773?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ashutosh Chauhan updated PIG-773: - Status: Open (was: Patch Available) Empty complex constants (empty bag, empty tuple and empty map) should be supported -- Key: PIG-773 URL: https://issues.apache.org/jira/browse/PIG-773 Project: Pig Issue Type: Bug Affects Versions: 0.3.0 Reporter: Pradeep Kamath Assignee: Ashutosh Chauhan Priority: Minor Attachments: pig-773.patch, pig-773_v2.patch, pig-773_v3.patch We should be able to create empty bag constant using {}, empty tuple constant using (), empty map constant using [] within a pig script -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online.
[jira] Updated: (PIG-773) Empty complex constants (empty bag, empty tuple and empty map) should be supported
[ https://issues.apache.org/jira/browse/PIG-773?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ashutosh Chauhan updated PIG-773: - Attachment: pig-773_v3.patch It turned out that there was a bug in DataType.java where schema for a Bag is computed. The patch fixes the bug. Test cases are modified to match the expected behavior. Also the values generated by the parser are checked against expected values for the parsed constants. Empty complex constants (empty bag, empty tuple and empty map) should be supported -- Key: PIG-773 URL: https://issues.apache.org/jira/browse/PIG-773 Project: Pig Issue Type: Bug Affects Versions: 0.3.0 Reporter: Pradeep Kamath Assignee: Ashutosh Chauhan Priority: Minor Attachments: pig-773.patch, pig-773_v2.patch, pig-773_v3.patch We should be able to create empty bag constant using {}, empty tuple constant using (), empty map constant using [] within a pig script -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online.
[jira] Updated: (PIG-773) Empty complex constants (empty bag, empty tuple and empty map) should be supported
[ https://issues.apache.org/jira/browse/PIG-773?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ashutosh Chauhan updated PIG-773: - Fix Version/s: 0.4.0 Status: Patch Available (was: Open) Empty complex constants (empty bag, empty tuple and empty map) should be supported -- Key: PIG-773 URL: https://issues.apache.org/jira/browse/PIG-773 Project: Pig Issue Type: Bug Affects Versions: 0.3.0 Reporter: Pradeep Kamath Assignee: Ashutosh Chauhan Priority: Minor Fix For: 0.4.0 Attachments: pig-773.patch, pig-773_v2.patch, pig-773_v3.patch We should be able to create empty bag constant using {}, empty tuple constant using (), empty map constant using [] within a pig script -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online.
Hudson build is back to normal: Pig-Patch-minerva.apache.org #106
See http://hudson.zones.apache.org/hudson/job/Pig-Patch-minerva.apache.org/106/