[jira] Commented: (PIG-1066) ILLUSTRATE called after DESCRIBE results in Grunt: ERROR 2999: Unexpected internal error. null

2009-10-30 Thread Bogdan Dorohonceanu (JIRA)

[ 
https://issues.apache.org/jira/browse/PIG-1066?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12771948#action_12771948
 ] 

Bogdan Dorohonceanu commented on PIG-1066:
--

In the code above if I comment ILLUSTRATE, the code works fine. If I un-comment 
it, grunt gets an error.

 ILLUSTRATE called after DESCRIBE results in Grunt: ERROR 2999: Unexpected 
 internal error. null
 

 Key: PIG-1066
 URL: https://issues.apache.org/jira/browse/PIG-1066
 Project: Pig
  Issue Type: Bug
  Components: grunt
Affects Versions: 0.4.0
Reporter: Bogdan Dorohonceanu

 -- load the QID_CT_QP20 data
 x = LOAD '$FS_TD/$QID_IN_FILES' USING PigStorage('\t') AS 
 (unstem_qid:chararray, jid_score_pairs:chararray);
 DESCRIBE x;
 --ILLUSTRATE x;
 -- load the ID_RQ data
 y0 = LOAD '$FS_USER/$ID_RQ_IN_FILE' USING PigStorage('\t') AS (sid:chararray, 
 query:chararray);
 -- force parallelization
 -- y1 = ORDER y0 BY sid PARALLEL $NUM;
 -- compute unstem_qid
 DEFINE f `text_streamer_query j3_unicode.dat prop.dat normal.txt TAB TAB 
 1:yes:UNSTEM_ID:%llx` INPUT(stdin USING PigStorage('\t')) OU\
 TPUT(stdout USING PigStorage('\t')) SHIP('$USER/text_streamer_query', 
 '$USER/j3_unicode.dat', '$USER/prop.dat', '$USER/normal.txt');
 y = STREAM y0 THROUGH f AS (sid:chararray, query:chararray, 
 unstem_qid:chararray);
 DESCRIBE y;
 --ILLUSTRATE y;
 rmf /user/vega/zoom/y_debug
 STORE y INTO '/user/vega/zoom/y_debug' USING PigStorage('\t');
 2009-10-30 13:36:48,437 [main] INFO  
 org.apache.pig.backend.hadoop.executionengine.HExecutionEngine - Connecting 
 to hadoop file system at: 
 hdfs://dd-9c32d03:8887/,/teoma/dd-9c34d04/middleware/hadoop.test.data/dfs/name
 09/10/30 13:36:48 INFO executionengine.HExecutionEngine: Connecting to hadoop 
 file system at: 
 hdfs://dd-9c32d03:8887/,/teoma/dd-9c34d04/middleware/hadoop.test.data/dfs/name
 2009-10-30 13:36:48,495 [main] INFO  
 org.apache.pig.backend.hadoop.executionengine.HExecutionEngine - Connecting 
 to map-reduce job tracker at: dd-9c32d04:8889
 09/10/30 13:36:48 INFO executionengine.HExecutionEngine: Connecting to 
 map-reduce job tracker at: dd-9c32d04:8889
 2009-10-30 13:36:49,242 [main] ERROR org.apache.pig.tools.grunt.Grunt - ERROR 
 2999: Unexpected internal error. null
 09/10/30 13:36:49 ERROR grunt.Grunt: ERROR 2999: Unexpected internal error. 
 null
 Details at logfile: /disk1/vega/zoom/pig_1256909801304.log

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.



[jira] Commented: (PIG-1066) ILLUSTRATE called after DESCRIBE results in Grunt: ERROR 2999: Unexpected internal error. null

2009-10-30 Thread Bogdan Dorohonceanu (JIRA)

[ 
https://issues.apache.org/jira/browse/PIG-1066?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12771951#action_12771951
 ] 

Bogdan Dorohonceanu commented on PIG-1066:
--

Actually, it looks like ILLUSTRATE crashes when used on a relation created with 
STREAM ... THROUGH 

 ILLUSTRATE called after DESCRIBE results in Grunt: ERROR 2999: Unexpected 
 internal error. null
 

 Key: PIG-1066
 URL: https://issues.apache.org/jira/browse/PIG-1066
 Project: Pig
  Issue Type: Bug
  Components: grunt
Affects Versions: 0.4.0
Reporter: Bogdan Dorohonceanu

 -- load the QID_CT_QP20 data
 x = LOAD '$FS_TD/$QID_IN_FILES' USING PigStorage('\t') AS 
 (unstem_qid:chararray, jid_score_pairs:chararray);
 DESCRIBE x;
 --ILLUSTRATE x;
 -- load the ID_RQ data
 y0 = LOAD '$FS_USER/$ID_RQ_IN_FILE' USING PigStorage('\t') AS (sid:chararray, 
 query:chararray);
 -- force parallelization
 -- y1 = ORDER y0 BY sid PARALLEL $NUM;
 -- compute unstem_qid
 DEFINE f `text_streamer_query j3_unicode.dat prop.dat normal.txt TAB TAB 
 1:yes:UNSTEM_ID:%llx` INPUT(stdin USING PigStorage('\t')) OU\
 TPUT(stdout USING PigStorage('\t')) SHIP('$USER/text_streamer_query', 
 '$USER/j3_unicode.dat', '$USER/prop.dat', '$USER/normal.txt');
 y = STREAM y0 THROUGH f AS (sid:chararray, query:chararray, 
 unstem_qid:chararray);
 DESCRIBE y;
 --ILLUSTRATE y;
 rmf /user/vega/zoom/y_debug
 STORE y INTO '/user/vega/zoom/y_debug' USING PigStorage('\t');
 2009-10-30 13:36:48,437 [main] INFO  
 org.apache.pig.backend.hadoop.executionengine.HExecutionEngine - Connecting 
 to hadoop file system at: 
 hdfs://dd-9c32d03:8887/,/teoma/dd-9c34d04/middleware/hadoop.test.data/dfs/name
 09/10/30 13:36:48 INFO executionengine.HExecutionEngine: Connecting to hadoop 
 file system at: 
 hdfs://dd-9c32d03:8887/,/teoma/dd-9c34d04/middleware/hadoop.test.data/dfs/name
 2009-10-30 13:36:48,495 [main] INFO  
 org.apache.pig.backend.hadoop.executionengine.HExecutionEngine - Connecting 
 to map-reduce job tracker at: dd-9c32d04:8889
 09/10/30 13:36:48 INFO executionengine.HExecutionEngine: Connecting to 
 map-reduce job tracker at: dd-9c32d04:8889
 2009-10-30 13:36:49,242 [main] ERROR org.apache.pig.tools.grunt.Grunt - ERROR 
 2999: Unexpected internal error. null
 09/10/30 13:36:49 ERROR grunt.Grunt: ERROR 2999: Unexpected internal error. 
 null
 Details at logfile: /disk1/vega/zoom/pig_1256909801304.log

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.