[jira] Updated: (PIG-690) UNION doesn't work in the latest code

2009-03-03 Thread Santhosh Srinivasan (JIRA) 

 [ 
https://issues.apache.org/jira/browse/PIG-690?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Santhosh Srinivasan updated PIG-690:


  Resolution: Fixed
Hadoop Flags: [Reviewed]
  Status: Resolved  (was: Patch Available)

Patch has been committed. Thanks for fixing this issue Pradeep.

 UNION doesn't work in the latest code
 -

 Key: PIG-690
 URL: https://issues.apache.org/jira/browse/PIG-690
 Project: Pig
  Issue Type: Bug
Affects Versions: types_branch
 Environment: mapred mode. local mode.has the same problem under linux.
 code is taken from trunk
Reporter: Amir Youssefi
Assignee: Pradeep Kamath
 Fix For: types_branch

 Attachments: PIG-690.patch


 grunt a = load 'tmp/f1' using BinStorage();
 grunt b = load 'tmp/f2' using BinStorage();
 grunt describe a;
 a: {int,chararray,int,{(int,chararray,chararray)}}
 grunt describe b;
 b: {int,chararray,int,{(int,chararray,chararray)}}
 grunt c = union a,b;
 grunt describe c;
 2009-02-27 11:51:46,012 [main] ERROR org.apache.pig.tools.grunt.Grunt - ERROR 
 1052: Cannot cast bag with schema bag({(int,chararray,chararray)}) to tuple 
 with schema tuple
 Details at logfile: /homes/amiry/pig_1235735380348.log
 dump a and dump b work fine.
 Sample data provided to dev team in an e-mail.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.

Re: [jira] Updated: (PIG-690) UNION doesn't work in the latest code

2009-03-03 Thread Mridul Muralidharan 


Great, thanks !
I am assuming this might also fix load related schema issues too (with 
BinStorage) ? Looked kind of similar issue as I reported in pig usergroup.


- Mridul

Pradeep Kamath (JIRA) wrote:

 [ 
https://issues.apache.org/jira/browse/PIG-690?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Pradeep Kamath updated PIG-690:
---

Fix Version/s: types_branch
 Assignee: Pradeep Kamath
Affects Version/s: types_branch
   Status: Patch Available  (was: Open)

The root cause of the issue is while merging schemas, the code recursively merges subschemas if a field is a tuple or a bag. At that point, it does not properly attribute the type to be bag if that was the case. It always marks the type as tuple whenever the field schema is of type bag or tuple. This is fixed in the patch and a unit test case has been added which tries to union two relations which have a bag field. 




UNION doesn't work in the latest code
-

Key: PIG-690
URL: https://issues.apache.org/jira/browse/PIG-690
Project: Pig
 Issue Type: Bug
   Affects Versions: types_branch
Environment: mapred mode. local mode.has the same problem under linux.
code is taken from trunk
   Reporter: Amir Youssefi
   Assignee: Pradeep Kamath
Fix For: types_branch

Attachments: PIG-690.patch


grunt a = load 'tmp/f1' using BinStorage();
grunt b = load 'tmp/f2' using BinStorage();
grunt describe a;
a: {int,chararray,int,{(int,chararray,chararray)}}
grunt describe b;
b: {int,chararray,int,{(int,chararray,chararray)}}
grunt c = union a,b;
grunt describe c;
2009-02-27 11:51:46,012 [main] ERROR org.apache.pig.tools.grunt.Grunt - ERROR 
1052: Cannot cast bag with schema bag({(int,chararray,chararray)}) to tuple 
with schema tuple
Details at logfile: /homes/amiry/pig_1235735380348.log
dump a and dump b work fine.
Sample data provided to dev team in an e-mail.

[jira] Updated: (PIG-690) UNION doesn't work in the latest code

2009-03-02 Thread Pradeep Kamath (JIRA) 

 [ 
https://issues.apache.org/jira/browse/PIG-690?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Pradeep Kamath updated PIG-690:
---

Attachment: PIG-690.patch

 UNION doesn't work in the latest code
 -

 Key: PIG-690
 URL: https://issues.apache.org/jira/browse/PIG-690
 Project: Pig
  Issue Type: Bug
Affects Versions: types_branch
 Environment: mapred mode. local mode.has the same problem under linux.
 code is taken from trunk
Reporter: Amir Youssefi
Assignee: Pradeep Kamath
 Fix For: types_branch

 Attachments: PIG-690.patch


 grunt a = load 'tmp/f1' using BinStorage();
 grunt b = load 'tmp/f2' using BinStorage();
 grunt describe a;
 a: {int,chararray,int,{(int,chararray,chararray)}}
 grunt describe b;
 b: {int,chararray,int,{(int,chararray,chararray)}}
 grunt c = union a,b;
 grunt describe c;
 2009-02-27 11:51:46,012 [main] ERROR org.apache.pig.tools.grunt.Grunt - ERROR 
 1052: Cannot cast bag with schema bag({(int,chararray,chararray)}) to tuple 
 with schema tuple
 Details at logfile: /homes/amiry/pig_1235735380348.log
 dump a and dump b work fine.
 Sample data provided to dev team in an e-mail.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.