[jira] Commented: (PIG-1074) Zebra store function should allow '::' in column names in output schema
[
https://issues.apache.org/jira/browse/PIG-1074?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12784325#action_12784325
]
Alan Gates commented on PIG-1074:
-
Checked into 0.6 branch as well.
Zebra store function should allow '::' in column names in output schema
---
Key: PIG-1074
URL: https://issues.apache.org/jira/browse/PIG-1074
Project: Pig
Issue Type: Bug
Reporter: Pradeep Kamath
Assignee: Yan Zhou
Fix For: 0.6.0, 0.7.0
Attachments: PIG-1074.patch, PIG-1074.patch, PIG-1074.patch
the following script fails:
{noformat}
a = load '/zebra/singlefile/studenttab10k' using
org.apache.hadoop.zebra.pig.TableLoader() as (name, age, gpa);
b = load '/zebra/singlefile/votertab10k' using
org.apache.hadoop.zebra.pig.TableLoader() as (name, age, registration,
contributions);
c = filter a by age 20;
d = filter b by age 20;
store c into
'/user/pig/out//ZebraMultiQuery_30.out.1' using
org.apache.hadoop.zebra.pig.TableStorer('');
store d into
'/user/pig/out//ZebraMultiQuery_30.out.2' using
org.apache.hadoop.zebra.pig.TableStorer('');
e = cogroup c by name, d by name;
f = foreach e generate flatten(c), flatten(d);
store f into '/user/pig//ZebraMultiQuery_30.out.3'
using org.apache.hadoop.zebra.pig.TableStorer('');
{noformat}
Here the schema of f has names like c::name and it looks like zebra storefunc
does not allow '::' in column name
The stack trace is
ERROR 2997: Unable to recreate exception from backend error:
java.io.IOException: ColumnGroup.Writer constructor failed : Partition
constructor failed :Encountered : : at line 1, column 3.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (PIG-1074) Zebra store function should allow '::' in column names in output schema
[
https://issues.apache.org/jira/browse/PIG-1074?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12782884#action_12782884
]
Hadoop QA commented on PIG-1074:
+1 overall. Here are the results of testing the latest attachment
http://issues.apache.org/jira/secure/attachment/12426177/PIG-1074.patch
against trunk revision 884235.
+1 @author. The patch does not contain any @author tags.
+1 tests included. The patch appears to include 7 new or modified tests.
+1 javadoc. The javadoc tool did not generate any warning messages.
+1 javac. The applied patch does not increase the total number of javac
compiler warnings.
+1 findbugs. The patch does not introduce any new Findbugs warnings.
+1 release audit. The applied patch does not increase the total number of
release audit warnings.
+1 core tests. The patch passed core unit tests.
+1 contrib tests. The patch passed contrib unit tests.
Test results:
http://hudson.zones.apache.org/hudson/job/Pig-Patch-h8.grid.sp2.yahoo.net/58/testReport/
Findbugs warnings:
http://hudson.zones.apache.org/hudson/job/Pig-Patch-h8.grid.sp2.yahoo.net/58/artifact/trunk/build/test/findbugs/newPatchFindbugsWarnings.html
Console output:
http://hudson.zones.apache.org/hudson/job/Pig-Patch-h8.grid.sp2.yahoo.net/58/console
This message is automatically generated.
Zebra store function should allow '::' in column names in output schema
---
Key: PIG-1074
URL: https://issues.apache.org/jira/browse/PIG-1074
Project: Pig
Issue Type: Bug
Reporter: Pradeep Kamath
Assignee: Yan Zhou
Fix For: 0.6.0, 0.7.0
Attachments: PIG-1074.patch, PIG-1074.patch, PIG-1074.patch
the following script fails:
{noformat}
a = load '/zebra/singlefile/studenttab10k' using
org.apache.hadoop.zebra.pig.TableLoader() as (name, age, gpa);
b = load '/zebra/singlefile/votertab10k' using
org.apache.hadoop.zebra.pig.TableLoader() as (name, age, registration,
contributions);
c = filter a by age 20;
d = filter b by age 20;
store c into
'/user/pig/out//ZebraMultiQuery_30.out.1' using
org.apache.hadoop.zebra.pig.TableStorer('');
store d into
'/user/pig/out//ZebraMultiQuery_30.out.2' using
org.apache.hadoop.zebra.pig.TableStorer('');
e = cogroup c by name, d by name;
f = foreach e generate flatten(c), flatten(d);
store f into '/user/pig//ZebraMultiQuery_30.out.3'
using org.apache.hadoop.zebra.pig.TableStorer('');
{noformat}
Here the schema of f has names like c::name and it looks like zebra storefunc
does not allow '::' in column name
The stack trace is
ERROR 2997: Unable to recreate exception from backend error:
java.io.IOException: ColumnGroup.Writer constructor failed : Partition
constructor failed :Encountered : : at line 1, column 3.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (PIG-1074) Zebra store function should allow '::' in column names in output schema
[
https://issues.apache.org/jira/browse/PIG-1074?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12782698#action_12782698
]
Gaurav Jain commented on PIG-1074:
--
Looks incorrect
IDENTIFIER: ( LETTER )+ ( DIGIT | LETTER | SPECIALCHAR )* ( SCOPEOP
)? ( LETTER )* ( DIGIT | LETTER | SPECIALCHAR )*
Should be
IDENTIFIER: ( LETTER )+ ( DIGIT | LETTER | SPECIALCHAR )* ( SCOPEOP
)? ( LETTER )+ ( DIGIT | LETTER | SPECIALCHAR )*
or
IDENTIFIER: ( LETTER )+ ( DIGIT | LETTER | SPECIALCHAR )* ( SCOPEOP
)? ( DIGIT | LETTER | SPECIALCHAR )+
Zebra store function should allow '::' in column names in output schema
---
Key: PIG-1074
URL: https://issues.apache.org/jira/browse/PIG-1074
Project: Pig
Issue Type: Bug
Reporter: Pradeep Kamath
Assignee: Yan Zhou
Fix For: 0.6.0, 0.7.0
Attachments: PIG-1074.patch
the following script fails:
{noformat}
a = load '/zebra/singlefile/studenttab10k' using
org.apache.hadoop.zebra.pig.TableLoader() as (name, age, gpa);
b = load '/zebra/singlefile/votertab10k' using
org.apache.hadoop.zebra.pig.TableLoader() as (name, age, registration,
contributions);
c = filter a by age 20;
d = filter b by age 20;
store c into
'/user/pig/out//ZebraMultiQuery_30.out.1' using
org.apache.hadoop.zebra.pig.TableStorer('');
store d into
'/user/pig/out//ZebraMultiQuery_30.out.2' using
org.apache.hadoop.zebra.pig.TableStorer('');
e = cogroup c by name, d by name;
f = foreach e generate flatten(c), flatten(d);
store f into '/user/pig//ZebraMultiQuery_30.out.3'
using org.apache.hadoop.zebra.pig.TableStorer('');
{noformat}
Here the schema of f has names like c::name and it looks like zebra storefunc
does not allow '::' in column name
The stack trace is
ERROR 2997: Unable to recreate exception from backend error:
java.io.IOException: ColumnGroup.Writer constructor failed : Partition
constructor failed :Encountered : : at line 1, column 3.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (PIG-1074) Zebra store function should allow '::' in column names in output schema
[
https://issues.apache.org/jira/browse/PIG-1074?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12782708#action_12782708
]
Gaurav Jain commented on PIG-1074:
--
+1
Zebra store function should allow '::' in column names in output schema
---
Key: PIG-1074
URL: https://issues.apache.org/jira/browse/PIG-1074
Project: Pig
Issue Type: Bug
Reporter: Pradeep Kamath
Assignee: Yan Zhou
Fix For: 0.6.0, 0.7.0
Attachments: PIG-1074.patch, PIG-1074.patch
the following script fails:
{noformat}
a = load '/zebra/singlefile/studenttab10k' using
org.apache.hadoop.zebra.pig.TableLoader() as (name, age, gpa);
b = load '/zebra/singlefile/votertab10k' using
org.apache.hadoop.zebra.pig.TableLoader() as (name, age, registration,
contributions);
c = filter a by age 20;
d = filter b by age 20;
store c into
'/user/pig/out//ZebraMultiQuery_30.out.1' using
org.apache.hadoop.zebra.pig.TableStorer('');
store d into
'/user/pig/out//ZebraMultiQuery_30.out.2' using
org.apache.hadoop.zebra.pig.TableStorer('');
e = cogroup c by name, d by name;
f = foreach e generate flatten(c), flatten(d);
store f into '/user/pig//ZebraMultiQuery_30.out.3'
using org.apache.hadoop.zebra.pig.TableStorer('');
{noformat}
Here the schema of f has names like c::name and it looks like zebra storefunc
does not allow '::' in column name
The stack trace is
ERROR 2997: Unable to recreate exception from backend error:
java.io.IOException: ColumnGroup.Writer constructor failed : Partition
constructor failed :Encountered : : at line 1, column 3.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (PIG-1074) Zebra store function should allow '::' in column names in output schema
[
https://issues.apache.org/jira/browse/PIG-1074?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12782724#action_12782724
]
Gaurav Jain commented on PIG-1074:
--
+1
With the latest patch,
it allow
c::c::c::c::d
but it does not allow
aab::c
If that is needed by PIG, then we need to revisit
Zebra store function should allow '::' in column names in output schema
---
Key: PIG-1074
URL: https://issues.apache.org/jira/browse/PIG-1074
Project: Pig
Issue Type: Bug
Reporter: Pradeep Kamath
Assignee: Yan Zhou
Fix For: 0.6.0, 0.7.0
Attachments: PIG-1074.patch, PIG-1074.patch, PIG-1074.patch
the following script fails:
{noformat}
a = load '/zebra/singlefile/studenttab10k' using
org.apache.hadoop.zebra.pig.TableLoader() as (name, age, gpa);
b = load '/zebra/singlefile/votertab10k' using
org.apache.hadoop.zebra.pig.TableLoader() as (name, age, registration,
contributions);
c = filter a by age 20;
d = filter b by age 20;
store c into
'/user/pig/out//ZebraMultiQuery_30.out.1' using
org.apache.hadoop.zebra.pig.TableStorer('');
store d into
'/user/pig/out//ZebraMultiQuery_30.out.2' using
org.apache.hadoop.zebra.pig.TableStorer('');
e = cogroup c by name, d by name;
f = foreach e generate flatten(c), flatten(d);
store f into '/user/pig//ZebraMultiQuery_30.out.3'
using org.apache.hadoop.zebra.pig.TableStorer('');
{noformat}
Here the schema of f has names like c::name and it looks like zebra storefunc
does not allow '::' in column name
The stack trace is
ERROR 2997: Unable to recreate exception from backend error:
java.io.IOException: ColumnGroup.Writer constructor failed : Partition
constructor failed :Encountered : : at line 1, column 3.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (PIG-1074) Zebra store function should allow '::' in column names in output schema
[
https://issues.apache.org/jira/browse/PIG-1074?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12782725#action_12782725
]
Yan Zhou commented on PIG-1074:
---
A typo in my last comment: the identifier syntax reads as ( LETTER )+ (
DIGIT | LETTER | SPECIALCHAR )* ( SCOPEOP ( LETTER )+ ( DIGIT |
LETTER | SPECIALCHAR )*)*
Zebra store function should allow '::' in column names in output schema
---
Key: PIG-1074
URL: https://issues.apache.org/jira/browse/PIG-1074
Project: Pig
Issue Type: Bug
Reporter: Pradeep Kamath
Assignee: Yan Zhou
Fix For: 0.6.0, 0.7.0
Attachments: PIG-1074.patch, PIG-1074.patch, PIG-1074.patch
the following script fails:
{noformat}
a = load '/zebra/singlefile/studenttab10k' using
org.apache.hadoop.zebra.pig.TableLoader() as (name, age, gpa);
b = load '/zebra/singlefile/votertab10k' using
org.apache.hadoop.zebra.pig.TableLoader() as (name, age, registration,
contributions);
c = filter a by age 20;
d = filter b by age 20;
store c into
'/user/pig/out//ZebraMultiQuery_30.out.1' using
org.apache.hadoop.zebra.pig.TableStorer('');
store d into
'/user/pig/out//ZebraMultiQuery_30.out.2' using
org.apache.hadoop.zebra.pig.TableStorer('');
e = cogroup c by name, d by name;
f = foreach e generate flatten(c), flatten(d);
store f into '/user/pig//ZebraMultiQuery_30.out.3'
using org.apache.hadoop.zebra.pig.TableStorer('');
{noformat}
Here the schema of f has names like c::name and it looks like zebra storefunc
does not allow '::' in column name
The stack trace is
ERROR 2997: Unable to recreate exception from backend error:
java.io.IOException: ColumnGroup.Writer constructor failed : Partition
constructor failed :Encountered : : at line 1, column 3.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (PIG-1074) Zebra store function should allow '::' in column names in output schema
[
https://issues.apache.org/jira/browse/PIG-1074?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12782750#action_12782750
]
Hadoop QA commented on PIG-1074:
+1 overall. Here are the results of testing the latest attachment
http://issues.apache.org/jira/secure/attachment/12426166/PIG-1074.patch
against trunk revision 884235.
+1 @author. The patch does not contain any @author tags.
+1 tests included. The patch appears to include 7 new or modified tests.
+1 javadoc. The javadoc tool did not generate any warning messages.
+1 javac. The applied patch does not increase the total number of javac
compiler warnings.
+1 findbugs. The patch does not introduce any new Findbugs warnings.
+1 release audit. The applied patch does not increase the total number of
release audit warnings.
+1 core tests. The patch passed core unit tests.
+1 contrib tests. The patch passed contrib unit tests.
Test results:
http://hudson.zones.apache.org/hudson/job/Pig-Patch-h8.grid.sp2.yahoo.net/56/testReport/
Findbugs warnings:
http://hudson.zones.apache.org/hudson/job/Pig-Patch-h8.grid.sp2.yahoo.net/56/artifact/trunk/build/test/findbugs/newPatchFindbugsWarnings.html
Console output:
http://hudson.zones.apache.org/hudson/job/Pig-Patch-h8.grid.sp2.yahoo.net/56/console
This message is automatically generated.
Zebra store function should allow '::' in column names in output schema
---
Key: PIG-1074
URL: https://issues.apache.org/jira/browse/PIG-1074
Project: Pig
Issue Type: Bug
Reporter: Pradeep Kamath
Assignee: Yan Zhou
Fix For: 0.6.0, 0.7.0
Attachments: PIG-1074.patch, PIG-1074.patch, PIG-1074.patch
the following script fails:
{noformat}
a = load '/zebra/singlefile/studenttab10k' using
org.apache.hadoop.zebra.pig.TableLoader() as (name, age, gpa);
b = load '/zebra/singlefile/votertab10k' using
org.apache.hadoop.zebra.pig.TableLoader() as (name, age, registration,
contributions);
c = filter a by age 20;
d = filter b by age 20;
store c into
'/user/pig/out//ZebraMultiQuery_30.out.1' using
org.apache.hadoop.zebra.pig.TableStorer('');
store d into
'/user/pig/out//ZebraMultiQuery_30.out.2' using
org.apache.hadoop.zebra.pig.TableStorer('');
e = cogroup c by name, d by name;
f = foreach e generate flatten(c), flatten(d);
store f into '/user/pig//ZebraMultiQuery_30.out.3'
using org.apache.hadoop.zebra.pig.TableStorer('');
{noformat}
Here the schema of f has names like c::name and it looks like zebra storefunc
does not allow '::' in column name
The stack trace is
ERROR 2997: Unable to recreate exception from backend error:
java.io.IOException: ColumnGroup.Writer constructor failed : Partition
constructor failed :Encountered : : at line 1, column 3.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (PIG-1074) Zebra store function should allow '::' in column names in output schema
[
https://issues.apache.org/jira/browse/PIG-1074?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12782760#action_12782760
]
Yan Zhou commented on PIG-1074:
---
Actually there was no typo. But somehow jira takes a * ) * as a highlighted
')'. It should read as A typo in my last comment: the identifier syntax reads
as ( LETTER )+ ( DIGIT | LETTER | SPECIALCHAR )* ( SCOPEOP ( LETTER
)+ ( DIGIT | LETTER | SPECIALCHAR ) * ) *
Zebra store function should allow '::' in column names in output schema
---
Key: PIG-1074
URL: https://issues.apache.org/jira/browse/PIG-1074
Project: Pig
Issue Type: Bug
Reporter: Pradeep Kamath
Assignee: Yan Zhou
Fix For: 0.6.0, 0.7.0
Attachments: PIG-1074.patch, PIG-1074.patch, PIG-1074.patch
the following script fails:
{noformat}
a = load '/zebra/singlefile/studenttab10k' using
org.apache.hadoop.zebra.pig.TableLoader() as (name, age, gpa);
b = load '/zebra/singlefile/votertab10k' using
org.apache.hadoop.zebra.pig.TableLoader() as (name, age, registration,
contributions);
c = filter a by age 20;
d = filter b by age 20;
store c into
'/user/pig/out//ZebraMultiQuery_30.out.1' using
org.apache.hadoop.zebra.pig.TableStorer('');
store d into
'/user/pig/out//ZebraMultiQuery_30.out.2' using
org.apache.hadoop.zebra.pig.TableStorer('');
e = cogroup c by name, d by name;
f = foreach e generate flatten(c), flatten(d);
store f into '/user/pig//ZebraMultiQuery_30.out.3'
using org.apache.hadoop.zebra.pig.TableStorer('');
{noformat}
Here the schema of f has names like c::name and it looks like zebra storefunc
does not allow '::' in column name
The stack trace is
ERROR 2997: Unable to recreate exception from backend error:
java.io.IOException: ColumnGroup.Writer constructor failed : Partition
constructor failed :Encountered : : at line 1, column 3.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (PIG-1074) Zebra store function should allow '::' in column names in output schema
[
https://issues.apache.org/jira/browse/PIG-1074?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12782764#action_12782764
]
Yan Zhou commented on PIG-1074:
---
MY last comment is still messed up. the identifier syntax should reads as
( LETTER )+ ( DIGIT | LETTER | SPECIALCHAR ) * ( SCOPEOP (
LETTER )+ ( DIGIT | LETTER | SPECIALCHAR ) * ) *
Zebra store function should allow '::' in column names in output schema
---
Key: PIG-1074
URL: https://issues.apache.org/jira/browse/PIG-1074
Project: Pig
Issue Type: Bug
Reporter: Pradeep Kamath
Assignee: Yan Zhou
Fix For: 0.6.0, 0.7.0
Attachments: PIG-1074.patch, PIG-1074.patch, PIG-1074.patch
the following script fails:
{noformat}
a = load '/zebra/singlefile/studenttab10k' using
org.apache.hadoop.zebra.pig.TableLoader() as (name, age, gpa);
b = load '/zebra/singlefile/votertab10k' using
org.apache.hadoop.zebra.pig.TableLoader() as (name, age, registration,
contributions);
c = filter a by age 20;
d = filter b by age 20;
store c into
'/user/pig/out//ZebraMultiQuery_30.out.1' using
org.apache.hadoop.zebra.pig.TableStorer('');
store d into
'/user/pig/out//ZebraMultiQuery_30.out.2' using
org.apache.hadoop.zebra.pig.TableStorer('');
e = cogroup c by name, d by name;
f = foreach e generate flatten(c), flatten(d);
store f into '/user/pig//ZebraMultiQuery_30.out.3'
using org.apache.hadoop.zebra.pig.TableStorer('');
{noformat}
Here the schema of f has names like c::name and it looks like zebra storefunc
does not allow '::' in column name
The stack trace is
ERROR 2997: Unable to recreate exception from backend error:
java.io.IOException: ColumnGroup.Writer constructor failed : Partition
constructor failed :Encountered : : at line 1, column 3.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (PIG-1074) Zebra store function should allow '::' in column names in output schema
[
https://issues.apache.org/jira/browse/PIG-1074?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12782317#action_12782317
]
Hadoop QA commented on PIG-1074:
+1 overall. Here are the results of testing the latest attachment
http://issues.apache.org/jira/secure/attachment/12426051/PIG-1074.patch
against trunk revision 883903.
+1 @author. The patch does not contain any @author tags.
+1 tests included. The patch appears to include 7 new or modified tests.
+1 javadoc. The javadoc tool did not generate any warning messages.
+1 javac. The applied patch does not increase the total number of javac
compiler warnings.
+1 findbugs. The patch does not introduce any new Findbugs warnings.
+1 release audit. The applied patch does not increase the total number of
release audit warnings.
+1 core tests. The patch passed core unit tests.
+1 contrib tests. The patch passed contrib unit tests.
Test results:
http://hudson.zones.apache.org/hudson/job/Pig-Patch-h8.grid.sp2.yahoo.net/54/testReport/
Findbugs warnings:
http://hudson.zones.apache.org/hudson/job/Pig-Patch-h8.grid.sp2.yahoo.net/54/artifact/trunk/build/test/findbugs/newPatchFindbugsWarnings.html
Console output:
http://hudson.zones.apache.org/hudson/job/Pig-Patch-h8.grid.sp2.yahoo.net/54/console
This message is automatically generated.
Zebra store function should allow '::' in column names in output schema
---
Key: PIG-1074
URL: https://issues.apache.org/jira/browse/PIG-1074
Project: Pig
Issue Type: Bug
Reporter: Pradeep Kamath
Assignee: Yan Zhou
Fix For: 0.6.0, 0.7.0
Attachments: PIG-1074.patch
the following script fails:
{noformat}
a = load '/zebra/singlefile/studenttab10k' using
org.apache.hadoop.zebra.pig.TableLoader() as (name, age, gpa);
b = load '/zebra/singlefile/votertab10k' using
org.apache.hadoop.zebra.pig.TableLoader() as (name, age, registration,
contributions);
c = filter a by age 20;
d = filter b by age 20;
store c into
'/user/pig/out//ZebraMultiQuery_30.out.1' using
org.apache.hadoop.zebra.pig.TableStorer('');
store d into
'/user/pig/out//ZebraMultiQuery_30.out.2' using
org.apache.hadoop.zebra.pig.TableStorer('');
e = cogroup c by name, d by name;
f = foreach e generate flatten(c), flatten(d);
store f into '/user/pig//ZebraMultiQuery_30.out.3'
using org.apache.hadoop.zebra.pig.TableStorer('');
{noformat}
Here the schema of f has names like c::name and it looks like zebra storefunc
does not allow '::' in column name
The stack trace is
ERROR 2997: Unable to recreate exception from backend error:
java.io.IOException: ColumnGroup.Writer constructor failed : Partition
constructor failed :Encountered : : at line 1, column 3.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (PIG-1074) Zebra store function should allow '::' in column names in output schema
[
https://issues.apache.org/jira/browse/PIG-1074?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12780743#action_12780743
]
Yan Zhou commented on PIG-1074:
---
This pacth is also targeted for the 0.6 release so it needs to be on the 0.6
branch too.
Zebra store function should allow '::' in column names in output schema
---
Key: PIG-1074
URL: https://issues.apache.org/jira/browse/PIG-1074
Project: Pig
Issue Type: Bug
Reporter: Pradeep Kamath
the following script fails:
{noformat}
a = load '/zebra/singlefile/studenttab10k' using
org.apache.hadoop.zebra.pig.TableLoader() as (name, age, gpa);
b = load '/zebra/singlefile/votertab10k' using
org.apache.hadoop.zebra.pig.TableLoader() as (name, age, registration,
contributions);
c = filter a by age 20;
d = filter b by age 20;
store c into
'/user/pig/out//ZebraMultiQuery_30.out.1' using
org.apache.hadoop.zebra.pig.TableStorer('');
store d into
'/user/pig/out//ZebraMultiQuery_30.out.2' using
org.apache.hadoop.zebra.pig.TableStorer('');
e = cogroup c by name, d by name;
f = foreach e generate flatten(c), flatten(d);
store f into '/user/pig//ZebraMultiQuery_30.out.3'
using org.apache.hadoop.zebra.pig.TableStorer('');
{noformat}
Here the schema of f has names like c::name and it looks like zebra storefunc
does not allow '::' in column name
The stack trace is
ERROR 2997: Unable to recreate exception from backend error:
java.io.IOException: ColumnGroup.Writer constructor failed : Partition
constructor failed :Encountered : : at line 1, column 3.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
