[
https://issues.apache.org/jira/browse/PIG-2245?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13092008#comment-13092008
]
Ashutosh Chauhan commented on PIG-2245:
---------------------------------------
Some test scenarios:
{code}
a = load 'data' as (f1:chararray);
b = foreach a generate TOKENIZE(f1);
dump b;
a = load 'data' as (f1:chararray);
b = foreach a generate TOKENIZE(f1,"|");
dump b;
a = load 'data' as (f1:chararray);
b = foreach a generate TOKENIZE(f1,'|');
dump b;
a = load 'data' as (f1:chararray);
b = foreach a generate TOKENIZE($0,'|');
dump b;
a = load 'data' as (f1:chararray);
b = foreach a generate TOKENIZE(f1,'"');
dump b;
a = load 'data' as (f1:chararray);
b = foreach a generate TOKENIZE(f1,'\'');
dump b;
{code}
> Add end to end test for tokenize
> --------------------------------
>
> Key: PIG-2245
> URL: https://issues.apache.org/jira/browse/PIG-2245
> Project: Pig
> Issue Type: Test
> Components: internal-udfs
> Affects Versions: 0.10
> Reporter: Ashutosh Chauhan
> Assignee: Mark Roddy
> Fix For: 0.10
>
>
> via test harness.
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira