[ 
https://issues.apache.org/jira/browse/PIG-2245?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13092008#comment-13092008
 ] 

Ashutosh Chauhan commented on PIG-2245:
---------------------------------------

Some test scenarios:

{code}
a = load 'data' as (f1:chararray);
b = foreach a generate TOKENIZE(f1);
dump b;

a = load 'data' as (f1:chararray);
b = foreach a generate TOKENIZE(f1,"|");
dump b;


a = load 'data' as (f1:chararray);
b = foreach a generate TOKENIZE(f1,'|');
dump b;


a = load 'data' as (f1:chararray);
b = foreach a generate TOKENIZE($0,'|');
dump b;


a = load 'data' as (f1:chararray);
b = foreach a generate TOKENIZE(f1,'"');
dump b;


a = load 'data' as (f1:chararray);
b = foreach a generate TOKENIZE(f1,'\'');
dump b;

{code}

> Add end to end test for tokenize
> --------------------------------
>
>                 Key: PIG-2245
>                 URL: https://issues.apache.org/jira/browse/PIG-2245
>             Project: Pig
>          Issue Type: Test
>          Components: internal-udfs
>    Affects Versions: 0.10
>            Reporter: Ashutosh Chauhan
>            Assignee: Mark Roddy
>             Fix For: 0.10
>
>
> via test harness.

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

Reply via email to