[ 
https://issues.apache.org/jira/browse/PIG-836?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14528516#comment-14528516
 ] 

Daniel Tomes commented on PIG-836:
----------------------------------

Daniel, if you actually want to use a backslash as a delimiter you mush escape 
that character first by using a second slash. For example, if your delimiter is 
\ then you would neet to use '\\' because backslash is a reserve character for 
much of regex.

> Allow setting of end-of-record delimiter in PigStorage
> ------------------------------------------------------
>
>                 Key: PIG-836
>                 URL: https://issues.apache.org/jira/browse/PIG-836
>             Project: Pig
>          Issue Type: Improvement
>          Components: impl
>            Reporter: George Mavromatis
>            Assignee: Benjamin Reed
>
> PigStorage allows overriding the default field delimiter ('\t'), but does not 
> allow overriding the record delimiter ('\n').
> It is a valid use case that fields contain new lines, e.g. because they are 
> contents of a document/web page. It is possible for the user to create a 
> custom load/store UDF to achieve that, but that is extra work on the user, 
> many users will have to do it , and that udf would be the exact code 
> duplicate of the PigStorage except for the delimiter.
> Thus, PigStorage() should allow to configure both field and record separators.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Reply via email to