[ 
https://issues.apache.org/jira/browse/CSV-150?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14501531#comment-14501531
 ] 

Benedikt Ritter commented on CSV-150:
-------------------------------------

Hello [~geo],

thank you for your patch, I've had the time to take a look:

* please don't use the tab character for indentation. Indent the code only 
using spaces
* the test case you defined can either be added to CSVParserTest oder LexerTest
* Special characters should be encoded using unicode escape sequences: 
{{StringReader stringReader = new 
StringReader("\"66\u2441\",,\"\",\"DeutscheBK\ufffe\",\"000\"\r\n");}}
* The way the test code is structured, it could throw a NPE from the finally 
block. You should check whether csvParser is != null.
* Some asserts for the expected record content should be added.

Thank you!

> Escaping is not disableable
> ---------------------------
>
>                 Key: CSV-150
>                 URL: https://issues.apache.org/jira/browse/CSV-150
>             Project: Commons CSV
>          Issue Type: Bug
>          Components: Parser
>    Affects Versions: 1.1
>            Reporter: Georg Tsakumagos
>             Fix For: Review
>
>         Attachments: CSV-150.patch
>
>
> h6. Problem
> If escaping is disabled the Lexer maps the NULL Character to the magic char  
> '\ufffe'.  I currently hit this char randomly with data. This leads to a 
> RuntimeException inside of 
> org.apache.commons.csv.Lexer.parseEncapsulatedToken(Token) with the message 
> "invalid char between encapsulated token and delimiter". 
> h6. Solution
> Don't map the Character object and use it. 
> {code:title=Lexer.java|borderStyle=solid}
>     Lexer(final CSVFormat format, final ExtendedBufferedReader reader) {
>         this.reader = reader;
>         this.delimiter = format.getDelimiter();
>         this.escape = format.getEscapeCharacter();
>         .
>         .
>         .
>     }
>     boolean isEscape(final int ch) {
>         return null != this.escape && escape.charValue() == ch;
>     }
> {code}
> h6. Hint
> This pattern is used in other cases to. It seem to be a systematic error. 
> This cases should be refactored also.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Reply via email to