[ 
https://issues.apache.org/jira/browse/TAJO-1222?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14232693#comment-14232693
 ] 

Hudson commented on TAJO-1222:
------------------------------

SUCCESS: Integrated in Tajo-master-build #476 (See 
[https://builds.apache.org/job/Tajo-master-build/476/])
TAJO-1222: DelimitedTextFile should be tolerant against parsing errors. 
(hyunsik: rev f69938abecd3d53968e318d97aba53d9acd3de40)
* 
tajo-storage/src/test/resources/dataset/TestDelimitedTextFile/testErrorTolerance1.json
* tajo-docs/src/main/sphinx/table_management/csv.rst
* tajo-storage/src/main/java/org/apache/tajo/storage/text/DelimitedTextFile.java
* 
tajo-storage/src/main/java/org/apache/tajo/storage/text/TextLineParsingError.java
* 
tajo-storage/src/test/resources/dataset/TestDelimitedTextFile/testErrorTolerance2.json
* tajo-common/src/main/java/org/apache/tajo/storage/StorageConstants.java
* 
tajo-storage/src/main/java/org/apache/tajo/storage/json/JsonLineDeserializer.java
* tajo-storage/src/test/java/org/apache/tajo/storage/TestDelimitedTextFile.java
* 
tajo-storage/src/main/java/org/apache/tajo/storage/text/TextLineDeserializer.java
* CHANGES
* 
tajo-storage/src/main/java/org/apache/tajo/storage/text/CSVLineDeserializer.java
* 
tajo-storage/src/main/java/org/apache/tajo/storage/FieldSerializerDeserializer.java


> DelimitedTextFile should be tolerant against parsing errors.
> ------------------------------------------------------------
>
>                 Key: TAJO-1222
>                 URL: https://issues.apache.org/jira/browse/TAJO-1222
>             Project: Tajo
>          Issue Type: New Feature
>          Components: storage
>            Reporter: Hyunsik Choi
>            Assignee: Hyunsik Choi
>             Fix For: 0.9.1
>
>         Attachments: TAJO-1222.patch, TAJO-1222_2.patch, TAJO-1222_3.patch
>
>
> DelimitedTextFile is a base class for plan-text file formats like CSV or 
> JSON. In practice, due to various reasons, parsing errors are usual. But, the 
> current implementation does not allow any parsing error. It is inconvenient 
> in many cases.
> The objective of this issue is to enable DelimitedTextFile to tolerate 
> parsing errors up to the number given by users.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Reply via email to