[
https://issues.apache.org/jira/browse/DRILL-3178?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15557029#comment-15557029
]
ASF GitHub Bot commented on DRILL-3178:
---------------------------------------
Github user fmethot commented on the issue:
https://github.com/apache/drill/pull/593
Thanks for the comments so far, See my newer changes, I suggest that we
remove the flag and add an extra method instead.
There is no more check for a boolean in nextChar, but instead there is an
extra method call (readNext()->readNextNoNewLineCheck())
> csv reader should allow newlines inside quotes
> -----------------------------------------------
>
> Key: DRILL-3178
> URL: https://issues.apache.org/jira/browse/DRILL-3178
> Project: Apache Drill
> Issue Type: Improvement
> Components: Storage - Text & CSV
> Affects Versions: 1.0.0
> Environment: Ubuntu Trusty 14.04.2 LTS
> Reporter: Neal McBurnett
> Assignee: F Méthot
> Fix For: Future
>
> Attachments: drill-3178.patch
>
>
> When reading a csv file which contains newlines within quoted strings, e.g.
> via
> select * from dfs.`/tmp/q.csv`;
> Drill 1.0 says:
> Error: SYSTEM ERROR: com.univocity.parsers.common.TextParsingException:
> Error processing input: Cannot use newline character within quoted string
> But many tools produce csv files with newlines in quoted strings. Drill
> should be able to handle them.
> Workaround: the csvquote program (https://github.com/dbro/csvquote) can
> encode embedded commas and newlines, and even decode them later if desired.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
