[
https://issues.apache.org/jira/browse/TIKA-2833?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16780851#comment-16780851
]
Tim Allison edited comment on TIKA-2833 at 2/28/19 7:34 PM:
------------------------------------------------------------
The newer reports on csvs alone look decent. There are some files that now
cause parse exceptions because they have malformed encapsulation -- 57 csvs out
of ~17,500 files.
The most common:
{noformat}
"the","quick"brown"fox","jumped"
{noformat}
{noformat}
"the","quick","
"brown fox","jumped"
{noformat}
was (Author: [email protected]):
The newer reports on csvs alone look decent. There are some files that now
cause parse exceptions because they have malformed encapsulation.
The most common:
{noformat}
"the","quick"brown"fox","jumped"
{noformat}
{noformat}
"the","quick","
"brown fox","jumped"
{noformat}
> Add a CSV/TSV detector
> ----------------------
>
> Key: TIKA-2833
> URL: https://issues.apache.org/jira/browse/TIKA-2833
> Project: Tika
> Issue Type: Task
> Reporter: Tim Allison
> Priority: Minor
> Attachments: csv_reports.zip
>
>
> Given initial experimentation, I think we can fairly easily add a fairly
> robust CSV/TSV detector that will identify well-formed (ha!) csvs and return
> the charset encoding and the delimiter.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
