[
https://issues.apache.org/jira/browse/ARROW-7251?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16981748#comment-16981748
]
Antoine Pitrou commented on ARROW-7251:
---------------------------------------
Well, using Arrow directly should generally be much faster than going through
Pandas. I'd be curious about your experience.
If disk space is not an issue, you might convert your CSV files to UTF-8
upfront (for example using iconv or even Python).
> [Python] Open CSVs with different encodings
> -------------------------------------------
>
> Key: ARROW-7251
> URL: https://issues.apache.org/jira/browse/ARROW-7251
> Project: Apache Arrow
> Issue Type: Wish
> Components: Python
> Reporter: Sascha Hofmann
> Priority: Major
>
> I would like to open an UTF-16 encoded CSVs (among others) without
> preprocessing in let's say Pandas. Is there maybe a way to do this already ?
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
