[
https://issues.apache.org/jira/browse/ARROW-13028?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17394197#comment-17394197
]
Antoine Pitrou commented on ARROW-13028:
----------------------------------------
Sorry for not answering earlier:
> Is this by design or accident?
I would say by accident, but I'm not sure what you mean with "the precision of
the string is too much for a float". Strictly speaking, some very short decimal
numbers are not exactly representable in binary floating-point, for example
"0.3". Should we reject them?
> Is there any interest in adding this for at least ints?
Potentially. [~npr] [~jonkeane] what do you think?
> [C++] CSV add convert option to attempt 32bit number inferences
> ---------------------------------------------------------------
>
> Key: ARROW-13028
> URL: https://issues.apache.org/jira/browse/ARROW-13028
> Project: Apache Arrow
> Issue Type: Improvement
> Components: C++
> Reporter: Nate Clark
> Assignee: Nate Clark
> Priority: Major
>
> When types are being inferred by CSV the numbers are always 64 bit. For large
> data sets it could be better to use 32 bit types to save over all memory. To
> do this it would be useful to add an option to ConvertOptions to try 32 bit
> numbers before 64 bit. By default this option would be disabled.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
