[
https://issues.apache.org/jira/browse/ARROW-13914?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17410720#comment-17410720
]
Krisztian Szucs commented on ARROW-13914:
-----------------------------------------
Data can come from a variety of noisy sources like pickle/json/csv files and
eventually arrow will serve as the first efficient format to convert into
(rather than hopping through numpy arrays or pandas series), so a convenient
while performant inference layer would be nice to have.
> [C++][Python] Optimize type inference when converting from python values
> ------------------------------------------------------------------------
>
> Key: ARROW-13914
> URL: https://issues.apache.org/jira/browse/ARROW-13914
> Project: Apache Arrow
> Issue Type: Improvement
> Components: Python
> Reporter: Krisztian Szucs
> Priority: Minor
>
> Currently we use an extensive set of checks to infer arrow type from python
> sequences.
> Last time I checked using asv, the inference part had a significant overhead.
> We could try other approaches to speed-up the type inference, see comments:
> https://github.com/apache/arrow/pull/11076#discussion_r702808196
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
