[
https://issues.apache.org/jira/browse/ARROW-2059?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16541898#comment-16541898
]
Antoine Pitrou commented on ARROW-2059:
---------------------------------------
Here is a profile tree got by exercising the write path on Python 3.6:
{code}
- arrow::py::NumPyConverter::ConvertObjectStrings()
- 80,27% arrow::py::AppendObjectStrings(tagPyArrayObject*,
tagPyArrayObject*, long, bool, arrow::StringBuilder*, long*, bool*)
- 50,74% arrow::py::internal::BuilderAppend(arrow::StringBuilder*,
_object*, bool, bool*)
- 24,95% arrow::BinaryBuilder::Append(unsigned char const*, int)
7,43% arrow::BinaryBuilder::AppendNextOffset()
+ 6,28% arrow::BufferBuilder::Resize(long, bool)
2,30% __memcpy_avx_unaligned
0,71% arrow::ArrayBuilder::Reserve(long)
6,16% PyUnicode_AsUTF8AndSize
+ 4,37% PyErr_Occurred
- 16,70% arrow::py::internal::PandasObjectIsNull(_object*)
- 8,29% arrow::py::internal::PyDecimal_Check(_object*)
PyType_IsSubtype
- 4,59% arrow::py::internal::PyFloat_IsNaN(_object*)
PyType_IsSubtype
2,51% PyArray_MultiplyList
2,41% PyType_IsSubtype
+ 1,57% arrow::ArrayBuilder::Finish(std::shared_ptr<arrow::Array>*)
{code}
> [Python] Possible performance regression in Feather read/write path
> -------------------------------------------------------------------
>
> Key: ARROW-2059
> URL: https://issues.apache.org/jira/browse/ARROW-2059
> Project: Apache Arrow
> Issue Type: Bug
> Components: Python
> Reporter: Wes McKinney
> Assignee: Jingyuan Wang
> Priority: Major
> Fix For: 0.11.0
>
>
> See discussion in https://github.com/wesm/feather/issues/329. Needs to be
> investigated
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
