jorisvandenbossche commented on PR #34128: URL: https://github.com/apache/arrow/pull/34128#issuecomment-1429773835
I was a bit surprised by this default, but indeed it has been True as default from the start: https://github.com/apache/arrow/pull/3257 (the PR mentions some rationale for the default; the default is only False on the C++ side) But be careful with a test like that, because Python itself also does some small string interning. If you create such a list in Python: ```python >>> l = ["one", "one"] >>> id(l[0]) == id(l[1]) True ``` But it seems that with the Python C API we use when creating those strings in the to_pandas conversion, this string interning is not used. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
