[jira] [Created] (ARROW-532) [Python] Expand pyarrow.parquet documentation in advance of 0.2 release
Wes McKinney created ARROW-532: -- Summary: [Python] Expand pyarrow.parquet documentation in advance of 0.2 release Key: ARROW-532 URL: https://issues.apache.org/jira/browse/ARROW-532 Project: Apache Arrow Issue Type: Improvement Components: Python Reporter: Wes McKinney Follow up to ARROW-531 -- This message was sent by Atlassian JIRA (v6.3.15#6346)
[jira] [Resolved] (ARROW-511) [Python] List[T] conversions not implemented for single arrays
[ https://issues.apache.org/jira/browse/ARROW-511?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wes McKinney resolved ARROW-511. Resolution: Fixed Issue resolved by pull request 320 [https://github.com/apache/arrow/pull/320] > [Python] List[T] conversions not implemented for single arrays > -- > > Key: ARROW-511 > URL: https://issues.apache.org/jira/browse/ARROW-511 > Project: Apache Arrow > Issue Type: Bug > Components: Python >Reporter: Wes McKinney >Assignee: Uwe L. Korn > > It works for tables, though > {code} > In [2]: import pyarrow as pa > In [3]: arr = pa.from_pylist([[1,2,3], None, [1, 2], [], [4]]) > In [4]: arr.to_pandas() > --- > ArrowExceptionTraceback (most recent call last) > in () > > 1 arr.to_pandas() > /home/wesm/code/arrow/python/pyarrow/array.pyx in > pyarrow.array.Array.to_pandas > (/home/wesm/code/arrow/python/build/temp.linux-x86_64-3.5/array.cxx:4271)() > /home/wesm/code/arrow/python/pyarrow/error.pyx in pyarrow.error.check_status > (/home/wesm/code/arrow/python/build/temp.linux-x86_64-3.5/error.cxx:1197)() > ArrowException: NotImplemented: Arrow type reading not implemented for > list > {code} -- This message was sent by Atlassian JIRA (v6.3.15#6346)
[jira] [Resolved] (ARROW-529) Python: Add jemalloc and Python 3.6 to manylinux1 build
[ https://issues.apache.org/jira/browse/ARROW-529?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wes McKinney resolved ARROW-529. Resolution: Fixed Issue resolved by pull request 319 [https://github.com/apache/arrow/pull/319] > Python: Add jemalloc and Python 3.6 to manylinux1 build > --- > > Key: ARROW-529 > URL: https://issues.apache.org/jira/browse/ARROW-529 > Project: Apache Arrow > Issue Type: Improvement >Reporter: Uwe L. Korn >Assignee: Uwe L. Korn > -- This message was sent by Atlassian JIRA (v6.3.15#6346)
[jira] [Assigned] (ARROW-370) Python: Pandas conversion from `datetime.date` columns
[ https://issues.apache.org/jira/browse/ARROW-370?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Uwe L. Korn reassigned ARROW-370: - Assignee: Uwe L. Korn > Python: Pandas conversion from `datetime.date` columns > -- > > Key: ARROW-370 > URL: https://issues.apache.org/jira/browse/ARROW-370 > Project: Apache Arrow > Issue Type: New Feature > Components: Python >Reporter: Uwe L. Korn >Assignee: Uwe L. Korn > Labels: newbie > > It seems to be a common practice to store some columns as Python > {{datetime.date}} to avoid issues with far future/past dates in Pandas. We > can natively store this data in Arrow as well in Parquet but there is no > conversion available yet. A simple way could be to provide a path > pandas.Series -> numpy.ndarray(datetime64[D]) -> arrow.Array(DATE)) -- This message was sent by Atlassian JIRA (v6.3.15#6346)
[jira] [Resolved] (ARROW-370) Python: Pandas conversion from `datetime.date` columns
[ https://issues.apache.org/jira/browse/ARROW-370?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Uwe L. Korn resolved ARROW-370. --- Resolution: Duplicate > Python: Pandas conversion from `datetime.date` columns > -- > > Key: ARROW-370 > URL: https://issues.apache.org/jira/browse/ARROW-370 > Project: Apache Arrow > Issue Type: New Feature > Components: Python >Reporter: Uwe L. Korn >Assignee: Uwe L. Korn > Labels: newbie > > It seems to be a common practice to store some columns as Python > {{datetime.date}} to avoid issues with far future/past dates in Pandas. We > can natively store this data in Arrow as well in Parquet but there is no > conversion available yet. A simple way could be to provide a path > pandas.Series -> numpy.ndarray(datetime64[D]) -> arrow.Array(DATE)) -- This message was sent by Atlassian JIRA (v6.3.15#6346)
[jira] [Commented] (ARROW-531) Python: Document jemalloc, extend Pandas section, add Getting Involved
[ https://issues.apache.org/jira/browse/ARROW-531?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15853302#comment-15853302 ] Uwe L. Korn commented on ARROW-531: --- PR: https://github.com/apache/arrow/pull/321 > Python: Document jemalloc, extend Pandas section, add Getting Involved > -- > > Key: ARROW-531 > URL: https://issues.apache.org/jira/browse/ARROW-531 > Project: Apache Arrow > Issue Type: New Feature > Components: Python >Reporter: Uwe L. Korn >Assignee: Uwe L. Korn > > Some pre-release documentation additions. -- This message was sent by Atlassian JIRA (v6.3.15#6346)
[jira] [Created] (ARROW-531) Python: Document jemalloc, extend Pandas section, add Getting Involved
Uwe L. Korn created ARROW-531: - Summary: Python: Document jemalloc, extend Pandas section, add Getting Involved Key: ARROW-531 URL: https://issues.apache.org/jira/browse/ARROW-531 Project: Apache Arrow Issue Type: New Feature Components: Python Reporter: Uwe L. Korn Assignee: Uwe L. Korn Some pre-release documentation additions. -- This message was sent by Atlassian JIRA (v6.3.15#6346)
[jira] [Commented] (ARROW-511) [Python] List[T] conversions not implemented for single arrays
[ https://issues.apache.org/jira/browse/ARROW-511?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15853199#comment-15853199 ] Uwe L. Korn commented on ARROW-511: --- PR: https://github.com/apache/arrow/pull/320 > [Python] List[T] conversions not implemented for single arrays > -- > > Key: ARROW-511 > URL: https://issues.apache.org/jira/browse/ARROW-511 > Project: Apache Arrow > Issue Type: Bug > Components: Python >Reporter: Wes McKinney >Assignee: Uwe L. Korn > > It works for tables, though > {code} > In [2]: import pyarrow as pa > In [3]: arr = pa.from_pylist([[1,2,3], None, [1, 2], [], [4]]) > In [4]: arr.to_pandas() > --- > ArrowExceptionTraceback (most recent call last) > in () > > 1 arr.to_pandas() > /home/wesm/code/arrow/python/pyarrow/array.pyx in > pyarrow.array.Array.to_pandas > (/home/wesm/code/arrow/python/build/temp.linux-x86_64-3.5/array.cxx:4271)() > /home/wesm/code/arrow/python/pyarrow/error.pyx in pyarrow.error.check_status > (/home/wesm/code/arrow/python/build/temp.linux-x86_64-3.5/error.cxx:1197)() > ArrowException: NotImplemented: Arrow type reading not implemented for > list > {code} -- This message was sent by Atlassian JIRA (v6.3.15#6346)
[jira] [Commented] (ARROW-529) Python: Add jemalloc and Python 3.6 to manylinux1 build
[ https://issues.apache.org/jira/browse/ARROW-529?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15853191#comment-15853191 ] Uwe L. Korn commented on ARROW-529: --- PR: https://github.com/apache/arrow/pull/319 > Python: Add jemalloc and Python 3.6 to manylinux1 build > --- > > Key: ARROW-529 > URL: https://issues.apache.org/jira/browse/ARROW-529 > Project: Apache Arrow > Issue Type: Improvement >Reporter: Uwe L. Korn >Assignee: Uwe L. Korn > -- This message was sent by Atlassian JIRA (v6.3.15#6346)
[jira] [Created] (ARROW-529) Python: Add jemalloc and Python 3.6 to manylinux1 build
Uwe L. Korn created ARROW-529: - Summary: Python: Add jemalloc and Python 3.6 to manylinux1 build Key: ARROW-529 URL: https://issues.apache.org/jira/browse/ARROW-529 Project: Apache Arrow Issue Type: Improvement Reporter: Uwe L. Korn Assignee: Uwe L. Korn -- This message was sent by Atlassian JIRA (v6.3.15#6346)
[jira] [Assigned] (ARROW-511) [Python] List[T] conversions not implemented for single arrays
[ https://issues.apache.org/jira/browse/ARROW-511?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Uwe L. Korn reassigned ARROW-511: - Assignee: Uwe L. Korn > [Python] List[T] conversions not implemented for single arrays > -- > > Key: ARROW-511 > URL: https://issues.apache.org/jira/browse/ARROW-511 > Project: Apache Arrow > Issue Type: Bug > Components: Python >Reporter: Wes McKinney >Assignee: Uwe L. Korn > > It works for tables, though > {code} > In [2]: import pyarrow as pa > In [3]: arr = pa.from_pylist([[1,2,3], None, [1, 2], [], [4]]) > In [4]: arr.to_pandas() > --- > ArrowExceptionTraceback (most recent call last) > in () > > 1 arr.to_pandas() > /home/wesm/code/arrow/python/pyarrow/array.pyx in > pyarrow.array.Array.to_pandas > (/home/wesm/code/arrow/python/build/temp.linux-x86_64-3.5/array.cxx:4271)() > /home/wesm/code/arrow/python/pyarrow/error.pyx in pyarrow.error.check_status > (/home/wesm/code/arrow/python/build/temp.linux-x86_64-3.5/error.cxx:1197)() > ArrowException: NotImplemented: Arrow type reading not implemented for > list > {code} -- This message was sent by Atlassian JIRA (v6.3.15#6346)
[jira] [Resolved] (ARROW-458) Python: Expose jemalloc MemoryPool
[ https://issues.apache.org/jira/browse/ARROW-458?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Uwe L. Korn resolved ARROW-458. --- Resolution: Fixed Issue resolved by pull request 315 https://github.com/apache/arrow/pull/315 > Python: Expose jemalloc MemoryPool > -- > > Key: ARROW-458 > URL: https://issues.apache.org/jira/browse/ARROW-458 > Project: Apache Arrow > Issue Type: Improvement > Components: Python >Reporter: Uwe L. Korn >Assignee: Uwe L. Korn > > Expose the {{jemalloc::MemoryPool}} to Python users as a separate > {{pyarrow.jemalloc}} module. -- This message was sent by Atlassian JIRA (v6.3.15#6346)