[jira] [Created] (ARROW-532) [Python] Expand pyarrow.parquet documentation in advance of 0.2 release

2017-02-05 Thread Wes McKinney (JIRA)
Wes McKinney created ARROW-532:
--

 Summary: [Python] Expand pyarrow.parquet documentation in advance 
of 0.2 release
 Key: ARROW-532
 URL: https://issues.apache.org/jira/browse/ARROW-532
 Project: Apache Arrow
  Issue Type: Improvement
  Components: Python
Reporter: Wes McKinney


Follow up to ARROW-531



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)


[jira] [Resolved] (ARROW-511) [Python] List[T] conversions not implemented for single arrays

2017-02-05 Thread Wes McKinney (JIRA)

 [ 
https://issues.apache.org/jira/browse/ARROW-511?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Wes McKinney resolved ARROW-511.

Resolution: Fixed

Issue resolved by pull request 320
[https://github.com/apache/arrow/pull/320]

> [Python] List[T] conversions not implemented for single arrays
> --
>
> Key: ARROW-511
> URL: https://issues.apache.org/jira/browse/ARROW-511
> Project: Apache Arrow
>  Issue Type: Bug
>  Components: Python
>Reporter: Wes McKinney
>Assignee: Uwe L. Korn
>
> It works for tables, though
> {code}
> In [2]: import pyarrow as pa
> In [3]: arr = pa.from_pylist([[1,2,3], None, [1, 2], [], [4]])
> In [4]: arr.to_pandas()
> ---
> ArrowExceptionTraceback (most recent call last)
>  in ()
> > 1 arr.to_pandas()
> /home/wesm/code/arrow/python/pyarrow/array.pyx in 
> pyarrow.array.Array.to_pandas 
> (/home/wesm/code/arrow/python/build/temp.linux-x86_64-3.5/array.cxx:4271)()
> /home/wesm/code/arrow/python/pyarrow/error.pyx in pyarrow.error.check_status 
> (/home/wesm/code/arrow/python/build/temp.linux-x86_64-3.5/error.cxx:1197)()
> ArrowException: NotImplemented: Arrow type reading not implemented for 
> list
> {code}



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)


[jira] [Resolved] (ARROW-529) Python: Add jemalloc and Python 3.6 to manylinux1 build

2017-02-05 Thread Wes McKinney (JIRA)

 [ 
https://issues.apache.org/jira/browse/ARROW-529?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Wes McKinney resolved ARROW-529.

Resolution: Fixed

Issue resolved by pull request 319
[https://github.com/apache/arrow/pull/319]

> Python: Add jemalloc and Python 3.6 to manylinux1 build
> ---
>
> Key: ARROW-529
> URL: https://issues.apache.org/jira/browse/ARROW-529
> Project: Apache Arrow
>  Issue Type: Improvement
>Reporter: Uwe L. Korn
>Assignee: Uwe L. Korn
>




--
This message was sent by Atlassian JIRA
(v6.3.15#6346)


[jira] [Assigned] (ARROW-370) Python: Pandas conversion from `datetime.date` columns

2017-02-05 Thread Uwe L. Korn (JIRA)

 [ 
https://issues.apache.org/jira/browse/ARROW-370?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Uwe L. Korn reassigned ARROW-370:
-

Assignee: Uwe L. Korn

> Python: Pandas conversion from `datetime.date` columns
> --
>
> Key: ARROW-370
> URL: https://issues.apache.org/jira/browse/ARROW-370
> Project: Apache Arrow
>  Issue Type: New Feature
>  Components: Python
>Reporter: Uwe L. Korn
>Assignee: Uwe L. Korn
>  Labels: newbie
>
> It seems to be a common practice to store some columns as Python 
> {{datetime.date}} to avoid issues with far future/past dates in Pandas. We 
> can natively store this data in Arrow as well in Parquet but there is no 
> conversion available yet. A simple way could be to provide a path 
> pandas.Series -> numpy.ndarray(datetime64[D]) -> arrow.Array(DATE))



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)


[jira] [Resolved] (ARROW-370) Python: Pandas conversion from `datetime.date` columns

2017-02-05 Thread Uwe L. Korn (JIRA)

 [ 
https://issues.apache.org/jira/browse/ARROW-370?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Uwe L. Korn resolved ARROW-370.
---
Resolution: Duplicate

> Python: Pandas conversion from `datetime.date` columns
> --
>
> Key: ARROW-370
> URL: https://issues.apache.org/jira/browse/ARROW-370
> Project: Apache Arrow
>  Issue Type: New Feature
>  Components: Python
>Reporter: Uwe L. Korn
>Assignee: Uwe L. Korn
>  Labels: newbie
>
> It seems to be a common practice to store some columns as Python 
> {{datetime.date}} to avoid issues with far future/past dates in Pandas. We 
> can natively store this data in Arrow as well in Parquet but there is no 
> conversion available yet. A simple way could be to provide a path 
> pandas.Series -> numpy.ndarray(datetime64[D]) -> arrow.Array(DATE))



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)


[jira] [Commented] (ARROW-531) Python: Document jemalloc, extend Pandas section, add Getting Involved

2017-02-05 Thread Uwe L. Korn (JIRA)

[ 
https://issues.apache.org/jira/browse/ARROW-531?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15853302#comment-15853302
 ] 

Uwe L. Korn commented on ARROW-531:
---

PR: https://github.com/apache/arrow/pull/321

> Python: Document jemalloc, extend Pandas section, add Getting Involved
> --
>
> Key: ARROW-531
> URL: https://issues.apache.org/jira/browse/ARROW-531
> Project: Apache Arrow
>  Issue Type: New Feature
>  Components: Python
>Reporter: Uwe L. Korn
>Assignee: Uwe L. Korn
>
> Some pre-release documentation additions.



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)


[jira] [Created] (ARROW-531) Python: Document jemalloc, extend Pandas section, add Getting Involved

2017-02-05 Thread Uwe L. Korn (JIRA)
Uwe L. Korn created ARROW-531:
-

 Summary: Python: Document jemalloc, extend Pandas section, add 
Getting Involved
 Key: ARROW-531
 URL: https://issues.apache.org/jira/browse/ARROW-531
 Project: Apache Arrow
  Issue Type: New Feature
  Components: Python
Reporter: Uwe L. Korn
Assignee: Uwe L. Korn


Some pre-release documentation additions.



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)


[jira] [Commented] (ARROW-511) [Python] List[T] conversions not implemented for single arrays

2017-02-05 Thread Uwe L. Korn (JIRA)

[ 
https://issues.apache.org/jira/browse/ARROW-511?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15853199#comment-15853199
 ] 

Uwe L. Korn commented on ARROW-511:
---

PR: https://github.com/apache/arrow/pull/320

> [Python] List[T] conversions not implemented for single arrays
> --
>
> Key: ARROW-511
> URL: https://issues.apache.org/jira/browse/ARROW-511
> Project: Apache Arrow
>  Issue Type: Bug
>  Components: Python
>Reporter: Wes McKinney
>Assignee: Uwe L. Korn
>
> It works for tables, though
> {code}
> In [2]: import pyarrow as pa
> In [3]: arr = pa.from_pylist([[1,2,3], None, [1, 2], [], [4]])
> In [4]: arr.to_pandas()
> ---
> ArrowExceptionTraceback (most recent call last)
>  in ()
> > 1 arr.to_pandas()
> /home/wesm/code/arrow/python/pyarrow/array.pyx in 
> pyarrow.array.Array.to_pandas 
> (/home/wesm/code/arrow/python/build/temp.linux-x86_64-3.5/array.cxx:4271)()
> /home/wesm/code/arrow/python/pyarrow/error.pyx in pyarrow.error.check_status 
> (/home/wesm/code/arrow/python/build/temp.linux-x86_64-3.5/error.cxx:1197)()
> ArrowException: NotImplemented: Arrow type reading not implemented for 
> list
> {code}



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)


[jira] [Commented] (ARROW-529) Python: Add jemalloc and Python 3.6 to manylinux1 build

2017-02-05 Thread Uwe L. Korn (JIRA)

[ 
https://issues.apache.org/jira/browse/ARROW-529?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15853191#comment-15853191
 ] 

Uwe L. Korn commented on ARROW-529:
---

PR: https://github.com/apache/arrow/pull/319

> Python: Add jemalloc and Python 3.6 to manylinux1 build
> ---
>
> Key: ARROW-529
> URL: https://issues.apache.org/jira/browse/ARROW-529
> Project: Apache Arrow
>  Issue Type: Improvement
>Reporter: Uwe L. Korn
>Assignee: Uwe L. Korn
>




--
This message was sent by Atlassian JIRA
(v6.3.15#6346)


[jira] [Created] (ARROW-529) Python: Add jemalloc and Python 3.6 to manylinux1 build

2017-02-05 Thread Uwe L. Korn (JIRA)
Uwe L. Korn created ARROW-529:
-

 Summary: Python: Add jemalloc and Python 3.6 to manylinux1 build
 Key: ARROW-529
 URL: https://issues.apache.org/jira/browse/ARROW-529
 Project: Apache Arrow
  Issue Type: Improvement
Reporter: Uwe L. Korn
Assignee: Uwe L. Korn






--
This message was sent by Atlassian JIRA
(v6.3.15#6346)


[jira] [Assigned] (ARROW-511) [Python] List[T] conversions not implemented for single arrays

2017-02-05 Thread Uwe L. Korn (JIRA)

 [ 
https://issues.apache.org/jira/browse/ARROW-511?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Uwe L. Korn reassigned ARROW-511:
-

Assignee: Uwe L. Korn

> [Python] List[T] conversions not implemented for single arrays
> --
>
> Key: ARROW-511
> URL: https://issues.apache.org/jira/browse/ARROW-511
> Project: Apache Arrow
>  Issue Type: Bug
>  Components: Python
>Reporter: Wes McKinney
>Assignee: Uwe L. Korn
>
> It works for tables, though
> {code}
> In [2]: import pyarrow as pa
> In [3]: arr = pa.from_pylist([[1,2,3], None, [1, 2], [], [4]])
> In [4]: arr.to_pandas()
> ---
> ArrowExceptionTraceback (most recent call last)
>  in ()
> > 1 arr.to_pandas()
> /home/wesm/code/arrow/python/pyarrow/array.pyx in 
> pyarrow.array.Array.to_pandas 
> (/home/wesm/code/arrow/python/build/temp.linux-x86_64-3.5/array.cxx:4271)()
> /home/wesm/code/arrow/python/pyarrow/error.pyx in pyarrow.error.check_status 
> (/home/wesm/code/arrow/python/build/temp.linux-x86_64-3.5/error.cxx:1197)()
> ArrowException: NotImplemented: Arrow type reading not implemented for 
> list
> {code}



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)


[jira] [Resolved] (ARROW-458) Python: Expose jemalloc MemoryPool

2017-02-05 Thread Uwe L. Korn (JIRA)

 [ 
https://issues.apache.org/jira/browse/ARROW-458?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Uwe L. Korn resolved ARROW-458.
---
Resolution: Fixed

Issue resolved by pull request 315
https://github.com/apache/arrow/pull/315

> Python: Expose jemalloc MemoryPool
> --
>
> Key: ARROW-458
> URL: https://issues.apache.org/jira/browse/ARROW-458
> Project: Apache Arrow
>  Issue Type: Improvement
>  Components: Python
>Reporter: Uwe L. Korn
>Assignee: Uwe L. Korn
>
> Expose the {{jemalloc::MemoryPool}} to Python users as a separate 
> {{pyarrow.jemalloc}} module.



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)