[jira] [Commented] (ARROW-1678) [Python] Incorrect serialization of numpy.float16

[ https://issues.apache.org/jira/browse/ARROW-1678?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16205681#comment-16205681 ] Licht Takeuchi commented on ARROW-1678: --- I also made the patch for this issue. > [Python] Incorrect

[jira] [Created] (ARROW-1678) [Python] Incorrect serialization of numpy.float16

Licht Takeuchi created ARROW-1678: - Summary: [Python] Incorrect serialization of numpy.float16 Key: ARROW-1678 URL: https://issues.apache.org/jira/browse/ARROW-1678 Project: Apache Arrow

[jira] [Updated] (ARROW-1678) [Python] Incorrect serialization of numpy.float16

[ https://issues.apache.org/jira/browse/ARROW-1678?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Licht Takeuchi updated ARROW-1678: -- Affects Version/s: 0.7.1 > [Python] Incorrect serialization of numpy.float16 >

[jira] [Assigned] (ARROW-480) [Python] Add accessors for Parquet column statistics

[ https://issues.apache.org/jira/browse/ARROW-480?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Licht Takeuchi reassigned ARROW-480: Assignee: Licht Takeuchi > [Python] Add accessors for Parquet column statistics >

[jira] [Comment Edited] (ARROW-1436) PyArrow Timestamps written to Parquet as INT96 appear in Spark as 'bigint'

[ https://issues.apache.org/jira/browse/ARROW-1436?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16265991#comment-16265991 ] Licht Takeuchi edited comment on ARROW-1436 at 11/26/17 12:44 PM: -- Here

[jira] [Commented] (ARROW-1436) PyArrow Timestamps written to Parquet as INT96 appear in Spark as 'bigint'

[ https://issues.apache.org/jira/browse/ARROW-1436?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16265991#comment-16265991 ] Licht Takeuchi commented on ARROW-1436: --- Here is the old Scala@1.5.0 result. {code:java} scala> //

[jira] [Commented] (ARROW-1436) PyArrow Timestamps written to Parquet as INT96 appear in Spark as 'bigint'

[ https://issues.apache.org/jira/browse/ARROW-1436?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16265989#comment-16265989 ] Licht Takeuchi commented on ARROW-1436: --- [~wesmckinn] This seems already fixed. * Python code:

[jira] [Comment Edited] (ARROW-1436) PyArrow Timestamps written to Parquet as INT96 appear in Spark as 'bigint'

[ https://issues.apache.org/jira/browse/ARROW-1436?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16265989#comment-16265989 ] Licht Takeuchi edited comment on ARROW-1436 at 11/26/17 12:39 PM: --

[jira] [Assigned] (ARROW-1436) PyArrow Timestamps written to Parquet as INT96 appear in Spark as 'bigint'

[ https://issues.apache.org/jira/browse/ARROW-1436?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Licht Takeuchi reassigned ARROW-1436: - Assignee: Licht Takeuchi > PyArrow Timestamps written to Parquet as INT96 appear in

[jira] [Comment Edited] (ARROW-1436) PyArrow Timestamps written to Parquet as INT96 appear in Spark as 'bigint'

[ https://issues.apache.org/jira/browse/ARROW-1436?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16265989#comment-16265989 ] Licht Takeuchi edited comment on ARROW-1436 at 11/26/17 12:39 PM: --

[jira] [Comment Edited] (ARROW-1436) PyArrow Timestamps written to Parquet as INT96 appear in Spark as 'bigint'

[ https://issues.apache.org/jira/browse/ARROW-1436?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16265989#comment-16265989 ] Licht Takeuchi edited comment on ARROW-1436 at 11/26/17 12:38 PM: --

[jira] [Assigned] (ARROW-1758) [Python] Remove pickle=True option for object serialization

[ https://issues.apache.org/jira/browse/ARROW-1758?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Licht Takeuchi reassigned ARROW-1758: - Assignee: Licht Takeuchi > [Python] Remove pickle=True option for object serialization >

[jira] [Assigned] (ARROW-1773) [C++] Add casts from date/time types to compatible signed integers

[ https://issues.apache.org/jira/browse/ARROW-1773?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Licht Takeuchi reassigned ARROW-1773: - Assignee: Licht Takeuchi > [C++] Add casts from date/time types to compatible signed

[jira] [Commented] (ARROW-971) [C++/Python] Implement Array.isvalid/notnull/isnull

[ https://issues.apache.org/jira/browse/ARROW-971?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16249741#comment-16249741 ] Licht Takeuchi commented on ARROW-971: -- [~wesmckinn] Is this already implemented in C++?

[jira] [Comment Edited] (ARROW-1756) [Python] Observed int32 overflow in Feather write/read path

[ https://issues.apache.org/jira/browse/ARROW-1756?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16234048#comment-16234048 ] Licht Takeuchi edited comment on ARROW-1756 at 11/1/17 1:19 PM:

[jira] [Commented] (ARROW-1756) [Python] Observed int32 overflow in Feather write/read path

[ https://issues.apache.org/jira/browse/ARROW-1756?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16234048#comment-16234048 ] Licht Takeuchi commented on ARROW-1756: --- [~wesmckinn] I found issues on Python and numpy.

[jira] [Assigned] (ARROW-1756) [Python] Observed int32 overflow in Feather write/read path

[ https://issues.apache.org/jira/browse/ARROW-1756?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Licht Takeuchi reassigned ARROW-1756: - Assignee: Licht Takeuchi > [Python] Observed int32 overflow in Feather write/read path >

[jira] [Assigned] (ARROW-1767) [C++] Support file reads and writes over 2GB on Windows

[ https://issues.apache.org/jira/browse/ARROW-1767?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Licht Takeuchi reassigned ARROW-1767: - Assignee: Licht Takeuchi > [C++] Support file reads and writes over 2GB on Windows >

[jira] [Assigned] (ARROW-1487) [C++] Implement casts from List to List, where a cast function is defined from any A to B

[ https://issues.apache.org/jira/browse/ARROW-1487?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Licht Takeuchi reassigned ARROW-1487: - Assignee: Licht Takeuchi > [C++] Implement casts from List to List, where a cast

[jira] [Comment Edited] (ARROW-1483) [C++] Implement casts between time32 and time64

[ https://issues.apache.org/jira/browse/ARROW-1483?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16275933#comment-16275933 ] Licht Takeuchi edited comment on ARROW-1483 at 12/3/17 1:32 PM:

[jira] [Comment Edited] (ARROW-1483) [C++] Implement casts between time32 and time64

[ https://issues.apache.org/jira/browse/ARROW-1483?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16275933#comment-16275933 ] Licht Takeuchi edited comment on ARROW-1483 at 12/3/17 1:32 PM:

[jira] [Comment Edited] (ARROW-1483) [C++] Implement casts between time32 and time64

[ https://issues.apache.org/jira/browse/ARROW-1483?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16275933#comment-16275933 ] Licht Takeuchi edited comment on ARROW-1483 at 12/3/17 1:30 PM:

[jira] [Assigned] (ARROW-1483) [C++] Implement casts between time32 and time64

[ https://issues.apache.org/jira/browse/ARROW-1483?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Licht Takeuchi reassigned ARROW-1483: - Assignee: Licht Takeuchi > [C++] Implement casts between time32 and time64 >

[jira] [Comment Edited] (ARROW-1483) [C++] Implement casts between time32 and time64

[ https://issues.apache.org/jira/browse/ARROW-1483?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16275933#comment-16275933 ] Licht Takeuchi edited comment on ARROW-1483 at 12/3/17 1:31 PM:

[jira] [Commented] (ARROW-1483) [C++] Implement casts between time32 and time64

[ https://issues.apache.org/jira/browse/ARROW-1483?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16275933#comment-16275933 ] Licht Takeuchi commented on ARROW-1483: --- [~wesmckinn] Seems fixed by my

[jira] [Comment Edited] (ARROW-1483) [C++] Implement casts between time32 and time64

[ https://issues.apache.org/jira/browse/ARROW-1483?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16275933#comment-16275933 ] Licht Takeuchi edited comment on ARROW-1483 at 12/3/17 1:29 PM:

[jira] [Assigned] (ARROW-1491) [C++] Add casting implementations from strings to numbers or boolean

[ https://issues.apache.org/jira/browse/ARROW-1491?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Licht Takeuchi reassigned ARROW-1491: - Assignee: Licht Takeuchi > [C++] Add casting implementations from strings to numbers or

[jira] [Comment Edited] (ARROW-1756) [Python] Observed int32 overflow in Feather write/read path

[ https://issues.apache.org/jira/browse/ARROW-1756?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16227380#comment-16227380 ] Licht Takeuchi edited comment on ARROW-1756 at 10/31/17 7:41 PM: -

[jira] [Comment Edited] (ARROW-1756) [Python] Observed int32 overflow in Feather write/read path

[ https://issues.apache.org/jira/browse/ARROW-1756?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16227380#comment-16227380 ] Licht Takeuchi edited comment on ARROW-1756 at 10/31/17 7:41 PM: -

[jira] [Commented] (ARROW-1756) [Python] Observed int32 overflow in Feather write/read path

[ https://issues.apache.org/jira/browse/ARROW-1756?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16227380#comment-16227380 ] Licht Takeuchi commented on ARROW-1756: --- [~wesmckinn] I am working on this. On my Mac, it fails on

[jira] [Comment Edited] (ARROW-1756) [Python] Observed int32 overflow in Feather write/read path

[ https://issues.apache.org/jira/browse/ARROW-1756?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16227380#comment-16227380 ] Licht Takeuchi edited comment on ARROW-1756 at 10/31/17 7:46 PM: -

[jira] [Commented] (ARROW-2273) Cannot deserialize pandas SparseDataFrame

[ https://issues.apache.org/jira/browse/ARROW-2273?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16463576#comment-16463576 ] Licht Takeuchi commented on ARROW-2273: --- Okay, I'll do that. > Cannot deserialize pandas

[jira] [Assigned] (ARROW-2273) Cannot deserialize pandas SparseDataFrame

[ https://issues.apache.org/jira/browse/ARROW-2273?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Licht Takeuchi reassigned ARROW-2273: - Assignee: Licht Takeuchi > Cannot deserialize pandas SparseDataFrame >

[jira] [Comment Edited] (ARROW-2273) Cannot deserialize pandas SparseDataFrame

[ https://issues.apache.org/jira/browse/ARROW-2273?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16463622#comment-16463622 ] Licht Takeuchi edited comment on ARROW-2273 at 5/4/18 9:39 AM: --- [~mitar],

[jira] [Comment Edited] (ARROW-2273) Cannot deserialize pandas SparseDataFrame

[ https://issues.apache.org/jira/browse/ARROW-2273?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16463622#comment-16463622 ] Licht Takeuchi edited comment on ARROW-2273 at 5/4/18 9:37 AM: --- [~mitar],

[jira] [Commented] (ARROW-2273) Cannot deserialize pandas SparseDataFrame

[ https://issues.apache.org/jira/browse/ARROW-2273?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16463622#comment-16463622 ] Licht Takeuchi commented on ARROW-2273: --- [~mitar], Yes, it is still there. But, {{SparseDataFrame}} 

[jira] [Comment Edited] (ARROW-2273) Cannot deserialize pandas SparseDataFrame

[ https://issues.apache.org/jira/browse/ARROW-2273?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16463622#comment-16463622 ] Licht Takeuchi edited comment on ARROW-2273 at 5/4/18 9:38 AM: --- [~mitar],

[jira] [Comment Edited] (ARROW-2273) Cannot deserialize pandas SparseDataFrame

[ https://issues.apache.org/jira/browse/ARROW-2273?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16463370#comment-16463370 ] Licht Takeuchi edited comment on ARROW-2273 at 5/4/18 5:09 AM: ---

[jira] [Comment Edited] (ARROW-2273) Cannot deserialize pandas SparseDataFrame

[ https://issues.apache.org/jira/browse/ARROW-2273?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16463576#comment-16463576 ] Licht Takeuchi edited comment on ARROW-2273 at 5/4/18 8:54 AM: --- Yes, I'll do

[jira] [Comment Edited] (ARROW-2273) Cannot deserialize pandas SparseDataFrame

[ https://issues.apache.org/jira/browse/ARROW-2273?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16463622#comment-16463622 ] Licht Takeuchi edited comment on ARROW-2273 at 5/4/18 9:38 AM: --- [~mitar],

[jira] [Commented] (ARROW-2459) pyarrow: Segfault with pyarrow.deserialize_pandas

[ https://issues.apache.org/jira/browse/ARROW-2459?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16461855#comment-16461855 ] Licht Takeuchi commented on ARROW-2459: --- Seems fixed at the latest master branch.

[jira] [Commented] (ARROW-2273) Cannot deserialize pandas SparseDataFrame

[ https://issues.apache.org/jira/browse/ARROW-2273?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16463370#comment-16463370 ] Licht Takeuchi commented on ARROW-2273: --- SparseDataFrame is planned to be deprecated.

[jira] [Assigned] (ARROW-2278) [Python] deserializing Numpy struct arrays raises

[ https://issues.apache.org/jira/browse/ARROW-2278?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Licht Takeuchi reassigned ARROW-2278: - Assignee: Licht Takeuchi > [Python] deserializing Numpy struct arrays raises >

[jira] [Commented] (ARROW-1730) [Python] Incorrect result from pyarrow.array when passing timestamp type

[ https://issues.apache.org/jira/browse/ARROW-1730?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16220405#comment-16220405 ] Licht Takeuchi commented on ARROW-1730: --- I'm working on this. It seems that PyLong is casted to

[jira] [Updated] (ARROW-1738) [Python] Wrong datetime conversion when pa.array with unit

[ https://issues.apache.org/jira/browse/ARROW-1738?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Licht Takeuchi updated ARROW-1738: -- Description: {code:java} import pyarrow as pa import datetime

[jira] [Created] (ARROW-1738) [Python] Wrong datetime conversion when pa.array with unit

Licht Takeuchi created ARROW-1738: - Summary: [Python] Wrong datetime conversion when pa.array with unit Key: ARROW-1738 URL: https://issues.apache.org/jira/browse/ARROW-1738 Project: Apache Arrow

[jira] [Closed] (ARROW-1713) [Python] Incorrect serialization pd.Series.index

[ https://issues.apache.org/jira/browse/ARROW-1713?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Licht Takeuchi closed ARROW-1713. - Resolution: Not A Problem > [Python] Incorrect serialization pd.Series.index >

[jira] [Created] (ARROW-1714) [Python] No named pd.Series name serialized as u'None'

Licht Takeuchi created ARROW-1714: - Summary: [Python] No named pd.Series name serialized as u'None' Key: ARROW-1714 URL: https://issues.apache.org/jira/browse/ARROW-1714 Project: Apache Arrow

[jira] [Issue Comment Deleted] (ARROW-1639) [Python] More efficient serialization for RangeIndex in serialize_pandas

[ https://issues.apache.org/jira/browse/ARROW-1639?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Licht Takeuchi updated ARROW-1639: -- Comment: was deleted (was: I'm working on this.) > [Python] More efficient serialization for

[jira] [Created] (ARROW-1713) [Python] Incorrect serialization pd.Series.index

Licht Takeuchi created ARROW-1713: - Summary: [Python] Incorrect serialization pd.Series.index Key: ARROW-1713 URL: https://issues.apache.org/jira/browse/ARROW-1713 Project: Apache Arrow

[jira] [Comment Edited] (ARROW-1639) [Python] More efficient serialization for RangeIndex in serialize_pandas

[ https://issues.apache.org/jira/browse/ARROW-1639?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16215255#comment-16215255 ] Licht Takeuchi edited comment on ARROW-1639 at 10/23/17 3:13 PM: - I'm

[jira] [Commented] (ARROW-1639) [Python] More efficient serialization for RangeIndex in serialize_pandas

[ https://issues.apache.org/jira/browse/ARROW-1639?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16215255#comment-16215255 ] Licht Takeuchi commented on ARROW-1639: --- I'm working on this. I want to make PR after

[jira] [Commented] (ARROW-1713) [Python] Incorrect serialization pd.Series.index

[ https://issues.apache.org/jira/browse/ARROW-1713?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16215276#comment-16215276 ] Licht Takeuchi commented on ARROW-1713: --- I'm sorry, I made the wrong PR. > [Python] Incorrect

[jira] [Assigned] (ARROW-1743) Table to_pandas fails when index contains categorical column

[ https://issues.apache.org/jira/browse/ARROW-1743?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Licht Takeuchi reassigned ARROW-1743: - Assignee: Licht Takeuchi > Table to_pandas fails when index contains categorical column

[jira] [Assigned] (ARROW-1714) [Python] No named pd.Series name serialized as u'None'

[ https://issues.apache.org/jira/browse/ARROW-1714?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Licht Takeuchi reassigned ARROW-1714: - Assignee: Licht Takeuchi > [Python] No named pd.Series name serialized as u'None' >

[jira] [Assigned] (ARROW-1941) Table <–> DataFrame roundtrip failing

[ https://issues.apache.org/jira/browse/ARROW-1941?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Licht Takeuchi reassigned ARROW-1941: - Assignee: Licht Takeuchi > Table <–> DataFrame roundtrip failing >

[jira] [Assigned] (ARROW-1992) [Python] to_pandas crashes when using strings_to_categoricals on empty string cols on 0.8.0

[ https://issues.apache.org/jira/browse/ARROW-1992?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Licht Takeuchi reassigned ARROW-1992: - Assignee: Licht Takeuchi > [Python] to_pandas crashes when using strings_to_categoricals

[jira] [Created] (ARROW-1997) [Python] to_pandas with strings_to_categorical fails

Licht Takeuchi created ARROW-1997: - Summary: [Python] to_pandas with strings_to_categorical fails Key: ARROW-1997 URL: https://issues.apache.org/jira/browse/ARROW-1997 Project: Apache Arrow

[jira] [Commented] (ARROW-1992) [Python] to_pandas crashes when using strings_to_categoricals on empty string cols on 0.8.0

[ https://issues.apache.org/jira/browse/ARROW-1992?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16326659#comment-16326659 ] Licht Takeuchi commented on ARROW-1992: --- I am working on this. I will make a PR after