[jira] [Created] (ARROW-9039) py_bytes created by pyarrow 0.11.1 cannot be deserialized by more recent versions

[Yoav Git (Jira)]

Yoav Git created ARROW-9039:
-------------------------------

             Summary: py_bytes created by pyarrow 0.11.1 cannot be deserialized 
by more recent versions
                 Key: ARROW-9039
                 URL: https://issues.apache.org/jira/browse/ARROW-9039
             Project: Apache Arrow
          Issue Type: Bug
          Components: Python
    Affects Versions: 0.15.1, 0.11.1
         Environment: python, windows
            Reporter: Yoav Git


I have been saving dataframes into mongodb using:

{{import pandas as pd; import pyarrow as pa}}
{{df = pd.DataFrame([[1,2,3],[2,3,4]], columns = ['x','y','z'])}}

{{byte = pa.serialize(df).to_buffer().to_pybytes()}}

and then reading back using:

{{df = pa.deserialize(pa.py_buffer(memoryview(byte)))}}

However, pyarrow is not back-compatible. i.e. both versions 0.11.1 and 0.15.1 
can read their own pybytes created by it. Alas, they cannot read each other. 

 



--
This message was sent by Atlassian Jira
(v8.3.4#803005)