Antoine Pitrou created ARROW-5161:
-------------------------------------

             Summary: [Python] Cannot convert struct type from Pandas object 
column
                 Key: ARROW-5161
                 URL: https://issues.apache.org/jira/browse/ARROW-5161
             Project: Apache Arrow
          Issue Type: Bug
          Components: Python
    Affects Versions: 0.13.0
            Reporter: Antoine Pitrou


As reported on [https://github.com/apache/arrow/issues/4045]. Interestingly, 
the datatype is inferred correctly.
{code:python}
>>> df = pd.DataFrame({'col': [{'ints': 5, 'strs': 'foo'}, {'ints': 6, 'strs': 
>>> 'bar'}]})                                                                   
>>>           
>>> df                                                                          
>>>                                                                             
>>>          
                          col
0  {'ints': 5, 'strs': 'foo'}
1  {'ints': 6, 'strs': 'bar'}
>>> pa.Table.from_pandas(df)                                                    
>>>                                                                             
>>>          
Traceback (most recent call last):
  File "<ipython-input-16-6eac5d0eec08>", line 1, in <module>
    pa.Table.from_pandas(df)
  File "pyarrow/table.pxi", line 1139, in pyarrow.lib.Table.from_pandas
    names, arrays, metadata = dataframe_to_arrays(
  File "/home/antoine/arrow/dev/python/pyarrow/pandas_compat.py", line 480, in 
dataframe_to_arrays
    types)
  File "/home/antoine/arrow/dev/python/pyarrow/pandas_compat.py", line 209, in 
construct_metadata
    field_name=sanitized_name)
  File "/home/antoine/arrow/dev/python/pyarrow/pandas_compat.py", line 151, in 
get_column_metadata
    logical_type = get_logical_type(arrow_type)
  File "/home/antoine/arrow/dev/python/pyarrow/pandas_compat.py", line 79, in 
get_logical_type
    raise NotImplementedError(str(arrow_type))
NotImplementedError: struct<ints: int64, strs: string>
{code}




--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

Reply via email to