[GitHub] [arrow] wjones127 commented on issue #12416: Parquet Partition issues with Int64 Null

[GitBox]

wjones127 commented on issue #12416:
URL: https://github.com/apache/arrow/issues/12416#issuecomment-1043541700


   Here's a shorter reproduction of the issue, which also fails in 7.0.0:
   
   ```python
   import pyarrow as pa
   import pyarrow.parquet as pq
   import pyarrow.dataset as ds
   import tempfile
   
   table = pa.table({
       'x': pa.array([23455555508999, 7753285016841556620, None]),
       'y': pa.array(['a', 'b', 'c'])
   })
   
   ds_dir = tempfile.mkdtemp()
   pq.write_to_dataset(table, ds_dir, partition_cols=['y'])
   
   table_after = ds.dataset(ds_dir).to_table()
   print(table['x'])
   print(table_after['x'])
   assert table['x'] == table_after['x']
   ```
   
   Output:
   
   ```
   [
     [
       23455555508999,
       7753285016841556620,
       null
     ]
   ]
   [
     [
       23455555508999
     ],
     [
       7753285016841556992
     ],
     [
       null
     ]
   ]
   ```


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscr...@arrow.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org