comicfans opened a new issue, #35105:
URL: https://github.com/apache/arrow/issues/35105

   ### Describe the bug, including details regarding any error messages, 
version, and platform.
   
   R arrow_info
   ```
   > arrow::arrow_info()
   Arrow package version: 11.0.0.3
   
   Capabilities:
                  
   dataset    TRUE
   substrait FALSE
   parquet    TRUE
   json       TRUE
   s3         TRUE
   gcs        TRUE
   utf8proc   TRUE
   re2        TRUE
   snappy     TRUE
   gzip       TRUE
   brotli     TRUE
   zstd       TRUE
   lz4        TRUE
   lz4_frame  TRUE
   lzo       FALSE
   bz2        TRUE
   jemalloc   TRUE
   mimalloc   TRUE
   
   Memory:
                     
   Allocator jemalloc
   Current    3.82 Gb
   Max        8.63 Gb
   
   Runtime:
                           
   SIMD Level          avx2
   Detected SIMD Level avx2
   
   Build:
                              
   C++ Library Version  11.0.0
   C++ Compiler            GNU
   C++ Compiler Version  7.5.0
   ```
   
   pyarrow info:
   ```
   pyarrow-11.0.0-cp311-cp311-manylinux_2_17_x86_64.manylinux2014_x86_64.whl 
from conda pip
   ```
   
   when using pyarrow to write file with column encoding as BYTE_STREAM_SPLIT, 
R can't parse such file
   ```
   Error: IOError: Data size too small for number of values (corrupted file?)
   ```
   
   ### Component(s)
   
   R


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: [email protected]

For queries about this service, please contact Infrastructure at:
[email protected]

Reply via email to