emmamendelsohn opened a new issue, #40202:
URL: https://github.com/apache/arrow/issues/40202
### Describe the bug, including details regarding any error messages,
version, and platform.
Moving this from ROpenSci slack. Our team has Mac, Linux, and Windows users,
and we have found that we get three different hashes when saving parquet files.
```
arrow::write_parquet(mtcars, "mtcars.parquet")
digest::digest("mtcars.parquet", file = TRUE)
```
Mac "05be83226acb5d2a673d922ff9f69414"
Linux "8bddf47bdbede54d87ec3c4cbec280da"
Windows "bef251d299843f07348248416572edab"
This was also the case with with the option `compression = "uncompressed"`.
`arrow_info()` for our three systems:
<details>
<summary> Mac </summary>
```
Arrow package version: 14.0.0.2
Capabilities:
acero TRUE
dataset TRUE
substrait FALSE
parquet TRUE
json TRUE
s3 TRUE
gcs TRUE
utf8proc TRUE
re2 TRUE
snappy TRUE
gzip TRUE
brotli TRUE
zstd TRUE
lz4 TRUE
lz4_frame TRUE
lzo FALSE
bz2 TRUE
jemalloc TRUE
mimalloc TRUE
Memory:
Allocator mimalloc
Current 0 bytes
Max 50.62 Kb
Runtime:
SIMD Level none
Detected SIMD Level none
Build:
C++ Library Version 14.0.0
C++ Compiler AppleClang
C++ Compiler Version 15.0.0.15000040
Git ID 2dcee3f82c6cf54b53a64729fd81840efa583244
```
</details>
<details>
<summary> Linux </summary>
```
Arrow package version: 14.0.0.2
Capabilities:
acero TRUE
dataset TRUE
substrait FALSE
parquet TRUE
json TRUE
s3 TRUE
gcs TRUE
utf8proc TRUE
re2 TRUE
snappy TRUE
gzip TRUE
brotli TRUE
zstd TRUE
lz4 TRUE
lz4_frame TRUE
lzo FALSE
bz2 TRUE
jemalloc TRUE
mimalloc TRUE
Memory:
Allocator jemalloc
Current 0 bytes
Max 0 bytes
Runtime:
SIMD Level avx2
Detected SIMD Level avx2
Build:
C++ Library Version 14.0.0
C++ Compiler GNU
C++ Compiler Version 11.4.0
```
</details>
<details>
<summary> Windows </summary>
```
Arrow package version: 14.0.0.2
Capabilities:
acero TRUE
dataset TRUE
substrait FALSE
parquet TRUE
json TRUE
s3 TRUE
gcs TRUE
utf8proc TRUE
re2 TRUE
snappy TRUE
gzip TRUE
brotli TRUE
zstd TRUE
lz4 TRUE
lz4_frame TRUE
lzo FALSE
bz2 TRUE
jemalloc FALSE
mimalloc TRUE
Arrow options():
arrow.use_threads FALSE
Memory:
Allocator mimalloc
Current 0 bytes
Max 0 bytes
Runtime:
SIMD Level avx2
Detected SIMD Level avx2
Build:
C++ Library Version 14.0.0
C++ Compiler GNU
C++ Compiler Version 10.3.0
Git ID 2dcee3f82c6cf54b53a64729fd81840efa583244
```
</details>
### Component(s)
Parquet, R
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
