[
https://issues.apache.org/jira/browse/ARROW-18314?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Lucas Mation updated ARROW-18314:
---------------------------------
Description:
This is running on a windows environment, arrow 10.0.0 (see arrow_info() below)
I issued two calls
```
ft <- path_to_dataset1
fa <- path_to_dataset2
#1)
tic()
d2 <- ft %>% open_dataset %>% filter( pis %in% mypis ) %>% collect
toc()
927.11 sec elapsed
#returned a dataset with 44 obs, 38 columns, took abnormal time, 16min
#1)
tic()
d3 <- fa %>% open_dataset %>% filter( pis %in% mypis ) %>% collect
terminate called after throwing an instance of 'cpp11::unwind_exception'
```
Then I got an error that craspad_hendler.exe stopped working. And R becomes
frozen, after a while R crashed too.
!image-2022-11-11-14-59-30-132.png!
arrow_info()
Arrow package version: 10.0.0
Capabilities:
dataset TRUE
substrait FALSE
parquet TRUE
json TRUE
s3 TRUE
gcs TRUE
utf8proc TRUE
re2 TRUE
snappy TRUE
gzip TRUE
brotli TRUE
zstd TRUE
lz4 TRUE
lz4_frame TRUE
lzo FALSE
bz2 TRUE
jemalloc FALSE
mimalloc TRUE
Arrow options():
arrow.use_threads FALSE
Memory:
Allocator mimalloc
Current 0 bytes
Max 0 bytes
Runtime:
SIMD Level avx2
Detected SIMD Level avx2
Build:
C++ Library Version 10.0.0
C++ Compiler GNU
C++ Compiler Version 10.3.0
Git ID aa7118b6e5f49b354fa8a93d9cf363c9ebe9a3f0
was:
I issued two calls
```
ft <- path_to_dataset1
fa <- path_to_dataset2
#1)
tic()
d2 <- ft %>% open_dataset %>% filter( pis %in% mypis ) %>% collect
toc()
927.11 sec elapsed
#returned a dataset with 44 obs, 38 columns, took abnormal time, 16min
#1)
tic()
d3 <- fa %>% open_dataset %>% filter( pis %in% mypis ) %>% collect
terminate called after throwing an instance of 'cpp11::unwind_exception'
```
Then I got an error that craspad_hendler.exe stopped working. And R becomes
frozen, after a while R crashed too.
!image-2022-11-11-14-59-30-132.png!
> "open_dataset(f) %>% filter(id %in% myvec) %>% collect" causes
> CPP11::unwind_execption, crashed R
> --------------------------------------------------------------------------------------------------
>
> Key: ARROW-18314
> URL: https://issues.apache.org/jira/browse/ARROW-18314
> Project: Apache Arrow
> Issue Type: Bug
> Reporter: Lucas Mation
> Priority: Major
> Attachments: image-2022-11-11-14-55-36-430.png,
> image-2022-11-11-14-59-30-132.png
>
>
> This is running on a windows environment, arrow 10.0.0 (see arrow_info()
> below)
> I issued two calls
> ```
> ft <- path_to_dataset1
> fa <- path_to_dataset2
> #1)
> tic()
> d2 <- ft %>% open_dataset %>% filter( pis %in% mypis ) %>% collect
> toc()
> 927.11 sec elapsed
> #returned a dataset with 44 obs, 38 columns, took abnormal time, 16min
> #1)
> tic()
> d3 <- fa %>% open_dataset %>% filter( pis %in% mypis ) %>% collect
> terminate called after throwing an instance of 'cpp11::unwind_exception'
> ```
> Then I got an error that craspad_hendler.exe stopped working. And R becomes
> frozen, after a while R crashed too.
> !image-2022-11-11-14-59-30-132.png!
>
> arrow_info()
> Arrow package version: 10.0.0
> Capabilities:
>
> dataset TRUE
> substrait FALSE
> parquet TRUE
> json TRUE
> s3 TRUE
> gcs TRUE
> utf8proc TRUE
> re2 TRUE
> snappy TRUE
> gzip TRUE
> brotli TRUE
> zstd TRUE
> lz4 TRUE
> lz4_frame TRUE
> lzo FALSE
> bz2 TRUE
> jemalloc FALSE
> mimalloc TRUE
> Arrow options():
>
> arrow.use_threads FALSE
> Memory:
>
> Allocator mimalloc
> Current 0 bytes
> Max 0 bytes
> Runtime:
>
> SIMD Level avx2
> Detected SIMD Level avx2
> Build:
>
> C++ Library Version 10.0.0
> C++ Compiler GNU
> C++ Compiler Version 10.3.0
> Git ID aa7118b6e5f49b354fa8a93d9cf363c9ebe9a3f0
>
>
>
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
