cgostic commented on issue #15056: URL: https://github.com/apache/arrow/issues/15056#issuecomment-1377683059
Thanks for that insight, I misunderstood the memory requirements of .csv vs. feather! I also realize that our EC2 instance is running on Linux (Ubuntu 22.04.1 LTS) if that's helpful. I've tried your suggestion to write the partitioned data as .csvs and still get the same segfault error. My logs now reference auto_deleter_background. This is output from [`httpuv`](https://github.com/rstudio/httpuv/blob/main/src/auto_deleter.h), though it seems like it's a result of the preceding "memory not mapped" issue. ``` 2023/01/10 9:23:03 AM: Running on host: <ip> 2023/01/10 9:23:03 AM: Linux distribution: Ubuntu 22.04.1 LTS (jammy) 2023/01/10 9:23:03 AM: Server version: 2022.09.0 2023/01/10 9:23:03 AM: LANG: C.UTF-8 2023/01/10 9:23:03 AM: Working directory: /opt/rstudio-connect/mnt/app 2023/01/10 9:23:03 AM: Running content using its packrat R library 2023/01/10 9:23:03 AM: Using Packrat dir /opt/rstudio-connect/mnt/app/packrat/lib/x86_64-pc-linux-gnu/4.2.1 2023/01/10 9:23:03 AM: R version: 4.2.1 2023/01/10 9:23:03 AM: shiny version: 1.7.4 2023/01/10 9:23:03 AM: httpuv version: 1.6.6 2023/01/10 9:23:03 AM: rmarkdown version: (none) 2023/01/10 9:23:03 AM: knitr version: (none) 2023/01/10 9:23:03 AM: jsonlite version: 1.8.4 2023/01/10 9:23:03 AM: RJSONIO version: (none) 2023/01/10 9:23:03 AM: htmltools version: 0.5.4 2023/01/10 9:23:03 AM: reticulate version: (none) 2023/01/10 9:23:03 AM: Using pandoc: /opt/rstudio-connect/ext/pandoc/2.16 2023/01/10 9:23:04 AM: Using Shiny bookmarking base directory /opt/rstudio-connect/mnt/bookmarks 2023/01/10 9:23:04 AM: 2023/01/10 9:23:04 AM: Starting R with process ID: '375796' ... 2023/01/10 9:27:39 AM: *** caught segfault *** 2023/01/10 9:27:39 AM: address 0x60, cause 'memory not mapped' 2023/01/10 9:27:39 AM: An irrecoverable exception occurred. R is aborting now ... 2023/01/10 9:27:39 AM: Can't detect correct thread for auto_deleter_background. 2023/01/10 9:27:39 AM: Can't detect correct thread for auto_deleter_background. 2023/01/10 9:27:39 AM: 2023/01/10 9:27:39 AM: *** caught segfault *** 2023/01/10 9:27:39 AM: address (nil), cause 'unknown' ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
