[
https://issues.apache.org/jira/browse/ARROW-7807?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17033321#comment-17033321
]
Omar Yassin edited comment on ARROW-7807 at 2/10/20 8:54 PM:
-------------------------------------------------------------
I'll have to switch the text a little bit to remove paths
*This is the code that triggers it and the error:*
{code:R}
> data <- read_parquet('/path/to/file.parquet')
Error in io___MemoryMappedFile__Open(path, mode) :
Cannot call io___MemoryMappedFile__Open(). Please use
arrow::install_arrow() to install required runtime libraries.
{code}
*This is the session info:*
{code}
R version 3.3.2 (2016-10-31)
Platform: x86_64-pc-linux-gnu (64-bit)
Running under: Red Hat Enterprise Linux Server 7.6 (Maipo)
locale:
[1] C
attached base packages:
[1] stats graphics grDevices utils datasets methods base
other attached packages:
[1] arrow_0.16.0
loaded via a namespace (and not attached):
[1] Rcpp_1.0.2 zeallot_0.1.0 crayon_1.3.4 assertthat_0.2.1
[5] R6_2.4.0 backports_1.1.4 magrittr_1.5 pillar_1.4.2
[9] rlang_0.4.0 vctrs_0.2.0 bit64_0.9-7 glue_1.3.1
[13] purrr_0.3.3 bit_1.1-14 pkgconfig_2.0.2 tidyselect_0.2.5
[17] tibble_2.1.3
{code}
*This is the stdout from the build that relied on the system arrow c++
libraries without setting LIBARROW_BINARY_DISTRO. The one that was directed to
centos-7 skipped directly to the builds without many complaints.*
{code}
> install.packages('arrow')
>
>
Installing package into '{/custom/user/rlib/path}'
(as 'lib' is unspecified)
--- Please select a CRAN mirror for use in this session ---
HTTPS CRAN mirror
1: 0-Cloud [https] 2: Algeria [https]
3: Australia (Canberra) [https] 4: Australia (Melbourne 1) [https]
5: Australia (Melbourne 2) [https] 6: Australia (Perth) [https]
7: Austria [https] 8: Belgium (Antwerp) [https]
9: Belgium (Ghent) [https] 10: Brazil (BA) [https]
11: Brazil (PR) [https] 12: Brazil (RJ) [https]
13: Brazil (SP 1) [https] 14: Brazil (SP 2) [https]
15: Bulgaria [https] 16: Canada (BC) [https]
17: Canada (MB) [https] 18: Canada (NS) [https]
19: Chile (Santiago) [https] 20: Chile (Temuco) [https]
21: China (Beijing) [https] 22: China (Hefei) [https]
23: China (Hong Kong) [https] 24: China (Guangzhou) [https]
25: China (Lanzhou) [https] 26: China (Shanghai) [https]
27: Colombia (Cali) [https] 28: Costa Rica [https]
29: Czech Republic [https] 30: Denmark [https]
31: East Asia [https] 32: Ecuador (Cuenca) [https]
33: Ecuador (Quito) [https] 34: Estonia [https]
35: France (Lyon 1) [https] 36: France (Lyon 2) [https]
37: France (Marseille) [https] 38: France (Montpellier) [https]
39: Germany (Erlangen) [https] 40: Germany (G<U+00F6>ttingen) [https]
41: Germany (M<U+00FC>nster) [https] 42: Germany (Regensburg) [https]
43: Greece [https] 44: Hungary [https]
45: Iceland [https] 46: Indonesia (Jakarta) [https]
47: Iran [https] 48: Ireland [https]
49: Italy (Padua) [https] 50: Japan (Tokyo) [https]
51: Japan (Yonezawa) [https] 52: Korea (Busan) [https]
53: Korea (Gyeongsan-si) [https] 54: Korea (Seoul 1) [https]
55: Malaysia [https] 56: Mexico (Mexico City) [https]
57: Morocco [https] 58: New Zealand [https]
59: Norway [https] 60: Philippines [https]
61: Russia [https] 62: Spain (Madrid) [https]
63: Sweden [https] 64: Switzerland [https]
65: Taiwan (Chungli) [https] 66: Turkey (Denizli) [https]
67: Turkey (Mersin) [https] 68: UK (Bristol) [https]
69: UK (London 1) [https] 70: USA (IA) [https]
71: USA (IN) [https] 72: USA (KS) [https]
73: USA (MI 1) [https] 74: USA (MI 2) [https]
75: USA (OH) [https] 76: USA (OR) [https]
77: USA (TN) [https] 78: USA (TX 1) [https]
79: Uruguay [https] 80: (HTTP mirrors)
Selection: 1
trying URL 'https://cloud.r-project.org/src/contrib/arrow_0.16.0.tar.gz'
Content type 'application/x-gzip' length 212922 bytes (207 KB)
==================================================
downloaded 207 KB
* installing *source* package 'arrow' ...
** package 'arrow' successfully unpacked and MD5 sums checked
*** No C++ binaries found for rhel-7
*** Successfully retrieved C++ source
chmod: cannot access '/tmp/RtmpisbeAL/file10a26194990b/cpp/build-support/*.sh':
No such file or directory
*** Building C++ libraries
*** Downloading cmake
Error in file(con, "rb") : cannot open the connection
Calls: build_libarrow -> ensure_cmake -> untar -> readBin -> file
In addition: Warning messages:
1: In download.file(binary_url, libfile, quiet = quietly) :
URL
'https://dl.bintray.com/ursalabs/arrow-r/libarrow/bin/rhel-7/arrow-0.16.0.zip':
status was '404 Not Found'
2: In download.file(source_url, tf1, quiet = quietly) :
URL 'https://dl.bintray.com/ursalabs/arrow-r/libarrow/src/arrow-0.16.0.zip':
status was '404 Not Found'
3: In unzip(tf1, exdir = src_dir) : error 1 in extracting from zip file
4: In download.file(cmake_binary_url, cmake_tar, quiet = quietly) :
URL
'https://github.com/Kitware/CMake/releases/download/v3.16.2/cmake-3.16.2-Linux-x86_64.tar.gz':
status was 'HTTP response code said error'
5: In file(con, "rb") :
cannot open file '/tmp/RtmpisbeAL/file10a26a78d666': No such file or
directory
Execution halted
------------------------- NOTE ---------------------------
After installation, please run arrow::install_arrow()
for help installing required runtime libraries
---------------------------------------------------------
** libs
g++ -std=c++0x -I{/custom/path/to/shared/R/build}/lib64/R/include -DNDEBUG
-I{/custom/path/to/shared/R/build}/include -fPIC
-I"{/custom/path/to/user/home}/cod
e/rlib/Rcpp/include" -fpic -g -O2 -c array.cpp -o array.o
g++ -std=c++0x -I{/custom/path/to/shared/R/build}/lib64/R/include -DNDEBUG
-I{/custom/path/to/shared/R/build}/include -fPIC
-I"{/custom/path/to/user/home}/cod
e/rlib/Rcpp/include" -fpic -g -O2 -c array_from_vector.cpp -o
array_from_vector.o
g++ -std=c++0x -I{/custom/path/to/shared/R/build}/lib64/R/include -DNDEBUG
-I{/custom/path/to/shared/R/build}/include -fPIC
-I"{/custom/path/to/user/home}/cod
e/rlib/Rcpp/include" -fpic -g -O2 -c array_to_vector.cpp -o
array_to_vector.o
g++ -std=c++0x -I{/custom/path/to/shared/R/build}/lib64/R/include -DNDEBUG
-I{/custom/path/to/shared/R/build}/include -fPIC
-I"{/custom/path/to/user/home}/cod
e/rlib/Rcpp/include" -fpic -g -O2 -c arraydata.cpp -o arraydata.o
g++ -std=c++0x -I{/custom/path/to/shared/R/build}/lib64/R/include -DNDEBUG
-I{/custom/path/to/shared/R/build}/include -fPIC
-I"{/custom/path/to/user/home}/cod
e/rlib/Rcpp/include" -fpic -g -O2 -c arrowExports.cpp -o arrowExports.o
g++ -std=c++0x -I{/custom/path/to/shared/R/build}/lib64/R/include -DNDEBUG
-I{/custom/path/to/shared/R/build}/include -fPIC
-I"{/custom/path/to/user/home}/cod
e/rlib/Rcpp/include" -fpic -g -O2 -c buffer.cpp -o buffer.o
g++ -std=c++0x -I{/custom/path/to/shared/R/build}/lib64/R/include -DNDEBUG
-I{/custom/path/to/shared/R/build}/include -fPIC
-I"{/custom/path/to/user/home}/cod
e/rlib/Rcpp/include" -fpic -g -O2 -c chunkedarray.cpp -o chunkedarray.o
g++ -std=c++0x -I{/custom/path/to/shared/R/build}/lib64/R/include -DNDEBUG
-I{/custom/path/to/shared/R/build}/include -fPIC
-I"{/custom/path/to/user/home}/cod
e/rlib/Rcpp/include" -fpic -g -O2 -c compression.cpp -o compression.o
g++ -std=c++0x -I{/custom/path/to/shared/R/build}/lib64/R/include -DNDEBUG
-I{/custom/path/to/shared/R/build}/include -fPIC
-I"{/custom/path/to/user/home}/cod
e/rlib/Rcpp/include" -fpic -g -O2 -c compute.cpp -o compute.o
g++ -std=c++0x -I{/custom/path/to/shared/R/build}/lib64/R/include -DNDEBUG
-I{/custom/path/to/shared/R/build}/include -fPIC
-I"{/custom/path/to/user/home}/cod
e/rlib/Rcpp/include" -fpic -g -O2 -c csv.cpp -o csv.o
g++ -std=c++0x -I{/custom/path/to/shared/R/build}/lib64/R/include -DNDEBUG
-I{/custom/path/to/shared/R/build}/include -fPIC
-I"{/custom/path/to/user/home}/cod
e/rlib/Rcpp/include" -fpic -g -O2 -c dataset.cpp -o dataset.o
g++ -std=c++0x -I{/custom/path/to/shared/R/build}/lib64/R/include -DNDEBUG
-I{/custom/path/to/shared/R/build}/include -fPIC
-I"{/custom/path/to/user/home}/cod
e/rlib/Rcpp/include" -fpic -g -O2 -c datatype.cpp -o datatype.o
g++ -std=c++0x -I{/custom/path/to/shared/R/build}/lib64/R/include -DNDEBUG
-I{/custom/path/to/shared/R/build}/include -fPIC
-I"{/custom/path/to/user/home}/cod
e/rlib/Rcpp/include" -fpic -g -O2 -c expression.cpp -o expression.o
g++ -std=c++0x -I{/custom/path/to/shared/R/build}/lib64/R/include -DNDEBUG
-I{/custom/path/to/shared/R/build}/include -fPIC
-I"{/custom/path/to/user/home}/cod
e/rlib/Rcpp/include" -fpic -g -O2 -c feather.cpp -o feather.o
g++ -std=c++0x -I{/custom/path/to/shared/R/build}/lib64/R/include -DNDEBUG
-I{/custom/path/to/shared/R/build}/include -fPIC
-I"{/custom/path/to/user/home}/cod
e/rlib/Rcpp/include" -fpic -g -O2 -c field.cpp -o field.o
g++ -std=c++0x -I{/custom/path/to/shared/R/build}/lib64/R/include -DNDEBUG
-I{/custom/path/to/shared/R/build}/include -fPIC
-I"{/custom/path/to/user/home}/cod
e/rlib/Rcpp/include" -fpic -g -O2 -c filesystem.cpp -o filesystem.o
g++ -std=c++0x -I{/custom/path/to/shared/R/build}/lib64/R/include -DNDEBUG
-I{/custom/path/to/shared/R/build}/include -fPIC
-I"{/custom/path/to/user/home}/cod
e/rlib/Rcpp/include" -fpic -g -O2 -c io.cpp -o io.o
g++ -std=c++0x -I{/custom/path/to/shared/R/build}/lib64/R/include -DNDEBUG
-I{/custom/path/to/shared/R/build}/include -fPIC
-I"{/custom/path/to/user/home}/cod
e/rlib/Rcpp/include" -fpic -g -O2 -c json.cpp -o json.o
g++ -std=c++0x -I{/custom/path/to/shared/R/build}/lib64/R/include -DNDEBUG
-I{/custom/path/to/shared/R/build}/include -fPIC
-I"{/custom/path/to/user/home}/cod
e/rlib/Rcpp/include" -fpic -g -O2 -c memorypool.cpp -o memorypool.o
g++ -std=c++0x -I{/custom/path/to/shared/R/build}/lib64/R/include -DNDEBUG
-I{/custom/path/to/shared/R/build}/include -fPIC
-I"{/custom/path/to/user/home}/cod
e/rlib/Rcpp/include" -fpic -g -O2 -c message.cpp -o message.o
g++ -std=c++0x -I{/custom/path/to/shared/R/build}/lib64/R/include -DNDEBUG
-I{/custom/path/to/shared/R/build}/include -fPIC
-I"{/custom/path/to/user/home}/cod
e/rlib/Rcpp/include" -fpic -g -O2 -c parquet.cpp -o parquet.o
g++ -std=c++0x -I{/custom/path/to/shared/R/build}/lib64/R/include -DNDEBUG
-I{/custom/path/to/shared/R/build}/include -fPIC
-I"{/custom/path/to/user/home}/cod
e/rlib/Rcpp/include" -fpic -g -O2 -c recordbatch.cpp -o recordbatch.o
g++ -std=c++0x -I{/custom/path/to/shared/R/build}/lib64/R/include -DNDEBUG
-I{/custom/path/to/shared/R/build}/include -fPIC
-I"{/custom/path/to/user/home}/cod
e/rlib/Rcpp/include" -fpic -g -O2 -c recordbatchreader.cpp -o
recordbatchreader.o
g++ -std=c++0x -I{/custom/path/to/shared/R/build}/lib64/R/include -DNDEBUG
-I{/custom/path/to/shared/R/build}/include -fPIC
-I"{/custom/path/to/user/home}/cod
e/rlib/Rcpp/include" -fpic -g -O2 -c recordbatchwriter.cpp -o
recordbatchwriter.o
g++ -std=c++0x -I{/custom/path/to/shared/R/build}/lib64/R/include -DNDEBUG
-I{/custom/path/to/shared/R/build}/include -fPIC
-I"{/custom/path/to/user/home}/cod
e/rlib/Rcpp/include" -fpic -g -O2 -c schema.cpp -o schema.o
g++ -std=c++0x -I{/custom/path/to/shared/R/build}/lib64/R/include -DNDEBUG
-I{/custom/path/to/shared/R/build}/include -fPIC
-I"{/custom/path/to/user/home}/cod
e/rlib/Rcpp/include" -fpic -g -O2 -c symbols.cpp -o symbols.o
g++ -std=c++0x -I{/custom/path/to/shared/R/build}/lib64/R/include -DNDEBUG
-I{/custom/path/to/shared/R/build}/include -fPIC
-I"{/custom/path/to/user/home}/cod
e/rlib/Rcpp/include" -fpic -g -O2 -c table.cpp -o table.o
g++ -std=c++0x -I{/custom/path/to/shared/R/build}/lib64/R/include -DNDEBUG
-I{/custom/path/to/shared/R/build}/include -fPIC
-I"{/custom/path/to/user/home}/cod
e/rlib/Rcpp/include" -fpic -g -O2 -c threadpool.cpp -o threadpool.o
g++ -std=c++0x -shared -L{/custom/path/to/shared/R/build}/lib64/R/lib
-Bdirect,--hash-style=both,-Wl,-O1 -L{/custom/path/to/shared/R/build}/lib -o
arrow.
so array.o array_from_vector.o array_to_vector.o arraydata.o arrowExports.o
buffer.o chunkedarray.o compression.o compute.o csv.o dataset.o datatype.o
expression.o feath
er.o field.o filesystem.o io.o json.o memorypool.o message.o parquet.o
recordbatch.o recordbatchreader.o recordbatchwriter.o schema.o symbols.o
table.o threadpool.o -L{/
custom/path/to/shared/R/build}/lib64/R/lib -lR
installing to {/custom/path/to/user/home}/code/rlib/arrow/libs
** R
** inst
** preparing package for lazy loading
** help
*** installing help indices
** building package indices
** installing vignettes
** testing if installed package can be loaded
* DONE (arrow)
The downloaded source packages are in
'/tmp/RtmpdzePOS/downloaded_packages'
{code}
Thanks again!
was (Author: oyassin):
I'll have to switch the text a little bit to remove paths
*This is the code that triggers it and the error:*
{{> data <- read_parquet('/path/to/file.parquet') }}
{{Error in io___MemoryMappedFile__Open(path, mode) :}}
{{ Cannot call io___MemoryMappedFile__Open(). Please use
arrow::install_arrow() to install required runtime libraries.}}
*This is the session info:*
{{R version 3.3.2 (2016-10-31)}}
{{Platform: x86_64-pc-linux-gnu (64-bit)}}
{{Running under: Red Hat Enterprise Linux Server 7.6 (Maipo)}}
{{locale:}}
{{[1] C}}
{{attached base packages:}}
{{[1] stats graphics grDevices utils datasets methods base}}
{{other attached packages:}}
{{[1] arrow_0.16.0}}
{{loaded via a namespace (and not attached):}}
{{ [1] Rcpp_1.0.2 zeallot_0.1.0 crayon_1.3.4 assertthat_0.2.1}}
{{ [5] R6_2.4.0 backports_1.1.4 magrittr_1.5 pillar_1.4.2}}
{{ [9] rlang_0.4.0 vctrs_0.2.0 bit64_0.9-7 glue_1.3.1}}
{{[13] purrr_0.3.3 bit_1.1-14 pkgconfig_2.0.2 tidyselect_0.2.5}}
{{[17] tibble_2.1.3}}
*This is the stdout from the build that relied on the system arrow c++
libraries without setting LIBARROW_BINARY_DISTRO. The one that was directed to
centos-7 skipped directly to the builds without many complaints.*
{{> install.packages('arrow') }}
{{Installing package into '\{/custom/user/rlib/path}' }}
{{(as 'lib' is unspecified) }}
{{--- Please select a CRAN mirror for use in this session --- }}
{{HTTPS CRAN mirror }}
{{ 1: 0-Cloud [https] 2: Algeria [https] }}
{{ 3: Australia (Canberra) [https] 4: Australia (Melbourne 1) [https] }}
{{ 5: Australia (Melbourne 2) [https] 6: Australia (Perth) [https] }}
{{ 7: Austria [https] 8: Belgium (Antwerp) [https] }}
{{ 9: Belgium (Ghent) [https] 10: Brazil (BA) [https] }}
{{11: Brazil (PR) [https] 12: Brazil (RJ) [https] }}
{{13: Brazil (SP 1) [https] 14: Brazil (SP 2) [https] }}
{{15: Bulgaria [https] 16: Canada (BC) [https] }}
{{17: Canada (MB) [https] 18: Canada (NS) [https] }}
{{19: Chile (Santiago) [https] 20: Chile (Temuco) [https] }}
{{21: China (Beijing) [https] 22: China (Hefei) [https] }}
{{23: China (Hong Kong) [https] 24: China (Guangzhou) [https] }}
{{25: China (Lanzhou) [https] 26: China (Shanghai) [https] }}
{{27: Colombia (Cali) [https] 28: Costa Rica [https] }}
{{29: Czech Republic [https] 30: Denmark [https] }}
{{31: East Asia [https] 32: Ecuador (Cuenca) [https] }}
{{33: Ecuador (Quito) [https] 34: Estonia [https] }}
{{35: France (Lyon 1) [https] 36: France (Lyon 2) [https] }}
{{37: France (Marseille) [https] 38: France (Montpellier) [https] }}
{{39: Germany (Erlangen) [https] 40: Germany (G<U+00F6>ttingen) [https] }}
{{41: Germany (M<U+00FC>nster) [https] 42: Germany (Regensburg) [https] }}
{{43: Greece [https] 44: Hungary [https] }}
{{45: Iceland [https] 46: Indonesia (Jakarta) [https] }}
{{47: Iran [https] 48: Ireland [https] }}
{{49: Italy (Padua) [https] 50: Japan (Tokyo) [https] }}
{{51: Japan (Yonezawa) [https] 52: Korea (Busan) [https] }}
{{53: Korea (Gyeongsan-si) [https] 54: Korea (Seoul 1) [https] }}
{{55: Malaysia [https] 56: Mexico (Mexico City) [https] }}
{{57: Morocco [https] 58: New Zealand [https] }}
{{59: Norway [https] 60: Philippines [https] }}
{{61: Russia [https] 62: Spain (Madrid) [https] }}
{{63: Sweden [https] 64: Switzerland [https] }}
{{65: Taiwan (Chungli) [https] 66: Turkey (Denizli) [https] }}
{{67: Turkey (Mersin) [https] 68: UK (Bristol) [https] }}
{{69: UK (London 1) [https] 70: USA (IA) [https] }}
{{71: USA (IN) [https] 72: USA (KS) [https] }}
{{73: USA (MI 1) [https] 74: USA (MI 2) [https] }}
{{75: USA (OH) [https] 76: USA (OR) [https] }}
{{77: USA (TN) [https] 78: USA (TX 1) [https] }}
{{79: Uruguay [https] 80: (HTTP mirrors) }}
{{Selection: 1 }}
{{trying URL 'https://cloud.r-project.org/src/contrib/arrow_0.16.0.tar.gz' }}
{{Content type 'application/x-gzip' length 212922 bytes (207 KB) }}
{{================================================== }}
{{downloaded 207 KB }}
{{* installing *source* package 'arrow' ... }}
{{** package 'arrow' successfully unpacked and MD5 sums checked }}
{{*** No C++ binaries found for rhel-7 }}
{{*** Successfully retrieved C++ source }}
{{chmod: cannot access
'/tmp/RtmpisbeAL/file10a26194990b/cpp/build-support/*.sh': No such file or
directory }}
{{*** Building C++ libraries }}
{{*** Downloading cmake }}
{{Error in file(con, "rb") : cannot open the connection }}
{{Calls: build_libarrow -> ensure_cmake -> untar -> readBin -> file }}
{{In addition: Warning messages: }}
{{1: In download.file(binary_url, libfile, quiet = quietly) : }}
{{ URL
'https://dl.bintray.com/ursalabs/arrow-r/libarrow/bin/rhel-7/arrow-0.16.0.zip':
status was '404 Not Found' }}
{{2: In download.file(source_url, tf1, quiet = quietly) : }}
{{ URL 'https://dl.bintray.com/ursalabs/arrow-r/libarrow/src/arrow-0.16.0.zip':
status was '404 Not Found' }}
{{3: In unzip(tf1, exdir = src_dir) : error 1 in extracting from zip file }}
{{4: In download.file(cmake_binary_url, cmake_tar, quiet = quietly) : }}
{{ URL
'https://github.com/Kitware/CMake/releases/download/v3.16.2/cmake-3.16.2-Linux-x86_64.tar.gz':
status was 'HTTP response code said error' }}
{{5: In file(con, "rb") : }}
{{ cannot open file '/tmp/RtmpisbeAL/file10a26a78d666': No such file or
directory }}
{{Execution halted }}
{{------------------------- NOTE --------------------------- }}
{{After installation, please run arrow::install_arrow() }}
{{for help installing required runtime libraries }}
{{--------------------------------------------------------- }}
{{** libs }}
{{g++ -std=c++0x -I\{/custom/path/to/shared/R/build}/lib64/R/include -DNDEBUG
-I\{/custom/path/to/shared/R/build}/include -fPIC
-I"\{/custom/path/to/user/home}/cod}}
{{e/rlib/Rcpp/include" -fpic -g -O2 -c array.cpp -o array.o }}
{{g++ -std=c++0x -I\{/custom/path/to/shared/R/build}/lib64/R/include -DNDEBUG
-I\{/custom/path/to/shared/R/build}/include -fPIC
-I"\{/custom/path/to/user/home}/cod}}
{{e/rlib/Rcpp/include" -fpic -g -O2 -c array_from_vector.cpp -o
array_from_vector.o }}
{{g++ -std=c++0x -I\{/custom/path/to/shared/R/build}/lib64/R/include -DNDEBUG
-I\{/custom/path/to/shared/R/build}/include -fPIC
-I"\{/custom/path/to/user/home}/cod}}
{{e/rlib/Rcpp/include" -fpic -g -O2 -c array_to_vector.cpp -o array_to_vector.o
}}
{{g++ -std=c++0x -I\{/custom/path/to/shared/R/build}/lib64/R/include -DNDEBUG
-I\{/custom/path/to/shared/R/build}/include -fPIC
-I"\{/custom/path/to/user/home}/cod}}
{{e/rlib/Rcpp/include" -fpic -g -O2 -c arraydata.cpp -o arraydata.o }}
{{g++ -std=c++0x -I\{/custom/path/to/shared/R/build}/lib64/R/include -DNDEBUG
-I\{/custom/path/to/shared/R/build}/include -fPIC
-I"\{/custom/path/to/user/home}/cod}}
{{e/rlib/Rcpp/include" -fpic -g -O2 -c arrowExports.cpp -o arrowExports.o }}
{{g++ -std=c++0x -I\{/custom/path/to/shared/R/build}/lib64/R/include -DNDEBUG
-I\{/custom/path/to/shared/R/build}/include -fPIC
-I"\{/custom/path/to/user/home}/cod}}
{{e/rlib/Rcpp/include" -fpic -g -O2 -c buffer.cpp -o buffer.o }}
{{g++ -std=c++0x -I\{/custom/path/to/shared/R/build}/lib64/R/include -DNDEBUG
-I\{/custom/path/to/shared/R/build}/include -fPIC
-I"\{/custom/path/to/user/home}/cod}}
{{e/rlib/Rcpp/include" -fpic -g -O2 -c chunkedarray.cpp -o chunkedarray.o}}
{{g++ -std=c++0x -I\{/custom/path/to/shared/R/build}/lib64/R/include -DNDEBUG
-I\{/custom/path/to/shared/R/build}/include -fPIC
-I"\{/custom/path/to/user/home}/cod}}
{{e/rlib/Rcpp/include" -fpic -g -O2 -c compression.cpp -o compression.o }}
{{g++ -std=c++0x -I\{/custom/path/to/shared/R/build}/lib64/R/include -DNDEBUG
-I\{/custom/path/to/shared/R/build}/include -fPIC
-I"\{/custom/path/to/user/home}/cod}}
{{e/rlib/Rcpp/include" -fpic -g -O2 -c compute.cpp -o compute.o }}
{{g++ -std=c++0x -I\{/custom/path/to/shared/R/build}/lib64/R/include -DNDEBUG
-I\{/custom/path/to/shared/R/build}/include -fPIC
-I"\{/custom/path/to/user/home}/cod}}
{{e/rlib/Rcpp/include" -fpic -g -O2 -c csv.cpp -o csv.o }}
{{g++ -std=c++0x -I\{/custom/path/to/shared/R/build}/lib64/R/include -DNDEBUG
-I\{/custom/path/to/shared/R/build}/include -fPIC
-I"\{/custom/path/to/user/home}/cod}}
{{e/rlib/Rcpp/include" -fpic -g -O2 -c dataset.cpp -o dataset.o }}
{{g++ -std=c++0x -I\{/custom/path/to/shared/R/build}/lib64/R/include -DNDEBUG
-I\{/custom/path/to/shared/R/build}/include -fPIC
-I"\{/custom/path/to/user/home}/cod}}
{{e/rlib/Rcpp/include" -fpic -g -O2 -c datatype.cpp -o datatype.o }}
{{g++ -std=c++0x -I\{/custom/path/to/shared/R/build}/lib64/R/include -DNDEBUG
-I\{/custom/path/to/shared/R/build}/include -fPIC
-I"\{/custom/path/to/user/home}/cod}}
{{e/rlib/Rcpp/include" -fpic -g -O2 -c expression.cpp -o expression.o }}
{{g++ -std=c++0x -I\{/custom/path/to/shared/R/build}/lib64/R/include -DNDEBUG
-I\{/custom/path/to/shared/R/build}/include -fPIC
-I"\{/custom/path/to/user/home}/cod}}
{{e/rlib/Rcpp/include" -fpic -g -O2 -c feather.cpp -o feather.o }}
{{g++ -std=c++0x -I\{/custom/path/to/shared/R/build}/lib64/R/include -DNDEBUG
-I\{/custom/path/to/shared/R/build}/include -fPIC
-I"\{/custom/path/to/user/home}/cod}}
{{e/rlib/Rcpp/include" -fpic -g -O2 -c field.cpp -o field.o }}
{{g++ -std=c++0x -I\{/custom/path/to/shared/R/build}/lib64/R/include -DNDEBUG
-I\{/custom/path/to/shared/R/build}/include -fPIC
-I"\{/custom/path/to/user/home}/cod}}
{{e/rlib/Rcpp/include" -fpic -g -O2 -c filesystem.cpp -o filesystem.o }}
{{g++ -std=c++0x -I\{/custom/path/to/shared/R/build}/lib64/R/include -DNDEBUG
-I\{/custom/path/to/shared/R/build}/include -fPIC
-I"\{/custom/path/to/user/home}/cod}}
{{e/rlib/Rcpp/include" -fpic -g -O2 -c io.cpp -o io.o }}
{{g++ -std=c++0x -I\{/custom/path/to/shared/R/build}/lib64/R/include -DNDEBUG
-I\{/custom/path/to/shared/R/build}/include -fPIC
-I"\{/custom/path/to/user/home}/cod}}
{{e/rlib/Rcpp/include" -fpic -g -O2 -c json.cpp -o json.o }}
{{g++ -std=c++0x -I\{/custom/path/to/shared/R/build}/lib64/R/include -DNDEBUG
-I\{/custom/path/to/shared/R/build}/include -fPIC
-I"\{/custom/path/to/user/home}/cod}}
{{e/rlib/Rcpp/include" -fpic -g -O2 -c memorypool.cpp -o memorypool.o }}
{{g++ -std=c++0x -I\{/custom/path/to/shared/R/build}/lib64/R/include -DNDEBUG
-I\{/custom/path/to/shared/R/build}/include -fPIC
-I"\{/custom/path/to/user/home}/cod}}
{{e/rlib/Rcpp/include" -fpic -g -O2 -c message.cpp -o message.o }}
{{g++ -std=c++0x -I\{/custom/path/to/shared/R/build}/lib64/R/include -DNDEBUG
-I\{/custom/path/to/shared/R/build}/include -fPIC
-I"\{/custom/path/to/user/home}/cod}}
{{e/rlib/Rcpp/include" -fpic -g -O2 -c parquet.cpp -o parquet.o }}
{{g++ -std=c++0x -I\{/custom/path/to/shared/R/build}/lib64/R/include -DNDEBUG
-I\{/custom/path/to/shared/R/build}/include -fPIC
-I"\{/custom/path/to/user/home}/cod}}
{{e/rlib/Rcpp/include" -fpic -g -O2 -c recordbatch.cpp -o recordbatch.o }}
{{g++ -std=c++0x -I\{/custom/path/to/shared/R/build}/lib64/R/include -DNDEBUG
-I\{/custom/path/to/shared/R/build}/include -fPIC
-I"\{/custom/path/to/user/home}/cod}}
{{e/rlib/Rcpp/include" -fpic -g -O2 -c recordbatchreader.cpp -o
recordbatchreader.o}}
{{g++ -std=c++0x -I\{/custom/path/to/shared/R/build}/lib64/R/include -DNDEBUG
-I\{/custom/path/to/shared/R/build}/include -fPIC
-I"\{/custom/path/to/user/home}/cod}}
{{e/rlib/Rcpp/include" -fpic -g -O2 -c recordbatchwriter.cpp -o
recordbatchwriter.o }}
{{g++ -std=c++0x -I\{/custom/path/to/shared/R/build}/lib64/R/include -DNDEBUG
-I\{/custom/path/to/shared/R/build}/include -fPIC
-I"\{/custom/path/to/user/home}/cod}}
{{e/rlib/Rcpp/include" -fpic -g -O2 -c schema.cpp -o schema.o }}
{{g++ -std=c++0x -I\{/custom/path/to/shared/R/build}/lib64/R/include -DNDEBUG
-I\{/custom/path/to/shared/R/build}/include -fPIC
-I"\{/custom/path/to/user/home}/cod}}
{{e/rlib/Rcpp/include" -fpic -g -O2 -c symbols.cpp -o symbols.o }}
{{g++ -std=c++0x -I\{/custom/path/to/shared/R/build}/lib64/R/include -DNDEBUG
-I\{/custom/path/to/shared/R/build}/include -fPIC
-I"\{/custom/path/to/user/home}/cod}}
{{e/rlib/Rcpp/include" -fpic -g -O2 -c table.cpp -o table.o }}
{{g++ -std=c++0x -I\{/custom/path/to/shared/R/build}/lib64/R/include -DNDEBUG
-I\{/custom/path/to/shared/R/build}/include -fPIC
-I"\{/custom/path/to/user/home}/cod}}
{{e/rlib/Rcpp/include" -fpic -g -O2 -c threadpool.cpp -o threadpool.o }}
{{g++ -std=c++0x -shared -L\{/custom/path/to/shared/R/build}/lib64/R/lib
-Bdirect,--hash-style=both,-Wl,-O1 -L\{/custom/path/to/shared/R/build}/lib -o
arrow.}}
{{so array.o array_from_vector.o array_to_vector.o arraydata.o arrowExports.o
buffer.o chunkedarray.o compression.o compute.o csv.o dataset.o datatype.o
expression.o feath}}
{{er.o field.o filesystem.o io.o json.o memorypool.o message.o parquet.o
recordbatch.o recordbatchreader.o recordbatchwriter.o schema.o symbols.o
table.o threadpool.o -L{/}}
{{custom/path/to/shared/R/build}/lib64/R/lib -lR }}
{{installing to \{/custom/path/to/user/home}/code/rlib/arrow/libs }}
{{** R }}
{{** inst }}
{{** preparing package for lazy loading }}
{{** help }}
{{*** installing help indices }}
{{** building package indices }}
{{** installing vignettes }}
{{** testing if installed package can be loaded }}
{{* DONE (arrow) }}
{{The downloaded source packages are in }}
{{ '/tmp/RtmpdzePOS/downloaded_packages'}}
Thanks again!
> [R] Installation on RHEL 7 Cannot call io___MemoryMappedFile__Open()
> --------------------------------------------------------------------
>
> Key: ARROW-7807
> URL: https://issues.apache.org/jira/browse/ARROW-7807
> Project: Apache Arrow
> Issue Type: Bug
> Components: R
> Affects Versions: 0.16.0
> Environment: RHEL 7.6
> Custom R build in a non-default location
> Reporter: Omar Yassin
> Priority: Major
>
> Hey Team,
> I've been using Arrow successfully in python through conda and have been able
> to write and read parquet files successfully. Now I'm trying to have R users
> consume some of the parquet files I've produced. They run a shared R build in
> a custom location, so can't use conda with their setup. We tried installing
> the C++ libraries system-wide and then the R library in a user's directory,
> but kept getting {color:#de350b}Cannot call
> io{color}{color:#de350b}{{__MemoryMappedFile_}}{color}{color:#de350b}Open()
> {color}errors on{color:#de350b} read_parquet(){color}. I'm not sure if we've
> missed a step, or where to continue debugging. Does the R package have any
> known issues on RHEL 7? Below are some details:
>
> Environment:
> * RHEL 7.6
> * Custom local R environment in a non-default location
> Steps taken:
> # Installed the C++ libraries first (now live in /usr/lib64) as described
> (v.0.16.0) in [https://arrow.apache.org/install/]
> # Ran {color:#de350b}{{install.packages('arrow')}}{color} in an interactive
> R session
> # It couldn't find the C++ libraries and said {{{color:#de350b}No C++
> binaries found for rhel-7{color}}}
> # Couldn't find
> [https://dl.bintray.com/ursalabs/arrow-r/libarrow/bin/rhel-7/arrow-0.16.0.zip]
> when it tried to pull the binaries
> # Source download didn't work due to internal github firewall rules
> # Installed without errors, but threw {{{color:#de350b}Cannot call
> io{color}}}{color:#de350b}{{__MemoryMappedFile_}}{color}{{{color:#de350b}Open(){color}}}
> error on {{{color:#de350b}read_parquet(){color}}}
> # Removed the rlib/arrow directory and tried a different route
> # Set {{{color:#de350b}LIBARROW_BINARY_DISTRO='centos-7'{color}}}
> # Set {{{color:#de350b}PKG_CONFIG=/usr/lib64{color}}}
> # Ran {color:#de350b}{{install.packages('arrow')}}{color} in an interactive
> R session
> # Binaries and package seemed to install correctly without complaints
> # Still threw {{{color:#de350b}Cannot call
> {color}}}{color:#de350b}{{io__MemoryMappedFile_Open{{{color:#de350b}(){color}
> on {color:#de350b}read_parquet{color}}}}}{color}
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
