[
https://issues.apache.org/jira/browse/ARROW-7807?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17034016#comment-17034016
]
Omar Yassin commented on ARROW-7807:
------------------------------------
That's what I can't tease out without knowing the C++ code myself - whether
it's a problem on the C++ side, or the R side. Below is the output when I
switch it to centos-7
{code:java}
> install.packages('https://cran.r-project.org/src/contrib/Archive/arrow/arrow_0.16.0.tar.gz')
Installing package into '/path/to/user/home/code/rlib'
(as 'lib' is unspecified)
inferring 'repos = NULL' from 'pkgs'
trying URL
'https://cran.r-project.org/src/contrib/Archive/arrow/arrow_0.16.0.tar.gz'
Content type 'application/x-gzip' length 212922 bytes (207 KB)
==================================================
downloaded 207 KB
* installing *source* package 'arrow' ...
** package 'arrow' successfully unpacked and MD5 sums checked
*** Successfully retrieved C++ binaries for centos-7
------------------------- NOTE ---------------------------
After installation, please run arrow::install_arrow()
for help installing required runtime libraries
---------------------------------------------------------
** libs
g++ -std=c++0x -I/custom/path/to/shared/build/lib64/R/include -DNDEBUG
-I/custom/path/to/shared/build/include -fPIC
-I"/path/to/user/home/code/rlib/Rcpp/include" -fpic -g -O2 -c array.cpp -o
array.o
g++ -std=c++0x -I/custom/path/to/shared/build/lib64/R/include -DNDEBUG
-I/custom/path/to/shared/build/include -fPIC
-I"/path/to/user/home/code/rlib/Rcpp/include" -fpic -g -O2 -c
array_from_vector.cpp -o array_from_vector.o
g++ -std=c++0x -I/custom/path/to/shared/build/lib64/R/include -DNDEBUG
-I/custom/path/to/shared/build/include -fPIC
-I"/path/to/user/home/code/rlib/Rcpp/include" -fpic -g -O2 -c
array_to_vector.cpp -o array_to_vector.o
g++ -std=c++0x -I/custom/path/to/shared/build/lib64/R/include -DNDEBUG
-I/custom/path/to/shared/build/include -fPIC
-I"/path/to/user/home/code/rlib/Rcpp/include" -fpic -g -O2 -c arraydata.cpp
-o arraydata.o
g++ -std=c++0x -I/custom/path/to/shared/build/lib64/R/include -DNDEBUG
-I/custom/path/to/shared/build/include -fPIC
-I"/path/to/user/home/code/rlib/Rcpp/include" -fpic -g -O2 -c
arrowExports.cpp -o arrowExports.o
g++ -std=c++0x -I/custom/path/to/shared/build/lib64/R/include -DNDEBUG
-I/custom/path/to/shared/build/include -fPIC
-I"/path/to/user/home/code/rlib/Rcpp/include" -fpic -g -O2 -c buffer.cpp -o
buffer.o
g++ -std=c++0x -I/custom/path/to/shared/build/lib64/R/include -DNDEBUG
-I/custom/path/to/shared/build/include -fPIC
-I"/path/to/user/home/code/rlib/Rcpp/include" -fpic -g -O2 -c
chunkedarray.cpp -o chunkedarray.o
g++ -std=c++0x -I/custom/path/to/shared/build/lib64/R/include -DNDEBUG
-I/custom/path/to/shared/build/include -fPIC
-I"/path/to/user/home/code/rlib/Rcpp/include" -fpic -g -O2 -c
compression.cpp -o compression.o
g++ -std=c++0x -I/custom/path/to/shared/build/lib64/R/include -DNDEBUG
-I/custom/path/to/shared/build/include -fPIC
-I"/path/to/user/home/code/rlib/Rcpp/include" -fpic -g -O2 -c compute.cpp -o
compute.o
g++ -std=c++0x -I/custom/path/to/shared/build/lib64/R/include -DNDEBUG
-I/custom/path/to/shared/build/include -fPIC
-I"/path/to/user/home/code/rlib/Rcpp/include" -fpic -g -O2 -c csv.cpp -o
csv.o
g++ -std=c++0x -I/custom/path/to/shared/build/lib64/R/include -DNDEBUG
-I/custom/path/to/shared/build/include -fPIC
-I"/path/to/user/home/code/rlib/Rcpp/include" -fpic -g -O2 -c dataset.cpp -o
dataset.o
g++ -std=c++0x -I/custom/path/to/shared/build/lib64/R/include -DNDEBUG
-I/custom/path/to/shared/build/include -fPIC
-I"/path/to/user/home/code/rlib/Rcpp/include" -fpic -g -O2 -c datatype.cpp
-o datatype.o
g++ -std=c++0x -I/custom/path/to/shared/build/lib64/R/include -DNDEBUG
-I/custom/path/to/shared/build/include -fPIC
-I"/path/to/user/home/code/rlib/Rcpp/include" -fpic -g -O2 -c expression.cpp
-o expression.o
g++ -std=c++0x -I/custom/path/to/shared/build/lib64/R/include -DNDEBUG
-I/custom/path/to/shared/build/include -fPIC
-I"/path/to/user/home/code/rlib/Rcpp/include" -fpic -g -O2 -c feather.cpp -o
feather.o
g++ -std=c++0x -I/custom/path/to/shared/build/lib64/R/include -DNDEBUG
-I/custom/path/to/shared/build/include -fPIC
-I"/path/to/user/home/code/rlib/Rcpp/include" -fpic -g -O2 -c field.cpp -o
field.o
g++ -std=c++0x -I/custom/path/to/shared/build/lib64/R/include -DNDEBUG
-I/custom/path/to/shared/build/include -fPIC
-I"/path/to/user/home/code/rlib/Rcpp/include" -fpic -g -O2 -c filesystem.cpp
-o filesystem.o
g++ -std=c++0x -I/custom/path/to/shared/build/lib64/R/include -DNDEBUG
-I/custom/path/to/shared/build/include -fPIC
-I"/path/to/user/home/code/rlib/Rcpp/include" -fpic -g -O2 -c io.cpp -o io.o
g++ -std=c++0x -I/custom/path/to/shared/build/lib64/R/include -DNDEBUG
-I/custom/path/to/shared/build/include -fPIC
-I"/path/to/user/home/code/rlib/Rcpp/include" -fpic -g -O2 -c json.cpp -o
json.o
g++ -std=c++0x -I/custom/path/to/shared/build/lib64/R/include -DNDEBUG
-I/custom/path/to/shared/build/include -fPIC
-I"/path/to/user/home/code/rlib/Rcpp/include" -fpic -g -O2 -c memorypool.cpp
-o memorypool.o
g++ -std=c++0x -I/custom/path/to/shared/build/lib64/R/include -DNDEBUG
-I/custom/path/to/shared/build/include -fPIC
-I"/path/to/user/home/code/rlib/Rcpp/include" -fpic -g -O2 -c message.cpp -o
message.o
g++ -std=c++0x -I/custom/path/to/shared/build/lib64/R/include -DNDEBUG
-I/custom/path/to/shared/build/include -fPIC
-I"/path/to/user/home/code/rlib/Rcpp/include" -fpic -g -O2 -c parquet.cpp -o
parquet.o
g++ -std=c++0x -I/custom/path/to/shared/build/lib64/R/include -DNDEBUG
-I/custom/path/to/shared/build/include -fPIC
-I"/path/to/user/home/code/rlib/Rcpp/include" -fpic -g -O2 -c
recordbatch.cpp -o recordbatch.o
g++ -std=c++0x -I/custom/path/to/shared/build/lib64/R/include -DNDEBUG
-I/custom/path/to/shared/build/include -fPIC
-I"/path/to/user/home/code/rlib/Rcpp/include" -fpic -g -O2 -c
recordbatchreader.cpp -o recordbatchreader.o
g++ -std=c++0x -I/custom/path/to/shared/build/lib64/R/include -DNDEBUG
-I/custom/path/to/shared/build/include -fPIC
-I"/path/to/user/home/code/rlib/Rcpp/include" -fpic -g -O2 -c
recordbatchwriter.cpp -o recordbatchwriter.o
g++ -std=c++0x -I/custom/path/to/shared/build/lib64/R/include -DNDEBUG
-I/custom/path/to/shared/build/include -fPIC
-I"/path/to/user/home/code/rlib/Rcpp/include" -fpic -g -O2 -c schema.cpp -o
schema.o
g++ -std=c++0x -I/custom/path/to/shared/build/lib64/R/include -DNDEBUG
-I/custom/path/to/shared/build/include -fPIC
-I"/path/to/user/home/code/rlib/Rcpp/include" -fpic -g -O2 -c symbols.cpp -o
symbols.o
g++ -std=c++0x -I/custom/path/to/shared/build/lib64/R/include -DNDEBUG
-I/custom/path/to/shared/build/include -fPIC
-I"/path/to/user/home/code/rlib/Rcpp/include" -fpic -g -O2 -c table.cpp -o
table.o
g++ -std=c++0x -I/custom/path/to/shared/build/lib64/R/include -DNDEBUG
-I/custom/path/to/shared/build/include -fPIC
-I"/path/to/user/home/code/rlib/Rcpp/include" -fpic -g -O2 -c threadpool.cpp
-o threadpool.o
g++ -std=c++0x -shared -L/custom/path/to/shared/build/lib64/R/lib
-Bdirect,--hash-style=both,-Wl,-O1 -L/custom/path/to/shared/build/lib -o
arrow.so array.o array_from_vector.o array_to_vector.o arraydata.o
arrowExports.o buffer.o chunkedarray.o compression.o compute.o csv.o dataset.o
datatype.o expression.o feather.o field.o filesystem.o io.o json.o memorypool.o
message.o parquet.o recordbatch.o recordbatchreader.o recordbatchwriter.o
schema.o symbols.o table.o threadpool.o
-L/custom/path/to/shared/build/lib64/R/lib -lR
installing to /path/to/user/home/code/rlib/arrow/libs
** R
** inst
** preparing package for lazy loading
** help
*** installing help indices
** building package indices
** installing vignettes
** testing if installed package can be loaded
* DONE (arrow)
>
{code}
*Same error:*
{code:java}
> data <- read_parquet('/custom/path/to/parquet/file.parquet')
>
>
Error in io___MemoryMappedFile__Open(path, mode) :
Cannot call io___MemoryMappedFile__Open(). Please use arrow::install_arrow()
to install required runtime libraries.
{code}
> [R] Installation on RHEL 7 Cannot call io___MemoryMappedFile__Open()
> --------------------------------------------------------------------
>
> Key: ARROW-7807
> URL: https://issues.apache.org/jira/browse/ARROW-7807
> Project: Apache Arrow
> Issue Type: Bug
> Components: R
> Affects Versions: 0.16.0
> Environment: RHEL 7.6
> Custom R build in a non-default location
> Reporter: Omar Yassin
> Priority: Major
>
> Hey Team,
> I've been using Arrow successfully in python through conda and have been able
> to write and read parquet files successfully. Now I'm trying to have R users
> consume some of the parquet files I've produced. They run a shared R build in
> a custom location, so can't use conda with their setup. We tried installing
> the C++ libraries system-wide and then the R library in a user's directory,
> but kept getting {color:#de350b}Cannot call
> io{color}{color:#de350b}{{__MemoryMappedFile_}}{color}{color:#de350b}Open()
> {color}errors on{color:#de350b} read_parquet(){color}. I'm not sure if we've
> missed a step, or where to continue debugging. Does the R package have any
> known issues on RHEL 7? Below are some details:
>
> Environment:
> * RHEL 7.6
> * Custom local R environment in a non-default location
> Steps taken:
> # Installed the C++ libraries first (now live in /usr/lib64) as described
> (v.0.16.0) in [https://arrow.apache.org/install/]
> # Ran {color:#de350b}{{install.packages('arrow')}}{color} in an interactive
> R session
> # It couldn't find the C++ libraries and said {{{color:#de350b}No C++
> binaries found for rhel-7{color}}}
> # Couldn't find
> [https://dl.bintray.com/ursalabs/arrow-r/libarrow/bin/rhel-7/arrow-0.16.0.zip]
> when it tried to pull the binaries
> # Source download didn't work due to internal github firewall rules
> # Installed without errors, but threw {{{color:#de350b}Cannot call
> io{color}}}{color:#de350b}{{__MemoryMappedFile_}}{color}{{{color:#de350b}Open(){color}}}
> error on {{{color:#de350b}read_parquet(){color}}}
> # Removed the rlib/arrow directory and tried a different route
> # Set {{{color:#de350b}LIBARROW_BINARY_DISTRO='centos-7'{color}}}
> # Set {{{color:#de350b}PKG_CONFIG=/usr/lib64{color}}}
> # Ran {color:#de350b}{{install.packages('arrow')}}{color} in an interactive
> R session
> # Binaries and package seemed to install correctly without complaints
> # Still threw {{{color:#de350b}Cannot call
> {color}}}{color:#de350b}{{io__MemoryMappedFile_Open{{{color:#de350b}(){color}
> on {color:#de350b}read_parquet{color}}}}}{color}
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
