jonkeane commented on pull request #10710: URL: https://github.com/apache/arrow/pull/10710#issuecomment-895130738
Ok, I've got a few more pieces of what's going on here: For 21.04 and gcc11 (which is based on 21.04). It looks like not _all_ of the system dependencies are being linked correctly in the R project. For example, thrift is installed in these images, and [is found when libarrow is being build](https://github.com/ursacomputing/crossbow/runs/3279031937?check_suite_focus=true#step:8:128), however, it's [not among the paths that are linked](https://github.com/ursacomputing/crossbow/runs/3279031937?check_suite_focus=true#step:8:1038), and [so when it is attempted to be loaded it errors](https://github.com/ursacomputing/crossbow/runs/3279031937?check_suite_focus=true#step:7:6874). This isn't happening with the `ARROW_DEPENDENCY_SOURCE=AUTO` test only because we hadn't pre-installed thrift on the system, it's not found during building and thus is build from source. But if someone did use `ARROW_DEPENDENCY_SOURCE=AUTO` and happen to have thrift installed, they would see this same issue. What we need to do is, for the dependencies that are found, run something like https://github.com/apache/arrow/blob/7ca6906454486d87a885175a16eaeb8211596072/r/configure#L191 on them where instead of `arrow` being at the end, it's the dependency name (e.g. `thrift`) so that those are added to `PKG_LIBS`. There might be a way to get this information from Arrow's build process (I thought I remember a comment about this earlier in the thread from Neal, but I can't find it anymore). Additionally, something [is off about the AWS SDK in the 21.04 build ](https://github.com/ursacomputing/crossbow/runs/3279031495?check_suite_focus=true#step:8:176)— it's not triggered by the gcc-11 build only because we've shut off S3 support (and therefore don't build the AWS SDK). I'm not certain that this issue is a problem with this PR specifically, or something more general that should be solved elsewhere. I wouldn't be opposed to adding `ARROW_S3=OFF` to the 21.04 build as well for now and making a follow up jira to figure out what's going on there — we already have one for bumping the AWS SDK version to something that is compatible with GCC11, and that might fix this entirely. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
