ChenSammi commented on PR #66: URL: https://github.com/apache/ozone-docker-runner/pull/66#issuecomment-4486731490
> > I need a public place to host the hadoop native library for Mac-OS, so that [apache/ozone#10305](https://github.com/apache/ozone/pull/10305) can download from. Do you have other suggestion better than host in this repo? I'm open to it. > > Thank you for the openness. > > Ideally Hadoop should release these native libs in platform-specific jars, e.g. Netty does that. > > Until then I suggest creating a separate repository (maybe `ozone-thirdparty`) for these artifacts. I would store them in the dir `native/hadoop-3.4.3` in case we may want to add Java libraries in the future. We should also add the same libs for Linux so that we can avoid download of Hadoop tarballs. Something like: > > ``` > libhadoop-linux-x86_64.so.1.0.0 > libhadoop-linux-aarch_64.so.1.0.0 > libhadoop-osx-aarch_64.1.0.0.dylib > ``` > > BTW, do I understand correctly that this Mac library is built locally, not part of the official Hadoop release? If so, we should mention it in a README.txt in the same dir, maybe with instructions on how to build it if needed (e.g. for new Hadoop versions). Yes, Hadoop release doesn't provide native library for Mac platform. This is built on my local environment. The hadoop native build on Mac is a little bit complex. Due to lack of some Linux headers referred by YARN container native code, it cannot succeed completely, but enough to get the libhadoop native library. And I hit several issues during that. And these issues varies on different Mac OS kernel version, cmake, gcc, zlib, openssl verions ( I have two Macbook, one intel chipset, one arm chipset). So I don't have enough confidence currently to provide a general hadoop native build guide for Mac platform. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
