Re: Build issues on macOS [newbie]
Thanks for letting us know. If there are any improvements we can make to the developer documentation, please feel free to open a JIRA or a pull request to fix On Mon, Sep 30, 2019 at 8:13 AM Tarek Allam Jr. wrote: > > > Hi Wes, > > Thank you very much, that indeed fixed things and allowed me to complete a > build. > > After running conda install --file ci/conda_env_cpp.yml I was able to get > passed > the above error, but then was faced with the error message akin to that found > at > https://issues.apache.org/jira/browse/ARROW-4935 > > But this was easily solved with running the suggested solution of > > $ cd /Library/Developer/CommandLineTools/Packages/ > $ open macOS_SDK_headers_for_macOS_10.14.pkg > > (Just putting links to the errors/issues for my reference) > > Thanks again for your help getting me started. I'll now go in search of > possible > areas of where I can contribute! > > Cheers, > Tarek > > > On 2019/09/26 19:23:08, Wes McKinney wrote: > > It looks like the development toolchain dependencies in > > conda_env_cpp.yml aren't installed in your "main" conda environment, > > e.g. > > > > https://github.com/apache/arrow/blob/master/ci/conda_env_cpp.yml#L42 > > > > You can see what's installed by running "conda list" > > > > Note that most of these dependencies are optional, but we provide the > > env files to simplify general development of the project so > > contributors aren't struggling to produce comprehensive builds. > > > > On Wed, Sep 25, 2019 at 11:33 AM Tarek Allam Jr. > > wrote: > > > > > > Thanks for the advice Uwe and Neal. I tried your suggestion (as well as > > > turning many of the flags to off) but then ran into other errors > > > afterwards such as: > > > > > > -- Using ZSTD_ROOT: /usr/local/anaconda3/envs/main > > > CMake Error at > > > /usr/local/Cellar/cmake/3.15.3/share/cmake/Modules/FindPackageHandleStandardArgs.cmake:137 > > > (message): > > > Could NOT find ZSTD (missing: ZSTD_LIB ZSTD_INCLUDE_DIR) > > > > > > /usr/local/Cellar/cmake/3.15.3/share/cmake/Modules/FindPackageHandleStandardArgs.cmake:378 > > > (_FPHSA_FAILURE_MESSAGE) > > > cmake_modules/FindZSTD.cmake:61 (find_package_handle_standard_args) > > > cmake_modules/ThirdpartyToolchain.cmake:181 (find_package) > > > cmake_modules/ThirdpartyToolchain.cmake:2033 (resolve_dependency) > > > CMakeLists.txt:412 (include) > > > > > > I think I will spend some more time to understand CMAKE better and > > > familiarise myself with the codebase more before having another go. > > > Hopefully in this time conda-forge would have removed the SDK requirement > > > as well which like you say should make things much more similar. > > > > > > Thanks again, > > > > > > Regards, > > > Tarek > > > > > > On 2019/09/19 16:00:09, "Uwe L. Korn" wrote: > > > > Hello Tarek, > > > > > > > > this error message is normally the one you get when CONDA_BUILD_SYSROOT > > > > doesn't point to your 10.9 SDK. Please delete your build folder again > > > > and do `export CONDA_BUILD_SYSROOT=..` immediately before running > > > > cmake. Running e.g. a conda install will sadly reset this variable to > > > > something different and break the build. > > > > > > > > As a sidenote: It looks like in 1-2 months that conda-forge will get > > > > rid of the SDK requirement, then this will be a bit simpler. > > > > > > > > Cheers > > > > Uwe > > > > > > > > On Thu, Sep 19, 2019, at 5:24 PM, Tarek Allam Jr. wrote: > > > > > > > > > > Hi all, > > > > > > > > > > Firstly I must apologies if what I put here is extremely trivial, but > > > > > I am a > > > > > complete newcomer to the Apache Arrow project and contributing to > > > > > Apache in > > > > > general, but I am very keen to get involved. > > > > > > > > > > I'm hoping to help where I can so I recently attempted to complete a > > > > > build > > > > > following the instructions laid out in the 'Python Development' > > > > > section of the > > > > > documentation here: > > > > > > > > > > After completing the steps that specifically uses Conda I was able to > > > > > create an > > > > > environment but when it comes to building I am unable to do so. > > > > > > > > > > I am on macOS -- 10.14.6 and as outlined in the docs and here > > > > > (https://stackoverflow.com/a/55798942/4521950) I used use 10.9.sdk > > > > > instead > > > > > of the latest. I have both added this manually using ccmake and also > > > > > defining it > > > > > like so: > > > > > > > > > > cmake -DCMAKE_INSTALL_PREFIX=$ARROW_HOME \ > > > > > -DCMAKE_INSTALL_LIBDIR=lib \ > > > > > -DARROW_FLIGHT=ON \ > > > > > -DARROW_GANDIVA=ON \ > > > > > -DARROW_ORC=ON \ > > > > > -DARROW_PARQUET=ON \ > > > > > -DARROW_PYTHON=ON \ > > > > > -DARROW_PLASMA=ON \ > > > > > -DARROW_BUILD_TESTS=ON \ > > > > > -DCONDA_BUILD_SYSROOT=/opt/MacOSX10.9.sdk \ > > > > > -DARROW_DEPENDENCY_SOURCE=AUTO \ > > > > > .. > > > > > > > > > > But it seems that
Re: Build issues on macOS [newbie]
Hi Wes, Thank you very much, that indeed fixed things and allowed me to complete a build. After running conda install --file ci/conda_env_cpp.yml I was able to get passed the above error, but then was faced with the error message akin to that found at https://issues.apache.org/jira/browse/ARROW-4935 But this was easily solved with running the suggested solution of $ cd /Library/Developer/CommandLineTools/Packages/ $ open macOS_SDK_headers_for_macOS_10.14.pkg (Just putting links to the errors/issues for my reference) Thanks again for your help getting me started. I'll now go in search of possible areas of where I can contribute! Cheers, Tarek On 2019/09/26 19:23:08, Wes McKinney wrote: > It looks like the development toolchain dependencies in > conda_env_cpp.yml aren't installed in your "main" conda environment, > e.g. > > https://github.com/apache/arrow/blob/master/ci/conda_env_cpp.yml#L42 > > You can see what's installed by running "conda list" > > Note that most of these dependencies are optional, but we provide the > env files to simplify general development of the project so > contributors aren't struggling to produce comprehensive builds. > > On Wed, Sep 25, 2019 at 11:33 AM Tarek Allam Jr. wrote: > > > > Thanks for the advice Uwe and Neal. I tried your suggestion (as well as > > turning many of the flags to off) but then ran into other errors afterwards > > such as: > > > > -- Using ZSTD_ROOT: /usr/local/anaconda3/envs/main > > CMake Error at > > /usr/local/Cellar/cmake/3.15.3/share/cmake/Modules/FindPackageHandleStandardArgs.cmake:137 > > (message): > > Could NOT find ZSTD (missing: ZSTD_LIB ZSTD_INCLUDE_DIR) > > > > /usr/local/Cellar/cmake/3.15.3/share/cmake/Modules/FindPackageHandleStandardArgs.cmake:378 > > (_FPHSA_FAILURE_MESSAGE) > > cmake_modules/FindZSTD.cmake:61 (find_package_handle_standard_args) > > cmake_modules/ThirdpartyToolchain.cmake:181 (find_package) > > cmake_modules/ThirdpartyToolchain.cmake:2033 (resolve_dependency) > > CMakeLists.txt:412 (include) > > > > I think I will spend some more time to understand CMAKE better and > > familiarise myself with the codebase more before having another go. > > Hopefully in this time conda-forge would have removed the SDK requirement > > as well which like you say should make things much more similar. > > > > Thanks again, > > > > Regards, > > Tarek > > > > On 2019/09/19 16:00:09, "Uwe L. Korn" wrote: > > > Hello Tarek, > > > > > > this error message is normally the one you get when CONDA_BUILD_SYSROOT > > > doesn't point to your 10.9 SDK. Please delete your build folder again and > > > do `export CONDA_BUILD_SYSROOT=..` immediately before running cmake. > > > Running e.g. a conda install will sadly reset this variable to something > > > different and break the build. > > > > > > As a sidenote: It looks like in 1-2 months that conda-forge will get rid > > > of the SDK requirement, then this will be a bit simpler. > > > > > > Cheers > > > Uwe > > > > > > On Thu, Sep 19, 2019, at 5:24 PM, Tarek Allam Jr. wrote: > > > > > > > > Hi all, > > > > > > > > Firstly I must apologies if what I put here is extremely trivial, but I > > > > am a > > > > complete newcomer to the Apache Arrow project and contributing to > > > > Apache in > > > > general, but I am very keen to get involved. > > > > > > > > I'm hoping to help where I can so I recently attempted to complete a > > > > build > > > > following the instructions laid out in the 'Python Development' section > > > > of the > > > > documentation here: > > > > > > > > After completing the steps that specifically uses Conda I was able to > > > > create an > > > > environment but when it comes to building I am unable to do so. > > > > > > > > I am on macOS -- 10.14.6 and as outlined in the docs and here > > > > (https://stackoverflow.com/a/55798942/4521950) I used use 10.9.sdk > > > > instead > > > > of the latest. I have both added this manually using ccmake and also > > > > defining it > > > > like so: > > > > > > > > cmake -DCMAKE_INSTALL_PREFIX=$ARROW_HOME \ > > > > -DCMAKE_INSTALL_LIBDIR=lib \ > > > > -DARROW_FLIGHT=ON \ > > > > -DARROW_GANDIVA=ON \ > > > > -DARROW_ORC=ON \ > > > > -DARROW_PARQUET=ON \ > > > > -DARROW_PYTHON=ON \ > > > > -DARROW_PLASMA=ON \ > > > > -DARROW_BUILD_TESTS=ON \ > > > > -DCONDA_BUILD_SYSROOT=/opt/MacOSX10.9.sdk \ > > > > -DARROW_DEPENDENCY_SOURCE=AUTO \ > > > > .. > > > > > > > > But it seems that whatever I try, I seem to get errors, the main only > > > > tripping > > > > me up at the moment is: > > > > > > > > -- Building using CMake version: 3.15.3 > > > > -- The C compiler identification is Clang 4.0.1 > > > > -- The CXX compiler identification is Clang 4.0.1 > > > > -- Check for working C compiler: > > > > /usr/local/anaconda3/envs/pyarrow-dev/bin/clang > > > > -- Check for working C compiler: > > > >
Re: Build issues on macOS [newbie]
It looks like the development toolchain dependencies in conda_env_cpp.yml aren't installed in your "main" conda environment, e.g. https://github.com/apache/arrow/blob/master/ci/conda_env_cpp.yml#L42 You can see what's installed by running "conda list" Note that most of these dependencies are optional, but we provide the env files to simplify general development of the project so contributors aren't struggling to produce comprehensive builds. On Wed, Sep 25, 2019 at 11:33 AM Tarek Allam Jr. wrote: > > Thanks for the advice Uwe and Neal. I tried your suggestion (as well as > turning many of the flags to off) but then ran into other errors afterwards > such as: > > -- Using ZSTD_ROOT: /usr/local/anaconda3/envs/main > CMake Error at > /usr/local/Cellar/cmake/3.15.3/share/cmake/Modules/FindPackageHandleStandardArgs.cmake:137 > (message): > Could NOT find ZSTD (missing: ZSTD_LIB ZSTD_INCLUDE_DIR) > > /usr/local/Cellar/cmake/3.15.3/share/cmake/Modules/FindPackageHandleStandardArgs.cmake:378 > (_FPHSA_FAILURE_MESSAGE) > cmake_modules/FindZSTD.cmake:61 (find_package_handle_standard_args) > cmake_modules/ThirdpartyToolchain.cmake:181 (find_package) > cmake_modules/ThirdpartyToolchain.cmake:2033 (resolve_dependency) > CMakeLists.txt:412 (include) > > I think I will spend some more time to understand CMAKE better and > familiarise myself with the codebase more before having another go. Hopefully > in this time conda-forge would have removed the SDK requirement as well which > like you say should make things much more similar. > > Thanks again, > > Regards, > Tarek > > On 2019/09/19 16:00:09, "Uwe L. Korn" wrote: > > Hello Tarek, > > > > this error message is normally the one you get when CONDA_BUILD_SYSROOT > > doesn't point to your 10.9 SDK. Please delete your build folder again and > > do `export CONDA_BUILD_SYSROOT=..` immediately before running cmake. > > Running e.g. a conda install will sadly reset this variable to something > > different and break the build. > > > > As a sidenote: It looks like in 1-2 months that conda-forge will get rid of > > the SDK requirement, then this will be a bit simpler. > > > > Cheers > > Uwe > > > > On Thu, Sep 19, 2019, at 5:24 PM, Tarek Allam Jr. wrote: > > > > > > Hi all, > > > > > > Firstly I must apologies if what I put here is extremely trivial, but I > > > am a > > > complete newcomer to the Apache Arrow project and contributing to Apache > > > in > > > general, but I am very keen to get involved. > > > > > > I'm hoping to help where I can so I recently attempted to complete a build > > > following the instructions laid out in the 'Python Development' section > > > of the > > > documentation here: > > > > > > After completing the steps that specifically uses Conda I was able to > > > create an > > > environment but when it comes to building I am unable to do so. > > > > > > I am on macOS -- 10.14.6 and as outlined in the docs and here > > > (https://stackoverflow.com/a/55798942/4521950) I used use 10.9.sdk > > > instead > > > of the latest. I have both added this manually using ccmake and also > > > defining it > > > like so: > > > > > > cmake -DCMAKE_INSTALL_PREFIX=$ARROW_HOME \ > > > -DCMAKE_INSTALL_LIBDIR=lib \ > > > -DARROW_FLIGHT=ON \ > > > -DARROW_GANDIVA=ON \ > > > -DARROW_ORC=ON \ > > > -DARROW_PARQUET=ON \ > > > -DARROW_PYTHON=ON \ > > > -DARROW_PLASMA=ON \ > > > -DARROW_BUILD_TESTS=ON \ > > > -DCONDA_BUILD_SYSROOT=/opt/MacOSX10.9.sdk \ > > > -DARROW_DEPENDENCY_SOURCE=AUTO \ > > > .. > > > > > > But it seems that whatever I try, I seem to get errors, the main only > > > tripping > > > me up at the moment is: > > > > > > -- Building using CMake version: 3.15.3 > > > -- The C compiler identification is Clang 4.0.1 > > > -- The CXX compiler identification is Clang 4.0.1 > > > -- Check for working C compiler: > > > /usr/local/anaconda3/envs/pyarrow-dev/bin/clang > > > -- Check for working C compiler: > > > /usr/local/anaconda3/envs/pyarrow-dev/bin/clang -- broken > > > CMake Error at > > > /usr/local/anaconda3/envs/pyarrow-dev/share/cmake-3.15/Modules/CMakeTestCCompiler.cmake:60 > > > (message): > > > The C compiler > > > > > > "/usr/local/anaconda3/envs/pyarrow-dev/bin/clang" > > > > > > is not able to compile a simple test program. > > > > > > It fails with the following output: > > > > > > Change Dir: /Users/tallamjr/Github/arrow/cpp/build/CMakeFiles/CMakeTmp > > > > > > Run Build Command(s):/usr/local/bin/gmake cmTC_b252c/fast && > > > /usr/local/bin/gmake -f CMakeFiles/cmTC_b252c.dir/build.make > > > CMakeFiles/cmTC_b252c.dir/build > > > gmake[1]: Entering directory > > > '/Users/tallamjr/Github/arrow/cpp/build/CMakeFiles/CMakeTmp' > > > Building C object CMakeFiles/cmTC_b252c.dir/testCCompiler.c.o > > > /usr/local/anaconda3/envs/pyarrow-dev/bin/clang -march=core2 > > > -mtune=haswell -mssse3 -ftree-vectorize -fPIC -fPIE > > >
Re: Build issues on macOS [newbie]
Thanks for the advice Uwe and Neal. I tried your suggestion (as well as turning many of the flags to off) but then ran into other errors afterwards such as: -- Using ZSTD_ROOT: /usr/local/anaconda3/envs/main CMake Error at /usr/local/Cellar/cmake/3.15.3/share/cmake/Modules/FindPackageHandleStandardArgs.cmake:137 (message): Could NOT find ZSTD (missing: ZSTD_LIB ZSTD_INCLUDE_DIR) /usr/local/Cellar/cmake/3.15.3/share/cmake/Modules/FindPackageHandleStandardArgs.cmake:378 (_FPHSA_FAILURE_MESSAGE) cmake_modules/FindZSTD.cmake:61 (find_package_handle_standard_args) cmake_modules/ThirdpartyToolchain.cmake:181 (find_package) cmake_modules/ThirdpartyToolchain.cmake:2033 (resolve_dependency) CMakeLists.txt:412 (include) I think I will spend some more time to understand CMAKE better and familiarise myself with the codebase more before having another go. Hopefully in this time conda-forge would have removed the SDK requirement as well which like you say should make things much more similar. Thanks again, Regards, Tarek On 2019/09/19 16:00:09, "Uwe L. Korn" wrote: > Hello Tarek, > > this error message is normally the one you get when CONDA_BUILD_SYSROOT > doesn't point to your 10.9 SDK. Please delete your build folder again and do > `export CONDA_BUILD_SYSROOT=..` immediately before running cmake. Running > e.g. a conda install will sadly reset this variable to something different > and break the build. > > As a sidenote: It looks like in 1-2 months that conda-forge will get rid of > the SDK requirement, then this will be a bit simpler. > > Cheers > Uwe > > On Thu, Sep 19, 2019, at 5:24 PM, Tarek Allam Jr. wrote: > > > > Hi all, > > > > Firstly I must apologies if what I put here is extremely trivial, but I am a > > complete newcomer to the Apache Arrow project and contributing to Apache in > > general, but I am very keen to get involved. > > > > I'm hoping to help where I can so I recently attempted to complete a build > > following the instructions laid out in the 'Python Development' section of > > the > > documentation here: > > > > After completing the steps that specifically uses Conda I was able to > > create an > > environment but when it comes to building I am unable to do so. > > > > I am on macOS -- 10.14.6 and as outlined in the docs and here > > (https://stackoverflow.com/a/55798942/4521950) I used use 10.9.sdk > > instead > > of the latest. I have both added this manually using ccmake and also > > defining it > > like so: > > > > cmake -DCMAKE_INSTALL_PREFIX=$ARROW_HOME \ > > -DCMAKE_INSTALL_LIBDIR=lib \ > > -DARROW_FLIGHT=ON \ > > -DARROW_GANDIVA=ON \ > > -DARROW_ORC=ON \ > > -DARROW_PARQUET=ON \ > > -DARROW_PYTHON=ON \ > > -DARROW_PLASMA=ON \ > > -DARROW_BUILD_TESTS=ON \ > > -DCONDA_BUILD_SYSROOT=/opt/MacOSX10.9.sdk \ > > -DARROW_DEPENDENCY_SOURCE=AUTO \ > > .. > > > > But it seems that whatever I try, I seem to get errors, the main only > > tripping > > me up at the moment is: > > > > -- Building using CMake version: 3.15.3 > > -- The C compiler identification is Clang 4.0.1 > > -- The CXX compiler identification is Clang 4.0.1 > > -- Check for working C compiler: > > /usr/local/anaconda3/envs/pyarrow-dev/bin/clang > > -- Check for working C compiler: > > /usr/local/anaconda3/envs/pyarrow-dev/bin/clang -- broken > > CMake Error at > > /usr/local/anaconda3/envs/pyarrow-dev/share/cmake-3.15/Modules/CMakeTestCCompiler.cmake:60 > > (message): > > The C compiler > > > > "/usr/local/anaconda3/envs/pyarrow-dev/bin/clang" > > > > is not able to compile a simple test program. > > > > It fails with the following output: > > > > Change Dir: /Users/tallamjr/Github/arrow/cpp/build/CMakeFiles/CMakeTmp > > > > Run Build Command(s):/usr/local/bin/gmake cmTC_b252c/fast && > > /usr/local/bin/gmake -f CMakeFiles/cmTC_b252c.dir/build.make > > CMakeFiles/cmTC_b252c.dir/build > > gmake[1]: Entering directory > > '/Users/tallamjr/Github/arrow/cpp/build/CMakeFiles/CMakeTmp' > > Building C object CMakeFiles/cmTC_b252c.dir/testCCompiler.c.o > > /usr/local/anaconda3/envs/pyarrow-dev/bin/clang -march=core2 > > -mtune=haswell -mssse3 -ftree-vectorize -fPIC -fPIE > > -fstack-protector-strong -O2 -pipe -isysroot /opt/MacOSX10.9.sdk -o > > CMakeFiles/cmTC_b252c.dir/testCCompiler.c.o -c > > /Users/tallamjr/Github/arrow/cpp/build/CMakeFiles/CMakeTmp/testCCompiler.c > > Linking C executable cmTC_b252c > > /usr/local/anaconda3/envs/pyarrow-dev/bin/cmake -E > > cmake_link_script CMakeFiles/cmTC_b252c.dir/link.txt --verbose=1 > > /usr/local/anaconda3/envs/pyarrow-dev/bin/clang -march=core2 > > -mtune=haswell -mssse3 -ftree-vectorize -fPIC -fPIE > > -fstack-protector-strong -O2 -pipe -isysroot /opt/MacOSX10.9.sdk > > -Wl,-search_paths_first -Wl,-headerpad_max_install_names -Wl,-pie > > -Wl,-headerpad_max_install_names -Wl,-dead_strip_dylibs > >
Re: Build issues on macOS [newbie]
Hello Tarek, this error message is normally the one you get when CONDA_BUILD_SYSROOT doesn't point to your 10.9 SDK. Please delete your build folder again and do `export CONDA_BUILD_SYSROOT=..` immediately before running cmake. Running e.g. a conda install will sadly reset this variable to something different and break the build. As a sidenote: It looks like in 1-2 months that conda-forge will get rid of the SDK requirement, then this will be a bit simpler. Cheers Uwe On Thu, Sep 19, 2019, at 5:24 PM, Tarek Allam Jr. wrote: > > Hi all, > > Firstly I must apologies if what I put here is extremely trivial, but I am a > complete newcomer to the Apache Arrow project and contributing to Apache in > general, but I am very keen to get involved. > > I'm hoping to help where I can so I recently attempted to complete a build > following the instructions laid out in the 'Python Development' section of the > documentation here: > > After completing the steps that specifically uses Conda I was able to create > an > environment but when it comes to building I am unable to do so. > > I am on macOS -- 10.14.6 and as outlined in the docs and here > (https://stackoverflow.com/a/55798942/4521950) I used use 10.9.sdk > instead > of the latest. I have both added this manually using ccmake and also > defining it > like so: > > cmake -DCMAKE_INSTALL_PREFIX=$ARROW_HOME \ > -DCMAKE_INSTALL_LIBDIR=lib \ > -DARROW_FLIGHT=ON \ > -DARROW_GANDIVA=ON \ > -DARROW_ORC=ON \ > -DARROW_PARQUET=ON \ > -DARROW_PYTHON=ON \ > -DARROW_PLASMA=ON \ > -DARROW_BUILD_TESTS=ON \ > -DCONDA_BUILD_SYSROOT=/opt/MacOSX10.9.sdk \ > -DARROW_DEPENDENCY_SOURCE=AUTO \ > .. > > But it seems that whatever I try, I seem to get errors, the main only tripping > me up at the moment is: > > -- Building using CMake version: 3.15.3 > -- The C compiler identification is Clang 4.0.1 > -- The CXX compiler identification is Clang 4.0.1 > -- Check for working C compiler: > /usr/local/anaconda3/envs/pyarrow-dev/bin/clang > -- Check for working C compiler: > /usr/local/anaconda3/envs/pyarrow-dev/bin/clang -- broken > CMake Error at > /usr/local/anaconda3/envs/pyarrow-dev/share/cmake-3.15/Modules/CMakeTestCCompiler.cmake:60 > (message): > The C compiler > > "/usr/local/anaconda3/envs/pyarrow-dev/bin/clang" > > is not able to compile a simple test program. > > It fails with the following output: > > Change Dir: /Users/tallamjr/Github/arrow/cpp/build/CMakeFiles/CMakeTmp > > Run Build Command(s):/usr/local/bin/gmake cmTC_b252c/fast && > /usr/local/bin/gmake -f CMakeFiles/cmTC_b252c.dir/build.make > CMakeFiles/cmTC_b252c.dir/build > gmake[1]: Entering directory > '/Users/tallamjr/Github/arrow/cpp/build/CMakeFiles/CMakeTmp' > Building C object CMakeFiles/cmTC_b252c.dir/testCCompiler.c.o > /usr/local/anaconda3/envs/pyarrow-dev/bin/clang -march=core2 > -mtune=haswell -mssse3 -ftree-vectorize -fPIC -fPIE > -fstack-protector-strong -O2 -pipe -isysroot /opt/MacOSX10.9.sdk -o > CMakeFiles/cmTC_b252c.dir/testCCompiler.c.o -c > /Users/tallamjr/Github/arrow/cpp/build/CMakeFiles/CMakeTmp/testCCompiler.c > Linking C executable cmTC_b252c > /usr/local/anaconda3/envs/pyarrow-dev/bin/cmake -E > cmake_link_script CMakeFiles/cmTC_b252c.dir/link.txt --verbose=1 > /usr/local/anaconda3/envs/pyarrow-dev/bin/clang -march=core2 > -mtune=haswell -mssse3 -ftree-vectorize -fPIC -fPIE > -fstack-protector-strong -O2 -pipe -isysroot /opt/MacOSX10.9.sdk > -Wl,-search_paths_first -Wl,-headerpad_max_install_names -Wl,-pie > -Wl,-headerpad_max_install_names -Wl,-dead_strip_dylibs > CMakeFiles/cmTC_b252c.dir/testCCompiler.c.o -o cmTC_b252c > ld: warning: ignoring file > /Applications/Xcode.app/Contents/Developer/Platforms/MacOSX.platform/Developer/SDKs/MacOSX10.14.sdk/usr/lib/libSystem.tbd, > file was built for unsupported file format ( 0x2D 0x2D 0x2D 0x20 0x21 0x74 > 0x61 0x70 0x69 0x2D 0x74 0x62 0x64 0x2D 0x76 0x33 ) which is not the > architecture being linked (x86_64): > /Applications/Xcode.app/Contents/Developer/Platforms/MacOSX.platform/Developer/SDKs/MacOSX10.14.sdk/usr/lib/libSystem.tbd > ld: dynamic main executables must link with libSystem.dylib for > architecture x86_64 > clang-4.0: error: linker command failed with exit code 1 (use -v to > see invocation) > gmake[1]: *** [CMakeFiles/cmTC_b252c.dir/build.make:87: cmTC_b252c] > Error 1 > gmake[1]: Leaving directory > '/Users/tallamjr/Github/arrow/cpp/build/CMakeFiles/CMakeTmp' > gmake: *** [Makefile:121: cmTC_b252c/fast] Error 2 > > > CMake will not be able to correctly generate this project. > Call Stack (most recent call first): > CMakeLists.txt:32 (project) > > -- Configuring incomplete, errors occurred! > See also "/Users/tallamjr/Github/arrow/cpp/build/CMakeFiles/CMakeOutput.log". > See also
Re: Build issues on macOS [newbie]
Others have different experience, but I ultimately had better luck using Homebrew for system dependencies rather than Conda. You might also want to start with more cmake flags OFF, just to keep things simpler while you work out the basic environment. Though your current error is happening before any of that would matter. Neal On Thu, Sep 19, 2019 at 8:39 AM Tarek Allam Jr. wrote: > > > Hi all, > > Firstly I must apologies if what I put here is extremely trivial, but I am a > complete newcomer to the Apache Arrow project and contributing to Apache in > general, but I am very keen to get involved. > > I'm hoping to help where I can so I recently attempted to complete a build > following the instructions laid out in the 'Python Development' section of the > documentation here: > > After completing the steps that specifically uses Conda I was able to create > an > environment but when it comes to building I am unable to do so. > > I am on macOS -- 10.14.6 and as outlined in the docs and here > (https://stackoverflow.com/a/55798942/4521950) I used use 10.9.sdk instead > of the latest. I have both added this manually using ccmake and also defining > it > like so: > > cmake -DCMAKE_INSTALL_PREFIX=$ARROW_HOME \ > -DCMAKE_INSTALL_LIBDIR=lib \ > -DARROW_FLIGHT=ON \ > -DARROW_GANDIVA=ON \ > -DARROW_ORC=ON \ > -DARROW_PARQUET=ON \ > -DARROW_PYTHON=ON \ > -DARROW_PLASMA=ON \ > -DARROW_BUILD_TESTS=ON \ > -DCONDA_BUILD_SYSROOT=/opt/MacOSX10.9.sdk \ > -DARROW_DEPENDENCY_SOURCE=AUTO \ > .. > > But it seems that whatever I try, I seem to get errors, the main only tripping > me up at the moment is: > > -- Building using CMake version: 3.15.3 > -- The C compiler identification is Clang 4.0.1 > -- The CXX compiler identification is Clang 4.0.1 > -- Check for working C compiler: > /usr/local/anaconda3/envs/pyarrow-dev/bin/clang > -- Check for working C compiler: > /usr/local/anaconda3/envs/pyarrow-dev/bin/clang -- broken > CMake Error at > /usr/local/anaconda3/envs/pyarrow-dev/share/cmake-3.15/Modules/CMakeTestCCompiler.cmake:60 > (message): > The C compiler > > "/usr/local/anaconda3/envs/pyarrow-dev/bin/clang" > > is not able to compile a simple test program. > > It fails with the following output: > > Change Dir: /Users/tallamjr/Github/arrow/cpp/build/CMakeFiles/CMakeTmp > > Run Build Command(s):/usr/local/bin/gmake cmTC_b252c/fast && > /usr/local/bin/gmake -f CMakeFiles/cmTC_b252c.dir/build.make > CMakeFiles/cmTC_b252c.dir/build > gmake[1]: Entering directory > '/Users/tallamjr/Github/arrow/cpp/build/CMakeFiles/CMakeTmp' > Building C object CMakeFiles/cmTC_b252c.dir/testCCompiler.c.o > /usr/local/anaconda3/envs/pyarrow-dev/bin/clang -march=core2 > -mtune=haswell -mssse3 -ftree-vectorize -fPIC -fPIE -fstack-protector-strong > -O2 -pipe -isysroot /opt/MacOSX10.9.sdk -o > CMakeFiles/cmTC_b252c.dir/testCCompiler.c.o -c > /Users/tallamjr/Github/arrow/cpp/build/CMakeFiles/CMakeTmp/testCCompiler.c > Linking C executable cmTC_b252c > /usr/local/anaconda3/envs/pyarrow-dev/bin/cmake -E cmake_link_script > CMakeFiles/cmTC_b252c.dir/link.txt --verbose=1 > /usr/local/anaconda3/envs/pyarrow-dev/bin/clang -march=core2 > -mtune=haswell -mssse3 -ftree-vectorize -fPIC -fPIE -fstack-protector-strong > -O2 -pipe -isysroot /opt/MacOSX10.9.sdk -Wl,-search_paths_first > -Wl,-headerpad_max_install_names -Wl,-pie -Wl,-headerpad_max_install_names > -Wl,-dead_strip_dylibs CMakeFiles/cmTC_b252c.dir/testCCompiler.c.o -o > cmTC_b252c > ld: warning: ignoring file > /Applications/Xcode.app/Contents/Developer/Platforms/MacOSX.platform/Developer/SDKs/MacOSX10.14.sdk/usr/lib/libSystem.tbd, > file was built for unsupported file format ( 0x2D 0x2D 0x2D 0x20 0x21 0x74 > 0x61 0x70 0x69 0x2D 0x74 0x62 0x64 0x2D 0x76 0x33 ) which is not the > architecture being linked (x86_64): > /Applications/Xcode.app/Contents/Developer/Platforms/MacOSX.platform/Developer/SDKs/MacOSX10.14.sdk/usr/lib/libSystem.tbd > ld: dynamic main executables must link with libSystem.dylib for > architecture x86_64 > clang-4.0: error: linker command failed with exit code 1 (use -v to see > invocation) > gmake[1]: *** [CMakeFiles/cmTC_b252c.dir/build.make:87: cmTC_b252c] Error > 1 > gmake[1]: Leaving directory > '/Users/tallamjr/Github/arrow/cpp/build/CMakeFiles/CMakeTmp' > gmake: *** [Makefile:121: cmTC_b252c/fast] Error 2 > > > CMake will not be able to correctly generate this project. > Call Stack (most recent call first): > CMakeLists.txt:32 (project) > > -- Configuring incomplete, errors occurred! > See also "/Users/tallamjr/Github/arrow/cpp/build/CMakeFiles/CMakeOutput.log". > See also "/Users/tallamjr/Github/arrow/cpp/build/CMakeFiles/CMakeError.log". > > Does anyone have any insight as to what might be happening and causing this to > fail. I notice that eventhough I set to CONDA_BUILD_SYSROOT to >
