Thanks for the advice Uwe and Neal. I tried your suggestion (as well as turning many of the flags to off) but then ran into other errors afterwards such as:
-- Using ZSTD_ROOT: /usr/local/anaconda3/envs/main CMake Error at /usr/local/Cellar/cmake/3.15.3/share/cmake/Modules/FindPackageHandleStandardArgs.cmake:137 (message): Could NOT find ZSTD (missing: ZSTD_LIB ZSTD_INCLUDE_DIR) /usr/local/Cellar/cmake/3.15.3/share/cmake/Modules/FindPackageHandleStandardArgs.cmake:378 (_FPHSA_FAILURE_MESSAGE) cmake_modules/FindZSTD.cmake:61 (find_package_handle_standard_args) cmake_modules/ThirdpartyToolchain.cmake:181 (find_package) cmake_modules/ThirdpartyToolchain.cmake:2033 (resolve_dependency) CMakeLists.txt:412 (include) I think I will spend some more time to understand CMAKE better and familiarise myself with the codebase more before having another go. Hopefully in this time conda-forge would have removed the SDK requirement as well which like you say should make things much more similar. Thanks again, Regards, Tarek On 2019/09/19 16:00:09, "Uwe L. Korn" <uw...@xhochy.com> wrote: > Hello Tarek, > > this error message is normally the one you get when CONDA_BUILD_SYSROOT > doesn't point to your 10.9 SDK. Please delete your build folder again and do > `export CONDA_BUILD_SYSROOT=..` immediately before running cmake. Running > e.g. a conda install will sadly reset this variable to something different > and break the build. > > As a sidenote: It looks like in 1-2 months that conda-forge will get rid of > the SDK requirement, then this will be a bit simpler. > > Cheers > Uwe > > On Thu, Sep 19, 2019, at 5:24 PM, Tarek Allam Jr. wrote: > > > > Hi all, > > > > Firstly I must apologies if what I put here is extremely trivial, but I am a > > complete newcomer to the Apache Arrow project and contributing to Apache in > > general, but I am very keen to get involved. > > > > I'm hoping to help where I can so I recently attempted to complete a build > > following the instructions laid out in the 'Python Development' section of > > the > > documentation here: > > > > After completing the steps that specifically uses Conda I was able to > > create an > > environment but when it comes to building I am unable to do so. > > > > I am on macOS -- 10.14.6 and as outlined in the docs and here > > (https://stackoverflow.com/a/55798942/4521950) I used use 10.9.sdk > > instead > > of the latest. I have both added this manually using ccmake and also > > defining it > > like so: > > > > cmake -DCMAKE_INSTALL_PREFIX=$ARROW_HOME \ > > -DCMAKE_INSTALL_LIBDIR=lib \ > > -DARROW_FLIGHT=ON \ > > -DARROW_GANDIVA=ON \ > > -DARROW_ORC=ON \ > > -DARROW_PARQUET=ON \ > > -DARROW_PYTHON=ON \ > > -DARROW_PLASMA=ON \ > > -DARROW_BUILD_TESTS=ON \ > > -DCONDA_BUILD_SYSROOT=/opt/MacOSX10.9.sdk \ > > -DARROW_DEPENDENCY_SOURCE=AUTO \ > > .. > > > > But it seems that whatever I try, I seem to get errors, the main only > > tripping > > me up at the moment is: > > > > -- Building using CMake version: 3.15.3 > > -- The C compiler identification is Clang 4.0.1 > > -- The CXX compiler identification is Clang 4.0.1 > > -- Check for working C compiler: > > /usr/local/anaconda3/envs/pyarrow-dev/bin/clang > > -- Check for working C compiler: > > /usr/local/anaconda3/envs/pyarrow-dev/bin/clang -- broken > > CMake Error at > > /usr/local/anaconda3/envs/pyarrow-dev/share/cmake-3.15/Modules/CMakeTestCCompiler.cmake:60 > > (message): > > The C compiler > > > > "/usr/local/anaconda3/envs/pyarrow-dev/bin/clang" > > > > is not able to compile a simple test program. > > > > It fails with the following output: > > > > Change Dir: /Users/tallamjr/Github/arrow/cpp/build/CMakeFiles/CMakeTmp > > > > Run Build Command(s):/usr/local/bin/gmake cmTC_b252c/fast && > > /usr/local/bin/gmake -f CMakeFiles/cmTC_b252c.dir/build.make > > CMakeFiles/cmTC_b252c.dir/build > > gmake[1]: Entering directory > > '/Users/tallamjr/Github/arrow/cpp/build/CMakeFiles/CMakeTmp' > > Building C object CMakeFiles/cmTC_b252c.dir/testCCompiler.c.o > > /usr/local/anaconda3/envs/pyarrow-dev/bin/clang -march=core2 > > -mtune=haswell -mssse3 -ftree-vectorize -fPIC -fPIE > > -fstack-protector-strong -O2 -pipe -isysroot /opt/MacOSX10.9.sdk -o > > CMakeFiles/cmTC_b252c.dir/testCCompiler.c.o -c > > /Users/tallamjr/Github/arrow/cpp/build/CMakeFiles/CMakeTmp/testCCompiler.c > > Linking C executable cmTC_b252c > > /usr/local/anaconda3/envs/pyarrow-dev/bin/cmake -E > > cmake_link_script CMakeFiles/cmTC_b252c.dir/link.txt --verbose=1 > > /usr/local/anaconda3/envs/pyarrow-dev/bin/clang -march=core2 > > -mtune=haswell -mssse3 -ftree-vectorize -fPIC -fPIE > > -fstack-protector-strong -O2 -pipe -isysroot /opt/MacOSX10.9.sdk > > -Wl,-search_paths_first -Wl,-headerpad_max_install_names -Wl,-pie > > -Wl,-headerpad_max_install_names -Wl,-dead_strip_dylibs > > CMakeFiles/cmTC_b252c.dir/testCCompiler.c.o -o cmTC_b252c > > ld: warning: ignoring file > > /Applications/Xcode.app/Contents/Developer/Platforms/MacOSX.platform/Developer/SDKs/MacOSX10.14.sdk/usr/lib/libSystem.tbd, > > file was built for unsupported file format ( 0x2D 0x2D 0x2D 0x20 0x21 0x74 > > 0x61 0x70 0x69 0x2D 0x74 0x62 0x64 0x2D 0x76 0x33 ) which is not the > > architecture being linked (x86_64): > > /Applications/Xcode.app/Contents/Developer/Platforms/MacOSX.platform/Developer/SDKs/MacOSX10.14.sdk/usr/lib/libSystem.tbd > > ld: dynamic main executables must link with libSystem.dylib for > > architecture x86_64 > > clang-4.0: error: linker command failed with exit code 1 (use -v to > > see invocation) > > gmake[1]: *** [CMakeFiles/cmTC_b252c.dir/build.make:87: cmTC_b252c] > > Error 1 > > gmake[1]: Leaving directory > > '/Users/tallamjr/Github/arrow/cpp/build/CMakeFiles/CMakeTmp' > > gmake: *** [Makefile:121: cmTC_b252c/fast] Error 2 > > > > > > CMake will not be able to correctly generate this project. > > Call Stack (most recent call first): > > CMakeLists.txt:32 (project) > > > > -- Configuring incomplete, errors occurred! > > See also > > "/Users/tallamjr/Github/arrow/cpp/build/CMakeFiles/CMakeOutput.log". > > See also "/Users/tallamjr/Github/arrow/cpp/build/CMakeFiles/CMakeError.log". > > > > Does anyone have any insight as to what might be happening and causing this > > to > > fail. I notice that eventhough I set to CONDA_BUILD_SYSROOT to > > /opt/MacOSX10.9.sdk I also see that ld is looking in MacOSX10.14.sdk, I > > assume > > that is not right.. > > > > I have tried to compare steps with ones outlined in > > https://lists.apache.org/list.html?dev@arrow.apache.org:2019-8 and in other > > corners of the internet but I feel very stuck at the moment. > > > > Any help would be greatly appreciated! Thank you > > > > >