It looks like the development toolchain dependencies in conda_env_cpp.yml aren't installed in your "main" conda environment, e.g.
https://github.com/apache/arrow/blob/master/ci/conda_env_cpp.yml#L42 You can see what's installed by running "conda list" Note that most of these dependencies are optional, but we provide the env files to simplify general development of the project so contributors aren't struggling to produce comprehensive builds. On Wed, Sep 25, 2019 at 11:33 AM Tarek Allam Jr. <t.allam...@gmail.com> wrote: > > Thanks for the advice Uwe and Neal. I tried your suggestion (as well as > turning many of the flags to off) but then ran into other errors afterwards > such as: > > -- Using ZSTD_ROOT: /usr/local/anaconda3/envs/main > CMake Error at > /usr/local/Cellar/cmake/3.15.3/share/cmake/Modules/FindPackageHandleStandardArgs.cmake:137 > (message): > Could NOT find ZSTD (missing: ZSTD_LIB ZSTD_INCLUDE_DIR) > > /usr/local/Cellar/cmake/3.15.3/share/cmake/Modules/FindPackageHandleStandardArgs.cmake:378 > (_FPHSA_FAILURE_MESSAGE) > cmake_modules/FindZSTD.cmake:61 (find_package_handle_standard_args) > cmake_modules/ThirdpartyToolchain.cmake:181 (find_package) > cmake_modules/ThirdpartyToolchain.cmake:2033 (resolve_dependency) > CMakeLists.txt:412 (include) > > I think I will spend some more time to understand CMAKE better and > familiarise myself with the codebase more before having another go. Hopefully > in this time conda-forge would have removed the SDK requirement as well which > like you say should make things much more similar. > > Thanks again, > > Regards, > Tarek > > On 2019/09/19 16:00:09, "Uwe L. Korn" <uw...@xhochy.com> wrote: > > Hello Tarek, > > > > this error message is normally the one you get when CONDA_BUILD_SYSROOT > > doesn't point to your 10.9 SDK. Please delete your build folder again and > > do `export CONDA_BUILD_SYSROOT=..` immediately before running cmake. > > Running e.g. a conda install will sadly reset this variable to something > > different and break the build. > > > > As a sidenote: It looks like in 1-2 months that conda-forge will get rid of > > the SDK requirement, then this will be a bit simpler. > > > > Cheers > > Uwe > > > > On Thu, Sep 19, 2019, at 5:24 PM, Tarek Allam Jr. wrote: > > > > > > Hi all, > > > > > > Firstly I must apologies if what I put here is extremely trivial, but I > > > am a > > > complete newcomer to the Apache Arrow project and contributing to Apache > > > in > > > general, but I am very keen to get involved. > > > > > > I'm hoping to help where I can so I recently attempted to complete a build > > > following the instructions laid out in the 'Python Development' section > > > of the > > > documentation here: > > > > > > After completing the steps that specifically uses Conda I was able to > > > create an > > > environment but when it comes to building I am unable to do so. > > > > > > I am on macOS -- 10.14.6 and as outlined in the docs and here > > > (https://stackoverflow.com/a/55798942/4521950) I used use 10.9.sdk > > > instead > > > of the latest. I have both added this manually using ccmake and also > > > defining it > > > like so: > > > > > > cmake -DCMAKE_INSTALL_PREFIX=$ARROW_HOME \ > > > -DCMAKE_INSTALL_LIBDIR=lib \ > > > -DARROW_FLIGHT=ON \ > > > -DARROW_GANDIVA=ON \ > > > -DARROW_ORC=ON \ > > > -DARROW_PARQUET=ON \ > > > -DARROW_PYTHON=ON \ > > > -DARROW_PLASMA=ON \ > > > -DARROW_BUILD_TESTS=ON \ > > > -DCONDA_BUILD_SYSROOT=/opt/MacOSX10.9.sdk \ > > > -DARROW_DEPENDENCY_SOURCE=AUTO \ > > > .. > > > > > > But it seems that whatever I try, I seem to get errors, the main only > > > tripping > > > me up at the moment is: > > > > > > -- Building using CMake version: 3.15.3 > > > -- The C compiler identification is Clang 4.0.1 > > > -- The CXX compiler identification is Clang 4.0.1 > > > -- Check for working C compiler: > > > /usr/local/anaconda3/envs/pyarrow-dev/bin/clang > > > -- Check for working C compiler: > > > /usr/local/anaconda3/envs/pyarrow-dev/bin/clang -- broken > > > CMake Error at > > > /usr/local/anaconda3/envs/pyarrow-dev/share/cmake-3.15/Modules/CMakeTestCCompiler.cmake:60 > > > (message): > > > The C compiler > > > > > > "/usr/local/anaconda3/envs/pyarrow-dev/bin/clang" > > > > > > is not able to compile a simple test program. > > > > > > It fails with the following output: > > > > > > Change Dir: /Users/tallamjr/Github/arrow/cpp/build/CMakeFiles/CMakeTmp > > > > > > Run Build Command(s):/usr/local/bin/gmake cmTC_b252c/fast && > > > /usr/local/bin/gmake -f CMakeFiles/cmTC_b252c.dir/build.make > > > CMakeFiles/cmTC_b252c.dir/build > > > gmake[1]: Entering directory > > > '/Users/tallamjr/Github/arrow/cpp/build/CMakeFiles/CMakeTmp' > > > Building C object CMakeFiles/cmTC_b252c.dir/testCCompiler.c.o > > > /usr/local/anaconda3/envs/pyarrow-dev/bin/clang -march=core2 > > > -mtune=haswell -mssse3 -ftree-vectorize -fPIC -fPIE > > > -fstack-protector-strong -O2 -pipe -isysroot /opt/MacOSX10.9.sdk -o > > > CMakeFiles/cmTC_b252c.dir/testCCompiler.c.o -c > > > /Users/tallamjr/Github/arrow/cpp/build/CMakeFiles/CMakeTmp/testCCompiler.c > > > Linking C executable cmTC_b252c > > > /usr/local/anaconda3/envs/pyarrow-dev/bin/cmake -E > > > cmake_link_script CMakeFiles/cmTC_b252c.dir/link.txt --verbose=1 > > > /usr/local/anaconda3/envs/pyarrow-dev/bin/clang -march=core2 > > > -mtune=haswell -mssse3 -ftree-vectorize -fPIC -fPIE > > > -fstack-protector-strong -O2 -pipe -isysroot /opt/MacOSX10.9.sdk > > > -Wl,-search_paths_first -Wl,-headerpad_max_install_names -Wl,-pie > > > -Wl,-headerpad_max_install_names -Wl,-dead_strip_dylibs > > > CMakeFiles/cmTC_b252c.dir/testCCompiler.c.o -o cmTC_b252c > > > ld: warning: ignoring file > > > /Applications/Xcode.app/Contents/Developer/Platforms/MacOSX.platform/Developer/SDKs/MacOSX10.14.sdk/usr/lib/libSystem.tbd, > > > file was built for unsupported file format ( 0x2D 0x2D 0x2D 0x20 0x21 > > > 0x74 0x61 0x70 0x69 0x2D 0x74 0x62 0x64 0x2D 0x76 0x33 ) which is not the > > > architecture being linked (x86_64): > > > /Applications/Xcode.app/Contents/Developer/Platforms/MacOSX.platform/Developer/SDKs/MacOSX10.14.sdk/usr/lib/libSystem.tbd > > > ld: dynamic main executables must link with libSystem.dylib for > > > architecture x86_64 > > > clang-4.0: error: linker command failed with exit code 1 (use -v to > > > see invocation) > > > gmake[1]: *** [CMakeFiles/cmTC_b252c.dir/build.make:87: cmTC_b252c] > > > Error 1 > > > gmake[1]: Leaving directory > > > '/Users/tallamjr/Github/arrow/cpp/build/CMakeFiles/CMakeTmp' > > > gmake: *** [Makefile:121: cmTC_b252c/fast] Error 2 > > > > > > > > > CMake will not be able to correctly generate this project. > > > Call Stack (most recent call first): > > > CMakeLists.txt:32 (project) > > > > > > -- Configuring incomplete, errors occurred! > > > See also > > > "/Users/tallamjr/Github/arrow/cpp/build/CMakeFiles/CMakeOutput.log". > > > See also > > > "/Users/tallamjr/Github/arrow/cpp/build/CMakeFiles/CMakeError.log". > > > > > > Does anyone have any insight as to what might be happening and causing > > > this to > > > fail. I notice that eventhough I set to CONDA_BUILD_SYSROOT to > > > /opt/MacOSX10.9.sdk I also see that ld is looking in MacOSX10.14.sdk, I > > > assume > > > that is not right.. > > > > > > I have tried to compare steps with ones outlined in > > > https://lists.apache.org/list.html?dev@arrow.apache.org:2019-8 and in > > > other > > > corners of the internet but I feel very stuck at the moment. > > > > > > Any help would be greatly appreciated! Thank you > > > > > > > >
