We are on RHEL 8, using modules that we can load/unload various version of
packages/libraries, and I have OpenMPI 4.1.1 with CUDA aware loaded along
with GDAL 3.3.0, GCC 10.2.0, and cmake 3.22.1
make PETSC_DIR=/path/to/petsc PETSC_ARCH=arch-linux-c-debug check
fails with the below errors,
Running
C_DIR=/path/to/petsc PETSC_ARCH=arch-linux-c-debug
> MPIEXEC="mpiexec -mca orte_base_help_aggregate 0 --mca
> opal_warn_on_missing_libcuda 0 -mca pml ucx --mca btl '^openib'"
>
> Wrt configure - it can be set with --with-mpiexec option - its saved in
> PETSC_ARCH/lib/petsc/co
SC_ARCH/lib
> LD_LIBRARY_PATHis is for run time, but the error happened at link time,
>
Yes that's what I already had. Any other debug that I can provide?
> On Fri, Oct 7, 2022 at 1:53 PM Satish Balay wrote:
>>
>>> you can try
>>>
>>> make PETSC_DIR=/pat
So perhaps PET_Sc is now being found. Any other suggestions?
On Fri, Oct 7, 2022 at 11:18 PM Rob Kudyba wrote:
>
> Thanks for the quick reply. I added these options to make and make check
>>> still produce the warnings so I used the command like this:
>>> make PETSC_DIR=/pat
>
> Perhaps we can back one step:
> Use your mpicc to build a "hello world" mpi test, then run it on a compute
> node (with GPU) to see if it works.
> If no, then your MPI environment has problems;
> If yes, then use it to build petsc (turn on petsc's gpu support,
> --with-cuda
ibfmt.a /path/to/petsc/arch-linux-cxx-debug/lib/libpetsc.so
>
> I did not find -lmpi to link in the mpi library. You can try to use cmake
> -DCMAKE_C_COMPILER=/path/to/mpicc -DCMAKE_CXX_COMPILER=/path/to/mpicxx to
> build your code
>
> On Sat, Oct 8, 2022 at 9:32 PM Rob Kudyba wrot
4.1.1_ucx_cuda_11.0.3_support/lib/libompitrace.so.40.30.0:
undefined reference to `PMPI_Win_get_name'
collect2: error: ld returned 1 exit status
make[2]: *** [common/richdem/CMakeFiles/richdem.dir/build.make:163:
common/richdem/librichdem.so] Error 1
make[2]: Leaving directory '/path/to/WTM/build'
make
richdem
<https://github.com/r-barnes/richdem> maintainer?
On Mon, Oct 10, 2022 at 9:12 AM Rob Kudyba wrote:
> OK, let's walk back and don't use -DCMAKE_C_COMPILER=/path/to/mpicc
>>
> Will do
>
>
>> libompitrace.so.40.30.0 is not the OpenMP library; it is the tracing
&g
