Re: [Opm] OPM Flow multi-node simulations stuck at domain decomposition step

Yogi Pandey Thu, 12 Mar 2020 14:17:30 -0700

Hi Atgeirr,

I've tried building 2019.10 from source. I encountered following error while 
building opm-common:


[  6%] Built target genkw
[  7%] Updating version information
[  7%] Built target update-version
[  7%] Building CXX object 
CMakeFiles/opmcommon.dir/src/opm/parser/eclipse/Parser/Parser.cpp.o
/home/opc/Installers/Opm-Flow-2019.10/opm-common/src/opm/parser/eclipse/Parser/Parser.cpp:311:37:
 error: expected template-name before ‘<’ token
 class InputStack : public std::stack< file, std::vector< file > > {
                                     ^
/home/opc/Installers/Opm-Flow-2019.10/opm-common/src/opm/parser/eclipse/Parser/Parser.cpp:311:37:
 error: expected ‘{’ before ‘<’ token
/home/opc/Installers/Opm-Flow-2019.10/opm-common/src/opm/parser/eclipse/Parser/Parser.cpp:311:37:
 error: expected unqualified-id before ‘<’ token
/home/opc/Installers/Opm-Flow-2019.10/opm-common/src/opm/parser/eclipse/Parser/Parser.cpp:320:71:
 error: invalid use of incomplete type ‘class Opm::{anonymous}::InputStack’
 void InputStack::push( std::string&& input, boost::filesystem::path p ) {
                                                                       ^
/home/opc/Installers/Opm-Flow-2019.10/opm-common/src/opm/parser/eclipse/Parser/Parser.cpp:311:7:
 note: forward declaration of ‘class Opm::{anonymous}::InputStack’
 class InputStack : public std::stack< file, std::vector< file > > {
       ^~~~~~~~~~
/home/opc/Installers/Opm-Flow-2019.10/opm-common/src/opm/parser/eclipse/Parser/Parser.cpp:348:20:
 error: field ‘input_stack’ has incomplete type ‘Opm::{anonymous}::InputStack’
         InputStack input_stack;
                    ^~~~~~~~~~~
/home/opc/Installers/Opm-Flow-2019.10/opm-common/src/opm/parser/eclipse/Parser/Parser.cpp:311:7:
 note: forward declaration of ‘class Opm::{anonymous}::InputStack’
 class InputStack : public std::stack< file, std::vector< file > > {
       ^~~~~~~~~~
make[2]: *** [CMakeFiles/opmcommon.dir/build.make:2728: 
CMakeFiles/opmcommon.dir/src/opm/parser/eclipse/Parser/Parser.cpp.o] Error 1
make[1]: *** [CMakeFiles/Makefile2:1962: CMakeFiles/opmcommon.dir/all] Error 2
make: *** [Makefile:141: all] Error 2

Following is the list of pre-requisites I have (not listing all commands here):
-sudo yum install -y devtoolset-8 (for GCC-8.3.1)
-sudo yum install -y gmp gmp-devel
-sudo yum install -y lapack lapack-devel
-sudo yum install -y suitesparse suitesparse-devel
-openmpi-4.0.2 (built from source)
-boost-1.72.0 (built from source)
-cmake-3.16.4 (built from source)
-parmetis-4.0.3 (built from source)
-dune-2.6.0: dune-common, dune-geometry, dune-grid, dune-istl (built from 
source)
-Zoltan-3.83 (built from source)

OPM Flow module opm-common is built using following commads:
1) cmake -DCMAKE_BUILD_TYPE=Release -DUSE_MPI=ON -DUSE_OPENMP=ON 
-DBLAS_LIBRARIES=/usr/lib64 -DCMAKE_INSTALL_PREFIX=/usr/local ..
2) sudo make

Am I missing any pre-requisite?

Any help will be greatly appreciated.

Thank you,
Yogi Pandey, Ph.D.

-----Original Message-----
From: Yogi Pandey 
Sent: Wednesday, March 11, 2020 9:59 AM
To: Atgeirr Rasmussen <[email protected]>; [email protected]
Subject: RE: [Opm] OPM Flow multi-node simulations stuck at domain 
decomposition step

Thank you for the suggestion Atgeirr. I'll try out the previous release 2019.10.

- Yogi

-----Original Message-----
From: Atgeirr Rasmussen [mailto:[email protected]] 
Sent: Wednesday, March 11, 2020 6:46 AM
To: [email protected]
Subject: Re: [Opm] OPM Flow multi-node simulations stuck at domain 
decomposition step

Hi Yogi,

Lots of things have changed in Flow for the initialization in parallel 
recently. Could you try to check out the previous release (2019.10) and check 
if you see the same problems?

Atgeirr
________________________________
Frå: Opm <[email protected]> på vegne av Markus Blatt 
<[email protected]>
Sendt: onsdag 11. mars 2020 11:08
Til: [email protected] <[email protected]>
Emne: Re: [Opm] OPM Flow multi-node simulations stuck at domain decomposition 
step

Hi Yogi,

On Tue, Mar 10, 2020 at 02:15:19PM -0700, Yogi Pandey wrote:
> Simulation is being run on 4 nodes with 32 processors each using following 
> command:
>
> mpirun --display-map -mca btl self -x UCX_TLS=rc,self,sm -x 
> HCOLL_ENABLE_MCAST_ALL=0 -mca coll_hcoll_enable 0 -x UCX_IB_TRAFFIC_CLASS=105 
> -x UCX_IB_GID_INDEX=3 --cpu-set 
> 0,1,2,3,4,5,6,7,8,9,10,11,12,13,14,15,16,17,18,19,20,21,22,23,24,25,26,27,28,29,30,31,32,33,34,35
>  -np 144 --hostfile /etc/opt/rdma/hostfile 
> /mnt/nfs-share/etc/opm-flow/opm-simulators/build/bin/flow 
> --parameter-file=/mnt/nfs-share/data/norne/params
>

Out of curiosity. Is there a special reason why --cpu-set runs until 35 with 32 
cpus per node? Might you be oversubscribing a node?

Markus

--
Dr. Markus Blatt
OPM-OP AS
_______________________________________________
Opm mailing list
[email protected]
https://urldefense.com/v3/__https://eur03.safelinks.protection.outlook.com/?url=https*3A*2F*2Fopm-project.org*2Fcgi-bin*2Fmailman*2Flistinfo*2Fopm&amp;data=02*7C01*7CAtgeirr.Rasmussen*40sintef.no*7C92c439a2c2934fdb4f6308d7c5a44bcd*7Ce1f00f39604145b0b309e0210d8b32af*7C1*7C0*7C637195181746088987&amp;sdata=DP6PfdO7olXefHaRUJk6jRg6*2Bmgthhr4lgZTV*2BJ7zIs*3D&amp;reserved=0__;JSUlJSUlJSUlJSUlJSUlJSUl!!GqivPVa7Brio!P_P6tQnFCIhpsXfRUqrm4JazzL052TnBcVaBQmYyoSsMgC17mQ7H5y4ejOt1VkzszQ$
 
_______________________________________________
Opm mailing list
[email protected]
https://urldefense.com/v3/__https://opm-project.org/cgi-bin/mailman/listinfo/opm__;!!GqivPVa7Brio!P_P6tQnFCIhpsXfRUqrm4JazzL052TnBcVaBQmYyoSsMgC17mQ7H5y4ejOvYRA19MA$
 
_______________________________________________
Opm mailing list
[email protected]
https://opm-project.org/cgi-bin/mailman/listinfo/opm

Re: [Opm] OPM Flow multi-node simulations stuck at domain decomposition step

Reply via email to