Hi, Jed, The following is the output. Two equations are solved during each time steps. One is using bicgstab is already very fast, the other one is using gmres+ml.
The log_summary output can found in the end of the output. Best Regards, Kai > Message: 6 > Date: Sun, 22 Jul 2012 07:16:07 -0500 > From: Jed Brown <jedbrown at mcs.anl.gov> > To: PETSc users list <petsc-users at mcs.anl.gov> > Subject: Re: [petsc-users] How to investigate the reason for slow > convergence rate? > Message-ID: > <CAM9tzSkxKz5FwFJJPZz0UO5eN-S45QsdQxmo7xnH345R1EdTEQ at mail.gmail.com> > Content-Type: text/plain; charset="utf-8" > > Please send -log_summary output with performance questions. > > On Sun, Jul 22, 2012 at 4:01 AM, Bao Kai <paeanball at gmail.com> wrote: > >> Hi, Matt, >> >> I tried ML6.2 with petsc3.3 with default parameters by only specifying >> the preconditioner to be PCML. The KSP solver is gmres. >> >> The convergence rate is much faster, while it still took much longer >> time in total. >> >> For example, for the problem with 500^3 mesh ( 125 million unknowns ) >> with 512nodes(4 processors per node) on bluegene/P , it tooks about >> ten iterations to get convergent while the total time used is about >> 400 seconds. >> >> 506 the KSP type is gmres >> 507 the PC type is ml >> 508 KSP rtol = 0.100000000000000008E-04 abstol = >> 0.100000000000000001E-49 dtol = 10000.0000000000000 maxit = 10000 >> 509 SNES rtol = 0.100000000000000002E-07 abstol = >> 0.100000000000000001E-49 stol = 0.100000000000000002E-07 maxit = >> 50 maxf= 10000 >> 510 0 SNES Function norm 5.859593121800e+02 >> 511 0 KSP Residual norm 8.340827070202e+06 >> 512 1 KSP Residual norm 7.980806572332e+05 >> 513 2 KSP Residual norm 1.870896731234e+05 >> 514 3 KSP Residual norm 6.790580947452e+04 >> 515 4 KSP Residual norm 2.665552335248e+04 >> 516 5 KSP Residual norm 1.130212349885e+04 >> 517 6 KSP Residual norm 4.053599972292e+03 >> 518 7 KSP Residual norm 1.786770710693e+03 >> 519 8 KSP Residual norm 7.313571654931e+02 >> 520 9 KSP Residual norm 3.205683714450e+02 >> 521 10 KSP Residual norm 1.263243312734e+02 >> 522 11 KSP Residual norm 3.945082815178e+01 >> 523 1 SNES Function norm 9.378772067642e-02 >> 524 0 KSP Residual norm 5.413489711800e+01 >> 525 1 KSP Residual norm 1.442598710609e+01 >> 526 2 KSP Residual norm 4.073537172140e+00 >> 527 3 KSP Residual norm 1.157455598705e+00 >> 528 4 KSP Residual norm 3.509855901968e-01 >> 529 5 KSP Residual norm 1.160625342728e-01 >> 530 6 KSP Residual norm 3.209351890216e-02 >> 531 7 KSP Residual norm 7.780869881329e-03 >> 532 8 KSP Residual norm 1.820828886636e-03 >> 533 9 KSP Residual norm 4.172544590190e-04 >> 534 2 SNES Function norm 6.747963806680e-07 >> 535 Number of KSP iteration is 9 >> 536 SNES solve takes time 406.724867261176314 >> >> But with bcgs and bjacobi, it tooks about 550 KSP iterations ( 2 snes >> iterations ) and 69 seconds to get the result. >> >> For much smaller problems, benefiting from the fast convergence, it >> did takes less time to get the result. It seems that the ml can not be >> scaled, or I used it in a wrong way. >> >> Best Regards, >> Kai >> >> >> > Message: 2 >> > Date: Sat, 21 Jul 2012 08:47:10 -0500 >> > From: Matthew Knepley <knepley at gmail.com> >> > To: PETSc users list <petsc-users at mcs.anl.gov> >> > Subject: Re: [petsc-users] How to investigate the reason for slow >> > convergence rate? >> > Message-ID: >> > < >> CAMYG4GkfV6kmTFEKXUadOv+2CrKHk9hRY7UR-cFWf+vcRxCv5g at mail.gmail.com> >> > Content-Type: text/plain; charset="iso-8859-1" >> > >> > On Sat, Jul 21, 2012 at 4:30 AM, Bao Kai <paeanball at gmail.com> wrote: >> > >> >> >> >>> HI, all, >> >> >> >> I am still suffering from the slow convergence rate of the KSP >> >> solution. >> >> >> >> I changed the code to use Petsc3.3 and then try the gamg >> >> precoditioner, >> >> the convergence rate is better, while it took more total time because >> >> it >> >> took much more time for each iteration and some extra time for >> >> pre-processing. >> >> >> > >> > Try ML to see if it has better defaults for your problem. If not, you >> will >> > have to start experimenting with the solver >> > parameters. >> > >> > >> >> I am wondering if there are some ways that can help me to investigate >> the >> >> slow convergence rate for KSP solution so that I can do some >> improvement. >> >> Is DMMG will be a good solution? >> >> >> > >> > No. >> > >> > Matt >> > >> > >> >> Thank you very much. >> >> >> >> Best Regards, >> >> Kai >> >> >> >>> >> >>> Message: 2 >> >>> Date: Wed, 11 Jul 2012 15:17:15 -0500 >> >>> From: Matthew Knepley <knepley at gmail.com> >> >>> To: PETSc users list <petsc-users at mcs.anl.gov> >> >>> Subject: Re: [petsc-users] Does this mean the matrix is >> >>> ill-conditioned? >> >>> Message-ID: >> >>> <CAMYG4Gk7T= >> >>> q+w1PKO7G_TW07iDzux90Sncbv9K7d0FD-MDrLRg at mail.gmail.com> >> >>> Content-Type: text/plain; charset="iso-8859-1" >> >>> >> >>> On Wed, Jul 11, 2012 at 12:40 PM, Bao Kai <paeanball at gmail.com> >> >>> wrote: >> >>> >> >>> > Hi, all, >> >>> > >> >>> > The following is the output from the solution of a Poisson equation >> >>> > from Darcy's law. >> >>> > >> >>> > To compute the condition number of matrix, I did not use PC and use >> >>> > GMRES KSP to do the test. >> >>> > >> >>> > It seems like that the condition number keep increasing during the >> >>> > iterative solution. Does this mean the matrix is ill-conditioned? >> >>> > >> >>> >> >>> Generally yes. Krylov methods take a long time to resolve the >> >>> smallest >> >>> eigenvalues, so this approximation is not great. >> >>> >> >>> >> >>> > For this test, it did not achieve convergence with 10000 >> >>> > iterations. >> >>> > >> >>> > When I use BJOCABI PC and BICGSTAB KSP, it generally takes about >> >>> > 600 >> >>> > times iteration to get the iteration convergent. >> >>> > >> >>> > Any suggestion for improving the convergence rate will be much >> >>> > appreciated. The solution of this equation has been the bottleneck >> of >> >>> > my code, it takes more than 90% of the total time. >> >>> > >> >>> >> >>> Try ML or GAMG. >> >>> >> >>> Matt >> >>> >> >>> >> >>> > Thank you very much. >> >>> > >> >>> > Best Regards, >> >>> > Kai >> >>> > >> >>> >> >>> >> >>> >> > >> > >> > -- >> > What most experimenters take for granted before they begin their >> > experiments is infinitely more interesting than any results to which >> their >> > experiments lead. >> > -- Norbert Wiener >> > -------------- next part -------------- >> > An HTML attachment was scrubbed... >> > URL: >> > < >> http://lists.mcs.anl.gov/pipermail/petsc-users/attachments/20120721/eaf7b2ee/attachment-0001.html >> > >> > >> > ------------------------------ >> > >> > -------------- next part -------------- > An HTML attachment was scrubbed... > URL: > <http://lists.mcs.anl.gov/pipermail/petsc-users/attachments/20120722/7f782dd6/attachment.html> > > ------------------------------ > > _______________________________________________ > petsc-users mailing list > petsc-users at mcs.anl.gov > https://lists.mcs.anl.gov/mailman/listinfo/petsc-users > > > End of petsc-users Digest, Vol 43, Issue 61 > ******************************************* > -------------- next part -------------- RST runs on 2048 processors. Calculating the coloring takes time 76.9829076376470596 Start the simulation of RST_advection on a 3D rectanguluar mesh of size 500x500x500. call solve_CO2(conc) ... solve_CO2 starts iT = 1 (tCurr= 0.000000000000000000E+00 , tNext= 360.000000000000000 ) using backwardEuler the memory used initially in SolveNE_option is 780578816.000000000 in 0 th processor Calculating the Jacobian matrix using multi-coloring finite difference Calculating the Jacobian matrix using multi-coloring finite difference, end Calculating the Jacobian matrix takes time 0.362482352898041427E-04 the KSP type is bcgs the PC type is bjacobi KSP rtol = 0.100000000000000008E-04 abstol = 0.100000000000000001E-49 dtol = 10000.0000000000000 maxit = 10000 SNES rtol = 0.100000000000000002E-07 abstol = 0.100000000000000001E-49 stol = 0.100000000000000002E-07 maxit = 50 maxf= 10000 0 SNES Function norm 2.027142332274e+05 0 KSP Residual norm 1.329836410984e+05 1 KSP Residual norm 2.003138625439e+02 2 KSP Residual norm 1.080655908195e+00 1 SNES Function norm 2.603715471664e+00 0 KSP Residual norm 1.821752606793e+00 1 KSP Residual norm 2.261877896690e-02 2 KSP Residual norm 5.689587885989e-04 3 KSP Residual norm 7.904719695607e-06 2 SNES Function norm 1.303262560403e-05 Number of KSP iteration is 3 SNES solve takes time 6.39838860470588600 Number of Newton iterations = 2 the SNES Converged Reason is 3 the memory used finally in SolveNE_option is 928034816.000000000 in 0 th processor solve_NE for concentration equations took time 6.40435670941175772 the memory used initially in SolveNE_option is 928034816.000000000 in 0 th processor Calculating the Jacobian matrix using multi-coloring finite difference Calculating the Jacobian matrix using multi-coloring finite difference, end Calculating the Jacobian matrix takes time 0.465729411871507182E-04 the KSP type is gmres the PC type is ml KSP rtol = 0.100000000000000008E-04 abstol = 0.100000000000000001E-49 dtol = 10000.0000000000000 maxit = 10000 SNES rtol = 0.100000000000000002E-07 abstol = 0.100000000000000001E-49 stol = 0.100000000000000002E-07 maxit = 50 maxf= 10000 0 SNES Function norm 6.854305936118e+02 0 KSP Residual norm 8.373098135096e+06 1 KSP Residual norm 7.298874883063e+05 2 KSP Residual norm 1.312057861504e+05 3 KSP Residual norm 2.940040817676e+04 4 KSP Residual norm 5.550730454363e+03 5 KSP Residual norm 9.403163430181e+02 6 KSP Residual norm 1.989882957671e+02 7 KSP Residual norm 3.776734457069e+01 1 SNES Function norm 1.128845203882e-01 0 KSP Residual norm 3.642500285026e+01 1 KSP Residual norm 1.088628928189e+01 2 KSP Residual norm 2.261263906033e+00 3 KSP Residual norm 5.225048266035e-01 4 KSP Residual norm 1.744244938506e-01 5 KSP Residual norm 5.392736524647e-02 6 KSP Residual norm 1.561840513585e-02 7 KSP Residual norm 3.216915891215e-03 8 KSP Residual norm 8.352256776033e-04 9 KSP Residual norm 2.616795560745e-04 2 SNES Function norm 4.222128984457e-07 Number of KSP iteration is 9 SNES solve takes time 396.688963249411700 Number of Newton iterations = 2 the SNES Converged Reason is 3 the memory used finally in SolveNE_option is 1108242432.00000000 in 0 th processor solve_NE for flow equations took time 396.693956828235287 solve_CO2 starts iT = 2 (tCurr= 360.000000000000000 , tNext= 720.000000000000000 ) using backwardEuler the memory used initially in SolveNE_option is 1108242432.00000000 in 0 th processor Calculating the Jacobian matrix using multi-coloring finite difference Calculating the Jacobian matrix using multi-coloring finite difference, end Calculating the Jacobian matrix takes time 0.738905881689788657E-04 the KSP type is bcgs the PC type is bjacobi KSP rtol = 0.100000000000000008E-04 abstol = 0.100000000000000001E-49 dtol = 10000.0000000000000 maxit = 10000 SNES rtol = 0.100000000000000002E-07 abstol = 0.100000000000000001E-49 stol = 0.100000000000000002E-07 maxit = 50 maxf= 10000 0 SNES Function norm 1.744975811532e+07 0 KSP Residual norm 6.042616216530e+06 1 KSP Residual norm 2.411229464574e+06 2 KSP Residual norm 9.384253591517e+05 3 KSP Residual norm 8.172654250461e+05 4 KSP Residual norm 3.278806775039e+05 5 KSP Residual norm 1.892646740749e+05 6 KSP Residual norm 1.688085534614e+05 7 KSP Residual norm 1.070929112445e+05 8 KSP Residual norm 8.894975127847e+04 9 KSP Residual norm 8.439037109644e+04 10 KSP Residual norm 2.210751081503e+05 11 KSP Residual norm 8.018906048020e+05 12 KSP Residual norm 2.463740463795e+05 13 KSP Residual norm 4.701709773936e+05 14 KSP Residual norm 2.572534693760e+05 15 KSP Residual norm 1.400576861591e+06 16 KSP Residual norm 6.843908357621e+04 17 KSP Residual norm 6.835423406956e+04 18 KSP Residual norm 3.306744876360e+05 19 KSP Residual norm 1.274200720122e+05 20 KSP Residual norm 2.864430197567e+05 21 KSP Residual norm 6.303052018354e+04 22 KSP Residual norm 1.040766852733e+04 23 KSP Residual norm 1.403019031174e+04 24 KSP Residual norm 8.304296941412e+03 25 KSP Residual norm 5.063990038197e+03 26 KSP Residual norm 2.072491899897e+04 27 KSP Residual norm 2.833725405550e+04 28 KSP Residual norm 6.025326846882e+02 29 KSP Residual norm 2.012835940363e+02 30 KSP Residual norm 9.871182569019e+01 31 KSP Residual norm 7.994364942410e+01 32 KSP Residual norm 8.722846666516e+01 33 KSP Residual norm 3.278037987095e+01 1 SNES Function norm 5.359315696689e+02 0 KSP Residual norm 3.278037984348e+01 1 KSP Residual norm 5.111266391765e+01 2 KSP Residual norm 1.548643476480e+01 3 KSP Residual norm 1.155495193877e+01 4 KSP Residual norm 7.125481575618e+00 5 KSP Residual norm 9.024848561174e+00 6 KSP Residual norm 2.257573584187e+00 7 KSP Residual norm 5.418784129233e-01 8 KSP Residual norm 3.719657020252e-01 9 KSP Residual norm 1.205608997222e-01 10 KSP Residual norm 3.615255985887e+00 11 KSP Residual norm 2.894677555372e-02 12 KSP Residual norm 1.376453957581e-03 13 KSP Residual norm 4.166968255993e-04 14 KSP Residual norm 4.913433524474e-04 15 KSP Residual norm 9.839518905020e-05 2 SNES Function norm 2.253731138673e-03 Number of KSP iteration is 15 SNES solve takes time 11.2357833341176274 Number of Newton iterations = 2 the SNES Converged Reason is 3 the memory used finally in SolveNE_option is 1092841472.00000000 in 0 th processor solve_NE for concentration equations took time 11.2626100023528579 the memory used initially in SolveNE_option is 1092841472.00000000 in 0 th processor Calculating the Jacobian matrix using multi-coloring finite difference Calculating the Jacobian matrix using multi-coloring finite difference, end Calculating the Jacobian matrix takes time 0.392435293861126411E-04 the KSP type is gmres the PC type is ml KSP rtol = 0.100000000000000008E-04 abstol = 0.100000000000000001E-49 dtol = 10000.0000000000000 maxit = 10000 SNES rtol = 0.100000000000000002E-07 abstol = 0.100000000000000001E-49 stol = 0.100000000000000002E-07 maxit = 50 maxf= 10000 0 SNES Function norm 6.168715721071e+02 0 KSP Residual norm 7.978767835480e+06 1 KSP Residual norm 8.728618105505e+05 2 KSP Residual norm 4.558368047941e+05 3 KSP Residual norm 4.346984519871e+05 4 KSP Residual norm 2.286709358986e+05 5 KSP Residual norm 1.332498617875e+05 6 KSP Residual norm 1.264578916032e+05 7 KSP Residual norm 1.058066886132e+05 8 KSP Residual norm 4.688543293468e+04 9 KSP Residual norm 1.706033347392e+04 10 KSP Residual norm 7.798848104292e+03 11 KSP Residual norm 5.313346550965e+03 12 KSP Residual norm 4.267989536057e+03 13 KSP Residual norm 4.104126803381e+03 14 KSP Residual norm 4.082103088618e+03 15 KSP Residual norm 3.730866428917e+03 16 KSP Residual norm 2.662009656165e+03 17 KSP Residual norm 1.507688407744e+03 18 KSP Residual norm 1.117001235096e+03 19 KSP Residual norm 1.019680471256e+03 20 KSP Residual norm 1.008960551221e+03 21 KSP Residual norm 1.007162979788e+03 22 KSP Residual norm 9.787062543248e+02 23 KSP Residual norm 8.700126671308e+02 24 KSP Residual norm 5.076825476614e+02 25 KSP Residual norm 1.697222557097e+02 26 KSP Residual norm 5.606185528901e+01 1 SNES Function norm 1.303677605733e-01 0 KSP Residual norm 1.275643534800e+02 1 KSP Residual norm 1.755473787471e+01 2 KSP Residual norm 4.019549783414e+00 3 KSP Residual norm 7.944360565021e-01 4 KSP Residual norm 1.499573425904e-01 5 KSP Residual norm 2.452264940057e-02 6 KSP Residual norm 5.066981841293e-03 7 KSP Residual norm 9.904807389870e-04 2 SNES Function norm 3.389130418502e-06 Number of KSP iteration is 7 SNES solve takes time 433.673481138823490 Number of Newton iterations = 2 the SNES Converged Reason is 3 the memory used finally in SolveNE_option is 1161392128.00000000 in 0 th processor solve_NE for flow equations took time 433.678236383529452 solve_CO2 starts iT = 3 (tCurr= 720.000000000000000 , tNext= 1080.00000000000000 ) using backwardEuler the memory used initially in SolveNE_option is 1161392128.00000000 in 0 th processor Calculating the Jacobian matrix using multi-coloring finite difference Calculating the Jacobian matrix using multi-coloring finite difference, end Calculating the Jacobian matrix takes time 0.611341175726920483E-04 the KSP type is bcgs the PC type is bjacobi KSP rtol = 0.100000000000000008E-04 abstol = 0.100000000000000001E-49 dtol = 10000.0000000000000 maxit = 10000 SNES rtol = 0.100000000000000002E-07 abstol = 0.100000000000000001E-49 stol = 0.100000000000000002E-07 maxit = 50 maxf= 10000 0 SNES Function norm 1.746230911748e+07 0 KSP Residual norm 6.056016610516e+06 1 KSP Residual norm 2.410588606648e+06 2 KSP Residual norm 9.456442885758e+05 3 KSP Residual norm 8.094818865575e+05 4 KSP Residual norm 3.287134485841e+05 5 KSP Residual norm 1.896118306005e+05 6 KSP Residual norm 1.754760017003e+05 7 KSP Residual norm 1.074211675332e+05 8 KSP Residual norm 8.892934191703e+04 9 KSP Residual norm 8.425895560687e+04 10 KSP Residual norm 2.210542597785e+05 11 KSP Residual norm 7.832399341096e+05 12 KSP Residual norm 2.473533515058e+05 13 KSP Residual norm 4.614685234415e+05 14 KSP Residual norm 2.551240693195e+05 15 KSP Residual norm 1.373194764628e+06 16 KSP Residual norm 6.869917844180e+04 17 KSP Residual norm 6.827906464339e+04 18 KSP Residual norm 3.315401022229e+05 19 KSP Residual norm 1.282764833555e+05 20 KSP Residual norm 2.897981334419e+05 21 KSP Residual norm 6.308627435161e+04 22 KSP Residual norm 1.045231001236e+04 23 KSP Residual norm 1.491143524048e+04 24 KSP Residual norm 8.656791195722e+03 25 KSP Residual norm 5.045336356514e+03 26 KSP Residual norm 2.166365912996e+04 27 KSP Residual norm 3.094664062274e+04 28 KSP Residual norm 6.117301214046e+02 29 KSP Residual norm 2.012060974502e+02 30 KSP Residual norm 9.900282227487e+01 31 KSP Residual norm 8.011585552510e+01 32 KSP Residual norm 8.686592920308e+01 33 KSP Residual norm 3.278618019592e+01 1 SNES Function norm 5.356912110054e+02 0 KSP Residual norm 3.278618016861e+01 1 KSP Residual norm 5.118173917522e+01 2 KSP Residual norm 1.548726082616e+01 3 KSP Residual norm 1.156812789566e+01 4 KSP Residual norm 7.149486136715e+00 5 KSP Residual norm 7.980447622207e+00 6 KSP Residual norm 2.184234814452e+00 7 KSP Residual norm 5.474499778219e-01 8 KSP Residual norm 3.733409066648e-01 9 KSP Residual norm 1.199274608307e-01 10 KSP Residual norm 3.099768217390e-01 11 KSP Residual norm 2.932626926870e-02 12 KSP Residual norm 1.398491373209e-03 13 KSP Residual norm 4.172815233796e-04 14 KSP Residual norm 6.539192013676e-04 15 KSP Residual norm 9.719451000433e-05 2 SNES Function norm 2.224809336173e-03 Number of KSP iteration is 15 SNES solve takes time 11.2320685176470079 Number of Newton iterations = 2 the SNES Converged Reason is 3 the memory used finally in SolveNE_option is 1145991168.00000000 in 0 th processor solve_NE for concentration equations took time 11.2598186258823034 the memory used initially in SolveNE_option is 1145991168.00000000 in 0 th processor Calculating the Jacobian matrix using multi-coloring finite difference Calculating the Jacobian matrix using multi-coloring finite difference, end Calculating the Jacobian matrix takes time 0.531258823457392282E-04 the KSP type is gmres the PC type is ml KSP rtol = 0.100000000000000008E-04 abstol = 0.100000000000000001E-49 dtol = 10000.0000000000000 maxit = 10000 SNES rtol = 0.100000000000000002E-07 abstol = 0.100000000000000001E-49 stol = 0.100000000000000002E-07 maxit = 50 maxf= 10000 0 SNES Function norm 5.906457664566e+02 0 KSP Residual norm 7.912814686693e+06 1 KSP Residual norm 9.645782297768e+05 2 KSP Residual norm 8.861064046254e+05 3 KSP Residual norm 4.897630000578e+05 4 KSP Residual norm 3.166880917820e+05 5 KSP Residual norm 3.069992066317e+05 6 KSP Residual norm 1.923010666939e+05 7 KSP Residual norm 9.534057223926e+04 8 KSP Residual norm 5.617225030104e+04 9 KSP Residual norm 5.000967170570e+04 10 KSP Residual norm 4.988510808219e+04 11 KSP Residual norm 4.377142165464e+04 12 KSP Residual norm 3.537339493753e+04 13 KSP Residual norm 3.444119180522e+04 14 KSP Residual norm 3.140632281962e+04 15 KSP Residual norm 2.387794289515e+04 16 KSP Residual norm 2.029305730532e+04 17 KSP Residual norm 1.944823332521e+04 18 KSP Residual norm 1.926082773332e+04 19 KSP Residual norm 1.604520680206e+04 20 KSP Residual norm 1.083092031672e+04 21 KSP Residual norm 5.980890172430e+03 22 KSP Residual norm 4.230302343358e+03 23 KSP Residual norm 3.473716174483e+03 24 KSP Residual norm 2.539150935402e+03 25 KSP Residual norm 1.225826890173e+03 26 KSP Residual norm 3.869466816538e+02 27 KSP Residual norm 1.166013359601e+02 28 KSP Residual norm 3.948921651246e+01 1 SNES Function norm 9.374214140858e-02 0 KSP Residual norm 4.314990451734e+01 1 KSP Residual norm 3.515946386829e+01 2 KSP Residual norm 2.695621438095e+01 3 KSP Residual norm 1.390235007360e+01 4 KSP Residual norm 1.386211256871e+01 5 KSP Residual norm 7.834323161908e+00 6 KSP Residual norm 5.517283406603e+00 7 KSP Residual norm 5.426656354145e+00 8 KSP Residual norm 3.458546275824e+00 9 KSP Residual norm 2.340650733306e+00 10 KSP Residual norm 2.308443591276e+00 11 KSP Residual norm 1.978019536730e+00 12 KSP Residual norm 1.751838848414e+00 13 KSP Residual norm 1.748423642827e+00 14 KSP Residual norm 1.558995531050e+00 15 KSP Residual norm 1.434334333026e+00 16 KSP Residual norm 1.429581841785e+00 17 KSP Residual norm 1.234896777884e+00 18 KSP Residual norm 1.113705072932e+00 19 KSP Residual norm 1.113002183375e+00 20 KSP Residual norm 1.000636547921e+00 21 KSP Residual norm 7.666212672065e-01 22 KSP Residual norm 4.954697001390e-01 23 KSP Residual norm 3.763741385658e-01 24 KSP Residual norm 3.061802852706e-01 25 KSP Residual norm 2.172246927676e-01 26 KSP Residual norm 1.263551553515e-01 27 KSP Residual norm 8.065653452946e-02 28 KSP Residual norm 6.666958151528e-02 29 KSP Residual norm 5.969554338215e-02 30 KSP Residual norm 4.701119423782e-02 31 KSP Residual norm 3.880526060321e-02 32 KSP Residual norm 3.550352775410e-02 33 KSP Residual norm 3.518508431556e-02 34 KSP Residual norm 3.365882337676e-02 35 KSP Residual norm 2.990974854198e-02 36 KSP Residual norm 2.960135454716e-02 37 KSP Residual norm 2.642485998975e-02 38 KSP Residual norm 2.207970762270e-02 39 KSP Residual norm 2.207627751574e-02 40 KSP Residual norm 1.939485668126e-02 41 KSP Residual norm 1.826512902599e-02 42 KSP Residual norm 1.776217373211e-02 43 KSP Residual norm 1.494313801753e-02 44 KSP Residual norm 1.491723533996e-02 45 KSP Residual norm 1.294925018292e-02 46 KSP Residual norm 1.031091165182e-02 47 KSP Residual norm 9.274721439823e-03 48 KSP Residual norm 9.199144088117e-03 49 KSP Residual norm 7.380758295213e-03 50 KSP Residual norm 5.312928096668e-03 51 KSP Residual norm 3.590846812049e-03 52 KSP Residual norm 3.453458627238e-03 53 KSP Residual norm 2.682574287054e-03 54 KSP Residual norm 1.535180831843e-03 55 KSP Residual norm 1.124868394925e-03 56 KSP Residual norm 9.042295611229e-04 57 KSP Residual norm 6.864456305576e-04 58 KSP Residual norm 4.500332684970e-04 59 KSP Residual norm 2.315845183804e-04 2 SNES Function norm 5.750728763041e-07 Number of KSP iteration is 59 SNES solve takes time 577.862047618823453 Number of Newton iterations = 2 the SNES Converged Reason is 3 the memory used finally in SolveNE_option is 1161392128.00000000 in 0 th processor solve_NE for flow equations took time 577.867189442352810 solve_CO2 starts iT = 4 (tCurr= 1080.00000000000000 , tNext= 1440.00000000000000 ) using backwardEuler the memory used initially in SolveNE_option is 1161392128.00000000 in 0 th processor Calculating the Jacobian matrix using multi-coloring finite difference Calculating the Jacobian matrix using multi-coloring finite difference, end Calculating the Jacobian matrix takes time 0.689435294134455035E-04 the KSP type is bcgs the PC type is bjacobi KSP rtol = 0.100000000000000008E-04 abstol = 0.100000000000000001E-49 dtol = 10000.0000000000000 maxit = 10000 SNES rtol = 0.100000000000000002E-07 abstol = 0.100000000000000001E-49 stol = 0.100000000000000002E-07 maxit = 50 maxf= 10000 0 SNES Function norm 1.747595578968e+07 0 KSP Residual norm 6.070738647764e+06 1 KSP Residual norm 2.410071228327e+06 2 KSP Residual norm 9.549253739214e+05 3 KSP Residual norm 7.981187668861e+05 4 KSP Residual norm 3.291532237393e+05 5 KSP Residual norm 1.900364740271e+05 6 KSP Residual norm 1.808298981550e+05 7 KSP Residual norm 1.077099555482e+05 8 KSP Residual norm 8.894381121663e+04 9 KSP Residual norm 8.417853266785e+04 10 KSP Residual norm 2.201981533464e+05 11 KSP Residual norm 7.709268659791e+05 12 KSP Residual norm 2.479014722435e+05 13 KSP Residual norm 4.666147266566e+05 14 KSP Residual norm 2.558241680066e+05 15 KSP Residual norm 1.373629431710e+06 16 KSP Residual norm 6.911910203172e+04 17 KSP Residual norm 6.842401632722e+04 18 KSP Residual norm 3.306049474142e+05 19 KSP Residual norm 1.283124304691e+05 20 KSP Residual norm 2.909356471676e+05 21 KSP Residual norm 6.322781226246e+04 22 KSP Residual norm 1.055406528283e+04 23 KSP Residual norm 1.769757469826e+04 24 KSP Residual norm 9.622138538562e+03 25 KSP Residual norm 5.002105247328e+03 26 KSP Residual norm 2.226851519086e+04 27 KSP Residual norm 3.333932229927e+04 28 KSP Residual norm 6.154801922084e+02 29 KSP Residual norm 2.017271873264e+02 30 KSP Residual norm 9.927125290556e+01 31 KSP Residual norm 8.026861874655e+01 32 KSP Residual norm 8.676016243921e+01 33 KSP Residual norm 3.299156885807e+01 1 SNES Function norm 5.386668000559e+02 0 KSP Residual norm 3.299156885877e+01 1 KSP Residual norm 5.156932987442e+01 2 KSP Residual norm 1.559190093665e+01 3 KSP Residual norm 1.166013674890e+01 4 KSP Residual norm 7.234093208644e+00 5 KSP Residual norm 7.150545499500e+00 6 KSP Residual norm 2.129440698767e+00 7 KSP Residual norm 5.576694756879e-01 8 KSP Residual norm 3.788441553969e-01 9 KSP Residual norm 1.193654283561e-01 10 KSP Residual norm 1.595986614454e-01 11 KSP Residual norm 2.993377362791e-02 12 KSP Residual norm 1.432762216316e-03 13 KSP Residual norm 4.171238217969e-04 14 KSP Residual norm 9.270694825671e-04 15 KSP Residual norm 9.451948560740e-05 2 SNES Function norm 2.164055274017e-03 Number of KSP iteration is 15 SNES solve takes time 11.2357321717647665 Number of Newton iterations = 2 the SNES Converged Reason is 3 the memory used finally in SolveNE_option is 1145991168.00000000 in 0 th processor solve_NE for concentration equations took time 11.2634957200000372 the memory used initially in SolveNE_option is 1145991168.00000000 in 0 th processor Calculating the Jacobian matrix using multi-coloring finite difference Calculating the Jacobian matrix using multi-coloring finite difference, end Calculating the Jacobian matrix takes time 0.580552941755740903E-04 the KSP type is gmres the PC type is ml KSP rtol = 0.100000000000000008E-04 abstol = 0.100000000000000001E-49 dtol = 10000.0000000000000 maxit = 10000 SNES rtol = 0.100000000000000002E-07 abstol = 0.100000000000000001E-49 stol = 0.100000000000000002E-07 maxit = 50 maxf= 10000 0 SNES Function norm 5.637544127911e+02 0 KSP Residual norm 8.074132757094e+06 1 KSP Residual norm 8.162289267400e+05 2 KSP Residual norm 2.485691052163e+05 3 KSP Residual norm 1.694979473006e+05 4 KSP Residual norm 1.692597553909e+05 5 KSP Residual norm 1.141369714739e+05 6 KSP Residual norm 5.411385565863e+04 7 KSP Residual norm 2.907568800779e+04 8 KSP Residual norm 2.195670663729e+04 9 KSP Residual norm 1.987662933665e+04 10 KSP Residual norm 1.984128544322e+04 11 KSP Residual norm 1.896159506872e+04 12 KSP Residual norm 1.529241417387e+04 13 KSP Residual norm 1.159676508149e+04 14 KSP Residual norm 8.386589100387e+03 15 KSP Residual norm 6.545195108415e+03 16 KSP Residual norm 4.670526409709e+03 17 KSP Residual norm 2.616131111174e+03 18 KSP Residual norm 1.340432005158e+03 19 KSP Residual norm 6.930110261487e+02 20 KSP Residual norm 3.501481900693e+02 21 KSP Residual norm 1.624612621900e+02 22 KSP Residual norm 8.693046524046e+01 23 KSP Residual norm 6.266502671985e+01 1 SNES Function norm 6.161796268733e-02 0 KSP Residual norm 6.116148118636e+02 1 KSP Residual norm 5.230020822749e+01 2 KSP Residual norm 8.211943951986e+00 3 KSP Residual norm 1.666142209341e+00 4 KSP Residual norm 3.507550432364e-01 5 KSP Residual norm 6.165808645033e-02 6 KSP Residual norm 1.202676243967e-02 7 KSP Residual norm 2.481833379192e-03 2 SNES Function norm 8.769102970782e-06 0 KSP Residual norm 2.228753345052e-03 1 KSP Residual norm 7.086547861298e-04 2 KSP Residual norm 2.208481325117e-04 3 KSP Residual norm 1.451575632052e-04 4 KSP Residual norm 1.418274746815e-04 5 KSP Residual norm 9.951896679242e-05 6 KSP Residual norm 6.710322416550e-05 7 KSP Residual norm 4.951304989493e-05 8 KSP Residual norm 4.517130650698e-05 9 KSP Residual norm 4.516237226608e-05 10 KSP Residual norm 4.204281863840e-05 11 KSP Residual norm 3.107532296876e-05 12 KSP Residual norm 2.213892288359e-05 13 KSP Residual norm 1.311130661770e-05 14 KSP Residual norm 7.469402767238e-06 15 KSP Residual norm 4.676669974107e-06 16 KSP Residual norm 3.240876159844e-06 17 KSP Residual norm 3.034954224512e-06 18 KSP Residual norm 3.032806716269e-06 19 KSP Residual norm 2.969785088371e-06 20 KSP Residual norm 2.538694624997e-06 21 KSP Residual norm 1.879982074346e-06 22 KSP Residual norm 1.255296471142e-06 23 KSP Residual norm 7.489364422265e-07 24 KSP Residual norm 5.322075248129e-07 25 KSP Residual norm 4.222735297804e-07 26 KSP Residual norm 3.111446552243e-07 27 KSP Residual norm 1.943375346943e-07 28 KSP Residual norm 1.065696516704e-07 29 KSP Residual norm 5.044714108566e-08 30 KSP Residual norm 2.083483747171e-08 3 SNES Function norm 5.372515919004e-11 Number of KSP iteration is 30 SNES solve takes time 690.774282409411626 Number of Newton iterations = 3 the SNES Converged Reason is 3 the memory used finally in SolveNE_option is 1161392128.00000000 in 0 th processor solve_NE for flow equations took time 690.779385967058715 solve_CO2 starts iT = 5 (tCurr= 1440.00000000000000 , tNext= 1800.00000000000000 ) using backwardEuler the memory used initially in SolveNE_option is 1161392128.00000000 in 0 th processor Calculating the Jacobian matrix using multi-coloring finite difference Calculating the Jacobian matrix using multi-coloring finite difference, end Calculating the Jacobian matrix takes time 0.581070585212728474E-04 the KSP type is bcgs the PC type is bjacobi KSP rtol = 0.100000000000000008E-04 abstol = 0.100000000000000001E-49 dtol = 10000.0000000000000 maxit = 10000 SNES rtol = 0.100000000000000002E-07 abstol = 0.100000000000000001E-49 stol = 0.100000000000000002E-07 maxit = 50 maxf= 10000 0 SNES Function norm 1.748870969739e+07 0 KSP Residual norm 6.086246201886e+06 1 KSP Residual norm 2.409389735394e+06 2 KSP Residual norm 9.622200928047e+05 3 KSP Residual norm 7.845100008720e+05 4 KSP Residual norm 3.296569920221e+05 5 KSP Residual norm 1.904589431018e+05 6 KSP Residual norm 1.844373287795e+05 7 KSP Residual norm 1.079285086282e+05 8 KSP Residual norm 8.891984486588e+04 9 KSP Residual norm 8.405179802744e+04 10 KSP Residual norm 2.194780141626e+05 11 KSP Residual norm 7.570843689971e+05 12 KSP Residual norm 2.482349011189e+05 13 KSP Residual norm 4.706092657967e+05 14 KSP Residual norm 2.563244095318e+05 15 KSP Residual norm 1.372950386269e+06 16 KSP Residual norm 6.944283147672e+04 17 KSP Residual norm 6.854632103265e+04 18 KSP Residual norm 3.267800586436e+05 19 KSP Residual norm 1.276852156441e+05 20 KSP Residual norm 2.929806690176e+05 21 KSP Residual norm 6.332255447748e+04 22 KSP Residual norm 1.065666927107e+04 23 KSP Residual norm 2.179427377587e+04 24 KSP Residual norm 1.090989269498e+04 25 KSP Residual norm 4.954750321830e+03 26 KSP Residual norm 2.290314834484e+04 27 KSP Residual norm 3.659049402840e+04 28 KSP Residual norm 6.198874437352e+02 29 KSP Residual norm 2.022064043710e+02 30 KSP Residual norm 9.950110754634e+01 31 KSP Residual norm 8.035889596931e+01 32 KSP Residual norm 8.653039748403e+01 33 KSP Residual norm 3.313695971119e+01 1 SNES Function norm 5.407716079365e+02 0 KSP Residual norm 3.313695972687e+01 1 KSP Residual norm 5.184734109949e+01 2 KSP Residual norm 1.566968138836e+01 3 KSP Residual norm 1.172734056613e+01 4 KSP Residual norm 7.295499990009e+00 5 KSP Residual norm 6.644562948205e+00 6 KSP Residual norm 2.090067616380e+00 7 KSP Residual norm 5.650798874604e-01 8 KSP Residual norm 3.828248875064e-01 9 KSP Residual norm 1.188237451760e-01 10 KSP Residual norm 1.219837906646e-01 11 KSP Residual norm 3.044197530806e-02 12 KSP Residual norm 1.437855652708e-03 13 KSP Residual norm 4.252496839951e-04 14 KSP Residual norm 1.998111152480e-04 2 SNES Function norm 4.503925443016e-03 Number of KSP iteration is 14 SNES solve takes time 11.1125425270588494 Number of Newton iterations = 2 the SNES Converged Reason is 3 the memory used finally in SolveNE_option is 1145991168.00000000 in 0 th processor solve_NE for concentration equations took time 11.1403631105881686 the memory used initially in SolveNE_option is 1145991168.00000000 in 0 th processor Calculating the Jacobian matrix using multi-coloring finite difference Calculating the Jacobian matrix using multi-coloring finite difference, end Calculating the Jacobian matrix takes time 0.470929412585974205E-04 the KSP type is gmres the PC type is ml KSP rtol = 0.100000000000000008E-04 abstol = 0.100000000000000001E-49 dtol = 10000.0000000000000 maxit = 10000 SNES rtol = 0.100000000000000002E-07 abstol = 0.100000000000000001E-49 stol = 0.100000000000000002E-07 maxit = 50 maxf= 10000 0 SNES Function norm 5.419004356488e+02 0 KSP Residual norm 8.261643592794e+06 1 KSP Residual norm 7.386189854719e+05 2 KSP Residual norm 1.584330883846e+05 3 KSP Residual norm 3.364196291575e+04 4 KSP Residual norm 7.368389136171e+03 5 KSP Residual norm 1.543727655193e+03 6 KSP Residual norm 3.911584281708e+02 7 KSP Residual norm 7.263753586758e+01 1 SNES Function norm 2.079911111668e-01 0 KSP Residual norm 6.479513763967e+01 1 KSP Residual norm 2.048884277583e+01 2 KSP Residual norm 1.594847809383e+01 3 KSP Residual norm 1.364588964425e+01 4 KSP Residual norm 6.269501761207e+00 5 KSP Residual norm 4.035896337551e+00 6 KSP Residual norm 4.031872117187e+00 7 KSP Residual norm 2.768850078744e+00 8 KSP Residual norm 1.403725412629e+00 9 KSP Residual norm 7.626536014837e-01 10 KSP Residual norm 6.202328834215e-01 11 KSP Residual norm 5.350435338368e-01 12 KSP Residual norm 4.666283999150e-01 13 KSP Residual norm 3.994738205585e-01 14 KSP Residual norm 2.771523168855e-01 15 KSP Residual norm 2.055070828125e-01 16 KSP Residual norm 1.791698744783e-01 17 KSP Residual norm 1.461949045869e-01 18 KSP Residual norm 9.828913420095e-02 19 KSP Residual norm 5.776184245190e-02 20 KSP Residual norm 3.376848313794e-02 21 KSP Residual norm 2.191994279649e-02 22 KSP Residual norm 1.907722095018e-02 23 KSP Residual norm 1.857170395786e-02 24 KSP Residual norm 1.828402291612e-02 25 KSP Residual norm 1.788622756769e-02 26 KSP Residual norm 1.688091022039e-02 27 KSP Residual norm 1.340769361306e-02 28 KSP Residual norm 7.135059196478e-03 29 KSP Residual norm 2.447119579046e-03 30 KSP Residual norm 7.151815788560e-04 31 KSP Residual norm 2.848411909092e-04 2 SNES Function norm 8.677875468083e-07 Number of KSP iteration is 31 SNES solve takes time 447.630811501176595 Number of Newton iterations = 2 the SNES Converged Reason is 3 the memory used finally in SolveNE_option is 1161392128.00000000 in 0 th processor solve_NE for flow equations took time 447.635830009412075 The simulation takes time (no initialization and finalization) 2598.08699473647039 The time for the flow equation solving (SNES) is 2546.65459863058823 The time for the concentration equation solving (SNES) is 51.3306441682352670 The total time for SNES is 2597.98524279882349 solve_CO2(conc) done. ************************************************************************************************************************ *** WIDEN YOUR WINDOW TO 120 CHARACTERS. Use 'enscript -r -fCourier9' to print this document *** ************************************************************************************************************************ ---------------------------------------------- PETSc Performance Summary: ---------------------------------------------- ./rst on a arch-shah named ionode65 with 2048 processors, by Unknown Sun Jul 22 16:50:55 2012 Using Petsc Release Version 3.3.0, Patch 2, Fri Jul 13 15:42:00 CDT 2012 Max Max/Min Avg Total Time (sec): 2.675e+03 1.00001 2.675e+03 Objects: 4.818e+03 1.00000 4.818e+03 Flops: 1.466e+10 1.11589 1.377e+10 2.820e+13 Flops/sec: 5.478e+06 1.11589 5.148e+06 1.054e+10 MPI Messages: 2.549e+06 18.36763 1.762e+06 3.609e+09 MPI Message Lengths: 3.313e+08 2.11656 1.667e+02 6.017e+11 MPI Reductions: 5.812e+03 1.00000 Flop counting convention: 1 flop = 1 real number operation of type (multiply/divide/add/subtract) e.g., VecAXPY() for real vectors of length N --> 2N flops and VecAXPY() for complex vectors of length N --> 8N flops Summary of Stages: ----- Time ------ ----- Flops ----- --- Messages --- -- Message Lengths -- -- Reductions -- Avg %Total Avg %Total counts %Total Avg %Total counts %Total 0: Main Stage: 2.6754e+03 100.0% 2.8204e+13 100.0% 3.609e+09 100.0% 1.667e+02 100.0% 5.811e+03 100.0% ------------------------------------------------------------------------------------------------------------------------ See the 'Profiling' chapter of the users' manual for details on interpreting output. Phase summary info: Count: number of times phase was executed Time and Flops: Max - maximum over all processors Ratio - ratio of maximum to minimum over all processors Mess: number of messages sent Avg. len: average message length Reduct: number of global reductions Global: entire computation Stage: stages of a computation. Set stages with PetscLogStagePush() and PetscLogStagePop(). %T - percent time in this phase %f - percent flops in this phase %M - percent messages in this phase %L - percent message lengths in this phase %R - percent reductions in this phase Total Mflop/s: 10e-6 * (sum of flops over all processors)/(max time over all processors) ------------------------------------------------------------------------------------------------------------------------ Event Count Time (sec) Flops --- Global --- --- Stage --- Total Max Ratio Max Ratio Max Ratio Mess Avg len Reduct %T %f %M %L %R %T %f %M %L %R Mflop/s ------------------------------------------------------------------------------------------------------------------------ --- Event Stage 0: Main Stage PetscBarrier 10 1.0 1.1748e-0211.3 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 SNESSolve 10 1.0 2.5979e+03 1.0 1.47e+10 1.1 3.6e+09 1.7e+02 5.7e+03 97100100100 98 97100100100 98 10857 SNESFunctionEval 31 1.0 9.2333e-01 1.2 0.00e+00 0.0 1.4e+06 3.5e+03 2.0e+00 0 0 0 1 0 0 0 0 1 0 0 SNESJacobianEval 21 1.0 5.0506e+01 1.0 7.33e+07 1.1 2.7e+07 3.5e+03 4.5e+01 2 1 1 16 1 2 1 1 16 1 2812 SNESLineSearch 21 1.0 1.2610e+00 1.0 8.81e+07 1.1 1.9e+06 3.5e+03 8.4e+01 0 1 0 1 1 0 1 0 1 1 134858 VecDot 413 1.0 1.4155e+00 4.7 5.33e+07 1.1 0.0e+00 0.0e+00 4.1e+02 0 0 0 0 7 0 0 0 0 7 72941 VecDotNorm2 196 1.0 1.1593e+00 9.0 5.06e+07 1.1 0.0e+00 0.0e+00 2.0e+02 0 0 0 0 3 0 0 0 0 3 84533 VecMDot 234 1.0 3.7595e+00 2.4 3.90e+08 1.1 0.0e+00 0.0e+00 2.3e+02 0 3 0 0 4 0 3 0 0 4 200889 VecNorm 496 1.0 1.1166e+00 2.5 6.40e+07 1.1 0.0e+00 0.0e+00 5.0e+02 0 0 0 0 9 0 0 0 0 9 111056 VecScale 4693 1.0 2.9463e-01 1.4 3.52e+07 1.5 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 224870 VecCopy 642 1.0 2.3825e-01 1.3 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 VecSet 2769 1.0 1.2421e-01 1.3 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 VecAXPY 2064 1.0 7.9276e-01 1.4 1.15e+08 1.1 0.0e+00 0.0e+00 0.0e+00 0 1 0 0 0 0 1 0 0 0 280230 VecAYPX 1482 1.0 4.0547e-01 1.2 1.98e+07 1.1 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 94524 VecAXPBYCZ 392 1.0 7.8397e-01 1.3 1.01e+08 1.1 0.0e+00 0.0e+00 0.0e+00 0 1 0 0 0 0 1 0 0 0 250009 VecWAXPY 413 1.0 2.6542e-01 1.3 5.19e+07 1.1 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 379120 VecMAXPY 247 1.0 1.4193e+00 1.2 4.20e+08 1.1 0.0e+00 0.0e+00 0.0e+00 0 3 0 0 0 0 3 0 0 0 573348 VecScatterBegin 7853 1.0 4.9287e+0127.9 0.00e+00 0.0 3.4e+09 1.8e+02 0.0e+00 0 0 94100 0 0 0 94100 0 0 VecScatterEnd 7853 1.0 4.1848e+02 1.8 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 13 0 0 0 0 13 0 0 0 0 0 VecReduceArith 52 1.0 2.3512e-02 1.1 6.71e+06 1.1 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 552907 VecReduceComm 31 1.0 9.8284e-02 5.7 0.00e+00 0.0 0.0e+00 0.0e+00 3.1e+01 0 0 0 0 1 0 0 0 0 1 0 VecNormalize 247 1.0 6.7727e-01 1.8 4.78e+07 1.1 0.0e+00 0.0e+00 2.5e+02 0 0 0 0 4 0 0 0 0 4 136762 MatMult 3723 1.0 1.7651e+02 5.4 3.85e+09 1.1 8.6e+08 2.3e+02 0.0e+00 5 26 24 32 0 5 26 24 32 0 42048 MatMultAdd 1482 1.0 2.3328e+0211.6 3.97e+07 1.1 0.0e+00 0.0e+00 2.2e+01 3 0 0 0 0 3 0 0 0 0 329 MatSolve 649 1.0 1.0815e+01 1.1 1.30e+09 1.1 0.0e+00 0.0e+00 0.0e+00 0 9 0 0 0 0 9 0 0 0 233096 MatSOR 2964 1.0 3.9407e+02 3.9 8.07e+09 1.1 2.5e+09 1.1e+02 9.9e+02 11 55 69 47 17 11 55 69 47 17 39298 MatLUFactorSym 11 1.0 1.1463e-03 1.1 0.00e+00 0.0 0.0e+00 0.0e+00 3.3e+01 0 0 0 0 1 0 0 0 0 1 0 MatLUFactorNum 21 1.0 2.4922e+00 1.1 1.45e+08 1.1 0.0e+00 0.0e+00 0.0e+00 0 1 0 0 0 0 1 0 0 0 112406 MatILUFactorSym 5 1.0 2.2485e-01 1.1 0.00e+00 0.0 0.0e+00 0.0e+00 5.0e+00 0 0 0 0 0 0 0 0 0 0 0 MatAssemblyBegin 110 1.0 2.6155e+00 5.1 0.00e+00 0.0 0.0e+00 0.0e+00 1.8e+02 0 0 0 0 3 0 0 0 0 3 0 MatAssemblyEnd 110 1.0 4.2814e+00 2.7 0.00e+00 0.0 7.1e+07 2.1e+01 5.4e+02 0 0 2 0 9 0 0 2 0 9 0 MatGetRowIJ 16 1.0 1.3113e-04 1.1 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 MatGetOrdering 16 1.0 1.4726e-02 1.1 0.00e+00 0.0 0.0e+00 0.0e+00 3.2e+01 0 0 0 0 1 0 0 0 0 1 0 MatZeroEntries 21 1.0 1.0455e-01 1.1 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 MatFDColorCreate 1 1.0 7.6147e+01 1.0 0.00e+00 0.0 8.9e+04 8.7e+02 9.2e+01 3 0 0 0 2 3 0 0 0 2 0 MatFDColorApply 21 1.0 5.0506e+01 1.0 7.33e+07 1.1 2.7e+07 3.5e+03 4.5e+01 2 1 1 16 1 2 1 1 16 1 2812 MatFDColorFunc 588 1.0 1.8813e+01 1.2 0.00e+00 0.0 2.6e+07 3.5e+03 0.0e+00 1 0 1 15 0 1 0 1 15 0 0 MatGetRedundant 11 1.0 1.0325e+01 1.3 0.00e+00 0.0 1.4e+08 6.0e+00 4.4e+01 0 0 4 0 1 0 0 4 0 1 0 KSPGMRESOrthog 234 1.0 4.9073e+00 1.7 7.80e+08 1.1 0.0e+00 0.0e+00 2.3e+02 0 5 0 0 4 0 5 0 0 4 307807 KSPSetUp 119 1.0 8.7377e-02 1.3 0.00e+00 0.0 0.0e+00 0.0e+00 2.4e+02 0 0 0 0 4 0 0 0 0 4 0 KSPSolve 21 1.0 2.5458e+03 1.0 1.45e+10 1.1 3.6e+09 1.4e+02 5.5e+03 95 99 99 83 95 95 99 99 83 95 10955 PCSetUp 31 1.0 1.9466e+03 1.0 5.28e+08 1.1 2.2e+08 1.1e+02 2.9e+03 73 4 6 4 50 73 4 6 4 50 524 PCSetUpOnBlocks 10 1.0 2.7321e+00 1.1 1.45e+08 1.1 0.0e+00 0.0e+00 1.5e+01 0 1 0 0 0 0 1 0 0 0 102534 PCApply 649 1.0 5.8003e+02 1.0 1.06e+10 1.1 3.3e+09 1.1e+02 1.0e+03 22 72 92 63 17 22 72 92 63 17 35241 ------------------------------------------------------------------------------------------------------------------------ Memory usage is given in bytes: Object Type Creations Destructions Memory Descendants' Mem. Reports information only for process 0. --- Event Stage 0: Main Stage Container 13 13 4212 0 SNES 1 1 812 0 SNESLineSearch 1 1 536 0 Vector 3975 3975 476579708 0 Vector Scatter 92 92 58512 0 Matrix 371 371 223370840 0 Matrix FD Coloring 1 1 13832832 0 Distributed Mesh 3 3 608136 0 Bipartite Graph 6 6 2424 0 Index Set 260 260 2533560 0 IS L to G Mapping 2 2 301224 0 Viewer 1 0 0 0 Krylov Solver 46 46 118572 0 Preconditioner 46 46 27124 0 ======================================================================================================================== Average time to get PetscTime(): 3.50475e-06 Average time for MPI_Barrier(): 3.76701e-06 Average time for zero size MPI_Send(): 1.35483e-05 #PETSc Option Table entries: -ksp_monitor -log_summary -snes_monitor #End of PETSc Option Table entries Compiled with FORTRAN kernels Compiled with full precision matrices (default) sizeof(short) 2 sizeof(int) 4 sizeof(long) 4 sizeof(void*) 4 sizeof(PetscScalar) 8 sizeof(PetscInt) 4 Configure run at: Sat Jul 21 18:38:13 2012 Configure options: --known-bits-per-byte=8 --known-level1-dcache-assoc=0 --known-level1-dcache-linesize=32 --known-level1-dcache-size=32768 --known-memcmp-ok --known-mpi-long-double=1 --known-mpi-shared-libraries=0 --known-sizeof-MPI_Comm=4 --known-sizeof-MPI_Fint=4 --known-sizeof-char=1 --known-sizeof-double=8 --known-sizeof-float=4 --known-sizeof-int=4 --known-sizeof-long-long=8 --known-sizeof-long=4 --known-sizeof-short=2 --known-sizeof-size_t=4 --known-sizeof-void-p=4 --with-batch=1 --download-f-blas-lapack=1 --with-cc=mpixlc_r --with-cxx=mpixlcxx_r --with-debugging=0 --with-fc="mpixlf77_r -qnosave" --with-fortran-kernels=1 --with-is-color-value-type=short --with-shared-libraries=0 --with-x=0 -COPTFLAGS="-O3 -qarch=450d -qtune=450 -qmaxmem=-1" -CXXOPTFLAGS="-O3 -qarch=450d -qtune=450 -qmaxmem=-1" -FOPTFLAGS="-O3 -qarch=450d -qtune=450 -qmaxmem=-1" --download-ml=1 PETSC_ARCH=arch-shaheen-bgp-opt ----------------------------------------- Libraries compiled on Sat Jul 21 18:38:13 2012 on fen1 Machine characteristics: Linux-2.6.16.60-0.93.1-ppc64-ppc64-with-SuSE-10-ppc Using PETSc directory: /home/kaibao/petsc-3.3-p2 Using PETSc arch: arch-shaheen-bgp-opt ----------------------------------------- Using C compiler: mpixlc_r -O3 -qarch=450d -qtune=450 -qmaxmem=-1 ${COPTFLAGS} ${CFLAGS} Using Fortran compiler: mpixlf77_r -qnosave -O3 -qarch=450d -qtune=450 -qmaxmem=-1 ${FOPTFLAGS} ${FFLAGS} ----------------------------------------- Using include paths: -I/home/kaibao/petsc-3.3-p2/arch-shaheen-bgp-opt/include -I/home/kaibao/petsc-3.3-p2/include -I/home/kaibao/petsc-3.3-p2/include -I/home/kaibao/petsc-3.3-p2/arch-shaheen-bgp-opt/include -I/bgsys/drivers/V1R4M2_200_2010-100508P/ppc/comm/default/include -I/bgsys/drivers/V1R4M2_200_2010-100508P/ppc/comm/sys/include ----------------------------------------- Using C linker: mpixlc_r Using Fortran linker: mpixlf77_r -qnosave Using libraries: -Wl,-rpath,/home/kaibao/petsc-3.3-p2/arch-shaheen-bgp-opt/lib -L/home/kaibao/petsc-3.3-p2/arch-shaheen-bgp-opt/lib -lpetsc -lpthread -Wl,-rpath,/home/kaibao/petsc-3.3-p2/arch-shaheen-bgp-opt/lib -L/home/kaibao/petsc-3.3-p2/arch-shaheen-bgp-opt/lib -lml -L/bgsys/drivers/V1R4M2_200_2010-100508P/ppc/comm/default/lib -L/bgsys/drivers/V1R4M2_200_2010-100508P/ppc/comm/sys/lib -L/bgsys/drivers/V1R4M2_200_2010-100508P/ppc/runtime/SPI -L/opt/ibmcmp/xlsmp/bg/1.7/bglib -L/opt/ibmcmp/xlmass/bg/4.4/bglib -L/opt/ibmcmp/vac/bg/9.0/bglib -L/opt/ibmcmp/vacpp/bg/9.0/bglib -L/bgsys/drivers/ppcfloor/gnu-linux/lib/gcc/powerpc-bgp-linux/4.1.2 -L/bgsys/drivers/ppcfloor/gnu-linux/powerpc-bgp-linux/lib -Wl,-rpath,/opt/ibmcmp/lib/bg/bglib -Wl,-rpath,/bgsys/drivers/V1R4M2_200_2010-100508P/ppc/comm/default/lib -Wl,-rpath,/bgsys/drivers/V1R4M2_200_2010-100508P/ppc/comm/sys/lib -Wl,-rpath,/bgsys/drivers/V1R4M2_200_2010-100508P/ppc/runtime/SPI -lcxxmpich.cnk -libmc++ -lstdc++ -lflapack -lfblas -L/opt/ibmcmp/xlf/bg/11.1/bglib -lxlf90_r -lxlomp_ser -lxlfmath -lm -lcxxmpich.cnk -libmc++ -lstdc++ -lcxxmpich.cnk -libmc++ -lstdc++ -ldl -lmpich.cnk -lopa -ldcmf.cnk -ldcmfcoll.cnk -lpthread -lSPI.cna -lrt -lxlopt -lxl -lgcc_eh -ldl ----------------------------------------- Finish RST_CO2. Finish interpreting the file infile_RSTi.m by RST. after mpi_finalize: ierr = 0
