Hi Jed,

Below are the output details. (Results were obtained with 
-snes_converged_reason, 
-snes_monitor. The -ksp_converged_reason ended up with seg fault, so was not 
included. It 
should not be the key problem though. )

Output from the desktop (good convergence rate):
total constitutive equations = ngauss = 1000
  EquationSystems
   n_systems()=1
    System #0, "Elasticity"
     Type "NonlinearImplicit"
     Variables={ "ux" "uy" "uz" }
     Finite Element Types="LAGRANGE"
     Approximation Orders="FIRST"
     n_dofs()=648
     n_local_dofs()=648
     n_constrained_dofs()=108
     n_local_constrained_dofs()=108
     n_vectors()=1
     n_matrices()=1
     DofMap Sparsity
       Average  On-Processor Bandwidth <= 56.8889
       Average Off-Processor Bandwidth <= 0
       Maximum  On-Processor Bandwidth <= 81
       Maximum Off-Processor Bandwidth <= 0
     DofMap Constraints
       Number of DoF Constraints = 108
       Average DoF Constraint Length= 0

*** Warning, This code is deprecated, and likely to be removed in future 
library versions! 
src/mesh/boundary_info.C, line 752, compiled Oct 29 2013 at 08:06:16 ***
   NL step  0, |residual|_2 = 1.440000e+00
   0 SNES Function norm 1.440000000000e+00
   NL step  1, |residual|_2 = 5.960479e-01
   1 SNES Function norm 5.960478586457e-01
   NL step  2, |residual|_2 = 3.745465e-02
   2 SNES Function norm 3.745464932748e-02
   NL step  3, |residual|_2 = 7.372288e-04
   3 SNES Function norm 7.372287735879e-04
   NL step  4, |residual|_2 = 1.426607e-07
   4 SNES Function norm 1.426607123296e-07
   NL step  5, |residual|_2 = 4.472564e-12
   5 SNES Function norm 4.472564229796e-12
Nonlinear solve converged due to CONVERGED_FNORM_RELATIVE iterations 5
Mechanics system solved at nonlinear iteration 5 , final nonlinear residual 
norm: 
4.472564e-12, converge reason= 3
------------------------------------------------------------------------------------------
Output from the cluster (poor convergence rate):
total constitutive equations = ngauss = 1000
  EquationSystems
   n_systems()=1
    System #0, "Elasticity"
     Type "NonlinearImplicit"
     Variables={ "ux" "uy" "uz" }
     Finite Element Types="LAGRANGE"
     Approximation Orders="FIRST"
     n_dofs()=648
     n_local_dofs()=648
     n_constrained_dofs()=108
     n_local_constrained_dofs()=108
     n_vectors()=1
     n_matrices()=1
     DofMap Sparsity
       Average  On-Processor Bandwidth <= 56.8889
       Average Off-Processor Bandwidth <= 0
       Maximum  On-Processor Bandwidth <= 81
       Maximum Off-Processor Bandwidth <= 0
     DofMap Constraints
       Number of DoF Constraints = 108
       Average DoF Constraint Length= 0

*** Warning, This code is deprecated, and likely to be removed in future 
library versions! 
src/mesh/boundary_info.C, line 752, compiled Dec 19 2013 at 15:59:31 ***
   NL step  0, |residual|_2 = 1.440000e+00
   0 SNES Function norm 1.440000000000e+00
   NL step  1, |residual|_2 = 5.960479e-01
   1 SNES Function norm 5.960478586457e-01
   NL step  2, |residual|_2 = 1.481775e-01
   2 SNES Function norm 1.481775334529e-01
   NL step  3, |residual|_2 = 7.269557e-02
   3 SNES Function norm 7.269556782845e-02
   NL step  4, |residual|_2 = 3.051185e-03
   4 SNES Function norm 3.051184607506e-03
   NL step  5, |residual|_2 = 2.572549e-03
   5 SNES Function norm 2.572548835065e-03
   NL step  6, |residual|_2 = 2.207251e-03
   6 SNES Function norm 2.207251245116e-03
   NL step  7, |residual|_2 = 2.131013e-03
   7 SNES Function norm 2.131012652111e-03
   NL step  8, |residual|_2 = 2.054042e-03
   8 SNES Function norm 2.054041562027e-03
   NL step  9, |residual|_2 = 1.981749e-03
   9 SNES Function norm 1.981749134719e-03
   NL step 10, |residual|_2 = 1.829931e-03
  10 SNES Function norm 1.829930870093e-03
   NL step 11, |residual|_2 = 1.732368e-03
  11 SNES Function norm 1.732367614052e-03
   NL step 12, |residual|_2 = 1.661435e-03
  12 SNES Function norm 1.661435082740e-03
   NL step 13, |residual|_2 = 1.550510e-03
  13 SNES Function norm 1.550509928763e-03
   NL step 14, |residual|_2 = 1.498905e-03
  14 SNES Function norm 1.498904724330e-03
   NL step 15, |residual|_2 = 1.451520e-03
  15 SNES Function norm 1.451520028630e-03
   NL step 16, |residual|_2 = 1.415582e-03
  16 SNES Function norm 1.415581852666e-03
   NL step 17, |residual|_2 = 1.314334e-03
  17 SNES Function norm 1.314334358891e-03
   NL step 18, |residual|_2 = 1.274014e-03
  18 SNES Function norm 1.274013709112e-03
   NL step 19, |residual|_2 = 1.774630e-04
  19 SNES Function norm 1.774630063354e-04
   NL step 20, |residual|_2 = 1.525944e-04
  20 SNES Function norm 1.525944094760e-04
   NL step 21, |residual|_2 = 1.477031e-04
  21 SNES Function norm 1.477031246669e-04
   NL step 22, |residual|_2 = 1.453195e-04
  22 SNES Function norm 1.453195226456e-04
   NL step 23, |residual|_2 = 1.302904e-04
  23 SNES Function norm 1.302904239436e-04
   NL step 24, |residual|_2 = 1.264238e-04
  24 SNES Function norm 1.264238361159e-04
   NL step 25, |residual|_2 = 1.135667e-04
  25 SNES Function norm 1.135667030231e-04
   NL step 26, |residual|_2 = 1.070810e-04
  26 SNES Function norm 1.070810206898e-04
   NL step 27, |residual|_2 = 1.036418e-04
  27 SNES Function norm 1.036417750251e-04
   NL step 28, |residual|_2 = 1.004803e-04
  28 SNES Function norm 1.004803143137e-04
   NL step 29, |residual|_2 = 9.154985e-05
  29 SNES Function norm 9.154985324734e-05
   NL step 30, |residual|_2 = 8.900270e-05
  30 SNES Function norm 8.900270443665e-05
   NL step 31, |residual|_2 = 6.523513e-05
  31 SNES Function norm 6.523513427832e-05
   NL step 32, |residual|_2 = 5.196890e-05
  32 SNES Function norm 5.196889874832e-05
   NL step 33, |residual|_2 = 4.962914e-05
  33 SNES Function norm 4.962914434970e-05
   NL step 34, |residual|_2 = 4.802445e-05
  34 SNES Function norm 4.802445335167e-05
   NL step 35, |residual|_2 = 4.660265e-05
  35 SNES Function norm 4.660265300997e-05
   NL step 36, |residual|_2 = 4.560508e-05
  36 SNES Function norm 4.560508074305e-05
   NL step 37, |residual|_2 = 4.176890e-05
  37 SNES Function norm 4.176889934246e-05
   NL step 38, |residual|_2 = 4.065922e-05
  38 SNES Function norm 4.065922035297e-05
   NL step 39, |residual|_2 = 2.819062e-05
  39 SNES Function norm 2.819062187692e-05
   NL step 40, |residual|_2 = 1.229634e-05
  40 SNES Function norm 1.229633591270e-05
   NL step 41, |residual|_2 = 8.466334e-06
  41 SNES Function norm 8.466333505983e-06
   NL step 42, |residual|_2 = 7.785196e-06
  42 SNES Function norm 7.785196405201e-06
   NL step 43, |residual|_2 = 7.517116e-06
  43 SNES Function norm 7.517115760778e-06
   NL step 44, |residual|_2 = 5.517172e-06
  44 SNES Function norm 5.517171865105e-06
   NL step 45, |residual|_2 = 4.627790e-06
  45 SNES Function norm 4.627789977237e-06
   NL step 46, |residual|_2 = 4.457517e-06
  46 SNES Function norm 4.457517058356e-06
   NL step 47, |residual|_2 = 4.393732e-06
  47 SNES Function norm 4.393732353601e-06
   NL step 48, |residual|_2 = 3.879515e-06
  48 SNES Function norm 3.879515135247e-06
   NL step 49, |residual|_2 = 3.763677e-06
  49 SNES Function norm 3.763677330091e-06
   NL step 50, |residual|_2 = 3.500036e-06
  50 SNES Function norm 3.500036191831e-06
   NL step 51, |residual|_2 = 3.256444e-06
  51 SNES Function norm 3.256444300502e-06
   NL step 52, |residual|_2 = 3.147962e-06
  52 SNES Function norm 3.147962249732e-06
   NL step 53, |residual|_2 = 2.860652e-06
  53 SNES Function norm 2.860652455813e-06
   NL step 54, |residual|_2 = 2.724702e-06
  54 SNES Function norm 2.724702170315e-06
   NL step 55, |residual|_2 = 2.619289e-06
  55 SNES Function norm 2.619289101215e-06
   NL step 56, |residual|_2 = 2.531273e-06
  56 SNES Function norm 2.531273013757e-06
   NL step 57, |residual|_2 = 2.229636e-06
  57 SNES Function norm 2.229636056679e-06
   NL step 58, |residual|_2 = 2.073304e-06
  58 SNES Function norm 2.073303801469e-06
   NL step 59, |residual|_2 = 2.003962e-06
  59 SNES Function norm 2.003961608610e-06
   NL step 60, |residual|_2 = 1.846291e-06
  60 SNES Function norm 1.846291365509e-06
   NL step 61, |residual|_2 = 1.752788e-06
  61 SNES Function norm 1.752788290496e-06
   NL step 62, |residual|_2 = 1.687328e-06
  62 SNES Function norm 1.687327986194e-06
   NL step 63, |residual|_2 = 1.633939e-06
  63 SNES Function norm 1.633938540202e-06
   NL step 64, |residual|_2 = 1.546997e-06
  64 SNES Function norm 1.546997405760e-06
   NL step 65, |residual|_2 = 1.436955e-06
  65 SNES Function norm 1.436954500901e-06
   NL step 66, |residual|_2 = 1.394765e-06
  66 SNES Function norm 1.394765119799e-06
   NL step 67, |residual|_2 = 1.177653e-06
  67 SNES Function norm 1.177652615109e-06
   NL step 68, |residual|_2 = 1.056466e-06
  68 SNES Function norm 1.056465738701e-06
   NL step 69, |residual|_2 = 1.029155e-06
  69 SNES Function norm 1.029154936896e-06
   NL step 70, |residual|_2 = 9.585998e-07
  70 SNES Function norm 9.585998143404e-07
   NL step 71, |residual|_2 = 9.124501e-07
  71 SNES Function norm 9.124500896542e-07
   NL step 72, |residual|_2 = 8.813674e-07
  72 SNES Function norm 8.813674410684e-07
   NL step 73, |residual|_2 = 8.557197e-07
  73 SNES Function norm 8.557196934474e-07
   NL step 74, |residual|_2 = 8.266958e-07
  74 SNES Function norm 8.266957904914e-07
   NL step 75, |residual|_2 = 7.628019e-07
  75 SNES Function norm 7.628018815310e-07
   NL step 76, |residual|_2 = 7.427199e-07
  76 SNES Function norm 7.427198948047e-07
   NL step 77, |residual|_2 = 2.892657e-07
  77 SNES Function norm 2.892656631445e-07
   NL step 78, |residual|_2 = 2.110709e-07
  78 SNES Function norm 2.110709381321e-07
   NL step 79, |residual|_2 = 1.971659e-07
  79 SNES Function norm 1.971659429523e-07
   NL step 80, |residual|_2 = 1.894502e-07
  80 SNES Function norm 1.894501578413e-07
   NL step 81, |residual|_2 = 1.811535e-07
  81 SNES Function norm 1.811534729574e-07
   NL step 82, |residual|_2 = 1.619090e-07
  82 SNES Function norm 1.619090109708e-07
   NL step 83, |residual|_2 = 1.568687e-07
  83 SNES Function norm 1.568686804349e-07
   NL step 84, |residual|_2 = 1.366121e-07
  84 SNES Function norm 1.366120654786e-07
   NL step 85, |residual|_2 = 1.276916e-07
  85 SNES Function norm 1.276915915061e-07
   NL step 86, |residual|_2 = 1.223932e-07
  86 SNES Function norm 1.223931884127e-07
   NL step 87, |residual|_2 = 1.163863e-07
  87 SNES Function norm 1.163863154650e-07
   NL step 88, |residual|_2 = 1.121774e-07
  88 SNES Function norm 1.121774061403e-07
   NL step 89, |residual|_2 = 1.079065e-07
  89 SNES Function norm 1.079065066402e-07
   NL step 90, |residual|_2 = 9.627717e-08
  90 SNES Function norm 9.627717396832e-08
   NL step 91, |residual|_2 = 9.338040e-08
  91 SNES Function norm 9.338040321284e-08
   NL step 92, |residual|_2 = 8.395781e-08
  92 SNES Function norm 8.395780687987e-08
   NL step 93, |residual|_2 = 7.972458e-08
  93 SNES Function norm 7.972458335224e-08
   NL step 94, |residual|_2 = 7.599603e-08
  94 SNES Function norm 7.599603469718e-08
   NL step 95, |residual|_2 = 7.371015e-08
  95 SNES Function norm 7.371015086782e-08
   NL step 96, |residual|_2 = 6.365861e-08
  96 SNES Function norm 6.365860767062e-08
   NL step 97, |residual|_2 = 5.893407e-08
  97 SNES Function norm 5.893407486421e-08
   NL step 98, |residual|_2 = 5.673266e-08
  98 SNES Function norm 5.673265571740e-08
   NL step 99, |residual|_2 = 5.195474e-08
  99 SNES Function norm 5.195473569965e-08
   NL step 100, |residual|_2 = 4.885457e-08
100 SNES Function norm 4.885457271896e-08
   NL step 101, |residual|_2 = 4.685175e-08
101 SNES Function norm 4.685175202156e-08
   NL step 102, |residual|_2 = 4.505639e-08
102 SNES Function norm 4.505639250964e-08
   NL step 103, |residual|_2 = 4.324372e-08
103 SNES Function norm 4.324372186040e-08
   NL step 104, |residual|_2 = 4.150867e-08
104 SNES Function norm 4.150867469968e-08
   NL step 105, |residual|_2 = 4.006847e-08
105 SNES Function norm 4.006846993522e-08
   NL step 106, |residual|_2 = 2.916694e-08
106 SNES Function norm 2.916693756766e-08
   NL step 107, |residual|_2 = 2.374078e-08
107 SNES Function norm 2.374078268250e-08
   NL step 108, |residual|_2 = 2.272917e-08
108 SNES Function norm 2.272917460537e-08
   NL step 109, |residual|_2 = 2.173385e-08
109 SNES Function norm 2.173385018336e-08
   NL step 110, |residual|_2 = 2.114292e-08
110 SNES Function norm 2.114291507081e-08
   NL step 111, |residual|_2 = 2.040838e-08
111 SNES Function norm 2.040838239152e-08
   NL step 112, |residual|_2 = 1.864519e-08
112 SNES Function norm 1.864518544055e-08
   NL step 113, |residual|_2 = 1.805016e-08
113 SNES Function norm 1.805015962441e-08
   NL step 114, |residual|_2 = 1.024459e-08
114 SNES Function norm 1.024458891160e-08
Nonlinear solve converged due to CONVERGED_FNORM_RELATIVE iterations 114
Mechanics system solved at nonlinear iteration 114 , final nonlinear residual 
norm: 
1.024459e-08, converge reason= 3

Thanks,
Dafang

On 1/2/2014 9:33 PM, Jed Brown wrote:
> Dafang Wang <[email protected]> writes:
>
>> Hi,
>>
>> My libmesh progam, which uses SNES to solve a nonlinear equation, had 
>> different
>> convergence behavior when running on a linux desktop and on a cluster 
>> machine.
>>
>> All other running conditions were double checked to be identical: It was the 
>> same program
>> running as a single thread on both machines. Both machines were using 
>> Libmesh 0.9.2.2.
>>
>> My program was solving a simple elastic model with good numerical/physical 
>> behavior. (The
>> model consists of a 5*5*5 cubic mesh with a total of ~600 degress of 
>> freedom.) For the
>> nonlinear solve, I was using the Newton method and line search (the default 
>> settings in
>> Petsc SNES).
>>
>> The Newton method took 5 iterations to converge on my desktop (Ubutun 
>> 12.04), whereas it
>> took 114 iterations to converge on the cluster. Moreover, both machines 
>> generated
>> identical results in the first 2 Newton iterations, then they diverged from 
>> the 3rd
>> iteration.
> Please send the output of -ksp_converged_reason
> -ksp_monitor_true_residual -snes_monitor -snes_converged_reason
> -snes_view for both cases.

-- 
Dafang Wang, Ph.D.
Postdoctoral Fellow
Institute of Computational Medicine
Hackerman Hall, Room 218
Johns Hopkins University, Baltimore, 21218
http://lagniappe.icm.jhu.edu/~dwang/
------------------------------------------------------------------------------
Rapidly troubleshoot problems before they affect your business. Most IT 
organizations don't have a clear picture of how application performance 
affects their revenue. With AppDynamics, you get 100% visibility into your 
Java,.NET, & PHP application. Start your 15-day FREE TRIAL of AppDynamics Pro!
http://pubads.g.doubleclick.net/gampad/clk?id=84349831&iu=/4140/ostg.clktrk
_______________________________________________
Libmesh-users mailing list
[email protected]
https://lists.sourceforge.net/lists/listinfo/libmesh-users

Reply via email to