Hello Oscar,
do you have time to look into my problem? Probably Takahiro has a
point and gdb behaves differently on Solaris and Linux, so that
the differing outputs have no meaning. I tried to debug my Java
program, but without success so far, because I wasn't able to get
into the Java program to set a breakpoint or to see the code. Have
you succeeded to debug a mpiJava program? If so, how must I call
gdb (I normally use "gdb mipexec" and then "run -np 1 java ...")?
What can I do to get helpful information to track the error down?
I have attached the error log file. Perhaps you can see if something
is going wrong with the Java interface. Thank you very much for your
help and any hints for the usage of gdb with mpiJava in advance.
Please let me know if I can provide anything else.
Kind regards
Siegmar
> > I think that it must have to do with MPI, because everything
> > works fine on Linux and my Java program works fine with an older
> > MPI version (openmpi-1.8.2a1r31804) as well.
>
> Yes. I also think it must have to do with MPI.
> But java process side, not mpiexec process side.
>
> When you run Java MPI program via mpiexec, a mpiexec process
> process launch a java process. When the java process (your
> Java program) calls a MPI method, native part (written in C/C++)
> of the MPI library is called. It runs in java process, not in
> mpiexec process. I suspect that part.
>
> > On Solaris things are different.
>
> Are you saying the following difference?
> After this line,
> > 881 ORTE_ACTIVATE_JOB_STATE(jdata, ORTE_JOB_STATE_INIT);
> Linux shows
> > orte_job_state_to_str (state=1)
> > at ../../openmpi-dev-124-g91e9686/orte/util/error_strings.c:217
> > 217 switch(state) {
> but Solaris shows
> > orte_util_print_name_args (name=0x100118380 <orte_process_info+104>)
> > at ../../openmpi-dev-124-g91e9686/orte/util/name_fns.c:122
> > 122 if (NULL == name) {
>
> Each macro is defined as:
>
> #define ORTE_ACTIVATE_JOB_STATE(j, s) \
> do { \
> orte_job_t *shadow=(j); \
> opal_output_verbose(1, orte_state_base_framework.framework_output, \
> "%s ACTIVATE JOB %s STATE %s AT %s:%d", \
> ORTE_NAME_PRINT(ORTE_PROC_MY_NAME), \
> (NULL == shadow) ? "NULL" : \
> ORTE_JOBID_PRINT(shadow->jobid), \
> orte_job_state_to_str((s)), \
> __FILE__, __LINE__); \
> orte_state.activate_job_state(shadow, (s)); \
> } while(0);
>
> #define ORTE_NAME_PRINT(n) \
> orte_util_print_name_args(n)
>
> #define ORTE_JOBID_PRINT(n) \
> orte_util_print_jobids(n)
>
> I'm not sure, but I think the gdb on Solaris steps into
> orte_util_print_name_args, but gdb on Linux doesn't step into
> orte_util_print_name_args and orte_util_print_jobids for some
> reason, or orte_job_state_to_str is evaluated before them.
>
> So I think it's not an important difference.
>
> You showed the following lines.
> > > > orterun (argc=5, argv=0xffffffff7fffe0d8)
> > > > at
../../../../openmpi-dev-124-g91e9686/orte/tools/orterun/orterun.c:1084
> > > > 1084 while (orte_event_base_active) {
> > > > (gdb)
> > > > 1085 opal_event_loop(orte_event_base, OPAL_EVLOOP_ONCE);
> > > > (gdb)
>
> I'm not familiar with this code but I think this part (in mpiexec
> process) is only waiting the java process to terminate (normally
> or abnormally). So I think the problem is not in a mpiexec process
> but in a java process.
>
> Regards,
> Takahiro
>
> > Hi Takahiro,
> >
> > > mpiexec and java run as distinct processes. Your JRE message
> > > says java process raises SEGV. So you should trace the java
> > > process, not the mpiexec process. And more, your JRE message
> > > says the crash happened outside the Java Virtual Machine in
> > > native code. So usual Java program debugger is useless.
> > > You should trace native code part of the java process.
> > > Unfortunately I don't know how to debug such one.
> >
> > I think that it must have to do with MPI, because everything
> > works fine on Linux and my Java program works fine with an older
> > MPI version (openmpi-1.8.2a1r31804) as well.
> >
> > linpc1 x 112 mpiexec -np 1 java InitFinalizeMain
> > Hello!
> > linpc1 x 113
> >
> > Therefore I single stepped through the program on Linux as well
> > and found a difference launching the process. On Linux I get the
> > following sequence.
> >
> > Breakpoint 1, rsh_launch (jdata=0x614aa0)
> > at
../../../../../openmpi-dev-124-g91e9686/orte/mca/plm/rsh/plm_rsh_module.c:876
> > 876 if (ORTE_FLAG_TEST(jdata, ORTE_JOB_FLAG_RESTART)) {
> > (gdb) s
> > 881 ORTE_ACTIVATE_JOB_STATE(jdata, ORTE_JOB_STATE_INIT);
> > (gdb) s
> > orte_job_state_to_str (state=1)
> > at ../../openmpi-dev-124-g91e9686/orte/util/error_strings.c:217
> > 217 switch(state) {
> > (gdb)
> > 221 return "PENDING INIT";
> > (gdb)
> > 317 }
> > (gdb)
> > orte_util_print_jobids (job=4294967295)
> > at ../../openmpi-dev-124-g91e9686/orte/util/name_fns.c:170
> > 170 ptr = get_print_name_buffer();
> > (gdb)
> >
> >
> >
> > On Solaris things are different.
> >
> > Breakpoint 1, rsh_launch (jdata=0x100125250)
> > at
../../../../../openmpi-dev-124-g91e9686/orte/mca/plm/rsh/plm_rsh_module.c:876
> > 876 if (ORTE_FLAG_TEST(jdata, ORTE_JOB_FLAG_RESTART)) {
> > (gdb) s
> > 881 ORTE_ACTIVATE_JOB_STATE(jdata, ORTE_JOB_STATE_INIT);
> > (gdb) s
> > orte_util_print_name_args (name=0x100118380 <orte_process_info+104>)
> > at ../../openmpi-dev-124-g91e9686/orte/util/name_fns.c:122
> > 122 if (NULL == name) {
> > (gdb)
> > 142 job = orte_util_print_jobids(name->jobid);
> > (gdb)
> > orte_util_print_jobids (job=2673410048)
> > at ../../openmpi-dev-124-g91e9686/orte/util/name_fns.c:170
> > 170 ptr = get_print_name_buffer();
> > (gdb)
> >
> >
> >
> > Is this normal or is it the reason for the crash on Solaris?
> >
> >
> > Kind regards
> >
> > Siegmar
> >
> >
> >
> >
> >
> >
> >
> > > The log file output by JRE may help you.
> > > > # An error report file with more information is saved as:
> > > > #
/home/fd1026/work/skripte/master/parallel/prog/mpi/java/hs_err_pid13080.log
> > >
> > > Regards,
> > > Takahiro
> > >
> > > > Hi,
> > > >
> > > > I installed openmpi-dev-124-g91e9686 on Solaris 10 Sparc with
> > > > gcc-4.9.1 to track down the error with my small Java program.
> > > > I started single stepping in orterun.c at line 1081 and
> > > > continued until I got the segmentation fault. I get
> > > > "jdata = 0x0" in version openmpi-1.8.2a1r31804, which is the
> > > > last one which works with Java in my environment, while I get
> > > > "jdata = 0x100125250" in this version. Unfortunately I don't
> > > > know which files or variables are important to look at. Perhaps
> > > > somebody can look at the following lines of code and tell me,
> > > > which information I should provide to solve the problem. I know
> > > > that Solaris isn't any longer on your list of supported systems,
> > > > but perhaps we can get it working again, if you tell me what
> > > > you need and I do the debugging.
> > > >
> > > > /usr/local/gdb-7.6.1_64_gcc/bin/gdb mpiexec
> > > > GNU gdb (GDB) 7.6.1
> > > > ...
> > > > (gdb) run -np 1 java InitFinalizeMain
> > > > Starting program: /usr/local/openmpi-1.9.0_64_gcc/bin/mpiexec \
> > > > -np 1 java InitFinalizeMain
> > > > [Thread debugging using libthread_db enabled]
> > > > [New Thread 1 (LWP 1)]
> > > > [New LWP 2 ]
> > > > #
> > > > # A fatal error has been detected by the Java Runtime Environment:
> > > > #
> > > > # SIGSEGV (0xb) at pc=0xffffffff7ea3c7f0, pid=13064, tid=2
> > > > ...
> > > > [LWP 2 exited]
> > > > [New Thread 2 ]
> > > > [Switching to Thread 1 (LWP 1)]
> > > > sol_thread_fetch_registers: td_ta_map_id2thr: no thread can be
> > > > found to satisfy query
> > > > (gdb) thread 1
> > > > [Switching to thread 1 (LWP 1 )]
> > > > #0 0xffffffff7f6173d0 in rtld_db_dlactivity () from
/usr/lib/sparcv9/ld.so.1
> > > > (gdb) b orterun.c:1081
> > > > Breakpoint 1 at 0x1000070dc: file
> > > > ../../../../openmpi-dev-124-g91e9686/orte/tools/orterun/orterun.c, line
1081.
> > > > (gdb) r
> > > > The program being debugged has been started already.
> > > > Start it from the beginning? (y or n) y
> > > >
> > > > Starting program: /usr/local/openmpi-1.9.0_64_gcc/bin/mpiexec -np 1
> > > > java
> > > > InitFinalizeMain
> > > > [Thread debugging using libthread_db enabled]
> > > > [New Thread 1 (LWP 1)]
> > > > [New LWP 2 ]
> > > > [Switching to Thread 1 (LWP 1)]
> > > >
> > > > Breakpoint 1, orterun (argc=5, argv=0xffffffff7fffe0d8)
> > > > at
../../../../openmpi-dev-124-g91e9686/orte/tools/orterun/orterun.c:1081
> > > > 1081 rc = orte_plm.spawn(jdata);
> > > > (gdb) print jdata
> > > > $1 = (orte_job_t *) 0x100125250
> > > > (gdb) s
> > > > rsh_launch (jdata=0x100125250)
> > > > at
> > > >
../../../../../openmpi-dev-124-g91e9686/orte/mca/plm/rsh/plm_rsh_module.c:876
> > > > 876 if (ORTE_FLAG_TEST(jdata, ORTE_JOB_FLAG_RESTART)) {
> > > > (gdb) s
> > > > 881 ORTE_ACTIVATE_JOB_STATE(jdata, ORTE_JOB_STATE_INIT);
> > > > (gdb)
> > > > orte_util_print_name_args (name=0x100118380 <orte_process_info+104>)
> > > > at ../../openmpi-dev-124-g91e9686/orte/util/name_fns.c:122
> > > > 122 if (NULL == name) {
> > > > (gdb)
> > > > 142 job = orte_util_print_jobids(name->jobid);
> > > > (gdb)
> > > > orte_util_print_jobids (job=2502885376) at
> > > > ../../openmpi-dev-124-g91e9686/orte/util/name_fns.c:170
> > > > 170 ptr = get_print_name_buffer();
> > > > (gdb)
> > > > get_print_name_buffer () at
> > > > ../../openmpi-dev-124-g91e9686/orte/util/name_fns.c:92
> > > > 92 if (!fns_init) {
> > > > (gdb)
> > > > 101 ret = opal_tsd_getspecific(print_args_tsd_key,
(void**)&ptr);
> > > > (gdb)
> > > > opal_tsd_getspecific (key=1, valuep=0xffffffff7fffd990)
> > > > at ../../openmpi-dev-124-g91e9686/opal/threads/tsd.h:163
> > > > 163 *valuep = pthread_getspecific(key);
> > > > (gdb)
> > > > 164 return OPAL_SUCCESS;
> > > > (gdb)
> > > > 165 }
> > > > (gdb)
> > > > get_print_name_buffer () at
> > > > ../../openmpi-dev-124-g91e9686/orte/util/name_fns.c:102
> > > > 102 if (OPAL_SUCCESS != ret) return NULL;
> > > > (gdb)
> > > > 104 if (NULL == ptr) {
> > > > (gdb)
> > > > 113 return (orte_print_args_buffers_t*) ptr;
> > > > (gdb)
> > > > 114 }
> > > > (gdb)
> > > > orte_util_print_jobids (job=2502885376) at
> > > > ../../openmpi-dev-124-g91e9686/orte/util/name_fns.c:172
> > > > 172 if (NULL == ptr) {
> > > > (gdb)
> > > > 178 if (ORTE_PRINT_NAME_ARG_NUM_BUFS == ptr->cntr) {
> > > > (gdb)
> > > > 182 if (ORTE_JOBID_INVALID == job) {
> > > > (gdb)
> > > > 184 } else if (ORTE_JOBID_WILDCARD == job) {
> > > > (gdb)
> > > > 187 tmp1 = ORTE_JOB_FAMILY((unsigned long)job);
> > > > (gdb)
> > > > 188 tmp2 = ORTE_LOCAL_JOBID((unsigned long)job);
> > > > (gdb)
> > > > 189 snprintf(ptr->buffers[ptr->cntr++],
> > > > (gdb)
> > > > 193 return ptr->buffers[ptr->cntr-1];
> > > > (gdb)
> > > > 194 }
> > > > (gdb)
> > > > orte_util_print_name_args (name=0x100118380 <orte_process_info+104>)
> > > > at ../../openmpi-dev-124-g91e9686/orte/util/name_fns.c:143
> > > > 143 vpid = orte_util_print_vpids(name->vpid);
> > > > (gdb)
> > > > orte_util_print_vpids (vpid=0) at
> > > > ../../openmpi-dev-124-g91e9686/orte/util/name_fns.c:260
> > > > 260 ptr = get_print_name_buffer();
> > > > (gdb)
> > > > get_print_name_buffer () at
> > > > ../../openmpi-dev-124-g91e9686/orte/util/name_fns.c:92
> > > > 92 if (!fns_init) {
> > > > (gdb)
> > > > 101 ret = opal_tsd_getspecific(print_args_tsd_key,
(void**)&ptr);
> > > > (gdb)
> > > > opal_tsd_getspecific (key=1, valuep=0xffffffff7fffd9a0)
> > > > at ../../openmpi-dev-124-g91e9686/opal/threads/tsd.h:163
> > > > 163 *valuep = pthread_getspecific(key);
> > > > (gdb)
> > > > 164 return OPAL_SUCCESS;
> > > > (gdb)
> > > > 165 }
> > > > (gdb)
> > > > get_print_name_buffer () at
> > > > ../../openmpi-dev-124-g91e9686/orte/util/name_fns.c:102
> > > > 102 if (OPAL_SUCCESS != ret) return NULL;
> > > > (gdb)
> > > > 104 if (NULL == ptr) {
> > > > (gdb)
> > > > 113 return (orte_print_args_buffers_t*) ptr;
> > > > (gdb)
> > > > 114 }
> > > > (gdb)
> > > > orte_util_print_vpids (vpid=0) at
> > > > ../../openmpi-dev-124-g91e9686/orte/util/name_fns.c:262
> > > > 262 if (NULL == ptr) {
> > > > (gdb)
> > > > 268 if (ORTE_PRINT_NAME_ARG_NUM_BUFS == ptr->cntr) {
> > > > (gdb)
> > > > 272 if (ORTE_VPID_INVALID == vpid) {
> > > > (gdb)
> > > > 274 } else if (ORTE_VPID_WILDCARD == vpid) {
> > > > (gdb)
> > > > 277 snprintf(ptr->buffers[ptr->cntr++],
> > > > (gdb)
> > > > 281 return ptr->buffers[ptr->cntr-1];
> > > > (gdb)
> > > > 282 }
> > > > (gdb)
> > > > orte_util_print_name_args (name=0x100118380 <orte_process_info+104>)
> > > > at ../../openmpi-dev-124-g91e9686/orte/util/name_fns.c:146
> > > > 146 ptr = get_print_name_buffer();
> > > > (gdb)
> > > > get_print_name_buffer () at
> > > > ../../openmpi-dev-124-g91e9686/orte/util/name_fns.c:92
> > > > 92 if (!fns_init) {
> > > > (gdb)
> > > > 101 ret = opal_tsd_getspecific(print_args_tsd_key,
(void**)&ptr);
> > > > (gdb)
> > > > opal_tsd_getspecific (key=1, valuep=0xffffffff7fffda60)
> > > > at ../../openmpi-dev-124-g91e9686/opal/threads/tsd.h:163
> > > > 163 *valuep = pthread_getspecific(key);
> > > > (gdb)
> > > > 164 return OPAL_SUCCESS;
> > > > (gdb)
> > > > 165 }
> > > > (gdb)
> > > > get_print_name_buffer () at
> > > > ../../openmpi-dev-124-g91e9686/orte/util/name_fns.c:102
> > > > 102 if (OPAL_SUCCESS != ret) return NULL;
> > > > (gdb)
> > > > 104 if (NULL == ptr) {
> > > > (gdb)
> > > > 113 return (orte_print_args_buffers_t*) ptr;
> > > > (gdb)
> > > > 114 }
> > > > (gdb)
> > > > orte_util_print_name_args (name=0x100118380 <orte_process_info+104>)
> > > > at ../../openmpi-dev-124-g91e9686/orte/util/name_fns.c:148
> > > > 148 if (NULL == ptr) {
> > > > (gdb)
> > > > 154 if (ORTE_PRINT_NAME_ARG_NUM_BUFS == ptr->cntr) {
> > > > (gdb)
> > > > 158 snprintf(ptr->buffers[ptr->cntr++],
> > > > (gdb)
> > > > 162 return ptr->buffers[ptr->cntr-1];
> > > > (gdb)
> > > > 163 }
> > > > (gdb)
> > > > orte_util_print_jobids (job=4294967295) at
> > > > ../../openmpi-dev-124-g91e9686/orte/util/name_fns.c:170
> > > > 170 ptr = get_print_name_buffer();
> > > > (gdb)
> > > > get_print_name_buffer () at
> > > > ../../openmpi-dev-124-g91e9686/orte/util/name_fns.c:92
> > > > 92 if (!fns_init) {
> > > > (gdb)
> > > > 101 ret = opal_tsd_getspecific(print_args_tsd_key,
(void**)&ptr);
> > > > (gdb)
> > > > opal_tsd_getspecific (key=1, valuep=0xffffffff7fffda60)
> > > > at ../../openmpi-dev-124-g91e9686/opal/threads/tsd.h:163
> > > > 163 *valuep = pthread_getspecific(key);
> > > > (gdb)
> > > > 164 return OPAL_SUCCESS;
> > > > (gdb)
> > > > 165 }
> > > > (gdb)
> > > > get_print_name_buffer () at
> > > > ../../openmpi-dev-124-g91e9686/orte/util/name_fns.c:102
> > > > 102 if (OPAL_SUCCESS != ret) return NULL;
> > > > (gdb)
> > > > 104 if (NULL == ptr) {
> > > > (gdb)
> > > > 113 return (orte_print_args_buffers_t*) ptr;
> > > > (gdb)
> > > > 114 }
> > > > (gdb)
> > > > orte_util_print_jobids (job=4294967295) at
> > > > ../../openmpi-dev-124-g91e9686/orte/util/name_fns.c:172
> > > > 172 if (NULL == ptr) {
> > > > (gdb)
> > > > 178 if (ORTE_PRINT_NAME_ARG_NUM_BUFS == ptr->cntr) {
> > > > (gdb)
> > > > 182 if (ORTE_JOBID_INVALID == job) {
> > > > (gdb)
> > > > 183 snprintf(ptr->buffers[ptr->cntr++],
> > > > ORTE_PRINT_NAME_ARGS_MAX_SIZE, "[INVALID]");
> > > > (gdb)
> > > > 193 return ptr->buffers[ptr->cntr-1];
> > > > (gdb)
> > > > 194 }
> > > > (gdb)
> > > > orte_job_state_to_str (state=1) at
> > > > ../../openmpi-dev-124-g91e9686/orte/util/error_strings.c:217
> > > > 217 switch(state) {
> > > > (gdb)
> > > > 221 return "PENDING INIT";
> > > > (gdb)
> > > > 317 }
> > > > (gdb)
> > > > opal_output_verbose (level=1, output_id=0,
> > > > format=0xffffffff7f14dd98 <orte_job_states>
> > > > "\336\257\276\355\336\257\276\355")
> > > > at ../../../openmpi-dev-124-g91e9686/opal/util/output.c:373
> > > > 373 va_start(arglist, format);
> > > > (gdb)
> > > > 369 {
> > > > (gdb)
> > > > 370 if (output_id >= 0 && output_id < OPAL_OUTPUT_MAX_STREAMS &&
> > > > (gdb)
> > > > 377 }
> > > > (gdb)
> > > > orte_state_base_activate_job_state (jdata=0x100125250, state=1)
> > > > at
> > > >
../../../../openmpi-dev-124-g91e9686/orte/mca/state/base/state_base_fns.c:33
> > > > 33 opal_list_item_t *itm, *any=NULL, *error=NULL;
> > > > (gdb)
> > > > 37 for (itm = opal_list_get_first(&orte_job_states);
> > > > (gdb)
> > > > opal_list_get_first (list=0xffffffff7f14dd98 <orte_job_states>)
> > > > at ../../../../openmpi-dev-124-g91e9686/opal/class/opal_list.h:320
> > > > 320 opal_list_item_t* item =
> > > > (opal_list_item_t*)list->opal_list_sentinel.opal_list_next;
> > > > (gdb)
> > > > 324 assert(1 == item->opal_list_item_refcount);
> > > > (gdb)
> > > > 325 assert( list == item->opal_list_item_belong_to );
> > > > (gdb)
> > > > 328 return item;
> > > > (gdb)
> > > > 329 }
> > > > (gdb)
> > > > orte_state_base_activate_job_state (jdata=0x100125250, state=1)
> > > > at
> > > >
../../../../openmpi-dev-124-g91e9686/orte/mca/state/base/state_base_fns.c:38
> > > > 38 itm != opal_list_get_end(&orte_job_states);
> > > > (gdb)
> > > > opal_list_get_end (list=0xffffffff7f14dd98 <orte_job_states>)
> > > > at ../../../../openmpi-dev-124-g91e9686/opal/class/opal_list.h:399
> > > > 399 return &(list->opal_list_sentinel);
> > > > (gdb)
> > > > 400 }
> > > > (gdb)
> > > > orte_state_base_activate_job_state (jdata=0x100125250, state=1)
> > > > at
> > > >
../../../../openmpi-dev-124-g91e9686/orte/mca/state/base/state_base_fns.c:37
> > > > 37 for (itm = opal_list_get_first(&orte_job_states);
> > > > (gdb)
> > > > 40 s = (orte_state_t*)itm;
> > > > (gdb)
> > > > 41 if (s->job_state == ORTE_JOB_STATE_ANY) {
> > > > (gdb)
> > > > 45 if (s->job_state == ORTE_JOB_STATE_ERROR) {
> > > > (gdb)
> > > > 48 if (s->job_state == state) {
> > > > (gdb)
> > > > 49 OPAL_OUTPUT_VERBOSE((1,
> > > > orte_state_base_framework.framework_output,
> > > > (gdb)
> > > > orte_util_print_name_args (name=0x100118380 <orte_process_info+104>)
> > > > at ../../openmpi-dev-124-g91e9686/orte/util/name_fns.c:122
> > > > 122 if (NULL == name) {
> > > > (gdb)
> > > > 142 job = orte_util_print_jobids(name->jobid);
> > > > (gdb)
> > > > orte_util_print_jobids (job=2502885376) at
> > > > ../../openmpi-dev-124-g91e9686/orte/util/name_fns.c:170
> > > > 170 ptr = get_print_name_buffer();
> > > > (gdb)
> > > > get_print_name_buffer () at
> > > > ../../openmpi-dev-124-g91e9686/orte/util/name_fns.c:92
> > > > 92 if (!fns_init) {
> > > > (gdb)
> > > > 101 ret = opal_tsd_getspecific(print_args_tsd_key,
(void**)&ptr);
> > > > (gdb)
> > > > opal_tsd_getspecific (key=1, valuep=0xffffffff7fffd880)
> > > > at ../../openmpi-dev-124-g91e9686/opal/threads/tsd.h:163
> > > > 163 *valuep = pthread_getspecific(key);
> > > > (gdb)
> > > > 164 return OPAL_SUCCESS;
> > > > (gdb)
> > > > 165 }
> > > > (gdb)
> > > > get_print_name_buffer () at
> > > > ../../openmpi-dev-124-g91e9686/orte/util/name_fns.c:102
> > > > 102 if (OPAL_SUCCESS != ret) return NULL;
> > > > (gdb)
> > > > 104 if (NULL == ptr) {
> > > > (gdb)
> > > > 113 return (orte_print_args_buffers_t*) ptr;
> > > > (gdb)
> > > > 114 }
> > > > (gdb)
> > > > orte_util_print_jobids (job=2502885376) at
> > > > ../../openmpi-dev-124-g91e9686/orte/util/name_fns.c:172
> > > > 172 if (NULL == ptr) {
> > > > (gdb)
> > > > 178 if (ORTE_PRINT_NAME_ARG_NUM_BUFS == ptr->cntr) {
> > > > (gdb)
> > > > 182 if (ORTE_JOBID_INVALID == job) {
> > > > (gdb)
> > > > 184 } else if (ORTE_JOBID_WILDCARD == job) {
> > > > (gdb)
> > > > 187 tmp1 = ORTE_JOB_FAMILY((unsigned long)job);
> > > > (gdb)
> > > > 188 tmp2 = ORTE_LOCAL_JOBID((unsigned long)job);
> > > > (gdb)
> > > > 189 snprintf(ptr->buffers[ptr->cntr++],
> > > > (gdb)
> > > > 193 return ptr->buffers[ptr->cntr-1];
> > > > (gdb)
> > > > 194 }
> > > > (gdb)
> > > > orte_util_print_name_args (name=0x100118380 <orte_process_info+104>)
> > > > at ../../openmpi-dev-124-g91e9686/orte/util/name_fns.c:143
> > > > 143 vpid = orte_util_print_vpids(name->vpid);
> > > > (gdb)
> > > > orte_util_print_vpids (vpid=0) at
> > > > ../../openmpi-dev-124-g91e9686/orte/util/name_fns.c:260
> > > > 260 ptr = get_print_name_buffer();
> > > > (gdb)
> > > > get_print_name_buffer () at
> > > > ../../openmpi-dev-124-g91e9686/orte/util/name_fns.c:92
> > > > 92 if (!fns_init) {
> > > > (gdb)
> > > > 101 ret = opal_tsd_getspecific(print_args_tsd_key,
(void**)&ptr);
> > > > (gdb)
> > > > opal_tsd_getspecific (key=1, valuep=0xffffffff7fffd890)
> > > > at ../../openmpi-dev-124-g91e9686/opal/threads/tsd.h:163
> > > > 163 *valuep = pthread_getspecific(key);
> > > > (gdb)
> > > > 164 return OPAL_SUCCESS;
> > > > (gdb)
> > > > 165 }
> > > > (gdb)
> > > > get_print_name_buffer () at
> > > > ../../openmpi-dev-124-g91e9686/orte/util/name_fns.c:102
> > > > 102 if (OPAL_SUCCESS != ret) return NULL;
> > > > (gdb)
> > > > 104 if (NULL == ptr) {
> > > > (gdb)
> > > > 113 return (orte_print_args_buffers_t*) ptr;
> > > > (gdb)
> > > > 114 }
> > > > (gdb)
> > > > orte_util_print_vpids (vpid=0) at
> > > > ../../openmpi-dev-124-g91e9686/orte/util/name_fns.c:262
> > > > 262 if (NULL == ptr) {
> > > > (gdb)
> > > > 268 if (ORTE_PRINT_NAME_ARG_NUM_BUFS == ptr->cntr) {
> > > > (gdb)
> > > > 272 if (ORTE_VPID_INVALID == vpid) {
> > > > (gdb)
> > > > 274 } else if (ORTE_VPID_WILDCARD == vpid) {
> > > > (gdb)
> > > > 277 snprintf(ptr->buffers[ptr->cntr++],
> > > > (gdb)
> > > > 281 return ptr->buffers[ptr->cntr-1];
> > > > (gdb)
> > > > 282 }
> > > > (gdb)
> > > > orte_util_print_name_args (name=0x100118380 <orte_process_info+104>)
> > > > at ../../openmpi-dev-124-g91e9686/orte/util/name_fns.c:146
> > > > 146 ptr = get_print_name_buffer();
> > > > (gdb)
> > > > get_print_name_buffer () at
> > > > ../../openmpi-dev-124-g91e9686/orte/util/name_fns.c:92
> > > > 92 if (!fns_init) {
> > > > (gdb)
> > > > 101 ret = opal_tsd_getspecific(print_args_tsd_key,
(void**)&ptr);
> > > > (gdb)
> > > > opal_tsd_getspecific (key=1, valuep=0xffffffff7fffd950)
> > > > at ../../openmpi-dev-124-g91e9686/opal/threads/tsd.h:163
> > > > 163 *valuep = pthread_getspecific(key);
> > > > (gdb)
> > > > 164 return OPAL_SUCCESS;
> > > > (gdb)
> > > > 165 }
> > > > (gdb)
> > > > get_print_name_buffer () at
> > > > ../../openmpi-dev-124-g91e9686/orte/util/name_fns.c:102
> > > > 102 if (OPAL_SUCCESS != ret) return NULL;
> > > > (gdb)
> > > > 104 if (NULL == ptr) {
> > > > (gdb)
> > > > 113 return (orte_print_args_buffers_t*) ptr;
> > > > (gdb)
> > > > 114 }
> > > > (gdb)
> > > > orte_util_print_name_args (name=0x100118380 <orte_process_info+104>)
> > > > at ../../openmpi-dev-124-g91e9686/orte/util/name_fns.c:148
> > > > 148 if (NULL == ptr) {
> > > > (gdb)
> > > > 154 if (ORTE_PRINT_NAME_ARG_NUM_BUFS == ptr->cntr) {
> > > > (gdb)
> > > > 158 snprintf(ptr->buffers[ptr->cntr++],
> > > > (gdb)
> > > > 162 return ptr->buffers[ptr->cntr-1];
> > > > (gdb)
> > > > 163 }
> > > > (gdb)
> > > > orte_util_print_jobids (job=4294967295) at
> > > > ../../openmpi-dev-124-g91e9686/orte/util/name_fns.c:170
> > > > 170 ptr = get_print_name_buffer();
> > > > (gdb)
> > > > get_print_name_buffer () at
> > > > ../../openmpi-dev-124-g91e9686/orte/util/name_fns.c:92
> > > > 92 if (!fns_init) {
> > > > (gdb)
> > > > 101 ret = opal_tsd_getspecific(print_args_tsd_key,
(void**)&ptr);
> > > > (gdb)
> > > > opal_tsd_getspecific (key=1, valuep=0xffffffff7fffd950)
> > > > at ../../openmpi-dev-124-g91e9686/opal/threads/tsd.h:163
> > > > 163 *valuep = pthread_getspecific(key);
> > > > (gdb)
> > > > 164 return OPAL_SUCCESS;
> > > > (gdb)
> > > > 165 }
> > > > (gdb)
> > > > get_print_name_buffer () at
> > > > ../../openmpi-dev-124-g91e9686/orte/util/name_fns.c:102
> > > > 102 if (OPAL_SUCCESS != ret) return NULL;
> > > > (gdb)
> > > > 104 if (NULL == ptr) {
> > > > (gdb)
> > > > 113 return (orte_print_args_buffers_t*) ptr;
> > > > (gdb)
> > > > 114 }
> > > > (gdb)
> > > > orte_util_print_jobids (job=4294967295) at
> > > > ../../openmpi-dev-124-g91e9686/orte/util/name_fns.c:172
> > > > 172 if (NULL == ptr) {
> > > > (gdb)
> > > > 178 if (ORTE_PRINT_NAME_ARG_NUM_BUFS == ptr->cntr) {
> > > > (gdb)
> > > > 182 if (ORTE_JOBID_INVALID == job) {
> > > > (gdb)
> > > > 183 snprintf(ptr->buffers[ptr->cntr++],
> > > > ORTE_PRINT_NAME_ARGS_MAX_SIZE, "[INVALID]");
> > > > (gdb)
> > > > 193 return ptr->buffers[ptr->cntr-1];
> > > > (gdb)
> > > > 194 }
> > > > (gdb)
> > > > orte_job_state_to_str (state=1) at
> > > > ../../openmpi-dev-124-g91e9686/orte/util/error_strings.c:217
> > > > 217 switch(state) {
> > > > (gdb)
> > > > 221 return "PENDING INIT";
> > > > (gdb)
> > > > 317 }
> > > > (gdb)
> > > > opal_output_verbose (level=1, output_id=-1, format=0x1 <Address 0x1 out
of
> > > > bounds>)
> > > > at ../../../openmpi-dev-124-g91e9686/opal/util/output.c:373
> > > > 373 va_start(arglist, format);
> > > > (gdb)
> > > > 369 {
> > > > (gdb)
> > > > 370 if (output_id >= 0 && output_id < OPAL_OUTPUT_MAX_STREAMS &&
> > > > (gdb)
> > > > 377 }
> > > > (gdb)
> > > > orte_state_base_activate_job_state (jdata=0x100125250, state=1)
> > > > at
> > > >
../../../../openmpi-dev-124-g91e9686/orte/mca/state/base/state_base_fns.c:54
> > > > 54 if (NULL == s->cbfunc) {
> > > > (gdb)
> > > > 62 caddy = OBJ_NEW(orte_state_caddy_t);
> > > > (gdb)
> > > > opal_obj_new_debug (type=0xffffffff7f14c7d8 <orte_state_caddy_t_class>,
> > > > file=0xffffffff7f034c08
> > > >
"../../../../openmpi-dev-124-g91e9686/orte/mca/state/base/state_base_fns.c",
> > > > line=62) at
../../../../openmpi-dev-124-g91e9686/opal/class/opal_object.h:249
> > > > 249 opal_object_t* object = opal_obj_new(type);
> > > > (gdb)
> > > > opal_obj_new (cls=0xffffffff7f14c7d8 <orte_state_caddy_t_class>)
> > > > at ../../../../openmpi-dev-124-g91e9686/opal/class/opal_object.h:465
> > > > 465 assert(cls->cls_sizeof >= sizeof(opal_object_t));
> > > > (gdb)
> > > > 470 object = (opal_object_t *) malloc(cls->cls_sizeof);
> > > > (gdb)
> > > > 472 if (0 == cls->cls_initialized) {
> > > > (gdb)
> > > > 473 opal_class_initialize(cls);
> > > > (gdb)
> > > > opal_class_initialize (cls=0xffffffff7f14c7d8
<orte_state_caddy_t_class>)
> > > > at ../../openmpi-dev-124-g91e9686/opal/class/opal_object.c:79
> > > > 79 assert(cls);
> > > > (gdb)
> > > > 84 if (1 == cls->cls_initialized) {
> > > > (gdb)
> > > > 87 opal_atomic_lock(&class_lock);
> > > > (gdb)
> > > > opal_atomic_lock (lock=0xffffffff7ee89bf0 <class_lock>)
> > > > at
../../openmpi-dev-124-g91e9686/opal/include/opal/sys/atomic_impl.h:397
> > > > 397 while( !opal_atomic_cmpset_acq_32( &(lock->u.lock),
> > > > (gdb)
> > > > opal_atomic_cmpset_acq_32 (addr=0xffffffff7ee89bf0 <class_lock>,
oldval=0,
> > > > newval=1)
> > > > at
../../openmpi-dev-124-g91e9686/opal/include/opal/sys/sparcv9/atomic.h:107
> > > > 107 rc = opal_atomic_cmpset_32(addr, oldval, newval);
> > > > (gdb)
> > > > opal_atomic_cmpset_32 (addr=0xffffffff7ee89bf0 <class_lock>, oldval=0,
newval=1)
> > > > at
../../openmpi-dev-124-g91e9686/opal/include/opal/sys/sparcv9/atomic.h:93
> > > > 93 int32_t ret = newval;
> > > > (gdb)
> > > > 95 __asm__ __volatile__("casa [%1] " ASI_P ", %2, %0"
> > > > (gdb)
> > > > 98 return (ret == oldval);
> > > > (gdb)
> > > > 99 }
> > > > (gdb)
> > > > opal_atomic_cmpset_acq_32 (addr=0xffffffff7ee89bf0 <class_lock>,
oldval=0,
> > > > newval=1)
> > > > at
../../openmpi-dev-124-g91e9686/opal/include/opal/sys/sparcv9/atomic.h:108
> > > > 108 opal_atomic_rmb();
> > > > (gdb)
> > > > opal_atomic_rmb () at
> > > > ../../openmpi-dev-124-g91e9686/opal/include/opal/sys/sparcv9/atomic.h:63
> > > > 63 MEMBAR("#LoadLoad");
> > > > (gdb)
> > > > 64 }
> > > > (gdb)
> > > > opal_atomic_cmpset_acq_32 (addr=0xffffffff7ee89bf0 <class_lock>,
oldval=0,
> > > > newval=1)
> > > > at
../../openmpi-dev-124-g91e9686/opal/include/opal/sys/sparcv9/atomic.h:110
> > > > 110 return rc;
> > > > (gdb)
> > > > 111 }
> > > > (gdb)
> > > > opal_atomic_lock (lock=0xffffffff7ee89bf0 <class_lock>)
> > > > at
../../openmpi-dev-124-g91e9686/opal/include/opal/sys/atomic_impl.h:403
> > > > 403 }
> > > > (gdb)
> > > > opal_class_initialize (cls=0xffffffff7f14c7d8
<orte_state_caddy_t_class>)
> > > > at ../../openmpi-dev-124-g91e9686/opal/class/opal_object.c:93
> > > > 93 if (1 == cls->cls_initialized) {
> > > > (gdb)
> > > > 103 cls->cls_depth = 0;
> > > > (gdb)
> > > > 104 cls_construct_array_count = 0;
> > > > (gdb)
> > > > 105 cls_destruct_array_count = 0;
> > > > (gdb)
> > > > 106 for (c = cls; c; c = c->cls_parent) {
> > > > (gdb)
> > > > 107 if( NULL != c->cls_construct ) {
> > > > (gdb)
> > > > 108 cls_construct_array_count++;
> > > > (gdb)
> > > > 110 if( NULL != c->cls_destruct ) {
> > > > (gdb)
> > > > 111 cls_destruct_array_count++;
> > > > (gdb)
> > > > 113 cls->cls_depth++;
> > > > (gdb)
> > > > 106 for (c = cls; c; c = c->cls_parent) {
> > > > (gdb)
> > > > 107 if( NULL != c->cls_construct ) {
> > > > (gdb)
> > > > 110 if( NULL != c->cls_destruct ) {
> > > > (gdb)
> > > > 113 cls->cls_depth++;
> > > > (gdb)
> > > > 106 for (c = cls; c; c = c->cls_parent) {
> > > > (gdb)
> > > > 122 (void
(**)(opal_object_t*))malloc((cls_construct_array_count +
> > > > (gdb)
> > > > 123
cls_destruct_array_count + 2)
> > > > *
> > > > (gdb)
> > > > 122 (void
(**)(opal_object_t*))malloc((cls_construct_array_count +
> > > > (gdb)
> > > > 121 cls->cls_construct_array =
> > > > (gdb)
> > > > 125 if (NULL == cls->cls_construct_array) {
> > > > (gdb)
> > > > 130 cls->cls_construct_array + cls_construct_array_count +
1;
> > > > (gdb)
> > > > 129 cls->cls_destruct_array =
> > > > (gdb)
> > > > 136 cls_construct_array = cls->cls_construct_array +
> > > > cls_construct_array_count;
> > > > (gdb)
> > > > 137 cls_destruct_array = cls->cls_destruct_array;
> > > > (gdb)
> > > > 139 c = cls;
> > > > (gdb)
> > > > 140 *cls_construct_array = NULL; /* end marker for the
constructors */
> > > > (gdb)
> > > > 141 for (i = 0; i < cls->cls_depth; i++) {
> > > > (gdb)
> > > > 142 if( NULL != c->cls_construct ) {
> > > > (gdb)
> > > > 143 --cls_construct_array;
> > > > (gdb)
> > > > 144 *cls_construct_array = c->cls_construct;
> > > > (gdb)
> > > > 146 if( NULL != c->cls_destruct ) {
> > > > (gdb)
> > > > 147 *cls_destruct_array = c->cls_destruct;
> > > > (gdb)
> > > > 148 cls_destruct_array++;
> > > > (gdb)
> > > > 150 c = c->cls_parent;
> > > > (gdb)
> > > > 141 for (i = 0; i < cls->cls_depth; i++) {
> > > > (gdb)
> > > > 142 if( NULL != c->cls_construct ) {
> > > > (gdb)
> > > > 146 if( NULL != c->cls_destruct ) {
> > > > (gdb)
> > > > 150 c = c->cls_parent;
> > > > (gdb)
> > > > 141 for (i = 0; i < cls->cls_depth; i++) {
> > > > (gdb)
> > > > 152 *cls_destruct_array = NULL; /* end marker for the
destructors */
> > > > (gdb)
> > > > 154 cls->cls_initialized = 1;
> > > > (gdb)
> > > > 155 save_class(cls);
> > > > (gdb)
> > > > save_class (cls=0xffffffff7f14c7d8 <orte_state_caddy_t_class>)
> > > > at ../../openmpi-dev-124-g91e9686/opal/class/opal_object.c:188
> > > > 188 if (num_classes >= max_classes) {
> > > > (gdb)
> > > > 189 expand_array();
> > > > (gdb)
> > > > expand_array () at
../../openmpi-dev-124-g91e9686/opal/class/opal_object.c:201
> > > > 201 max_classes += increment;
> > > > (gdb)
> > > > 202 classes = (void**)realloc(classes, sizeof(opal_class_t*) *
> > > > max_classes);
> > > > (gdb)
> > > > 203 if (NULL == classes) {
> > > > (gdb)
> > > > 207 for (i = num_classes; i < max_classes; ++i) {
> > > > (gdb)
> > > > 208 classes[i] = NULL;
> > > > (gdb)
> > > > 207 for (i = num_classes; i < max_classes; ++i) {
> > > > (gdb)
> > > > 208 classes[i] = NULL;
> > > > (gdb)
> > > > 207 for (i = num_classes; i < max_classes; ++i) {
> > > > (gdb)
> > > > 208 classes[i] = NULL;
> > > > (gdb)
> > > > 207 for (i = num_classes; i < max_classes; ++i) {
> > > > (gdb)
> > > > 208 classes[i] = NULL;
> > > > (gdb)
> > > > 207 for (i = num_classes; i < max_classes; ++i) {
> > > > (gdb)
> > > > 208 classes[i] = NULL;
> > > > (gdb)
> > > > 207 for (i = num_classes; i < max_classes; ++i) {
> > > > (gdb)
> > > > 208 classes[i] = NULL;
> > > > (gdb)
> > > > 207 for (i = num_classes; i < max_classes; ++i) {
> > > > (gdb)
> > > > 208 classes[i] = NULL;
> > > > (gdb)
> > > > 207 for (i = num_classes; i < max_classes; ++i) {
> > > > (gdb)
> > > > 208 classes[i] = NULL;
> > > > (gdb)
> > > > 207 for (i = num_classes; i < max_classes; ++i) {
> > > > (gdb)
> > > > 208 classes[i] = NULL;
> > > > (gdb)
> > > > 207 for (i = num_classes; i < max_classes; ++i) {
> > > > (gdb)
> > > > 208 classes[i] = NULL;
> > > > (gdb)
> > > > 207 for (i = num_classes; i < max_classes; ++i) {
> > > > (gdb)
> > > > 210 }
> > > > (gdb)
> > > > save_class (cls=0xffffffff7f14c7d8 <orte_state_caddy_t_class>)
> > > > at ../../openmpi-dev-124-g91e9686/opal/class/opal_object.c:192
> > > > 192 classes[num_classes] = cls->cls_construct_array;
> > > > (gdb)
> > > > 193 ++num_classes;
> > > > (gdb)
> > > > 194 }
> > > > (gdb)
> > > > opal_class_initialize (cls=0xffffffff7f14c7d8
<orte_state_caddy_t_class>)
> > > > at ../../openmpi-dev-124-g91e9686/opal/class/opal_object.c:159
> > > > 159 opal_atomic_unlock(&class_lock);
> > > > (gdb)
> > > > opal_atomic_unlock (lock=0xffffffff7ee89bf0 <class_lock>)
> > > > at
../../openmpi-dev-124-g91e9686/opal/include/opal/sys/atomic_impl.h:409
> > > > 409 opal_atomic_wmb();
> > > > (gdb)
> > > > opal_atomic_wmb () at
> > > > ../../openmpi-dev-124-g91e9686/opal/include/opal/sys/sparcv9/atomic.h:69
> > > > 69 MEMBAR("#StoreStore");
> > > > (gdb)
> > > > 70 }
> > > > (gdb)
> > > > opal_atomic_unlock (lock=0xffffffff7ee89bf0 <class_lock>)
> > > > at
../../openmpi-dev-124-g91e9686/opal/include/opal/sys/atomic_impl.h:410
> > > > 410 lock->u.lock=OPAL_ATOMIC_UNLOCKED;
> > > > (gdb)
> > > > 411 }
> > > > (gdb)
> > > > opal_class_initialize (cls=0xffffffff7f14c7d8
<orte_state_caddy_t_class>)
> > > > at ../../openmpi-dev-124-g91e9686/opal/class/opal_object.c:160
> > > > 160 }
> > > > (gdb)
> > > > opal_obj_new (cls=0xffffffff7f14c7d8 <orte_state_caddy_t_class>)
> > > > at ../../../../openmpi-dev-124-g91e9686/opal/class/opal_object.h:475
> > > > 475 if (NULL != object) {
> > > > (gdb)
> > > > 476 object->obj_class = cls;
> > > > (gdb)
> > > > 477 object->obj_reference_count = 1;
> > > > (gdb)
> > > > 478 opal_obj_run_constructors(object);
> > > > (gdb)
> > > > opal_obj_run_constructors (object=0x1001bfcf0)
> > > > at ../../../../openmpi-dev-124-g91e9686/opal/class/opal_object.h:420
> > > > 420 assert(NULL != object->obj_class);
> > > > (gdb)
> > > > 422 cls_construct = object->obj_class->cls_construct_array;
> > > > (gdb)
> > > > 423 while( NULL != *cls_construct ) {
> > > > (gdb)
> > > > 424 (*cls_construct)(object);
> > > > (gdb)
> > > > orte_state_caddy_construct (caddy=0x1001bfcf0)
> > > > at
> > > >
../../../../openmpi-dev-124-g91e9686/orte/mca/state/base/state_base_frame.c:84
> > > > 84 memset(&caddy->ev, 0, sizeof(opal_event_t));
> > > > (gdb)
> > > > 85 caddy->jdata = NULL;
> > > > (gdb)
> > > > 86 }
> > > > (gdb)
> > > > opal_obj_run_constructors (object=0x1001bfcf0)
> > > > at ../../../../openmpi-dev-124-g91e9686/opal/class/opal_object.h:425
> > > > 425 cls_construct++;
> > > > (gdb)
> > > > 423 while( NULL != *cls_construct ) {
> > > > (gdb)
> > > > 427 }
> > > > (gdb)
> > > > opal_obj_new (cls=0xffffffff7f14c7d8 <orte_state_caddy_t_class>)
> > > > at ../../../../openmpi-dev-124-g91e9686/opal/class/opal_object.h:480
> > > > 480 return object;
> > > > (gdb)
> > > > 481 }
> > > > (gdb)
> > > > opal_obj_new_debug (type=0xffffffff7f14c7d8 <orte_state_caddy_t_class>,
> > > > file=0xffffffff7f034c08
> > > >
"../../../../openmpi-dev-124-g91e9686/orte/mca/state/base/state_base_fns.c",
> > > > line=62) at
../../../../openmpi-dev-124-g91e9686/opal/class/opal_object.h:250
> > > > 250 object->obj_magic_id = OPAL_OBJ_MAGIC_ID;
> > > > (gdb)
> > > > 251 object->cls_init_file_name = file;
> > > > (gdb)
> > > > 252 object->cls_init_lineno = line;
> > > > (gdb)
> > > > 253 return object;
> > > > (gdb)
> > > > 254 }
> > > > (gdb)
> > > > orte_state_base_activate_job_state (jdata=0x100125250, state=1)
> > > > at
> > > >
../../../../openmpi-dev-124-g91e9686/orte/mca/state/base/state_base_fns.c:63
> > > > 63 if (NULL != jdata) {
> > > > (gdb)
> > > > 64 caddy->jdata = jdata;
> > > > (gdb)
> > > > 65 caddy->job_state = state;
> > > > (gdb)
> > > > 66 OBJ_RETAIN(jdata);
> > > > (gdb)
> > > > opal_obj_update (inc=1, object=0x100125250)
> > > > at ../../../../openmpi-dev-124-g91e9686/opal/class/opal_object.h:497
> > > > 497 return opal_atomic_add_32(&(object->obj_reference_count),
inc);
> > > > (gdb)
> > > > opal_atomic_add_32 (addr=0x100125260, delta=1)
> > > > at
> > > >
../../../../openmpi-dev-124-g91e9686/opal/include/opal/sys/atomic_impl.h:63
> > > > 63 oldval = *addr;
> > > > (gdb)
> > > > 64 } while (0 == opal_atomic_cmpset_32(addr, oldval, oldval +
delta));
> > > > (gdb)
> > > > opal_atomic_cmpset_32 (addr=0x100125260, oldval=1, newval=2)
> > > > at
> > > >
../../../../openmpi-dev-124-g91e9686/opal/include/opal/sys/sparcv9/atomic.h:93
> > > > 93 int32_t ret = newval;
> > > > (gdb)
> > > > 95 __asm__ __volatile__("casa [%1] " ASI_P ", %2, %0"
> > > > (gdb)
> > > > 98 return (ret == oldval);
> > > > (gdb)
> > > > 99 }
> > > > (gdb)
> > > > opal_atomic_add_32 (addr=0x100125260, delta=1)
> > > > at
> > > >
../../../../openmpi-dev-124-g91e9686/opal/include/opal/sys/atomic_impl.h:65
> > > > 65 return (oldval + delta);
> > > > (gdb)
> > > > 66 }
> > > > (gdb)
> > > > orte_state_base_activate_job_state (jdata=0x100125250, state=1)
> > > > at
> > > >
../../../../openmpi-dev-124-g91e9686/orte/mca/state/base/state_base_fns.c:66
> > > > 66 OBJ_RETAIN(jdata);
> > > > (gdb)
> > > > 68 opal_event_set(orte_event_base, &caddy->ev, -1,
> > > > OPAL_EV_WRITE, s->cbfunc, caddy);
> > > > (gdb)
> > > > 69 opal_event_set_priority(&caddy->ev, s->priority);
> > > > (gdb)
> > > > 70 opal_event_active(&caddy->ev, OPAL_EV_WRITE, 1);
> > > > (gdb)
> > > > 71 return;
> > > > (gdb)
> > > > 105 }
> > > > (gdb)
> > > > rsh_launch (jdata=0x100125250)
> > > > at
> > > >
../../../../../openmpi-dev-124-g91e9686/orte/mca/plm/rsh/plm_rsh_module.c:883
> > > > 883 return ORTE_SUCCESS;
> > > > (gdb)
> > > > 884 }
> > > > (gdb)
> > > > orterun (argc=5, argv=0xffffffff7fffe0d8)
> > > > at
../../../../openmpi-dev-124-g91e9686/orte/tools/orterun/orterun.c:1084
> > > > 1084 while (orte_event_base_active) {
> > > > (gdb)
> > > > 1085 opal_event_loop(orte_event_base, OPAL_EVLOOP_ONCE);
> > > > (gdb)
> > > > 1084 while (orte_event_base_active) {
> > > > (gdb)
> > > > 1085 opal_event_loop(orte_event_base, OPAL_EVLOOP_ONCE);
> > > > (gdb)
> > > > 1084 while (orte_event_base_active) {
> > > > (gdb)
> > > > 1085 opal_event_loop(orte_event_base, OPAL_EVLOOP_ONCE);
> > > > (gdb)
> > > > #
> > > > # A fatal error has been detected by the Java Runtime Environment:
> > > > #
> > > > # SIGSEGV (0xb) at pc=0xffffffff7ea3c7f0, pid=13080, tid=2
> > > > #
> > > > # JRE version: Java(TM) SE Runtime Environment (8.0-b132) (build
1.8.0-b132)
> > > > # Java VM: Java HotSpot(TM) 64-Bit Server VM (25.0-b70 mixed mode
solaris-sparc
> > > > compressed oops)
> > > > # Problematic frame:
> > > > # 1084 while (orte_event_base_active) {
> > > > (gdb)
> > > > 1085 opal_event_loop(orte_event_base, OPAL_EVLOOP_ONCE);
> > > > (gdb)
> > > > C [libc.so.1+0x3c7f0] strlen+0x50
> > > > #
> > > > # Failed to write core dump. Core dumps have been disabled. To enable
core
> > > > dumping, try "ulimit -c unlimited" before starting Java again
> > > > #
> > > > # An error report file with more information is saved as:
> > > > #
/home/fd1026/work/skripte/master/parallel/prog/mpi/java/hs_err_pid13080.log
> > > > #
> > > > # If you would like to submit a bug report, please visit:
> > > > # http://bugreport.sun.com/bugreport/crash.jsp
> > > > # The crash happened outside the Java Virtual Machine in native code.
> > > > # See problematic frame for where to report the bug.
> > > > #
> > > >
--------------------------------------------------------------------------
> > > > mpiexec noticed that process rank 0 with PID 0 on node tyr exited on
signal 6
> > > > (Abort).
> > > >
--------------------------------------------------------------------------
> > > > 1084 while (orte_event_base_active) {
> > > > (gdb)
> > > > 1089 orte_odls.kill_local_procs(NULL);
> > > > (gdb)
> > > >
> > > >
> > > > Thank you very much for any help in advance.
> > > >
> > > > Kind regards
> > > >
> > > > Siegmar
> _______________________________________________
> users mailing list
> us...@open-mpi.org
> Subscription: http://www.open-mpi.org/mailman/listinfo.cgi/users
> Link to this post:
http://www.open-mpi.org/community/lists/users/2014/10/25559.php
#
# A fatal error has been detected by the Java Runtime Environment:
#
# SIGSEGV (0xb) at pc=0xffffffff7ea3c7f0, pid=13080, tid=2
#
# JRE version: Java(TM) SE Runtime Environment (8.0-b132) (build 1.8.0-b132)
# Java VM: Java HotSpot(TM) 64-Bit Server VM (25.0-b70 mixed mode solaris-sparc
compressed oops)
# Problematic frame:
# C [libc.so.1+0x3c7f0] strlen+0x50
#
# Failed to write core dump. Core dumps have been disabled. To enable core
dumping, try "ulimit -c unlimited" before starting Java again
#
# If you would like to submit a bug report, please visit:
# http://bugreport.sun.com/bugreport/crash.jsp
# The crash happened outside the Java Virtual Machine in native code.
# See problematic frame for where to report the bug.
#
--------------- T H R E A D ---------------
Current thread (0x000000010010e800): JavaThread "main" [_thread_in_native,
id=2, stack(0xffffffff7b400000,0xffffffff7b500000)]
siginfo:si_signo=SIGSEGV: si_errno=0, si_code=1 (SEGV_MAPERR),
si_addr=0x0000000000000000
Registers:
G1=0xffffffff7b4fd915 G2=0x0000000000000000 G3=0xffffffff7fffe0b9
G4=0xfffffffffffffad8
G5=0x0000000000000000 G6=0xffffffff2affe000 G7=0xffffffff7e900a00
Y=0x0000000000000000
O0=0x0000000000000000 O1=0x0000000000000053 O2=0x0000000000000000
O3=0x0000000000000000
O4=0x0000000000000000 O5=0x0000000000000053 O6=0xffffffff7b4fbf31
O7=0xffffffff7eaacdc8
L0=0x0000000000000000 L1=0x0000000000000073 L2=0x0000000000000000
L3=0x0000000000000000
L4=0x0000000000001000 L5=0x0000000000000000 L6=0x0000000000000000
L7=0xffffffff7ec491f9
I0=0xfffffffee4854037 I1=0xffffffff7b4fdac0 I2=0xffffffff7eaab058
I3=0xffffffff7b4fd1c5
I4=0x0000000000000000 I5=0xfffffffee4854036 I6=0xffffffff7b4fcf01
I7=0xffffffff7eaaf638
PC=0xffffffff7ea3c7f0 nPC=0xffffffff7ea3c7f4
Top of Stack: (sp=0xffffffff7b4fc730)
0xffffffff7b4fc730: 0000000000000000 0000000000000073
0xffffffff7b4fc740: 0000000000000000 0000000000000000
0xffffffff7b4fc750: 0000000000001000 0000000000000000
0xffffffff7b4fc760: 0000000000000000 ffffffff7ec491f9
0xffffffff7b4fc770: fffffffee4854037 ffffffff7b4fdac0
0xffffffff7b4fc780: ffffffff7eaab058 ffffffff7b4fd1c5
0xffffffff7b4fc790: 0000000000000000 fffffffee4854036
0xffffffff7b4fc7a0: ffffffff7b4fcf01 ffffffff7eaaf638
0xffffffff7b4fc7b0: ffffffff7f635b91 000000007b4fd238
0xffffffff7b4fc7c0: ffffffff7b4fcc58 ffffffff7b4fd150
0xffffffff7b4fc7d0: 000000000000000a ffffffff7b4fd050
0xffffffff7b4fc7e0: ffffffff7b4fd7c0 0000000000000000
0xffffffff7b4fc7f0: 0000000000000000 ffffffff7ec3e000
0xffffffff7b4fc800: 0000000000000000 0000000000000000
0xffffffff7b4fc810: 0000000000000000 0000000100000000
0xffffffff7b4fc820: 0000000000000001 0000000000002000
Instructions: (pc=0xffffffff7ea3c7f0)
0xffffffff7ea3c7d0: d2 12 80 00 99 32 60 08 80 90 00 0c 02 40 00 24
0xffffffff7ea3c7e0: 80 8a 60 ff 02 40 00 22 94 02 a0 01 94 02 a0 01
0xffffffff7ea3c7f0: d2 02 80 00 19 00 40 40 1b 20 20 20 98 13 21 01
0xffffffff7ea3c800: 9a 13 60 80 96 2b 40 09 82 22 40 0c 80 8a c0 01
Register to memory mapping:
G1=0xffffffff7b4fd915 is pointing into the stack for thread: 0x000000010010e800
G2=0x0000000000000000 is an unknown value
G3=0xffffffff7fffe0b9 is an unknown value
G4=0xfffffffffffffad8 is an unknown value
G5=0x0000000000000000 is an unknown value
G6=0xffffffff2affe000 is an unknown value
G7=0xffffffff7e900a00 is an unknown value
O0=0x0000000000000000 is an unknown value
O1=0x0000000000000053 is an unknown value
O2=0x0000000000000000 is an unknown value
O3=0x0000000000000000 is an unknown value
O4=0x0000000000000000 is an unknown value
O5=0x0000000000000053 is an unknown value
O6=0xffffffff7b4fbf31 is pointing into the stack for thread: 0x000000010010e800
O7=0xffffffff7eaacdc8: _doprnt+0x1d80 in /lib/sparcv9/libc.so.1 at
0xffffffff7ea00000
L0=0x0000000000000000 is an unknown value
L1=0x0000000000000073 is an unknown value
L2=0x0000000000000000 is an unknown value
L3=0x0000000000000000 is an unknown value
L4=0x0000000000001000 is an unknown value
L5=0x0000000000000000 is an unknown value
L6=0x0000000000000000 is an unknown value
L7=0xffffffff7ec491f9: _ctype+0x1 in /lib/sparcv9/libc.so.1 at
0xffffffff7ea00000
I0=0xfffffffee4854037: var_type_sizes+0x2df in
/export2/prog/SunOS_sparc/openmpi-1.9.0_64_gcc/lib64/libopen-pal.so.0.0.0 at
0xfffffffee4700000
I1=0xffffffff7b4fdac0 is pointing into the stack for thread: 0x000000010010e800
I2=0xffffffff7eaab058: _doprnt+0x10 in /lib/sparcv9/libc.so.1 at
0xffffffff7ea00000
I3=0xffffffff7b4fd1c5 is pointing into the stack for thread: 0x000000010010e800
I4=0x0000000000000000 is an unknown value
I5=0xfffffffee4854036: var_type_sizes+0x2de in
/export2/prog/SunOS_sparc/openmpi-1.9.0_64_gcc/lib64/libopen-pal.so.0.0.0 at
0xfffffffee4700000
I6=0xffffffff7b4fcf01 is pointing into the stack for thread: 0x000000010010e800
I7=0xffffffff7eaaf638: vsnprintf+0x7c in /lib/sparcv9/libc.so.1 at
0xffffffff7ea00000
Stack: [0xffffffff7b400000,0xffffffff7b500000], sp=0xffffffff7b4fc730, free
space=1009k
Native frames: (J=compiled Java code, j=interpreted, Vv=VM code, C=native code)
C [libc.so.1+0x3c7f0] strlen+0x50
C [libc.so.1+0xaf640] vsnprintf+0x84
C [libc.so.1+0xaadb4] vasprintf+0x20
C [libc.so.1+0xaaf04] asprintf+0x28
C [libopen-pal.so.0.0.0+0xaf3cc] mca_base_var_cache_files+0x160
C [libopen-pal.so.0.0.0+0xaed90] mca_base_var_init+0x4e8
C [libopen-pal.so.0.0.0+0xb260c] register_variable+0x214
C [libopen-pal.so.0.0.0+0xb36a0] mca_base_var_register+0x104
C [libmpi_java.so.0.0.0+0x221e8] JNI_OnLoad+0x128
C [libjava.so+0x10860] Java_java_lang_ClassLoader_00024NativeLibrary_load+0xb8
j java.lang.ClassLoader$NativeLibrary.load(Ljava/lang/String;Z)V+-665819
j java.lang.ClassLoader$NativeLibrary.load(Ljava/lang/String;Z)V+0
j java.lang.ClassLoader.loadLibrary0(Ljava/lang/Class;Ljava/io/File;)Z+328
j java.lang.ClassLoader.loadLibrary(Ljava/lang/Class;Ljava/lang/String;Z)V+290
j java.lang.Runtime.loadLibrary0(Ljava/lang/Class;Ljava/lang/String;)V+54
j java.lang.System.loadLibrary(Ljava/lang/String;)V+7
j mpi.MPI.<clinit>()V+28
v ~StubRoutines::call_stub
V [libjvm.so+0x6fd4f0] void
JavaCalls::call_helper(JavaValue*,methodHandle*,JavaCallArguments*,Thread*)+0xa58
V [libjvm.so+0x690b2c] void
InstanceKlass::call_class_initializer_impl(instanceKlassHandle,Thread*)+0xd4
V [libjvm.so+0x68f394] void
InstanceKlass::initialize_impl(instanceKlassHandle,Thread*)+0x654
V [libjvm.so+0x68e190] void InstanceKlass::initialize(Thread*)+0x38
V [libjvm.so+0x9ac5ec] void
LinkResolver::resolve_static_call(CallInfo&,KlassHandle&,Symbol*,Symbol*,KlassHandle,bool,bool,Thread*)+0xbc
V [libjvm.so+0x9b2ff8] void
LinkResolver::resolve_invokestatic(CallInfo&,constantPoolHandle,int,Thread*)+0x200
V [libjvm.so+0x9b2b34] void
LinkResolver::resolve_invoke(CallInfo&,Handle,constantPoolHandle,int,Bytecodes::Code,Thread*)+0x94c
V [libjvm.so+0x6e8af8] void
InterpreterRuntime::resolve_invoke(JavaThread*,Bytecodes::Code)+0x938
j InitFinalizeMain.main([Ljava/lang/String;)V+1
v ~StubRoutines::call_stub
V [libjvm.so+0x6fd4f0] void
JavaCalls::call_helper(JavaValue*,methodHandle*,JavaCallArguments*,Thread*)+0xa58
V [libjvm.so+0x793324] jni_CallStaticVoidMethod+0x910
C [libjli.so+0x7298] JavaMain+0x778
Java frames: (J=compiled Java code, j=interpreted, Vv=VM code)
j java.lang.ClassLoader$NativeLibrary.load(Ljava/lang/String;Z)V+0
j java.lang.ClassLoader.loadLibrary0(Ljava/lang/Class;Ljava/io/File;)Z+328
j java.lang.ClassLoader.loadLibrary(Ljava/lang/Class;Ljava/lang/String;Z)V+290
j java.lang.Runtime.loadLibrary0(Ljava/lang/Class;Ljava/lang/String;)V+54
j java.lang.System.loadLibrary(Ljava/lang/String;)V+7
j mpi.MPI.<clinit>()V+28
v ~StubRoutines::call_stub
j InitFinalizeMain.main([Ljava/lang/String;)V+1
v ~StubRoutines::call_stub
--------------- P R O C E S S ---------------
Java Threads: ( => current thread )
0x000000010035e800 JavaThread "Service Thread" daemon [_thread_blocked,
id=11, stack(0xfffffffee5500000,0xfffffffee5600000)]
0x00000001002fa000 JavaThread "C1 CompilerThread1" daemon [_thread_blocked,
id=10, stack(0xfffffffee5700000,0xfffffffee5800000)]
0x00000001002f7000 JavaThread "C2 CompilerThread0" daemon [_thread_blocked,
id=9, stack(0xfffffffee5900000,0xfffffffee5a00000)]
0x00000001002f5800 JavaThread "Signal Dispatcher" daemon [_thread_blocked,
id=8, stack(0xfffffffee5b00000,0xfffffffee5c00000)]
0x00000001002c4000 JavaThread "Finalizer" daemon [_thread_blocked, id=7,
stack(0xfffffffee5d00000,0xfffffffee5e00000)]
0x00000001002bc800 JavaThread "Reference Handler" daemon [_thread_blocked,
id=6, stack(0xfffffffee5f00000,0xfffffffee6000000)]
=>0x000000010010e800 JavaThread "main" [_thread_in_native, id=2,
stack(0xffffffff7b400000,0xffffffff7b500000)]
Other Threads:
0x00000001002b6000 VMThread [stack: 0xfffffffee6100000,0xfffffffee6200000]
[id=5]
0x0000000100364000 WatcherThread [stack:
0xfffffffee5300000,0xfffffffee5400000] [id=12]
VM state:not at safepoint (normal execution)
VM Mutex/Monitor currently owned by a thread: None
Heap:
PSYoungGen total 8192K, used 933K [0xffffffff55c00000,
0xffffffff56800000, 0xffffffff6b000000)
eden space 4096K, 22% used
[0xffffffff55c00000,0xffffffff55ce9530,0xffffffff56000000)
from space 4096K, 0% used
[0xffffffff56400000,0xffffffff56400000,0xffffffff56800000)
to space 4096K, 0% used
[0xffffffff56000000,0xffffffff56000000,0xffffffff56400000)
ParOldGen total 53248K, used 0K [0xffffffff2b000000, 0xffffffff2e400000,
0xffffffff55c00000)
object space 53248K, 0% used
[0xffffffff2b000000,0xffffffff2b000000,0xffffffff2e400000)
Metaspace used 2853K, capacity 4550K, committed 4864K, reserved 1056768K
class space used 305K, capacity 386K, committed 512K, reserved 1048576K
Card table byte_map: [0xffffffff6b100000,0xffffffff6b302000] byte_map_base:
0xff7fffff6b7a8000
Marking Bits: (ParMarkBitMap*) 0xffffffff7e5daee0
Begin Bits: [0xffffffff28400000, 0xffffffff29400000)
End Bits: [0xffffffff29400000, 0xffffffff2a400000)
Polling page: 0xffffffff7b100000
CodeCache: size=245760Kb used=1116Kb max_used=1116Kb free=244643Kb
bounds [0xffffffff6b800000, 0xffffffff6bc00000, 0xffffffff7a800000]
total_blobs=272 nmethods=38 adapters=151
compilation: enabled
Compilation events (10 events):
Event: 0.308 Thread 0x00000001002fa000 34 3
java.lang.AbstractStringBuilder::append (50 bytes)
Event: 0.309 Thread 0x00000001002fa000 nmethod 34 0xffffffff6b9131d0 code
[0xffffffff6b9133c0, 0xffffffff6b913978]
Event: 0.312 Thread 0x00000001002fa000 35 3
java.lang.System::getSecurityManager (4 bytes)
Event: 0.313 Thread 0x00000001002fa000 nmethod 35 0xffffffff6b913b90 code
[0xffffffff6b913ce0, 0xffffffff6b913e48]
Event: 0.315 Thread 0x00000001002fa000 36 3
java.lang.String::lastIndexOf (52 bytes)
Event: 0.316 Thread 0x00000001002fa000 nmethod 36 0xffffffff6b913ed0 code
[0xffffffff6b9140a0, 0xffffffff6b9145f0]
Event: 0.316 Thread 0x00000001002fa000 38 3
java.util.HashMap::putVal (300 bytes)
Event: 0.319 Thread 0x00000001002fa000 nmethod 38 0xffffffff6b914790 code
[0xffffffff6b914b40, 0xffffffff6b916670]
Event: 0.319 Thread 0x00000001002fa000 37 3
java.util.HashMap::put (13 bytes)
Event: 0.320 Thread 0x00000001002fa000 nmethod 37 0xffffffff6b916d50 code
[0xffffffff6b916f00, 0xffffffff6b9173d0]
GC Heap History (0 events):
No events
Deoptimization events (0 events):
No events
Internal exceptions (5 events):
Event: 0.107 Thread 0x000000010010e800 Exception <a
'java/lang/NoSuchMethodError': Method
sun.misc.Unsafe.defineClass(Ljava/lang/String;[BII)Ljava/lang/Class; name or
signature does not match> (0xffffffff55c0bd00) thrown at
[/tmp/workspace/8-2-build-solaris-sparcv9/jdk8/2238/hotspot/src/share/
Event: 0.108 Thread 0x000000010010e800 Exception <a
'java/lang/NoSuchMethodError': Method
sun.misc.Unsafe.prefetchRead(Ljava/lang/Object;J)V name or signature does not
match> (0xffffffff55c0bf90) thrown at
[/tmp/workspace/8-2-build-solaris-sparcv9/jdk8/2238/hotspot/src/share/vm/prims/jni.cpp,
Event: 0.274 Thread 0x000000010010e800 Exception <a
'java/security/PrivilegedActionException'> (0xffffffff55cb1f60) thrown at
[/tmp/workspace/8-2-build-solaris-sparcv9/jdk8/2238/hotspot/src/share/vm/prims/jvm.cpp,
line 1248]
Event: 0.288 Thread 0x000000010010e800 Exception <a
'java/security/PrivilegedActionException'> (0xffffffff55cb6c78) thrown at
[/tmp/workspace/8-2-build-solaris-sparcv9/jdk8/2238/hotspot/src/share/vm/prims/jvm.cpp,
line 1248]
Event: 0.306 Thread 0x000000010010e800 Exception <a
'java/security/PrivilegedActionException'> (0xffffffff55cc3270) thrown at
[/tmp/workspace/8-2-build-solaris-sparcv9/jdk8/2238/hotspot/src/share/vm/prims/jvm.cpp,
line 1248]
Events (10 events):
Event: 0.306 loading class mpi/MPI
Event: 0.306 loading class mpi/MPI done
Event: 0.312 loading class java/io/IOException
Event: 0.312 loading class java/io/IOException done
Event: 0.313 loading class java/util/concurrent/ConcurrentHashMap$ForwardingNode
Event: 0.313 loading class
java/util/concurrent/ConcurrentHashMap$ForwardingNode done
Event: 0.314 loading class java/lang/AssertionError
Event: 0.314 loading class java/lang/AssertionError done
Event: 0.316 loading class java/lang/ClassLoaderHelper
Event: 0.316 loading class java/lang/ClassLoaderHelper done
Dynamic libraries:
0x0000000100000000 /export2/prog/SunOS_sparc/jdk1.8.0/bin/java
0xffffffff7f000000
/export2/prog/SunOS_sparc/jdk1.8.0/bin/../lib/sparcv9/jli/libjli.so
0xffffffff7f100000 /lib/sparcv9/libthread.so.1
0xffffffff7ed00000 /lib/sparcv9/libdl.so.1
0xffffffff7ea00000 /lib/sparcv9/libc.so.1
0xffffffff7e800000 /platform/SUNW,A70/lib/sparcv9/libc_psr.so.1
0xffffffff7d400000
/export2/prog/SunOS_sparc/jdk1.8.0/jre/lib/sparcv9/server/libjvm.so
0xffffffff7d200000 /lib/sparcv9/libsocket.so.1
0xffffffff7e400000 /usr/lib/sparcv9/libsched.so.1
0xffffffff7cf00000 /lib/sparcv9/libm.so.1
0xffffffff7cd00000 /usr/lib/sparcv9/libCrun.so.1
0xffffffff7cb00000 /lib/sparcv9/libdoor.so.1
0xffffffff7c900000 /usr/lib/sparcv9/libdemangle.so.1
0xffffffff7c700000 /lib/sparcv9/libkstat.so.1
0xffffffff7c500000 /lib/sparcv9/libnsl.so.1
0xffffffff7c300000 /lib/sparcv9/libm.so.2
0xffffffff7c100000 /lib/sparcv9/libmp.so.2
0xffffffff7bf00000 /lib/sparcv9/libmd.so.1
0xffffffff7bd00000 /platform/SUNW,A70/lib/sparcv9/libmd_psr.so.1
0xffffffff7bb00000 /lib/sparcv9/libscf.so.1
0xffffffff7b900000 /lib/sparcv9/libuutil.so.1
0xffffffff7b700000 /lib/sparcv9/libgen.so.1
0xffffffff7b200000
/export2/prog/SunOS_sparc/jdk1.8.0/jre/lib/sparcv9/libverify.so
0xffffffff7b000000
/export2/prog/SunOS_sparc/jdk1.8.0/jre/lib/sparcv9/libjava.so
0xffffffff7ab00000
/export2/prog/SunOS_sparc/jdk1.8.0/jre/lib/sparcv9/libzip.so
0xfffffffee5100000
/export2/prog/SunOS_sparc/openmpi-1.9.0_64_gcc/lib64/libmpi_java.so.0.0.0
0xfffffffee4d00000 /usr/local/openmpi-1.9.0_64_gcc/lib64/libmpi.so.0
0xfffffffee4a00000 /usr/local/openmpi-1.9.0_64_gcc/lib64/libopen-rte.so.0
0xfffffffee4700000 /usr/local/openmpi-1.9.0_64_gcc/lib64/libopen-pal.so.0
0xfffffffee4500000 /lib/sparcv9/libsendfile.so.1
0xfffffffee4300000 /usr/lib/sparcv9/libpicl.so.1
0xfffffffee4100000 /usr/lib/sparcv9/liblgrp.so.1
0xfffffffee3f00000 /lib/sparcv9/librt.so.1
0xfffffffee3d00000 /usr/local/gcc-4.9.1/lib/sparcv9/libgcc_s.so.1
0xfffffffee4c00000 /lib/sparcv9/libpthread.so.1
0xfffffffee3b00000 /lib/sparcv9/libaio.so.1
VM Arguments:
jvm_args: -Djava.library.path=/usr/local/openmpi-1.9.0_64_gcc/lib64
java_command: InitFinalizeMain
java_class_path (initial):
/home/fd1026/work/skripte/master/parallel/prog/mpi/java:/usr/local/junit4.10:/usr/local/junit4.10/junit-4.10.jar:/usr/local/javacc-5.0/javacc.jar:.:/home/fd1026/SunOS/sparc/mpi_classfiles:/usr/local/openmpi-1.9.0_64_gcc/lib64/mpi.jar
Launcher Type: SUN_STANDARD
Environment Variables:
JAVA_HOME=/usr/local/jdk1.8.0
CLASSPATH=/usr/local/junit4.10:/usr/local/junit4.10/junit-4.10.jar:/usr/local/javacc-5.0/javacc.jar:.:/home/fd1026/SunOS/sparc/mpi_classfiles
PATH=/usr/local/openmpi-1.9.0_64_gcc/bin:/usr/local/openmpi-1.9.0_64_gcc/bin:/usr/local/openmpi-1.9.0_64_gcc/bin:/usr/local/NetBeans-4.0/bin:/usr/local/jdk1.8.0/bin:/usr/local/apache-ant-1.6.2/bin:/usr/local/gcc-4.9.1/bin:/opt/solstudio12.3/bin:/usr/local/bin:/usr/local/ssl/bin:/usr/local/pgsql/bin:/usr/bin:/usr/openwin/bin:/usr/dt/bin:/usr/ccs/bin:/usr/sfw/bin:/opt/sfw/bin:/usr/ucb:/usr/xpg4/bin:/usr/local/teTeX-1.0.7/bin/sparc-sun-solaris2.10:/usr/local/bluej-2.1.2:/usr/local/hwloc-1.10.0/bin:/home/fd1026/SunOS/sparc/bin:.:/usr/sbin:/usr/sbin
LD_LIBRARY_PATH=/usr/local/openmpi-1.9.0_64_gcc/lib:/usr/local/openmpi-1.9.0_64_gcc/lib64:/usr/local/openmpi-1.9.0_64_gcc/lib:/usr/local/jdk1.8.0/jre/lib/sparc:/usr/local/gcc-4.9.1/lib:/usr/local/gcc-4.9.1/lib/gcc/sparc-sun-solaris2.10/4.9.1:/usr/local/lib:/usr/local/ssl/lib:/usr/local/oracle:/usr/local/pgsql/lib:/lib:/usr/lib:/usr/openwin/lib:/usr/dt/lib:/usr/X11R6/lib:/usr/ccs/lib:/usr/sfw/lib:/opt/sfw/lib:/usr/ucblib:/usr/local/hwloc-1.10.0/lib:/usr/lib/gnome-private/lib:/home/fd1026/SunOS/sparc/lib
SHELL=/bin/tcsh
DISPLAY=localhost:11.0
HOSTTYPE=sun4
OSTYPE=solaris
MACHTYPE=sparc
Signal Handlers:
SIGSEGV: [libjvm.so+0xd98e60], sa_mask[0]=0xffbffeff, sa_flags=0x0000000c
SIGBUS: [libjvm.so+0xd98e60], sa_mask[0]=0xffbffeff, sa_flags=0x0000000c
SIGFPE: [libjvm.so+0xb44e68], sa_mask[0]=0xffbffeff, sa_flags=0x0000000c
SIGPIPE: [libjvm.so+0xb44e68], sa_mask[0]=0xffbffeff, sa_flags=0x0000000c
SIGXFSZ: [libjvm.so+0xb44e68], sa_mask[0]=0xffbffeff, sa_flags=0x0000000c
SIGILL: [libjvm.so+0xb44e68], sa_mask[0]=0xffbffeff, sa_flags=0x0000000c
SIGUSR1: SIG_DFL, sa_mask[0]=0x00000000, sa_flags=0x00000000
SIGUSR2: SIG_DFL, sa_mask[0]=0x00000000, sa_flags=0x00000000
SIGQUIT: [libjvm.so+0xb3f148], sa_mask[0]=0xffbffeff, sa_flags=0x00000004
SIGHUP: [libjvm.so+0xb3f148], sa_mask[0]=0xffbffeff, sa_flags=0x00000004
SIGINT: [libjvm.so+0xb3f148], sa_mask[0]=0xffbffeff, sa_flags=0x00000004
SIGTERM: [libjvm.so+0xb3f148], sa_mask[0]=0xffbffeff, sa_flags=0x00000004
SIG39: [libjvm.so+0xb44eb8], sa_mask[0]=0x00000000, sa_flags=0x00000008
SIG40: [libjvm.so+0xb44e68], sa_mask[0]=0xffbffeff, sa_flags=0x0000000c
--------------- S Y S T E M ---------------
OS: Solaris 10 10/09 s10s_u8wos_08a SPARC
Copyright 2009 Sun Microsystems, Inc. All Rights Reserved.
Use is subject to license terms.
Assembled 16 September 2009
uname:SunOS 5.10 Generic_150400-11 sun4u
(T2 libthread)
rlimit: STACK 8192k, CORE 0k, NOFILE 65536, AS infinity
load average:0.07 0.28 0.23
CPU:total 2 v9, vis1, vis2, ultra3
Memory: 8k page, physical 4194304k(2345768k free)
vm_info: Java HotSpot(TM) 64-Bit Server VM (25.0-b70) for solaris-sparc JRE
(1.8.0-b132), built on Mar 4 2014 11:22:49 by "" with Sun Studio 12u1
time: Tue Oct 21 13:22:10 2014
elapsed time: 0 seconds
