This output is from renton. It tries to connect to begbie and
tommy, but they do not have an open MX endpoint. The connect fails
and PVFS2 gives up.
Yes, this is what happens, but it all happens in 0.1s, not really
enough time to get servers started on the other machines. Clearly
there should be some sort of waiting involved. BMX_TIMEOUT is set to
20s (20000 ms), so that isn't the problem.
I have not experimented much with multiple servers. Perhaps someone
else can chime in as to whether there should be specific order to
bringing up servers (e.g. in Lustre the metadata server must come
up before the storage servers).
In my configuration, the three servers are linked by 10GbE and I'm
running Open-MX on each. I currently have PVFS2 configured to have
all servers be both metadata and storage servers.
Another possibility is that PVFS2 tries again with socket
connections but is not with MX. Can anyone verify this?
Lastly, I expected to see some more message from bmi_mx. Is
BMX_DB_CONN set in the BMX_DB_MASK?
BMX_DB_CONN was set in BMX_DB_MASK, yes -- though now I've just set
BMX_DB_ALL instead, so here is a run with the full bmi_mx debug output:
[S 08/25 00:19] PVFS2 Server on node renton version 2.8.2 starting...
[D 08/25 00:19] Logging all (mask 18446744073709551615)
[D 08/25 00:19] PINT_encode_initialize
[D 08/25 00:19] lebf_initialize
[D 08/25 00:19] check_req_size
[D 08/25 00:19] encode_common
[D 08/25 00:19] lebf_encode_req
[D 08/25 00:19] lebf_encode_rel
[D 08/25 00:19] check_resp_size
[D 08/25 00:19] encode_common
[D 08/25 00:19] lebf_encode_resp
[D 08/25 00:19] lebf_encode_rel
[D 08/25 00:19] check_req_size
[D 08/25 00:19] encode_common
[D 08/25 00:19] lebf_encode_req
[D 08/25 00:19] lebf_encode_rel
[D 08/25 00:19] check_resp_size
[D 08/25 00:19] encode_common
[D 08/25 00:19] lebf_encode_resp
[D 08/25 00:19] lebf_encode_rel
[D 08/25 00:19] check_req_size
[D 08/25 00:19] encode_common
[D 08/25 00:19] lebf_encode_req
[D 08/25 00:19] PINT_do_request_commit: commit node 0x7fff60b373d0
[D 08/25 00:19] node stored at 0
[D 08/25 00:19] clearing tree
[D 08/25 00:19] lebf_encode_rel
[D 08/25 00:19] check_resp_size
[D 08/25 00:19] encode_common
[D 08/25 00:19] lebf_encode_resp
[D 08/25 00:19] lebf_encode_rel
[D 08/25 00:19] check_req_size
[D 08/25 00:19] encode_common
[D 08/25 00:19] lebf_encode_req
[D 08/25 00:19] lebf_encode_rel
[D 08/25 00:19] check_resp_size
[D 08/25 00:19] encode_common
[D 08/25 00:19] lebf_encode_resp
[D 08/25 00:19] lebf_encode_rel
[D 08/25 00:19] check_req_size
[D 08/25 00:19] encode_common
[D 08/25 00:19] lebf_encode_req
[D 08/25 00:19] lebf_encode_rel
[D 08/25 00:19] check_resp_size
[D 08/25 00:19] encode_common
[D 08/25 00:19] lebf_encode_resp
[D 08/25 00:19] lebf_encode_rel
[D 08/25 00:19] check_req_size
[D 08/25 00:19] encode_common
[D 08/25 00:19] lebf_encode_req
[D 08/25 00:19] lebf_encode_rel
[D 08/25 00:19] check_resp_size
[D 08/25 00:19] encode_common
[D 08/25 00:19] lebf_encode_resp
[D 08/25 00:19] lebf_encode_rel
[D 08/25 00:19] check_req_size
[D 08/25 00:19] encode_common
[D 08/25 00:19] lebf_encode_req
[D 08/25 00:19] lebf_encode_rel
[D 08/25 00:19] check_resp_size
[D 08/25 00:19] encode_common
[D 08/25 00:19] lebf_encode_resp
[D 08/25 00:19] lebf_encode_rel
[D 08/25 00:19] check_req_size
[D 08/25 00:19] encode_common
[D 08/25 00:19] lebf_encode_req
[D 08/25 00:19] lebf_encode_rel
[D 08/25 00:19] check_resp_size
[D 08/25 00:19] encode_common
[D 08/25 00:19] lebf_encode_resp
[D 08/25 00:19] lebf_encode_rel
[D 08/25 00:19] check_req_size
[D 08/25 00:19] encode_common
[D 08/25 00:19] lebf_encode_req
[D 08/25 00:19] lebf_encode_rel
[D 08/25 00:19] check_resp_size
[D 08/25 00:19] encode_common
[D 08/25 00:19] lebf_encode_resp
[D 08/25 00:19] lebf_encode_rel
[D 08/25 00:19] check_req_size
[D 08/25 00:19] encode_common
[D 08/25 00:19] lebf_encode_req
[D 08/25 00:19] lebf_encode_rel
[D 08/25 00:19] check_resp_size
[D 08/25 00:19] encode_common
[D 08/25 00:19] lebf_encode_resp
[D 08/25 00:19] lebf_encode_rel
[D 08/25 00:19] check_req_size
[D 08/25 00:19] encode_common
[D 08/25 00:19] lebf_encode_req
[D 08/25 00:19] lebf_encode_rel
[D 08/25 00:19] check_resp_size
[D 08/25 00:19] encode_common
[D 08/25 00:19] lebf_encode_resp
[D 08/25 00:19] lebf_encode_rel
[D 08/25 00:19] check_req_size
[D 08/25 00:19] encode_common
[D 08/25 00:19] lebf_encode_req
[D 08/25 00:19] lebf_encode_rel
[D 08/25 00:19] check_resp_size
[D 08/25 00:19] encode_common
[D 08/25 00:19] lebf_encode_resp
[D 08/25 00:19] lebf_encode_rel
[D 08/25 00:19] check_req_size
[D 08/25 00:19] encode_common
[D 08/25 00:19] lebf_encode_req
[D 08/25 00:19] lebf_encode_rel
[D 08/25 00:19] check_resp_size
[D 08/25 00:19] encode_common
[D 08/25 00:19] lebf_encode_resp
[D 08/25 00:19] lebf_encode_rel
[D 08/25 00:19] check_resp_size
[D 08/25 00:19] encode_common
[D 08/25 00:19] lebf_encode_resp
[D 08/25 00:19] lebf_encode_rel
[D 08/25 00:19] check_req_size
[D 08/25 00:19] encode_common
[D 08/25 00:19] lebf_encode_req
[D 08/25 00:19] lebf_encode_rel
[D 08/25 00:19] check_resp_size
[D 08/25 00:19] encode_common
[D 08/25 00:19] lebf_encode_resp
[D 08/25 00:19] lebf_encode_rel
[D 08/25 00:19] check_req_size
[D 08/25 00:19] encode_common
[D 08/25 00:19] lebf_encode_req
[D 08/25 00:19] lebf_encode_rel
[D 08/25 00:19] check_resp_size
[D 08/25 00:19] encode_common
[D 08/25 00:19] lebf_encode_resp
[D 08/25 00:19] lebf_encode_rel
[D 08/25 00:19] check_req_size
[D 08/25 00:19] encode_common
[D 08/25 00:19] lebf_encode_req
[D 08/25 00:19] lebf_encode_rel
[D 08/25 00:19] check_resp_size
[D 08/25 00:19] encode_common
[D 08/25 00:19] lebf_encode_resp
[D 08/25 00:19] lebf_encode_rel
[D 08/25 00:19] check_req_size
[D 08/25 00:19] encode_common
[D 08/25 00:19] lebf_encode_req
[D 08/25 00:19] lebf_encode_rel
[D 08/25 00:19] check_resp_size
[D 08/25 00:19] encode_common
[D 08/25 00:19] lebf_encode_resp
[D 08/25 00:19] lebf_encode_rel
[D 08/25 00:19] check_req_size
[D 08/25 00:19] encode_common
[D 08/25 00:19] lebf_encode_req
[D 08/25 00:19] lebf_encode_rel
[D 08/25 00:19] check_resp_size
[D 08/25 00:19] encode_common
[D 08/25 00:19] lebf_encode_resp
[D 08/25 00:19] lebf_encode_rel
[D 08/25 00:19] check_req_size
[D 08/25 00:19] encode_common
[D 08/25 00:19] lebf_encode_req
[D 08/25 00:19] lebf_encode_rel
[D 08/25 00:19] check_resp_size
[D 08/25 00:19] encode_common
[D 08/25 00:19] lebf_encode_resp
[D 08/25 00:19] lebf_encode_rel
[D 08/25 00:19] check_req_size
[D 08/25 00:19] encode_common
[D 08/25 00:19] lebf_encode_req
[D 08/25 00:19] lebf_encode_rel
[D 08/25 00:19] check_resp_size
[D 08/25 00:19] encode_common
[D 08/25 00:19] lebf_encode_resp
[D 08/25 00:19] lebf_encode_rel
[D 08/25 00:19] check_req_size
[D 08/25 00:19] encode_common
[D 08/25 00:19] lebf_encode_req
[D 08/25 00:19] lebf_encode_rel
[D 08/25 00:19] check_resp_size
[D 08/25 00:19] encode_common
[D 08/25 00:19] lebf_encode_resp
[D 08/25 00:19] lebf_encode_rel
[D 08/25 00:19] check_req_size
[D 08/25 00:19] encode_common
[D 08/25 00:19] lebf_encode_req
[D 08/25 00:19] lebf_encode_rel
[D 08/25 00:19] check_resp_size
[D 08/25 00:19] encode_common
[D 08/25 00:19] lebf_encode_resp
[D 08/25 00:19] lebf_encode_rel
[D 08/25 00:19] check_req_size
[D 08/25 00:19] encode_common
[D 08/25 00:19] lebf_encode_req
[D 08/25 00:19] lebf_encode_rel
[D 08/25 00:19] check_resp_size
[D 08/25 00:19] encode_common
[D 08/25 00:19] lebf_encode_resp
[D 08/25 00:19] lebf_encode_rel
[D 08/25 00:19] check_req_size
[D 08/25 00:19] encode_common
[D 08/25 00:19] lebf_encode_req
[D 08/25 00:19] lebf_encode_rel
[D 08/25 00:19] check_resp_size
[D 08/25 00:19] encode_common
[D 08/25 00:19] lebf_encode_resp
[D 08/25 00:19] lebf_encode_rel
[D 08/25 00:19] check_req_size
[D 08/25 00:19] encode_common
[D 08/25 00:19] lebf_encode_req
[D 08/25 00:19] lebf_encode_rel
[D 08/25 00:19] check_resp_size
[D 08/25 00:19] encode_common
[D 08/25 00:19] lebf_encode_resp
[D 08/25 00:19] lebf_encode_rel
[D 08/25 00:19] check_req_size
[D 08/25 00:19] encode_common
[D 08/25 00:19] lebf_encode_req
[D 08/25 00:19] lebf_encode_rel
[D 08/25 00:19] check_resp_size
[D 08/25 00:19] encode_common
[D 08/25 00:19] lebf_encode_resp
[D 08/25 00:19] lebf_encode_rel
[D 08/25 00:19] check_req_size
[D 08/25 00:19] encode_common
[D 08/25 00:19] lebf_encode_req
[D 08/25 00:19] lebf_encode_rel
[D 08/25 00:19] check_resp_size
[D 08/25 00:19] encode_common
[D 08/25 00:19] lebf_encode_resp
[D 08/25 00:19] lebf_encode_rel
[D 08/25 00:19] check_req_size
[D 08/25 00:19] encode_common
[D 08/25 00:19] lebf_encode_req
[D 08/25 00:19] lebf_encode_rel
[D 08/25 00:19] check_resp_size
[D 08/25 00:19] encode_common
[D 08/25 00:19] lebf_encode_resp
[D 08/25 00:19] lebf_encode_rel
[D 08/25 00:19] check_req_size
[D 08/25 00:19] encode_common
[D 08/25 00:19] lebf_encode_req
[D 08/25 00:19] lebf_encode_rel
[D 08/25 00:19] check_resp_size
[D 08/25 00:19] encode_common
[D 08/25 00:19] lebf_encode_resp
[D 08/25 00:19] lebf_encode_rel
[D 08/25 00:19] check_req_size
[D 08/25 00:19] encode_common
[D 08/25 00:19] lebf_encode_req
[D 08/25 00:19] PINT_do_request_commit: commit node 0x7fff60b373d0
[D 08/25 00:19] node stored at 0
[D 08/25 00:19] clearing tree
[D 08/25 00:19] lebf_encode_rel
[D 08/25 00:19] check_resp_size
[D 08/25 00:19] encode_common
[D 08/25 00:19] lebf_encode_resp
[D 08/25 00:19] lebf_encode_rel
[D 08/25 00:19] check_req_size
[D 08/25 00:19] encode_common
[D 08/25 00:19] lebf_encode_req
[D 08/25 00:19] lebf_encode_rel
[D 08/25 00:19] check_resp_size
[D 08/25 00:19] encode_common
[D 08/25 00:19] lebf_encode_resp
[D 08/25 00:19] lebf_encode_rel
[D 08/25 00:19] check_req_size
[D 08/25 00:19] encode_common
[D 08/25 00:19] lebf_encode_req
[D 08/25 00:19] lebf_encode_rel
[D 08/25 00:19] check_resp_size
[D 08/25 00:19] encode_common
[D 08/25 00:19] lebf_encode_resp
[D 08/25 00:19] lebf_encode_rel
[D 08/25 00:19] check_req_size
[D 08/25 00:19] encode_common
[D 08/25 00:19] lebf_encode_req
[D 08/25 00:19] lebf_encode_rel
[D 08/25 00:19] check_resp_size
[D 08/25 00:19] encode_common
[D 08/25 00:19] lebf_encode_resp
[D 08/25 00:19] lebf_encode_rel
[D 08/25 00:19] check_req_size
[D 08/25 00:19] encode_common
[D 08/25 00:19] lebf_encode_req
[D 08/25 00:19] lebf_encode_rel
[D 08/25 00:19] check_resp_size
[D 08/25 00:19] encode_common
[D 08/25 00:19] lebf_encode_resp
[D 08/25 00:19] lebf_encode_rel
[D 08/25 00:19] Passing mx://renton:0:3 as BMI listen address.
[D 08/25 00:19] bmi_mx: entering BMI_mx_method_addr_lookup.
[D 08/25 00:19] bmi_mx: BMI_mx_method_addr_lookup with id mx://
renton:0:3.
[D 08/25 00:19] bmi_mx: entering bmx_alloc_method_addr.
[D 08/25 00:19] bmi_mx: exiting bmx_alloc_method_addr.
[D 08/25 00:19] bmi_mx: exiting BMI_mx_method_addr_lookup.
[D 08/25 00:19] bmi_mx: entering BMI_mx_initialize.
OMX: Emulating MX_DISABLE_SHMEM as OMX_DISABLE_SHARED
OMX: Forcing shared comms to disabled
OMX: Setting 4 bits of context id at offset 60 in matching
[D 08/25 00:19] bmi_mx: entering bmx_ctx_init.
[D 08/25 00:19] bmi_mx: exiting bmx_ctx_init.
[D 08/25 00:19] bmi_mx: entering bmx_ctx_init.
[D 08/25 00:19] bmi_mx: exiting bmx_ctx_init.
[D 08/25 00:19] bmi_mx: entering bmx_ctx_init.
[D 08/25 00:19] bmi_mx: exiting bmx_ctx_init.
[D 08/25 00:19] bmi_mx: entering bmx_ctx_init.
[D 08/25 00:19] bmi_mx: exiting bmx_ctx_init.
[D 08/25 00:19] bmi_mx: entering bmx_ctx_init.
[D 08/25 00:19] bmi_mx: exiting bmx_ctx_init.
[D 08/25 00:19] bmi_mx: entering bmx_ctx_init.
[D 08/25 00:19] bmi_mx: exiting bmx_ctx_init.
[D 08/25 00:19] bmi_mx: entering bmx_ctx_init.
[D 08/25 00:19] bmi_mx: exiting bmx_ctx_init.
[D 08/25 00:19] bmi_mx: entering bmx_ctx_init.
[D 08/25 00:19] bmi_mx: exiting bmx_ctx_init.
[D 08/25 00:19] bmi_mx: entering bmx_ctx_init.
[D 08/25 00:19] bmi_mx: exiting bmx_ctx_init.
[D 08/25 00:19] bmi_mx: entering bmx_ctx_init.
[D 08/25 00:19] bmi_mx: exiting bmx_ctx_init.
[D 08/25 00:19] bmi_mx: entering bmx_ctx_init.
[D 08/25 00:19] bmi_mx: exiting bmx_ctx_init.
[D 08/25 00:19] bmi_mx: entering bmx_ctx_init.
[D 08/25 00:19] bmi_mx: exiting bmx_ctx_init.
[D 08/25 00:19] bmi_mx: entering bmx_ctx_init.
[D 08/25 00:19] bmi_mx: exiting bmx_ctx_init.
[D 08/25 00:19] bmi_mx: entering bmx_ctx_init.
[D 08/25 00:19] bmi_mx: exiting bmx_ctx_init.
[D 08/25 00:19] bmi_mx: entering bmx_ctx_init.
[D 08/25 00:19] bmi_mx: exiting bmx_ctx_init.
[D 08/25 00:19] bmi_mx: entering bmx_ctx_init.
[D 08/25 00:19] bmi_mx: exiting bmx_ctx_init.
[D 08/25 00:19] bmi_mx: entering bmx_ctx_init.
[D 08/25 00:19] bmi_mx: exiting bmx_ctx_init.
[D 08/25 00:19] bmi_mx: entering bmx_ctx_init.
[D 08/25 00:19] bmi_mx: exiting bmx_ctx_init.
[D 08/25 00:19] bmi_mx: entering bmx_ctx_init.
[D 08/25 00:19] bmi_mx: exiting bmx_ctx_init.
[D 08/25 00:19] bmi_mx: entering bmx_ctx_init.
[D 08/25 00:19] bmi_mx: exiting bmx_ctx_init.
[D 08/25 00:19] bmi_mx: bmx_peer_addref refcount was 0.
[D 08/25 00:19] bmi_mx: entering bmx_ctx_init.
[D 08/25 00:19] bmi_mx: exiting bmx_ctx_init.
[D 08/25 00:19] bmi_mx: entering bmx_ctx_init.
[D 08/25 00:19] bmi_mx: exiting bmx_ctx_init.
[D 08/25 00:19] bmi_mx: entering bmx_ctx_init.
[D 08/25 00:19] bmi_mx: exiting bmx_ctx_init.
[D 08/25 00:19] bmi_mx: entering bmx_ctx_init.
[D 08/25 00:19] bmi_mx: exiting bmx_ctx_init.
[D 08/25 00:19] bmi_mx: entering bmx_ctx_init.
[D 08/25 00:19] bmi_mx: exiting bmx_ctx_init.
[D 08/25 00:19] bmi_mx: entering bmx_ctx_init.
[D 08/25 00:19] bmi_mx: exiting bmx_ctx_init.
[D 08/25 00:19] bmi_mx: entering bmx_ctx_init.
[D 08/25 00:19] bmi_mx: exiting bmx_ctx_init.
[D 08/25 00:19] bmi_mx: entering bmx_ctx_init.
[D 08/25 00:19] bmi_mx: exiting bmx_ctx_init.
[D 08/25 00:19] bmi_mx: entering bmx_ctx_init.
[D 08/25 00:19] bmi_mx: exiting bmx_ctx_init.
[D 08/25 00:19] bmi_mx: entering bmx_ctx_init.
[D 08/25 00:19] bmi_mx: exiting bmx_ctx_init.
[D 08/25 00:19] bmi_mx: entering bmx_ctx_init.
[D 08/25 00:19] bmi_mx: exiting bmx_ctx_init.
[D 08/25 00:19] bmi_mx: entering bmx_ctx_init.
[D 08/25 00:19] bmi_mx: exiting bmx_ctx_init.
[D 08/25 00:19] bmi_mx: entering bmx_ctx_init.
[D 08/25 00:19] bmi_mx: exiting bmx_ctx_init.
[D 08/25 00:19] bmi_mx: entering bmx_ctx_init.
[D 08/25 00:19] bmi_mx: exiting bmx_ctx_init.
[D 08/25 00:19] bmi_mx: entering bmx_ctx_init.
[D 08/25 00:19] bmi_mx: exiting bmx_ctx_init.
[D 08/25 00:19] bmi_mx: entering bmx_ctx_init.
[D 08/25 00:19] bmi_mx: exiting bmx_ctx_init.
[D 08/25 00:19] bmi_mx: entering bmx_ctx_init.
[D 08/25 00:19] bmi_mx: exiting bmx_ctx_init.
[D 08/25 00:19] bmi_mx: entering bmx_ctx_init.
[D 08/25 00:19] bmi_mx: exiting bmx_ctx_init.
[D 08/25 00:19] bmi_mx: entering bmx_ctx_init.
[D 08/25 00:19] bmi_mx: exiting bmx_ctx_init.
[D 08/25 00:19] bmi_mx: entering bmx_ctx_init.
[D 08/25 00:19] bmi_mx: exiting bmx_ctx_init.
[D 08/25 00:19] bmi_mx: entering bmx_ctx_init.
[D 08/25 00:19] bmi_mx: exiting bmx_ctx_init.
[D 08/25 00:19] bmi_mx: entering bmx_ctx_init.
[D 08/25 00:19] bmi_mx: exiting bmx_ctx_init.
[D 08/25 00:19] bmi_mx: entering bmx_ctx_init.
[D 08/25 00:19] bmi_mx: exiting bmx_ctx_init.
[D 08/25 00:19] bmi_mx: entering bmx_ctx_init.
[D 08/25 00:19] bmi_mx: exiting bmx_ctx_init.
[D 08/25 00:19] bmi_mx: entering bmx_ctx_init.
[D 08/25 00:19] bmi_mx: exiting bmx_ctx_init.
[D 08/25 00:19] bmi_mx: entering bmx_ctx_init.
[D 08/25 00:19] bmi_mx: exiting bmx_ctx_init.
[D 08/25 00:19] bmi_mx: entering bmx_ctx_init.
[D 08/25 00:19] bmi_mx: exiting bmx_ctx_init.
[D 08/25 00:19] bmi_mx: entering bmx_ctx_init.
[D 08/25 00:19] bmi_mx: exiting bmx_ctx_init.
[D 08/25 00:19] bmi_mx: entering bmx_ctx_init.
[D 08/25 00:19] bmi_mx: exiting bmx_ctx_init.
[D 08/25 00:19] bmi_mx: entering bmx_ctx_init.
[D 08/25 00:19] bmi_mx: exiting bmx_ctx_init.
[D 08/25 00:19] bmi_mx: entering bmx_ctx_init.
[D 08/25 00:19] bmi_mx: exiting bmx_ctx_init.
[D 08/25 00:19] bmi_mx: entering bmx_ctx_init.
[D 08/25 00:19] bmi_mx: exiting bmx_ctx_init.
[D 08/25 00:19] bmi_mx: entering bmx_ctx_init.
[D 08/25 00:19] bmi_mx: exiting bmx_ctx_init.
[D 08/25 00:19] bmi_mx: entering bmx_ctx_init.
[D 08/25 00:19] bmi_mx: exiting bmx_ctx_init.
[D 08/25 00:19] bmi_mx: entering bmx_ctx_init.
[D 08/25 00:19] bmi_mx: exiting bmx_ctx_init.
[D 08/25 00:19] bmi_mx: entering bmx_ctx_init.
[D 08/25 00:19] bmi_mx: exiting bmx_ctx_init.
[D 08/25 00:19] bmi_mx: entering bmx_ctx_init.
[D 08/25 00:19] bmi_mx: exiting bmx_ctx_init.
[D 08/25 00:19] bmi_mx: entering bmx_ctx_init.
[D 08/25 00:19] bmi_mx: exiting bmx_ctx_init.
[D 08/25 00:19] bmi_mx: entering bmx_ctx_init.
[D 08/25 00:19] bmi_mx: exiting bmx_ctx_init.
[D 08/25 00:19] bmi_mx: entering bmx_ctx_init.
[D 08/25 00:19] bmi_mx: exiting bmx_ctx_init.
[D 08/25 00:19] bmi_mx: entering bmx_ctx_init.
[D 08/25 00:19] bmi_mx: exiting bmx_ctx_init.
[D 08/25 00:19] bmi_mx: entering bmx_ctx_init.
[D 08/25 00:19] bmi_mx: exiting bmx_ctx_init.
[D 08/25 00:19] bmi_mx: entering bmx_ctx_init.
[D 08/25 00:19] bmi_mx: exiting bmx_ctx_init.
[D 08/25 00:19] bmi_mx: entering bmx_ctx_init.
[D 08/25 00:19] bmi_mx: exiting bmx_ctx_init.
[D 08/25 00:19] bmi_mx: entering bmx_ctx_init.
[D 08/25 00:19] bmi_mx: exiting bmx_ctx_init.
[D 08/25 00:19] bmi_mx: entering bmx_ctx_init.
[D 08/25 00:19] bmi_mx: exiting bmx_ctx_init.
[D 08/25 00:19] bmi_mx: entering bmx_ctx_init.
[D 08/25 00:19] bmi_mx: exiting bmx_ctx_init.
[D 08/25 00:19] bmi_mx: entering bmx_ctx_init.
[D 08/25 00:19] bmi_mx: exiting bmx_ctx_init.
[D 08/25 00:19] bmi_mx: entering bmx_ctx_init.
[D 08/25 00:19] bmi_mx: exiting bmx_ctx_init.
[D 08/25 00:19] bmi_mx: entering bmx_ctx_init.
[D 08/25 00:19] bmi_mx: exiting bmx_ctx_init.
[D 08/25 00:19] bmi_mx: entering bmx_ctx_init.
[D 08/25 00:19] bmi_mx: exiting bmx_ctx_init.
[D 08/25 00:19] bmi_mx: entering bmx_ctx_init.
[D 08/25 00:19] bmi_mx: exiting bmx_ctx_init.
[D 08/25 00:19] bmi_mx: entering bmx_ctx_init.
[D 08/25 00:19] bmi_mx: exiting bmx_ctx_init.
[D 08/25 00:19] bmi_mx: entering bmx_ctx_init.
[D 08/25 00:19] bmi_mx: exiting bmx_ctx_init.
[D 08/25 00:19] bmi_mx: entering bmx_ctx_init.
[D 08/25 00:19] bmi_mx: exiting bmx_ctx_init.
[D 08/25 00:19] bmi_mx: entering bmx_ctx_init.
[D 08/25 00:19] bmi_mx: exiting bmx_ctx_init.
[D 08/25 00:19] bmi_mx: entering bmx_ctx_init.
[D 08/25 00:19] bmi_mx: exiting bmx_ctx_init.
[D 08/25 00:19] bmi_mx: entering bmx_ctx_init.
[D 08/25 00:19] bmi_mx: exiting bmx_ctx_init.
[D 08/25 00:19] bmi_mx: entering bmx_ctx_init.
[D 08/25 00:19] bmi_mx: exiting bmx_ctx_init.
[D 08/25 00:19] bmi_mx: entering bmx_ctx_init.
[D 08/25 00:19] bmi_mx: exiting bmx_ctx_init.
[D 08/25 00:19] bmi_mx: entering bmx_ctx_init.
[D 08/25 00:19] bmi_mx: exiting bmx_ctx_init.
[D 08/25 00:19] bmi_mx: entering bmx_ctx_init.
[D 08/25 00:19] bmi_mx: exiting bmx_ctx_init.
[D 08/25 00:19] bmi_mx: entering bmx_ctx_init.
[D 08/25 00:19] bmi_mx: exiting bmx_ctx_init.
[D 08/25 00:19] bmi_mx: entering bmx_ctx_init.
[D 08/25 00:19] bmi_mx: exiting bmx_ctx_init.
[D 08/25 00:19] bmi_mx: entering bmx_ctx_init.
[D 08/25 00:19] bmi_mx: exiting bmx_ctx_init.
[D 08/25 00:19] bmi_mx: entering bmx_ctx_init.
[D 08/25 00:19] bmi_mx: exiting bmx_ctx_init.
[D 08/25 00:19] bmi_mx: entering bmx_ctx_init.
[D 08/25 00:19] bmi_mx: exiting bmx_ctx_init.
[D 08/25 00:19] bmi_mx: entering bmx_ctx_init.
[D 08/25 00:19] bmi_mx: exiting bmx_ctx_init.
[D 08/25 00:19] bmi_mx: entering bmx_ctx_init.
[D 08/25 00:19] bmi_mx: exiting bmx_ctx_init.
[D 08/25 00:19] bmi_mx: entering bmx_ctx_init.
[D 08/25 00:19] bmi_mx: exiting bmx_ctx_init.
[D 08/25 00:19] bmi_mx: entering bmx_ctx_init.
[D 08/25 00:19] bmi_mx: exiting bmx_ctx_init.
[D 08/25 00:19] bmi_mx: entering bmx_ctx_init.
[D 08/25 00:19] bmi_mx: exiting bmx_ctx_init.
[D 08/25 00:19] bmi_mx: entering bmx_ctx_init.
[D 08/25 00:19] bmi_mx: exiting bmx_ctx_init.
[D 08/25 00:19] bmi_mx: entering bmx_ctx_init.
[D 08/25 00:19] bmi_mx: exiting bmx_ctx_init.
[D 08/25 00:19] bmi_mx: entering bmx_ctx_init.
[D 08/25 00:19] bmi_mx: exiting bmx_ctx_init.
[D 08/25 00:19] bmi_mx: entering bmx_ctx_init.
[D 08/25 00:19] bmi_mx: exiting bmx_ctx_init.
[D 08/25 00:19] bmi_mx: entering bmx_ctx_init.
[D 08/25 00:19] bmi_mx: exiting bmx_ctx_init.
[D 08/25 00:19] bmi_mx: entering bmx_ctx_init.
[D 08/25 00:19] bmi_mx: exiting bmx_ctx_init.
[D 08/25 00:19] bmi_mx: entering bmx_ctx_init.
[D 08/25 00:19] bmi_mx: exiting bmx_ctx_init.
[D 08/25 00:19] bmi_mx: entering bmx_ctx_init.
[D 08/25 00:19] bmi_mx: exiting bmx_ctx_init.
[D 08/25 00:19] bmi_mx: entering bmx_ctx_init.
[D 08/25 00:19] bmi_mx: exiting bmx_ctx_init.
[D 08/25 00:19] bmi_mx: entering bmx_ctx_init.
[D 08/25 00:19] bmi_mx: exiting bmx_ctx_init.
[D 08/25 00:19] bmi_mx: entering bmx_ctx_init.
[D 08/25 00:19] bmi_mx: exiting bmx_ctx_init.
[D 08/25 00:19] bmi_mx: entering bmx_ctx_init.
[D 08/25 00:19] bmi_mx: exiting bmx_ctx_init.
[D 08/25 00:19] bmi_mx: entering bmx_ctx_init.
[D 08/25 00:19] bmi_mx: exiting bmx_ctx_init.
[D 08/25 00:19] bmi_mx: entering bmx_ctx_init.
[D 08/25 00:19] bmi_mx: exiting bmx_ctx_init.
[D 08/25 00:19] bmi_mx: entering bmx_ctx_init.
[D 08/25 00:19] bmi_mx: exiting bmx_ctx_init.
[D 08/25 00:19] bmi_mx: entering bmx_ctx_init.
[D 08/25 00:19] bmi_mx: exiting bmx_ctx_init.
[D 08/25 00:19] bmi_mx: entering bmx_ctx_init.
[D 08/25 00:19] bmi_mx: exiting bmx_ctx_init.
[D 08/25 00:19] bmi_mx: entering bmx_ctx_init.
[D 08/25 00:19] bmi_mx: exiting bmx_ctx_init.
[D 08/25 00:19] bmi_mx: entering bmx_ctx_init.
[D 08/25 00:19] bmi_mx: exiting bmx_ctx_init.
[D 08/25 00:19] bmi_mx: entering bmx_ctx_init.
[D 08/25 00:19] bmi_mx: exiting bmx_ctx_init.
[D 08/25 00:19] bmi_mx: entering bmx_ctx_init.
[D 08/25 00:19] bmi_mx: exiting bmx_ctx_init.
[D 08/25 00:19] bmi_mx: entering bmx_ctx_init.
[D 08/25 00:19] bmi_mx: exiting bmx_ctx_init.
[D 08/25 00:19] bmi_mx: entering bmx_ctx_init.
[D 08/25 00:19] bmi_mx: exiting bmx_ctx_init.
[D 08/25 00:19] bmi_mx: entering bmx_ctx_init.
[D 08/25 00:19] bmi_mx: exiting bmx_ctx_init.
[D 08/25 00:19] bmi_mx: entering bmx_ctx_init.
[D 08/25 00:19] bmi_mx: exiting bmx_ctx_init.
[D 08/25 00:19] bmi_mx: entering bmx_ctx_init.
[D 08/25 00:19] bmi_mx: exiting bmx_ctx_init.
[D 08/25 00:19] bmi_mx: entering bmx_ctx_init.
[D 08/25 00:19] bmi_mx: exiting bmx_ctx_init.
[D 08/25 00:19] bmi_mx: entering bmx_ctx_init.
[D 08/25 00:19] bmi_mx: exiting bmx_ctx_init.
[D 08/25 00:19] bmi_mx: exiting BMI_mx_initialize.
[D 08/25 00:19] Server using shm key hint: 1937657261
[D 08/25 00:19] [BMI CONTROL]: BMI_set_info: set_info: 0 option: 11
[D 08/25 00:19] bmi_mx: entering BMI_mx_set_info.
[D 08/25 00:19] bmi_mx: exiting BMI_mx_set_info.
[D 08/25 00:19] [BMI CONTROL]: BMI_set_info: set_info: 0 option: 12
[D 08/25 00:19] bmi_mx: entering BMI_mx_set_info.
[D 08/25 00:19] bmi_mx: exiting BMI_mx_set_info.
[D 08/25 00:19] dbpf_thread_initialize: initialized
[D 08/25 00:19] dbpf_thread_function started
[D 08/25 00:19] [SYNC_COALESCE]: dbpf_sync_context_init for context
0 called
[D 08/25 00:19] bmi_mx: entering BMI_mx_testcontext.
[D 08/25 00:19] bmi_mx: entering bmx_connection_handlers.
[D 08/25 00:19] bmi_mx: entering BMI_mx_method_addr_lookup.
[D 08/25 00:19] bmi_mx: exiting bmx_connection_handlers.
[D 08/25 00:19] bmi_mx: BMI_mx_method_addr_lookup with id mx://
begbie:0:3.
[D 08/25 00:19] bmi_mx: entering bmx_alloc_method_addr.
[D 08/25 00:19] bmi_mx: entering bmx_deq_completed.
[D 08/25 00:19] bmi_mx: exiting bmx_alloc_method_addr.
[D 08/25 00:19] bmi_mx: exiting bmx_deq_completed.
[D 08/25 00:19] bmi_mx: exiting BMI_mx_testcontext.
[D 08/25 00:19] bmi_mx: entering bmx_ctx_init.
[D 08/25 00:19] bmi_mx: exiting bmx_ctx_init.
[D 08/25 00:19] bmi_mx: entering bmx_ctx_init.
[D 08/25 00:19] bmi_mx: exiting bmx_ctx_init.
[D 08/25 00:19] bmi_mx: entering bmx_ctx_init.
[D 08/25 00:19] bmi_mx: exiting bmx_ctx_init.
[D 08/25 00:19] bmi_mx: entering bmx_ctx_init.
[D 08/25 00:19] bmi_mx: exiting bmx_ctx_init.
[D 08/25 00:19] bmi_mx: entering bmx_ctx_init.
[D 08/25 00:19] bmi_mx: exiting bmx_ctx_init.
[D 08/25 00:19] bmi_mx: entering bmx_ctx_init.
[D 08/25 00:19] bmi_mx: exiting bmx_ctx_init.
[D 08/25 00:19] bmi_mx: entering bmx_ctx_init.
[D 08/25 00:19] bmi_mx: exiting bmx_ctx_init.
[D 08/25 00:19] bmi_mx: entering bmx_ctx_init.
[D 08/25 00:19] bmi_mx: exiting bmx_ctx_init.
[D 08/25 00:19] bmi_mx: entering bmx_ctx_init.
[D 08/25 00:19] bmi_mx: exiting bmx_ctx_init.
[D 08/25 00:19] bmi_mx: entering bmx_ctx_init.
[D 08/25 00:19] bmi_mx: exiting bmx_ctx_init.
[D 08/25 00:19] bmi_mx: entering bmx_ctx_init.
[D 08/25 00:19] bmi_mx: exiting bmx_ctx_init.
[D 08/25 00:19] bmi_mx: entering bmx_ctx_init.
[D 08/25 00:19] bmi_mx: exiting bmx_ctx_init.
[D 08/25 00:19] bmi_mx: entering bmx_ctx_init.
[D 08/25 00:19] bmi_mx: exiting bmx_ctx_init.
[D 08/25 00:19] bmi_mx: entering bmx_ctx_init.
[D 08/25 00:19] bmi_mx: exiting bmx_ctx_init.
[D 08/25 00:19] bmi_mx: entering bmx_ctx_init.
[D 08/25 00:19] bmi_mx: exiting bmx_ctx_init.
[D 08/25 00:19] bmi_mx: entering bmx_ctx_init.
[D 08/25 00:19] bmi_mx: exiting bmx_ctx_init.
[D 08/25 00:19] bmi_mx: entering bmx_ctx_init.
[D 08/25 00:19] bmi_mx: exiting bmx_ctx_init.
[D 08/25 00:19] bmi_mx: entering bmx_ctx_init.
[D 08/25 00:19] bmi_mx: exiting bmx_ctx_init.
[D 08/25 00:19] bmi_mx: entering bmx_ctx_init.
[D 08/25 00:19] bmi_mx: exiting bmx_ctx_init.
[D 08/25 00:19] bmi_mx: entering bmx_ctx_init.
[D 08/25 00:19] bmi_mx: exiting bmx_ctx_init.
[D 08/25 00:19] bmi_mx: bmx_peer_addref refcount was 0.
[D 08/25 00:19] bmi_mx: entering bmx_peer_connect.
[D 08/25 00:19] bmi_mx: Setting peer mx://begbie:0:3 to BMX_PEER_WAIT.
[D 08/25 00:19] bmi_mx: bmx_peer_addref refcount was 1.
[D 08/25 00:19] bmi_mx: exiting bmx_peer_connect.
[D 08/25 00:19] bmi_mx: exiting BMI_mx_method_addr_lookup.
[D 08/25 00:19] bmi_mx: entering BMI_mx_method_addr_lookup.
[D 08/25 00:19] bmi_mx: BMI_mx_method_addr_lookup with id mx://
renton:0:3.
[D 08/25 00:19] bmi_mx: exiting BMI_mx_method_addr_lookup.
[D 08/25 00:19] bmi_mx: entering BMI_mx_method_addr_lookup.
[D 08/25 00:19] bmi_mx: BMI_mx_method_addr_lookup with id mx://tommy:
0:3.
[D 08/25 00:19] bmi_mx: entering bmx_alloc_method_addr.
[D 08/25 00:19] bmi_mx: exiting bmx_alloc_method_addr.
[D 08/25 00:19] bmi_mx: entering bmx_ctx_init.
[D 08/25 00:19] bmi_mx: exiting bmx_ctx_init.
[D 08/25 00:19] bmi_mx: entering bmx_ctx_init.
[D 08/25 00:19] bmi_mx: exiting bmx_ctx_init.
[D 08/25 00:19] bmi_mx: entering bmx_ctx_init.
[D 08/25 00:19] bmi_mx: exiting bmx_ctx_init.
[D 08/25 00:19] bmi_mx: entering bmx_ctx_init.
[D 08/25 00:19] bmi_mx: exiting bmx_ctx_init.
[D 08/25 00:19] bmi_mx: entering bmx_ctx_init.
[D 08/25 00:19] bmi_mx: exiting bmx_ctx_init.
[D 08/25 00:19] bmi_mx: entering bmx_ctx_init.
[D 08/25 00:19] bmi_mx: exiting bmx_ctx_init.
[D 08/25 00:19] bmi_mx: entering bmx_ctx_init.
[D 08/25 00:19] bmi_mx: exiting bmx_ctx_init.
[D 08/25 00:19] bmi_mx: entering bmx_ctx_init.
[D 08/25 00:19] bmi_mx: exiting bmx_ctx_init.
[D 08/25 00:19] bmi_mx: entering bmx_ctx_init.
[D 08/25 00:19] bmi_mx: exiting bmx_ctx_init.
[D 08/25 00:19] bmi_mx: entering bmx_ctx_init.
[D 08/25 00:19] bmi_mx: exiting bmx_ctx_init.
[D 08/25 00:19] bmi_mx: entering bmx_ctx_init.
[D 08/25 00:19] bmi_mx: exiting bmx_ctx_init.
[D 08/25 00:19] bmi_mx: entering bmx_ctx_init.
[D 08/25 00:19] bmi_mx: exiting bmx_ctx_init.
[D 08/25 00:19] bmi_mx: entering bmx_ctx_init.
[D 08/25 00:19] bmi_mx: exiting bmx_ctx_init.
[D 08/25 00:19] bmi_mx: entering bmx_ctx_init.
[D 08/25 00:19] bmi_mx: exiting bmx_ctx_init.
[D 08/25 00:19] bmi_mx: entering bmx_ctx_init.
[D 08/25 00:19] bmi_mx: exiting bmx_ctx_init.
[D 08/25 00:19] bmi_mx: entering bmx_ctx_init.
[D 08/25 00:19] bmi_mx: exiting bmx_ctx_init.
[D 08/25 00:19] bmi_mx: entering bmx_ctx_init.
[D 08/25 00:19] bmi_mx: exiting bmx_ctx_init.
[D 08/25 00:19] bmi_mx: entering bmx_ctx_init.
[D 08/25 00:19] bmi_mx: exiting bmx_ctx_init.
[D 08/25 00:19] bmi_mx: entering bmx_ctx_init.
[D 08/25 00:19] bmi_mx: exiting bmx_ctx_init.
[D 08/25 00:19] bmi_mx: entering bmx_ctx_init.
[D 08/25 00:19] bmi_mx: exiting bmx_ctx_init.
[D 08/25 00:19] bmi_mx: bmx_peer_addref refcount was 0.
[D 08/25 00:19] bmi_mx: entering bmx_peer_connect.
[D 08/25 00:19] bmi_mx: Setting peer mx://tommy:0:3 to BMX_PEER_WAIT.
[D 08/25 00:19] bmi_mx: bmx_peer_addref refcount was 1.
OMX: Completing iconnect request: Remote Endpoint is Closed
It seems like repeatedly calling bmx_ctx_init might not be the
expected normal behavior, but it's hard to tell without a known-
working MX stack to test it against. If anyone has any multiple-
server PVFS2 installation actually working over any type of MX (Open
or Myricom), would you be able to set BMX_DB_MASK to BMX_DB_ALL and
send the output?
Thanks!
Josh.
_______________________________________________
Pvfs2-users mailing list
[email protected]
http://www.beowulf-underground.org/mailman/listinfo/pvfs2-users
