Sweet. I've committed the patch to CVS. On Tue, Feb 10, 2009 at 10:45 AM, John Biddiscombe <biddi...@cscs.ch> wrote: > Utkarsh > > Looks good. 10 out of 10 successes with the patch applied (using 5 to 10 > pvserver nodes) - I'll try with more later when the rest of the machine is > free. > > Thanks yet again for your help. If the problem comes back in another flavour > I'll be sure to let you know. > > JB > > > >> John, >> >> Here's my understanding of what may be happening: >> * pvclient has done a gather data information and is waiting to >> receive that data >> * pvserver0 has received this "gather data" request is asking all >> satellites to gather data >> * pvserver1 also received that "gather data" request but before is >> starts processing it, pv1 needs to pass on the message to it's "child" >> i.e process 3 (this is the fancy tree based message communication that >> we are now using. So now, instead of the root node sending the message >> to all processes one after the other, it uses a tree structure). >> * pvserver2 I believe is happily waiting for the next message. It >> already processed the "gather data" request, sent the response to the >> root (although root has not processed that response yet) and now is >> waiting for the next request. >> * pvserver3 is the rogue. It's stuck in "Cancel", hence it won't >> receive any messages other send to it. This cancel was not done as a >> part of this gather data request but was done at the end of some >> previous request. Thus it's not yet able to receive the "gather data" >> request pvserver1 is trying to send, consequently freezing pvserver1. >> >> Of course, this is just one possible explanation. I've attached a >> patch. Can you please test if this overcomes the issue. If not, you >> may also want to try by connecting the "Cancel" out all together. That >> will at the least help us narrow down the problem. >> >> Utkarsh >> >> >> On Tue, Feb 10, 2009 at 2:56 AM, John Biddiscombe <biddi...@cscs.ch> >> wrote: >> >>> >>> I've been having problems with paraview 3.5 (CVS) since I started working >>> on >>> a parallel problem last week (which means it may have existed for some >>> time, >>> but I was doing other things). >>> >>> How to reproduce the problem >>> Start pvserver on 4 (or more) nodes and pvclient on 1 >>> Create Sources/wavelet >>> ParaView hangs indefinitley without showing bounding box of cube. >>> >>> Reproducibility : not always (3 out of 4 times - for me). Sometimes >>> paraview >>> completes as usual, but shows other hanging symptoms later on. >>> >>> ParaView 3.4 does not have this problem. >>> >>> Something seems to have changed between 3.4 and 3.5 which is affecting >>> the >>> client server delivery of data. It appears to be an MPI related issue. I >>> have attached the debugger to all pvserver nodes and the stack traces are >>> shown below >>> >>> To summarize : >>> pvserver 3 : Cancelled a request >>> pvserver 2 : waiting in ReceiveDataInternal >>> pvserver 1 : still in vtkMPICommunicatorSendData<char> >>> pvserver 0 : still in vtkMPICommunicatorSendData<char> >>> pvclient : trying to Receive >>> >>> It seems that one of the pvserver nodes has given up sending, or has >>> nothing >>> to send and the others are waiting without end. >>> >>> Notes 1: It took me time to go from one node to the other and attach gdb, >>> so >>> if I stopped one task - another might have been affected before it had >>> its >>> stack trace dumped. I'm not very expert at gdb. >>> >>> Notes 2: ParaView 3.4 seems to work flawlessly. Something is different in >>> 3.5 >>> >>> Notes 3: I ran the b_eff_io ( >>> https://fs.hlrs.de/projects/par/mpi//b_eff_io/ >>> - NB. link unreliable) on 15 nodes and it completed without error and >>> without any unusual behaviuor, so my instinct is that our hpmpi is >>> working >>> ok. >>> >>> Questions : >>> 1) Has anyone else observed this behaviour? >>> 2) Has anyone changed anything in the mpi-commmunicator code which might >>> have caused this behaviour >>> 3) It's possible we have a network problem and this is causing the >>> locking, >>> but our logs do not show any errors - can we rule this out? >>> 4) If anyone has answered yes to 1/2, do they know what's wrong and can >>> they >>> fix it? >>> >>> I welcome help as this is preventing me finishing my current project. >>> >>> JB >>> >>> >>> Stack trace for pvserver 3 >>> ========================== >>> >>> #0 0x0000003dbd4afba9 in sched_yield () from /lib64/tls/libc.so.6 >>> #1 0x0000002a9a725a97 in hpmp_yield () from >>> /opt/hpmpi/lib/linux_amd64/libmpi.so.1 >>> #2 0x0000002a9a71f3b4 in hpmp_adv () from >>> /opt/hpmpi/lib/linux_amd64/libmpi.so.1 >>> #3 0x0000002a9a757012 in hpmp_waitany () from >>> /opt/hpmpi/lib/linux_amd64/libmpi.so.1 >>> #4 0x0000002a9a756cf0 in VMPI_Waitany () from >>> /opt/hpmpi/lib/linux_amd64/libmpi.so.1 >>> #5 0x0000002a9a753a9e in VMPI_Wait () from >>> /opt/hpmpi/lib/linux_amd64/libmpi.so.1 >>> #6 0x0000002a9a754520 in VMPI_Cancel () from >>> /opt/hpmpi/lib/linux_amd64/libmpi.so.1 >>> #7 0x0000002a99e27045 in vtkMPICommunicator::Request::Cancel >>> (this=0xacf740) at >>> /users/biddisco/code/pv-meshless/VTK/Parallel/vtkMPICommunicator.cxx:973 >>> #8 0x0000002a95639e36 in vtkPVProgressHandler::CleanupSatellites >>> (this=0xae8dd0) at >>> >>> /users/biddisco/code/pv-meshless/Servers/Common/vtkPVProgressHandler.cxx:399 >>> #9 0x0000002a95639c85 in vtkPVProgressHandler::CleanupPendingProgress >>> (this=0xae8dd0) at >>> >>> /users/biddisco/code/pv-meshless/Servers/Common/vtkPVProgressHandler.cxx:337 >>> #10 0x0000002a956061ce in vtkProcessModule::CleanupPendingProgress >>> (this=0x590ee0) at >>> /users/biddisco/code/pv-meshless/Servers/Common/vtkProcessModule.cxx:1267 >>> #11 0x0000002a965b22f7 in vtkProcessModuleCommand (arlu=0x591d20, >>> ob=0x590ee0, method=0xb69dc9 "CleanupPendingProgress", m...@0x7fbfffdec0, >>> resultstre...@0x590330) >>> at >>> >>> /users/biddisco/build/pv-shared/Servers/Common/vtkProcessModuleClientServer.cxx:316 >>> #12 0x0000002a9995f4e0 in >>> vtkClientServerInterpreter::ProcessCommandInvoke >>> (this=0x591d20, c...@0x7fbfffe120, midx=0) >>> at >>> >>> /users/biddisco/code/pv-meshless/Utilities/VTKClientServer/vtkClientServerInterpreter.cxx:384 >>> #13 0x0000002a9995ecfc in vtkClientServerInterpreter::ProcessOneMessage >>> (this=0x591d20, c...@0x7fbfffe120, message=0) >>> at >>> >>> /users/biddisco/code/pv-meshless/Utilities/VTKClientServer/vtkClientServerInterpreter.cxx:214 >>> #14 0x0000002a9995ebe9 in vtkClientServerInterpreter::ProcessStream >>> (this=0x591d20, c...@0x7fbfffe120) >>> at >>> >>> /users/biddisco/code/pv-meshless/Utilities/VTKClientServer/vtkClientServerInterpreter.cxx:183 >>> #15 0x0000002a9995eb7b in vtkClientServerInterpreter::ProcessStream >>> (this=0x591d20, msg=0xb68e10 "\001\001", msgLength=48) >>> at >>> >>> /users/biddisco/code/pv-meshless/Utilities/VTKClientServer/vtkClientServerInterpreter.cxx:175 >>> #16 0x0000002a95658ee2 in vtkSelfConnection::ProcessStreamLocally >>> (this=0xad1a10, data=0xb68e10 "\001\001", length=48) at >>> /users/biddisco/code/pv-meshless/Servers/Common/vtkSelfConnection.cxx:128 >>> #17 0x0000002a955f5ca2 in vtkMPISelfConnectionProcessRMI >>> (localArg=0xad1a10, >>> remoteArg=0xb68e10, remoteArgLength=48) at >>> >>> /users/biddisco/code/pv-meshless/Servers/Common/vtkMPISelfConnection.cxx:38 >>> #18 0x0000002a99d665e9 in vtkMultiProcessController::ProcessRMI >>> (this=0x2a9eb49010, remoteProcessId=1, arg=0xb68e10, argLength=48, >>> rmiTag=397529) >>> at >>> >>> /users/biddisco/code/pv-meshless/VTK/Parallel/vtkMultiProcessController.cxx:551 >>> #19 0x0000002a99d66372 in vtkMultiProcessController::ProcessRMIs >>> (this=0x2a9eb49010, reportErrors=1, dont_loop=0) at >>> >>> /users/biddisco/code/pv-meshless/VTK/Parallel/vtkMultiProcessController.cxx:503 >>> #20 0x0000002a99d65d53 in vtkMultiProcessController::ProcessRMIs >>> (this=0x2a9eb49010) at >>> >>> /users/biddisco/code/pv-meshless/VTK/Parallel/vtkMultiProcessController.cxx:434 >>> #21 0x0000002a955f61e3 in vtkMPISelfConnection::InitializeSatellite >>> (this=0xad1a10) at >>> >>> /users/biddisco/code/pv-meshless/Servers/Common/vtkMPISelfConnection.cxx:154 >>> #22 0x0000002a955f6110 in vtkMPISelfConnection::Initialize >>> (this=0xad1a10, >>> argc=1, argv=0x590050, partitionId=0x7fbfffe5fc) >>> at >>> >>> /users/biddisco/code/pv-meshless/Servers/Common/vtkMPISelfConnection.cxx:113 >>> #23 0x0000002a955fa798 in vtkProcessModuleConnectionManager::Initialize >>> (this=0x89efd0, argc=1, argv=0x590050, clientMode=0, >>> partitionId=0x7fbfffe5fc) >>> at >>> >>> /users/biddisco/code/pv-meshless/Servers/Common/vtkProcessModuleConnectionManager.cxx:145 >>> #24 0x0000002a9560350e in vtkProcessModule::Start (this=0x590ee0, argc=1, >>> argv=0x590050) at >>> /users/biddisco/code/pv-meshless/Servers/Common/vtkProcessModule.cxx:316 >>> #25 0x0000002a95a9bd38 in vtkPVMain::Run (this=0x58fe00, >>> options=0x58fad0) >>> at /users/biddisco/code/pv-meshless/Servers/Filters/vtkPVMain.cxx:261 >>> #26 0x00000000004015fa in main (argc=1, argv=0x7fbfffe7f8) at >>> /users/biddisco/code/pv-meshless/Servers/Executables/pvserver.cxx:45 >>> >>> Stack trace for pvserver 2 >>> ========================== >>> >>> #0 0x0000003dbd4afba9 in sched_yield () from /lib64/tls/libc.so.6 >>> #1 0x0000002a9a725a97 in hpmp_yield () from >>> /opt/hpmpi/lib/linux_amd64/libmpi.so.1 >>> #2 0x0000002a9a71f3b4 in hpmp_adv () from >>> /opt/hpmpi/lib/linux_amd64/libmpi.so.1 >>> #3 0x0000002a9a766425 in recv_notfast () from >>> /opt/hpmpi/lib/linux_amd64/libmpi.so.1 >>> #4 0x0000002a9a765be4 in VMPI_Recv () from >>> /opt/hpmpi/lib/linux_amd64/libmpi.so.1 >>> #5 0x0000002a99e2460b in vtkMPICommunicator::ReceiveDataInternal >>> (this=0xad04f0, data=0x7fbfffe2c0 "Ù\020\006", length=512, sizeoftype=1, >>> remoteProcessId=-2, tag=1, info=0x7fbfffe170, useCopy=0, >>> sender...@0xad0538) at >>> /users/biddisco/code/pv-meshless/VTK/Parallel/vtkMPICommunicator.cxx:257 >>> #6 0x0000002a99e26889 in vtkMPICommunicator::ReceiveVoidArray >>> (this=0xad04f0, data=0x7fbfffe2c0, maxlength=512, type=3, >>> remoteProcessId=-1, tag=1) >>> at >>> /users/biddisco/code/pv-meshless/VTK/Parallel/vtkMPICommunicator.cxx:754 >>> #7 0x0000002a955f71c1 in vtkCommunicator::Receive (this=0xad04f0, >>> data=0x7fbfffe2c0 "Ù\020\006", maxlength=512, remoteHandle=-1, tag=1) >>> at /users/biddisco/code/pv-meshless/VTK/Parallel/vtkCommunicator.h:213 >>> #8 0x0000002a99d65da8 in vtkMultiProcessController::ProcessRMIs >>> (this=0x2a9eb49010, reportErrors=1, dont_loop=0) at >>> >>> /users/biddisco/code/pv-meshless/VTK/Parallel/vtkMultiProcessController.cxx:446 >>> #9 0x0000002a99d65d53 in vtkMultiProcessController::ProcessRMIs >>> (this=0x2a9eb49010) at >>> >>> /users/biddisco/code/pv-meshless/VTK/Parallel/vtkMultiProcessController.cxx:434 >>> #10 0x0000002a955f61e3 in vtkMPISelfConnection::InitializeSatellite >>> (this=0xad1a10) at >>> >>> /users/biddisco/code/pv-meshless/Servers/Common/vtkMPISelfConnection.cxx:154 >>> #11 0x0000002a955f6110 in vtkMPISelfConnection::Initialize >>> (this=0xad1a10, >>> argc=1, argv=0x590050, partitionId=0x7fbfffe5fc) >>> at >>> >>> /users/biddisco/code/pv-meshless/Servers/Common/vtkMPISelfConnection.cxx:113 >>> #12 0x0000002a955fa798 in vtkProcessModuleConnectionManager::Initialize >>> (this=0x89efd0, argc=1, argv=0x590050, clientMode=0, >>> partitionId=0x7fbfffe5fc) >>> at >>> >>> /users/biddisco/code/pv-meshless/Servers/Common/vtkProcessModuleConnectionManager.cxx:145 >>> #13 0x0000002a9560350e in vtkProcessModule::Start (this=0x590ee0, argc=1, >>> argv=0x590050) at >>> /users/biddisco/code/pv-meshless/Servers/Common/vtkProcessModule.cxx:316 >>> #14 0x0000002a95a9bd38 in vtkPVMain::Run (this=0x58fe00, >>> options=0x58fad0) >>> at /users/biddisco/code/pv-meshless/Servers/Filters/vtkPVMain.cxx:261 >>> #15 0x00000000004015fa in main (argc=1, argv=0x7fbfffe7f8) at >>> /users/biddisco/code/pv-meshless/Servers/Executables/pvserver.cxx:45 >>> >>> Stack trace for pvserver 1 >>> ========================== >>> >>> #0 0x0000003dbd4afba9 in sched_yield () from /lib64/tls/libc.so.6 >>> #1 0x0000002a9a725a97 in hpmp_yield () from >>> /opt/hpmpi/lib/linux_amd64/libmpi.so.1 >>> #2 0x0000002a9a71f3b4 in hpmp_adv () from >>> /opt/hpmpi/lib/linux_amd64/libmpi.so.1 >>> #3 0x0000002a9a75ae2d in hpmp_blksend () from >>> /opt/hpmpi/lib/linux_amd64/libmpi.so.1 >>> #4 0x0000002a9a758aff in VMPI_Ssend () from >>> /opt/hpmpi/lib/linux_amd64/libmpi.so.1 >>> #5 0x0000002a99e29bf0 in vtkMPICommunicatorSendData<char> >>> (data=0x7fbfffdf90 "Ù\020\006", length=57, sizeoftype=1, >>> remoteProcessId=3, >>> tag=1, datatype=0x2a9a923e40, Handle=0xadf4b0, useCopy=0, >>> useSsend=1) at >>> /users/biddisco/code/pv-meshless/VTK/Parallel/vtkMPICommunicator.cxx:223 >>> #6 0x0000002a99e2656b in vtkMPICommunicator::SendVoidArray >>> (this=0xad04f0, >>> data=0x7fbfffdf90, length=57, type=3, remoteProcessId=3, tag=1) >>> at >>> /users/biddisco/code/pv-meshless/VTK/Parallel/vtkMPICommunicator.cxx:716 >>> #7 0x0000002a955f3983 in vtkCommunicator::Send (this=0xad04f0, >>> data=0x7fbfffdf90 "Ù\020\006", length=57, remoteHandle=3, tag=1) >>> at /users/biddisco/code/pv-meshless/VTK/Parallel/vtkCommunicator.h:152 >>> #8 0x0000002a99d65b57 in vtkMultiProcessController::TriggerRMIInternal >>> (this=0x2a9eb49010, remoteProcessId=3, arg=0xb69c20, argLength=41, >>> rmiTag=397529, propagate=true) >>> at >>> >>> /users/biddisco/code/pv-meshless/VTK/Parallel/vtkMultiProcessController.cxx:397 >>> #9 0x0000002a99e2ad2c in vtkMPIController::TriggerRMIInternal >>> (this=0x2a9eb49010, remoteProcessId=3, arg=0xb69c20, argLength=41, >>> rmiTag=397529, propagate=true) >>> at >>> /users/biddisco/code/pv-meshless/VTK/Parallel/vtkMPIController.cxx:126 >>> #10 0x0000002a99d659b8 in >>> vtkMultiProcessController::TriggerRMIOnAllChildren >>> (this=0x2a9eb49010, arg=0xb69c20, argLength=41, rmiTag=397529) >>> at >>> >>> /users/biddisco/code/pv-meshless/VTK/Parallel/vtkMultiProcessController.cxx:343 >>> #11 0x0000002a99d6634d in vtkMultiProcessController::ProcessRMIs >>> (this=0x2a9eb49010, reportErrors=1, dont_loop=0) at >>> >>> /users/biddisco/code/pv-meshless/VTK/Parallel/vtkMultiProcessController.cxx:501 >>> #12 0x0000002a99d65d53 in vtkMultiProcessController::ProcessRMIs >>> (this=0x2a9eb49010) at >>> >>> /users/biddisco/code/pv-meshless/VTK/Parallel/vtkMultiProcessController.cxx:434 >>> #13 0x0000002a955f61e3 in vtkMPISelfConnection::InitializeSatellite >>> (this=0xad1a10) at >>> >>> /users/biddisco/code/pv-meshless/Servers/Common/vtkMPISelfConnection.cxx:154 >>> #14 0x0000002a955f6110 in vtkMPISelfConnection::Initialize >>> (this=0xad1a10, >>> argc=1, argv=0x590050, partitionId=0x7fbfffe5fc) >>> at >>> >>> /users/biddisco/code/pv-meshless/Servers/Common/vtkMPISelfConnection.cxx:113 >>> #15 0x0000002a955fa798 in vtkProcessModuleConnectionManager::Initialize >>> (this=0x89efd0, argc=1, argv=0x590050, clientMode=0, >>> partitionId=0x7fbfffe5fc) >>> at >>> >>> /users/biddisco/code/pv-meshless/Servers/Common/vtkProcessModuleConnectionManager.cxx:145 >>> #16 0x0000002a9560350e in vtkProcessModule::Start (this=0x590ee0, argc=1, >>> argv=0x590050) at >>> /users/biddisco/code/pv-meshless/Servers/Common/vtkProcessModule.cxx:316 >>> #17 0x0000002a95a9bd38 in vtkPVMain::Run (this=0x58fe00, >>> options=0x58fad0) >>> at /users/biddisco/code/pv-meshless/Servers/Filters/vtkPVMain.cxx:261 >>> #18 0x00000000004015fa in main (argc=1, argv=0x7fbfffe7f8) at >>> /users/biddisco/code/pv-meshless/Servers/Executables/pvserver.cxx:45 >>> >>> Stack trace for pvserver 0 >>> ========================== >>> >>> #0 0x0000003dbd4afba9 in sched_yield () from /lib64/tls/libc.so.6 >>> #1 0x0000002a9a725a97 in hpmp_yield () from >>> /opt/hpmpi/lib/linux_amd64/libmpi.so.1 >>> #2 0x0000002a9a71f3b4 in hpmp_adv () from >>> /opt/hpmpi/lib/linux_amd64/libmpi.so.1 >>> #3 0x0000002a9a75ae2d in hpmp_blksend () from >>> /opt/hpmpi/lib/linux_amd64/libmpi.so.1 >>> #4 0x0000002a9a758aff in VMPI_Ssend () from >>> /opt/hpmpi/lib/linux_amd64/libmpi.so.1 >>> #5 0x0000002a99e29bf0 in vtkMPICommunicatorSendData<char> >>> (data=0x7fbfffdc10 "m\234\a", length=62, sizeoftype=1, remoteProcessId=1, >>> tag=1, datatype=0x2a9a923e40, Handle=0xadf4b0, useCopy=0, >>> useSsend=1) at >>> /users/biddisco/code/pv-meshless/VTK/Parallel/vtkMPICommunicator.cxx:223 >>> #6 0x0000002a99e2656b in vtkMPICommunicator::SendVoidArray >>> (this=0xad04f0, >>> data=0x7fbfffdc10, length=62, type=3, remoteProcessId=1, tag=1) >>> at >>> /users/biddisco/code/pv-meshless/VTK/Parallel/vtkMPICommunicator.cxx:716 >>> #7 0x0000002a955f3983 in vtkCommunicator::Send (this=0xad04f0, >>> data=0x7fbfffdc10 "m\234\a", length=62, remoteHandle=1, tag=1) >>> at /users/biddisco/code/pv-meshless/VTK/Parallel/vtkCommunicator.h:152 >>> #8 0x0000002a99d65b57 in vtkMultiProcessController::TriggerRMIInternal >>> (this=0x2a9eb49010, remoteProcessId=1, arg=0xb6fed0, argLength=46, >>> rmiTag=498797, propagate=true) >>> at >>> >>> /users/biddisco/code/pv-meshless/VTK/Parallel/vtkMultiProcessController.cxx:397 >>> #9 0x0000002a99e2ad2c in vtkMPIController::TriggerRMIInternal >>> (this=0x2a9eb49010, remoteProcessId=1, arg=0xb6fed0, argLength=46, >>> rmiTag=498797, propagate=true) >>> at >>> /users/biddisco/code/pv-meshless/VTK/Parallel/vtkMPIController.cxx:126 >>> #10 0x0000002a99d659b8 in >>> vtkMultiProcessController::TriggerRMIOnAllChildren >>> (this=0x2a9eb49010, arg=0xb6fed0, argLength=46, rmiTag=498797) >>> at >>> >>> /users/biddisco/code/pv-meshless/VTK/Parallel/vtkMultiProcessController.cxx:343 >>> #11 0x0000002a955f6716 in vtkMPISelfConnection::GatherInformationRoot >>> (this=0xad1a10, info=0xb6ac00, id={ID = 560}) at >>> >>> /users/biddisco/code/pv-meshless/Servers/Common/vtkMPISelfConnection.cxx:290 >>> #12 0x0000002a955f6683 in vtkMPISelfConnection::GatherInformation >>> (this=0xad1a10, serverFlags=1, info=0xb6ac00, id={ID = 560}) >>> at >>> >>> /users/biddisco/code/pv-meshless/Servers/Common/vtkMPISelfConnection.cxx:275 >>> #13 0x0000002a955fc66b in >>> vtkProcessModuleConnectionManager::GatherInformation (this=0x89efd0, >>> connectionID=1, serverFlags=1, info=0xb6ac00, id={ID = 560}) >>> at >>> >>> /users/biddisco/code/pv-meshless/Servers/Common/vtkProcessModuleConnectionManager.cxx:565 >>> #14 0x0000002a95603311 in vtkProcessModule::GatherInformation >>> (this=0x590ee0, connectionID=1, serverFlags=1, info=0xb6ac00, id={ID = >>> 560}) >>> at >>> /users/biddisco/code/pv-meshless/Servers/Common/vtkProcessModule.cxx:293 >>> #15 0x0000002a955f2db6 in vtkClientConnection::SendInformation >>> (this=0xae4be0, stre...@0x7fbfffe130) at >>> >>> /users/biddisco/code/pv-meshless/Servers/Common/vtkClientConnection.cxx:398 >>> #16 0x0000002a955f1d9f in vtkClientConnectionGatherInformationRMI >>> (localArg=0xae4be0, remoteArg=0xb6b3b0, remoteArgLength=46) >>> at >>> >>> /users/biddisco/code/pv-meshless/Servers/Common/vtkClientConnection.cxx:109 >>> #17 0x0000002a99d665e9 in vtkMultiProcessController::ProcessRMI >>> (this=0x2a9eb6b010, remoteProcessId=1, arg=0xb6b3b0, argLength=46, >>> rmiTag=838491) >>> at >>> >>> /users/biddisco/code/pv-meshless/VTK/Parallel/vtkMultiProcessController.cxx:551 >>> #18 0x0000002a99d66372 in vtkMultiProcessController::ProcessRMIs >>> (this=0x2a9eb6b010, reportErrors=0, dont_loop=1) at >>> >>> /users/biddisco/code/pv-meshless/VTK/Parallel/vtkMultiProcessController.cxx:503 >>> #19 0x0000002a9565235e in vtkRemoteConnection::ProcessCommunication >>> (this=0xae4be0) at >>> >>> /users/biddisco/code/pv-meshless/Servers/Common/vtkRemoteConnection.cxx:75 >>> #20 0x0000002a955fc046 in >>> vtkProcessModuleConnectionManager::MonitorConnections (this=0x89efd0, >>> msec=0) at >>> >>> /users/biddisco/code/pv-meshless/Servers/Common/vtkProcessModuleConnectionManager.cxx:430 >>> #21 0x0000002a95603a62 in vtkProcessModule::StartServer (this=0x590ee0, >>> msec=0) at >>> /users/biddisco/code/pv-meshless/Servers/Common/vtkProcessModule.cxx:438 >>> #22 0x0000002a95603602 in vtkProcessModule::Start (this=0x590ee0, argc=1, >>> argv=0x590050) at >>> /users/biddisco/code/pv-meshless/Servers/Common/vtkProcessModule.cxx:349 >>> #23 0x0000002a95a9bd38 in vtkPVMain::Run (this=0x58fe00, >>> options=0x58fad0) >>> at /users/biddisco/code/pv-meshless/Servers/Filters/vtkPVMain.cxx:261 >>> #24 0x00000000004015fa in main (argc=1, argv=0x7fbfffe7f8) at >>> /users/biddisco/code/pv-meshless/Servers/Executables/pvserver.cxx:45 >>> >>> Stack trace for pvclient >>> ======================== >>> #0 0x0000003dbdb0b5b4 in recv () from /lib64/tls/libpthread.so.0 >>> #1 0x0000002aa0b3d77f in vtkSocket::Receive (this=0x116ed70, >>> data=0x7fbfffc2cc, length=4, readFully=1) >>> at /users/biddisco/code/pv-meshless/VTK/Common/vtkSocket.cxx:381 >>> #2 0x0000002a9e039632 in vtkSocketCommunicator::ReceiveTagged ( >>> this=0x1773fd0, data=0x7fbfffc4dc, wordSize=4, numWords=1, tag=838492, >>> logName=0x1b8d3d8 "Int32") >>> at >>> >>> /users/biddisco/code/pv-meshless/VTK/Parallel/vtkSocketCommunicator.cxx:701 >>> #3 0x0000002a9e0369b5 in vtkSocketCommunicator::ReceiveVoidArray ( >>> this=0x1773fd0, data=0x7fbfffc4dc, length=1, type=6, >>> remoteProcessId=1, >>> tag=838492) >>> at >>> >>> /users/biddisco/code/pv-meshless/VTK/Parallel/vtkSocketCommunicator.cxx:282 >>> #4 0x0000002a98e85455 in vtkCommunicator::Receive (this=0x1773fd0, >>> data=0x7fbfffc4dc, maxlength=1, remoteHandle=1, tag=838492) >>> at /users/biddisco/code/pv-meshless/VTK/Parallel/vtkCommunicator.h:203 >>> #5 0x0000002a98e853f0 in vtkMultiProcessController::Receive >>> (this=0x172fe40, >>> data=0x7fbfffc4dc, length=1, remoteProcessId=1, tag=838492) >>> at >>> >>> /users/biddisco/code/pv-meshless/VTK/Parallel/vtkMultiProcessController.h:1139 >>> #6 0x0000002a9b494d69 in >>> vtkServerConnection::GatherInformationFromController >>> (this=0x11d97d0, controller=0x172fe40, info=0x1b77250, id={ID = 560}) >>> ---Type <return> to continue, or q <return> to quit--- >>> at >>> >>> /users/biddisco/code/pv-meshless/Servers/Common/vtkServerConnection.cxx:341 >>> #7 0x0000002a9b494c5f in vtkServerConnection::GatherInformation ( >>> this=0x11d97d0, serverFlags=1, info=0x1b77250, id={ID = 560}) >>> at >>> >>> /users/biddisco/code/pv-meshless/Servers/Common/vtkServerConnection.cxx:311 >>> #8 0x0000002a9b43666b in >>> vtkProcessModuleConnectionManager::GatherInformation >>> (this=0x681de0, connectionID=5, serverFlags=1, info=0x1b77250, id= >>> {ID = 560}) >>> at >>> >>> /users/biddisco/code/pv-meshless/Servers/Common/vtkProcessModuleConnectionManager.cxx:565 >>> #9 0x0000002a9b43d311 in vtkProcessModule::GatherInformation >>> (this=0x5bd330, >>> connectionID=5, serverFlags=1, info=0x1b77250, id={ID = 560}) >>> at >>> /users/biddisco/code/pv-meshless/Servers/Common/vtkProcessModule.cxx:293 >>> #10 0x0000002a986919dc in vtkSMOutputPort::GatherDataInformation ( >>> this=0x1b76ec0) >>> at >>> >>> /users/biddisco/code/pv-meshless/Servers/ServerManager/vtkSMOutputPort.cxx:233 >>> #11 0x0000002a98691756 in vtkSMOutputPort::GetDataInformation >>> (this=0x1b76ec0) >>> at >>> >>> /users/biddisco/code/pv-meshless/Servers/ServerManager/vtkSMOutputPort.cxx:192 >>> #12 0x0000002a987069a1 in vtkSMSourceProxy::GetDataInformation ( >>> this=0x1b57ad0, idx=0) >>> ---Type <return> to continue, or q <return> to quit--- >>> at >>> >>> /users/biddisco/code/pv-meshless/Servers/ServerManager/vtkSMSourceProxy.cxx:615 >>> #13 0x0000002a95d6b1ee in pqOutputPort::getDataInformation >>> (this=0x1b6e6f0) >>> at /users/biddisco/code/pv-meshless/Qt/Core/pqOutputPort.cxx:112 >>> #14 0x0000002a957f4652 in pqDataInformationModel::dataUpdated >>> (this=0x11587a0, >>> changedSource=0x1b6e3b0) >>> at >>> >>> /users/biddisco/code/pv-meshless/Qt/Components/pqDataInformationModel.cxx:492 >>> #15 0x0000002a95966898 in pqDataInformationModel::qt_metacall >>> (this=0x11587a0, >>> _c=QMetaObject::InvokeMetaMethod, _id=3, _a=0x7fbfffc940) >>> at >>> >>> /users/biddisco/build/pv-shared/Qt/Components/moc_pqDataInformationModel.cxx:77 >>> #16 0x0000002a9774322f in QMetaObject::activate (sender=0x1b6e3b0, >>> from_signal_index=14, to_signal_index=14, argv=Variable "argv" is not >>> available. >>> ) at kernel/qobject.cpp:3007 >>> #17 0x0000002a95de65f9 in pqPipelineSource::dataUpdated (this=0x1b6e3b0, >>> _t1=0x1b6e3b0) >>> at >>> /users/biddisco/build/pv-shared/Qt/Core/moc_pqPipelineSource.cxx:178 >>> #18 0x0000002a95d74479 in pqPipelineSource::dataUpdated (this=0x1b6e3b0) >>> at /users/biddisco/code/pv-meshless/Qt/Core/pqPipelineSource.cxx:159 >>> #19 0x0000002a95de6303 in pqPipelineSource::qt_metacall (this=0x1b6e3b0, >>> _c=QMetaObject::InvokeMetaMethod, _id=16, _a=0x7fbfffca70) >>> at >>> /users/biddisco/build/pv-shared/Qt/Core/moc_pqPipelineSource.cxx:118 >>> #20 0x0000002a9774322f in QMetaObject::activate (sender=0x1b6ec60, >>> ---Type <return> to continue, or q <return> to quit--- >>> from_signal_index=4, to_signal_index=4, argv=Variable "argv" is not >>> available. >>> ) at kernel/qobject.cpp:3007 >>> #21 0x0000002a97ba3850 in vtkQtConnection::EmitExecute (this=0x1b6ec60, >>> _t1=0x1b57ad0, _t2=75, _t3=0x0, _t4=0x0, _t5=0x1b6e820) >>> at >>> >>> /users/biddisco/build/pv-shared/VTK/GUISupport/Qt/moc_vtkQtConnection.cxx:77 >>> #22 0x0000002a97b7b395 in vtkQtConnection::Execute (this=0x1b6ec60, >>> caller=0x1b57ad0, e=75, call_data=0x0) >>> at >>> /users/biddisco/code/pv-meshless/VTK/GUISupport/Qt/vtkQtConnection.cxx:72 >>> #23 0x0000002a97b7b327 in vtkQtConnection::DoCallback (vtk_obj=0x1b57ad0, >>> event=75, client_data=0x1b6ec60, call_data=0x0) >>> at >>> /users/biddisco/code/pv-meshless/VTK/GUISupport/Qt/vtkQtConnection.cxx:62 >>> #24 0x0000002aa0a1ad9e in vtkCallbackCommand::Execute (this=0x1b6e820, >>> caller=0x1b57ad0, event=75, callData=0x0) >>> at >>> /users/biddisco/code/pv-meshless/VTK/Common/vtkCallbackCommand.cxx:42 >>> #25 0x0000002aa0afa433 in vtkSubjectHelper::InvokeEvent (this=0x1b65de0, >>> event=75, callData=0x0, self=0x1b57ad0) >>> at /users/biddisco/code/pv-meshless/VTK/Common/vtkObject.cxx:602 >>> #26 0x0000002aa0afa8ea in vtkObject::InvokeEvent (this=0x1b57ad0, >>> event=75, >>> callData=0x0) >>> at /users/biddisco/code/pv-meshless/VTK/Common/vtkObject.cxx:770 >>> #27 0x0000002a986b0b59 in vtkSMProxy::PostUpdateData (this=0x1b57ad0) >>> ---Type <return> to continue, or q <return> to quit--- >>> at >>> >>> /users/biddisco/code/pv-meshless/Servers/ServerManager/vtkSMProxy.cxx:1726 >>> #28 0x0000002a987064b4 in vtkSMSourceProxy::PostUpdateData >>> (this=0x1b57ad0) >>> at >>> >>> /users/biddisco/code/pv-meshless/Servers/ServerManager/vtkSMSourceProxy.cxx:521 >>> #29 0x0000002a98705955 in vtkSMSourceProxy::UpdatePipeline >>> (this=0x1b57ad0, >>> time=0) >>> at >>> >>> /users/biddisco/code/pv-meshless/Servers/ServerManager/vtkSMSourceProxy.cxx:305 >>> #30 0x0000002a95d7445e in pqPipelineSource::updatePipeline >>> (this=0x1b6e3b0) >>> at /users/biddisco/code/pv-meshless/Qt/Core/pqPipelineSource.cxx:153 >>> #31 0x0000002a95d35468 in pqDisplayPolicy::getPreferredViewType ( >>> this=0xb90e10, opPort=0x1b6e6f0, update_pipeline=true) >>> at /users/biddisco/code/pv-meshless/Qt/Core/pqDisplayPolicy.cxx:74 >>> #32 0x0000002a95d3599d in pqDisplayPolicy::getPreferredView >>> (this=0xb90e10, >>> opPort=0x1b6e6f0, currentView=0x1994dc0) >>> at /users/biddisco/code/pv-meshless/Qt/Core/pqDisplayPolicy.cxx:182 >>> #33 0x0000002a95d35ba6 in pqDisplayPolicy::createPreferredRepresentation >>> ( >>> this=0xb90e10, opPort=0x1b6e6f0, view=0x1994dc0, >>> dont_create_view=false) >>> at /users/biddisco/code/pv-meshless/Qt/Core/pqDisplayPolicy.cxx:234 >>> #34 0x0000002a95d6c9a3 in pqPendingDisplayManager::createPendingDisplays >>> ( >>> this=0xd16110, activeview=0x1994dc0) >>> at >>> /users/biddisco/code/pv-meshless/Qt/Core/pqPendingDisplayManager.cxx:178 >>> ---Type <return> to continue, or q <return> to quit--- >>> #35 0x0000002a95d6ccc1 in pqPendingDisplayManager::createPendingDisplays >>> ( >>> this=0xd16110) >>> at >>> /users/biddisco/code/pv-meshless/Qt/Core/pqPendingDisplayManager.cxx:255 >>> #36 0x0000002a95de598b in pqPendingDisplayManager::qt_metacall >>> (this=0xd16110, >>> _c=QMetaObject::InvokeMetaMethod, _id=5, _a=0x7fbfffd108) >>> at >>> >>> /users/biddisco/build/pv-shared/Qt/Core/moc_pqPendingDisplayManager.cxx:82 >>> #37 0x0000002a9774322f in QMetaObject::activate (sender=0x1120a90, >>> from_signal_index=28, to_signal_index=28, argv=Variable "argv" is not >>> available. >>> ) at kernel/qobject.cpp:3007 >>> #38 0x0000002a95970da6 in pqObjectInspectorWidget::accepted >>> (this=0x1120a90) >>> at >>> >>> /users/biddisco/build/pv-shared/Qt/Components/moc_pqObjectInspectorWidget.cxx:133 >>> #39 0x0000002a9589ba81 in pqObjectInspectorWidget::accept >>> (this=0x1120a90) >>> at >>> >>> /users/biddisco/code/pv-meshless/Qt/Components/pqObjectInspectorWidget.cxx:517 >>> #40 0x0000002a95970c78 in pqObjectInspectorWidget::qt_metacall ( >>> this=0x1120a90, _c=QMetaObject::InvokeMetaMethod, _id=9, >>> _a=0x7fbfffd300) >>> at >>> >>> /users/biddisco/build/pv-shared/Qt/Components/moc_pqObjectInspectorWidget.cxx:107 >>> #41 0x0000002a9774322f in QMetaObject::activate (sender=0x1123a20, >>> from_signal_index=29, to_signal_index=30, argv=Variable "argv" is not >>> available. >>> ) at kernel/qobject.cpp:3007 >>> #42 0x0000002a96f0e6b7 in QAbstractButton::clicked (this=Variable "this" >>> is >>> not available. >>> ) >>> at .moc/release-shared/moc_qabstractbutton.cpp:185 >>> ---Type <return> to continue, or q <return> to quit--- >>> #43 0x0000002a96c7bdae in QAbstractButtonPrivate::emitClicked >>> (this=0x1123a50) >>> at widgets/qabstractbutton.cpp:544 >>> #44 0x0000002a96c7c5ba in QAbstractButtonPrivate::click (this=0x1123a50) >>> at widgets/qabstractbutton.cpp:537 >>> #45 0x0000002a96c7c801 in QAbstractButton::mouseReleaseEvent >>> (this=0x1123a20, >>> e=0x7fbfffdad0) at widgets/qabstractbutton.cpp:1116 >>> #46 0x0000002a96992bfc in QWidget::event (this=0x1123a20, >>> event=0x7fbfffdad0) >>> at kernel/qwidget.cpp:7021 >>> #47 0x0000002a96c7bcc2 in QAbstractButton::event (this=0x1123a20, >>> e=Variable >>> "e" is not available. >>> ) >>> at widgets/qabstractbutton.cpp:1078 >>> #48 0x0000002a96d1ace6 in QPushButton::event (this=0x1123a20, >>> e=0x7fbfffdad0) >>> at widgets/qpushbutton.cpp:658 >>> #49 0x0000002a969428f0 in QApplicationPrivate::notify_helper >>> (this=0x55b870, >>> receiver=0x1123a20, e=0x7fbfffdad0) at kernel/qapplication.cpp:3800 >>> #50 0x0000002a9694335e in QApplication::notify (this=Variable "this" is >>> not >>> available. >>> ) >>> at kernel/qapplication.cpp:3527 >>> #51 0x0000002a977323c7 in QCoreApplication::notifyInternal >>> (this=0x7fbfffe720, >>> receiver=0x1123a20, event=0x7fbfffdad0) at >>> kernel/qcoreapplication.cpp:591 >>> #52 0x0000002a96944afc in QApplicationPrivate::sendMouseEvent ( >>> receiver=0x1123a20, event=0x7fbfffdad0, alienWidget=0x1123a20, >>> nativeWidget=0x105fbf0, buttonDown=Variable "buttonDown" is not >>> available. >>> ) >>> at >>> ../../include/QtCore/../../src/corelib/kernel/qcoreapplication.h:218 >>> #53 0x0000002a969ad76a in QETWidget::translateMouseEvent (this=0x105fbf0, >>> ---Type <return> to continue, or q <return> to quit--- >>> event=Variable "event" is not available. >>> ) at kernel/qapplication_x11.cpp:4047 >>> #54 0x0000002a969ac31d in QApplication::x11ProcessEvent >>> (this=0x7fbfffe720, >>> event=0x7fbfffe3a0) at kernel/qapplication_x11.cpp:3244 >>> #55 0x0000002a969d0612 in x11EventSourceDispatch (s=0x55ebe0, callback=0, >>> user_data=0x0) >>> at >>> ../../include/QtCore/../../src/corelib/kernel/qcoreapplication.h:104 >>> #56 0x0000003dc0026606 in g_main_context_dispatch () >>> from /usr/lib64/libglib-2.0.so.0 >>> #57 0x0000003dc002821e in g_main_context_acquire () >>> from /usr/lib64/libglib-2.0.so.0 >>> #58 0x0000003dc002873f in g_main_context_iteration () >>> from /usr/lib64/libglib-2.0.so.0 >>> #59 0x0000002a9775c060 in QEventDispatcherGlib::processEvents >>> (this=0x55c940, >>> flags={i = 4}) at kernel/qeventdispatcher_glib.cpp:327 >>> #60 0x0000002a969d0009 in QGuiEventDispatcherGlib::processEvents >>> (this=Variable "this" is not available. >>> ) >>> at ../../include/QtCore/../../src/corelib/global/qglobal.h:1915 >>> #61 0x0000002a97731a23 in QEventLoop::processEvents (this=Variable "this" >>> is >>> not available. >>> ) >>> at ../../include/QtCore/../../src/corelib/global/qglobal.h:1915 >>> #62 0x0000002a97731bd2 in QEventLoop::exec (this=0x7fbfffe670, flags={i = >>> 0}) >>> at ../../include/QtCore/../../src/corelib/global/qglobal.h:1931 >>> #63 0x0000002a977361d8 in QCoreApplication::exec () >>> at ../../include/QtCore/../../src/corelib/global/qglobal.h:1916 >>> #64 0x0000000000404139 in main (argc=2, argv=0x7fbfffe828) >>> ---Type <return> to continue, or q <return> to quit--- >>> at /users/biddisco/code/pv-meshless/Applications/Client/main.cxx:80 >>> >>> >>> _______________________________________________ >>> ParaQ-Developer mailing list >>> paraq-develo...@paraview.org >>> http://public.kitware.com/cgi-bin/mailman/listinfo/paraq-developer >>> >>> > > > -- > John Biddiscombe, email:biddisco @ cscs.ch > http://www.cscs.ch/ > CSCS, Swiss National Supercomputing Centre | Tel: +41 (91) 610.82.07 > Via Cantonale, 6928 Manno, Switzerland | Fax: +41 (91) 610.82.82 > > > _______________________________________________ Powered by www.kitware.com
Visit other Kitware open-source projects at http://www.kitware.com/opensource/opensource.html Please keep messages on-topic and check the ParaView Wiki at: http://paraview.org/Wiki/ParaView Follow this link to subscribe/unsubscribe: http://www.paraview.org/mailman/listinfo/paraview