Hi Everyone,
We have recently moved our ND 4 production environment from one physical
server to another. Th new box was configured exactly the same way as the old
one (OS version, SP, IIS, ND ). The only difference between the 2 boxes is
the hardware - we moved from a smaller (2CPU/1GB RAM) to a bigger (4CPU/2GB
RAM) box. Our problem is that the ND App Server has been extremely unstable
and has been going down every single day.
The ndDefaultPartition log has the following errors:
1266 Nov 01, 1999 at 17:42:56.468 Critical Thread-8
CPService
netdyn.services.pe.client.CNdPEProxyImpl:c:941500155740:w:941500156906:Proxy
: bogus worker in reservation context
org.omg.CORBA.COMM_FAILURE[completed=MAYBE, reason=java.net.SocketException:
Connection reset by peer]
1267 Nov 01, 1999 at 17:42:56.515 Warning Thread-8 CPService
netdyn.services.pe.client.CNdPEProxyImpl:c:941500155740:w:941500156906:getSe
rvice: cannot locate service PEServiceexception CNdNoServiceException{string
reason="no service matching properties";}
1268 Nov 01, 1999 at 17:42:56.531 Warning Thread-8 CPService
netdyn.services.pe.client.CNdPEProxyImpl:c:941500155740:w:941500156906:getSe
rvice: cannot locate service PEServiceexception CNdNoServiceException{string
reason="no service matching properties";}
1269 Nov 01, 1999 at 17:42:56.531 Warning Thread-8 CPService
netdyn.services.pe.client.CNdPEProxyImpl:c:941500155740:w:941500156906:getSe
rvice: cannot locate service PEServiceexception CNdNoServiceException{string
reason="no service matching properties";}
1270 Nov 01, 1999 at 17:42:56.546 Warning Thread-8 CPService
netdyn.services.pe.client.CNdPEProxyImpl:c:941500155740:w:941500156906:getSe
rvice: cannot locate service PEServiceexception CNdNoServiceException{string
reason="no service matching properties";}
1271 Nov 01, 1999 at 17:44:07.31 Warning Thread-167
ServiceManager
netdyn.cosi.locator.CNdServiceLocatorProxy:managerContext:handleUserExceptio
n: exception CNdNoServiceException{string reason="bind: ServiceLocator ior
is NULL for 0";}
1272 Nov 01, 1999 at 17:44:07.31 Error Thread-167
ServiceManager
netdyn.cosi.manager.CNdSMControlImpl:managerContext:registerServices:
exception CNdNoServiceException{string reason="bind: ServiceLocator ior is
NULL for 0";}
1273 Nov 01, 1999 at 17:44:07.62 Warning Thread-167
ServiceManager netdyn.services.log.client.CNdLogProxy:managerContext:Proxy:
failed to release worker exception CNdInvalidStateException{TNdObjectState
state=TERMINATED_STATE;string reason="operation:
LogService.INdService.releaseWorkerdoes not transition from TERMINATED_STATE
to TERMINATED_STATE";}
1274 Nov 01, 1999 at 17:44:07.62 Error Thread-167
ServiceManager
netdyn.services.log.client.CNdLogProxy:managerContext:getService: exception
CNdInvalidStateException{TNdObjectState state=TERMINATED_STATE;string
reason="operation: ServiceLocator.INdLocator.getServicedoes not transition
from TERMINATED_STATE to TERMINATED_STATE";}
1275 Nov 01, 1999 at 17:44:07.62 Warning Thread-167
ServiceManager netdyn.services.log.client.CNdLogProxy:managerContext:Proxy:
failed to release worker exception CNdInvalidStateException{TNdObjectState
state=TERMINATED_STATE;string reason="operation:
LogService.INdService.releaseWorkerdoes not transition from TERMINATED_STATE
to TERMINATED_STATE";}
1276 Nov 01, 1999 at 17:44:07.46 Warning
manager.CNdSMBackgroundThread ServiceManager
netdyn.cosi.locator.CNdServiceLocatorProxy:CNdCOSIThread:
manager.CNdSMBackgroundThread:handleUserException: exception
CNdServiceMismatchException{string reason="manager
192.6.35.43.DefaultPartition.ServiceManager no longer exists";}
In the smDefaultPartition log, we see the following:
Full thread dump:
e> "Thread-14" (TID:0x1d02c60, sys_thread_t:0x6ddc80, Win32ID:0x226,
state:R) prio=5
e> java.net.SocketInputStream.read(Compiled Code)
e> com.visigenic.vbroker.orb.TcpConnection.read(Compiled Code)
e>
com.visigenic.vbroker.orb.GiopConnectionImpl.receive_message(Compiled Code)
e> com.visigenic.vbroker.orb.GiopProtocolAdapter.readMessage(Compiled
Code)
e> com.visigenic.vbroker.orb.ThreadPoolDispatcher.run(Compiled Code)
e> com.visigenic.vbroker.orb.WorkerThread.run(Compiled Code)
e> "Thread-13" (TID:0x1d7bae8, sys_thread_t:0x6dedb0, Win32ID:0x1f5,
state:CW) prio=5
e> java.lang.Object.wait(Compiled Code)
e> com.visigenic.vbroker.orb.WorkerThread.run(Compiled Code)
e> "Thread-12" (TID:0x1cca5d8, sys_thread_t:0x6de410, Win32ID:0x1ae,
state:R) prio=5
e> java.net.SocketInputStream.read(Compiled Code)
e> com.visigenic.vbroker.orb.TcpConnection.read(Compiled Code)
e>
com.visigenic.vbroker.orb.GiopConnectionImpl.receive_message(Compiled Code)
e> com.visigenic.vbroker.orb.GiopProtocolAdapter.readMessage(Compiled
Code)
e> com.visigenic.vbroker.orb.ThreadPoolDispatcher.run(Compiled Code)
e> com.visigenic.vbroker.orb.WorkerThread.run(Compiled Code)
e> "Thread-8" (TID:0x1dd2b18, sys_thread_t:0x6964c0, Win32ID:0x1f9,
state:CW) prio=5
e> java.lang.Object.wait(Compiled Code)
e> com.visigenic.vbroker.orb.WorkerThread.run(Compiled Code)
e> "CSpDataCacheMaintainer" (TID:0x1dcebd8, sys_thread_t:0x668430,
Win32ID:0x1dd, state:CW) prio=5
e> spider.database.cache.CSpDataCacheMaintainer.doRun(Compiled Code)
e> spider.util.CSpThread.run(CSpThread.java)
e> "CNdTimer" (TID:0x1dc3e08, sys_thread_t:0x649c10, Win32ID:0x213,
state:CW) prio=5
e> netdyn.cosi.common.CNdTimer.run(Compiled Code)
e> "Thread-4" (TID:0x1dc2f60, sys_thread_t:0x637210, Win32ID:0x189,
state:R) prio=5
e> java.net.PlainSocketImpl.accept(PlainSocketImpl.java:379)
e> java.net.ServerSocket.implAccept(ServerSocket.java:198)
e> java.net.ServerSocket.accept(ServerSocket.java:181)
e> com.visigenic.vbroker.orb.TcpSocket.doAccept(TcpSocket.java:41)
e> com.visigenic.vbroker.orb.TcpListener.accept(TcpListener.java:47)
e> com.visigenic.vbroker.orb.NormalAdapterListener.run(Compiled Code)
e> java.lang.Thread.run(Thread.java:466)
e> "GarbageCollector" (TID:0x1dc2958, sys_thread_t:0x63bed0,
Win32ID:0x14f, state:CW) prio=5
e> com.visigenic.vbroker.orb.GarbageCollector.run(Compiled Code)
e> "AreYouAlive" (TID:0x1dc24c8, sys_thread_t:0x634a70, Win32ID:0x220,
state:CW) prio=5
e> com.visigenic.vbroker.ds.DSUser$AreYouAlive.run(Compiled Code)
e> "Thread-1" (TID:0x1dc1ff0, sys_thread_t:0x63a7c0, Win32ID:0x1e1,
state:R) prio=5
e> java.net.DatagramSocket.receive(Compiled Code)
e> com.visigenic.vbroker.ds.DSUser$DatagramThread.run(Compiled Code)
e> "Finalizer thread" (TID:0x1dbc088, sys_thread_t:0x623680,
Win32ID:0x24f, state:CW) prio=2
e> "main" (TID:0x1dbc0b0, sys_thread_t:0x6209b0, Win32ID:0x24b,
state:CW) prio=5
e> java.lang.Object.wait(Compiled Code)
e> com.visigenic.vbroker.orb.AdapterImpl.impl_is_ready(Compiled Code)
e> netdyn.cosi.common.CNdVisiOrb.impl_is_ready(CNdVisiOrb.java)
e> netdyn.cosi.common.CNdListener.listen(Compiled Code)
e> netdyn.cosi.common.CNdListener.listen(CNdListener.java)
e>
netdyn.cosi.common.CNdObjectFactoryImpl.listen(CNdObjectFactoryImpl.java)
e>
netdyn.cosi.common.CNdObjectFactoryImpl.main(CNdObjectFactoryImpl.java)
e> Monitor Cache Dump:
e> java.net.PlainSocketImpl@1DC2FA8/1E1B9F0: owner "Thread-4"
(0x637210, 1 entry)
e> com.visigenic.vbroker.orb.GarbageCollector@1DC2958/1E20630:
<unowned>
e> Waiters: 1
e> com.visigenic.vbroker.orb.WorkerThread@1D7BAE8/2451D90: <unowned>
e> Waiters: 1
e> java.net.PlainDatagramSocketImpl@1DC2118/1E1BBC0: owner "Thread-1"
(0x63a7c0, 1 entry)
e> java.net.DatagramPacket@1D7A158/24918D8: owner "Thread-1" (0x63a7c0,
1 entry)
e> com.visigenic.vbroker.ds.DSUser$AreYouAlive@1DC24C8/1E184D0:
<unowned>
e> Waiters: 1
e> <unknown key> (0x668430): <unowned>
e> Waiters: 1
e> com.visigenic.vbroker.orb.TPIiopAdapter@1DC2488/1E18870: <unowned>
e> Waiters: 1
e> netdyn.cosi.common.CNdTimer@1DC3E08/1E21F60: <unowned>
e> Waiters: 1
We have opened a call with NetDynamics Tech support who haven't come up with
anything concrete yet. Their latest advice to recopy our project over to the
production server. Somehow, I'm NOT convinced this will solve the problem.
If anyone has ANY clues as to what might be going wrong, I'd greatly
appreciate hearing from you.
Our configuration is as follows:
NT 4 SP4
ND 4.1.3.8 SP1
JDK 1.1.7B
MS IIS 4
Thanks in advance,
Anisha
~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
~ Anisha Vaswani @ Agilent Technologies ~
~ Semiconductor Products Group IT - WW Sales & Marketing Systems ~
~ Email: [EMAIL PROTECTED] | Vmail: (408) 970-2242 ~
~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
_________________________________________________________________________
For help in using, subscribing, and unsubscribing to the discussion
forums, please go to: http://www.netdynamics.com/support/visitdevfor.html
For dire need help, email: [EMAIL PROTECTED]
