Guys,
This past weekend my spacewalk server started sending me emails every hour on
the hour with errors that were occurring. I logged into the server and
restarted the server and noticed that s2s, c2s, and sm were starting but dying
after about 20 seconds. The startup process completes without error but the
shutdown fails on the three processes I mentioned previously. I have not
touched the server in several weeks and there is no one else who accesses it. I
am attaching the output of one of the traceback messages that I have received.
Any ideas as to why this might be occurring? I have tried rebooting the
server...
Traceback email:
Exception reported from spacewalk-test.garmin.com
Time: Mon Apr 6 05:15:07 2009
Exception type server.rhnSQL.sql_base.SQLConnectError
Request object information:
URI: /XMLRPC
Remote Host: 10.33.13.108
Server Name: spacewalk-test.garmin.com:0 Headers passed in:
Accept-Encoding: identity
Content-Length: 2151
Host: spacewalk-host-test.garmin.com
content-type: text/xml
user-agent: rhn.rpclib.py/$Revision$
x-client-version: 1
x-info: RPC Processor (C) Red Hat, Inc (version $Revision$)
x-rhn-client-capability:
packages.verifyAll(1)=1,caneatCheese(1)=1,packages.extended_profile(1)=1,reboot.reboot(1)=1,packages.verify(1)=1,packages.runTransaction(1)=1,packages.rollBack(1)=1,packages.verifyAll(1)=1,caneatCheese(1)=1,packages.extended_profile(1)=1,reboot.reboot(1)=1,packages.verify(1)=1,packages.runTransaction(1)=1,packages.rollBack(1)=1
x-rhn-transport-capability: follow-redirects=2
x-transport-info: Extended Capabilities Transport (C) Red Hat, Inc
(version $Revision$)
x-up2date-version: 0.4.17-10.fc9
Exception Handler Information
Traceback (most recent call last):
File "/usr/share/rhn/server/apacheHandler.py", line 72, in headerParserHandler
rhnSQL.initDB()
File "/usr/share/rhn/server/rhnSQL/__init__.py", line 99, in initDB
__init__DB(backend, host, port, username, password, database)
File "/usr/share/rhn/server/rhnSQL/__init__.py", line 59, in __init__DB
__DB.check_connection()
File "/usr/share/rhn/server/rhnSQL/driver_cx_Oracle.py", line 441, in
check_connection
self.connect() # only allow one try
File "/usr/share/rhn/server/rhnSQL/driver_cx_Oracle.py", line 332, in connect
raise apply(sql_base.SQLConnectError, err_args)
SQLConnectError: (257, 'ORA-00257: archiver error. Connect internal only, until
freed.\n', 'SPPOC', 'Connection_Connect(): begin session')
Local variables by frame
Frame connect in /usr/share/rhn/server/rhnSQL/driver_cx_Oracle.py at line 332
e = <type 'instance'> ORA-00257: archiver error.
Connect internal only, until freed.
errno = <type 'int'> 257
self = <type 'instance'>
<server.rhnSQL.driver_cx_Oracle.Database instance at 0xb77e540c>
ret = <type 'tuple'> (257, 'ORA-00257: archiver error.
Connect internal only, until freed.\n', 'Connection_Connect(): begin session')
reconnect = <type 'int'> 1
err_args = <type 'list'> ['SPPOC', 257, 'ORA-00257: archiver
error. Connect internal only, until freed.\n', 'Connection_Connect(): begin
session']
errmsg = <type 'str'> ORA-00257: archiver error. Connect
internal only, until freed.
Frame check_connection in /usr/share/rhn/server/rhnSQL/driver_cx_Oracle.py at
line 441
self = <type 'instance'>
<server.rhnSQL.driver_cx_Oracle.Database instance at 0xb77e540c>
Frame __init__DB in /usr/share/rhn/server/rhnSQL/__init__.py at line 59
username = <type 'str'> spacewalk
database = <type 'str'> SPPOC
host = <type 'str'> localhost
password = <type 'str'> spacewalk
port = <type 'NoneType'> None
backend = <type 'str'> oracle
Frame initDB in /usr/share/rhn/server/rhnSQL/__init__.py at line 105
username = <type 'str'> spacewalk
temp = <type 'str'> spacew...@sppoc
database = <type 'str'> SPPOC
dsn = <type 'str'> <CENSORED!>
host = <type 'str'> localhost
password = <type 'str'> spacewalk
port = <type 'NoneType'> None
backend = <type 'str'> oracle
Frame headerParserHandler in /usr/share/rhn/server/apacheHandler.py at line 74
self = <type 'instance'>
<server.apacheHandler.apacheHandler instance at 0xb784746c>
req = <type 'mp_request'> <mp_request object at
0xb7adad2c>
ret = <type 'int'> 0
Frame __call__ in /usr/share/rhn/server/apacheServer.py at line 58
self = <type 'instance'> <server.apacheServer.HandlerWrap
instance at 0xb78e3bcc>
req = <type 'mp_request'> <mp_request object at
0xb7adad2c>
options = <type 'mp_table'> {'RHNComponentType':
'server.xmlrpc', 'SERVER': 'xmlrpc', 'RootDir': '/usr/share/rhn'}
f = <type 'instancemethod'> <bound method
apacheHandler.headerParserHandler of <server.apacheHandler.apacheHandler
instance at 0xb784746c>>
Frame HandlerDispatch in /usr/lib/python2.4/site-packages/mod_python/apache.py
at line 299
req = <type 'mp_request'> <mp_request object at
0xb7adad2c>
config = <type 'mp_table'> {'PythonInterpreter':
'rhn.server', 'PythonPath': 'sys.path+['/usr/share/rhn']'}
self = <type 'instance'> <mod_python.apache.CallBack
instance at 0xb7ae876c>
object = <type 'instance'> <server.apacheServer.HandlerWrap
instance at 0xb78e3bcc>
l = <type 'list'> ['server.apacheServer',
'HeaderParserHandler']
module = <type 'module'> <module 'server.apacheServer' from
'/usr/share/rhn/server/apacheServer.pyc'>
hlist = <type 'mp_hlist'>
{'handler:'server.apacheServer::HeaderParserHandler','directory':'/XMLRPC/','silent':0}
object_str = <type 'str'> HeaderParserHandler
debug = <type 'int'> 0
module_name = <type 'str'> server.apacheServer
pathstring = <type 'str'> sys.path+['/usr/share/rhn']
result = <type 'int'> 500
Environment for PID=18230 on exception:
LANG = C
NLS_LANG = english.AL32UTF8
ORACLE_HOME = /opt/oracle
PATH = /sbin:/usr/sbin:/bin:/usr/bin
PERL_BADFREE = 0
PWD = /
SHLVL = 2
TERM = linux
_ = /usr/sbin/httpd
Jonathan Hooker
Desktop Support - Engineering
Garmin International
[email protected]
________________________________
This e-mail and any attachments may contain confidential material for the sole
use of the intended recipient. If you are not the intended recipient, please be
aware that any disclosure, copying, distribution or use of this e-mail or any
attachment is prohibited. If you have received this e-mail in error, please
contact the sender and delete all copies.
Thank you for your cooperation
_______________________________________________
Spacewalk-list mailing list
[email protected]
https://www.redhat.com/mailman/listinfo/spacewalk-list