I'm running into a problem during package verification on my spacewalk server. I suspect that this is an oracle-postgresql issue, but will leave that to the experts. This happens when I request package verification for all packages on a specific machine. Running rhn_check -v manually on the client, I get:
prelink: /usr/lib64/libXinerama.so.1.0.0: at least one of file's dependencies has changed since prelinking prelink: /usr/lib64/libXext.so.6.4.0: at least one of file's dependencies has changed since prelinking ... [many similar prelinks messages removed for brevity] prelink: /usr/bin/factor: at least one of file's dependencies has changed since prelinking prelink: /usr/lib64/libatk-1.0.so.0.2809.1: at least one of file's dependencies has changed since prelinking prelink: /usr/lib64/libXdamage.so.1.1.0: at least one of file's dependencies has changed since prelinking XMLRPC ProtocolError: <ProtocolError for juno.doreydesign.local /XMLRPC: 500 Internal Server Error> I'm running spacewalk 1.7 on Centos 6.2 on x86_64 platform with a postgresql database. All packages are up to date. I'm including Apache error logs below. Please let me know if there's other information or tests that would be useful. >From /var/log/httpd/error_log on the server (juno): [Sun Jun 03 14:46:06 2012] [error] Exception reported from juno.doreydesign.local [Sun Jun 03 14:46:06 2012] [error] Time: Sun Jun 3 14:46:06 2012 [Sun Jun 03 14:46:06 2012] [error] Exception type <class 'spacewalk.server.rhnSQL.sql_base.SQLStatementPrepareError'> [Sun Jun 03 14:46:06 2012] [error] Exception while handling function queue.submit [Sun Jun 03 14:46:06 2012] [error] Request object information: [Sun Jun 03 14:46:06 2012] [error] URI: /XMLRPC [Sun Jun 03 14:46:06 2012] [error] Remote Host: skylab.doreydesign.local [Sun Jun 03 14:46:06 2012] [error] Server Name: juno.doreydesign.local:443 [Sun Jun 03 14:46:06 2012] [error] Headers passed in: [Sun Jun 03 14:46:06 2012] [error] \tAccept-Encoding: identity [Sun Jun 03 14:46:06 2012] [error] \tCONTENT_LENGTH: 214719 [Sun Jun 03 14:46:06 2012] [error] \tCONTENT_TYPE: text/xml [Sun Jun 03 14:46:06 2012] [error] \tDOCUMENT_ROOT: /var/www/html [Sun Jun 03 14:46:06 2012] [error] \tGATEWAY_INTERFACE: CGI/1.1 [Sun Jun 03 14:46:06 2012] [error] \tHTTPS: 1 [Sun Jun 03 14:46:06 2012] [error] \tHTTP_ACCEPT_ENCODING: identity [Sun Jun 03 14:46:06 2012] [error] \tHTTP_HOST: juno.doreydesign.local [Sun Jun 03 14:46:06 2012] [error] \tHTTP_USER_AGENT: rhn.rpclib.py/$Revision$ [Sun Jun 03 14:46:06 2012] [error] \tHTTP_X_CLIENT_VERSION: 1 [Sun Jun 03 14:46:06 2012] [error] \tHTTP_X_INFO: RPC Processor (C) Red Hat, Inc (version $Revision$) [Sun Jun 03 14:46:06 2012] [error] \tHTTP_X_RHN_CLIENT_CAPABILITY: osad.ping(1)=1,packages.verify(1)=1,packages.extended_profile(2)=1,osad.rhn_check(1)=1,configfiles.base64_enc(1)=1,reboot.reboot(1)=1,configfiles.deploy(1)=1,caneatCheese(1)=1,packages.rollBack(1)=1,configfiles.mtime_upload(1)=1,configfiles.diff(1)=1,packages.update(2)=2,script.run(1)=1,configfiles.upload(1)=1,packages.runTransaction(1)=1,osad.ping(1)=1,packages.verify(1)=1,packages.extended_profile(2)=1,osad.rhn_check(1)=1,configfiles.base64_enc(1)=1,reboot.reboot(1)=1,configfiles.deploy(1)=1,caneatCheese(1)=1,packages.rollBack(1)=1,configfiles.mtime_upload(1)=1,configfiles.diff(1)=1,packages.update(2)=2,script.run(1)=1,configfiles.upload(1)=1,packages.runTransaction(1)=1 [Sun Jun 03 14:46:06 2012] [error] \tHTTP_X_RHN_TRANSPORT_CAPABILITY: follow-redirects=3 [Sun Jun 03 14:46:06 2012] [error] \tHTTP_X_TRANSPORT_INFO: Extended Capabilities Transport (C) Red Hat, Inc (version $Revision$) [Sun Jun 03 14:46:06 2012] [error] \tHTTP_X_UP2DATE_VERSION: 1.7.14-1.el6 [Sun Jun 03 14:46:06 2012] [error] \tHost: juno.doreydesign.local [Sun Jun 03 14:46:06 2012] [error] \tPATH_INFO: [Sun Jun 03 14:46:06 2012] [error] \tQUERY_STRING: [Sun Jun 03 14:46:06 2012] [error] \tREMOTE_ADDR: 192.168.168.42 [Sun Jun 03 14:46:06 2012] [error] \tREMOTE_PORT: 53534 [Sun Jun 03 14:46:06 2012] [error] \tREQUEST_METHOD: POST [Sun Jun 03 14:46:06 2012] [error] \tREQUEST_URI: /XMLRPC [Sun Jun 03 14:46:06 2012] [error] \tSCRIPT_FILENAME: /usr/share/rhn/wsgi/xmlrpc.py [Sun Jun 03 14:46:06 2012] [error] \tSCRIPT_NAME: /XMLRPC [Sun Jun 03 14:46:06 2012] [error] \tSCRIPT_URI: https://juno.doreydesign.local/XMLRPC [Sun Jun 03 14:46:06 2012] [error] \tSCRIPT_URL: /XMLRPC [Sun Jun 03 14:46:06 2012] [error] \tSERVER_ADDR: 192.168.168.27 [Sun Jun 03 14:46:06 2012] [error] \tSERVER_ADMIN: root@localhost [Sun Jun 03 14:46:06 2012] [error] \tSERVER_NAME: juno.doreydesign.local [Sun Jun 03 14:46:06 2012] [error] \tSERVER_PORT: 443 [Sun Jun 03 14:46:06 2012] [error] \tSERVER_PROTOCOL: HTTP/1.1 [Sun Jun 03 14:46:06 2012] [error] \tSERVER_SIGNATURE: <address>Apache Server at juno.doreydesign.local Port 443</address> [Sun Jun 03 14:46:06 2012] [error] [Sun Jun 03 14:46:06 2012] [error] \tSERVER_SOFTWARE: Apache [Sun Jun 03 14:46:06 2012] [error] \tUser-Agent: rhn.rpclib.py/$Revision$ [Sun Jun 03 14:46:06 2012] [error] \tX-Client-Version: 1 [Sun Jun 03 14:46:06 2012] [error] \tX-Info: RPC Processor (C) Red Hat, Inc (version $Revision$) [Sun Jun 03 14:46:06 2012] [error] \tX-RHN-Client-Capability: osad.ping(1)=1,packages.verify(1)=1,packages.extended_profile(2)=1,osad.rhn_check(1)=1,configfiles.base64_enc(1)=1,reboot.reboot(1)=1,configfiles.deploy(1)=1,caneatCheese(1)=1,packages.rollBack(1)=1,configfiles.mtime_upload(1)=1,configfiles.diff(1)=1,packages.update(2)=2,script.run(1)=1,configfiles.upload(1)=1,packages.runTransaction(1)=1,osad.ping(1)=1,packages.verify(1)=1,packages.extended_profile(2)=1,osad.rhn_check(1)=1,configfiles.base64_enc(1)=1,reboot.reboot(1)=1,configfiles.deploy(1)=1,caneatCheese(1)=1,packages.rollBack(1)=1,configfiles.mtime_upload(1)=1,configfiles.diff(1)=1,packages.update(2)=2,script.run(1)=1,configfiles.upload(1)=1,packages.runTransaction(1)=1 [Sun Jun 03 14:46:06 2012] [error] \tX-RHN-Transport-Capability: follow-redirects=3 [Sun Jun 03 14:46:06 2012] [error] \tX-Transport-Info: Extended Capabilities Transport (C) Red Hat, Inc (version $Revision$) [Sun Jun 03 14:46:06 2012] [error] \tX-Up2Date-Version: 1.7.14-1.el6 [Sun Jun 03 14:46:06 2012] [error] \tmod_wsgi.application_group: juno.doreydesign.local|/xmlrpc [Sun Jun 03 14:46:06 2012] [error] \tmod_wsgi.callable_object: application [Sun Jun 03 14:46:06 2012] [error] \tmod_wsgi.handler_script: [Sun Jun 03 14:46:06 2012] [error] \tmod_wsgi.input_chunked: 0 [Sun Jun 03 14:46:06 2012] [error] \tmod_wsgi.listener_host: [Sun Jun 03 14:46:06 2012] [error] \tmod_wsgi.listener_port: 443 [Sun Jun 03 14:46:06 2012] [error] \tmod_wsgi.process_group: [Sun Jun 03 14:46:06 2012] [error] \tmod_wsgi.request_handler: wsgi-script [Sun Jun 03 14:46:06 2012] [error] \tmod_wsgi.script_reloading: 1 [Sun Jun 03 14:46:06 2012] [error] \tmod_wsgi.version: (3, 2) [Sun Jun 03 14:46:06 2012] [error] \twsgi.errors: <mod_wsgi.Log object at 0x7f4271be3730> [Sun Jun 03 14:46:06 2012] [error] \twsgi.file_wrapper: <built-in method file_wrapper of mod_wsgi.Adapter object at 0x7f4257546a80> [Sun Jun 03 14:46:06 2012] [error] \twsgi.input: <mod_wsgi.Input object at 0x7f4271bea730> [Sun Jun 03 14:46:06 2012] [error] \twsgi.multiprocess: True [Sun Jun 03 14:46:06 2012] [error] \twsgi.multithread: False [Sun Jun 03 14:46:06 2012] [error] \twsgi.run_once: False [Sun Jun 03 14:46:06 2012] [error] \twsgi.url_scheme: https [Sun Jun 03 14:46:06 2012] [error] \twsgi.version: (1, 1) [Sun Jun 03 14:46:06 2012] [error] Extra information about this error: [Sun Jun 03 14:46:06 2012] [error] SQL Error generated: ("function lookup_evr(integer, unknown, unknown) does not exist\\nLINE 15: lookup_evr(1, E'5.5', E'37.el6_2.1'),\\n ^\\nHINT: No function matches the given name and argument types. You might need to add explicit type casts.\\n", 0, '\\ninsert into rhnServerActionVerifyResult (\\n server_id, action_id,\\n package_name_id,\\n package_evr_id,\\n package_arch_id,\\n package_capability_id,\\n attribute, size_differs, mode_differs, checksum_differs,\\n devnum_differs, readlink_differs, uid_differs,\\n gid_differs, mtime_differs\\n)\\nvalues (\\n %(server_id)s, %(action_id)s,\\n lookup_package_name(%(package_name)s),\\n lookup_evr(%(epoch)s, %(version)s, %(release)s),\\n lookup_package_arch(%(arch)s),\\n lookup_package_capability(%(filename)s),\\n %(attrib)s, %(test_S)s, %(test_M)s, %(test_5)s,\\n %(test_D)s, %(test_L)s, %(test_U)s,\\n %(test_G)s, %(test_T)s\\n)\\n') [Sun Jun 03 14:46:06 2012] [error] [Sun Jun 03 14:46:06 2012] [error] Exception Handler Information [Sun Jun 03 14:46:06 2012] [error] Traceback (most recent call last): [Sun Jun 03 14:46:06 2012] [error] File "/usr/lib/python2.6/site-packages/spacewalk/server/apacheRequest.py", line 122, in call_function [Sun Jun 03 14:46:06 2012] [error] response = apply(func, params) [Sun Jun 03 14:46:06 2012] [error] File "/usr/share/rhn/server/handlers/xmlrpc/queue.py", line 470, in submit [Sun Jun 03 14:46:06 2012] [error] action_type=action_type) [Sun Jun 03 14:46:06 2012] [error] File "/usr/share/rhn/server/handlers/xmlrpc/queue.py", line 515, in process_extra_data [Sun Jun 03 14:46:06 2012] [error] result = method(self.server_id, action_id, data=data) [Sun Jun 03 14:46:06 2012] [error] File "/usr/lib/python2.6/site-packages/spacewalk/server/action_extra_data/packages.py", line 171, in verify [Sun Jun 03 14:46:06 2012] [error] apply(h.executemany, (), verify_attribs) [Sun Jun 03 14:46:06 2012] [error] File "/usr/lib/python2.6/site-packages/spacewalk/server/rhnSQL/sql_base.py", line 172, in executemany [Sun Jun 03 14:46:06 2012] [error] return apply(self._execute_wrapper, (self._executemany, ) + p, kw) [Sun Jun 03 14:46:06 2012] [error] File "/usr/lib/python2.6/site-packages/spacewalk/server/rhnSQL/driver_postgresql.py", line 282, in _execute_wrapper [Sun Jun 03 14:46:06 2012] [error] retval = apply(function, p, kw) [Sun Jun 03 14:46:06 2012] [error] File "/usr/lib/python2.6/site-packages/spacewalk/server/rhnSQL/driver_postgresql.py", line 318, in _executemany [Sun Jun 03 14:46:06 2012] [error] self._real_cursor.executemany(self.sql, all_kwargs) [Sun Jun 03 14:46:06 2012] [error] SQLStatementPrepareError: ("function lookup_evr(integer, unknown, unknown) does not exist\\nLINE 15: lookup_evr(1, E'5.5', E'37.el6_2.1'),\\n ^\\nHINT: No function matches the given name and argument types. You might need to add explicit type casts.\\n", 0, '\\ninsert into rhnServerActionVerifyResult (\\n server_id, action_id,\\n package_name_id,\\n package_evr_id,\\n package_arch_id,\\n package_capability_id,\\n attribute, size_differs, mode_differs, checksum_differs,\\n devnum_differs, readlink_differs, uid_differs,\\n gid_differs, mtime_differs\\n)\\nvalues (\\n %(server_id)s, %(action_id)s,\\n lookup_package_name(%(package_name)s),\\n lookup_evr(%(epoch)s, %(version)s, %(release)s),\\n lookup_package_arch(%(arch)s),\\n lookup_package_capability(%(filename)s),\\n %(attrib)s, %(test_S)s, %(test_M)s, %(test_5)s,\\n %(test_D)s, %(test_L)s, %(test_U)s,\\n %(test_G)s, %(test_T)s\\n)\\n') [Sun Jun 03 14:46:06 2012] [error] Thanks - Daniel _______________________________________________ Spacewalk-list mailing list [email protected] https://www.redhat.com/mailman/listinfo/spacewalk-list
