Hello, Thank you for your response on this issue. We could reproduce this issue on CentOS 6.6. Based on our investigation and crash (segfault) messages, issue seems to be with "libc-2.12.so" module. Since crash is not with OMSA code so we tried below steps and issues disappears.
We just upgraded glibc and its dependent modules through yum (yum update glibc) and restarted the OS. Issue exists. We upgraded entire system/OS through yum (yum update) and restarted the OS. Issue disappears. Please try to see this resolves on your environment. Let us know how it goes. Regards Chandra ---------------------------------------------------------------------- Message: 1 Date: Fri, 10 Mar 2017 18:11:25 +0000 From: [email protected] Subject: Re: [Linux-PowerEdge] OMSA no longer working To: [email protected] Message-ID: Content-Type: text/plain; charset=us-ascii [email protected] writes: > Hello, > > Thank you for using Dell EMC OMSA. > > Kindly note that, OMSA is not officially certified and supported on CentOS. > However, we have tried to reproduce on R730 server and CentOS 6.8 64-bit. We > are unable to reproduce the issue. > > Can you please help us providing more details about the issue? > > Whether you have installed directly OMSA8.4 version or it has been upgraded > from different version? In brief: it seems to fail on machines not running the latest CentOS 6.8, ie. running 6.4/6.6. All machines were upgraded to 8.4 last October and were working fine since. When I noticed what is happening, I removed 8.4 completely and reinstalled from scratch, no change. By completely, I mean yum remove and then rm -rf /opt/dell. > Can you share us the coredump or stack trace of the crash? I don't get much for either dsm_sa_eventmgrd or dsm_sa_snmpd. [root@host ]# /opt/dell/srvadmin/sbin/srvadmin-services.sh start ; strace -p $(ps -ef |awk '/\/opt\/dell\/srvadmin\/sbin\/dsm_sa_snmpd/{print $2}') Starting Systems Management Device Drivers: Starting dell_rbu: [ OK ] Starting ipmi driver: Already started [ OK ] Starting Systems Management Data Engine: Starting dsm_sa_datamgrd: [ OK ] Starting dsm_sa_eventmgrd: [ OK ] Starting dsm_sa_snmpd: [ OK ] Starting DSM SA Shared Services: [ OK ] Starting DSM SA Connection Service: [ OK ] Process 12017 attached - interrupt to quit rt_sigtimedwait([INT TERM], NULL, NULL, 8 +++ killed by SIGSEGV +++ [root@host ~]# > Have you upgraded any OS pkg's? Since last July, no packages have been updated or installed other than dell-system-update, dsucatalog, invcol. That's for the 6.4/6.6 systems. > Any other useful data for reproducing the issue? It's a bizarre problem. Machines that have seen no other updates in the past year than OMSA/dsu etc. This is a machine where everything was working fine up until a few minutes ago. It runs CentOS 6.6 and had OMSA 8.4 installed last October. [root@host log]# cat yum.log Jan 24 11:25:35 Updated: dsucatalog-17.01.00-TDDR9.noarch Jan 24 11:25:36 Updated: dell-system-update-1.3.1-17.01.00.x86_64 Jan 24 13:05:16 Erased: dsucatalog Jan 24 13:17:57 Installed: dsucatalog-17.01.00-TDDR9.noarch Jan 24 13:29:58 Installed: invcol_WF06C_LN64_16.12.200.896_A00-16.12.200.896-WF06C.x86_64 Feb 28 14:00:50 Updated: dsucatalog-17.02.00-WF25X.noarch Feb 28 14:00:50 Updated: dell-system-update-1.4.0-17.02.00.x86_64 Mar 01 11:49:16 Erased: dsucatalog Mar 01 12:01:41 Installed: dsucatalog-17.02.00-WF25X.noarch [root@host log]# [root@host log]# cd [root@host ~]# /opt/dell/srvadmin/sbin/srvadmin-services.sh status dell_rbu (module) is running ipmi driver is running dsm_sa_datamgrd (pid 31664 31382) is running dsm_sa_eventmgrd (pid 31617) is running dsm_sa_snmpd (pid 31645) is running dsm_om_shrsvcd (pid 31898) is running dsm_om_connsvcd (pid 31964 31963) is running [root@host log]# /opt/dell/srvadmin/sbin/srvadmin-services.sh stop Shutting down DSM SA Shared Services: [ OK ] Shutting down DSM SA Connection Service: [ OK ] Stopping Systems Management Data Engine: Stopping dsm_sa_snmpd: [ OK ] Stopping dsm_sa_eventmgrd: [ OK ] Stopping dsm_sa_datamgrd: [ OK ] Stopping Systems Management Device Drivers: Stopping dell_rbu: [ OK ] [root@host log]# ps -ef |grep dsm root 27396 18309 0 17:50 pts/1 00:00:00 grep dsm [root@host log]# /opt/dell/srvadmin/sbin/srvadmin-services.sh start Starting Systems Management Device Drivers: Starting dell_rbu: [ OK ] Starting ipmi driver: Already started [ OK ] Starting Systems Management Data Engine: Starting dsm_sa_datamgrd: [ OK ] Starting dsm_sa_eventmgrd: [ OK ] Starting dsm_sa_snmpd: [ OK ] Starting DSM SA Shared Services: [ OK ] Starting DSM SA Connection Service: [ OK ] [root@host log]# /opt/dell/srvadmin/sbin/srvadmin-services.sh status dell_rbu (module) is running ipmi driver is running dsm_sa_datamgrd (pid 27888 27616) is running dsm_sa_eventmgrd is stopped dsm_sa_snmpd is stopped dsm_om_shrsvcd (pid 27937) is running dsm_om_connsvcd (pid 28005 28004) is running Mar 10 17:51:11 host kernel: dsm_sa_eventmgr[27854]: segfault at 0 ip 00007f24a56e6220 sp 00007f24a640e0f8 error 4 in libc-2.12.so[7f24a55bd000+18a000] Mar 10 17:51:11 host snmpd[2130]: [smux_process] peek failed: Success Mar 10 17:51:11 host kernel: dsm_sa_snmpd[27882]: segfault at 7fc800000000 ip 00007fc8139d2220 sp 00007fc8146d9828 error 4 in libc-2.12.so[7fc8138a9000+18a000] Mar 10 17:52:47 host kernel: MaserIE[28384]: segfault at 7f8b00000000 ip 00007f8bda6f0220 sp 00007ffc0e967098 error 4 in libc-2.12.so[7f8bda5c7000+18a000] ------------------------------ Message: 2 Date: Fri, 10 Mar 2017 12:24:41 -0600 From: jsl6uy js16uy Subject: Re: [Linux-PowerEdge] dsu on ubu 16.04 via ubu live iso To: [email protected] Cc: [email protected] Message-ID: Content-Type: text/plain; charset="utf-8" Making /usr/libexec/dell_dup gets me farther. But dsu then exits b/c of no Catalog.xml file. Looking at an strace I can see that dsu was looking for that file. >>>interlude So, I mirror via rsync from the dell linux repo for dsu updates. Works with rhel/centos via rpm b/c repodata is there for a yum repo to work. I don't see this for ubu linux.dell.com::repo/hardware/DSU* path for normal dsu updates linux.dell.com::repo/hardware/ubuntu* -- path for ubuntu from the page that was sent in the update that dsu would run on ubu The only thing that rsyncs down is root@X1:/dellrp/ubuntu# find . ./catalog ./catalog/Catalog_Ubuntu.gz********************************** ./catalog/Catalog_Ubuntu.gz.sign ./catalog_bkps ./catalog_bkps/Catalog_Ubuntu.gz ./catalog_bkps/Catalog_Ubuntu.gz.sign ./dsu ./dsu/Catalog.gz*************************************************** ./dsu/Catalog.gz.sign ./Catalog_Ubuntu_Q2_2016.xml ./Catalog_july_2016.xml ./Ubuntu_Q2_2016.html ./latest.html root@X1:/dellrp/ubuntu# >>>> end interlude So I tried Catalog.gz under dsu and Catalog_Ubuntu.gz under catalog. Brought these files to the server and placed under /usr/libexec/dell_dup. Then I was able to get dsu -g to work, see below, but still can't run dsu -i Note I tried separately one Catalog file at a time and then both present root@X:/usr/libexec/dell_dup# find $PWD /usr/libexec/dell_dup /usr/libexec/dell_dup/Catalog.xml root@X:/usr/libexec/dell_dup# Now I am able to dsu -g root@X:~# dsu -g Verifying catalog installation ... Installing catalog from repository ... Fetching dsucatalog ... Reading the catalog ... Category Value : Category Name -------------- ------------- AS : SAS Drive BI : BIOS CE : Chassis System Management ES : ESM Express Flash PCIe SSD : Express Flash PCIe SSD FC : Fibre Channel FW : Firmware NI : Network PC : PCIe SSS SA : Serial ATA SE : SAS Non-RAID SF : SAS RAID SM : Systems Management Application iDRAC with Lifecycle Controller : iDRAC with Lifecycle Controller root@X:~# Still can't run dsu -i root@X:~# dsu -i Verifying catalog installation ... Installing catalog from repository ... Fetching dsucatalog ... Reading the catalog ... dsu: symbol lookup error: dsu: undefined symbol: _ZNK9DCMKitAPI16GetInventoryFileE21DCMOSArchitectureEnum root@X:~# Maybe I don't understand how to use this dsu via ubu. Once installed how does the dsu get its catalog info? How do I integrate in local pushes from my local mirror? Apologies so many questions. Would be happy to read something/RTFM if I missed something thanks all again On Fri, Mar 10, 2017 at 9:46 AM, jsl6uy js16uy wrote: > thanks very much > will take a look at that path > though I do agree with Chuck that this is a bit obscure > > Again thanks very much, will report back > > On Fri, Mar 10, 2017 at 6:02 AM, wrote: > >> Dell - Internal Use - Confidential >> >> >> Hi, >> >> DSU will try to create the work folder >> ?/usr/libexec/dell_dup/? and copy files during execution. Please make >> sure the /usr folder is writable in the booted ISO. >> >> Soorej Ponnandi >> Dell | Change Management >> >> From: linux-poweredge-bounces-Lists On Behalf Of jsl6uy js16uy >> Sent: Friday, March 10, 2017 1:23 AM >> To: linux-poweredge-Lists >> Subject: [Linux-PowerEdge] dsu on ubu 16.04 via ubu live iso >> >> Hello all hope all is well >> Should this, this being dsu on ubuntu, work on a live iso? >> We have booted up a live iso ubu 16.04.2 on a dell r630. I have >> installed linux DUP package from: http://www.dell.com/support/ho >> me/us/en/19/Drivers/DriversDetails?driverid=YKMFW/ >> >> >> and dsu does not work >> To sum up my errors: >> After installing without reported errors-- oot@X:~# dsu -i >> dsu: symbol lookup error: dsu: undefined symbol: >> _ZN7DSMFile15CreateDirectoryEbP16DSMErrorCodeEnum >> root@X:~# dsu -g >> dsu: symbol lookup error: dsu: undefined symbol: >> _ZN7DSMFile15CreateDirectoryEbP16DSMErrorCodeEnum >> root@X:~# dsu >> dsu: symbol lookup error: dsu: undefined symbol: >> _ZN7DSMFile15CreateDirectoryEbP16DSMErrorCodeEnum >> root@X:~# >> >> Below provides more details >> >> root@X:~# bash >> ./Systems-Management_Application_YKMFW_LN64_1.4.0_A00.BIN >> Collecting inventory... >> .. >> Running validation... >> >> Dell System Update >> >> No version of this Update Package is currently installed. >> Software application name: DSU >> Package version: 1.4.0 >> >> Continue? Y/N:y >> Executing update... >> WARNING: DO NOT STOP THIS PROCESS OR INSTALL OTHER DELL PRODUCTS >> WHILE UPDATE IS IN PROGRESS. >> THESE ACTIONS MAY CAUSE YOUR SYSTEM TO BECOME UNSTABLE! >> ........... >> Dell System Update installed successfully. >> The update completed successfully. >> root@X:~# dsu -h >> >> Usage: dsu [OPTION]... >> Options: >> -h, --help Help >> -v, --version Version >> -i, --inventory Perform Inventory >> -n, --non-interactive Non-interactive >> mode >> -g, --get-categories Get category values >> -c, --category= List only updates >> of categories >> -u, --apply-upgrades-only List only >> upgradable updates >> -d, --apply-downgrades-only List only >> downgradable updates >> -e, --apply-equivalent-updates Enable equivalent >> updates >> -l, --update-list= Apply >> updates >> --config= Configuration file >> --source-type= TYPE=PDK >> --source= Source location >> --destination-type= TYPE=ISO|CBD >> --destination-location= Output location >> when destination-type is provided >> --bootable-log-location= File to write >> logs during server update >> --ic-location= Inventory >> Collector binary >> --input-inventory-file= Inventory XML file >> --output-inventory-xml= Path to save the >> Inventory XML file >> --preview Preview updates >> root@X:~# man dsu >> >> root@X:~# dpkg -l|grep -Pi 'dsu|dell|openman' >> ii dell-system-update 1.4.0 >> amd64 Dell utility for system updates >> root@X:~# dsu -i >> dsu: symbol lookup error: dsu: undefined symbol: >> _ZN7DSMFile15CreateDirectoryEbP16DSMErrorCodeEnum >> root@X:~# dsu -g >> dsu: symbol lookup error: dsu: undefined symbol: >> _ZN7DSMFile15CreateDirectoryEbP16DSMErrorCodeEnum >> root@X:~# dsu >> dsu: symbol lookup error: dsu: undefined symbol: >> _ZN7DSMFile15CreateDirectoryEbP16DSMErrorCodeEnum >> root@X:~# >> >> root@X:~# cat /etc/lsb-release >> DISTRIB_ID=Ubuntu >> DISTRIB_RELEASE=16.04 >> DISTRIB_CODENAME=xenial >> DISTRIB_DESCRIPTION="Ubuntu 16.04.2 LTS" >> root@X:~# >> Thanks for any and all help >> > > -------------- next part -------------- An HTML attachment was scrubbed... URL: http://lists.us.dell.com/pipermail/linux-poweredge/attachments/20170310/ed988dd3/attachment.html ------------------------------ _______________________________________________ Linux-PowerEdge mailing list [email protected] https://lists.us.dell.com/mailman/listinfo/linux-poweredge End of Linux-PowerEdge Digest, Vol 154, Issue 13 ************************************************
_______________________________________________ Linux-PowerEdge mailing list [email protected] https://lists.us.dell.com/mailman/listinfo/linux-poweredge
