Hi, I don't know what you're running in your primary domain, but it looks like you don't have enough memory to run everything. Considering that you are emailing from symantec.com, I would assume you've installed something like VSF/VCS, which consumes memory obviously. If you are using ZFS for the your LDoms, it's recommended that you assign 4GB's of RAM to the primary. To get around this, shutdown the system to the iLOM and set the boot mode to the factory_default MD and reset the server. This will bring the system up with the default configuration with no LDoms and allow you to get into your primary domain or atleast boot from cdrom.
*-*-*-*-*-*-*-*-*-*-*-*-*-*-*-*-*-*-*-*-*-*-*-*-*-*-*-*-*-*-*-*-*-*-*-*-*-*-* Octave J. Orgeron Solaris Virtualization Architect and Consultant Web: http://unixconsole.blogspot.com E-Mail: unixconsole at yahoo.com *-*-*-*-*-*-*-*-*-*-*-*-*-*-*-*-*-*-*-*-*-*-*-*-*-*-*-*-*-*-*-*-*-*-*-*-*-*-* ________________________________ From: Toan Nguyen <toan_ngu...@symantec.com> To: annie.chan at sun.com; ldoms-discuss at opensolaris.org Cc: Thanh Van <thanh_van at symantec.com> Sent: Friday, May 1, 2009 6:25:10 PM Subject: [ldoms-discuss] FW: [Fwd: Re: LDOM On T5240] Hello Annie and Ldoms team, I am currently having issues with LDOM configurations on both of the machines. Both of servers came with pre-installed. I have also opened the case with Sun on this problems. The support engineer did not know how to troubleshoot this error. Here is the case number: 70979344. ok boot T5240, No Keyboard Copyright 2008 Sun Microsystems, Inc. All rights reserved. OpenBoot 4.30.0, 1024 MB memory available, Serial #86438504. Ethernet address 0:21:28:26:f2:68, Host ID: 8526f268. Boot device: /pci at 400/pci at 0/pci at 8/scsi at 0/disk at 0 File and args: -r SunOS Release 5.10 Version Generic_138888-03 64-bit Copyright 1983-2008 Sun Microsystems, Inc. All rights reserved. Use is subject to license terms. NOTICE: nxge0: xcvr addr:0x1d - link is down NOTICE: nxge2: xcvr addr:0x1b - link is down NOTICE: nxge1: xcvr addr:0x1c - link is down NOTICE: nxge4: xcvr addr:0x0d - link is down NOTICE: nxge3: xcvr addr:0x1a - link is down NOTICE: nxge0: xcvr addr:0x1d - link is up 1000 Mbps full duplex NOTICE: nxge5: xcvr addr:0x0c - link is down NOTICE: nxge2: xcvr addr:0x1b - link is up 1000 Mbps full duplex NOTICE: nxge1: xcvr addr:0x1c - link is up 1000 Mbps full duplex NOTICE: nxge3: xcvr addr:0x1a - link is up 1000 Mbps full duplex Apr 29 17:01:11 svc.startd[7]: network/pfil:default failed: transitioned to maintenance (see 'svcs -xv' for details) WARNING: /etc/svc/volatile: File system full, swap space limit exceeded WARNING: /etc/svc/volatile: File system full, swap space limit exceeded WARNING: /etc/svc/volatile: File system full, swap space limit exceeded WARNING: /etc/svc/volatile: File system full, swap space limit exceeded WARNING: /etc/svc/volatile: File system full, swap space limit exceeded WARNING: /etc/svc/volatile: File system full, swap space limit exceeded WARNING: /etc/svc/volatile: File system full, swap space limit exceeded WARNING: /etc/svc/volatile: File system full, swap space limit exceeded WARNING: /etc/svc/volatile: File system full, swap space limit exceeded WARNING: /etc/svc/volatile: File system full, swap space limit exceeded WARNING: /etc/svc/volatile: File system full, swap space limit exceeded INIT: Couldn't write persistent state file `/etc/svc/volatile/init.state'. WARNING: /etc/svc/volatile: File system full, swap space limit exceeded Apr 29 17:06:37 svc.startd[7]: Failed to add svc:/network/routing/legacy-routing:ipv4 (Software caused connection abort). WARNING: /etc/svc/volatile: File system full, swap space limit exceeded WARNING: /etc/svc/volatile: File system full, swap space limit exceeded WARNING: /etc/svc/volatile: File system full, swap space limit exceeded Apr 29 17:07:38 svc.startd[7]: svc:/network/physical:default: Method "/lib/svc/method/net-physical" failed due to signal KILL. WARNING: /etc/svc/volatile: File system full, swap space limit exceeded WARNING: /etc/svc/volatile: File system full, swap space limit exceeded WARNING: /etc/svc/volatile: File system full, swap space limit exceeded Apr 29 17:09:36 svc.startd[7]: svc:/system/filesystem/root:default: Method or service exit timed out. Killing contract 9. Apr 29 17:10:36 svc.startd[7]: svc:/system/filesystem/root:default: Method "/lib/svc/method/fs-root" failed due to signal KILL. Another issue this same server. boot cdrom Boot device: /pci at 400/pci at 0/pci at 1/pci at 0/usb at 0,2/storage at 2/disk at 0:f File and args: SunOS Release 5.10 Version Generic_137137-09 64-bit Copyright 1983-2008 Sun Microsystems, Inc. All rights reserved. Use is subject to license terms. WARNING: vsw0: device (nxge0) open failed rv:16 WARNING: vsw0: device (nxge0) open failed rv:16 WARNING: vsw1: device (nxge1) open failed rv:16 WARNING: vsw1: device (nxge1) open failed rv:16 WARNING: vsw4: device (nxge4) open failed rv:16 WARNING: vsw4: device (nxge4) open failed rv:16 WARNING: vsw3: device (nxge3) open failed rv:16 WARNING: vsw3: device (nxge3) open failed rv:16 WARNING: vsw2: device (nxge2) open failed rv:16 WARNING: vsw2: device (nxge2) open failed rv:16 WARNING: vsw5: device (nxge5) open failed rv:16 WARNING: vsw5: device (nxge5) open failed rv:16 Configuring devices. NOTICE: nxge4: xcvr addr:0x1d - link is up 1000 Mbps full duplex NOTICE: nxge2: xcvr addr:0x0b - link is up 1000 Mbps full duplex NOTICE: nxge5: xcvr addr:0x1c - link is up 1000 Mbps full duplex NOTICE: nxge3: xcvr addr:0x0a - link is up 1000 Mbps full duplex NOTICE: nxge6: xcvr addr:0x1b - link is up 1000 Mbps full duplex NOTICE: nxge7: xcvr addr:0x1a - link is up 1000 Mbps full duplex WARNING: /pci at 400/pci at 0/pci at 8/scsi at 0/sd at 0,0 (sd0): Corrupt label; wrong magic number NOTICE: nxge0: xcvr addr:0x0d - link is down NOTICE: nxge1: xcvr addr:0x0c - link is down NOTICE: nxge2: xcvr addr:0x0b - link is up 1000 Mbps full duplex NOTICE: nxge3: xcvr addr:0x0a - link is up 1000 Mbps full duplex NOTICE: nxge4: xcvr addr:0x1d - link is up 1000 Mbps full duplex NOTICE: nxge5: xcvr addr:0x1c - link is up 1000 Mbps full duplex NOTICE: nxge6: xcvr addr:0x1b - link is up 1000 Mbps full duplex NOTICE: nxge0: xcvr addr:0x0d - link is down NOTICE: nxge7: xcvr addr:0x1a - link is up 1000 Mbps full duplex NOTICE: nxge1: xcvr addr:0x0c - link is down NOTICE: nxge2: xcvr addr:0x0b - link is up 1000 Mbps full duplex NOTICE: nxge3: xcvr addr:0x0a - link is up 1000 Mbps full duplex NOTICE: nxge4: xcvr addr:0x1d - link is up 1000 Mbps full duplex NOTICE: nxge5: xcvr addr:0x1c - link is up 1000 Mbps full duplex NOTICE: nxge6: xcvr addr:0x1b - link is up 1000 Mbps full duplex /sbin/install-discovery: fork failed - too many processes Apr 29 21:07:28 svc.startd[7]: svc:/system/install-discovery:default: Method "/sbin/install-discovery < /dev/console > /dev/console 2>&1" failed with exit status 1. ln: cannot create /tmp/devices/devices: Operation not applicable Configuring devices. devfsadmd: daemon pid 28 is already running Using RPC Bootparams for network configuration information. Attempting to configure interface nxge6... Skipped interface nxge6 Attempting to configure interface nxge5... Skipped interface nxge5 Attempting to configure interface nxge4... Skipped interface nxge4 Attempting to configure interface nxge3... Skipped interface nxge3 Attempting to configure interface nxge2... Skipped interface nxge2 Attempting to configure interface nxge1... Skipped interface nxge1 Attempting to configure interface nxge0... Skipped interface nxge0 Attempting to configure interface vsw5... Skipped interface vsw5 Attempting to configure interface vsw4... Skipped interface vsw4 Attempting to configure interface vsw3... Skipped interface vsw3 Attempting to configure interface vsw2... Skipped interface vsw2 Attempting to configure interface vsw1... Skipped interface vsw1 Attempting to configure interface vsw0... Skipped interface vsw0 Reading ZFS config: done. Setting up Java. Please wait... NOTE: Not enough memory for graphical installation. Graphical installation requires 96 MB of virtual memory. Found 8 MB of virtual memory. Reverting to text-based installation. Serial console, reverting to text install Beginning system identification... Apr 29 21:35:55 svc.startd[7]: svc:/system/cryptosvc:default: Couldn't fork to execute method /usr/sbin/cryptoadm start: Resource temporarily unavailable Searching for configuration file(s)... WARNING: Module verification failed for /platform/SUNW,T5240/kernel/drv/sparcv9/ncp. /sbin/sysidfind: fork failed - too many processes Search complete. /sbin/install-setup: fork failed - too many processes Apr 29 21:44:52 svc.startd[7]: svc:/system/system-log:default: Method or service exit timed out. Killing contract 18. Discovering additional network configuration... /usr/sbin/sysidnet: Couldn't start user interface /sbin/install-setup: fork failed - too many processes /sbin/install-setup: fork failed - too many processes Apr 29 21:57:26 svc.startd[7]: svc:/system/system-log:default: Method "/lib/svc/method/system-log" failed with exit status 1. /sbin/install-setup: fork failed - too many processes /sbin/install-begin: fork failed - too many processes Apr 29 22:09:58 svc.startd[7]: svc:/system/install-setup:default: Couldn't fork to execute method /sbin/install-setup > /dev/console < /dev/console 2>&1: Resource temporarily unavailable Exiting to shell... # # One more error with the same issue. This is after power off and power back on the machine. k boot Boot device: disk File and args: SunOS Release 5.10 Version Generic_138888-03 64-bit Copyright 1983-2008 Sun Microsystems, Inc. All rights reserved. Use is subject to license terms. NOTICE: nxge0: xcvr addr:0x1d - link is down NOTICE: nxge2: xcvr addr:0x1b - link is down NOTICE: nxge1: xcvr addr:0x1c - link is down NOTICE: nxge4: xcvr addr:0x0d - link is down NOTICE: nxge5: xcvr addr:0x0c - link is down NOTICE: nxge3: xcvr addr:0x1a - link is down NOTICE: nxge2: xcvr addr:0x1b - link is up 1000 Mbps full duplex NOTICE: nxge0: xcvr addr:0x1d - link is up 1000 Mbps full duplex NOTICE: nxge1: xcvr addr:0x1c - link is up 1000 Mbps full duplex NOTICE: nxge3: xcvr addr:0x1a - link is up 1000 Mbps full duplex panic[cpu0]/thread=180e000: main: unable to fork init. 000000000180ba10 genunix:main+410 (18f7c68, 18f3800, 185b2a0, 18ab400, 182b598, 18fa000) %l0-3: 000000000101a800 00000000018fa000 00000000018fa000 0000000000000002 %l4-7: 00000000018faec0 00000000018fac00 00000000018f7c78 00000000018f7c00 syncing file systems... done skipping system dump - no dump device configured rebooting... Resetting... T5240, No Keyboard Copyright 2008 Sun Microsystems, Inc. All rights reserved. OpenBoot 4.30.0, 768 MB memory available, Serial #86438504. Ethernet address 0:21:28:26:f2:68, Host ID: 8526f268. {0}ok +++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++ Here is an error with another T5240. I was able to bring 27 LDOMs up online. When I attempted to bind the 28th Ldom I got the following errors INIT: fork() for svc.startd failed: Resource temporarily unavailable. Will retry in 1 second... INIT: fork() for svc.startd failed: Resource temporarily unavailable. Will retry in 1 second... INIT: fork() for svc.startd failed: Resource temporarily unavailable. Will retry in 1 second... INIT: fork() for svc.startd failed: Resource temporarily unavailable. Will retry in 1 second... INIT: fork() for svc.startd failed: Resource temporarily unavailable. Will retry in 1 second... INIT: fork() for svc.startd failed: Resource temporarily unavailable. Will retry in 1 second... INIT: fork() for svc.startd failed: Resource temporarily unavailable. Will retry in 1 second... INIT: fork() for svc.startd failed: Resource temporarily unavailable. Will retry in 1 second... INIT: fork() for svc.startd failed: Resource temporarily unavailable. Will retry in 1 second... INIT: fork() for svc.startd failed: Resource temporarily unavailable. Will retry in 1 second... INIT: fork() for svc.startd failed: Resource temporarily unavailable. Will retry in 1 second... INIT: fork() for svc.startd failed: Resource temporarily unavailable. Will retry in 1 second... INIT: fork() for svc.startd failed: Resource temporarily unavailable. Will retry in 1 second... INIT: fork() for svc.startd failed: Resource temporarily unavailable. Will retry in 1 second... INIT: fork() for svc.startd failed: Resource temporarily unavailable. Will retry in 1 second... INIT: fork() for svc.startd failed: Resource temporarily unavailable. Will retry in 1 second... INIT: fork() for svc.startd failed: Resource temporarily unavailable. Will retry in 1 second... INIT: fork() for svc.startd failed: Resource temporarily unavailable. Will retry in 1 second... INIT: fork() for svc.startd failed: Resource temporarily unavailable. Will retry in 1 second... INIT: fork() for svc.startd failed: Resource temporarily unavailable. Will retry in 1 second... INIT: fork() for svc.startd failed: Resource temporarily unavailable. Will retry in 1 second... INIT: fork() for svc.startd failed: Resource temporarily unavailable. Will retry in 1 second... At this point, I can issue any commands at all. Not even a ls command. Please look into this. If you have any questions, please give a call @ (650)527-1968 Thanks and regards. Toan. From:Thanh Van [mailto:thanh_van at symantec.com] Sent: Friday, May 01, 2009 4:04 PM To: Toan Nguyen Subject: [Fwd: Re: LDOM On T5240] FYI -------- Original Message -------- Subject: Re: LDOM On T5240 Date: Fri, 01 May 2009 15:16:03 -0700 From: Annie Chan <annie.c...@sun.com> Organization: Western Region SE To: Thanh Van <thanh_van at symantec.com> CC: Annie.Chan at sun.com References: <49F9D6B0.6050506 at symantec.com> <49F9EE6B.2010808 at Sun.COM> Hi TV, I just realized that the information in my previous email is wrong. Minimum memory per guest domain is 1GB. So my suggestion to try 512MB will not work. My error... and apologize for this. Also I review the document (url is below), click Section 1 (New) Hardware, there are best practices on memory assign to each domain. http://wikis.sun.com/display/SolarisLogicalDomains/LDoms%20Community%20Cookbook Thanks, Annie On 04/30/09 11:31 AM, Annie Chan wrote: HI TV, Technically you don't have 1GB free memory available to you. Apparently the hypervisor on the T5240 requires ~128MB memory to operate. Perhaps reducing memory size for the 31st LDom to less than 1GB, let's try 512MB to see if the 31st LDom can successfully bind. Please let me know the outcome. Thank you! Regards, Annie Annie Chan Sales Systems Engineer Sun Microsystems, Inc. 4040 Palm Drive,, M/S# USCA04-203 Santa Clara, CA 95054 US Phone (650) 688-9985 x49985 Mobile (408) 307-1192 Fax (408) 276-8069 Email Annie.Chan at Sun.COM On 04/30/09 09:49 AM, Thanh Van wrote: Hi Annie, Here is an out put of the ldom configured: bash-3.00# ldm bind thor504v29; ldm start thor504v29; ldm list bash-3.00# ./ldm list NAME STATE FLAGS CONS VCPU MEMORY UTIL UPTIME primary active -n-cv- SP 4 1G 6.9% 1h 1m thor504v1 active -t---- 5000 4 1G 25% 2h 51m thor504v10 active -t---- 5009 4 1G 25% 2h 51m thor504v11 active -t---- 5010 4 1G 25% 2h 51m thor504v12 active -t---- 5011 4 1G 25% 2h 51m thor504v13 active -t---- 5012 4 1G 25% 2h 51m thor504v14 active -t---- 5013 4 1G 25% 2h 51m thor504v15 active -n---- 5014 4 1G 0.4% 53m thor504v16 active -t---- 5015 4 1G 25% 2h 51m thor504v17 active -t---- 5016 4 1G 25% 2h 51m thor504v18 active -t---- 5017 4 1G 25% 2h 51m thor504v19 active -t---- 5018 4 1G 25% 2h 51m thor504v2 active -t---- 5001 4 1G 25% 2h 51m thor504v20 active -t---- 5019 4 1G 25% 2h 51m thor504v21 active -n---- 5020 4 1G 0.3% 1h 59m thor504v22 active -n---- 5021 4 1G 0.2% 1h 57m thor504v23 active -n---- 5022 4 1G 0.2% 1h 48m thor504v24 active -n---- 5023 4 1G 0.3% 1h 47m thor504v25 active -n---- 5024 4 1G 0.2% 1h 29m thor504v26 active -n---- 5025 4 1G 0.2% 1h 25m thor504v27 active -n---- 5026 4 1G 0.2% 1h 16m thor504v28 active -n---- 5027 4 1G 0.3% 1h 14m thor504v29 active -n---- 5028 4 1G 0.2% 1h 3m thor504v3 active -t---- 5002 4 1G 25% 2h 51m thor504v30 active -n---- 5029 4 1G 0.3% 30m thor504v4 active -t---- 5003 4 1G 25% 2h 51m thor504v5 active -t---- 5004 4 1G 25% 2h 51m thor504v6 active -t---- 5005 4 1G 25% 2h 51m thor504v7 active -t---- 5006 4 1G 25% 2h 51m thor504v8 active -t---- 5007 4 1G 25% 2h 51m thor504v9 active -t---- 5008 4 1G 25% 2h 51m thor504v31 inactive ------ 4 1G bash-3.00# ./ldm bind thor504v31 Not enough free memory present to meet this request Could not bind requested memory for LDom thor504v31 bash-3.00# Connection to thor504.engba.symantec.com closed by foreign host. -- Thanks & Best Regards, Thanh Van {TV} SYMANTEC Corporation Storage & Availability Management Group [SAMG] 350 Ellis Street - MTV-B4003 Mountain View, CA 94043 Phone: (650)-527-4689 Fax: (650)-527-1982 Email: thanh_van at symantec.com -------------- next part -------------- An HTML attachment was scrubbed... URL: <http://mail.opensolaris.org/pipermail/ldoms-discuss/attachments/20090502/58984403/attachment.html>
