Re: Oracle Sun T5120 support getting better in debian 6.0.5 ?
On 08/01/2012 02:44 AM, Brig McCoy wrote: We've got one that we're not using... what would be involved in setting it up for use as a build/porter? Best would be to have it somewhere at a location where we host Debian hardware already. We want to avoid to have yet another hosting location :) Where is the machine located? And would you be willing to give it out of your hands? Feel free to reply to hardware-donati...@debian.org instead. Thanks, Bernd ...brig From: Bernd Zeimetz [be...@bzed.de] Sent: Tuesday, July 31, 2012 6:30 PM To: T.J. Yang Cc: Michel Schanen; debian-sparc@lists.debian.org Subject: Re: Oracle Sun T5120 support getting better in debian 6.0.5 ? Hi, On 07/13/2012 03:20 PM, T.J. Yang wrote: Hi, Michel Thanks for sharing your info on running Debian on Sun T5120. I really appreciate this. I haven't made the switch yet. I will probably start with running the test using LDOM since I don't have a physical T5120 for testing. the debian project also doesn't have a T5120 or similar machine - would be nice to have as a buildd/porter box to ensure the sparc port keeps going on. Just in case somebody has a spare one ;) Cheers, Bernd tj On Fri, Jul 13, 2012 at 6:48 AM, Michel Schanen michel.scha...@googlemail.com wrote: Hi, we installed Debian SPARC 6.0.3 on 20 Sun T5120 Enterprise nodes interconnected with infiniband cards and onboard network cards. The infiniband cards are very buggy and only work over IP. Problem is that there are no supported infiniband drivers for Linux/SPARC. I recommend the Debian installation guide for SPARCs. We used the TFTP method, which worked fairly well. We ran into the same trouble as you when connecting a CDROM drive. http://www.debian.org/releases/stable/sparc/ch04s03.html.en Only trick was that the image had to be named after the IP of the installation target, e.g. 192.168.0.2 - C0.A8.00.02 We received these cluster nodes at no costs and we use them essentially for simulation codes/testing. As the tools are all SPARC and not SPARC64 we had some problems using OpenMP. For instance the atomic statement was very slow. After compiling gcc with arch=SPARC64 we had a considerable performance boost using OpenMP. In the end, all our development tools are now recompiled with arch=SPARC64. Other than that, everything works flawlessly! NFS crashes after some weeks of uptime. Therefore we do a weekly reboot. You will be able to log in to the ILOM SPs over SSH and eventually to your system console. Oh and don't forget to recompile your kernel with 64 CPU support. Otherwise you will be stuck with 32 or something. Michel -- Bernd ZeimetzDebian GNU/Linux Developer http://bzed.dehttp://www.debian.org GPG Fingerprint: ECA1 E3F2 8E11 2432 D485 DD95 EB36 171A 6FF9 435F -- To UNSUBSCRIBE, email to debian-sparc-requ...@lists.debian.org with a subject of unsubscribe. Trouble? Contact listmas...@lists.debian.org Archive: http://lists.debian.org/50186aa9.4030...@bzed.de -- Bernd ZeimetzDebian GNU/Linux Developer http://bzed.dehttp://www.debian.org GPG Fingerprint: ECA1 E3F2 8E11 2432 D485 DD95 EB36 171A 6FF9 435F -- To UNSUBSCRIBE, email to debian-sparc-requ...@lists.debian.org with a subject of unsubscribe. Trouble? Contact listmas...@lists.debian.org Archive: http://lists.debian.org/5022dade.6050...@bzed.de
Re: Oracle Sun T5120 support getting better in debian 6.0.5 ?
Hi, On 07/13/2012 03:20 PM, T.J. Yang wrote: Hi, Michel Thanks for sharing your info on running Debian on Sun T5120. I really appreciate this. I haven't made the switch yet. I will probably start with running the test using LDOM since I don't have a physical T5120 for testing. the debian project also doesn't have a T5120 or similar machine - would be nice to have as a buildd/porter box to ensure the sparc port keeps going on. Just in case somebody has a spare one ;) Cheers, Bernd tj On Fri, Jul 13, 2012 at 6:48 AM, Michel Schanen michel.scha...@googlemail.com wrote: Hi, we installed Debian SPARC 6.0.3 on 20 Sun T5120 Enterprise nodes interconnected with infiniband cards and onboard network cards. The infiniband cards are very buggy and only work over IP. Problem is that there are no supported infiniband drivers for Linux/SPARC. I recommend the Debian installation guide for SPARCs. We used the TFTP method, which worked fairly well. We ran into the same trouble as you when connecting a CDROM drive. http://www.debian.org/releases/stable/sparc/ch04s03.html.en Only trick was that the image had to be named after the IP of the installation target, e.g. 192.168.0.2 - C0.A8.00.02 We received these cluster nodes at no costs and we use them essentially for simulation codes/testing. As the tools are all SPARC and not SPARC64 we had some problems using OpenMP. For instance the atomic statement was very slow. After compiling gcc with arch=SPARC64 we had a considerable performance boost using OpenMP. In the end, all our development tools are now recompiled with arch=SPARC64. Other than that, everything works flawlessly! NFS crashes after some weeks of uptime. Therefore we do a weekly reboot. You will be able to log in to the ILOM SPs over SSH and eventually to your system console. Oh and don't forget to recompile your kernel with 64 CPU support. Otherwise you will be stuck with 32 or something. Michel -- Bernd ZeimetzDebian GNU/Linux Developer http://bzed.dehttp://www.debian.org GPG Fingerprint: ECA1 E3F2 8E11 2432 D485 DD95 EB36 171A 6FF9 435F -- To UNSUBSCRIBE, email to debian-sparc-requ...@lists.debian.org with a subject of unsubscribe. Trouble? Contact listmas...@lists.debian.org Archive: http://lists.debian.org/50186aa9.4030...@bzed.de
RE: Oracle Sun T5120 support getting better in debian 6.0.5 ?
We've got one that we're not using... what would be involved in setting it up for use as a build/porter? ...brig From: Bernd Zeimetz [be...@bzed.de] Sent: Tuesday, July 31, 2012 6:30 PM To: T.J. Yang Cc: Michel Schanen; debian-sparc@lists.debian.org Subject: Re: Oracle Sun T5120 support getting better in debian 6.0.5 ? Hi, On 07/13/2012 03:20 PM, T.J. Yang wrote: Hi, Michel Thanks for sharing your info on running Debian on Sun T5120. I really appreciate this. I haven't made the switch yet. I will probably start with running the test using LDOM since I don't have a physical T5120 for testing. the debian project also doesn't have a T5120 or similar machine - would be nice to have as a buildd/porter box to ensure the sparc port keeps going on. Just in case somebody has a spare one ;) Cheers, Bernd tj On Fri, Jul 13, 2012 at 6:48 AM, Michel Schanen michel.scha...@googlemail.com wrote: Hi, we installed Debian SPARC 6.0.3 on 20 Sun T5120 Enterprise nodes interconnected with infiniband cards and onboard network cards. The infiniband cards are very buggy and only work over IP. Problem is that there are no supported infiniband drivers for Linux/SPARC. I recommend the Debian installation guide for SPARCs. We used the TFTP method, which worked fairly well. We ran into the same trouble as you when connecting a CDROM drive. http://www.debian.org/releases/stable/sparc/ch04s03.html.en Only trick was that the image had to be named after the IP of the installation target, e.g. 192.168.0.2 - C0.A8.00.02 We received these cluster nodes at no costs and we use them essentially for simulation codes/testing. As the tools are all SPARC and not SPARC64 we had some problems using OpenMP. For instance the atomic statement was very slow. After compiling gcc with arch=SPARC64 we had a considerable performance boost using OpenMP. In the end, all our development tools are now recompiled with arch=SPARC64. Other than that, everything works flawlessly! NFS crashes after some weeks of uptime. Therefore we do a weekly reboot. You will be able to log in to the ILOM SPs over SSH and eventually to your system console. Oh and don't forget to recompile your kernel with 64 CPU support. Otherwise you will be stuck with 32 or something. Michel -- Bernd ZeimetzDebian GNU/Linux Developer http://bzed.dehttp://www.debian.org GPG Fingerprint: ECA1 E3F2 8E11 2432 D485 DD95 EB36 171A 6FF9 435F -- To UNSUBSCRIBE, email to debian-sparc-requ...@lists.debian.org with a subject of unsubscribe. Trouble? Contact listmas...@lists.debian.org Archive: http://lists.debian.org/50186aa9.4030...@bzed.de -- To UNSUBSCRIBE, email to debian-sparc-requ...@lists.debian.org with a subject of unsubscribe. Trouble? Contact listmas...@lists.debian.org Archive: http://lists.debian.org/523a9a3871570244a740476d1438929e0281e...@bl2prd0710mb362.namprd07.prod.outlook.com
Re: Oracle Sun T5120 support getting better in debian 6.0.5 ?
Hi, On Fri, Jul 13, 2012 at 3:57 PM, Frans van Berckel fberc...@xs4all.nlwrote: On Fri, 2012-07-13 at 13:48 +0200, Michel Schanen wrote: We received these cluster nodes at no costs and we use them essentially for simulation codes/testing. As the tools are all SPARC and not SPARC64 we had some problems using OpenMP. For instance the atomic statement was very slow. After compiling gcc with arch=SPARC64 we had a considerable performance boost using OpenMP. In the end, all our development tools are now recompiled with arch=SPARC64. Did you know theres a SPARC64 packages port at Debian-ports? http://buildd.debian-ports.org/status/architecture.php?a=sparc64suite=sid I haven't known yet. Maybe I'll test a SPARC64 installation on a spare node or get involved in the build/testing process. Thank you. Oh and don't forget to recompile your kernel with 64 CPU support. Otherwise you will be stuck with 32 or something. And they even did build a 64 bit kernel as well. A how-to bootstrapping it for SPARC64 can be found in this wiki. http://wiki.debian.org/Sparc64 Correct me if I'm wrong but I think that the kernel is 64bit on the official SPARC port of debian. Only the userland is 32bit. Here I was only talking about the number of CPU limit. The Niagara T2 has 64 cores, where only 32 will be used if you use the provided kernel on the official SPARC release. Thanks, Frans van Berckel Another problem we faced with the T5120 systems was that the tftp network boot failed. We installed all of the nodes diskless. This kernel has to have nfs support builtin. That way the root file system is mounted over nfs. While pulling the kernel over tftp boot, the download stalled. The problem was the size of our kernel. We had to strip it down to a size of currently 5 MB; over 5MB net boot fails. Michel
Re: Oracle Sun T5120 support getting better in debian 6.0.5 ?
Hi, we installed Debian SPARC 6.0.3 on 20 Sun T5120 Enterprise nodes interconnected with infiniband cards and onboard network cards. The infiniband cards are very buggy and only work over IP. Problem is that there are no supported infiniband drivers for Linux/SPARC. I recommend the Debian installation guide for SPARCs. We used the TFTP method, which worked fairly well. We ran into the same trouble as you when connecting a CDROM drive. http://www.debian.org/releases/stable/sparc/ch04s03.html.en Only trick was that the image had to be named after the IP of the installation target, e.g. 192.168.0.2 - C0.A8.00.02 We received these cluster nodes at no costs and we use them essentially for simulation codes/testing. As the tools are all SPARC and not SPARC64 we had some problems using OpenMP. For instance the atomic statement was very slow. After compiling gcc with arch=SPARC64 we had a considerable performance boost using OpenMP. In the end, all our development tools are now recompiled with arch=SPARC64. Other than that, everything works flawlessly! NFS crashes after some weeks of uptime. Therefore we do a weekly reboot. You will be able to log in to the ILOM SPs over SSH and eventually to your system console. Oh and don't forget to recompile your kernel with 64 CPU support. Otherwise you will be stuck with 32 or something. Michel
Re: Oracle Sun T5120 support getting better in debian 6.0.5 ?
Hi, Michel Thanks for sharing your info on running Debian on Sun T5120. I really appreciate this. I haven't made the switch yet. I will probably start with running the test using LDOM since I don't have a physical T5120 for testing. tj On Fri, Jul 13, 2012 at 6:48 AM, Michel Schanen michel.scha...@googlemail.com wrote: Hi, we installed Debian SPARC 6.0.3 on 20 Sun T5120 Enterprise nodes interconnected with infiniband cards and onboard network cards. The infiniband cards are very buggy and only work over IP. Problem is that there are no supported infiniband drivers for Linux/SPARC. I recommend the Debian installation guide for SPARCs. We used the TFTP method, which worked fairly well. We ran into the same trouble as you when connecting a CDROM drive. http://www.debian.org/releases/stable/sparc/ch04s03.html.en Only trick was that the image had to be named after the IP of the installation target, e.g. 192.168.0.2 - C0.A8.00.02 We received these cluster nodes at no costs and we use them essentially for simulation codes/testing. As the tools are all SPARC and not SPARC64 we had some problems using OpenMP. For instance the atomic statement was very slow. After compiling gcc with arch=SPARC64 we had a considerable performance boost using OpenMP. In the end, all our development tools are now recompiled with arch=SPARC64. Other than that, everything works flawlessly! NFS crashes after some weeks of uptime. Therefore we do a weekly reboot. You will be able to log in to the ILOM SPs over SSH and eventually to your system console. Oh and don't forget to recompile your kernel with 64 CPU support. Otherwise you will be stuck with 32 or something. Michel -- T.J. Yang -- To UNSUBSCRIBE, email to debian-sparc-requ...@lists.debian.org with a subject of unsubscribe. Trouble? Contact listmas...@lists.debian.org Archive: http://lists.debian.org/CAD2GW8r74o7Aoi3XH6=teeizfeif23xjyo0mvqg243ab5ot...@mail.gmail.com
Re: Oracle Sun T5120 support getting better in debian 6.0.5 ?
On Fri, 2012-07-13 at 13:48 +0200, Michel Schanen wrote: We received these cluster nodes at no costs and we use them essentially for simulation codes/testing. As the tools are all SPARC and not SPARC64 we had some problems using OpenMP. For instance the atomic statement was very slow. After compiling gcc with arch=SPARC64 we had a considerable performance boost using OpenMP. In the end, all our development tools are now recompiled with arch=SPARC64. Did you know theres a SPARC64 packages port at Debian-ports? http://buildd.debian-ports.org/status/architecture.php?a=sparc64suite=sid Oh and don't forget to recompile your kernel with 64 CPU support. Otherwise you will be stuck with 32 or something. And they even did build a 64 bit kernel as well. A how-to bootstrapping it for SPARC64 can be found in this wiki. http://wiki.debian.org/Sparc64 Thanks, Frans van Berckel -- To UNSUBSCRIBE, email to debian-sparc-requ...@lists.debian.org with a subject of unsubscribe. Trouble? Contact listmas...@lists.debian.org Archive: http://lists.debian.org/1342187832.6087.6.ca...@deblnxsrv224.lan
Re: Oracle Sun T5120 support getting better in debian 6.0.5 ?
I'm about 99% sure that Debian has run 64-bit SPARC kernels for a while now, just that few packages are compiled for it. Unlike x86, most binaries are faster as 32-bit code unless they make use of = 3GB RAM and/or 64-bit integer calculations. As a result, only stuff like databases, webservers, or heavy large integer usage (RSA encryption, e.g.) would really benefit much. Finding a binary that is faster when compiled as 64-bit code is an exception to the rule. However, using SPARCv9 instructions (which require a 64-bit CPU) in 32-bit binary can improve performance. Patrick And they even did build a 64 bit kernel as well. A how-to bootstrapping it for SPARC64 can be found in this wiki. http://wiki.debian.org/Sparc64 Thanks, Frans van Berckel -- To UNSUBSCRIBE, email to debian-sparc-requ...@lists.debian.org with a subject of unsubscribe. Trouble? Contact listmas...@lists.debian.org Archive: http://lists.debian.org/1342187832.6087.6.ca...@deblnxsrv224.lan
Re: Oracle Sun T5120 support getting better in debian 6.0.5 ?
On Fri, Jul 13, 2012 at 08:20:36AM -0500, T.J. Yang wrote: Hi, Michel Thanks for sharing your info on running Debian on Sun T5120. I really appreciate this. I haven't made the switch yet. I will probably start with running the test using LDOM since I don't have a physical T5120 for testing. Did you have any luck installing in LDOM? As you probably saw, nobody replied on sparclinux list either, so I suspect that the CD-ROM was never properly supported for LDOM installs. We should probably add it to wheezy errata. tj On Fri, Jul 13, 2012 at 6:48 AM, Michel Schanen michel.scha...@googlemail.com wrote: Hi, we installed Debian SPARC 6.0.3 on 20 Sun T5120 Enterprise nodes interconnected with infiniband cards and onboard network cards. The infiniband cards are very buggy and only work over IP. Problem is that there are no supported infiniband drivers for Linux/SPARC. I recommend the Debian installation guide for SPARCs. We used the TFTP method, which worked fairly well. We ran into the same trouble as you when connecting a CDROM drive. http://www.debian.org/releases/stable/sparc/ch04s03.html.en Only trick was that the image had to be named after the IP of the installation target, e.g. 192.168.0.2 - C0.A8.00.02 We received these cluster nodes at no costs and we use them essentially for simulation codes/testing. As the tools are all SPARC and not SPARC64 we had some problems using OpenMP. For instance the atomic statement was very slow. After compiling gcc with arch=SPARC64 we had a considerable performance boost using OpenMP. In the end, all our development tools are now recompiled with arch=SPARC64. Other than that, everything works flawlessly! NFS crashes after some weeks of uptime. Therefore we do a weekly reboot. You will be able to log in to the ILOM SPs over SSH and eventually to your system console. Oh and don't forget to recompile your kernel with 64 CPU support. Otherwise you will be stuck with 32 or something. Michel -- T.J. Yang -- To UNSUBSCRIBE, email to debian-sparc-requ...@lists.debian.org with a subject of unsubscribe. Trouble? Contact listmas...@lists.debian.org Archive: http://lists.debian.org/CAD2GW8r74o7Aoi3XH6=teeizfeif23xjyo0mvqg243ab5ot...@mail.gmail.com -- Jurij Smakov ju...@wooyd.org Key: http://www.wooyd.org/pgpkey/ KeyID: C99E03CC -- To UNSUBSCRIBE, email to debian-sparc-requ...@lists.debian.org with a subject of unsubscribe. Trouble? Contact listmas...@lists.debian.org Archive: http://lists.debian.org/20120713190242.ga4...@wooyd.org
Re: Oracle Sun T5120 support getting better in debian 6.0.5 ?
On Fri, Jul 13, 2012 at 2:02 PM, Jurij Smakov ju...@wooyd.org wrote: On Fri, Jul 13, 2012 at 08:20:36AM -0500, T.J. Yang wrote: Hi, Michel Thanks for sharing your info on running Debian on Sun T5120. I really appreciate this. I haven't made the switch yet. I will probably start with running the test using LDOM since I don't have a physical T5120 for testing. Did you have any luck installing in LDOM? As you probably saw, nobody replied on sparclinux list either, so I suspect that the CD-ROM was never properly supported for LDOM installs. Using vcdrom that connected to an iso image won't work in LDOM. My only option is to use tftp to boot up a LDOM session. But this task (debian in LDOM) is not in high priority for me right now. tj We should probably add it to wheezy errata. tj On Fri, Jul 13, 2012 at 6:48 AM, Michel Schanen michel.scha...@googlemail.com wrote: Hi, we installed Debian SPARC 6.0.3 on 20 Sun T5120 Enterprise nodes interconnected with infiniband cards and onboard network cards. The infiniband cards are very buggy and only work over IP. Problem is that there are no supported infiniband drivers for Linux/SPARC. I recommend the Debian installation guide for SPARCs. We used the TFTP method, which worked fairly well. We ran into the same trouble as you when connecting a CDROM drive. http://www.debian.org/releases/stable/sparc/ch04s03.html.en Only trick was that the image had to be named after the IP of the installation target, e.g. 192.168.0.2 - C0.A8.00.02 We received these cluster nodes at no costs and we use them essentially for simulation codes/testing. As the tools are all SPARC and not SPARC64 we had some problems using OpenMP. For instance the atomic statement was very slow. After compiling gcc with arch=SPARC64 we had a considerable performance boost using OpenMP. In the end, all our development tools are now recompiled with arch=SPARC64. Other than that, everything works flawlessly! NFS crashes after some weeks of uptime. Therefore we do a weekly reboot. You will be able to log in to the ILOM SPs over SSH and eventually to your system console. Oh and don't forget to recompile your kernel with 64 CPU support. Otherwise you will be stuck with 32 or something. Michel -- T.J. Yang -- To UNSUBSCRIBE, email to debian-sparc-requ...@lists.debian.org with a subject of unsubscribe. Trouble? Contact listmas...@lists.debian.org Archive: http://lists.debian.org/CAD2GW8r74o7Aoi3XH6=teeizfeif23xjyo0mvqg243ab5ot...@mail.gmail.com -- Jurij Smakov ju...@wooyd.org Key: http://www.wooyd.org/pgpkey/ KeyID: C99E03CC -- T.J. Yang -- To UNSUBSCRIBE, email to debian-sparc-requ...@lists.debian.org with a subject of unsubscribe. Trouble? Contact listmas...@lists.debian.org Archive: http://lists.debian.org/CAD2GW8puaVtTOJ=vmrduoca8szmdzzpej-db+k+gz6_t2qm...@mail.gmail.com
Oracle Sun T5120 support getting better in debian 6.0.5 ?
Hi, I am interested to run debian 6.0.5 for sparc on T5120 machine. bash-3.00# uname -a SunOS somemachine 5.10 Generic_142909-17 sun4v sparc SUNW,SPARC-Enterprise-T5120 bash-3.00# Found some old thread discussing T5120's issue with older version of debian. My questions are 1. SLOM/ILOM After install, Can I get to debian root prompt via ILOM port ? 2. network interface onbaord network card is supported right ? 3. USB CDROM Can I do the install via debian sparc DVD ? Thanks for your time tj -- T.J. Yang -- To UNSUBSCRIBE, email to debian-sparc-requ...@lists.debian.org with a subject of unsubscribe. Trouble? Contact listmas...@lists.debian.org Archive: http://lists.debian.org/CAD2GW8rdJ7zhk0aYueLW+XgzCOJHX=_aCnVWJ1hrpR=gpar...@mail.gmail.com
