Re: [zfs-discuss] Opteron 6100? Does it work with opensolaris?
You can resume a send if the destination has a snapshot in common with the source. If you don't, there's nothing you can do. It probably taking a while to restart because the sends that were interrupted need to be rolled back. Sent from my Nexus One. On May 21, 2010 9:44 PM, Thomas Burgess wonsl...@gmail.com wrote: I can't tell you for sure For some reason the server lost power and it's taking forever to come back up. (i'm really not sure what happened) anyways, this leads me to my next couple questions: Is there any way to resume a zfs send/recv Why is it taking so long for the server to come up? it's stuck on Reading ZFS config and there is a FLURRY of hard drive lights blinking (all 10 in sync ) On Sat, May 22, 2010 at 12:26 AM, Brandon High bh...@freaks.com wrote: On Fri, May 21, 201... ___ zfs-discuss mailing list zfs-discuss@opensolaris.org http://mail.opensolaris.org/mailman/listinfo/zfs-discuss
Re: [zfs-discuss] Opteron 6100? Does it work with opensolaris?
yah, unfortunately this is the first send. i'm trying to send 9 TB of data. It really sucks because i was at 6 TB when it lost power On Sat, May 22, 2010 at 2:34 AM, Brandon High bh...@freaks.com wrote: You can resume a send if the destination has a snapshot in common with the source. If you don't, there's nothing you can do. It probably taking a while to restart because the sends that were interrupted need to be rolled back. Sent from my Nexus One. On May 21, 2010 9:44 PM, Thomas Burgess wonsl...@gmail.com wrote: I can't tell you for sure For some reason the server lost power and it's taking forever to come back up. (i'm really not sure what happened) anyways, this leads me to my next couple questions: Is there any way to resume a zfs send/recv Why is it taking so long for the server to come up? it's stuck on Reading ZFS config and there is a FLURRY of hard drive lights blinking (all 10 in sync ) On Sat, May 22, 2010 at 12:26 AM, Brandon High bh...@freaks.com wrote: On Fri, May 21, 201... ___ zfs-discuss mailing list zfs-discuss@opensolaris.org http://mail.opensolaris.org/mailman/listinfo/zfs-discuss
Re: [zfs-discuss] Opteron 6100? Does it work with opensolaris?
On Fri, May 21, 2010 at 10:22 PM, Thomas Burgess wonsl...@gmail.com wrote: yah, it seems that rsync is faster for what i need anywaysat least right now... If you don't have snapshots you want to keep in the new copy, then probably... -B -- Brandon High : bh...@freaks.com ___ zfs-discuss mailing list zfs-discuss@opensolaris.org http://mail.opensolaris.org/mailman/listinfo/zfs-discuss
Re: [zfs-discuss] Opteron 6100? Does it work with opensolaris?
i only care about the most recent snapshot, as this is a growing video collection. i do have snapshots, but i only keep them for when/if i accidently delete something, or rename something wrong. On Sat, May 22, 2010 at 3:43 AM, Brandon High bh...@freaks.com wrote: On Fri, May 21, 2010 at 10:22 PM, Thomas Burgess wonsl...@gmail.com wrote: yah, it seems that rsync is faster for what i need anywaysat least right now... If you don't have snapshots you want to keep in the new copy, then probably... -B -- Brandon High : bh...@freaks.com ___ zfs-discuss mailing list zfs-discuss@opensolaris.org http://mail.opensolaris.org/mailman/listinfo/zfs-discuss
Re: [zfs-discuss] Opteron 6100? Does it work with opensolaris?
On May 21, 2010, at 7:03 PM, Brandon High wrote: On Fri, May 21, 2010 at 5:54 PM, Thomas Burgess wonsl...@gmail.com wrote: shouldn't the newer server have LESS load? Please forgive my ubernoobness. Depends on what it's doing! Load average is really how many process are waiting to run, so it's not always a useful metric. If there are processes waiting on disk, you can have high load with almost no cpu use. Check the iowait with iostat or top. iowait is defined to be 0. It is a useless metric anyway. -- richard -- ZFS and NexentaStor training, Rotterdam, July 13-15, 2010 http://nexenta-rotterdam.eventbrite.com/ ___ zfs-discuss mailing list zfs-discuss@opensolaris.org http://mail.opensolaris.org/mailman/listinfo/zfs-discuss
Re: [zfs-discuss] Opteron 6100? Does it work with opensolaris?
here ya go (sorry for the late reply) wonsl...@wonslung-raidz2:~$ kstat -m cpu_info -c misc module: cpu_infoinstance: 0 name: cpu_info0 class:misc brand AMD Opteron(tm) Processor 6128 cache_id0 chip_id 0 clock_MHz 2000 clog_id 0 core_id 0 cpu_typei386 crtime 9168.3602694 current_clock_Hz20 current_cstate 1 family 16 fpu_typei387 compatible implementation x86 (chipid 0x0 AuthenticAMD 100F91 family 16 model 9 step 1 clock 2000 MHz) model 9 ncore_per_chip 8 ncpu_per_chip 8 pg_id 3 pkg_core_id 0 snaptime113230.79067 socket_type G34 state on-line state_begin 1274377642 stepping1 supported_frequencies_Hz 8:10:12:15:20 supported_max_cstates 0 vendor_id AuthenticAMD module: cpu_infoinstance: 1 name: cpu_info1 class:misc brand AMD Opteron(tm) Processor 6128 cache_id1 chip_id 0 clock_MHz 2000 clog_id 1 core_id 1 cpu_typei386 crtime 9171.356087394 current_clock_Hz20 current_cstate 1 family 16 fpu_typei387 compatible implementation x86 (chipid 0x0 AuthenticAMD 100F91 family 16 model 9 step 1 clock 2000 MHz) model 9 ncore_per_chip 8 ncpu_per_chip 8 pg_id 4 pkg_core_id 1 snaptime113230.734042092 socket_type G34 state on-line state_begin 1274377645 stepping1 supported_frequencies_Hz 8:10:12:15:20 supported_max_cstates 0 vendor_id AuthenticAMD module: cpu_infoinstance: 2 name: cpu_info2 class:misc brand AMD Opteron(tm) Processor 6128 cache_id2 chip_id 0 clock_MHz 2000 clog_id 2 core_id 2 cpu_typei386 crtime 9171.410218363 current_clock_Hz8 current_cstate 0 family 16 fpu_typei387 compatible implementation x86 (chipid 0x0 AuthenticAMD 100F91 family 16 model 9 step 1 clock 2000 MHz) model 9 ncore_per_chip 8 ncpu_per_chip 8 pg_id 5 pkg_core_id 2 snaptime113230.734600041 socket_type G34 state on-line state_begin 1274377645 stepping1 supported_frequencies_Hz 8:10:12:15:20 supported_max_cstates 0 vendor_id AuthenticAMD module: cpu_infoinstance: 3 name: cpu_info3 class:misc brand AMD Opteron(tm) Processor 6128 cache_id3 chip_id 0 clock_MHz 2000 clog_id 3 core_id 3 cpu_typei386 crtime 9171.440232239 current_clock_Hz20 current_cstate 0
Re: [zfs-discuss] Opteron 6100? Does it work with opensolaris?
Something i've been meaning to ask I'm transfering some data from my older server to my newer one. the older server has a socket 775 intel Q9550 8 gb ddr2 800 20 1TB drives in raidz2 (3 vdevs, 2 with 7 drives one with 6) connected to 3 AOC-SAT2-MV8 cards spread as evenly across them as i could The new server is socket g34 based with the opteron 6128 8 core cpu with 16 gb ddr3 1333 ECC ram with 10 2TB drives (so far) in a single raidz2 vdev connected to 3 LSI SAS3081E-R cards (flashed with IT firmware) I'm sure this is due to something i don't understand, but durring zfs send/recv from the old server to the new server (3 send/recv streams) I'm noticing the loadavg on the old server is much less than the new one this is form top on the old server: load averages: 1.58, 1.57, 1.37; up 5+05:13:17 04:52:42 and this is the newer server load averages: 6.20, 5.98, 5.30; up 1+05:03:02 18:49:57 shouldn't the newer server have LESS load? Please forgive my ubernoobness. ___ zfs-discuss mailing list zfs-discuss@opensolaris.org http://mail.opensolaris.org/mailman/listinfo/zfs-discuss
Re: [zfs-discuss] Opteron 6100? Does it work with opensolaris?
On 05/22/10 12:54 PM, Thomas Burgess wrote: Something i've been meaning to ask I'm transfering some data from my older server to my newer one. the older server has a socket 775 intel Q9550 8 gb ddr2 800 20 1TB drives in raidz2 (3 vdevs, 2 with 7 drives one with 6) connected to 3 AOC-SAT2-MV8 cards spread as evenly across them as i could The new server is socket g34 based with the opteron 6128 8 core cpu with 16 gb ddr3 1333 ECC ram with 10 2TB drives (so far) in a single raidz2 vdev connected to 3 LSI SAS3081E-R cards (flashed with IT firmware) I'm sure this is due to something i don't understand, but durring zfs send/recv from the old server to the new server (3 send/recv streams) I'm noticing the loadavg on the old server is much less than the new one this is form top on the old server: load averages: 1.58, 1.57, 1.37; up 5+05:13:17 04:52:42 and this is the newer server load averages: 6.20, 5.98, 5.30; up 1+05:03:02 18:49:57 shouldn't the newer server have LESS load? Do you have compression on? Compressing is more CPU intensive than uncompressing. -- Ian. ___ zfs-discuss mailing list zfs-discuss@opensolaris.org http://mail.opensolaris.org/mailman/listinfo/zfs-discuss
Re: [zfs-discuss] Opteron 6100? Does it work with opensolaris?
On Fri, May 21, 2010 at 5:54 PM, Thomas Burgess wonsl...@gmail.com wrote: shouldn't the newer server have LESS load? Please forgive my ubernoobness. Depends on what it's doing! Load average is really how many process are waiting to run, so it's not always a useful metric. If there are processes waiting on disk, you can have high load with almost no cpu use. Check the iowait with iostat or top. You've got a pretty wide stripe, which isn't going to give the best performance, especially for random write workloads. Your old 3 vdev config will have better random write performance. Check to see what's using the CPU with top or prstat. prstat gives better info for threads, imo. -B -- Brandon High : bh...@freaks.com ___ zfs-discuss mailing list zfs-discuss@opensolaris.org http://mail.opensolaris.org/mailman/listinfo/zfs-discuss
Re: [zfs-discuss] Opteron 6100? Does it work with opensolaris?
is 3 zfs recv's random? On Fri, May 21, 2010 at 10:03 PM, Brandon High bh...@freaks.com wrote: On Fri, May 21, 2010 at 5:54 PM, Thomas Burgess wonsl...@gmail.com wrote: shouldn't the newer server have LESS load? Please forgive my ubernoobness. Depends on what it's doing! Load average is really how many process are waiting to run, so it's not always a useful metric. If there are processes waiting on disk, you can have high load with almost no cpu use. Check the iowait with iostat or top. You've got a pretty wide stripe, which isn't going to give the best performance, especially for random write workloads. Your old 3 vdev config will have better random write performance. Check to see what's using the CPU with top or prstat. prstat gives better info for threads, imo. -B -- Brandon High : bh...@freaks.com ___ zfs-discuss mailing list zfs-discuss@opensolaris.org http://mail.opensolaris.org/mailman/listinfo/zfs-discuss
Re: [zfs-discuss] Opteron 6100? Does it work with opensolaris?
yeah, i'm aware of the performance aspects. I use these servers as mostly hd video servers for my house...they don't need to perform amazingly. I originally went with the setup on the old server because of everything i had read about performance with wide stripes...in all honesty it performed amazingly well, much more than i truly need...i plan to have 2 raidz2 stripes of 10 drives in this server (new one). At most it will be serving 4-5 HD streams (mostly 720p mkv files, with some 1080p as well) The older server can EASILY max out 2 Gb/s links..i imagine the new server will be able to do this as well...i think a scrub of the old server takes 4-5 hours.i'm not sure what this equates to in MB/s but its WAY more than i ever really need. This is what led me to use wider stripes in the new server, and i'm honestly considering redoing the old server as well, if i switched to 2 wider stripes instead of 3 i'd gain another TB or twofor my use i don't think that would be a horrible thing. On Fri, May 21, 2010 at 10:03 PM, Brandon High bh...@freaks.com wrote: On Fri, May 21, 2010 at 5:54 PM, Thomas Burgess wonsl...@gmail.com wrote: shouldn't the newer server have LESS load? Please forgive my ubernoobness. Depends on what it's doing! Load average is really how many process are waiting to run, so it's not always a useful metric. If there are processes waiting on disk, you can have high load with almost no cpu use. Check the iowait with iostat or top. You've got a pretty wide stripe, which isn't going to give the best performance, especially for random write workloads. Your old 3 vdev config will have better random write performance. Check to see what's using the CPU with top or prstat. prstat gives better info for threads, imo. -B -- Brandon High : bh...@freaks.com ___ zfs-discuss mailing list zfs-discuss@opensolaris.org http://mail.opensolaris.org/mailman/listinfo/zfs-discuss
Re: [zfs-discuss] Opteron 6100? Does it work with opensolaris?
On Fri, May 21, 2010 at 7:57 PM, Thomas Burgess wonsl...@gmail.com wrote: is 3 zfs recv's random? It might be. What do a few reports of 'iostat -xcn 30' look like? -B -- Brandon High : bh...@freaks.com ___ zfs-discuss mailing list zfs-discuss@opensolaris.org http://mail.opensolaris.org/mailman/listinfo/zfs-discuss
Re: [zfs-discuss] Opteron 6100? Does it work with opensolaris?
I can't tell you for sure For some reason the server lost power and it's taking forever to come back up. (i'm really not sure what happened) anyways, this leads me to my next couple questions: Is there any way to resume a zfs send/recv Why is it taking so long for the server to come up? it's stuck on Reading ZFS config and there is a FLURRY of hard drive lights blinking (all 10 in sync ) On Sat, May 22, 2010 at 12:26 AM, Brandon High bh...@freaks.com wrote: On Fri, May 21, 2010 at 7:57 PM, Thomas Burgess wonsl...@gmail.com wrote: is 3 zfs recv's random? It might be. What do a few reports of 'iostat -xcn 30' look like? -B -- Brandon High : bh...@freaks.com ___ zfs-discuss mailing list zfs-discuss@opensolaris.org http://mail.opensolaris.org/mailman/listinfo/zfs-discuss
Re: [zfs-discuss] Opteron 6100? Does it work with opensolaris?
On 05/22/10 04:44 PM, Thomas Burgess wrote: I can't tell you for sure For some reason the server lost power and it's taking forever to come back up. (i'm really not sure what happened) anyways, this leads me to my next couple questions: Is there any way to resume a zfs send/recv Nope. Why is it taking so long for the server to come up? it's stuck on Reading ZFS config and there is a FLURRY of hard drive lights blinking (all 10 in sync ) It's cleaning up the mess. If you had a lot of data copied over, it'll take a while deleting it! -- Ian. ___ zfs-discuss mailing list zfs-discuss@opensolaris.org http://mail.opensolaris.org/mailman/listinfo/zfs-discuss
Re: [zfs-discuss] Opteron 6100? Does it work with opensolaris?
yah, it seems that rsync is faster for what i need anywaysat least right now... On Sat, May 22, 2010 at 1:07 AM, Ian Collins i...@ianshome.com wrote: On 05/22/10 04:44 PM, Thomas Burgess wrote: I can't tell you for sure For some reason the server lost power and it's taking forever to come back up. (i'm really not sure what happened) anyways, this leads me to my next couple questions: Is there any way to resume a zfs send/recv Nope. Why is it taking so long for the server to come up? it's stuck on Reading ZFS config and there is a FLURRY of hard drive lights blinking (all 10 in sync ) It's cleaning up the mess. If you had a lot of data copied over, it'll take a while deleting it! -- Ian. ___ zfs-discuss mailing list zfs-discuss@opensolaris.org http://mail.opensolaris.org/mailman/listinfo/zfs-discuss
Re: [zfs-discuss] Opteron 6100? Does it work with opensolaris?
extended device statistics r/sw/s kr/s kw/s wait actv wsvc_t asvc_t %w %b device 0.00.00.00.0 0.0 0.00.0 983.9 0 0 fd0 3.05.5 152.2 67.8 0.0 0.05.01.2 1 1 c8t1d0 41.33.4 1288.3 69.1 0.1 0.12.73.3 3 8 c5t0d0 41.43.6 1288.0 69.0 0.1 0.22.03.4 3 7 c4t0d0 41.43.5 1287.4 69.1 0.1 0.12.63.3 3 8 c4t1d0 41.33.5 1289.1 69.1 0.1 0.22.13.6 3 7 c5t1d0 40.93.6 1267.8 66.6 0.1 0.12.23.0 3 7 c4t2d0 40.73.5 1269.1 66.6 0.1 0.12.43.2 3 7 c5t2d0 40.93.6 1267.9 66.6 0.1 0.12.43.1 3 7 c4t3d0 41.33.5 1288.6 69.0 0.1 0.22.13.5 3 7 c5t3d0 28.03.3 1060.1 60.3 0.0 0.11.22.4 1 4 c4t5d0 27.83.2 1053.8 60.3 0.0 0.11.22.5 1 4 c5t4d0 40.83.5 1268.8 66.6 0.1 0.12.33.1 3 7 c5t5d0 28.13.1 1067.1 60.3 0.0 0.11.32.5 1 4 c5t6d0 28.23.1 1072.2 60.3 0.0 0.11.22.5 1 4 c5t7d0 40.73.6 1268.3 66.6 0.1 0.12.03.3 3 7 c6t0d0 41.33.5 1288.6 69.1 0.1 0.12.63.3 3 8 c6t1d0 40.73.5 1269.2 66.6 0.1 0.12.53.2 3 8 c6t2d0 41.33.6 1288.7 69.0 0.1 0.22.13.5 3 7 c6t3d0 40.83.5 1268.8 66.6 0.1 0.12.43.1 3 7 c6t4d0 29.03.2 .5 60.3 0.0 0.11.32.5 1 4 c6t5d0 28.93.2 1112.6 60.3 0.0 0.11.32.6 1 4 c6t6d0 2.4 15.8 57.0 1962.8 0.2 0.0 10.01.8 3 3 c8t5d0 0.00.00.00.0 0.0 0.00.00.2 0 0 c4t7d0 cpu us sy wt id 40 32 0 28 extended device statistics r/sw/s kr/s kw/s wait actv wsvc_t asvc_t %w %b device 0.00.00.00.0 0.0 0.00.00.0 0 0 fd0 1.82.3 13.7 34.7 0.0 0.03.00.9 0 0 c8t1d0 106.12.4 5636.1 101.4 0.5 0.24.31.5 13 16 c5t0d0 107.02.5 5607.5 101.4 0.3 0.22.52.0 8 14 c4t0d0 109.62.4 5625.9 101.3 0.4 0.13.41.3 11 14 c4t1d0 103.92.4 5665.5 101.3 0.3 0.32.92.4 9 15 c5t1d0 111.02.8 5646.9 100.7 0.4 0.13.31.3 11 15 c4t2d0 105.02.9 5700.7 100.7 0.5 0.25.01.6 14 17 c5t2d0 109.22.8 5635.1 100.6 0.4 0.13.61.3 12 15 c4t3d0 104.62.4 5676.6 101.4 0.3 0.32.92.4 8 15 c5t3d0 51.92.3 3622.1 90.0 0.1 0.21.53.4 3 8 c4t5d0 54.32.0 3696.0 90.0 0.3 0.14.41.5 7 8 c5t4d0 106.62.8 5679.7 100.6 0.3 0.32.82.8 8 16 c5t5d0 93.32.1 6861.6 89.7 0.5 0.14.91.6 12 15 c5t6d0 85.32.1 6186.8 89.9 0.3 0.23.42.8 7 14 c5t7d0 106.22.6 5678.9 100.6 0.3 0.32.82.4 8 14 c6t0d0 104.22.2 5674.1 101.3 0.3 0.33.12.9 9 16 c6t1d0 104.62.9 5655.1 100.7 0.3 0.33.22.8 9 16 c6t2d0 104.72.4 5660.9 101.4 0.3 0.33.02.4 9 15 c6t3d0 106.22.8 5691.6 100.7 0.5 0.24.11.4 12 16 c6t4d0 60.02.1 3987.1 89.9 0.2 0.13.91.4 7 9 c6t5d0 64.92.2 4581.7 89.9 0.0 0.30.64.8 2 10 c6t6d0 1.5 177.6 38.3 22270.8 2.6 0.4 14.52.2 36 39 c8t5d0 0.00.00.00.0 0.0 0.00.00.0 0 0 c4t7d0 cpu us sy wt id 41 33 0 26 extended device statistics r/sw/s kr/s kw/s wait actv wsvc_t asvc_t %w %b device 0.00.00.00.0 0.0 0.00.00.0 0 0 fd0 1.54.2 10.2 65.9 0.0 0.04.71.1 1 1 c8t1d0 108.22.3 5851.0 104.4 0.5 0.24.61.6 14 18 c5t0d0 110.52.4 5851.0 104.4 0.0 0.50.04.7 0 15 c4t0d0 114.52.3 5828.3 104.4 0.4 0.23.71.4 12 16 c4t1d0 106.12.5 5874.3 104.5 0.0 0.60.05.4 0 16 c5t1d0 111.92.6 5937.4 101.9 0.4 0.23.71.4 12 16 c4t2d0 107.02.7 5958.2 101.8 0.5 0.24.61.6 14 18 c5t2d0 112.42.9 5960.2 102.0 0.4 0.23.71.4 11 16 c4t3d0 105.02.4 5890.0 104.4 0.0 0.60.05.5 0 17 c5t3d0 64.22.1 4534.2 91.2 0.1 0.21.83.6 4 10 c4t5d0 42.42.2 2964.4 91.2 0.2 0.14.03.3 4 8 c5t4d0 107.32.7 5937.3 102.0 0.2 0.42.03.9 6 17 c5t5d0 88.32.0 6630.2 91.1 0.5 0.25.51.7 12 15 c5t6d0 82.51.9 6108.0 90.9 0.0 0.50.06.3 0 13 c5t7d0 106.22.6 5965.5 101.8 0.0 0.60.05.5 0 16 c6t0d0 108.42.4 5891.2 104.5 0.0 0.70.06.5 0 19 c6t1d0 107.32.7 5977.0 102.0 0.2 0.51.94.2 6 18 c6t2d0 105.62.5 5879.0 104.4 0.0 0.60.05.7 0 17 c6t3d0 107.82.5 5949.5 101.9 0.5
Re: [zfs-discuss] Opteron 6100? Does it work with opensolaris?
On 05/22/10 05:22 PM, Thomas Burgess wrote: yah, it seems that rsync is faster for what i need anywaysat least right now... ZFS send/receive should run at wire speed for a Gig-E link. Ian. ___ zfs-discuss mailing list zfs-discuss@opensolaris.org http://mail.opensolaris.org/mailman/listinfo/zfs-discuss
Re: [zfs-discuss] Opteron 6100? Does it work with opensolaris?
well it wasn't. it was running pretty slow. i had one really big filesystemwith rsync i'm able to do multiple streams and it's moving much faster On Sat, May 22, 2010 at 1:45 AM, Ian Collins i...@ianshome.com wrote: On 05/22/10 05:22 PM, Thomas Burgess wrote: yah, it seems that rsync is faster for what i need anywaysat least right now... ZFS send/receive should run at wire speed for a Gig-E link. Ian. ___ zfs-discuss mailing list zfs-discuss@opensolaris.org http://mail.opensolaris.org/mailman/listinfo/zfs-discuss
Re: [zfs-discuss] Opteron 6100? Does it work with opensolaris?
hey, when i do this single user boot, is there anyway to capture what pops
on the screen? It's a LOT of stuff.
anyways, it seems to work fine when i do singleuser -srv
cpustat -h lists exactly what you said it should plus a lot more (though the
more is above, so like you said, it shows what it should show at the
bottom)
I'll capture all that later and post it.
On Sat, May 15, 2010 at 8:35 PM, Dennis Clarke dcla...@blastwave.orgwrote:
- Original Message -
From: Thomas Burgess wonsl...@gmail.com
Date: Saturday, May 15, 2010 8:09 pm
Subject: Re: [zfs-discuss] Opteron 6100? Does it work with opensolaris?
To: Orvar Korvar knatte_fnatte_tja...@yahoo.com
Cc: zfs-discuss@opensolaris.org
Well i just wanted to let everyone know that preliminary results are
good.
The livecd booted, all important things seem to be recognized. It
sees all
16 gb of ram i installed and all 8 cores of my opteron 6128
The only real shocker is how loud the norco RPC-4220 fans are (i have
another machine with a norco 4020 case so i assumed the fans would be
similar.this was a BAD assumption) This thing sounds like a hair
dryer
Anyways, I'm running the install now so we'll see how that goes. It
did take
about 10 minutes to find a disk durring the installer, but if i
remember
right, this happened on other machines as well.
Once you have the install done could you post ( somewhere ) what you see
during a single user mode boot with options -srv ?
I would like to see all the gory details.
Also, could you run cpustat -h ?
At the bottom, according to usr/src/uts/intel/pcbe/opteron_pcbe.c you shoud
see :
See BIOS and Kernel Developer's Guide (BKDG) For AMD Family 10h
Processors (AMD publication 31116)
The following registers should be listed :
#defineAMD_FAMILY_10h_generic_events
\
{ PAPI_tlb_dm,DC_dtlb_L1_miss_L2_miss, 0x7 }, \
{ PAPI_tlb_im,IC_itlb_L1_miss_L2_miss, 0x3 }, \
{ PAPI_l3_dcr,L3_read_req, 0xf1 }, \
{ PAPI_l3_icr,L3_read_req, 0xf2 }, \
{ PAPI_l3_tcr,L3_read_req, 0xf7 }, \
{ PAPI_l3_stm,L3_miss, 0xf4 }, \
{ PAPI_l3_ldm,L3_miss, 0xf3 }, \
{ PAPI_l3_tcm,L3_miss, 0xf7 }
You should NOT see anything like this :
r...@aequitas:/root# uname -a
SunOS aequitas 5.11 snv_139 i86pc i386 i86pc Solaris
r...@aequitas:/root# cpustat -h
cpustat: cannot access performance counters - Operation not applicable
... as well as psrinfo -pv please ?
When I get my HP Proliant with the 6174 procs I'll be sure to post whatever
I see.
Dennis
___
zfs-discuss mailing list
zfs-discuss@opensolaris.org
http://mail.opensolaris.org/mailman/listinfo/zfs-discuss
Re: [zfs-discuss] Opteron 6100? Does it work with opensolaris?
psrinfo -pv shows:
The physical processor has 8 virtual processors (0-7)
x86 (AuthenticAMD 100F91 family 16 model 9 step 1 clock 200 MHz)
AMD Opteron(tm) Processor 6128 [ Socket: G34 ]
On Sat, May 15, 2010 at 8:35 PM, Dennis Clarke dcla...@blastwave.orgwrote:
- Original Message -
From: Thomas Burgess wonsl...@gmail.com
Date: Saturday, May 15, 2010 8:09 pm
Subject: Re: [zfs-discuss] Opteron 6100? Does it work with opensolaris?
To: Orvar Korvar knatte_fnatte_tja...@yahoo.com
Cc: zfs-discuss@opensolaris.org
Well i just wanted to let everyone know that preliminary results are
good.
The livecd booted, all important things seem to be recognized. It
sees all
16 gb of ram i installed and all 8 cores of my opteron 6128
The only real shocker is how loud the norco RPC-4220 fans are (i have
another machine with a norco 4020 case so i assumed the fans would be
similar.this was a BAD assumption) This thing sounds like a hair
dryer
Anyways, I'm running the install now so we'll see how that goes. It
did take
about 10 minutes to find a disk durring the installer, but if i
remember
right, this happened on other machines as well.
Once you have the install done could you post ( somewhere ) what you see
during a single user mode boot with options -srv ?
I would like to see all the gory details.
Also, could you run cpustat -h ?
At the bottom, according to usr/src/uts/intel/pcbe/opteron_pcbe.c you shoud
see :
See BIOS and Kernel Developer's Guide (BKDG) For AMD Family 10h
Processors (AMD publication 31116)
The following registers should be listed :
#defineAMD_FAMILY_10h_generic_events
\
{ PAPI_tlb_dm,DC_dtlb_L1_miss_L2_miss, 0x7 }, \
{ PAPI_tlb_im,IC_itlb_L1_miss_L2_miss, 0x3 }, \
{ PAPI_l3_dcr,L3_read_req, 0xf1 }, \
{ PAPI_l3_icr,L3_read_req, 0xf2 }, \
{ PAPI_l3_tcr,L3_read_req, 0xf7 }, \
{ PAPI_l3_stm,L3_miss, 0xf4 }, \
{ PAPI_l3_ldm,L3_miss, 0xf3 }, \
{ PAPI_l3_tcm,L3_miss, 0xf7 }
You should NOT see anything like this :
r...@aequitas:/root# uname -a
SunOS aequitas 5.11 snv_139 i86pc i386 i86pc Solaris
r...@aequitas:/root# cpustat -h
cpustat: cannot access performance counters - Operation not applicable
... as well as psrinfo -pv please ?
When I get my HP Proliant with the 6174 procs I'll be sure to post whatever
I see.
Dennis
___
zfs-discuss mailing list
zfs-discuss@opensolaris.org
http://mail.opensolaris.org/mailman/listinfo/zfs-discuss
Re: [zfs-discuss] Opteron 6100? Does it work with opensolaris?
no.it doesn't. The only sata ports that show up are the ones connected to the backpane via the reverse breakout sas cableand they show as emptyso i'm thinking that opensolaris isn't working with the chipset sata. In the bios i can select from: Native IDE AMD_AHCI RAID Legacy IDE I have it set to AMD_AHCIbut my board also has an IDE slot which i was using for the CDROM drive (this is what i used to load opensolaris in the first place) I also have an option called Sate IDE combined mode I think this may be my problem...i had this enabled, because i thought i needed it in order to use both sata and idei think now it's something else. I'm going to try to boot without it on, if it doesn't work, i'll try to reinstall with it disabled. On Sun, May 16, 2010 at 8:18 PM, Ian Collins i...@ianshome.com wrote: On 05/17/10 12:08 PM, Thomas Burgess wrote: well, i haven't had a lot of time to work with this...but i'm having trouble getting the onboard sata to work in anything but NATIVE IDE mode. I'm not sure exactly what the problem isi'm wondering if i bought the wrong cable (i have a norco 4220 case so the drives connect via a sas sff-8087 on the backpane) I thought this required a reverse breakout cable but maybe i was wrongthis is the first time i've worked with sas on the otherhand, I was able to flash my intel Intel SASUC8I cards with the LSI SAS3081E IT firmware from the LSI site. These seem to work fine. I think i'm just going to order a 3rd card and put it in the pci-e x4 slot. I don't want 16 drives running as sata and 4 running in IDE mode.Is there any way i can tell if the drive i installed opensolaris to is in IDE or SATA mode? Does it show up in cfgadm? -- Ian. ___ zfs-discuss mailing list zfs-discuss@opensolaris.org http://mail.opensolaris.org/mailman/listinfo/zfs-discuss
Re: [zfs-discuss] Opteron 6100? Does it work with opensolaris?
On Mon, May 17, 2010 at 12:51 PM, Thomas Burgess wonsl...@gmail.com wrote: In the bios i can select from: Native IDE AMD_AHCI This is probably what you want. AHCI is supposed to be chipset agnostic. I also have an option called Sate IDE combined mode See if there's anything in the docs about what this actually does. You might need it to use the PATA port, but it could be what's messing things up. If you can't use the cdrom, maybe install from a thumb drive or usb crdrom. (My ASUS M2N-LR board refuses to boot from a thumb drive. Likewise with a friend's Supermicro Intel board. Both work fine from a usb cdrom.) I think this may be my problem...i had this enabled, because i thought i needed it in order to use both sata and idei think now it's something else. I think so. It makes the first 4 ports look like IDE drives (two channels, two drives per channel) and the remaining BIOS RAID or AHCI. -B -- Brandon High : bh...@freaks.com ___ zfs-discuss mailing list zfs-discuss@opensolaris.org http://mail.opensolaris.org/mailman/listinfo/zfs-discuss
Re: [zfs-discuss] Opteron 6100? Does it work with opensolaris?
ok, well this was part of the problem. I disabled the Sata IDE combined mode and reinstalled opensolaris (i tried to just disable it but osol wouldn't boot) now the drive connected to the SSD DOES show up in cfgadm so it seems to be in sata mode...but the drives connected to the reverse breakout cable still don't show up. On the bright side, the drives connected to my SAS cards (through the same backpane, with a standard sff-8087 to sff-8087 cable) DO show up. S, now i just need to figure out why these 4 drives aren't showing up. (my case is the norco RPC-4220, i thought i'd be ok with 2 SAS cards (8 sata ports each) and then 4 of the onboard ports using the reverse breakout cable.something must be wrong with the cablei'll test the 2 drives connected directly in a biti have to take everything appart to do that) On Mon, May 17, 2010 at 4:04 PM, Brandon High bh...@freaks.com wrote: On Mon, May 17, 2010 at 12:51 PM, Thomas Burgess wonsl...@gmail.com wrote: In the bios i can select from: Native IDE AMD_AHCI This is probably what you want. AHCI is supposed to be chipset agnostic. I also have an option called Sate IDE combined mode See if there's anything in the docs about what this actually does. You might need it to use the PATA port, but it could be what's messing things up. If you can't use the cdrom, maybe install from a thumb drive or usb crdrom. (My ASUS M2N-LR board refuses to boot from a thumb drive. Likewise with a friend's Supermicro Intel board. Both work fine from a usb cdrom.) I think this may be my problem...i had this enabled, because i thought i needed it in order to use both sata and idei think now it's something else. I think so. It makes the first 4 ports look like IDE drives (two channels, two drives per channel) and the remaining BIOS RAID or AHCI. -B -- Brandon High : bh...@freaks.com ___ zfs-discuss mailing list zfs-discuss@opensolaris.org http://mail.opensolaris.org/mailman/listinfo/zfs-discuss
Re: [zfs-discuss] Opteron 6100? Does it work with opensolaris?
On 05-17-10, Thomas Burgess wonsl...@gmail.com wrote: psrinfo -pv shows: The physical processor has 8 virtual processors (0-7) x86 (AuthenticAMD 100F91 family 16 model 9 step 1 clock 200 MHz) AMD Opteron(tm) Processor 6128 [ Socket: G34 ] That's odd. Please try this : # kstat -m cpu_info -c misc module: cpu_infoinstance: 0 name: cpu_info0 class:misc brand VIA Esther processor 1200MHz cache_id0 chip_id 0 clock_MHz 1200 clog_id 0 core_id 0 cpu_typei386 crtime 3288.24125364 current_clock_Hz1199974847 current_cstate 0 family 6 fpu_typei387 compatible implementation x86 (CentaurHauls 6A9 family 6 model 10 step 9 clock 1200 MHz) model 10 ncore_per_chip 1 ncpu_per_chip 1 pg_id -1 pkg_core_id 0 snaptime1526742.97169617 socket_type Unknown state on-line state_begin 1272610247 stepping9 supported_frequencies_Hz1199974847 supported_max_cstates 0 vendor_id CentaurHauls You should get a LOT more data. Dennis ___ zfs-discuss mailing list zfs-discuss@opensolaris.org http://mail.opensolaris.org/mailman/listinfo/zfs-discuss
Re: [zfs-discuss] Opteron 6100? Does it work with opensolaris?
well, i haven't had a lot of time to work with this...but i'm having trouble getting the onboard sata to work in anything but NATIVE IDE mode. I'm not sure exactly what the problem isi'm wondering if i bought the wrong cable (i have a norco 4220 case so the drives connect via a sas sff-8087 on the backpane) I thought this required a reverse breakout cable but maybe i was wrongthis is the first time i've worked with sas on the otherhand, I was able to flash my intel Intel SASUC8I cards with the LSI SAS3081E IT firmware from the LSI site. These seem to work fine. I think i'm just going to order a 3rd card and put it in the pci-e x4 slot. I don't want 16 drives running as sata and 4 running in IDE mode.Is there any way i can tell if the drive i installed opensolaris to is in IDE or SATA mode? On Thu, May 13, 2010 at 4:43 AM, Orvar Korvar knatte_fnatte_tja...@yahoo.com wrote: Great! Please report here so we can read about your impressions. -- This message posted from opensolaris.org ___ zfs-discuss mailing list zfs-discuss@opensolaris.org http://mail.opensolaris.org/mailman/listinfo/zfs-discuss ___ zfs-discuss mailing list zfs-discuss@opensolaris.org http://mail.opensolaris.org/mailman/listinfo/zfs-discuss
Re: [zfs-discuss] Opteron 6100? Does it work with opensolaris?
On 05/17/10 12:08 PM, Thomas Burgess wrote: well, i haven't had a lot of time to work with this...but i'm having trouble getting the onboard sata to work in anything but NATIVE IDE mode. I'm not sure exactly what the problem isi'm wondering if i bought the wrong cable (i have a norco 4220 case so the drives connect via a sas sff-8087 on the backpane) I thought this required a reverse breakout cable but maybe i was wrongthis is the first time i've worked with sas on the otherhand, I was able to flash my intel Intel SASUC8I cards with the LSI SAS3081E IT firmware from the LSI site. These seem to work fine. I think i'm just going to order a 3rd card and put it in the pci-e x4 slot. I don't want 16 drives running as sata and 4 running in IDE mode.Is there any way i can tell if the drive i installed opensolaris to is in IDE or SATA mode? Does it show up in cfgadm? -- Ian. ___ zfs-discuss mailing list zfs-discuss@opensolaris.org http://mail.opensolaris.org/mailman/listinfo/zfs-discuss
Re: [zfs-discuss] Opteron 6100? Does it work with opensolaris?
On Sun, May 16, 2010 at 5:08 PM, Thomas Burgess wonsl...@gmail.com wrote: well, i haven't had a lot of time to work with this...but i'm having trouble getting the onboard sata to work in anything but NATIVE IDE mode. Have you tried going straight from the motherboard to a drive too? Take as many pieces out of the mix to see what helps. Is the backplane just a backplane, or a SAS expander? Norco has a Discrete SATA to SFF-8087 Mini SAS Reverse breakout cable listed on the 4220 page, so you've probably got the right thing. -B -- Brandon High : bh...@freaks.com ___ zfs-discuss mailing list zfs-discuss@opensolaris.org http://mail.opensolaris.org/mailman/listinfo/zfs-discuss
Re: [zfs-discuss] Opteron 6100? Does it work with opensolaris?
Well i just wanted to let everyone know that preliminary results are good. The livecd booted, all important things seem to be recognized. It sees all 16 gb of ram i installed and all 8 cores of my opteron 6128 The only real shocker is how loud the norco RPC-4220 fans are (i have another machine with a norco 4020 case so i assumed the fans would be similar.this was a BAD assumption) This thing sounds like a hair dryer Anyways, I'm running the install now so we'll see how that goes. It did take about 10 minutes to find a disk durring the installer, but if i remember right, this happened on other machines as well. On Thu, May 13, 2010 at 9:56 AM, Thomas Burgess wonsl...@gmail.com wrote: I ordered it. It should be here monday or tuesday. When i get everything built and installed, i'll report back. I'm very excited. I am not expecting problems now that i've talked to supermicro about it. Solaris 10 runs for them so i would imagine opensolaris should be fine too. On Thu, May 13, 2010 at 4:43 AM, Orvar Korvar knatte_fnatte_tja...@yahoo.com wrote: Great! Please report here so we can read about your impressions. -- This message posted from opensolaris.org ___ zfs-discuss mailing list zfs-discuss@opensolaris.org http://mail.opensolaris.org/mailman/listinfo/zfs-discuss ___ zfs-discuss mailing list zfs-discuss@opensolaris.org http://mail.opensolaris.org/mailman/listinfo/zfs-discuss
Re: [zfs-discuss] Opteron 6100? Does it work with opensolaris?
- Original Message -
From: Thomas Burgess wonsl...@gmail.com
Date: Saturday, May 15, 2010 8:09 pm
Subject: Re: [zfs-discuss] Opteron 6100? Does it work with opensolaris?
To: Orvar Korvar knatte_fnatte_tja...@yahoo.com
Cc: zfs-discuss@opensolaris.org
Well i just wanted to let everyone know that preliminary results are good.
The livecd booted, all important things seem to be recognized. It
sees all
16 gb of ram i installed and all 8 cores of my opteron 6128
The only real shocker is how loud the norco RPC-4220 fans are (i have
another machine with a norco 4020 case so i assumed the fans would be
similar.this was a BAD assumption) This thing sounds like a hair
dryer
Anyways, I'm running the install now so we'll see how that goes. It
did take
about 10 minutes to find a disk durring the installer, but if i remember
right, this happened on other machines as well.
Once you have the install done could you post ( somewhere ) what you see during
a single user mode boot with options -srv ?
I would like to see all the gory details.
Also, could you run cpustat -h ?
At the bottom, according to usr/src/uts/intel/pcbe/opteron_pcbe.c you shoud see
:
See BIOS and Kernel Developer's Guide (BKDG) For AMD Family 10h Processors
(AMD publication 31116)
The following registers should be listed :
#defineAMD_FAMILY_10h_generic_events
\
{ PAPI_tlb_dm,DC_dtlb_L1_miss_L2_miss, 0x7 }, \
{ PAPI_tlb_im,IC_itlb_L1_miss_L2_miss, 0x3 }, \
{ PAPI_l3_dcr,L3_read_req, 0xf1 }, \
{ PAPI_l3_icr,L3_read_req, 0xf2 }, \
{ PAPI_l3_tcr,L3_read_req, 0xf7 }, \
{ PAPI_l3_stm,L3_miss, 0xf4 }, \
{ PAPI_l3_ldm,L3_miss, 0xf3 }, \
{ PAPI_l3_tcm,L3_miss, 0xf7 }
You should NOT see anything like this :
r...@aequitas:/root# uname -a
SunOS aequitas 5.11 snv_139 i86pc i386 i86pc Solaris
r...@aequitas:/root# cpustat -h
cpustat: cannot access performance counters - Operation not applicable
... as well as psrinfo -pv please ?
When I get my HP Proliant with the 6174 procs I'll be sure to post whatever I
see.
Dennis
___
zfs-discuss mailing list
zfs-discuss@opensolaris.org
http://mail.opensolaris.org/mailman/listinfo/zfs-discuss
Re: [zfs-discuss] Opteron 6100? Does it work with opensolaris?
Great! Please report here so we can read about your impressions. -- This message posted from opensolaris.org ___ zfs-discuss mailing list zfs-discuss@opensolaris.org http://mail.opensolaris.org/mailman/listinfo/zfs-discuss
Re: [zfs-discuss] Opteron 6100? Does it work with opensolaris?
I ordered it. It should be here monday or tuesday. When i get everything built and installed, i'll report back. I'm very excited. I am not expecting problems now that i've talked to supermicro about it. Solaris 10 runs for them so i would imagine opensolaris should be fine too. On Thu, May 13, 2010 at 4:43 AM, Orvar Korvar knatte_fnatte_tja...@yahoo.com wrote: Great! Please report here so we can read about your impressions. -- This message posted from opensolaris.org ___ zfs-discuss mailing list zfs-discuss@opensolaris.org http://mail.opensolaris.org/mailman/listinfo/zfs-discuss ___ zfs-discuss mailing list zfs-discuss@opensolaris.org http://mail.opensolaris.org/mailman/listinfo/zfs-discuss
Re: [zfs-discuss] Opteron 6100? Does it work with opensolaris?
This is how i understand it. I know the network cards are well supported and i know my storage cards are supportedthe onboard sata may work and it may not. If it does, great, i'll use it for booting, if not, this board has 2 onboard bootable USB sticksluckily usb seems to work regardless On Wed, May 12, 2010 at 1:18 AM, Geoff Nordli geo...@gnaa.net wrote: On Behalf Of James C. McPherson Sent: Tuesday, May 11, 2010 5:41 PM On 12/05/10 10:32 AM, Michael DeMan wrote: I agree on the motherboard and peripheral chipset issue. This, and the last generation AMD quad/six core motherboards all seem to use the AMD SP56x0/SP5100 chipset, which I can't find much information about support on for either OpenSolaris or FreeBSD. If you can get the device driver detection utility to run on it, that will give you a reasonable idea. Another issue is the LSI SAS2008 chipset for SAS controller which is frequently offered as an onboard option for many motherboards as well and still seems to be somewhat of a work in progress in regards to being 'production ready'. What metric are you using for production ready ? Are there features missing which you expect to see in the driver, or is it just oh noes, I haven't seen enough big customers with it ? I have been wondering what the compatibility is like on OpenSolaris. My perception is basic network driver support is decent, but storage controllers are more difficult for driver support. My perception is if you are using external cards which you know work for networking and storage, then you should be alright. Am I out in left-field on this? Thanks, Geoff ___ zfs-discuss mailing list zfs-discuss@opensolaris.org http://mail.opensolaris.org/mailman/listinfo/zfs-discuss ___ zfs-discuss mailing list zfs-discuss@opensolaris.org http://mail.opensolaris.org/mailman/listinfo/zfs-discuss
Re: [zfs-discuss] Opteron 6100? Does it work with opensolaris?
On 12/05/10 03:18 PM, Geoff Nordli wrote: I have been wondering what the compatibility is like on OpenSolaris. My perception is basic network driver support is decent, but storage controllers are more difficult for driver support. Now wait just a minute. You're casting aspersions on stuff here without saying what you're talking about, still less where you're getting your info from. Be specific - put up, or shut up. My perception is if you are using external cards which you know work for networking and storage, then you should be alright. Am I out in left-field on this? I believe you are talking through your hat. James C. McPherson -- Senior Software Engineer, Solaris Oracle http://www.jmcp.homeunix.com/blog ___ zfs-discuss mailing list zfs-discuss@opensolaris.org http://mail.opensolaris.org/mailman/listinfo/zfs-discuss
Re: [zfs-discuss] Opteron 6100? Does it work with opensolaris?
Now wait just a minute. You're casting aspersions on stuff here without saying what you're talking about, still less where you're getting your info from. Be specific - put up, or shut up. I think he was just trying to tell me that my cpu should be fine, that the only thing which i might have to worry about is network and disk drivers. ___ zfs-discuss mailing list zfs-discuss@opensolaris.org http://mail.opensolaris.org/mailman/listinfo/zfs-discuss
Re: [zfs-discuss] Opteron 6100? Does it work with opensolaris?
The problem is the Solaris team and lsi have put a lot of work into the new 2008 cards. Claiming there are issues without listing specific bugs they can address is, I'm sure, frustrating to say the least. On May 12, 2010 8:22 AM, Thomas Burgess wonsl...@gmail.com wrote: Now wait just a minute. You're casting aspersions on stuff here without saying what you're ... I think he was just trying to tell me that my cpu should be fine, that the only thing which i might have to worry about is network and disk drivers. ___ zfs-discuss mailing list zfs-discuss@opensolaris.org http://mail.opensolaris.org/mailman/listinfo/zfs-discuss ___ zfs-discuss mailing list zfs-discuss@opensolaris.org http://mail.opensolaris.org/mailman/listinfo/zfs-discuss
Re: [zfs-discuss] Opteron 6100? Does it work with opensolaris?
From: James C. McPherson [mailto:james.mcpher...@oracle.com] Sent: Wednesday, May 12, 2010 2:28 AM On 12/05/10 03:18 PM, Geoff Nordli wrote: I have been wondering what the compatibility is like on OpenSolaris. My perception is basic network driver support is decent, but storage controllers are more difficult for driver support. Now wait just a minute. You're casting aspersions on stuff here without saying what you're talking about, still less where you're getting your info from. Be specific - put up, or shut up. My perception is if you are using external cards which you know work for networking and storage, then you should be alright. Am I out in left-field on this? I believe you are talking through your hat. James, it is not my intention to cast an aspersion in this thread. I should have worded my reply differently instead of posting my perception, but I really didn't think I would get piled on for it. This subject interests me because we are going to have customers deploy OpenSolaris on their own equipment and I have been concerned about compatibility. Is the MOBO/Chipset/CPU actually something to be worried about with OpenSolaris compatibility? I know this is not an all-encompassing list, but I got my hardware info from the Nexenta site (http://www.nexenta.com/corp/supported-hardware/hardware-supported-list) because that is the distro I started with. Have a great day! Geoff ___ zfs-discuss mailing list zfs-discuss@opensolaris.org http://mail.opensolaris.org/mailman/listinfo/zfs-discuss
Re: [zfs-discuss] Opteron 6100? Does it work with opensolaris?
jcm == James C McPherson james.mcpher...@oracle.com writes: storage controllers are more difficult for driver support. jcm Be specific - put up, or shut up. marvell controller hangs machine when a drive is unplugged marvell controller does not support NCQ marvell driver is closed-source blob sil3124 driver has lost interrupt problems ATI SB600/SB700 AHCI driver has performance problems mpt driver has disconnect under heavy load problems that may or may not be MSI-related mpt driver is closed source blob mpt driver is not SATA framework and thus does not work with DVD-ROMS or with smartctl XXX -- smartctl does work now, with '-d sat,12'? or only AHCI works with that? USUAL SUGGESTION: use 1068e non-raid and mpt driver, live with problems USUAL OPTIMISM: lsi2008 / mega_sas, which i THINK are open source but opengrok seems to be down so I did not verify. My perception is if you are using external cards which you know work for networking and storage, then you should be alright. Am I out in left-field on this? jcm I believe you are talking through your hat. network performance problems with realtek network performance problems with nvidia nforce network working-at-all problems with broadcom bge and bnx because of the ludicrous number of chip steppings and errata closed-source blob drivers with broadcom bnx performance and working-at-all problems for atheros L1 USUAL SUGGESTION: use intel 82540 derivative. which, for an AMD board, will almost always be an external card because AMD boards are usually realtek, broadcom, or marvell for AMD chipsets, and realtek or nforce for nVidia chipsets (if anyone still uses nvidia chipsets). FAIR STATEMENT: Linux shares most of these problems except over there bnx is open source. USUAL OPTIMISM: crossbow-supported cards with L4 classifiers in the MAC other than bnx, such as 10gig ones, may be the future, much more performant, ready for CoS pause frames, and good multicore performance, and having source. god willing their quality might turn out to be more uniform but probably nobody knows yet, and they're not cheap and ubiquitous onboard yet. I'm hoping infiniband comes back and 10gig goes away, but that's probably not realistic. WELL POISONING: saying ``if you want open-source drivers go whine at the hardware vendor because they make us sign an NDA, so there's nothing we can do,'' is hogwash. (a) Sun's the one able to realistically bargain with the vendor, not users, because they bring to the table developer hours, OS support, a class of customers, trusting contacts within the vendor, and a hardware manufacturing arm that can make purchasing decisions long-term and at a motherboard component level; no user has anywhere near this insane level of bargaining power; see OpenBSD presentation and ``the OEM problem'', (b) usually only one chip works anyway, so there is no competition, (c) Linux has open source drivers for all these chips and is an existence proof that yes, you can do something about it, and (d) the competition for users is between Solaris and Linux, not between Marvell and LSI. If we want complete source for the OS we will get it faster and more reliably by going to the OS that offers it, not by whining to chip vendors. This is not flamebait but just obvious reality---so obvious that almost everyone who really cares enough to say it is already gone. HTH, HAND. pgpGJkSjxmX5x.pgp Description: PGP signature ___ zfs-discuss mailing list zfs-discuss@opensolaris.org http://mail.opensolaris.org/mailman/listinfo/zfs-discuss
Re: [zfs-discuss] Opteron 6100? Does it work with opensolaris?
On 12/05/10 11:21 PM, Thomas Burgess wrote: Now wait just a minute. You're casting aspersions on stuff here without saying what you're talking about, still less where you're getting your info from. Be specific - put up, or shut up. I think he was just trying to tell me that my cpu should be fine, that the only thing which i might have to worry about is network and disk drivers. If you are worrying about your network and disk controller drivers, then you need to give some information about what you believe any problems are. So far, there's been a bunch of FUD cast on a driver that I worked on (mpt_sas), and I'm still trying to find out from you and others what you think is a problem with it. James C. McPherson -- Senior Software Engineer, Solaris Oracle http://www.jmcp.homeunix.com/blog ___ zfs-discuss mailing list zfs-discuss@opensolaris.org http://mail.opensolaris.org/mailman/listinfo/zfs-discuss
Re: [zfs-discuss] Opteron 6100? Does it work with opensolaris?
I've gotten a couple of the newest prototype AMD systems, with the C34 and G34 sockets. All have run various flavors of OpenSolaris quite well, with the exception of a couple of flaky network problems, which we've tracked down to pre-production NIC hardware and early-access drivers. This is a similar problem I see all the time on prototype Intel stuff. The problems go away when we put in production-ready NIC cards (even when such NIC cards have the same actual chip series, the bugs inevitably are nailed to the beta-level original NIC chips). So I would NOT expect any problems if your MB passes the Device Check tool (or whatever we're calling it nowadays). -- Erik Trimble Java System Support Mailstop: usca22-123 Phone: x17195 Santa Clara, CA Timezone: US/Pacific (GMT-0800) ___ zfs-discuss mailing list zfs-discuss@opensolaris.org http://mail.opensolaris.org/mailman/listinfo/zfs-discuss
Re: [zfs-discuss] Opteron 6100? Does it work with opensolaris?
On 05/13/10 12:46 PM, Erik Trimble wrote: I've gotten a couple of the newest prototype AMD systems, with the C34 and G34 sockets. All have run various flavors of OpenSolaris quite well, with the exception of a couple of flaky network problems, which we've tracked down to pre-production NIC hardware and early-access drivers. This is a similar problem I see all the time on prototype Intel stuff. The problems go away when we put in production-ready NIC cards (even when such NIC cards have the same actual chip series, the bugs inevitably are nailed to the beta-level original NIC chips). So I would NOT expect any problems if your MB passes the Device Check tool (or whatever we're calling it nowadays). Bit of a chicken and egg that, isn't it? You need to run the tool to see if the board's worth buying and you need to buy the board to run the tool! -- Ian. ___ zfs-discuss mailing list zfs-discuss@opensolaris.org http://mail.opensolaris.org/mailman/listinfo/zfs-discuss
Re: [zfs-discuss] Opteron 6100? Does it work with opensolaris?
On Thu, 2010-05-13 at 13:25 +1200, Ian Collins wrote: On 05/13/10 12:46 PM, Erik Trimble wrote: I've gotten a couple of the newest prototype AMD systems, with the C34 and G34 sockets. All have run various flavors of OpenSolaris quite well, with the exception of a couple of flaky network problems, which we've tracked down to pre-production NIC hardware and early-access drivers. This is a similar problem I see all the time on prototype Intel stuff. The problems go away when we put in production-ready NIC cards (even when such NIC cards have the same actual chip series, the bugs inevitably are nailed to the beta-level original NIC chips). So I would NOT expect any problems if your MB passes the Device Check tool (or whatever we're calling it nowadays). Bit of a chicken and egg that, isn't it? You need to run the tool to see if the board's worth buying and you need to buy the board to run the tool! *Somebody* has to be that first early adopter. After that, we all get to ride on their experience. -- Erik Trimble Java System Support Mailstop: usca22-123 Phone: x17195 Santa Clara, CA Timezone: US/Pacific (GMT-0800) ___ zfs-discuss mailing list zfs-discuss@opensolaris.org http://mail.opensolaris.org/mailman/listinfo/zfs-discuss
Re: [zfs-discuss] Opteron 6100? Does it work with opensolaris?
Bit of a chicken and egg that, isn't it? You need to run the tool to see if the board's worth buying and you need to buy the board to run the tool! *Somebody* has to be that first early adopter. After that, we all get to ride on their experience. I am sure the Tier-1 stuff will work just fine. I have an HP unit on order thus : HP Proliant DL165G7 server, 1U Rack Server, 2 × AMD Opteron Processor Model 6172 ( 12 core, 2.1 GHz, 12MB Level 3 Cache, 80W), dual socket configuration for 24-cores in total, 16GB (8 x 2GB) Advanced ECC PC3-10600R (RDIMM) memory, Twenty Four DIMM slots, 2 PCI-E Slots ( 1 PCI Express expansion slot 1, low-profile, half-length and PCI Express expansion slot 2 full height full length ×16 75W +EXT 75W with optional PCI-X support ), 2x HP NC362i Integrated Dual Port Gigabit Server Adapter, Storage Controller (1) Smart Array P410i/256MB BBWC, single HP 500W CS HE Power Supply, no internal HDD, slim height 9.5mm DVD included, no OS - no Monitor, 3 year warranty So when it gets in I'll toss it into a rack, hook up a serial cable and then boot *whatever* as verbosely as possible.[1] If you want you can ssh in to the blastwave server farm and jump on that also ... I'm always game to play with such things. -- Dennis Clarke dcla...@opensolaris.ca - Email related to the open source Solaris dcla...@blastwave.org - Email related to open source for Solaris [1] ummm No, I won't be installing Microsoft Windows 7 64-bit Ultimate Edition. .. or maybe I will :-P ___ zfs-discuss mailing list zfs-discuss@opensolaris.org http://mail.opensolaris.org/mailman/listinfo/zfs-discuss
Re: [zfs-discuss] Opteron 6100? Does it work with opensolaris?
- Thomas Burgess wonsl...@gmail.com skrev: I was looking at building a new ZFS based server for my media files and i was wondering if this cpu was supported...i googled and i coudlnt' find much info about it. I'm specificially looking at this motherboard: http://www.newegg.com/Product/Product.aspx?Item=N82E16813182230 I'd hate to buy it and find out it doesn't work. AFAIK this is just yet another Opteron, only with a bunch more of cores ... roy -- Roy Sigurd Karlsbakk (+47) 97542685 r...@karlsbakk.net http://blogg.karlsbakk.net/ -- I all pedagogikk er det essensielt at pensum presenteres intelligibelt. Det er et elementært imperativ for alle pedagoger å unngå eksessiv anvendelse av idiomer med fremmed opprinnelse. I de fleste tilfeller eksisterer adekvate og relevante synonymer på norsk. ___ zfs-discuss mailing list zfs-discuss@opensolaris.org http://mail.opensolaris.org/mailman/listinfo/zfs-discuss
Re: [zfs-discuss] Opteron 6100? Does it work with opensolaris?
On Tue, May 11, 2010 at 5:29 AM, Thomas Burgess wonsl...@gmail.com wrote: I'm specificially looking at this motherboard: http://www.newegg.com/Product/Product.aspx?Item=N82E16813182230 I'd be more concerned that the motherboard and it's attached peripherals are unsupported than the processor. Solaris can handle 12 cores with no problems. -B -- Brandon High : bh...@freaks.com ___ zfs-discuss mailing list zfs-discuss@opensolaris.org http://mail.opensolaris.org/mailman/listinfo/zfs-discuss
Re: [zfs-discuss] Opteron 6100? Does it work with opensolaris?
I agree on the motherboard and peripheral chipset issue. This, and the last generation AMD quad/six core motherboards all seem to use the AMD SP56x0/SP5100 chipset, which I can't find much information about support on for either OpenSolaris or FreeBSD. Another issue is the LSI SAS2008 chipset for SAS controller which is frequently offered as an onboard option for many motherboards as well and still seems to be somewhat of a work in progress in regards to being 'production ready'. On May 11, 2010, at 3:29 PM, Brandon High wrote: On Tue, May 11, 2010 at 5:29 AM, Thomas Burgess wonsl...@gmail.com wrote: I'm specificially looking at this motherboard: http://www.newegg.com/Product/Product.aspx?Item=N82E16813182230 I'd be more concerned that the motherboard and it's attached peripherals are unsupported than the processor. Solaris can handle 12 cores with no problems. -B -- Brandon High : bh...@freaks.com ___ zfs-discuss mailing list zfs-discuss@opensolaris.org http://mail.opensolaris.org/mailman/listinfo/zfs-discuss ___ zfs-discuss mailing list zfs-discuss@opensolaris.org http://mail.opensolaris.org/mailman/listinfo/zfs-discuss
Re: [zfs-discuss] Opteron 6100? Does it work with opensolaris?
On 12/05/10 10:32 AM, Michael DeMan wrote: I agree on the motherboard and peripheral chipset issue. This, and the last generation AMD quad/six core motherboards all seem to use the AMD SP56x0/SP5100 chipset, which I can't find much information about support on for either OpenSolaris or FreeBSD. If you can get the device driver detection utility to run on it, that will give you a reasonable idea. Another issue is the LSI SAS2008 chipset for SAS controller which is frequently offered as an onboard option for many motherboards as well and still seems to be somewhat of a work in progress in regards to being 'production ready'. What metric are you using for production ready ? Are there features missing which you expect to see in the driver, or is it just oh noes, I haven't seen enough big customers with it ? James C. McPherson -- Senior Software Engineer, Solaris Oracle http://www.jmcp.homeunix.com/blog ___ zfs-discuss mailing list zfs-discuss@opensolaris.org http://mail.opensolaris.org/mailman/listinfo/zfs-discuss
Re: [zfs-discuss] Opteron 6100? Does it work with opensolaris?
the onboard sata is a secondary issue. If i need to, i'll boot from the oboard usb slots. I have 2 LSI 1068e based sas controllers which i will be using. On Tue, May 11, 2010 at 8:40 PM, James C. McPherson j...@opensolaris.orgwrote: On 12/05/10 10:32 AM, Michael DeMan wrote: I agree on the motherboard and peripheral chipset issue. This, and the last generation AMD quad/six core motherboards all seem to use the AMD SP56x0/SP5100 chipset, which I can't find much information about support on for either OpenSolaris or FreeBSD. If you can get the device driver detection utility to run on it, that will give you a reasonable idea. Another issue is the LSI SAS2008 chipset for SAS controller which is frequently offered as an onboard option for many motherboards as well and still seems to be somewhat of a work in progress in regards to being 'production ready'. What metric are you using for production ready ? Are there features missing which you expect to see in the driver, or is it just oh noes, I haven't seen enough big customers with it ? James C. McPherson -- Senior Software Engineer, Solaris Oracle http://www.jmcp.homeunix.com/blog ___ zfs-discuss mailing list zfs-discuss@opensolaris.org http://mail.opensolaris.org/mailman/listinfo/zfs-discuss ___ zfs-discuss mailing list zfs-discuss@opensolaris.org http://mail.opensolaris.org/mailman/listinfo/zfs-discuss
Re: [zfs-discuss] Opteron 6100? Does it work with opensolaris?
Well i went ahead and ordered the board. I will report back soon with the results..i'm pretty excited. These CPU's seem great on paper. On Tue, May 11, 2010 at 9:02 PM, Thomas Burgess wonsl...@gmail.com wrote: the onboard sata is a secondary issue. If i need to, i'll boot from the oboard usb slots. I have 2 LSI 1068e based sas controllers which i will be using. On Tue, May 11, 2010 at 8:40 PM, James C. McPherson j...@opensolaris.orgwrote: On 12/05/10 10:32 AM, Michael DeMan wrote: I agree on the motherboard and peripheral chipset issue. This, and the last generation AMD quad/six core motherboards all seem to use the AMD SP56x0/SP5100 chipset, which I can't find much information about support on for either OpenSolaris or FreeBSD. If you can get the device driver detection utility to run on it, that will give you a reasonable idea. Another issue is the LSI SAS2008 chipset for SAS controller which is frequently offered as an onboard option for many motherboards as well and still seems to be somewhat of a work in progress in regards to being 'production ready'. What metric are you using for production ready ? Are there features missing which you expect to see in the driver, or is it just oh noes, I haven't seen enough big customers with it ? James C. McPherson -- Senior Software Engineer, Solaris Oracle http://www.jmcp.homeunix.com/blog ___ zfs-discuss mailing list zfs-discuss@opensolaris.org http://mail.opensolaris.org/mailman/listinfo/zfs-discuss ___ zfs-discuss mailing list zfs-discuss@opensolaris.org http://mail.opensolaris.org/mailman/listinfo/zfs-discuss
Re: [zfs-discuss] Opteron 6100? Does it work with opensolaris?
On Behalf Of James C. McPherson Sent: Tuesday, May 11, 2010 5:41 PM On 12/05/10 10:32 AM, Michael DeMan wrote: I agree on the motherboard and peripheral chipset issue. This, and the last generation AMD quad/six core motherboards all seem to use the AMD SP56x0/SP5100 chipset, which I can't find much information about support on for either OpenSolaris or FreeBSD. If you can get the device driver detection utility to run on it, that will give you a reasonable idea. Another issue is the LSI SAS2008 chipset for SAS controller which is frequently offered as an onboard option for many motherboards as well and still seems to be somewhat of a work in progress in regards to being 'production ready'. What metric are you using for production ready ? Are there features missing which you expect to see in the driver, or is it just oh noes, I haven't seen enough big customers with it ? I have been wondering what the compatibility is like on OpenSolaris. My perception is basic network driver support is decent, but storage controllers are more difficult for driver support. My perception is if you are using external cards which you know work for networking and storage, then you should be alright. Am I out in left-field on this? Thanks, Geoff ___ zfs-discuss mailing list zfs-discuss@opensolaris.org http://mail.opensolaris.org/mailman/listinfo/zfs-discuss
