What is a good choice of sata-ii raid controller for freebsd?

2007-02-08 Thread Artem Kuchin

Hello!

I need a raid controller for FBSD 6.2 which has the following options

1) Full SATA-II support
2) Good rperfomance (over 50MB read, over 30 write) in mirror mode
3) No weird problems with freebSD (like with SRCS16)
4) Utility to monitor status of raids (command line or web)
5) Utility to rebuild, repair, manager arrays in OS
6) Preferably Intel

I know, 3ware has such good stuff, but those controller are not
certified for internet services in here (russia). So, i am pretty much
limited to Intel controllers. Is there intel controller which satisfied all the
1-6  conditions? I only need mirroring.

--
С уважением,
Артем Кучин
ООО Ай  Ти Легион
www.itlegion.ru
+7 (495) 232-0338



___
freebsd-stable@freebsd.org mailing list
http://lists.freebsd.org/mailman/listinfo/freebsd-stable
To unsubscribe, send any mail to [EMAIL PROTECTED]


Re: What is a good choice of sata-ii raid controller for freebsd?

2007-02-08 Thread Stefan Lambrev

Hello,

Artem Kuchin wrote:

Hello!

I need a raid controller for FBSD 6.2 which has the following options

1) Full SATA-II support
2) Good rperfomance (over 50MB read, over 30 write) in mirror mode
3) No weird problems with freebSD (like with SRCS16)
4) Utility to monitor status of raids (command line or web)
5) Utility to rebuild, repair, manager arrays in OS
6) Preferably Intel

I'm very happy with ARECA ARC1110.
ARECA also provide cli tool for freebsd on their site.
I'm using it in RAID 10 configuration and here are few benchmark results 
that I run on production server ;)


*bonnie++ -d /var/tmp -u root -s 16g -n 256:65536:65536:16 Version 1.93c*

Version 1.93c   --Sequential Output-- --Sequential Input- 
--Random-
Concurrency   1 -Per Chr- --Block-- -Rewrite- -Per Chr- --Block-- 
--Seeks--
MachineSize K/sec %CP K/sec %CP K/sec %CP K/sec %CP K/sec %CP  
/sec %CP
blah.cmotd.com  16G   159  88 54264  24 24727  12   299  94 70744  19 
223.5  12
Latency 63581us 803ms1123ms   93936us   94991us 
251ms
Version 1.93c   --Sequential Create-- Random 
Create
blah.cmotd.com  -Create-- --Read--- -Delete-- -Create-- --Read--- 
-Delete--
files:max:min/sec %CP  /sec %CP  /sec %CP  /sec %CP  /sec %CP  
/sec %CP
256:65536:65536/16   715  24   826  25 17321  49   733  2451   2  
6039  70
Latency  1220ms 408ms2805ms1189ms 692ms
2735ms



*./bonnie++ -d /mnt/mblogs -u root -s 16g -n 256:65536:65536:16 - 
Version  1.03*


Version  1.03   --Sequential Output-- --Sequential Input- 
--Random-
   -Per Chr- --Block-- -Rewrite- -Per Chr- --Block-- 
--Seeks--
MachineSize K/sec %CP K/sec %CP K/sec %CP K/sec %CP K/sec %CP  
/sec %CP
blah.cmotd.com  16G 54953  57 56950  21 24375  10 48757  49 70351  17 
202.5   1
   --Sequential Create-- Random 
Create
   -Create-- --Read--- -Delete-- -Create-- --Read--- 
-Delete--
files:max:min/sec %CP  /sec %CP  /sec %CP  /sec %CP  /sec %CP  
/sec %CP
256:65536:65536/16   723  20   909  17 20905  41   756  2151   2  
6528  74


FreeBSD blah.XXX 6.2-PRERELEASE FreeBSD 6.2-PRERELEASE #3: Tue Oct 10 
13:28:56 CEST 2006 [EMAIL PROTECTED]:/usr/obj/usr/src/sys/CORE-SMP  i386


I know, 3ware has such good stuff, but those controller are not
certified for internet services in here (russia). So, i am pretty much
limited to Intel controllers. Is there intel controller which 
satisfied all the

1-6  conditions? I only need mirroring.

--
С уважением,
Артем Кучин
ООО Ай  Ти Легион
www.itlegion.ru
+7 (495) 232-0338



___
freebsd-stable@freebsd.org mailing list
http://lists.freebsd.org/mailman/listinfo/freebsd-stable
To unsubscribe, send any mail to [EMAIL PROTECTED]


--
Best Wishes,
Stefan Lambrev
ICQ# 24134177


___
freebsd-stable@freebsd.org mailing list
http://lists.freebsd.org/mailman/listinfo/freebsd-stable
To unsubscribe, send any mail to [EMAIL PROTECTED]


Re: What is a good choice of sata-ii raid controller for freebsd?

2007-02-08 Thread Clayton Milos

Hello,

Artem Kuchin wrote:

Hello!

I need a raid controller for FBSD 6.2 which has the following options

1) Full SATA-II support
2) Good rperfomance (over 50MB read, over 30 write) in mirror mode
3) No weird problems with freebSD (like with SRCS16)
4) Utility to monitor status of raids (command line or web)
5) Utility to rebuild, repair, manager arrays in OS
6) Preferably Intel

I'm very happy with ARECA ARC1110.
ARECA also provide cli tool for freebsd on their site.
I'm using it in RAID 10 configuration and here are few benchmark results
that I run on production server ;)

*bonnie++ -d /var/tmp -u root -s 16g -n 256:65536:65536:16 Version 1.93c*

Version 1.93c   --Sequential Output-- --Sequential Input-
--Random-
Concurrency   1 -Per Chr- --Block-- -Rewrite- -Per Chr- --Block-- 
--Seeks--

MachineSize K/sec %CP K/sec %CP K/sec %CP K/sec %CP K/sec %CP
/sec %CP
blah.cmotd.com  16G   159  88 54264  24 24727  12   299  94 70744  19
223.5  12
Latency 63581us 803ms1123ms   93936us   94991us
251ms
Version 1.93c   --Sequential Create-- Random
Create
blah.cmotd.com  -Create-- --Read--- -Delete-- -Create-- --Read--- 
-Delete--

files:max:min/sec %CP  /sec %CP  /sec %CP  /sec %CP  /sec %CP
/sec %CP
256:65536:65536/16   715  24   826  25 17321  49   733  2451   2
6039  70
Latency  1220ms 408ms2805ms1189ms 692ms
2735ms


*./bonnie++ -d /mnt/mblogs -u root -s 16g -n 256:65536:65536:16 -
Version  1.03*

Version  1.03   --Sequential Output-- --Sequential Input-
--Random-
   -Per Chr- --Block-- -Rewrite- -Per Chr- --Block-- 
--Seeks--

MachineSize K/sec %CP K/sec %CP K/sec %CP K/sec %CP K/sec %CP
/sec %CP
blah.cmotd.com  16G 54953  57 56950  21 24375  10 48757  49 70351  17
202.5   1
   --Sequential Create-- Random
Create
   -Create-- --Read--- -Delete-- -Create-- --Read--- 
-Delete--

files:max:min/sec %CP  /sec %CP  /sec %CP  /sec %CP  /sec %CP
/sec %CP
256:65536:65536/16   723  20   909  17 20905  41   756  2151   2
6528  74

FreeBSD blah.XXX 6.2-PRERELEASE FreeBSD 6.2-PRERELEASE #3: Tue Oct 10
13:28:56 CEST 2006 [EMAIL PROTECTED]:/usr/obj/usr/src/sys/CORE-SMP  i386


I know, 3ware has such good stuff, but those controller are not
certified for internet services in here (russia). So, i am pretty much
limited to Intel controllers. Is there intel controller which satisfied 
all the

1-6  conditions? I only need mirroring.

--
С уважением,
Артем Кучин
ООО Ай  Ти Легион
www.itlegion.ru
+7 (495) 232-0338



I'll second Stefan with the Areca. I have an Areca 1120 8 port SATA2 
controller.
It hasn't given me an ounce of issues. It's got a nice CLI and web based 
interface as well as being SNMP manageable.
Been running mine for 2 years without any issues at all. It also supports 
nifty things like online volume expansion and hot-swapping (if you have the 
hot-swap SATA drive bays)


-Clay


___
freebsd-stable@freebsd.org mailing list
http://lists.freebsd.org/mailman/listinfo/freebsd-stable
To unsubscribe, send any mail to [EMAIL PROTECTED]


Re: What is a good choice of sata-ii raid controller for freebsd?

2007-02-08 Thread Rink Springer
Hi,

On Thu, Feb 08, 2007 at 12:42:39PM +0300, Artem Kuchin wrote:
 I need a raid controller for FBSD 6.2 which has the following options

I can highly recommend the Areca family of SATA-II controllers. I have a
ARC-1110 (4 poort RAID controller) with 4x 320GB Western Digital
SATA-II drives attached to it in a RAID5 configuration.

Simple dd(1)-ing gives around 100MB/sec read and 70MB/sec write
performance. You can use sysutils/areca-cli to monitor it and update
settings (I have never tried actually creating arrays there though).

The controllers are a tad expensive, but once you have one, you won't
reget it.

Regards,

-- 
Rink P.W. Springer- http://rink.nu
It is such a quiet thing, to fall. But yet a far more terrible thing,
 to admit it.- Darth Traya


smime.p7s
Description: S/MIME cryptographic signature


Re: What is a good choice of sata-ii raid controller for freebsd?

2007-02-08 Thread Clayton Milos

Hi,

On Thu, Feb 08, 2007 at 12:42:39PM +0300, Artem Kuchin wrote:

I need a raid controller for FBSD 6.2 which has the following options


I can highly recommend the Areca family of SATA-II controllers. I have a
ARC-1110 (4 poort RAID controller) with 4x 320GB Western Digital
SATA-II drives attached to it in a RAID5 configuration.

Simple dd(1)-ing gives around 100MB/sec read and 70MB/sec write
performance. You can use sysutils/areca-cli to monitor it and update
settings (I have never tried actually creating arrays there though).

The controllers are a tad expensive, but once you have one, you won't
reget it.

Regards,

--
Rink P.W. Springer- http://rink.nu
It is such a quiet thing, to fall. But yet a far more terrible thing,
to admit it.- Darth Traya

I have 2 arryas of 4 WD320G drives each running RAID0 (I have backups I just 
need the speed).


[EMAIL PROTECTED]:/nas # dd if=/dev/zero of=test.file bs=65536 count=16384
16384+0 records in
16384+0 records out
1073741824 bytes transferred in 7.314186 secs (146802639 bytes/sec)


-Clay


___
freebsd-stable@freebsd.org mailing list
http://lists.freebsd.org/mailman/listinfo/freebsd-stable
To unsubscribe, send any mail to [EMAIL PROTECTED]


Re: Can't build threaded perl 5.8 on 6.2-RELEASE and 7-CURRENT

2007-02-08 Thread Fabian Keil
LI Xin [EMAIL PROTECTED] wrote:

 It seems that threaded perl is broken on 6.2-RELEASE and 7-CURRENT.  I
 have tried some option combinations with no luck, if WITH_THREADED=yes
 is specified then the build would fail with a coredump.

 Any hints?

I ran into the same miniperl core dumps a few days ago
while trying to switch back to non-threaded Perl (shortly
after updating the system to a recent RELENG_6).

The only way I found to fix it was to:

- deinstall all Perl ports,
- rebuild Perl
- reinstall all Perl ports

I assume miniperl somehow included incompatible local
Perl libraries, but I didn't really look into it.

Fabian


signature.asc
Description: PGP signature


Re: Can't build threaded perl 5.8 on 6.2-RELEASE and 7-CURRENT

2007-02-08 Thread LI Xin
LI Xin wrote:
 LI Xin wrote:
 Hi,

 It seems that threaded perl is broken on 6.2-RELEASE and 7-CURRENT.  I
 have tried some option combinations with no luck, if WITH_THREADED=yes
 is specified then the build would fail with a coredump.
 
 Another observation is that this happens with 6.2-RELEASE kernel with
 6.1-RELEASE userland too.  But 6.1+6.1 configuration is not affected.

Sorry, I mean that 6.1+6.1 configuration was not tested.

Cheers,
-- 
Xin LI [EMAIL PROTECTED]  http://www.delphij.net/
FreeBSD - The Power to Serve!



signature.asc
Description: OpenPGP digital signature


Re: What is a good choice of sata-ii raid controller for freebsd?

2007-02-08 Thread Alexey Karagodov

http://www.3ware.com/



2007/2/8, Jeremy Chadwick [EMAIL PROTECTED]:


On Thu, Feb 08, 2007 at 12:47:10PM +0200, Clayton Milos wrote:
 I can highly recommend the Areca family of SATA-II controllers. I have a
 ARC-1110 (4 poort RAID controller) with 4x 320GB Western Digital
 SATA-II drives attached to it in a RAID5 configuration.

I have questions:

1) Do these controllers, from a BIOS level, permit SMART commands
  to be sent directly to the drives (via pass(4)) so you can
  monitor drives for potential upcoming failures and perform
  drive tests, via smartctl?

2) Regardless of performance, have you actually tried a hard failure
  with these controllers and seen what both the controller and the
  OS do?  A good example is to pull the SATA power plug out of one
  of the drives in the array while it's powered on and see what
  happens, both from a controller perspective and what FreeBSD does.
  The same question applies to hot-swapping.

3) Does Areca provide any form of carriage/enclosure medium, such as
  an enclosure which supports 4 drives, allows hot-swapping, and
  allows you to query the enclosure for statistics (fan RPM, thermals,
  and so on)?

4) string'ing the cli32 binary returns some references to SMART, but
  the monitoring is generally retarded (literally, not slang) -- it
  looks as if it just wants to use SMART to say drive bad or drive
  good.  This is not an effective use of SMART, and does nothing
  for those wanting to monitor drives properly (read: temperature,
  excessive ECC, perform SMART tests for bad blocks, etc.).

5) Is there native FreeBSD 6.x binaries for administrative utilities?
  It doesn't look like it, but maybe I'm looking at the wrong utility:
  ~/V1.5_50930 $ file cli32
  cli32: ELF 32-bit LSB executable, Intel 80386, version 1, for FreeBSD
4.2, statically linked, not stripped

Many controllers (including Adaptec) these days suffer from some or
all of the above issues, too.  Ultimately this turns me off to
using any form of RAID controller; vendors who refuse to give full
documentation for their hardware to engineers who want to write
drivers for it, refuse to implement proper passthrough methods (I'm
looking at you, Adaptec) so that you can talk to the drives directly
if need be, nor provide you with any form of useful FreeBSD support
(here's our old crusty 3.x a.out binaries built by a guy who left
the company 7 years ago! Thanks for buying company, bye!)

The best out of the bunch in this regards seems to be Promise, who
despite having ehhh controllers, has given Soren lots of documen-
tation and has been helpful in providing him answers to his
questions.  I can't say the same for other controller vendors.

I'm sorry if I sound bitter, but I must have gone through 4 different
brands of SATA RAID controllers before saying screw this and going
with non-RAID or using geom.  I don't have anything against Areca
(I've never used their hardware), but I have no desire to use hardware
which does not support the above things -- which in 2007 should be
standard by all means.

--
| Jeremy Chadwick jdc at parodius.com |
| Parodius Networkinghttp://www.parodius.com/ |
| UNIX Systems Administrator   Mountain View, CA, USA |
| Making life hard for others since 1977.   PGP: 4BD6C0CB |

___
freebsd-stable@freebsd.org mailing list
http://lists.freebsd.org/mailman/listinfo/freebsd-stable
To unsubscribe, send any mail to [EMAIL PROTECTED]


___
freebsd-stable@freebsd.org mailing list
http://lists.freebsd.org/mailman/listinfo/freebsd-stable
To unsubscribe, send any mail to [EMAIL PROTECTED]


Re: What is a good choice of sata-ii raid controller for freebsd?

2007-02-08 Thread Freddie Cash
On Thursday 08 February 2007 08:52 am, Jeremy Chadwick wrote:
 On Thu, Feb 08, 2007 at 12:47:10PM +0200, Clayton Milos wrote:
  I can highly recommend the Areca family of SATA-II controllers. I
  have a ARC-1110 (4 poort RAID controller) with 4x 320GB Western
  Digital SATA-II drives attached to it in a RAID5 configuration.

The following is from my experience with 3Ware Escalade RAID controllers 
(7506-4LP, 9500S-8, 9550SX-8. 9550SX-12 single and multi-lane).

 I have questions:
 1) Do these controllers, from a BIOS level, permit SMART commands
to be sent directly to the drives (via pass(4)) so you can
monitor drives for potential upcoming failures and perform
drive tests, via smartctl?

Don't know, never checked.

 2) Regardless of performance, have you actually tried a hard failure
with these controllers and seen what both the controller and the
OS do?  A good example is to pull the SATA power plug out of one
of the drives in the array while it's powered on and see what
happens, both from a controller perspective and what FreeBSD does.
The same question applies to hot-swapping.

Pulling the plug on a drive running on FreeBSD 5.2.1, 5.3, and 6.0 didn't 
phase the OS.  A message was logged to the console and /var/log/messages 
that the array was degraded, an e-mail was sent to my account and my 
phone that the array was degraded, and everything continued merrily on.  
We ran the test server for three weeks with one drive disconnected.  
Couldn't really notice any performance lags in normal use (it was a mail 
filtering gateway box running Postfix, MySQL, Amavisd-new, and ClamAV).

When we plugged the drive back in, a message was logged (and send via 
e-mail) that a new drive was found, and a rebuild was underway.  Took 
three or four days to rebuild the array during normal usage, and 
performance did take a hit during this time.  After the rebuild 
completed, another message was logged and an e-mail sent saying 
everything was back to normal.

 3) Does Areca provide any form of carriage/enclosure medium, such as
an enclosure which supports 4 drives, allows hot-swapping, and
allows you to query the enclosure for statistics (fan RPM, thermals,
and so on)?

Don't have any experience with actual enclosures (with fans and thermals - 
at least not for monitoring purposes) but the 3Ware cards work well in 
hot-swappable drive bays in our 2U, 4U, and 5U rackmounts.

 5) Is there native FreeBSD 6.x binaries for administrative utilities?
It doesn't look like it, but maybe I'm looking at the wrong utility:
~/V1.5_50930 $ file cli32
cli32: ELF 32-bit LSB executable, Intel 80386, version 1, for
 FreeBSD 4.2, statically linked, not stripped

Don't know about the ARECA but the 3Ware cli is a FreeBSD native binary 
(don't have any FreeBSD boxes with 3Ware cards at the moment to run file 
on - they're all Debian Etch now), although we used the web GUI for 
everything (3dm2).

-- 
Freddie Cash
[EMAIL PROTECTED]
___
freebsd-stable@freebsd.org mailing list
http://lists.freebsd.org/mailman/listinfo/freebsd-stable
To unsubscribe, send any mail to [EMAIL PROTECTED]


Re: kqueue LOR

2007-02-08 Thread Frode Nordahl

On 27. nov. 2006, at 10.21, Kostik Belousov wrote:


On Sun, Nov 26, 2006 at 09:30:39AM +0100, V??clav Haisman wrote:

Hi,
the attached lor.txt contains LOR I got this yesterday. It is  
FreeBSD 6.1

with relatively recent kernel, from last week or so.

--
VH



+lock order reversal:
+ 1st 0xc537f300 kqueue (kqueue) @ /usr/src/sys/kern/kern_event.c: 
1547
+ 2nd 0xc45c22dc struct mount mtx (struct mount mtx) @ /usr/src/ 
sys/ufs/ufs/ufs_vnops.c:138

+KDB: stack backtrace:
+kdb_backtrace(c07f9879,c45c22dc,c07fd31c,c07fd31c,c080c7b2,...)  
at kdb_backtrace+0x2f
+witness_checkorder(c45c22dc,9,c080c7b2,8a,c07fc6bd,...) at  
witness_checkorder+0x5fe
+_mtx_lock_flags(c45c22dc,0,c080c7b2,8a,e790ba20,...) at  
_mtx_lock_flags+0x32
+ufs_itimes(c47a0dd0,c47a0e90,e790ba78,c060e1cc,c47a0dd0,...) at  
ufs_itimes+0x6c
+ufs_getattr(e790ba54,e790baec,c0622af6,c0896f40,e790ba54,...) at  
ufs_getattr+0x20
+VOP_GETATTR_APV(c0896f40,e790ba54,c08a5760,c47a0dd0,e790ba74,...)  
at VOP_GETATTR_APV+0x3a

+filt_vfsread(c4cf261c,6,c07f445e,60b,0,...) at filt_vfsread+0x75
+knote(c4f57114,6,1,1f30c2af,1f30c2af,...) at knote+0x75
+VOP_WRITE_APV(c0896f40,e790bbec,c47a0dd0,227,e790bcb4,...) at  
VOP_WRITE_APV+0x148
+vn_write(c45d5120,e790bcb4,c5802a00,0,c4b73a80,...) at vn_write 
+0x201
+dofilewrite(c4b73a80,1b,c45d5120,e790bcb4,,...) at  
dofilewrite+0x84

+kern_writev(c4b73a80,1b,e790bcb4,8220c71,0,...) at kern_writev+0x65
+write(c4b73a80,e790bd04,c,c07d899c,3,...) at write+0x4f
+syscall(3b,3b,bfbf003b,0,bfbfeae4,...) at syscall+0x295
+Xint0x80_syscall() at Xint0x80_syscall+0x1f
+--- syscall (4, FreeBSD ELF32, write), eip = 0x2831d727, esp =  
0xbfbfea1c, ebp = 0xbfbfea48 ---


Thank you for the report. The LOR is caused by my commit into
sys/ufs/ufs/ufs_vnops.c, rev. 1.280.


While debugging a problem I have with 6.2-RELEASE on one of my  
servers I saw this LOR. After being up for a short while the server  
freezes, not responding to serial console, network og keyboard. I  
can't even get to DDB by sending BREAK on the serial console.


Enabling INVARIANTS, INVARIANT_SUPPORT, WITNESS and WITNESS_SKIPSPIN  
did not give more information about the freeze other than printing  
the LOR now and then.


The LOR I am getting is exactly the same except the calls are made to  
writev instead of write.



What application you run that triggers the LOR ? Patch below is one
possible approach to fixing it.


I am seeing this on a front-end MX server, I can trigger it by  
running tail -f /var/log/maillog, the LOR is printed before any  
output is printed by tail. After triggering it once, it will not  
trigger regularilly until waiting for some time.


Waiting 180 seconds seems to be good to make it happen every time,  
but it can be triggered earlier. My maillog grows about 976K during  
that time.


May this LOR have something to do with the system freze I am  
experiencing? Should I try the patch in your mail from november 27.  
or december 13? Or has some other fix emerged since then?


--
Frode Nordahl



___
freebsd-stable@freebsd.org mailing list
http://lists.freebsd.org/mailman/listinfo/freebsd-stable
To unsubscribe, send any mail to [EMAIL PROTECTED]


RE: What is a good choice of sata-ii raid controller for freebsd?

2007-02-08 Thread Jaime Bozza
 They kick ass is what they are like. :)
 
 I had a 3U box with a 12 port controller sitting next to my desk for a
 few weeks and my only goal was to confuse/break the 3Ware controller.

 No amount of power plug pulling, pulling multiple drives, quickly
 re-arranging drives could confuse the controller.  Made the SCSI stuff
 we use look like absolute neurotic junk.

Forgot that note - Areca handles drive location changes the same way.
I assume this is handled by metadata on the drive.

 -They added a moving part (2-wire fan, no tach) to a
mission-critical
 part.  That seems real stupid.  After the bearings die in 2-3 years,
 what happens to your card?  Does it melt or just start acting weird?
 If the engineers didn't consider that, what other failure modes did 
 their limited creativity miss? :)

Strange.  Our 1160 has a fan, but also had just a heatsink (no fan) that
was in the box.  My 1261ML was heatsink only.  I believe someone asked
for the feature.  Both controllers monitor the fan and would notify you
if the fan died.  You can turn the option on or off (off by default)
if you need to.

 -Availability.  None of our normal dealers could get them.

Availability seems to be a bit better now, but I can't answer for your
dealers.

 -Not many people seemed to be using them, so less feedback available
 and the whole package (hardware/firmware/driver) has less exposure
than
 3Ware.

While the 9xxx series seem to be great (use a different driver), the
twe cards caused me so much grief that I was afraid to try them out.
We had a bunch of corruption issues (in RAID 5) with our 75xx
controllers that I was never able to fix.  RAID 0 or 1 seems to work
just fine for them.

 -3Ware answered pre-sales questions, Areca didn't.

Perhaps they've changed?   I spent a good hour on the phone with a tech
before we purchased our first controller.  This was last year sometime.

 Performance and feature-wise the Areca and 3Ware seemed pretty close,
 so we went with 3Ware.

Everyone has their reasons - I liked the RAID 6 feature, plus the OOB
management of Areca, plus my history with 3ware wasn't good. :(


Jaime Bozza
Qlinks Media Group

___
freebsd-stable@freebsd.org mailing list
http://lists.freebsd.org/mailman/listinfo/freebsd-stable
To unsubscribe, send any mail to [EMAIL PROTECTED]


RE: What is a good choice of sata-ii raid controller for freebsd?

2007-02-08 Thread Jaime Bozza
I want to second the recommendation for Areca controllers.  We have two
systems - The first is using an 1160 (16-port PCI-x) with 16 400GB
drives, the 2nd is using the newer 1261ML card (16 port PCI Express,
mini SAS connectors) with 16 500GB drives. Comments below:

 1) Do these controllers, from a BIOS level, permit SMART commands
to be sent directly to the drives (via pass(4)) so you can
monitor drives for potential upcoming failures and perform
drive tests, via smartctl?

The cli32 will give you smart attributes, but no testing when the drive
is part of a RaidSet.  The controllers do support passthrough with JBOD.
See below for more information.

 2) Regardless of performance, have you actually tried a hard failure
with these controllers and seen what both the controller and the
OS do?  A good example is to pull the SATA power plug out of one
of the drives in the array while it's powered on and see what
happens, both from a controller perspective and what FreeBSD does.
The same question applies to hot-swapping.

Both our systems are using RAID 6, and I've tested them thoroughly.
I've pulled one drive out, OS didn't really care.  The 16-port cards
have their own Ethernet interface which will send emails for any events.
Put the drive back in and the controllers just automatically start
rebuilding.  While I was rebuilding, I pulled a different drive.  Again
- FreeBSD happily went on.  Put the drive back in and the controllers
would rebuild the 2nd drive after done with the first.   During all
this, FreeBSD could do anything it wanted with the array.  I then
dropped power to the entire system.  Coming back on, it would start
rebuilding once FreeBSD started to load (the controller needs to have an
OS Driver loaded before it starts to rebuild, or you need to go into the
BIOS utility to process the rebuild in the foreground).  Booting, fsck,
or anything else would work just fine while the system was rebuilding.
You can set the background processing to be 5%, 20%, 50%, or 80%.
Obviously, 80% will be quicker but slow down access to the system.  I
didn't feel that it slowed down TOO much, but that is a matter of
opinion.  Setting it to 5% or 20% should have little or no change in
performance.

 3) Does Areca provide any form of carriage/enclosure medium, such as
an enclosure which supports 4 drives, allows hot-swapping, and
allows you to query the enclosure for statistics (fan RPM,
thermals,
and so on)?

Areca supports individual HD Activity/Failure connections and the I2C
standard.  I don't believe Areca has its own external drive cage, but
it'll work with many others.  I'm not sure about drive cage thermals or
fans, but it monitors everything about the drives.  We handle case
thermals via the motherboard.  The controllers we have do not have any
external connectors, so it would all be internal.

 4) string'ing the cli32 binary returns some references to SMART, but
the monitoring is generally retarded (literally, not slang) -- it
looks as if it just wants to use SMART to say drive bad or drive
good.  This is not an effective use of SMART, and does nothing
for those wanting to monitor drives properly (read: temperature,
excessive ECC, perform SMART tests for bad blocks, etc.).

In RAID mode, I don't think it allows you to test each drive directly.
It'll monitor the SMART attributes and generate warnings (for instance,
if a drive gets too hot), or if there are other problems.  If you're
looking at using the controller in JBOD mode, or a drive in JBOD mode,
you can create a passthrough, which I would assume would allow you
direct access, but I haven't tested that.
 
 5) Is there native FreeBSD 6.x binaries for administrative utilities?
It doesn't look like it, but maybe I'm looking at the wrong
utility:
~/V1.5_50930 $ file cli32
cli32: ELF 32-bit LSB executable, Intel 80386, version 1, for
 FreeBSD 4.2, statically linked, not stripped

While the utility may be 4.2, it's statically linked, so it works fine
on any later version (of FreeBSD) I've tested.  

 I'm sorry if I sound bitter, but I must have gone through 4 different
 brands of SATA RAID controllers before saying screw this and going
 with non-RAID or using geom.  I don't have anything against Areca
 (I've never used their hardware), but I have no desire to use hardware
 which does not support the above things -- which in 2007 should be
 standard by all means.

The only thing that the Areca cards may not give you is the ability to
run SMART tests on a drive.  I think the idea is that Areca just
monitors the drive and if the drive reports any sort of stability, it
takes the drive offline and notifies you.  In a case like that, I would
be more inclined to pull the drive, replace it with a new one, and run
my tests on the old (possibly bad) drive outside the RAID array.  IMHO,
I don't want to take chances testing a drive and having the array in a
degraded state.  Another possibility 

Re: What is a good choice of sata-ii raid controller for freebsd?

2007-02-08 Thread Mike Andrews

Jaime Bozza wrote:


Everyone has their reasons - I liked the RAID 6 feature, plus the OOB
management of Areca, plus my history with 3ware wasn't good. :(


For what it's worth, 3Ware's latest PCI-E cards (9650 series) now 
support RAID 6.  The updated twa driver that supports them hasn't yet 
been merged into FreeBSD (see kern/106488 which I filed 2 months ago) 
but you can download either the source or the binary for it from 3Ware 
that works just fine.  The updated 3dm2 for it did make it into the 
Ports tree.


Driver annoyances aside, my 9650SE is considerably faster than my 9500S 
(both have batteries, both have the drive's write cache off), especially 
on writes, and they are both much faster than my Adaptec 2410SA (which 
has no battery option and thus needed write caching disabled).


Despite not being a fan of the 2410SA, I'm pretty happy with the SCSI 
version (2120S) which uses the exact same FreeBSD driver.  Part of that 
is the SCSI version has a battery option so write speeds don't suck, 
where the SATA version doesn't.  Or at least that specific model of SATA 
card doesn't.  I'm less of a fan of the older asr-based 2110S...  but 
the one we have still works as long as we keep it in a 32-bit non-PAE box.


I've never tried Areca.  I would probably like them, from the sound of 
things.  I'm sticking with 3Ware for SATA systems for now though...  but 
hey, personal preference and all.  For my next SCSI/SAS system I may 
have to do some serious evaluation of what's new out there...



--
Mike Andrews  *  [EMAIL PROTECTED]  *  http://www.bit0.com
It's not news, it's Fark.com.  Carpe cavy!
___
freebsd-stable@freebsd.org mailing list
http://lists.freebsd.org/mailman/listinfo/freebsd-stable
To unsubscribe, send any mail to [EMAIL PROTECTED]


Re: pppd crashes, was: kde-freebsd

2007-02-08 Thread John Walthall

Ok, now an editorial:

Kernel PPP is certified crap and should be phased out.

In my personal opinion the reason that it is unmaintained and slowly
dissolving into a nonfunctional pool of electrolytes, is that it is
functionally obsolete. User PPP provides better service, and several
tangible design benefits. User PPP is very easy to use, Kernel PPP is not.

I have had nothing but serious problems with Kernel PPP, In my
experience whenever Kernel PPP crashes, which it does pretty much at
random, and always when the network drops (a common happening for those
of us blighted by Dial up.) It causes the whole system to lock up.
*Forcing*me*to*physically*unplug*the*computer*to*continue*.

FreeBSD is NOT Linux, and SHOULD NOT attempt to model it. FreeBSD is BSD
UNIX! Isn't that the WHOLE POINT (pardon my shouting) for our existence?
Isn't this why you and me bear with minor points such as this one.
BECAUSE WE ARE DIFFERENT AND PROUD OF IT! If you just start modeling
Linux, we are invalidating our own existence and vindicating Linux's
innumerable disparities, nay flaws.

We have a fundamental design difference from Linux here. We chose this
difference because we believed that it was better. Why would we go back
now because the developers of a third-party interface to our systems did
a clumsy job? Rather than weep in anguish at their implementation of a
known faulty and legacy system. We should adjure them to implement the
new and better system. This is not actually an appropriate place for
this discussion. It should be directed to [EMAIL PROTECTED] and/or
http://bugs.kde.org. Because it is a KDE problem and *not* a FreeBSD
Problem. (I have already submitted it to the KDE Bugzilla)

These are of course my own opinions.

--
Unless instructed to do otherwise| Support public access UNIX
address mail to [EMAIL PROTECTED]  | http://sdf.lonestar.org
and not to [EMAIL PROTECTED]|

___
freebsd-stable@freebsd.org mailing list
http://lists.freebsd.org/mailman/listinfo/freebsd-stable
To unsubscribe, send any mail to [EMAIL PROTECTED]


Re: What is a good choice of sata-ii raid controller for freebsd?

2007-02-08 Thread Erik Trulsson
On Thu, Feb 08, 2007 at 02:51:58PM -0800, Freddie Cash wrote:
 On Thursday 08 February 2007 02:17 pm, Mike Andrews wrote:
  Jaime Bozza wrote:
   Everyone has their reasons - I liked the RAID 6 feature, plus the OOB
   management of Areca, plus my history with 3ware wasn't good. :(
 
  For what it's worth, 3Ware's latest PCI-E cards (9650 series) now
  support RAID 6.  The updated twa driver that supports them hasn't yet
  been merged into FreeBSD (see kern/106488 which I filed 2 months ago)
  but you can download either the source or the binary for it from 3Ware
  that works just fine.  The updated 3dm2 for it did make it into the
  Ports tree.
 
  Driver annoyances aside, my 9650SE is considerably faster than my 9500S
 
 Not all that surprising, since the 9500-series use PATA-133 chipsets with 
 SATA-PATA bridges, and the 9550+ uses a native 3G SATA chipset.  Even 
 though the 9500s are listed as 1.5G SATA parts, you'll never get better 
 than ATA-133 speeds out of them.

Which is quite irrelevant since there are no SATA-disks which actually can
use more speed than that.  (The fastest SATA-disks currently available --
Western Digital's Raptor series has a maximum transfer rate of just under
90 MB/s.  Most disks are significantly slower than that.)

The 133 MB/s one can get out of ATA-133 is quite enough for that (and not
all that much less than the 150MB/s that normal SATA provides. (Some SATA
devices also provide a 300MB/s transfer speed, but since no disks can keep up
with that it does not make all that much of a difference in practice.))

Just about all reviews that have compared both controllers and disks 
with and without SATA-PATA bridges have come to the conclusion that
those bridges do not cause any measurable drop in performance over their
native-SATA counterparts.

The only real drawback with using SATA-PATA bridges is that you cannot get
support for the optional SATA features like NCQ. (But not all native-SATA
solutions support those features either.)


 
 We didn't realise that when we ordered our first pair of Escalade 9500S 
 4-port cards.  Thankfully, just after they arrived and before we put in 
 the mass-order, the 9550SX was released and we've standardised on them.

The 9550SX should be a bit faster than the 9500S and the 9650SE faster
still, but that is for other reasons.  (Faster processor for handling the
parity calculations for RAID-5, faster memory on the card, being able to do
more operations in parallell, etc.)


-- 
Insert your favourite quote here.
Erik Trulsson
[EMAIL PROTECTED]
___
freebsd-stable@freebsd.org mailing list
http://lists.freebsd.org/mailman/listinfo/freebsd-stable
To unsubscribe, send any mail to [EMAIL PROTECTED]


Re: What is a good choice of sata-ii raid controller for freebsd?

2007-02-08 Thread Geoffrey Giesemann
On Thu, Feb 08, 2007 at 04:34:57PM -0500, Charles Sprickman wrote:
 -They added a moving part (2-wire fan, no tach) to a mission-critical 
 part.  That seems real stupid.  After the bearings die in 2-3 years, what 
 happens to your card?  Does it melt or just start acting weird?  If the 
 engineers didn't consider that, what other failure modes did their limited 
 creativity miss? :)
 

The fan does have a tachometer which you can monitor from the card BIOS
or using the cli binary.

You can also disable the tachometer so you can swap the heatsink+fan for
the larger heatsink (w/o fan) that comes in the box.

You can find all of this out by *gasp* reading the manual.

--Geoff
___
freebsd-stable@freebsd.org mailing list
http://lists.freebsd.org/mailman/listinfo/freebsd-stable
To unsubscribe, send any mail to [EMAIL PROTECTED]


RE: What is a good choice of sata-ii raid controller for freebsd?

2007-02-08 Thread Jaime Bozza
 For what it's worth, 3Ware's latest PCI-E cards (9650 series) now
 support RAID 6.  The updated twa driver that supports them hasn't yet
 been merged into FreeBSD (see kern/106488 which I filed 2 months ago)
 but you can download either the source or the binary for it from 3Ware
 that works just fine.  The updated 3dm2 for it did make it into the
 Ports tree.

I noticed that when I was making my reply from earlier.  At some point
in time I may test out the newer (twa-based) cards.  It seems that 3ware
is actually interested in supporting those.  They never managed to get
the twe driver out of what they called beta, so that's where my
experience ended.

Interesting thing - When I installed FreeBSD on the new system (pre-6.2
version discs) it didn't see the new Areca card.  I started to get
worried but quickly found out that the driver had been updated shortly
before 6.2 was released. Quick update and all was well.  So the kernel
driver *is* being updated.

 Driver annoyances aside, my 9650SE is considerably faster than my
9500S
 (both have batteries, both have the drive's write cache off),
especially
 on writes, and they are both much faster than my Adaptec 2410SA (which
 has no battery option and thus needed write caching disabled).

I haven't tested the current system in speeds, but it's noticeably
faster than my other (1160 PCI-X) system.  Possibly due to the fact that
I was using WD4000YR drives in the first which do not support the
updated speeds of SATA2.  The current system does and the card detects
it.  The newer card also has an updated processor - Intel IOP341 instead
of an IOP33x series processor which I would guess makes a big
difference.  At least according to synthetic benchmarks going around the
net. :)

 I've never tried Areca.  I would probably like them, from the sound of
 things.  I'm sticking with 3Ware for SATA systems for now though...
but
 hey, personal preference and all.  For my next SCSI/SAS system I may
 have to do some serious evaluation of what's new out there...

Regardless of what you choose, there are a few decent options for
FreeBSD now.  Shows that people out there are actually starting to care
about FreeBSD for some of these controllers.

Unfortunately, I didn't have the same solid results with the mirroring
(RAID1) support for onboard SATA (Supermicro X7DVL-E).  I mirrored two
SATA2 drives (OS) and tried pulling one drive.  Placing it back in
didn't automatically start a rebuild, but I could force it.  Pulling it,
restarting, and then removing the drive from the RAID1 array (via the
BIOS) would then cause FreeBSD to panic at boot (or drive insertion)
every time.  I don't know if it was the fact that there was still
metadata on the drive so the ataraid driver thought something
differently, but it bothered me a little.  I had to disable ATA RAID in
the BIOS completely (and remove the ataraid device from the kernel) to
get FreeBSD to boot or allow the drive back into the system at all.
Since the motherboard RAID is just software RAID, I switched over to
gmirror but kept AHCI on so I'd still have hotplug support.  After that
I wasn't able to kill the system.


Jaime Bozza
Qlinks Media Group



___
freebsd-stable@freebsd.org mailing list
http://lists.freebsd.org/mailman/listinfo/freebsd-stable
To unsubscribe, send any mail to [EMAIL PROTECTED]


Re: What is a good choice of sata-ii raid controller for freebsd?

2007-02-08 Thread Charles Sprickman

On Fri, 9 Feb 2007, Geoffrey Giesemann wrote:


On Thu, Feb 08, 2007 at 04:34:57PM -0500, Charles Sprickman wrote:

-They added a moving part (2-wire fan, no tach) to a mission-critical
part.  That seems real stupid.  After the bearings die in 2-3 years, what
happens to your card?  Does it melt or just start acting weird?  If the
engineers didn't consider that, what other failure modes did their limited
creativity miss? :)



The fan does have a tachometer which you can monitor from the card BIOS
or using the cli binary.

You can also disable the tachometer so you can swap the heatsink+fan for
the larger heatsink (w/o fan) that comes in the box.


These were a few of the things that their pre-sales folks were not able to 
tell me...



You can find all of this out by *gasp* reading the manual.


I did flip through it fairly quickly, but I'm not even sure that these 
features were available at the time I compared the Areca to the 3Ware. 
The best info I could find at the time about the fan was looking at the 
picture on their website - it showed a small heatsink+fan with two wires 
(no tach).


I'm certainly not trying to push people away from the Areca cards - the 
more FreeBSD people out there using these the better.  Next time we may 
buy some Arecas since I now am finding some positive feedback from the 
FreeBSD community.


Charles


--Geoff
___
freebsd-stable@freebsd.org mailing list
http://lists.freebsd.org/mailman/listinfo/freebsd-stable
To unsubscribe, send any mail to [EMAIL PROTECTED]


___
freebsd-stable@freebsd.org mailing list
http://lists.freebsd.org/mailman/listinfo/freebsd-stable
To unsubscribe, send any mail to [EMAIL PROTECTED]


Re: pppd crashes, was: kde-freebsd

2007-02-08 Thread Michael Nottebrock
On Thursday, 8. February 2007 23:16, John Walthall wrote:
 Ok, now an editorial:

I should not really dignify this rant by replying to it, but:

 We have a fundamental design difference from Linux here. We chose this
 difference because we believed that it was better. Why would we go back
 now because the developers of a third-party interface to our systems did
 a clumsy job?

KPPP is not an interface to 'our' systems. It's an interface to *pppd*, which 
happens to be available for a wide range of Unices and Unix-like systems.

 We should adjure them to implement the 
 new and better system. This is not actually an appropriate place for
 this discussion. It should be directed to [EMAIL PROTECTED] and/or
 http://bugs.kde.org. Because it is a KDE problem and *not* a FreeBSD
 Problem. (I have already submitted it to the KDE Bugzilla)

A kernel panic/freeze triggered by a badly maintained driver is most certainly 
not any application's problem. You should probably close that bug yourself.

-- 
   ,_,   | Michael Nottebrock   | [EMAIL PROTECTED]
 (/^ ^\) | FreeBSD - The Power to Serve | http://www.freebsd.org
   \u/   | K Desktop Environment on FreeBSD | http://freebsd.kde.org


pgpC06TnsA434.pgp
Description: PGP signature


Re: kqueue LOR

2007-02-08 Thread Kostik Belousov
On Thu, Feb 08, 2007 at 09:49:23PM +0100, Frode Nordahl wrote:
 On 27. nov. 2006, at 10.21, Kostik Belousov wrote:
 
 On Sun, Nov 26, 2006 at 09:30:39AM +0100, V??clav Haisman wrote:
 Hi,
 the attached lor.txt contains LOR I got this yesterday. It is  
 FreeBSD 6.1
 with relatively recent kernel, from last week or so.
 
 --
 VH
 
 +lock order reversal:
 + 1st 0xc537f300 kqueue (kqueue) @ /usr/src/sys/kern/kern_event.c: 
 1547
 + 2nd 0xc45c22dc struct mount mtx (struct mount mtx) @ /usr/src/ 
 sys/ufs/ufs/ufs_vnops.c:138
 +KDB: stack backtrace:
 +kdb_backtrace(c07f9879,c45c22dc,c07fd31c,c07fd31c,c080c7b2,...)  
 at kdb_backtrace+0x2f
 +witness_checkorder(c45c22dc,9,c080c7b2,8a,c07fc6bd,...) at  
 witness_checkorder+0x5fe
 +_mtx_lock_flags(c45c22dc,0,c080c7b2,8a,e790ba20,...) at  
 _mtx_lock_flags+0x32
 +ufs_itimes(c47a0dd0,c47a0e90,e790ba78,c060e1cc,c47a0dd0,...) at  
 ufs_itimes+0x6c
 +ufs_getattr(e790ba54,e790baec,c0622af6,c0896f40,e790ba54,...) at  
 ufs_getattr+0x20
 +VOP_GETATTR_APV(c0896f40,e790ba54,c08a5760,c47a0dd0,e790ba74,...)  
 at VOP_GETATTR_APV+0x3a
 +filt_vfsread(c4cf261c,6,c07f445e,60b,0,...) at filt_vfsread+0x75
 +knote(c4f57114,6,1,1f30c2af,1f30c2af,...) at knote+0x75
 +VOP_WRITE_APV(c0896f40,e790bbec,c47a0dd0,227,e790bcb4,...) at  
 VOP_WRITE_APV+0x148
 +vn_write(c45d5120,e790bcb4,c5802a00,0,c4b73a80,...) at vn_write 
 +0x201
 +dofilewrite(c4b73a80,1b,c45d5120,e790bcb4,,...) at  
 dofilewrite+0x84
 +kern_writev(c4b73a80,1b,e790bcb4,8220c71,0,...) at kern_writev+0x65
 +write(c4b73a80,e790bd04,c,c07d899c,3,...) at write+0x4f
 +syscall(3b,3b,bfbf003b,0,bfbfeae4,...) at syscall+0x295
 +Xint0x80_syscall() at Xint0x80_syscall+0x1f
 +--- syscall (4, FreeBSD ELF32, write), eip = 0x2831d727, esp =  
 0xbfbfea1c, ebp = 0xbfbfea48 ---
 
 Thank you for the report. The LOR is caused by my commit into
 sys/ufs/ufs/ufs_vnops.c, rev. 1.280.
 
 While debugging a problem I have with 6.2-RELEASE on one of my  
 servers I saw this LOR. After being up for a short while the server  
 freezes, not responding to serial console, network og keyboard. I  
 can't even get to DDB by sending BREAK on the serial console.
 
 Enabling INVARIANTS, INVARIANT_SUPPORT, WITNESS and WITNESS_SKIPSPIN  
 did not give more information about the freeze other than printing  
 the LOR now and then.
The useful way to report deadlock is described in developer handbook,
kernel debug chapter, deadlock debugging. If the freeze caused by this LOR,
then supplying me with information requested in that chapter could be
helpful (both to you and me).


pgpsIgstFJaJP.pgp
Description: PGP signature


Re: IPv6 over gif(4) broken in 6.2-RELEASE?

2007-02-08 Thread Bruce A. Mah
If memory serves me right, Dimitry Andric wrote:
 Bruce A. Mah wrote:

 I mean that it may be that between -RELEASE and -STABLE, other things
 have changed, e.g. network rc scripts, /sbin/route itself, etc, which
 may also influence this behaviour.  I'm sure more than only nd6.c
 changed. :)

The testing I did doesn't require any of that stuff, only a kernel, a
shell, and ifconfig(8).  I'm not aware of anything relevant.  (As one of
the RE types, I do follow commit mails pretty closely, especially during
and just after a release cycle.)

 However, for me, with the whole system at -STABLE (as of Jan 11), I
 verified the following results again just now:
 
 nd6.c rev state
 - -
 1.48.2.12 works
 1.48.2.13 works
 1.48.2.14 works
 1.48.2.15 works
 1.48.2.16 doesn't work

I've convinced myself that this problem needs to be tested in isolation
(i.e. you have complete control over both ends of the tunnel) because
incoming packets over the tunnel cause the host route to get added
automatically if it wasn't there already.

After reading the code and discussing this with a couple folks, I've
managed to convince myself that 1.48.2.14 and 1.48.2.15 (and their
analogues on HEAD) need to go away.  I've committed diffs that back
these out, and they solve the problem for me in my testing (which I've
done with two VMs in isolation).  The applicable revisions for nd6.c are
1.74 (HEAD) and 1.48.2.18 (RELENG_6).  Updating up to (or beyond) these
revisions should clear up the problem.

Testing reports from people who were having problems would be appreciated.

Bruce.



signature.asc
Description: OpenPGP digital signature