Re: MPS driver: force bus rescan after remove SAS cable

2011-04-28 Thread Denny Schierz
hi,

Am Mittwoch, den 27.04.2011, 20:23 -0700 schrieb Jeremy Chadwick:
 I don't mean to sound critical, but why do you guys do this? 

two answers:

1.) Think of: It could happen, instead of it shouldn't happen :-)
2.) Adding a new JBOD on the fly, without reboot the whole machine, what
I've done under Solaris and Linux and that wasn't a big deal. It just
works.

At the moment, replug the SAS cable let you see not all the same disks,
like before. Means, replug several times, you get different disks, but
most the last 30~46 are missed.

However: SAS is a hot pluggable bus, so it should work, but it
doesn't. Maybe a bug in the driver or something else.

cu denny


signature.asc
Description: This is a digitally signed message part


Re: correct way to setup gmirror on 7.4?

2011-04-28 Thread Daniel Kalchev



On 28.04.11 01:30, Freddie Cash wrote:

gmirror doesn't touch the start of the disk, but saves it's metadata
in the last sector of the disk, and creates a new GEOM provider that's
one sector shorter.

GPT stores it's partition table in the first sector of the disk, and
saves a backup copy of it in the last sector of the disk.

This looks like layering issue to me.

In theory, both gmirror and gpt should work on 'providers'. So if you 
give an gmirrored provider to gpt it should touch the last sector of the 
gmirror, but not the last sector of the disk - and not complain. It 
should not even be able to see the last sector of the real disk.


Is this hard to fix?

Daniel
___
freebsd-stable@freebsd.org mailing list
http://lists.freebsd.org/mailman/listinfo/freebsd-stable
To unsubscribe, send any mail to freebsd-stable-unsubscr...@freebsd.org


Re: correct way to setup gmirror on 7.4?

2011-04-28 Thread Edho P Arief
On Thu, Apr 28, 2011 at 4:15 PM, Daniel Kalchev dan...@digsys.bg wrote:


 On 28.04.11 01:30, Freddie Cash wrote:

 gmirror doesn't touch the start of the disk, but saves it's metadata
 in the last sector of the disk, and creates a new GEOM provider that's
 one sector shorter.

 GPT stores it's partition table in the first sector of the disk, and
 saves a backup copy of it in the last sector of the disk.

 This looks like layering issue to me.

 In theory, both gmirror and gpt should work on 'providers'. So if you give
 an gmirrored provider to gpt it should touch the last sector of the gmirror,
 but not the last sector of the disk - and not complain. It should not even
 be able to see the last sector of the real disk.

 Is this hard to fix?


I believe it goes like this

gmX: | gpt |  data   | gpt |

which in actual disk goes like this:

adY: | gpt |  data   | gpt | gmirror |

so geom read gpt in the first sector but doesn't find it in the last sector.
___
freebsd-stable@freebsd.org mailing list
http://lists.freebsd.org/mailman/listinfo/freebsd-stable
To unsubscribe, send any mail to freebsd-stable-unsubscr...@freebsd.org


Re: way for failover zpool (no HAST needed): hastmon

2011-04-28 Thread Denny Schierz
hi,

ok, here we go: I've installed hastmon and both FreeBSD nodes and one on
Linux Debian as watchdog:

Simple setup:
 
# cat /etc.local/hastmon.conf 


resource sanip {
exec /usr/local/_rbg/bin/san-ip
friends iscsihead-m iscsihead-s nos

on iscsihead-m {
remote tcp4://iscsihead-s
priority 0
}
on iscsihead-s {
remote tcp4://iscsihead-m
priority 1
}
on linux {
remote tcp4://iscsihead-m tcp4://iscsihead-s
}
} 

It works only half. 

The simple script adds/remove an alias for the em0 and for status it
does a ping -c 1 to the global ip. After tell every host, what is role
is, I get on the primary state unknown, in the secondary state run
and watchdog for the Linux host.

Than I rebooted the primary, the secondary take over and executed the
script. After the primary was reachable again, he doesn't get the
secondary role, but init/unknown.
The same happens, in the opposite:

from Linux:

hastmonctl status
sanip:
  role: watchdog
  exec: /usr/local/_rbg/bin/san-ip
  remote:
tcp4://iscsihead-m (primary/run)
tcp4://iscsihead-s (init/unknown)
  state: run
  attempts: 0 from 5
  complaints: 0 for last 60 sec (threshold 3)
  heartbeat: 10 sec

from iscsihead-s:

hastmonctl status
sanip:
  role: init
  exec: /usr/local/_rbg/bin/san-ip
  remote:
tcp4://iscsihead-m
  state: unknown
  attempts: 0 from 5
  complaints: 0 for last 60 sec (threshold 3)
  heartbeat: 10 sec

and last from iscsihead-m


hastmonctl status
sanip:
  role: primary
  exec: /usr/local/_rbg/bin/san-ip
  remote:
tcp4://iscsihead-s (disconnected)
  state: run
  attempts: 0 from 5
  complaints: 0 for last 60 sec (threshold 3)
  heartbeat: 10 sec



If I take a look into the logfile from the iscsihead-m:

[sanip] (primary) Remote node acts as init for the resource and not as
secondary.

[sanip] (primary) Handshake header from tcp4://iscsihead-s has no
'token' field.

Do I have missed something?

cu denny


signature.asc
Description: This is a digitally signed message part


ZFS vs OSX Time Machine

2011-04-28 Thread Daniel O'Connor
Does anyone else use ZFS to store TM backups?

I find that whenever my laptop (over wifi!) starts a TM the ZFS machine it's 
backing up to grinds to a halt.. Other systems streaming stuff over NFS from it 
also tend to stall..

I presume that TM is doing something which causes ZFS some issues but I'm not 
sure how to find out what the real problem is let alone how to fix it..

I am running FreeBSD midget.dons.net.au 8.2-PRERELEASE FreeBSD 8.2-PRERELEASE 
#8 r217094M: Sat Jan  8 11:15:07 CST 2011 
dar...@midget.dons.net.au:/usr/obj/usr/src/sys/MIDGET  amd64

It is a 5 disk RAIDZ1 with 1.29Tb free using WD10EADS drives.

I don't see any SMART errors or ZFS warnings.

I have the following ZFS related tunables

vfs.zfs.arc_max=3072M
vfs.zfs.prefetch_disable=1 
vfs.zfs.txg.timeout=5
vfs.zfs.cache_flush_disable=1

Any help appreciated, thanks :)

--
Daniel O'Connor software and network engineer
for Genesis Software - http://www.gsoft.com.au
The nice thing about standards is that there
are so many of them to choose from.
  -- Andrew Tanenbaum
GPG Fingerprint - 5596 B766 97C0 0E94 4347 295E E593 DC20 7B3F CE8C






___
freebsd-stable@freebsd.org mailing list
http://lists.freebsd.org/mailman/listinfo/freebsd-stable
To unsubscribe, send any mail to freebsd-stable-unsubscr...@freebsd.org


Re: correct way to setup gmirror on 7.4?

2011-04-28 Thread Freddie Cash
On Thu, Apr 28, 2011 at 2:20 AM, Edho P Arief edhopr...@gmail.com wrote:
 On Thu, Apr 28, 2011 at 4:15 PM, Daniel Kalchev dan...@digsys.bg wrote:


 On 28.04.11 01:30, Freddie Cash wrote:

 gmirror doesn't touch the start of the disk, but saves it's metadata
 in the last sector of the disk, and creates a new GEOM provider that's
 one sector shorter.

 GPT stores it's partition table in the first sector of the disk, and
 saves a backup copy of it in the last sector of the disk.

 This looks like layering issue to me.

 In theory, both gmirror and gpt should work on 'providers'. So if you give
 an gmirrored provider to gpt it should touch the last sector of the gmirror,
 but not the last sector of the disk - and not complain. It should not even
 be able to see the last sector of the real disk.

 Is this hard to fix?


 I believe it goes like this

 gmX: | gpt |          data           | gpt |

 which in actual disk goes like this:

 adY: | gpt |          data           | gpt | gmirror |

 so geom read gpt in the first sector but doesn't find it in the last sector.

Correct.  The layering is not, in itself, the issue.  The issue is
that the loader or kernel or whatever reads the first sector of the
disk, finds a GPT so it then looks for the backup GPT in the last
physical sector of the disk and doesn't find it.  At this point,
gmirror is not loaded (or not noticed, since there's nothing in the
first sector of the disk to show it's a mirror).  Once gmirror is
loaded, then the GPT stops complaining as the first and last sectors
of the gmirrror provider have the GPT tables.

My completely WAG to a fix would be for all GEOM classes to store
metadata in the last *and* first sector of the provider.  Thus,
allowing for proper stacking/layering, and proper, orderly tasting of
providors:

adX:  | gmirror | gpt |data | gpt | gmirror |

And to get complicated:

adX: | glabel | gmirror | gpt |  data   | gpt | gmirror | glabel |

And so on.  Then the loader or kernel or whatever just starts at the
beginning of the disk and reads metadata as needed.

Granted, there may be reasons why it wasn't done like this in the
beginning, but my non-GEOM programmer's eyes can't see any.
-- 
Freddie Cash
fjwc...@gmail.com
___
freebsd-stable@freebsd.org mailing list
http://lists.freebsd.org/mailman/listinfo/freebsd-stable
To unsubscribe, send any mail to freebsd-stable-unsubscr...@freebsd.org


Re: correct way to setup gmirror on 7.4?

2011-04-28 Thread Edho P Arief
On Thu, Apr 28, 2011 at 9:40 PM, Freddie Cash fjwc...@gmail.com wrote:
 Granted, there may be reasons why it wasn't done like this in the
 beginning, but my non-GEOM programmer's eyes can't see any.

I believe one of the reason is it would prevent conversion from
non-gmirror disk to gmirror one as explained here

http://www.freebsd.org/doc/en_US.ISO8859-1/books/handbook/geom-mirror.html
___
freebsd-stable@freebsd.org mailing list
http://lists.freebsd.org/mailman/listinfo/freebsd-stable
To unsubscribe, send any mail to freebsd-stable-unsubscr...@freebsd.org


Re: ZFS vs OSX Time Machine

2011-04-28 Thread Thomas Ronner

Hi,

On 4/28/11 4:03 PM, Daniel O'Connor wrote:

Does anyone else use ZFS to store TM backups?

I find that whenever my laptop (over wifi!) starts a TM the ZFS machine it's 
backing up to grinds to a halt.. Other systems streaming stuff over NFS from it 
also tend to stall..


Are you using zfs compression? If so, try turning that off.

I have a pool with a couple of filesystems with gzip-9 compression 
enabled. Whenever I write (using zfs receive, it is a backup server) to 
one of those volumes the whole pool stalls with lots of disk activity. 
Even creating a  snapshot on another filesystem within the same pool 
lasts a couple of minutes.


Does anyone know how to make this perform a little better? It's only 
writing small amounts (70-100 ops/s, 1 MB/s) on an otherwise idle pool. 
Still the drive leds blink like crazy. One of my two CPU cores is maxed 
out, the other is idle. I suppose it won't get any faster (it's CPU 
bound because of the heavy gzip compression), but why is the pool so 
slow? Is zfs receive using synchonous writes?


Sorry for maybe being offtopic :-)



Regards,
Thomas
___
freebsd-stable@freebsd.org mailing list
http://lists.freebsd.org/mailman/listinfo/freebsd-stable
To unsubscribe, send any mail to freebsd-stable-unsubscr...@freebsd.org


Re: correct way to setup gmirror on 7.4?

2011-04-28 Thread Pete French
 Correct.  The layering is not, in itself, the issue.  The issue is
 that the loader or kernel or whatever reads the first sector of the
 disk, finds a GPT so it then looks for the backup GPT in the last
 physical sector of the disk and doesn't find it.  At this point,
 gmirror is not loaded (or not noticed, since there's nothing in the
 first sector of the disk to show it's a mirror).  Once gmirror is
 loaded, then the GPT stops complaining as the first and last sectors
 of the gmirrror provider have the GPT tables.

Is not the problem here that you are trying to GPT label a gmirrored disc ?
If you instead gmirror two GPT partitions then the problem goes away
doesnt it ? Thats how I set things up - use parititoning on the ohysical
drives, and then put the mirroring into the partitions thus created.
Works fine, and doesnt suffer from any of the afforementioned problems.

-pete.
___
freebsd-stable@freebsd.org mailing list
http://lists.freebsd.org/mailman/listinfo/freebsd-stable
To unsubscribe, send any mail to freebsd-stable-unsubscr...@freebsd.org


Re: correct way to setup gmirror on 7.4?

2011-04-28 Thread Michael Proto
On Thu, Apr 28, 2011 at 11:43 AM, Pete French petefre...@ingresso.co.uk wrote:
 Correct.  The layering is not, in itself, the issue.  The issue is
 that the loader or kernel or whatever reads the first sector of the
 disk, finds a GPT so it then looks for the backup GPT in the last
 physical sector of the disk and doesn't find it.  At this point,
 gmirror is not loaded (or not noticed, since there's nothing in the
 first sector of the disk to show it's a mirror).  Once gmirror is
 loaded, then the GPT stops complaining as the first and last sectors
 of the gmirrror provider have the GPT tables.

 Is not the problem here that you are trying to GPT label a gmirrored disc ?
 If you instead gmirror two GPT partitions then the problem goes away
 doesnt it ? Thats how I set things up - use parititoning on the ohysical
 drives, and then put the mirroring into the partitions thus created.
 Works fine, and doesnt suffer from any of the afforementioned problems.

 -pete.
 ___
 freebsd-stable@freebsd.org mailing list
 http://lists.freebsd.org/mailman/listinfo/freebsd-stable
 To unsubscribe, send any mail to freebsd-stable-unsubscr...@freebsd.org


Actually I was first creating 2 GPT partitions on each disk and then
creating a mirror on each of those partitions (2 partitions per disk,
2 mirrors). When doing that I ran into the secondary GPT block
displaying as not found during boot. As I mentioned, I didn't know
if that was a problem per-se, which is why I posted to the list to see
if there was a better way of mirroring partitions. From what I'm
gathering, I think I did things correctly actually.


-Proto
___
freebsd-stable@freebsd.org mailing list
http://lists.freebsd.org/mailman/listinfo/freebsd-stable
To unsubscribe, send any mail to freebsd-stable-unsubscr...@freebsd.org


Re: correct way to setup gmirror on 7.4?

2011-04-28 Thread Ivan Voras

On 28/04/2011 17:02, Edho P Arief wrote:

On Thu, Apr 28, 2011 at 9:40 PM, Freddie Cashfjwc...@gmail.com  wrote:

Granted, there may be reasons why it wasn't done like this in the
beginning, but my non-GEOM programmer's eyes can't see any.


I believe one of the reason is it would prevent conversion from
non-gmirror disk to gmirror one as explained here

http://www.freebsd.org/doc/en_US.ISO8859-1/books/handbook/geom-mirror.html


Actually, storing any kind of metadata in the first sector can lead to 
weird and unexpected problems with some buggy disk controllers which 
parse the MBR for some (wrong) reasons. I personally have a disk 
controller which hangs on boot if the MBR contains anything but primary 
partitions of DOS type (even changing the partition type makes it hang), 
and that is not the only disk controller I've seen with this type of a bug.


The second reason is that storing anything except the MBR in the first 
sector makes the drive non-bootable (even if the controller is ok) and 
it is kind of nice to be able to make a cheap soft-RAID1 from two 
ordinary (S)ATA drives.



___
freebsd-stable@freebsd.org mailing list
http://lists.freebsd.org/mailman/listinfo/freebsd-stable
To unsubscribe, send any mail to freebsd-stable-unsubscr...@freebsd.org


Re: correct way to setup gmirror on 7.4?

2011-04-28 Thread Tom Evans
On Thu, Apr 28, 2011 at 4:43 PM, Pete French petefre...@ingresso.co.uk wrote:
 Is not the problem here that you are trying to GPT label a gmirrored disc ?
 If you instead gmirror two GPT partitions then the problem goes away
 doesnt it ? Thats how I set things up - use parititoning on the ohysical
 drives, and then put the mirroring into the partitions thus created.
 Works fine, and doesnt suffer from any of the afforementioned problems.

 -pete.

Is this simple to do? When I setup my home ZFS server, I couldn't get
it to boot from ZFS, so I configured 2 disks as 'boot' discs:

=34  2930277101  ada5  GPT  (1.4T)
  34 128 1  (null)  (64K)
 16212582912 2  root  (6.0G)
12583074  2917694061 3  samsung15-1  (1.4T)

The other 'boot' disc is configured the same, except it has
altroot/samsung15-2 labels on the UFS/ZFS GPT partitions (the other 4
discs have a corresponding 6 GB partition for swap/dumps).

However, this is as far as I got. I currently have
vfs.root.mountfrom=ufs:/dev/gpt/root, and I'd like to gmirror 'root'
onto 'altroot', without overwriting GPT labels or anything dangerous!

Cheers

Tom
___
freebsd-stable@freebsd.org mailing list
http://lists.freebsd.org/mailman/listinfo/freebsd-stable
To unsubscribe, send any mail to freebsd-stable-unsubscr...@freebsd.org


Re: correct way to setup gmirror on 7.4?

2011-04-28 Thread Pete French
 Is this simple to do? When I setup my home ZFS server, I couldn't get
 it to boot from ZFS, so I configured 2 disks as 'boot' discs:

Its fairly simple - I generally dont boot from ZFs either, my
standard config has a 4 gig UFS boot partition, and then a large zpool
on the rest of the drive. usually I add in a bit of swap there, which I
dnt mirror, so I get swap on each drive.

So each disk looks like this with MBR

da0s1 - 4 gig for /
da0s2 - 2 gig for swap
da0s3 - rest of drive for zpool

because the gmirror is at the end of the partiton then the boot
code finds the UFS filesystem at the start and boots from it not
needing to know about gmirror. The gmirror is loaded in the boot
process, and then mirrors the drive being booted with the other drive.
I can boot of either drive and the system comes up fine.  As for the
zpool, well that sorts itself out fne, as ZFS is wont to do ;-)

 =34  2930277101  ada5  GPT  (1.4T)
   34 128 1  (null)  (64K)
  16212582912 2  root  (6.0G)
 12583074  2917694061 3  samsung15-1  (1.4T)

 The other 'boot' disc is configured the same, except it has
 altroot/samsung15-2 labels on the UFS/ZFS GPT partitions (the other 4
 discs have a corresponding 6 GB partition for swap/dumps).

 However, this is as far as I got. I currently have
 vfs.root.mountfrom=ufs:/dev/gpt/root, and I'd like to gmirror 'root'
 onto 'altroot', without overwriting GPT labels or anything dangerous!

I havent tried with GPT, but it should be the same as with MBR.
Boot off the 1st drive, create a gmirror inside the root partition on
the 2nd drive, newfs it and then cpdup the running system over to it.
Make sure you do the necessaries on the 2nd drive to make it bootable
as if you just had a standard UFS filesystem in that partition, with no
gmirror. Now on te 2nd drive edit loader.conf so it looks something
like this:

geom_mirror_load=YES
vfs.root.mountfrom=ufs:/dev/mirror/mymirror

and fstab similarly:

/dev/mirror/mymirror /   ufs rw  2   2

Yu shuld now be able to boot from the 2nd drive fine. Check that
works - it should come up OK, running wth your root on agmirror
with a single element on that partition. At this point you can then
add in the partition from the first disc to the mirror. Should now
boot from either drive fine.

as I said, I havent tried it with GPT, but there is no reason I can see
that it wudnt work the same as with MBR. The only reason I still stick
with MBR is that I like the FreeBSD boot loader which will
let me choose F5 to select the next drive to boot from. Last time I
looked there wasn't an exquivalent for GPT (if I missed this then I
will now feel foolish...)

cheers,

-pete.
___
freebsd-stable@freebsd.org mailing list
http://lists.freebsd.org/mailman/listinfo/freebsd-stable
To unsubscribe, send any mail to freebsd-stable-unsubscr...@freebsd.org


Re: ZFS vs OSX Time Machine

2011-04-28 Thread Malcolm Waltz
I doubt the issues you are encountering have much to do with ZFS.

It sounds like you are using TimeMachine over NFS.  Obviously, Apple does not 
support that configuration:
http://www.google.com/search?q=time+machine+nfs+site:apple.com

In my opinion, TimeMachine should only be used with block storage.  If you use 
any kind of file-sharing protocol (AFP, SMB/CIFS or NFS), TimeMachine is 
implemented using a sparse disk image broken into hundreds or thousands of 
separate files.  This is a hack at best.

Time machine works very well with locally attached storage, but if you need to 
use network storage, you might want to try iSCSI:
http://thegreyblog.blogspot.com/2010/02/using-zfs-with-apple-time-machine.html
http://people.freebsd.org/~rse/iscsi/iscsi.txt


On Apr 28, 2011, at 7:03 AM, Daniel O'Connor wrote:

 Does anyone else use ZFS to store TM backups?
 
 I find that whenever my laptop (over wifi!) starts a TM the ZFS machine it's 
 backing up to grinds to a halt.. Other systems streaming stuff over NFS from 
 it also tend to stall..
 
 I presume that TM is doing something which causes ZFS some issues but I'm not 
 sure how to find out what the real problem is let alone how to fix it..
 
 I am running FreeBSD midget.dons.net.au 8.2-PRERELEASE FreeBSD 8.2-PRERELEASE 
 #8 r217094M: Sat Jan  8 11:15:07 CST 2011 
 dar...@midget.dons.net.au:/usr/obj/usr/src/sys/MIDGET  amd64
 
 It is a 5 disk RAIDZ1 with 1.29Tb free using WD10EADS drives.
 
 I don't see any SMART errors or ZFS warnings.
 
 I have the following ZFS related tunables
 
 vfs.zfs.arc_max=3072M
 vfs.zfs.prefetch_disable=1 
 vfs.zfs.txg.timeout=5
 vfs.zfs.cache_flush_disable=1
 
 Any help appreciated, thanks :)
 
 --
 Daniel O'Connor software and network engineer
 for Genesis Software - http://www.gsoft.com.au
 The nice thing about standards is that there
 are so many of them to choose from.
  -- Andrew Tanenbaum
 GPG Fingerprint - 5596 B766 97C0 0E94 4347 295E E593 DC20 7B3F CE8C
 
 
 
 
 
 
 ___
 freebsd-stable@freebsd.org mailing list
 http://lists.freebsd.org/mailman/listinfo/freebsd-stable
 To unsubscribe, send any mail to freebsd-stable-unsubscr...@freebsd.org

___
freebsd-stable@freebsd.org mailing list
http://lists.freebsd.org/mailman/listinfo/freebsd-stable
To unsubscribe, send any mail to freebsd-stable-unsubscr...@freebsd.org


Re: ZFS vs OSX Time Machine

2011-04-28 Thread Adam Vande More
On Thu, Apr 28, 2011 at 10:32 AM, Thomas Ronner tho...@ronner.org wrote:

 On 4/28/11 4:03 PM, Daniel O'Connor wrote:

 Does anyone else use ZFS to store TM backups?

 I find that whenever my laptop (over wifi!) starts a TM the ZFS machine
 it's backing up to grinds to a halt.. Other systems streaming stuff over NFS
 from it also tend to stall..



 Are you using zfs compression? If so, try turning that off.

 I have a pool with a couple of filesystems with gzip-9 compression enabled.
 Whenever I write (using zfs receive, it is a backup server) to one of those
 volumes the whole pool stalls with lots of disk activity. Even creating a
  snapshot on another filesystem within the same pool lasts a couple of
 minutes.

 Does anyone know how to make this perform a little better? It's only
 writing small amounts (70-100 ops/s, 1 MB/s) on an otherwise idle pool.
 Still the drive leds blink like crazy. One of my two CPU cores is maxed out,
 the other is idle. I suppose it won't get any faster (it's CPU bound because
 of the heavy gzip compression), but why is the pool so slow? Is zfs receive
 using synchonous writes?


gzip-9 is very poor choice for most datasets.  It's going to be extremely
slow especially with data that can't be compressed easily eg data that
already compressed or encrypted.  So yeah, if you're running into a cpu
bottleneck, change your compression algo.  I find lzjb to be a good one for
general use.

And to the OP, I'm not familar with TM, but see if disabling sendfile in any
of your daemons helps.  Also I don't think you want this setting:
vfs.zfs.cache_flush_disable=1

-- 
Adam Vande More
___
freebsd-stable@freebsd.org mailing list
http://lists.freebsd.org/mailman/listinfo/freebsd-stable
To unsubscribe, send any mail to freebsd-stable-unsubscr...@freebsd.org


Re: ZFS vs OSX Time Machine

2011-04-28 Thread Chuck Swiger
On Apr 28, 2011, at 7:03 AM, Daniel O'Connor wrote:
 Does anyone else use ZFS to store TM backups?
 
 I find that whenever my laptop (over wifi!) starts a TM the ZFS machine it's 
 backing up to grinds to a halt.. Other systems streaming stuff over NFS from 
 it also tend to stall..
 
 I presume that TM is doing something which causes ZFS some issues but I'm not 
 sure how to find out what the real problem is let alone how to fix it..


Caveat: Time Machine is a viable backup system, but you're outside the 
configurations which it supports.

TM really wants the backup to be located on an HFS+ filesystem because it makes 
very extensive use of hard links-- including hard links to directories-- which 
are not widely supported by other Unix filesystems.  Even if you choose to 
continue using ZFS storage, please note that you'll obtain significantly better 
results by using AFP instead of NFS filesharing.

Wikipedia has useful info here:

  http://en.wikipedia.org/wiki/Time_Machine_%28Mac_OS%29
  http://en.wikipedia.org/wiki/Apple_Filing_Protocol

Regards,
-- 
-Chuck

___
freebsd-stable@freebsd.org mailing list
http://lists.freebsd.org/mailman/listinfo/freebsd-stable
To unsubscribe, send any mail to freebsd-stable-unsubscr...@freebsd.org


Re: ZFS vs OSX Time Machine

2011-04-28 Thread George Kontostanos
I am using TM over smb on a ZFS Raidz1 pool of my fileserver with no
problems whatsoever.

NAME  USED  AVAIL  REFER  MOUNTPOINT
tank/apple   37.2G  82.8G  37.2G  /tank/apple

Oldest backup 14 December 2009

On Thu, Apr 28, 2011 at 9:25 PM, Chuck Swiger cswi...@mac.com wrote:

 On Apr 28, 2011, at 7:03 AM, Daniel O'Connor wrote:
  Does anyone else use ZFS to store TM backups?
 
  I find that whenever my laptop (over wifi!) starts a TM the ZFS machine
 it's backing up to grinds to a halt.. Other systems streaming stuff over NFS
 from it also tend to stall..
 
  I presume that TM is doing something which causes ZFS some issues but I'm
 not sure how to find out what the real problem is let alone how to fix it..


 Caveat: Time Machine is a viable backup system, but you're outside the
 configurations which it supports.

 TM really wants the backup to be located on an HFS+ filesystem because it
 makes very extensive use of hard links-- including hard links to
 directories-- which are not widely supported by other Unix filesystems.
  Even if you choose to continue using ZFS storage, please note that you'll
 obtain significantly better results by using AFP instead of NFS filesharing.

 Wikipedia has useful info here:

  http://en.wikipedia.org/wiki/Time_Machine_%28Mac_OS%29
  http://en.wikipedia.org/wiki/Apple_Filing_Protocol

 Regards,
 --
 -Chuck

 ___
 freebsd-stable@freebsd.org mailing list
 http://lists.freebsd.org/mailman/listinfo/freebsd-stable
 To unsubscribe, send any mail to freebsd-stable-unsubscr...@freebsd.org




-- 
George Kontostanos
aisecure.net http://www.aisecure.net
___
freebsd-stable@freebsd.org mailing list
http://lists.freebsd.org/mailman/listinfo/freebsd-stable
To unsubscribe, send any mail to freebsd-stable-unsubscr...@freebsd.org


Re: ZFS vs OSX Time Machine

2011-04-28 Thread Chuck Swiger
On Apr 28, 2011, at 12:17 PM, George Kontostanos wrote:
 I am using TM over smb on a ZFS Raidz1 pool of my fileserver with no problems 
 whatsoever.  
 
 NAME  USED  AVAIL  REFER  MOUNTPOINT
 tank/apple   37.2G  82.8G  37.2G  /tank/apple
 
 Oldest backup 14 December 2009

SMB aka CIFS is a better choice than NFS, because it supports better locking 
(oplocks or stealable locks), but it is not as good as AFP for this 
particular purpose.  Also, ZFS isn't going to be as space efficient at storing 
TM backups compared with HFS+, because it doesn't support hard links to 
directories.

Regards,
-- 
-Chuck



___
freebsd-stable@freebsd.org mailing list
http://lists.freebsd.org/mailman/listinfo/freebsd-stable
To unsubscribe, send any mail to freebsd-stable-unsubscr...@freebsd.org


Re: ZFS vs OSX Time Machine

2011-04-28 Thread Jeremy Chadwick
On Thu, Apr 28, 2011 at 11:33:22PM +0930, Daniel O'Connor wrote:
 Does anyone else use ZFS to store TM backups?
 
 I find that whenever my laptop (over wifi!) starts a TM the ZFS machine it's 
 backing up to grinds to a halt.. Other systems streaming stuff over NFS from 
 it also tend to stall..
 
 I presume that TM is doing something which causes ZFS some issues but I'm not 
 sure how to find out what the real problem is let alone how to fix it..
 
 I am running FreeBSD midget.dons.net.au 8.2-PRERELEASE FreeBSD 8.2-PRERELEASE 
 #8 r217094M: Sat Jan  8 11:15:07 CST 2011 
 dar...@midget.dons.net.au:/usr/obj/usr/src/sys/MIDGET  amd64
 
 It is a 5 disk RAIDZ1 with 1.29Tb free using WD10EADS drives.
 
 I don't see any SMART errors or ZFS warnings.
 
 I have the following ZFS related tunables
 
 vfs.zfs.arc_max=3072M
 vfs.zfs.prefetch_disable=1 
 vfs.zfs.txg.timeout=5
 vfs.zfs.cache_flush_disable=1

Are the last two actually *working* in /boot/loader.conf?  Can you
verify by looking at them via sysctl?  AFAIK they shouldn't work, since
they lack double-quotes around the values.  Parsing errors are supposed
to throw you back to the loader prompt.  See loader.conf(5) for the
syntax.

I'm also not sure why you're setting cache_flush_disable at all.

 Any help appreciated, thanks :)

Others seem to be battling stating that NFS doesn't work for TM, but
that isn't what you're complaining about.  You're complaining that
FreeBSD with ZFS + NFS performs extremely poorly when trying to do
backups from an OS X client using TM (writing to the NFS mount).

I have absolutely no experience with TM or OS X, so if it's actually a
client-level problem (which I'm doubting) I can't help you there.

Just sort of a ramble here at different things...

It would be useful to provide ZFS ARC sysctl data from the FreeBSD
system where you're seeing performance issues.  sysctl -a
kstat.zfs.misc.arcstats should suffice.

You should also try executing zpool iostat -v 1 during the TM backup
to see if there's a particular device which is behaving poorly.  There
have been reports of ZFS pools behaving poorly when a single device
within the pool has slow I/O (e.g. 5 hard disks, one of which has
internal issues, resulting in the entire pool performing horribly).  You
should let this run for probably 60-120 seconds to get an idea.  Given
your parameters above (assuming vfs.zfs.txg.timeout IS in fact 5!), you
should see bursts of writes every 5 seconds.

I know that there are some things on ZFS that perform badly overall.
Anything that involves excessive/large numbers of files (not file sizes,
but actual files themselves) seems to perform not-so-great with ZFS.
For example, Maildir on ZFS = piss-poor performance.  There are ways to
work around this issue (if I remember correctly, by adding a dedicated
log device to your ZFS pool, but be aware your log devices need to
be reliable (if you have a single log device and it fails the entire
pool is damaged, if I remember right)), but I don't consider it
feasible.  So if TM is creating tons of files on the NFS mount (backed
by ZFS), then I imagine the performance isn't so great.

Could you please provide the following sysctl values?  Thanks.

kern.maxvnodes
kern.minvnodes
vfs.freevnodes
vfs.numvnodes

If the FreeBSD machine has a wireless card in it, if at all possible
could you try ruling that out by hooking up wired Ethernet instead?
It's probably not the cause, but worth trying anyway.  If you have a
home router or something doing 802.11, don't bother with this idea.

Next, you COULD try using Samba/CIFS on the FreeBSD box to see if you
can narrow the issue down to bad NFS performance.  Please see this post
of mine about tuning Samba on FreeBSD (backed by ZFS) to get extremely
good performance.  Many people responded and said their performance
drastically improved (you can see the thread yourself).  The trick is
AIO.  You can ignore the part about setting vm.kmem_size in loader.conf;
that advice is now old/deprecated (does not pertain to you given the
date of your kernel), and vfs.zfs.txg.write_limit_override is something
you shouldn't mess with unless absolutely needed to leave it default:

http://lists.freebsd.org/pipermail/freebsd-stable/2011-February/061642.html

Finally, when was the last time this FreeBSD machine was rebooted?  Some
people have seen horrible performance that goes away after a reboot.
There's some speculation that memory fragmentation has something to do
with it.  I simply don't know.  I'm not telling you to reboot the box
(please don't; it would be more useful if it could be kept up in case
folks want to do analysis of it).

-- 
| Jeremy Chadwick   j...@parodius.com |
| Parodius Networking   http://www.parodius.com/ |
| UNIX Systems Administrator  Mountain View, CA, USA |
| Making life hard for others since 1977.   PGP 4BD6C0CB |

___

Re: ZFS vs OSX Time Machine

2011-04-28 Thread Malcolm Waltz
AFP is not the same as HFS+.  Time Machine will work better with AFP than NFS 
or SMB/CIFS, but it's still not using native HFS+ unless you are using block 
storage (even if you use AFP with an HFS+ filesystem).

Time Machine cannot function at all without accessing HFS+ directly.  If you 
are using a network filesystem (AFP, SMB/CIFS or NFS), Time Machine creates a 
sparse disk image, formatted as HFS+ and stores it on your file-server.  It 
then attaches that disk image as a disk device and mounts it (somewhat like 
mdconfig -a -t vnode -f /path/to/disk-image -u 1; mount /dev/md1 /mnt).  It 
then treats that disk image basically the same way that it treats local 
attached storage, including creating hard directory links (but all inside the 
disk image).  See man hdiutil (on OS X) for more info, particularly the part 
about SPARSEBUNDLEs, sparse images backing HFS+ filesystems and band sizes.

Even if you use Mac OS 10 Server and create a Time Machine share (which is the 
best case scenario), it still uses emulated block storage as described above 
(disk image over AFP on HFS+).  I have personally done this and decided that it 
was not a very good solution.  Your milage may very.  I know that people do 
this, but it seems rather silly.

If you have the knowledge to use ZFS, use a zvol via iSCSI.  It is much more 
efficient to use a form of network storage that handles block access natively 
(like iSCSI) instead of accessing emulated block storage via file-sharing 
protocols that were not designed for such use.  ZFS doesn't care what you use 
it for.  If you are using ZFSv28 (I wouldn't use it for critical data on 
FreeBSD yet) you can even do dedupe and compression on a native HFS+ Time 
Machine volume (although you would only see the saved space from the 
perspective of the zpool and make sure you have lots of RAM). 


On Apr 28, 2011, at 12:33 PM, Chuck Swiger wrote:

 On Apr 28, 2011, at 12:17 PM, George Kontostanos wrote:
 I am using TM over smb on a ZFS Raidz1 pool of my fileserver with no 
 problems whatsoever.  
 
 NAME  USED  AVAIL  REFER  MOUNTPOINT
 tank/apple   37.2G  82.8G  37.2G  /tank/apple
 
 Oldest backup 14 December 2009
 
 SMB aka CIFS is a better choice than NFS, because it supports better locking 
 (oplocks or stealable locks), but it is not as good as AFP for this 
 particular purpose.  Also, ZFS isn't going to be as space efficient at 
 storing TM backups compared with HFS+, because it doesn't support hard links 
 to directories.
 
 Regards,
 -- 
 -Chuck
 
 
 
 ___
 freebsd-stable@freebsd.org mailing list
 http://lists.freebsd.org/mailman/listinfo/freebsd-stable
 To unsubscribe, send any mail to freebsd-stable-unsubscr...@freebsd.org

___
freebsd-stable@freebsd.org mailing list
http://lists.freebsd.org/mailman/listinfo/freebsd-stable
To unsubscribe, send any mail to freebsd-stable-unsubscr...@freebsd.org


No data received with Intel Corporation Gigabit CT Desktop Adapter (82574L)

2011-04-28 Thread Wiktor Niesiobedzki
Hi,

I've installed Intel Gigabit CT Desktop Adapter in my FreeBSD 8.2 box
and I can't see any incoming traffic on this card. Even ARP resolution
doesn't work. Though I see the outgoing traffic on the other end.

Relevant info:
kadlubek# uname -a
FreeBSD kadlubek 8.2-PRERELEASE FreeBSD 8.2-PRERELEASE #20: Sat Feb 12
21:22:19 CET 2011 root@kadlubek:/usr/obj/usr/src/sys/KADLUB  i386

kadlubek# dmesg | grep em0
em0: Intel(R) PRO/1000 Network Connection 7.1.9 port 0xdc00-0xdc1f
mem 0xfe9e-0xfe9f,0xfe90-0xfe97,0xfe9dc000-0xfe9d
irq 24 at device 0.0 on pci2
em0: Using MSIX interrupts with 0 vectors
em0: [FILTER]

kadlubek# ping 192.168.115.1
PING 192.168.115.1 (192.168.115.1): 56 data bytes
ping: sendto: Host is down
ping: sendto: Host is down

In mean time - tcpdump shows:
kadlubek# tcpdump -i em0
22:03:55.962118 ARP, Request who-has 192.168.115.1 tell
192.168.115.220, length 28
22:03:56.967107 ARP, Request who-has 192.168.115.1 tell
192.168.115.220, length 28
22:03:57.972094 ARP, Request who-has 192.168.115.1 tell
192.168.115.220, length 28

I've checked the firewall rules, but there are none there:
kadlubek# pfctl -s rules
No ALTQ support in kernel
ALTQ related functions disabled

pciconf -lv shows the card as:
em0@pci0:2:0:0: class=0x02 card=0xa01f8086 chip=0x10d38086 rev=0x00 hdr=0x00
vendor = 'Intel Corporation'
device = 'Intel 82574L Gigabit Ethernet Controller (82574L)'
class  = network
subclass   = ethernet


kadlubek# sysctl dev.em.0
dev.em.0.%desc: Intel(R) PRO/1000 Network Connection 7.1.9
dev.em.0.%driver: em
dev.em.0.%location: slot=0 function=0 handle=\_SB_.PCI0.NBPG.NPGS
dev.em.0.%pnpinfo: vendor=0x8086 device=0x10d3 subvendor=0x8086
subdevice=0xa01f class=0x02
dev.em.0.%parent: pci2
dev.em.0.nvm: -1
dev.em.0.debug: -1
dev.em.0.rx_int_delay: 0
dev.em.0.tx_int_delay: 66
dev.em.0.rx_abs_int_delay: 66
dev.em.0.tx_abs_int_delay: 66
dev.em.0.rx_processing_limit: 100
dev.em.0.flow_control: 3
dev.em.0.link_irq: 0
dev.em.0.mbuf_alloc_fail: 0
dev.em.0.cluster_alloc_fail: 0
dev.em.0.dropped: 0
dev.em.0.tx_dma_fail: 0
dev.em.0.rx_overruns: 0
dev.em.0.watchdog_timeouts: 0
dev.em.0.device_control: 1477444168
dev.em.0.rx_control: 67141634
dev.em.0.fc_high_water: 18432
dev.em.0.fc_low_water: 16932
dev.em.0.queue0.txd_head: 35
dev.em.0.queue0.txd_tail: 35
dev.em.0.queue0.tx_irq: 0
dev.em.0.queue0.no_desc_avail: 0
dev.em.0.queue0.rxd_head: 117
dev.em.0.queue0.rxd_tail: 1023
dev.em.0.queue0.rx_irq: 0
dev.em.0.mac_stats.excess_coll: 0
dev.em.0.mac_stats.single_coll: 0
dev.em.0.mac_stats.multiple_coll: 0
dev.em.0.mac_stats.late_coll: 0
dev.em.0.mac_stats.collision_count: 0
dev.em.0.mac_stats.symbol_errors: 0
dev.em.0.mac_stats.sequence_errors: 0
dev.em.0.mac_stats.defer_count: 0
dev.em.0.mac_stats.missed_packets: 0
dev.em.0.mac_stats.recv_no_buff: 0
dev.em.0.mac_stats.recv_undersize: 0
dev.em.0.mac_stats.recv_fragmented: 0
dev.em.0.mac_stats.recv_oversize: 0
dev.em.0.mac_stats.recv_jabber: 0
dev.em.0.mac_stats.recv_errs: 0
dev.em.0.mac_stats.crc_errs: 0
dev.em.0.mac_stats.alignment_errs: 0
dev.em.0.mac_stats.coll_ext_errs: 0
dev.em.0.mac_stats.xon_recvd: 0
dev.em.0.mac_stats.xon_txd: 0
dev.em.0.mac_stats.xoff_recvd: 0
dev.em.0.mac_stats.xoff_txd: 0
dev.em.0.mac_stats.total_pkts_recvd: 117
dev.em.0.mac_stats.good_pkts_recvd: 117
dev.em.0.mac_stats.bcast_pkts_recvd: 41
dev.em.0.mac_stats.mcast_pkts_recvd: 42
dev.em.0.mac_stats.rx_frames_64: 71
dev.em.0.mac_stats.rx_frames_65_127: 0
dev.em.0.mac_stats.rx_frames_128_255: 35
dev.em.0.mac_stats.rx_frames_256_511: 11
dev.em.0.mac_stats.rx_frames_512_1023: 0
dev.em.0.mac_stats.rx_frames_1024_1522: 0
dev.em.0.mac_stats.good_octets_recvd: 15499
dev.em.0.mac_stats.good_octets_txd: 2240
dev.em.0.mac_stats.total_pkts_txd: 35
dev.em.0.mac_stats.good_pkts_txd: 35
dev.em.0.mac_stats.bcast_pkts_txd: 35
dev.em.0.mac_stats.mcast_pkts_txd: 0
dev.em.0.mac_stats.tx_frames_64: 35
dev.em.0.mac_stats.tx_frames_65_127: 0
dev.em.0.mac_stats.tx_frames_128_255: 0
dev.em.0.mac_stats.tx_frames_256_511: 0
dev.em.0.mac_stats.tx_frames_512_1023: 0
dev.em.0.mac_stats.tx_frames_1024_1522: 0
dev.em.0.mac_stats.tso_txd: 0
dev.em.0.mac_stats.tso_ctx_fail: 0
dev.em.0.interrupts.asserts: 2
dev.em.0.interrupts.rx_pkt_timer: 0
dev.em.0.interrupts.rx_abs_timer: 0
dev.em.0.interrupts.tx_pkt_timer: 0
dev.em.0.interrupts.tx_abs_timer: 0
dev.em.0.interrupts.tx_queue_empty: 0
dev.em.0.interrupts.tx_queue_min_thresh: 0
dev.em.0.interrupts.rx_desc_min_thresh: 0
dev.em.0.interrupts.rx_overrun: 0
dev.em.0.wake: 0

kadlubek# sysctl dev.em.0.debug=1
Interface is RUNNING and INACTIVE
em0: hw tdh = 35, hw tdt = 35
em0: hw rdh = 118, hw rdt = 1023
em0: Tx Queue Status = 1
em0: TX descriptors avail = 989
em0: Tx Descriptors avail failure = 0
em0: RX discarded packets = 0
em0: RX Next to Check = 0
em0: RX Next to Refresh = 0


I've tried booting linux on this box, and card is detected as follows:
[   16.376557] e1000e: Intel(R) PRO/1000 Network Driver - 1.2.20-k2
[ 

Re: No data received with Intel Corporation Gigabit CT Desktop Adapter (82574L)

2011-04-28 Thread Jack Vogel
Notice this:  em0: Using MSIX interrupts with 0 vectors

ZERO vectors are not a good sign :) You need to look at your system, you
have MSIX
disabled or something? Maybe some message in /var/log/messages??

Jack


On Thu, Apr 28, 2011 at 1:20 PM, Wiktor Niesiobedzki b...@vink.pl wrote:

 Hi,

 I've installed Intel Gigabit CT Desktop Adapter in my FreeBSD 8.2 box
 and I can't see any incoming traffic on this card. Even ARP resolution
 doesn't work. Though I see the outgoing traffic on the other end.

 Relevant info:
 kadlubek# uname -a
 FreeBSD kadlubek 8.2-PRERELEASE FreeBSD 8.2-PRERELEASE #20: Sat Feb 12
 21:22:19 CET 2011 root@kadlubek:/usr/obj/usr/src/sys/KADLUB  i386

 kadlubek# dmesg | grep em0
 em0: Intel(R) PRO/1000 Network Connection 7.1.9 port 0xdc00-0xdc1f
 mem 0xfe9e-0xfe9f,0xfe90-0xfe97,0xfe9dc000-0xfe9d
 irq 24 at device 0.0 on pci2
 em0: Using MSIX interrupts with 0 vectors
 em0: [FILTER]

 kadlubek# ping 192.168.115.1
 PING 192.168.115.1 (192.168.115.1): 56 data bytes
 ping: sendto: Host is down
 ping: sendto: Host is down

 In mean time - tcpdump shows:
 kadlubek# tcpdump -i em0
 22:03:55.962118 ARP, Request who-has 192.168.115.1 tell
 192.168.115.220, length 28
 22:03:56.967107 ARP, Request who-has 192.168.115.1 tell
 192.168.115.220, length 28
 22:03:57.972094 ARP, Request who-has 192.168.115.1 tell
 192.168.115.220, length 28

 I've checked the firewall rules, but there are none there:
 kadlubek# pfctl -s rules
 No ALTQ support in kernel
 ALTQ related functions disabled

 pciconf -lv shows the card as:
 em0@pci0:2:0:0: class=0x02 card=0xa01f8086 chip=0x10d38086 rev=0x00
 hdr=0x00
vendor = 'Intel Corporation'
device = 'Intel 82574L Gigabit Ethernet Controller (82574L)'
class  = network
subclass   = ethernet


 kadlubek# sysctl dev.em.0
 dev.em.0.%desc: Intel(R) PRO/1000 Network Connection 7.1.9
 dev.em.0.%driver: em
 dev.em.0.%location: slot=0 function=0 handle=\_SB_.PCI0.NBPG.NPGS
 dev.em.0.%pnpinfo: vendor=0x8086 device=0x10d3 subvendor=0x8086
 subdevice=0xa01f class=0x02
 dev.em.0.%parent: pci2
 dev.em.0.nvm: -1
 dev.em.0.debug: -1
 dev.em.0.rx_int_delay: 0
 dev.em.0.tx_int_delay: 66
 dev.em.0.rx_abs_int_delay: 66
 dev.em.0.tx_abs_int_delay: 66
 dev.em.0.rx_processing_limit: 100
 dev.em.0.flow_control: 3
 dev.em.0.link_irq: 0
 dev.em.0.mbuf_alloc_fail: 0
 dev.em.0.cluster_alloc_fail: 0
 dev.em.0.dropped: 0
 dev.em.0.tx_dma_fail: 0
 dev.em.0.rx_overruns: 0
 dev.em.0.watchdog_timeouts: 0
 dev.em.0.device_control: 1477444168
 dev.em.0.rx_control: 67141634
 dev.em.0.fc_high_water: 18432
 dev.em.0.fc_low_water: 16932
 dev.em.0.queue0.txd_head: 35
 dev.em.0.queue0.txd_tail: 35
 dev.em.0.queue0.tx_irq: 0
 dev.em.0.queue0.no_desc_avail: 0
 dev.em.0.queue0.rxd_head: 117
 dev.em.0.queue0.rxd_tail: 1023
 dev.em.0.queue0.rx_irq: 0
 dev.em.0.mac_stats.excess_coll: 0
 dev.em.0.mac_stats.single_coll: 0
 dev.em.0.mac_stats.multiple_coll: 0
 dev.em.0.mac_stats.late_coll: 0
 dev.em.0.mac_stats.collision_count: 0
 dev.em.0.mac_stats.symbol_errors: 0
 dev.em.0.mac_stats.sequence_errors: 0
 dev.em.0.mac_stats.defer_count: 0
 dev.em.0.mac_stats.missed_packets: 0
 dev.em.0.mac_stats.recv_no_buff: 0
 dev.em.0.mac_stats.recv_undersize: 0
 dev.em.0.mac_stats.recv_fragmented: 0
 dev.em.0.mac_stats.recv_oversize: 0
 dev.em.0.mac_stats.recv_jabber: 0
 dev.em.0.mac_stats.recv_errs: 0
 dev.em.0.mac_stats.crc_errs: 0
 dev.em.0.mac_stats.alignment_errs: 0
 dev.em.0.mac_stats.coll_ext_errs: 0
 dev.em.0.mac_stats.xon_recvd: 0
 dev.em.0.mac_stats.xon_txd: 0
 dev.em.0.mac_stats.xoff_recvd: 0
 dev.em.0.mac_stats.xoff_txd: 0
 dev.em.0.mac_stats.total_pkts_recvd: 117
 dev.em.0.mac_stats.good_pkts_recvd: 117
 dev.em.0.mac_stats.bcast_pkts_recvd: 41
 dev.em.0.mac_stats.mcast_pkts_recvd: 42
 dev.em.0.mac_stats.rx_frames_64: 71
 dev.em.0.mac_stats.rx_frames_65_127: 0
 dev.em.0.mac_stats.rx_frames_128_255: 35
 dev.em.0.mac_stats.rx_frames_256_511: 11
 dev.em.0.mac_stats.rx_frames_512_1023: 0
 dev.em.0.mac_stats.rx_frames_1024_1522: 0
 dev.em.0.mac_stats.good_octets_recvd: 15499
 dev.em.0.mac_stats.good_octets_txd: 2240
 dev.em.0.mac_stats.total_pkts_txd: 35
 dev.em.0.mac_stats.good_pkts_txd: 35
 dev.em.0.mac_stats.bcast_pkts_txd: 35
 dev.em.0.mac_stats.mcast_pkts_txd: 0
 dev.em.0.mac_stats.tx_frames_64: 35
 dev.em.0.mac_stats.tx_frames_65_127: 0
 dev.em.0.mac_stats.tx_frames_128_255: 0
 dev.em.0.mac_stats.tx_frames_256_511: 0
 dev.em.0.mac_stats.tx_frames_512_1023: 0
 dev.em.0.mac_stats.tx_frames_1024_1522: 0
 dev.em.0.mac_stats.tso_txd: 0
 dev.em.0.mac_stats.tso_ctx_fail: 0
 dev.em.0.interrupts.asserts: 2
 dev.em.0.interrupts.rx_pkt_timer: 0
 dev.em.0.interrupts.rx_abs_timer: 0
 dev.em.0.interrupts.tx_pkt_timer: 0
 dev.em.0.interrupts.tx_abs_timer: 0
 dev.em.0.interrupts.tx_queue_empty: 0
 dev.em.0.interrupts.tx_queue_min_thresh: 0
 dev.em.0.interrupts.rx_desc_min_thresh: 0
 dev.em.0.interrupts.rx_overrun: 0
 dev.em.0.wake: 0

 kadlubek# sysctl dev.em.0.debug=1
 

[releng_8 tinderbox] failure on arm/arm

2011-04-28 Thread FreeBSD Tinderbox
TB --- 2011-04-28 20:03:30 - tinderbox 2.6 running on freebsd-stable.sentex.ca
TB --- 2011-04-28 20:03:30 - starting RELENG_8 tinderbox run for arm/arm
TB --- 2011-04-28 20:03:30 - cleaning the object tree
TB --- 2011-04-28 20:03:37 - cvsupping the source tree
TB --- 2011-04-28 20:03:37 - /usr/bin/csup -z -r 3 -g -L 1 -h cvsup.sentex.ca 
/tinderbox/RELENG_8/arm/arm/supfile
TB --- 2011-04-28 20:04:20 - building world
TB --- 2011-04-28 20:04:20 - MAKEOBJDIRPREFIX=/obj
TB --- 2011-04-28 20:04:20 - PATH=/usr/bin:/usr/sbin:/bin:/sbin
TB --- 2011-04-28 20:04:20 - TARGET=arm
TB --- 2011-04-28 20:04:20 - TARGET_ARCH=arm
TB --- 2011-04-28 20:04:20 - TZ=UTC
TB --- 2011-04-28 20:04:20 - __MAKE_CONF=/dev/null
TB --- 2011-04-28 20:04:20 - cd /src
TB --- 2011-04-28 20:04:20 - /usr/bin/make -B buildworld
 World build started on Thu Apr 28 20:04:21 UTC 2011
 Rebuilding the temporary build tree
 stage 1.1: legacy release compatibility shims
 stage 1.2: bootstrap tools
 stage 2.1: cleaning up the object tree
 stage 2.2: rebuilding the object tree
 stage 2.3: build tools
 stage 3: cross tools
 stage 4.1: building includes
 stage 4.2: building libraries
 stage 4.3: make dependencies
 stage 4.4: building everything
[...]
gzip -cn /src/usr.sbin/uhsoctl/uhsoctl.1  uhsoctl.1.gz
=== usr.sbin/usbdump (all)
cc -O -pipe  -std=gnu99 -Wsystem-headers -Werror -Wall -Wno-format-y2k -W 
-Wno-unused-parameter -Wstrict-prototypes -Wmissing-prototypes -Wpointer-arith 
-Wreturn-type -Wcast-qual -Wwrite-strings -Wswitch -Wshadow -Wcast-align 
-Wunused-parameter -Wno-uninitialized -Wno-pointer-sign -c 
/src/usr.sbin/usbdump/usbdump.c
cc1: warnings being treated as errors
/src/usr.sbin/usbdump/usbdump.c: In function 'print_apacket':
/src/usr.sbin/usbdump/usbdump.c:353: warning: cast increases required alignment 
of target type
/src/usr.sbin/usbdump/usbdump.c: In function 'print_packets':
/src/usr.sbin/usbdump/usbdump.c:399: warning: cast increases required alignment 
of target type
*** Error code 1

Stop in /src/usr.sbin/usbdump.
*** Error code 1

Stop in /src/usr.sbin.
*** Error code 1

Stop in /src.
*** Error code 1

Stop in /src.
*** Error code 1

Stop in /src.
TB --- 2011-04-28 21:06:31 - WARNING: /usr/bin/make returned exit code  1 
TB --- 2011-04-28 21:06:31 - ERROR: failed to build world
TB --- 2011-04-28 21:06:31 - 2417.55 user 410.77 system 3780.77 real


http://tinderbox.freebsd.org/tinderbox-releng_8-RELENG_8-arm-arm.full
___
freebsd-stable@freebsd.org mailing list
http://lists.freebsd.org/mailman/listinfo/freebsd-stable
To unsubscribe, send any mail to freebsd-stable-unsubscr...@freebsd.org


Re: No data received with Intel Corporation Gigabit CT Desktop Adapter (82574L)

2011-04-28 Thread Wiktor Niesiobedzki
Hi,

I really don't know (I haven't done that intentionally). There is
nothing special in /var/log/messages:
kadlubek# grep -i msix /var/log/messages
Apr 28 21:37:03 kadlubek kernel: em0: Using MSIX interrupts with 0 vectors

Though sysctl suggests, that I haven't disabled MSIX:
kadlubek# sysctl -a | grep -i msix
hw.pci.enable_msix: 1

I've checked further pciconf output (now with -c option also) and there is:
em0@pci0:2:0:0: class=0x02 card=0xa01f8086 chip=0x10d38086 rev=0x00 hdr=0x00
vendor = 'Intel Corporation'
device = 'Intel 82574L Gigabit Ethernet Controller (82574L)'
class  = network
subclass   = ethernet
cap 01[c8] = powerspec 2  supports D0 D3  current D0
cap 05[d0] = MSI supports 1 message, 64 bit
cap 10[e0] = PCI-Express 1 endpoint max data 128(256) link x1(x1)
cap 11[a0] = MSI-X supports 5 messages in map 0x1c enabled

So it looks, like the card supports MSI-X and has them enabled.

Though my PCI Express bridges report as:
pcib2@pci0:0:2:0:   class=0x060400 card=0xc3231106 chip=0xa3641106
rev=0x80 hdr=0x01
vendor = 'VIA Technologies, Inc.'
device = 'P4M900 PCI to PCI Bridge Controller'
class  = bridge
subclass   = PCI-PCI
cap 10[40] = PCI-Express 1 root port max data 128(256) link x1(x1)
cap 01[68] = powerspec 2  supports D0 D3  current D0
cap 05[70] = MSI supports 1 message, 64 bit
cap 08[88] = HT MSI fixed address window disabled at 0xfee0
cap 0d[98] = PCI Bridge card=0xc3231106
ecap 0001[100] = AER 1 0 fatal 0 non-fatal 0 corrected
ecap 0002[140] = VC 1 max VC1
ecap 0005[180] = unknown 1
pcib3@pci0:0:3:0:   class=0x060400 card=0xc3231106 chip=0xc3641106
rev=0x80 hdr=0x01
vendor = 'VIA Technologies, Inc.'
device = 'P4M900 PCI to PCI Bridge Controller'
class  = bridge
subclass   = PCI-PCI
cap 10[40] = PCI-Express 1 root port max data 128(256) link x1(x1)
cap 01[68] = powerspec 2  supports D0 D3  current D0
cap 05[70] = MSI supports 1 message, 64 bit
cap 08[88] = HT MSI fixed address window disabled at 0xfee0
cap 0d[98] = PCI Bridge card=0xc3231106
ecap 0001[100] = AER 1 0 fatal 0 non-fatal 0 corrected
ecap 0002[140] = VC 1 max VC1
ecap 0005[180] = unknown 1

pcib5@pci0:128:0:0: class=0x060400 card=0x chip=0x287c1106
rev=0x00 hdr=0x01
vendor = 'VIA Technologies, Inc.'
device = 'VT8251 Standard PCIe Root Port'
class  = bridge
subclass   = PCI-PCI
cap 10[40] = PCI-Express 1 root port max data 128(256) link x0(x2)
cap 01[68] = powerspec 2  supports D0 D3  current D0
cap 05[70] = MSI supports 1 message, 64 bit, vector masks
cap 08[88] = HT MSI fixed address window disabled at 0xfee0
cap 0d[90] = PCI Bridge card=0x
ecap 0001[100] = AER 1 0 fatal 0 non-fatal 0 corrected
ecap 0002[140] = VC 1 max VC1
ecap 0005[180] = unknown 1
pcib6@pci0:128:0:1: class=0x060400 card=0x0004 chip=0x287d1106
rev=0x00 hdr=0x01
vendor = 'VIA Technologies, Inc.'
device = 'VT8251 Standard PCIe Root Port'
class  = bridge
subclass   = PCI-PCI
cap 10[40] = PCI-Express 1 root port max data 128(256) link x0(x1)
cap 01[68] = powerspec 2  supports D0 D3  current D0
cap 05[70] = MSI supports 1 message, 64 bit, vector masks
cap 08[88] = HT MSI fixed address window disabled at 0xfee0
cap 0d[90] = PCI Bridge card=0x0004

Though they mention that HT MSI windows is disabled. I'm not sure,
whether this matters.

Cheers,

Wiktor

2011/4/28 Jack Vogel jfvo...@gmail.com:
 Notice this:  em0: Using MSIX interrupts with 0 vectors

 ZERO vectors are not a good sign :) You need to look at your system, you
 have MSIX
 disabled or something? Maybe some message in /var/log/messages??

 Jack


 On Thu, Apr 28, 2011 at 1:20 PM, Wiktor Niesiobedzki b...@vink.pl wrote:

 Hi,

 I've installed Intel Gigabit CT Desktop Adapter in my FreeBSD 8.2 box
 and I can't see any incoming traffic on this card. Even ARP resolution
 doesn't work. Though I see the outgoing traffic on the other end.

 Relevant info:
 kadlubek# uname -a
 FreeBSD kadlubek 8.2-PRERELEASE FreeBSD 8.2-PRERELEASE #20: Sat Feb 12
 21:22:19 CET 2011     root@kadlubek:/usr/obj/usr/src/sys/KADLUB  i386

 kadlubek# dmesg | grep em0
 em0: Intel(R) PRO/1000 Network Connection 7.1.9 port 0xdc00-0xdc1f
 mem 0xfe9e-0xfe9f,0xfe90-0xfe97,0xfe9dc000-0xfe9d
 irq 24 at device 0.0 on pci2
 em0: Using MSIX interrupts with 0 vectors
 em0: [FILTER]

 kadlubek# ping 192.168.115.1
 PING 192.168.115.1 (192.168.115.1): 56 data bytes
 ping: sendto: Host is down
 ping: sendto: Host is down

 In mean time - tcpdump shows:
 kadlubek# tcpdump -i em0
 22:03:55.962118 ARP, Request who-has 192.168.115.1 tell
 192.168.115.220, length 28
 22:03:56.967107 ARP, Request who-has 192.168.115.1 tell
 192.168.115.220, length 28
 22:03:57.972094 ARP, Request who-has 192.168.115.1 tell
 192.168.115.220, length 28

 I've 

Re: ZFS vs OSX Time Machine

2011-04-28 Thread Scott Sipe
On Apr 28, 2011, at 3:56 PM, Jeremy Chadwick wrote:

 On Thu, Apr 28, 2011 at 11:33:22PM +0930, Daniel O'Connor wrote:
 Does anyone else use ZFS to store TM backups?
 
 I find that whenever my laptop (over wifi!) starts a TM the ZFS machine it's 
 backing up to grinds to a halt.. Other systems streaming stuff over NFS from 
 it also tend to stall..
 
 I presume that TM is doing something which causes ZFS some issues but I'm 
 not sure how to find out what the real problem is let alone how to fix it..
 
 I am running FreeBSD midget.dons.net.au 8.2-PRERELEASE FreeBSD 
 8.2-PRERELEASE #8 r217094M: Sat Jan  8 11:15:07 CST 2011 
 dar...@midget.dons.net.au:/usr/obj/usr/src/sys/MIDGET  amd64
 
 It is a 5 disk RAIDZ1 with 1.29Tb free using WD10EADS drives.
 
 I don't see any SMART errors or ZFS warnings.
 
 I have the following ZFS related tunables
 
 vfs.zfs.arc_max=3072M
 vfs.zfs.prefetch_disable=1 
 vfs.zfs.txg.timeout=5
 vfs.zfs.cache_flush_disable=1
 
 Are the last two actually *working* in /boot/loader.conf?  Can you
 verify by looking at them via sysctl?  AFAIK they shouldn't work, since
 they lack double-quotes around the values.  Parsing errors are supposed
 to throw you back to the loader prompt.  See loader.conf(5) for the
 syntax.

In my /boot/loader.conf I have:

vfs.zfs.arc_max=62
vfs.zfs.vdev.min_pending=4
vfs.zfs.vdev.max_pending=8
vfs.zfs.txg.timeout=5
vfs.zfs.prefetch_disable=1

And they all are properly reflected in sysctl values (no parse errors seen).

 Next, you COULD try using Samba/CIFS on the FreeBSD box to see if you
 can narrow the issue down to bad NFS performance.  Please see this post
 of mine about tuning Samba on FreeBSD (backed by ZFS) to get extremely
 good performance.  Many people responded and said their performance
 drastically improved (you can see the thread yourself).  The trick is
 AIO.  You can ignore the part about setting vm.kmem_size in loader.conf;
 that advice is now old/deprecated (does not pertain to you given the
 date of your kernel), and vfs.zfs.txg.write_limit_override is something
 you shouldn't mess with unless absolutely needed to leave it default:
 
 http://lists.freebsd.org/pipermail/freebsd-stable/2011-February/061642.html

Just wanted to note that we were having a terrible time with ZFS performance. 
Copying just a single large file over the network would bring interactive 
system usage to an absolute crawl (system is 2x xeons, 12gb ram). Thanks to 
your optimizations we have great ZFS + Samba performance. We also use Netatalk 
for afpd file sharing (though I have not tried Netatalk as a Time Machine 
target) and our performance is quite good there as well.

Scott
___
freebsd-stable@freebsd.org mailing list
http://lists.freebsd.org/mailman/listinfo/freebsd-stable
To unsubscribe, send any mail to freebsd-stable-unsubscr...@freebsd.org


Re: No data received with Intel Corporation Gigabit CT Desktop Adapter (82574L)

2011-04-28 Thread Jack Vogel
Well, rebuild your kernel so the driver is not static, then you can load and
unload
the driver to see what happens.  You only have one interface, no em1?

Jack


On Thu, Apr 28, 2011 at 2:17 PM, Wiktor Niesiobedzki b...@vink.pl wrote:

 Hi,

 I really don't know (I haven't done that intentionally). There is
 nothing special in /var/log/messages:
 kadlubek# grep -i msix /var/log/messages
 Apr 28 21:37:03 kadlubek kernel: em0: Using MSIX interrupts with 0 vectors

 Though sysctl suggests, that I haven't disabled MSIX:
 kadlubek# sysctl -a | grep -i msix
 hw.pci.enable_msix: 1

 I've checked further pciconf output (now with -c option also) and there is:
 em0@pci0:2:0:0: class=0x02 card=0xa01f8086 chip=0x10d38086 rev=0x00
 hdr=0x00
vendor = 'Intel Corporation'
device = 'Intel 82574L Gigabit Ethernet Controller (82574L)'
class  = network
subclass   = ethernet
 cap 01[c8] = powerspec 2  supports D0 D3  current D0
cap 05[d0] = MSI supports 1 message, 64 bit
cap 10[e0] = PCI-Express 1 endpoint max data 128(256) link x1(x1)
cap 11[a0] = MSI-X supports 5 messages in map 0x1c enabled

 So it looks, like the card supports MSI-X and has them enabled.

 Though my PCI Express bridges report as:
 pcib2@pci0:0:2:0:   class=0x060400 card=0xc3231106 chip=0xa3641106
 rev=0x80 hdr=0x01
vendor = 'VIA Technologies, Inc.'
device = 'P4M900 PCI to PCI Bridge Controller'
class  = bridge
subclass   = PCI-PCI
cap 10[40] = PCI-Express 1 root port max data 128(256) link x1(x1)
cap 01[68] = powerspec 2  supports D0 D3  current D0
cap 05[70] = MSI supports 1 message, 64 bit
cap 08[88] = HT MSI fixed address window disabled at 0xfee0
cap 0d[98] = PCI Bridge card=0xc3231106
 ecap 0001[100] = AER 1 0 fatal 0 non-fatal 0 corrected
 ecap 0002[140] = VC 1 max VC1
 ecap 0005[180] = unknown 1
 pcib3@pci0:0:3:0:   class=0x060400 card=0xc3231106 chip=0xc3641106
 rev=0x80 hdr=0x01
vendor = 'VIA Technologies, Inc.'
device = 'P4M900 PCI to PCI Bridge Controller'
class  = bridge
subclass   = PCI-PCI
cap 10[40] = PCI-Express 1 root port max data 128(256) link x1(x1)
cap 01[68] = powerspec 2  supports D0 D3  current D0
cap 05[70] = MSI supports 1 message, 64 bit
cap 08[88] = HT MSI fixed address window disabled at 0xfee0
cap 0d[98] = PCI Bridge card=0xc3231106
 ecap 0001[100] = AER 1 0 fatal 0 non-fatal 0 corrected
 ecap 0002[140] = VC 1 max VC1
 ecap 0005[180] = unknown 1

 pcib5@pci0:128:0:0: class=0x060400 card=0x chip=0x287c1106
 rev=0x00 hdr=0x01
vendor = 'VIA Technologies, Inc.'
device = 'VT8251 Standard PCIe Root Port'
class  = bridge
subclass   = PCI-PCI
cap 10[40] = PCI-Express 1 root port max data 128(256) link x0(x2)
cap 01[68] = powerspec 2  supports D0 D3  current D0
cap 05[70] = MSI supports 1 message, 64 bit, vector masks
cap 08[88] = HT MSI fixed address window disabled at 0xfee0
cap 0d[90] = PCI Bridge card=0x
 ecap 0001[100] = AER 1 0 fatal 0 non-fatal 0 corrected
 ecap 0002[140] = VC 1 max VC1
 ecap 0005[180] = unknown 1
 pcib6@pci0:128:0:1: class=0x060400 card=0x0004 chip=0x287d1106
 rev=0x00 hdr=0x01
vendor = 'VIA Technologies, Inc.'
device = 'VT8251 Standard PCIe Root Port'
class  = bridge
subclass   = PCI-PCI
cap 10[40] = PCI-Express 1 root port max data 128(256) link x0(x1)
cap 01[68] = powerspec 2  supports D0 D3  current D0
cap 05[70] = MSI supports 1 message, 64 bit, vector masks
cap 08[88] = HT MSI fixed address window disabled at 0xfee0
cap 0d[90] = PCI Bridge card=0x0004

 Though they mention that HT MSI windows is disabled. I'm not sure,
 whether this matters.

 Cheers,

 Wiktor

 2011/4/28 Jack Vogel jfvo...@gmail.com:
  Notice this:  em0: Using MSIX interrupts with 0 vectors
 
  ZERO vectors are not a good sign :) You need to look at your system, you
  have MSIX
  disabled or something? Maybe some message in /var/log/messages??
 
  Jack
 
 
  On Thu, Apr 28, 2011 at 1:20 PM, Wiktor Niesiobedzki b...@vink.pl
 wrote:
 
  Hi,
 
  I've installed Intel Gigabit CT Desktop Adapter in my FreeBSD 8.2 box
  and I can't see any incoming traffic on this card. Even ARP resolution
  doesn't work. Though I see the outgoing traffic on the other end.
 
  Relevant info:
  kadlubek# uname -a
  FreeBSD kadlubek 8.2-PRERELEASE FreeBSD 8.2-PRERELEASE #20: Sat Feb 12
  21:22:19 CET 2011 root@kadlubek:/usr/obj/usr/src/sys/KADLUB  i386
 
  kadlubek# dmesg | grep em0
  em0: Intel(R) PRO/1000 Network Connection 7.1.9 port 0xdc00-0xdc1f
  mem 0xfe9e-0xfe9f,0xfe90-0xfe97,0xfe9dc000-0xfe9d
  irq 24 at device 0.0 on pci2
  em0: Using MSIX interrupts with 0 vectors
  em0: [FILTER]
 
  kadlubek# ping 192.168.115.1
  PING 192.168.115.1 (192.168.115.1): 56 data bytes
  ping: sendto: Host is down
  ping: sendto: Host is down
 
  In mean time 

Re: ZFS vs OSX Time Machine

2011-04-28 Thread John Baldwin
On Thursday, April 28, 2011 3:56:01 pm Jeremy Chadwick wrote:
 On Thu, Apr 28, 2011 at 11:33:22PM +0930, Daniel O'Connor wrote:
  Does anyone else use ZFS to store TM backups?
  
  I find that whenever my laptop (over wifi!) starts a TM the ZFS machine 
it's backing up to grinds to a halt.. Other systems streaming stuff over NFS 
from it also tend to stall..
  
  I presume that TM is doing something which causes ZFS some issues but I'm 
not sure how to find out what the real problem is let alone how to fix it..
  
  I am running FreeBSD midget.dons.net.au 8.2-PRERELEASE FreeBSD 8.2-
PRERELEASE #8 r217094M: Sat Jan  8 11:15:07 CST 2011 
dar...@midget.dons.net.au:/usr/obj/usr/src/sys/MIDGET  amd64
  
  It is a 5 disk RAIDZ1 with 1.29Tb free using WD10EADS drives.
  
  I don't see any SMART errors or ZFS warnings.
  
  I have the following ZFS related tunables
  
  vfs.zfs.arc_max=3072M
  vfs.zfs.prefetch_disable=1 
  vfs.zfs.txg.timeout=5
  vfs.zfs.cache_flush_disable=1
 
 Are the last two actually *working* in /boot/loader.conf?  Can you
 verify by looking at them via sysctl?  AFAIK they shouldn't work, since
 they lack double-quotes around the values.  Parsing errors are supposed
 to throw you back to the loader prompt.  See loader.conf(5) for the
 syntax.

Huh?  I use values without quotes all the time in loader.conf.

-- 
John Baldwin
___
freebsd-stable@freebsd.org mailing list
http://lists.freebsd.org/mailman/listinfo/freebsd-stable
To unsubscribe, send any mail to freebsd-stable-unsubscr...@freebsd.org


Re: No data received with Intel Corporation Gigabit CT Desktop Adapter (82574L)

2011-04-28 Thread John Baldwin
On Thursday, April 28, 2011 5:17:11 pm Wiktor Niesiobedzki wrote:
 Hi,
 
 I really don't know (I haven't done that intentionally). There is
 nothing special in /var/log/messages:
 kadlubek# grep -i msix /var/log/messages
 Apr 28 21:37:03 kadlubek kernel: em0: Using MSIX interrupts with 0 vectors
 
 Though sysctl suggests, that I haven't disabled MSIX:
 kadlubek# sysctl -a | grep -i msix
 hw.pci.enable_msix: 1
 
 I've checked further pciconf output (now with -c option also) and there is:
 em0@pci0:2:0:0: class=0x02 card=0xa01f8086 chip=0x10d38086 rev=0x00 
hdr=0x00
 vendor = 'Intel Corporation'
 device = 'Intel 82574L Gigabit Ethernet Controller (82574L)'
 class  = network
 subclass   = ethernet
 cap 01[c8] = powerspec 2  supports D0 D3  current D0
 cap 05[d0] = MSI supports 1 message, 64 bit
 cap 10[e0] = PCI-Express 1 endpoint max data 128(256) link x1(x1)
 cap 11[a0] = MSI-X supports 5 messages in map 0x1c enabled
 
 So it looks, like the card supports MSI-X and has them enabled.
 
 Though my PCI Express bridges report as:
 pcib2@pci0:0:2:0:   class=0x060400 card=0xc3231106 chip=0xa3641106
 rev=0x80 hdr=0x01
 vendor = 'VIA Technologies, Inc.'
 device = 'P4M900 PCI to PCI Bridge Controller'
 class  = bridge
 subclass   = PCI-PCI
 cap 10[40] = PCI-Express 1 root port max data 128(256) link x1(x1)
 cap 01[68] = powerspec 2  supports D0 D3  current D0
 cap 05[70] = MSI supports 1 message, 64 bit
 cap 08[88] = HT MSI fixed address window disabled at 0xfee0
 cap 0d[98] = PCI Bridge card=0xc3231106
 ecap 0001[100] = AER 1 0 fatal 0 non-fatal 0 corrected
 ecap 0002[140] = VC 1 max VC1
 ecap 0005[180] = unknown 1
 pcib3@pci0:0:3:0:   class=0x060400 card=0xc3231106 chip=0xc3641106
 rev=0x80 hdr=0x01
 vendor = 'VIA Technologies, Inc.'
 device = 'P4M900 PCI to PCI Bridge Controller'
 class  = bridge
 subclass   = PCI-PCI
 cap 10[40] = PCI-Express 1 root port max data 128(256) link x1(x1)
 cap 01[68] = powerspec 2  supports D0 D3  current D0
 cap 05[70] = MSI supports 1 message, 64 bit
 cap 08[88] = HT MSI fixed address window disabled at 0xfee0
 cap 0d[98] = PCI Bridge card=0xc3231106
 ecap 0001[100] = AER 1 0 fatal 0 non-fatal 0 corrected
 ecap 0002[140] = VC 1 max VC1
 ecap 0005[180] = unknown 1
 
 pcib5@pci0:128:0:0: class=0x060400 card=0x chip=0x287c1106
 rev=0x00 hdr=0x01
 vendor = 'VIA Technologies, Inc.'
 device = 'VT8251 Standard PCIe Root Port'
 class  = bridge
 subclass   = PCI-PCI
 cap 10[40] = PCI-Express 1 root port max data 128(256) link x0(x2)
 cap 01[68] = powerspec 2  supports D0 D3  current D0
 cap 05[70] = MSI supports 1 message, 64 bit, vector masks
 cap 08[88] = HT MSI fixed address window disabled at 0xfee0
 cap 0d[90] = PCI Bridge card=0x
 ecap 0001[100] = AER 1 0 fatal 0 non-fatal 0 corrected
 ecap 0002[140] = VC 1 max VC1
 ecap 0005[180] = unknown 1
 pcib6@pci0:128:0:1: class=0x060400 card=0x0004 chip=0x287d1106
 rev=0x00 hdr=0x01
 vendor = 'VIA Technologies, Inc.'
 device = 'VT8251 Standard PCIe Root Port'
 class  = bridge
 subclass   = PCI-PCI
 cap 10[40] = PCI-Express 1 root port max data 128(256) link x0(x1)
 cap 01[68] = powerspec 2  supports D0 D3  current D0
 cap 05[70] = MSI supports 1 message, 64 bit, vector masks
 cap 08[88] = HT MSI fixed address window disabled at 0xfee0
 cap 0d[90] = PCI Bridge card=0x0004
 
 Though they mention that HT MSI windows is disabled. I'm not sure,
 whether this matters.

Yes, that is probably what breaks this.

-- 
John Baldwin
___
freebsd-stable@freebsd.org mailing list
http://lists.freebsd.org/mailman/listinfo/freebsd-stable
To unsubscribe, send any mail to freebsd-stable-unsubscr...@freebsd.org


Re: No data received with Intel Corporation Gigabit CT Desktop Adapter (82574L)

2011-04-28 Thread Jack Vogel
On Thu, Apr 28, 2011 at 2:28 PM, John Baldwin j...@freebsd.org wrote:

 On Thursday, April 28, 2011 5:17:11 pm Wiktor Niesiobedzki wrote:
  Hi,
 
  I really don't know (I haven't done that intentionally). There is
  nothing special in /var/log/messages:
  kadlubek# grep -i msix /var/log/messages
  Apr 28 21:37:03 kadlubek kernel: em0: Using MSIX interrupts with 0
 vectors
 
  Though sysctl suggests, that I haven't disabled MSIX:
  kadlubek# sysctl -a | grep -i msix
  hw.pci.enable_msix: 1
 
  I've checked further pciconf output (now with -c option also) and there
 is:
  em0@pci0:2:0:0: class=0x02 card=0xa01f8086 chip=0x10d38086 rev=0x00
 hdr=0x00
  vendor = 'Intel Corporation'
  device = 'Intel 82574L Gigabit Ethernet Controller (82574L)'
  class  = network
  subclass   = ethernet
  cap 01[c8] = powerspec 2  supports D0 D3  current D0
  cap 05[d0] = MSI supports 1 message, 64 bit
  cap 10[e0] = PCI-Express 1 endpoint max data 128(256) link x1(x1)
  cap 11[a0] = MSI-X supports 5 messages in map 0x1c enabled
 
  So it looks, like the card supports MSI-X and has them enabled.
 
  Though my PCI Express bridges report as:
  pcib2@pci0:0:2:0:   class=0x060400 card=0xc3231106 chip=0xa3641106
  rev=0x80 hdr=0x01
  vendor = 'VIA Technologies, Inc.'
  device = 'P4M900 PCI to PCI Bridge Controller'
  class  = bridge
  subclass   = PCI-PCI
  cap 10[40] = PCI-Express 1 root port max data 128(256) link x1(x1)
  cap 01[68] = powerspec 2  supports D0 D3  current D0
  cap 05[70] = MSI supports 1 message, 64 bit
  cap 08[88] = HT MSI fixed address window disabled at 0xfee0
  cap 0d[98] = PCI Bridge card=0xc3231106
  ecap 0001[100] = AER 1 0 fatal 0 non-fatal 0 corrected
  ecap 0002[140] = VC 1 max VC1
  ecap 0005[180] = unknown 1
  pcib3@pci0:0:3:0:   class=0x060400 card=0xc3231106 chip=0xc3641106
  rev=0x80 hdr=0x01
  vendor = 'VIA Technologies, Inc.'
  device = 'P4M900 PCI to PCI Bridge Controller'
  class  = bridge
  subclass   = PCI-PCI
  cap 10[40] = PCI-Express 1 root port max data 128(256) link x1(x1)
  cap 01[68] = powerspec 2  supports D0 D3  current D0
  cap 05[70] = MSI supports 1 message, 64 bit
  cap 08[88] = HT MSI fixed address window disabled at 0xfee0
  cap 0d[98] = PCI Bridge card=0xc3231106
  ecap 0001[100] = AER 1 0 fatal 0 non-fatal 0 corrected
  ecap 0002[140] = VC 1 max VC1
  ecap 0005[180] = unknown 1
 
  pcib5@pci0:128:0:0: class=0x060400 card=0x chip=0x287c1106
  rev=0x00 hdr=0x01
  vendor = 'VIA Technologies, Inc.'
  device = 'VT8251 Standard PCIe Root Port'
  class  = bridge
  subclass   = PCI-PCI
  cap 10[40] = PCI-Express 1 root port max data 128(256) link x0(x2)
  cap 01[68] = powerspec 2  supports D0 D3  current D0
  cap 05[70] = MSI supports 1 message, 64 bit, vector masks
  cap 08[88] = HT MSI fixed address window disabled at 0xfee0
  cap 0d[90] = PCI Bridge card=0x
  ecap 0001[100] = AER 1 0 fatal 0 non-fatal 0 corrected
  ecap 0002[140] = VC 1 max VC1
  ecap 0005[180] = unknown 1
  pcib6@pci0:128:0:1: class=0x060400 card=0x0004 chip=0x287d1106
  rev=0x00 hdr=0x01
  vendor = 'VIA Technologies, Inc.'
  device = 'VT8251 Standard PCIe Root Port'
  class  = bridge
  subclass   = PCI-PCI
  cap 10[40] = PCI-Express 1 root port max data 128(256) link x0(x1)
  cap 01[68] = powerspec 2  supports D0 D3  current D0
  cap 05[70] = MSI supports 1 message, 64 bit, vector masks
  cap 08[88] = HT MSI fixed address window disabled at 0xfee0
  cap 0d[90] = PCI Bridge card=0x0004
 
  Though they mention that HT MSI windows is disabled. I'm not sure,
  whether this matters.

 Yes, that is probably what breaks this.

 --
 John Baldwin


Opps, missed that, thanks John.  So, disable MSIX and MSI using sysctl,
then the driver should use legacy when it loads.

Still, I'd get a different motherboard, sucks to not have MSIX :(

Jack
___
freebsd-stable@freebsd.org mailing list
http://lists.freebsd.org/mailman/listinfo/freebsd-stable
To unsubscribe, send any mail to freebsd-stable-unsubscr...@freebsd.org


Re: ZFS vs OSX Time Machine

2011-04-28 Thread Jeremy Chadwick
On Thu, Apr 28, 2011 at 05:27:04PM -0400, John Baldwin wrote:
 On Thursday, April 28, 2011 3:56:01 pm Jeremy Chadwick wrote:
  On Thu, Apr 28, 2011 at 11:33:22PM +0930, Daniel O'Connor wrote:
   Does anyone else use ZFS to store TM backups?
   
   I find that whenever my laptop (over wifi!) starts a TM the ZFS machine 
 it's backing up to grinds to a halt.. Other systems streaming stuff over NFS 
 from it also tend to stall..
   
   I presume that TM is doing something which causes ZFS some issues but I'm 
 not sure how to find out what the real problem is let alone how to fix it..
   
   I am running FreeBSD midget.dons.net.au 8.2-PRERELEASE FreeBSD 8.2-
 PRERELEASE #8 r217094M: Sat Jan  8 11:15:07 CST 2011 
 dar...@midget.dons.net.au:/usr/obj/usr/src/sys/MIDGET  amd64
   
   It is a 5 disk RAIDZ1 with 1.29Tb free using WD10EADS drives.
   
   I don't see any SMART errors or ZFS warnings.
   
   I have the following ZFS related tunables
   
   vfs.zfs.arc_max=3072M
   vfs.zfs.prefetch_disable=1 
   vfs.zfs.txg.timeout=5
   vfs.zfs.cache_flush_disable=1
  
  Are the last two actually *working* in /boot/loader.conf?  Can you
  verify by looking at them via sysctl?  AFAIK they shouldn't work, since
  they lack double-quotes around the values.  Parsing errors are supposed
  to throw you back to the loader prompt.  See loader.conf(5) for the
  syntax.
 
 Huh?  I use values without quotes all the time in loader.conf.

I've seen cases where entries in /boot/loader.conf throw parser errors
during loader(8) when quotes aren't used.  The man page denotes that
quotes are required, which doesn't appear to be true?  Possibly the
parser only throws errors if non-numeric/non-integer values (e.g.
strings) are specified without quotes.

It's interesting that in the BUGS section of the man page the syntax
shown for hw.ata.ata_dma=0 also violates the required syntax.

So the question is: what's reality, and would better documentation
suffice?

-- 
| Jeremy Chadwick   j...@parodius.com |
| Parodius Networking   http://www.parodius.com/ |
| UNIX Systems Administrator  Mountain View, CA, USA |
| Making life hard for others since 1977.   PGP 4BD6C0CB |

___
freebsd-stable@freebsd.org mailing list
http://lists.freebsd.org/mailman/listinfo/freebsd-stable
To unsubscribe, send any mail to freebsd-stable-unsubscr...@freebsd.org


Re: No data received with Intel Corporation Gigabit CT Desktop Adapter (82574L)

2011-04-28 Thread Wiktor Niesiobedzki
2011/4/28 Jack Vogel jfvo...@gmail.com:
 On Thu, Apr 28, 2011 at 2:28 PM, John Baldwin j...@freebsd.org wrote:

 On Thursday, April 28, 2011 5:17:11 pm Wiktor Niesiobedzki wrote:
  Though they mention that HT MSI windows is disabled. I'm not sure,
  whether this matters.

 Yes, that is probably what breaks this.

 --
 John Baldwin

 Opps, missed that, thanks John.  So, disable MSIX and MSI using sysctl,
 then the driver should use legacy when it loads.

 Still, I'd get a different motherboard, sucks to not have MSIX :(


Thanks for hints. I've disabled MSIX and MSI:
kadlubek# sysctl hw.pci | grep msi
hw.pci.honor_msi_blacklist: 1
hw.pci.enable_msix: 0
hw.pci.enable_msi: 0

and reloaded if_em module. During initialization it confirmed, that
will not use MSI(X):
em0: Intel(R) PRO/1000 Network Connection 7.1.9 port 0xdc00-0xdc1f
mem 0xfe9e-0xfe9f,0xfe90-0xfe97,0xfe9dc000-0xfe9d
irq 24 at device 0.0 on pci2
em0: MSIX: insufficient vectors, using MSI
em0: No MSI/MSIX using a Legacy IRQ
em0: [FILTER]
em0: Ethernet address: 00:1b:21:9d:52:1b
em0: link state changed to UP

Though behavior hasn't change - I still see outgoing packets, and no
incoming traffic.

As far as I see, linux driver does that automagically, when no MSI(-X)
is available, then it fallbacks to IRQ:
 [   16.377387] e1000e :02:00.0: (unregistered net_device): Failed
to initialize MSI-X interrupts.  Falling back to MSI interrupts.
 [   16.377511] e1000e :02:00.0: (unregistered net_device): Failed
to initialize MSI interrupts.  Falling back to legacy interrupts.

Does anything come to your mind, that I can do, to debug, why this
card is not working?

Cheers,

Wiktor
___
freebsd-stable@freebsd.org mailing list
http://lists.freebsd.org/mailman/listinfo/freebsd-stable
To unsubscribe, send any mail to freebsd-stable-unsubscr...@freebsd.org


Re: ZFS vs OSX Time Machine

2011-04-28 Thread Mikael Fridh
On Thu, Apr 28, 2011 at 11:59 PM, Jeremy Chadwick
free...@jdc.parodius.com wrote:

 I've seen cases where entries in /boot/loader.conf throw parser errors
 during loader(8) when quotes aren't used.  The man page denotes that
 quotes are required, which doesn't appear to be true?  Possibly the
 parser only throws errors if non-numeric/non-integer values (e.g.
 strings) are specified without quotes.

 It's interesting that in the BUGS section of the man page the syntax
 shown for hw.ata.ata_dma=0 also violates the required syntax.

 So the question is: what's reality, and would better documentation
 suffice?

My reality:

zfs_load=YES
vfs.root.mountfrom=zfs:zroot
vfs.root.mountfrom.options=rw
vfs.zfs.debug=1
geom_mirror_load=YES
ahci_load=YES

... works.

And I've used even more sloppy syntax on occasion, basically I've left
out quotes on pretty much all values which are pure alphanumeric.

loader.conf(5) does say:
 All settings have the following format:
 variable=value

but it also says it's format was defined explicitly to resemble
rc.conf(5) and can be sourced by sh(1), which should mean that quoting
is not required anywhere.
If you read that literally, you should even be able to do this in loader.conf:

some_value=VALUE\ WITH\ SPACES

... because that can be sourced by sh(1) and would result in
some_value='VALUE WITH SPACES', but I haven't tried rebooting a
machine with such settings in loader.conf yet and I wouldn't bet on it
working nor would I actually use such madness in loader.conf even if I
could.

--
Mikael
___
freebsd-stable@freebsd.org mailing list
http://lists.freebsd.org/mailman/listinfo/freebsd-stable
To unsubscribe, send any mail to freebsd-stable-unsubscr...@freebsd.org


[releng_8 tinderbox] failure on ia64/ia64

2011-04-28 Thread FreeBSD Tinderbox
TB --- 2011-04-28 21:26:53 - tinderbox 2.6 running on freebsd-stable.sentex.ca
TB --- 2011-04-28 21:26:53 - starting RELENG_8 tinderbox run for ia64/ia64
TB --- 2011-04-28 21:26:53 - cleaning the object tree
TB --- 2011-04-28 21:27:10 - cvsupping the source tree
TB --- 2011-04-28 21:27:10 - /usr/bin/csup -z -r 3 -g -L 1 -h cvsup.sentex.ca 
/tinderbox/RELENG_8/ia64/ia64/supfile
TB --- 2011-04-28 21:27:42 - building world
TB --- 2011-04-28 21:27:42 - MAKEOBJDIRPREFIX=/obj
TB --- 2011-04-28 21:27:42 - PATH=/usr/bin:/usr/sbin:/bin:/sbin
TB --- 2011-04-28 21:27:42 - TARGET=ia64
TB --- 2011-04-28 21:27:42 - TARGET_ARCH=ia64
TB --- 2011-04-28 21:27:42 - TZ=UTC
TB --- 2011-04-28 21:27:42 - __MAKE_CONF=/dev/null
TB --- 2011-04-28 21:27:42 - cd /src
TB --- 2011-04-28 21:27:42 - /usr/bin/make -B buildworld
 World build started on Thu Apr 28 21:27:43 UTC 2011
 Rebuilding the temporary build tree
 stage 1.1: legacy release compatibility shims
 stage 1.2: bootstrap tools
 stage 2.1: cleaning up the object tree
 stage 2.2: rebuilding the object tree
 stage 2.3: build tools
 stage 3: cross tools
 stage 4.1: building includes
 stage 4.2: building libraries
 stage 4.3: make dependencies
 stage 4.4: building everything
[...]
gzip -cn /src/usr.sbin/uhsoctl/uhsoctl.1  uhsoctl.1.gz
=== usr.sbin/usbdump (all)
cc -O2 -pipe  -std=gnu99 -Wsystem-headers -Werror -Wall -Wno-format-y2k -W 
-Wno-unused-parameter -Wstrict-prototypes -Wmissing-prototypes -Wpointer-arith 
-Wreturn-type -Wcast-qual -Wwrite-strings -Wswitch -Wshadow -Wcast-align 
-Wunused-parameter -Wno-uninitialized -Wno-pointer-sign -c 
/src/usr.sbin/usbdump/usbdump.c
cc1: warnings being treated as errors
/src/usr.sbin/usbdump/usbdump.c: In function 'print_apacket':
/src/usr.sbin/usbdump/usbdump.c:353: warning: cast increases required alignment 
of target type
/src/usr.sbin/usbdump/usbdump.c: In function 'print_packets':
/src/usr.sbin/usbdump/usbdump.c:399: warning: cast increases required alignment 
of target type
*** Error code 1

Stop in /src/usr.sbin/usbdump.
*** Error code 1

Stop in /src/usr.sbin.
*** Error code 1

Stop in /src.
*** Error code 1

Stop in /src.
*** Error code 1

Stop in /src.
TB --- 2011-04-28 23:04:28 - WARNING: /usr/bin/make returned exit code  1 
TB --- 2011-04-28 23:04:28 - ERROR: failed to build world
TB --- 2011-04-28 23:04:28 - 4070.73 user 440.80 system 5854.84 real


http://tinderbox.freebsd.org/tinderbox-releng_8-RELENG_8-ia64-ia64.full
___
freebsd-stable@freebsd.org mailing list
http://lists.freebsd.org/mailman/listinfo/freebsd-stable
To unsubscribe, send any mail to freebsd-stable-unsubscr...@freebsd.org


[releng_8 tinderbox] failure on mips/mips

2011-04-28 Thread FreeBSD Tinderbox
TB --- 2011-04-28 22:26:40 - tinderbox 2.6 running on freebsd-stable.sentex.ca
TB --- 2011-04-28 22:26:40 - starting RELENG_8 tinderbox run for mips/mips
TB --- 2011-04-28 22:26:40 - cleaning the object tree
TB --- 2011-04-28 22:26:51 - cvsupping the source tree
TB --- 2011-04-28 22:26:51 - /usr/bin/csup -z -r 3 -g -L 1 -h cvsup.sentex.ca 
/tinderbox/RELENG_8/mips/mips/supfile
TB --- 2011-04-28 22:27:25 - building world
TB --- 2011-04-28 22:27:25 - MAKEOBJDIRPREFIX=/obj
TB --- 2011-04-28 22:27:25 - PATH=/usr/bin:/usr/sbin:/bin:/sbin
TB --- 2011-04-28 22:27:25 - TARGET=mips
TB --- 2011-04-28 22:27:25 - TARGET_ARCH=mips
TB --- 2011-04-28 22:27:25 - TZ=UTC
TB --- 2011-04-28 22:27:25 - __MAKE_CONF=/dev/null
TB --- 2011-04-28 22:27:25 - cd /src
TB --- 2011-04-28 22:27:25 - /usr/bin/make -B buildworld
 World build started on Thu Apr 28 22:27:26 UTC 2011
 Rebuilding the temporary build tree
 stage 1.1: legacy release compatibility shims
 stage 1.2: bootstrap tools
 stage 2.1: cleaning up the object tree
 stage 2.2: rebuilding the object tree
 stage 2.3: build tools
 stage 3: cross tools
 stage 4.1: building includes
 stage 4.2: building libraries
 stage 4.3: make dependencies
 stage 4.4: building everything
[...]
gzip -cn /src/usr.sbin/uhsoctl/uhsoctl.1  uhsoctl.1.gz
=== usr.sbin/usbdump (all)
cc -O -pipe -EL -msoft-float -G0 -mno-dsp -mabicalls  -std=gnu99 
-Wsystem-headers -Werror -Wall -Wno-format-y2k -W -Wno-unused-parameter 
-Wstrict-prototypes -Wmissing-prototypes -Wpointer-arith -Wreturn-type 
-Wcast-qual -Wwrite-strings -Wswitch -Wshadow -Wcast-align -Wunused-parameter 
-Wno-uninitialized -Wno-pointer-sign -c /src/usr.sbin/usbdump/usbdump.c
cc1: warnings being treated as errors
/src/usr.sbin/usbdump/usbdump.c: In function 'print_apacket':
/src/usr.sbin/usbdump/usbdump.c:353: warning: cast increases required alignment 
of target type
/src/usr.sbin/usbdump/usbdump.c: In function 'print_packets':
/src/usr.sbin/usbdump/usbdump.c:399: warning: cast increases required alignment 
of target type
*** Error code 1

Stop in /src/usr.sbin/usbdump.
*** Error code 1

Stop in /src/usr.sbin.
*** Error code 1

Stop in /src.
*** Error code 1

Stop in /src.
*** Error code 1

Stop in /src.
TB --- 2011-04-28 23:29:52 - WARNING: /usr/bin/make returned exit code  1 
TB --- 2011-04-28 23:29:52 - ERROR: failed to build world
TB --- 2011-04-28 23:29:52 - 2348.38 user 376.27 system 3791.79 real


http://tinderbox.freebsd.org/tinderbox-releng_8-RELENG_8-mips-mips.full
___
freebsd-stable@freebsd.org mailing list
http://lists.freebsd.org/mailman/listinfo/freebsd-stable
To unsubscribe, send any mail to freebsd-stable-unsubscr...@freebsd.org


Re: [releng_8 tinderbox] failure on arm/arm

2011-04-28 Thread Jeremy Chadwick
On Thu, Apr 28, 2011 at 09:06:32PM +, FreeBSD Tinderbox wrote:
 === usr.sbin/usbdump (all)
 cc -O -pipe  -std=gnu99 -Wsystem-headers -Werror -Wall -Wno-format-y2k -W 
 -Wno-unused-parameter -Wstrict-prototypes -Wmissing-prototypes 
 -Wpointer-arith -Wreturn-type -Wcast-qual -Wwrite-strings -Wswitch -Wshadow 
 -Wcast-align -Wunused-parameter -Wno-uninitialized -Wno-pointer-sign -c 
 /src/usr.sbin/usbdump/usbdump.c
 cc1: warnings being treated as errors
 /src/usr.sbin/usbdump/usbdump.c: In function 'print_apacket':
 /src/usr.sbin/usbdump/usbdump.c:353: warning: cast increases required 
 alignment of target type
 /src/usr.sbin/usbdump/usbdump.c: In function 'print_packets':
 /src/usr.sbin/usbdump/usbdump.c:399: warning: cast increases required 
 alignment of target type
 *** Error code 1
 
 Stop in /src/usr.sbin/usbdump.
 *** Error code 1

CC'ing hselasky and thompsa for review of this.

For failure logs (so far ia64 and arm), please see end of this page:

http://lists.freebsd.org/pipermail/freebsd-stable/2011-April/thread.html

Commit question is revision 1.6.2.2 to RELENG_8:

http://www.freebsd.org/cgi/cvsweb.cgi/src/usr.sbin/usbdump/usbdump.c

Relevant code bits:

290: static void
291: print_apacket(const struct bpf_xhdr *hdr, const uint8_t *ptr, int ptr_len)
292: {
...
349:const struct usbpf_framehdr *uf;
...
353:uf = (const struct usbpf_framehdr *)ptr;

-- 
| Jeremy Chadwick   j...@parodius.com |
| Parodius Networking   http://www.parodius.com/ |
| UNIX Systems Administrator  Mountain View, CA, USA |
| Making life hard for others since 1977.   PGP 4BD6C0CB |

___
freebsd-stable@freebsd.org mailing list
http://lists.freebsd.org/mailman/listinfo/freebsd-stable
To unsubscribe, send any mail to freebsd-stable-unsubscr...@freebsd.org


Re: ZFS vs OSX Time Machine

2011-04-28 Thread Daniel O'Connor

On 29/04/2011, at 2:16, Malcolm Waltz wrote:
 I doubt the issues you are encountering have much to do with ZFS.
 
 It sounds like you are using TimeMachine over NFS.  Obviously, Apple does not 
 support that configuration:
 http://www.google.com/search?q=time+machine+nfs+site:apple.com
 
 In my opinion, TimeMachine should only be used with block storage.  If you 
 use any kind of file-sharing protocol (AFP, SMB/CIFS or NFS), TimeMachine is 
 implemented using a sparse disk image broken into hundreds or thousands of 
 separate files.  This is a hack at best.
 
 Time machine works very well with locally attached storage, but if you need 
 to use network storage, you might want to try iSCSI:
 http://thegreyblog.blogspot.com/2010/02/using-zfs-with-apple-time-machine.html
 http://people.freebsd.org/~rse/iscsi/iscsi.txt

Hmm, I _am_ using AFPD, not NFS for this.. I will see about using an ISCSI disk 
image instead (although that would make it impossible to resize once it's 
created right?)

I see that the sparse disk image does use ~8 files in a single directory 
which does take.. a while.. to stat..

--
Daniel O'Connor software and network engineer
for Genesis Software - http://www.gsoft.com.au
The nice thing about standards is that there
are so many of them to choose from.
  -- Andrew Tanenbaum
GPG Fingerprint - 5596 B766 97C0 0E94 4347 295E E593 DC20 7B3F CE8C






___
freebsd-stable@freebsd.org mailing list
http://lists.freebsd.org/mailman/listinfo/freebsd-stable
To unsubscribe, send any mail to freebsd-stable-unsubscr...@freebsd.org


Re: ZFS vs OSX Time Machine

2011-04-28 Thread Daniel O'Connor

On 29/04/2011, at 5:26, Jeremy Chadwick wrote:
 I have the following ZFS related tunables
 
 vfs.zfs.arc_max=3072M
 vfs.zfs.prefetch_disable=1 
 vfs.zfs.txg.timeout=5
 vfs.zfs.cache_flush_disable=1
 
 Are the last two actually *working* in /boot/loader.conf?  Can you
 verify by looking at them via sysctl?  AFAIK they shouldn't work, since
 they lack double-quotes around the values.  Parsing errors are supposed
 to throw you back to the loader prompt.  See loader.conf(5) for the
 syntax.

Yep, they're working :)

 I'm also not sure why you're setting cache_flush_disable at all.

I think I was wondering if it would help the abysmal write performance of these 
disks..

 Any help appreciated, thanks :)
 
 Others seem to be battling stating that NFS doesn't work for TM, but
 that isn't what you're complaining about.  You're complaining that
 FreeBSD with ZFS + NFS performs extremely poorly when trying to do
 backups from an OS X client using TM (writing to the NFS mount).

Yes, and also TM is over AFP not NFS (I forgot to mention that..)

 I have absolutely no experience with TM or OS X, so if it's actually a
 client-level problem (which I'm doubting) I can't help you there.
 
 Just sort of a ramble here at different things...
 
 It would be useful to provide ZFS ARC sysctl data from the FreeBSD
 system where you're seeing performance issues.  sysctl -a
 kstat.zfs.misc.arcstats should suffice.

kstat.zfs.misc.arcstats.hits: 236092077
kstat.zfs.misc.arcstats.misses: 6451964
kstat.zfs.misc.arcstats.demand_data_hits: 98087637
kstat.zfs.misc.arcstats.demand_data_misses: 1220891
kstat.zfs.misc.arcstats.demand_metadata_hits: 138004440
kstat.zfs.misc.arcstats.demand_metadata_misses: 5231073
kstat.zfs.misc.arcstats.prefetch_data_hits: 0
kstat.zfs.misc.arcstats.prefetch_data_misses: 0
kstat.zfs.misc.arcstats.prefetch_metadata_hits: 0
kstat.zfs.misc.arcstats.prefetch_metadata_misses: 0
kstat.zfs.misc.arcstats.mru_hits: 15041670
kstat.zfs.misc.arcstats.mru_ghost_hits: 956048
kstat.zfs.misc.arcstats.mfu_hits: 221050407
kstat.zfs.misc.arcstats.mfu_ghost_hits: 3269042
kstat.zfs.misc.arcstats.allocated: 15785717
kstat.zfs.misc.arcstats.deleted: 4690878
kstat.zfs.misc.arcstats.stolen: 4990300
kstat.zfs.misc.arcstats.recycle_miss: 2142423
kstat.zfs.misc.arcstats.mutex_miss: 518
kstat.zfs.misc.arcstats.evict_skip: 2251705
kstat.zfs.misc.arcstats.evict_l2_cached: 0
kstat.zfs.misc.arcstats.evict_l2_eligible: 470396116480
kstat.zfs.misc.arcstats.evict_l2_ineligible: 2048
kstat.zfs.misc.arcstats.hash_elements: 482679
kstat.zfs.misc.arcstats.hash_elements_max: 503063
kstat.zfs.misc.arcstats.hash_collisions: 19593315
kstat.zfs.misc.arcstats.hash_chains: 116103
kstat.zfs.misc.arcstats.hash_chain_max: 16
kstat.zfs.misc.arcstats.p: 1692798721
kstat.zfs.misc.arcstats.c: 3221225472
kstat.zfs.misc.arcstats.c_min: 402653184
kstat.zfs.misc.arcstats.c_max: 3221225472
kstat.zfs.misc.arcstats.size: 3221162968
kstat.zfs.misc.arcstats.hdr_size: 103492088
kstat.zfs.misc.arcstats.data_size: 2764591616
kstat.zfs.misc.arcstats.other_size: 353079264
kstat.zfs.misc.arcstats.l2_hits: 0
kstat.zfs.misc.arcstats.l2_misses: 0
kstat.zfs.misc.arcstats.l2_feeds: 0
kstat.zfs.misc.arcstats.l2_rw_clash: 0
kstat.zfs.misc.arcstats.l2_read_bytes: 0
kstat.zfs.misc.arcstats.l2_write_bytes: 0
kstat.zfs.misc.arcstats.l2_writes_sent: 0
kstat.zfs.misc.arcstats.l2_writes_done: 0
kstat.zfs.misc.arcstats.l2_writes_error: 0
kstat.zfs.misc.arcstats.l2_writes_hdr_miss: 0
kstat.zfs.misc.arcstats.l2_evict_lock_retry: 0
kstat.zfs.misc.arcstats.l2_evict_reading: 0
kstat.zfs.misc.arcstats.l2_free_on_write: 0
kstat.zfs.misc.arcstats.l2_abort_lowmem: 0
kstat.zfs.misc.arcstats.l2_cksum_bad: 0
kstat.zfs.misc.arcstats.l2_io_error: 0
kstat.zfs.misc.arcstats.l2_size: 0
kstat.zfs.misc.arcstats.l2_hdr_size: 0
kstat.zfs.misc.arcstats.memory_throttle_count: 19
kstat.zfs.misc.arcstats.l2_write_trylock_fail: 0
kstat.zfs.misc.arcstats.l2_write_passed_headroom: 0
kstat.zfs.misc.arcstats.l2_write_spa_mismatch: 0
kstat.zfs.misc.arcstats.l2_write_in_l2: 0
kstat.zfs.misc.arcstats.l2_write_io_in_progress: 0
kstat.zfs.misc.arcstats.l2_write_not_cacheable: 1
kstat.zfs.misc.arcstats.l2_write_full: 0
kstat.zfs.misc.arcstats.l2_write_buffer_iter: 0
kstat.zfs.misc.arcstats.l2_write_pios: 0
kstat.zfs.misc.arcstats.l2_write_buffer_bytes_scanned: 0
kstat.zfs.misc.arcstats.l2_write_buffer_list_iter: 0
kstat.zfs.misc.arcstats.l2_write_buffer_list_null_iter: 0

 You should also try executing zpool iostat -v 1 during the TM backup
 to see if there's a particular device which is behaving poorly.  There
 have been reports of ZFS pools behaving poorly when a single device
 within the pool has slow I/O (e.g. 5 hard disks, one of which has
 internal issues, resulting in the entire pool performing horribly).  You
 should let this run for probably 60-120 seconds to get an idea.  Given
 your parameters above (assuming vfs.zfs.txg.timeout IS in fact 5!), you
 should see bursts of writes every 5 seconds.

OK.

 I know that 

Re: [releng_8 tinderbox] failure on arm/arm

2011-04-28 Thread Andrew Thompson
On 29 April 2011 11:30, Jeremy Chadwick free...@jdc.parodius.com wrote:

 On Thu, Apr 28, 2011 at 09:06:32PM +, FreeBSD Tinderbox wrote:
  === usr.sbin/usbdump (all)
  cc -O -pipe  -std=gnu99 -Wsystem-headers -Werror -Wall -Wno-format-y2k -W
 -Wno-unused-parameter -Wstrict-prototypes -Wmissing-prototypes
 -Wpointer-arith -Wreturn-type -Wcast-qual -Wwrite-strings -Wswitch -Wshadow
 -Wcast-align -Wunused-parameter -Wno-uninitialized -Wno-pointer-sign -c
 /src/usr.sbin/usbdump/usbdump.c
  cc1: warnings being treated as errors
  /src/usr.sbin/usbdump/usbdump.c: In function 'print_apacket':
  /src/usr.sbin/usbdump/usbdump.c:353: warning: cast increases required
 alignment of target type
  /src/usr.sbin/usbdump/usbdump.c: In function 'print_packets':
  /src/usr.sbin/usbdump/usbdump.c:399: warning: cast increases required
 alignment of target type
  *** Error code 1
 
  Stop in /src/usr.sbin/usbdump.
  *** Error code 1

 CC'ing hselasky and thompsa for review of this.

 For failure logs (so far ia64 and arm), please see end of this page:

 http://lists.freebsd.org/pipermail/freebsd-stable/2011-April/thread.html

 Commit question is revision 1.6.2.2 to RELENG_8:

 http://www.freebsd.org/cgi/cvsweb.cgi/src/usr.sbin/usbdump/usbdump.c

 Relevant code bits:


I merged the missing rev a few hours ago,
http://svnweb.freebsd.org/base?view=revisionrevision=221185


Andrew
___
freebsd-stable@freebsd.org mailing list
http://lists.freebsd.org/mailman/listinfo/freebsd-stable
To unsubscribe, send any mail to freebsd-stable-unsubscr...@freebsd.org


Re: ZFS vs OSX Time Machine

2011-04-28 Thread Jeremy Chadwick
On Fri, Apr 29, 2011 at 09:43:47AM +0930, Daniel O'Connor wrote:
 
 On 29/04/2011, at 5:26, Jeremy Chadwick wrote:
  I have the following ZFS related tunables
  
  vfs.zfs.arc_max=3072M
  vfs.zfs.prefetch_disable=1 
  vfs.zfs.txg.timeout=5
  vfs.zfs.cache_flush_disable=1
  
  Are the last two actually *working* in /boot/loader.conf?  Can you
  verify by looking at them via sysctl?  AFAIK they shouldn't work, since
  they lack double-quotes around the values.  Parsing errors are supposed
  to throw you back to the loader prompt.  See loader.conf(5) for the
  syntax.
 
 Yep, they're working :)
 
  I'm also not sure why you're setting cache_flush_disable at all.
 
 I think I was wondering if it would help the abysmal write performance of 
 these disks..
 
  Any help appreciated, thanks :)
  
  Others seem to be battling stating that NFS doesn't work for TM, but
  that isn't what you're complaining about.  You're complaining that
  FreeBSD with ZFS + NFS performs extremely poorly when trying to do
  backups from an OS X client using TM (writing to the NFS mount).
 
 Yes, and also TM is over AFP not NFS (I forgot to mention that..)
 
  I have absolutely no experience with TM or OS X, so if it's actually a
  client-level problem (which I'm doubting) I can't help you there.
  
  Just sort of a ramble here at different things...
  
  It would be useful to provide ZFS ARC sysctl data from the FreeBSD
  system where you're seeing performance issues.  sysctl -a
  kstat.zfs.misc.arcstats should suffice.
 
 kstat.zfs.misc.arcstats.hits: 236092077
 kstat.zfs.misc.arcstats.misses: 6451964
 kstat.zfs.misc.arcstats.demand_data_hits: 98087637
 kstat.zfs.misc.arcstats.demand_data_misses: 1220891
 kstat.zfs.misc.arcstats.demand_metadata_hits: 138004440
 kstat.zfs.misc.arcstats.demand_metadata_misses: 5231073
 kstat.zfs.misc.arcstats.prefetch_data_hits: 0
 kstat.zfs.misc.arcstats.prefetch_data_misses: 0
 kstat.zfs.misc.arcstats.prefetch_metadata_hits: 0
 kstat.zfs.misc.arcstats.prefetch_metadata_misses: 0
 kstat.zfs.misc.arcstats.mru_hits: 15041670
 kstat.zfs.misc.arcstats.mru_ghost_hits: 956048
 kstat.zfs.misc.arcstats.mfu_hits: 221050407
 kstat.zfs.misc.arcstats.mfu_ghost_hits: 3269042
 kstat.zfs.misc.arcstats.allocated: 15785717
 kstat.zfs.misc.arcstats.deleted: 4690878
 kstat.zfs.misc.arcstats.stolen: 4990300
 kstat.zfs.misc.arcstats.recycle_miss: 2142423
 kstat.zfs.misc.arcstats.mutex_miss: 518
 kstat.zfs.misc.arcstats.evict_skip: 2251705
 kstat.zfs.misc.arcstats.evict_l2_cached: 0
 kstat.zfs.misc.arcstats.evict_l2_eligible: 470396116480
 kstat.zfs.misc.arcstats.evict_l2_ineligible: 2048
 kstat.zfs.misc.arcstats.hash_elements: 482679
 kstat.zfs.misc.arcstats.hash_elements_max: 503063
 kstat.zfs.misc.arcstats.hash_collisions: 19593315
 kstat.zfs.misc.arcstats.hash_chains: 116103
 kstat.zfs.misc.arcstats.hash_chain_max: 16
 kstat.zfs.misc.arcstats.p: 1692798721
 kstat.zfs.misc.arcstats.c: 3221225472
 kstat.zfs.misc.arcstats.c_min: 402653184
 kstat.zfs.misc.arcstats.c_max: 3221225472
 kstat.zfs.misc.arcstats.size: 3221162968
 kstat.zfs.misc.arcstats.hdr_size: 103492088
 kstat.zfs.misc.arcstats.data_size: 2764591616
 kstat.zfs.misc.arcstats.other_size: 353079264
 kstat.zfs.misc.arcstats.l2_hits: 0
 kstat.zfs.misc.arcstats.l2_misses: 0
 kstat.zfs.misc.arcstats.l2_feeds: 0
 kstat.zfs.misc.arcstats.l2_rw_clash: 0
 kstat.zfs.misc.arcstats.l2_read_bytes: 0
 kstat.zfs.misc.arcstats.l2_write_bytes: 0
 kstat.zfs.misc.arcstats.l2_writes_sent: 0
 kstat.zfs.misc.arcstats.l2_writes_done: 0
 kstat.zfs.misc.arcstats.l2_writes_error: 0
 kstat.zfs.misc.arcstats.l2_writes_hdr_miss: 0
 kstat.zfs.misc.arcstats.l2_evict_lock_retry: 0
 kstat.zfs.misc.arcstats.l2_evict_reading: 0
 kstat.zfs.misc.arcstats.l2_free_on_write: 0
 kstat.zfs.misc.arcstats.l2_abort_lowmem: 0
 kstat.zfs.misc.arcstats.l2_cksum_bad: 0
 kstat.zfs.misc.arcstats.l2_io_error: 0
 kstat.zfs.misc.arcstats.l2_size: 0
 kstat.zfs.misc.arcstats.l2_hdr_size: 0
 kstat.zfs.misc.arcstats.memory_throttle_count: 19
 kstat.zfs.misc.arcstats.l2_write_trylock_fail: 0
 kstat.zfs.misc.arcstats.l2_write_passed_headroom: 0
 kstat.zfs.misc.arcstats.l2_write_spa_mismatch: 0
 kstat.zfs.misc.arcstats.l2_write_in_l2: 0
 kstat.zfs.misc.arcstats.l2_write_io_in_progress: 0
 kstat.zfs.misc.arcstats.l2_write_not_cacheable: 1
 kstat.zfs.misc.arcstats.l2_write_full: 0
 kstat.zfs.misc.arcstats.l2_write_buffer_iter: 0
 kstat.zfs.misc.arcstats.l2_write_pios: 0
 kstat.zfs.misc.arcstats.l2_write_buffer_bytes_scanned: 0
 kstat.zfs.misc.arcstats.l2_write_buffer_list_iter: 0
 kstat.zfs.misc.arcstats.l2_write_buffer_list_null_iter: 0

Thanks.  I don't see anything indicative here of ARC problems.
memory_throttle_count being 19 is acceptable as well (though a very
large number could indicate issues of a different sort).  Otherwise
things look very good/normal.

  You should also try executing zpool iostat -v 1 during the TM backup
  to see if there's a particular device which is behaving poorly.  There
  have been 

Re: ZFS vs OSX Time Machine

2011-04-28 Thread Malcolm Waltz
ZFS volumes (zvol s) can definitely be resized using the volsize property:
# zfs get volsize mypool/myvol
NAMEPROPERTY  VALUESOURCE
mypool/myvol  volsize   2G   -
# zfs set volsize=4g mypool/myvol

Mac OS 10.5 and later allows you to resize Journaled HFS+ volumes (using 
diskutil or Disk Utility.app).  Doing a quick google search, I see plenty of 
references to decreasing the size of a TimeMachine volume, so it's probably 
possible to increase it as well.  I'm sure you can find more with a little 
googleing.

man diskutil (look for resizeVolume) indicates that you can increase and 
decrease the size and doesn't mention anything special about Time Machine.


On Apr 28, 2011, at 5:02 PM, Daniel O'Connor wrote:

 
 On 29/04/2011, at 2:16, Malcolm Waltz wrote:
 I doubt the issues you are encountering have much to do with ZFS.
 
 It sounds like you are using TimeMachine over NFS.  Obviously, Apple does 
 not support that configuration:
 http://www.google.com/search?q=time+machine+nfs+site:apple.com
 
 In my opinion, TimeMachine should only be used with block storage.  If you 
 use any kind of file-sharing protocol (AFP, SMB/CIFS or NFS), TimeMachine is 
 implemented using a sparse disk image broken into hundreds or thousands of 
 separate files.  This is a hack at best.
 
 Time machine works very well with locally attached storage, but if you need 
 to use network storage, you might want to try iSCSI:
 http://thegreyblog.blogspot.com/2010/02/using-zfs-with-apple-time-machine.html
 http://people.freebsd.org/~rse/iscsi/iscsi.txt
 
 Hmm, I _am_ using AFPD, not NFS for this.. I will see about using an ISCSI 
 disk image instead (although that would make it impossible to resize once 
 it's created right?)
 
 I see that the sparse disk image does use ~8 files in a single directory 
 which does take.. a while.. to stat..
 
 --
 Daniel O'Connor software and network engineer
 for Genesis Software - http://www.gsoft.com.au
 The nice thing about standards is that there
 are so many of them to choose from.
  -- Andrew Tanenbaum
 GPG Fingerprint - 5596 B766 97C0 0E94 4347 295E E593 DC20 7B3F CE8C
 
 
 
 
 
 

___
freebsd-stable@freebsd.org mailing list
http://lists.freebsd.org/mailman/listinfo/freebsd-stable
To unsubscribe, send any mail to freebsd-stable-unsubscr...@freebsd.org


Re: ZFS vs OSX Time Machine

2011-04-28 Thread Malcolm Waltz
On Apr 28, 2011, at 6:08 PM, Jeremy Chadwick wrote:

Be aware there are all sorts of caveats/complexities with iSCSI on
FreeBSD.  There are past threads on -stable and -fs talking about them
in great detail.  I personally wouldn't go this route.

Why can't OS X use CIFS?  It has the ability to mount a SMB filesystem,
right?  Is there some reason you can't mount that, then tell TM to write
its backups to /mountedcifs?


Ahh...  I see.  Well this works perfectly (iSCSI on ZFS):
http://www.nexenta.org/

Perhaps we will see some improvements in the future.

As for CIFS, yes some people do that.  I wouldn't, but whatever.  Certainly you 
won't see _better_ performance.  Most people choose AFP for this (as did the 
original poster).
http://www.nickebo.net/tag/benchmark/  (there are plenty of others)

As you can read in my previous posts, Time Machine needs block storage.  If you 
don't use block storage, it will emulate block storage using a disk image, 
which in this case is generating ~8 files in one directory (sparse-bands).  
Good luck with that.

If iSCSI is not stable on FreeBSD, then it's probably best not to store Time 
Machine data on FreeBSD.  Some people don't seem to have issues with this (as 
one other poster mentioned).  I suppose it depends on how much and what kind of 
data you are backing up.

I can say that if you are backing up a media library and other normal user data 
using Time Machine, it definitely performs poorly (unusable) after a while if 
you are using anything but block based storage.  If it hasn't happened to you 
yet, just wait.  It will.

___
freebsd-stable@freebsd.org mailing list
http://lists.freebsd.org/mailman/listinfo/freebsd-stable
To unsubscribe, send any mail to freebsd-stable-unsubscr...@freebsd.org


Re: ZFS vs OSX Time Machine

2011-04-28 Thread Artem Belevich
On Thu, Apr 28, 2011 at 6:08 PM, Jeremy Chadwick
free...@jdc.parodius.com wrote:
 I will note something, however: your ARC max is set to 3072MB, yet Wired
 is around 4143MB.  Do you have something running on this box that takes
 up a lot of RAM?  mysqld, etc..?  I'm trying to account for the extra
 gigabyte in Wired.  top -o res might help here, but we'd need to see
 the process list.

 I'm thinking something else on your machine is also taking up Wired,
 because your arcstats shows:

 kstat.zfs.misc.arcstats.c: 3221225472
 kstat.zfs.misc.arcstats.c_min: 402653184
 kstat.zfs.misc.arcstats.c_max: 3221225472
 kstat.zfs.misc.arcstats.size: 3221162968

 Which is about 3072MB (there is always some degree of variance).

The difference is probably due to fragmentation (most of ARC
allocations are served from power-of-2 zones, if I'm not mistaken) + a
lot of wired memory sits in slab allocator caches (FREE column in
vmstat -z). On a system with ARC size of ~16G I regularly see ~22GB
wired. Ona smaller box I get about 7GB wired at around 5.5GB ARC size.

--Artem
___
freebsd-stable@freebsd.org mailing list
http://lists.freebsd.org/mailman/listinfo/freebsd-stable
To unsubscribe, send any mail to freebsd-stable-unsubscr...@freebsd.org


Re: ZFS vs OSX Time Machine

2011-04-28 Thread Daniel O'Connor

On 29/04/2011, at 11:43, Artem Belevich wrote:

 On Thu, Apr 28, 2011 at 6:08 PM, Jeremy Chadwick
 free...@jdc.parodius.com wrote:
 I will note something, however: your ARC max is set to 3072MB, yet Wired
 is around 4143MB.  Do you have something running on this box that takes
 up a lot of RAM?  mysqld, etc..?  I'm trying to account for the extra
 gigabyte in Wired.  top -o res might help here, but we'd need to see
 the process list.
 
 I'm thinking something else on your machine is also taking up Wired,
 because your arcstats shows:
 
 kstat.zfs.misc.arcstats.c: 3221225472
 kstat.zfs.misc.arcstats.c_min: 402653184
 kstat.zfs.misc.arcstats.c_max: 3221225472
 kstat.zfs.misc.arcstats.size: 3221162968
 
 Which is about 3072MB (there is always some degree of variance).
 
 The difference is probably due to fragmentation (most of ARC
 allocations are served from power-of-2 zones, if I'm not mistaken) + a
 lot of wired memory sits in slab allocator caches (FREE column in
 vmstat -z). On a system with ARC size of ~16G I regularly see ~22GB
 wired. Ona smaller box I get about 7GB wired at around 5.5GB ARC size.

This system also does double duty as a desktop PC so it gets a fair hammering..

It did have 4GB of RAM but that was fairly terrible, 8GB is a lot better though 
:)

--
Daniel O'Connor software and network engineer
for Genesis Software - http://www.gsoft.com.au
The nice thing about standards is that there
are so many of them to choose from.
  -- Andrew Tanenbaum
GPG Fingerprint - 5596 B766 97C0 0E94 4347 295E E593 DC20 7B3F CE8C






___
freebsd-stable@freebsd.org mailing list
http://lists.freebsd.org/mailman/listinfo/freebsd-stable
To unsubscribe, send any mail to freebsd-stable-unsubscr...@freebsd.org


Re: MPS driver: force bus rescan after remove SAS cable

2011-04-28 Thread Rumen Telbizov
Jeremy:


 I don't mean to sound critical, but why do you guys do this?  The reason
 I ask: on actual production filers (read: NetApps), you don't go yanking
 out the FC cable between the HBA and the NA and expect everything to be
 happy afterwards.  Most SAN administrators tend to reboot an appliance
 when doing this kind of work -- because this kind of work is considered
 maintenance.


I have just realized that I didn't respond with what I intended to. Sorry
about that.
What I meant to add to the discussion yesterday was that ejecting a single
disk
and plugging it back in does not cause (at least in my case) the block
device to
re-appear again. I haven't tried unplugging the whole cable/backplane.
Don't see the point indeed.


 I understand what you folks are reporting is a problem.  I'm just
 wondering why you're complaining about having to reboot a machine with
 an HBA in it after doing this kind of *physical* cabling work.  My
 immediate thought is I'm really not surprised.  I guess some other
 people *are* surprised.  :-)


Again I missed the point and didn't respond properly.


  Also identify function doesn't work from the OS (no problem
  via the card BIOS). Don't remember having any luck with sg3_util
  package either but worth trying again.

 I don't use SAS myself, but wouldn't the command be inquiry and not
 identify?  identify is for ATA (specifically SATA via CAM), while
 inquiry is for SCSI.  Where SAS fits into this is unknown to me.


Well I have SATA disks visible as /dev/da* . From camcontrol(8):

 inquiry Send a SCSI inquiry command (0x12) to a device.  By
default,
 camcontrol will print out the standard inquiry data, device
 serial number, and transfer rate information.  The user can
 specify that only certain types of inquiry data be printed:

Example:

# camcontrol inquiry /dev/da47
pass48: ATA WDC WD2003FYYS-0 0D02 Fixed Direct Access SCSI-5 device
pass48: Serial Number  WD-WMAUR0408496
pass48: 300.000MB/s transfers, Command Queueing Enabled

It's a SATA disk in this case attached to SAS/SATA backplane and SAS2008 HBA
chip (9211-8i)
What I need is a way to light on the fault led on the disk that I want to
identify (point to)
This is usually what I need when I send a DC technician to replace a disk.
For which I though I should
be using:

 identifySend a ATA identify command (0xec) to a device.

From my experience SAS or SATA disks - I always get those as /dev/da* disks.
It's a combo controller and backplane.
So which is the correct way of identifying a disk?

 On a related note: recently LSI released version 9.0 of their firmware
  for SAS2008 and I found it fixes certain performance problems with
  SuperMicro backplanes!

 In another thread, or a PR, if you could provide those technical details
 that would be beneficial.  There are a very large number of FreeBSD
 users who use Supermicro server-class hardware, and I'm certain they
 would be interested in a full disclosure.


What I meant was that it fixes problems not specific to FreeBSD.
I don't have much more to add and don't think that a separate thread is
required for this here (since it's not directly FreeBSD specific) but in a
nutshell
the issue that I was experiencing was that when I connect a 9211-8i to a
6Gbit/s SAS expander the performance/bandwidth was terrible and I couldn't
get more than 200 MB/s of off the disk array in sequential access even
when the disks were in a simple raid0 setup. With the release of version 9.0
everything is pretty good and am able to achieve gigabyte speeds in
sequential access.
Another bug they fixed which wasn't too bad but still ... is that each lane
in a multilane cable (8087) to the backplane was reported as a separate
connection so all the disks were visible 4 times (via 4 different expanders)
even though there's only 1 multilane cable connected to 1 backplane.
Again both those are fixed in 9.0.

I hope this helps.

Cheers,
-- 
Rumen Telbizov
http://telbizov.com
___
freebsd-stable@freebsd.org mailing list
http://lists.freebsd.org/mailman/listinfo/freebsd-stable
To unsubscribe, send any mail to freebsd-stable-unsubscr...@freebsd.org


Re: ZFS vs OSX Time Machine

2011-04-28 Thread Daniel O'Connor

On 29/04/2011, at 10:38, Jeremy Chadwick wrote:
 Could you please provide output from zfs get all poolname?  Myself and
 others would like to review what settings you're using on the
 filesystem.  If it's a separate filesystem (e.g. pool/foobar), please
 also provide output from zfs get all pool.

[midget 11:51] ~ zfs get all tank
NAME  PROPERTY  VALUE  SOURCE
tank  type  filesystem -
tank  creation  Thu Sep 24 11:22 2009  -
tank  used  2.58T  -
tank  available 981G   -
tank  referenced44.7K  -
tank  compressratio 1.00x  -
tank  mounted   yes-
tank  quota none   default
tank  reservation   none   default
tank  recordsize128K   default
tank  mountpoint/tank  default
tank  sharenfs  offdefault
tank  checksum  on default
tank  compression   offdefault
tank  atime on default
tank  devices   on default
tank  exec  on default
tank  setuidon default
tank  readonly  offdefault
tank  jailedoffdefault
tank  snapdir   hidden default
tank  aclmode   groupmask  default
tank  aclinheritrestricted default
tank  canmount  on default
tank  shareiscsioffdefault
tank  xattr offtemporary
tank  copies1  default
tank  version   3  -
tank  utf8only  off-
tank  normalization none   -
tank  casesensitivity   sensitive  -
tank  vscan offdefault
tank  nbmandoffdefault
tank  sharesmb  offdefault
tank  refquota  none   default
tank  refreservationnone   default
tank  primarycache  alldefault
tank  secondarycachealldefault
tank  usedbysnapshots   0  -
tank  usedbydataset 44.7K  -
tank  usedbychildren2.58T  -
tank  usedbyrefreservation  0  -
[midget 11:51] ~ zfs get all tank/TimeMachine  
NAME  PROPERTY  VALUE  SOURCE
tank/TimeMachine  type  filesystem -
tank/TimeMachine  creation  Sat May  8 10:59 2010  -
tank/TimeMachine  used  555G   -
tank/TimeMachine  available 45.3G  -
tank/TimeMachine  referenced555G   -
tank/TimeMachine  compressratio 1.00x  -
tank/TimeMachine  mounted   yes-
tank/TimeMachine  quota 600G   local
tank/TimeMachine  reservation   none   default
tank/TimeMachine  recordsize128K   default
tank/TimeMachine  mountpoint/tank/TimeMachine  default
tank/TimeMachine  sharenfs  offdefault
tank/TimeMachine  checksum  on default
tank/TimeMachine  compression   offdefault
tank/TimeMachine  atime on default
tank/TimeMachine  devices   on default
tank/TimeMachine  exec  on default
tank/TimeMachine  setuidon default
tank/TimeMachine  readonly  offdefault
tank/TimeMachine  jailedoffdefault
tank/TimeMachine  snapdir   hidden default
tank/TimeMachine  aclmode   groupmask  default
tank/TimeMachine  aclinheritrestricted default
tank/TimeMachine  canmount  on default
tank/TimeMachine  shareiscsioffdefault
tank/TimeMachine  xattr offtemporary
tank/TimeMachine  copies1  default
tank/TimeMachine  version   3  -
tank/TimeMachine  utf8only  off-
tank/TimeMachine  normalization none   -
tank/TimeMachine  

Re: panic, but /var/crash ist empty

2011-04-28 Thread Brandon Gooch
On Wed, Apr 27, 2011 at 1:44 PM, Helmut Schneider jumpe...@gmx.de wrote:
 Hi,

 running 8.2-RELEASE-p1 within VMWare ESXi 4.1-u1 I want to use raw
 devices as hard disks. I create the devices using this link:

 http://www.mattiasholm.com/node/33

 I tried 3 different hard drives (Seagate 2x80GB and 1x400GB SATA2)
 which are fine on a physical machine. I also ran Seatool many hours on
 all of them without errors.

 I can partiton the disks and create a few files/directories on it. But
 as soon as I copy a larger number of files to those disks (tried with
 MBR and GPT) the VM reboots *instantly* (I tried cp, dump/restore and
 rsync). No Rebooting within 15 seconds, just *snap*. I think I can
 see an panic but I'm not sure, it's too fast.

 (as far as I can see most of the times the data on the first UFS slice
 (and only the first UFS slice!) of the partition gets *severly*
 corrupted, most of the time all that is left are a few files within
 lost+found. Sometimes all the labels are gone but are recoverable using
 bsdlabel -R)

 The problem is that /var/crash remains empty.

 What can I do to create a backtrace to open a PR?

 Thanks, Helmut


Hi Helmut,

To get a backtrace from the crash (or drop to the debugger), you'll
need to compile a kernel with at least a couple of options defined.
These two:

options KDB
options DDB

...will allow you to work with the debugger on the console after a crash.

Further, with the option KDB_TRACE in the kernel config, you'll get a
backtrace printed automatically when the kernel panicsb.

Here are a couple of excellent documents to read to get you started:

http://www.freebsd.org/doc/en/books/handbook/kernelconfig-building.html
http://www.freebsd.org/doc/en/books/developers-handbook/kerneldebug.html

Kernel debug options:

http://www.freebsd.org/doc/en/books/developers-handbook/kerneldebug-options.html
___
freebsd-stable@freebsd.org mailing list
http://lists.freebsd.org/mailman/listinfo/freebsd-stable
To unsubscribe, send any mail to freebsd-stable-unsubscr...@freebsd.org


Re: MPS driver: force bus rescan after remove SAS cable

2011-04-28 Thread Alexander Motin
Rumen Telbizov wrote:
  Also identify function doesn't work from the OS (no problem
  via the card BIOS). Don't remember having any luck with sg3_util
  package either but worth trying again.
 
 I don't use SAS myself, but wouldn't the command be inquiry and not
 identify?  identify is for ATA (specifically SATA via CAM), while
 inquiry is for SCSI.  Where SAS fits into this is unknown to me.
 
 
 Well I have SATA disks visible as /dev/da* . From camcontrol(8):
 
  inquiry Send a SCSI inquiry command (0x12) to a device.  By
 default,
  camcontrol will print out the standard inquiry data, device
  serial number, and transfer rate information.  The user can
  specify that only certain types of inquiry data be printed:
 
 Example:
 
 # camcontrol inquiry /dev/da47
 pass48: ATA WDC WD2003FYYS-0 0D02 Fixed Direct Access SCSI-5 device 
 pass48: Serial Number  WD-WMAUR0408496
 pass48: 300.000MB/s transfers, Command Queueing Enabled 
 
 It's a SATA disk in this case attached to SAS/SATA backplane and SAS2008
 HBA chip (9211-8i)
 What I need is a way to light on the fault led on the disk that I want
 to identify (point to)
 This is usually what I need when I send a DC technician to replace a
 disk. For which I though I should
 be using:
 
  identifySend a ATA identify command (0xec) to a device.
 
 From my experience SAS or SATA disks - I always get those as /dev/da*
 disks. It's a combo controller and backplane.
 So which is the correct way of identifying a disk?

`camcontrol identify` means sending ATA IDENTIFY DEVICE command to the
ATA device. That command is roughly the analogue of the SCSI INQUIRY
command. It has nothing to do with LEDs. LEDs most likely controlled via
ses device or some alike management thing.

The fact that you see ATA device as daX is just means that your SAS
controller does protocol translation on-the-fly. It allows you to
communicate with disk using SCSI commands _instead_ of ATA.

-- 
Alexander Motin
___
freebsd-stable@freebsd.org mailing list
http://lists.freebsd.org/mailman/listinfo/freebsd-stable
To unsubscribe, send any mail to freebsd-stable-unsubscr...@freebsd.org