Re: Encrypted volume - how?
Norberto Meijome wrote: Hi all, I'm looking for a way to recreate the functionality of PGP Disk (under Win32). Basically, create an encrypted file, which contains a filesystem which can then be mounted in any mount point. Is this: http://www.freebsd.org/cgi/man.cgi?query=mdconfig what you are looking for? (see -t vnode option; you can apply any GEOM class, including GELI, on such devices) ___ freebsd-questions@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-questions To unsubscribe, send any mail to [EMAIL PROTECTED]
Re: VLAN filtering on FreeBSD 7.0 / 6.3
Yony Yossef wrote: Hi, I have two questions about VLANs on FreeBSD 6.3/7.0. 1. I'm trying to understand whether HW VLAN filtering can be supported. Looking at the code I can't find a proper ioctl that will inform the driver about a vlan creation/destruction. Is there a way of doing it? If you're asking how to support vlans in FreeBSD, add lines like these to rc.conf: cloned_interfaces=vlan0 ifconfig_bce1=inet 0.0.0.0 ifconfig_vlan0=vlan 250 vlandev bce1 ifconfig_vlan0_alias0=inet 161.53.72.23 netmask 255.255.255.0 This has worked for me in 6.2 and 6.3. Hardware VLAN filtering is supported in both 6.x and 7.x (at least in bce driver; look for VLAN_HWTAGGING flag in ifconfig). 2. Second issue - is there way of enabling TSO on vlan interfaces? I've asked that question about a week ago on network developers mailing list and the answer was that it could be done but it's not yet implemented (i.e. using VLANs in any way effectively disables TSO). signature.asc Description: OpenPGP digital signature
Re: iSCSI support
Jeff Chen - PTT 陳龍焜 wrote: Hi, My company is a storage RAID system company. There is one customer ask iSCSI solution with my production of my company with FreeBSD 6.1. But I found some information in the Internet, the iSCSI full support on FreeBSD is 7.0. Is it mean FreeBSD 6.1 can’t support iSCSI? Yes, the iSCSI initiator is in FreeBSD 7.x. Soon, FreeBSD 7.1 will be released. signature.asc Description: OpenPGP digital signature
Re: fastest raw device copy?
Jeremy Chadwick wrote: On Fri, Oct 31, 2008 at 09:48:16AM +0100, Christoph Kukulies wrote: What would be the fastest way to do that sector by sector copy? I'm using dd right now, dd if=/dev/ad0 of=/dev/da0 bs=1000 On the flip side, your blocksize (bs) there is quite high for no good reason. I'd pick something more like bs=64k or bs=128k. The default (512) is too small for what you want, but 10MBytes is silly. Not only that, but 1000 isn't even correct - it needs to be a multiple of sector size. Generally, using suffixes will do the right thing: dd if=/dev/ad0 of=/dev/da0 bs=1m signature.asc Description: OpenPGP digital signature
Re: fastest raw device copy?
Christoph Kukulies wrote: OK, I understand that 1000 isn't good, I just thought it wouldn't harm. But if it is a transfer rate killer then I'd better think of typing ^C now. The command is running for 6 hours now. No, with a size that isn't a multiple of sector sizes your transferred data will be corrupted. Actually, it's surprising that your number even works - the system should have complained when you requested that size for bs. An idea how I can check the current amount of transfered byed alongside the running dd command? Or watch the current i/o rate? hit Ctrl-T while running dd. signature.asc Description: OpenPGP digital signature
Re: 128 Bucket Failures?
Chris Pratt wrote: I have asked this before a couple of years ago but received no replies. I assumed that's because it's a somewhat obscure question. I'm still interested and thought I might try again in case someone new is watching this list who might know. A vmstat -z on my highest traffic server always shows the failures as below on 128 Bucket. It also goes to having 0 free rather soon after the system is restarted and never returns to having more than 1 free in that column and yet always has the highest number of requests by far. Does this mean anything significant? Is it something I should tune or even can be tuned? UMA buckets seem to be some kind of cache for SMP-optimized allocations - I hope someone who knows it better will explain them. Here is the output of the vmstat -z with everything chopped out besides the 128 Bucket line. The machine it's on is an 8 core 8 GB Tyan and shouldn't really be starved for anything in my way of thinking. vmstat -z ITEM SIZE LIMIT USED FREE REQUESTS FAILURES 128 Bucket: 1048,0, 2043,0,13591, 6511069 What is the server used for? Here's a snapshot from a very loaded apache+php+pgsql web server, uptime 60 days (since the last power outage): 16 Bucket: 76,0, 42, 58, 125, 0 32 Bucket:140,0, 76, 64, 183, 0 64 Bucket:268,0, 74, 38, 438, 11 128 Bucket: 524,0, 2060, 642, 788828, 6985 A generic advice would be to increase vm.kmem_size (you're using AMD64, right?) and see what happens. signature.asc Description: OpenPGP digital signature
Re: FreeBSD not stable enough for Xen?
Redd Vinylene wrote: Hello hello. I want this hosting company to offer FreeBSD but they claim it's not yet stable enough for their Xen setup. Is there anything I can do to prove them wrong? No. Xen work is highly experimental even in -CURRENT. It *can* be used, and people have successfully booted FreeBSD under Xen but I don't think anyone is using it in production. If you're interested in FreeBSD-Xen, you can follow this mailing list: http://lists.freebsd.org/mailman/listinfo/freebsd-xen It's likely that Xen will be good enough to be used in FreeBSD 8. signature.asc Description: OpenPGP digital signature
Re: php5 Only IE Users can View Pages.
Martin McCormick wrote: I inherited a mrtg application thatnow is running on a FreeBSD6.3 system. Clients report that one can see the php pages when using Internet Explorer but not other browsers that should display the pages. Those customers see raw code. Any suggestion as to what I should be looking for? One of the browsers for sure that isn't working is firefox. Many thanks. Looks like you didn't configure PHP to properly interact with the web server. signature.asc Description: OpenPGP digital signature
Re: ZFS over iSCSI anyone ?
Jeremy Chadwick wrote: On Mon, Nov 17, 2008 at 03:44:23PM +0100, Frank Bonnet wrote: Hello Does anyone has tried to use ZFS over iSCSI ? Another FreeBSD user recently brought to my attention problems with iSCSI on FreeBSD. There is a patch available which fixes the issue, but I felt you might want to know about it beforehand. Issue: http://lists.freebsd.org/pipermail/freebsd-scsi/2008-February/003383.html Patch: http://lists.freebsd.org/pipermail/freebsd-scsi/2008-February/003387.html Isn't this committed already? signature.asc Description: OpenPGP digital signature
Re: ZFS over iSCSI anyone ?
Jeremy Chadwick wrote: On Mon, Nov 17, 2008 at 04:29:06PM +0100, Ivan Voras wrote: Jeremy Chadwick wrote: On Mon, Nov 17, 2008 at 03:44:23PM +0100, Frank Bonnet wrote: Hello Does anyone has tried to use ZFS over iSCSI ? Another FreeBSD user recently brought to my attention problems with iSCSI on FreeBSD. There is a patch available which fixes the issue, but I felt you might want to know about it beforehand. Issue: http://lists.freebsd.org/pipermail/freebsd-scsi/2008-February/003383.html Patch: http://lists.freebsd.org/pipermail/freebsd-scsi/2008-February/003387.html Isn't this committed already? The user tells me it is not, and that his replies to the patch author have gone ignored. It looks like the iSCSI developer disappeared - I got a bounce message (in French) on the last e-mail :( signature.asc Description: OpenPGP digital signature
Re: PEA kernel in FreeBSD 7.0
Olivier Nicole wrote: Hi, I am about to install few brand new servers, each with 8GB RAM. If I choose to use 7.0, will I have to use PEA kernel to be able to access the total memory? Yes if you want to use the 32-bit version of FreeBSD. Use a 64-bit version instead. signature.asc Description: OpenPGP digital signature
Re: realtime network replication
Ansar Mohammed wrote: Hello all, I need to replicate /home between two freebsd servers in real time (no scheduled rsyncs) What are my options? Maybe the best option for you would be http://www.furquim.org/chironfs/index.en.html used in combination with NFS. It's available as fusefs-chiron in ports. signature.asc Description: OpenPGP digital signature
Re: Analysing VMcore files.
Simon Burke wrote: I am currently running FreeBSD 7.0 as my desktop OS, and I have a need to analyse VWCores from a RedHat ES system. Knowing very little about analysing dumps, is it possible to do this? or would I have to set up a more comparable environment? In theory, you could set up a Linux environment (http://www.freebsd.org/doc/en/books/handbook/linuxemu.html) with the binaries from your RedHat system, spawn a Linux shell and go from there as if you're on Linux, but this will almost certainly be more work than just finding a RedHat system (or even installing one in qemu). signature.asc Description: OpenPGP digital signature
Re: ZFS over iSCSI anyone ?
Ivan Voras wrote: Jeremy Chadwick wrote: On Mon, Nov 17, 2008 at 04:29:06PM +0100, Ivan Voras wrote: Jeremy Chadwick wrote: On Mon, Nov 17, 2008 at 03:44:23PM +0100, Frank Bonnet wrote: Hello Does anyone has tried to use ZFS over iSCSI ? Another FreeBSD user recently brought to my attention problems with iSCSI on FreeBSD. There is a patch available which fixes the issue, but I felt you might want to know about it beforehand. Issue: http://lists.freebsd.org/pipermail/freebsd-scsi/2008-February/003383.html Patch: http://lists.freebsd.org/pipermail/freebsd-scsi/2008-February/003387.html Isn't this committed already? The user tells me it is not, and that his replies to the patch author have gone ignored. It looks like the iSCSI developer disappeared - I got a bounce message (in French) on the last e-mail :( It looks like there's new development in -CURRENT: http://svn.freebsd.org/viewvc/base?view=revisionrevision=185289 signature.asc Description: OpenPGP digital signature
Re: ZFS over iSCSI anyone ?
2008/11/26 Frank Bonnet [EMAIL PROTECTED]: Well good news ! it seems to be integrated inside operating system isn't it ? Yes, the patch is for -CURRENT (which means it will be present in the 8.0 release; bug the developers if you need it earlier). ___ freebsd-questions@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-questions To unsubscribe, send any mail to [EMAIL PROTECTED]
Re: APIC error
Da Rock wrote: I know the system is failing because I'm getting usb enumeration errors (something that has come up twice before on dying systems, and has disappeared as soon as I bought a new one), plus acpi errors in the form of being unable to attach device data. I understand this software unable to cope with interrupts at the cpu, and can mean hardware failure or bad software. But given my hardware issues I'm fairly certain its the former. My biggest question is where? How does it come up with something like that? Can anyone shed some light on the details of this? I'll be greatful for whatever I can get- information is power after all. This is too little information for general troubleshooting, except if someone has encountered this exact problem before. From your description, especially since you're suggesting a hardware failure, it could be anything from BIOS or BIOS CMOS error (or battery) to real hardware problems in the conductors to the buses. signature.asc Description: OpenPGP digital signature
Re: repair v.7 installation
PJ wrote:
I believe that my installation should be salvageable but I do not know
how to phrase my search question.
Here is the problem:
Apparently due to some connector problem in the computer one or some
files were damaged. I ran a regenerating program on the disk and all
sectors are readable.
How can I locate the problem files and repair or reinstall them without
damaging other files?
Try reading all the files on the drive, something like
find / -exec cat {} /dev/null ;
See if any files error out.
From trying to boot the system, it appears that the problem is related
to the login files: I boot to safe mode and get the logon prompt which
is not accepted. I then get to the single user mode and can read the
Boot to a single-user mode and see if /etc/passwd and /etc/master.passwd
are ok. If so, regenerate the databases (easiest way is to run vipw).
contents of the root (top or main) directory and subdirectories.
The command df returns -70016 under Avail and 104% under Capacity,
Mounted on / .
This doesn't necessarily mean there's an error. If you filled the file
system past its reserved space limit, it's normal to get negative
available bytes and over 100% usage. See also if you have a /lost+found
directory.
Or is it possible to reinstall the system from the installation CD? I
would like to avoid having to reinstall all the programs that run on
this local development server - Apache, Samba, Cups, php, pstgresql, etc.
It is possible, with care, to reinstall the system from the CD media,
and keep all user settings. /usr/local/* will not be touched in any case
when performing an upgrade.
signature.asc
Description: OpenPGP digital signature
Re: Pasting via ssh causes data loss
Eugene Pimenov wrote: Hello everyone, I'm not really sure weither it's related to freebsd or ssh. When I paste a lot of data (6060 bytes, 60 lines 100 bytes each + ‘\n’) via ssh into `cat test.txt` or the small program, one freebsd receives 5181, another receives 3221 bytes. I regularly do copy-pastes of textual data of that size (and larger) in interactive sessions (with text editors) without problems, between FreeBSD machines and from Linux to FreeBSD machines. Are you sure it's not a problem with your terminal application and not on the server side? (try a different terminal). signature.asc Description: OpenPGP digital signature
Re: Pasting via ssh causes data loss
Chris wrote: a cat testfile then pasted through an ssh terminal.app connection over satellite (very bad connection) into a FreeBSD 7.0 box I built in the last month. At Btw. lousy connections don't come into this as SSH does HMAC checking on the data - i.e. even if you somehow managed to loose parts of a TCP stream in a way that's not detected by TCP (which is also practically impossible), SSH will aditionally cryptographically make sure that what is sent is what is received (if an error occurs, the connection will be aborted). Either the sending part / terminal has problem or the receiving part / terminal. Operating system, the network stack or the network quality cannot cause the described behaviour. signature.asc Description: OpenPGP digital signature
Re: RAID5 on FreeBSD 6 or 7
Wojciech Puchar wrote: fast, though. See it's page on Wikipedia for more info. I'd use it more if it was part of official FreeBSD release, but for now it is only available as a patch (AFAIK). which is strange. someone don't like RAID5 to be included in system? I'd like to see graid5 in the base system but I'm also one of those who sort-of held it back from being imported, at least by inaction. The reasons are: a) Last time there was discussion about including it (it's available somewhere in the freebsd-geom list archives) an issue was raised about its over-aggressive use of caching that is turned *on* by default. IIRC it's also likely that the design of the current code doesn't allow turning it off. I suppose this is what makes it fast but the concerns for data stability / corruption are real and not imaginary. b) It was developed by a non-developer. This in itself says nothing about the quality or the lack of quality of the code and is technically irrelevant but there are couple of organizational issues: 1) it needs someone to look after it when it's imported 2) it needs to conform to the style and code layout rules of the project I can't find the patch right now so I can't say for sure what is its state now. I believe that if issues a) and b.2) are solved there would be no problems or objections in importing it. (It could be said that ZFS makes it obsolete, but it's not so - lightweight RAID and file systems will always have their use). signature.asc Description: OpenPGP digital signature
Re: Disenchanted with ZFS; alternatives?
Kirk Strauser wrote: At this point, I'm almost ready to go back to good ol' UFS2, but I'd hate to give up that easy addition of new filesystems. I *could* have a single 700GB root FS but that just doesn't seem right. Are there any good, tested GEOM- based ways of getting that functionality, perhaps along the lines of using something like gvirstor and growfs as needed? There's nothing as convenient as ZFS (really... anywhere) :( . I'm still hoping someone will sponsor development or porting of a widely used journalling file system like XFS, JFS, even ext3/4 to FreeBSD, but in the meantime UFS2+SU isn't that bad. Practically the only way to break it is if you have hardware errors that end up corrupting file system data. The need to run full fsck occasionally (as opposed to the softupdates-assisted one) is annoying but 700 GB should be manageable with 3-4 GB of memory. The softupdates-assisted fsck actually works very well in all but the heaviest loads (i.e. when the server is swamped by requests immediately after booting). You could also try gjournal but benchmark and test it first for your workload. gvirstor is a theoretically good option if you need its specific functionality, only be doubly sure to benchmark it for your specific workload as it has some /unusual/ performance characteristics. signature.asc Description: OpenPGP digital signature
Re: Disenchanted with ZFS; alternatives?
2008/12/2 Nathan Lay [EMAIL PROTECTED]: What about DragonFlyBSD's new HAMMER FS? I hear it has similar capabilities as ZFS without the overhead. Though, strangely, I haven't really heard anyone discuss it even though it was released some months ago. Well, that's because it doesn't :) ___ freebsd-questions@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-questions To unsubscribe, send any mail to [EMAIL PROTECTED]
Re: Disenchanted with ZFS; alternatives?
Wojciech Puchar wrote: It's already usable on DragonFly. DragonFLY itself is stable, but only supports one CPUIt probably will never be ported to FreeBSD due to API differences. time to wait and see if they will really make dragonfly faster than FreeBSD (it's their goal)... http://people.freebsd.org/~kris/scaling/dfly.html Good luck to them, they need it :) signature.asc Description: OpenPGP digital signature
Re: Disenchanted with ZFS; alternatives?
Wojciech Puchar wrote: What about DragonFlyBSD's new HAMMER FS? I hear it has similar capabilities as ZFS without the overhead. Though, strangely, I haven't really heard anyone discuss it even though it was released some months ago. it's maybe pre-pre-prerelease. it's not finished yet. I don't think HAMMER intends to implement a significant portion of ZFS's features. In particular, IIRC Matt specifically said he won't do anything about volume management (the data storage / RAID layer of ZFS) which among many other things means no ad-hoc file system creation. Also, HAMMER needs to be vacuumed periodically by design (the reason for this seems to me similar to that of pgsql) which isn't a particularly nice design. signature.asc Description: OpenPGP digital signature
Re: Best Journaling File System - ZFS/???
Wojciech Puchar wrote: what file system would you choose? What options are out there besides UFS and ZFS? What FS's are least likely to have corruption issues when there are power hits? May be UFS + gjournal. I use gjournal since FreeBSD 7.0 and it seems to work fine. is it really smart enough to not write everything twice or am i wrong? It writes everything twice :) (but every journaling system has to write something twice) signature.asc Description: OpenPGP digital signature
Re: Tool for benchmark local disk vs. iSCSI
Ewald Jenisch wrote: Hi, To gain an understanding on the performance of iSCSI vs. local disk IO I'm looking for a tool. My first thought was about iozone... iozone is ok, but a little complex to run. Any disk benchmark will be ok - bonnie++, blogbench, etc. but each has an emphasis on a different aspect of the system. I think bonnie++ will be the simplest in your case. Make sure you know what you're benchmarking - for example if the iSCSI drive (target) is hosted as a file in a regular file system, it will be overly (and dangerously) cached on the server. signature.asc Description: OpenPGP digital signature
Re: Tool for benchmark local disk vs. iSCSI
Wojciech Puchar wrote: My first thought was about iozone... iozone is ok, but a little complex to run. Any disk benchmark will be ok - bonnie++, blogbench, etc. but each has an emphasis on a different aspect of the system. I think bonnie++ will be the simplest in your case. can bonnie++ operate on raw device not filesystem? he asked about disk benchmarked not disk+filesystem Sorry, you're right. signature.asc Description: OpenPGP digital signature
Re: what script is whacking root's files
Derek Ragona wrote: This particular server is running in a VM on a vmware esx 3.5 server. The server runs fine, but every so often the dot files disappear for root. I have not found the behavior to follow a reboot, but some period of time. Hence my suspicions it was a periodic script. Are you sure the vmware server doesn't periodically (or on reboot, perhaps?) revert the disk's content to an earlier snapshot? signature.asc Description: OpenPGP digital signature
Re: Performance benchmarks pitting FreeBSD against Windows
[EMAIL PROTECTED] wrote: Hi, I don't even know if this has been done before, nor do I know for sure if it's a sound comparison. Never the less, someone posted, in response to someone else here just a few days ago, some very nice benchmarks provided by Kris ?Kenneway? I could be wrong on the last name, it just seems to me that's a last name I've seen with Kris frequently (my apologies Kris if I'm wrong). Using the URL that the other poster, posted, I poked around the other *.html files in that directory, but did not find any with FreeBSD pitted against windows. I'm just curious to see how it looks for my own sanity's sake. At work, someone got the grand idea that we should move to Windoze embedded (CE and XPe) and it's been quite discouraging I must say, though I must admit, it's nice to actually know why Windows is ugly underneath. From a programming perspective, it's just not simplistic. Anyway, I digress, I'm just curious to see how things compare to Windows on similar benchmarks to what Kris provided if its ever been done. I've done some benchmarking of Windows file system IO (NTFS) using known tools like bonnie++, blogbench and postmark under cygwin and the results are abysmal. It might be due to cygwin, and it might not. I've used Windows Enterprise Server 2003. You'll probably not find any difference in computational (numeric) tasks and fairly bad results in tasks that do a lot of system work. signature.asc Description: OpenPGP digital signature
Re: Performance benchmarks pitting FreeBSD against Windows
Chad Perrin wrote: On Fri, Dec 05, 2008 at 12:20:49PM +0100, Ivan Voras wrote: [EMAIL PROTECTED] wrote: Hi, I don't even know if this has been done before, nor do I know for sure if it's a sound comparison. Never the less, someone posted, in response to someone else here just a few days ago, some very nice benchmarks provided by Kris ?Kenneway? I could be wrong on the last name, it just seems to me that's a last name I've seen with Kris frequently (my apologies Kris if I'm wrong). Using the URL that the other poster, posted, I poked around the other *.html files in that directory, but did not find any with FreeBSD pitted against windows. I'm just curious to see how it looks for my own sanity's sake. At work, someone got the grand idea that we should move to Windoze embedded (CE and XPe) and it's been quite discouraging I must say, though I must admit, it's nice to actually know why Windows is ugly underneath. From a programming perspective, it's just not simplistic. Anyway, I digress, I'm just curious to see how things compare to Windows on similar benchmarks to what Kris provided if its ever been done. I've done some benchmarking of Windows file system IO (NTFS) using known tools like bonnie++, blogbench and postmark under cygwin and the results are abysmal. It might be due to cygwin, and it might not. I've used Windows Enterprise Server 2003. You'll probably not find any difference in computational (numeric) tasks and fairly bad results in tasks that do a lot of system work. While the usefulness of such benchmarks may be suspect, I'd still be interested in seeing your results. I have a large spreadsheet full of them, but here's a selection. The benchmark is bonnie++: Win2003 R2 NTFSRAID10-15 87 25 113 6425 11990 Ubuntu Server 7.10 ext3RAID10-15 129 60 167 36114 72562 Ubuntu Server 7.10 JFS RAID10-15 131 64 167 6638 4855 Ubuntu Server 7.10 Reiser3 RAID10-15 130 60 159 30307 35101 Ubuntu Server 7.10 XFS RAID10-15 104 62 164 39 10 FreeBSD 7 UFS+SU RAID10-15 109 43 111 36551 9 FreeBSD 7 UFS+GJ RAID10-15 50 28 103 52460 46604 FreeBSD 7 ZFS RAID10-15 95 63 180 40522 20260 The first three columns describe the system RAID (e.g. RAID10-15 means RAID10 created from 4 15 kRPM drives), the next three are write/rewrite/read speed in MB/s, the last two are random files created/deleted. I hope the mailer doesn't destroy the formatting too much. This was on IBM ServeRAID 8k, 256 M BBU cache. (ZFS RAID was not used). FreeBSD UFS generally achieved low performance but it doesn't surprise me - I'd say its disk IO has a lot of performance problems right now. ZFS was very good, but not so much when compared to Linux file systems, especially for writing. I believe XFS was broken in that version of Linux so file creation deletion was garbage - it's normal in more recent versions. File systems were left at default except noatime was turned on where available. One thing where Linux's ext3 really shines is concurrent IO - blogbench (not present in the above table) was really bad in all other OS file system combination, so after all my results (I have 1000 of them), I'm really hoping for an ext3/4 port to FreeBSD :) signature.asc Description: OpenPGP digital signature
Re: Performance benchmarks pitting FreeBSD against Windows
Wojciech Puchar wrote: Win2003 R2NTFSRAID10-158725113642511990 Ubuntu Server 7.10ext3RAID10-1512960167 3611472562 Ubuntu Server 7.10JFSRAID10-15131641676638 4855 Ubuntu Server 7.10Reiser3RAID10-1513060159 3030735101 Ubuntu Server 7.10XFSRAID10-15104621643910 FreeBSD 7UFS+SURAID10-151094311136551 9 FreeBSD 7UFS+GJRAID10-1550281035246046604 FreeBSD 7ZFSRAID10-1595631804052220260 The first three columns describe the system RAID (e.g. RAID10-15 means RAID10 created from 4 15 kRPM drives), the next three are write/rewrite/read speed in MB/s, the last two are random files created/deleted. I hope the mailer doesn't destroy the formatting too could you compare raw device speed between linux and FreeBSD No, I don't have the system now. it looks like there is driver problem - low linear speed. I don't think so. It's *very* unlikely a driver can mess up linear speed - it's far more easier to mess up random IO. I don't know why it's so (it might be cause by FreeBSD's tiny MAXPHYS), but it's probably not the driver's fault. I've seen this behaviour with other controllers (including plain SATA). ZFS was very good, but not so much when compared to Linux file systems, ZFS in your benchmart is similar to UFS. Look at the read speed. signature.asc Description: OpenPGP digital signature
Re: Backup complete gmirror/gstripe/gjournal drives, how-to?
Doug Poland wrote: Hello, I've got a 7.1-PRERELEASE i386 box with 4 SATA drives configured in a RAID-10 using gmirror, gstripe, and gjournal. Normally, I use dump and rsync for periodic backups on this machine, but I suspect that the gmirror/gstripe/gjournal information is not being backed up. If my assumption is correct, how can I perform a one-time backup such that I could do a bare-metal restore? The essence of the question being I want to preserve not only the data, but also the gmirror/gstripe/gjournal meta-data as well. The only thought that comes to mind is to boot with a 7.1 live filesystem CD-ROM and dd each drive, piping the results to my backup machine. e.g., host# dd if=/dev/ad4 bs=2m | gzip | nc backuphost 12345 host# dd if=/dev/ad6 bs=2m | gzip | nc backuphost 12346 host# dd if=/dev/ad10 bs=2m | gzip | nc backuphost 12347 host# dd if=/dev/ad12 bs=2m | gzip | nc backuphost 12348 Any thoughts, suggestions, caveats? I hope you understand the problems with this kind of backup procedures. Assuming that ad4,6,10,12 are the drives from which you created your RAID-10, everything is backed up, including GEOM metadata. signature.asc Description: OpenPGP digital signature
Re: Performance benchmarks pitting FreeBSD against Windows
Wojciech Puchar wrote: changed it to 1MB everywhere. I've found that increasing vfs.read_max increases read performance quite a bit in bonnie++ benchmarks. sysctl vfs.read_max=32 what exactly this option do? read_max 32 what? UFS blocks? MAXPHYS blocks? UFS blocks. The default is 8 == 128 kB == MAXPHYS. signature.asc Description: OpenPGP digital signature
Re: removing a php5-pcre extension
Zbigniew Szalbot wrote: Hello, Now that pcre is included in the base installation, how do I remove it? $ pkg_delete -nv php5-pcre-5.2.6_2 pkg_delete: package 'php5-pcre-5.2.6_2' is required by these other packages and may not be deinstalled: pear-1.7.2 pear-Auth-1.6.1 pear-Auth_SASL-1.0.2 pear-DB-1.7.13,1 pear-Log-1.10.1 pear-Mail_Mime-1.5.2,1 pear-Mail_mimeDecode-1.5.0 pear-Net_SMTP-1.3.0 pear-Net_Socket-1.0.8 pear-Pager-2.4.6 pecl-filter-0.11.0 php5-extensions-1.2 phpMyAdmin-3.1.0 smarty-2.6.19 pkg_delete: 1 package deletion(s) failed Am I safe just deleting it? Or do I have to rebuild all the above listed ports? Leaving it as is is probably not a good idea... Presumably, if you delete it, the listed packages will stop working. signature.asc Description: OpenPGP digital signature
Re: QEMU: increase image size with FreeBSD partitions ...
Marc G. Fournier wrote: --On Tuesday, December 09, 2008 10:15:45 +0100 Ivan Voras [EMAIL PROTECTED] wrote: Marc G. Fournier wrote: I have FreeBSD 7 running in a QEMU VM ... works like a charm, but I'm wondering if there is some way of *increasing* the size of the image beyond what I configured it for? I'm only finding stuff pertaining to NTFS/FAT32, but nothing about Unix in general, or FreeBSD specifically ... Is there any way of doing this, or do I have to build a new, larger img, and copy the data from diskA - diskB, and reboot on diskB? Doable, but time consuming ... I don't think there's anything automatic but you can grow the virtual disk, then modify the last partition size by hand, then use growfs. 'k, that is what I figured, but how do I grow the virtual disk? I've checked the qemu-img man page, and there doesn't appear to be a method of doing this ... I think I've incorrectly assumed you're using plain raw disk images - from the context I'd say that you're actually using one of qemu's own formats, right? The only thing I've found is this: http://kev.coolcavemen.com/2007/04/how-to-grow-any-qemu-system-image/ signature.asc Description: OpenPGP digital signature
Re: PostgreSQL on FreeBSD 7.0 amd64 with more than 2GB shared memory
Hell, Robert wrote: I just found a bug report for that issue: http://www.freebsd.org/cgi/query-pr.cgi?pr=121423cat= Try asking on current@ - I think there were some patches available some time ago. -Original Message- From: Wojciech Puchar [mailto:[EMAIL PROTECTED] Sent: Mittwoch, 10. Dezember 2008 18:30 To: Hell, Robert Cc: freebsd-questions@freebsd.org Subject: Re: PostgreSQL on FreeBSD 7.0 amd64 with more than 2GB shared memory fails again with ENOMEM. Is there any easy way to use a shared memory segment which is larger than 2GB? getting two smaller ? :) no idea - maybe it's bug of SHM. as you already checked it please do sent-pr ___ freebsd-questions@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-questions To unsubscribe, send any mail to [EMAIL PROTECTED] signature.asc Description: OpenPGP digital signature
Re: FreeBSD amd64 crash - why?
Wojciech Puchar wrote:
(kgdb) bt\
#0 doadump () at pcpu.h:195
#1 0x0004 in ?? ()
#2 0x8029cde9 in boot (howto=260) at
../../../kern/kern_shutdown.c:418
#3 0x8029d202 in panic (fmt=0x104 Address 0x104 out of bounds)
at ../../../kern/kern_shutdown.c:574
#4 0x804da163 in trap_fatal (frame=0xff0001ae06e0,
eva=Variable eva is not available.
)
at ../../../amd64/amd64/trap.c:764
#5 0x804da535 in trap_pfault (frame=0xa53818f0,
usermode=0)
at ../../../amd64/amd64/trap.c:680
#6 0x804dae85 in trap (frame=0xa53818f0) at
../../../amd64/amd64/trap.c:449
#7 0x804c083e in calltrap () at
../../../amd64/amd64/exception.S:209
#8 0xa5381b00 in ?? ()
#9 0xff0001ae06e0 in ?? ()
#10 0x804cb596 in ipi_bitmap_handler (frame=
{tf_rdi = -2140742176, tf_rsi = -1523049488, tf_rdx = 4104, tf_rcx
= 715684, tf_r8 = -1098907750400, tf_r9 = -2140669600, tf_rax = 7840359,
tf_rbx = -2140742176, tf_rbp = -2140614400, tf_r10 = 4640, tf_r11 = 116,
tf_r12 = 5153376776576, tf_r13 = -1523049728, tf_r14 = 71567949, tf_r15
= 2, tf_trapno = -1523049712, tf_addr = -1099483445536, tf_flags =
-1099212052096, tf_err = 0, tf_rip = -2145744350, tf_cs = 8, tf_rflags =
582, tf_rsp = -1523049824, tf_ss = 16})
at ../../../amd64/amd64/mp_machdep.c:979
#11 0x804c1236 in Xipi_intr_bitmap_handler () at apic_vector.S:206
#12 0x801a8a22 in acpi_timer_read () at cpufunc.h:239
#13 0x801a8a47 in acpi_timer_get_timecount_safe (tc=Variable
tc is not available.
) at ../../../dev/acpica/acpi_timer.c:244
#14 0x802a81aa in binuptime (bt=0xa5381b00) at
../../../kern/kern_tc.c:167
#15 0x802a8230 in bintime (bt=0xa5381b00) at
../../../kern/kern_tc.c:217
#16 0x802a82b7 in microtime (tvp=0xa5381b20) at
../../../kern/kern_tc.c:237
#17 0x802adb17 in gettimeofday (td=Variable td is not available.
) at ../../../kern/kern_time.c:430
#18 0x804da754 in syscall (frame=0xa5381c80) at
../../../amd64/amd64/trap.c:907
#19 0x804c0a4b in Xfast_syscall () at
../../../amd64/amd64/exception.S:330
#20 0x000800d96bdc in ?? ()
Previous frame inner to this frame (corrupt stack?)
(kgdb) [EMAIL PROTECTED] ~]# exit
The code path in this backtrace is very low-risk, there are not many
things that can go wrong in a gettimeofday() call. It's very likely it's
a hardware problem (tried memtest86 recently?), but you should post it
to current@ to verify. You might want to switch to TSC timecounter if
it's available on your hardware (see kern.timecounter.smp_tsc) to avoid
the acpi_timer* code path and see if the system still panics.
___
freebsd-questions@freebsd.org mailing list
http://lists.freebsd.org/mailman/listinfo/freebsd-questions
To unsubscribe, send any mail to [EMAIL PROTECTED]
Re: Centralized DB of system users
Ivan Voras wrote: Manolis Kiagias wrote: don't have local users but they query the DB to get login credentials and such. I don't really know what to look for. So any suggestion and hints to how can i achieve this are welcomed. thank you and a great day, v What you are looking for is called NIS: http://www.freebsd.org/doc/en_US.ISO8859-1/books/handbook/network-nis.html However note it is not (unfortunately) interoperable between FreeBSD and Linux, although there is a setting (UNSECURE=true in /var/yp/Makefile of the NIS server) that works around this, albeit it lowers security. There are other solutions too (LDAP?) but NIS would be the easiest to setup. I agree - NIS is easiest to setup, but LDAP is the right solution in this case (though it's very complicated to set up, especially the first time). One alternative to those is samba - there is pam_smb in the ports, but there's no nss_smb but that's somewhat weird to use in a unix-like environment :) I just found about http://pam-mysql.sourceforge.net/ In ports as security/pam-mysql and the NSS in net/libnss-mysql . I didn't try it. signature.asc Description: OpenPGP digital signature
Re: Centralized DB of system users
Manolis Kiagias wrote: don't have local users but they query the DB to get login credentials and such. I don't really know what to look for. So any suggestion and hints to how can i achieve this are welcomed. thank you and a great day, v What you are looking for is called NIS: http://www.freebsd.org/doc/en_US.ISO8859-1/books/handbook/network-nis.html However note it is not (unfortunately) interoperable between FreeBSD and Linux, although there is a setting (UNSECURE=true in /var/yp/Makefile of the NIS server) that works around this, albeit it lowers security. There are other solutions too (LDAP?) but NIS would be the easiest to setup. I agree - NIS is easiest to setup, but LDAP is the right solution in this case (though it's very complicated to set up, especially the first time). One alternative to those is samba - there is pam_smb in the ports, but there's no nss_smb but that's somewhat weird to use in a unix-like environment :) signature.asc Description: OpenPGP digital signature
Re: Centralized DB of system users
2008/12/12 Wojciech Puchar woj...@wojtek.tensor.gdynia.pl: I agree - NIS is easiest to setup, but LDAP is the right solution in this case (though it's very complicated to set up, especially the first why it is right solution? Interoperability. Today, with Linux, tomorrow, Windows or Mac OS X. Besides, it scales well and has a large number of supporting utilities. ___ freebsd-questions@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-questions To unsubscribe, send any mail to freebsd-questions-unsubscr...@freebsd.org
Re: Centralized DB of system users
Valentin Bud wrote: On Fri, Dec 12, 2008 at 3:12 PM, Wojciech Puchar woj...@wojtek.tensor.gdynia.pl wrote: this case (though it's very complicated to set up, especially the first why it is right solution? Interoperability. Today, with Linux, tomorrow, Windows or Mac OS X. so not right but interoperable. if i do have only unix systems in LAN, NIS is much better easier and faster. If you only have UNIX systems in LAN. But in my case i have Linux + FreeBSD (server). From the handbook NIS only works between FBSDs. Am i missing something? You are correct. signature.asc Description: OpenPGP digital signature
Re: Centralized DB of system users
Julien Cigar wrote: On Fri, 2008-12-12 at 13:26 +0100, Ivan Voras wrote: 2008/12/12 Wojciech Puchar woj...@wojtek.tensor.gdynia.pl: I agree - NIS is easiest to setup, but LDAP is the right solution in this case (though it's very complicated to set up, especially the first why it is right solution? Interoperability. Today, with Linux, tomorrow, Windows or Mac OS X. Besides, it scales well and has a large number of supporting utilities. Off-topic, but do you know any good tool other than gq/phpldapadmin to manage/browse/... an LDAP server ? At the moment I've my own set of LDIF files that I use with ldap[add|delete|modify], but it's not very flexible .. A ncurses tool would be perfect. I'm using http://www.jxplorer.org/ with great success and productivity. signature.asc Description: OpenPGP digital signature
Re: geom lvm class - glvm
Franck Royer wrote: Hi, I found this entry on the official website : http://www.freebsd.org/news/status/r...0-2007-12.html http://www.freebsd.org/news/status/report-2007-10-2007-12.html But I didn't find any other information about the geom lvm class or glvm. How can i activate it in the kernel ? Is here any tools about it ? It's still here, it's just been renamed to geom_linux_lvm to avoid confusion with possible future native LVM. signature.asc Description: OpenPGP digital signature
Re: geom lvm class - glvm
2008/12/20 Franck Royer royer.fra...@gmail.com: Apparently, the option is only available on freebsd-8.0. /boot/kernel/geom_linux_lvm.ko is present in 7-STABLE. I will check If I can compile a Freebsd-8.0 kernel on a freebsd-7.0 just for getting the files from my lvm and then going back on a stable kernel. ___ freebsd-questions@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-questions To unsubscribe, send any mail to freebsd-questions-unsubscr...@freebsd.org
Re: geom lvm class - glvm
2008/12/21 Franck Royer royer.fra...@gmail.com: Ivan Voras a écrit : 2008/12/20 Franck Royer royer.fra...@gmail.com: Apparently, the option is only available on freebsd-8.0. /boot/kernel/geom_linux_lvm.ko is present in 7-STABLE. Sorry, but it's not the case on my freebsd. my uname -a : FreeBSD methrilla-test.home 7.0-RELEASE FreeBSD 7.0-RELEASE #0: Fri Dec 12 21:54:37 GMT 2008 r...@methrilla-test.home:/usr/obj/usr/src/sys/ZFS i386 How did you do that ? Probably by using 7-STABLE, not 7.0-RELEASE :) ___ freebsd-questions@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-questions To unsubscribe, send any mail to freebsd-questions-unsubscr...@freebsd.org
Re: Status of hyperthreading in FreeBSD
Brett Glass wrote: Which raises a question: What's the status of FreeBSD's support for hyperthreading? As far as I know, after it was revealed that some processes on a machine with hyperthreading could spy on others, and Yes, but that is a hardware problem which is independent of the operating system (it's present in all of them). also that hyperthreading didn't always improve performance on high end processors, the feature was turned off by default. But on single-user Yes, especially on the early Pentium 4 CPUs. This is also OS-independent. machines, or on servers where the CPU was likely to be shared by two processes that were both privileged anyway, it might make sense to re-enable it. But has this feature of the scheduler been maintained well enough for this to be a good idea? If not, would it worth looking into updating it so that FreeBSD runs well on the Atom? It's as good as it can be on recent ULE2 scheduler. ULE2 has support for HTT but there's not much that can be done at the scheduler level as the Atom is single-socket, single-core CPU. Atom's HTT is actually pretty good - I saw up to 25% more performance simply by using multithreading in 7zip's compression benchmark (on WinXP, though). Of course, OTOH it uses about that much more transistors on the CPU die so it's not exactly free performance. signature.asc Description: OpenPGP digital signature
Re: Status of hyperthreading in FreeBSD
Sam Fourman Jr. wrote: as far as i know, just enabling smp will allow ht to function. also, i don't know if intel changed ht in the new atom processor, they could have. is FreeBSD's smp special in some way that it would be the exception to the following statement. I know there was a lot of changes made in the new ULE2 scheduler maybe that is why? /* Hyper-threading relies on support in the operating system as well as the CPU. Conventional multiprocessor support is not enough to take advantage of hyper-threading.[1] For example, even though Windows 2000 supports multiple CPUs, Intel does not recommend that hyper-threading be enabled under that operating system. */ I found this in wikipedia at the following link http://en.wikipedia.org/wiki/Hyper-threading Yes, system respond variously to hyperthreading but it's mostly in two areas: a) Granularity of locking - systems with big locks like FreeBSD's Giant was when HTT was new don't scale well in multi-CPU configurations (logical CPUs) and simply using HTT can expose and increase these inefficiencies. Modern FreeBSD locking is good enough for 8 cores in 7.x and it's improving in 8.x. b) Behaviour in multi-core (or multi-CPU) case when individual CPUs or cores support HTT. This is a scheduler issue - if the scheduler isn't aware that some logical CPU's are fake and some are not (i.e. if it treats all of them equally) it could move processes or threads from one CPU or CPU core to another when it would be much better to move it from one fake (hyperthreaded) CPU to another within the same real CPU. There are more similar issues here, but none of them (including those I described) are applicable to Atom since a) locking in FreeBSD is good enough for it in recent releases (even in 6.x) and b) there are only two fake logical CPUs and they really can be treated equally. Now, with Nehalem design (i7) the system can have a quad-core CPU (actually, several of those) with each core supporting hyperthreading. A system with 16 logical CPUs (2 x quadcore x HTT) isn't really strange any more. The scheduler knows about HTT, so the issues under a) are much more noticable. signature.asc Description: OpenPGP digital signature
Re: Status of hyperthreading in FreeBSD
Wojciech Puchar wrote: Atom's HTT is actually pretty good - I saw up to 25% more performance simply by using multithreading in 7zip's compression benchmark (on WinXP, though). Of course, OTOH it uses about that much more transistors on the CPU die so it's not exactly free performance. really that much? i thought maybe 1-2% (just 2 sets of registers). Screenshots are available :) I was also surprised because in this case both threads use the same algorithm with the same requirements on registers. It used to be (in the days of Pentium 4) that HTT would work best if the two threads used different sets of instructions and registers (e.g. one doing integer math and another doing floating point math). I guess they made more effort this time. signature.asc Description: OpenPGP digital signature
Re: exFAT File System Format
Mario Lobo wrote: Hi guys; News: http://bhandler.spaces.live.com/Blog/cns!70F64BC910C9F7F3!5216.entry?w a=wsignin1.0sa=911422520 Any chance of this being supported on FBSD so we can dump ntfs for good? Feel free to fund a developer to implement it :) (i.e. no) signature.asc Description: OpenPGP digital signature
Re: Strange messages in /var/log/messages
Martin Schweizer wrote: Since I have the above options I get the following messages in my /var/log/messages: [snip] Jan 30 17:54:45 firewall kernel: c Jan 30 17:54:46 firewall kernel: 0 Jan 30 17:54:57 firewall kernel: w Nothing serious - two (or more) CPUs were writing things to the log at the same time. signature.asc Description: OpenPGP digital signature
Re: [6.3] ALT-CTRL-DEL = clean unmount?
Gilles wrote: Hello I was wondering: When hitting the ALT-CTRL-DEL combination as an easy way to call reboot, does this unmount disks properly? Yes. I'm concerned because I did this recently, and here's what dmesg says: ad0: DMA limited to UDMA33, controller found non-ATA66 cable ad0: 19092MB Seagate ST320413A 3.39 at ata0-master UDMA33 acd0: CDROM ASUS CD-S400/A/V2.3H at ata1-master UDMA33 Trying to mount root from ufs:/dev/ad0s1a WARNING: / was not properly dismounted WARNING: /tmp was not properly dismounted WARNING: /usr was not properly dismounted WARNING: /var was not properly dismounted The OS reboot process might have been interrupted somehow, or your drive might be caching more than it should be. signature.asc Description: OpenPGP digital signature
Re: apt of freebsd
Alexander Wolf wrote: Ivan Voras пишет: It's probably used for the Linux emulation in FreeBSD, you can't use it with FreeBSD native packages. Hmm... I'm maybe can use it for web-applications? Or not? You cannot use it for FreeBSD packages at all. signature.asc Description: OpenPGP digital signature
Re: apt of freebsd
Alexander Wolf wrote: I'm find into /usr/ports/sysutils/apt porting from Debian APT. How to using this on FreeBSD? It's probably used for the Linux emulation in FreeBSD, you can't use it with FreeBSD native packages. signature.asc Description: OpenPGP digital signature
Re: apt of freebsd
prad wrote: On Mon, 02 Feb 2009 11:23:50 +0100 Ivan Voras ivo...@freebsd.org wrote: It's probably used for the Linux emulation in FreeBSD, you can't use it with FreeBSD native packages. so what does this mean? if you have linux emulation, you can install .debs from the debian repository? Yes. Though the preferred linux_base is Fedora nowadays. signature.asc Description: OpenPGP digital signature
Re: is there any way to increase disk performance ?
Yavuz wrote: Ok. I increased vfs.read_max while I was looking into this case in google, I see a value of MAXPHYS in my kernel, there is a value called MAXPHYS=(128*1024) as default. What should I set this value ? Neither vfs.read_max nor MAXPHYS will help a mail server (or any other server dealing with small files). signature.asc Description: OpenPGP digital signature
Re: mysqld out of memory
Valentin Bud wrote: I noticed that it is already at 1GB. Now my problem is how can i avoid this in the future because on that production server mysql is crucial or in case it happens how ca I be the first to know of that problem? If you examine the mysql-server script in /usr/local/etc/rc.d you'll see it supports the mysql_limits option for rc.conf. Set mysql_limits=YES to /etc/rc.conf and the server start with removed limits. You can increase maxdsiz (which is different than limits) by adding a line to loader.conf, something like: kern.maxdsiz=2GB kern.dfldsiz=2GB Note that you can't increase it to more than 3 GB on i386. Another thing is that mysql shouldn't take infinite amounts of memory to work. You need to configure entries in my.cnf to match your limits and maxdsiz (in steady state + estimated spikes). signature.asc Description: OpenPGP digital signature
Re: [6.3/MySQL Server 5.1] item_cmpfunc.h:1301: internal compiler error
Gilles wrote: Hello I updated the Ports collection on this 6.3 host, but it fails compiling MySQL Server 5.1: === In file included from item.h:2428, from mysql_priv.h:749, from sql_profile.cc:32: item_cmpfunc.h:1301: internal compiler error: Illegal instruction: 4 Please submit a full bug report, with preprocessed source if appropriate. === Has someone seen this, and knows a work-around? If you have any CFLAGS set (the most common are those for CPU optimizations), disable them and try again. signature.asc Description: OpenPGP digital signature
Re: [6.3/MySQL Server 5.1] item_cmpfunc.h:1301: internal compiler error
Gilles wrote: On Tue, 17 Feb 2009 09:53:09 +0100, Gilles gilles.gana...@free.fr wrote: BTW, here are the CFLAGS-related lines MySQL Server's Makefile: Using make BUILD_OPTIMIZED=no doesn't solve the issue :-/ In file included from item.h:2199, from mysql_priv.h:589, from ha_berkeley.cc:53: item_geofunc.h:78: internal compiler error: Illegal instruction: 4 Ok, there are two more possibilities: a) Your hardware has problems (try http://www.memtest86.com/) b) Your compiler was itself compiled with invalid optimizations. This is only possible if you or someone else compiled the system for you, not if you simply installed it from released ISO images. signature.asc Description: OpenPGP digital signature
Re: Install 7.1 DVD iso UNetbootin Eee Box
loony wrote: Has anyone had any luck with UNetbootin and the 7.1 DVD iso? I'm trying to prep USB media on windows vista64. Unlike the CDROM based isos, the DVD install is compressed .gz. I assume the iso needs to be extracted prior to loading it with UNetbootin and wonder if somehow gzip.exe on Windows is messing with the sanctity (for lack of better technical term) of the iso files. When I boot from a 8gb usb device I've prepped with 7.1 DVD using UNetbootin, I get a missing or corrupted kernel image. No problems with using the latest BackTrack iso. I'm putting together a resource for running FreeBSD on the Asus Eee box at http://groups.google.com/group/freebsd-eee-box?hl=en and would really appreciate assistance with creating a USB boot media (preferably on Windows but a FBSD 7.0 box is available as well) based on the DVD as the DVD is a lot more convenient than a CDROM install. Is it possible to edit the syslinux file installed by UNetbootin to point to a generic kernel in the kernels directory? It looks like UNetbootIn is broken for FreeBSD ISO images (it doesn't do the right thing when presented a FreeBSD ISO). See http://ivoras.sharanet.org/blog/tree/2009-02-07.installing-freebsd-on-acer-aspire-one-netbook.html for a workaround. signature.asc Description: OpenPGP digital signature
Re: memory limitations per process
af300...@gmail.com wrote: Hi, I'm running into a per process memory limit at work (on Windoze though), but I'm wondering what's the limit per process in FreeBSD for 32 bit systems, ie i386? Is it 4gb or 2? From stuff I found on the Net, I'm guessing 4gb, but wanted to ask anyway. It seems to be an implementation deal limiting the windows world to 2gb per process rather than hardware limitations. Your question is vague. A 32-bit process can only access 4 GB of memory, but all processes also have a bit of memory reserved for the kernel. On FreeBSD the accessible memory for processes is closer to 3 GB than 2 or 4. See this discussion for details: http://wiki.freebsd.org/KVA_PAGES Also, FreeBSD processes have administrative limits to their size set by defaults. See for example this: http://unix.derkeiler.com/Mailing-Lists/FreeBSD/questions/2008-11/msg01363.html . If you want to use the whole 3 GB for a process, you'll have to increase maxdsiz. Note that you may need to experiment with this size since your BIOS will probably not let you use 4 GB of physical memory for the OS except if you enable PAE, and it's possible to create an unbootable system by messing with kernel memory limits. You should probably experiment on the loader command line first, not in the loader.conf file. signature.asc Description: OpenPGP digital signature
Re: SAS drives seem slow
Josh Paetzel wrote: I have a 3ware 9690SA SAS RAID controller in a PCI-e 8x slot with Fujitsu MBA series 15k SAS drives attached, and the array is coming up as: da0 at twa0 bus 0 target 0 lun 0 da0: AMCC 9690SA-4I DISK 4.06 Fixed Direct Access SCSI-5 device da0: 100.000MB/s transfers da0: 138272MB (283181056 512 byte sectors: 255H 63S/T 17627C) If you don't get any answer here, try the freebsd-scsi@ mailing list. signature.asc Description: OpenPGP digital signature
Re: FreeBSD and Xen in paravirtualized mode
Redd Vinylene wrote: Why doesn't FreeBSD support Xen in paravirtualized mode? Imagine the increase in ISPs being able to offer FreeBSD to its customers. I just got my heart broken today: http://forum.slicehost.com/comments.php?DiscussionID=3191/ Perhaps you could help fund the development of FreeBSD support for Xen? AFAIK lack of funding is what's keeping the development slow, though it does go on: http://wiki.freebsd.org/FreeBSD/Xen signature.asc Description: OpenPGP digital signature
Re: load average and some built-in monitoring mechanism
Zbigniew Szalbot wrote: Hi there, My machine has recently been taken down by (most likely) runaway java process. The box had to be rebooted as there was no remote access to it but I am not able to find anything useful in logs to confirm whether it was java. Is there a tool that would enable me to automatically turn on verbose logging of top processes to some file once the load average is greater than the specified value? This way, once the storm is over, I would be able to see which process(es) went nuts. I guess a tool like that may simply already exist in which case I'd appreciate links/more information. How are you dealing with such issues when/if they happen to you? I don't think something like that already exists in base. You can use top -d1 to get a snapshot from top and a small shell script (or a script in your chosen language) to test if the load average (you can get it from sysctl vm.loadavg) gets unreasonable. signature.asc Description: OpenPGP digital signature
Re: Anyone runs 7.1 with an IBM X3650 (64 bits ARCH) ?
Frank Bonnet wrote: Hello Everything is in the subject :-) I'm not running it now but I've tested it - worked fine. signature.asc Description: OpenPGP digital signature
Re: Replace console login prompt
Matias Surdi wrote: Hi, Please, could somebody give me a pointer to some documentation or an idea of how to replace the default console login prompt with a custom script? man 5 ttys signature.asc Description: OpenPGP digital signature
Re: umass performance
Andrea Venturoli wrote: Hello. I'm using dd to clone an 8GB USB memory into an identical one. # dd if=/dev/da2 of=/dev/da1 load: 0.01 cmd: dd 12026 [physwr] 0.00u 0.01s 0% 904k 396+0 records in 395+0 records out 202240 bytes transferred in 1.453741 secs (139117 bytes/sec) 15925248+0 records in 15925248+0 records out 8153726976 bytes transferred in 31722.194052 secs (257035 bytes/sec) By using this command line not only are you getting slow results, you are also probably significantly reducing the lifetime of you flash memory drive (depending on its technology). What you said in the above command line is that the copy is to be done one 512-byte block at a time - i.e. read 512 bytes, write 512 bytes, repeat. As common flash memories have large flash blocks (32 kB - 128 kB), you're actually rewriting the whole large flash block by writing small blocks of data. For example, to fill a 32 kB block by writing 512 bytes at a time, the whole block will be rewritten 64 times. Use a bs=1m argument next time. signature.asc Description: OpenPGP digital signature
Re: Compression with *.zip output
Polytropon wrote: On Sat, 21 Mar 2009 12:27:20 +0200, Manolis Kiagias sonic200...@gmail.com wrote: Wildly off-topic as we are discussing Windows, but all recent versions (XP, Vista, etc) can handle zip files. They call them compressed folders (don't confuse with NTFS compression though) and even have a silly wizard-like interface for extracting files from them. If you don't like it you can always install WinZip to take over this function. I've seen WinZip and my stomache reported to me. :-) Much better is the FAR Manager which handles zip archives (and many others) just like directories, like the Midnight Commander does. It's typical for MICROS~1 to make things more complicated than they need to be, and invent new names for already known stuff. The next time someone mentions compressed folders I will know what he's talking about, and show him some (real) folders I have compressed to 10cm x 10cm x 10cm handy sized cubes. :-) More off-topicness: The compressed folders thingy is called like that because it's implemented as a very stupid rudimentary kind of a userland file system. Some tools - mostly Microsoft ones - really treat them like folders ... almost. The almost qualifier is because while they really sometimes appear like folders, they are not normal folders in that you cannot do almost any operations on the files in there except copy-to and copy-from, and that includes file content / icons preview. The most stupid part is that the support is built-in in the shell, not OS-wide, so applications that do (to translate to POSIX) readdir() instead of calling the shell to do it for them, treat them as files. Mostly this behaviour is annoying, if only because the built-in search tool (which works like find) does know about the special folders and, if you're searching something from the shell in a folder that has actual ZIP files, it will search *within* those zip files, which is extremely slow. A good, free (as in speech) Windows archiving utility for multiple archive formats (including zip, gzip and bzip2) is 7-zip: http://www.7-zip.org/ , which also has a POSIX variant that supports its own file format: http://p7zip.sourceforge.net/ . signature.asc Description: OpenPGP digital signature
Re: Recovering a GEOM RAID0 array
Juan Miscaro wrote: Hi gang, I'm running a remote 6.2 system which recently got shut down unexpectedly (tower was physically nudged and apparently lost power). I am running a 2-disk striped array with the geom_stripe.ko module. So my fstab line is /dev/stripe/st0a/data ufs rw,acls 2 2 Thing is, the /dev/stripe directory no longer exists. The system was running for well over 2 years with several reboots in there. I have a lot of data that I want to recover on these 2 disks. Is there any way to regain access to the data? I can' t seem to find anything unusual in the logs. You need to see if the drives that have made the array still exist and are accessible. See if they are recognized in dmesg - maybe a cable was knocked out from one of them. signature.asc Description: OpenPGP digital signature
Re: Recovering a GEOM RAID0 array
Juan Miscaro wrote: This is the end of dmesg (the drives in question are ad1 and ad3): GEOM_STRIPE: Device st0 created (id=3091204740). GEOM_STRIPE: Disk ad1 attached to st0. GEOM_STRIPE: Disk ad1 removed from st0. GEOM_STRIPE: Device st0 destroyed. GEOM_STRIPE: Device st0 created (id=3091204740). GEOM_STRIPE: Disk ad1 attached to st0. Firstly, as you can see ad3 is never added. This can mean several things, of which the most probable is that its metadata has been destroyed. The messages after the second message is probably due to you opening the drives manually, bypassing gstripe, probably with the following commands. # bsdlabel ad1 # /dev/ad1: 8 partitions: #size offsetfstype [fsize bsize bps/cpg] a: 1250280640 164.2BSD 2048 16384 28552 c: 12502806560unused0 0 # raw part, don't edit partition a: partition extends past end of unit partition c: partition extends past end of unit bsdlabel: partition c doesn't cover the whole unit! bsdlabel: An incorrect partition c may cause problems for standard system utilities # bsdlabel ad3 # /dev/ad3: 8 partitions: #size offsetfstype [fsize bsize bps/cpg] a: 625142432 164.2BSD 2048 16384 28552 c: 6251424480unused0 0 # raw part, don't edit These drives should appear to be identical. This is the wrong way to inspect your drives. If you did anything to the drives individually (i.e. bypassing gstripe) it's very likely you corrupted some data. I don't know if this is obvious to you so I'm saying it just in case. Inspect your drives with diskinfo -v to get information such as its size. What does gstripe list say? What does sysctl -b kern.geom.confxml say? If gstripe list doesn't mention ad3, you need to establish what happened to metadata on ad3. Try extracting the last sector from ad3 by hand (using dd) into a file and inspect it (send output of hd filename). signature.asc Description: OpenPGP digital signature
Re: Recovering a GEOM RAID0 array
Ivan Voras wrote: If gstripe list doesn't mention ad3, you need to establish what happened to metadata on ad3. Try extracting the last sector from ad3 by hand (using dd) into a file and inspect it (send output of hd filename). I just noticed there could be an easier way to do it: use gstripe dump ad3 - it will write out its metadata. Use the manual (dd) approach if this doesn't work. signature.asc Description: OpenPGP digital signature
Re: Recovering a GEOM RAID0 array
Juan Miscaro wrote: What does gstripe list say? What does sysctl -b kern.geom.confxml say? 'gstripe list' does not return any output at all. Output to the sysctl command is attached. gstripe list cannot output nothing, since the sysctl output you posted says a partial GEOM_STRIPE instance is present on the system. This is bad: geom id=0xc3065300 class ref=0xc0978f60/ namead3c/name rank3/rank consumer id=0xc30698c0 geom ref=0xc3065300/ provider ref=0xc2e6fd80/ moder0w0e0/mode /consumer /geom geom id=0xc3032a00 class ref=0xc0978f60/ namead3a/name rank3/rank consumer id=0xc2fde5c0 geom ref=0xc3032a00/ provider ref=0xc2e6fc80/ moder0w0e0/mode /consumer /geom geom id=0xc3032d00 class ref=0xc0978f60/ namead3s1/name rank3/rank consumer id=0xc2fdea00 geom ref=0xc3032d00/ provider ref=0xc2e6fa00/ moder0w0e0/mode /consumer /geom It looks like you created a both a fdisk partition table and a bsdlabel partition table on the ad3 drive. If so, your data is probably already corrupted. ad1 is also strangely partitioned but since it's your first drive in a stripe this can be acceptable (it will contain the first sectors of the array, including its partition tables). # gstripe dump ad3 Can't read metadata from ad3: Invalid argument. Not fully done. This can happen if the metadata on ad3 is corrupted. You'll need to dump the last sector and inspect it to verify. signature.asc Description: OpenPGP digital signature
Re: Recovering a GEOM RAID0 array
Juan Miscaro wrote: It looks like you created a both a fdisk partition table and a bsdlabel partition table on the ad3 drive. If so, your data is probably already corrupted. What is a generic configuration? Or can you explain how you come to that conclusion? RAID 0 means striping data across N drives (2 in your case), with a fixed stripe size. From the information in kern.geom.confxml (which is why gstripe list should work), your stripe size is 4 kB, which is good for this purpose. This kind of setup is usually done with raw drives, i.e. with GEOM_STRIPE: gstripe label st0 ad1 ad3. After this, your array is called stripe/st0 - this is where you create the file system, etc. Striping means that each drive contains only a part of the data. E.g. if you write 8 kB to the start of your array, the first 4 kB will be written to ad1, the next 4 kB to ad3. Both smaller and larger requests are handled logically. This means that the first sector on ad1 contains the partition table of your array, if you partitioned it (and it looks like you did). The first sector of ad3 contains whatever data is at position 4096 in your array - probably nothing important because your partitions start at 32 kB - 512. If you wrote only the partition table to ad3 then it's not a big deal - it's useless but it may not corrupt anything important. If you proceeded to to something else on ad3, then there could be problems. ad1 is also strangely partitioned but since it's your first drive in a stripe this can be acceptable (it will contain the first sectors of the array, including its partition tables). # gstripe dump ad3 Can't read metadata from ad3: Invalid argument. Not fully done. This can happen if the metadata on ad3 is corrupted. You'll need to dump the last sector and inspect it to verify. I've never done that before. Can you be explicit? Using information from your previous posts, you should do this: # dd if=/dev/ad3 of=ad3last count=1 skip=625142447 # hd ad3last signature.asc Description: OpenPGP digital signature
Re: Recovering a GEOM RAID0 array
Juan Miscaro wrote: # dd if=/dev/ad3 of=ad3last count=1 skip=625142447 # hd ad3last Thanks for that great explanation. The file ad3last.txt is attached. ... 24 47 41 46 52 10 41 08 00 00 00 00 00 00 00 00 |$GAFR.A.| 0010 00 00 00 00 00 00 00 00 00 00 6f e2 42 25 00 00 |..o¿B%..| ... If this is the last sector of ad3, it certainly doesn't contain GEOM_STRIPE metadata, for whatever reasons. If this is really the right drive, you might try creating a temporary stripe array (with gstripe create instead of gstripe label of these two drives) and try running dumpfs on the array (or specifically partitions with UFS file systems on the array). If it finds the file system(s), run fsck on them. If it also passes, then delete this array and create it again with gstripe label to make it permanent. If dumpfs and/or fsck fail, you have at this point no way to reclaim your data. signature.asc Description: OpenPGP digital signature
Re: I would like to know about tracing system call in FreeBSD.
hjun...@illinois.edu wrote: Dear, I have tried to trace system call using C language. I would like to detect privilege escalation through traceing system call. Although freebsd announce the patch of telnet demon to remove malicious access to esaclate privilege, I would like to implement the detecting program. My idea is if I detect the change of uid of process then I can recongnize the privilege escalation. Maybe the audit(4) framework will be useful to you. signature.asc Description: OpenPGP digital signature
Re: Migration to 7.1 ?
Frank Bonnet wrote: Hello I'm planning to migrate our mailhub (IBM X3650) to FreeBSD 7.1 from Debian etch ;-) , of course I'll restart from scratch. I have two questions before doing so. Does 7.1 has reached a stability that it could be used for a high load production server ? Generally, yes. Does the LAGG driver works well with broadcomm giga ethernet chips ? ( I plan to use LACP to a Cisco switch ) Try asking at freebsd-net@ signature.asc Description: OpenPGP digital signature
Re: Automounting of USB drives - Why is it a problem?
Odhiambo Washington wrote: Hello List, For some time now, I have been baffled by one thing: Mac OS X somehow has FreeBSD under the hood. When you connect a USB stick (flash disk, external drive) to a Mac, it gets automounted, yet the same does not happen on FreeBSD. I have seen several questions being asked on this list about this feature, but the answer is neither here nor there. There is even a port (sysutils/automounter) that I believe is supposed to help towards this, but again it's not as easy as it seems to be. Now my question is just one: Why should it be this difficult for FreeBSD to have the automount feature within the base system? If OS X is doing it, Linux is doing it, FreeBSD can do it. Of course. Find someone and pay him to do it, just like OS X and Linux did :) (or look at http://www.freebsd.org/cgi/man.cgi?devd.conf and http://www.freebsd.org/cgi/man.cgi?amd ) signature.asc Description: OpenPGP digital signature
Re: hard drive performance
Alexander Best wrote: hi there, i have 2 hard drives running. the first one is SATA300 and the other one UDMA100. here are the dmesg entries: ad0: 238474MB SAMSUNG SP2504C VT100-50 at ata0-master SATA300 ad1: 157066MB Hitachi HDS722516VLAT80 V34OA63A at ata4-master UDMA100 i've tried to test the drives' performances using the following commands: dd if=/dev/ad0 of=/dev/null bs=1m count=300 and dd if=/dev/ad1 of=/dev/null bs=1m count=300 the results are: ad0 = 314572800 bytes transferred in 4.325645 secs (72722751 bytes/sec) ad1 = 314572800 bytes transferred in 5.166126 secs (60891430 bytes/sec) the results for ad0 are a bit disappointing though. is this normal or is bs=1m wrong? 70+ MB/s is a perfectly fine speed for a modern drive. The 300 in SATA300 doesn't mean what you probably think it means. signature.asc Description: OpenPGP digital signature
Re: Corrupt libraries
Ruel Luchavez wrote: Hi List.. Is there any way how to determine a corrupt libraries in Freebsd 7.0? or is there any command how to check libraries? It depends on what do you need it for. Out of the box, there is no way to check if the libraries have been changed / corrupted from the time of the install because there are many valid modes of installation for new libraries. You can use the built-in md5 or mtree commands to make a record of some state of files and later compare the record with the new state, or you can install one of many ports that do something like that more-or-less automatically (e.g. security/tripwire). signature.asc Description: OpenPGP digital signature
Re: Automounting of USB drives - Why is it a problem?
Manolis Kiagias wrote: Odhiambo Washington wrote: Hello List, For some time now, I have been baffled by one thing: Mac OS X somehow has FreeBSD under the hood. When you connect a USB stick (flash disk, external drive) to a Mac, it gets automounted, yet the same does not happen on FreeBSD. I have seen several questions being asked on this list about this feature, but the answer is neither here nor there. There is even a port (sysutils/automounter) that I believe is supposed to help towards this, but again it's not as easy as it seems to be. Now my question is just one: Why should it be this difficult for FreeBSD to have the automount feature within the base system? If OS X is doing it, Linux is doing it, FreeBSD can do it. FreeBSD *can* automount. The problem for the time being is pulling a USB flash drive without unmounting. This works better in 7-STABLE. signature.asc Description: OpenPGP digital signature
Re: NFS slow
Jan Catrysse wrote: Hello all, I am having some problems with NFS and slow performance. This is the scenario: 2x FreeBSD 7.1. (Raid storage server, MP, the works) GB Lan interface between them. When I transfer 1 big file the speed is never higher than 10MB/s with a peak to 14MB/s. When I transfer multiple files at the same time speed is about 10MB/s per thread. Disk speed 100MB/s Network speed using samba 60MB/s (limited by clients disk speed) Tried enabling NFSlockd, NFSstatd but that changes nothing. Any help or hunch would be greatly appreciated. Here are some ideas for testing: * Any firewall in between them? Do you have network errors? * Any other network problems, like DNS lookup failures? (not that it should matter for sustained tranfers but still...) * Are you using TCP or UDP for NFS? TCP should be better in all cases. * Have you monitored the system with top? Try hitting S and H in top while transfering files, see if anything looks suspicious. * Run iostat 1, check tps and KB/t. * What file system are you using? signature.asc Description: OpenPGP digital signature
Re: Unexpected gmirror behavior: Is this a bug?
Peter Steele wrote: We had a somewhat startling scenario occur with gmirror. We have systems with four drives ad4, ad6, ad8, and ad10, with the OS setup on a mirrored slice across all four drives. The ad4 drive failed at one point, due to a simple bad connection in its drive bay. While it was offline, the system was continued to be used for a while and new data was added to the mirrored file system. We eventually took the box down to deal with ad4, and tried simply pulling and reinserting the drive. On reboot we saw that the BIOS detected the drive, so that was good. However, when FreeBSD got to the point of starting up the GEOM driver, instead of reinserting ad4 into the more current mirror consisting of ad6/ad8/ad10 and resyncing it with that data, the GEOM driver assumed ad4 was the good mirror and ended up resyncing ad6/ad8/ad10 with the data from ad4, causing the new files we had added to those drives to be lost. This only happens with ad4. If ad6 for example goes offline in the same way, when it is reinserted it does not become the dominant drive and resync its data with the other drives. Rather its data is overwritten with the data from the 3 member mirror, as you'd expect. So, clearly ad4, the first disk, is treated specially. The question is this a bug or a feature? Is there anyway to prevent this behavior? This would be a disastrous thing to happen in the field on one of our customer systems. This definitely looks like a bug. Try asking again on the freebsd-geom@ list. Provide output of gmirror list. From what you said it looks like you did the procedure safely - you turned off the server, then pulled the drive and reinserted it, then turned it on again, right? signature.asc Description: OpenPGP digital signature
Re: Unexpected gmirror behavior: Is this a bug?
Ivan Voras wrote: Peter Steele wrote: We had a somewhat startling scenario occur with gmirror. We have systems with four drives ad4, ad6, ad8, and ad10, with the OS setup on a mirrored slice across all four drives. The ad4 drive failed at one point, due to a simple bad connection in its drive bay. While it was offline, the system was continued to be used for a while and new data was added to the mirrored file system. We eventually took the box down to deal with ad4, and tried simply pulling and reinserting the drive. On reboot we saw that the BIOS detected the drive, so that was good. However, when FreeBSD got to the point of starting up the GEOM driver, instead of reinserting ad4 into the more current mirror consisting of ad6/ad8/ad10 and resyncing it with that data, the GEOM driver assumed ad4 was the good mirror and ended up resyncing ad6/ad8/ad10 with the data from ad4, causing the new files we had added to those drives to be lost. This only happens with ad4. If ad6 for example goes offline in the same way, when it is reinserted it does not become the dominant drive and resync its data with the other drives. Rather its data is overwritten with the data from the 3 member mirror, as you'd expect. So, clearly ad4, the first disk, is treated specially. The question is this a bug or a feature? Is there anyway to prevent this behavior? This would be a disastrous thing to happen in the field on one of our customer systems. This definitely looks like a bug. Try asking again on the freebsd-geom@ list. Provide output of gmirror list. From what you said it looks like you did the procedure safely - you turned off the server, then pulled the drive and reinserted it, then turned it on again, right? Sorry, that was a useless response - what I said should be a no-op. So, your steps were: 1. ad4, ad6, ad8 and ad10 in a 4-way mirror 2. ad4 fails. At this point did you do a gmirror list? I.e. did gmirror detect it failing? If I read it correctly, the GenID field should have been increased in this case. 3. The system continues to be used 4. You power it down, take out and reinsert ad4 5. On boot, ad4 is detected, inserted in the mirror but as a known good copy, not a stale one. Correct? What version of FreeBSD are you using? signature.asc Description: OpenPGP digital signature
Re: Unexpected gmirror behavior: Is this a bug?
2009/4/24 Peter Steele pste...@maxiscale.com: This definitely looks like a bug. Try asking again on the freebsd-geom@ list. Provide output of gmirror list. I'll try that list... So, your steps were: 1. ad4, ad6, ad8 and ad10 in a 4-way mirror 2. ad4 fails. At this point did you do a gmirror list? I.e. did gmirror detect it failing? If I read it correctly, the GenID field should have been increased in this case. 3. The system continues to be used 4. You power it down, take out and reinsert ad4 5. On boot, ad4 is detected, inserted in the mirror but as a known good copy, not a stale one. Correct? Yes, that's basically the sequence that occurred. I can easily recreate the condition though. I shut my box down, took out ad4 and then rebooted. The system complained about ad4 being missing and proceeded with a mirror using 3/4 of the drives. I then created a file on the system, shutdown again, and then reinserted ad4. On reboot as the system was starting up the gmirror driver, it detected ad4 but instead of reinserting in in the most recent mirror made up of the other drives, it became the active drive and kicked out its old partners, By kicked out you mean overwritten? You should definitely look at gmirror list before and after. ___ freebsd-questions@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-questions To unsubscribe, send any mail to freebsd-questions-unsubscr...@freebsd.org
Re: Confusion About FreeBSD now supports host and guest modes in VirtualBox
Ivan Voras wrote: Ryan Ware wrote: Maybe someone here can distribute some enlightenment. In the press release for 8.0 it says, FreeBSD now supports host and guest modes in VirtualBox. I understand what the host mode support is with the VirtualBox port. What I don't understand is what support for guest mode is. I don't see anything anywhere about guest additions. As far as I can tell, guest support seems to consist of simply allowing the kernel to run in VirtualBox. Am I missing something? AFAIK no, that's it. Actually, it looks like the newest version (will arrive to ports soon) has guest tools/additions for FreeBSD. ___ freebsd-questions@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-questions To unsubscribe, send any mail to freebsd-questions-unsubscr...@freebsd.org
Re: 8.0-R-p2 ZFS: unixbench causing kmem exhaustion panic
Doug Poland wrote: So the question is, can ZFS be tuned to not panic or hang no matter what I throw at it? Apparently not. I began with a system with no tunables in /boot/loader.conf (vm.kmem_size and vm.kmem_size_max). Then I tried increasing vm.kmem_size and vm.kmem_size_max a GB at a time, until I was at 4GB. Try adding vfs.zfs.arc_max=512M to /boot/loader.conf. ___ freebsd-questions@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-questions To unsubscribe, send any mail to freebsd-questions-unsubscr...@freebsd.org
Re: 8.0-R-p2 ZFS: unixbench causing kmem exhaustion panic
2010/1/13 Doug Poland d...@polands.org: On Wed, January 13, 2010 11:55, Ivan Voras wrote: Doug Poland wrote: So the question is, can ZFS be tuned to not panic or hang no matter what I throw at it? Apparently not. I began with a system with no tunables in /boot/loader.conf (vm.kmem_size and vm.kmem_size_max). Then I tried increasing vm.kmem_size and vm.kmem_size_max a GB at a time, until I was at 4GB. Try adding vfs.zfs.arc_max=512M to /boot/loader.conf. Would you suggest tweaking the vm.kmem_size tunables in addition to arc_max? No, unless they auto-tune to something lesser than approximately arc_max*3. I try to set arc_max to be a third (or a quarter) the kmem_size, and tune kmem_size ad_hoc to suit the machine and its purpose. The reason for this is that arc_max is just a guideline, not a hard limit... the ZFS ARC usage can and will spike to much larger values, usually in the most inopportune moment. ___ freebsd-questions@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-questions To unsubscribe, send any mail to freebsd-questions-unsubscr...@freebsd.org
Re: 8.0-R-p2 ZFS: unixbench causing kmem exhaustion panic
2010/1/13 Doug Poland d...@polands.org: On Wed, January 13, 2010 12:35, Ivan Voras wrote: Try adding vfs.zfs.arc_max=512M to /boot/loader.conf. Would you suggest tweaking the vm.kmem_size tunables in addition to arc_max? No, unless they auto-tune to something lesser than approximately arc_max*3. I try to set arc_max to be a third (or a quarter) the kmem_size, and tune kmem_size ad_hoc to suit the machine and its purpose. The reason for this is that arc_max is just a guideline, not a hard limit... the ZFS ARC usage can and will spike to much larger values, usually in the most inopportune moment. This is the state of the machine when it panicked this time: panic: kmem_malloc(131072): kmem_map too small: 1296957440 total allocated cpuid = 1 /boot/loader.conf: vfs.zfs.arc_max=512M vfs.numvnodes: 660 vfs.zfs.arc_max: 536870912 vfs.zfs.arc_meta_limit: 134217728 vfs.zfs.arc_meta_used: 7006136 vfs.zfs.arc_min: 67108864 vfs.zfs.zil_disable: 0 vm.kmem_size: 1327202304 vm.kmem_size_max: 329853485875 (from the size of arc_max I assume you did remember to reboot after changing loader.conf and before testing again but just checking - did you?) Can you monitor and record kstat.zfs.misc.arcstats.size sysctl while the test is running (and crashing)? This looks curious - your kmem_max is ~~ 1.2 GB, arc_max is 0.5 GB and you are still having panics. Is there anything unusual about your system? Like unusually slow CPU, unusually fast or slow drives? I don't have any ideas smarter than reducing arc_max by half then try again and continue reducing it until it works. It would be very helpful if you could monitor the kstat.zfs.misc.arcstats.size sysctl while you are doing the tests to document what is happening to the system. If it by any chance stays the same you should probably monitor vmstat -m. Using a handy little script I found posted in several places, I was monitoring memory: TEXT 15373968 14.66 MiB DATA 1536957440 1465.76 MiB TOTAL 1552331408 1480.42 MiB Where TEXT = a sum of kldstat memory values and DATA = a sum of vmstat -m values Is there a next step to try, or is this chasing a wild goose? -- Regards, Doug ___ freebsd-questions@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-questions To unsubscribe, send any mail to freebsd-questions-unsubscr...@freebsd.org
Re: 8.0-R-p2 ZFS: unixbench causing kmem exhaustion panic
Doug Poland wrote: Ok, I re-ran with same config, but this time monitoring the sysctls you requested* ( and the rest I was watching ): I failed to mention that kstat.zfs.misc.arcstats.size seemed to fluctuate between about 164,000,00 and 180,000,000 bytes during this last run Is that with or without panicking? If the system did panic then it looks like the problem is a memory leak somewhere else in the kernel, which you could confirm by monitoring vmstat -z. ___ freebsd-questions@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-questions To unsubscribe, send any mail to freebsd-questions-unsubscr...@freebsd.org
Re: GELI file systems unusable after glabel label operations
Scott Bennett wrote: I used glabel label to label each of the file systems I have on external disk drives. Unfortunately, afterward I am now unable to geli attach any of the GELI-encrypted file systems. The system is FreeBSD 7.2-STABLE. Hmm, did you say you had geli-encrypted drives, then you have overwritten the last sector with glabel, and then you are surprised you cannot get to the data any more? Or have I just lost everything in the encrypted file systems? I think you did. From the geli(8) man page: init ... The last provider’s sector is used to store metadata. From the glabel(8) man page: label ... metadata is stored in a provider’s last sector. If you did geli init ... da0 and then glabel label ... da0 then you have lost the geli metadata, which contains keys, etc. You might recover this, though, by reading geli(8) about the restore command. There is no way you can label your devices after you applied geli to them (which is one of the points of using geli...). You could destroy the geli layer (and the data), apply the label and then apply geli to the label. ___ freebsd-questions@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-questions To unsubscribe, send any mail to freebsd-questions-unsubscr...@freebsd.org
Re: any port use /dev/dsp directly?
Gary Kline wrote:
On Wed, Jan 13, 2010 at 08:37:46PM -0500, Glen Barber wrote:
Gary Kline wrote:
I have a couple short programs where I mess with /dev/dsp. I'll open
check to be sure the speed is right, open in mono or stereo, c. is
there anything is ports that uses this dev by opening, doing ioctls and
so forth?
I think I may need to flush my data before closing the FILE *FP. Not
sure; just guessing.
I don't know if this directly answers your question, but from sound(4):
hw.snd.default_unit
Default sound card for systems with multiple sound cards. When
using devfs(5), the default device for /dev/dsp. Equivalent to a
symlink from /dev/dsp to /dev/dsp${hw.snd.default_unit}.
FWIW, www/linux-f10-flashplugin10 is using /dev/dsp0.0 on my system at the
moment.
Regards,
Thanks, but I already read the sound man page. I am trying to emulate
/bin/cat WAVEFILE /dev/dsp
which works well by opening /dev/dsp, making sure everything is set,
the writing the bytes of the WAVEFILE thru/into the device with a
write() call. It works, the sound echoes, but at the end is an ugly
HISSing or FI sound.
Anybody seen anything like this? Doesn't hurt to ask, given the
brainpower on this list. But this may be something I have got to
figure out.
(There doesn't seem to be any way of getting rid of that annoying
HISS. ... .)
I have no idea how /dev/dsp really works but what you say sounds like
there is some canonical buffer size it expects - like 64 kB or something
like that, and it (wrongly) interprets garbage memory past your write as
sound data. Try creating a larger buffer and fill the memory past the
end of your sound with zeroes.
___
freebsd-questions@freebsd.org mailing list
http://lists.freebsd.org/mailman/listinfo/freebsd-questions
To unsubscribe, send any mail to freebsd-questions-unsubscr...@freebsd.org
Re: GELI file systems unusable after glabel label operations
Scott Bennett wrote: As noted above, that would not work because then the label would not be readable at boot time. Yes it would. What you would have is a nested configuration, geli within a label. The label would be read when the device is present, then you would be able to attach the geli device (probably as /dev/label/blah.geli, I didn't try it). ___ freebsd-questions@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-questions To unsubscribe, send any mail to freebsd-questions-unsubscr...@freebsd.org
Re: 8.0-R-p2 ZFS: unixbench causing kmem exhaustion panic
2010/1/14 Doug Poland d...@polands.org: On Thu, January 14, 2010 03:17, Ivan Voras wrote: Doug Poland wrote: Ok, I re-ran with same config, but this time monitoring the sysctls you requested* ( and the rest I was watching ): I failed to mention that kstat.zfs.misc.arcstats.size seemed to fluctuate between about 164,000,00 and 180,000,000 bytes during this last run Is that with or without panicking? with a panic If the system did panic then it looks like the problem is a memory leak somewhere else in the kernel, which you could confirm by monitoring vmstat -z. I'll give that a try. Am I looking for specific items in vmstat -z? arc*, zil*, zfs*, zio*? Please advise. You should look for whatever is allocating all your memory between 180 MB (which is your ARC size) and 1.2 GB (which is your kmem size). ___ freebsd-questions@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-questions To unsubscribe, send any mail to freebsd-questions-unsubscr...@freebsd.org
Re: 8.0-R-p2 ZFS: unixbench causing kmem exhaustion panic
2010/1/14 Doug Poland d...@polands.org:
On Thu, January 14, 2010 08:50, Ivan Voras wrote:
2010/1/14 Doug Poland d...@polands.org:
kstat.zfs.misc.arcstats.size
seemed to fluctuate between about 164,000,00 and 180,000,000 bytes
during this last run
Is that with or without panicking?
with a panic
If the system did panic then it looks like the problem is a memory
leak somewhere else in the kernel, which you could confirm by
monitoring vmstat -z.
I'll give that a try. Am I looking for specific items in vmstat
-z? arc*, zil*, zfs*, zio*? Please advise.
You should look for whatever is allocating all your memory between 180
MB (which is your ARC size) and 1.2 GB (which is your kmem size).
OK, another run, this time back to vfs.zfs.arc_max=512M in
/boot/loader.conf, and a panic:
panic: kmem malloc(131072): kmem map too small: 1294258176 total
allocated
I admit I do not fully understand what metrics are important to proper
analysis of this issue. In this case, I was watching the following
within 1 second of the panic:
sysctl kstat.zfs.misc.arcstats.size: 41739944
sysctl vfs.numvnodes: 678
sysctl vfs.zfs.arc_max: 536870912
sysctl vfs.zfs.arc_meta_limit: 134217728
sysctl vfs.zfs.arc_meta_used: 7228584
sysctl vfs.zfs.arc_min: 67108864
sysctl vfs.zfs.cache_flush_disable: 0
sysctl vfs.zfs.debug: 0
sysctl vfs.zfs.mdcomp_disable: 0
sysctl vfs.zfs.prefetch_disable: 1
sysctl vfs.zfs.recover: 0
sysctl vfs.zfs.scrub_limit: 10
sysctl vfs.zfs.super_owner: 0
sysctl vfs.zfs.txg.synctime: 5
sysctl vfs.zfs.txg.timeout: 30
sysctl vfs.zfs.vdev.aggregation_limit: 131072
sysctl vfs.zfs.vdev.cache.bshift: 16
sysctl vfs.zfs.vdev.cache.max: 16384
sysctl vfs.zfs.vdev.cache.size: 10485760
sysctl vfs.zfs.vdev.max_pending: 35
sysctl vfs.zfs.vdev.min_pending: 4
sysctl vfs.zfs.vdev.ramp_rate: 2
sysctl vfs.zfs.vdev.time_shift: 6
sysctl vfs.zfs.version.acl: 1
sysctl vfs.zfs.version.dmu_backup_header: 2
sysctl vfs.zfs.version.dmu_backup_stream: 1
sysctl vfs.zfs.version.spa: 13
sysctl vfs.zfs.version.vdev_boot: 1
sysctl vfs.zfs.version.zpl: 3
sysctl vfs.zfs.zfetch.array_rd_sz: 1048576
sysctl vfs.zfs.zfetch.block_cap: 256
sysctl vfs.zfs.zfetch.max_streams: 8
sysctl vfs.zfs.zfetch.min_sec_reap: 2
sysctl vfs.zfs.zil_disable: 0
sysctl vm.kmem_size: 1327202304
sysctl vm.kmem_size_max: 329853485875
sysctl vm.kmem_size_min: 0
sysctl vm.kmem_size_scale: 3
vmstat -z | egrep -i 'zfs|zil|arc|zio|files'
ITEM SIZE LIMIT USED FREE REQUESTS
Files: 80, 0, 116, 199, 850713
zio_cache: 720, 0, 53562, 98, 86386955
arc_buf_hdr_t: 208, 0, 1193, 31, 11990
arc_buf_t: 72, 0, 1180, 120, 11990
zil_lwb_cache: 200, 0, 11580, 2594, 62407
zfs_znode_cache: 376, 0, 605, 55, 654
vmstat -m |grep solaris|sed 's/K//'|awk '{print vm.solaris:, $3*1024}'
solaris: 1285068800
The value I see as the culprit is vmstat -m | grep solaris. This
value fluctuates wildly during the run and is always near kmem_size at
the time of the panic.
Again, I'm not sure what to look for here, and you are patiently
helping me along in this process. If you have any tips or can point
me to docs on how to easily monitor these values, I will endeavor to
do so.
The only really important ones should be kstat.zfs.misc.arcstats.size
(which you very rarely print) and vm.kmem_size. The solaris entry
above should be near kstat.zfs.misc.arcstats.size in all cases.
But I don't have any more ideas here. Try taking this post (also
include kstst.zfs.misc.arcstats.size) to the freebsd-fs@ mailing list.
___
freebsd-questions@freebsd.org mailing list
http://lists.freebsd.org/mailman/listinfo/freebsd-questions
To unsubscribe, send any mail to freebsd-questions-unsubscr...@freebsd.org
Re: gmirror+gjournal: spontaneous reboots on excessive disk access
Michael Grimm wrote: Hi -- I'm running a gmirror raid1 plus gjournal for a year now. This is a 7.2-RELEASE-p6 right now. Both disks are regular ATA and healthy according smartctl. Sometimes, not always though, I do experience spontaneous reboots without leaving any hints in logfiles whenver I beat my disks excessively. This might be something like: dd if=/dev/null of=/some/file bs=1M count=4k plus parallel disk accesses by mail and news server. If I omit all parallel disk access those dd's will run to completion without reboots, always. What you have is a common symptom of hardware problems - either a weak power supply or a broken disk controller. In the first case because two drives try to suck power where only one was doing it before and in the second reason because the disk controller is too broken to correctly handle simultaneous access to two drives. Unfortunately, if you don't get any console error messages it is hard to tell which. The power supply is usually easier to replace. ___ freebsd-questions@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-questions To unsubscribe, send any mail to freebsd-questions-unsubscr...@freebsd.org
Re: VirtualBox - does it work for FreeBSD?
On 01/21/10 08:11, Glyn Millington wrote: Good Morning :-) A quick question for anyone running VirtualBox on a FreeBSD _host_ machine, with Linux or Windows as a _guest_ OS. Does it work? Yes. at is, do the guest additions work fully for those guests, or are there limitations such those I experience currently when running FreeBSD 8 as the guest? (eg no access to USB, no fullscreen mode). You are right about USB and probably about fullscreen mode. seamless mode works at least for Windows. Any major problems with a FreeBSDS host and Windows/Linux guest? You might have problems with using virtual SMP. ___ freebsd-questions@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-questions To unsubscribe, send any mail to freebsd-questions-unsubscr...@freebsd.org
Re: hardening FreeBSD, already using GBDE
On 01/21/10 16:32, Henry Olyer wrote: For example, the editor I use normally writes to /tmp -- I changed that, making it slower, but in the event that someone takes my laptop I want to sleep at night. If you use a swap-backed memory drive (see http://man.freebsd.org/mdconfig) for /tmp and use geli to encrypt the swap, there would be no chance of recovery of your temporary files. I've no problem letting some poor person make a windoz machine out of my laptop -- but I don't want to share my work, my intellectual property. (I do research.) So, I'm looking for a list of changes to make, hacks really, that will further tighten up security. You did not specify anything really exact. You already encrypt your on-disk data. Do you always use encrypted network protocols like ssh and https? Strong passwords? Adequate physical security? Up-to-date software? ___ freebsd-questions@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-questions To unsubscribe, send any mail to freebsd-questions-unsubscr...@freebsd.org
Re: ISO simple non-forking TCP connection forward/balance tool
Chris Peiffer wrote: I'm looking for a simple program I can use to forward incoming TCP connections to several other addr:port pairs. (including one on the machine itself.) Holding the connections open and passing the data back and forth until both parties close their ends. I need a solution that doesn't fork. One way to do it is just fork ad-hoc netcat pipes with inetd, but I'm trying to avoid the process overhead. See net/bsdproxy. ___ freebsd-questions@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-questions To unsubscribe, send any mail to freebsd-questions-unsubscr...@freebsd.org
Re: posting coding bounties, appropriate money amounts?
Dan Naumov wrote: Hello I am curious about posting some coding bounties, my current interest revolves around improving the ZVOL functionality in FreeBSD: fixing the known ZVOL SWAP reliability/stability problems as well as making ZVOLs work as a dumpon device (as is already the case in OpenSolaris) for crash dumps. I am a private individual and not some huge Fortune 100 and while I am not exactly rich, I am willing to put some of my personal money towards this. I am curious though, what would be the best way to approach this: directly approaching committer(s) with the know-how-and-why of the areas involved or through the FreeBSD Foundation? And how would one go about calculating the appropriate amount of money for such a thing? Hi, This idea (bounties) appear approximately every 6 months and it appears there is no better way than contacting the developers directly. AFAIK all attempts to conglomerate such an effort have failed. One important conclusion is that it cannot go through the Foundation since they cannot accept targeted donations. ___ freebsd-questions@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-questions To unsubscribe, send any mail to freebsd-questions-unsubscr...@freebsd.org
Re: FreeBSD 8.0 amd64 on Nehelem Xeon?
Nerius Landys wrote: I'm in the process of purchasing a small Nehelem-based server (Xeon L5506 CPU to be exact). I will be installing some flavor of FreeBSD 8.0 (either i386 32 bit or amd64 64 bit, to be exact). I have no immediate need for a 64 bit server, as none of the processes that I will be running in the forseeable future will require more than 3 gigs of memory. My primary use for the server (which will be in a data center) will be to run video games servers; the exact game I'll be running is based on the ioquake3 open source engine, which compiles and runs fine on FreeBSD, at least 32 bit (have not tried 64 bit FreeBSD yet, but will get around to that). My two concerns when making a decision between 32 bit and 64 bit are: 1. Performance. Will there be any difference in performance between a 64 bit OS and 32 bit on my Nehelem? Probably not so much that you would notice (i.e. not something the users would immediately feel) - for general loads we're talking about low percentages in either direction. But installing a 64-bit OS is more like planning for the future. Maybe you will need more RAM for some application and then you will be stuck with a 32-bit OS. 2. Availability of software. Will some software run only on 32 bit? Only on 64 bit? There probably are some. If you are only interested in FreeBSD ports, you can make a list of which ports you need and then inspect their Makefiles to see if there's a flag disabling them on the amd64 architecture. Another option is that you bring up a 32-bit-only jail and run your 32-bit applications from it. Additional information for Nehalems is that you should stick to the more widely available models - the 4 core+HTT ones. Some of the more exotic ones (6 core) might have problems with ULE and topology guesswork. http://suckit.blog.hu/2009/10/05/freebsd_8_is_it_worth_to_upgrade ___ freebsd-questions@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-questions To unsubscribe, send any mail to freebsd-questions-unsubscr...@freebsd.org
Re: FreeBSD 8.0 amd64 on Nehelem Xeon?
On 23 January 2010 01:14, Nerius Landys nlan...@gmail.com wrote: There probably are some. If you are only interested in FreeBSD ports, you can make a list of which ports you need and then inspect their Makefiles to see if there's a flag disabling them on the amd64 architecture. OK thanks. Could you give me an example of a port that is disabled on 64 bit and tell me what I will find in the Makefile, so I can look for it on other ports? emulators/wine: ONLY_FOR_ARCHS= i386 Additional information for Nehalems is that you should stick to the more widely available models - the 4 core+HTT ones. Some of the more exotic ones (6 core) might have problems with ULE and topology guesswork. The L5506 is a 4 core model without Turbo Boost and without Hyper Threading. It's a power-efficient model. Think that'll be OK? http://ark.intel.com/Product.aspx?id=40712 Yes. ___ freebsd-questions@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-questions To unsubscribe, send any mail to freebsd-questions-unsubscr...@freebsd.org
