geli still broken on latest 9.* from svn
is it planned to fix or should i just treat some non latest 9.* release as the last non-broken one, and just apply security fixes manually? ___ freebsd-hackers@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-hackers To unsubscribe, send any mail to freebsd-hackers-unsubscr...@freebsd.org
Re: After the FreeBSD VM crash, file system in VM got rolled back to some old previous state causing data loss
I hit this unexpected problem: my host had an ungraceful shutdown while FreeBSD 9.1 STABLE was running in the VirtualBox VM. After reboot of the host and VM, local ufs file system was missing all recent updates for at least 20 hours (!!!) My question is, how is this possible? Is this related to journaled soft-updates which were enabled in VM? not possible in FreeBSD with UFS. but if you run virtualbox under linux i cannot say much... ___ freebsd-hackers@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-hackers To unsubscribe, send any mail to freebsd-hackers-unsubscr...@freebsd.org
Re: Kern.hz= +1 hertz at anything 2500 and above.
improved with a higher kern.hz rating. Unless the future holds an emu20k2, there will be RAM used from the motherboard. 1. I will need a real-time or a faster kernel- hence the high rate wanted- because the devices to be built will be used in an active environment: art, music, audio control. 2. Any system with limited memory and a low CPU hertz rate benefits from the higher kern.hz setting. rather opposite. more kern.hz=more interrupts. 3. Why not? If it works for PowerPC, SPARC64, AMD64, and i386 then it may work for other architectures. 4. Some applications may be ran from within a jail. On Wed, Jul 24, 2013 at 8:16 PM, Adrian Chadd adr...@freebsd.org wrote: Well, why is it reducing latency? That's the thing you should investigate. Is it because processes aren't getting enough time? or too much time? Or the audio device isn't getting enough time to run? etc. -adrian On 24 July 2013 15:35, Super Bisquit superbisq...@gmail.com wrote: http://lists.freebsd.org/pipermail/freebsd-stable/2009-September/051789.html This is the thread that I was referring to earlier. Since the patch is for 2009, what are the chances it would work with 10.x or 9.x? On PowerPC machines with a low MHz rate- or any machine with a CPU rate of 800 MHz or less- increasing the kern.hz improves performance and cuts down on latency. I am building audio applications and suites that are used in different projects. A G3 based machine should be able to run a kernel with kern.hz=5000 with no problem. Unfortunately, this cannot be done. @PowerPC: some of you may find that performance does increase at a higher kern.hz rate. @Hackers Current: What's the chance that the default rate limit can be raised to 5k? ___ freebsd-...@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-ppc To unsubscribe, send any mail to freebsd-ppc-unsubscr...@freebsd.org ___ freebsd-hackers@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-hackers To unsubscribe, send any mail to freebsd-hackers-unsubscr...@freebsd.org ___ freebsd-hackers@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-hackers To unsubscribe, send any mail to freebsd-hackers-unsubscr...@freebsd.org
Re: writing a rc.d script
any other script is a template. man rc is your documentation On Sun, 7 Jul 2013, Aryeh Friedman wrote: I have a program I am making a port for that also requires a /usr/local/etc/rc.d script is there anywhere I can find documentation on how write one and/or a template file to follow? ___ freebsd-hackers@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-hackers To unsubscribe, send any mail to freebsd-hackers-unsubscr...@freebsd.org ___ freebsd-hackers@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-hackers To unsubscribe, send any mail to freebsd-hackers-unsubscr...@freebsd.org
Re: hw.physmem/hw.realmem question
AMD Features2=0x1LAHF TSC: P-state invariant, performance statistics real memory = 34359738368 (32768 MB) avail memory = 32191340544 (30700 MB) 2GB memory disappears too even when you don't set anything. i asked such a question for other machine some time ago without much answer. in your laptop it may be shared graphics memory reserved by chipset still on my dell server real memory = 34359738368 (32768 MB) avail memory = 33166921728 (31630 MB) i have over 1GB unavailable and it doesn't have shared graphics memory. it would be nice to be able to look exactly how memory is used. Event timer LAPIC quality 600 ACPI APIC Table: DELL DCSRADON and from sysctl: hw.physmem: 34284916736 hw.usermem: 32964923392 hw.realmem: 36507222016 after setting hw.physmem=16G from dmesg: real memory = 34359738368 (32768 MB) avail memory = 13999382528 (13350 MB) and sysctl: hw.physmem: 14957563904 hw.usermem: 10094678016 hw.realmem: 17179869184 from the numbers, I can assume that realmem is the real physical memory, (or whatever is set in hw.physmem), if so, where did almost 2G go? (realmem - physmen) the only info I found so far is: from loader(8): hw.physmemLimit the amount of physical memory the system will use. By default the size is in bytes, but the k, K, m, M, g and G suffixes are also accepted and indicate kilobytes, megabytes and gigabytes respectively. An invalid suffix will result in the variable being ignored by the kernel. what is physmem and realmem, and what's the relationship - if any - between them? cheers, danny ___ freebsd-hackers@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-hackers To unsubscribe, send any mail to freebsd-hackers-unsubscr...@freebsd.org ___ freebsd-hackers@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-hackers To unsubscribe, send any mail to freebsd-hackers-unsubscr...@freebsd.org
Re: what's got messed with geli in newest 9.* kernel (svn)
really nobody use geli. tried today - still geli crash system within a minute. On Fri, 21 Jun 2013, Wojciech Puchar wrote: after getting yesterday new kernel, upgrading everything (including userland, all in sync) my geli encrypted partition starts to randomly produce read/write errors (error number 11) or just random reboots. going back to kernel compiled from 6 day older sources fixes everything. evidently a serious bug, making this kernel useless. Should i sent-pr or just sent all needed data (including kernel config) to someone directly? ___ freebsd-hackers@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-hackers To unsubscribe, send any mail to freebsd-hackers-unsubscr...@freebsd.org ___ freebsd-hackers@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-hackers To unsubscribe, send any mail to freebsd-hackers-unsubscr...@freebsd.org
what's going on after upgrade to svn-latest 9.
i'm getting this on my computer. disk seems OK, smart shows nothing, dd reads whole partition without problem. no other errors from disk itself (AHCI timeout or so). started exactly after i rebooted with new kernel. everything unchanged. userland is in sync thanks for help g_vfs_done():ada0s3d.eli[WRITE(offset=30653186048, length=1048576)]error = 11 g_vfs_done():ada0s3d.eli[WRITE(offset=31218532352, length=65536)]error = 11 g_vfs_done():ada0s3d.eli[WRITE(offset=31218630656, length=65536)]error = 11 g_vfs_done():ada0s3d.eli[WRITE(offset=31218761728, length=32768)]error = 11 g_vfs_done():ada0s3d.eli[WRITE(offset=31218827264, length=32768)]error = 11 g_vfs_done():ada0s3d.eli[WRITE(offset=31218892800, length=65536)]error = 11 g_vfs_done():ada0s3d.eli[WRITE(offset=31218991104, length=65536)]error = 11 g_vfs_done():ada0s3d.eli[WRITE(offset=31219089408, length=32768)]error = 11 g_vfs_done():ada0s3d.eli[WRITE(offset=31219187712, length=65536)]error = 11 g_vfs_done():ada0s3d.eli[WRITE(offset=31219318784, length=32768)]error = 11 g_vfs_done():ada0s3d.eli[WRITE(offset=31219515392, length=131072)]error = 11 g_vfs_done():ada0s3d.eli[WRITE(offset=31219679232, length=294912)]error = 11 g_vfs_done():ada0s3d.eli[WRITE(offset=31216599040, length=32768)]error = 11 g_vfs_done():ada0s3d.eli[WRITE(offset=31218597888, length=32768)]error = 11 g_vfs_done():ada0s3d.eli[WRITE(offset=31218794496, length=32768)]error = 11 g_vfs_done():ada0s3d.eli[WRITE(offset=31218860032, length=32768)]error = 11 g_vfs_done():ada0s3d.eli[WRITE(offset=31218958336, length=32768)]error = 11 g_vfs_done():ada0s3d.eli[WRITE(offset=31219056640, length=32768)]error = 11 g_vfs_done():ada0s3d.eli[WRITE(offset=31219154944, length=32768)]error = 11 g_vfs_done():ada0s3d.eli[WRITE(offset=31219482624, length=32768)]error = 11 g_vfs_done():ada0s3d.eli[WRITE(offset=31219646464, length=32768)]error = 11 ___ freebsd-hackers@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-hackers To unsubscribe, send any mail to freebsd-hackers-unsubscr...@freebsd.org
what's got messed with geli in newest 9.* kernel (svn)
after getting yesterday new kernel, upgrading everything (including userland, all in sync) my geli encrypted partition starts to randomly produce read/write errors (error number 11) or just random reboots. going back to kernel compiled from 6 day older sources fixes everything. evidently a serious bug, making this kernel useless. Should i sent-pr or just sent all needed data (including kernel config) to someone directly? ___ freebsd-hackers@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-hackers To unsubscribe, send any mail to freebsd-hackers-unsubscr...@freebsd.org
Re: how do I build a single app?
I installed FreeBSD into a VirtualBox VM in January and started playing with the code. I must complement you people on the clarity of your code. I've enjoyed examining it. I wanted to try some code changes to some of the apps in the /bin directory, but can't figure out how to build a single app, or even build a single set of apps, like /usr/src/bin, /usr/src/sbin, /usr/src/usr.bin, or /usr/src/usr.sbin. Is there a way to do this, or do I just have to create my own Makefiles for each app I am experimenting on? cd /usr/src/bin/program make ___ freebsd-hackers@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-hackers To unsubscribe, send any mail to freebsd-hackers-unsubscr...@freebsd.org
Re: 3955MiB of swap space
warning: total configured swap (1178880 pages) exceeds maximum recommended amount (1012480 pages). warning: increase kern.maxswzone or reduce amount of swap. I am yet to hear whether the warning is safe to ignore. Which one of the following is true? (1) Only 3955MiB of swap space will be used (instead of 4092MiB), but that reduced space will have maximum operational performance. this. or just increase kern.maxswzone (2) 4096MiB of swap space will be used, at reduced performance. To increase performance, the partitions have to be resized to (3955/4)MiB each. ___ freebsd-hackers@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-hackers To unsubscribe, send any mail to freebsd-hackers-unsubscr...@freebsd.org ___ freebsd-hackers@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-hackers To unsubscribe, send any mail to freebsd-hackers-unsubscr...@freebsd.org
Re: seeding randomness in zee cloud
Or is there a cleaner way to add a additional seed as a one-off with disturbing as little as possible (in the few seconds just after the network is brought up). If this needs to be done automatically, not really. If there's a person available, you could use the please type a screen full of random junk approach and feed both the inter-character timings (which should be done automatically via IRQ harvesting) and junk into /dev/random. why just not put entropy files before installing from image? ___ freebsd-hackers@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-hackers To unsubscribe, send any mail to freebsd-hackers-unsubscr...@freebsd.org
Re: seeding randomness in zee cloud
.. snipped... # Seed Software random generator # cat rnd /dev/random # Activate software random generator as an additional source sysctl kern.random.sys.harvest.swi=1 Or does this cause a loss/reset of all entropy gathered by the hardware sofar ? no - writing to /dev/random adds randomness ___ freebsd-hackers@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-hackers To unsubscribe, send any mail to freebsd-hackers-unsubscr...@freebsd.org
Re: 3955MiB of swap space
prefer to repartition the drives for them to have swap partitions each of size (3955/4)MiB. By the way, is swapping distributed evenly among the drives? How? Is there a yes. downfall when one of the drives is outstandingly slow? no really. sometimes swapin would be slower, 3/4 times of cases faster, by average would be a bit slower. ___ freebsd-hackers@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-hackers To unsubscribe, send any mail to freebsd-hackers-unsubscr...@freebsd.org
Re: FreeBSD installers and future direction
I heard there was some discussion at BSDCan about the direction of a future FreeBSD installer. Considering we currently have bsdinstall, pc-sysinstall, the best would be removing it at all and adding instruction how to install by hand. At least someone that install FreeBSD will know what he/she actually did, and what to do then in case of emergency or how to say.. move the system ___ freebsd-hackers@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-hackers To unsubscribe, send any mail to freebsd-hackers-unsubscr...@freebsd.org
stupid question about sendmail
how to redirect recipient address. i mean - if someone try to send to x...@y.pl from serwer then it should be redirected to local account, while the rest of mails to domain @y.pl should get out normally. alternatively outgoing mail to x...@y.pl should be rejected. tried access.db - To:x...@y.pl REJECT doesn't work any idea. thank you ___ freebsd-hackers@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-hackers To unsubscribe, send any mail to freebsd-hackers-unsubscr...@freebsd.org
Re: stupid question about sendmail
To:x...@y.pl REJECT doesn't work any idea. thank you Don't use /etc/mail/access, use /etc/mail/aliases. E.g.: x: /dev/null x is NOT on my server. it will not work. all i want is when someone send a mail from my server to x...@y.pl (which is someone else domain) it will not get there and be blocked or redirected ___ freebsd-hackers@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-hackers To unsubscribe, send any mail to freebsd-hackers-unsubscr...@freebsd.org
Re: stupid question about sendmail
all i want is when someone send a mail from my server to x...@y.pl (which is someone else domain) it will not get there and be blocked or redirected My bad, take a look at the /etc/mail/genericstable file: http://www.sendmail.com/sm/open_source/docs/m4/features.html Maybe a line like this one will help you achieve your goal: j...@bar.comerror:5.7.0:550 Address invalid i tried it. maybe i do something wrong but tried on my home server woj...@3miasto.net.pl error:5.7.0:550 Address invalid (TAB separates fields) in /etc/mail/genericstable and FEATURE(`genericstable') in wojtek.tensor.gdynia.pl.mc did make make install /etc/rc.d/sendmail restart and tried to send mail to woj...@3miasto.net.pl mail is not blocked any more ideas? thank you! ___ freebsd-hackers@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-hackers To unsubscribe, send any mail to freebsd-hackers-unsubscr...@freebsd.org
Re: stupid question about sendmail
http://www.sendmail.com/sm/open_source/docs/m4/features.html Maybe a line like this one will help you achieve your goal: j...@bar.comerror:5.7.0:550 Address invalid I was wrong again, sorry, but I believe I got it right this time: 1. Edit the /etc/mail/access file. 2. Insert a line like this one: To:mail...@some.domain.tld REJECT tried too. doesn't work. ___ freebsd-hackers@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-hackers To unsubscribe, send any mail to freebsd-hackers-unsubscr...@freebsd.org
Re: stupid question about sendmail
works fine after your advice. thank you very much. FEATURE(`access_db') FEATURE(`blacklist_recipients') On Fri, 24 May 2013, Claus Assmann wrote: On Fri, May 24, 2013, Trond Endrest?l wrote: [freebsd-hackers doesn't seem like the appropriate list...] FEATURE(access_db, `hash -o -TTMPF /etc/mail/access') Do NOT use -o. Moreover, do not specify arguments that are default. FEATURE(`access_db') is the best choice. One final(?) note: You might need this line as well: FEATURE(blacklist_recipients) That's not a might, that's a MUST for this case. Note: (sendmail's) cf/README is a rather useful document. ___ freebsd-hackers@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-hackers To unsubscribe, send any mail to freebsd-hackers-unsubscr...@freebsd.org
Re: Writing a (BSD like) Operating Systems From Scratch
I've been read thousands of pages of FreeBSD and Linux Kernel source code and books on the internals of BSD and Linux over the years in attempt to develop a complete understanding of operating systems (or at least, UNIX like ones). However, I feel that I'm as mystified as to the finer details as when I first started. So I've concluded that the best way to really understand the deep dark details of UNIX is to try and write one from scratch (using the general guidelines of standards like POSIX etc ...), and maybe taking a peek at BSD and Linux from time to time. My questions around this are: except writing TCP/IP stack and filesystem it should be possible to do by single person. a) What kind of hardware (processor) would I use as a development platform, given the requirements of cheap, well documented, easily obtainable, easy to debug etc ... I believe the hardware platform chosen should satisfy the following requirements: any except PCs unless you will like to deal with CPU and other (over)complexity. ___ freebsd-hackers@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-hackers To unsubscribe, send any mail to freebsd-hackers-unsubscr...@freebsd.org
Re: tape (sa0) on sparc64 ?
1:0x26:DDS-4 variable 97000DCLZ 2:0x26:DDS-4 variable 97000DCLZ 3:0x26:DDS-4 variable 97000DCLZ - Current Driver State: at rest. - File Number: 0 Record Number: 0Residual Count 0 all fine. However, attached to either controller (after a reboot of the machine and a powercycle of the drive), I get: [1:25:325]root@run:/home/foo dd if=/dev/sa0 of=tape5 dd: /dev/sa0: Input/output error 0+0 records in 0+0 records out 0 bytes transferred in 0.002930 secs (0 bytes/sec) ... which is a return code of '1' and no messages on the console... I have, before you ask, tried bs=10k and 20k ... but I believe this command should run by itself fetching the first 512 bytes of each block --- wrong. you have to specify proper block size or multiple of it. if you don't remember block size just try. I am not sure (not used tape for a long) but requesting larger block that is available should work too. if you used dump(8) then block size is most probably 32kB. try restore(8) or tar. ___ freebsd-hackers@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-hackers To unsubscribe, send any mail to freebsd-hackers-unsubscr...@freebsd.org
Re: ladmins that cannot type a command
On Sat, 4 May 2013, Alexander Yerenkow wrote: You still can't accept that there could be more than one point of view, and you show no respect to other's opinions. I know no projects that actually worked and succeded if democracy were used to decide about it's direction. ___ freebsd-hackers@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-hackers To unsubscribe, send any mail to freebsd-hackers-unsubscr...@freebsd.org
Re: ladmins that cannot type a command
Since this will enable more people to run FreeBSD that otherwise wouldn't give it a second glance, I would say it is VERY useful. Really? How useful is FreeBSD going to be to someone who cannot type? Who is the target here? Idiots? People without fingers? that's exactly what i mean here. Having more people able to install FreeBSD somehow only hurt it. We need more USERS, not more ladmins. The reverse would be true if FreeBSD would be commercially sold software - the more sold the better. Linux already got that way. contrary to common opinion GUI doesn't help learning. It prevents learning. ___ freebsd-hackers@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-hackers To unsubscribe, send any mail to freebsd-hackers-unsubscr...@freebsd.org
Re: ladmins that cannot type a command
spending your time polishing the wheels. You need to spend more time writing patches rather than telling other people what not to do. We're (nearly) all volunteers. If you think something needs fixing, you can have a go yourself or pay someone, but do NOT tell someone that their contribution is not worthwhile while pushing your agenda. yes i am telling someone that his contribution is not worthwhile. Or to be more exact - that it hurts. ___ freebsd-hackers@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-hackers To unsubscribe, send any mail to freebsd-hackers-unsubscr...@freebsd.org
Re: ladmins that cannot type a command
or partially. Then I gave a try Kde accessibility and found out that it's not quite ready for real usage. But it was something, at least. About Gui I always think it's better to have it than not. Not true. GUI is only a problem. you may just make your fonts larger using xterm. ___ freebsd-hackers@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-hackers To unsubscribe, send any mail to freebsd-hackers-unsubscr...@freebsd.org
Re: My GSOC proposal for review
point c. is what i would like the most and is really the most important for NON embedded system. others for embedded ones. d. won't really cut much f. may not save much but slow things down i wish you a success. On Thu, 2 May 2013, Amit Rawat wrote: Hi, I am attaching my gsoc proposal with this mail for review. If any body want any extra thing in it they can mail. Thanks, Amit Rawat ___ freebsd-hackers@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-hackers To unsubscribe, send any mail to freebsd-hackers-unsubscr...@freebsd.org
Re: GSoC: PKGNG GUI Proposal Available for Review
good for today and future ladmins that cannot type a command. Any USEFUL proposals that add some real functionality? On Fri, 3 May 2013, Justin Edward Muniz wrote: Thank you everyone for helping me create a suitable project to propose. I have submitted a draft of my proposal, though I am still in the process of enhancing it. If anyone has the time, please check it out and I'll gladly accept any feedback. I am new to Google Summer of Code, and just discovered I could update my proposal after submitting it. Initially I uploaded most of the proposal but I am still finishing the last parts. Any advice could help me (or others) develop future proposals, so I hope to hear from people even after the deadline. My proposal can be read at the following address: https://www.google-melange.com/gsoc/proposal/review/google/gsoc2013/justin_muniz/1 I appreciate you taking the time to read this email. Happy coding everyone. Justin Muniz ___ freebsd-hackers@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-hackers To unsubscribe, send any mail to freebsd-hackers-unsubscr...@freebsd.org ___ freebsd-hackers@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-hackers To unsubscribe, send any mail to freebsd-hackers-unsubscr...@freebsd.org
Re: GSOC: Qt front-end for freebsd-update
I am a CS major and have experience with Qt, C++ and shell scripting. I have been developing on FreeBSD for several years, and I am looking to tackle developing a new Qt front-end for the freebsd-update command. spend your time for something more useful :) ___ freebsd-hackers@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-hackers To unsubscribe, send any mail to freebsd-hackers-unsubscr...@freebsd.org
Re: Multiple page size support on FreeBSD?
How do your tests work? Do you examine PTEs directly to check for superpages or are you relying on the vm.pmap.pde sysctls? the later. anyway - algorithm described on list - that heuristics detects consecutive page access doesn't really help the urgent case - RANDOM access to large amount of memory. sequential access will get minimal improvement. IMHO the only way that really make sens is to add options to madvise to give kernel information about usage. ___ freebsd-hackers@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-hackers To unsubscribe, send any mail to freebsd-hackers-unsubscr...@freebsd.org
Re: GSOC 2013 project Kernel Size Reduction for Embedded System
happy that FreeBSD is among the selected organization. I am a third year student interested to work in the field of embedded system. I applied last year and the title of my project was Kernel Size why only in embedded system. smaller programs are always good :) And yes FreeBSD kernel is huge. doesn't really matter with 1GB or more RAM but yes - it is huge even relative to linux. ___ freebsd-hackers@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-hackers To unsubscribe, send any mail to freebsd-hackers-unsubscr...@freebsd.org
Re: GSOC 2013 project Kernel Size Reduction for Embedded System
And yes FreeBSD kernel is huge. doesn't really matter with 1GB or more RAM but yes - it is huge even relative to linux. Ah, any insight as to why? my custom compiled kernel: -r-xr-xr-x 1 root wheel 8791402 6 kwi 22:08 /boot//kernel/kernel only with features i need. linux is AFAIK like 3-4MB uncompressed. ___ freebsd-hackers@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-hackers To unsubscribe, send any mail to freebsd-hackers-unsubscr...@freebsd.org
Re: Multiple page size support on FreeBSD?
Superpage promotion happens automatically when consecutive data are accessed according to the proper heuristic. and in practice - unless there are only few processes, never really works. this is a result of my own tests. ___ freebsd-hackers@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-hackers To unsubscribe, send any mail to freebsd-hackers-unsubscr...@freebsd.org
Re: considering i386 as a tier 1 architecture
Computers are getting faster, but also more memory intensive. I can not find a laptop with less than 4 or 8 GB of RAM. Modern browsers, such as Firefox, require a 64bit architecture and 8GB of RAM. what? i rarely see firefox exceed 1GB and it is already way too much IMHO. ? A 32 bit platform is not enough now a days on systems with more than 4 GB of RAM. and never was. A 32 bit core now is like 640K of RAM in the 1990s. Even in the embedded world ARM is going 64 bit with ARMv8. but ALL NEW x86 computers have 64-bit instruction set. Secondly, the i386 port is unmaintained. Very few developers run it, so it doesn't get the testing it deserves. Almost every user post or bug report I see from a x86 compatible processor is running amd64. When was the last time you booted i386 outside a virtual machine? now 1 server running. because it's older and not 64-bit capable. and replace it with the ARM architecture as Tier 1. true. no need to support it as tier 1. users of older hardware usually don't want to upgrade to latest freebsd kernel and userland. ___ freebsd-hackers@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-hackers To unsubscribe, send any mail to freebsd-hackers-unsubscr...@freebsd.org
Re: considering i386 as a tier 1 architecture
that it is NOT necessary to make it a first class branch . 1 Giga Bytes , and even 2 Giga Bytes memory chips are disappearing from the computer shops slowly . at now 2GB RAM is smallest you can get, and intel atom is lowest end - but still 64-bit - CPU. At present , there is NO any processor which is ONLY 32-bits . Not only the Windows Server , if I am not remembering incorrectly , new regular Windows it should not matter what microsoft do. It is Unix. ___ freebsd-hackers@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-hackers To unsubscribe, send any mail to freebsd-hackers-unsubscr...@freebsd.org
Re: considering i386 as a tier 1 architecture
WP still 64-bit - CPU. It is not exact so. Some Atoms on some motherboards with some firmwares are 64-bit CPU. don't know of any now in shops that are not -- // Black Lion AKA Lev Serebryakov l...@freebsd.org ___ freebsd-hackers@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-hackers To unsubscribe, send any mail to freebsd-hackers-unsubscr...@freebsd.org ___ freebsd-hackers@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-hackers To unsubscribe, send any mail to freebsd-hackers-unsubscr...@freebsd.org
Re: considering i386 as a tier 1 architecture
You should also check your calendar :) This is one of the finest pieces of April Fools' Day trolling I've seen in quite some time. I'd rank it right up there with that press release from some years ago about Microsoft's acquisition of the Roman Catholic Church. anyway Easter at 1 april for me is already a great joke :) ___ freebsd-hackers@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-hackers To unsubscribe, send any mail to freebsd-hackers-unsubscr...@freebsd.org
Re: Help porting Linux app - getting Free Memory and Real Memory
I'm working on a port I maintain and the code has drastically changed. Everything is going we except that the program gives warnings that there isn't enough free memory on the system to perform certain actions. The program uses Linux call to /proc/meminfo to get this information. this is just a nonsense. the only thing program should check is data size limit. man getrlimit. RLIMIT_DATA is fine. unices (including linux) have virtual memory. providing enough total VM is a job for sysadmin. checking available memory by one program doesn't make much sense, as other programs are running in the same time. ___ freebsd-hackers@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-hackers To unsubscribe, send any mail to freebsd-hackers-unsubscr...@freebsd.org
snd_geode - where it is
i found it mentioned on older mailing list archives. Unfortunately all links to source are dead. There is no such driver now in FreeBSD-9. Is there any reason that it was removed, or it wasn't commited at all? any place where i can get it? ___ freebsd-hackers@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-hackers To unsubscribe, send any mail to freebsd-hackers-unsubscr...@freebsd.org
recent FreeBSD 9 kernel breaks fusefs-kmod
Before about 3 months ago or so, fusefs-kmod worked fine under FreeBSD 9. Now, with newest 9 it doesn't on amd64. It works fine on i386. on amd64 i can do ntfsmount but the mountpoint is not a directory and all i can do is to unmount. tried exactly the same version of fusefs-kmod, as well as recent. Any idea? ___ freebsd-hackers@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-hackers To unsubscribe, send any mail to freebsd-hackers-unsubscr...@freebsd.org
Re: lots of network interfaces
i am asking for ca 800 tun(4) interfaces active but no more than 250Mbit/s over them total. Do you hit CPU limits at that point? i am not because i don't do this now, and ask BEFORE planning. Adrian ___ freebsd-hackers@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-hackers To unsubscribe, send any mail to freebsd-hackers-unsubscr...@freebsd.org
Re: lots of network interfaces
You wrote 8 ? 2013 ?., 20:14:59: WP i am not because i don't do this now, and ask BEFORE planning. I know ISP, who uses FreeBSD with mpd5 as BRAS for PPPoE. They uses exactly what i want, just with vtun. So it will go fine. thank you. ___ freebsd-hackers@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-hackers To unsubscribe, send any mail to freebsd-hackers-unsubscr...@freebsd.org
Re: lots of network interfaces
very usable at that point, ifconfig aside). The interfaces are a linked list, plus there's a separate kernel dive for each interface. The list (as opposed to individual interfaces) is i don't care how fast ifconfig displays them, just for how fast things like routing or ipfw rule like via tun196 would work. if it is hashed somehow - fine. if not - very bad. ___ freebsd-hackers@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-hackers To unsubscribe, send any mail to freebsd-hackers-unsubscr...@freebsd.org
Re: gjournal +UFS - anyone actually use it?
Interesting I will have to try this; can you post the exact test steps . Also what type of controller were you using and what kernel / version . intel atom D525 builtin ahci0: Intel ICH7 AHCI SATA controller port 0x20b8-0x20bf,0x20cc-0x20cf,0x20b0-0x20b7,0x20c8-0x20cb,0x20a0-0x20af mem 0xf0284000-0xf02843ff irq 18 at device 31.2 on pci0 ada0 at ahcich0 bus 0 scbus0 target 0 lun 0 ada0: ST500NM0011 PA08 ATA-8 SATA 2.x device ada0: 300.000MB/s transfers (SATA 2.x, UDMA6, PIO 8192bytes) ada0: Command Queueing enabled ada0: 476940MB (976773168 512 byte sectors: 16H 63S/T 16383C) ada0: Previously was known as ad4 (BTW - no idea why it previously was known as ad4 as i've never ever run this machine without AHCI driver ;) create partition. copy kernel sources tarball here. now on that partition rm -rf * then write a script test.sh #!/usr/local/bin/bash a=0 while [ $a -lt 12 ];do mkdir $a cd $a a=$[a+1] tar xpf ../yourtarball.tar.gz cd .. done run it with (after chmod 700) time ./test.sh rerun a test on different conditions. SU+J makes sure that metadata will get consistent. NOT DATA. And this is quite a mess if you get UPS failure under high load. gjournal does journal everything. Not exactly, ufs mounted with default options insures data is written sync and metadata asynchronous . Standard Softupdate (no journal) improves upon this by limiting what ops need to write to the disk. It had some short falls for edge case operations; which softupdate journal resolved by journaling the metadata ops that were not protected / covered by standard softupdate . See http://jeffr-tech.livejournal.com/24357.html gjournal recommends using async, because it takes care of the rest. my tests using pendrive as log device (slow but OK) confirmed my opinion, at least roughly. SSDs are not expensive today. i can get 128GB SSD and create 20GB journal just to limit wear. and possibly use the rest of SSD to store read-intensive data. I wonder if how trim / no trim effects the journal wear . not at all. gjournal writes sequentially. best case for SSD - just write subsequent flash blocks and older gets freed completely and erase it. gjournal doesn't seem to be elegant in case of journal failure (i simulated it with forced removal of ramdisk with mdconfig). TONS of messages in logs, but still - no data loss, just you have to shutdown system, boot from pendrive, remove journal, fsck (just for sure), and then add journal again I would be careful of using the md for the journal . Something makes me think it will play nicer when you remove that then a real failure . Try a USB stick for the journal; tried. same results. md was only for testing, doesn't make any sense in production setup as it's volatile. Also when testing su+j I ran the following test case . Extract ports via portsnap extract , build world with -j4 . Let the box warm up the yank the power and then boot the box back up and see what happens . and? didn't you end with empty - but existing - object files that make things it is properly compiled programs? ___ freebsd-hackers@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-hackers To unsubscribe, send any mail to freebsd-hackers-unsubscr...@freebsd.org
lots of network interfaces
are there any scalability limits in case of lots of network interfaces. i am asking for ca 800 tun(4) interfaces active but no more than 250Mbit/s over them total. ___ freebsd-hackers@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-hackers To unsubscribe, send any mail to freebsd-hackers-unsubscr...@freebsd.org
Re: gjournal +UFS - anyone actually use it?
I was using it to store large MySQL myisam tables , speed was acceptable at the time . I never had any fs corruption and it worked as expected . At the time I set it up I remember there was some chatter about how slow gjournal was compared to ufs with softupdate . did some tests yesterday on 25GB partition. i simulated journal on SSD using 2GB malloc backed ramdisk (md0). UFS partition mounted async as gjournal recommends. test: unpacking kernel sources to multiple directories until disk gets full simulates write heavy I/O. gjournal+SATA drive (seagate constellation ES 500GB) with write cache disabled - 14 minutes 20 seconds. write cache enabled - 14 minutes 5 seconds (nearly no difference). UFS+journalled softupdates, no gjournal, disk write cache on - 26 minutes 44 seconds. disk write cache off - was too lazy to wait after an hour. With gjournal it is not only faster, but it doesn't make other I/O activity crawling. Fast forward to today I almost always use ufs with softupdate journal , new in FreeBSD 9.0 and available as a patch to 6.x, 7.x , and 8.x The problem is as follows: SU+J makes sure that metadata will get consistent. NOT DATA. And this is quite a mess if you get UPS failure under high load. gjournal does journal everything. This is better supported now , as more people use it in new 9.x builds . i think about journal on SSD. I believe this is only and option in geom journal , SSDs are not expensive today. i can get 128GB SSD and create 20GB journal just to limit wear. and possibly use the rest of SSD to store read-intensive data. the way gjournal writes to journal device (sequential) is very friendly for SSD too. Small SLC-based SSD would be best but i don't see anything on the market with acceptable price for now. I am not sure if you can relocate a suj journal to an alternate disk. no you can't. But still you will end with consistent metadata but not consistent data. I recovered it but still it took a time and lots of checking. gjournal doesn't seem to be elegant in case of journal failure (i simulated it with forced removal of ramdisk with mdconfig). TONS of messages in logs, but still - no data loss, just you have to shutdown system, boot from pendrive, remove journal, fsck (just for sure), and then add journal again ___ freebsd-hackers@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-hackers To unsubscribe, send any mail to freebsd-hackers-unsubscr...@freebsd.org
gjournal +UFS - anyone actually use it?
if yes - how about performance on production server. i think about journal on SSD. ___ freebsd-hackers@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-hackers To unsubscribe, send any mail to freebsd-hackers-unsubscr...@freebsd.org
Re: attaching iscsi (or ggate) disk before mounting root
thank you very much. i solved that problem other way, finally ending in NFS root. but i still need raw block device as swap device, which will (rarely) be in active use. What do you recommend - iscsi or geom_gate. the latter is 100 times more simple, and i like simple solutions. but geom_gate use userland process for I/O. Does it make a risk of deadlock? is iscsi deadlock free too? i mean iscsi in kernel needs to allocate memory to perform swapout, but it have to wait for free memory, but memory will not be freed until swapout is done. ___ freebsd-hackers@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-hackers To unsubscribe, send any mail to freebsd-hackers-unsubscr...@freebsd.org
attaching iscsi (or ggate) disk before mounting root
how to do it? ___ freebsd-hackers@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-hackers To unsubscribe, send any mail to freebsd-hackers-unsubscr...@freebsd.org
TFTP single file kernel load
can it be done? converting ELF kernel (i don't use kld modules) to format that can be loaded directly over TFTP - without intermediate stages like loader(8)? just to have SINGLE FILE that tftp would load and run. no loader(8) etc. ___ freebsd-hackers@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-hackers To unsubscribe, send any mail to freebsd-hackers-unsubscr...@freebsd.org
Re: TFTP single file kernel load
Basically what needs doing is to link the kernel with a modified ldscript that doesn't add space for the program headers, and then run the output of that link through objcopy -S -O binary to create a kernel.bin file. That file can be directly loaded to the address it was linked for, and a jump to the load address launches the kernel. is btxld(8) a tool i have to use after making kernel.bin file? what should i use for -b and -l Whether the kernel runs properly when launched that way is a different question. An arm kernel will run that way because we haven't had the luxury of loader(8) in the arm world until recently. The x86 kernel may expect values in the environment that the loader obtained from the bios. it can be loaded without loader for now - if you press a key before loader(8) is loaded and enter kernel image. at least it was like that. ___ freebsd-hackers@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-hackers To unsubscribe, send any mail to freebsd-hackers-unsubscr...@freebsd.org
Sound driver for Wyse S50
with Geode CS5535 processor. any idea? tried kldload every driver from generic kernel - nothing attaches. no support or is there a support just not in base system? ___ freebsd-hackers@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-hackers To unsubscribe, send any mail to freebsd-hackers-unsubscr...@freebsd.org
blocking teamviewer trojan
anyone have tested method on doing this? tried blocking port 5938 as well as teamviewer.com domain in squid (and all port 80 traffic is already forwarded to squid). Still doesn't work. thanks for any help. ___ freebsd-hackers@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-hackers To unsubscribe, send any mail to freebsd-hackers-unsubscr...@freebsd.org
Re: blocking teamviewer trojan
sorry for polluting a list. i've got somewhat worried about general human stupidity. On Thu, 21 Feb 2013, Chris Rees wrote: On 21 Feb 2013 16:22, Wojciech Puchar woj...@wojtek.tensor.gdynia.pl wrote: anyone have tested method on doing this? tried blocking port 5938 as well as teamviewer.com domain in squid (and all port 80 traffic is already forwarded to squid). Still doesn't work. thanks for any help. You would have better luck on a Windows security list. This list is for development of FreeBSD. Chris ___ freebsd-hackers@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-hackers To unsubscribe, send any mail to freebsd-hackers-unsubscr...@freebsd.org
Re: Chicken and egg, encrypted root FS on remote server
Geli can ask for a root password at the console to unlock the root fs but that of course won't work for a remote server. Ideally I'd like the server to start, do minimal network config, run a minimal ssh client (dropbear?) and wait for someone to log in, provide the passphrase to unlock the root filesystem and then mount the root filesystem and do a normal startup. I read about a pivotroot call in other OS-es, that would allow for a too much complexity. just make simple small partition with OS installed, and just sshd and maybe few (not requiring security) things services running, then log in, geli attach main partition, fsck and mount and then run other services. make script for it. that's all ___ freebsd-hackers@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-hackers To unsubscribe, send any mail to freebsd-hackers-unsubscr...@freebsd.org
rsh/rlogin strange behavior
i use rsh/rlogin regularly within LAN and over encrypted tunnels it works generally fine but have strange behavior when i output long amount of text in console (eg. cat bigfile), where long is like 20kB it a) display part of it and hangs (i have to kill rlogin) - rarely b) display part of it and rest is skipped. then i can work normally. ssh doesn't have such a problem. what is wrong? ___ freebsd-hackers@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-hackers To unsubscribe, send any mail to freebsd-hackers-unsubscr...@freebsd.org
RE: rsh/rlogin strange behavior
repeat 100 rsh host date HINT: Set yourself up in /etc/hosts.equiv on host for password-less entry Repeat about 5 or 6 times and then eventually the connection will hang and you won't be able to make more connections for some time. Next step? Execute netstat -an | less and look for oddities (like a mass pile of FIN_WAIT_2 connections). In our case (ymmv) the final ACK was not being sent leaving the client side stacking up a bunch of connections that take msl.timeout time to expire (iirc). If I do remember correctly the problem happened when the server was using an em(4) driver. Our ultimate solution was to either switch critical servers to fxp(4) based hardware or roll entire sites over to using key-based SSH (which may work for you -- have you thought about giving ssh-keygen a try? that is, if you're using rsh for the convenience of password-less entry via hosts.equiv for example). -- it is FreeBSD 9, em or re or bge hardware but rlogin goes over tun(4) interface. in the same time rcp works fine even for gigabyte file. any more ideas? ___ freebsd-hackers@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-hackers To unsubscribe, send any mail to freebsd-hackers-unsubscr...@freebsd.org
RE: rsh/rlogin strange behavior
systat -iostat 1 not a disk for sure. not even use everything needed already cached netstat 1 # netstat -I tun3 1 input (tun3) output packets errs idrops bytespackets errs bytes colls 1 0 0 52 1 0173 0 1 0 0 52 1 0121 0 2 0 0104 2 0201 0 1 0 0 52 2 0201 0 5 0 0263 3 0254 0 1 0 0 52 1 0121 0 1 0 0 52 1 0121 0 12 0 0628 17 0 16452 0 4 0 0208 4 0473 0 5 0 0263 4 0950 0 23 0 0 1202 30 0 32656 0 50 0 0 2619 76 0 81661 0 41 0 0 2148 60 0 65301 0 43 0 0 2252 61 0 65353 0 45 0 0 2356 62 0 65433 0 45 0 0 2356 62 0 65433 0 43 0 0 2252 61 0 65353 0 44 0 0 2305 61 0 65353 0 11 0 0575 16 0 16429 0 5 0 0260 5 0553 0 and that's it. seems fine. strange observation - usually first time it trims part of output. second or third is good. ___ freebsd-hackers@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-hackers To unsubscribe, send any mail to freebsd-hackers-unsubscr...@freebsd.org
disk errors on heavy write I/O
when doing lots of writes (large file) after few tens of gigabytes i've got as below. smartctl -t long (full surface test) reports no errors my disk is ada0 at ahcich0 bus 0 scbus0 target 0 lun 0 ada0: SAMSUNG HD154UI 1AG01118 ATA-7 SATA 2.x device ada0: 300.000MB/s transfers (SATA 2.x, UDMA6, PIO 8192bytes) ada0: Command Queueing enabled ada0: 1430799MB (2930277168 512 byte sectors: 16H 63S/T 16383C) i have the same drive model at other place, and got into the same situation once. any ideas what it is. i cannot find any firmware update. Feb 13 18:29:20 wojtek kernel: ahcich0: Timeout on slot 25 port 0 Feb 13 18:29:20 wojtek kernel: ahcich0: is cs fdff ss rs tfd c0 serr cmd da17 Feb 13 18:29:20 wojtek kernel: (ada0:ahcich0:0:0:0): WRITE_FPDMA_QUEUED. ACB: 61 00 b0 9c bf 40 02 00 00 08 00 00 Feb 13 18:29:20 wojtek kernel: (ada0:ahcich0:0:0:0): CAM status: Command timeout Feb 13 18:29:20 wojtek kernel: (ada0:ahcich0:0:0:0): Retrying command Feb 13 18:29:20 wojtek kernel: (ada0:ahcich0:0:0:0): WRITE_FPDMA_QUEUED. ACB: 61 20 10 74 0a 40 02 00 00 00 00 00 Feb 13 18:29:20 wojtek kernel: (ada0:ahcich0:0:0:0): CAM status: CCB request was invalid Feb 13 18:29:20 wojtek kernel: (ada0:ahcich0:0:0:0): Error 22, Unretryable error Feb 13 18:29:20 wojtek kernel: (ada0:ahcich0:0:0:0): WRITE_FPDMA_QUEUED. ACB: 61 20 d0 31 10 40 02 00 00 00 00 00 Feb 13 18:29:20 wojtek kernel: g_vfs_done():(ada0:ahcich0:0:0:0): CAM status: CCB request was invalid Feb 13 18:29:20 wojtek kernel: ada0a[WRITE(offset=17530617856, length=16384)]error = 22 Feb 13 18:29:20 wojtek kernel: (ada0:ahcich0:0:0:0): Error 22, Unretryable error Feb 13 18:29:20 wojtek kernel: (ada0:ahcich0:0:0:0): WRITE_FPDMA_QUEUED. ACB: 61 20 90 ef 15 40 02 00 00 00 00 00 Feb 13 18:29:20 wojtek kernel: g_vfs_done():(ada0:ahcich0:0:0:0): CAM status: CCB request was invalid Feb 13 18:29:20 wojtek kernel: ada0a[WRITE(offset=17723260928, length=16384)]error = 22 Feb 13 18:29:20 wojtek kernel: (ada0:ahcich0:0:0:0): Error 22, Unretryable error Feb 13 18:29:20 wojtek kernel: (ada0:ahcich0:0:0:0): WRITE_FPDMA_QUEUED. ACB: 61 20 50 ad 1b 40 02 00 00 00 00 00 Feb 13 18:29:20 wojtek kernel: g_vfs_done():(ada0:ahcich0:0:0:0): CAM status: CCB request was invalid Feb 13 18:29:20 wojtek kernel: ada0a[WRITE(offset=17915904000, length=16384)]error = 22 Feb 13 18:29:20 wojtek kernel: (ada0:ahcich0:0:0:0): Error 22, Unretryable error Feb 13 18:29:20 wojtek kernel: (ada0:ahcich0:0:0:0): WRITE_FPDMA_QUEUED. ACB: 61 20 10 6b 21 40 02 00 00 00 00 00 Feb 13 18:29:20 wojtek kernel: g_vfs_done():(ada0:ahcich0:0:0:0): CAM status: CCB request was invalid Feb 13 18:29:20 wojtek kernel: ada0a[WRITE(offset=18108547072, length=16384)]error = 22 Feb 13 18:29:20 wojtek kernel: (ada0:ahcich0:0:0:0): Error 22, Unretryable error Feb 13 18:29:20 wojtek kernel: (ada0:ahcich0:0:0:0): WRITE_FPDMA_QUEUED. ACB: 61 20 d0 28 27 40 02 00 00 00 00 00 Feb 13 18:29:20 wojtek kernel: g_vfs_done():(ada0:ahcich0:0:0:0): CAM status: CCB request was invalid Feb 13 18:29:20 wojtek kernel: ada0a[WRITE(offset=18301190144, length=16384)]error = 22 Feb 13 18:29:20 wojtek kernel: (ada0:ahcich0:0:0:0): Error 22, Unretryable error Feb 13 18:29:20 wojtek kernel: (ada0:ahcich0:0:0:0): WRITE_FPDMA_QUEUED. ACB: 61 20 90 e6 2c 40 02 00 00 00 00 00 Feb 13 18:29:20 wojtek kernel: g_vfs_done():(ada0:ahcich0:0:0:0): CAM status: CCB request was invalid Feb 13 18:29:20 wojtek kernel: ada0a[WRITE(offset=18493833216, length=16384)]error = 22 Feb 13 18:29:20 wojtek kernel: (ada0:ahcich0:0:0:0): Error 22, Unretryable error Feb 13 18:29:20 wojtek kernel: (ada0:ahcich0:0:0:0): WRITE_FPDMA_QUEUED. ACB: 61 20 50 a4 32 40 02 00 00 00 00 00 Feb 13 18:29:20 wojtek kernel: g_vfs_done():(ada0:ahcich0:0:0:0): CAM status: CCB request was invalid Feb 13 18:29:20 wojtek kernel: ada0a[WRITE(offset=18686476288, length=16384)]error = 22 Feb 13 18:29:20 wojtek kernel: (ada0:ahcich0:0:0:0): Error 22, Unretryable error Feb 13 18:29:20 wojtek kernel: (ada0:ahcich0:0:0:0): WRITE_FPDMA_QUEUED. ACB: 61 20 10 62 38 40 02 00 00 00 00 00 Feb 13 18:29:20 wojtek kernel: g_vfs_done():(ada0:ahcich0:0:0:0): CAM status: CCB request was invalid Feb 13 18:29:20 wojtek kernel: ada0a[WRITE(offset=18879119360, length=16384)]error = 22 Feb 13 18:29:20 wojtek kernel: (ada0:ahcich0:0:0:0): Error 22, Unretryable error Feb 13 18:29:20 wojtek kernel: (ada0:ahcich0:0:0:0): WRITE_FPDMA_QUEUED. ACB: 61 20 d0 1f 3e 40 02 00 00 00 00 00 Feb 13 18:29:20 wojtek kernel: g_vfs_done():(ada0:ahcich0:0:0:0): CAM status: CCB request was invalid Feb 13 18:29:20 wojtek kernel: ada0a[WRITE(offset=19071762432, length=16384)]error = 22 Feb 13 18:29:20 wojtek kernel: (ada0:ahcich0:0:0:0): Error 22, Unretryable error Feb 13 18:29:20 wojtek kernel: (ada0:ahcich0:0:0:0): WRITE_FPDMA_QUEUED. ACB: 61 20 90 dd 43 40 02 00 00 00 00 00 Feb 13 18:29:20 wojtek kernel: g_vfs_done():(ada0:ahcich0:0:0:0): CAM status: CCB
Re: building select ports for packaging on install media
cdrom. What I'd like to do is augement that CD-ROM image with several binary packages, so I can just install them via 'sysinstall', rather than having to maintain a /usr/ports tree on every host and compile the same software again and again... why not just use pkg_add? ___ freebsd-hackers@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-hackers To unsubscribe, send any mail to freebsd-hackers-unsubscr...@freebsd.org
gstripe
option -s stripe size - what is stripe size? if i stripped 4 devices with -s $[512*1024*1024] then does it mean that 1) it will take 512MB from device 1, then 512MB from device 2, then 512MB from device 3 then 512MB from device 4 or 2) it will take 128MB from each for 512MB total ___ freebsd-hackers@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-hackers To unsubscribe, send any mail to freebsd-hackers-unsubscr...@freebsd.org
receiving aerial digital TV
i am out of current knowledge about common TV for about 10 years. Currently in Poland there is aerial TV broadcasted in DVB-T standard. There are TVs with builtin decoder/demodulator or separate decoders/demodulator with HDMI output. But how about just receiving demodulated data and letting mplayer play it, and - most importantly - recording it directly. I know there are USB receivers on market. Are such devices supported under FreeBSD? if so - what driver, what chipset to look when buying such a thing? any other recommendation. With analog TV broadcast there were PCI cards with brooktree chipset that worked with FreeBSD. Thank you very much ___ freebsd-hackers@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-hackers To unsubscribe, send any mail to freebsd-hackers-unsubscr...@freebsd.org
HDD write cache
after reading quite recent topics about disabling/enabling write cache, i tried to test in on desktop 3.5 drive kern.cam.ada.write_cache: 1 kern.cam.ada.read_ahead: 1 kern.cam.ada.0.read_ahead: -1 kern.cam.ada.0.write_cache: -1 i tried writing 1 or 0 to kern.cam.ada.0.write_cache, and there were exactly no differences at all, and disk seems to do always write caching. Does that drive lie and ignore commands or i do it wrong? this is my disk. ada0 at ahcich0 bus 0 scbus0 target 0 lun 0 ada0: SAMSUNG HD501LJ CR100-10 ATA-8 SATA 2.x device ada0: 300.000MB/s transfers (SATA 2.x, UDMA6, PIO 8192bytes) ada0: Command Queueing enabled ada0: 476940MB (976773168 512 byte sectors: 16H 63S/T 16383C) ___ freebsd-hackers@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-hackers To unsubscribe, send any mail to freebsd-hackers-unsubscr...@freebsd.org
Re: HDD write cache
registered. Try setting the values in /boot/loader.conf if you haven't already? You can check the actual status of the disk itself using:- camcontrol identify ada0 this proved your statement. will check it out at next reboot. Regards Steve - Original Message - From: Wojciech Puchar woj...@wojtek.tensor.gdynia.pl To: freebsd-hackers@freebsd.org Sent: Friday, February 01, 2013 2:26 PM Subject: HDD write cache after reading quite recent topics about disabling/enabling write cache, i tried to test in on desktop 3.5 drive kern.cam.ada.write_cache: 1 kern.cam.ada.read_ahead: 1 kern.cam.ada.0.read_ahead: -1 kern.cam.ada.0.write_cache: -1 i tried writing 1 or 0 to kern.cam.ada.0.write_cache, and there were exactly no differences at all, and disk seems to do always write caching. Does that drive lie and ignore commands or i do it wrong? this is my disk. ada0 at ahcich0 bus 0 scbus0 target 0 lun 0 ada0: SAMSUNG HD501LJ CR100-10 ATA-8 SATA 2.x device ada0: 300.000MB/s transfers (SATA 2.x, UDMA6, PIO 8192bytes) ada0: Command Queueing enabled ada0: 476940MB (976773168 512 byte sectors: 16H 63S/T 16383C) ___ freebsd-hackers@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-hackers To unsubscribe, send any mail to freebsd-hackers-unsubscr...@freebsd.org This e.mail is private and confidential between Multiplay (UK) Ltd. and the person or entity to whom it is addressed. In the event of misdirection, the recipient is prohibited from using, copying, printing or otherwise disseminating it or any information contained in it. In the event of misdirection, illegible or incomplete transmission please telephone +44 845 868 1337 or return the E.mail to postmas...@multiplay.co.uk. ___ freebsd-hackers@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-hackers To unsubscribe, send any mail to freebsd-hackers-unsubscr...@freebsd.org
Re: HDD write cache
Investigating a bit more a device reset will also trigger the change so after changing the value you can use camcontrol reset to trigger the change to apply using e.g. camcontrol reset 0:0:0 THIS actually work. And the results are disastrous. in spite of NCQ working and fully filled, when unpacking source tree (as a test) onto UFS filesystem gstat shows at most 100 IOPS, and average 700 with write cache disabled. this is on / partition that spans 1/10 of disk. Drive can actually manage multiple writes in short distance well with write cache enabled. While this is stated in the man for ada its not obvious that changing the sysctl without a reset won't work, so you might want to raise a PR about it. Regards Steve - Original Message - From: Steven Hartland Looking at the cam ata code I can't see how those values would do anything after booting. I suspect they should be loader only tunables with the current code and cant be changed on the fly for a disk that's already been registered. Try setting the values in /boot/loader.conf if you haven't already? You can check the actual status of the disk itself using:- camcontrol identify ada0 Regards Steve - Original Message - From: Wojciech Puchar after reading quite recent topics about disabling/enabling write cache, i tried to test in on desktop 3.5 drive kern.cam.ada.write_cache: 1 kern.cam.ada.read_ahead: 1 kern.cam.ada.0.read_ahead: -1 kern.cam.ada.0.write_cache: -1 i tried writing 1 or 0 to kern.cam.ada.0.write_cache, and there were exactly no differences at all, and disk seems to do always write caching. Does that drive lie and ignore commands or i do it wrong? this is my disk. ada0 at ahcich0 bus 0 scbus0 target 0 lun 0 ada0: SAMSUNG HD501LJ CR100-10 ATA-8 SATA 2.x device ada0: 300.000MB/s transfers (SATA 2.x, UDMA6, PIO 8192bytes) ada0: Command Queueing enabled ada0: 476940MB (976773168 512 byte sectors: 16H 63S/T 16383C) This e.mail is private and confidential between Multiplay (UK) Ltd. and the person or entity to whom it is addressed. In the event of misdirection, the recipient is prohibited from using, copying, printing or otherwise disseminating it or any information contained in it. In the event of misdirection, illegible or incomplete transmission please telephone +44 845 868 1337 or return the E.mail to postmas...@multiplay.co.uk. ___ freebsd-hackers@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-hackers To unsubscribe, send any mail to freebsd-hackers-unsubscr...@freebsd.org ___ freebsd-hackers@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-hackers To unsubscribe, send any mail to freebsd-hackers-unsubscr...@freebsd.org
Xorg help
long time ago with CRT monitors i used xvidtune and defined my modeline based on existing one. With LCD laptop Xorg automatically selected good one. Now with desktop and new LG monitor capable of 1920x1080 it uses 1024x768 no possible modelines are displayed and i have no idea how to set it properly. It is LG Flatron E2211 if it helps. What driver should i use with Atom D525? xf86-video-intel29 is the only one that works, in spite of market as not supported. Or am i missing something? .. .. . (--) PCI:*(0:0:2:0) 8086:a001:8086:574d Intel Corporation N10 Family Integrated Graphics Controller rev 2, Mem @ 0xf020/524288, 0xe000/268435456, 0xf010/1048576, I/O @ 0x20c0/8, BIOS @ 0x/65536 (II) extmod will be loaded. This was enabled by default and also specified in the config file. (II) dbe will be loaded. This was enabled by default and also specified in the config file. (II) glx will be loaded. This was enabled by default and also specified in the config file. (II) record will be loaded. This was enabled by default and also specified in the config file. (II) dri will be loaded. This was enabled by default and also specified in the config file. (II) dri2 will be loaded. This was enabled by default and also specified in the config file. . . . (II) LoadModule: intel (II) Loading /usr/local/lib/xorg/modules/drivers/intel_drv.so (II) Module intel: vendor=X.Org Foundation compiled for 1.7.7, module version = 2.9.1 Module class: X.Org Video Driver ABI class: X.Org Video Driver, version 6.0 . . . (==) intel(0): RGB weight 888 (==) intel(0): Default visual is TrueColor (II) intel(0): Integrated Graphics Chipset: Intel(R) Pineview G (--) intel(0): Chipset: Pineview G (--) intel(0): Linear framebuffer at 0xE000 (--) intel(0): IO registers at addr 0xF020 size 524288 (II) intel(0): No SDVO device is found in VBT (II) intel(0): 2 display pipes available. ___ freebsd-hackers@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-hackers To unsubscribe, send any mail to freebsd-hackers-unsubscr...@freebsd.org
Re: Xorg help
xf86-video-intel29 is not supported. It was used for a short time when gem/kms was still developed. I have no idea what graphics card your atom comes with, it has integrated graphics, but you have to find out vgapci0@pci0:0:2:0: class=0x03 card=0x574d8086 chip=0xa0018086 rev=0x02 hdr=0x00 vendor = 'Intel Corporation' device = 'N10 Family Integrated Graphics Controller' class = display subclass = VGA which exact version it is. In general, for newer intel graphics cards, the best is to use the new xorg distribution, that should give you hardware acceleration. Otherwise you can try xf86-video-intel in the old xorg distribution, but the risk is that it will revert back to using xf86-video-intel will turn whole screen off and run at 100% CPU (checked by logging from other machine), then only reboot will get display back. ___ freebsd-hackers@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-hackers To unsubscribe, send any mail to freebsd-hackers-unsubscr...@freebsd.org
Re: Xorg help
What driver should i use with Atom D525? xf86-video-intel29 is the only one that works, in spite of market as not supported. Citing https://wiki.freebsd.org/Intel_GPU Required usermode components are available in the ports tree, you need to add WITH_NEW_XORG=true and WITH_KMS=true to /etc/make.conf. the driver you should use is xf86-video-intel (rebuild X/kernel if you just changed make.conf) I'm not sure if this is reqired, but my kernel has device i915kms and device drm. With this configuration intel works perfectly. thank you very much. you mean rebuilding X server, X libraries or just xf86-video-intel and kernel? ___ freebsd-hackers@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-hackers To unsubscribe, send any mail to freebsd-hackers-unsubscr...@freebsd.org
RE: Xorg help
Hi, We use LG Flatron at $work (tho not wide-aspect like the model you mention -- read: we run our LG Flatron LCDs at 1600x1200). I've had a little experience in working on higher definitions tho (like 1920x1080). Very first thing I do is I run xrandr with no arguments to see if the mode that I want is listed and available, just not used. If the resolution you want is listed in the xrandr output, then switching to it is as simple as running xrandr --size WxH where W is pixel-width and H is pixel-height (e.g. xrandr --size 1920x1080). After which, you can make this mode your default by adding the following to the appropriate Display subsection in /etc/X11/xorg.conf: Modes 1920x1080 thanks for all help. now server runs with i915kms, but still required Modes 1920x1080 to turn it. By default it still used 1024x768 no idea why autodetect doesn't work. but works fine manually. thank you LVDS1 connected 1280x800+0+0 (normal left inverted right x axis y axis) 0mm x 0mm 1280x800 58.1*+ 1024x768 85.0 75.0 70.1 60.0 43.5 832x62474.6 800x60085.1 72.2 75.0 60.3 56.2 640x48085.0 72.8 75.0 59.9 720x40085.0 640x40085.1 640x35085.1 VGA1 connected 1920x1080+0+0 (normal left inverted right x axis y axis) 477mm x 268mm 1920x1080 60.0*+ 1680x1050 60.0 1280x1024 75.0 60.0 1152x864 75.0 1024x768 75.1 60.0 800x60075.0 60.3 640x48075.0 60.0 720x40070.1 ___ freebsd-hackers@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-hackers To unsubscribe, send any mail to freebsd-hackers-unsubscr...@freebsd.org
Re: ZFS regimen: scrub, scrub, scrub and scrub again.
here is my real world production example of users mail as well as documents. /dev/mirror/home1.eli 2788 1545 1243 55% 1941057 20981181 8% /home Not the same data, I imagine. A mix. 90% Mailboxes and user data (documents, pictures), rest are some .tar.gz backups. At other places i have similar situation. one or more gmirror sets, 1-3TB each depends on drives. For those who puts 1000 of mailboxes i recommend dovecot with mdbox storage backend I was dealing with the actual byte counts ... that figure is going to be in whole blocks. ___ freebsd-hackers@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-hackers To unsubscribe, send any mail to freebsd-hackers-unsubscr...@freebsd.org
Re: ZFS regimen: scrub, scrub, scrub and scrub again.
then stored on a different disk. You could think of it as a regular RAID-5 with stripe size of 32768 bytes. PostgreSQL uses 8192 byte pages that fit evenly both into ZFS record size and column size. Each page access requires only a single disk read. Random i/o performance here should be 5 times that of a single disk. think about writing 8192 byte pages randomly. and then doing linear search over table. For me the reliability ZFS offers is far more important than pure performance. Except it is on paper reliability. ___ freebsd-hackers@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-hackers To unsubscribe, send any mail to freebsd-hackers-unsubscr...@freebsd.org
Re: ZFS regimen: scrub, scrub, scrub and scrub again.
several small files at once, does the transaction use a record, or does each file need to use a record? Additionally, if small files use sub-records, when you delete that file, does the sub-record get moved or just wasted (until the record is completely free)? writes of small files are always good with ZFS. ___ freebsd-hackers@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-hackers To unsubscribe, send any mail to freebsd-hackers-unsubscr...@freebsd.org
Re: ZFS regimen: scrub, scrub, scrub and scrub again.
So far I've not lost a single ZFS pool or any data stored. so far my house wasn't robbed. ___ freebsd-hackers@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-hackers To unsubscribe, send any mail to freebsd-hackers-unsubscr...@freebsd.org
Re: ZFS regimen: scrub, scrub, scrub and scrub again.
There are 3,236,316 files summing to 97,500,008,691 bytes. That puts the average file at 30,127 bytes. But for the full breakdown: quite low. what do you store. here is my real world production example of users mail as well as documents. /dev/mirror/home1.eli 2788 1545 124355% 1941057 209811818% /home ___ freebsd-hackers@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-hackers To unsubscribe, send any mail to freebsd-hackers-unsubscr...@freebsd.org
Re: ZFS regimen: scrub, scrub, scrub and scrub again.
While RAID-Z is already a king of bad performance, I don't believe RAID-Z is any worse than RAID5. Do you have any actual measurements to back up your claim? it is clearly described even in ZFS papers. Both on reads and writes it gives single drive random I/O performance. ___ freebsd-hackers@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-hackers To unsubscribe, send any mail to freebsd-hackers-unsubscr...@freebsd.org
Re: ZFS regimen: scrub, scrub, scrub and scrub again.
This is because RAID-Z spreads each block out over all disks, whereas RAID5 (as it is typically configured) puts each block on only one disk. So to read a block from RAID-Z, all data disks must be involved, vs. for RAID5 only one disk needs to have its head moved. For other workloads (especially streaming reads/writes), there is no fundamental difference, though of course implementation quality may vary. streaming workload generally is always good. random I/O is what is important. ___ freebsd-hackers@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-hackers To unsubscribe, send any mail to freebsd-hackers-unsubscr...@freebsd.org
Re: ZFS regimen: scrub, scrub, scrub and scrub again.
I've heard this same thing -- every vdev == 1 drive in performance. I've never seen any proof/papers on it though. read original ZFS papers. ___ freebsd-hackers@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-hackers To unsubscribe, send any mail to freebsd-hackers-unsubscr...@freebsd.org
Re: ZFS regimen: scrub, scrub, scrub and scrub again.
gives single drive random I/O performance. For reads - true. For writes it's probably behaves better than RAID5 yes, because as with reads it gives single drive performance. small writes on RAID5 gives lower than single disk performance. If you need higher performance, build your pool out of multiple RAID-Z vdevs. even you need normal performance use gmirror and UFS ___ freebsd-hackers@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-hackers To unsubscribe, send any mail to freebsd-hackers-unsubscr...@freebsd.org
Re: ZFS regimen: scrub, scrub, scrub and scrub again.
1 drive in performance only applies to number of random i/o operations vdev can perform. You still get increased throughput. I.e. 5-drive RAIDZ will have 4x bandwidth of individual disks in vdev, but unless your work is serving movies it doesn't matter. ___ freebsd-hackers@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-hackers To unsubscribe, send any mail to freebsd-hackers-unsubscr...@freebsd.org
Re: ZFS regimen: scrub, scrub, scrub and scrub again.
associated with mirroring. Thanks for the link, but I could have done that; I am attempting to explain to Wojciech that his habit of making bold assertions and as you can see it is not a bold assertion, just you use something without even reading it's docs. Not mentioning doing any more research. ___ freebsd-hackers@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-hackers To unsubscribe, send any mail to freebsd-hackers-unsubscr...@freebsd.org
Re: ZFS regimen: scrub, scrub, scrub and scrub again.
even you need normal performance use gmirror and UFS I've no objection. If it works for you -- go for it. both works. For todays trend of solving everything by more hardware ZFS may even have enough performance. But still it is dangerous for a reasons i explained, as well as it promotes bad setups and layouts like making single filesystem out of large amount of disks. This is bad for no matter what filesystem and RAID setup you use, or even what OS. ___ freebsd-hackers@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-hackers To unsubscribe, send any mail to freebsd-hackers-unsubscr...@freebsd.org
Re: ZFS regimen: scrub, scrub, scrub and scrub again.
Please don't misinterpret this post: ZFS's ability to recover from fairly catastrophic failures is pretty stellar, but I'm wondering if there can be from my testing it is exactly opposite. You have to see a difference between marketing and reality. a little room for improvement. I use RAID pretty much everywhere. I don't like to loose data and disks are cheap. I have a fair amount of experience with all flavors ... and ZFS just like me. And because i want performance and - as you described - disks are cheap - i use RAID-1 (gmirror). has become a go-to filesystem for most of my applications. My applications doesn't tolerate low performance, overcomplexity and high risk of data loss. That's why i use properly tuned UFS, gmirror, and prefer not to use gstripe but have multiple filesystems One of the best recommendations I can give for ZFS is it's crash-recoverability. Which is marketing, not truth. If you want bullet-proof recoverability, UFS beats everything i've ever seen. If you want FAST crash recovery, use softupdates+journal, available in FreeBSD 9. As a counter example, if you have most hardware RAID going or a software whole-disk raid, after a crash it will generally declare one disk as good and the other disk as to be repaired ... after which a full surface scan of the affected disks --- reading one and writing the other --- ensues. true. gmirror do it, but you can defer mirror rebuild, which i use. I have a script that send me a mail when gmirror is degraded, and i - after finding out the cause of problem, and possibly replacing disk - run rebuild after work hours, so no slowdown is experienced. ZFS is smart on this point: it will recover on reboot with a minimum amount of fuss. Even if you dislodge a drive ... so that it's missing the last 'n' transactions, ZFS seems to figure this out (which I thought was extra cudos). Yes this is marketing. practice is somehow different. as you discovered yourself. MY PROBLEM comes from problems that scrub can fix. Let's talk, in specific, about my home array. It has 9x 1.5T and 8x 2T in a RAID-Z configuration (2 sets, obviously). While RAID-Z is already a king of bad performance, i assume you mean two POOLS, not 2 RAID-Z sets. if you mixed 2 different RAID-Z pools you would spread load unevenly and make performance even worse. A full scrub of my drives weighs in at 36 hours or so. which is funny as ZFS is marketed as doing this efficient (like checking only used space). dd if=/dev/disk of=/dev/null bs=2m would take no more than a few hours. and you may do all in parallel. vr2/cvs:0x1c1 Now ... this is just an example: after each scrub, the hex number was seems like scrub simply not do it's work right. before the old error was cleared. Then this new error gets similarly cleared by the next scrub. It seems that if the scrub returned to this new found error after fixing the known errors, this could save whole new scrub runs from being required. Even better - use UFS. For both bullet proof recoverability and performance. If you need help in tuning you may ask me privately. ___ freebsd-hackers@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-hackers To unsubscribe, send any mail to freebsd-hackers-unsubscr...@freebsd.org
Re: IBM blade server abysmal disk write performances
Interesting. Is there a way to tell, other than coming up with some way to actually test it, whether a particular drive waits until my crappy laptop hard drive behave the same no matter if i turn write cache on, off or leave default. seems like it is always on. ___ freebsd-hackers@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-hackers To unsubscribe, send any mail to freebsd-hackers-unsubscr...@freebsd.org
Re: IBM blade server abysmal disk write performances
With SATA vs SAS, the gap is much narrower. The TCQ command set (still used by SAS) is still better than the NCQ command set, but the in what point TCQ is exactly better than SATA NCQ. ___ freebsd-hackers@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-hackers To unsubscribe, send any mail to freebsd-hackers-unsubscr...@freebsd.org
Re: IBM blade server abysmal disk write performances
I've had my share of sudden UPS failures over the years. Probably more everything can fail. That's why serious sysadmins do proper backup, no matter what safety features are used in their servers. ___ freebsd-hackers@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-hackers To unsubscribe, send any mail to freebsd-hackers-unsubscr...@freebsd.org
Re: IBM blade server abysmal disk write performances
Turning the write cache off eliminates the risk of having the write cache on. this sentence sounds like not having a car eliminates a risks of driving. ___ freebsd-hackers@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-hackers To unsubscribe, send any mail to freebsd-hackers-unsubscr...@freebsd.org
Re: IBM blade server abysmal disk write performances
I remember those drives from some 20 years ago. Before that time, SCSI and IDE drives were independently developed and SCSI drives offered way yes. 20 years ago it was true. even in 1995, when i had SCSI controller in my 486 and it was great compared to ATA. today SATA and SAS are mostly the same, just protocol are different. the main difference is that SATA is simpler and have less problems. ___ freebsd-hackers@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-hackers To unsubscribe, send any mail to freebsd-hackers-unsubscr...@freebsd.org
Re: IBM blade server abysmal disk write performances
to be enabled to get any speed-up from tagged commands. This was no risk with SCSI drives, since the cache did not make the drives lye i see no correlation between interface type and possibility of lying about command completion. ___ freebsd-hackers@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-hackers To unsubscribe, send any mail to freebsd-hackers-unsubscr...@freebsd.org
Re: stupid UFS behaviour on random writes
But I doubt that such a change would improve performance in the you doubt but i am sure it would improve it a lot. Just imagine multiple VM images on filesystem, running windoze with 4kB cluster size, each writing something. no matter what is written from within VM it ends up as read followed by write, unless blocks are already in buffer cache. ___ freebsd-hackers@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-hackers To unsubscribe, send any mail to freebsd-hackers-unsubscr...@freebsd.org
Re: IBM blade server abysmal disk write performances
The default value, -1, instructs the driver to leave the STA drives at their configuration default. Often times this means that the MPT BIOS will turn off the write cache on every system boot sequence. IT DOES THIS FOR A GOOD REASON! An enabled write cache is counter to data reliability. Yes, it helps make benchmarks look really good, and it's acceptable if your data can be safely thrown away (for example, you're just caching from a slower source, and the cache can be rebuilt if it gets corrupted). And yes, Linux has many tricks to make this benchmark look really good. The tricks range from buffering the raw device to having 'dd' recognize the requested task and short-circuit the process of going to /dev/null or pulling from /dev/zero. I can't tell you how bogus these tests are and how completely irrelevant they are in predicting actual workload performance. But, I'm not going to stop anyone from trying, so give the above tunable a try and let me know how it works. If computer have UPS then write caching is fine. even if FreeBSD crash, disk would write data___ freebsd-hackers@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-hackers To unsubscribe, send any mail to freebsd-hackers-unsubscr...@freebsd.org
Re: IBM blade server abysmal disk write performances
disk would write data I suspect that I'm encountering situations right now at netflix where this advice is not true. I have drives that are seeing intermittent errors, then being forced into reset after a timeout, and then coming back up with filesystem problems. It's only a suspicion at this point, not a confirmed case. true. I just assumed that anywhere it matters one would use gmirror. As for myself - i always prefer to put different manufacturers drives for gmirror or at least - not manufactured at similar time. 2 fails at the same moment is rather unlikely. Of course - everything is possible so i do proper backups to remote sites. Remote means another city.___ freebsd-hackers@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-hackers To unsubscribe, send any mail to freebsd-hackers-unsubscr...@freebsd.org
Re: IBM blade server abysmal disk write performances
That is incorrect. A UPS reduces the risk, but does not eliminate it. nothing eliminate all risks. But for most applications, you must have the write cache off, and you need queuing (e.g. TCQ or NCQ) for performance. If you have queuing, there is no need to turn the write cache on. did you tested the above claim? i have SATA drives everywhere, all in ahci mode, all with NCQ active. It is inexcusable that FreeBSD defaults to leaving the write cache on for SATA PATA drives. At least the admin can easily fix this by adding hw.ata.wc=0 to /boot/loader.conf. The bigger problem is that FreeBSD does not support queuing on all controllers that support it. i must be happy as i never had a case of not seeing adaX: Command Queueing enabled on my machines. ___ freebsd-hackers@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-hackers To unsubscribe, send any mail to freebsd-hackers-unsubscr...@freebsd.org
Re: IBM blade server abysmal disk write performances
and anyone who enabled SATA WC or complained about I/O slowness would be forced into Siberian salt mines for the remainder of their lives. so reserve a place for me there. ___ freebsd-hackers@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-hackers To unsubscribe, send any mail to freebsd-hackers-unsubscr...@freebsd.org
Re: disadvantages of running 8.3 kernel on freebsd 8.2 system
- What are specific disadvantages that i can see clearly, running 8.3 kernel on freebsd 8.2? no idea. just get latest -8 sources, compile world and kernel and install. all newest and in sync. ___ freebsd-hackers@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-hackers To unsubscribe, send any mail to freebsd-hackers-unsubscr...@freebsd.org
Re: IBM blade server abysmal disk write performances
Note that the driver says Command Queueing enabled without specifying which. If the driver is trying to use SATA's NCQ but the drive only speaks SCSI's TCQ, that could explain it. Or if the TCQ isn't working for some other reason. even without TCQ,NCQ and write cache the write speed is really terrible. ___ freebsd-hackers@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-hackers To unsubscribe, send any mail to freebsd-hackers-unsubscr...@freebsd.org
Re: off topic but no idea where to ask
from first local disk at 0x07c00 and booting as with normal hard drive. instead of pxeboot, try giving /boot/boot0 works, except of delay. fixed from sources for 1s delay :) ___ freebsd-hackers@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-hackers To unsubscribe, send any mail to freebsd-hackers-unsubscr...@freebsd.org
Re: disadvantages of running 8.3 kernel on freebsd 8.2 system
Are you simply apprehensive over the time of buildworld? no idea what you mean - my english isn't perfect. I normally have latest binaries and generic kernel built for FreeBSD 8 which i use on servers (don't upgrade now as it works and there is no need to). I have .tar.gz file with binaries, and compile custom kernel on given machine but with same sys sources. so all always in sync. I once had strange out of sync problems - but with virtualbox kernel module. recompiling this module solved all of them. ___ freebsd-hackers@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-hackers To unsubscribe, send any mail to freebsd-hackers-unsubscr...@freebsd.org
Re: off topic but no idea where to ask
may the source be with you :-) btw, the above works for MBR, if you use GPT then you should use pmbr. they are windoze workstations only. and with FreeBSD i too don't have to use GPT strangeness fortunately. ___ freebsd-hackers@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-hackers To unsubscribe, send any mail to freebsd-hackers-unsubscr...@freebsd.org
stupid UFS behaviour on random writes
create 10GB file (on 2GB RAM machine, with some swap used to make sure little cache would be available for filesystem. dd if=/dev/zero of=file bs=1m count=10k block size is 32KB, fragment size 4k now test random read access to it (10 threads) randomio test 10 0 0 4096 normal result on such not so fast disk in my laptop. 118.5 | 118.5 5.8 82.3 383.2 85.6 |0.0 infnan0.0nan 138.4 | 138.4 3.9 72.2 499.7 76.1 |0.0 infnan0.0nan 142.9 | 142.9 5.4 69.9 297.7 60.9 |0.0 infnan0.0nan 133.9 | 133.9 4.3 74.1 480.1 75.1 |0.0 infnan0.0nan 138.4 | 138.4 5.1 72.1 380.0 71.3 |0.0 infnan0.0nan 145.9 | 145.9 4.7 68.8 419.3 69.6 |0.0 infnan0.0nan systat shows 4kB I/O size. all is fine. BUT random 4kB writes randomio test 10 1 0 4096 total | read: latency (ms) | write:latency (ms) iops | iops minavgmax sdev | iops minavgmax sdev +---+-- 38.5 |0.0 infnan0.0nan | 38.5 9.0 166.5 1156.8 261.5 44.0 |0.0 infnan0.0nan | 44.0 0.1 251.2 2616.7 492.7 44.0 |0.0 infnan0.0nan | 44.0 7.6 178.3 1895.4 330.0 45.0 |0.0 infnan0.0nan | 45.0 0.0 239.8 3457.4 522.3 45.5 |0.0 infnan0.0nan | 45.5 0.1 249.8 5126.7 621.0 results are horrific. systat shows 32kB I/O, gstat shows half are reads half are writes. Why UFS need to read full block, change one 4kB part and then write back, instead of just writing 4kB part? ___ freebsd-hackers@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-hackers To unsubscribe, send any mail to freebsd-hackers-unsubscr...@freebsd.org
Re: stupid UFS behaviour on random writes
I'd argue that using an I/O size smaller than the file system block size is simply sub-optimal and that most apps. don't do random I/O of blocks. OR If you had an app. that does random I/O of 4K blocks (at 4K byte offsets), then using a 4K/1K file system would be better. i can just use raw partition but it isn't about the question. For me it is just clearly suboptimal behavior, but if it cannot be fixed then fine. The case is when you store VM images on filesystem and virtual machine issues writes. Quite common case. ___ freebsd-hackers@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-hackers To unsubscribe, send any mail to freebsd-hackers-unsubscr...@freebsd.org
Re: IBM blade server abysmal disk write performances
1+0 records out 512 bytes transferred in 60.024997 secs (85298 bytes/sec) 1 ops in 60 seconds is practically the definition of a 10k drive. nonsense. ___ freebsd-hackers@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-hackers To unsubscribe, send any mail to freebsd-hackers-unsubscr...@freebsd.org
