Re: [gentoo-user] Running out of space on /var partition
Depending on your available ram and swap space, you might want to mount /var/tmp/portage as tmpfs. My fstab entry shows none/var/tmp/portagetmpfs size=10g,nr_inodes=1m I have 4GB ram, and the speed benefit especially for open/libre-office is quite impressive. The advantage is, that it a) uses only as much of memory as is really used b) you may use mount option -remount to increase the size of the filesystem, and add proper swapfiles if you see that you're running out of space (mkswap, swapon) Greetings, Alex Am Montag, 25. Juli 2011, 12:02:34 schrieb Mick: After some deliberation I've started emerging libreoffice. It gave the usual office suite warnings at the beginning that there isn't enough space in /var (I have 5.8G and it was asking for more than 7G+). Half way through the emerge I noticed that I have only 74M left and is going down fast! O_O OpenOffice was able to emerge in the past using this partition size without a problem. I've flushed logs and what not to free some space, but I'm thinking of extending the partition somehow. I don't run LVM on this machine so that's not a solution for this circumstance. Is there anything I can do with mount --rbind and could I do this in the middle of an emerge? I have another partition with loads of space in it, but it has a different fs on it (reiser4 instead of /var's ext4).
[gentoo-user] wireshark fails. undefined reference to ****
Is anyone else running into this: libtool: link: x86_64-pc-linux-gnu-gcc -DINET6 -D_U_=__attribute__((unused)) -march=native -O2 -pipe -Wall -W -Wextra -Wdeclaration-after-statement -Wendif-labels -Wpointer-arith -Wno-pointer-sign -Warray-bounds -Wcast-align -Wformat-security -I/usr/include -I/usr/local/include -pthread -I/usr/include/gtk-2.0 -I/usr/lib64/gtk-2.0/include -I/usr/include/atk-1.0 -I/usr/include/cairo -I/usr/include/gdk-pixbuf-2.0 -I/usr/include/pango-1.0 -I/usr/include/glib-2.0 -I/usr/lib64/glib-2.0/include -I/usr/include/pixman-1 -I/usr/include/freetype2 -I/usr/include/libpng14 -I/usr/include/libdrm -I/usr/include -Wl,-O1 -Wl,--as-needed -Wl,--as-needed -o .libs/rawshark rawshark-capture-pcap-util-unix.o rawshark-capture-pcap-util.o rawshark-cfile.o rawshark-clopts_common.o rawshark-disabled_protos.o rawshark-packet-range.o rawshark-print.o rawshark-ps.o rawshark-sync_pipe_write.o rawshark-timestats.o rawshark-util.o rawshark-tap-megaco-common.o rawshark-tap-rtp-common.o rawshark-version_info.o rawshark-rawshark.o .libs/rawsharkS.o -Wl,--export-dynamic -pthread -Wl,-rpath -Wl,/usr/lib64 -Wl,--export-dynamic -L/usr/lib -L/usr/local/lib wiretap/.libs/libwiretap.so epan/.libs/libwireshark.so wsutil/.libs/libwsutil.so /usr/lib64/libgmodule-2.0.so -lrt /usr/lib64/libglib-2.0.so -lm -L/usr/lib64 -lpcap /usr/lib64/libgnutls.so -lz -pthread epan/.libs/libwireshark.so: undefined reference to `gcry_md_map_name' epan/.libs/libwireshark.so: undefined reference to `gcry_md_close' epan/.libs/libwireshark.so: undefined reference to `gcry_cipher_setiv' epan/.libs/libwireshark.so: undefined reference to `gcry_cipher_get_algo_keylen' epan/.libs/libwireshark.so: undefined reference to `gcry_cipher_get_algo_blklen' epan/.libs/libwireshark.so: undefined reference to `gcry_md_read' epan/.libs/libwireshark.so: undefined reference to `gcry_pk_decrypt' epan/.libs/libwireshark.so: undefined reference to `gcry_strsource' epan/.libs/libwireshark.so: undefined reference to `gcry_sexp_sprint' epan/.libs/libwireshark.so: undefined reference to `gcry_md_get_algo' epan/.libs/libwireshark.so: undefined reference to `gcry_cipher_setkey' epan/.libs/libwireshark.so: undefined reference to `gcry_cipher_map_name' epan/.libs/libwireshark.so: undefined reference to `gcry_mpi_scan' epan/.libs/libwireshark.so: undefined reference to `gcry_md_setkey' epan/.libs/libwireshark.so: undefined reference to `gcry_md_get_algo_dlen' epan/.libs/libwireshark.so: undefined reference to `gcry_sexp_release' epan/.libs/libwireshark.so: undefined reference to `gcry_md_write' epan/.libs/libwireshark.so: undefined reference to `gcry_strerror' epan/.libs/libwireshark.so: undefined reference to `gcry_mpi_print' epan/.libs/libwireshark.so: undefined reference to `gcry_cipher_open' epan/.libs/libwireshark.so: undefined reference to `gcry_cipher_close' epan/.libs/libwireshark.so: undefined reference to `gcry_cipher_decrypt' epan/.libs/libwireshark.so: undefined reference to `gcry_sexp_build' epan/.libs/libwireshark.so: undefined reference to `gcry_sexp_nth_mpi' epan/.libs/libwireshark.so: undefined reference to `gcry_md_open' epan/.libs/libwireshark.so: undefined reference to `gcry_mpi_release' collect2: ld returned 1 exit status make[2]: *** [dftest] Error 1 epan/.libs/libwireshark.so: undefined reference to `gcry_md_map_name' epan/.libs/libwireshark.so: undefined reference to `gcry_md_close' epan/.libs/libwireshark.so: undefined reference to `gcry_cipher_setiv' epan/.libs/libwireshark.so: undefined reference to `gcry_cipher_get_algo_keylen' epan/.libs/libwireshark.so: undefined reference to `gcry_cipher_get_algo_blklen' epan/.libs/libwireshark.so: undefined reference to `gcry_md_read' epan/.libs/libwireshark.so: undefined reference to `gcry_pk_decrypt' epan/.libs/libwireshark.so: undefined reference to `gcry_strsource' epan/.libs/libwireshark.so: undefined reference to `gcry_sexp_sprint' epan/.libs/libwireshark.so: undefined reference to `gcry_md_get_algo' epan/.libs/libwireshark.so: undefined reference to `gcry_cipher_setkey' epan/.libs/libwireshark.so: undefined reference to `gcry_cipher_map_name' epan/.libs/libwireshark.so: undefined reference to `gcry_mpi_scan' epan/.libs/libwireshark.so: undefined reference to `gcry_md_setkey' epan/.libs/libwireshark.so: undefined reference to `gcry_md_get_algo_dlen' epan/.libs/libwireshark.so: undefined reference to `gcry_sexp_release' epan/.libs/libwireshark.so: undefined reference to `gcry_md_write' epan/.libs/libwireshark.so: undefined reference to `gcry_strerror' epan/.libs/libwireshark.so: undefined reference to `gcry_mpi_print' epan/.libs/libwireshark.so: undefined reference to `gcry_cipher_open' epan/.libs/libwireshark.so: undefined reference to `gcry_cipher_close' epan/.libs/libwireshark.so: undefined reference to `gcry_cipher_decrypt' epan/.libs/libwireshark.so: undefined reference to `gcry_sexp_build' epan/.libs/libwireshark.so: undefined reference to `gcry_sexp_nth_mpi'
Re: [gentoo-user] Running out of space on /var partition
On Wednesday 27 Jul 2011 08:24:37 Alexander Puchmayr wrote: Depending on your available ram and swap space, you might want to mount /var/tmp/portage as tmpfs. My fstab entry shows none/var/tmp/portagetmpfs size=10g,nr_inodes=1m I have 4GB ram, and the speed benefit especially for open/libre-office is quite impressive. The advantage is, that it a) uses only as much of memory as is really used b) you may use mount option -remount to increase the size of the filesystem, and add proper swapfiles if you see that you're running out of space (mkswap, swapon) I also only have 4G of RAM and libreoffice seems to need more than 7-8G of /var/tmp/portage to compile and build. OOo does it in less that 5G. What will libreoffice do if /var/tmp/portage is a tmpfs? Start swapping like mad? -- Regards, Mick signature.asc Description: This is a digitally signed message part.
Re: [gentoo-user] Running out of space on /var partition
On Wed, Jul 27, 2011 at 9:23 AM, Mick michaelkintz...@gmail.com wrote: On Wednesday 27 Jul 2011 08:24:37 Alexander Puchmayr wrote: Depending on your available ram and swap space, you might want to mount /var/tmp/portage as tmpfs. My fstab entry shows none /var/tmp/portage tmpfs size=10g,nr_inodes=1m I have 4GB ram, and the speed benefit especially for open/libre-office is quite impressive. The advantage is, that it a) uses only as much of memory as is really used b) you may use mount option -remount to increase the size of the filesystem, and add proper swapfiles if you see that you're running out of space (mkswap, swapon) I also only have 4G of RAM and libreoffice seems to need more than 7-8G of /var/tmp/portage to compile and build. OOo does it in less that 5G. What will libreoffice do if /var/tmp/portage is a tmpfs? Start swapping like mad? No; the tmpfs runs out of space, and the build fails. Had that happen with Thunderbird, and thus ended my usage of tmpfs for /var/tmp. I'll probably go back to using tmpfs there once I've bumped my machine up to the motherboard's max of 16GB of RAM. -- :wq
Re: [gentoo-user] wireshark fails. undefined reference to ****
* Dale rdalek1...@gmail.com [110727 05:07]: Is anyone else running into this: libtool: link: x86_64-pc-linux-gnu-gcc -DINET6 -D_U_=__attribute__((unused)) -march=native -O2 -pipe -Wall -W -Wextra -Wdeclaration-after-statement -Wendif-labels -Wpointer-arith -Wno-pointer-sign -Warray-bounds -Wcast-align -Wformat-security -I/usr/include -I/usr/local/include -pthread -I/usr/include/gtk-2.0 -I/usr/lib64/gtk-2.0/include -I/usr/include/atk-1.0 -I/usr/include/cairo -I/usr/include/gdk-pixbuf-2.0 -I/usr/include/pango-1.0 -I/usr/include/glib-2.0 -I/usr/lib64/glib-2.0/include -I/usr/include/pixman-1 -I/usr/include/freetype2 -I/usr/include/libpng14 -I/usr/include/libdrm -I/usr/include -Wl,-O1 -Wl,--as-needed -Wl,--as-needed -o .libs/rawshark rawshark-capture-pcap-util-unix.o rawshark-capture-pcap-util.o rawshark-cfile.o rawshark-clopts_common.o rawshark-disabled_protos.o rawshark-packet-range.o rawshark-print.o rawshark-ps.o rawshark-sync_pipe_write.o rawshark-timestats.o rawshark-util.o rawshark-tap-megaco-common.o rawshark-tap-rtp-common.o rawshark-version_info.o rawshark-rawshark.o .libs/rawsharkS.o -Wl,--export-dynamic -pthread -Wl,-rpath -Wl,/usr/lib64 -Wl,--export-dynamic -L/usr/lib -L/usr/local/lib wiretap/.libs/libwiretap.so epan/.libs/libwireshark.so wsutil/.libs/libwsutil.so /usr/lib64/libgmodule-2.0.so -lrt /usr/lib64/libglib-2.0.so -lm -L/usr/lib64 -lpcap /usr/lib64/libgnutls.so -lz -pthread epan/.libs/libwireshark.so: undefined reference to `gcry_md_map_name' epan/.libs/libwireshark.so: undefined reference to `gcry_md_close' epan/.libs/libwireshark.so: undefined reference to `gcry_cipher_setiv' epan/.libs/libwireshark.so: undefined reference to `gcry_cipher_get_algo_keylen' epan/.libs/libwireshark.so: undefined reference to `gcry_cipher_get_algo_blklen' epan/.libs/libwireshark.so: undefined reference to `gcry_md_read' epan/.libs/libwireshark.so: undefined reference to `gcry_pk_decrypt' epan/.libs/libwireshark.so: undefined reference to `gcry_strsource' epan/.libs/libwireshark.so: undefined reference to `gcry_sexp_sprint' epan/.libs/libwireshark.so: undefined reference to `gcry_md_get_algo' epan/.libs/libwireshark.so: undefined reference to `gcry_cipher_setkey' epan/.libs/libwireshark.so: undefined reference to `gcry_cipher_map_name' epan/.libs/libwireshark.so: undefined reference to `gcry_mpi_scan' epan/.libs/libwireshark.so: undefined reference to `gcry_md_setkey' epan/.libs/libwireshark.so: undefined reference to `gcry_md_get_algo_dlen' epan/.libs/libwireshark.so: undefined reference to `gcry_sexp_release' epan/.libs/libwireshark.so: undefined reference to `gcry_md_write' epan/.libs/libwireshark.so: undefined reference to `gcry_strerror' epan/.libs/libwireshark.so: undefined reference to `gcry_mpi_print' epan/.libs/libwireshark.so: undefined reference to `gcry_cipher_open' epan/.libs/libwireshark.so: undefined reference to `gcry_cipher_close' epan/.libs/libwireshark.so: undefined reference to `gcry_cipher_decrypt' epan/.libs/libwireshark.so: undefined reference to `gcry_sexp_build' epan/.libs/libwireshark.so: undefined reference to `gcry_sexp_nth_mpi' epan/.libs/libwireshark.so: undefined reference to `gcry_md_open' epan/.libs/libwireshark.so: undefined reference to `gcry_mpi_release' collect2: ld returned 1 exit status make[2]: *** [dftest] Error 1 epan/.libs/libwireshark.so: undefined reference to `gcry_md_map_name' epan/.libs/libwireshark.so: undefined reference to `gcry_md_close' epan/.libs/libwireshark.so: undefined reference to `gcry_cipher_setiv' epan/.libs/libwireshark.so: undefined reference to `gcry_cipher_get_algo_keylen' epan/.libs/libwireshark.so: undefined reference to `gcry_cipher_get_algo_blklen' epan/.libs/libwireshark.so: undefined reference to `gcry_md_read' epan/.libs/libwireshark.so: undefined reference to `gcry_pk_decrypt' epan/.libs/libwireshark.so: undefined reference to `gcry_strsource' epan/.libs/libwireshark.so: undefined reference to `gcry_sexp_sprint' epan/.libs/libwireshark.so: undefined reference to `gcry_md_get_algo' epan/.libs/libwireshark.so: undefined reference to `gcry_cipher_setkey' epan/.libs/libwireshark.so: undefined reference to `gcry_cipher_map_name' epan/.libs/libwireshark.so: undefined reference to `gcry_mpi_scan' epan/.libs/libwireshark.so: undefined reference to `gcry_md_setkey' epan/.libs/libwireshark.so: undefined reference to `gcry_md_get_algo_dlen' epan/.libs/libwireshark.so: undefined reference to `gcry_sexp_release' epan/.libs/libwireshark.so: undefined reference to `gcry_md_write' epan/.libs/libwireshark.so: undefined reference to `gcry_strerror' epan/.libs/libwireshark.so: undefined reference to `gcry_mpi_print' epan/.libs/libwireshark.so: undefined reference to `gcry_cipher_open' epan/.libs/libwireshark.so: undefined reference to `gcry_cipher_close' epan/.libs/libwireshark.so: undefined reference to `gcry_cipher_decrypt'
Re: [gentoo-user] Running out of space on /var partition
On Wednesday 27 July 2011 14:29:12 Michael Mol wrote: On Wed, Jul 27, 2011 at 9:23 AM, Mick michaelkintz...@gmail.com wrote: What will libreoffice do if /var/tmp/portage is a tmpfs? Start swapping like mad? No; the tmpfs runs out of space, and the build fails. Had that happen with Thunderbird, and thus ended my usage of tmpfs for /var/tmp. Doesn't do that here. When tmpfs is full it starts being swapped out to the swap partition. Perhaps you didn't have any swap at the time. -- Rgds Peter Linux Counter number 5290
Re: [gentoo-user] Running out of space on /var partition
On Wed, Jul 27, 2011 at 9:41 AM, Peter Humphrey pe...@humphrey.ukfsn.org wrote: On Wednesday 27 July 2011 14:29:12 Michael Mol wrote: On Wed, Jul 27, 2011 at 9:23 AM, Mick michaelkintz...@gmail.com wrote: What will libreoffice do if /var/tmp/portage is a tmpfs? Start swapping like mad? No; the tmpfs runs out of space, and the build fails. Had that happen with Thunderbird, and thus ended my usage of tmpfs for /var/tmp. Doesn't do that here. When tmpfs is full it starts being swapped out to the swap partition. Perhaps you didn't have any swap at the time. Possible. With 6-8GB of RAM, I've generally not needed it. -- :wq
Re: [gentoo-user] CFlags for CPU
On 07/26/2011 12:22 PM, pk wrote: On 2011-07-26 22:36, Alokat wrote: model name : Intel(R) Core(TM)2 Duo CPU L7100 @ 1.20GHz snip I guess *core2* is the right one? Yes, acc. to: http://en.gentoo-wiki.com/wiki/Safe_Cflags/Intel#Core_2_Duo.2FQuad.2C_Xeon_51xx.2F53xx.2F54xx.2F3360.2C_Pentium_Dual-Core_T23xx.2B.2FE.2C_Celeron_Dual-Core HTH Best regards Peter K Another good trick I've found on the forums is to run: $ gcc -### -e -v -march=native /usr/include/stdlib.h The last line of output will include the various CFLAGS that -march=native picks. In my case (Phenom II 955): /usr/libexec/gcc/x86_64-pc-linux-gnu/4.4.5/cc1 -quiet /usr/include/stdlib.h -D_FORTIFY_SOURCE=2 *-march=amdfam10 -mcx16 -msahf -mpopcnt* --param l1-cache-size=64 --param l1-cache-line-size=64 --param l2-cache-size=512 -mtune=amdfam10 -quiet -dumpbase stdlib.h -auxbase stdlib -o /tmp/ccR1PlNZ.s --output-pch=/usr/include/stdlib.h.gch I typically use -march=native when I don't need to worry about distcc, or the options from that output that start with -m. -Andy
Re: [gentoo-user] CFlags for CPU
On Wed, Jul 27, 2011 at 5:09 PM, Andy Wilkinson drukar...@gmail.com wrote: ** On 07/26/2011 12:22 PM, pk wrote: On 2011-07-26 22:36, Alokat wrote: model name : Intel(R) Core(TM)2 Duo CPU L7100 @ 1.20GHz snip I guess *core2* is the right one? Yes, acc. to:http://en.gentoo-wiki.com/wiki/Safe_Cflags/Intel#Core_2_Duo.2FQuad.2C_Xeon_51xx.2F53xx.2F54xx.2F3360.2C_Pentium_Dual-Core_T23xx.2B.2FE.2C_Celeron_Dual-Core HTH Best regards Peter K Another good trick I've found on the forums is to run: $ gcc -### -e -v -march=native /usr/include/stdlib.h The last line of output will include the various CFLAGS that -march=native picks. In my case (Phenom II 955): /usr/libexec/gcc/x86_64-pc-linux-gnu/4.4.5/cc1 -quiet /usr/include/stdlib.h -D_FORTIFY_SOURCE=2 *-march=amdfam10 -mcx16 -msahf -mpopcnt* --param l1-cache-size=64 --param l1-cache-line-size=64 --param l2-cache-size=512 -mtune=amdfam10 -quiet -dumpbase stdlib.h -auxbase stdlib -o /tmp/ccR1PlNZ.s --output-pch=/usr/include/stdlib.h.gch I typically use -march=native when I don't need to worry about distcc, or the options from that output that start with -m. -Andy I must stay, this is brilliant ! Thank you very much. Kfir
Re: [gentoo-user] Running out of space on /var partition
On Wed, 27 Jul 2011 14:41:33 +0100, Peter Humphrey wrote: Doesn't do that here. When tmpfs is full it starts being swapped out to the swap partition. Perhaps you didn't have any swap at the time. The default size for a tmpfs filesystem is half the physical RAM, unless you specify more as a mount option, it will never use significant amounts of swap. I wonder how effective tmpfs is for PORTAGE_TMPDIR as the builds that need a lot of disk space can often require a fair bit of memory too, and tmpfs is using it all. -- Neil Bothwick Nobody's perfect and since I'm nobody...! signature.asc Description: PGP signature
Re: [gentoo-user] Running out of space on /var partition
Neil Bothwick wrote: On Wed, 27 Jul 2011 14:41:33 +0100, Peter Humphrey wrote: Doesn't do that here. When tmpfs is full it starts being swapped out to the swap partition. Perhaps you didn't have any swap at the time. The default size for a tmpfs filesystem is half the physical RAM, unless you specify more as a mount option, it will never use significant amounts of swap. I wonder how effective tmpfs is for PORTAGE_TMPDIR as the builds that need a lot of disk space can often require a fair bit of memory too, and tmpfs is using it all. I posted this somewhere but anyway. I tested this with my 16Gbs and some fairly good size packages. Most of them took a little longer to compile on tmpfs than it did on the hard drive. So, putting portage's work directory on tmpfs doesn't help a bit. Dale :-) :-)
RE: [gentoo-user] CFlags for CPU
-original message- Subject: Re: [gentoo-user] CFlags for CPU From: Andy Wilkinson drukar...@gmail.com Date: 2011-07-27 21:09 Another good trick I've found on the forums is to run: $ gcc -### -e -v -march=native /usr/include/stdlib.h The last line of output will include the various CFLAGS that -march=native picks. In my case (Phenom II 955): /usr/libexec/gcc/x86_64-pc-linux-gnu/4.4.5/cc1 -quiet /usr/include/stdlib.h -D_FORTIFY_SOURCE=2 *-march=amdfam10 -mcx16 -msahf -mpopcnt* --param l1-cache-size=64 --param l1-cache-line-size=64 --param l2-cache-size=512 -mtune=amdfam10 -quiet -dumpbase stdlib.h -auxbase stdlib -o /tmp/ccR1PlNZ.s --output-pch=/usr/include/stdlib.h.gch I typically use -march=native when I don't need to worry about distcc, or the options from that output that start with -m. Hey, that's a nice trick! Thanks for re-sharing :) That said, I usually *can't* use -march=native because all my Gentoo systems are virtualized servers, running on top of XenServer, which itself runs on heterogenous server boxes (all Intel). So, I purposefully limit myself to -march=nocona. (I did raise an explicit point about -march parameter in my Gentoo-Wiki article) Rgds, -- FdS Pandu E Poluan ~ IT Optimizer ~ Sent from Nokia E72-1
Re: [gentoo-user] Running out of space on /var partition
On Wednesday 27 July 2011 15:40:03 Neil Bothwick did opine thusly: On Wed, 27 Jul 2011 14:41:33 +0100, Peter Humphrey wrote: Doesn't do that here. When tmpfs is full it starts being swapped out to the swap partition. Perhaps you didn't have any swap at the time. The default size for a tmpfs filesystem is half the physical RAM, unless you specify more as a mount option, it will never use significant amounts of swap. I wonder how effective tmpfs is for PORTAGE_TMPDIR as the builds that need a lot of disk space can often require a fair bit of memory too, and tmpfs is using it all. In this last week someone reported doing actually measurements and found that using a tmpfs was actually slower. -- alan dot mckinnon at gmail dot com
Re: [gentoo-user] Running out of space on /var partition
On Wed, Jul 27, 2011 at 10:40 AM, Neil Bothwick n...@digimed.co.uk wrote:
On Wed, 27 Jul 2011 14:41:33 +0100, Peter Humphrey wrote:
Doesn't do that here. When tmpfs is full it starts being swapped out to
the swap partition. Perhaps you didn't have any swap at the time.
The default size for a tmpfs filesystem is half the physical RAM, unless
you specify more as a mount option, it will never use significant
amounts of swap.
I wonder how effective tmpfs is for PORTAGE_TMPDIR as the builds that
need a lot of disk space can often require a fair bit of memory too, and
tmpfs is using it all.
portage (by default) cleans up after itself after each ebuild, so
there's no leakage across ebuilds, but yeah; if you don't have enough
RAM for it, stuffing your files and your active processes in the RAM
won't work. That's a pretty simple concept.
tmpfs for PORTAGE_TMPDIR is great, as long as you have the RAM for it.
When I first started using Gentoo, I did. Lately, builds have gotten
large enough (especially when I added -ggdb to CFLAGS) that I had to
stop using it.
However, I can see an argument for tmpfs to still be useful, even if
you don't have enough RAM for it, but you do have swap space. If you
allow tmpfs to be backed by swap, you can avoid the (unnecessary in
this case) bookkeeping done by normal disk filesystems like
ext{2|3|4}. So long as your swap partition is as fast as the partition
your erstwhile disk filesystem sits on, it'd be a theoretical gain.
(Though if you're using a swap *file* as opposed to a swap partition,
you'd lose that gain. So YMMV.)
With that in mind, I think I'll re-enable tmpfs when I get home, and
set it to act as a 16GB filesystem. I only have 6GB of RAM, but tmpfs
won't consume more RAM than it has data to fill pages, and the use of
swap shouldn't be terrible.
My understanding of tmpfs is that it's implemented as a thin layer on
top of the file page cache, and that as active processes need more
RAM, the file page cache is the first thing to be sacrificed, being
flushed to disk. (Presumably, in the case of tmpfs, 'disk' would be
'swap') So truly active process memory should have no more trouble
remaining in physical RAM than if tmpfs weren't there; if tmpfs
weren't there, the data would still sit in the file cache, but would
have to pass through a filesystem like ext{2|3|4} (or whatever) on its
way to disk.
--
:wq
Re: [gentoo-user] Running out of space on /var partition
On Wed, Jul 27, 2011 at 10:52 AM, Alan McKinnon alan.mckin...@gmail.com wrote: On Wednesday 27 July 2011 15:40:03 Neil Bothwick did opine thusly: On Wed, 27 Jul 2011 14:41:33 +0100, Peter Humphrey wrote: Doesn't do that here. When tmpfs is full it starts being swapped out to the swap partition. Perhaps you didn't have any swap at the time. The default size for a tmpfs filesystem is half the physical RAM, unless you specify more as a mount option, it will never use significant amounts of swap. I wonder how effective tmpfs is for PORTAGE_TMPDIR as the builds that need a lot of disk space can often require a fair bit of memory too, and tmpfs is using it all. In this last week someone reported doing actually measurements and found that using a tmpfs was actually slower. Hm. I wonder why that is; it seems counterintuitive to my understanding of how tmpfs is implemented wrt the kernel's caching. But I haven't red up on that in years. -- :wq
Re: [gentoo-user] Running out of space on /var partition
On Wed, 27 Jul 2011 16:52:53 +0200, Alan McKinnon wrote: I wonder how effective tmpfs is for PORTAGE_TMPDIR as the builds that need a lot of disk space can often require a fair bit of memory too, and tmpfs is using it all. In this last week someone reported doing actually measurements and found that using a tmpfs was actually slower. Yes, but that was Dale and nothing works as it should for him :-O -- Neil Bothwick I work with User-Surly Software. signature.asc Description: PGP signature
Re: [gentoo-user] Running out of space on /var partition
Neil Bothwick wrote: On Wed, 27 Jul 2011 16:52:53 +0200, Alan McKinnon wrote: I wonder how effective tmpfs is for PORTAGE_TMPDIR as the builds that need a lot of disk space can often require a fair bit of memory too, and tmpfs is using it all. In this last week someone reported doing actually measurements and found that using a tmpfs was actually slower. Yes, but that was Dale and nothing works as it should for him :-O That one did. Someone on the forums posted the same results. It doesn't make sense but . . . . I can also say that I done a .35 kernel from scratch and can now download videos. So, I'm working again. :-P Dale :-) :-)
Re: [gentoo-user] wireshark fails. undefined reference to ****
Todd Goodman wrote: It looks like you're missing linking in of libgcrypt. Maybe ensure you have an up to date version (or not too up to date.) Or try emerging without the gcrypt use flag? I just emerged that for x86 and had no problem. But I don't have the gcrypt use flag enabled. Todd Dale :-) :-) I have dev-libs/libgcrypt-1.4.6-r1 installed at the moment. The others are keyworded. Anyone used the 1.5 series with no problems? Dale :-) :-)
Re: [gentoo-user] CFlags for CPU
On Wed, Jul 27, 2011 at 5:34 PM, Kfir Lavi lavi.k...@gmail.com wrote: On Wed, Jul 27, 2011 at 5:09 PM, Andy Wilkinson drukar...@gmail.comwrote: ** On 07/26/2011 12:22 PM, pk wrote: On 2011-07-26 22:36, Alokat wrote: model name : Intel(R) Core(TM)2 Duo CPU L7100 @ 1.20GHz snip I guess *core2* is the right one? Yes, acc. to:http://en.gentoo-wiki.com/wiki/Safe_Cflags/Intel#Core_2_Duo.2FQuad.2C_Xeon_51xx.2F53xx.2F54xx.2F3360.2C_Pentium_Dual-Core_T23xx.2B.2FE.2C_Celeron_Dual-Core HTH Best regards Peter K Another good trick I've found on the forums is to run: $ gcc -### -e -v -march=native /usr/include/stdlib.h The last line of output will include the various CFLAGS that -march=native picks. In my case (Phenom II 955): /usr/libexec/gcc/x86_64-pc-linux-gnu/4.4.5/cc1 -quiet /usr/include/stdlib.h -D_FORTIFY_SOURCE=2 *-march=amdfam10 -mcx16 -msahf -mpopcnt* --param l1-cache-size=64 --param l1-cache-line-size=64 --param l2-cache-size=512 -mtune=amdfam10 -quiet -dumpbase stdlib.h -auxbase stdlib -o /tmp/ccR1PlNZ.s --output-pch=/usr/include/stdlib.h.gch I typically use -march=native when I don't need to worry about distcc, or the options from that output that start with -m. -Andy I must stay, this is brilliant ! Thank you very much. Kfir Just shared this trick in my blog. http://gentoo-what-did-you-say.blogspot.com/2011/07/finding-cpu-flags-using-gcc.html I added a link to this thread in the post. Kfir
Re: [gentoo-user] CFlags for CPU
On Wednesday 27 Jul 2011 17:13:21 Kfir Lavi wrote: On Wed, Jul 27, 2011 at 5:34 PM, Kfir Lavi lavi.k...@gmail.com wrote: On Wed, Jul 27, 2011 at 5:09 PM, Andy Wilkinson Another good trick I've found on the forums is to run: $ gcc -### -e -v -march=native /usr/include/stdlib.h The last line of output will include the various CFLAGS that -march=native picks. In my case (Phenom II 955): /usr/libexec/gcc/x86_64-pc-linux-gnu/4.4.5/cc1 -quiet /usr/include/stdlib.h -D_FORTIFY_SOURCE=2 *-march=amdfam10 -mcx16 -msahf -mpopcnt* --param l1-cache-size=64 --param l1-cache-line-size=64 --param l2-cache-size=512 -mtune=amdfam10 -quiet -dumpbase stdlib.h -auxbase stdlib -o /tmp/ccR1PlNZ.s --output-pch=/usr/include/stdlib.h.gch I typically use -march=native when I don't need to worry about distcc, or the options from that output that start with -m. Just shared this trick in my blog. http://gentoo-what-did-you-say.blogspot.com/2011/07/finding-cpu-flags-using -gcc.html I added a link to this thread in the post. It seems that on my early i7, the -march=core2 does not have all the -msse* flags enabled, while native does: $ diff -y --suppress-common-lines core2.txt native.txt -mcx16[disabled]| -mcx16 [enabled] -mno-sse4 [enabled] | -mno-sse4 [disabled] -mpopcnt [disabled]| -mpopcnt[enabled] -msahf[disabled]| -msahf [enabled] -msse [disabled]| -msse [enabled] -msse2[disabled]| -msse2 [enabled] -msse3[disabled]| -msse3 [enabled] -msse4[disabled]| -msse4 [enabled] -msse4.1 [disabled]| -msse4.1[enabled] -msse4.2 [disabled]| -msse4.2[enabled] -mssse3 [disabled]| -mssse3 [enabled] -mtune= | -mtune= core2 I wonder if I should just set it to -march=native -O2 -pipe and forget about it ... native it seems to have more stuff switched on and it would probably be a-good-thing® (although my understanding of what each flag does is rather cursory). -- Regards, Mick signature.asc Description: This is a digitally signed message part.
Re: [gentoo-user] CFlags for CPU
On Wed, Jul 27, 2011 at 11:32 AM, Mick michaelkintz...@gmail.com wrote: On Wednesday 27 Jul 2011 17:13:21 Kfir Lavi wrote: On Wed, Jul 27, 2011 at 5:34 PM, Kfir Lavi lavi.k...@gmail.com wrote: On Wed, Jul 27, 2011 at 5:09 PM, Andy Wilkinson Another good trick I've found on the forums is to run: $ gcc -### -e -v -march=native /usr/include/stdlib.h The last line of output will include the various CFLAGS that -march=native picks. In my case (Phenom II 955): /usr/libexec/gcc/x86_64-pc-linux-gnu/4.4.5/cc1 -quiet /usr/include/stdlib.h -D_FORTIFY_SOURCE=2 *-march=amdfam10 -mcx16 -msahf -mpopcnt* --param l1-cache-size=64 --param l1-cache-line-size=64 --param l2-cache-size=512 -mtune=amdfam10 -quiet -dumpbase stdlib.h -auxbase stdlib -o /tmp/ccR1PlNZ.s --output-pch=/usr/include/stdlib.h.gch I typically use -march=native when I don't need to worry about distcc, or the options from that output that start with -m. Just shared this trick in my blog. http://gentoo-what-did-you-say.blogspot.com/2011/07/finding-cpu-flags-using -gcc.html I added a link to this thread in the post. It seems that on my early i7, the -march=core2 does not have all the -msse* flags enabled, while native does: $ diff -y --suppress-common-lines core2.txt native.txt -mcx16 [disabled] | -mcx16 [enabled] -mno-sse4 [enabled] | -mno-sse4 [disabled] -mpopcnt [disabled] | -mpopcnt [enabled] -msahf [disabled] | -msahf [enabled] -msse [disabled] | -msse [enabled] -msse2 [disabled] | -msse2 [enabled] -msse3 [disabled] | -msse3 [enabled] -msse4 [disabled] | -msse4 [enabled] -msse4.1 [disabled] | -msse4.1 [enabled] -msse4.2 [disabled] | -msse4.2 [enabled] -mssse3 [disabled] | -mssse3 [enabled] -mtune= | -mtune= core2 I wonder if I should just set it to -march=native -O2 -pipe and forget about it ... native it seems to have more stuff switched on and it would probably be a-good-thing® (although my understanding of what each flag does is rather cursory). -- Regards, Mick Just curious if that's consistent with /proc/cpuinfo in the flags section? MAybe gcc is wrong in it's enable/disable choices, or maybe they know something specific. This is from an i7-980 Extreme from about 1 year ago: flags : fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx pdpe1gb rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni pclmulqdq dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm sse4_1 sse4_2 popcnt aes lahf_lm ida arat dts tpr_shadow vnmi flexpriority ept vpid - Mark
Re: [gentoo-user] Running out of space on /var partition
On Wed, 27 Jul 2011 10:58:28 -0500, Dale wrote: I wonder how effective tmpfs is for PORTAGE_TMPDIR as the builds that need a lot of disk space can often require a fair bit of memory too, and tmpfs is using it all. In this last week someone reported doing actually measurements and found that using a tmpfs was actually slower. Yes, but that was Dale and nothing works as it should for him :-O That one did. Someone on the forums posted the same results. It doesn't make sense but . . . . It makes sense because the ramdisk is using memory that would otherwise be used for compilation and filesystem caches. -- Neil Bothwick NOTICE: -- THE ELEVATORS WILL BE OUT OF ORDER TODAY -- (The nearest working elevators are in the building across the street.) signature.asc Description: PGP signature
Re: [gentoo-user] Running out of space on /var partition
On Wed, Jul 27, 2011 at 4:44 PM, Neil Bothwick n...@digimed.co.uk wrote: On Wed, 27 Jul 2011 10:58:28 -0500, Dale wrote: I wonder how effective tmpfs is for PORTAGE_TMPDIR as the builds that need a lot of disk space can often require a fair bit of memory too, and tmpfs is using it all. In this last week someone reported doing actually measurements and found that using a tmpfs was actually slower. Yes, but that was Dale and nothing works as it should for him :-O That one did. Someone on the forums posted the same results. It doesn't make sense but . . . . It makes sense because the ramdisk is using memory that would otherwise be used for compilation and filesystem caches. tmpfs isn't implemented as a ramdisk, it's implemented as a thin layer on top of the filesystem cache. -- :wq
Re: [gentoo-user] CFlags for CPU
On Wednesday 27 Jul 2011 21:24:33 Mark Knecht wrote: On Wed, Jul 27, 2011 at 11:32 AM, Mick michaelkintz...@gmail.com wrote: On Wednesday 27 Jul 2011 17:13:21 Kfir Lavi wrote: On Wed, Jul 27, 2011 at 5:34 PM, Kfir Lavi lavi.k...@gmail.com wrote: On Wed, Jul 27, 2011 at 5:09 PM, Andy Wilkinson Another good trick I've found on the forums is to run: $ gcc -### -e -v -march=native /usr/include/stdlib.h The last line of output will include the various CFLAGS that -march=native picks. In my case (Phenom II 955): /usr/libexec/gcc/x86_64-pc-linux-gnu/4.4.5/cc1 -quiet /usr/include/stdlib.h -D_FORTIFY_SOURCE=2 *-march=amdfam10 -mcx16 -msahf -mpopcnt* --param l1-cache-size=64 --param l1-cache-line-size=64 --param l2-cache-size=512 -mtune=amdfam10 -quiet -dumpbase stdlib.h -auxbase stdlib -o /tmp/ccR1PlNZ.s --output-pch=/usr/include/stdlib.h.gch I typically use -march=native when I don't need to worry about distcc, or the options from that output that start with -m. Just shared this trick in my blog. http://gentoo-what-did-you-say.blogspot.com/2011/07/finding-cpu-flags-us ing -gcc.html I added a link to this thread in the post. It seems that on my early i7, the -march=core2 does not have all the -msse* flags enabled, while native does: $ diff -y --suppress-common-lines core2.txt native.txt -mcx16[disabled]| -mcx16 [enabled] -mno-sse4 [enabled] | -mno-sse4 [disabled] -mpopcnt [disabled]| -mpopcnt[enabled] -msahf[disabled]| -msahf [enabled] -msse [disabled]| -msse [enabled] -msse2[disabled]| -msse2 [enabled] -msse3[disabled]| -msse3 [enabled] -msse4[disabled]| -msse4 [enabled] -msse4.1 [disabled]| -msse4.1[enabled] -msse4.2 [disabled]| -msse4.2[enabled] -mssse3 [disabled]| -mssse3 [enabled] -mtune= | -mtune= core2 I wonder if I should just set it to -march=native -O2 -pipe and forget about it ... native it seems to have more stuff switched on and it would probably be a-good-thing® (although my understanding of what each flag does is rather cursory). -- Regards, Mick Just curious if that's consistent with /proc/cpuinfo in the flags section? MAybe gcc is wrong in it's enable/disable choices, or maybe they know something specific. This is from an i7-980 Extreme from about 1 year ago: flags : fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx pdpe1gb rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni pclmulqdq dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm sse4_1 sse4_2 popcnt aes lahf_lm ida arat dts tpr_shadow vnmi flexpriority ept vpid Same here: flags : fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx smx est tm2 ssse3 cx16 xtpr pdcm sse4_1 sse4_2 popcnt lahf_lm ida dts tpr_shadow vnmi flexpriority ept vpid -- Regards, Mick signature.asc Description: This is a digitally signed message part.
Re: [gentoo-user] X Freezes With Firefox on Many Post 2.6.38 Kernels
Todd Goodman wrote: It's certainly possible it's unrelated. Or it could be something similar and the other bug reporter made a mistake bisecting or didn't run long enough to fail with that bisection. It's possibly a lot of things since we don't have enough information. I don't think that would work OK (but don't know for sure.) In most cases it would probably work OK as I believe unused parameters will be ignored. But if a parameter was removed or the meaning changed then you might have a problem (unlikely I'd guess, but I don't know.) Todd Here is a update. Let's see what folks think about this situation. I mentioned in another thread that I did a from scratch kernel. It was a .35 version. It seemed to work fine, for a while. When I tell Seamonkey to download to my desktop, it works fine. The minute I tell it to save it to my large 750Gb drive, I get a kernel panic. Keep in mind, there is nothing OS related on that drive. Nothing OS at all. It is videos, CD ISO's and such as that. Here is another thing I just found out. I did download a few videos I wanted to save. They were on my desktop and who likes desktop clutter. So, I dragged them over to the large data drive. I did this by dragging from the desktop to a open Konqueror window. This was not downloading or anything, just a straight move operation. It copied a few Mbs and panic. This had nothing to do with Seamonkey either. So, did this issue just move from a Seamonkey sort of problem to completely something else? Hm. After the crash, I boot to single user mode. I ran resierfsck --fix-fixable on the drive. Not one error. I ran the smart thingy and not one error there either. Thinking file system is bad in the kernel, well my /home directory is on reiserfs too. It is the one that works. Now, what the heck is this about? Does this make sense to anyone? Dale :-) :-)
Re: [gentoo-user] Running out of space on /var partition
Neil Bothwick wrote: On Wed, 27 Jul 2011 10:58:28 -0500, Dale wrote: I wonder how effective tmpfs is for PORTAGE_TMPDIR as the builds that need a lot of disk space can often require a fair bit of memory too, and tmpfs is using it all. In this last week someone reported doing actually measurements and found that using a tmpfs was actually slower. Yes, but that was Dale and nothing works as it should for him :-O That one did. Someone on the forums posted the same results. It doesn't make sense but . . . . It makes sense because the ramdisk is using memory that would otherwise be used for compilation and filesystem caches. I have 16Gbs here. It's not like I'm going to run out or anything. I can put half on tmpfs and still have 8Gbs left. That is more than enough to compile even OOo with no space problems. Thoughts? Dale :-) :-)
Re: [gentoo-user] CFlags for CPU
On 2011-07-27 20:32, Mick wrote: It seems that on my early i7, the -march=core2 does not have all the -msse* flags enabled, while native does: Acc. to this there is a flag for i7, BUT... I'm not sure if current stable version accepts it: http://gcc.gnu.org/onlinedocs/gcc/i386-and-x86_002d64-Options.html I wonder if I should just set it to -march=native -O2 -pipe and forget about it ... native it seems to have more stuff switched on and it would probably be a-good-thing® (although my understanding of what each flag does is rather cursory). I assume native would do fine... Best regards Peter K
Re: [gentoo-user] Running out of space on /var partition
On Wed, Jul 27, 2011 at 5:07 PM, Dale rdalek1...@gmail.com wrote: Neil Bothwick wrote: On Wed, 27 Jul 2011 10:58:28 -0500, Dale wrote: I have 16Gbs here. It's not like I'm going to run out or anything. I can put half on tmpfs and still have 8Gbs left. That is more than enough to compile even OOo with no space problems. Thoughts? This is Gentoo, where all us users are reputed to spend their days passing around benchmarks of emerge -e world, right? Try it. :) -- :wq
Re: [gentoo-user] Running out of space on /var partition
Michael Mol wrote: On Wed, Jul 27, 2011 at 5:07 PM, Dalerdalek1...@gmail.com wrote: Neil Bothwick wrote: On Wed, 27 Jul 2011 10:58:28 -0500, Dale wrote: I have 16Gbs here. It's not like I'm going to run out or anything. I can put half on tmpfs and still have 8Gbs left. That is more than enough to compile even OOo with no space problems. Thoughts? This is Gentoo, where all us users are reputed to spend their days passing around benchmarks of emerge -e world, right? Try it. :) Yep, we do that. Mine is about 12 hours. I would post it but I got a Blocker instead. I'll work on that and post it later. lol Point is, I have more than enough memory to test the theory that putting portage's work directory on tmpfs is faster/slower than a hard drive. I tested it and it really didn't make much difference. Most of the time it was slower but a couple times it was faster but only by a few seconds. I guess drives are just a lot faster nowadays or at least fast enough. I dunno. Dale :-) :-)
Re: [gentoo-user] X Freezes With Firefox on Many Post 2.6.38 Kernels
On Wednesday 27 July 2011 22:03:31 Dale wrote: Does this make sense to anyone? Yes. I think your power interruption has damaged the drive electronics. -- Rgds Peter Linux Counter number 5290
Re: [gentoo-user] Running out of space on /var partition
On Wed, Jul 27, 2011 at 5:51 PM, Dale rdalek1...@gmail.com wrote: Michael Mol wrote: On Wed, Jul 27, 2011 at 5:07 PM, Dalerdalek1...@gmail.com wrote: Neil Bothwick wrote: On Wed, 27 Jul 2011 10:58:28 -0500, Dale wrote: I have 16Gbs here. It's not like I'm going to run out or anything. I can put half on tmpfs and still have 8Gbs left. That is more than enough to compile even OOo with no space problems. Thoughts? This is Gentoo, where all us users are reputed to spend their days passing around benchmarks of emerge -e world, right? Try it. :) Yep, we do that. Mine is about 12 hours. I would post it but I got a Blocker instead. I'll work on that and post it later. lol Point is, I have more than enough memory to test the theory that putting portage's work directory on tmpfs is faster/slower than a hard drive. I tested it and it really didn't make much difference. Most of the time it was slower but a couple times it was faster but only by a few seconds. I guess drives are just a lot faster nowadays or at least fast enough. I dunno. Dale :-) :-) I would hazard a guess here that, rather than it being a benefit from improvement in drive speeds, it's moreso an improvement in the kernel's file caching. As I understand it (likely incorrectly) tmpfs essentially does little more than inject the given file into the filesystem cache, with a 'keep this here' flag attached to it. As files are accessed on the disk, they're pulled into the filesystem cache anyhow, and they stay there as long as they're being used and there's room to keep them. With tmpfs, every file you put into it stays until explicitly removed, wheras letting the kernel handle the selected list of files in the cache only keeps the ones the kernel feels are worth keeping. I am curious, though, whether *not* using -pipe will actually improve performance when building in tmpfs, as you're already sidestepping most of the overhead of creating files with tmpfs, so piping data rather than using intermediate files just creates extra memory usage overhead (which, while cheaper than disk i/o and filesystem metadata updates, is still overhead). Another likely source of performance loss in using tmpfs over physical disk to hold the build is that, by design, tmpfs occupies a portion of the filesystem cache. During a build, every header imported, every library linked, and every process that runs to make it all come together gets touched. When you touch files on disk, some or all of them get pulled into the filesystem cache, so keeping the entire build tree in the cache may well leave more frequently used files being dropped from cache to trade back and forth between one another. Again, all of this comes with a I likely have no idea what I'm talking about, but it sounds convincing disclaimer. :-) -- Poison [BLX] Joshua M. Murphy
Re: [gentoo-user] X Freezes With Firefox on Many Post 2.6.38 Kernels
On Wed, Jul 27, 2011 at 4:03 PM, Dale rdalek1...@gmail.com wrote: Here is a update. Let's see what folks think about this situation. I mentioned in another thread that I did a from scratch kernel. It was a .35 version. It seemed to work fine, for a while. When I tell Seamonkey to download to my desktop, it works fine. The minute I tell it to save it to my large 750Gb drive, I get a kernel panic. Keep in mind, there is nothing OS related on that drive. Nothing OS at all. It is videos, CD ISO's and such as that. Here is another thing I just found out. I did download a few videos I wanted to save. They were on my desktop and who likes desktop clutter. So, I dragged them over to the large data drive. I did this by dragging from the desktop to a open Konqueror window. This was not downloading or anything, just a straight move operation. It copied a few Mbs and panic. This had nothing to do with Seamonkey either. This looks like a drive/cable issue, since it only occurs on the one drive. If both drives are SATA, I would try swapping the cables to rule out a bad cable. If the problem stays with the drive I would first try a different SATA port to see if that clears up the issue. So, did this issue just move from a Seamonkey sort of problem to completely something else? Hm. After the crash, I boot to single user mode. I ran resierfsck --fix-fixable on the drive. Not one error. I ran the smart thingy and not one error there either. Thinking file system is bad in the kernel, well my /home directory is on reiserfs too. It is the one that works. Now, what the heck is this about? Does this make sense to anyone? Dale :-) :-) -- No trees were harmed in the sending of this message. However, a large number of electrons were terribly inconvenienced.
Re: [gentoo-user] Running out of space on /var partition
Joshua Murphy wrote: On Wed, Jul 27, 2011 at 5:51 PM, Dalerdalek1...@gmail.com wrote: Michael Mol wrote: On Wed, Jul 27, 2011 at 5:07 PM, Dalerdalek1...@gmail.comwrote: Neil Bothwick wrote: On Wed, 27 Jul 2011 10:58:28 -0500, Dale wrote: I have 16Gbs here. It's not like I'm going to run out or anything. I can put half on tmpfs and still have 8Gbs left. That is more than enough to compile even OOo with no space problems. Thoughts? This is Gentoo, where all us users are reputed to spend their days passing around benchmarks of emerge -e world, right? Try it. :) Yep, we do that. Mine is about 12 hours. I would post it but I got a Blocker instead. I'll work on that and post it later. lol Point is, I have more than enough memory to test the theory that putting portage's work directory on tmpfs is faster/slower than a hard drive. I tested it and it really didn't make much difference. Most of the time it was slower but a couple times it was faster but only by a few seconds. I guess drives are just a lot faster nowadays or at least fast enough. I dunno. Dale :-) :-) I would hazard a guess here that, rather than it being a benefit from improvement in drive speeds, it's moreso an improvement in the kernel's file caching. As I understand it (likely incorrectly) tmpfs essentially does little more than inject the given file into the filesystem cache, with a 'keep this here' flag attached to it. As files are accessed on the disk, they're pulled into the filesystem cache anyhow, and they stay there as long as they're being used and there's room to keep them. With tmpfs, every file you put into it stays until explicitly removed, wheras letting the kernel handle the selected list of files in the cache only keeps the ones the kernel feels are worth keeping. I am curious, though, whether *not* using -pipe will actually improve performance when building in tmpfs, as you're already sidestepping most of the overhead of creating files with tmpfs, so piping data rather than using intermediate files just creates extra memory usage overhead (which, while cheaper than disk i/o and filesystem metadata updates, is still overhead). Another likely source of performance loss in using tmpfs over physical disk to hold the build is that, by design, tmpfs occupies a portion of the filesystem cache. During a build, every header imported, every library linked, and every process that runs to make it all come together gets touched. When you touch files on disk, some or all of them get pulled into the filesystem cache, so keeping the entire build tree in the cache may well leave more frequently used files being dropped from cache to trade back and forth between one another. Again, all of this comes with a I likely have no idea what I'm talking about, but it sounds convincing disclaimer. :-) Sounds better than my I dunno tho. LOL I know it doesn't make much sense tho, at least not based on what several others thought would happen way back in the day. Back then, very few people had enough ram to really test this. Those who did, well, it may not be their machine to run the test. ;-) I may test this again one day. All you have to do is create a set and emerge it. Reboot to make sure the cache is cleaned 100%, mount tmpfs and emerge the set again. Compare the times and see what hits the fan, theory or reality. :/ Dale :-) :-)
Re: [gentoo-user] Running out of space on /var partition
On Wed, 27 Jul 2011 16:54:22 -0400, Michael Mol wrote: It makes sense because the ramdisk is using memory that would otherwise be used for compilation and filesystem caches. tmpfs isn't implemented as a ramdisk, it's implemented as a thin layer on top of the filesystem cache. That's true, but it is still a storage device using RAM. The implementation may be different but it still uses up memory that would otherwise be available to the system. I stand by my comment, semantics aside. -- Neil Bothwick Last yur I kudnt spel modjerater now I are won. signature.asc Description: PGP signature
Re: [gentoo-user] Running out of space on /var partition
On Wed, 27 Jul 2011 16:07:30 -0500, Dale wrote: It makes sense because the ramdisk is using memory that would otherwise be used for compilation and filesystem caches. I have 16Gbs here. It's not like I'm going to run out or anything. I can put half on tmpfs and still have 8Gbs left. That is more than enough to compile even OOo with no space problems. I wasn't thinking of systems with that much memory. Like you, I'd expect your system to be faster, even if not by much, using tmpfs. -- Neil Bothwick Physics is like sex: sure, it may give some practical results, but that's not why we do it.Richard Feynman signature.asc Description: PGP signature
Re: [gentoo-user] Running out of space on /var partition
Neil Bothwick wrote: On Wed, 27 Jul 2011 16:07:30 -0500, Dale wrote: It makes sense because the ramdisk is using memory that would otherwise be used for compilation and filesystem caches. I have 16Gbs here. It's not like I'm going to run out or anything. I can put half on tmpfs and still have 8Gbs left. That is more than enough to compile even OOo with no space problems. I wasn't thinking of systems with that much memory. Like you, I'd expect your system to be faster, even if not by much, using tmpfs. That's what I was expecting too. It is confusing for sure. Speaking of tmpfs, I should have re-emerged OOo on tmpfs. It filled up /var and died, just a few minutes before it would have finished. Oh well, I'll make /var bigger next time. Maybe a couple more Gbs. I put that http-replicator on here when I decided to keep my old rig up to date and it just eats up my /var. I guess I could move http* directory tho. ^_^ I really need to figure out this hard drive issue right now tho. That's buggin me a lot. Dale :-) :-)
Re: [gentoo-user] Running out of space on /var partition
Dale writes: Neil Bothwick wrote: I wasn't thinking of systems with that much memory. Like you, I'd expect your system to be faster, even if not by much, using tmpfs. That's what I was expecting too. It is confusing for sure. Years ago, I used tmpfs, and it was slightly faster, but on average only few seconds in an hou-long emerge. I don't use tmpfs any more, as 8G of RAM is barely enough to run KDe here. Speaking of tmpfs, I should have re-emerged OOo on tmpfs. It filled up /var and died, just a few minutes before it would have finished. Oh well, I'll make /var bigger next time. Maybe a couple more Gbs. Well, if you were using LVM, this would take less than a minute: lvresize -L +2G /dev/myVolumeGroup/myVarVolume resize2fs /dev/myVolumeGroup/myVarVolume I put that http-replicator on here when I decided to keep my old rig up to date and it just eats up my /var. I guess I could move http* directory tho. ^_^ Sure, either by changing some config file, or crating a symlink to the new location. I have a partition for portage stuff (trees, distfiles, packages, tmpdir), as I don't like my /var to become full just because I emerge something large. Wonko
[gentoo-user] Re: mysqld invoked oom-killer
On 07/25/2011 08:54 PM, Grant wrote: BTW, can anyone tell me why I'm using icedtea6-bin instead of icedtea? When I first installed icedtea-bin there was no icedtea package, so I tried to compile it myself using online instructions and gave up in frustration. I'm glad you asked, because now I'll try the icedtea package instead. I just noticed the icedtea-web package, which supplies an nsbrowser java plugin. I don't know if the 'plugin' errors you were seeing are related to the browser java plugin or some other plugin library, but I'm going to install both packages tomorrow and give them a try. I assume you need to eselect the java-nsplugin as well as the java-vm if you install icedtea-web. I'll try it.
Re: [gentoo-user] Running out of space on /var partition
Alex Schuster wrote: Dale writes: That's what I was expecting too. It is confusing for sure. Years ago, I used tmpfs, and it was slightly faster, but on average only few seconds in an hou-long emerge. I don't use tmpfs any more, as 8G of RAM is barely enough to run KDe here. I run KDE here and it uses less than 1Gbs all the time. Most of the time it hovers around 1Gb with a lot of junk open. If your used 8Gbs, you got a lot running or something. o_O Speaking of tmpfs, I should have re-emerged OOo on tmpfs. It filled up /var and died, just a few minutes before it would have finished. Oh well, I'll make /var bigger next time. Maybe a couple more Gbs. Well, if you were using LVM, this would take less than a minute: lvresize -L +2G /dev/myVolumeGroup/myVarVolume resize2fs /dev/myVolumeGroup/myVarVolume Yea but I don't use LVM. I may one day but not today. I got enough drive issues right now without adding another layer to it. I put that http-replicator on here when I decided to keep my old rig up to date and it just eats up my /var. I guess I could move http* directory tho. ^_^ Sure, either by changing some config file, or crating a symlink to the new location. I have a partition for portage stuff (trees, distfiles, packages, tmpdir), as I don't like my /var to become full just because I emerge something large. Wonko I have a separate /boot, /usr/portage, /home and /var. I started to make /var larger but didn't realize I was going to be using the http-replicator thing. It would be nice to have LVM but that is water under the bridge right now. Dale :-) :-)
Re: [gentoo-user] Running out of space on /var partition
Dale wrote: I run KDE here and it uses less than 1Gbs all the time. Most of the time it hovers around 1Gb with a lot of junk open. If your used 8Gbs, you got a lot running or something. o_O That should read less than 2 Gbs all the time. I hit the wrong button. lol Dale :-) :-)
Re: [gentoo-user] Re: mysqld invoked oom-killer
walt wrote: On 07/25/2011 08:54 PM, Grant wrote: BTW, can anyone tell me why I'm using icedtea6-bin instead of icedtea? When I first installed icedtea-bin there was no icedtea package, so I tried to compile it myself using online instructions and gave up in frustration. I'm glad you asked, because now I'll try the icedtea package instead. I just noticed the icedtea-web package, which supplies an nsbrowser java plugin. I don't know if the 'plugin' errors you were seeing are related to the browser java plugin or some other plugin library, but I'm going to install both packages tomorrow and give them a try. I assume you need to eselect the java-nsplugin as well as the java-vm if you install icedtea-web. I'll try it. Now I got to ask a question. Does this replace the other flash player thingy that has so many security holes? If so, can you post how well it works? Does it work well, so so, not well at all? If it works OK, I might like to try it. Dale :-) :-)
Re: [gentoo-user] Re: mysqld invoked oom-killer
Now I got to ask a question. Does this replace the other flash player thingy that has so many security holes? No, java != flash, different plugin. Try about:plugins in the URL box so see what you have.
[gentoo-user] Re: Running out of space on /var partition
On 07/27/2011 08:01 AM, Michael Mol wrote: If you allow tmpfs to be backed by swap... Does that require some extra configuration?
Re: [gentoo-user] Re: mysqld invoked oom-killer
Adam Carter wrote: Now I got to ask a question. Does this replace the other flash player thingy that has so many security holes? No, java != flash, different plugin. Try about:plugins in the URL box so see what you have. OK. I just thought there may be a open source option that is better or at least has less security problems. Thanks. Dale :-) :-)
Re: [gentoo-user] Re: mysqld invoked oom-killer
OK. I just thought there may be a open source option that is better or at least has less security problems. There are some, lightspark and gnash are in portage. I've never tried any of them...
Re: Re: [gentoo-user] Running out of space on /var partition
Dale writes: Alex Schuster wrote: I don't use tmpfs any more, as 8G of RAM is barely enough to run KDe here. I run KDE here and it uses less than 1Gbs all the time. Most of the time it hovers around 1Gb with a lot of junk open. If your used 8Gbs, you got a lot running or something. o_O I'm using 4.5G right now according to free -m (using the -/+ buffers/cache entry). 550M for a Windows VM, 355M for Kontact, 350M for my TV-Browser application, 200M for Firefox, incredible 165M for a Chromium instance, 155M plasma-desktop. Oh, there's an emerge -a command waiting for me to confirm it should run, 155M. virtuoso-t neds 150M, the same goes for Amarok, and kwin is at 140 now. The rest is mainly more Chromium and Konqueror processes, X, akonadi_nepomuk, apache2, kmymoney, the rest is less then 65M each. The system even starts swapping from time to time. 6G was not enough, things are much better now that I have 8G. With 4, it became unusable after 1-2 days of being logged into KDE. Well, if you were using LVM, this would take less than a minute: lvresize -L +2G /dev/myVolumeGroup/myVarVolume resize2fs /dev/myVolumeGroup/myVarVolume Yea but I don't use LVM. I know :) Wonko
[gentoo-user] Re: wireshark fails. undefined reference to ****
On 07/27/2011 09:04 AM, Dale wrote: Todd Goodman wrote: It looks like you're missing linking in of libgcrypt. Maybe ensure you have an up to date version (or not too up to date.) Or try emerging without the gcrypt use flag? I just emerged that for x86 and had no problem. But I don't have the gcrypt use flag enabled. Todd Dale :-) :-) I have dev-libs/libgcrypt-1.4.6-r1 installed at the moment. The others are keyworded. Anyone used the 1.5 series with no problems? I have wireshark-1.48 and libgcrypt-1.5.0 (with gcrypt useflag set) and had no problems compiling. I'm running ~amd64 and ~x86.
Re: [gentoo-user] Running out of space on /var partition
Alex Schuster wrote: Dale writes: Alex Schuster wrote: I don't use tmpfs any more, as 8G of RAM is barely enough to run KDe here. I run KDE here and it uses less than 1Gbs all the time. Most of the time it hovers around 1Gb with a lot of junk open. If your used 8Gbs, you got a lot running or something. o_O I'm using 4.5G right now according to free -m (using the -/+ buffers/cache entry). 550M for a Windows VM, 355M for Kontact, 350M for my TV-Browser application, 200M for Firefox, incredible 165M for a Chromium instance, 155M plasma-desktop. Oh, there's an emerge -a command waiting for me to confirm it should run, 155M. virtuoso-t neds 150M, the same goes for Amarok, and kwin is at 140 now. The rest is mainly more Chromium and Konqueror processes, X, akonadi_nepomuk, apache2, kmymoney, the rest is less then 65M each. The system even starts swapping from time to time. 6G was not enough, things are much better now that I have 8G. With 4, it became unusable after 1-2 days of being logged into KDE. Well, if you were using LVM, this would take less than a minute: lvresize -L +2G /dev/myVolumeGroup/myVarVolume resize2fs /dev/myVolumeGroup/myVarVolume Yea but I don't use LVM. I know :) Wonko Jeez, I thought I used the kitchen sink here at times. The better question may be, what don't you have running? LOL Dale :-) :-)
[gentoo-user] Re: IRC active time?
On 07/26/2011 06:07 PM, Pandu Poluan wrote: Anyone here knows at what time the Gentoo IRC channels are usually active? In UTC, if possible :) (Still can't wrap my head around USA time zone codes) I'd like to commission a survey of, say, MS, google, and Oracle, to see who is wearing a wrist-watch, and who isn't -- and then sort them by job description. I predict that the ones with no wrist-watch are the one who arewell, I'll wait for the survey to be done before I announce my prediction.
Re: [gentoo-user] Re: wireshark fails. undefined reference to ****
walt wrote: On 07/27/2011 09:04 AM, Dale wrote: Todd Goodman wrote: It looks like you're missing linking in of libgcrypt. Maybe ensure you have an up to date version (or not too up to date.) Or try emerging without the gcrypt use flag? I just emerged that for x86 and had no problem. But I don't have the gcrypt use flag enabled. Todd Dale :-) :-) I have dev-libs/libgcrypt-1.4.6-r1 installed at the moment. The others are keyworded. Anyone used the 1.5 series with no problems? I have wireshark-1.48 and libgcrypt-1.5.0 (with gcrypt useflag set) and had no problems compiling. I'm running ~amd64 and ~x86. Thanks. I'll add them to the keyword file and give it a whirl. Dale :-) :-)
[gentoo-user] logrotate blocks portage?
Tried `emerge -avuND @world` and found out that logrotate blocks portage : Total: 17 packages (13 upgrades, 1 downgrade, 2 new, 1 in new slot), Size of downloads: 39,167 kB Conflict: 1 block (1 unsatisfied) * Error: The above package list contains packages which cannot be * installed at the same time on the same system. (app-admin/logrotate-3.7.9-r2::gentoo, installed) pulled in by app-admin/logrotate required by (net-proxy/squid-3.1.8::gentoo, installed) app-admin/logrotate required by @selected (sys-apps/portage-2.2.0_alpha47::gentoo, ebuild scheduled for merge) pulled in by sys-apps/portage required by @selected sys-apps/portage required by (virtual/package-manager-0::gentoo, installed) sys-apps/portage required by (app-portage/gentoolkit-0.3.0.4::gentoo, installed) =sys-apps/portage-2.1.6 required by (app-admin/python-updater-0.9::gentoo, installed) Oookay. So. How can I solve this conundrum? I *need* squid. Rgds, -- Pandu E Poluan ~ IT Optimizer ~ • Blog : http://pepoluan.tumblr.com • Linked-In : http://id.linkedin.com/in/pepoluan
Re: [gentoo-user] Re: IRC active time?
On Wed, Jul 27, 2011 at 9:23 PM, walt w41...@gmail.com wrote: On 07/26/2011 06:07 PM, Pandu Poluan wrote: Anyone here knows at what time the Gentoo IRC channels are usually active? In UTC, if possible :) (Still can't wrap my head around USA time zone codes) I'd like to commission a survey of, say, MS, google, and Oracle, to see who is wearing a wrist-watch, and who isn't -- and then sort them by job description. I predict that the ones with no wrist-watch are the one who arewell, I'll wait for the survey to be done before I announce my prediction. /me wonders where you are going with this...
