Re: [gentoo-user] Partitioning strategy...?
On Sun, 27 Nov 2011 00:01:07 +0100 Alex Schuster wo...@wonkology.org wrote: pvcreate /dev/sda5 vgcreate myvg /dev/sda5 lvcreate -n usr -L 10G myvg mke2fs -j /dev/myvg/usr Of course, just using /dev/sda5 for /usr is simpler. But what if this turns out to be too small? With so many partitions I would think this is very likely to happen sooner or later. With LVM, all you'd have to do is: lvresize -L +1G /dev/myvg/usr resize2fs /dev/myvg/usr Here I do not understand from where this +1G is taken? Don't you have to make something smaller by 1G first? Robert -- Róbert Čerňanský E-mail: hslis...@zoznam.sk Jabber: h...@jabber.sk
Re: [gentoo-user] Partitioning strategy...?
Róbert Čerňanský wrote: On Sun, 27 Nov 2011 00:01:07 +0100 Alex Schusterwo...@wonkology.org wrote: pvcreate /dev/sda5 vgcreate myvg /dev/sda5 lvcreate -n usr -L 10G myvg mke2fs -j /dev/myvg/usr Of course, just using /dev/sda5 for /usr is simpler. But what if this turns out to be too small? With so many partitions I would think this is very likely to happen sooner or later. With LVM, all you'd have to do is: lvresize -L +1G /dev/myvg/usr resize2fs /dev/myvg/usr Here I do not understand from where this +1G is taken? Don't you have to make something smaller by 1G first? Robert Nope. Not if you have 1Gb of space that is not used yet. Here is a example: root@fireball / # vgdisplay --- Volume group --- VG Name data System ID Formatlvm2 Metadata Areas1 Metadata Sequence No 9 VG Access read/write VG Status resizable MAX LV0 Cur LV1 Open LV 1 Max PV0 Cur PV1 Act PV1 VG Size 698.63 GiB PE Size 4.00 MiB Total PE 178850 Alloc PE / Size 102400 / 400.00 GiB Free PE / Size 76450 / 298.63 GiB VG UUID eNF7B0-3BDb-qe1W-5FTH-4Uah-wRe1-xD7Xa8 root@fireball / # Right now there is 400Gbs of space used. I have 298Gbs of free space. If I wanted to add some space to something, lvresize -L +1G /dev/path to lv here would get it added then just resize the file system. That help? Dale :-) :-) -- I am only responsible for what I said ... Not for what you understood or how you interpreted my words!
Re: [gentoo-user] Partitioning strategy...?
On Sun, 27 Nov 2011 09:02:37 +0100 Róbert Čerňanský hslis...@zoznam.sk wrote: On Sun, 27 Nov 2011 00:01:07 +0100 Alex Schuster wo...@wonkology.org wrote: pvcreate /dev/sda5 vgcreate myvg /dev/sda5 lvcreate -n usr -L 10G myvg mke2fs -j /dev/myvg/usr Of course, just using /dev/sda5 for /usr is simpler. But what if this turns out to be too small? With so many partitions I would think this is very likely to happen sooner or later. With LVM, all you'd have to do is: lvresize -L +1G /dev/myvg/usr resize2fs /dev/myvg/usr Here I do not understand from where this +1G is taken? Don't you have to make something smaller by 1G first? The 1G is taken from the free pool of unused extents. This assumes you have free extents, if not, then you do need to free some up somwehere else first. Using LVM is a lot like using a SAN - don't allocate everything right at the beginning, rather give each lv what it needs today and grow it as space needs change. This way you always have free extents available for use. -- Alan McKinnnon alan.mckin...@gmail.com
Re: [gentoo-user] Gnupg 2 and BZIP2 preference
On Saturday 26 Nov 2011 23:50:24 Florian Philipp wrote: Am 27.11.2011 00:03, schrieb Samuraiii: Hello fellow Gentoonians, I have problem with Gnupg 2 and compress preference on keys. When I recieve email which is for recipirnt with set compress preference to BZIP2 Thunderbird (with enigmail) fails to decrypt it due this: gpg command line and output: /usr/bin/gpg2 gpg: invalid item `BZIP2' in preference string gpg: invalid personal compress preferences As I have set BZIP2 USE as global in make.conf I don't see why is not working gpg --version returns: [...] I've re-emerged gpg-2.0.17 (USE=nls bzip2) and cannot confirm this issue. gpg --version gpg (GnuPG) 2.0.17 libgcrypt 1.4.6 Copyright (C) 2011 Free Software Foundation, Inc. License GPLv3+: GNU GPL version 3 or later http://gnu.org/licenses/gpl.html This is free software: you are free to change and redistribute it. There is NO WARRANTY, to the extent permitted by law. Home: ~/.gnupg Supported algorithms: Pubkey: RSA, ELG, DSA Cipher: 3DES, CAST5, BLOWFISH, AES, AES192, AES256, TWOFISH, CAMELLIA128, CAMELLIA192, CAMELLIA256 Hash: MD5, SHA1, RIPEMD160, SHA256, SHA384, SHA512, SHA224 Compression: Uncompressed, ZIP, ZLIB, BZIP2 I haven't remerged mine recently, but I have more detailed compression options it seems: === $ gpg --version gpg (GnuPG) 2.0.17 libgcrypt 1.4.6 Copyright (C) 2011 Free Software Foundation, Inc. License GPLv3+: GNU GPL version 3 or later http://gnu.org/licenses/gpl.html This is free software: you are free to change and redistribute it. There is NO WARRANTY, to the extent permitted by law. Home: ~/.gnupg Supported algorithms: Pubkey: RSA, ELG, DSA Cipher: 3DES (S2), CAST5 (S3), BLOWFISH (S4), AES (S7), AES192 (S8), AES256 (S9), TWOFISH (S10), CAMELLIA128 (S11), CAMELLIA192 (S12), CAMELLIA256 (S13) Hash: MD5 (H1), SHA1 (H2), RIPEMD160 (H3), SHA256 (H8), SHA384 (H9), SHA512 (H10), SHA224 (H11) Compression: Uncompressed (Z0), ZIP (Z1), ZLIB (Z2), BZIP2 (Z3) === These are the flags that I have emerged it with: $ eix -l gnupg [I] app-crypt/gnupg . . . Installed versions: 2.0.17(09:22:32 02/20/11)(bzip2 ldap nls -adns -caps -doc -openct -pcsc-lite -selinux -smartcard -static) -- Regards, Mick signature.asc Description: This is a digitally signed message part.
Re: [gentoo-user] emerge -j, make -j and make -l
On Saturday 26 Nov 2011 15:22:15 Michael Mol wrote: I just wanted to share an experience I had today with optimizing parallel builds after discovering -l for Make... I've got a little more tweaking I still want to do, but this is pretty awesome... http://funnybutnot.wordpress.com/2011/11/26/optimizing-parallel-builds/ ZZ Thanks for sharing! How do you determine the optimum value for -l? -- Regards, Mick signature.asc Description: This is a digitally signed message part.
Re: [gentoo-user] Partitioning strategy...?
Róbert Čerňanský writes: On Sun, 27 Nov 2011 00:01:07 +0100 Alex Schuster wo...@wonkology.org wrote: pvcreate /dev/sda5 vgcreate myvg /dev/sda5 lvcreate -n usr -L 10G myvg mke2fs -j /dev/myvg/usr Of course, just using /dev/sda5 for /usr is simpler. But what if this turns out to be too small? With so many partitions I would think this is very likely to happen sooner or later. With LVM, all you'd have to do is: lvresize -L +1G /dev/myvg/usr resize2fs /dev/myvg/usr Here I do not understand from where this +1G is taken? Don't you have to make something smaller by 1G first? I assumed that /dev/sda5 is large enough and has free space that is not being used for logical volumes. The lvcreate -L 10G step creates a logical volume of 10 GB size, the rest of the volume group (that is using the physical volume /dev/sda5) is being unused. You can create other logical volumes with lvcreate, or extend existing ones, until all of that space is being used. Then, you need to make something smaller of course (which can be done), or you can extend your volume group by another partition. Which may be on the same drive, or even on another one. pvcreate /dev/sda6 vgextend myvg /dev/sda6 lvresize... Wonko
Re: [gentoo-user] emerge -j, make -j and make -l
On Sun, Nov 27, 2011 at 4:27 AM, Mick michaelkintz...@gmail.com wrote: On Saturday 26 Nov 2011 15:22:15 Michael Mol wrote: I just wanted to share an experience I had today with optimizing parallel builds after discovering -l for Make... I've got a little more tweaking I still want to do, but this is pretty awesome... http://funnybutnot.wordpress.com/2011/11/26/optimizing-parallel-builds/ ZZ Thanks for sharing! How do you determine the optimum value for -l? I'm making an educated guess. . I figure that the optimal number of simultaneous CPU-consuming processes is going to be the number of CPU cores, plus enough to keep the CPU occupied while others are blocked on I/O. That's the same reasoning that drives the selection of a -j number, really. If I read make's man page correctly, -l acts as a threshold, choosing not to spawn an additional child process if the system load average is above a certain value Since system load is a count of actively running and ready-to-run processes, you want it to be very close to your number of logical cores[1]. Since it's going to be a spot decision for Make as to whether or not to spawn another child (if it hits its limit, it's not going to check again until after one of its children returns), there will be many race cases where the load average is high when it looks, but some other processes will return shortly afterward.[2] That means adding a process or two for a fudge factor. That's a lot of guess, though, and it still comes down to guess-and-check. emerge -j8 @world # MAKEOPTS=-j16 -l10 Was the first combination I tried. This completed in 89 minutes. emerge -j8 @world # MAKEOPT=-j16 -l8 Was the second. This took significantly longer. I haven't tried higher than -l10; I needed this box to do be able to do things, which meant installing more software. I've gone from 177 packages to 466. [1] I don't have a hyperthreading system available, but I suspect that this is also going to be true of logical cores; It's my understanding that the overhead from overcommitting CPU comes primarily from context switching between processors, and hyperthreading adds CPU hardware specifically to reduce the need to context-switch in splitting physical CPU resources between threads/processes. So while you'd lose a little speed for an individual thread, you would gain it back in aggregate over both threads. [2] There would also be cases where the load average is low, such as if a Make recipe calls for a significant bit of I/O before it consumes a great deal of CPU, but a simple 7200rpm SATA disk appears to be sufficiently fast that this case is less frequent. -- :wq
Re: [gentoo-user] emerge -j, make -j and make -l
Mick michaelkintz...@gmail.com wrote: On Saturday 26 Nov 2011 15:22:15 Michael Mol wrote: I just wanted to share an experience I had today with optimizing parallel builds after discovering -l for Make... I've got a little more tweaking I still want to do, but this is pretty awesome... http://funnybutnot.wordpress.com/2011/11/26/optimizing-parallel-builds/ ZZ Thanks for sharing! How do you determine the optimum value for -l? How do you get emerge not to display number of jobs and load average -- I only want to compile one at a time -- much safer that way and it is doing that, but now it displays all that load average and how many jobs, etc. -- any way to get rid of that display? -- Your life is like a penny. You're going to lose it. The question is: How do you spend it? John Covici cov...@ccs.covici.com
Re: [gentoo-user] emerge -j, make -j and make -l
On Sun, Nov 27, 2011 at 5:39 AM, cov...@ccs.covici.com wrote: Mick michaelkintz...@gmail.com wrote: On Saturday 26 Nov 2011 15:22:15 Michael Mol wrote: I just wanted to share an experience I had today with optimizing parallel builds after discovering -l for Make... I've got a little more tweaking I still want to do, but this is pretty awesome... http://funnybutnot.wordpress.com/2011/11/26/optimizing-parallel-builds/ ZZ Thanks for sharing! How do you determine the optimum value for -l? How do you get emerge not to display number of jobs and load average -- The display is something emerge will show you if you've asked it to build in parallel (which you did, by passing -j to emerge. That's different from putting -j in MAKEOPTS.) I only want to compile one at a time -- much safer that way and it is doing that, It's likely only doing that because there isn't anything it can immediately build that doesn't have what it's *currently* working on as a build dependency. I noted in my blog post that emerge's parallelization has many of the same limitations as make's that's one of the things I was talking about; there can be linchpin and keystone packages which need to be built before many others. libc would be an example. gcc is a frequent example. but now it displays all that load average and how many jobs, etc. -- any way to get rid of that display? Forget the display; it sounds like you don't want emerge building in parallel. In that event, don't pass -j to emerge. The display will go away. -- :wq
Re: [gentoo-user] glibc-2.14.1 upgrade
Am 27.11.2011 01:59, schrieb Paul Hartman: On Sat, Nov 26, 2011 at 6:25 PM, Adam Carter adamcart...@gmail.com wrote: /lib64/libc.so.6: version `GLIBC_2.14' not found (required by /lib64/libcrypt.so.1) There were no @preserved-rebuild and revdep-rebuild found nothing. I rebuilt pam and things seem to be working again. Are there any other packages I should rebuild before encountering a problem? Or some way to detect which need to be rebuilt? Should I re-emerge world against my new glibc? :) How did you know to rebuild pam? Both /lib64/libc.so.6 and /lib64/libcrypt.so.1 are from glibc, and I interpret your error as 'libcrypt.so.1 couldn't find a GLIBC_2.14 version of /lib64/libc.so.6', which doesn't make any sense to me as both files are from the same package. How could the version dependency between them be incorrect? Sorry, I accidentally pasted the incomplete error message. It was part of this kind of message in my syslog: Nov 25 19:40:01 [cron] PAM unable to dlopen(/lib64/security/pam_unix.so): /lib64/libc.so.6: version `GLIBC_2.14' not found (required by /lib64/security/pam_unix.so) Nov 25 19:40:01 [cron] PAM adding faulty module: /lib64/security/pam_unix.so THAT is the reason why neither revdep-rebuild nor @preserved-rebuild found pam. It dynamically loads libraries using dlopen instead of letting the dynamic linker handle it when the application is started. There is no reasonable way for revdep-rebuild to find these issues. Regards, Florian Philipp signature.asc Description: OpenPGP digital signature
[gentoo-user] Re: Any vbox made gentoo vm appliances available for dload
Albert W. Hopkins mar...@letterboxes.org writes: On Sat, 2011-11-26 at 17:01 -0600, Harry Putnam wrote: Creating a gentoo vm has always been a serious pita to me. I'm sure there will be those who claim its `simple'. Simple or not, I want to bypass it if possible. So wondering if anyone here has (or has seen) a gentoo (vbox) appliance available for download? I maintain a quasi-daily build of a gentoo virtual appliance. It should work with kvm, vmware, and virutalbox (and possibly xen?). Albert, I cloned your hg repo and tried to build from it, but it fails at downloading gentoo-sources. Something about not being able to resolve the kernel URLS. I suspect it is a problem in the ebuild itself, but I was not able to find where `portage' is on disc during that build. I wanted to attempt editing the ebuild but even with variable: REMOVE_PORTAGE_TREE NO I never find a `portage' directory. Once the build fails, their is no `portage' directory containing the tree. In virtual-appliance: find . -type d -name 'portage' ./vabuild/var/lib/portage ./vabuild/var/log/portage ./vabuild/var/cache/edb/dep/usr/portage ./vabuild/usr/lib/portage ./vabuild/usr/lib/portage/pym/portage None of those contain the tree. Here is tail of `sudo make' , | Resolving www.fr.kernel.org... failed: Name or service not known. | wget: unable to resolve host address “www.fr.kernel.org” | Downloading 'http://www.us.kernel.org/pub/linux/kernel/v3.x/linux-3.1.tar.bz2' | --2011-11-27 04:24:43-- http://www.us.kernel.org/pub/linux/kernel/v3.x/linux-3.1.tar.bz2 | Resolving www.us.kernel.org... failed: Name or service not known. | wget: unable to resolve host address “www.us.kernel.org” | !!! Couldn't download 'linux-3.1.tar.bz2'. Aborting. | * Fetch failed for 'sys-kernel/gentoo-sources-3.1.1', Log file: | * '/var/tmp/portage/sys-kernel/gentoo-sources-3.1.1/temp/build.log' | | * Messages for package sys-kernel/gentoo-sources-3.1.1: | | * Fetch failed for 'sys-kernel/gentoo-sources-3.1.1', Log file: | * '/var/tmp/portage/sys-kernel/gentoo-sources-3.1.1/temp/build.log' ` I cannot ping any of those kernel urls. But kernel.org appears up ping kernel.org PING kernel.org (149.20.4.69) 56(84) bytes of data. 64 bytes from pub2.kernel.org (149.20.4.69): icmp_req=1 ttl=55 time=87.5 ms ls vabuild/var/tmp/ empty Apparently umounted or rm'd How to keep working portage tree accessible. I monkeyed around with your Makefile but couldn't follow it well enough to stop the umounting.
[gentoo-user] Re: Any vbox made gentoo vm appliances available for dload
James Wall wallservi...@gmail.com writes: On Sat, Nov 26, 2011 at 5:01 PM, Harry Putnam rea...@newsguy.com wrote: Creating a gentoo vm has always been a serious pita to me. I'm sure there will be those who claim its `simple'. Simple or not, I want to bypass it if possible. So wondering if anyone here has (or has seen) a gentoo (vbox) appliance available for download? From an earlier thread about virtual machine images the link is here: the thread is titled [OT virtual stuff] gentoo vm appliance http://starship.python.net/crew/marduk/base.vmdk That 404s for me.
Re: [gentoo-user] emerge -j, make -j and make -l
cov...@ccs.covici.com wrote: Mickmichaelkintz...@gmail.com wrote: On Saturday 26 Nov 2011 15:22:15 Michael Mol wrote: I just wanted to share an experience I had today with optimizing parallel builds after discovering -l for Make... I've got a little more tweaking I still want to do, but this is pretty awesome... http://funnybutnot.wordpress.com/2011/11/26/optimizing-parallel-builds/ ZZ Thanks for sharing! How do you determine the optimum value for -l? How do you get emerge not to display number of jobs and load average -- I only want to compile one at a time -- much safer that way and it is doing that, but now it displays all that load average and how many jobs, etc. -- any way to get rid of that display? Thank Zac for that. He thinks he knows what you want. ;-) Apparently not huh? http://forums.gentoo.org/viewtopic-t-901858.html Just add --quiet-build=n to EMERGE_DEFAULT_OPTS in make.conf and it will do it the old way. Hope that helps. Dale :-) :-) -- I am only responsible for what I said ... Not for what you understood or how you interpreted my words!
[gentoo-user] Re: Any vbox made gentoo vm appliances available for dload
Albert W. Hopkins mar...@letterboxes.org writes: This is just a minimal Gentoo install, I have specialized appliances as well. where?
Re: [gentoo-user] gnome 3 has landed
I googled how to disable the gnome-shell and get my gnome-panel back, along with the panel applets that I refuse to give up. (The gnome- shell replaces the gnome-panel, so there is nowhere to run the old applets.) If you want to disable gnome-shell you can do it with the System Info function in System Settings. Click the Graphics icon and enable the gnome-fallback setting to disable gnome-shell. Ah, much better :) I don't know if this can be useful for you, however: having a box with debian, I read the debian ML, too. Two weeks ago (if I remember correctly) gnome 3 landed in testing, resulting in many discussions. Among these, I remember that a few people claimed that fallback mode is only a temporary solution, and, sooner or later, it'll be removed. I don't know if it's true or not, but maybe this information can be valuable (or worth verification) for those that are going to run gnome 3 in fallback mode... FYI only. Cheers, Lorenzo -- Nothing is interesting if you're not interested.
Re: [gentoo-user] Any vbox made gentoo vm appliances available for dload
On Sun, 2011-11-27 at 08:48 +0530, Vishnupradeep wrote: Albert W. Hopkins, is that 64bit or 32bit ? It si 64-bit. Though conceivably the build process could build 32-bit appliances, I haven't yet tried it.
Re: [gentoo-user] Any vbox made gentoo vm appliances available for dload
On Sun, 2011-11-27 at 08:53 +0530, Vishnupradeep wrote: Need login details. There are none. When you first log in (as root) you are forced to set a password.
Re: [gentoo-user] wicd and net-tools
On Sunday 27 November 2011 02.02:54 Paul Hartman wrote: On Fri, Nov 25, 2011 at 4:58 PM, Allan Gottlieb gottl...@nyu.edu wrote: In the last day or two wicd broke badly due to a net-tools upgrade. The recommended workarounds are to specify USE=old-output for net-tools or to downgrade net-tools one version (I am ~amd64). Neither of these have helped me. Wicd cannot start either the wired or wireless interface. I have no solution, but just a me too that wicd-based networking stopped working entirely after I emerged some updates a couple days ago. My short-term solution was just stop wicd and use the old-style net init script instead since I haven't had time to research any this weekend yet. I had the same issue after upgrading net-tools, wicd stoped working. While googling for a solution I found a workaround: Use the ioctl backend instead of the external backend. For me this workaround works. -- Dan Johansson, http://www.dmj.nu *** This message is printed on 100% recycled electrons! ***
Re: [gentoo-user] Re: Any vbox made gentoo vm appliances available for dload
On Sun, 2011-11-27 at 04:52 -0600, Harry Putnam wrote: Albert, I cloned your hg repo and tried to build from it, but it fails at downloading gentoo-sources. Something about not being able to resolve the kernel URLS. I suspect it is a problem in the ebuild itself, but I was not able to find where `portage' is on disc during that build. I wanted to attempt editing the ebuild but even with variable: REMOVE_PORTAGE_TREE NO I never find a `portage' directory. It grabs the sources from wherever they are specified (SRC_URI) in the ebuild. I just tried it and it worked for me: virtual-appliance # emerge --fetchonly gentoo-sources Calculating dependencies... done! Fetching (1 of 1) sys-kernel/gentoo-sources-3.0.6 Downloading 'http://distfiles.gentoo.org/distfiles/linux-3.0.tar.bz2' --2011-11-27 12:15:37-- http://distfiles.gentoo.org/distfiles/linux-3.0.tar.bz2 Resolving distfiles.gentoo.org... 216.165.129.135, 64.50.233.100, 64.50.236.52, ... Connecting to distfiles.gentoo.org|216.165.129.135|:80... connected. HTTP request sent, awaiting response... 200 OK Length: 76753134 (73M) [application/x-tar] Saving to: `/usr/portage/distfiles/linux-3.0.tar.bz2' 100%[==] 76,753,134 523K/s in 49s The portage tree itself (should be) in the chroot directory. The build will download the latest snapshot and unpack it in the chroot. Although, I did just try that and am getting failures. It seems the latest portage snapshot is currupt? virtual-appliance # make portage rsync --no-motd -L rsync://rsync.us.gentoo.org/gentoo/snapshots/portage-latest.tar.bz2 portage-latest.tar.bz2 touch sync_portage mkdir -p /root/virtual-appliance/vabuild tar xjpf stage4/base-stage4.tar.bz2 -C /root/virtual-appliance/vabuild touch stage3 tar xjf portage-latest.tar.bz2 -C /root/virtual-appliance/vabuild/usr tar: Unexpected EOF in archive tar: Unexpected EOF in archive tar: Error is not recoverable: exiting now make: *** [portage] Error 2 Anyone else getting this?
Re: [gentoo-user] emerge -j, make -j and make -l
Dale rdalek1...@gmail.com wrote: cov...@ccs.covici.com wrote: Mickmichaelkintz...@gmail.com wrote: On Saturday 26 Nov 2011 15:22:15 Michael Mol wrote: I just wanted to share an experience I had today with optimizing parallel builds after discovering -l for Make... I've got a little more tweaking I still want to do, but this is pretty awesome... http://funnybutnot.wordpress.com/2011/11/26/optimizing-parallel-builds/ ZZ Thanks for sharing! How do you determine the optimum value for -l? How do you get emerge not to display number of jobs and load average -- I only want to compile one at a time -- much safer that way and it is doing that, but now it displays all that load average and how many jobs, etc. -- any way to get rid of that display? Thank Zac for that. He thinks he knows what you want. ;-) Apparently not huh? http://forums.gentoo.org/viewtopic-t-901858.html Just add --quiet-build=n to EMERGE_DEFAULT_OPTS in make.conf and it will do it the old way. Hope that helps. Thanks much. Don't these people have anything to do -- like fix ebuild bugs? Very strange indeed. -- Your life is like a penny. You're going to lose it. The question is: How do you spend it? John Covici cov...@ccs.covici.com
Re: [gentoo-user] emerge -j, make -j and make -l
cov...@ccs.covici.com wrote: Dalerdalek1...@gmail.com wrote: cov...@ccs.covici.com wrote: Mickmichaelkintz...@gmail.com wrote: On Saturday 26 Nov 2011 15:22:15 Michael Mol wrote: I just wanted to share an experience I had today with optimizing parallel builds after discovering -l for Make... I've got a little more tweaking I still want to do, but this is pretty awesome... http://funnybutnot.wordpress.com/2011/11/26/optimizing-parallel-builds/ ZZ Thanks for sharing! How do you determine the optimum value for -l? How do you get emerge not to display number of jobs and load average -- I only want to compile one at a time -- much safer that way and it is doing that, but now it displays all that load average and how many jobs, etc. -- any way to get rid of that display? Thank Zac for that. He thinks he knows what you want. ;-) Apparently not huh? http://forums.gentoo.org/viewtopic-t-901858.html Just add --quiet-build=n to EMERGE_DEFAULT_OPTS in make.conf and it will do it the old way. Hope that helps. Thanks much. Don't these people have anything to do -- like fix ebuild bugs? Very strange indeed. Well, they had the poll but the dev thinks he knows better. So, this is Gentoo and the devs rule the roost here. It's pretty much been that way since I started using Gentoo back in 2003. I don't expect it to change and you shouldn't either. ;-) Just do like I do, when they change something, override it with your own setting. It works for me. Dale :-) :-) -- I am only responsible for what I said ... Not for what you understood or how you interpreted my words!
[gentoo-user] Can one get me that link?
Hi, Can one please let me know about the difference between the two torrents written at: http://torrents.gentoo.org/ Since in both the torrents, 'amd 64' is written...? Thanks.
Re: [gentoo-user] Can one get me that link?
What is multilib and how can I use it? Every AMD64 processor is able to run 32bit code as well as 64bit code. However, when you have a 32bit application, you are unable to mix it with 64bit libraries or vice versa. You can, however, natively run 32bit applications if all shared libraries it needs are available as 32bit objects. You can choose whether you want multilib support or not by selecting the according profile. The default is a multilib-enabled profile. *Warning: *Currently you cannot switch from a no-multilib to a multilib-enabled profile, so think over your decision twice before you use the no-multilib profile. source: http://www.gentoo.org/doc/en/gentoo-amd64-faq.xml#multilib Linux Blog: http://xtreme-linux.blogspot.com/ Fedora Blog: http://xtreme-fedora.blogspot.com/ My Blog: http://sharedonweb.blogspot.com/ On Sun, Nov 27, 2011 at 8:32 PM, LinuxIsOne linuxis...@gmail.com wrote: Hi, Can one please let me know about the difference between the two torrents written at: http://torrents.gentoo.org/ Since in both the torrents, 'amd 64' is written...? Thanks.
Re: [gentoo-user] emerge -j, make -j and make -l
Dale rdalek1...@gmail.com wrote: cov...@ccs.covici.com wrote: Dalerdalek1...@gmail.com wrote: cov...@ccs.covici.com wrote: Mickmichaelkintz...@gmail.com wrote: On Saturday 26 Nov 2011 15:22:15 Michael Mol wrote: I just wanted to share an experience I had today with optimizing parallel builds after discovering -l for Make... I've got a little more tweaking I still want to do, but this is pretty awesome... http://funnybutnot.wordpress.com/2011/11/26/optimizing-parallel-builds/ ZZ Thanks for sharing! How do you determine the optimum value for -l? How do you get emerge not to display number of jobs and load average -- I only want to compile one at a time -- much safer that way and it is doing that, but now it displays all that load average and how many jobs, etc. -- any way to get rid of that display? Thank Zac for that. He thinks he knows what you want. ;-) Apparently not huh? http://forums.gentoo.org/viewtopic-t-901858.html Just add --quiet-build=n to EMERGE_DEFAULT_OPTS in make.conf and it will do it the old way. Hope that helps. Thanks much. Don't these people have anything to do -- like fix ebuild bugs? Very strange indeed. Well, they had the poll but the dev thinks he knows better. So, this is Gentoo and the devs rule the roost here. It's pretty much been that way since I started using Gentoo back in 2003. I don't expect it to change and you shouldn't either. ;-) Just do like I do, when they change something, override it with your own setting. It works for me. Yep, that is the nice thing about gentoo. Thanks. -- Your life is like a penny. You're going to lose it. The question is: How do you spend it? John Covici cov...@ccs.covici.com
Quiet builds Re: [gentoo-user] emerge -j, make -j and make -l
On Sun, Nov 27, 2011 at 5:58 AM, Dale rdalek1...@gmail.com wrote: cov...@ccs.covici.com wrote: Mickmichaelkintz...@gmail.com wrote: On Saturday 26 Nov 2011 15:22:15 Michael Mol wrote: I just wanted to share an experience I had today with optimizing parallel builds after discovering -l for Make... I've got a little more tweaking I still want to do, but this is pretty awesome... http://funnybutnot.wordpress.com/2011/11/26/optimizing-parallel-builds/ ZZ Thanks for sharing! How do you determine the optimum value for -l? How do you get emerge not to display number of jobs and load average -- I only want to compile one at a time -- much safer that way and it is doing that, but now it displays all that load average and how many jobs, etc. -- any way to get rid of that display? Thank Zac for that. He thinks he knows what you want. ;-) Apparently not huh? http://forums.gentoo.org/viewtopic-t-901858.html Just add --quiet-build=n to EMERGE_DEFAULT_OPTS in make.conf and it will do it the old way. Oh! I hadn't realized there was an update to portage that changed that. Missed it on my main box, I suppose. -- :wq
[gentoo-user] [OT]: How does behave the Olympus LS-5/LS-11 with Linux?
Hi, does anyone own a Plympus LS-5 or Olympus LS-11 mobile digital audio recorder here? Is it possible to access this device 1) as a usb storage device for downloading the recordings 2) as usb audio device to be used a stereo usb mcirohone ? Thank you very much in advance for any help! Best regards, mcc
Re: Quiet builds Re: [gentoo-user] emerge -j, make -j and make -l
Michael Mol wrote: On Sun, Nov 27, 2011 at 5:58 AM, Dalerdalek1...@gmail.com wrote: cov...@ccs.covici.com wrote: Mickmichaelkintz...@gmail.comwrote: On Saturday 26 Nov 2011 15:22:15 Michael Mol wrote: I just wanted to share an experience I had today with optimizing parallel builds after discovering -l for Make... I've got a little more tweaking I still want to do, but this is pretty awesome... http://funnybutnot.wordpress.com/2011/11/26/optimizing-parallel-builds/ ZZ Thanks for sharing! How do you determine the optimum value for -l? How do you get emerge not to display number of jobs and load average -- I only want to compile one at a time -- much safer that way and it is doing that, but now it displays all that load average and how many jobs, etc. -- any way to get rid of that display? Thank Zac for that. He thinks he knows what you want. ;-) Apparently not huh? http://forums.gentoo.org/viewtopic-t-901858.html Just add --quiet-build=n to EMERGE_DEFAULT_OPTS in make.conf and it will do it the old way. Oh! I hadn't realized there was an update to portage that changed that. Missed it on my main box, I suppose. You have got to crawl out of the hole every once in a while. It was on -dev then got moved over to the forums with a poll, which the results were ignored. Bad thing is, they won't announce the change until it hits stable. I'm thinking of adding it to my sig so people will notice it and not have to ask. sighs Dale :-) :-) -- I am only responsible for what I said ... Not for what you understood or how you interpreted my words!
Re: [gentoo-user] Can one get me that link?
On Sun, Nov 27, 2011 at 10:16 AM, Vishnupradeep intermedia.vis...@gmail.com wrote: http://torrents.gentoo.org/ From this link, which one I should use to download for 64 bit processor for my PC? Thanks.
Re: Quiet builds Re: [gentoo-user] emerge -j, make -j and make -l
On Sun, Nov 27, 2011 at 10:48 AM, Dale rdalek1...@gmail.com wrote: Michael Mol wrote: Oh! I hadn't realized there was an update to portage that changed that. Missed it on my main box, I suppose. You have got to crawl out of the hole every once in a while. It was on -dev then got moved over to the forums with a poll, which the results were ignored. Bad thing is, they won't announce the change until it hits stable. I'm thinking of adding it to my sig so people will notice it and not have to ask. Hm. Honestly, I don't know that it's such a terrible default. IMO, it'd be better if builds couldn't be slowed down by slow terminals, but this is probably the simpler solution. -- :wq
[gentoo-user] What happened to OpenRC 0.9.6?
sys-apps/openrc-0.9.6 is just... gone? Not even masked, but completely gone from portage. What happened to it?
Re: [gentoo-user] What happened to OpenRC 0.9.6?
On Sun 27 Nov 2011 09:06:39 PM IST, Nikos Chantziaras wrote: sys-apps/openrc-0.9.6 is just... gone? Not even masked, but completely gone from portage. What happened to it? 0.9.6? I updated my tree 24h before writing this reply. It's still not there. Only upto 0.9.4 - is masked. -- Nilesh Govindarajan http://nileshgr.com
[gentoo-user] Re: LibreOffice 3.4.4: required HDD space
On 2011-11-20, Alan McKinnon alan.mckin...@gmail.com wrote: 4-9GiB is a pretty wide range. If the maintainer implemented that, he'd be promptly inundated with all manner of support question none of which he can answer accurately. A slight mis-measurement on how much space a specific setup needs results in a failed build, or a build that won't start or any amount of other craziness. I've developed a pretty accurate rule for determining how much disk space is required for building LO. Just before you start the emerge, do a df command. Take the number for the filesystem where your builds are done and add 15%. -- Grant
Re: [gentoo-user] What happened to OpenRC 0.9.6?
Am 27.11.2011 17:22, schrieb Nilesh Govindarajan: On Sun 27 Nov 2011 09:06:39 PM IST, Nikos Chantziaras wrote: sys-apps/openrc-0.9.6 is just... gone? Not even masked, but completely gone from portage. What happened to it? 0.9.6? I updated my tree 24h before writing this reply. It's still not there. Only upto 0.9.4 - is masked. From $PORTDIR/sys-apps/openrc/Changelog: 26 Nov 2011; William Hubbs willi...@gentoo.org -openrc-0.9.6.ebuild: remove release that did not work with rc_parallel Regards, Florian Philipp signature.asc Description: OpenPGP digital signature
Re: [gentoo-user] What happened to OpenRC 0.9.6?
Nilesh Govindarajan wrote: On Sun 27 Nov 2011 09:06:39 PM IST, Nikos Chantziaras wrote: sys-apps/openrc-0.9.6 is just... gone? Not even masked, but completely gone from portage. What happened to it? 0.9.6? I updated my tree 24h before writing this reply. It's still not there. Only upto 0.9.4 - is masked. I got this in mine: root@fireball / # equery list -p openrc * Searching for openrc ... [IP-] [ ] sys-apps/openrc-0.8.3-r1:0 [-P-] [ ~] sys-apps/openrc-0.9.2:0 [-P-] [ ~] sys-apps/openrc-0.9.3:0 [-P-] [ ~] sys-apps/openrc-0.9.3-r1:0 [-P-] [ ~] sys-apps/openrc-0.9.4:0 [-P-] [ ~] sys-apps/openrc-0.9.6:0 [-P-] [ -] sys-apps/openrc-:0 root@fireball / # My last sync was: Fri Nov 25 19:20:06 2011 If you need a ebuild or something, speak up soon while I still got it. :-) Could it be that that version had a serious problem and puked on the devs keyboard so he, or she, removed it before it messed up someone else's keyboard? We got any female devs? :/ Dale :-) :-) -- I am only responsible for what I said ... Not for what you understood or how you interpreted my words!
Re: [gentoo-user] emerge -j, make -j and make -l
Am 26.11.2011 16:22, schrieb Michael Mol: parallel builds Sweet, I didn't even know about emerges -j option to do parallel builds. Thx for sharing, I am sure I'll use this in the feature
Re: [gentoo-user] emerge -j, make -j and make -l
On Nov 28, 2011 12:29 AM, Michael Hampicke gentoo-u...@hadt.biz wrote: Am 26.11.2011 16:22, schrieb Michael Mol: parallel builds Sweet, I didn't even know about emerges -j option to do parallel builds. Thx for sharing, I am sure I'll use this in the feature emerge -j will be useful if the packages being emerged are independent from one another. Packages that depend on another package will be emerged sequentially after their dependencies are emerged. Rgds,
Re: [gentoo-user] emerge -j, make -j and make -l
On Nov 27, 2011 5:12 PM, Michael Mol mike...@gmail.com wrote: I figure that the optimal number of simultaneous CPU-consuming processes is going to be the number of CPU cores, plus enough to keep the CPU occupied while others are blocked on I/O. That's the same reasoning that drives the selection of a -j number, really. If I read make's man page correctly, -l acts as a threshold, choosing not to spawn an additional child process if the system load average is above a certain value Since system load is a count of actively running and ready-to-run processes, you want it to be very close to your number of logical cores[1]. Since it's going to be a spot decision for Make as to whether or not to spawn another child (if it hits its limit, it's not going to check again until after one of its children returns), there will be many race cases where the load average is high when it looks, but some other processes will return shortly afterward.[2] That means adding a process or two for a fudge factor. That's a lot of guess, though, and it still comes down to guess-and-check. emerge -j8 @world # MAKEOPTS=-j16 -l10 Was the first combination I tried. This completed in 89 minutes. emerge -j8 @world # MAKEOPT=-j16 -l8 Was the second. This took significantly longer. I haven't tried higher than -l10; I needed this box to do be able to do things, which meant installing more software. I've gone from 177 packages to 466. [1] I don't have a hyperthreading system available, but I suspect that this is also going to be true of logical cores; It's my understanding that the overhead from overcommitting CPU comes primarily from context switching between processors, and hyperthreading adds CPU hardware specifically to reduce the need to context-switch in splitting physical CPU resources between threads/processes. So while you'd lose a little speed for an individual thread, you would gain it back in aggregate over both threads. [2] There would also be cases where the load average is low, such as if a Make recipe calls for a significant bit of I/O before it consumes a great deal of CPU, but a simple 7200rpm SATA disk appears to be sufficiently fast that this case is less frequent. Here's my experience: I always experience emerge failures on my Gentoo VMs if I use MAKEOPTS=-j3. Not all packages, but many. Including, IIRC, glibc and gcc. This happens even if I make sure that there's just one emerge job being done. And this happens even if I allocate more vCPUs than -j, on VMware and XenServer alike. I don't know where the 'blame' lies, but I've found myself standardizing on MAKEOPTS=-j3, and PORTAGE_DEFAULT_OPTS=--jobs --load-average=1.6*num_of_vCPU (Yes, no explicit number of jobs. The newer portages are smart enough to keep starting new jobs until the load number is reached) Rgds,
Re: [gentoo-user] 200MB waste from /usr/share/locale ?
On 11/26/2011 07:32 AM, Mike Edenfield wrote: Can anyone explain what is going on ? Different packages include different levels of support for filtering their installed localization messages, typically one of install everything, install what's requested, or whats a locale? The reason you mostly have files under LC_MESSAGES is because that's 99% of what is needed to localize a package. The files in there are string resource packages, translations of the strings used by the program, which are picked up by the localization library (gettext) automatically based on your locale settings. (coreutils installs file into LC_TIME for locales with date/time formatting requirements; I don't think I've ever seen any other locale files.) The standard way to inform a package which languages you want is to set your LINGUAS variable in /etc/make.conf to the locale name(s) you want installed (without the charset specifier). LINGUAS works like any other portage expansion variables: for those packages that support it, you get a set of USE-flag-like language keywords set on build. (LINGUAS is the well-known environment variable used by most autotools-based packages to select languages, but portage provides support above and beyond that.) Unfortunately, proper locale support is spotty -- mostly due to upstream maintainers being too lazy to properly add it to their builds. Instead, the package will install every message file it has available all the time. You can safely delete any folders from /usr/share/locale for locales that you don't have installed, since the normal locale support in glibc will never ask for them. But they'll just get put back next time you upgrade the package. --Mike Excellent description -- thank you! In case I find time to blog about this on Planet Gentoo: would you allow using the above text under some Creative Commons license, say CC-BY-SA/3.0? Do you have a personal website or blog that I could add a link to? Best, Sebastian
Re: [gentoo-user] 200MB waste from /usr/share/locale ?
On 11/26/2011 01:36 AM, Albert W. Hopkins wrote: (not that 200MB is really that big by today's standards). In my case it is. I am caching all of /usr/share/ into a cache working on file system level with space limited to 1GB taken from RAM. It's an experiment and it doesn't seem to perform very well, so you don't really miss anything, though. Best, Sebastian
Re: [gentoo-user] Re: 200MB waste from /usr/share/locale ?
On 11/26/2011 06:23 PM, walt wrote: Someone recommended app-admin/localepurge, which removes them after installation. Reclaims hundreds of MB when I run it every month or so. Thanks for that hint. Best, Sebastian
Re: [gentoo-user] What happened to OpenRC 0.9.6?
On 27/11/11 16.36, Nikos Chantziaras wrote: sys-apps/openrc-0.9.6 is just... gone? Not even masked, but completely gone from portage. What happened to it? Last time I checked it was hardmasked. Now it's been confined into oblivion, I hope. It had a little problem in resolving the dependencies of a newly introduced boot service that created a cycle and caused the boot process to hang (almost) forever with rc_parallel=YES. With 100% repeatability, mind you, which does raise same questions on the amount of testing done before release. Yes, it's ~arch and rc_parallel is explicitly marked experimental, but it's not expected to be completely and consistently broken, either. If that sounds like I'm ranting, it's because I just spent about an hour getting three machines affected by this problem back into working state. If anyone still has it installed, it's time to sync and downgrade :) andrea
[gentoo-user] Re: Any vbox made gentoo vm appliances available for dload
Albert W. Hopkins mar...@letterboxes.org writes: On Sun, 2011-11-27 at 04:52 -0600, Harry Putnam wrote: Albert, I cloned your hg repo and tried to build from it, but it fails at downloading gentoo-sources. Something about not being able to resolve the kernel URLS. I suspect it is a problem in the ebuild itself, but I was not able to find where `portage' is on disc during that build. I wanted to attempt editing the ebuild but even with variable: REMOVE_PORTAGE_TREE NO I never find a `portage' directory. It grabs the sources from wherever they are specified (SRC_URI) in the ebuild. I just tried it and it worked for me: virtual-appliance # emerge --fetchonly gentoo-sources Calculating dependencies... done! Fetching (1 of 1) sys-kernel/gentoo-sources-3.0.6 Downloading 'http://distfiles.gentoo.org/distfiles/linux-3.0.tar.bz2' --2011-11-27 12:15:37-- http://distfiles.gentoo.org/distfiles/linux-3.0.tar.bz2 Resolving distfiles.gentoo.org... 216.165.129.135, 64.50.233.100, 64.50.236.52, ... Connecting to distfiles.gentoo.org|216.165.129.135|:80... connected. HTTP request sent, awaiting response... 200 OK Length: 76753134 (73M) [application/x-tar] Saving to: `/usr/portage/distfiles/linux-3.0.tar.bz2' 100%[==] 76,753,134 523K/s in 49s ---- ---=--- - ---- ---=--- - You messages have completely different urls. Yours in connecting to 'http://distfiles.gentoo.org Mine is connecting to several differnt versions of kernel.org , | Resolving www.fr.kernel.org... failed: Name or service not known. | wget: unable to resolve host address “www.fr.kernel.org” | Downloading 'http://www.us.kernel.org/pub/linux/kernel/v3.x/linux-3.1.tar.bz2' | --2011-11-27 04:24:43-- http://www.us.kernel.org/pub/linux/kernel/v3.x/linux-3.1.tar.bz2 | Resolving www.us.kernel.org... failed: Name or service not known. | wget: unable to resolve host address “www.us.kernel.org” | !!! Couldn't download 'linux-3.1.tar.bz2'. Aborting. | * Fetch failed for 'sys-kernel/gentoo-sources-3.1.1', Log file: | * '/var/tmp/portage/sys-kernel/gentoo-sources-3.1.1/temp/build.log' [...] Why is that? I cannot ping any of the urls in that message yet `kernel.org' is definitely up. The portage tree itself (should be) in the chroot directory. The build will download the latest snapshot and unpack it in the chroot. Although, I did just try that and am getting failures. It seems the latest portage snapshot is currupt? I had no problem getting portage, the tar ball, but it never appears to be accessible in chroot. You mean chroot = vabuild/usr/portage by default right? At any rate, I guess you are not maintaining things at the repo eh?
[gentoo-user] ImageMagick
Hi all, I used to use ImageMagick to quickly resize images and convert from one format to another (jpg to png, for example). ImageMagick is installed on my system (installed as requirement of something else), but I'm darned if I can find an executable to run the program. There used to be one in /usr/bin on my old system. Does anyone have any experience with this? Regards, Colleen -- Registered Linux User #411143 with the Linux Counter, http://counter.li.org
[gentoo-user] USB Drive Mount
I have two 500GB USB drives that my Gentoo system here will not read. Both these drives are fat formatted. The tail of DMESG, the entries actually go on for a long long time, has the following report for either of those two drives, [ 6027.085508] ehci_hcd :01:0a.2: detected XactErr len 0/8 retry 29 [ 6027.085636] ehci_hcd :01:0a.2: detected XactErr len 0/8 retry 30 [ 6027.085760] ehci_hcd :01:0a.2: detected XactErr len 0/8 retry 31 [ 6027.085885] ehci_hcd :01:0a.2: devpath 3 ep0in 3strikes [ 6027.136031] ehci_hcd :01:0a.2: GetStatus port:3 status 001002 0 ACK POWER sig=se0 CSC [ 6027.136052] hub 1-0:1.0: unable to enumerate USB device on port 3 [ 6027.136062] hub 1-0:1.0: state 7 ports 5 chg evt 0008 Both these fat formatted drives are easily read on several other systems running Windows or MAC OS X. The Gentoo system will read small usb memory sticks up to 16 GB fat formatted. The Gentoo system will also read a 750 GB NTFS drive without problems. Is anyone able to point me in the direction to figure out why the fat usb drives will not be read by the Gentoo system? Thanks Sean
Re: [gentoo-user] emerge -j, make -j and make -l
On Sun, Nov 27, 2011 at 12:56 PM, Pandu Poluan pa...@poluan.info wrote: On Nov 27, 2011 5:12 PM, Michael Mol mike...@gmail.com wrote: [snip] Here's my experience: I always experience emerge failures on my Gentoo VMs if I use MAKEOPTS=-j3. Not all packages, but many. Including, IIRC, glibc and gcc. In my barebones 177-package state, I didn't get any build failures from parallel building, either via emerge -j or make -j. I did get one failure when I went to install X that worked fine on the second attempt. Parallel operations are finicky things; if you don't define the relationships correctly, you can have things work fine most of the time, and then a race condition between one make recipe and another (or perhaps between one ebuild and another; a revdep-rebuild afterward might not be a bad CYA) causes one thing to fail, just this one time. My day job is C++ on Windows[1], and we do a *lot* with multithreaded code. Race conditions are a PITA; you might not be able to reproduce a race-induced failure on any of the workstations or test systems you have, but then have it crop up consistently on a customer's system. The same principles can and will apply with things like parallel make and parallel emerge. I've even seen it happen in VS2005 and VS2008 parallel builds. This happens even if I make sure that there's just one emerge job being done. And this happens even if I allocate more vCPUs than -j, on VMware and XenServer alike. FWIW, I've been running with MAKEOPTS=-j10 on my Phenom 9650 for over a year. It's very rare that something breaks due to the parallel build. I think it's happened perhaps three times, and each time was resolvable with a retry. YMMV, of course; race conditions are finicky. I don't know where the 'blame' lies, but I've found myself standardizing on MAKEOPTS=-j3, and PORTAGE_DEFAULT_OPTS=--jobs --load-average=1.6*num_of_vCPU (Yes, no explicit number of jobs. The newer portages are smart enough to keep starting new jobs until the load number is reached) Sweet; I didn't know about Portage's --load-average; I'll definitely switch to that instead of -j. Load-driven make plus load-driven portage should work beautifully on my system. I'll steal your 1.6 factor, and give: MAKEOPTS=-j 2*N -l 1.6*N) PORTAGE_DEFAULT_OPTS=--jobs --load-average1.6*N a try. How does that interact with distcc, by the way? I've got two of these octo-core Xeon boxes, and I've still got my Phenom 9650--distcc on my home network should become very, very nice. And this box is consuming 255W at the wall with monitor off, 326W with monitor on. That's not bad. Though perhaps I should move to an apartment where heat isn't free... [1] Well, for most of this year, my task list has been more PHP-oriented, but I'm still on tap for our C++ work. -- :wq
Re: [gentoo-user] ImageMagick
On Sun, Nov 27, 2011 at 4:08 PM, Colleen Beamer colleen.bea...@gmail.com wrote: Hi all, I used to use ImageMagick to quickly resize images and convert from one format to another (jpg to png, for example). ImageMagick is installed on my system (installed as requirement of something else), but I'm darned if I can find an executable to run the program. There used to be one in /usr/bin on my old system. Does anyone have any experience with this? equery f imagemagick|grep bin ? -- :wq
Re: [gentoo-user] ImageMagick
Hi Colleen, Am Sonntag, 27. November 2011, 16:08:41 schrieb Colleen Beamer: Hi all, I used to use ImageMagick to quickly resize images and convert from one format to another (jpg to png, for example). ImageMagick is installed on my system (installed as requirement of something else), but I'm darned if I can find an executable to run the program. There used to be one in /usr/bin on my old system. Does anyone have any experience with this? yes :) It's /usr/bin/convert Regards, Colleen Best, Michael
[gentoo-user] Apache Php cgi and user_dirs
Hello, Today Im form morning trying to get working apache 2.2.21-r1 and php 5.3.8 with userdirs mod. The problem is that apache is capable of opening ~/public_html but when it gets to open folder with index.php it fails with this error: (in browser) The requested URL /php5cgi/php/~uname/path/to/index.php was not found on this server. (in syslog) [date] [error] [client ::1] File does not exist: /var/www/localhost/htdocs/php5cgi php uses: apache2 berkdb bzip2 cli crypt ctype curl curlwrappers exif fileinfo filter flatfile ftp gd gdbm hash iconv ipv6 json ldap mhash mysql mysqli nls phar posix readline session simplexml spell ssl sysvipc tidy tokenizer truetype unicode xml zlib apache uses: apache2_modules_actions apache2_modules_alias apache2_modules_auth_basic apache2_modules_authn_alias apache2_modules_authn_anon apache2_modules_authn_dbm apache2_modules_authn_default apache2_modules_authn_file apache2_modules_authz_dbm apache2_modules_authz_default apache2_modules_authz_groupfile apache2_modules_authz_host apache2_modules_authz_owner apache2_modules_authz_user apache2_modules_autoindex apache2_modules_cache apache2_modules_dav apache2_modules_dav_fs apache2_modules_dav_lock apache2_modules_deflate apache2_modules_dir apache2_modules_disk_cache apache2_modules_env apache2_modules_expires apache2_modules_ext_filter apache2_modules_file_cache apache2_modules_filter apache2_modules_headers apache2_modules_include apache2_modules_info apache2_modules_log_config apache2_modules_logio apache2_modules_mem_cache apache2_modules_mime apache2_modules_mime_magic apache2_modules_negotiation apache2_modules_rewrite apache2_modules_setenvif apache2_modules_speling apache2_modules_status apache2_modules_unique_id apache2_modules_userdir apache2_modules_usertrack apache2_modules_vhost_alias ldap ssl I'm absolutly desprate of this I do not understand why its looking for php files under /php5cgi/php/ whe I dont even have cgi enabled in both php and apache Any suggestions would be appreciated S
Re: [gentoo-user] emerge -j, make -j and make -l
On Sun, Nov 27, 2011 at 3:16 PM, Michael Mol mike...@gmail.com wrote: I'll steal your 1.6 factor, and give: MAKEOPTS=-j 2*N -l 1.6*N) PORTAGE_DEFAULT_OPTS=--jobs --load-average1.6*N a try. Ah. Which file does PORTAGE_DEFAULT_OPTS go in? It doesn't appear to have an impact in /etc/make.conf -- :wq
Re: [gentoo-user] emerge -j, make -j and make -l
Michael Mol writes: On Sun, Nov 27, 2011 at 3:16 PM, Michael Mol mike...@gmail.com wrote: I'll steal your 1.6 factor, and give: MAKEOPTS=-j 2*N -l 1.6*N) PORTAGE_DEFAULT_OPTS=--jobs --load-average1.6*N a try. Ah. Which file does PORTAGE_DEFAULT_OPTS go in? It doesn't appear to have an impact in /etc/make.conf It's EMERGE_DEFAULT_OPTS in make.conf. See man make.conf. Wonko
Re: [gentoo-user] USB Drive Mount
On Sun, 27 Nov 2011 15:08:10 -0500 sean tech.j...@myfairpoint.net wrote: I have two 500GB USB drives that my Gentoo system here will not read. Both these drives are fat formatted. The tail of DMESG, the entries actually go on for a long long time, has the following report for either of those two drives, [ 6027.085508] ehci_hcd :01:0a.2: detected XactErr len 0/8 retry 29 [ 6027.085636] ehci_hcd :01:0a.2: detected XactErr len 0/8 retry 30 [ 6027.085760] ehci_hcd :01:0a.2: detected XactErr len 0/8 retry 31 [ 6027.085885] ehci_hcd :01:0a.2: devpath 3 ep0in 3strikes [ 6027.136031] ehci_hcd :01:0a.2: GetStatus port:3 status 001002 0 ACK POWER sig=se0 CSC [ 6027.136052] hub 1-0:1.0: unable to enumerate USB device on port 3 [ 6027.136062] hub 1-0:1.0: state 7 ports 5 chg evt 0008 Both these fat formatted drives are easily read on several other systems running Windows or MAC OS X. The Gentoo system will read small usb memory sticks up to 16 GB fat formatted. The Gentoo system will also read a 750 GB NTFS drive without problems. Is anyone able to point me in the direction to figure out why the fat usb drives will not be read by the Gentoo system? This post http://permalink.gmane.org/gmane.linux.usb.general/48758 implies possible hardware errors (you seem to have protocol errors on the USB bus). Before proceeding further, I'd try a few more tests to narrow down the circumstances that produce the errors. What results do you get if you plug the drives into different USB controllers/ports on the gentoo system? Can you test if they work with a different kernel version (higher and lower than the current one in use)? What kind of drives are these? Are you plugging USB3 drives into USB2 ports for example? If you are really lucky you might have free space on a drive you can run mkfs.vfat on and see if that works. The results of these simple tests stand a good chance of pointing us in the right direction for the next step. -- Alan McKinnnon alan.mckin...@gmail.com
Re: [gentoo-user] emerge -j, make -j and make -l
On Sun, 27 Nov 2011 15:16:33 -0500 Michael Mol mike...@gmail.com wrote: [snip] My day job is C++ on Windows[1], [1] Well, for most of this year, my task list has been more PHP-oriented, but I'm still on tap for our C++ work. You have my deepest, deepest, sympathies. Gotta pay the rent something though, hey? [I have a similar thing going myself with SLES] -- Alan McKinnnon alan.mckin...@gmail.com
Re: [gentoo-user] USB Drive Mount
On Sun, Nov 27, 2011 at 12:52 PM, Alan McKinnon alan.mckin...@gmail.com wrote: On Sun, 27 Nov 2011 15:08:10 -0500 sean tech.j...@myfairpoint.net wrote: I have two 500GB USB drives that my Gentoo system here will not read. Both these drives are fat formatted. The tail of DMESG, the entries actually go on for a long long time, has the following report for either of those two drives, [ 6027.085508] ehci_hcd :01:0a.2: detected XactErr len 0/8 retry 29 [ 6027.085636] ehci_hcd :01:0a.2: detected XactErr len 0/8 retry 30 [ 6027.085760] ehci_hcd :01:0a.2: detected XactErr len 0/8 retry 31 [ 6027.085885] ehci_hcd :01:0a.2: devpath 3 ep0in 3strikes [ 6027.136031] ehci_hcd :01:0a.2: GetStatus port:3 status 001002 0 ACK POWER sig=se0 CSC [ 6027.136052] hub 1-0:1.0: unable to enumerate USB device on port 3 [ 6027.136062] hub 1-0:1.0: state 7 ports 5 chg evt 0008 Both these fat formatted drives are easily read on several other systems running Windows or MAC OS X. The Gentoo system will read small usb memory sticks up to 16 GB fat formatted. The Gentoo system will also read a 750 GB NTFS drive without problems. Is anyone able to point me in the direction to figure out why the fat usb drives will not be read by the Gentoo system? This post http://permalink.gmane.org/gmane.linux.usb.general/48758 implies possible hardware errors (you seem to have protocol errors on the USB bus). Before proceeding further, I'd try a few more tests to narrow down the circumstances that produce the errors. What results do you get if you plug the drives into different USB controllers/ports on the gentoo system? Can you test if they work with a different kernel version (higher and lower than the current one in use)? What kind of drives are these? Are you plugging USB3 drives into USB2 ports for example? If you are really lucky you might have free space on a drive you can run mkfs.vfat on and see if that works. The results of these simple tests stand a good chance of pointing us in the right direction for the next step. -- Alan McKinnnon alan.mckin...@gmail.com I have something like 10 USB drives here at home. 9 of those drives works perfectly in 5 machines in the house. 1 drive works when attached to 4 of the machines but produces a similar error when attached to my most expensive i7-980x machine. I've never determined what causes it and have sort of decided it's just some weird incompatibility... - Mark
Re: [gentoo-user] ImageMagick
On 11/27/11 15:18, Michael Schreckenbauer wrote: Hi Colleen, Am Sonntag, 27. November 2011, 16:08:41 schrieb Colleen Beamer: Hi all, I used to use ImageMagick to quickly resize images and convert from one format to another (jpg to png, for example). ImageMagick is installed on my system (installed as requirement of something else), but I'm darned if I can find an executable to run the program. There used to be one in /usr/bin on my old system. Does anyone have any experience with this? yes :) It's /usr/bin/convert This isn't quite what I wanted - you have to add options to the command. I was hoping to get the graphical interface that I had before. Please don't tell me they took a great little program and screwed it up! :-) Colleen -- Registered Linux User #411143 with the Linux Counter, http://counter.li.org
Re: [gentoo-user] wicd and net-tools
On Sun, Nov 27 2011, Dan Johansson wrote: On Sunday 27 November 2011 02.02:54 Paul Hartman wrote: On Fri, Nov 25, 2011 at 4:58 PM, Allan Gottlieb gottl...@nyu.edu wrote: In the last day or two wicd broke badly due to a net-tools upgrade. The recommended workarounds are to specify USE=old-output for net-tools or to downgrade net-tools one version (I am ~amd64). Neither of these have helped me. Wicd cannot start either the wired or wireless interface. I have no solution, but just a me too that wicd-based networking stopped working entirely after I emerged some updates a couple days ago. My short-term solution was just stop wicd and use the old-style net init script instead since I haven't had time to research any this weekend yet. I had the same issue after upgrading net-tools, wicd stoped working. While googling for a solution I found a workaround: Use the ioctl backend instead of the external backend. For me this workaround works. Thanks for the comments. I did the changes suggested in the bug report (downgrade net-tools or specify USE=old-output). This changed the behavior, but it was far from perfect. The next morning, however, after no hardware/software changes but after our thanksgiving guests (plus their laptops, phones, and ipads) left, wicd is working pretty well on both affected machines. I was nowhere near the 50 dhcp connection limit, but perhaps the extra radio transmissions were hurting. Anyway now one machine has the downgraded net-tools, the other USE=old-output and both seem to work. This was definitely not fun. Now for a really scary thought. I just let portage put gnome 3 on my extra laptop. That machine has a fresh fairly minimalistic desktop/gnome install. Light testing shows gnome-3 works as advertised. Do I dare put it on my real laptop? I am tempted to wait until intersession so as not to hinder preparing for my lectures; but I worry about letting a system go 1 month without updates. allan
Re: [gentoo-user] ImageMagick
Am Sonntag, 27. November 2011, 17:04:24 schrieb Colleen Beamer: On 11/27/11 15:18, Michael Schreckenbauer wrote: Hi Colleen, Am Sonntag, 27. November 2011, 16:08:41 schrieb Colleen Beamer: Hi all, I used to use ImageMagick to quickly resize images and convert from one format to another (jpg to png, for example). ImageMagick is installed on my system (installed as requirement of something else), but I'm darned if I can find an executable to run the program. There used to be one in /usr/bin on my old system. Does anyone have any experience with this? yes :) It's /usr/bin/convert This isn't quite what I wanted - you have to add options to the command. I was hoping to get the graphical interface that I had before. Please don't tell me they took a great little program and screwed it up! :-) ImageMagick has no gui-frontend and it never had. It's a library for image manipulation and a collection of CLI-programs for the same task. I have no idea what you used before, but it wasn't part of ImageMagick. Colleen Best, Michael
Re: [gentoo-user] ImageMagick
On Sun, Nov 27, 2011 at 5:04 PM, Colleen Beamer colleen.bea...@gmail.com wrote: On 11/27/11 15:18, Michael Schreckenbauer wrote: Hi Colleen, Am Sonntag, 27. November 2011, 16:08:41 schrieb Colleen Beamer: Does anyone have any experience with this? yes :) It's /usr/bin/convert This isn't quite what I wanted - you have to add options to the command. I was hoping to get the graphical interface that I had before. Please don't tell me they took a great little program and screwed it up! :-) A GUI interface specifically for imagemagick is news to me; imagemagick has always been a cli program. I don't see any reference to a GUI among its USE flags, either. Perhaps you were using some other program which acted as a front-end? Have you done a --depclean which may have removed that? Incidentally, if you want to retain a package, you really should select it for your @world set; otherwise, a depclean could pull it out from under you. -- :wq
Re: [gentoo-user] ImageMagick
Am Sonntag, 27. November 2011, 17:04:24 schrieb Colleen Beamer: On 11/27/11 15:18, Michael Schreckenbauer wrote: Hi Colleen, Am Sonntag, 27. November 2011, 16:08:41 schrieb Colleen Beamer: Hi all, I used to use ImageMagick to quickly resize images and convert from one format to another (jpg to png, for example). ImageMagick is installed on my system (installed as requirement of something else), but I'm darned if I can find an executable to run the program. There used to be one in /usr/bin on my old system. Does anyone have any experience with this? yes :) It's /usr/bin/convert This isn't quite what I wanted - you have to add options to the command. I was hoping to get the graphical interface that I had before. Please don't tell me they took a great little program and screwed it up! :-) is /usr/bin/display the program you were looking for? It supports a subset of ImageMagick's functionality. Colleen Best, Michael
Re: [gentoo-user] emerge -j, make -j and make -l
On Sat, Nov 26, 2011 at 7:22 AM, Michael Mol mike...@gmail.com wrote:
I just wanted to share an experience I had today with optimizing parallel
builds after discovering -l for Make...
I've got a little more tweaking I still want to do, but this is pretty
awesome...
http://funnybutnot.wordpress.com/2011/11/26/optimizing-parallel-builds/
ZZ
Good post Michael. Thanks.
I want to verify that in make.conf this is indeed MAKEOPTS we are
talking about and not EMERGE_DEFAULT_OPTS.
Currently for my i7-980x (6 physical cores + hyper threading = 12
logical cores) I have:
MAKEOPTS=-j3
EMERGE_DEFAULT_OPTS=--with-bdeps y
PORTAGE_IONICE_COMMAND=ionice -c 3 -p \${PID}
I generally keep -j small day-to-day to allow emerge to work more or
less the background while I'm using the machine for other things. If I
was going to do an emerge -e @world then in the past I'd push it up
for 13. (N+1)
I've not used the -l option but it sounds interesting. If I understand
the then you're suggesting in /etc/make.conf
MAKEOPTS=-j13 -l7
or something in that range for a full blown emerge -e @world?
- Mark
[gentoo-user] Disappearing useflag hell
Somewhere deep in the bowels of portage my 'introspection' useflag is vanishing -- but on just one of my three machines. I set the introspection useflag on all three machines (two ~amd64 and one ~x86) but when I run emerge --info, only two of the machines show the introspection useflag in the output. Why? All three machines share the same /usr/portage by NFS, so they all see the same use.mask and use.force files, etc. I'm running the default linux desktop gnome profile on all three. I tried deleting my /etc/portage/* on the problem machine, which made no difference. I even tried using an empty make.conf and adding the single line USE=introspection, but that made no difference either. When I flip other useflags in make.conf the changes show up in the output of emerge --info, but not when I flip 'introspection'. Two days wasted and I'm out of ideas. Anyone understand the details of emerge --info or what I can do to diagnose this problem?
[gentoo-user] Re: Can one get me that link?
On 11/27/2011 07:49 AM, LinuxIsOne wrote: On Sun, Nov 27, 2011 at 10:16 AM, Vishnupradeep intermedia.vis...@gmail.com mailto:intermedia.vis...@gmail.com wrote: http://torrents.gentoo.org/ From this link, which one I should use to download for 64 bit processor for my PC? Both will run 64-bit software, but only the 'multilib' will also run 32-bit software. You may not care about running older 32-bit software on your 64-bit machine.
Re: [gentoo-user] emerge -j, make -j and make -l
Mark Knecht wrote:
On Sat, Nov 26, 2011 at 7:22 AM, Michael Molmike...@gmail.com wrote:
I just wanted to share an experience I had today with optimizing parallel
builds after discovering -l for Make...
I've got a little more tweaking I still want to do, but this is pretty
awesome...
http://funnybutnot.wordpress.com/2011/11/26/optimizing-parallel-builds/
ZZ
Good post Michael. Thanks.
I want to verify that in make.conf this is indeed MAKEOPTS we are
talking about and not EMERGE_DEFAULT_OPTS.
Currently for my i7-980x (6 physical cores + hyper threading = 12
logical cores) I have:
MAKEOPTS=-j3
EMERGE_DEFAULT_OPTS=--with-bdeps y
PORTAGE_IONICE_COMMAND=ionice -c 3 -p \${PID}
I generally keep -j small day-to-day to allow emerge to work more or
less the background while I'm using the machine for other things. If I
was going to do an emerge -e @world then in the past I'd push it up
for 13. (N+1)
I've not used the -l option but it sounds interesting. If I understand
the then you're suggesting in /etc/make.conf
MAKEOPTS=-j13 -l7
or something in that range for a full blown emerge -e @world?
- Mark
You should also look into this setting if you want to let portage run in
the background:
PORTAGE_NICENESS=5
I have a 4 core system and run this:
MAKEOPTS=-j16 -l10
EMERGE_DEFAULT_OPTS=-j8
I can't even tell portage is running. Heck, I even watch videos and
such. No problems with slowdown at all.
Oh, the -l10 is sort of new. The -j16 is changing a bit over time.
Trying to test speed to see what is fastest. So far, no compile race
problems either.
Dale
:-) :-)
--
I am only responsible for what I said ... Not for what you understood or how
you interpreted my words!
Re: [gentoo-user] wicd and net-tools
On Sun, 27 Nov 2011 13:27:59 +0100, Dan Johansson wrote: I had the same issue after upgrading net-tools, wicd stoped working. While googling for a solution I found a workaround: Use the ioctl backend instead of the external backend. For me this workaround works. That explains why I was unaffected by this, I already used the ioctl, since it claims to be faster and we Gentoo users are all ricers... aren't we? ;-) -- Neil Bothwick Hard work has a future payoff. Laziness pays off NOW! signature.asc Description: PGP signature
Re: [gentoo-user] emerge -j, make -j and make -l
On Mon, 28 Nov 2011 00:56:17 +0700, Pandu Poluan wrote: I don't know where the 'blame' lies, but I've found myself standardizing on MAKEOPTS=-j3, and PORTAGE_DEFAULT_OPTS=--jobs --load-average=1.6*num_of_vCPU (Yes, no explicit number of jobs. The newer portages are smart enough to keep starting new jobs until the load number is reached) The problem I found with that is the ebuilds load the system lightly to start with, before they enter the compile phase, to portage starts dozens of parallel ebuilds, then the system gets completely bogged down when they start compiling. -- Neil Bothwick If Microsoft made cars: The airbag system would ask are you sure? before deploying. signature.asc Description: PGP signature
Re: [gentoo-user] ImageMagick
On 11/27/11 16:18, Michael Schreckenbauer wrote: Am Sonntag, 27. November 2011, 17:04:24 schrieb Colleen Beamer: On 11/27/11 15:18, Michael Schreckenbauer wrote: Hi Colleen, Am Sonntag, 27. November 2011, 16:08:41 schrieb Colleen Beamer: Hi all, I used to use ImageMagick to quickly resize images and convert from one format to another (jpg to png, for example). ImageMagick is installed on my system (installed as requirement of something else), but I'm darned if I can find an executable to run the program. There used to be one in /usr/bin on my old system. Does anyone have any experience with this? yes :) It's /usr/bin/convert This isn't quite what I wanted - you have to add options to the command. I was hoping to get the graphical interface that I had before. Please don't tell me they took a great little program and screwed it up! :-) ImageMagick has no gui-frontend and it never had. It's a library for image manipulation and a collection of CLI-programs for the same task. I have no idea what you used before, but it wasn't part of ImageMagick. Oh, yes, it was! :-) There used to be a command in /usr/bin named imagemagick and if you launched it, it brought up an interface with menus/buttons that you could click on. Granted, I haven't used it in quite a while. However, I used to use it all the time to scale graphics when I was writing the handbook for krecipes and convert images from jpeg to png. Regards, Colleen -- Registered Linux User #411143 with the Linux Counter, http://counter.li.org
Re: [gentoo-user] Disappearing useflag hell
walt wrote: Somewhere deep in the bowels of portage my 'introspection' useflag is vanishing -- but on just one of my three machines. I set the introspection useflag on all three machines (two ~amd64 and one ~x86) but when I run emerge --info, only two of the machines show the introspection useflag in the output. Why? All three machines share the same /usr/portage by NFS, so they all see the same use.mask and use.force files, etc. I'm running the default linux desktop gnome profile on all three. I tried deleting my /etc/portage/* on the problem machine, which made no difference. I even tried using an empty make.conf and adding the single line USE=introspection, but that made no difference either. When I flip other useflags in make.conf the changes show up in the output of emerge --info, but not when I flip 'introspection'. Two days wasted and I'm out of ideas. Anyone understand the details of emerge --info or what I can do to diagnose this problem? I searched the -dev mailing list and only found references to the flag being enabled on a lot of packages. It appears to be a Gnome thing but don't quote me on it. Is it possible that it is enable by default whether it is set or not? There was talk of making it on in the profile instead of make.conf. I would do a emerge -pv package that uses the flag and see if it shows up there. If it is a small package, compile it then see if it is built in or not. If it is, then they have it turned on somewhere. This is a bug report that you can read on too. https://bugs.gentoo.org/show_bug.cgi?id=324989 That help any? Dale :-) :-) -- I am only responsible for what I said ... Not for what you understood or how you interpreted my words!
Re: [gentoo-user] ImageMagick
On 11/27/11 16:22, Michael Mol wrote: On Sun, Nov 27, 2011 at 5:04 PM, Colleen Beamer colleen.bea...@gmail.com wrote: On 11/27/11 15:18, Michael Schreckenbauer wrote: Hi Colleen, Am Sonntag, 27. November 2011, 16:08:41 schrieb Colleen Beamer: Does anyone have any experience with this? yes :) It's /usr/bin/convert This isn't quite what I wanted - you have to add options to the command. I was hoping to get the graphical interface that I had before. Please don't tell me they took a great little program and screwed it up! :-) A GUI interface specifically for imagemagick is news to me; imagemagick has always been a cli program. I don't see any reference to a GUI among its USE flags, either. Perhaps you were using some other program which acted as a front-end? Have you done a --depclean which may have removed that? Incidentally, if you want to retain a package, you really should select it for your @world set; otherwise, a depclean could pull it out from under you. Haven't done a depclean. This is a reasonable new computer. Haven't used ImageMagick in quite a while (way before I got this new computer) and granted, it wasn't a gui that automatically got added to your kmenu, but I created an icon for and for the command, I used /usr/bin/imagemagick. I recall at one point that if I used the command imagemagick, it would launch some other interface (can't remember which one) and I had to create a symlink named magick which linked to /usr/bin/imagemagick. I have tons of graphics that I resized and converted to png from jpegs, but unfortunately, the don't say that I used imagemagick to alter them. -- Registered Linux User #411143 with the Linux Counter, http://counter.li.org
Re: [gentoo-user] ImageMagick
On 11/27/11 16:28, Michael Schreckenbauer wrote: Am Sonntag, 27. November 2011, 17:04:24 schrieb Colleen Beamer: On 11/27/11 15:18, Michael Schreckenbauer wrote: Hi Colleen, Am Sonntag, 27. November 2011, 16:08:41 schrieb Colleen Beamer: Hi all, I used to use ImageMagick to quickly resize images and convert from one format to another (jpg to png, for example). ImageMagick is installed on my system (installed as requirement of something else), but I'm darned if I can find an executable to run the program. There used to be one in /usr/bin on my old system. Does anyone have any experience with this? yes :) It's /usr/bin/convert This isn't quite what I wanted - you have to add options to the command. I was hoping to get the graphical interface that I had before. Please don't tell me they took a great little program and screwed it up! :-) is /usr/bin/display the program you were looking for? It supports a subset of ImageMagick's functionality. Thank you!!! This is EXACTLY it. :-) Like I said, haven't used this in a while and had forgotten about this! Regards, Colleen -- Registered Linux User #411143 with the Linux Counter, http://counter.li.org
Re: [gentoo-user] ImageMagick
Colleen Beamer wrote: Oh, yes, it was! :-) There used to be a command in /usr/bin named imagemagick and if you launched it, it brought up an interface with menus/buttons that you could click on. Granted, I haven't used it in quite a while. However, I used to use it all the time to scale graphics when I was writing the handbook for krecipes and convert images from jpeg to png. Regards, Colleen I searched for that command, I can't find it or any reference to it having any GUI at all. According to the wiki: The software mainly consists of a number of command-line interface http://en.wikipedia.org/wiki/Command-line_interface utilities for manipulating images. ImageMagick does *not* have a GUI http://en.wikipedia.org/wiki/Graphical_user_interface-based interface to edit images, as do Adobe Photoshop http://en.wikipedia.org/wiki/Adobe_Photoshop and GIMP http://en.wikipedia.org/wiki/GIMP, but instead modifies existing images as directed by various command-line parameters. http://en.wikipedia.org/wiki/ImageMagick I also can't find anything on their website about a GUI either. There are front ends to it tho. This from the imagemagick website: The functionality of ImageMagick is typically utilized from the command line or you can use the features from programs written in your favorite language. Choose from these interfaces: G2F http://www.imagemagick.org/script/api.php#ada (Ada), MagickCore http://www.imagemagick.org/script/api.php#c (C), MagickWand http://www.imagemagick.org/script/api.php#c (C), ChMagick http://www.imagemagick.org/script/api.php#ch (Ch), ImageMagickObject http://www.imagemagick.org/script/api.php#com_ (COM+), Magick++ http://www.imagemagick.org/script/api.php#c__ (C++), JMagick http://www.imagemagick.org/script/api.php#java (Java), L-Magick http://www.imagemagick.org/script/api.php#lisp (Lisp), NMagick http://www.imagemagick.org/script/api.php#neko (Neko/haXe), MagickNet http://www.imagemagick.org/script/api.php#dot-net (.NET), PascalMagick http://www.imagemagick.org/script/api.php#pascal (Pascal), PerlMagick http://www.imagemagick.org/script/api.php#perl (Perl), MagickWand for PHP http://www.imagemagick.org/script/api.php#php (PHP), IMagick http://www.imagemagick.org/script/api.php#php (PHP), PythonMagick http://www.imagemagick.org/script/api.php#python (Python), RMagick http://www.imagemagick.org/script/api.php#ruby (Ruby), or TclMagick http://www.imagemagick.org/script/api.php#tcl (Tcl/TK). With a language interface, use ImageMagick to modify or create images dynamically and /automagically/. I'm not sure if any of those are GUI tho. Maybe whatever distro you were using sort of played a name game with the command? The command was named imagemagick but was actually pointing to something else that had a GUI and was a front end for it. Krecipe huh? Installing it now. I like to cook and eat. lol Dale :-) :-) -- I am only responsible for what I said ... Not for what you understood or how you interpreted my words!
Re: [gentoo-user] Disappearing useflag hell
On Nov 27, 2011 3:44 PM, Dale rdalek1...@gmail.com wrote: walt wrote: Somewhere deep in the bowels of portage my 'introspection' useflag is vanishing -- but on just one of my three machines. I set the introspection useflag on all three machines (two ~amd64 and one ~x86) but when I run emerge --info, only two of the machines show the introspection useflag in the output. Why? All three machines share the same /usr/portage by NFS, so they all see the same use.mask and use.force files, etc. I'm running the default linux desktop gnome profile on all three. I tried deleting my /etc/portage/* on the problem machine, which made no difference. I even tried using an empty make.conf and adding the single line USE=introspection, but that made no difference either. When I flip other useflags in make.conf the changes show up in the output of emerge --info, but not when I flip 'introspection'. Two days wasted and I'm out of ideas. Anyone understand the details of emerge --info or what I can do to diagnose this problem? I searched the -dev mailing list and only found references to the flag being enabled on a lot of packages. It appears to be a Gnome thing but don't quote me on it. Is it possible that it is enable by default whether it is set or not? There was talk of making it on in the profile instead of make.conf. Yeah, could it be part of your profile? That's up in /etc so it could be different among hosts. I would do a emerge -pv package that uses the flag and see if it shows up there. If it is a small package, compile it then see if it is built in or not. If it is, then they have it turned on somewhere. This is a bug report that you can read on too. https://bugs.gentoo.org/show_bug.cgi?id=324989 That help any? Dale :-) :-) -- I am only responsible for what I said ... Not for what you understood or how you interpreted my words!
Re: [gentoo-user] emerge -j, make -j and make -l
On Nov 28, 2011 3:55 AM, Alex Schuster wo...@wonkology.org wrote: Michael Mol writes: On Sun, Nov 27, 2011 at 3:16 PM, Michael Mol mike...@gmail.com wrote: I'll steal your 1.6 factor, and give: MAKEOPTS=-j 2*N -l 1.6*N) PORTAGE_DEFAULT_OPTS=--jobs --load-average1.6*N a try. Ah. Which file does PORTAGE_DEFAULT_OPTS go in? It doesn't appear to have an impact in /etc/make.conf It's EMERGE_DEFAULT_OPTS in make.conf. See man make.conf. Yes, it's EMERGE_DEFAULT_OPTS . I really should stop sending an email when it's 00:44 in the morning... Rgds,
Re: [gentoo-user] emerge -j, make -j and make -l
On Nov 28, 2011 6:24 AM, Neil Bothwick n...@digimed.co.uk wrote: On Mon, 28 Nov 2011 00:56:17 +0700, Pandu Poluan wrote: I don't know where the 'blame' lies, but I've found myself standardizing on MAKEOPTS=-j3, and PORTAGE_DEFAULT_OPTS=--jobs --load-average=1.6*num_of_vCPU (Yes, no explicit number of jobs. The newer portages are smart enough to keep starting new jobs until the load number is reached) The problem I found with that is the ebuilds load the system lightly to start with, before they enter the compile phase, to portage starts dozens of parallel ebuilds, then the system gets completely bogged down when they start compiling. Yes, sometimes that would happen if at the beginning there are network-bound ebuilds all downloading their respective distfiles. The load stays low until they all start ./configure-ing roughly at the same time. Then all hell breaks loose. I successfully mitigate such load-explosion by doing a --fetchonly step first, and keeping MAKEOPTS at low -j (which, in my case, is actually required). Just to add more info: I use USE=graphite (with some CFLAGS, uh, 'enhancements') with gcc-4.5.3. IIRC, I could push MAKEOPTS up to -j5 (and even more, but I ran out of cores) when I was still using gcc-4.4.x and no USE=graphite. Won't file a bug report, though. I have a feeling that my bug report re: emerge failure will be marked WONTFIX thanks to the 'ricer special' CFLAGS :-P Rgds,
Re: [gentoo-user] emerge -j, make -j and make -l
On Nov 28, 2011 3:21 AM, Michael Mol mike...@gmail.com wrote: On Sun, Nov 27, 2011 at 12:56 PM, Pandu Poluan pa...@poluan.info wrote: On Nov 27, 2011 5:12 PM, Michael Mol mike...@gmail.com wrote: [snip] Here's my experience: I always experience emerge failures on my Gentoo VMs if I use MAKEOPTS=-j3. Not all packages, but many. Including, IIRC, glibc and gcc. In my barebones 177-package state, I didn't get any build failures from parallel building, either via emerge -j or make -j. I did get one failure when I went to install X that worked fine on the second attempt. And in my barebones system (172 packages), there are several packages that reliably fail, even when emerged on their own *sigh* This happens even if I make sure that there's just one emerge job being done. And this happens even if I allocate more vCPUs than -j, on VMware and XenServer alike. FWIW, I've been running with MAKEOPTS=-j10 on my Phenom 9650 for over a year. It's very rare that something breaks due to the parallel build. I think it's happened perhaps three times, and each time was resolvable with a retry. YMMV, of course; race conditions are finicky. I have a hunch that the hypervisor had some effects. Most likely, another VM in the same host has a high enough load that necessitates the Gentoo VM to be shifted to another (physical) core, and this messes up the timing. MAKEOPTS=-j3 always succeeds, though. So I'm disinclined to delve deeper into the issue. I don't know where the 'blame' lies, but I've found myself standardizing on MAKEOPTS=-j3, and PORTAGE_DEFAULT_OPTS=--jobs --load-average=1.6*num_of_vCPU (Yes, no explicit number of jobs. The newer portages are smart enough to keep starting new jobs until the load number is reached) Sweet; I didn't know about Portage's --load-average; I'll definitely switch to that instead of -j. Load-driven make plus load-driven portage should work beautifully on my system. I'll steal your 1.6 factor, and give: MAKEOPTS=-j 2*N -l 1.6*N) PORTAGE_DEFAULT_OPTS=--jobs --load-average1.6*N a try. Make sure that make supports non-integer values for -l, though. How does that interact with distcc, by the way? I've got two of these octo-core Xeon boxes, and I've still got my Phenom 9650--distcc on my home network should become very, very nice. And this box is consuming 255W at the wall with monitor off, 326W with monitor on. That's not bad. Though perhaps I should move to an apartment where heat isn't free... Well, I don't use distcc, so I can't speculate. But with plain single system compilation, my settings have been serving me real well :-) Rgds,
[gentoo-user] Re: emerge -j, make -j and make -l
Pandu Poluan wrote: On Nov 28, 2011 6:24 AM, Neil Bothwick n...@digimed.co.uk wrote: On Mon, 28 Nov 2011 00:56:17 +0700, Pandu Poluan wrote: I don't know where the 'blame' lies, but I've found myself standardizing on MAKEOPTS=-j3, and PORTAGE_DEFAULT_OPTS=--jobs --load-average=1.6*num_of_vCPU (Yes, no explicit number of jobs. The newer portages are smart enough to keep starting new jobs until the load number is reached) The problem I found with that is the ebuilds load the system lightly to start with, before they enter the compile phase, to portage starts dozens of parallel ebuilds, then the system gets completely bogged down when they start compiling. Yes, sometimes that would happen if at the beginning there are network-bound ebuilds all downloading their respective distfiles. The load stays low until they all start ./configure-ing roughly at the same time. Then all hell breaks loose. I successfully mitigate such load-explosion by doing a --fetchonly step first, and keeping MAKEOPTS at low -j (which, in my case, is actually required). Just to add more info: I use USE=graphite (with some CFLAGS, uh, 'enhancements') with gcc-4.5.3. IIRC, I could push MAKEOPTS up to -j5 (and even more, but I ran out of cores) when I was still using gcc-4.4.x and no USE=graphite. Won't file a bug report, though. I have a feeling that my bug report re: emerge failure will be marked WONTFIX thanks to the 'ricer special' CFLAGS :-P Rgds, It would be nice if there were some way to mark particular packages that should never be compiled in parallel (like the trick for using a using a separate, non-tmpfs build directory for large packages). The load-explosion you describe is bad enough with regular packages but when firefox, xulrunner, chromium and libreoffice all decide to start compiling at the same time it turns into a complete nightmare.
Re: [gentoo-user] Disappearing useflag hell
Dale wrote: I searched the -dev mailing list and only found references to the flag being enabled on a lot of packages. It appears to be a Gnome thing but don't quote me on it. Is it possible that it is enable by default whether it is set or not? There was talk of making it on in the profile instead of make.conf. I would do a emerge -pv package that uses the flag and see if it shows up there. If it is a small package, compile it then see if it is built in or not. If it is, then they have it turned on somewhere. This is a bug report that you can read on too. https://bugs.gentoo.org/show_bug.cgi?id=324989 That help any? Dale :-) :-) More looking here. This is what I found with euse -i on my amd64 system: [- ] introspection sys-fs/udev: Use dev-libs/gobject-introspection for introspection but this is what emerge shows: root@fireball / # emerge -pv udev These are the packages that would be merged, in order: Calculating dependencies... done! [ebuild R] sys-fs/udev-164-r2 USE=extras -build (-selinux) -test 0 kB Total: 1 package (1 reinstall), Size of downloads: 0 kB root@fireball / # So, I suspect it is enabled somewhere on a much lower level and not optional. Then I emerge udev and used the find tool. I found these little tidbits: ./configure --prefix=/usr --build=x86_64-pc-linux-gnu --host=x86_64-pc-linux-gnu --mandir=/usr/share/man --infodir=/usr/share/info --datadir=/usr/share --sysconfdir=/etc --localstatedir=/var/lib --prefix=/usr --sysconfdir=/etc --sbindir=/sbin --libdir=/usr/lib64 --with-rootlibdir=/lib64 --libexecdir=/lib64/udev --enable-logging --enable-static --without-selinux --enable-extras --disable-introspection gintrospection: no So, seeing that it is disabled, maybe it is disabled now on a lower level and is no longer a option? Notice the question mark. This makes me wonder. It still shows up with euse. It appears disabled but also doesn't show up as a USE flag option for us mere mortals. ;-) More looking. I find this: [- ] introspection media-libs/gstreamer: Use dev-libs/gobject-introspection for introspection Then emerge reports this: root@fireball / # emerge -pv gstreamer These are the packages that would be merged, in order: Calculating dependencies... done! [ebuild R] media-libs/gstreamer-0.10.35 USE=introspection nls -test 0 kB Total: 1 package (1 reinstall), Size of downloads: 0 kB root@fireball / # So, it is enabled on this one but not udev. The flag does exist and can be controlled, at least on some packages. My thoughts. Some packages it is disabled somewhere that overrides your settings. Might be because it breaks something. The packages where it is a option, then it sees your settings and applies them. I'm as confused as you are on emerge --info tho. If it helps any, I don't have the flag in my make.conf but it appears to be enabled for gstreamer but disabled for udev. I think the devs are picking and choosing which packages can have the flag user controlled and not break something. One last thing that I find interesting. This is weird. root@fireball / # USE=introspection emerge -Na world These are the packages that would be merged, in order: Calculating dependencies... done! Total: 0 packages, Size of downloads: 0 kB Nothing to merge; would you like to auto-clean packages? [Yes/No] n Quitting. root@fireball / # USE=-introspection emerge -Na world These are the packages that would be merged, in order: Calculating dependencies... done! Total: 0 packages, Size of downloads: 0 kB Nothing to merge; would you like to auto-clean packages? [Yes/No] n Quitting. root@fireball / # It appears that the packages on my system are all controlled by something over my settings. It does nothing when I enable or disable it. Yet it is turned on for one package above and turned off for the other. Scratch your head on that one for a while. Dale :-) :-) -- I am only responsible for what I said ... Not for what you understood or how you interpreted my words!
Re: [gentoo-user] Re: emerge -j, make -j and make -l
Jack Byer wrote: It would be nice if there were some way to mark particular packages that should never be compiled in parallel (like the trick for using a using a separate, non-tmpfs build directory for large packages). The load-explosion you describe is bad enough with regular packages but when firefox, xulrunner, chromium and libreoffice all decide to start compiling at the same time it turns into a complete nightmare. I think it has that already. I have noticed several times that mine will only be working on one package and have a lot of packages left to update. When that single package is done, it loads up several and does them at the same time. Something tells emerge not to run them at the same time and I assume it is in the ebuild somewhere. I have to have tmpfs in use when LOo comes up for a compile. I have more memory than I have space on /var. If I don't have portages work directory on tmpfs, the compile fills up /var and dies. Ironic that what works for one fails for another. Dale :-) :-) -- I am only responsible for what I said ... Not for what you understood or how you interpreted my words!
Re: [gentoo-user] 200MB waste from /usr/share/locale ?
On 11/27/2011 1:10 PM, Sebastian Pipping wrote: On 11/26/2011 07:32 AM, Mike Edenfield wrote: Can anyone explain what is going on ? Different packages include different levels of support for filtering their installed localization messages, typically one of install everything, install what's requested, or whats a locale? In case I find time to blog about this on Planet Gentoo: would you allow using the above text under some Creative Commons license, say CC-BY-SA/3.0? Since I didn't write it at work it's all yours. :) --Mike
Re: [gentoo-user] Re: emerge -j, make -j and make -l
On Nov 28, 2011 8:38 AM, Dale rdalek1...@gmail.com wrote: Jack Byer wrote: It would be nice if there were some way to mark particular packages that should never be compiled in parallel (like the trick for using a using a separate, non-tmpfs build directory for large packages). The load-explosion you describe is bad enough with regular packages but when firefox, xulrunner, chromium and libreoffice all decide to start compiling at the same time it turns into a complete nightmare. I think it has that already. I have noticed several times that mine will only be working on one package and have a lot of packages left to update. When that single package is done, it loads up several and does them at the same time. Something tells emerge not to run them at the same time and I assume it is in the ebuild somewhere. I have to have tmpfs in use when LOo comes up for a compile. I have more memory than I have space on /var. If I don't have portages work directory on tmpfs, the compile fills up /var and dies. Ironic that what works for one fails for another. portage.env? http://wiki.gentoo.org/wiki//etc/portage/env Rgds,
Re: [gentoo-user] wicd and net-tools
On Nov 28, 2011 6:18 AM, Neil Bothwick n...@digimed.co.uk wrote: On Sun, 27 Nov 2011 13:27:59 +0100, Dan Johansson wrote: I had the same issue after upgrading net-tools, wicd stoped working. While googling for a solution I found a workaround: Use the ioctl backend instead of the external backend. For me this workaround works. That explains why I was unaffected by this, I already used the ioctl, since it claims to be faster and we Gentoo users are all ricers... aren't we? ;-) gentoo inside joke Aha! Neil, now that you've gone out of the closet and admit you're a ricer, I'm going to mark all your bug reports as WONTFIX. . . . Naaah, just kidding. The devs/maintainers will do that for me :-P /gentoo inside joke Rgds,
Re: [gentoo-user] emerge -j, make -j and make -l
On Sun, Nov 27, 2011 at 5:07 PM, Mark Knecht markkne...@gmail.com wrote:
On Sat, Nov 26, 2011 at 7:22 AM, Michael Mol mike...@gmail.com wrote:
I just wanted to share an experience I had today with optimizing parallel
builds after discovering -l for Make...
I've got a little more tweaking I still want to do, but this is pretty
awesome...
http://funnybutnot.wordpress.com/2011/11/26/optimizing-parallel-builds/
ZZ
Good post Michael. Thanks.
I want to verify that in make.conf this is indeed MAKEOPTS we are
talking about and not EMERGE_DEFAULT_OPTS.
It'd be a combination of them.
EMERGE_DEFAULT_OPTS, for my 8-way system, would have been -j8 (I'll be
changing this to reflect portage's load-aware behavior).
MAKEOPTS would be -j16, -l10. (Which actually goes up to about 12 or
13 based on that N*1.6 behavior)
Currently for my i7-980x (6 physical cores + hyper threading = 12
logical cores) I have:
MAKEOPTS=-j3
EMERGE_DEFAULT_OPTS=--with-bdeps y
PORTAGE_IONICE_COMMAND=ionice -c 3 -p \${PID}
I generally keep -j small day-to-day to allow emerge to work more or
less the background while I'm using the machine for other things. If I
was going to do an emerge -e @world then in the past I'd push it up
for 13. (N+1)
I've not used the -l option but it sounds interesting. If I understand
the then you're suggesting in /etc/make.conf
MAKEOPTS=-j13 -l7
or something in that range for a full blown emerge -e @world?
Pretty much. Though I wouldn't do it just for @world. I'd leave it in
for all emerges.
--
:wq
Re: [gentoo-user] emerge -j, make -j and make -l
On Sun, Nov 27, 2011 at 6:21 PM, Neil Bothwick n...@digimed.co.uk wrote: On Mon, 28 Nov 2011 00:56:17 +0700, Pandu Poluan wrote: I don't know where the 'blame' lies, but I've found myself standardizing on MAKEOPTS=-j3, and PORTAGE_DEFAULT_OPTS=--jobs --load-average=1.6*num_of_vCPU (Yes, no explicit number of jobs. The newer portages are smart enough to keep starting new jobs until the load number is reached) The problem I found with that is the ebuilds load the system lightly to start with, before they enter the compile phase, to portage starts dozens of parallel ebuilds, then the system gets completely bogged down when they start compiling. I did notice that, but it settles back down *very* quickly with the -l parameter to make. -- :wq
Re: [gentoo-user] emerge -j, make -j and make -l
On Sun, Nov 27, 2011 at 7:54 PM, Pandu Poluan pa...@poluan.info wrote: On Nov 28, 2011 6:24 AM, Neil Bothwick n...@digimed.co.uk wrote: On Mon, 28 Nov 2011 00:56:17 +0700, Pandu Poluan wrote: I don't know where the 'blame' lies, but I've found myself standardizing on MAKEOPTS=-j3, and PORTAGE_DEFAULT_OPTS=--jobs --load-average=1.6*num_of_vCPU (Yes, no explicit number of jobs. The newer portages are smart enough to keep starting new jobs until the load number is reached) The problem I found with that is the ebuilds load the system lightly to start with, before they enter the compile phase, to portage starts dozens of parallel ebuilds, then the system gets completely bogged down when they start compiling. Yes, sometimes that would happen if at the beginning there are network-bound ebuilds all downloading their respective distfiles. The load stays low until they all start ./configure-ing roughly at the same time. Then all hell breaks loose. I successfully mitigate such load-explosion by doing a --fetchonly step first, and keeping MAKEOPTS at low -j (which, in my case, is actually required). Just to add more info: I use USE=graphite (with some CFLAGS, uh, 'enhancements') with gcc-4.5.3. IIRC, I could push MAKEOPTS up to -j5 (and even more, but I ran out of cores) when I was still using gcc-4.4.x and no USE=graphite. Won't file a bug report, though. I have a feeling that my bug report re: emerge failure will be marked WONTFIX thanks to the 'ricer special' CFLAGS As I noted, -l in MAKEOPTS takes care of the load explosion very nicely. -- :wq
Re: [gentoo-user] emerge -j, make -j and make -l
On Nov 28, 2011 11:38 AM, Michael Mol mike...@gmail.com wrote: On Sun, Nov 27, 2011 at 7:54 PM, Pandu Poluan pa...@poluan.info wrote: On Nov 28, 2011 6:24 AM, Neil Bothwick n...@digimed.co.uk wrote: On Mon, 28 Nov 2011 00:56:17 +0700, Pandu Poluan wrote: I don't know where the 'blame' lies, but I've found myself standardizing on MAKEOPTS=-j3, and PORTAGE_DEFAULT_OPTS=--jobs --load-average=1.6*num_of_vCPU (Yes, no explicit number of jobs. The newer portages are smart enough to keep starting new jobs until the load number is reached) The problem I found with that is the ebuilds load the system lightly to start with, before they enter the compile phase, to portage starts dozens of parallel ebuilds, then the system gets completely bogged down when they start compiling. Yes, sometimes that would happen if at the beginning there are network-bound ebuilds all downloading their respective distfiles. The load stays low until they all start ./configure-ing roughly at the same time. Then all hell breaks loose. I successfully mitigate such load-explosion by doing a --fetchonly step first, and keeping MAKEOPTS at low -j (which, in my case, is actually required). Just to add more info: I use USE=graphite (with some CFLAGS, uh, 'enhancements') with gcc-4.5.3. IIRC, I could push MAKEOPTS up to -j5 (and even more, but I ran out of cores) when I was still using gcc-4.4.x and no USE=graphite. Won't file a bug report, though. I have a feeling that my bug report re: emerge failure will be marked WONTFIX thanks to the 'ricer special' CFLAGS As I noted, -l in MAKEOPTS takes care of the load explosion very nicely. Most likely so. I am not aware of -l in MAKEOPTS before, so what I posted was my workaround to prevent load explosion. Thanks to your very useful tip, I now no longer have to worry about load explosion :-) (I still like doing pre-fetchonly-ing, though. But now for a different main reason :-) Rgds,
Re: [gentoo-user] emerge -j, make -j and make -l
On Nov 28, 2011 11:32 AM, Michael Mol mike...@gmail.com wrote: - 8 snip MAKEOPTS would be -j16, -l10. (Which actually goes up to about 12 or 13 based on that N*1.6 behavior) - 8 snip Just in case anyone wonders where the multiplier 1.6 comes from: There had been a discussion somewhere (I forgot where exactly, sorry) about load numbers. The final conclusion was that the ideal load number for today's processors is 2*N, because with the out-of-order capability of modern processors, two instructions can overlap in the pipeline, even without hyperthreading. Unfortunately, striving for 2*N will inadvertently result in short bursts of 2*N, and this potentially induce a stall, which will be very costly. 1.8*N gives a 10% margin for burst activities, while 1.6*N gives a 20% margin. Since emerging packages has a sudden increase in load when autoconfigure finishes and make fires up all the parallel building, I figure 20% margin will be better. Of course, that's before @mikemol made me aware of MAKEOPTS -l, so I am now tempted to raise the load-average to 1.8*N, letting make handle the bursts. Rgds,
Re: [gentoo-user] emerge -j, make -j and make -l
On Mon, Nov 28, 2011 at 12:13 AM, Pandu Poluan pa...@poluan.info wrote: On Nov 28, 2011 11:38 AM, Michael Mol mike...@gmail.com wrote: On Sun, Nov 27, 2011 at 7:54 PM, Pandu Poluan pa...@poluan.info wrote: On Nov 28, 2011 6:24 AM, Neil Bothwick n...@digimed.co.uk wrote: On Mon, 28 Nov 2011 00:56:17 +0700, Pandu Poluan wrote: I don't know where the 'blame' lies, but I've found myself standardizing on MAKEOPTS=-j3, and PORTAGE_DEFAULT_OPTS=--jobs --load-average=1.6*num_of_vCPU (Yes, no explicit number of jobs. The newer portages are smart enough to keep starting new jobs until the load number is reached) The problem I found with that is the ebuilds load the system lightly to start with, before they enter the compile phase, to portage starts dozens of parallel ebuilds, then the system gets completely bogged down when they start compiling. Yes, sometimes that would happen if at the beginning there are network-bound ebuilds all downloading their respective distfiles. The load stays low until they all start ./configure-ing roughly at the same time. Then all hell breaks loose. I successfully mitigate such load-explosion by doing a --fetchonly step first, and keeping MAKEOPTS at low -j (which, in my case, is actually required). Just to add more info: I use USE=graphite (with some CFLAGS, uh, 'enhancements') with gcc-4.5.3. IIRC, I could push MAKEOPTS up to -j5 (and even more, but I ran out of cores) when I was still using gcc-4.4.x and no USE=graphite. Won't file a bug report, though. I have a feeling that my bug report re: emerge failure will be marked WONTFIX thanks to the 'ricer special' CFLAGS As I noted, -l in MAKEOPTS takes care of the load explosion very nicely. Most likely so. I am not aware of -l in MAKEOPTS before, so what I posted was my workaround to prevent load explosion. Thanks to your very useful tip, I now no longer have to worry about load explosion :-) (I still like doing pre-fetchonly-ing, though. But now for a different main reason :-) The explosion of information in this thread is going to make for a *great* followup blog post. :) Now I just wish there were a way to get Portage and Make to watch CPU usage and raise or lower the load-average threshold depending on how much CPU was going to 'sys', 'user' and 'wait'; Lower -l if a great deal of time is spent in 'sys'; you're likely burning cycles in context switches. Raise -l if a great deal of time is spent waiting on I/O. It'd also be helpful to be able to give keystone[1] packages and Make recipes a more favorable NICE value than those less important, to induce the scheduler to favor the important packages over less-important packages when we've got more ready work than cores. I don't think Make *can* have the smarts for that, but Portage could conceivably do it for its own parallelization. [1] Where many things depend on them, either directly or indirectly. Getting these out of the way means more parallel-buildable packages being available at the same time. -- :wq
Re: [gentoo-user] emerge -j, make -j and make -l
On Sun, Nov 27, 2011 at 8:06 PM, Pandu Poluan pa...@poluan.info wrote: On Nov 28, 2011 3:21 AM, Michael Mol mike...@gmail.com wrote: On Sun, Nov 27, 2011 at 12:56 PM, Pandu Poluan pa...@poluan.info wrote: [snip] Sweet; I didn't know about Portage's --load-average; I'll definitely switch to that instead of -j. Load-driven make plus load-driven portage should work beautifully on my system. I'll steal your 1.6 factor, and give: MAKEOPTS=-j 2*N -l 1.6*N) PORTAGE_DEFAULT_OPTS=--jobs --load-average1.6*N a try. Make sure that make supports non-integer values for -l, though. I rounded up to 13. -- :wq
Re: [gentoo-user] emerge -j, make -j and make -l
On Nov 28, 2011 12:35 PM, Michael Mol mike...@gmail.com wrote: On Sun, Nov 27, 2011 at 8:06 PM, Pandu Poluan pa...@poluan.info wrote: On Nov 28, 2011 3:21 AM, Michael Mol mike...@gmail.com wrote: On Sun, Nov 27, 2011 at 12:56 PM, Pandu Poluan pa...@poluan.info wrote: [snip] Sweet; I didn't know about Portage's --load-average; I'll definitely switch to that instead of -j. Load-driven make plus load-driven portage should work beautifully on my system. I'll steal your 1.6 factor, and give: MAKEOPTS=-j 2*N -l 1.6*N) PORTAGE_DEFAULT_OPTS=--jobs --load-average1.6*N a try. Make sure that make supports non-integer values for -l, though. I rounded up to 13. Shouldn't you be rounding down, instead? That said, as long as the number falls between 1.6*N and 1.8*N (see my previous post), nothing should blow up. Well, not spectacularly, at least :-) BTW, FYI, --load-average accepts non-integer values. Rgds,
[gentoo-user] dev-lang/cabal-install compilation fails
Hey list, I want to use cabal-install in my Gentoo box , but fails :-. it seems that cabal-install depends on mtl, so in the phase of compiling mtl , it reports error . The complete build log is here(https://gist.github.com/1399303). # emerge -pqv =dev-haskell/mtl-1.1.0.2 [ebuild N] dev-haskell/mtl-1.1.0.2 USE=-doc -profile # emerge --info =dev-haskell/mtl-1.1.0.2 Portage 2.1.10.11 (default/linux/x86/10.0/desktop, gcc-4.5.3, glibc-2.12.2-r0, 3.0.6-gentoo i686) = System Settings = System uname: Linux-3.0.6-gentoo-i686-Pentium-R-_Dual-Core_CPU_E6500_@_2.93GHz-with-gentoo-2.0.3 Timestamp of tree: Mon, 28 Nov 2011 04:15:02 + app-shells/bash: 4.1_p9 dev-lang/python: 2.7.2-r3, 3.1.4-r3 dev-util/cmake: 2.8.4-r1 dev-util/pkgconfig: 0.26 sys-apps/baselayout: 2.0.3 sys-apps/openrc: 0.8.3-r1 sys-apps/sandbox: 2.5 sys-devel/autoconf: 2.13, 2.68 sys-devel/automake: 1.9.6-r3, 1.11.1 sys-devel/binutils: 2.21.1-r1 sys-devel/gcc:4.5.3-r1 sys-devel/gcc-config: 1.4.1-r1 sys-devel/libtool:2.4-r1 sys-devel/make: 3.82-r1 sys-kernel/linux-headers: 2.6.39 (virtual/os-headers) sys-libs/glibc: 2.12.2 Repositories: gentoo ACCEPT_KEYWORDS=x86 ACCEPT_LICENSE=* -@EULA CBUILD=i686-pc-linux-gnu CFLAGS=-O2 -march=i686 -pipe CHOST=i686-pc-linux-gnu CONFIG_PROTECT=/etc /usr/share/gnupg/qualified.txt CONFIG_PROTECT_MASK=/etc/ca-certificates.conf /etc/dconf /etc/env.d /etc/fonts/fonts.conf /etc/gconf /etc/gentoo-release /etc/revdep-rebuild /etc/sandbox.d /etc/terminfo /etc/texmf/language.dat.d /etc/texmf/language.def.d /etc/texmf/updmap.d /etc/texmf/web2c CXXFLAGS=-O2 -march=i686 -pipe DISTDIR=/usr/portage/distfiles FEATURES=assume-digests binpkg-logs distlocks ebuild-locks fixlafiles fixpackages news parallel-fetch protect-owned sandbox sfperms strict unknown-features-warn unmerge-logs unmerge-orphans userfetch FFLAGS= GENTOO_MIRRORS=http://123.58.173.106/gentoo/; LANG=zh_CN.UTF-8 LDFLAGS=-Wl,-O1 -Wl,--as-needed LINGUAS=zh_CN MAKEOPTS=-j4 PKGDIR=/usr/portage/packages PORTAGE_CONFIGROOT=/ PORTAGE_RSYNC_OPTS=--recursive --links --safe-links --perms --times --compress --force --whole-file --delete --stats --timeout=180 --exclude=/distfiles --exclude=/local --exclude=/packages PORTAGE_TMPDIR=/var/tmp PORTDIR=/usr/portage PORTDIR_OVERLAY= SYNC=rsync://rsync.cn.gentoo.org/gentoo-portage USE=X a52 aac acl acpi alsa bash-completion berkdb bluetooth branding bzip2 cairo cdda cdr cli consolekit cracklib crypt cscope cups cxx dbus dri dts dvd dvdr dvi emboss encode exif fam firefox flac fortran gdbm gdu gif gnome gpm gtk iconv ipv6 jpeg kdrive kpathsea lcms ldap libnotify mad mng modules mp3 mp4 mpeg mudflap ncurses nls nptl nptlonly ogg opengl openmp pam pango pcre pdf png policykit ppds pppd qt3support qt4 readline sdl session spell sqlite ssl startup-notification static-libs svg sysfs tcpd tiff truetype udev unicode usb vorbis x264 x86 xcb xml xorg xulrunner xv xvid zlib ALSA_CARDS=ali5451 als4000 atiixp atiixp-modem bt87x ca0106 cmipci emu10k1 emu10k1x ens1370 ens1371 es1938 es1968 fm801 hda-intel intel8x0 intel8x0m maestro3 trident usb-audio via82xx via82xx-modem ymfpci ALSA_PCM_PLUGINS=adpcm alaw asym copy dmix dshare dsnoop empty extplug file hooks iec958 ioplug ladspa lfloat linear meter mmap_emul mulaw multi null plug rate route share shm softvol APACHE2_MODULES=actions alias auth_basic authn_alias authn_anon authn_dbm authn_default authn_file authz_dbm authz_default authz_groupfile authz_host authz_owner authz_user autoindex cache cgi cgid dav dav_fs dav_lock deflate dir disk_cache env expires ext_filter file_cache filter headers include info log_config logio mem_cache mime mime_magic negotiation rewrite setenvif speling status unique_id userdir usertrack vhost_alias CALLIGRA_FEATURES=kexi words flow plan stage tables krita karbon braindump CAMERAS=ptp2 COLLECTD_PLUGINS=df interface irq load memory rrdtool swap syslog ELIBC=glibc GPSD_PROTOCOLS=ashtech aivdm earthmate evermore fv18 garmin garmintxt gpsclock itrax mtk3301 nmea ntrip navcom oceanserver oldstyle oncore rtcm104v2 rtcm104v3 sirf superstar2 timing tsip tripmate tnt ubx INPUT_DEVICES=keyboard mouse evdev KERNEL=linux LCD_DEVICES=bayrad cfontz cfontz633 glk hd44780 lb216 lcdm001 mtxorb ncurses text LINGUAS=zh_CN PHP_TARGETS=php5-3 RUBY_TARGETS=ruby18 USERLAND=GNU VIDEO_CARDS=nvidia XTABLES_ADDONS=quota2 psd pknock lscan length2 ipv4options ipset ipp2p iface geoip fuzzy condition tee tarpit sysrq steal rawnat logmark ipmark dhcpmac delude chaos account Unset: CPPFLAGS, CTARGET, EMERGE_DEFAULT_OPTS, INSTALL_MASK, LC_ALL, PORTAGE_BUNZIP2_COMMAND, PORTAGE_COMPRESS, PORTAGE_COMPRESS_FLAGS, PORTAGE_RSYNC_EXTRA_OPTS Can some offer any suggestions? Thanks ! -- Yes, I use Debian
Re: [gentoo-user] Re: Can one get me that link?
On Sun, Nov 27, 2011 at 5:44 PM, walt w41...@gmail.com wrote: Both will run 64-bit software, but only the 'multilib' will also run 32-bit software. You may not care about running older 32-bit software on your 64-bit machine. Oh I see. thanks Reagrds, LinuxIsOne
Re: [gentoo-user] ImageMagick
On Monday 28 Nov 2011 00:55:36 Colleen Beamer wrote: On 11/27/11 16:28, Michael Schreckenbauer wrote: Am Sonntag, 27. November 2011, 17:04:24 schrieb Colleen Beamer: On 11/27/11 15:18, Michael Schreckenbauer wrote: Hi Colleen, Am Sonntag, 27. November 2011, 16:08:41 schrieb Colleen Beamer: Hi all, I used to use ImageMagick to quickly resize images and convert from one format to another (jpg to png, for example). ImageMagick is installed on my system (installed as requirement of something else), but I'm darned if I can find an executable to run the program. There used to be one in /usr/bin on my old system. Does anyone have any experience with this? yes :) It's /usr/bin/convert This isn't quite what I wanted - you have to add options to the command. I was hoping to get the graphical interface that I had before. Please don't tell me they took a great little program and screwed it up! :-) is /usr/bin/display the program you were looking for? It supports a subset of ImageMagick's functionality. Thank you!!! This is EXACTLY it. :-) Like I said, haven't used this in a while and had forgotten about this! I was also going to mention /usr/bin/display, but as I wasn't quick enough I will mention Kim4: kde-misc/kim4 Available versions: (4) (~) 0.9.5 ~amd64 ~x86 Installed versions: 0.9.5(4)(16:39:44 12/18/10) Homepage:http://www.kde- apps.org/content/show.php/Kim+%28Kde+Image+Menu%29?content=11505 Description: a Dolphin and Konqueror service menu for ImageMagick in case you are using KDE apps. -- Regards, Mick signature.asc Description: This is a digitally signed message part.
Re: [gentoo-user] Re: emerge -j, make -j and make -l
Pandu Poluan wrote: On Nov 28, 2011 8:38 AM, Dale rdalek1...@gmail.com mailto:rdalek1...@gmail.com wrote: Jack Byer wrote: It would be nice if there were some way to mark particular packages that should never be compiled in parallel (like the trick for using a using a separate, non-tmpfs build directory for large packages). The load-explosion you describe is bad enough with regular packages but when firefox, xulrunner, chromium and libreoffice all decide to start compiling at the same time it turns into a complete nightmare. I think it has that already. I have noticed several times that mine will only be working on one package and have a lot of packages left to update. When that single package is done, it loads up several and does them at the same time. Something tells emerge not to run them at the same time and I assume it is in the ebuild somewhere. I have to have tmpfs in use when LOo comes up for a compile. I have more memory than I have space on /var. If I don't have portages work directory on tmpfs, the compile fills up /var and dies. Ironic that what works for one fails for another. portage.env? http://wiki.gentoo.org/wiki//etc/portage/env Rgds, I just added it to fstab so that it mounts automatically. If I am running some program that needs that much ram, I can always unmount it. If course, when knotify went wonky the other day and was using 14Gbs of ram, it didn't complain about tmpfs or anything. It did get a bit slow until I killed it. Don't have KDE running when you recompile some parts of it. ;-) Dale :-) :-) -- I am only responsible for what I said ... Not for what you understood or how you interpreted my words!
Re: [gentoo-user] ImageMagick
On Sun, 27 Nov 2011 22:28:35 +0100 Michael Schreckenbauer grim...@gmx.de wrote: Am Sonntag, 27. November 2011, 17:04:24 schrieb Colleen Beamer: On 11/27/11 15:18, Michael Schreckenbauer wrote: Hi Colleen, Am Sonntag, 27. November 2011, 16:08:41 schrieb Colleen Beamer: Hi all, I used to use ImageMagick to quickly resize images and convert from one format to another (jpg to png, for example). ImageMagick is installed on my system (installed as requirement of something else), but I'm darned if I can find an executable to run the program. There used to be one in /usr/bin on my old system. Does anyone have any experience with this? yes :) It's /usr/bin/convert This isn't quite what I wanted - you have to add options to the command. I was hoping to get the graphical interface that I had before. Please don't tell me they took a great little program and screwed it up! :-) is /usr/bin/display the program you were looking for? It supports a subset of ImageMagick's functionality. There was also another GUI with commands like on this screenshot: http://tuxradar.com/files/imagemagick-1.png but I do not remember how to launch it. :-) Robert -- Róbert Čerňanský E-mail: hslis...@zoznam.sk Jabber: h...@jabber.sk
[gentoo-user] Re: dev-lang/cabal-install compilation fails
On 28 November 2011 14:06, wolf python london lyh19901...@gmail.com wrote: Hey list, I want to use cabal-install in my Gentoo box , but fails :-. it seems that cabal-install depends on mtl, so in the phase of compiling mtl , it reports error . The complete build log is here(https://gist.github.com/1399303). # emerge -pqv =dev-haskell/mtl-1.1.0.2 [ebuild N ] dev-haskell/mtl-1.1.0.2 USE=-doc -profile # emerge --info =dev-haskell/mtl-1.1.0.2 Portage 2.1.10.11 (default/linux/x86/10.0/desktop, gcc-4.5.3, glibc-2.12.2-r0, 3.0.6-gentoo i686) = System Settings = System uname: Linux-3.0.6-gentoo-i686-Pentium-R-_Dual-Core_CPU_E6500_@_2.93GHz-with-gentoo-2.0.3 Timestamp of tree: Mon, 28 Nov 2011 04:15:02 + app-shells/bash: 4.1_p9 dev-lang/python: 2.7.2-r3, 3.1.4-r3 dev-util/cmake: 2.8.4-r1 dev-util/pkgconfig: 0.26 sys-apps/baselayout: 2.0.3 sys-apps/openrc: 0.8.3-r1 sys-apps/sandbox: 2.5 sys-devel/autoconf: 2.13, 2.68 sys-devel/automake: 1.9.6-r3, 1.11.1 sys-devel/binutils: 2.21.1-r1 sys-devel/gcc: 4.5.3-r1 sys-devel/gcc-config: 1.4.1-r1 sys-devel/libtool: 2.4-r1 sys-devel/make: 3.82-r1 sys-kernel/linux-headers: 2.6.39 (virtual/os-headers) sys-libs/glibc: 2.12.2 Repositories: gentoo ACCEPT_KEYWORDS=x86 ACCEPT_LICENSE=* -@EULA CBUILD=i686-pc-linux-gnu CFLAGS=-O2 -march=i686 -pipe CHOST=i686-pc-linux-gnu CONFIG_PROTECT=/etc /usr/share/gnupg/qualified.txt CONFIG_PROTECT_MASK=/etc/ca-certificates.conf /etc/dconf /etc/env.d /etc/fonts/fonts.conf /etc/gconf /etc/gentoo-release /etc/revdep-rebuild /etc/sandbox.d /etc/terminfo /etc/texmf/language.dat.d /etc/texmf/language.def.d /etc/texmf/updmap.d /etc/texmf/web2c CXXFLAGS=-O2 -march=i686 -pipe DISTDIR=/usr/portage/distfiles FEATURES=assume-digests binpkg-logs distlocks ebuild-locks fixlafiles fixpackages news parallel-fetch protect-owned sandbox sfperms strict unknown-features-warn unmerge-logs unmerge-orphans userfetch FFLAGS= GENTOO_MIRRORS=http://123.58.173.106/gentoo/; LANG=zh_CN.UTF-8 LDFLAGS=-Wl,-O1 -Wl,--as-needed LINGUAS=zh_CN MAKEOPTS=-j4 PKGDIR=/usr/portage/packages PORTAGE_CONFIGROOT=/ PORTAGE_RSYNC_OPTS=--recursive --links --safe-links --perms --times --compress --force --whole-file --delete --stats --timeout=180 --exclude=/distfiles --exclude=/local --exclude=/packages PORTAGE_TMPDIR=/var/tmp PORTDIR=/usr/portage PORTDIR_OVERLAY= SYNC=rsync://rsync.cn.gentoo.org/gentoo-portage USE=X a52 aac acl acpi alsa bash-completion berkdb bluetooth branding bzip2 cairo cdda cdr cli consolekit cracklib crypt cscope cups cxx dbus dri dts dvd dvdr dvi emboss encode exif fam firefox flac fortran gdbm gdu gif gnome gpm gtk iconv ipv6 jpeg kdrive kpathsea lcms ldap libnotify mad mng modules mp3 mp4 mpeg mudflap ncurses nls nptl nptlonly ogg opengl openmp pam pango pcre pdf png policykit ppds pppd qt3support qt4 readline sdl session spell sqlite ssl startup-notification static-libs svg sysfs tcpd tiff truetype udev unicode usb vorbis x264 x86 xcb xml xorg xulrunner xv xvid zlib ALSA_CARDS=ali5451 als4000 atiixp atiixp-modem bt87x ca0106 cmipci emu10k1 emu10k1x ens1370 ens1371 es1938 es1968 fm801 hda-intel intel8x0 intel8x0m maestro3 trident usb-audio via82xx via82xx-modem ymfpci ALSA_PCM_PLUGINS=adpcm alaw asym copy dmix dshare dsnoop empty extplug file hooks iec958 ioplug ladspa lfloat linear meter mmap_emul mulaw multi null plug rate route share shm softvol APACHE2_MODULES=actions alias auth_basic authn_alias authn_anon authn_dbm authn_default authn_file authz_dbm authz_default authz_groupfile authz_host authz_owner authz_user autoindex cache cgi cgid dav dav_fs dav_lock deflate dir disk_cache env expires ext_filter file_cache filter headers include info log_config logio mem_cache mime mime_magic negotiation rewrite setenvif speling status unique_id userdir usertrack vhost_alias CALLIGRA_FEATURES=kexi words flow plan stage tables krita karbon braindump CAMERAS=ptp2 COLLECTD_PLUGINS=df interface irq load memory rrdtool swap syslog ELIBC=glibc GPSD_PROTOCOLS=ashtech aivdm earthmate evermore fv18 garmin garmintxt gpsclock itrax mtk3301 nmea ntrip navcom oceanserver oldstyle oncore rtcm104v2 rtcm104v3 sirf superstar2 timing tsip tripmate tnt ubx INPUT_DEVICES=keyboard mouse evdev KERNEL=linux LCD_DEVICES=bayrad cfontz cfontz633 glk hd44780 lb216 lcdm001 mtxorb ncurses text LINGUAS=zh_CN PHP_TARGETS=php5-3 RUBY_TARGETS=ruby18 USERLAND=GNU VIDEO_CARDS=nvidia XTABLES_ADDONS=quota2 psd pknock lscan length2 ipv4options ipset ipp2p iface geoip fuzzy condition tee tarpit sysrq steal rawnat logmark ipmark dhcpmac delude chaos account Unset: CPPFLAGS, CTARGET, EMERGE_DEFAULT_OPTS, INSTALL_MASK, LC_ALL,
