[gentoo-dev] mount portage from squashfs
Proposal, create snapshots of portage as squashfs iso, to be used in place of /usr/portage directory. prior art: see #1 Already working here: one central server which keep the portage full tree and that after a sync create portage.sqsh a squashfs 4.0 iso. Advantages are mainly: - cleaner root directory (ext4: du -sh /usr/portage ~= 600M | find /g/portage | wc -l ~= 13) - faster `emerge --sync` with fast connections - faster `emerge -uDpvN world` - less cpu/disk load on the server (if not serving from memory) Disadvantages - need to mount portage, or to use autofs - need kernel = 2.6.30 - bigger rsync transfer size (?= 2x) #2 - bigger initial transfer size, lzma snapshot currently weight 30.8M, portage.sqsh 45M How it's done here: Currently on the dispatcher the following run after every emerge --sync: mksquashfs /usr/portage /srv/portage.sqsh \ -noappend -no-exports -no-recovery -force-uid 250 -force-gid 250 The clients run from cron the following: umount /g/portage 2/dev/null \ ; cp /srv/server/portage.sqsh /var/tmp/portage.sqsh \ mount /usr/portage /etc/fstab: /srv/server/portage.sqsh /usr/portage squashfs loop,ro,noauto 1 1 some real data: stats for a portage sync, one day Number of files: 136429 Number of files transferred: 326 Total file size: 180345216 bytes Total transferred file size: 1976658 bytes Literal data: 1976658 bytes Matched data: 0 bytes File list size: 3377038 File list generation time: 0.001 seconds File list transfer time: 0.000 seconds Total bytes sent: 47533 Total bytes received: 4120255 sent 47533 bytes received 4120255 bytes 124411.58 bytes/sec total size is 180345216 speedup is 43.27 stats for a portage.sqsh sync, one day Number of files: 1 Number of files transferred: 1 Total file size: 46985216 bytes Total transferred file size: 46985216 bytes Literal data: 8430976 bytes Matched data: 38554240 bytes File list size: 27 File list generation time: 0.001 seconds File list transfer time: 0.000 seconds Total bytes sent: 48096 Total bytes received: 8454837 sent 48096 bytes received 8454837 bytes 5668622.00 bytes/sec total size is 46985216 speedup is 5.53 #1 http://forums.gentoo.org/viewtopic-p-2218914.html http://www.mail-archive.com/gentoo-...@gentoo.org/msg05240.html #2 May be mitigated by mksquashfs '--sort' option, to be tested - francesco (vivo)
[gentoo-dev] Re: Stats test server running, please check it out
Sebastian Pipping posted on Wed, 12 Aug 2009 14:31:48 +0200 as excerpted: Also, the man page does not seem to list these features: cvs preserve-libs split-debug splitdebug unmerge-logs Either people use invalid features (you tell me) or the man page needs an update. Maybe both (split-debug vs splitdebug)? Note that some FEATURES may in fact trigger various portage bashrc customizations. While Ed Catmur disappeared some time ago now, I still use some of his bashrc customizations, including FEATURES=patchtree, for instance. There were others, but many of them were more dev focused than I as a user am, so it's likely that various devs still use a possibly further customized version of the same scripts, today. The point being, due to customization it's not reasonable to expect a full mapping, FEATURES or other variable, tho at least some of the above would appear to be legitimate mainline portage if perhaps not yet well documented FEATURES. -- Duncan - List replies preferred. No HTML msgs. Every nonfree program has a lord, a master -- and if you use the program, he is your master. Richard Stallman
Re: [gentoo-dev] about a new app
hiperon wrote: Hi you all, I am sorry for posting this question but I saw no other way (got really confused). I am developping an application (a text editor) and I would like to see it into Gentoo distro, but I can't really understand the way that thing goes. I read the documentation about how to make an ebuild file, but could not figured out how to submit it. Could you point me some directions, please, even if it is another maillist. Please don't use HTML format when posting on mailinglist. New packages should be reported to http://bugs.gentoo.org and if I you want to write your own ebuild to attach in the bug, see http://devmanual.gentoo.org Thanks, Samuli
Re: [gentoo-dev] about a new app
Samuli Suominen wrote: I am sorry for posting this question but I saw no other way (got really confused). I am developping an application (a text editor) and I would like to see it into Gentoo distro, but I can't really understand the way that thing goes. I read the documentation about how to make an ebuild file, but could not figured out how to submit it. Could you point me some directions, please, even if it is another maillist. Please don't use HTML format when posting on mailinglist. New packages should be reported to http://bugs.gentoo.org and if I you want to write your own ebuild to attach in the bug, see http://devmanual.gentoo.org Hello hiperon, thanks for asking. Your project will probably become package app-editors/cafe. From the kind of application it would fit either (A) the main tree (in which case bugs.gentoo.org is the place to go) or (B) the sunrise overlay (in which case #gentoo-sunrise on Freenode will get you running and help with ebuild _review_). Sebastian
[gentoo-dev] Re: about a new app
On 08/12/2009 06:49 PM, hiperon wrote: Hi you all, I am sorry for posting this question but I saw no other way (got really confused). I am developping an application (a text editor) and I would like to see it into Gentoo distro, but I can't really understand the way that thing goes. I read the documentation about how to make an ebuild file, but could not figured out how to submit it. Could you point me some directions, please, even if it is another maillist. Well, the Gentoo documentation itself has a chapter on how to contribute ebuilds: http://www.gentoo.org/doc/en/ebuild-submit.xml Also, there's the gentoo-devhelp mailing list devoted to these kinds of questions: http://www.gentoo.org/main/en/lists.xml All Gentoo lists are also available for reading/posting through GManes NNTP server: nntp://news.gmane.org/gmane.linux.gentoo.devhelp Hope that helps.
[gentoo-dev] about a new app
Hi you all, I am sorry for posting this question but I saw no other way (got really confused). I am developping an application (a text editor) and I would like to see it into Gentoo distro, but I can't really understand the way that thing goes. I read the documentation about how to make an ebuild file, but could not figured out how to submit it. Could you point me some directions, please, even if it is another maillist. sorry for the inconvenience. for whom might be interested: http://cafe.sourceforge.net -- // // o ___ ___ //=// // //_ / //_ //_ / // // //\ / // // // // //_ // \ //_// // \/
Re: [gentoo-dev] about a new app
hiperon wrote: Hi you all, I am sorry for posting this question but I saw no other way (got really confused). I am developping an application (a text editor) and I would like to see it into Gentoo distro, but I can't really understand the way that thing goes. I read the documentation about how to make an ebuild file, but could not figured out how to submit it. Could you point me some directions, please, even if it is another maillist. sorry for the inconvenience. for whom might be interested: http://cafe.sourceforge.net -- // // o ___ ___ //=// // //_ / //_ //_ / // // //\ / // // // // //_ // \ //_// // \/ Hi there, The best thing to do is to file a bug at http://bugs.gentoo.org requesting that the application be added to the Portage tree. A Gentoo developer can then make the ebuild file for you. If I get a little time today to look at the source, I might be able to throw one together. The best thing for you to do now though is to file the bug. Hope that helps, Nathan Zachary
Re: [gentoo-dev] mount portage from squashfs
I'm doing more or less the same here for a few years already, works pretty well. I think others are as well. Doing the sync only on one system (and applying patches to the tree where needed) and then locally copying the image to systems. Big advantage I see is more efficient access to portage tree and less disk usage on all systems (even the master system except for the duration of the sync) On master system I do the following: dd if=/dev/zero of=/tmp/portage.img size=384m mkfs.ext2 /tmp/portage.img mkdir /tmp/portage mount /tmp/portage.img /tmp/portage -o loop cp -a /usr/portage/* /tmp/portage umount /usr/portage mount /tmp/portage /usr/portage --move emerge --sync (apply patches) mksquashfs /usr/portage /tmp/portage.sqsh $options umount /usr/portage rm -f /tmp/portage.img mv /tmp/portage.sqsh $target mount $target /usr/portage -o loop This is pretty quick (and ext2 image on tmpfs uses less memory at the end of the day than what would be needed for putting portage tree on tmpfs) After that I can fetch the sqsh image from any client system when I do updates over there (I even keep a few weeks worth of images on the master in case one would be needed) Only thing to take care of is mounting RW filesystem over /usr/portage/distfiles and /usr/portage/packages or adjusting make.conf so portage can download distfiles and if asked to same binpkgs. If there is some interest, I can share my script which does the whole process. Having tree snapshots that are currently available as tarballs also available as squashfs images would be nice, more or less same download size but easier to access (e.g. no need to unpack) Bruno On Wed, 12 August 2009 Francesco R viv...@gmail.com wrote: Proposal, create snapshots of portage as squashfs iso, to be used in place of /usr/portage directory. prior art: see #1 Already working here: one central server which keep the portage full tree and that after a sync create portage.sqsh a squashfs 4.0 iso. Advantages are mainly: - cleaner root directory (ext4: du -sh /usr/portage ~= 600M | find /g/portage | wc -l ~= 13) - faster `emerge --sync` with fast connections - faster `emerge -uDpvN world` - less cpu/disk load on the server (if not serving from memory) Disadvantages - need to mount portage, or to use autofs - need kernel = 2.6.30 - bigger rsync transfer size (?= 2x) #2 - bigger initial transfer size, lzma snapshot currently weight 30.8M, portage.sqsh 45M How it's done here: Currently on the dispatcher the following run after every emerge --sync: mksquashfs /usr/portage /srv/portage.sqsh \ -noappend -no-exports -no-recovery -force-uid 250 -force-gid 250 The clients run from cron the following: umount /g/portage 2/dev/null \ ; cp /srv/server/portage.sqsh /var/tmp/portage.sqsh \ mount /usr/portage /etc/fstab: /srv/server/portage.sqsh /usr/portage squashfs loop,ro,noauto 1 1 some real data: stats for a portage sync, one day Number of files: 136429 Number of files transferred: 326 Total file size: 180345216 bytes Total transferred file size: 1976658 bytes Literal data: 1976658 bytes Matched data: 0 bytes File list size: 3377038 File list generation time: 0.001 seconds File list transfer time: 0.000 seconds Total bytes sent: 47533 Total bytes received: 4120255 sent 47533 bytes received 4120255 bytes 124411.58 bytes/sec total size is 180345216 speedup is 43.27 stats for a portage.sqsh sync, one day Number of files: 1 Number of files transferred: 1 Total file size: 46985216 bytes Total transferred file size: 46985216 bytes Literal data: 8430976 bytes Matched data: 38554240 bytes File list size: 27 File list generation time: 0.001 seconds File list transfer time: 0.000 seconds Total bytes sent: 48096 Total bytes received: 8454837 sent 48096 bytes received 8454837 bytes 5668622.00 bytes/sec total size is 46985216 speedup is 5.53 #1 http://forums.gentoo.org/viewtopic-p-2218914.html http://www.mail-archive.com/gentoo-...@gentoo.org/msg05240.html #2 May be mitigated by mksquashfs '--sort' option, to be tested - francesco (vivo)
[gentoo-dev] base/use.defaults
Do we still need it? It appears to be very unmaintained. And if there's 3rd party tools that still need it, I wouldn't count them qualifying. Suggestion: cvs remove -f Thanks, Samuli
[gentoo-dev] Only 11 bugs left to be fixed in GCC 4.4+/GLIBC 2.10+ trackers. Would be nice to get some help for these.
These bugs would need your attention. About half of them are x86 only software, and I don't have such platform. I've took out all the bugs that are assigned to qa/treecleaners for removal due random reasons. Users help would be nice too. Just attach a patch in the bug and I'll commit them. GCC 4.4+ # 273526 [ga...@gentoo.org] - games-board/hexxagon: fails to build with gcc-4.4. # 276246 [embed...@gentoo.org] - sys-libs/uclibc++: fails to build with gcc-4.4. # 276841 [...@gentoo.org] - net-p2p/kmldonkey removal request (was: fails to build with gcc-4.4). # 279160 [oli.b...@web.de] - sci-libs/openfoam-kernel fails to build with gcc-4.4. # 280704 [bug-wrangl...@gentoo.org] - app-office/openoffice-3.0.1: Supported gcc majors are 2 , 3 and 4 = 4.3. Unsupported gcc major version.. GLIBC 2.10+ and GCC 4.4+ # 273407 [ga...@gentoo.org] - games-emulation/mupen64-glide64: fails to build with glibc-2.10. # 273557 [ga...@gentoo.org] - games-arcade/xevil: fails to build with glibc-2.10. # 273652 [ga...@gentoo.org] - games-puzzle/gemhun: fails to build with glibc-2.10. # 276932 [sbrie...@gentoo.org] - media-gfx/iscan removal request (was: fails to build with glibc-2.10). # 277072 [ga...@gentoo.org] - =games-sports/toycars-0.3.10 fails to build with glibc-2.10+. # 277107 [j...@gentoo.org] - dev-java/sun-jre-bin (?): Sun Java VM crashes with sys-libs/glibc-2.10.1.
[gentoo-dev] RFC: Make 10.0 profiles EAPI-2 'compliant'
I am suggesting that the new 10.0 profiles be marked as EAPI-2 compliant. This involves setting the content of the 'eapi' file to 2 and bumping up the required portage version. This seems like progress to me. Often, developers are complaining that they can't use SLOT syntax in profiles (I know that is EAPI-1). Since, the only time we can bump EAPI syntax in profiles is upon a new directory creation, this seems like a good time to me. The new profiles are still in flux until the official stages/cd's are produced. Also, another good reason is: why not? I don't think any Gentoo user can avoid EAPI-2 up til now anyway. Any comments? No comments means it will be decided off-list. Timeframe: 1 week from now. -Jeremy
[gentoo-dev] One more USE flag added to desktop make.defaults
Since USE dvd was there already, I previously dropped in the a52 codec required for standard DVD support. Forgot to add one USE flag, beandog nicely added it today. It's: USE dts That's also a default DVD codec, it pulls in basically one library small, media-libs/libdca for sounds. Thanks, Samuli
[gentoo-dev] Lastrite: app-misc/sdricoh_cs
(I know this mask is quite old, but I haven't sent correct last rites back then, so doing this now) # Hanno Boeck ha...@gentoo.org (22 Jan 2009) # This has been included in kernel 2.6.27 and shouldn't be used # any more. Will remove within a month, please contact me if you # think it should stay. app-misc/sdricoh_cs -- Hanno Böck Blog: http://www.hboeck.de/ GPG: 3DBD3B20 Jabber/Mail:ha...@hboeck.de signature.asc Description: This is a digitally signed message part.
Re: [gentoo-dev] RFC: Make 10.0 profiles EAPI-2 'compliant'
Jeremy Olexa wrote: I am suggesting that the new 10.0 profiles be marked as EAPI-2 compliant. This involves setting the content of the 'eapi' file to 2 and bumping up the required portage version. YES!! Please. Ben
Re: [gentoo-dev] RFC: Make 10.0 profiles EAPI-2 'compliant'
Jeremy Olexa wrote: I am suggesting that the new 10.0 profiles be marked as EAPI-2 compliant. This involves setting the content of the 'eapi' file to 2 and bumping up the required portage version. +1
Re: [gentoo-dev] RFC: Make 10.0 profiles EAPI-2 'compliant'
On Wed, 12 Aug 2009 20:41:30 +0200 Tomáš Chvátal scarab...@gentoo.org wrote: Also we should allow the stuff as directory thingus (portage already handles it right). That's a seperate thing that needs EAPI control. You'll need to propose it for EAPI 4 if you want that. -- Ciaran McCreesh signature.asc Description: PGP signature
Re: [gentoo-dev] RFC: Make 10.0 profiles EAPI-2 'compliant'
2009-08-12 20:41:30 Tomáš Chvátal napisał(a): Dne středa 12 Srpen 2009 19:58:05 Jeremy Olexa napsal(a): I am suggesting that the new 10.0 profiles be marked as EAPI-2 compliant. This involves setting the content of the 'eapi' file to 2 and bumping up the required portage version. This seems like progress to me. Often, developers are complaining that they can't use SLOT syntax in profiles (I know that is EAPI-1). Since, the only time we can bump EAPI syntax in profiles is upon a new directory creation, this seems like a good time to me. The new profiles are still in flux until the official stages/cd's are produced. Also, another good reason is: why not? I don't think any Gentoo user can avoid EAPI-2 up til now anyway. Any comments? No comments means it will be decided off-list. Timeframe: 1 week from now. -Jeremy Agreed. This is great idea. Also we should allow the stuff as directory thingus (portage already handles it right). package.mask/koffice-2 package.mask/live-gnome +1. -- Arfrever Frehtes Taifersar Arahesis signature.asc Description: This is a digitally signed message part.
Re: [gentoo-dev] Stats test server running, please check it out
Yannick Chabanois wrote: Not really a problem, I can had gentoo and funtoo trees in gpo.zugaina.org. This will be available very soon ( next week ?) with the new version of the site. All source code of gpo.zugaina.org will be made available in the same time. That's great news! Please keep me up to date about this. And thank you for such a great service. Sebastian
Re: [gentoo-dev] RFC: Make 10.0 profiles EAPI-2 'compliant'
Dne středa 12 Srpen 2009 19:58:05 Jeremy Olexa napsal(a): I am suggesting that the new 10.0 profiles be marked as EAPI-2 compliant. This involves setting the content of the 'eapi' file to 2 and bumping up the required portage version. This seems like progress to me. Often, developers are complaining that they can't use SLOT syntax in profiles (I know that is EAPI-1). Since, the only time we can bump EAPI syntax in profiles is upon a new directory creation, this seems like a good time to me. The new profiles are still in flux until the official stages/cd's are produced. Also, another good reason is: why not? I don't think any Gentoo user can avoid EAPI-2 up til now anyway. Any comments? No comments means it will be decided off-list. Timeframe: 1 week from now. -Jeremy Agreed. This is great idea. Also we should allow the stuff as directory thingus (portage already handles it right). package.mask/koffice-2 package.mask/live-gnome Tomas signature.asc Description: This is a digitally signed message part.
Re: [gentoo-dev] Only 11 bugs left to be fixed in GCC 4.4+/GLIBC 2.10+ trackers. Would be nice to get some help for these.
Samuli Suominen wrote: These bugs would need your attention. About half of them are x86 only software, and I don't have such platform. I've took out all the bugs that are assigned to qa/treecleaners for removal due random reasons. Users help would be nice too. Just attach a patch in the bug and I'll commit them. GCC 4.4+ # 273526 [ga...@gentoo.org] - games-board/hexxagon: fails to build with gcc-4.4. # 277072 [ga...@gentoo.org] - =games-sports/toycars-0.3.10 fails to build with glibc-2.10+. These got fixed by users :-) 9 bugs left. Big thanks to ayoy and vasuvi from #gentoo-kde. -Samuli
Re: [gentoo-dev] mount portage from squashfs
On Wed, Aug 12, 2009 at 05:17:55PM +0200, Francesco R wrote: Proposal, create snapshots of portage as squashfs iso, to be used in place of /usr/portage directory. To all of these suggestions, I'd like to point out that if you're willing to pay the same cost in administration (maintaining a separate filesystem for /usr/portage), then you can have EVERYTHING in the advantages list, and none of the things in the disadvantages list by simply using a small reiserfs space for /usr/portage, with tail-packing enabled. For the rsync.g.o main rotation servers, we actually do that, just RAM-backed to serve files as fast as possible without hitting disk. When you removed bandwidth limitations and disk limitations on the client side, I believe the record time for a emerge --sync that was 24 hours out of date was somewhere around 23 seconds. If you really wanted to get the rsync transfer size down, see what you can do about the 'file list size' section, which is eating up a lot of the download gains with the classical rsync:// sync. -- Robin Hugh Johnson Gentoo Linux Developer Infra Guy E-Mail : robb...@gentoo.org GnuPG FP : 11AC BA4F 4778 E3F6 E4ED F38E B27B 944E 3488 4E85
Re: [gentoo-dev] Stats test server running, please check it out
On Wednesday 12 August 2009, Sebastian Pipping wrote: cvs Missing documentation, but valid, see make.conf.example split-debug This is probably invalid. preserve-libs splitdebug unmerge-logs These are documented in Portage 2.2 make.conf(5). Robert signature.asc Description: This is a digitally signed message part.
Re: [gentoo-dev] Re: gcc-4.4 unmasking soon
Nikos == Nikos Chantziaras rea...@arcor.de writes: Nikos I see that the graphite USE flag is disabled by default. Nikos Are there any known issues with this new optimizer? I haven't found any using it on march=pentium3. It looks like debian has it enabled in their gcc-4.4 packages, and I've not found any problems on deb boxen (32 and 64 bit systems on modern chips) either. The USE flag probably ought to be +. -JimC -- James Cloos cl...@jhcloos.com OpenPGP: 1024D/ED7DAEA6
Re: [gentoo-dev] Re: gcc-4.4 unmasking soon
James Cloos wrote: Nikos I see that the graphite USE flag is disabled by default. Nikos Are there any known issues with this new optimizer? It looks like debian has it enabled in their gcc-4.4 packages, and I've not found any problems on deb boxen (32 and 64 bit systems on modern chips) either. The USE flag probably ought to be +. I'd like to remind that we can't add EAPI's to system pkgs since it would break the upgrading path. If it works well, it should likely go in without USE flag... -Samuli
[gentoo-dev] In memory of Ferris E. McCormick (fmccor): trustee, developer, and friend
All, It is with sadness that we as Trustee's bring forward this news that we have recently received. Ferris Ellsworth McCormick, better known as fmccor, has passed away unexpectedly on the 5th of August. His family does not wish to be contacted. We have expressed our gratitude for his contributions on behalf of the Community. Ferris studied mathematics in college at Indiana University, graduating in 1968 with a Bachelor of Arts. Later he entered into the Law school at the University of Michigan, earning his Juris Doctor degree in 1991. He passed the bar in Michigan that same year and has continued to be an actively certified Lawyer with the State of Michigan since then. He was also a member of the Association for Computing Machinery (ACM). Ferris joined Gentoo on April 16th 2004 as part of the sparc team and improved sparc support for the entire open source community. Within a year he also joined the Developer Relations team to help with mediation of any issues that might come up between people. As time went on Ferris continued to expand and assist Gentoo in many ways including assisting with the User Relations team and growing to become the Strategic Manager of the sparc project. Finally, he became a trustee and the Vice President of the Foundation assisting in getting the foundation back into good standing. While it is too late to say in person, the Foundation would like to thank Ferris once again for all that he did for both Gentoo and the Open source community. He will be missed. Please join the community in eulogizing Ferris in our forums [1]. 1. http://forums.gentoo.org/viewtopic-p-5930501.html -- Robin Hugh Johnson Gentoo Linux: Developer, Trustee Infrastructure Lead E-Mail : robb...@gentoo.org GnuPG FP : 11AC BA4F 4778 E3F6 E4ED F38E B27B 944E 3488 4E85 pgp63Qy7PGAQC.pgp Description: PGP signature
[gentoo-dev] Re: gcc-4.4 unmasking soon
On 08/13/2009 12:39 AM, Samuli Suominen wrote: James Cloos wrote: Nikos I see that the graphite USE flag is disabled by default. Nikos Are there any known issues with this new optimizer? It looks like debian has it enabled in their gcc-4.4 packages, and I've not found any problems on deb boxen (32 and 64 bit systems on modern chips) either. The USE flag probably ought to be +. I'd like to remind that we can't add EAPI's to system pkgs since it would break the upgrading path. If it works well, it should likely go in without USE flag... Or a negating USE flag (nographite for example.)
Re: [gentoo-dev] Stats test server running, please check it out
Robert Buchholz wrote: preserve-libs splitdebug unmerge-logs These are documented in Portage 2.2 make.conf(5). Just updated to make.conf from revision 13844. http://smolt.hartwork.org:45678/static/man/man5/make.conf.5.html My man2tidyhtml wrapper around manServer [1] is now hosted here [2]. An ebuild for manServer is in the pipeline, currently waiting for the next reply from upstream. An ebuild for man2tidyhtml will follow. Sebastian [1] http://www.squarebox.co.uk/users/rolf/download/manServer.shtml [2] http://git.goodpoint.de/?p=man2tidyhtml.git;a=summary
Re: [gentoo-dev] mount portage from squashfs
On Wed, Aug 12, 2009 at 10:51 PM, Robin H. Johnson robb...@gentoo.orgwrote: On Wed, Aug 12, 2009 at 05:17:55PM +0200, Francesco R wrote: Proposal, create snapshots of portage as squashfs iso, to be used in place of /usr/portage directory. To all of these suggestions, I'd like to point out that if you're willing to pay the same cost in administration (maintaining a separate filesystem for /usr/portage), then you can have EVERYTHING in the advantages list, and none of the things in the disadvantages list by simply using a small reiserfs space for /usr/portage, with tail-packing enabled. well squashfs has a pair of advantages over reiserfs, duplicate file detection, compression and a bright future. For the rsync.g.o main rotation servers, we actually do that, just RAM-backed to serve files as fast as possible without hitting disk. only possibility to cope with the load they have I think When you removed bandwidth limitations and disk limitations on the client side, I believe the record time for a emerge --sync that was 24 hours out of date was somewhere around 23 seconds. 23 seconds are ... a lot without bandwidth and disk limitation, disk time for 50 MB is 1 sec (or even much less), and it transfer the whole iso in that time If you really wanted to get the rsync transfer size down, see what you can do about the 'file list size' section, which is eating up a lot of the download gains with the classical rsync:// sync. IMHKnowledge the only way to do this is to have one index file (or files) the file should contain a triple ctime, status and file name (ordered by ctime possibly descending), and provide a cheap way to retrieve the list of files changed in a certain amount of time, status would be needed mainly for deleted files, but it can be modified or added too. Portage already has timestamp in /metadata so that skew of the client clock are not a problem, skew on the server would be. As a side advantage this could be served by an http server, still having rsync as an option. Currently rsync already use the option --whole-file and does only time/size check, if those differ, it downloat the full (little) file. Right ? This would be interesting too, but what happen if the timestamp in the client is too old or absent? fallback to rsync? How much time or how much size would the index file be allowed to grow? P.S. as a http client curl would be more useful than wget because it permit to download more file in one session
[gentoo-dev] Re: gcc-4.4 unmasking soon
On Thu, 13 Aug 2009 00:39:11 +0300 Samuli Suominen ssuomi...@gentoo.org wrote: James Cloos wrote: Nikos I see that the graphite USE flag is disabled by default. Nikos Are there any known issues with this new optimizer? It looks like debian has it enabled in their gcc-4.4 packages, and I've not found any problems on deb boxen (32 and 64 bit systems on modern chips) either. The USE flag probably ought to be +. I'd like to remind that we can't add EAPI's to system pkgs since it would break the upgrading path. If it works well, it should likely go in without USE flag... It's best to keep the number of external packages needed to build the toolchain to a bare minimum. Anything that isn't a hard requirement should be a USE flag. We also need to be able to bootstrap without a C++ compiler, which one of graphite's dependencies (PPL) needs. -- gcc-porting, Character is what you are in the dark. treecleaner, wxwidgets @ gentoo EFFD 380E 047A 4B51 D2BD C64F 8AA8 8346 F9A4 0662 signature.asc Description: PGP signature
[gentoo-dev] Re: RFC: Make 10.0 profiles EAPI-2 'compliant'
On Wed, 12 Aug 2009 19:46:56 +0100 Ciaran McCreesh ciaran.mccre...@googlemail.com wrote: On Wed, 12 Aug 2009 20:41:30 +0200 Tomáš Chvátal scarab...@gentoo.org wrote: Also we should allow the stuff as directory thingus (portage already handles it right). That's a seperate thing that needs EAPI control. You'll need to propose it for EAPI 4 if you want that. Why is that (seriously curious, not disagreeing)? Portage has supported this for quite a while now. Does the current PMS disallow it? What I've really wanted for a long time is different package.mask files for different types of masks. eg. package.mask/broken.mask (qa.mask?) package.mask/removal.mask package.mask/security.mask package.mask/testing.mask etc. If this requires a EAPI change, let me be the first to request it for EAPI 4. ;) -- gcc-porting, Character is what you are in the dark. treecleaner, wxwidgets @ gentoo EFFD 380E 047A 4B51 D2BD C64F 8AA8 8346 F9A4 0662 signature.asc Description: PGP signature
