[gentoo-user] impolite emerge
It seems that emerge can be rather impolite at times. [ebuild I FU ] app-emulation/vmware-workstation-6.5.3.185404 ;-) -- Keith Dart -- -- ~ Keith Dart ke...@dartworks.biz public key: ID: 19017044 http://www.dartworks.biz/ =
[gentoo-user] problem filtering portage messages...
Hi, I have a log-server (syslog-ng) collecting logs from my servers. Everything works for standard logs: clients forward them to server where they are filtered (based on facility or application) and splitted into a few files (for each client). The problem is with portage logs: I can not find any pattern I could use to filter them out. For example, this is small part of /var/log/emerge.log: 1250923552: *** emerge sync 1250923552: === sync 1250923552: Starting rsync with rsync://140.211.166.165/gentoo-portage 1250923665: === Sync completed with rsync://140.211.166.165/gentoo-portage 1250923666: *** terminating. 1250923760: Started emerge on: Aug 22, 2009 06:49:20 1250923760: *** emerge depclean 1250923760: depclean ... Can I somehow force portage to write all its logs (summary.log, emerge-fetch.log, emerge.log) in standard syslog format RFC-3164? I mean with all that stuff like priority (facility), header (timestamp, hostname), application, etc. Even better if portage could write its logs to /dev/log... Jarry -- ___ This mailbox accepts e-mails only from selected mailing-lists! Everything else is considered to be spam and therefore deleted.
Re: [gentoo-user] problem filtering portage messages...
On Sat, 2009-08-22 at 10:39 +0200, Jarry wrote: Hi, I have a log-server (syslog-ng) collecting logs from my servers. Everything works for standard logs: clients forward them to server where they are filtered (based on facility or application) and splitted into a few files (for each client). The problem is with portage logs: I can not find any pattern I could use to filter them out. For example, this is small part of /var/log/emerge.log: 1250923552: *** emerge sync 1250923552: === sync 1250923552: Starting rsync with rsync://140.211.166.165/gentoo-portage 1250923665: === Sync completed with rsync://140.211.166.165/gentoo-portage 1250923666: *** terminating. 1250923760: Started emerge on: Aug 22, 2009 06:49:20 1250923760: *** emerge depclean 1250923760: depclean ... Can I somehow force portage to write all its logs (summary.log, emerge-fetch.log, emerge.log) in standard syslog format RFC-3164? I mean with all that stuff like priority (facility), header (timestamp, hostname), application, etc. Even better if portage could write its logs to /dev/log... Portage doesn't use syslog format (that's why it doesn't log to syslog ;) There is the portrage elog system but's kinda a misnomer (maybe should be called portage message system). You can change PORTAGE_ELOG_SYSTEM=syslog but it won't do what you are expecting. I'm not sure what you are trying to filter out. Portage logs are relatively machine-readable (e.g. qlop). If you don't mind getting your hands dirty, portage is written mostly in python and bash so it shouldn't be that difficult to dig into the parts that handle emerge.log and emerge-fetch.log and convert them to syslog. -a
Re: [gentoo-user] problem filtering portage messages...
Albert Hopkins wrote: On Sat, 2009-08-22 at 10:39 +0200, Jarry wrote: The problem is with portage logs: I can not find any pattern I could use to filter them out. I'm not sure what you are trying to filter out. Portage logs are relatively machine-readable (e.g. qlop). syslog-ng in client mode does not open new connection for every source (be it /dev/log, /proc/kmsg/, /var/log/messages, etc.). Instead of that, it opens only one connection and pumps logs to server in one stream. It is a log-server's job to split it out. The first quite natural filter-rule is to split logs according to client-IP (or hostname). The second level is to split logs according to application. I do not want to have logs from kernel, sshd, apache, ntp, portage, ftp, dns, mixed together in one file. And that is a problem. I can easily identify logs from i.e. sshd: 2009-08-22T10:54:30+00:00 obelix sshd[6984]: Accepted... Simply I use filter sshd* for the 3rd field (application name). Or in case of ntpd-logs I put filter for ntpd*: 2009-08-22T10:54:48+00:00 nitino ntpd[4421]: synchronized... But what do I have to do with this: 1250867551: *** Finished. Cleaning up... or: 1250867528: === Sync completed How can a log-server indentify it as portage-log so that it could save it into /var/log/$HOST/emerge.log? If you don't mind getting your hands dirty, portage is written mostly in python and bash so it shouldn't be that difficult to dig into the parts that handle emerge.log and emerge-fetch.log and convert them to syslog. Well, I'm affraid this is beyond my skill. I've looked at those scripts, but they seem to me to be really complicated... Jarry -- ___ This mailbox accepts e-mails only from selected mailing-lists! Everything else is considered to be spam and therefore deleted.
Re: [gentoo-user] problem filtering portage messages...
On Saturday 22 August 2009 13:25:12 Jarry wrote: The first quite natural filter-rule is to split logs according to client-IP (or hostname). The second level is to split logs according to application. I do not want to have logs from kernel, sshd, apache, ntp, portage, ftp, dns, mixed together in one file. The solution is quite obvious: portage does not do what you want. So, either you or someone else, must add a feature so that it can do what you want. File a bug request. -- alan dot mckinnon at gmail dot com
Re: [gentoo-user] problem filtering portage messages...
On Saturday 22 August 2009, Jarry wrote:
Hi,
I have a log-server (syslog-ng) collecting logs from my servers.
Everything works for standard logs: clients forward them to server
where they are filtered (based on facility or application) and
splitted into a few files (for each client).
The problem is with portage logs: I can not find any pattern
I could use to filter them out. For example, this is small part
of /var/log/emerge.log:
1250923552: *** emerge sync
1250923552: === sync
1250923552: Starting rsync with rsync://140.211.166.165/gentoo-portage
1250923665: === Sync completed with rsync://140.211.166.165/gentoo-portage
1250923666: *** terminating.
1250923760: Started emerge on: Aug 22, 2009 06:49:20
1250923760: *** emerge depclean
1250923760: depclean
...
Can I somehow force portage to write all its logs (summary.log,
emerge-fetch.log, emerge.log) in standard syslog format RFC-3164?
I mean with all that stuff like priority (facility), header
(timestamp, hostname), application, etc. Even better if portage
could write its logs to /dev/log...
This came up on the Gentoo portage forum recently. What I do is this:
1. In /etc/conf.d/local.start add a line
tail -F /var/log/emerge.log | awk '{$1=;print | logger -t emerge -p
local5.info}'
2. In /etc/syslog-ng/syslog-ng.conf add lines to the effect of:
destination emerge { file(/var/log/emerge); };
filter f_emerge { program(emerge); };
filter f_messages { level(info..emerg)
and not facility(auth, authpriv, mail, news, cron, local0, local6)
and not program(emerge); };
log { source(src); filter(f_emerge); destination(emerge); };
Restart syslog-ng and there you go. :)
HTH
-Robin
--
--
Robin Atwood.
Ship me somewheres east of Suez, where the best is like the worst,
Where there ain't no Ten Commandments an' a man can raise a thirst
from Mandalay by Rudyard Kipling
--
Re: [gentoo-user] problem filtering portage messages...
Robin Atwood wrote:
1. In /etc/conf.d/local.start add a line
tail -F /var/log/emerge.log | awk '{$1=;print | logger -t emerge -p
local5.info}'
Thanks. First I'll try to figure out what this line actually means! :-)
Jarry
--
___
This mailbox accepts e-mails only from selected mailing-lists!
Everything else is considered to be spam and therefore deleted.
Re: [gentoo-user] problem filtering portage messages...
On Saturday 22 August 2009, Jarry wrote:
Robin Atwood wrote:
1. In /etc/conf.d/local.start add a line
tail -F /var/log/emerge.log | awk '{$1=;print | logger -t emerge -p
local5.info}'
Thanks. First I'll try to figure out what this line actually means! :-)
This was devised by Mike Hunt on the Portage forum (see
http://forums.gentoo.org/viewtopic-t-788086-highlight-.html). It tails the
default emerge log into an awk stage which deletes the Unix time stamp, and
then logs the records into the standard syslog with the priority set to
facility local5 and level info; these can be whatever works for you.
-Robin
--
--
Robin Atwood.
Ship me somewheres east of Suez, where the best is like the worst,
Where there ain't no Ten Commandments an' a man can raise a thirst
from Mandalay by Rudyard Kipling
--
[gentoo-user] Announcement: KrcStat 0.6 available for KDE 4.2+
From the gratuitous self-publicising department: My GUI replacement for rc-update/rc-show is now available for KDE 4.3. You can find it at http://kde-apps.org/content/show.php/KrcStat?content=110734. Previous releases did not attract much attention because, I guess, there are not too many Gentoo users checking kde-apps.org, so I have announced it here. It should work with both baselayout 1 and 2. Enjoy! -Robin -- -- Robin Atwood. Ship me somewheres east of Suez, where the best is like the worst, Where there ain't no Ten Commandments an' a man can raise a thirst from Mandalay by Rudyard Kipling --
[gentoo-user] Re: Announcement: KrcStat 0.6 available for KDE 4.2+
On 08/22/2009 05:09 PM, Robin Atwood wrote: From the gratuitous self-publicising department: My GUI replacement for rc-update/rc-show is now available for KDE 4.3. You can find it at http://kde-apps.org/content/show.php/KrcStat?content=110734. Previous releases did not attract much attention because, I guess, there are not too many Gentoo users checking kde-apps.org [...] Well, submitting an ebuild to bugzilla would be a good idea. If it won't make it to portage at first, you should be able to put it in sunrise. That's the place you need to go, not kde-apps.org.
Re: [gentoo-user] Re: Announcement: KrcStat 0.6 available for KDE 4.2+
On Samstag 22 August 2009, Nikos Chantziaras wrote: On 08/22/2009 05:09 PM, Robin Atwood wrote: From the gratuitous self-publicising department: My GUI replacement for rc-update/rc-show is now available for KDE 4.3. You can find it at http://kde-apps.org/content/show.php/KrcStat?content=110734. Previous releases did not attract much attention because, I guess, there are not too many Gentoo users checking kde-apps.org [...] Well, submitting an ebuild to bugzilla would be a good idea. If it won't make it to portage at first, you should be able to put it in sunrise. That's the place you need to go, not kde-apps.org. kde-apps.org is ok - not everybody checks out sunrise regularly or searches biugzilla for new stuff. That said, bugzilla AND kde-apps.org now that is a good idea ;)
[gentoo-user] Re: Announcement: KrcStat 0.6 available for KDE 4.2+
On 08/22/2009 05:24 PM, Volker Armin Hemmann wrote: On Samstag 22 August 2009, Nikos Chantziaras wrote: On 08/22/2009 05:09 PM, Robin Atwood wrote: From the gratuitous self-publicising department: My GUI replacement for rc-update/rc-show is now available for KDE 4.3. You can find it at http://kde-apps.org/content/show.php/KrcStat?content=110734. Previous releases did not attract much attention because, I guess, there are not too many Gentoo users checking kde-apps.org [...] Well, submitting an ebuild to bugzilla would be a good idea. If it won't make it to portage at first, you should be able to put it in sunrise. That's the place you need to go, not kde-apps.org. kde-apps.org is ok - not everybody checks out sunrise regularly or searches biugzilla for new stuff. That said, bugzilla AND kde-apps.org now that is a good idea ;) There's no kde-apps overlay, so emerge krcstat won't work ;) It's a Gentoo app, so it has to be in a Gentoo overlay. Keeping track of out of tree apps is painful; the fewer I need to deal with, the better.
Re: [gentoo-user] Re: Announcement: KrcStat 0.6 available for KDE 4.2+
On Saturday 22 August 2009, Volker Armin Hemmann wrote: On Samstag 22 August 2009, Nikos Chantziaras wrote: On 08/22/2009 05:09 PM, Robin Atwood wrote: From the gratuitous self-publicising department: My GUI replacement for rc-update/rc-show is now available for KDE 4.3. You can find it at http://kde-apps.org/content/show.php/KrcStat?content=110734. Previous releases did not attract much attention because, I guess, there are not too many Gentoo users checking kde-apps.org [...] Well, submitting an ebuild to bugzilla would be a good idea. If it won't make it to portage at first, you should be able to put it in sunrise. That's the place you need to go, not kde-apps.org. kde-apps.org is ok - not everybody checks out sunrise regularly or searches biugzilla for new stuff. That said, bugzilla AND kde-apps.org now that is a good idea ;) OK! http://bugs.gentoo.org/show_bug.cgi?id=282310 -- -- Robin Atwood. Ship me somewheres east of Suez, where the best is like the worst, Where there ain't no Ten Commandments an' a man can raise a thirst from Mandalay by Rudyard Kipling --
Re: [gentoo-user] impolite emerge
On Sat, Aug 22, 2009 at 3:11 AM, Keith Dartke...@dartworks.biz wrote: It seems that emerge can be rather impolite at times. [ebuild I FU ] app-emulation/vmware-workstation-6.5.3.185404 ;-) Given the hours and hours of headaches I have suffered trying to install VMWare Workstation, FU seems about right :)
RE: [gentoo-user] Re: May be OT: recommended niceness settings for Portage while using Gnome?
-Original Message-
From: news [mailto:n...@ger.gmane.org] On Behalf Of Nikos Chantziaras
Sent: August 21, 2009 1:50 PM
To: gentoo-user@lists.gentoo.org
Subject: [gentoo-user] Re: May be OT: recommended niceness settings for
Portage while using Gnome?
On 08/21/2009 07:54 PM, James Homuth wrote:
I just got Gnome set up completely on a 5-year-old laptop with 512 MB
of RAM running on a P4, and am sort of halfway in the middle of
playing with it. In the process, I'm discovering I still need to
install a few things. Just one problem. I emerge said things, and the
system flatlines until such time as the compilation(s) are done--load
is currently sitting at 2.1+. Are there any make.conf settings I can
tweak so that I can still actually use the system while things
compile, or would I be better off setting things to compile, throwing
in a movie, and coming back when they're done? Thanks for any pointers.
Not sure if something changed in recent kernels, but 19 used to be the most
efficient value since processes running at 19 are considered batch jobs.
They get plenty of CPU time due to longer time-slices (responsiveness
suffers, but you don't care about portage being responsive in the first
place, so it's optimal.) So:
PORTAGE_NICENESS=19
Is best. However, also very important is I/O nice. Setting an ionice
value of idle will result in portage not blocking your other applications
whey they need to do disk I/O:
PORTAGE_IONICE_COMMAND=ionice -c 3 -p \${PID}
This needs a kernel newer than 2.6.16 and it has to be configured to use the
CFQ scheduler. You know if that's the case if this command:
zgrep CFQ /proc/config.gz
says:
CONFIG_IOSCHED_CFQ=y
CONFIG_DEFAULT_CFQ=y
It does not. I was thinking about upgrading to 2.6.30 anyway, so which
switch would I throw to enable it?
[gentoo-user] Opinions on -fstack-protector
Hi list! I'm wondering what you think about CFLAGS=-fstack-protector? Do you use it on security critical systems? Do you compile your kernel with it (2.6.30+)? Is the performance decrease noticeable? Thanks in advance! Florian Philipp signature.asc Description: OpenPGP digital signature
[gentoo-user] flip video on gentoo
I have received a flip video, ultra series (records 60 minutes) digital camcorder for a present. This works fine on windows, but I would naturally much prefer to use gentoo. The windows software can presumably do a bunch of stuff but I would be very happy to simply * Copy video from the camera to the computer. * Show, on the computer, video that has been copied on to the computer. * Delete video from the computer. I am reasonably experienced with gentoo, quite experienced with linux, but a complete novice with digital video. A google search suggests strongly that there is support on gentoo, but I have yet to find a HOWTO and would greatly appreciate a pointer. thanks, allan
[gentoo-user] Re: flip video on gentoo
Allan Gottlieb wrote: I have received a flip video, ultra series (records 60 minutes) digital camcorder for a present. This works fine on windows, but I would naturally much prefer to use gentoo. The windows software can presumably do a bunch of stuff but I would be very happy to simply * Copy video from the camera to the computer. * Show, on the computer, video that has been copied on to the computer. * Delete video from the computer. I am reasonably experienced with gentoo, quite experienced with linux, but a complete novice with digital video. A google search suggests strongly that there is support on gentoo, but I have yet to find a HOWTO and would greatly appreciate a pointer. thanks, allan The Flip Video Ultra works great in linux. The device is mounted as a USB mass storage device. The videos are avi files encoded in mpeg4. Just drag and drop. Use Totem or mplayer to play. Very nice. http://jamesguske.blogspot.com/2007/10/flip-video-ultra-works-in-ubuntu.html Once you copy your files to HD, I'd guess that linux video editing software will do anything windows can do. :-) HTH
Re: [gentoo-user] Re: May be OT: recommended niceness settings for Portage while using Gnome?
On Sat, Aug 22, 2009 at 12:06 PM, James Homuthja...@the-jdh.com wrote: CONFIG_IOSCHED_CFQ=y CONFIG_DEFAULT_CFQ=y It does not. I was thinking about upgrading to 2.6.30 anyway, so which switch would I throw to enable it? In menuconfig: Enable the block layer - IO Schedulers -- CFQ I/O Scheduler -- Default IO Scheduler (CFQ)
Re: [gentoo-user] Re: flip video on gentoo
On 23 Aug 2009, at 02:12, 7v5w7go9ub0o wrote: ... Once you copy your files to HD, I'd guess that linux video editing software will do anything windows can do. :-) LOL!
