Re: Processing time spent in IRQ handling and what to do about it
On Wed, 2007-12-19 at 09:58 +0200, Dotan Shavit wrote: On Tuesday 18 December 2007, Oded Arbel wrote: I can see that a lot of time is spent in the hard-IRQ region - sometimes more then all other regions together. Lets look for more hints... - Anything interesting in the logs (during boot and after) ? - Lets plug out all the hardware you can: network , USB, disks... - rmmod all the modules you can. - Boot with a different kernel version. - Nothing yet? Lets play with the BIOS... The logs do not show anything that I don't understand or that I can relate to this problem, and none of the other options are possible as this is a production machine. On a duplicate machine that runs mysql replicated from the first, and doesn't have any load, stopping the mysqld caused the load to fall to almost 0. There were very few hardware interrupts after that (as evident from /proc/interrupts) but there isn't any load so I don't know. -- Oded = To unsubscribe, send mail to [EMAIL PROTECTED] with the word unsubscribe in the message body, e.g., run the command echo unsubscribe | mail [EMAIL PROTECTED]
Re: Processing time spent in IRQ handling and what to do about it
On Wed, 2007-12-19 at 10:34 +0200, Aviv Greenberg wrote: Can you send an output of cat /proc/interrupts ? Is there any device sharing the IRQ line with the network interface? On Tue, 2007-12-18 at 22:14 +0200, Oron Peled wrote: 6. Why guess? watch -n10 -d cat /proc/interrupts /proc/interrupts looks like this: CPU0 CPU1 CPU2 CPU3 0: 2818676796 3045096095 2597715597 3039460137 IO-APIC-edge timer 1: 0 2 0 0 IO-APIC-edge i8042 9: 0 0 0 0 IO-APIC-fasteoi acpi 12: 0 1 1 2 IO-APIC-edge i8042 14:6144547 861135937042 85048 IO-APIC-edge libata 15: 0 0 0 0 IO-APIC-edge libata 16: 1 0 0 1 IO-APIC-fasteoi uhci_hcd:usb1, ehci_hcd:usb6 17:234 13197 11 IO-APIC-fasteoi uhci_hcd:usb2 18: 0 0 0 0 IO-APIC-fasteoi uhci_hcd:usb3 19: 0 0 0 0 IO-APIC-fasteoi uhci_hcd:usb4 22: 24 24 25 23 IO-APIC-fasteoi uhci_hcd:usb5 2289: 426764360 12 153890890 25567190 PCI-MSI-edge eth1 2290: 184062475 14352363 1146094937 36605794 PCI-MSI-edge eth0 2292: 253368176 26799612 221976501 20082294 PCI-MSI-edge cciss0 NMI: 0 0 0 0 LOC: 2910906978 2910907454 2910906845 2910907935 I haven't calculated diffs exactly yet, but on first glance it looks like eth0 interrupts are happening at about 150 a second while cciss0 interrupts are happening at about 20 per second. Also eth0 interrupts happen almost exclusively on one CPI (currently 2 at the moment) and cciss happen on two CPUs (0 and 2). I'm not sure what's up with CPU1 and 3 - is it possible that because these are the 2nd cores on each chip that they don't get as many interrupts ? isn't 'irqbalance' supposed to do something about it ? -- Oded = To unsubscribe, send mail to [EMAIL PROTECTED] with the word unsubscribe in the message body, e.g., run the command echo unsubscribe | mail [EMAIL PROTECTED]
missing /home
I have a strange problem. When I try to login with any user, except for root, I get an error message saying that the userś home directory doesn´t exist. I verified that this is NOT true. All home directories seem to be intact. I GOOGLED and found a suggestion that /etc/passwd could, for some reason, not include the names of the home directories. I verified that /etc/passwd is OK. Does anyone have any suggestions? Since I can get into my system (I don´t want to run as root), I´m sending this from a different system via gmail, so please CC replies to my Gmail account. Shlomo Solomon
Re: missing /home
It seems as if for some reason the /home partition was not mounted when you tried to log it. -- Ori Idan On Dec 20, 2007 9:52 PM, shlomo solomon [EMAIL PROTECTED] wrote: I have a strange problem. When I try to login with any user, except for root, I get an error message saying that the userś home directory doesn´t exist. I verified that this is NOT true. All home directories seem to be intact. I GOOGLED and found a suggestion that /etc/passwd could, for some reason, not include the names of the home directories. I verified that /etc/passwd is OK. Does anyone have any suggestions? Since I can get into my system (I don´t want to run as root), I´m sending this from a different system via gmail, so please CC replies to my Gmail account. Shlomo Solomon -- ספרים וסיפורים שכתבתי: http://www.thestories.org
Re: missing /home
Check the permissions on /home and /home/user. The user must have +x on /home and +rx on /home/user. Try to su to the user and check if you can access its home directory. On 12/20/07, shlomo solomon [EMAIL PROTECTED] wrote: I have a strange problem. When I try to login with any user, except for root, I get an error message saying that the userś home directory doesn´t exist. I verified that this is NOT true. All home directories seem to be intact. I GOOGLED and found a suggestion that /etc/passwd could, for some reason, not include the names of the home directories. I verified that /etc/passwd is OK. Does anyone have any suggestions? Since I can get into my system (I don´t want to run as root), I´m sending this from a different system via gmail, so please CC replies to my Gmail account. Shlomo Solomon
Re: missing /home
No, as I already wrote, all the home directories are OK. I should have specifically written that when I login as root, I can cd to them all. I also tried creating a new user and after verifying that the new user AND home directory were created, I couldn login as the new user either. I have some additional information, but I don´t know what to do about it.. BTW, I don´t know if this is significant, but notice that the timestamp in the log abrubtly jumps back and forth 2 hours. I checked and saw a log entry that ntpd was disabled, but that also seems to be only partialy true, because later on the time jumped back to what it should be. tail -300 syslog | grep kdm Dec 20 22:09:17 shlomo1 kdm_config[4076]: Invalid option value 'All' at /usr/share/config/kdm/kdmrc:52 Dec 20 22:09:39 shlomo1 kdm: :0[4823]: Can't update authorization file in home dir /home/solomon Dec 20 20:09:39 shlomo1 kdm: :0[4823]: Can't create authorization file in /tmp Dec 20 20:09:39 shlomo1 kdm: :0[4823]: Cannot chdir to solomon's home /home/solomon: Permission denied, using / Dec 20 20:09:39 shlomo1 kdm: :0[4823]: Cannot create fallback session log file /tmp/xerr-solomon-:0: Permission denied Dec 20 20:09:39 shlomo1 kdm: :0[4823]: Session /etc/X11/xdm/Xsession execution failed: Permission denied Dec 20 20:09:39 shlomo1 kdm: :0[4823]: Failsafe client /usr/bin/xterm execution failed: Permission denied Dec 20 22:09:41 shlomo1 kdm: :0[4116]: Can't update authorization file in home dir /home/solomon Dec 20 22:18:42 shlomo1 kdm: :0[6222]: Can't update authorization file in home dir /home/solomon Dec 20 20:18:42 shlomo1 kdm: :0[6222]: Can't create authorization file in /tmp Dec 20 20:18:42 shlomo1 kdm: :0[6222]: Cannot chdir to solomon's home /home/solomon: Permission denied, using / Dec 20 20:18:42 shlomo1 kdm: :0[6222]: Cannot create fallback session log file /tmp/xerr-solomon-:0: Permission denied Dec 20 20:18:42 shlomo1 kdm: :0[6222]: Session /etc/X11/xdm/Xsession execution failed: Permission denied Dec 20 20:18:42 shlomo1 kdm: :0[6222]: Failsafe client /usr/bin/xterm execution failed: Permission denied Dec 20 22:18:44 shlomo1 kdm: :0[4924]: Can't update authorization file in home dir /home/solomon On Dec 20, 2007 10:03 PM, Ori Idan [EMAIL PROTECTED] wrote: It seems as if for some reason the /home partition was not mounted when you tried to log it. -- Ori Idan On Dec 20, 2007 9:52 PM, shlomo solomon [EMAIL PROTECTED] wrote: I have a strange problem. When I try to login with any user, except for root, I get an error message saying that the userś home directory doesn´t exist. I verified that this is NOT true. All home directories seem to be intact. I GOOGLED and found a suggestion that /etc/passwd could, for some reason, not include the names of the home directories. I verified that /etc/passwd is OK. Does anyone have any suggestions? Since I can get into my system (I don´t want to run as root), I´m sending this from a different system via gmail, so please CC replies to my Gmail account. Shlomo Solomon -- ספרים וסיפורים שכתבתי: http://www.thestories.org
Re: missing /home
On Dec 20, 2007 10:36 PM, Alon Altman [EMAIL PROTECTED] wrote: Check the permissions on /home and /home/user. The user must have +x on /home and +rx on /home/user. Try to su to the user and check if you can access its home directory. Already tried that - permissons are correct. As far as su, when logged in as root, any attemp to su to another user gets an error message. I´m not sure, but I think the error reffered to insufficient permission. I´ll have to check what was the exact error message. To unsubscribe, send mail to [EMAIL PROTECTED] with the word unsubscribe in the message body, e.g., run the command echo unsubscribe | mail [EMAIL PROTECTED]
Re: missing /home
Even if you can cd to the directories as root does not mean that you can read/write there as user. Please supply the output of ls -la /home (as root). Alon On 12/20/07, shlomo solomon [EMAIL PROTECTED] wrote: No, as I already wrote, all the home directories are OK. I should have specifically written that when I login as root, I can cd to them all. I also tried creating a new user and after verifying that the new user AND home directory were created, I couldn login as the new user either. I have some additional information, but I don´t know what to do about it.. BTW, I don´t know if this is significant, but notice that the timestamp in the log abrubtly jumps back and forth 2 hours. I checked and saw a log entry that ntpd was disabled, but that also seems to be only partialy true, because later on the time jumped back to what it should be. tail -300 syslog | grep kdm Dec 20 22:09:17 shlomo1 kdm_config[4076]: Invalid option value 'All' at /usr/share/config/kdm/kdmrc:52 Dec 20 22:09:39 shlomo1 kdm: :0[4823]: Can't update authorization file in home dir /home/solomon Dec 20 20:09:39 shlomo1 kdm: :0[4823]: Can't create authorization file in /tmp Dec 20 20:09:39 shlomo1 kdm: :0[4823]: Cannot chdir to solomon's home /home/solomon: Permission denied, using / Dec 20 20:09:39 shlomo1 kdm: :0[4823]: Cannot create fallback session log file /tmp/xerr-solomon-:0: Permission denied Dec 20 20:09:39 shlomo1 kdm: :0[4823]: Session /etc/X11/xdm/Xsession execution failed: Permission denied Dec 20 20:09:39 shlomo1 kdm: :0[4823]: Failsafe client /usr/bin/xterm execution failed: Permission denied Dec 20 22:09:41 shlomo1 kdm: :0[4116]: Can't update authorization file in home dir /home/solomon Dec 20 22:18:42 shlomo1 kdm: :0[6222]: Can't update authorization file in home dir /home/solomon Dec 20 20:18:42 shlomo1 kdm: :0[6222]: Can't create authorization file in /tmp Dec 20 20:18:42 shlomo1 kdm: :0[6222]: Cannot chdir to solomon's home /home/solomon: Permission denied, using / Dec 20 20:18:42 shlomo1 kdm: :0[6222]: Cannot create fallback session log file /tmp/xerr-solomon-:0: Permission denied Dec 20 20:18:42 shlomo1 kdm: :0[6222]: Session /etc/X11/xdm/Xsession execution failed: Permission denied Dec 20 20:18:42 shlomo1 kdm: :0[6222]: Failsafe client /usr/bin/xterm execution failed: Permission denied Dec 20 22:18:44 shlomo1 kdm: :0[4924]: Can't update authorization file in home dir /home/solomon On Dec 20, 2007 10:03 PM, Ori Idan [EMAIL PROTECTED] wrote: It seems as if for some reason the /home partition was not mounted when you tried to log it. -- Ori Idan On Dec 20, 2007 9:52 PM, shlomo solomon [EMAIL PROTECTED] wrote: I have a strange problem. When I try to login with any user, except for root, I get an error message saying that the userś home directory doesn´t exist. I verified that this is NOT true. All home directories seem to be intact. I GOOGLED and found a suggestion that /etc/passwd could, for some reason, not include the names of the home directories. I verified that /etc/passwd is OK. Does anyone have any suggestions? Since I can get into my system (I don´t want to run as root), I´m sending this from a different system via gmail, so please CC replies to my Gmail account. Shlomo Solomon -- ספרים וסיפורים שכתבתי: http://www.thestories.org
Re: Processing time spent in IRQ handling and what to do about it
On Thursday, 20 בDecember 2007, Oded Arbel wrote: I haven't calculated diffs exactly yet, but on first glance it looks like eth0 interrupts are happening at about 150 a second while cciss0 interrupts are happening at about 20 per second. Well, ~150 interrupts/seconds is very low interrupt rate and should not cause a significant load *unless* they are doing a heavy work in each interrupt. [as a reference, on a specific device family I work, we use a *minimum* of 1000 interrupts/second even on very low-end hosts. When we connect several devices on a bit stonger hosts (single cpu) we normally get around ~4000 interrupts/second] I still tend to suspect the disk controller although its interrupt rate is really low. Maybe you can test this (run some I/O bound process like 'find /' and see if it affects on the hardware interrupts load in top. If all else fails, than you may want to start using oprofile. Hope it helps, -- Oron Peled Voice/Fax: +972-4-8228492 [EMAIL PROTECTED] http://www.actcom.co.il/~oron ICQ UIN: 16527398 Free software: each person contributes a brick, but ultimately each person receives a house in return. -- Brendan Scott To unsubscribe, send mail to [EMAIL PROTECTED] with the word unsubscribe in the message body, e.g., run the command echo unsubscribe | mail [EMAIL PROTECTED]
Re: missing /home
On Dec 20, 2007 11:01 PM, Alon Altman [EMAIL PROTECTED] wrote: Even if you can cd to the directories as root does not mean that you can read/write there as user. Please supply the output of ls -la /home (as root). Alon At the moment, I´m using a rescue partition on the same box. So I mounted the home partition as /-home. The result of ls -la should be the same as what I get on the real system. BTW - since I´ve only got user solomon set up, all the other users appear only as id 501, 502 etc. But I can assure you that on the real system, they all appear with the proper names. [EMAIL PROTECTED] ~]# ls -la /-home total 8 drwxr-xr-x 13 rootroot 304 Dec 20 22:19 ./ drwxr-xr-x 38 rootroot1000 Dec 20 22:29 ../ drwxr-xr-x 3 506 506 224 Nov 27 2006 kids/ drwxr-xr-x 3 507 507 224 Jul 8 21:10 mypublic/ drwxr-xr-x 29 501 501 1272 May 26 2007 shlomo/ drwxr-xr-x 6 502 502 352 Jun 21 18:21 shoshana/ drwxr-xr-x 90 solomon solomon 6608 Dec 20 20:55 solomon/ drwxr-xr-x 3 508 508 224 Dec 20 22:19 test1/ drwxr-xr-x 5 503 503 304 Jan 5 2007 yael/ drwxr-xr-x 3 505 505 224 Nov 27 2006 yael-yishai/ drwxr-xr-x 3 504 504 224 Nov 27 2006 yishai/ [EMAIL PROTECTED] ~]# To unsubscribe, send mail to [EMAIL PROTECTED] with the word unsubscribe in the message body, e.g., run the command echo unsubscribe | mail [EMAIL PROTECTED]
yjobs.co.il-for-Mozilla Filter
Hi all! Well, this is also a way to make sites compatible with Firefox and other Mozilla-based browsers. :-) If you are job hunting and want to use http://www.yjobs.co.il/ and would prefer to use Firefox, then look no further than: http://www.shlomifish.org/open-source/projects/yjobs-on-mozilla/ Download and read the instructions at the top. Open-sourced under the MIT-X11 licence, but the script contains some JavaScript code that appeared on yjobs.co.il and was modified. Happy Job Hunting! Regards, Shlomi Fish - Shlomi Fish [EMAIL PROTECTED] Homepage:http://www.shlomifish.org/ I'm not an actor - I just play one on T.V. = To unsubscribe, send mail to [EMAIL PROTECTED] with the word unsubscribe in the message body, e.g., run the command echo unsubscribe | mail [EMAIL PROTECTED]
Re: missing /home
Another reason kde could fail to write is lack of disk space. Is /home full or close to full? Alon On 12/20/07, shlomo solomon [EMAIL PROTECTED] wrote: On Dec 20, 2007 11:01 PM, Alon Altman [EMAIL PROTECTED] wrote: Even if you can cd to the directories as root does not mean that you can read/write there as user. Please supply the output of ls -la /home (as root). Alon At the moment, I´m using a rescue partition on the same box. So I mounted the home partition as /-home. The result of ls -la should be the same as what I get on the real system. BTW - since I´ve only got user solomon set up, all the other users appear only as id 501, 502 etc. But I can assure you that on the real system, they all appear with the proper names. [EMAIL PROTECTED] ~]# ls -la /-home total 8 drwxr-xr-x 13 rootroot 304 Dec 20 22:19 ./ drwxr-xr-x 38 rootroot1000 Dec 20 22:29 ../ drwxr-xr-x 3 506 506 224 Nov 27 2006 kids/ drwxr-xr-x 3 507 507 224 Jul 8 21:10 mypublic/ drwxr-xr-x 29 501 501 1272 May 26 2007 shlomo/ drwxr-xr-x 6 502 502 352 Jun 21 18:21 shoshana/ drwxr-xr-x 90 solomon solomon 6608 Dec 20 20:55 solomon/ drwxr-xr-x 3 508 508 224 Dec 20 22:19 test1/ drwxr-xr-x 5 503 503 304 Jan 5 2007 yael/ drwxr-xr-x 3 505 505 224 Nov 27 2006 yael-yishai/ drwxr-xr-x 3 504 504 224 Nov 27 2006 yishai/ [EMAIL PROTECTED] ~]# To unsubscribe, send mail to [EMAIL PROTECTED] with the word unsubscribe in the message body, e.g., run the command echo unsubscribe | mail [EMAIL PROTECTED]
Re: missing /home
On 12/20/07, shlomo solomon [EMAIL PROTECTED] wrote: On Dec 20, 2007 11:01 PM, Alon Altman [EMAIL PROTECTED] wrote: Even if you can cd to the directories as root does not mean that you can read/write there as user. Please supply the output of ls -la /home (as root). Alon At the moment, I´m using a rescue partition on the same box. So I mounted the home partition as /-home. The result of ls -la should be the same as what I get on the real system. BTW - since I´ve only got user solomon set up, all the other users appear only as id 501, 502 etc. But I can assure you that on the real system, they all appear with the proper names. [EMAIL PROTECTED] ~]# ls -la /-home total 8 drwxr-xr-x 13 rootroot 304 Dec 20 22:19 ./ drwxr-xr-x 38 rootroot1000 Dec 20 22:29 ../ drwxr-xr-x 3 506 506 224 Nov 27 2006 kids/ drwxr-xr-x 3 507 507 224 Jul 8 21:10 mypublic/ drwxr-xr-x 29 501 501 1272 May 26 2007 shlomo/ drwxr-xr-x 6 502 502 352 Jun 21 18:21 shoshana/ drwxr-xr-x 90 solomon solomon 6608 Dec 20 20:55 solomon/ drwxr-xr-x 3 508 508 224 Dec 20 22:19 test1/ drwxr-xr-x 5 503 503 304 Jan 5 2007 yael/ drwxr-xr-x 3 505 505 224 Nov 27 2006 yael-yishai/ drwxr-xr-x 3 504 504 224 Nov 27 2006 yishai/ [EMAIL PROTECTED] ~]# To unsubscribe, send mail to [EMAIL PROTECTED] with the word unsubscribe in the message body, e.g., run the command echo unsubscribe | mail [EMAIL PROTECTED]
Re: yjobs.co.il-for-Mozilla Filter
On 20/12/2007, Shlomi Fish [EMAIL PROTECTED] wrote: Hi all! Well, this is also a way to make sites compatible with Firefox and other Mozilla-based browsers. :-) If you are job hunting and want to use http://www.yjobs.co.il/ and would prefer to use Firefox, then look no further than: http://www.shlomifish.org/open-source/projects/yjobs-on-mozilla/ Download and read the instructions at the top. Open-sourced under the MIT-X11 licence, but the script contains some JavaScript code that appeared on yjobs.co.il and was modified. Happy Job Hunting! Regards, Shlomi Fish And don't forget to write to the owners of these sites and to tell them that they need to support Firefox. If anyone will send to me the address of a non-compatible site and details of the error, I'll gladly confirm the error and write to the webmaster. Dotan Cohen http://what-is-what.com http://gibberish.co.il א-ב-ג-ד-ה-ו-ז-ח-ט-י-ך-כ-ל-ם-מ-ן-נ-ס-ע-ף-פ-ץ-צ-ק-ר-ש-ת A: Because it messes up the order in which people normally read text. Q: Why is top-posting such a bad thing?
Re: Processing time spent in IRQ handling and what to do about it
And my word to this never ending story: You may use get_cycles (http://lxr.linux.no/linux/include/asm-i386/tsc.h#L19) to measure time (cycles) in interrupts. Read more here: http://www.linuxdriver.co.il/ldd3/linuxdrive3-CHP-7-SECT-1.html -- Constantine Shulyupin Freelance Embedded Linux Engineer 054-4234440 http://www.linuxdriver.co.il/ = To unsubscribe, send mail to [EMAIL PROTECTED] with the word unsubscribe in the message body, e.g., run the command echo unsubscribe | mail [EMAIL PROTECTED]
Re: missing /home
On Dec 20, 2007 11:36 PM, Alon Altman [EMAIL PROTECTED] wrote: Another reason kde could fail to write is lack of disk space. Is /home full or close to full? No - over 20 Gb free on /home. BTW - itś not a KDE problem. I can login from a console (Ctl-Alt-1) either.
Re: missing /home
On Dec 20, 2007 11:50 PM, shlomo solomon [EMAIL PROTECTED] wrote: On Dec 20, 2007 11:36 PM, Alon Altman [EMAIL PROTECTED] wrote: Another reason kde could fail to write is lack of disk space. Is /home full or close to full? No - over 20 Gb free on /home. BTW - itś not a KDE problem. I can login from a console (Ctl-Alt-1) either. OOPS - a typo - that should be: BTW - itś not a KDE problem. I can´t login from a console (Ctl-Alt-1) either.
Re: missing /home
When checking for free disk space, check also inodes (by df -i). According to past experience, when a partition runs out of inodes, sometimes the system manages to continue to work and erratically fail (when processes need to create new files without deleting others beforehand). Another shot in the dark: which filesystem are you using on home - ext2, ext3, reiserfs, ... ? --- Omer On Thu, 2007-12-20 at 23:50 +0200, shlomo solomon wrote: On Dec 20, 2007 11:36 PM, Alon Altman [EMAIL PROTECTED] wrote: Another reason kde could fail to write is lack of disk space. Is /home full or close to full? No - over 20 Gb free on /home. BTW - it¶ not a KDE problem. I can login from a console (Ctl-Alt-1) either. -- One does not make peace with enemies. One makes peace with former enemies. My own blog is at http://www.zak.co.il/tddpirate/ My opinions, as expressed in this E-mail message, are mine alone. They do not represent the official policy of any organization with which I may be affiliated in any way. WARNING TO SPAMMERS: at http://www.zak.co.il/spamwarning.html To unsubscribe, send mail to [EMAIL PROTECTED] with the word unsubscribe in the message body, e.g., run the command echo unsubscribe | mail [EMAIL PROTECTED]
boot messages
When I boot, I see hundreds of messages flying off the screen faster than I can read them - some of them error messages. Alot, BUT NOT ALL, of the messages can be seen with dmesg, but there are many messages that I can´t see there or in the logs (unless, of course there are additional logs I haven´t checked). This is probably related to my previous, unsolved issue aboout not being able to login, because I´m pretty sure that in the past I didn´t see error messages during boot. Can anyone suggest how to slow down the messages and/or capture them into a file I can see after booting. In case I didn mention it earlier, my system is Mandriva 2007.0 with all upgrades.. To unsubscribe, send mail to [EMAIL PROTECTED] with the word unsubscribe in the message body, e.g., run the command echo unsubscribe | mail [EMAIL PROTECTED]
