On Sun 2017-01-15, Florian Siegesmund <[email protected]> wrote:
> On Sun 2017-01-15, Ben Hutchings <[email protected]> wrote:
>> On Sun, 2017-01-15 at 11:05 +0100, Florian Siegesmund wrote:
> 
>>> Package: src:linux
>>> Version: 4.8.15-2
>>> Severity: critical
>>> Tags: upstream
>>> Justification: breaks the whole system

[...]

>> Linux 4.9 is said to have better OOM behaviour and is now available in
>> unstable.  Can you test whether it works better on this system?
> 
> We will see:
> 
> HOSTNAME:~# uname -a ; uptime
> Linux kyrrdis 4.9.0-1-686-pae #1 SMP Debian 4.9.2-2 (2017-01-12) i686 
> GNU/Linux
>  22:35:41 up 10:53,  2 users,  load average: 0.28, 0.11, 0.04
> HOSTNAME:~#

Looks better on first sight, but not good (still one major kill):

LOGHOST:~ # egrep '(HOSTNAME|LXCONTAINER).*kernel' /var/log/syslog
Jan 16 02:06:28 LXCONTAINER kernel: [51885.810272] perf: interrupt took too 
long (4940 > 4937), lowering kernel.perf_event_max_sample_rate to 40250
Jan 16 02:14:20 LXCONTAINER kernel: [52357.447647] find invoked oom-killer: 
gfp_mask=0x2420848(GFP_NOFS|__GFP_NOFAIL|__GFP_HARDWALL|__GFP_MOVABLE), 
nodemask=0, order=0, oom_score_adj=0
Jan 16 02:14:20 LXCONTAINER kernel: [52357.447652] find cpuset=/ mems_allowed=0
Jan 16 02:14:20 LXCONTAINER kernel: [52357.447660] CPU: 0 PID: 4949 Comm: find 
Not tainted 4.9.0-1-686-pae #1 Debian 4.9.2-2
Jan 16 02:14:20 LXCONTAINER kernel: [52357.447661] Hardware name: 
Hewlett-Packard HP dx5150 MT(PE679AV)/09AC, BIOS 1.09 11/22/2005
Jan 16 02:14:20 LXCONTAINER kernel: [52357.447663]  c16c5b38 db2f17c2 c16c5c30 
f1b312c0 db1d4dd0 00000000 00000206 00000206
Jan 16 02:14:20 LXCONTAINER kernel: [52357.447669]  db2f788f c16c5b3c ef30d0c0 
ef256000 f1b317b0 c16c5c30 f1b312c0 c16c5b7c
Jan 16 02:14:20 LXCONTAINER kernel: [52357.447673]  db16bec1 db070e8a c16c5b68 
db16bb27 00000003 00000000 00000000 0000000e
Jan 16 02:14:20 LXCONTAINER kernel: [52357.447677] Call Trace:
Jan 16 02:14:20 LXCONTAINER kernel: [52357.447688]  [<db2f17c2>] ? 
dump_stack+0x55/0x73
Jan 16 02:14:20 LXCONTAINER kernel: [52357.447693]  [<db1d4dd0>] ? 
dump_header+0x64/0x1ab
Jan 16 02:14:20 LXCONTAINER kernel: [52357.447697]  [<db2f788f>] ? 
___ratelimit+0x9f/0x100
Jan 16 02:14:20 LXCONTAINER kernel: [52357.447700]  [<db16bec1>] ? 
oom_kill_process+0x221/0x3e0
Jan 16 02:14:20 LXCONTAINER kernel: [52357.447704]  [<db070e8a>] ? 
has_capability_noaudit+0x1a/0x30
Jan 16 02:14:20 LXCONTAINER kernel: [52357.447706]  [<db16bb27>] ? 
oom_badness.part.13+0xd7/0x150
Jan 16 02:14:20 LXCONTAINER kernel: [52357.447709]  [<db16c374>] ? 
out_of_memory+0xe4/0x290
Jan 16 02:14:20 LXCONTAINER kernel: [52357.447711]  [<db170905>] ? 
__alloc_pages_nodemask+0xbe5/0xca0
Jan 16 02:14:20 LXCONTAINER kernel: [52357.447717]  [<db167fea>] ? 
pagecache_get_page+0xba/0x270
Jan 16 02:14:20 LXCONTAINER kernel: [52357.447721]  [<db20dc89>] ? 
__getblk_gfp+0x109/0x310
Jan 16 02:14:20 LXCONTAINER kernel: [52357.447724]  [<db1bb31d>] ? 
fixup_slab_list.isra.48+0x4d/0x70
Jan 16 02:14:20 LXCONTAINER kernel: [52357.447727]  [<db20e8ee>] ? 
__bread_gfp+0x1e/0x100
Jan 16 02:14:20 LXCONTAINER kernel: [52357.447735]  [<f9c8bfa4>] ? 
udf_tread+0x44/0x50 [udf]
Jan 16 02:14:20 LXCONTAINER kernel: [52357.447739]  [<f9c8c294>] ? 
udf_read_tagged+0x24/0x140 [udf]
Jan 16 02:14:20 LXCONTAINER kernel: [52357.447743]  [<db1f3372>] ? 
inode_sb_list_add+0x32/0x50
Jan 16 02:14:20 LXCONTAINER kernel: [52357.447747]  [<f9c8063e>] ? 
__udf_iget+0x16e/0xa40 [udf]
Jan 16 02:14:20 LXCONTAINER kernel: [52357.447752]  [<f9c84eb9>] ? 
udf_lookup+0xa9/0xd0 [udf]
Jan 16 02:14:20 LXCONTAINER kernel: [52357.447754]  [<db1e40ec>] ? 
lookup_slow+0x7c/0x140
Jan 16 02:14:20 LXCONTAINER kernel: [52357.447756]  [<db1e4784>] ? 
walk_component+0x1e4/0x300
Jan 16 02:14:20 LXCONTAINER kernel: [52357.447760]  [<db1e2d5d>] ? 
path_init+0x14d/0x330
Jan 16 02:14:20 LXCONTAINER kernel: [52357.447762]  [<db1e582b>] ? 
path_lookupat+0x5b/0x110
Jan 16 02:14:20 LXCONTAINER kernel: [52357.447764]  [<db1e7e83>] ? 
filename_lookup+0xd3/0x190
Jan 16 02:14:20 LXCONTAINER kernel: [52357.447766]  [<db1e7e49>] ? 
filename_lookup+0x99/0x190
Jan 16 02:14:20 LXCONTAINER kernel: [52357.447769]  [<db1d4ced>] ? 
__check_object_size+0x9d/0x11c
Jan 16 02:14:20 LXCONTAINER kernel: [52357.447773]  [<db322799>] ? 
strncpy_from_user+0x39/0x140
Jan 16 02:14:20 LXCONTAINER kernel: [52357.447775]  [<db1e7aa5>] ? 
getname_flags+0x55/0x1a0
Jan 16 02:14:20 LXCONTAINER kernel: [52357.447778]  [<db1dd450>] ? 
vfs_fstatat+0x60/0xb0
Jan 16 02:14:20 LXCONTAINER kernel: [52357.447780]  [<db1ddf0a>] ? 
SyS_fstatat64+0x2a/0x50
Jan 16 02:14:20 LXCONTAINER kernel: [52357.447784]  [<db0036fa>] ? 
do_fast_syscall_32+0x8a/0x150
Jan 16 02:14:20 LXCONTAINER kernel: [52357.447788]  [<db59d98a>] ? 
sysenter_past_esp+0x47/0x75
Jan 16 02:14:20 LXCONTAINER kernel: [52357.447790] Mem-Info:
Jan 16 02:14:20 LXCONTAINER kernel: [52357.447796] active_anon:14770 
inactive_anon:22166 isolated_anon:0
Jan 16 02:14:20 LXCONTAINER kernel: [52357.447796]  active_file:179810 
inactive_file:399831 isolated_file:0
Jan 16 02:14:20 LXCONTAINER kernel: [52357.447796]  unevictable:1825 dirty:0 
writeback:0 unstable:0
Jan 16 02:14:20 LXCONTAINER kernel: [52357.447796]  slab_reclaimable:32628 
slab_unreclaimable:71435
Jan 16 02:14:20 LXCONTAINER kernel: [52357.447796]  mapped:26191 shmem:10602 
pagetables:807 bounce:0
Jan 16 02:14:20 LXCONTAINER kernel: [52357.447796]  free:28495 free_pcp:97 
free_cma:0
Jan 16 02:14:20 LXCONTAINER kernel: [52357.447802] Node 0 active_anon:59080kB 
inactive_anon:88664kB active_file:719240kB inactive_file:1599324kB 
unevictable:7300kB isolated(anon):0kB isolated(file):0kB mapped:104764kB 
dirty:0kB writeback:0kB shmem:0kB shmem_thp: 0kB shmem_pmdmapped: 0kB anon_thp: 
42408kB writeback_tmp:0kB unstable:0kB pages_scanned:39836878 
all_unreclaimable? yes
Jan 16 02:14:20 LXCONTAINER kernel: [52357.447808] DMA free:4044kB min:788kB 
low:984kB high:1180kB active_anon:0kB inactive_anon:0kB active_file:6540kB 
inactive_file:0kB unevictable:0kB writepending:0kB present:15992kB 
managed:15916kB mlocked:0kB slab_reclaimable:1416kB slab_unreclaimable:3908kB 
kernel_stack:8kB pagetables:0kB bounce:0kB free_pcp:0kB local_pcp:0kB 
free_cma:0kB
Jan 16 02:14:20 LXCONTAINER kernel: lowmem_reserve[]: 0 815 2932 2932
Jan 16 02:14:20 LXCONTAINER kernel: [52357.447816] Normal free:41484kB 
min:41488kB low:51860kB high:62232kB active_anon:2312kB inactive_anon:96kB 
active_file:390236kB inactive_file:136kB unevictable:276kB writepending:0kB 
present:894968kB managed:857360kB mlocked:276kB slab_reclaimable:129096kB 
slab_unreclaimable:281832kB kernel_stack:2656kB pagetables:40kB bounce:0kB 
free_pcp:336kB local_pcp:336kB free_cma:0kB
Jan 16 02:14:20 LXCONTAINER kernel: lowmem_reserve[]: 0 0 16935 16935
Jan 16 02:14:20 LXCONTAINER kernel: [52357.447824] HighMem free:68452kB 
min:512kB low:27428kB high:54344kB active_anon:56768kB inactive_anon:88568kB 
active_file:322464kB inactive_file:1599188kB unevictable:7024kB 
writepending:0kB present:2167752kB managed:2167752kB mlocked:7024kB 
slab_reclaimable:0kB slab_unreclaimable:0kB kernel_stack:0kB pagetables:3188kB 
bounce:0kB free_pcp:52kB local_pcp:52kB free_cma:0kB
Jan 16 02:14:20 LXCONTAINER kernel: lowmem_reserve[]: 0 0 0 0
Jan 16 02:14:20 LXCONTAINER kernel: [52357.447828] DMA: 19*4kB (UME) 18*8kB 
(UE) 11*16kB (UE) 10*32kB (UME) 14*64kB (UME) 13*128kB (UME) 3*256kB (UM) 
0*512kB 0*1024kB 0*2048kB 0*4096kB = 4044kB
Jan 16 02:14:20 LXCONTAINER kernel: Normal: 441*4kB (ME) 515*8kB (UME) 531*16kB 
(ME) 701*32kB (UME) 69*64kB (UM) 2*128kB (U) 0*256kB 0*512kB 0*1024kB 0*2048kB 
0*4096kB = 41484kB
Jan 16 02:14:20 LXCONTAINER kernel: HighMem: 1027*4kB (UM) 1377*8kB (UM) 
791*16kB (UM) 247*32kB (UM) 88*64kB (UM) 42*128kB (UM) 3*256kB (UM) 1*512kB (U) 
2*1024kB (UM) 1*2048kB (M) 4*4096kB (UM) = 68452kB
Jan 16 02:14:20 LXCONTAINER kernel: [52357.447869] Node 0 hugepages_total=0 
hugepages_free=0 hugepages_surp=0 hugepages_size=2048kB
Jan 16 02:14:20 LXCONTAINER kernel: [52357.447870] 591589 total pagecache pages
Jan 16 02:14:20 LXCONTAINER kernel: [52357.447873] 609 pages in swap cache
Jan 16 02:14:20 LXCONTAINER kernel: [52357.447874] Swap cache stats: add 4224, 
delete 3615, find 597/670
Jan 16 02:14:20 LXCONTAINER kernel: [52357.447875] Free swap  = 1033368kB
Jan 16 02:14:20 LXCONTAINER kernel: [52357.447876] Total swap = 1048572kB
Jan 16 02:14:20 LXCONTAINER kernel: [52357.447877] 769678 pages RAM
Jan 16 02:14:20 LXCONTAINER kernel: [52357.447877] 541938 pages 
HighMem/MovableOnly
Jan 16 02:14:20 LXCONTAINER kernel: [52357.447878] 9421 pages reserved
Jan 16 02:14:20 LXCONTAINER kernel: [52357.447879] 0 pages hwpoisoned
Jan 16 02:14:20 LXCONTAINER kernel: [52357.447880] [ pid ]   uid  tgid total_vm 
     rss nr_ptes nr_pmds swapents oom_score_adj name
Jan 16 02:14:20 LXCONTAINER kernel: [52357.447893] [  352]     0   352     7771 
    2225      13       3        0             0 systemd-journal
Jan 16 02:14:20 LXCONTAINER kernel: [52357.447897] [  370]     0   370     5467 
     328       8       3        0             0 lvmetad
Jan 16 02:14:20 LXCONTAINER kernel: [52357.447900] [  390]     0   390     4038 
     845       9       3        0         -1000 systemd-udevd
Jan 16 02:14:20 LXCONTAINER kernel: [52357.447904] [  544]     0   544      835 
     463       5       3        0             0 mdadm
Jan 16 02:14:20 LXCONTAINER kernel: [52357.447909] [  669]     0   669     1754 
     775       7       3        0             0 rpcbind
Jan 16 02:14:20 LXCONTAINER kernel: [52357.447912] [  691]   116   691     1672 
     964       7       3        0          -900 dbus-daemon
Jan 16 02:14:20 LXCONTAINER kernel: [52357.447915] [  701]   134   701     1561 
     707       7       3        0             0 avahi-daemon
Jan 16 02:14:20 LXCONTAINER kernel: [52357.447918] [  704]     0   704      555 
       3       5       3       12             0 atopacctd
Jan 16 02:14:20 LXCONTAINER kernel: [52357.447921] [  707]     0   707     1864 
    1090       7       3        0             0 systemd-logind
Jan 16 02:14:20 LXCONTAINER kernel: [52357.447924] [  708]     0   708     1108 
     414       6       3        0             0 irexec
Jan 16 02:14:20 LXCONTAINER kernel: [52357.447927] [  712]     0   712    12718 
    1749      15       3        1             0 ModemManager
Jan 16 02:14:20 LXCONTAINER kernel: [52357.447930] [  715]   134   715     1561 
      74       7       3        0             0 avahi-daemon
Jan 16 02:14:20 LXCONTAINER kernel: [52357.447932] [  717]     0   717     1459 
     978       6       3        0             0 smartd
Jan 16 02:14:20 LXCONTAINER kernel: [52357.447936] [  718]     0   718    26082 
     617      20       3        1             0 lxcfs
Jan 16 02:14:20 LXCONTAINER kernel: [52357.447938] [  719]     0   719     1390 
     386       7       3        0             0 inetd
Jan 16 02:14:20 LXCONTAINER kernel: [52357.447941] [  720]     0   720     4242 
    1618      13       3        0             0 cupsd
Jan 16 02:14:20 LXCONTAINER kernel: [52357.447944] [  731]     0   731     1128 
     388       7       3        0             0 lircmd
Jan 16 02:14:20 LXCONTAINER kernel: [52357.447947] [  741]     0   741     1800 
     615       7       3        0             0 cron
Jan 16 02:14:20 LXCONTAINER kernel: [52357.447950] [  744]     0   744     5724 
     759       8       3        0             0 rsyslogd
Jan 16 02:14:20 LXCONTAINER kernel: [52357.447953] [  745]     0   745    21541 
    3016      23       3        0             0 NetworkManager
Jan 16 02:14:20 LXCONTAINER kernel: [52357.447956] [  746]     0   746    10093 
    1503      14       3        0             0 accounts-daemon
Jan 16 02:14:20 LXCONTAINER kernel: [52357.447959] [  753]     0   753     9218 
    1460      12       3        0             0 polkitd
Jan 16 02:14:20 LXCONTAINER kernel: [52357.447962] [  755]     0   755     8886 
    1698      15       3        0             0 cups-browsed
Jan 16 02:14:20 LXCONTAINER kernel: [52357.447965] [  907]   125   907    11663 
    2891      16       3       27             0 colord
Jan 16 02:14:20 LXCONTAINER kernel: [52357.447968] [ 1058]     7  1058     3013 
    1224      10       3        0             0 dbus
Jan 16 02:14:20 LXCONTAINER kernel: [52357.447971] [ 1504]     0  1504     2027 
     622       8       3        0             0 dhclient
Jan 16 02:14:20 LXCONTAINER kernel: [52357.447973] [ 1556]   121  1556      769 
     484       5       3        0             0 ntpd
Jan 16 02:14:20 LXCONTAINER kernel: [52357.447976] [ 1557]   121  1557      875 
     571       5       3        0             0 ntpd
Jan 16 02:14:20 LXCONTAINER kernel: [52357.447979] [ 1558]     0  1558      733 
      50       5       3        0             0 ntpd
Jan 16 02:14:20 LXCONTAINER kernel: [52357.447982] [ 1560]     1  1560      563 
     173       5       3        0             0 uptimed
Jan 16 02:14:20 LXCONTAINER kernel: [52357.447985] [ 1654]     0  1654     2621 
    1379       8       3        0         -1000 sshd
Jan 16 02:14:20 LXCONTAINER kernel: [52357.447988] [ 1665]     0  1665     1207 
     730       6       3        0             0 lircd
Jan 16 02:14:20 LXCONTAINER kernel: [52357.447991] [ 1669]     0  1669     1129 
     407       6       3        0             0 lircd-uinput
Jan 16 02:14:20 LXCONTAINER kernel: [52357.447995] [ 1747]     0  1747     1050 
     558       6       3        0             0 lxc-autostart
Jan 16 02:14:20 LXCONTAINER kernel: [52357.447998] [ 1755]     0  1755     2370 
     850       8       3        0             0 systemd
Jan 16 02:14:20 LXCONTAINER kernel: [52357.448001] [ 1821]     0  1821     3791 
     999       9       3        0             0 systemd-journal
Jan 16 02:14:20 LXCONTAINER kernel: [52357.448061] [ 1823]     0  1823    12726 
    3505      19       3       42             0 fail2ban-server
Jan 16 02:14:20 LXCONTAINER kernel: [52357.448065] [ 1856]     0  1856      895 
     569       5       3        0             0 cron
Jan 16 02:14:20 LXCONTAINER kernel: [52357.448068] [ 1857]   109  1857     1564 
     606       7       3        0          -900 dbus-daemon
Jan 16 02:14:20 LXCONTAINER kernel: [52357.448071] [ 1867]     0  1867     1764 
      91       7       3        0             0 systemd-logind
Jan 16 02:14:20 LXCONTAINER kernel: [52357.448074] [ 1869]     0  1869     5656 
     609      10       3        0             0 rsyslogd
Jan 16 02:14:20 LXCONTAINER kernel: [52357.448077] [ 1883]     8  1883     1059 
     389       6       3        0             0 nullmailer-send
Jan 16 02:14:20 LXCONTAINER kernel: [52357.448081] [ 1961]     0  1961     1202 
     366       6       3        0             0 agetty
Jan 16 02:14:20 LXCONTAINER kernel: [52357.448084] [ 2062]   104  2062     5970 
    3808      15       3        0             0 nsd
Jan 16 02:14:20 LXCONTAINER kernel: [52357.448087] [ 2088]   102  2088     5273 
     406       7       3        0             0 ippl
Jan 16 02:14:20 LXCONTAINER kernel: [52357.448090] [ 2095]     0  2095      634 
     419       5       3        0             0 agetty
Jan 16 02:14:20 LXCONTAINER kernel: [52357.448093] [ 2096]     0  2096      634 
     375       5       3        0             0 agetty
Jan 16 02:14:20 LXCONTAINER kernel: [52357.448096] [ 2098]     0  2098      634 
     434       5       3        0             0 agetty
Jan 16 02:14:20 LXCONTAINER kernel: [52357.448099] [ 2101]     0  2101      634 
     364       5       3        0             0 agetty
Jan 16 02:14:20 LXCONTAINER kernel: [52357.448102] [ 2102]     0  2102      634 
     396       5       3        0             0 agetty
Jan 16 02:14:20 LXCONTAINER kernel: [52357.448105] [ 2103]     0  2103      634 
     430       5       3        0             0 agetty
Jan 16 02:14:20 LXCONTAINER kernel: [52357.448109] [ 2118]     0  2118    11323 
     180      15       3        0             0 sensord
Jan 16 02:14:20 LXCONTAINER kernel: [52357.448112] [ 2213]   133  2213     5455 
    2495      14       3        5             0 timidity
Jan 16 02:14:20 LXCONTAINER kernel: [52357.448115] [ 2347]     0  2347     1530 
      90       5       3        0             0 hddtemp
Jan 16 02:14:20 LXCONTAINER kernel: [52357.448117] [ 2362]     0  2362     2783 
    1809       9       3        0             0 munin-node
Jan 16 02:14:20 LXCONTAINER kernel: [52357.448120] [ 2398]   104  2398     8621 
    7331      20       3        0             0 nsd
Jan 16 02:14:20 LXCONTAINER kernel: [52357.448123] [ 2431]   104  2431     8695 
     451      17       3        0             0 nsd
Jan 16 02:14:20 LXCONTAINER kernel: [52357.448126] [ 2434]   103  2434     5065 
    2065      12       3        0             0 unbound
Jan 16 02:14:20 LXCONTAINER kernel: [52357.448129] [ 2697]   101  2697     2816 
     781       9       3        0             0 exim4
Jan 16 02:14:20 LXCONTAINER kernel: [52357.448132] [ 2779]   200  2779   112830 
   17215     124       3       28             0 mythbackend
Jan 16 02:14:20 LXCONTAINER kernel: [52357.448136] [ 3270]  1002  3270     2393 
    1479       8       3        1             0 systemd
Jan 16 02:14:20 LXCONTAINER kernel: [52357.448139] [ 3271]  1002  3271     7447 
     460      12       3       10             0 (sd-pam)
Jan 16 02:14:20 LXCONTAINER kernel: [52357.448142] [ 3275]     0  3275     8276 
    1557      13       3        0             0 console-kit-dae
Jan 16 02:14:20 LXCONTAINER kernel: [52357.448145] [ 6539]  1002  6539     4976 
     665      10       3        0             0 dirmngr
Jan 16 02:14:20 LXCONTAINER kernel: [52357.448148] [10916]     0 10916    11996 
    2418      18       3        0             0 packagekitd
Jan 16 02:14:20 LXCONTAINER kernel: [52357.448151] [30746]  1002 30746     1564 
     840       6       3        0             0 dbus-daemon
Jan 16 02:14:20 LXCONTAINER kernel: [52357.448154] [  488]     0   488     1968 
    1827       7       3        0             0 atop
Jan 16 02:14:20 LXCONTAINER kernel: [52357.448157] [32326]   300 32326     2145 
     376       8       3        0             0 uuidd
Jan 16 02:14:20 LXCONTAINER kernel: [52357.448161] [ 4572]     0  4572     2635 
     871       8       3        0             0 cron
Jan 16 02:14:20 LXCONTAINER kernel: [52357.448163] [ 4574]     0  4574      582 
     148       5       3        0             0 sh
Jan 16 02:14:20 LXCONTAINER kernel: [52357.448166] [ 4578]     0  4578      582 
     366       5       3        0             0 tigercron
Jan 16 02:14:20 LXCONTAINER kernel: [52357.448169] [ 4695]     0  4695      582 
     274       5       3        0             0 tigercron
Jan 16 02:14:20 LXCONTAINER kernel: [52357.448172] [ 4696]     0  4696      582 
      38       5       3        0             0 tigercron
Jan 16 02:14:20 LXCONTAINER kernel: [52357.448175] [ 4701]     0  4701      583 
     343       5       3        0             0 check_accounts
Jan 16 02:14:20 LXCONTAINER kernel: [52357.448178] [ 4896]     0  4896      583 
     276       4       3        0             0 check_accounts
Jan 16 02:14:20 LXCONTAINER kernel: [52357.448181] [ 4948]     0  4948      583 
      40       4       3        0             0 check_accounts
Jan 16 02:14:20 LXCONTAINER kernel: [52357.448184] [ 4949]     0  4949      896 
     326       6       3        0             0 find
Jan 16 02:14:20 LXCONTAINER kernel: [52357.448187] [ 4950]     0  4950      563 
     145       5       3        0             0 wc
Jan 16 02:14:20 LXCONTAINER kernel: [52357.448189] Out of memory: Kill process 
2779 (mythbackend) score 16 or sacrifice child
Jan 16 02:14:20 LXCONTAINER kernel: [52357.448361] Killed process 2779 
(mythbackend) total-vm:451320kB, anon-rss:29180kB, file-rss:39680kB, 
shmem-rss:0kB
Jan 16 02:20:48 LXCONTAINER kernel: [52745.931104] kthreadd: page allocation 
stalls for 10216ms, order:1, mode:0x27000c0(GFP_KERNEL_ACCOUNT|__GFP_NOTRACK)
Jan 16 02:20:48 LXCONTAINER kernel: [52745.931119] CPU: 0 PID: 2 Comm: kthreadd 
Not tainted 4.9.0-1-686-pae #1 Debian 4.9.2-2
Jan 16 02:20:48 LXCONTAINER kernel: [52745.931120] Hardware name: 
Hewlett-Packard HP dx5150 MT(PE679AV)/09AC, BIOS 1.09 11/22/2005
Jan 16 02:20:48 LXCONTAINER kernel: [52745.931122]  f7507df0 db2f17c2 db6a73b0 
00000000 db16fc96 db6ab872 027000c0 f7507df8
Jan 16 02:20:48 LXCONTAINER kernel: [52745.931128]  f7507e00 db6a73b0 f7507dd4 
e9279996 00000001 00000001 00000000 f7507eb4
Jan 16 02:20:48 LXCONTAINER kernel: [52745.931133]  db1707e0 027000c0 db6a73b0 
000027e8 00000001 f75012c0 00000010 000009c4
Jan 16 02:20:48 LXCONTAINER kernel: [52745.931138] Call Trace:
Jan 16 02:20:48 LXCONTAINER kernel: [52745.931150]  [<db2f17c2>] ? 
dump_stack+0x55/0x73
Jan 16 02:20:48 LXCONTAINER kernel: [52745.931155]  [<db16fc96>] ? 
warn_alloc+0xf6/0x110
Jan 16 02:20:48 LXCONTAINER kernel: [52745.931158]  [<db1707e0>] ? 
__alloc_pages_nodemask+0xac0/0xca0
Jan 16 02:20:48 LXCONTAINER kernel: [52745.931164]  [<db0646a8>] ? 
copy_process.part.41+0xd8/0x14f0
Jan 16 02:20:48 LXCONTAINER kernel: [52745.931167]  [<db0646cd>] ? 
copy_process.part.41+0xfd/0x14f0
Jan 16 02:20:48 LXCONTAINER kernel: [52745.931170]  [<db083f70>] ? 
kthread_park+0x50/0x50
Jan 16 02:20:48 LXCONTAINER kernel: [52745.931173]  [<db083f70>] ? 
kthread_park+0x50/0x50
Jan 16 02:20:48 LXCONTAINER kernel: [52745.931175]  [<db065c9d>] ? 
_do_fork+0xed/0x3d0
Jan 16 02:20:48 LXCONTAINER kernel: [52745.931180]  [<db599143>] ? 
__schedule+0x263/0x760
Jan 16 02:20:48 LXCONTAINER kernel: [52745.931184]  [<db099e37>] ? 
set_curr_task_fair+0x27/0x60
Jan 16 02:20:48 LXCONTAINER kernel: [52745.931186]  [<db083f70>] ? 
kthread_park+0x50/0x50
Jan 16 02:20:48 LXCONTAINER kernel: [52745.931188]  [<db065fb5>] ? 
kernel_thread+0x35/0x40
Jan 16 02:20:48 LXCONTAINER kernel: [52745.931191]  [<db084d44>] ? 
kthreadd+0x104/0x150
Jan 16 02:20:48 LXCONTAINER kernel: [52745.931194]  [<db084c40>] ? 
kthread_create_worker_on_cpu+0x30/0x30
Jan 16 02:20:48 LXCONTAINER kernel: [52745.931197]  [<db59d903>] ? 
ret_from_fork+0x1b/0x28
Jan 16 02:20:48 LXCONTAINER kernel: [52745.931198] Mem-Info:
Jan 16 02:20:48 LXCONTAINER kernel: [52745.931204] active_anon:13904 
inactive_anon:15676 isolated_anon:0
Jan 16 02:20:48 LXCONTAINER kernel: [52745.931204]  active_file:130154 
inactive_file:213505 isolated_file:0
Jan 16 02:20:48 LXCONTAINER kernel: [52745.931204]  unevictable:1911 dirty:9 
writeback:0 unstable:0
Jan 16 02:20:48 LXCONTAINER kernel: [52745.931204]  slab_reclaimable:35705 
slab_unreclaimable:98694
Jan 16 02:20:48 LXCONTAINER kernel: [52745.931204]  mapped:18632 shmem:10605 
pagetables:683 bounce:0
Jan 16 02:20:48 LXCONTAINER kernel: [52745.931204]  free:241784 free_pcp:0 
free_cma:0
Jan 16 02:20:48 LXCONTAINER kernel: [52745.931210] Node 0 active_anon:55616kB 
inactive_anon:62704kB active_file:520616kB inactive_file:854020kB 
unevictable:7644kB isolated(anon):0kB isolated(file):0kB mapped:74528kB 
dirty:36kB writeback:0kB shmem:0kB shmem_thp: 0kB shmem_pmdmapped: 0kB 
anon_thp: 42420kB writeback_tmp:0kB unstable:0kB pages_scanned:0 
all_unreclaimable? no
Jan 16 02:20:48 LXCONTAINER kernel: [52745.931215] DMA free:4044kB min:788kB 
low:984kB high:1180kB active_anon:0kB inactive_anon:0kB active_file:4160kB 
inactive_file:0kB unevictable:0kB writepending:0kB present:15992kB 
managed:15916kB mlocked:0kB slab_reclaimable:1900kB slab_unreclaimable:5812kB 
kernel_stack:0kB pagetables:0kB bounce:0kB free_pcp:0kB local_pcp:0kB 
free_cma:0kB
Jan 16 02:20:48 LXCONTAINER kernel: lowmem_reserve[]: 0 815 2932 2932
Jan 16 02:20:48 LXCONTAINER kernel: [52745.931223] Normal free:41972kB 
min:41488kB low:51860kB high:62232kB active_anon:668kB inactive_anon:84kB 
active_file:272636kB inactive_file:888kB unevictable:276kB writepending:36kB 
present:894968kB managed:857360kB mlocked:276kB slab_reclaimable:140920kB 
slab_unreclaimable:388964kB kernel_stack:2456kB pagetables:32kB bounce:0kB 
free_pcp:0kB local_pcp:0kB free_cma:0kB
Jan 16 02:20:48 LXCONTAINER kernel: lowmem_reserve[]: 0 0 16935 16935
Jan 16 02:20:48 LXCONTAINER kernel: [52745.931231] HighMem free:921120kB 
min:512kB low:27428kB high:54344kB active_anon:54948kB inactive_anon:62620kB 
active_file:243788kB inactive_file:853164kB unevictable:7368kB writepending:0kB 
present:2167752kB managed:2167752kB mlocked:7368kB slab_reclaimable:0kB 
slab_unreclaimable:0kB kernel_stack:0kB pagetables:2700kB bounce:0kB 
free_pcp:0kB local_pcp:0kB free_cma:0kB
Jan 16 02:20:48 LXCONTAINER kernel: lowmem_reserve[]: 0 0 0 0
Jan 16 02:20:48 LXCONTAINER kernel: [52745.931235] DMA: 3*4kB (UM) 6*8kB (UME) 
7*16kB (UME) 23*32kB (UME) 15*64kB (UM) 9*128kB (UME) 4*256kB (UM) 0*512kB 
0*1024kB 0*2048kB 0*4096kB = 4044kB
Jan 16 02:20:48 LXCONTAINER kernel: Normal: 253*4kB (ME) 1459*8kB (UMEH) 
1251*16kB (UMEH) 210*32kB (UMEH) 30*64kB (UMEH) 3*128kB (UM) 1*256kB (H) 
0*512kB 0*1024kB 0*2048kB 0*4096kB = 41980kB
Jan 16 02:20:48 LXCONTAINER kernel: HighMem: 184*4kB (U) 94*8kB (U) 7025*16kB 
(UM) 8234*32kB (UM) 4118*64kB (UM) 1083*128kB (UM) 233*256kB (UM) 70*512kB (UM) 
25*1024kB (UM) 2*2048kB (M) 4*4096kB (UM) = 921120kB
Jan 16 02:20:48 LXCONTAINER kernel: [52745.931277] Node 0 hugepages_total=0 
hugepages_free=0 hugepages_surp=0 hugepages_size=2048kB
Jan 16 02:20:48 LXCONTAINER kernel: [52745.931277] 355609 total pagecache pages
Jan 16 02:20:48 LXCONTAINER kernel: [52745.931280] 605 pages in swap cache
Jan 16 02:20:48 LXCONTAINER kernel: [52745.931282] Swap cache stats: add 4224, 
delete 3619, find 598/671
Jan 16 02:20:48 LXCONTAINER kernel: [52745.931283] Free swap  = 1033488kB
Jan 16 02:20:48 LXCONTAINER kernel: [52745.931283] Total swap = 1048572kB
Jan 16 02:20:48 LXCONTAINER kernel: [52745.931284] 769678 pages RAM
Jan 16 02:20:48 LXCONTAINER kernel: [52745.931285] 541938 pages 
HighMem/MovableOnly
Jan 16 02:20:48 LXCONTAINER kernel: [52745.931286] 9421 pages reserved
Jan 16 02:20:48 LXCONTAINER kernel: [52745.931286] 0 pages hwpoisoned
Jan 16 09:40:14 LXCONTAINER kernel: [79111.436042] usb 2-2: new low-speed USB 
device number 3 using ohci-pci
Jan 16 09:40:14 LXCONTAINER kernel: [79111.651057] usb 2-2: New USB device 
found, idVendor=046a, idProduct=0001
Jan 16 09:40:14 LXCONTAINER kernel: [79111.651061] usb 2-2: New USB device 
strings: Mfr=0, Product=0, SerialNumber=0
Jan 16 09:40:14 LXCONTAINER kernel: [79111.663344] input: HID 046a:0001 as 
/devices/pci0000:00/0000:00:13.0/usb2/2-2/2-2:1.0/0003:046A:0001.0002/input/input8
Jan 16 09:40:14 LXCONTAINER kernel: [79111.720461] hid-generic 
0003:046A:0001.0002: input,hidraw0: USB HID v1.00 Keyboard [HID 046a:0001] on 
usb-0000:00:13.0-2/input0
Jan 16 09:46:40 LXCONTAINER kernel: [79497.487849] usb 2-2: USB disconnect, 
device number 3
LOGHOST:~ #

It is confusing that this time the kernel errors were logged by the LXC
container. The killed process (mythbackend) lives outside the container
and the triggering find process was running from the host context most
likely, too:

Jan 16 02:00:01 HOSTNAME CRON[4574]: (root) CMD (   test -x /usr/sbin/tigercron 
&& { [ -r "$DEFAULT" ] && . "$DEFAULT" ; nice -n$NICETIGER /usr/sbin/tigercron 
-q ; })

Florian

-- 
:wq

Reply via email to