Package: obnam Followup-For: Bug #682798 There seems to be a problem with how obnam deals with ENOMEM conditions, causing it to leak pipes.
Yet another trial run failed. This time I ran a lsof process periodically in another screen window: % (export LC_ALL=C ; while :; do date; really lsof -c obnam | grep -c pipe$; sleep 20; done) | tee obnam-lsof.txt The data are interesting: [... several hours of low counts deleted ...] Fri Jul 27 06:50:14 EEST 2012 2 Fri Jul 27 06:50:34 EEST 2012 2 Fri Jul 27 06:50:54 EEST 2012 2 Fri Jul 27 06:51:14 EEST 2012 2 Fri Jul 27 06:51:34 EEST 2012 2 Fri Jul 27 06:51:54 EEST 2012 2 Fri Jul 27 06:52:14 EEST 2012 2 Fri Jul 27 06:52:34 EEST 2012 11 Fri Jul 27 06:52:55 EEST 2012 9 Fri Jul 27 06:53:15 EEST 2012 2 Fri Jul 27 06:53:35 EEST 2012 9 Fri Jul 27 06:53:55 EEST 2012 2 Fri Jul 27 06:54:15 EEST 2012 2 Fri Jul 27 06:54:35 EEST 2012 2 Fri Jul 27 06:54:55 EEST 2012 2 Fri Jul 27 06:55:15 EEST 2012 2 Fri Jul 27 06:55:35 EEST 2012 23 Fri Jul 27 06:55:55 EEST 2012 33 Fri Jul 27 06:56:15 EEST 2012 33 Fri Jul 27 06:56:35 EEST 2012 30 Fri Jul 27 06:56:55 EEST 2012 30 Fri Jul 27 06:57:15 EEST 2012 49 Fri Jul 27 06:57:35 EEST 2012 44 Fri Jul 27 06:57:55 EEST 2012 44 Fri Jul 27 06:58:15 EEST 2012 44 Fri Jul 27 06:58:36 EEST 2012 49 Fri Jul 27 06:58:56 EEST 2012 44 Fri Jul 27 06:59:16 EEST 2012 44 Fri Jul 27 06:59:36 EEST 2012 49 Fri Jul 27 06:59:56 EEST 2012 398 Fri Jul 27 07:00:16 EEST 2012 1605 Fri Jul 27 07:00:36 EEST 2012 3222 Fri Jul 27 07:00:57 EEST 2012 5994 Fri Jul 27 07:01:18 EEST 2012 5994 Fri Jul 27 07:01:40 EEST 2012 5994 Fri Jul 27 07:02:01 EEST 2012 5994 Fri Jul 27 07:02:23 EEST 2012 5994 Fri Jul 27 07:02:44 EEST 2012 5994 Fri Jul 27 07:03:05 EEST 2012 5994 Fri Jul 27 07:03:27 EEST 2012 5994 Fri Jul 27 07:03:48 EEST 2012 5994 Fri Jul 27 07:04:09 EEST 2012 5994 Fri Jul 27 07:04:30 EEST 2012 5994 Fri Jul 27 07:04:52 EEST 2012 5994 Fri Jul 27 07:05:13 EEST 2012 5994 Fri Jul 27 07:05:34 EEST 2012 5994 Fri Jul 27 07:05:55 EEST 2012 5994 Fri Jul 27 07:06:15 EEST 2012 5994 Fri Jul 27 07:06:37 EEST 2012 5994 Fri Jul 27 07:06:58 EEST 2012 5994 Fri Jul 27 07:07:19 EEST 2012 5994 Fri Jul 27 07:07:40 EEST 2012 5994 Fri Jul 27 07:08:00 EEST 2012 5994 Fri Jul 27 07:08:22 EEST 2012 5994 Fri Jul 27 07:08:43 EEST 2012 5994 Fri Jul 27 07:09:03 EEST 2012 5994 Fri Jul 27 07:09:25 EEST 2012 5994 Fri Jul 27 07:09:46 EEST 2012 5994 Fri Jul 27 07:10:07 EEST 2012 5994 Fri Jul 27 07:10:29 EEST 2012 5994 Fri Jul 27 07:10:50 EEST 2012 5994 Fri Jul 27 07:11:11 EEST 2012 5994 Fri Jul 27 07:11:33 EEST 2012 5994 Fri Jul 27 07:11:54 EEST 2012 5994 Fri Jul 27 07:12:15 EEST 2012 5994 Fri Jul 27 07:12:37 EEST 2012 5994 Fri Jul 27 07:12:58 EEST 2012 5994 Fri Jul 27 07:13:19 EEST 2012 5994 Fri Jul 27 07:13:41 EEST 2012 5994 Fri Jul 27 07:14:02 EEST 2012 5994 Fri Jul 27 07:14:23 EEST 2012 5994 Fri Jul 27 07:14:45 EEST 2012 5994 Fri Jul 27 07:15:07 EEST 2012 5994 Fri Jul 27 07:15:28 EEST 2012 5994 Fri Jul 27 07:15:49 EEST 2012 5994 Fri Jul 27 07:16:11 EEST 2012 5994 Fri Jul 27 07:16:32 EEST 2012 5994 Fri Jul 27 07:16:54 EEST 2012 5994 Fri Jul 27 07:17:15 EEST 2012 5994 Fri Jul 27 07:17:37 EEST 2012 5994 Fri Jul 27 07:17:58 EEST 2012 5994 Fri Jul 27 07:18:20 EEST 2012 5994 Fri Jul 27 07:18:42 EEST 2012 5994 Fri Jul 27 07:19:03 EEST 2012 5994 Fri Jul 27 07:19:25 EEST 2012 5994 Fri Jul 27 07:19:45 EEST 2012 5994 Fri Jul 27 07:20:06 EEST 2012 5994 Fri Jul 27 07:20:26 EEST 2012 5994 Fri Jul 27 07:20:47 EEST 2012 5994 Fri Jul 27 07:21:08 EEST 2012 5994 Fri Jul 27 07:21:29 EEST 2012 5994 Fri Jul 27 07:21:49 EEST 2012 5994 Fri Jul 27 07:22:10 EEST 2012 5994 Fri Jul 27 07:22:32 EEST 2012 5994 Fri Jul 27 07:22:52 EEST 2012 5994 Fri Jul 27 07:23:14 EEST 2012 5994 Fri Jul 27 07:23:35 EEST 2012 5994 Fri Jul 27 07:23:55 EEST 2012 5994 Fri Jul 27 07:24:16 EEST 2012 5994 Fri Jul 27 07:24:37 EEST 2012 5994 Fri Jul 27 07:24:58 EEST 2012 5994 Fri Jul 27 07:25:19 EEST 2012 5994 Fri Jul 27 07:25:40 EEST 2012 5994 Fri Jul 27 07:26:02 EEST 2012 5994 Fri Jul 27 07:26:23 EEST 2012 5994 Fri Jul 27 07:26:44 EEST 2012 5994 Fri Jul 27 07:27:04 EEST 2012 5994 Fri Jul 27 07:27:26 EEST 2012 5994 Fri Jul 27 07:27:46 EEST 2012 5994 Fri Jul 27 07:28:07 EEST 2012 5994 Fri Jul 27 07:28:28 EEST 2012 5994 Fri Jul 27 07:28:49 EEST 2012 5994 Fri Jul 27 07:29:10 EEST 2012 5994 Fri Jul 27 07:29:32 EEST 2012 5994 Fri Jul 27 07:29:54 EEST 2012 5994 Fri Jul 27 07:30:15 EEST 2012 5994 Fri Jul 27 07:30:36 EEST 2012 5994 Fri Jul 27 07:30:57 EEST 2012 5994 Fri Jul 27 07:31:18 EEST 2012 5994 Fri Jul 27 07:31:38 EEST 2012 5994 Fri Jul 27 07:31:59 EEST 2012 5994 Fri Jul 27 07:32:20 EEST 2012 5994 Fri Jul 27 07:32:41 EEST 2012 5994 Fri Jul 27 07:33:03 EEST 2012 5994 Fri Jul 27 07:33:24 EEST 2012 5994 Fri Jul 27 07:33:45 EEST 2012 5994 Fri Jul 27 07:34:07 EEST 2012 5994 Fri Jul 27 07:34:29 EEST 2012 5994 Fri Jul 27 07:34:51 EEST 2012 5994 Fri Jul 27 07:35:12 EEST 2012 5994 Fri Jul 27 07:35:34 EEST 2012 5994 Fri Jul 27 07:35:55 EEST 2012 5994 Fri Jul 27 07:36:16 EEST 2012 5994 Fri Jul 27 07:36:38 EEST 2012 5994 Fri Jul 27 07:36:59 EEST 2012 5994 Fri Jul 27 07:37:21 EEST 2012 5994 Fri Jul 27 07:37:42 EEST 2012 5994 Fri Jul 27 07:38:04 EEST 2012 5994 Fri Jul 27 07:38:26 EEST 2012 5994 Fri Jul 27 07:38:48 EEST 2012 5994 Fri Jul 27 07:39:09 EEST 2012 5994 Fri Jul 27 07:39:31 EEST 2012 5994 Fri Jul 27 07:39:52 EEST 2012 5994 Fri Jul 27 07:40:14 EEST 2012 5994 Fri Jul 27 07:40:35 EEST 2012 5994 Fri Jul 27 07:40:56 EEST 2012 5994 Fri Jul 27 07:41:16 EEST 2012 5994 Fri Jul 27 07:41:38 EEST 2012 5994 Fri Jul 27 07:41:58 EEST 2012 5994 Fri Jul 27 07:42:19 EEST 2012 5994 Fri Jul 27 07:42:39 EEST 2012 5994 Fri Jul 27 07:43:01 EEST 2012 5994 Fri Jul 27 07:43:22 EEST 2012 5994 Fri Jul 27 07:43:43 EEST 2012 5994 Fri Jul 27 07:44:04 EEST 2012 5994 Fri Jul 27 07:44:24 EEST 2012 5994 Fri Jul 27 07:44:46 EEST 2012 5994 Fri Jul 27 07:45:06 EEST 2012 5994 Fri Jul 27 07:45:27 EEST 2012 5994 Fri Jul 27 07:45:49 EEST 2012 5994 Fri Jul 27 07:46:09 EEST 2012 5994 Fri Jul 27 07:46:30 EEST 2012 5994 Fri Jul 27 07:46:52 EEST 2012 5994 Fri Jul 27 07:47:13 EEST 2012 5994 Fri Jul 27 07:47:34 EEST 2012 5994 Fri Jul 27 07:47:54 EEST 2012 5994 Fri Jul 27 07:48:15 EEST 2012 5994 Fri Jul 27 07:48:36 EEST 2012 0 Fri Jul 27 07:48:56 EEST 2012 0 Fri Jul 27 07:49:16 EEST 2012 0 Fri Jul 27 07:49:36 EEST 2012 0 Fri Jul 27 07:49:56 EEST 2012 0 At around the time when the count started first to rise, the log has this anomaly: 2012-07-27 06:55:32 DEBUG VmRSS: 625748 KiB 2012-07-27 06:55:32 DEBUG Backing up /home/ajk/Maildir/.oldmails/cur/1313387878.M745770P30583.flowerpot.kaijanaho.info,S=895:2,S 2012-07-27 06:55:32 ERROR Can't back up /home/ajk/Maildir/.oldmails/cur/1313387878.M745770P30583.flowerpot.kaijanaho.info,S=895:2,S: Cannot allocate memory 2012-07-27 06:55:32 DEBUG OSError(12, 'Cannot allocate memory') 2012-07-27 06:55:32 DEBUG Backing up /home/ajk/Maildir/.oldmails/cur/1313387876.M599798P30583.flowerpot.kaijanaho.info,S=1259:2,S 2012-07-27 06:55:32 ERROR Can't back up /home/ajk/Maildir/.oldmails/cur/1313387876.M599798P30583.flowerpot.kaijanaho.info,S=1259:2,S: Cannot allocate memory 2012-07-27 06:55:32 DEBUG OSError(12, 'Cannot allocate memory') 2012-07-27 06:55:32 DEBUG Backing up /home/ajk/Maildir/.oldmails/cur/1319446952.M473066P21565.flowerpot.kaijanaho.info,S=4679:2,S 2012-07-27 06:55:32 ERROR Can't back up /home/ajk/Maildir/.oldmails/cur/1319446952.M473066P21565.flowerpot.kaijanaho.info,S=4679:2,S: Cannot allocate memory 2012-07-27 06:55:32 DEBUG OSError(12, 'Cannot allocate memory') 2012-07-27 06:55:32 DEBUG Backing up /home/ajk/Maildir/.oldmails/cur/1343031219.30714_43721.flowerpot:2,S 2012-07-27 06:55:32 DEBUG dumping memory profiling data: at end of file content backup for /home/ajk/Maildir/.oldmails/cur/1343031219.30714_43721.flowerpot:2,S 2012-07-27 06:55:32 DEBUG VmRSS: 625756 KiB Afterward, normal logging continued. ENOMEM errors occur again when the count skyrockets and continue until they switch to too many open files, which eventually leads to the crash. -- System Information: Debian Release: wheezy/sid APT prefers testing APT policy: (990, 'testing') Architecture: i386 (i686) Kernel: Linux 2.6.32.33-kvm-i386-20111128-dirty (SMP w/1 CPU core) Locale: LANG=fi_FI.UTF-8, LC_CTYPE=fi_FI.UTF-8 (charmap=UTF-8) Shell: /bin/sh linked to /bin/bash Versions of packages obnam depends on: ii libc6 2.13-33 ii python 2.7.3~rc2-1 ii python-cliapp 1.20120630-1 ii python-larch 1.20120527-1 ii python-paramiko 1.7.7.1-3 ii python-tracing 0.6-2 ii python-ttystatus 0.19-1 obnam recommends no packages. obnam suggests no packages. -- no debconf information -- To UNSUBSCRIBE, email to [email protected] with a subject of "unsubscribe". Trouble? Contact [email protected]
