On Mon, Jan 24, 2011 at 12:47 AM, Carl Karsten <c...@personnelware.com> wrote: > I could use some help tracking down why melt is eating memory and > getting killed. > > It is about the same parameters as I used a week ago to encode 2 1 > hour videos. The main difference is I am currently using pal, the 1 > hour videos were ntsc. > > I am using 0.6.0 from ppa:kxstudio-team/ppa and ffmpeg > libavcodec-extra-52 libavdevice-extra-52 libavfilter-extra-1 > libavformat-extra-52 libavutil-extra-50 libpostproc-extra-51 from > packages.medibuntu.org > > top - 00:36:47 up 1:42, 4 users, load average: 3.39, 2.29, 1.42 > Tasks: 117 total, 1 running, 116 sleeping, 0 stopped, 0 zombie > Cpu0 : 15.4%us, 5.7%sy, 0.0%ni, 0.3%id, 76.6%wa, 0.0%hi, 2.0%si, 0.0%st > Cpu1 : 7.9%us, 2.8%sy, 0.0%ni, 51.0%id, 37.9%wa, 0.0%hi, 0.3%si, 0.0%st > Mem: 2014880k total, 1998180k used, 16700k free, 264k buffers > Swap: 4016124k total, 3842720k used, 173404k free, 17112k cached > > PID USER PR NI VIRT RES SHR S %CPU %MEM TIME+ COMMAND > 3429 carl 20 0 6840m 1.7g 1252 S 35 91.0 3:05.08 melt > 33 root 20 0 0 0 0 S 4 0.0 1:11.73 kswapd0 > 21 root 20 0 0 0 0 S 0 0.0 0:05.30 kblockd/0 > 2128 carl 20 0 85372 236 192 S 0 0.0 0:02.18 sshd > 1 root 20 0 23900 184 184 S 0 0.0 0:00.57 init > 2 root 20 0 0 0 0 S 0 0.0 0:00.00 kthreadd > > [ 6168.711803] oom_kill_process: 24 callbacks suppressed > [ 6168.711809] iwl3945 invoked oom-killer: gfp_mask=0x2d0, order=0, oom_adj=0 > [ 6168.711813] iwl3945 cpuset=/ mems_allowed=0 > [ 6168.711817] Pid: 806, comm: iwl3945 Not tainted 2.6.35-24-generic > #42-Ubuntu > [ 6168.711820] Call Trace: > [ 6168.711831] [<ffffffff810aefcd>] ? > cpuset_print_task_mems_allowed+0x9d/0xb0 > [ 6168.711837] [<ffffffff811044c1>] dump_header+0x81/0xc0 > [ 6168.711841] [<ffffffff81104581>] oom_kill_process+0x81/0x180 > [ 6168.711845] [<ffffffff81104ab8>] __out_of_memory+0x58/0xd0 > [ 6168.711849] [<ffffffff81104bb6>] out_of_memory+0x86/0x1c0 > [ 6168.711854] [<ffffffff8110854e>] __alloc_pages_slowpath+0x58e/0x5a0 > [ 6168.711859] [<ffffffff811086fa>] __alloc_pages_nodemask+0x19a/0x1f0 > [ 6168.711864] [<ffffffff8104d388>] ? update_curr+0xf8/0x1e0 > [ 6168.711869] [<ffffffff8113a75a>] alloc_pages_current+0x9a/0x100 > [ 6168.711882] [<ffffffffa0330be7>] iwl3945_rx_allocate+0x107/0x270 [iwl3945] > [ 6168.711888] [<ffffffffa0330f20>] ? > iwl3945_bg_rx_replenish+0x0/0x50 [iwl3945] > [ 6168.711894] [<ffffffffa0330eed>] iwl3945_rx_replenish+0x2d/0x60 [iwl3945] > [ 6168.711900] [<ffffffffa0330f20>] ? > iwl3945_bg_rx_replenish+0x0/0x50 [iwl3945] > [ 6168.711906] [<ffffffffa0330f5d>] iwl3945_bg_rx_replenish+0x3d/0x50 > [iwl3945] > [ 6168.711912] [<ffffffff8107a885>] run_workqueue+0xc5/0x1a0 > [ 6168.711916] [<ffffffff8107aa03>] worker_thread+0xa3/0x110 > [ 6168.711920] [<ffffffff8107f730>] ? autoremove_wake_function+0x0/0x40 > [ 6168.711925] [<ffffffff8107a960>] ? worker_thread+0x0/0x110 > [ 6168.711928] [<ffffffff8107f1d6>] kthread+0x96/0xa0 > [ 6168.711933] [<ffffffff8100aee4>] kernel_thread_helper+0x4/0x10 > [ 6168.711937] [<ffffffff8107f140>] ? kthread+0x0/0xa0 > [ 6168.711941] [<ffffffff8100aee0>] ? kernel_thread_helper+0x0/0x10 > [ 6168.711944] Mem-Info: > [ 6168.711946] Node 0 DMA per-cpu: > [ 6168.711949] CPU 0: hi: 0, btch: 1 usd: 0 > [ 6168.711952] CPU 1: hi: 0, btch: 1 usd: 0 > [ 6168.711954] Node 0 DMA32 per-cpu: > [ 6168.711958] CPU 0: hi: 186, btch: 31 usd: 10 > [ 6168.711961] CPU 1: hi: 186, btch: 31 usd: 171 > [ 6168.711967] active_anon:351995 inactive_anon:118020 isolated_anon:0 > [ 6168.711969] active_file:31 inactive_file:48 isolated_file:0 > [ 6168.711970] unevictable:0 dirty:1 writeback:0 unstable:0 > [ 6168.711972] free:3384 slab_reclaimable:1841 slab_unreclaimable:3265 > [ 6168.711973] mapped:25 shmem:3156 pagetables:4505 bounce:0 > [ 6168.711976] Node 0 DMA free:7892kB min:44kB low:52kB high:64kB > active_anon:3756kB inactive_anon:3956kB active_file:0kB > inactive_file:56kB unevictable:0kB isolated(anon):0kB > isolated(file):0kB present:15700kB mlocked:0kB dirty:0kB writeback:0kB > mapped:4kB shmem:0kB slab_reclaimable:0kB slab_unreclaimable:0kB > kernel_stack:0kB pagetables:80kB unstable:0kB bounce:0kB > writeback_tmp:0kB pages_scanned:88 all_unreclaimable? no > [ 6168.711989] lowmem_reserve[]: 0 1963 1963 1963 > [ 6168.711994] Node 0 DMA32 free:5644kB min:5644kB low:7052kB > high:8464kB active_anon:1404224kB inactive_anon:468124kB > active_file:124kB inactive_file:136kB unevictable:0kB > isolated(anon):0kB isolated(file):0kB present:2010592kB mlocked:0kB > dirty:4kB writeback:0kB mapped:96kB shmem:12624kB > slab_reclaimable:7364kB slab_unreclaimable:13060kB kernel_stack:1520kB > pagetables:17940kB unstable:0kB bounce:0kB writeback_tmp:0kB > pages_scanned:672 all_unreclaimable? yes > [ 6168.712008] lowmem_reserve[]: 0 0 0 0 > [ 6168.712013] Node 0 DMA: 7*4kB 15*8kB 4*16kB 2*32kB 3*64kB 2*128kB > 0*256kB 0*512kB 1*1024kB 1*2048kB 1*4096kB = 7892kB > [ 6168.712027] Node 0 DMA32: 357*4kB 7*8kB 4*16kB 0*32kB 0*64kB > 0*128kB 0*256kB 0*512kB 0*1024kB 0*2048kB 1*4096kB = 5644kB > [ 6168.712040] 3523 total pagecache pages > [ 6168.712042] 274 pages in swap cache > [ 6168.712045] Swap cache stats: add 7535563, delete 7535289, find > 2050769/2358827 > [ 6168.712048] Free swap = 0kB > [ 6168.712050] Total swap = 4016124kB > [ 6168.719049] 513696 pages RAM > [ 6168.719052] 9977 pages reserved > [ 6168.719054] 3249 pages shared > [ 6168.719056] 496651 pages non-shared > [ 6168.719060] Out of memory: kill process 3428 (go.sh) score 912155 or a > child > [ 6168.719114] Killed process 3429 (melt) vsz:7268644kB, > anon-rss:1862232kB, file-rss:0kB > [ 6168.722640] iwl3945 invoked oom-killer: gfp_mask=0x2d0, order=0, oom_adj=0 > [ 6168.722646] iwl3945 cpuset=/ mems_allowed=0 > [ 6168.722651] Pid: 806, comm: iwl3945 Not tainted 2.6.35-24-generic > #42-Ubuntu > [ 6168.722655] Call Trace: > [ 6168.722666] [<ffffffff810aefcd>] ? > cpuset_print_task_mems_allowed+0x9d/0xb0 > [ 6168.722674] [<ffffffff811044c1>] dump_header+0x81/0xc0 > [ 6168.722679] [<ffffffff81104581>] oom_kill_process+0x81/0x180 > [ 6168.722685] [<ffffffff81104ab8>] __out_of_memory+0x58/0xd0 > [ 6168.722690] [<ffffffff81104bb6>] out_of_memory+0x86/0x1c0 > [ 6168.722696] [<ffffffff8110854e>] __alloc_pages_slowpath+0x58e/0x5a0 > [ 6168.722703] [<ffffffff811086fa>] __alloc_pages_nodemask+0x19a/0x1f0 > [ 6168.722710] [<ffffffff8104d388>] ? update_curr+0xf8/0x1e0 > [ 6168.722716] [<ffffffff8113a75a>] alloc_pages_current+0x9a/0x100 > [ 6168.722731] [<ffffffffa0330be7>] iwl3945_rx_allocate+0x107/0x270 [iwl3945] > [ 6168.722742] [<ffffffffa0330f20>] ? > iwl3945_bg_rx_replenish+0x0/0x50 [iwl3945] > [ 6168.722748] [<ffffffffa0330eed>] iwl3945_rx_replenish+0x2d/0x60 [iwl3945] > [ 6168.722754] [<ffffffffa0330f20>] ? > iwl3945_bg_rx_replenish+0x0/0x50 [iwl3945] > [ 6168.722760] [<ffffffffa0330f5d>] iwl3945_bg_rx_replenish+0x3d/0x50 > [iwl3945] > [ 6168.722765] [<ffffffff8107a885>] run_workqueue+0xc5/0x1a0 > [ 6168.722769] [<ffffffff8107aa03>] worker_thread+0xa3/0x110 > [ 6168.722774] [<ffffffff8107f730>] ? autoremove_wake_function+0x0/0x40 > [ 6168.722778] [<ffffffff8107a960>] ? worker_thread+0x0/0x110 > [ 6168.722782] [<ffffffff8107f1d6>] kthread+0x96/0xa0 > [ 6168.722787] [<ffffffff8100aee4>] kernel_thread_helper+0x4/0x10 > [ 6168.722791] [<ffffffff8107f140>] ? kthread+0x0/0xa0 > [ 6168.722795] [<ffffffff8100aee0>] ? kernel_thread_helper+0x0/0x10 > [ 6168.722797] Mem-Info: > [ 6168.722799] Node 0 DMA per-cpu: > [ 6168.722803] CPU 0: hi: 0, btch: 1 usd: 0 > [ 6168.722806] CPU 1: hi: 0, btch: 1 usd: 0 > [ 6168.722808] Node 0 DMA32 per-cpu: > [ 6168.722812] CPU 0: hi: 186, btch: 31 usd: 10 > [ 6168.722815] CPU 1: hi: 186, btch: 31 usd: 171 > [ 6168.722821] active_anon:351995 inactive_anon:118020 isolated_anon:0 > [ 6168.722823] active_file:31 inactive_file:48 isolated_file:0 > [ 6168.722824] unevictable:0 dirty:1 writeback:0 unstable:0 > [ 6168.722825] free:3384 slab_reclaimable:1841 slab_unreclaimable:3265 > [ 6168.722827] mapped:25 shmem:3156 pagetables:4505 bounce:0 > [ 6168.722830] Node 0 DMA free:7892kB min:44kB low:52kB high:64kB > active_anon:3756kB inactive_anon:3956kB active_file:0kB > inactive_file:56kB unevictable:0kB isolated(anon):0kB > isolated(file):0kB present:15700kB mlocked:0kB dirty:0kB writeback:0kB > mapped:4kB shmem:0kB slab_reclaimable:0kB slab_unreclaimable:0kB > kernel_stack:0kB pagetables:80kB unstable:0kB bounce:0kB > writeback_tmp:0kB pages_scanned:88 all_unreclaimable? yes > [ 6168.722843] lowmem_reserve[]: 0 1963 1963 1963 > [ 6168.722848] Node 0 DMA32 free:5644kB min:5644kB low:7052kB > high:8464kB active_anon:1404224kB inactive_anon:468124kB > active_file:124kB inactive_file:136kB unevictable:0kB > isolated(anon):0kB isolated(file):0kB present:2010592kB mlocked:0kB > dirty:4kB writeback:0kB mapped:96kB shmem:12624kB > slab_reclaimable:7364kB slab_unreclaimable:13060kB kernel_stack:1520kB > pagetables:17940kB unstable:0kB bounce:0kB writeback_tmp:0kB > pages_scanned:672 all_unreclaimable? yes > [ 6168.722862] lowmem_reserve[]: 0 0 0 0 > [ 6168.722867] Node 0 DMA: 7*4kB 15*8kB 4*16kB 2*32kB 3*64kB 2*128kB > 0*256kB 0*512kB 1*1024kB 1*2048kB 1*4096kB = 7892kB > [ 6168.722881] Node 0 DMA32: 357*4kB 7*8kB 4*16kB 0*32kB 0*64kB > 0*128kB 0*256kB 0*512kB 0*1024kB 0*2048kB 1*4096kB = 5644kB > [ 6168.722894] 3523 total pagecache pages > [ 6168.722896] 274 pages in swap cache > [ 6168.722899] Swap cache stats: add 7535563, delete 7535289, find > 2050769/2358828 > [ 6168.722902] Free swap = 0kB > [ 6168.722904] Total swap = 4016124kB > [ 6168.729402] 513696 pages RAM > [ 6168.729404] 9977 pages reserved > [ 6168.729406] 3249 pages shared > [ 6168.729408] 496650 pages non-shared > [ 6168.729412] Out of memory: kill process 726 (rsyslogd) score 31507 or a > child > [ 6168.729462] Killed process 726 (rsyslogd) vsz:126028kB, > anon-rss:0kB, file-rss:0kB > > ps, I am at http://linux.conf.au noc so if you want to come over and debug...
Oh yeah, and here is the command melt -progress -profile square_pal welcome.mlt -consumer avformat:welcome.flv progressive=1 acodec=libfaac ab=96k ar=44100 vcodec=libx264 -b=240k vpre=/usr/share/ffmpeg/libx264-hq.ffpreset /usr/share/ffmpeg/libx264-hq.ffpreset: [ ref=1, coder=1, flags=+loop, cmp=+chroma, partitions=+parti8x8+parti4x4+partp8x8+partb8x8, me_method=umh, subq=8, me_range=16, g=250, keyint_min=25, sc_threshold=40, i_qfactor=0.71, b_strategy=2, qcomp=0.6, qmin=10, qmax=51, qdiff=4, bf=3, refs=4, directpred=3, trellis=1, flags2=+wpred+mixed_refs+dct8x8+fastpskip, wpredp=2 ] -- Carl K ------------------------------------------------------------------------------ Special Offer-- Download ArcSight Logger for FREE (a $49 USD value)! Finally, a world-class log management solution at an even better price-free! Download using promo code Free_Logger_4_Dev2Dev. Offer expires February 28th, so secure your free ArcSight Logger TODAY! http://p.sf.net/sfu/arcsight-sfd2d _______________________________________________ Mlt-devel mailing list Mlt-devel@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/mlt-devel
