Re: How can the total memory consumption rise without top/htop displaying increasing processes' use?

[Rabin Yasharzadehe]

Maybe it's writing/logging something to a tmpfs folder (like /tmp)

--
Rabin

On 3 August 2016 at 16:43, Shlomi Fish  wrote:

> Hi all,
>
> On Wed, Aug 3, 2016 at 3:23 PM, Shlomi Fish  wrote:
>
>> Hi all!
>>
>> I reported a bug in VLC earlier today about it causing increasing total
>> RAM consumption:
>>
>> https://trac.videolan.org/vlc/ticket/17241
>>
>> However, the strange thing is when it happens, the %MEM usage of the
>> system increases, but I don't see it in htop/top (as root)'s individual
>> processes' RAM consumption. And the memory gets freed after I quit VLC
>> Player.
>>
>> Why? How is it possible? Where does all the memory go?
>>
>> I'm on mageia v6 x86-64 with :
>>
>> shlomif@telaviv1:~$ uname -a
>> Linux telaviv1.shlomifish.org 4.7.0-desktop-2.mga6 #1 SMP Sat Jul 30
>> 21:54:30 UTC 2016 x86_64 x86_64 x86_64 GNU/Linux
>>
>> Is this a bug somewhere? Any insights will be appreciated.
>>
>>
> One update is that I discovered that the VLC process's "VIRT" column in
> htop continuously increases while it is exhibiting this problem while the
> rest of the memory-related columns (including the percentage) remain the
> same.
>
> M_SIZE (VIRT)
> The size of the virtual memory of the process.
>
>
> Thanks to someone on Freenode for the tip.
>
> --
> Shlomi Fish http://www.shlomifish.org/
>
> You can never truly appreciate The Gilmore Girls until you've watched it
> in the original Klingon.
>
> Please reply to list if it's a mailing list post - http://shlom.in/reply .
>
> ___
> Linux-il mailing list
> Linux-il@cs.huji.ac.il
> http://mailman.cs.huji.ac.il/mailman/listinfo/linux-il
>
>
___
Linux-il mailing list
Linux-il@cs.huji.ac.il
http://mailman.cs.huji.ac.il/mailman/listinfo/linux-il

Re: How can the total memory consumption rise without top/htop displaying increasing processes' use?

[Shlomi Fish]

Hi all,

On Wed, Aug 3, 2016 at 3:23 PM, Shlomi Fish  wrote:

> Hi all!
>
> I reported a bug in VLC earlier today about it causing increasing total
> RAM consumption:
>
> https://trac.videolan.org/vlc/ticket/17241
>
> However, the strange thing is when it happens, the %MEM usage of the
> system increases, but I don't see it in htop/top (as root)'s individual
> processes' RAM consumption. And the memory gets freed after I quit VLC
> Player.
>
> Why? How is it possible? Where does all the memory go?
>
> I'm on mageia v6 x86-64 with :
>
> shlomif@telaviv1:~$ uname -a
> Linux telaviv1.shlomifish.org 4.7.0-desktop-2.mga6 #1 SMP Sat Jul 30
> 21:54:30 UTC 2016 x86_64 x86_64 x86_64 GNU/Linux
>
> Is this a bug somewhere? Any insights will be appreciated.
>
>
One update is that I discovered that the VLC process's "VIRT" column in
htop continuously increases while it is exhibiting this problem while the
rest of the memory-related columns (including the percentage) remain the
same.

M_SIZE (VIRT)
The size of the virtual memory of the process.


Thanks to someone on Freenode for the tip.

-- 
Shlomi Fish http://www.shlomifish.org/

You can never truly appreciate The Gilmore Girls until you've watched it in
the original Klingon.

Please reply to list if it's a mailing list post - http://shlom.in/reply .
___
Linux-il mailing list
Linux-il@cs.huji.ac.il
http://mailman.cs.huji.ac.il/mailman/listinfo/linux-il

Re: How can the total memory consumption rise without top/htop displaying increasing processes' use?

[Shlomi Fish]

Hi E. S.,

On Wed, Aug 3, 2016 at 3:37 PM, E.S. Rosenberg 
wrote:

> This is just a hunch but I think filesystem caching is not counted
> towards a process' memory usage, so if you are playing a large movie a
> large chunk (or the whole file) may be kept in memory by the
> filesystem driver while being memory that is 'available' for immediate
> freeing it is counted as %used but not as process used since it's the
> driver/kernel.
>
>
Thanks for your reply.

However, it also happens to me when playing a file that is 28,407,200 bytes
in size while I have over 7 GB of RAM and it consumes hundreds and
thousands of megabytes. So it seems unlikely that this is the case here.
That put aside, I now have an idea to run vlc under strace and see what it
can reveal - so thank you.

Regards,

-- Shlomi Fish




-- 
Shlomi Fish http://www.shlomifish.org/

You can never truly appreciate The Gilmore Girls until you've watched it in
the original Klingon.

Please reply to list if it's a mailing list post - http://shlom.in/reply .
___
Linux-il mailing list
Linux-il@cs.huji.ac.il
http://mailman.cs.huji.ac.il/mailman/listinfo/linux-il

Re: How can the total memory consumption rise without top/htop displaying increasing processes' use?

[E.S. Rosenberg]

This is just a hunch but I think filesystem caching is not counted
towards a process' memory usage, so if you are playing a large movie a
large chunk (or the whole file) may be kept in memory by the
filesystem driver while being memory that is 'available' for immediate
freeing it is counted as %used but not as process used since it's the
driver/kernel.

2016-08-03 15:23 GMT+03:00 Shlomi Fish :
> Hi all!
>
> I reported a bug in VLC earlier today about it causing increasing total RAM
> consumption:
>
> https://trac.videolan.org/vlc/ticket/17241
>
> However, the strange thing is when it happens, the %MEM usage of the system
> increases, but I don't see it in htop/top (as root)'s individual processes'
> RAM consumption. And the memory gets freed after I quit VLC Player.
>
> Why? How is it possible? Where does all the memory go?
>
> I'm on mageia v6 x86-64 with :
>
> shlomif@telaviv1:~$ uname -a
> Linux telaviv1.shlomifish.org 4.7.0-desktop-2.mga6 #1 SMP Sat Jul 30
> 21:54:30 UTC 2016 x86_64 x86_64 x86_64 GNU/Linux
>
> Is this a bug somewhere? Any insights will be appreciated.
>
> Regards,
>
>  -- Shlomi Fish
>
> --
> Shlomi Fish http://www.shlomifish.org/
>
> You can never truly appreciate The Gilmore Girls until you've watched it in
> the original Klingon.
>
> Please reply to list if it's a mailing list post - http://shlom.in/reply .
>
> ___
> Linux-il mailing list
> Linux-il@cs.huji.ac.il
> http://mailman.cs.huji.ac.il/mailman/listinfo/linux-il
>

___
Linux-il mailing list
Linux-il@cs.huji.ac.il
http://mailman.cs.huji.ac.il/mailman/listinfo/linux-il