Re: Ccache hangs while compiling and cache size is exaggerated

2011-01-09 Thread Dima Panov
Hello!

08.01.2011, 21:00, Denny Lin dennyli...@hs.ntnu.edu.tw:
 On Tue, Jan 04, 2011 at 04:23:12AM +0200, Volodymyr Kostyrko wrote:

  02.01.2011 16:01, Anonymous wrote:
 I'm using ccache 3.1.3, and it often hangs while compiling.
 What its waiting channel? Hit ^T when it hangs or run under ktrace(1).

 This is what appears when I hit ^T:
 load: 0.96  cmd: ccache 25893 [zio-io_cv)] 3.83r 0.00u 0.06s 1% 1604k

  Not just every compilation attempt triggers it. Chances are closer to 100/1.

 Correct, but it's always triggered at the same point.

 Every time this happens, the cache size from $ ccache -s also becomes
 ridiculously large (larger than the actual cache size).

 $ ccache -s
 [...]
 cache size    6.9 Gbytes
 The filesystem says it's only 2.9 GB.
 How did you measure it? du(1) with `-A' option?
 For example, compression can make difference

 Compression is turned off.

  I'd clarify this one. ccache reports size of cache +4G per damaged
  subdir. If damaged subdir would be removed ccache reports normal size of
  cache again.
 I can reproduce this, but I don't know what is causing this.
  This gives high IO. When ccache thinks cache is full it tries to purge
  it, yet purge does nothing. But this means walking all subdir per each
  compilation.

 This seems to be the exact reason ccache is hanging. Does anyone have a
 clue why subdirs are getting damaged and how this can be prevented?

I'm also affected by ccache stalling is some circumstances. 
In my case it's mostly for large ports with parallell build enabled 
(MAKE_JOBS_SAFE)


-- 
Dima Panov (flu...@freebsd.org)
k...@freebsd team

Facebook: http://www.facebook.com/?id=10181104157
___
freebsd-ports@freebsd.org mailing list
http://lists.freebsd.org/mailman/listinfo/freebsd-ports
To unsubscribe, send any mail to freebsd-ports-unsubscr...@freebsd.org


Re: Ccache hangs while compiling and cache size is exaggerated

2011-01-08 Thread Denny Lin
On Tue, Jan 04, 2011 at 04:23:12AM +0200, Volodymyr Kostyrko wrote:
 02.01.2011 16:01, Anonymous wrote:
 I'm using ccache 3.1.3, and it often hangs while compiling.
 
 What its waiting channel? Hit ^T when it hangs or run under ktrace(1).

This is what appears when I hit ^T:
load: 0.96  cmd: ccache 25893 [zio-io_cv)] 3.83r 0.00u 0.06s 1% 1604k

 Not just every compilation attempt triggers it. Chances are closer to 100/1.

Correct, but it's always triggered at the same point.

 Every time this happens, the cache size from $ ccache -s also becomes
 ridiculously large (larger than the actual cache size).
 
 $ ccache -s
 [...]
 cache size6.9 Gbytes
 
 The filesystem says it's only 2.9 GB.
 
 How did you measure it? du(1) with `-A' option?
 For example, compression can make difference

Compression is turned off.

 I'd clarify this one. ccache reports size of cache +4G per damaged 
 subdir. If damaged subdir would be removed ccache reports normal size of 
 cache again.
 
 I can reproduce this, but I don't know what is causing this.
 
 This gives high IO. When ccache thinks cache is full it tries to purge 
 it, yet purge does nothing. But this means walking all subdir per each 
 compilation.

This seems to be the exact reason ccache is hanging. Does anyone have a
clue why subdirs are getting damaged and how this can be prevented?

-- 
Denny Lin
___
freebsd-ports@freebsd.org mailing list
http://lists.freebsd.org/mailman/listinfo/freebsd-ports
To unsubscribe, send any mail to freebsd-ports-unsubscr...@freebsd.org


Re: Ccache hangs while compiling and cache size is exaggerated

2011-01-03 Thread Volodymyr Kostyrko

02.01.2011 16:01, Anonymous wrote:

I'm using ccache 3.1.3, and it often hangs while compiling.


What its waiting channel? Hit ^T when it hangs or run under ktrace(1).


Not just every compilation attempt triggers it. Chances are closer to 100/1.


Every time this happens, the cache size from $ ccache -s also becomes
ridiculously large (larger than the actual cache size).

$ ccache -s
[...]
cache size6.9 Gbytes



The filesystem says it's only 2.9 GB.


How did you measure it? du(1) with `-A' option?
For example, compression can make difference

   $ df ~/.ccache
   Filesystem SizeUsed   Avail Capacity  Mounted on
   /.../.ccache49G666M 48G 1%~/.ccache

   $ du -hs ~/.ccache
   666M~/.ccache

   $ du -Ahs ~/.ccache
   912M~/.ccache


I'd clarify this one. ccache reports size of cache +4G per damaged 
subdir. If damaged subdir would be removed ccache reports normal size of 
cache again.



I can reproduce this, but I don't know what is causing this.


This gives high IO. When ccache thinks cache is full it tries to purge 
it, yet purge does nothing. But this means walking all subdir per each 
compilation.


--
Sphinx of black quartz judge my vow.
___
freebsd-ports@freebsd.org mailing list
http://lists.freebsd.org/mailman/listinfo/freebsd-ports
To unsubscribe, send any mail to freebsd-ports-unsubscr...@freebsd.org


Ccache hangs while compiling and cache size is exaggerated

2011-01-02 Thread Denny Lin
Hi,

I'm using ccache 3.1.3, and it often hangs while compiling. Every time
this happens, the cache size from $ ccache -s also becomes ridiculously
large (larger than the actual cache size).

$ ccache -s
[...]
cache size6.9 Gbytes

The filesystem says it's only 2.9 GB.

I can reproduce this, but I don't know what is causing this.

-- 
Denny Lin
___
freebsd-ports@freebsd.org mailing list
http://lists.freebsd.org/mailman/listinfo/freebsd-ports
To unsubscribe, send any mail to freebsd-ports-unsubscr...@freebsd.org


Re: Ccache hangs while compiling and cache size is exaggerated

2011-01-02 Thread Anonymous
Denny Lin dennyli...@hs.ntnu.edu.tw writes:

 Hi,

 I'm using ccache 3.1.3, and it often hangs while compiling.

What its waiting channel? Hit ^T when it hangs or run under ktrace(1).

 Every time this happens, the cache size from $ ccache -s also becomes
 ridiculously large (larger than the actual cache size).

 $ ccache -s
 [...]
 cache size6.9 Gbytes

 The filesystem says it's only 2.9 GB.

How did you measure it? du(1) with `-A' option?
For example, compression can make difference

  $ df ~/.ccache
  Filesystem SizeUsed   Avail Capacity  Mounted on
  /.../.ccache49G666M 48G 1%~/.ccache

  $ du -hs ~/.ccache
  666M~/.ccache

  $ du -Ahs ~/.ccache
  912M~/.ccache


 I can reproduce this, but I don't know what is causing this.
___
freebsd-ports@freebsd.org mailing list
http://lists.freebsd.org/mailman/listinfo/freebsd-ports
To unsubscribe, send any mail to freebsd-ports-unsubscr...@freebsd.org