[valgrind] [Bug 399355] Add callgrind_diff
https://bugs.kde.org/show_bug.cgi?id=399355 --- Comment #14 from Philippe Waroquiers --- Note that at work, I am busy discussing to have someone working on this bug. So, some progress might happen in the coming weeks (but not for 3.15). -- You are receiving this mail because: You are watching all bug changes.
[valgrind] [Bug 399355] Add callgrind_diff
https://bugs.kde.org/show_bug.cgi?id=399355 --- Comment #13 from Nick Nethercote --- I haven't looked into the problems reported in comment 6. I don't see why this shouldn't be able to work, but the Callgrind format does have a lot of bells and whistles that the Cachegrind format does not, so they have to all be handled appropriately. -- You are receiving this mail because: You are watching all bug changes.
[valgrind] [Bug 399355] Add callgrind_diff
https://bugs.kde.org/show_bug.cgi?id=399355 --- Comment #12 from Julian Seward --- Nick, what's the situation here? Is it possible to make this work well enough to be worth landing? -- You are receiving this mail because: You are watching all bug changes.
[valgrind] [Bug 399355] Add callgrind_diff
https://bugs.kde.org/show_bug.cgi?id=399355 Bug 399355 depends on bug 399301, which changed state. Bug 399301 Summary: Use inlined frames in Massif XTree output. https://bugs.kde.org/show_bug.cgi?id=399301 What|Removed |Added Status|REPORTED|RESOLVED Resolution|--- |FIXED -- You are receiving this mail because: You are watching all bug changes.
[valgrind] [Bug 399355] Add callgrind_diff
https://bugs.kde.org/show_bug.cgi?id=399355 --- Comment #11 from Philippe Waroquiers --- When building, I also see the below error: ./callgrind/Makefile.am:1: error: docs/callgrind_diff-manpage.xml is in EXTRA_DIST but doesn't exist -- You are receiving this mail because: You are watching all bug changes.
[valgrind] [Bug 399355] Add callgrind_diff
https://bugs.kde.org/show_bug.cgi?id=399355 --- Comment #10 from Philippe Waroquiers --- (In reply to Philippe Waroquiers from comment #6) > Brainstorm idea: if ever the callgrind format allows it, it would be nice > to have a 'delta call' output also, i.e. have for each > 'call A to B' in each file produce some costs like > A has called B Calls Increase Calls Decrease > (I guess this would imply to output a fake call from A to B in the diff file > and associate some costs to this call, showing the increase/decrease). If having the delta for each 'arrow' in the callgraph as suggested above is too tricky, a maybe simpler alternative is to just produce 2 new costs 'call increase/call decrease' for each function : this will not indicate where the increase/decrease of calls is coming from, but it might be helpful in any case. -- You are receiving this mail because: You are watching all bug changes.
[valgrind] [Bug 399355] Add callgrind_diff
https://bugs.kde.org/show_bug.cgi?id=399355 --- Comment #9 from Philippe Waroquiers --- Created attachment 115775 --> https://bugs.kde.org/attachment.cgi?id=115775=edit Second big callgrind file -- You are receiving this mail because: You are watching all bug changes.
[valgrind] [Bug 399355] Add callgrind_diff
https://bugs.kde.org/show_bug.cgi?id=399355 --- Comment #8 from Philippe Waroquiers --- Created attachment 115774 --> https://bugs.kde.org/attachment.cgi?id=115774=edit First big callgrind file -- You are receiving this mail because: You are watching all bug changes.
[valgrind] [Bug 399355] Add callgrind_diff
https://bugs.kde.org/show_bug.cgi?id=399355 --- Comment #7 from Philippe Waroquiers --- (In reply to Philippe Waroquiers from comment #6) > The alternative is to have callgrind_diff producing a file with twice more > events > than the compared files: for each event (e.g. instruction fetch/syscount), > have 2 new costs in the diff file: > Instruction Fetch Increase Instruction Fetch Decrease > Syscount Increase Comment sent a little bit too early, missing Syscount Decrease. -- You are receiving this mail because: You are watching all bug changes.
[valgrind] [Bug 399355] Add callgrind_diff
https://bugs.kde.org/show_bug.cgi?id=399355
--- Comment #6 from Philippe Waroquiers ---
(In reply to Nick Nethercote from comment #5)
> Created attachment 115743 [details]
> Updated version
>
> This fixes the problem that Philippe identified.
Thanks for the fix.
Here is some more feedback with bigger files (that I will attach).
I still obtain some error messages:
callgrind_diff callgrind.out.counterp1.24494.5
callgrind.out.counterp1.17960.5 > d.out
Use of uninitialized value in subtraction (-) at
/home/philippe/valgrind/git/fixes/Inst/bin/callgrind_diff line 159.
Use of uninitialized value in subtraction (-) at
/home/philippe/valgrind/git/fixes/Inst/bin/callgrind_diff line 159.
Use of uninitialized value in subtraction (-) at
/home/philippe/valgrind/git/fixes/Inst/bin/callgrind_diff line 159.
...
The numbers obtained in the resulting file seems also not realistic.
E.g. when I look in kcachegrind the intruction fetch costs for
curtain__airspace__list__curtain_impl__airspaces_iter__asp_iter__slave__next
(a leaf function), I see:
9_933_891_910 in the 24494.5 file
and 9_901_341_110 in the 17960.5 file,
but d.out contains
fl=/cm/build12/cm/ot/ELD/GEO_FLIGHT!22.5.0.87/build_G!19.OP.L7/sources/group_iterator_g.adb
fn=curtain__airspace__list__curtain_impl__airspaces_iter__asp_iter__slave__next
0 3731582914 74 963
callgrind_annotate d.out produces some output but mixed with errors after some
lines:
Use of uninitialized value in multiplication (*) at
/home/philippe/valgrind/git/fixes/Inst/bin/callgrind_annotate line 910.
Use of uninitialized value in multiplication (*) at
/home/philippe/valgrind/git/fixes/Inst/bin/callgrind_annotate line 910.
Use of uninitialized value in multiplication (*) at
/home/philippe/valgrind/git/fixes/Inst/bin/callgrind_annotate line 910.
Also, when reading the resulting file with kcachegrind, that gives a list
of errors such as:
kcachegrind(31363): Loading "./d.out" : 9 : "Garbage at end of cost line
('-151919000 -2 -3')"
kcachegrind(31363): Loading "./d.out" : 15 : "Garbage at end of cost line
('-1 -4963')"
kcachegrind(31363): Loading "./d.out" : 21 : "Garbage at end of cost line
('-1')"
kcachegrind(31363): Loading "./d.out" : 30 : "Garbage at end of cost line
('-546')"
kcachegrind(31363): Loading "./d.out" : 36 : "Garbage at end of cost line
('-470934')"
kcachegrind(31363): Loading "./d.out" : 42 : "Garbage at end of cost line
('-161016 -1 -1')"
kcachegrind(31363): Loading "./d.out" : 48 : "Garbage at end of cost line
('-30')"
kcachegrind looks to be more strict about the callgrind format, that according
to the callgrind format grammar documentation, only allows costs >= 0:
Costs := (Number Space+)+
Number := HexNumber | (Digit)+
Not clear if it would be easy to enhance kcachegrind to support negative costs
(maybe Josef can give an idea of the complexity of this).
The alternative is to have callgrind_diff producing a file with twice more
events
than the compared files: for each event (e.g. instruction fetch/syscount),
have 2 new costs in the diff file:
Instruction Fetch Increase Instruction Fetch Decrease
Syscount Increase
and then the cost will always be positive.
Brainstorm idea: if ever the callgrind format allows it, it would be nice
to have a 'delta call' output also, i.e. have for each
'call A to B' in each file produce some costs like
A has called B Calls Increase Calls Decrease
(I guess this would imply to output a fake call from A to B in the diff file
and associate some costs to this call, showing the increase/decrease).
--
You are receiving this mail because:
You are watching all bug changes.
[valgrind] [Bug 399355] Add callgrind_diff
https://bugs.kde.org/show_bug.cgi?id=399355 Nick Nethercote changed: What|Removed |Added Attachment #115396|0 |1 is obsolete|| --- Comment #5 from Nick Nethercote --- Created attachment 115743 --> https://bugs.kde.org/attachment.cgi?id=115743=edit Updated version This fixes the problem that Philippe identified. -- You are receiving this mail because: You are watching all bug changes.
[valgrind] [Bug 399355] Add callgrind_diff
https://bugs.kde.org/show_bug.cgi?id=399355 Nick Nethercote changed: What|Removed |Added Depends on|399322 | Referenced Bugs: https://bugs.kde.org/show_bug.cgi?id=399322 [Bug 399322] Improve callgrind_annotate output -- You are receiving this mail because: You are watching all bug changes.
[valgrind] [Bug 399355] Add callgrind_diff
https://bugs.kde.org/show_bug.cgi?id=399355 Bug 399355 depends on bug 399322, which changed state. Bug 399322 Summary: Improve callgrind_annotate output https://bugs.kde.org/show_bug.cgi?id=399322 What|Removed |Added Status|REPORTED|RESOLVED Resolution|--- |FIXED -- You are receiving this mail because: You are watching all bug changes.
[valgrind] [Bug 399355] Add callgrind_diff
https://bugs.kde.org/show_bug.cgi?id=399355 --- Comment #4 from Nick Nethercote --- Thank you for the feedback. I will look at the failures next week. -- You are receiving this mail because: You are watching all bug changes.
[valgrind] [Bug 399355] Add callgrind_diff
https://bugs.kde.org/show_bug.cgi?id=399355 Philippe Waroquiers changed: What|Removed |Added CC||philippe.waroquiers@skynet. ||be --- Comment #3 from Philippe Waroquiers --- I tried callgrind_diff at work on big callgrind out files, but I got several error messages. At least one of them can be reproduced by doing: ./vg-in-place --tool=callgrind --dump-instr=yes --collect-jumps=yes --collect-systime=yes ./perf/memrw -l 5 ./vg-in-place --tool=callgrind --dump-instr=yes --collect-jumps=yes --collect-systime=yes ./perf/memrw -l 3 and then running callgrind_diff on the resulting 2 files: ./Inst/bin/callgrind_diff callgrind.out.8448 callgrind.out.8452 Line 179: too many event counts On the big file, before this 'too many event counts', I have a bunch of errors such as: Argument "*" isn't numeric in addition (+) at /home/philippe/valgrind/git/fixes/Inst/bin/callgrind_diff line 139, line 27. Argument "*" isn't numeric in addition (+) at /home/philippe/valgrind/git/fixes/Inst/bin/callgrind_diff line 139, line 28. Argument "*" isn't numeric in addition (+) at /home/philippe/valgrind/git/fixes/Inst/bin/callgrind_diff line 139, line 29. Argument "*" isn't numeric in addition (+) at /home/philippe/valgrind/git/fixes/Inst/bin/callgrind_diff line 139, line 32. Argument "*" isn't numeric in addition (+) at /home/philippe/valgrind/git/fixes/Inst/bin/callgrind_diff line 139, line 34. Argument "*" isn't numeric in addition (+) at /home/philippe/valgrind/git/fixes/Inst/bin/callgrind_diff line 139, line 35. The first few lines of the big callgrind files are: # callgrind format version: 1 creator: callgrind-3.14.0.GIT pid: 24494 cmd: counterp_process part: 5 desc: I1 cache: desc: D1 cache: desc: LL cache: desc: Timerange: Basic block 21282324349 - 244375501750 desc: Trigger: dump End_of_script_./replay/scripts/minutely_targets.replay.el positions: instr line events: Ir sysCount sysTime summary: 1006404365481 50339204 252715138 ob=(3) /usr/lib64/libc-2.17.so fl=(613) /usr/src/debug/glibc-2.17-c758a686/misc/tsearch.c fn=(4236) tfind 0xf43a0 307 2 +2 +3 2 +3 -3 2 +3 * 2 +1 * 2 +3 * 2 +1 +3 2 jcnd=2/2 +37 +5 * * +37 +5 2 +3 * 2 +3 * 2 +2 +12 2 +1 * 2 +1 -16 2 +2 +16 2 +2 * 2 -- You are receiving this mail because: You are watching all bug changes.
[valgrind] [Bug 399355] Add callgrind_diff
https://bugs.kde.org/show_bug.cgi?id=399355 --- Comment #2 from Nick Nethercote --- Is it really worth splitting the patch? I guess you could put the threshold changes in one patch and everything else in another, but it doesn't seem worth the effort. I did the original threshold changes in Cachegrind while writing cg_diff... I don't remember the exact reason (it was a few years ago) but I did the threshold changes in response to the results I was getting from cg_diff. -- You are receiving this mail because: You are watching all bug changes.
[valgrind] [Bug 399355] Add callgrind_diff
https://bugs.kde.org/show_bug.cgi?id=399355 --- Comment #1 from Josef Weidendorfer --- On a first look, this patch looks fine. I would split the unrelated parts into separate commits (I can do that). -- You are receiving this mail because: You are watching all bug changes.
