On 2021-06-16 1:33 p.m., Richard Purdie wrote:
[Please note: This e-mail is from an EXTERNAL e-mail address]
On Wed, 2021-06-16 at 04:43 -0400, [email protected] wrote:
summarize_top_output.py is used to summarize the top
output that is captured during autobuilder intermittent
failures.
Use the script to summarize the host top output and
publish the summary that is created instead of
the raw logfile.
[...]
if jcfg:
diff --git a/scripts/summarize_top_output.py b/scripts/summarize_top_output.py
new file mode 100755
index 0000000..0606a34
--- /dev/null
+++ b/scripts/summarize_top_output.py
@@ -0,0 +1,132 @@
+#!/usr/bin/env python3
+
+import os, sys, glob
+
+# constants
+top_header = 7
+top_summary = 5
+max_cols = 11
+
+# string substitution to make things easier to read
+subs = {
+ "/home/pokybuild/yocto-worker/" : "~/",
+ "/build/build/tmp/work/core2-32-poky-linux/" : "/.../POKY_32/.../",
+ "/build/build/tmp/work/core2-64-poky-linux/" : "/.../POKY_64/.../",
+
"/recipe-sysroot-native/usr/bin/x86_64-poky-linux/../../libexec/x86_64-poky-linux/gcc/x86_64-poky-linux/"
: "/...GCC.../"
+}
One quick question - the above assumes an x86 target machine using those two
tunes.
Should that be wildcarded?
Cheers,
Richard
Yes it should be. We've looked at a number of logs and I will send a V2
with wild-carding for the cross-compiler paths.
After the V2, I plan on submitting patches for the following in roughly
the presented order:
1) any process that is listed once (singleton) is not reported in the
summary, but we are planning to make exceptions for "special" commands
such as "rm" and "tar"
2) i noticed some zombie processes and it might be worthwhile to report
them. Right now they are not indicated in the summary. Should we report
all zombies or ignore the singletons?
For example I'd collapse [Parser-31], [Parser-32] into [Parser-N]
3) It would be nice to specify other builds going on and the top level
directory
4) currently top does not show PPID, should we include the information
in the output? This is useful for more context in the raw logfile.
5) show top 5 or 10 virtual memory users
From the yp-ab index page, there are no logs for arm host. I will run a
build and make sure the script work well there as well.
Any ideas on why the arm host builds are not being shown on the index page?
Sakib
-=-=-=-=-=-=-=-=-=-=-=-
Links: You receive all messages sent to this group.
View/Reply Online (#53903): https://lists.yoctoproject.org/g/yocto/message/53903
Mute This Topic: https://lists.yoctoproject.org/mt/83576331/21656
Group Owner: [email protected]
Unsubscribe: https://lists.yoctoproject.org/g/yocto/unsub
[[email protected]]
-=-=-=-=-=-=-=-=-=-=-=-
