Re: Removing [PID] prefix from |make mozmill| warning/error/assertion lines?
On (2014年04月22日 08:11), Zack Weinberg wrote: On 2014-04-21 1:07 PM, Steve Fink wrote: On Sat 19 Apr 2014 08:36:22 AM PDT, ISHIKAWA,chiaki wrote: egrep ^(\\[[0-9]*\\] |)WARNING $1 | egrep NS_ENSURE | grep -v sort operation has occurred for the SQL statement | sort | uniq -f1 -c | sort -n -r It'd be easier if you threw in a *little* bit of perl: perl -lne 'print $1 if /WARNING: (NS_ENSURE.*)/' | sort | uniq -c | sort -nr If you're going to use perl, you might as well use perl: perl -e 'my %hits; while () { $hits{$1}++ if /WARNING: (NS_ENSURE.*)/ } printf(%d\t%s\n, $hits{$_}, $_) for sort { $hits{$b} = $hits{$a} } keys %hits;' Untested but, I believe, equivalent. Could perhaps be further optimized by use of each() instead of keys() but I have forgotten too much to do it myself. zw Thank you for the suggestions. My original intent was to avoid script programming as much as possible and yet gain reasonably good summary. I guess the time is over for a simple shell scripting to produce a meaningful summary from ever evolving log record. (Yes, my script goes over the log many times and in that sense it is not very efficient, but it can handle 100+MiB |mach mochitest-plain| of debug build of FF in several seconds on my local PC and not too bad for my purpose of obtaining a meaningful summary without investing too much in programming.) When I have a time to re-engineer my script, I will post a prototype for review by people who may be interested in such a script. TIA ___ dev-platform mailing list dev-platform@lists.mozilla.org https://lists.mozilla.org/listinfo/dev-platform
Re: Removing [PID] prefix from |make mozmill| warning/error/assertion lines?
On Sat 19 Apr 2014 08:36:22 AM PDT, ISHIKAWA,chiaki wrote: egrep ^(\\[[0-9]*\\] |)WARNING $1 | egrep NS_ENSURE | grep -v sort operation has occurred for the SQL statement | sort | uniq -f1 -c | sort -n -r It'd be easier if you threw in a *little* bit of perl: perl -lne 'print $1 if /WARNING: (NS_ENSURE.*)/' | sort | uniq -c | sort -nr But you must be ignoring the SQL statement warning because it has varying text? I don't have an example line in my log, but if it matches https://bugzilla.mozilla.org/show_bug.cgi?id=933456 then you could use something like perl -lne 'next unless s/.*?WARNING: (NS_ENSURE.*)/$1/; s/0x[\da-f]+/0x/i; print' | sort | uniq -c | sort -nr ___ dev-platform mailing list dev-platform@lists.mozilla.org https://lists.mozilla.org/listinfo/dev-platform
Re: Removing [PID] prefix from |make mozmill| warning/error/assertion lines?
On 4/18/2014 7:07 PM, ISHIKAWA,chiaki wrote: Does anyone know how to disable this prefixing short of modifying the source code? Why can't you just accept this in your parsing regex? There is no runtime control for this behavior. It was made non-optional so that we could which process an assertion was coming from when child processes are present (plugins, content, eventually sandboxed media decoders). http://hg.mozilla.org/mozilla-central/annotate/db431ea44a1a/xpcom/base/nsDebugImpl.cpp#l311 --BDS ___ dev-platform mailing list dev-platform@lists.mozilla.org https://lists.mozilla.org/listinfo/dev-platform
Removing [PID] prefix from |make mozmill| warning/error/assertion lines?
Hi, I have been analyzing warning/error/assertion lines produced by full debug version of TB (comm-central). To facilitate the analysis I created a few scripts to process the error statistically. Staring 1Q of 2014, I think such lines are prefixed with [pid] . Now that probably is very good, but unfortunately, this makes it very difficult to use a simple-minded script to gather statistical information from the log. Does anyone know how to disable this prefixing short of modifying the source code? I have found that |mach| has a command for disabling timestamp (not tested yet) --log-no-timestamp. If |make mozmill| has a similar run-time option to suppress [pid' prefix, that is great. TIA PS: the lines look as follows. Note [pid] Random sampling. [17085] WARNING: not an nsIRDFRemoteDataSource: 'remote != nullptr', file /REF-COMM-CENTRAL/comm-central/mozilla/rdf/datasource/src/nsLocalStore.cpp, line 279 [19427] WARNING: Leaking the RDF Service.: file /REF-COMM-CENTRAL/comm-central/mozilla/rdf/build/nsRDFModule.cpp, line 165 [19427] ###!!! ASSERTION: Component Manager being held past XPCOM shutdown.: 'cnt == 0', file /REF-COMM-CENTRAL/comm-central/mozilla/xpcom/build/nsXPComInit.cpp, line 1020 [18458] WARNING: NS_ENSURE_TRUE(parentObject) failed: file /REF-COMM-CENTRAL/comm-central/mozilla/accessible/src/atk/AccessibleWrap.cpp, line 1295 etc. ___ dev-platform mailing list dev-platform@lists.mozilla.org https://lists.mozilla.org/listinfo/dev-platform