Author: ben
Date: 2008-01-02 14:30:27 -0800 (Wed, 02 Jan 2008)
New Revision: 7708
Modified:
tools/trunk/performance/cruncher/build.xml
tools/trunk/performance/src/org/openlaszlo/perf/PerfResult.java
Log:
Change 20080102-ben-M by [EMAIL PROTECTED] on 2008-01-02 14:28:47 PST
in /Users/ben/src/svn/tools/trunk
for http://svn.openlaszlo.org/tools/trunk
Summary: Updates performance analysis tool to (ahem) work
Documentation:
To gather the data for performance analysis:
On each architecture of interest:
In $LPS_HOME/test/lfc/perf/build.xml edit these lines to indicate which
browsers, branches, test suites, and runtimes you want to test:
var suites = ["sprite", "functions", "viewperf", "imageperformance",
"textperformance"];
var runtimes = ["swf8", "dhtml"]; // swf7 numbers are boring, almost
identical to swf8 numbers
var browsers = ["Firefox"];
var webapps = ["trunk"];
Then invoke ant to drive the tests... leave your machine alone for around 10
minutes while it runs the test.
$ cd $LPS_HOME/test/lfc/pref
$ ant -Dbranch=trunk hitallbrowsers storelog
This will result in a lot of log data being stored in svn -- the latest one
(which I just stored) is here:
http://svn.openlaszlo.org/QA/performance/raw/7656-openlaszlo-trunk.txt
Each of those lines represents the results from one test (executed several
times) in each suite. That's the raw data.
.....
The tool for analyzing the raw data is in $LZ_TOOLS_ROOT/performance/cruncher.
It is a java program. To compile it, see instructions in
http://svn.openlaszlo.org/tools/trunk/performance/README.txt
cd $LZ_TOOLS_ROOT/performance/cruncher
ant -Dbuild.id=7656-openlaszlo-trunk go
performance/cruncher/build.xml fetches the raw performance logs for the
specified build from subversion, runs the java performance analysis tool on it,
and mails the results to a few interested parties. "ant go" is all you need.
The cruncher analyzes whatever data is in the checked-in raw log; it expects to
analyze data recorded by test/lfc/perf/reporter.lzx via
test/lfc/perf/reporter.jsp. The reporting itself does not need to happen on the
same machine as the analysis.
Standard usage is from within the laszlosystems firewall (so we can send mail)
and as a logged-in svn user with commit access to the repository. Then just
$ ant go
To run analysis on a particular build, pass in
-Dbuild.id=thebuildid for example
$ ant -Dbuild.id=2469-openlaszlo-branches-legals go
To prevent any interaction with subversion at all, pass in
-Dno.svn=true for example
$ ant -Dno.svn go
If you've already got the data locally and you just want to analyze it, with no
network communication, do this
$ ant -v -Dno.svn=true -Dbuild.id=2469-openlaszlo-branches-legals analyze
$ more localanalysis/2469-openlaszlo-branches-legals-analysis.txt
Use the "clean" target to tidy up all local files. This is, of course,
destructive.
Release Notes:
Details:
Tests:
Modified: tools/trunk/performance/cruncher/build.xml
===================================================================
--- tools/trunk/performance/cruncher/build.xml 2008-01-02 22:27:55 UTC (rev
7707)
+++ tools/trunk/performance/cruncher/build.xml 2008-01-02 22:30:27 UTC (rev
7708)
@@ -27,7 +27,7 @@
Use the "clean" target to tidy up all local files. This is, of course,
destructive.
- Copyright 2006 Laszlo Systems
+ Copyright 2006-2008 Laszlo Systems
</description>
<property name="build.mail.sender" value="[EMAIL PROTECTED]"/>
@@ -44,7 +44,7 @@
<exec executable="svn" output="repository-info.xml">
<arg value="info" />
<arg value="--xml" />
- <arg value="http://svn.openlaszlo.org/test/performance/raw"; />
+ <arg value="http://svn.openlaszlo.org/QA/performance/raw"; />
</exec>
<property name="done.get-svn-info" value="true" />
</sequential>
@@ -63,7 +63,7 @@
<mkdir dir="locallogs" />
<exec executable="svn" failonerror="true">
<arg value="export"/>
- <arg
value="http://svn.openlaszlo.org/test/performance/raw/${build.id}.txt"; />
+ <arg
value="http://svn.openlaszlo.org/QA/performance/raw/${build.id}.txt"; />
<arg value="locallogs/${build.id}.txt" />
</exec>
</target>
@@ -128,7 +128,7 @@
<arg value="import"/>
<arg value="-m 'automated import of performance analysis'" />
<arg value="localanalysis/${build.id}-analysis.txt" />
- <arg
value="http://svn.openlaszlo.org/test/performance/analysis/${build.id}-analysis.txt";
/>
+ <arg
value="http://svn.openlaszlo.org/QA/performance/analysis/${build.id}-analysis.txt";
/>
</exec>
</target>
Modified: tools/trunk/performance/src/org/openlaszlo/perf/PerfResult.java
===================================================================
--- tools/trunk/performance/src/org/openlaszlo/perf/PerfResult.java
2008-01-02 22:27:55 UTC (rev 7707)
+++ tools/trunk/performance/src/org/openlaszlo/perf/PerfResult.java
2008-01-02 22:30:27 UTC (rev 7708)
@@ -26,6 +26,7 @@
String buildDate = "unknown date";
String comment = "no comment";
String browserInfo = "no browser info";
+ String branch = "unspecified branch";
boolean debug = false;
static final boolean WARN_NULL_VALUES = false;
@@ -139,6 +140,8 @@
this.debug = Boolean.parseBoolean(val);
} else if (attr.equalsIgnoreCase("comment")) {
this.comment = val;
+ } else if (attr.equalsIgnoreCase("branch")) {
+ this.branch = val;
} else {
throw new Exception("Found unknown attribute in log: "
+ attr);
@@ -206,7 +209,7 @@
}
/* J_LZ_COPYRIGHT_BEGIN *******************************************************
-* Copyright 2006 Laszlo Systems, Inc. All Rights Reserved. *
+* Copyright 2006-2008 Laszlo Systems, Inc. All Rights Reserved.
*
* Use is subject to license terms. *
* J_LZ_COPYRIGHT_END *********************************************************/
_______________________________________________
Laszlo-checkins mailing list
[email protected]
http://www.openlaszlo.org/mailman/listinfo/laszlo-checkins
