hi, Nathan:
In my understanding one just check the result files and the perl
scripts, and makes some updates to generate the results pages. One can also
do automatical results generation with more scripts after a well ssh
configuration. Anyway please see if below/attached descriptions meet your
expeactation, let us discuss a bit more to see where is the problem if it is
not the case.
This tutorial introduces the steps to setup the web result pages for
integrity testing and snapshot testing.
(1) Integrity testing result, as in
http://people.apache.org/~chunrong/harmony-integrity.
The result page is generated by the local results files in the
integrity testing machine, named as {platform}.{test_suite}.status.zip,
which are stored in the the directory specified by
framework.parameters.optional.upload.dir(*.1) in framework.local.properties.
(1.1) One can now manually generate the result page by running the
scripts in
http://svn.apache.org/repos/asf/harmony/enhanced/buildtest/trunk/tools/integrity/status-table(*.2),
with some changes to specify the platforms, test suites, result URL
and the result files.
The diff file I made to generate the result page is also attached
(integrity.diff). After have made such minor changes, I upload the result
files to %test_results_links (in my apache account), unzip them, and running
the perl scripts to generate the result page in %test_results_links for the
specified %testsuites and %platforms. Because the web page is generated in
the apache server (http://people.apache.org, the files are also uploaded to
there), one needs an apache account to do that.
(1.2) More works are needed to make above steps running automatically.
Firstly one needs to set up ssh keys (*.3) of local integrity testing
machine and store them to the apache account, thus can connect to the apache
server automatically. If the local file is behind a firewall, more
utilities, for example, the connect utility (*.4) will be required to do
that.
Secondly I update the testing infrastructure, the diff file is also
attached, to check the result directory if one file with specified name
exists. The file actually acts as a flag. Others can just ignore the file
thus only do manual result web page generation. I myself do created the file
so it always exists in my environment. In this way the result files got
auto-uploaded and another scripts, with contents of "ssh apache 'cd
/home/chunrong/public-html/harmony-integrity ** ./generate-webpages.sh'"
will be executed. The latest scripts, named generate-webpages.sh, located in
the remote apache server just extracts the result files and automatically
run the perl scripts exactly as in (1.1). To simplify the scripts I just
handle result files and result pages for all platforms/testsuites after
every result file (with specific platform/testsuite) has been uploaded. I
see that can be possibly optimized.
(2) There are no new issue to generate the result pages for snapshot
testing (*.5). The result files are generated in
infra/build/checkouts/snapshot/results.
(*.1)
http://svn.apache.org/viewvc/harmony/enhanced/buildtest/trunk/infra/README.txt?view=markup
(*.2)
http://svn.apache.org/repos/asf/harmony/enhanced/buildtest/trunk/tools/integrity/status-table
(*.3)
http://www.puddingonline.com/~dave/publications/SSH-with-Keys-HOWTO/document/html/SSH-with-Keys-HOWTO-4.html#ss4.4
(*.4) http://www.meadowy.org/~gotoh/projects/connect.
(*.5)
http://svn.apache.org/viewvc/harmony/enhanced/buildtest/trunk/tools/snapshot/snapshots-table/
On Sun, Dec 7, 2008 at 1:04 PM, Nathan Beyer <[EMAIL PROTECTED]> wrote:
> And for the integrity site too? I'm actually more interested in that.
>
> http://people.apache.org/~chunrong/harmony-integrity/
>
> On Sat, Dec 6, 2008 at 11:03 PM, Nathan Beyer <[EMAIL PROTECTED]> wrote:
> > Chunrong,
> > Can you write up a tutorial for your snapshot site [1]? I want to do
> > the same thing on my people.apache.org site, but for Linux x86_64.
> >
> > -Nathan
> >
> > [1] http://people.apache.org/~chunrong/snapshots/snapshots_summary.html
> >
> > On Mon, Nov 24, 2008 at 8:20 PM, Nathan Beyer <[EMAIL PROTECTED]>
> wrote:
> >> That's why I asked about documentation. I want a tutorial for Harmony
> >> committers to setup their own instance.
> >>
> >> On Mon, Nov 24, 2008 at 8:15 PM, chunrong lai <[EMAIL PROTECTED]>
> wrote:
> >>> What is the problem?
> >>> Yes the scripts may need some modifications to adapt the changed URLs,
> or
> >>> the network setting, I did not change/commit the scripts because I just
> do
> >>> not think they can be pre-determined (and others probably can not run
> >>> scripts in my accounts). I have not noticed large changes before
> running
> >>> them.
> >>>
> >>> On Tue, Nov 25, 2008 at 10:07 AM, Nathan Beyer <[EMAIL PROTECTED]>
> wrote:
> >>>
> >>>> Is that documented anywhere? We've discussed this before and I've
> >>>> never been able to recreate it on one of my servers in a minimal
> >>>> amount of time.
> >>>>
> >>>> I'd love to recreate this on one or two of my servers and get it
> >>>> loaded in my people.apache.org site.
> >>>>
> >>>> -Nathan
> >>>>
> >>>> On Mon, Nov 24, 2008 at 8:00 PM, chunrong lai <[EMAIL PROTECTED]>
> >>>> wrote:
> >>>> > Oops. It seems that I did not update the link from the download
> page.
> >>>> > The scripts to generate the page is in
> >>>> >
> >>>>
> http://svn.apache.org/viewvc/harmony/enhanced/buildtest/trunk/tools/snapshot/snapshots-table/
> >>>> > (
> >>>> >
> >>>>
> http://svn.apache.org/repos/asf/harmony/enhanced/buildtest/trunk/tools/integrity/status-table
> >>>> > are
> >>>> > the scripts to generate the integrity testing results), while I
> slightly
> >>>> > modified the URLs, involved platforms and the test suites in running
> >>>> them. I
> >>>> > have not updated them since I think the modifications are trivial.
> >>>> > The scripts runner still need to upload the result files from the
> >>>> testing
> >>>> > cycle to the apache account of the scripts, manually or
> automatically,
> >>>> > before running the mentioned scripts.
> >>>> > Thanks a lot.
> >>>> >
> >>>> >
> >>>> > On Mon, Nov 24, 2008 at 11:47 PM, Sean Qiu <[EMAIL PROTECTED]>
> >>>> wrote:
> >>>> >
> >>>> >> Interested in the script too.
> >>>> >>
> >>>> >> 2008/11/24 Mark Hindess <[EMAIL PROTECTED]>
> >>>> >>
> >>>> >> >
> >>>> >> > The new location might be:
> >>>> >> >
> >>>> >> >
> http://people.apache.org/~chunrong/snapshots/snapshots_summary.html
> >>>> >> >
> >>>> >> > Are the scripts to create this in svn? I think it is a good idea
> that
> >>>> >> > all processes - even ad-hoc ones - are keep in svn so anyone can
> pick
> >>>> >> > them up and run them if they are out of date.
> >>>> >> >
> >>>> >> > Regards,
> >>>> >> > Mark.
> >>>> >> >
> >>>> >> >
> >>>> >> > In message <
> >>>> [EMAIL PROTECTED]
> >>>> >> >,
> >>>> >> > "Sian
> >>>> >> > January" writes:
> >>>> >> > >
> >>>> >> > > I've noticed on the download page that we have a link to a page
> >>>> that's
> >>>> >> > > quite out of date[1] (under the 'Snapshot builds for Harmony
> 5.0'
> >>>> >> > > section: "Results of automatic testing scenarios for snapshots
> can
> >>>> be
> >>>> >> > > viewed _here_"). Before deleting the link I was just wondering
> if
> >>>> >> > > anyone has created or is planning to create an equivalent
> up-to-date
> >>>> >> > > page?
> >>>> >> > >
> >>>> >> > > Thanks,
> >>>> >> > >
> >>>> >> > > Sian
> >>>> >> > >
> >>>> >> > >
> >>>> >> > > [1]
> >>>> >> >
> >>>> >>
> >>>>
> http://people.apache.org/~mloenko/snapshot_testing/script/snapshots_summa
> >>>> >> > > ry.html
> >>>> >> > >
> >>>> >> > > --
> >>>> >> > > Unless stated otherwise above:
> >>>> >> > > IBM United Kingdom Limited - Registered in England and Wales
> with
> >>>> >> number
> >>>> >> > 7415
> >>>> >> > > 98.
> >>>> >> > > Registered office: PO Box 41, North Harbour, Portsmouth,
> Hampshire
> >>>> PO6
> >>>> >> > 3AU
> >>>> >> > >
> >>>> >> >
> >>>> >> >
> >>>> >> >
> >>>> >>
> >>>> >>
> >>>> >> --
> >>>> >> Best Regards
> >>>> >> Sean, Xiao Xia Qiu
> >>>> >>
> >>>> >> China Software Development Lab, IBM
> >>>> >>
> >>>> >
> >>>>
> >>>
> >>
> >
>
This tutorial introduces the steps to setup the web result pages for integrity
testing and snapshot testing.
(1) Integrity testing result, as in
http://people.apache.org/~chunrong/harmony-integrity.
The result page is generated by the local results files in the integrity
testing machine, named as {platform}.{test_suite}.status.zip, which are stored
in the the directory specified by framework.parameters.optional.upload.dir(*.1)
in framework.local.properties.
(1.1) One can now manually generate the result page by running the scripts
in
http://svn.apache.org/repos/asf/harmony/enhanced/buildtest/trunk/tools/integrity/status-table
(*.2), with some changes to specify the platforms, test suites, result URL and
the result files.
The diff file I made to generate the result page is also attached
(integrity.diff). After have made such changes, I upload the result files to
%test_results_links (in my apache account), unzip them, and running the perl
scripts to generate the result page in %test_results_links for the specified
%testsuites and %platforms. Because the web page is generated in the apache
server (http://people.apache.org, the files are also uploaded to there), one
needs an apache account to do that.
(1.2) More works are needed to make above steps running automatically.
Firstly one needs to set up ssh keys (*.3) of local integrity testing
machine and store them to the apache account, thus can connect to the apache
server automatically. If the local file is behind a firewall, more utilities,
for example, the connect utility (*.4) will be required to do that.
Secondly I update the testing infrastructure, the diff file is also
attached, to check the result directory if one file with specified name exists.
The file actually acts as a flag. Others can just ignore the file thus only do
manual result web page generation. I myself do created the file so it always
exists in my environment. In this way the result files got auto-uploaded and
another scripts, with contents of "ssh apache 'cd
/home/chunrong/public-html/harmony-integrity ** ./generate-webpages.sh'" will
be executed. The latest scripts, named generate-webpages.sh, located in the
remote apache server just extracts the result files and automatically run the
perl scripts exactly as in (1.1). To simplify the scripts I just handle result
files and result pages for all platforms/testsuites after every result file
(with specific platform/testsuite) has been uploaded. I see that can be
possibly optimized.
(2) There are no new issue to generate the result pages for snapshot testing
(*.5). The result files are generated in
infra/build/checkouts/snapshot/results.
(*.1)
http://svn.apache.org/viewvc/harmony/enhanced/buildtest/trunk/infra/README.txt?view=markup
(*.2)
http://svn.apache.org/repos/asf/harmony/enhanced/buildtest/trunk/tools/integrity/status-table
(*.3)
http://www.puddingonline.com/~dave/publications/SSH-with-Keys-HOWTO/document/html/SSH-with-Keys-HOWTO-4.html#ss4.4
(*.4) http://www.meadowy.org/~gotoh/projects/connect.
(*.5)
http://svn.apache.org/viewvc/harmony/enhanced/buildtest/trunk/tools/snapshot/snapshots-table/diff -BburN integrity.new/status-table/integrity.pl
integrity/status-table/integrity.pl
--- integrity.new/status-table/integrity.pl 2008-12-07 23:12:59.000000000
+0800
+++ integrity/status-table/integrity.pl 2008-12-07 23:02:10.000000000 +0800
@@ -25,16 +25,13 @@
#$proxy = "proxy.com:8080";
#testuites results locations
-%test_results_links = ("file:///home/varlax/public_html/harmony-integrity" =>
"http://people.apache.org/~varlax/harmony-integrity";);
+%test_results_links = ("file:///home/chunrong/public_html/harmony-integrity"
=> "http://people.apache.org/~chunrong/harmony-integrity";);
#list of testsuites
%testsuites = (
"hdk" => " Federated HDK build",
- "drlvm" => " DRLVM build",
- "classlib" => " Classlib build",
"classlib-test" => "Classlib tests",
- "classlib-gui-test" => "Classlib Swing/AWT tests",
"ehwa-api" => " Eclipse Hello World Application",
"jdktools-test" => "JDKTools tests",
"drlvm-test" => "DRLVM tests",
@@ -46,7 +43,7 @@
"LIN32" => "linux_x86",
"WIN64" => "windows_x86_64",
"LIN64" => "linux_x86_64",
- "LIN_IPF" => "linux_ia64");
+ );
#verbose printing
#$verbose = 1;
diff -BburN integrity.new/status-table/testsuites_row.tpl
integrity/status-table/testsuites_row.tpl
--- integrity.new/status-table/testsuites_row.tpl 2008-12-07
23:12:59.000000000 +0800
+++ integrity/status-table/testsuites_row.tpl 2008-12-07 23:02:45.000000000
+0800
@@ -4,5 +4,4 @@
<td>{LIN32}</td>
<td>{WIN64}</td>
<td>{LIN64}</td>
- <td>{LIN_IPF}</td>
</tr>
diff -BburN integrity.new/status-table/testsuites_table.tpl
integrity/status-table/testsuites_table.tpl
--- integrity.new/status-table/testsuites_table.tpl 2008-12-07
23:12:59.000000000 +0800
+++ integrity/status-table/testsuites_table.tpl 2008-12-07 23:02:27.000000000
+0800
@@ -22,7 +22,6 @@
<th width="15%">Linux x86 32 bit</th>
<th width="15%">Windows x86 64 bit</th>
<th width="15%">Linux x86 64 bit</th>
- <th width="15%">Linux IA64</th>
</tr>
{TABLE_ROW}
</tbody>
Index: scripts/cc-exec-adaptor.xml
===================================================================
--- scripts/cc-exec-adaptor.xml (revision 673021)
+++ scripts/cc-exec-adaptor.xml (working copy)
@@ -264,6 +264,16 @@
basedir="${results.dir}"
includes="${hy.platform}/${suite.name}/**"
update="true" />
+
+ <available property="autouploads" file="${upload.dir}/autouploading"/>
+ <antcall target="-auto-upload"/>
</target>
+ <target name="-auto-upload" if="autouploads">
+ <exec executable="scp" dir="${upload.dir}">
+ <arg line="${hy.platform}.${suite.name}.status.zip
apache:/home/chunrong/public_html/harmony-integrity"/>
+ </exec>
+ <exec executable="${upload.dir}/generateresults.sh"
dir="${upload.dir}">
+ </exec>
+ </target>
</project>
