Re: Buildfarm coverage (was Re: [HACKERS] OK, ready for RC1 or Beta6)

2004-12-04 Thread Kurt Roeckx
On Fri, Dec 03, 2004 at 09:37:42PM +0100, Peter Eisentraut wrote:
> 
> Once RC1 is out and the build farm has picked it up, we should start 
> filling out our little table with the build farm results and then look 
> for ways to fill the holes.  Does the build farm turn on all the 
> compiler options?  It really should.  I'm looking for
> 
> /configure --prefix=SOMEWHERE --enable-thread-safety --with-tcl \ 
> --with-perl --with-python --with-krb5 --with-pam -with-openssl

I actually run panda (x86_64/amd64) with those options together with
--enable-nls and --enable-integer-datetimes.  I based my options
on the debian postgresql package.


Kurt


---(end of broadcast)---
TIP 1: subscribe and unsubscribe commands go to [EMAIL PROTECTED]


Re: Buildfarm coverage (was Re: [HACKERS] OK, ready for RC1 or Beta6)

2004-12-03 Thread Tom Lane
Travis P <[EMAIL PROTECTED]> writes:
> You'll probably find multi-OS-testing (various versions of AIX, Linux, 
> MacOS X on PPC and/or PowerPC) much more important than differentiating 
> particular pieces of hardware in the PPC or RS6000 category, assuming 
> both 32-bit and 64-bit is covered and also that SMP tests are made.

Agreed.

> Does 'make check' test SMP?

Yes; not very hard, but it will usually catch bad problems, especially
over the long haul of many retries.

regards, tom lane

---(end of broadcast)---
TIP 9: the planner will ignore your desire to choose an index scan if your
  joining column's datatypes do not match


Re: Buildfarm coverage (was Re: [HACKERS] OK, ready for RC1 or Beta6)

2004-12-03 Thread Travis P
On Dec 3, 2004, at 2:33 PM, Kenneth Marshall wrote:
On Fri, Dec 03, 2004 at 03:20:48PM -0500, Tom Lane wrote:
PPC tested pretty often by moi
RS6000  isn't this same as PPC?
This is the IBM Power4 and now Power5 architecture which is
different from the PowerPC.
Yeah, it's confusing.  I believe that Power3 (also known as PowerPC 
630), Power4, and Power5 satisfy the requirements of being both Power 
architecture and PowerPC architecture processors.

Not all PowerPC processors are Power processors.  I believe that all 
modern Power processors are PowerPC processors (the Power2 "P2SC" was 
the last non-PowerPC Power processor, IIRC).

IBM's Power architecture has architectural features for Server systems 
(with a capital S there) that PowerPC for workstations (Apple) and 
embedded (Moto/IBM) shouldn't be required to have, and is also IBM's 
own solely-owned branding.  Hence the differentiation.

That's what I've pieced together anyway.
You'll probably find multi-OS-testing (various versions of AIX, Linux, 
MacOS X on PPC and/or PowerPC) much more important than differentiating 
particular pieces of hardware in the PPC or RS6000 category, assuming 
both 32-bit and 64-bit is covered and also that SMP tests are made.

Does 'make check' test SMP?
-Travis
---(end of broadcast)---
TIP 1: subscribe and unsubscribe commands go to [EMAIL PROTECTED]


Re: Buildfarm coverage (was Re: [HACKERS] OK, ready for RC1 or Beta6)

2004-12-03 Thread Tom Lane
"Jim Buttafuoco" <[EMAIL PROTECTED]> writes:
> I have setup the following running debian linux. MIPS, MIPSEL, ALPHA,
> PARISC, M68K, ARM, SPARC, I386.  I have the build farm running local
> and I have just started to get the systems registered.

Excellent, that's very good news.

regards, tom lane

---(end of broadcast)---
TIP 7: don't forget to increase your free space map settings


Re: Buildfarm coverage (was Re: [HACKERS] OK, ready for RC1 or Beta6)

2004-12-03 Thread Tom Lane
Andrew Dunstan <[EMAIL PROTECTED]> writes:
> The configuration is chosen in the config file for each member, rather 
> than being dictated centrally.

This is good.  Now what we need is a little cooperation among the
buildfarm team to make sure that the collective set of cases tested
covers all the interesting combinations of configure flags, as per
my followup ...

> A single member can run more than one branch, and per-branch config can 
> be set up. A single machine can run more than one farm member (e.g. to 
> use different compilers).

Yeah, on platforms where there's a non-gcc vendor compiler, testing with
the vendor compiler is very interesting.

regards, tom lane

---(end of broadcast)---
TIP 5: Have you checked our extensive FAQ?

   http://www.postgresql.org/docs/faqs/FAQ.html


Re: Buildfarm coverage (was Re: [HACKERS] OK, ready for RC1 or Beta6)

2004-12-03 Thread Andrew Dunstan

Peter Eisentraut wrote:
Tom Lane wrote:
 

Where the buildfarm falls down a bit is on the cross-product
coverage. But I think you're not going to get the cross product
without a call for port reports; there aren't that many people who
are going to offer dedicated time on every random platform there is.
   

Once RC1 is out and the build farm has picked it up, we should start 
filling out our little table with the build farm results and then look 
for ways to fill the holes.  Does the build farm turn on all the 
compiler options?  It really should.  I'm looking for

/configure --prefix=SOMEWHERE --enable-thread-safety --with-tcl \ 
--with-perl --with-python --with-krb5 --with-pam -with-openssl
make
make install
make check
 


I know you're busy, but please take a few moments to check out how it works.
The configuration is chosen in the config file for each member, rather 
than being dictated centrally. Every report (success and failure) shows 
the config settings. The only setting that buildfarm needs to set itself 
is --prefix which is chosen relative to another config file setting. 
Everything else is up to the farm member sysadmin to choose appropriately.

A single member can run more than one branch, and per-branch config can 
be set up. A single machine can run more than one farm member (e.g. to 
use different compilers).

In addition to the steps above, we do the following:
initdb
pg_ctl start
make installcheck
make contrib
make contrib::installcheck
pg_ctl stop
The worth of these extra steps has already been shown - a number of bugs 
of unknown age and provenance have been fixed, especially in contrib.

It is possible to run the buildfarm yourself without even being 
registered on www.pgbuildfarm.org - the script has a --nosend option 
which means it doesn't try to upload its results to the server. I 
encourage anyone interested in running buildfarm to try this option first.

cheers
andrew
---(end of broadcast)---
TIP 8: explain analyze is your friend


Re: Buildfarm coverage (was Re: [HACKERS] OK, ready for RC1 or Beta6)

2004-12-03 Thread Jim Buttafuoco
Tom/all,

I have setup the following running debian linux. MIPS, MIPSEL, ALPHA, PARISC, 
M68K, ARM, SPARC, I386.  I have the 
build farm running local and I have just started to get the systems registered. 
 I am also willing to aquire other 
hardware/ operating systems in an effort to give something back to the 
Postgresql community

Jim



-- Original Message ---
From: Tom Lane <[EMAIL PROTECTED]>
To: "Joshua D. Drake" <[EMAIL PROTECTED]>
Cc: PostgreSQL-development <[EMAIL PROTECTED]>
Sent: Fri, 03 Dec 2004 15:20:48 -0500
Subject: Buildfarm coverage (was Re: [HACKERS] OK, ready for RC1 or Beta6)

> "Joshua D. Drake" <[EMAIL PROTECTED]> writes:
> > 1. Buildfarm doesn't yet have that many platforms on it.
> 
> It's not as bad as all that.  Our current list of supported platforms
> (ie, things that got tested last time) is
> 
>   AIX
>   Free/Open/NetBSDcovered by buildfarm
>   HPUXused daily by moi
>   IRIX
>   Linux   covered by buildfarm
>   OS Xtested pretty often by moi
>   Solaris covered by buildfarm
>   Tru64
>   UnixWare
>   Windows/Cygwin  covered by buildfarm
> 
> With respect to hardware it's
> 
>   x86 covered by buildfarm
>   ia64
>   x86_64  covered by buildfarm
>   ARM
>   Alpha
>   MIPScovered by buildfarm
>   m68k
>   PA-RISC used daily by moi
>   PPC tested pretty often by moi
>   RS6000  isn't this same as PPC?
>   S/390
>   Sparc   covered by buildfarm
> 
> Considering that we have both 32- and 64-bit, little- and big-endian
> hardware in there, most of the basic hardware gotchas are covered;
> the only thing I think is at much risk is the spinlock assembler code,
> which we change seldom.
> 
> Where the buildfarm falls down a bit is on the cross-product coverage.
> But I think you're not going to get the cross product without a call for
> port reports; there aren't that many people who are going to offer
> dedicated time on every random platform there is.
> 
> It would be nice to get an Alpha into the buildfarm, and PPC too.
> 
>   regards, tom lane
> 
> ---(end of broadcast)---
> TIP 3: if posting/reading through Usenet, please send an appropriate
>   subscribe-nomail command to [EMAIL PROTECTED] so that your
>   message can get through to the mailing list cleanly
--- End of Original Message ---


---(end of broadcast)---
TIP 7: don't forget to increase your free space map settings


Re: Buildfarm coverage (was Re: [HACKERS] OK, ready for RC1 or Beta6)

2004-12-03 Thread Tom Lane
Peter Eisentraut <[EMAIL PROTECTED]> writes:
> Does the build farm turn on all the 
> compiler options?  It really should.  I'm looking for

> /configure --prefix=SOMEWHERE --enable-thread-safety --with-tcl \ 
> --with-perl --with-python --with-krb5 --with-pam -with-openssl

I was just thinking about what the buildfarm should do with configure
options.  IMHO it would be most useful if we could have it testing a
variety of different combinations.  For instance, that stupid mistake
I made last night would only have been detected by testing the
combination --with-openssl and *not* --enable-thread-safety.  We
obviously are not going to have enough machines to test every possible
combination, let alone every combination on every platform, but maybe we
could make sure that interesting option combinations appear at least
once among the set of buildfarm machines.

I think it would be useful to cover all 16 permutations of 
--enable-thread-safety --with-krb5 --with-pam -with-openssl
if possible, since those potentially interact in libpq.  The
--with-tcl --with-perl --with-python switches are probably pretty
independent of these, but we should have one or two buildfarm machines
trying each language if possible.  Other switches that should be getting
used by some but not all machines:

  --enable-integer-datetimes
  --enable-nls
  --without-readline(just to make sure it builds)
  --without-zlib(ditto)

Finally, while I think most of the platforms should use --enable-debug
and --enable-cassert to aid in tracking down problems, there should be
one machine building without these, just to catch silly mistakes.

regards, tom lane

---(end of broadcast)---
TIP 4: Don't 'kill -9' the postmaster


Re: Buildfarm coverage (was Re: [HACKERS] OK, ready for RC1 or Beta6)

2004-12-03 Thread Kenneth Marshall
On Fri, Dec 03, 2004 at 03:20:48PM -0500, Tom Lane wrote:
> "Joshua D. Drake" <[EMAIL PROTECTED]> writes:
> > 1. Buildfarm doesn't yet have that many platforms on it.
> 
> It's not as bad as all that.  Our current list of supported platforms
> (ie, things that got tested last time) is
> 
>   AIX
>   Free/Open/NetBSDcovered by buildfarm
>   HPUXused daily by moi
>   IRIX
>   Linux   covered by buildfarm
>   OS Xtested pretty often by moi
>   Solaris covered by buildfarm
>   Tru64
>   UnixWare
>   Windows/Cygwin  covered by buildfarm
> 
> With respect to hardware it's
> 
>   x86 covered by buildfarm
>   ia64
>   x86_64  covered by buildfarm
>   ARM
>   Alpha
>   MIPScovered by buildfarm
>   m68k
>   PA-RISC used daily by moi
>   PPC tested pretty often by moi
>   RS6000  isn't this same as PPC?
This is the IBM Power4 and now Power5 architecture which is
different from the PowerPC.

Ken

---(end of broadcast)---
TIP 9: the planner will ignore your desire to choose an index scan if your
  joining column's datatypes do not match


Re: Buildfarm coverage (was Re: [HACKERS] OK, ready for RC1 or Beta6)

2004-12-03 Thread Peter Eisentraut
Tom Lane wrote:
> Where the buildfarm falls down a bit is on the cross-product
> coverage. But I think you're not going to get the cross product
> without a call for port reports; there aren't that many people who
> are going to offer dedicated time on every random platform there is.

Once RC1 is out and the build farm has picked it up, we should start 
filling out our little table with the build farm results and then look 
for ways to fill the holes.  Does the build farm turn on all the 
compiler options?  It really should.  I'm looking for

/configure --prefix=SOMEWHERE --enable-thread-safety --with-tcl \ 
--with-perl --with-python --with-krb5 --with-pam -with-openssl
make
make install
make check

-- 
Peter Eisentraut
http://developer.postgresql.org/~petere/

---(end of broadcast)---
TIP 5: Have you checked our extensive FAQ?

   http://www.postgresql.org/docs/faqs/FAQ.html


Buildfarm coverage (was Re: [HACKERS] OK, ready for RC1 or Beta6)

2004-12-03 Thread Tom Lane
"Joshua D. Drake" <[EMAIL PROTECTED]> writes:
> 1. Buildfarm doesn't yet have that many platforms on it.

It's not as bad as all that.  Our current list of supported platforms
(ie, things that got tested last time) is

AIX
Free/Open/NetBSDcovered by buildfarm
HPUXused daily by moi
IRIX
Linux   covered by buildfarm
OS Xtested pretty often by moi
Solaris covered by buildfarm
Tru64
UnixWare
Windows/Cygwin  covered by buildfarm

With respect to hardware it's

x86 covered by buildfarm
ia64
x86_64  covered by buildfarm
ARM
Alpha
MIPScovered by buildfarm
m68k
PA-RISC used daily by moi
PPC tested pretty often by moi
RS6000  isn't this same as PPC?
S/390
Sparc   covered by buildfarm

Considering that we have both 32- and 64-bit, little- and big-endian
hardware in there, most of the basic hardware gotchas are covered;
the only thing I think is at much risk is the spinlock assembler code,
which we change seldom.

Where the buildfarm falls down a bit is on the cross-product coverage.
But I think you're not going to get the cross product without a call for
port reports; there aren't that many people who are going to offer
dedicated time on every random platform there is.

It would be nice to get an Alpha into the buildfarm, and PPC too.

regards, tom lane

---(end of broadcast)---
TIP 3: if posting/reading through Usenet, please send an appropriate
  subscribe-nomail command to [EMAIL PROTECTED] so that your
  message can get through to the mailing list cleanly