Hi,
On 2016-05-06 14:17:13 -0700, Joshua D. Drake wrote: > How do I test? > > Is there a script I can run? Unfortunately there's few interesting things to test with pre-made scripts. There's no relevant OS dependency here, so each already existing test doesn't really lead to significantly increased coverage being run by other people. Generally, when testing for correctness issues, it's often of limited benefit to run tests written by the author of reviewer - such scripts will usually just test things either has thought of. The dangerous areas are the ones neither author or reviewer has considered. > Are there specific things I can do to try and break it? Upgrade clusters using pg_upgrade and make sure things like index only scans still work and yield correct data. Set up workloads that involve freezing, and check that less WAL (and not more!) is generated with 9.6 than with 9.5. Make sure queries still work. > What are we looking for exactly? Data corruption, efficiency problems. > A lot of -hackers seem to forget that although we have 100 -hackers, we have > 10000 "consultant/practitioners". Could I read the code and with a weekend > of WTF and -hackers questions figure out what is going on, yes but a lot of > people couldn't and I don't have the time. I think tests without reading the code are quite sensible and important. And it perfectly makes sense to ask for information about what to test. But fundamentally testing is a lot of work, as is writing and reviewing code; unless you're really really good at destructive testing, you won't find much in a 15 minute break. > You want me (or people like me) to test more? Give us an easy way to > do it. Useful additional testing and easy just don't go well together. By the time I have made it easy I've done the testing that's needed. > Otherwise, we do what we can, which is try and interface on the things that > will directly and immediately affect us (like keywords and syntax). The amount of bikeshedding on -hackers steals energy and time for actually working on stuff, including testing. So I have little sympathy for the amount of bike shedding done. Greetings, Andres Freund -- Sent via pgsql-hackers mailing list (pgsql-hackers@postgresql.org) To make changes to your subscription: http://www.postgresql.org/mailpref/pgsql-hackers
