Re: [GENERAL] Possible causes for database corruption and solutions

2010-02-24 Thread Greg Smith
Bruce Momjian wrote: Is changing the OS/X wal_sync_method default something we should consider? It's certainly reasonable to consider changing both OS X and Windows so wal_sync_method defaulted to fsync_writethrough, and provide safer operation by default on both those platforms. It

Re: [GENERAL] Possible causes for database corruption and solutions

2010-02-19 Thread Bruce Momjian
Is changing the OS/X wal_sync_method default something we should consider? --- Greg Smith wrote: Michael Clark wrote: The solution to the problem seemed to be to change the value for the wal_sync_method setting to

Re: [GENERAL] Possible causes for database corruption and solutions

2009-12-16 Thread Craig Ringer
On 16/12/2009 3:54 PM, Florian Weimer wrote: * Michael Clark: The solution to the problem seemed to be to change the value for the wal_sync_method setting to fsync_writethrough from the default of fsync. I was curious if there were perhaps any other reasons that we should look at? Or if there

Re: [GENERAL] Possible causes for database corruption and solutions

2009-12-16 Thread Florian Weimer
* Craig Ringer: On 16/12/2009 3:54 PM, Florian Weimer wrote: * Michael Clark: The solution to the problem seemed to be to change the value for the wal_sync_method setting to fsync_writethrough from the default of fsync. I was curious if there were perhaps any other reasons that we should

Re: [GENERAL] Possible causes for database corruption and solutions

2009-12-16 Thread Craig Ringer
On 16/12/2009 6:41 PM, Florian Weimer wrote: * Craig Ringer: When you're dealing with end users who have machines running god-knows-what kinds of awful hardware drivers Even Mac OS X? There should be less variety. Of disk and other critical drivers, sure. There is, however, a huge variety

Re: [GENERAL] Possible causes for database corruption and solutions

2009-12-16 Thread Michael Clark
Hello Craig - thanks for the reply. I will reply below. On Tue, Dec 15, 2009 at 9:34 PM, Craig Ringer cr...@postnewspapers.com.auwrote: On 16/12/2009 6:39 AM, Michael Clark wrote: Hello all, Over the past 6 months or so I have posted to the list a couple times looking for information

Re: [GENERAL] Possible causes for database corruption and solutions

2009-12-16 Thread Michael Clark
Hi Scott and Craig, On Tue, Dec 15, 2009 at 9:45 PM, Craig Ringer cr...@postnewspapers.com.auwrote: On 16/12/2009 9:07 AM, Scott Marlowe wrote: I'd also recommend moving off of OSX as you're using a minority OS as far as databases are concerned, and you won't have a very large community to

Re: [GENERAL] Possible causes for database corruption and solutions

2009-12-16 Thread Michael Clark
Hi Greg, thanks for the reply! On Tue, Dec 15, 2009 at 10:52 PM, Greg Smith g...@2ndquadrant.com wrote: Michael Clark wrote: Secondly, I ask about an alternative solution to the corruption problem because with preliminary testing we have seen a significant degradation in performance. So

Re: [GENERAL] Possible causes for database corruption and solutions

2009-12-16 Thread Michael Clark
On Wed, Dec 16, 2009 at 5:41 AM, Florian Weimer fwei...@bfk.de wrote: * Craig Ringer: On 16/12/2009 3:54 PM, Florian Weimer wrote: * Michael Clark: and with no power protection, then I expect it does. Add laptop users with ageing/flakey batteries, laptops let go flat after they go

Re: [GENERAL] Possible causes for database corruption and solutions

2009-12-16 Thread Greg Smith
Florian Weimer wrote: I hope that Mac OS X turns off write caches on low battery. I've never heard of such a thing. The best you can do is try to push the system into hibernation instead of going down hard. That *should* clear any disk caches as part of the graceful shutdown. But

Re: [GENERAL] Possible causes for database corruption and solutions

2009-12-16 Thread Michael Clark
On Wed, Dec 16, 2009 at 11:25 AM, Greg Smith g...@2ndquadrant.com wrote: Florian Weimer wrote: I hope that Mac OS X turns off write caches on low battery. I've never heard of such a thing. The best you can do is try to push the system into hibernation instead of going down hard. That

Re: [GENERAL] Possible causes for database corruption and solutions

2009-12-16 Thread Greg Smith
Michael Clark wrote: On Wed, Dec 16, 2009 at 11:25 AM, Greg Smith g...@2ndquadrant.com mailto:g...@2ndquadrant.com wrote: Florian Weimer wrote: I hope that Mac OS X turns off write caches on low battery. I've never heard of such a thing. The best you can do is

Re: [GENERAL] Possible causes for database corruption and solutions

2009-12-16 Thread Michael Clark
On Wed, Dec 16, 2009 at 2:05 PM, Greg Smith g...@2ndquadrant.com wrote: Michael Clark wrote: On Wed, Dec 16, 2009 at 11:25 AM, Greg Smith g...@2ndquadrant.com wrote: Florian Weimer wrote: I hope that Mac OS X turns off write caches on low battery. I've never heard of such a thing.

[GENERAL] Possible causes for database corruption and solutions

2009-12-15 Thread Michael Clark
Hello all, Over the past 6 months or so I have posted to the list a couple times looking for information regarding recovering databases from corruption. At the time the incidents of corruption among our users was very low, but the frequency is starting to increase, most likely due to the

Re: [GENERAL] Possible causes for database corruption and solutions

2009-12-15 Thread Scott Marlowe
On Tue, Dec 15, 2009 at 3:39 PM, Michael Clark codingni...@gmail.com wrote: Hello all, Over the past 6 months or so I have posted to the list a couple times looking for information regarding recovering databases from corruption.  At the time the incidents of corruption among our users was very

Re: [GENERAL] Possible causes for database corruption and solutions

2009-12-15 Thread Craig Ringer
On 16/12/2009 6:39 AM, Michael Clark wrote: Hello all, Over the past 6 months or so I have posted to the list a couple times looking for information regarding recovering databases from corruption. At the time the incidents of corruption among our users was very low, but the frequency is

Re: [GENERAL] Possible causes for database corruption and solutions

2009-12-15 Thread Craig Ringer
On 16/12/2009 9:07 AM, Scott Marlowe wrote: I'd also recommend moving off of OSX as you're using a minority OS as far as databases are concerned, and you won't have a very large community to help out when things do go wrong. It sounds like PostgreSQL is being used as a DB bundled with an app

Re: [GENERAL] Possible causes for database corruption and solutions

2009-12-15 Thread Greg Smith
Michael Clark wrote: The solution to the problem seemed to be to change the value for the wal_sync_method setting to fsync_writethrough from the default of fsync. I was surprised recently to discover the default wasn't fsync_writethrough on that platform, because it probably should be.

Re: [GENERAL] Possible causes for database corruption and solutions

2009-12-15 Thread Ron Mayer
Craig Ringer wrote: On 16/12/2009 9:07 AM, Scott Marlowe wrote: I'd also recommend moving off of OSX as you're using a minority OS as far as databases are concerned, and you won't have a very large community to help out when things do go wrong It sounds like PostgreSQL is being used as a DB

Re: [GENERAL] Possible causes for database corruption and solutions

2009-12-15 Thread Scott Marlowe
On Tue, Dec 15, 2009 at 7:45 PM, Craig Ringer cr...@postnewspapers.com.au wrote: On 16/12/2009 9:07 AM, Scott Marlowe wrote: I'd also recommend moving off of OSX as you're using a minority OS as far as databases are concerned, and you won't have a very large community to help out when things

Re: [GENERAL] Possible causes for database corruption and solutions

2009-12-15 Thread Florian Weimer
* Michael Clark: The solution to the problem seemed to be to change the value for the wal_sync_method setting to fsync_writethrough from the default of fsync. I was curious if there were perhaps any other reasons that we should look at? Or if there may be other alternatives to changing the