Re: Half billion records in one table? RDS

2017-11-27 Thread Laurenz Albe
Jean Baro wrote: > Hi there, > > We are creating a new DB which will behave most like a file system, > I mean, there will be no complex queries or joins running in the DB. > The idea is to grab the WHOLE set of messages for a particular user > and then filter, order, combine or full text search

Re: Setting effective_io_concurrency in VM?

2017-11-27 Thread Fernando Hevia
El 27 nov. 2017 15:24, "Don Seiler" escribió: Good afternoon. We run Postgres (currently 9.2, upgrading to 9.6 shortly) in VMWare ESX machines. We currently have effective_io_concurrency set to the default of 1. I'm told that the data volume is a RAID 6 with 14 data drives and 2

Re: Setting effective_io_concurrency in VM?

2017-11-27 Thread Scott Marlowe
On Mon, Nov 27, 2017 at 11:23 AM, Don Seiler wrote: > Good afternoon. > > We run Postgres (currently 9.2, upgrading to 9.6 shortly) in VMWare ESX > machines. We currently have effective_io_concurrency set to the default of > 1. I'm told that the data volume is a RAID 6 with 14

Re: Setting effective_io_concurrency in VM?

2017-11-27 Thread Don Seiler
On Mon, Nov 27, 2017 at 3:44 PM, Andrew Kerber wrote: > Whats the guest OS? I have been able to get Oracle to perform just as > well on Virtuals as it does on Physicals. I suspect the settings are > pretty similar. > Guest OS is CentOS 6 and CentOS 7 depending on

Re: Setting effective_io_concurrency in VM?

2017-11-27 Thread Jeff Janes
On Mon, Nov 27, 2017 at 10:40 AM, Scott Marlowe wrote: > > Generally VMs are never going to be as fast as running on bare metal > etc. You can adjust it and test it with something simple like pgbench > with various settings for -c (concurrency) and see where it peaks etc

Re: Setting effective_io_concurrency in VM?

2017-11-27 Thread Andres Freund
Hi, On 2017-11-27 11:40:19 -0700, Scott Marlowe wrote: > tl;dr: Only way to know is to benchmark it. I'd guess that somewhere > between 10 and 20 is going to get the best throughput but that's just > a guess. Benchmark it and let us know! FWIW, for SSDs my previous experiments suggest that the