Re: [GENERAL] pgbench initialize

2016-12-16 Thread Vladimir Rusinov
Depends on goals of your benchmarking. What are you trying to achieve? Initialization and vacuuming each time will help achieve more consistent best-case numbers (to reduce variance, I'd also destroy cluster completely and clean up hardware, e.g. run fstrim in case of SSD, etc). If you are howeve

[GENERAL] pgbench initialize

2016-12-15 Thread Anirudh Jayakumar
Hi, I have a couple of questions regarding pgbench. I'm new to PostgreSQL and databases in general, so these might be very trivial questions. 1. Is it necessary to initialize pgbench(-i option) before every run to get consistent results? 2. The vacuuming process after initialize consumes time, w

Re: [GENERAL] pgbench and scaling

2016-11-19 Thread rakeshkumar464
"Are the TPS numbers per pgbench? If so, then you're getting 10x490=4900 TPS system wide, or 20*280=5600 TPS system wide. " Per pgbench. Your explanation makes sense. thanks. -- View this message in context: http://postgresql.nabble.com/pgbench-and-scaling-tp5930891p5931131.html Sent from

Re: [GENERAL] pgbench and scaling

2016-11-18 Thread Vick Khera
On Thu, Nov 17, 2016 at 8:08 PM, Rakesh Kumar wrote: > I noticed that as I scale from 5 to 10 to 20 to 40, the TPS starts falling > almost linearly : > > with 5, TPS was doing 639 > with 10 TPS was down to 490 > with 20 TPS was down to 280 > and so on. Are the TPS numbers per pgbench? If so, the

Re: [GENERAL] pgbench and scaling

2016-11-17 Thread Rakesh Kumar
I forgot to mention that the db is replicated synchronously. I think that is the culprit. -- Sent via pgsql-general mailing list (pgsql-general@postgresql.org) To make changes to your subscription: http://www.postgresql.org/mailpref/pgsql-general

[GENERAL] pgbench and scaling

2016-11-17 Thread Rakesh Kumar
PG 9.5.3 RHEL Linux To cut the story short and giving as much details as I can remember: I created 40 database db1 .. db40 in a cluster. On each database I initialized pgbench tables with a scale of 15. Then I concurrently ran 5 pgbenches for 15 min. Each pgbench connected to one db. In other w

[GENERAL] pgbench support dynamic identifier name

2016-11-01 Thread 德哥
HI, pgbench can support literal parameter now, so if need different pgbench client thread to support different table name. must use multi script , and set different name in the file. but ,if pgbench can support it , will much better like sysbench. for exp: ``` vi test.sql \set id ra

Re: [GENERAL] pgbench tps drop from 5000 to 37 going from localhost to a server 13ms away

2015-07-27 Thread Jeff Janes
On Mon, Jul 27, 2015 at 3:19 AM, Chris Withers wrote: > On 24/07/2015 22:51, Jeff Janes wrote: > > starting vacuum...end. > >> transaction type: TPC-B (sort of) >> scaling factor: 1 >> > > This is your problem. There is only one row in the pgbench_branch > table, and every transaction has to

Re: [GENERAL] pgbench tps drop from 5000 to 37 going from localhost to a server 13ms away

2015-07-27 Thread Chris Withers
On 24/07/2015 22:51, Jeff Janes wrote: starting vacuum...end. transaction type: TPC-B (sort of) scaling factor: 1 This is your problem. There is only one row in the pgbench_branch table, and every transaction has to update that one row. This is inherently a seriaized event. Indeed

Re: [GENERAL] pgbench tps drop from 5000 to 37 going from localhost to a server 13ms away

2015-07-24 Thread Jeff Janes
On Fri, Jul 24, 2015 at 12:13 PM, Chris Withers wrote: > On 24/07/2015 19:21, Jan Lentfer wrote: > >> >> I've been doing some lightweight load testing with “pgbench -c8 -j8 -T10” When run locally on the postgres server I've testing, this gives around 5000tps When I

Re: [GENERAL] pgbench tps drop from 5000 to 37 going from localhost to a server 13ms away

2015-07-24 Thread Chris Withers
On 24/07/2015 19:21, Jan Lentfer wrote: I've been doing some lightweight load testing with “pgbench -c8 -j8 -T10” When run locally on the postgres server I've testing, this gives around 5000tps When I do it from a server that has a 13ms ping latency, it drops to 37tps. This is using the defa

Re: [GENERAL] pgbench tps drop from 5000 to 37 going from localhost to a server 13ms away

2015-07-24 Thread Jan Lentfer
>> Am 24.07.2015 um 18:59 schrieb Chris Withers : >> >> Hi all, >> >> I've been doing some lightweight load testing with >> “pgbench -c8 -j8 -T10” >> >> When run locally on the postgres server I've testing, this gives around >> 5000tps >> >> When I do it from a server that has a 13ms ping la

Re: [GENERAL] pgbench tps drop from 5000 to 37 going from localhost to a server 13ms away

2015-07-24 Thread Jan Lentfer
That seems to be a large drop. On the other hand 13 ms is also like a very large network latency. On LAN your usually in the sub ms area. So going from e.g. 0.2 ms to 13ms is 65 fold decrease. What is the network toplogy like? Jan Von meinem iPad gesendet > Am 24.07.2015 um 18:59 schrieb Chris

[GENERAL] pgbench tps drop from 5000 to 37 going from localhost to a server 13ms away

2015-07-24 Thread Chris Withers
Hi all, I've been doing some lightweight load testing with “pgbench -c8 -j8 -T10” When run locally on the postgres server I've testing, this gives around 5000tps When I do it from a server that has a 13ms ping latency, it drops to 37tps. This is using the default pgbench script, is it to be

Re: [GENERAL] pgbench - prevent client from aborting on ERROR

2015-04-30 Thread Adrian Klaver
On 04/30/2015 11:36 AM, Nicholson, Brad (Toronto, ON, CA) wrote: Hi, Is there any way to do this? For context, I'm wanting to write a custom script in repeatable read isolation level. If I hit a serializable error, I don't want the client to abort, I want it to continue running transactions.

[GENERAL] pgbench - prevent client from aborting on ERROR

2015-04-30 Thread Nicholson, Brad (Toronto, ON, CA)
Hi, Is there any way to do this? For context, I'm wanting to write a custom script in repeatable read isolation level. If I hit a serializable error, I don't want the client to abort, I want it to continue running transactions. Is that possible? thanks, Brad. -- Sent via pgsql-general m

Re: [GENERAL] pgbench

2014-12-13 Thread alikon
Hi, can you share the plsql procedure to call the query from pgbench i'm running in the same issue cause i have a long query that i want to submit to pgbench There are any news for fix this pgbench issue ? -- View this message in context: http://postgresql.nabble.com/pgbench-tp5773225p5830455

[GENERAL] pgbench and GP

2013-12-26 Thread GR Vishwanath
I am very eager to test our GP4.2/PG 8.2 with pgworkbench. Is it simply (??) a matter of running the test against all the individual segments, or maybe an individual representative segment (aka PG instance)? Thanks GR

Re: [GENERAL] pgbench

2013-10-04 Thread Simeó Reig
A 2013-10-03 17:50, Alvaro Herrera escrigué: Giuseppe Broccolo wrote: The format of the script file has to be one SQL command per line; multiline SQL commands are not supported, and empty lines are ignored. This could bring to errors. Could this be your case? Multiline SQL commands are not su

Re: [GENERAL] pgbench

2013-10-03 Thread Tom Lane
Alvaro Herrera writes: > Multiline SQL commands are not supported? Well that sucks, because only > BUFSIZ chars are read from each line. In my platform that's 8192, but > maybe in Simeó's case it's shorter .. or maybe his query really is > longer than 8192 bytes. > This smells like a pgbench b

Re: [GENERAL] pgbench

2013-10-03 Thread Alvaro Herrera
Giuseppe Broccolo wrote: > The format of the script file has to be one SQL command per line; > multiline SQL commands are not supported, and empty lines are > ignored. This could bring to errors. Could this be your case? Multiline SQL commands are not supported? Well that sucks, because only BUF

Re: [GENERAL] pgbench

2013-10-03 Thread Adrian Klaver
On 10/03/2013 07:48 AM, Simeó Reig wrote: A 2013-10-03 16:40, Adrian Klaver escrigué: On 10/03/2013 07:23 AM, Simeó Reig wrote: Unfortunately I can't put the sql here, but I repeat: I could do: psql -d databasename > scrip_file.sql and it works perfectly, and It is a one line query. I wo

Re: [GENERAL] pgbench

2013-10-03 Thread Giuseppe Broccolo
Il 03/10/2013 16:11, Simeó Reig ha scritto: A 2013-10-03 15:51, Adrian Klaver escrigué: On 10/03/2013 06:21 AM, Simeó Reig wrote: Hello I was doing a performance test with pgbench with a pretty long queries and I have the next error: $ pgbench -n -c1 -T 3 -f veins_pgbench.sql pdn Cl

Re: [GENERAL] pgbench

2013-10-03 Thread Simeó Reig
A 2013-10-03 16:40, Adrian Klaver escrigué: On 10/03/2013 07:23 AM, Simeó Reig wrote: You have not shown the query, but could you be running into the belwo: http://www.postgresql.org/docs/9.3/interactive/pgbench.html "The format of a script file is one SQL command per line; multiline SQL c

Re: [GENERAL] pgbench

2013-10-03 Thread Adrian Klaver
On 10/03/2013 07:23 AM, Simeó Reig wrote: You have not shown the query, but could you be running into the belwo: http://www.postgresql.org/docs/9.3/interactive/pgbench.html "The format of a script file is one SQL command per line; multiline SQL commands are not supported. Empty lines and line

Re: [GENERAL] pgbench

2013-10-03 Thread Simeó Reig
A 2013-10-03 16:16, Adrian Klaver escrigué: On 10/03/2013 07:11 AM, Simeó Reig wrote: A 2013-10-03 15:51, Adrian Klaver escrigué: On 10/03/2013 06:21 AM, Simeó Reig wrote: Hello I was doing a performance test with pgbench with a pretty long queries and I have the next error: $ pgbenc

Re: [GENERAL] pgbench

2013-10-03 Thread Simeó Reig
A 2013-10-03 15:51, Adrian Klaver escrigué: On 10/03/2013 06:21 AM, Simeó Reig wrote: Hello I was doing a performance test with pgbench with a pretty long queries and I have the next error: $ pgbench -n -c1 -T 3 -f veins_pgbench.sql pdn Client 0 aborted in state 0: ERROR: syntax err

Re: [GENERAL] pgbench

2013-10-03 Thread Adrian Klaver
On 10/03/2013 07:11 AM, Simeó Reig wrote: A 2013-10-03 15:51, Adrian Klaver escrigué: On 10/03/2013 06:21 AM, Simeó Reig wrote: Hello I was doing a performance test with pgbench with a pretty long queries and I have the next error: $ pgbench -n -c1 -T 3 -f veins_pgbench.sql pdn Client

Re: [GENERAL] pgbench

2013-10-03 Thread Adrian Klaver
On 10/03/2013 06:21 AM, Simeó Reig wrote: Hello I was doing a performance test with pgbench with a pretty long queries and I have the next error: $ pgbench -n -c1 -T 3 -f veins_pgbench.sql pdn Client 0 aborted in state 0: ERROR: syntax error at end of input LINE 1: ...(abc.persones.p

[GENERAL] pgbench

2013-10-03 Thread Simeó Reig
Hello I was doing a performance test with pgbench with a pretty long queries and I have the next error: $ pgbench -n -c1 -T 3 -f veins_pgbench.sql pdn Client 0 aborted in state 0: ERROR: syntax error at end of input LINE 1: ...(abc.persones.provincia = abc.poblacions.cod_provinc ^ tran

Re: [GENERAL] pgbench help

2012-12-24 Thread Atri Sharma
Sent from my iPad On 24-Dec-2012, at 17:15, Georges Racinet wrote: > On 12/24/2012 12:32 PM, John R Pierce wrote: >> On 12/24/2012 2:43 AM, Georges Racinet wrote: >>> Make sure both servers aren't running at the same time >> >> why? its perfectly OK to ahve severla postgres servers running at

Re: [GENERAL] pgbench help

2012-12-24 Thread Georges Racinet
On 12/24/2012 12:32 PM, John R Pierce wrote: > On 12/24/2012 2:43 AM, Georges Racinet wrote: >> Make sure both servers aren't running at the same time > > why? its perfectly OK to ahve severla postgres servers running at > once, as long as they are on different port numbers. I generally use > 543

Re: [GENERAL] pgbench help

2012-12-24 Thread John R Pierce
On 12/24/2012 2:43 AM, Georges Racinet wrote: Make sure both servers aren't running at the same time why? its perfectly OK to ahve severla postgres servers running at once, as long as they are on different port numbers. I generally use 5432, 5433, 5434, etc for this. mostly for developmen

Re: [GENERAL] pgbench help

2012-12-24 Thread Atri Sharma
On Mon, Dec 24, 2012 at 4:13 PM, Georges Racinet wrote: > On 12/24/2012 08:50 AM, Atri Sharma wrote: >> I have two 9.2 servers running in different data directories and >> installation directories. One of them(the main one) has its bin in the >> path of my system.The other one does not, hence, I n

Re: [GENERAL] pgbench help

2012-12-24 Thread Georges Racinet
On 12/24/2012 08:50 AM, Atri Sharma wrote: > I have two 9.2 servers running in different data directories and > installation directories. One of them(the main one) has its bin in the > path of my system.The other one does not, hence, I need to use the > complete path(/usr/local/pgsql/...). > > I wa

[GENERAL] pgbench help

2012-12-23 Thread Atri Sharma
Hi all, I have two 9.2 servers running in different data directories and installation directories. One of them(the main one) has its bin in the path of my system.The other one does not, hence, I need to use the complete path(/usr/local/pgsql/...). I want to run pgbench on the second server. How s

Re: [GENERAL] pgbench out of memory error

2010-01-05 Thread Greg Smith
Jeff Ross wrote: I'm trying to put a new server on line and I'm having a problem getting any kind of decent performance from it. pgbench yields around 4000 tps until scale and clients both are above 21, then I see the following: NOTICE: ALTER TABLE / ADD PRIMARY KEY will create implicit index

[GENERAL] pgbench out of memory error

2010-01-05 Thread Jeff Ross
Hi, I'm trying to put a new server on line and I'm having a problem getting any kind of decent performance from it. pgbench yields around 4000 tps until scale and clients both are above 21, then I see the following: ... 218 tuples done. 219 tuples done. 220 tuples done. set prima

Re: [GENERAL] Pgbench tool download

2009-08-17 Thread Josh Kupershmidt
On Mon, Aug 17, 2009 at 11:56 AM, Chris Barnes wrote: > I am looking for pgbench. Is there a good source from which I can download > the most current version? If you installed from source, look under contrib for the pgbench subdirectory. If you installed from your OS's package repository, try look

[GENERAL] Pgbench tool download

2009-08-17 Thread Chris Barnes
I am looking for pgbench. Is there a good source from which I can download the most current version? your help is appeciated, Chris _ Stay on top of things, check email from other accounts! http://go.microsoft.com/?linkid=96

Re: [GENERAL] pgbench

2008-08-08 Thread Heeman Lee
Never mind. I found it. On Fri, 2008-08-08 at 12:16 -0400, Heeman Lee wrote: > Hi, > > I can't find pgbench on the package we installed. I built, contrib pkg > and installed, but that still didn't generate pgbench anywhere. > Any idea where to get pgbench? > > -- > Heeman Lee -- Heeman Lee

[GENERAL] pgbench

2008-08-08 Thread Heeman Lee
Hi, I can't find pgbench on the package we installed. I built, contrib pkg and installed, but that still didn't generate pgbench anywhere. Any idea where to get pgbench? -- Heeman Lee

Re: [GENERAL] pgbench not setting scale size correctly?

2008-03-14 Thread Justin
Greg Smith wrote: On Fri, 14 Mar 2008, Justin wrote: I was wondering why the -s would not rescale the data? First, you don't know how to rescale the data if someone is passing in a custom script. More importantly, people don't expect the benchmark tool to change things in tables unless s

Re: [GENERAL] pgbench not setting scale size correctly?

2008-03-14 Thread Justin
Tom Lane wrote: Justin <[EMAIL PROTECTED]> writes: I was wondering why the -s would not rescale the data? That would involve re-initializing the table contents. If that's what you want, use -i. regards, tom lane thanks

Re: [GENERAL] pgbench not setting scale size correctly?

2008-03-14 Thread Greg Smith
On Fri, 14 Mar 2008, Justin wrote: I was wondering why the -s would not rescale the data? First, you don't know how to rescale the data if someone is passing in a custom script. More importantly, people don't expect the benchmark tool to change things in tables unless specifically requeste

Re: [GENERAL] pgbench not setting scale size correctly?

2008-03-14 Thread Tom Lane
Justin <[EMAIL PROTECTED]> writes: > I was wondering why the -s would not rescale the data? That would involve re-initializing the table contents. If that's what you want, use -i. regards, tom lane -- Sent via pgsql-general mailing list (pgsql-general@postgresql.org) T

Re: [GENERAL] pgbench not setting scale size correctly?

2008-03-14 Thread Justin
Tom Lane wrote: Greg Smith <[EMAIL PROTECTED]> writes: On Fri, 14 Mar 2008, Tom Lane wrote: Yeah, -s is only meaningful when given with -i. Maybe someday we ought to fix pgbench to complain if you try to set it at other times. You have to pass -s in to the actual run if y

Re: [GENERAL] pgbench not setting scale size correctly?

2008-03-14 Thread Tom Lane
Greg Smith <[EMAIL PROTECTED]> writes: > On Fri, 14 Mar 2008, Tom Lane wrote: >> Yeah, -s is only meaningful when given with -i. Maybe someday we ought >> to fix pgbench to complain if you try to set it at other times. > You have to pass -s in to the actual run if you're specifying your own > cu

Re: [GENERAL] pgbench not setting scale size correctly?

2008-03-14 Thread Greg Smith
On Fri, 14 Mar 2008, Tom Lane wrote: "Pavan Deolasee" <[EMAIL PROTECTED]> writes: You must have initialized pgbench with scale 1. Yeah, -s is only meaningful when given with -i. Maybe someday we ought to fix pgbench to complain if you try to set it at other times. You have to pass -s in to

Re: [GENERAL] pgbench not setting scale size correctly?

2008-03-14 Thread Tom Lane
"Pavan Deolasee" <[EMAIL PROTECTED]> writes: > On Fri, Mar 14, 2008 at 2:34 PM, Enrico Sirola <[EMAIL PROTECTED]> wrote: >> as you see, the reported scaling factor is 1, but I specified -s 1000, > You must have initialized pgbench with scale 1. Yeah, -s is only meaningful when given with -i. May

Re: [GENERAL] pgbench not setting scale size correctly?

2008-03-14 Thread Pavan Deolasee
On Fri, Mar 14, 2008 at 2:34 PM, Enrico Sirola <[EMAIL PROTECTED]> wrote: > > as you see, the reported scaling factor is 1, but I specified -s 1000, > which seems strange... I'm going to recompile it from the sources now. > Didn't I get anything or there is a bug somewhere? You must have initi

[GENERAL] pgbench not setting scale size correctly?

2008-03-14 Thread Enrico Sirola
Hello, I'm trying to perform some benchmarks using pgbench. I'm using the following rpm package: postgresql-contrib-8.3.0-2PGDG.rhel5 for x86_64, downloaded from the pgsql yum repository for centos5/amd64. When I init the pgbench database, the scale factor seems to work, however when perfor

Re: [GENERAL] pgbench

2006-03-04 Thread Tatsuo Ishii
pgbench comes with PostgreSQL source code distribution and must be compiled under PostgreSQL source tree. I'm not familiar with MacOS but I guess there may be pre-compiled package. Anyone can help him? -- Tatsuo Ishii SRA OSS, Inc. Japan > I have just received my new MacBook (1.83Gz. Duo) and wan