Re: LOG: could not send data to client: Broken pipe

2020-06-02 Thread Adrian Klaver
On 6/2/20 12:20 PM, TALLURI Nareshkumar wrote: Hello Adrian, What is the application stack? - I will check with Application team and get back to you. When I see Windows and interruptions to Postgres I think anti-virus software. Is there any running on the client? yes ,

Re: Oracle vs. PostgreSQL - a comment

2020-06-02 Thread raf
Ron wrote: > On 6/2/20 1:56 PM, Tim Clarke wrote: > > On 02/06/2020 19:43, Stephen Frost wrote: > > > > But require a new port, and Enterprises have Processes that must be > > > > followed. > > > Sure they do. Automate them. > > > > > > :) > > > > > > Thanks, > > > Stephen > > > > +1 for

Re: Oracle vs. PostgreSQL - a comment

2020-06-02 Thread Kenneth Marshall
On Tue, Jun 02, 2020 at 11:18:52PM +0200, Thomas Kellerer wrote: > Ron schrieb am 02.06.2020 um 20:38: > > > >>   PG's individual clusters are relatively lightweight, after all. > > > >But require a new port, and Enterprises have Processes that must be followed. > > I am not 100% sure, but I

Re: Vanishing unique constraint

2020-06-02 Thread Bernhard Beroun
Am Montag, Juni 01, 2020 17:27 CEST, schrieb Julien Rouhaud :  On Mon, Jun 1, 2020 at 1:23 PM Bernhard Beroun wrote: > > Am Montag, Juni 01, 2020 12:56 CEST, schrieb Julien Rouhaud > : > > On Mon, Jun 1, 2020 at 11:15 AM Bernhard Beroun wrote: > > > > Hello, > > > > I am experiencing a

Re: Oracle vs. PostgreSQL - a comment

2020-06-02 Thread Stephen Frost
Greetings, * Adam Brusselback (adambrusselb...@gmail.com) wrote: > > How good will that be in performance. > > In my experience, not great. It's definitely better than not having it at > all, but it does not make for quick queries and caused serious > connection overhead when a query referenced

Re: Oracle vs. PostgreSQL - a comment

2020-06-02 Thread Stephen Frost
Greetings, * Guyren Howe (guy...@gmail.com) wrote: > On Jun 2, 2020, at 14:16 , Stephen Frost wrote: > > I'm sure there's things we can do to improve the performance of the FDW. > > Not sure we'll get to a point where we are actually cacheing information > > from the far side... but who knows,

Re: Oracle vs. PostgreSQL - a comment

2020-06-02 Thread Adam Brusselback
> How good will that be in performance. In my experience, not great. It's definitely better than not having it at all, but it does not make for quick queries and caused serious connection overhead when a query referenced that foreign table. I've since moved to logical replication to improve the

Re: Oracle vs. PostgreSQL - a comment

2020-06-02 Thread Guyren Howe
On Jun 2, 2020, at 14:16 , Stephen Frost wrote: > > Greetings, > I'm sure there's things we can do to improve the performance of the FDW. > Not sure we'll get to a point where we are actually cacheing information > from the far side... but who knows, maybe if we arrange to have a > notification

Re: Oracle vs. PostgreSQL - a comment

2020-06-02 Thread Thomas Kellerer
Ron schrieb am 02.06.2020 um 20:38:    PG's individual clusters are relatively lightweight, after all. But require a new port, and Enterprises have Processes that must be followed. I am not 100% sure, but I think you can get around that by putting pgPool or pgBouncer in front and make all

Re: Oracle vs. PostgreSQL - a comment

2020-06-02 Thread Stephen Frost
Greetings, * Ravi Krishna (sravikris...@comcast.net) wrote: > > Eh, that's something that I think we should be looking at supporting, by > > using FDWs, but I haven't tried to figure out how hard it'd be. > > How good will that be in performance. > > In db2 you can do it using dblinks and that

Re: Oracle vs. PostgreSQL - a comment

2020-06-02 Thread Ravi Krishna
> > Eh, that's something that I think we should be looking at supporting, by > using FDWs, but I haven't tried to figure out how hard it'd be. > How good will that be in performance. In db2 you can do it using dblinks and that kills performance. isn't FDW something like dblink. The cool

Re: Oracle vs. PostgreSQL - a comment

2020-06-02 Thread Christophe Pettus
> On Jun 2, 2020, at 13:30, Stephen Frost wrote: > > Eh, that's something that I think we should be looking at supporting, by > using FDWs, but I haven't tried to figure out how hard it'd be. Being able to access a FDW that way would rock. -- -- Christophe Pettus x...@thebuild.com

Re: Oracle vs. PostgreSQL - a comment

2020-06-02 Thread Stephen Frost
Greetings, * Ravi Krishna (sravikris...@comcast.net) wrote: > > Generally speaking, I discourage having lots of databases under one PG > > cluster for exactly these kinds of reasons. PG's individual clusters > > are relatively lightweight, after all. > > Plus PG does not directly support cross

Re: Oracle vs. PostgreSQL - a comment

2020-06-02 Thread Guyren Howe
On Jun 2, 2020, at 12:45 , Ravi Krishna wrote: > >> >> >> Generally speaking, I discourage having lots of databases under one PG >> cluster for exactly these kinds of reasons. PG's individual clusters >> are relatively lightweight, after all. >> > > Plus PG does not directly support cross

Re: Oracle vs. PostgreSQL - a comment

2020-06-02 Thread Ravi Krishna
> > Generally speaking, I discourage having lots of databases under one PG > cluster for exactly these kinds of reasons. PG's individual clusters > are relatively lightweight, after all. > Plus PG does not directly support cross database queries using 3 part name, something sqlserver excels

Re: Oracle vs. PostgreSQL - a comment

2020-06-02 Thread Ron
On 6/2/20 1:56 PM, Tim Clarke wrote: On 02/06/2020 19:43, Stephen Frost wrote: But require a new port, and Enterprises have Processes that must be followed. Sure they do. Automate them. :) Thanks, Stephen +1 for automation, isoX != slow It is when FW rules must be manually approved (and

RE: LOG: could not send data to client: Broken pipe

2020-06-02 Thread TALLURI Nareshkumar
Hello Adrian, What is the application stack? - I will check with Application team and get back to you. When I see Windows and interruptions to Postgres I think anti-virus software. Is there any running on the client? yes , symantec Are the client and server on the same

Re: Oracle vs. PostgreSQL - a comment

2020-06-02 Thread Tim Clarke
On 02/06/2020 19:43, Stephen Frost wrote: >> But require a new port, and Enterprises have Processes that must be followed. > Sure they do. Automate them. > > :) > > Thanks, > > Stephen +1 for automation, isoX != slow Tim Clarke MBCS IT Director Direct: +44 (0)1376 504510 | Mobile: +44 (0)7887

Re: LOG: could not send data to client: Broken pipe

2020-06-02 Thread Adrian Klaver
On 6/2/20 11:18 AM, TALLURI Nareshkumar wrote: Hello Adrian Klaver, Here is the answers What version of JDBC? : 9.3-1104-jdbc41 What is the application stack? : Java That is the programming language. I was looking for the actual

Re: Oracle vs. PostgreSQL - a comment

2020-06-02 Thread Stephen Frost
Greetings, * Ron (ronljohnso...@gmail.com) wrote: > On 6/2/20 1:30 PM, Stephen Frost wrote: > >* Ron (ronljohnso...@gmail.com) wrote: > >>On 6/2/20 4:59 AM, Grigory Smolkin wrote: > >>>On 6/2/20 11:22 AM, Ron wrote: > The inability to do a point-in-time restoration of a *single* database >

Re: Oracle vs. PostgreSQL - a comment

2020-06-02 Thread Ron
On 6/2/20 1:30 PM, Stephen Frost wrote: Greetings, * Ron (ronljohnso...@gmail.com) wrote: On 6/2/20 4:59 AM, Grigory Smolkin wrote: On 6/2/20 11:22 AM, Ron wrote: The inability to do a point-in-time restoration of a *single* database in a multi-db cluster is a serious -- and fundamental --

RE: LOG: could not send data to client: Broken pipe

2020-06-02 Thread TALLURI Nareshkumar
Hello Adrian Klaver, Here is the answers What version of JDBC? : 9.3-1104-jdbc41 What is the application stack? : Java Client OS? : windows 2016 What is the network distance between the

Re: Oracle vs. PostgreSQL - a comment

2020-06-02 Thread Stephen Frost
Greetings, * Ron (ronljohnso...@gmail.com) wrote: > On 6/2/20 4:59 AM, Grigory Smolkin wrote: > >On 6/2/20 11:22 AM, Ron wrote: > >>The inability to do a point-in-time restoration of a *single* database > >>in a multi-db cluster is a serious -- and fundamental -- missing feature > >>(never to be

Re: Oracle vs. PostgreSQL - a comment

2020-06-02 Thread Ron
On 6/2/20 4:59 AM, Grigory Smolkin wrote: On 6/2/20 11:22 AM, Ron wrote: The inability to do a point-in-time restoration of a *single* database in a multi-db cluster is a serious -- and fundamental -- missing feature (never to be implemented because of the fundamental design). It is

Re: Oracle vs. PostgreSQL - a comment

2020-06-02 Thread Ron
On 6/2/20 3:27 AM, Tim Clarke wrote: On 02/06/2020 09:22, Ron wrote: The inability to do a point-in-time restoration of a *single* database in a multi-db cluster is a serious -- and fundamental -- missing feature (never to be implemented because of the fundamental design). In SQL Server,

Re: When to use PARTITION BY HASH?

2020-06-02 Thread Stephen Frost
Greetings, Please don't cross post to multiple lists without any particular reason for doing so- pick whichever list makes sense and post to that. * Oleksandr Shulgin (oleksandr.shul...@zalando.de) wrote: > I was reading up on declarative partitioning[1] and I'm not sure what could > be a

Re: When to use PARTITION BY HASH?

2020-06-02 Thread Michel Pelletier
On Tue, Jun 2, 2020 at 10:17 AM Oleksandr Shulgin < oleksandr.shul...@zalando.de> wrote: > Hi! > > I was reading up on declarative partitioning[1] and I'm not sure what > could be a possible application of Hash partitioning. > > Is anyone actually using it? What are typical use cases? What

Re: When to use PARTITION BY HASH?

2020-06-02 Thread David G. Johnston
On Tue, Jun 2, 2020 at 10:17 AM Oleksandr Shulgin < oleksandr.shul...@zalando.de> wrote: > That *might* turn out to be the case with a small number of distinct > values in the partitioning column(s), but then why rely on hash > assignment instead of using PARTITION BY LIST in the first place? > >

Re: When to use PARTITION BY HASH?

2020-06-02 Thread MichaelDBA
Hi, I use it quite often, since I'm dealing with partitioning keys that have high cardinality, ie, high number of different values.  If your cardinality is very high, but your spacing between values is not uniform, HASH will balance your partitioned tables naturally.  If your spacing between

When to use PARTITION BY HASH?

2020-06-02 Thread Oleksandr Shulgin
Hi! I was reading up on declarative partitioning[1] and I'm not sure what could be a possible application of Hash partitioning. Is anyone actually using it? What are typical use cases? What benefits does such a partitioning scheme provide? On its face, it seems that it can only give you a

Re: Oracle vs. PostgreSQL - a comment

2020-06-02 Thread Michael Nolan
I spent about 10 years as an Oracle DBA (back around Oracle 7 and 8) and the last 20 or so years doing PostgreSQL. My initial impressions were that Oracle did a better job providing tools and options that users and DBAs need and PostgreSQL was pretty much roll-your-own. Things like being able to

Re: LOG: could not send data to client: Broken pipe

2020-06-02 Thread Adrian Klaver
On 6/1/20 8:41 PM, TALLURI Nareshkumar wrote: Hello Postgres Support Team, I need your help to identify the issue and apply the fix for it. My client is running one query through Application and getting error like below. 11:20:46.298 [http-nio-8083-exec-7] ERROR

Re: LOG: could not send data to client: Broken pipe

2020-06-02 Thread Adrian Klaver
On 6/1/20 8:41 PM, TALLURI Nareshkumar wrote: Hello Postgres Support Team, I need your help to identify the issue and apply the fix for it. My client is running one query through Application and getting error like below. 11:20:46.298 [http-nio-8083-exec-7] ERROR

Re: Fine grained permissions on User Mapping

2020-06-02 Thread Tom Lane
Paul Bonaud writes: > Imagine you have a destination database which you have no control over. > Let's call it “external-db”. This database has a unique pg user (no > specific pg permission attributes) with read-write access to the whole > database let's call it “external-user”. > ... > Now over

Re: Using JSONB with nested key-value structures, and skipping/wildcarding the key

2020-06-02 Thread Alban Hertroys
> On 2 Jun 2020, at 9:30, Shaheed Haque wrote: > > >> I do something like this to get a set of sub-paths in a JSONB field (no idea >> how to write that in Django): >> >> select snapshot->’pay_definition’->k.value->’name’ >> from MyModel >> join lateral

Re: Patroni

2020-06-02 Thread Paul Förster
Hi Sonam, > On 02. Jun, 2020, at 13:36, Sonam Sharma wrote: > > Can someone please share steps or any link for how to do set up postgres > replication using patroni. And also to test automatic failover. all you need to know is here: https://github.com/zalando/patroni Cheers, Paul

Fine grained permissions on User Mapping

2020-06-02 Thread Paul Bonaud
Hello, I couldn't find any answer in the PostgreSQL documentation so here I am with a question regarding FDW and User Mappings. *Is it possible to define permissions on user mappings to hide the connection info (mainly the password) to a user?* More details of the context: Imagine you have

Re: Oracle vs. PostgreSQL - a comment

2020-06-02 Thread Tim Clarke
On 02/06/2020 09:22, Ron wrote: The inability to do a point-in-time restoration of a single database in a multi-db cluster is a serious -- and fundamental -- missing feature (never to be implemented because of the fundamental design). In SQL Server, it's trivial to restore -- including

LOG: could not send data to client: Broken pipe

2020-06-02 Thread TALLURI Nareshkumar
Hello Postgres Support Team, I need your help to identify the issue and apply the fix for it. My client is running one query through Application and getting error like below. 11:20:46.298 [http-nio-8083-exec-7] ERROR c.s.s.g.a.alcor.pdi.dao.PdiDao - While getting pdi from 2019-12-21 to

Patroni

2020-06-02 Thread Sonam Sharma
Can someone please share steps or any link for how to do set up postgres replication using patroni. And also to test automatic failover. Thanks in advance, Sonam

Re: pg_dump crashes

2020-06-02 Thread Nico De Ranter
FYI: I tried setting the md5 field to '' in the whole table but that didn't fix the pg_dump issue. In the end I decided to drop the database and revert to my last successful backup. I'm now still reading in all tapes to reconstruct the latest database state. Thanks for the help anyway. Nico

Re: Oracle vs. PostgreSQL - a comment

2020-06-02 Thread Grigory Smolkin
On 6/2/20 11:22 AM, Ron wrote: The inability to do a point-in-time restoration of a *single* database in a multi-db cluster is a serious -- and fundamental -- missing feature (never to be implemented because of the fundamental design). It is possible via 3rd party tools like pg_probackup and

Re: Oracle vs. PostgreSQL - a comment

2020-06-02 Thread Ron
On 6/1/20 4:58 AM, Peter J. Holzer wrote: [snip] As a developer (and part time DBA) I have a hard time thinking of any Oracle feature that I'm missing in PostgreSQL. The inability to do a point-in-time restoration of a *single* database in a multi-db cluster is a serious -- and fundamental --

Re: Using JSONB with nested key-value structures, and skipping/wildcarding the key

2020-06-02 Thread Thomas Kellerer
> One question: as a novice here, I think I understand the right hand > side of your JOIN "... k(value)" is shorthand for: > > ... AS table_name(column_name) > > except that I don't see any clues in the docs that > jsonb_object_keys() is a "table function".> Can you kindly clarify? The clue is in

Re: Using JSONB with nested key-value structures, and skipping/wildcarding the key

2020-06-02 Thread Shaheed Haque
> > Hi, > > On Mon, 1 Jun 2020 at 23:50, Alban Hertroys wrote: > > On 1 Jun 2020, at 20:18, Shaheed Haque wrote: > > > > Hi, > > > > I'm using Django's ORM to access Postgres12. My "MyModel" table has a > JSONB column called 'snapshot'. In Python terms, each row's 'snapshot' > looks like this: