Re: [GENERAL] Proper relational database?

2016-04-22 Thread Guyren Howe
On Apr 22, 2016, at 18:56 , wrote: > > Why schema-on-demand? Can you explain what you mean by that? Something that is attractive, for beginners or perhaps when prototyping is that you don't have to declare a table. You can just insert tuples into a predicate whose name you provide and they go

Re: [GENERAL] Proper relational database?

2016-04-22 Thread Manuel Gómez
On Sat, Apr 23, 2016 at 12:05 AM, Thomas Munro wrote: > FWIW standard SQL may not allow it but Postgres does, and it's even > possible to exclude duplicates by using an expression that references > the whole row. Indeed, but its semantics can be rather wonky. Witness: postgres=# select 1; ?col

Re: [GENERAL] [NOVICE] Fwd: Process scheduling in postgres

2016-04-22 Thread Sameer Kumar
On Fri, Apr 22, 2016 at 5:21 PM raghu vineel wrote: > > Hi, > > I have a 4 core CPU for postgres and I have submitted 6 queries parallely > in 6 different sessions. But I am seeing only 1 query per CPU and the > remainig queries are queued. I am not sure why is it happening. Do you have > any spe

Re: [GENERAL] Add relcreated (timestamp) column to pg_class catalog to record the time an object was created

2016-04-22 Thread Shulgin, Oleksandr
On Apr 22, 2016 19:46, "Melvin Davidson" wrote: > > > First, tahnk you for your feedback Alex. > > "IMO, every time it was conclusively demonstrated that when you consider dump/restore semantics, this feature can have exactly zero value if implemented *inside pg_catalog*. And it would have to be

Re: [GENERAL] Proper relational database?

2016-04-22 Thread david
> So, let's just flat-out ask. > > Dear Important People: would the PostgreSQL project consider supporting > other query languages? Or creating a plug-in mechanism for them, so that > alternative interface languages could be added without changing the base > code? I very much doubt it. The use c

Re: [GENERAL] Proper relational database?

2016-04-22 Thread Thomas Munro
On Sat, Apr 23, 2016 at 2:04 PM, wrote: >> Why is starting at a low level important? A database is truly relational to >> the extent that it implements the relational model. If you don't want the >> database to allow tables without keys, or to allow null values, don't let >> people create them.

Re: [GENERAL] Proper relational database?

2016-04-22 Thread david
> On Fri, Apr 22, 2016 at 10:45 PM, John R Pierce wrote: > > a table with no columns would have no primary key... doesn't that > > violate one of the fundamental tenets of the relational model ? > > Not as I understand it. A relation must have at least one candidate key. > That will be the set

Re: [GENERAL] Proper relational database?

2016-04-22 Thread Raymond Brinzer
On Fri, Apr 22, 2016 at 10:45 PM, John R Pierce wrote: > a table with no columns would have no primary key... doesn't that violate > one of the fundamental tenets of the relational model ? Not as I understand it. A relation must have at least one candidate key. That will be the set of all the

Re: [GENERAL] Proper relational database?

2016-04-22 Thread John R Pierce
On 4/22/2016 7:04 PM, da...@andl.org wrote: Absolutely not. SQL is a (nearly) full implementation of the relational algebra, plus other non-relational stuff. The only thing it really can't handle is a table with no columns! (I have to fake that) a table with no columns would have no primary

Re: [GENERAL] Proper relational database?

2016-04-22 Thread david
> Why is starting at a low level important? A database is truly relational to > the extent that it implements the relational model. If you don't want the > database to allow tables without keys, or to allow null values, don't let > people create them. If the underlying machinery allows them, that

Re: [GENERAL] Proper relational database?

2016-04-22 Thread david
Eventual consistency is not part of the language, so outside the scope of Andl. Easy distribution depends on a standardised language. SQL is a definite fail. There is only one Andl and it works identically on all platforms. That should help. Why schema-on-demand? Can you explain what you

Re: [GENERAL] Proper relational database?

2016-04-22 Thread david
Andl is a "proper relational database" language. Andl is an original implementation of the language D described in The Third Manifesto. http://www.dcs.warwick.ac.uk/~hugh/TTM/. I have a working implementation of Andl on Postgres. See http://www.andl.org/2016/04/postgres-meet-andl/. This versio

Re: [GENERAL] Proper relational database?

2016-04-22 Thread Manuel Gómez
On Fri, Apr 22, 2016 at 3:07 PM, Paul Jungwirth wrote: > I'm surprised no one yet has mentioned Tutorial D by C. J. Date. His book > _Database in Depth_ is pretty much an extended argument for how superior it > is to SQL. RelDB is apparently an open source implementation of it, and D4 > is a comme

Re: [GENERAL] Fwd: Process scheduling in postgres

2016-04-22 Thread John R Pierce
On 4/22/2016 1:30 AM, raghu vineel wrote: I have a 4 core CPU for postgres and I have submitted 6 queries parallely in 6 different sessions. But I am seeing only 1 query per CPU and the remainig queries are queued. I am not sure why is it happening. Do you have any special scheduler for postg

Re: [GENERAL] Columnar store as default for PostgreSQL 10?

2016-04-22 Thread Guyren Howe
On Apr 22, 2016, at 15:03 , Merlin Moncure wrote: > > On Thu, Apr 21, 2016 at 5:08 AM, Bráulio Bhavamitra > wrote: >> I'm finally having performance issues with PostgreSQL when doing big >> analytics queries over almost the entire database of more than 100gb of >> data. >> >> And what I keep r

Re: [GENERAL] Columnar store as default for PostgreSQL 10?

2016-04-22 Thread Merlin Moncure
On Thu, Apr 21, 2016 at 5:08 AM, Bráulio Bhavamitra wrote: > Hi all, > > I'm finally having performance issues with PostgreSQL when doing big > analytics queries over almost the entire database of more than 100gb of > data. > > And what I keep reading all over the web is many databases switching t

[GENERAL] Fwd: Process scheduling in postgres

2016-04-22 Thread raghu vineel
Hi, I have a 4 core CPU for postgres and I have submitted 6 queries parallely in 6 different sessions. But I am seeing only 1 query per CPU and the remainig queries are queued. I am not sure why is it happening. Do you have any special scheduler for postgres? I can see that CPU has been shared wit

Re: [GENERAL] Columnar store as default for PostgreSQL 10?

2016-04-22 Thread jje
An interesting topic we have also discussed in our team. Realistically - this is more about picking the right software for the job. PostgreSQL has come so far up in it's performance for more general workloads that it is fast becoming a bit of a darling in the world of cloud - being able to handle

Re: [GENERAL] Proper relational database?

2016-04-22 Thread David G. Johnston
On Fri, Apr 22, 2016 at 12:54 PM, Guyren Howe wrote: > The SQL language is terrible but we can live with it. > ​If anything, and especially something as pervasive and esoteric as SQL, makes you question your desire to live please get help.​ > But the answer to "Are there any relational data st

Re: [GENERAL] Proper relational database?

2016-04-22 Thread Joshua D. Drake
On 04/22/2016 12:25 PM, Raymond Brinzer wrote: So, let's just flat-out ask. Dear Important People: would the PostgreSQL project consider supporting other query languages? Or creating a plug-in mechanism for them, so that alternative interface languages could be added without changing the base c

Re: [GENERAL] Proper relational database?

2016-04-22 Thread Guyren Howe
The SQL language is terrible but we can live with it. But the answer to "Are there any relational data stores that offer eventual consistency, easy distribution, schema-on-demand or any such things a large modern application can use?" appears to be no. And that's just awful. > On Apr 22, 2016,

Re: [GENERAL] Proper relational database?

2016-04-22 Thread David G. Johnston
On Fri, Apr 22, 2016 at 12:25 PM, Raymond Brinzer wrote: > So, let's just flat-out ask. > > Dear Important People: would the PostgreSQL project consider > supporting other query languages? Or creating a plug-in mechanism for > them, so that alternative interface languages could be added without

Re: [GENERAL] Proper relational database?

2016-04-22 Thread Paul Jungwirth
On 04/21/2016 01:36 PM, Guyren Howe wrote: Anyone familiar with the issue would have to say that the tech world > would be a significantly better place if IBM had developed a real > relational database with an elegant query language I'm surprised no one yet has mentioned Tutorial D by C. J. Dat

Re: [GENERAL] Proper relational database?

2016-04-22 Thread Raymond Brinzer
So, let's just flat-out ask. Dear Important People: would the PostgreSQL project consider supporting other query languages? Or creating a plug-in mechanism for them, so that alternative interface languages could be added without changing the base code? On Thu, Apr 21, 2016 at 4:36 PM, Guyren Ho

Re: [GENERAL] Enhancement request for pg_dump

2016-04-22 Thread Adrian Klaver
On 04/22/2016 11:16 AM, Pierre Chevalier Géologue wrote: Le 22/04/2016 19:11, Adrian Klaver a écrit : Last time I had to do this kind of exercise, a few years ago, I was in a remote place without Internet access, so I could not get any information or ask any help. I was kind of surprised/frustr

Re: [GENERAL] Proper relational database?

2016-04-22 Thread Guyren Howe
On Apr 22, 2016, at 10:45 , Raymond Brinzer wrote: > > Are there relational algebra expressions, or other operations > necessary to a truly relational database, which cannot be translated > into SQL? I'm not aware that there are, but I'd be interested to hear > of it. If there were, there's a g

Re: [GENERAL] Proper relational database?

2016-04-22 Thread Eric Schwarzenbach
On 04/22/2016 06:21 AM, David Goodenough wrote: On Thursday 21 April 2016 13:36:54 Guyren Howe wrote: Anyone familiar with the issue would have to say that the tech world would be a significantly better place if IBM had developed a real relational database with an elegant query language rather t

Re: [GENERAL] Enhancement request for pg_dump

2016-04-22 Thread Pierre Chevalier Géologue
Le 22/04/2016 19:11, Adrian Klaver a écrit : Last time I had to do this kind of exercise, a few years ago, I was in a remote place without Internet access, so I could not get any information or ask any help. I was kind of surprised/frustrated by the (apparent) lack of order of the pg_dump output

Re: [GENERAL] Add relcreated (timestamp) column to pg_class catalog to record the time an object was created

2016-04-22 Thread Melvin Davidson
On Fri, Apr 22, 2016 at 12:49 PM, Shulgin, Oleksandr < oleksandr.shul...@zalando.de> wrote: > On Thu, Apr 21, 2016 at 6:55 PM, Melvin Davidson > wrote: > >> And so far, NO ONE has shown any proof that this enhancement could >> possibly cause ANY negative result. >> > > Searching through the list

Re: [GENERAL] Proper relational database?

2016-04-22 Thread Raymond Brinzer
On Fri, Apr 22, 2016 at 2:05 AM, Guyren Howe wrote: > If I had the time and money to put together a team to do this, I would start > with the lower-level guts of either Postgres or SQLite (or, heck, MySQL) so > you had a thing that did BTrees and other data structures on disk and > indexes, and pr

Re: [GENERAL] Enhancement request for pg_dump

2016-04-22 Thread Adrian Klaver
On 04/22/2016 09:44 AM, Pierre Chevalier Géologue wrote: > Hi, > Le 18/04/2016 02:26, Sergei Agalakov a écrit : > >> If you never encountered a situation when in the dozens of >> environments the databases has diverged because somebody has >> done something manually - good for you, you are lucky g

Re: [GENERAL] Add relcreated (timestamp) column to pg_class catalog to record the time an object was created

2016-04-22 Thread Shulgin, Oleksandr
On Thu, Apr 21, 2016 at 6:55 PM, Melvin Davidson wrote: > And so far, NO ONE has shown any proof that this enhancement could > possibly cause ANY negative result. > Searching through the list archives[1] I can see that you've asked this question a number of times already. And I'm pretty sure it

Re: [GENERAL] I need testers for incremental backups (similar Oracle)

2016-04-22 Thread Yury Zhuravlev
John R Pierce wrote: doesn't a wal archive give you pretty much the same thing? No, because WAL quickly enough may become larger than the database. In the WAL can be any number of records that change only one page of memory. In addition recover from the WAL too long, because it should be "play

Re: [GENERAL] Enhancement request for pg_dump

2016-04-22 Thread Pierre Chevalier Géologue
Le 18/04/2016 03:10, Sergei Agalakov a écrit : I just wanted to check that my request will have the peoples support. So far it doesn't. Well, you can count on my support, for sure! It looks like that or people never need to compare two PG databases to find the differences in the schemas or s

Re: [GENERAL] Enhancement request for pg_dump

2016-04-22 Thread Pierre Chevalier Géologue
Hi, Le 18/04/2016 02:26, Sergei Agalakov a écrit : If you never encountered a situation when in the dozens of environments the databases has diverged because somebody has done something manually - good for you, you are lucky guy then. I'm definitely not a lucky guy at all! :-) And this is happ

[GENERAL] pg_stat_archiver Enhancement Request

2016-04-22 Thread Rob Brucks
I'd like to request the following enhancement to enable better monitoring of a PostgreSQL cluster. I propose adding a column to "pg_stat_archiver" to determine how many WAL logs are waiting to be archived. This would enable external monitoring systems to query the status via SQL (without being

Re: [GENERAL] I need testers for incremental backups (similar Oracle)

2016-04-22 Thread John R Pierce
On 4/22/2016 8:36 AM, Yury Zhuravlev wrote: I'm working on incremental backup based on tracking of memory pages (ptrack). Now project in beta stage. And I did not have many feedbacks for catch bugs. doesn't a wal archive give you pretty much the same thing? -- john r pierce, recycling bits

[GENERAL] I need testers for incremental backups (similar Oracle)

2016-04-22 Thread Yury Zhuravlev
Hello all. I'm working on incremental backup based on tracking of memory pages (ptrack). Now project in beta stage. And I did not have many feedbacks for catch bugs. I think it is important project for postgres exploitation. This approach can really speed up incremental backup with small over

Re: [GENERAL] Initdb --data-checksums by default

2016-04-22 Thread Bob Lunney
> On Apr 22, 2016, at 3:21 AM, Stuart Bishop wrote: > > On 20 April 2016 at 14:43, Alex Ignatov wrote: >> Hello everyone! >> Today in Big Data epoch silent data corruption becoming more and more issue >> to afraid of. With uncorrectable read error rate ~ 10^-15 on multiterabyte >> disk bit ro

Re: [GENERAL] Proper relational database?

2016-04-22 Thread John McKown
On Fri, Apr 22, 2016 at 1:05 AM, Guyren Howe wrote: > > A brief review of it says it would be better than SQL, but then almost > anything would be. But the syntax looks a bit… baroque. Quell similarly. > > If I had the time and money to put together a team to do this, I would > start with the low

Re: [GENERAL] Partition table data not found in pg_dump

2016-04-22 Thread Adrian Klaver
On 04/15/2016 11:35 PM, vinothcanwin wrote: Partition tables are empty in backup while using pg_dump to take backup, but those tables having data in database. Below is the command i am using to take backup. ./pg_dump -i -h localhost -p 5432 -U postgres -F c -b -v -f /tmp/dump.sql db_mydb Not

Re: [GENERAL] Proper relational database?

2016-04-22 Thread Geoff Winkless
On 22 April 2016 at 07:05, Guyren Howe wrote: > As I say, it amazes and somewhat depresses me that someone isn't doing this. > The NoSQL movement shows that the world is ready for change. Someone should > be offering folks something better than bloody MongoDB. > > Please don't get me wrong. I *ado

Re: [GENERAL] different empty array syntax requirements

2016-04-22 Thread Scott Ribe
On Apr 21, 2016, at 8:37 PM, Tom Lane wrote: > > The parens turn into an actual parsetree node when > operator_precedence_warning is on, and the cast-of-an-array hack doesn't > know it should look through such a node. I figured that. The mystery is why on my pg, and not on the other. I've aske

Re: [GENERAL] different empty array syntax requirements

2016-04-22 Thread Scott Ribe
On Apr 21, 2016, at 8:25 PM, Alvaro Aguayo Garcia-Rada wrote: > > Looks like one has the appropiate cast operator, while the other hasn't. Have > you tried doing the same, on both server, on an empty database created from > template0? Excellent suggestion: pedcard=# create database test; CRE

Re: [GENERAL] Initdb --data-checksums by default

2016-04-22 Thread Alex Ignatov
On 21.04.2016 20:26, Vick Khera wrote: On Thu, Apr 21, 2016 at 9:00 AM, Alex Ignatov mailto:a.igna...@postgrespro.ru>> wrote: Ms Windows doesnt have ZFS support. AIX also doesnt. Z/OS also. Any other commercial Linux distros don't have ZFS support. Yes you can compile it and u

Re: [GENERAL] Proper relational database?

2016-04-22 Thread David Goodenough
On Thursday 21 April 2016 13:36:54 Guyren Howe wrote: > Anyone familiar with the issue would have to say that the tech world would > be a significantly better place if IBM had developed a real relational > database with an elegant query language rather than the awful camel of a > thing that is SQL.

Re: [GENERAL] Initdb --data-checksums by default

2016-04-22 Thread Stuart Bishop
On 20 April 2016 at 14:43, Alex Ignatov wrote: > Hello everyone! > Today in Big Data epoch silent data corruption becoming more and more issue > to afraid of. With uncorrectable read error rate ~ 10^-15 on multiterabyte > disk bit rot is the real issue. > I think that today checksumming data mu