Re: [HACKERS] PG 10 release notes

2017-06-02 Thread Jim Nasby
On 4/24/17 8:31 PM, Bruce Momjian wrote: I have committed the first draft of the Postgres 10 release notes. They are current as of two days ago, and I will keep them current. Please give me any feedback you have. The only unusual thing is that this release has ~180 items while most recent

Re: [HACKERS] Faster methods for getting SPI results (460% improvement)

2017-04-06 Thread Jim Nasby
e returned with feedback. Agreed. -- Jim Nasby, Chief Data Architect, Austin TX OpenSCG http://OpenSCG.com -- Sent via pgsql-hackers mailing list (pgsql-hackers@postgresql.org) To make changes to your subscription: http://www.postgresql.org/mailpref/pgsql-hackers

Re: [HACKERS] Faster methods for getting SPI results (460% improvement)

2017-04-06 Thread Jim Nasby
On Apr 6, 2017, at 9:10 PM, Andres Freund wrote: > >>> Why? We could very well return a somewhat "smarter" object. Returning >>> rows row-by-row if accessed via iterator, materializes when accessed via >>> row offset. >> >> I completely agree with that. What I don't

Re: [HACKERS] Faster methods for getting SPI results (460% improvement)

2017-04-06 Thread Jim Nasby
On 4/6/17 9:04 PM, Andres Freund wrote: On 2017-04-06 09:14:43 -0700, Jim Nasby wrote: On 4/6/17 9:04 AM, Peter Eisentraut wrote: On 4/6/17 03:50, Craig Ringer wrote: But otherwise, pending docs changes, I think it's ready for committer. My opinion is still that this is ultimately the wrong

Re: [HACKERS] Faster methods for getting SPI results (460% improvement)

2017-04-06 Thread Jim Nasby
efactoring or not. Agreed, and I agree that the current patch is a bit of a hack when it comes to DestReceiver (or really, DestReceiver has become an ugly wart over the years, as you pointed out). I'll plan to pick this up again once the dust settles on this commitfest. -- Jim Nasby, Chief Data

Re: [HACKERS] Faster methods for getting SPI results (460% improvement)

2017-04-06 Thread Jim Nasby
On 4/6/17 9:04 AM, Peter Eisentraut wrote: On 4/6/17 03:50, Craig Ringer wrote: But otherwise, pending docs changes, I think it's ready for committer. My opinion is still that this is ultimately the wrong approach. The right fix for performance issues in PL/Python is to change PL/Python not

Re: [HACKERS] Faster methods for getting SPI results (460% improvement)

2017-04-05 Thread Jim Nasby
n I'll dig into it. Sounds good. Thanks! -- Jim Nasby, Chief Data Architect, Austin TX OpenSCG http://OpenSCG.com -- Sent via pgsql-hackers mailing list (pgsql-hackers@postgresql.org) To make changes to your subscription: http://www.postgresql.org/mailpref/pgsql-hackers

Re: [HACKERS] Faster methods for getting SPI results (460% improvement)

2017-04-05 Thread Jim Nasby
On 4/5/17 7:44 PM, Jim Nasby wrote: Updated patches attached, but I still need to update the docs. Attached is a complete series of patches that includes the docs patch. Right now, the docs don't include a concrete example, because adding one would be a pretty large if it demonstrated real

Re: [HACKERS] Faster methods for getting SPI results (460% improvement)

2017-04-05 Thread Jim Nasby
* not sure it's worth worrying about that though. */ Updated patches attached, but I still need to update the docs. -- Jim Nasby, Chief Data Architect, Austin TX OpenSCG http://OpenSCG.com From 0a2ef661f55a047763a43b0eebd7483760e4a427 Mon Sep 17 00:00:00 2001 From: Jim Nasby <jim.na...@b

Re: [HACKERS] Faster methods for getting SPI results (460% improvement)

2017-04-05 Thread Jim Nasby
=$PGC_PORT -C --enable-cassert --enable-debug CFLAGS='-ggdb -O0 -fno-omit-frame-pointer' Darwin decina.local 15.6.0 Darwin Kernel Version 15.6.0: Mon Jan 9 23:07:29 PST 2017; root:xnu-3248.60.11.2.1~1/RELEASE_X86_64 x86_64 -- Jim Nasby, Chief Data Architect, Austin TX OpenSCG

[HACKERS] Missing increment of vacrelstats->pinskipped_pages

2017-03-28 Thread Jim Nasby
lazy_vacuum_heap() does not count pages that it skips due to not obtaining the buffer cleanup lock. vacuum_pinskipped.patch fixes that. That should be backpatched to 9.5. vacuum_comment.patch cleans up a comment in lazy_scan_heap(). -- Jim C. Nasby, Data Architect

Re: [HACKERS] PL/Python: Add cursor and execute methods to plan object

2017-03-23 Thread Jim Nasby
On 2/25/17 10:27 AM, Peter Eisentraut wrote: So I'm also wondering here which style people prefer so I can implement it there. I think the more OO style is definitely better. I expect it would simplify the code as well. -- Jim C. Nasby, Data Architect j...@nasby.net

Re: [HACKERS] Privilege checks on array coercions

2017-03-23 Thread Jim Nasby
On 3/23/17 12:37 PM, Andres Freund wrote: On 2017-03-23 15:26:51 -0400, Tom Lane wrote: There is a test in privileges.sql (currently lines 589-625 in privileges.out) that seems to be dependent on the fact that the ArrayCoerceExpr logic doesn't check for EXECUTE privilege on the per-element type

Re: [HACKERS] Re: Improve OR conditions on joined columns (common star schema problem)

2017-03-19 Thread Jim Nasby
On 3/19/17 2:32 PM, Tom Lane wrote: Jim Nasby <jim.na...@openscg.com> writes: Having thought about it, I share Tom's concerns. And now I'm worried about what happens if there are multiple separate OR clauses. I guess those would be handled by separate UNIONs? As proposed, the patch wou

Re: [HACKERS] PinBuffer() no longer makes use of strategy

2017-03-18 Thread Jim Nasby
utzing with. Marked as RFC. -- Jim Nasby, Chief Data Architect, Austin TX OpenSCG http://OpenSCG.com -- Sent via pgsql-hackers mailing list (pgsql-hackers@postgresql.org) To make changes to your subscription: http://www.postgresql.org/mailpref/pgsql-hackers

[HACKERS] Re: Improve OR conditions on joined columns (common star schema problem)

2017-03-18 Thread Jim Nasby
On 3/16/17 11:54 AM, David Steele wrote: On 2/14/17 4:03 PM, Tom Lane wrote: Jim Nasby <jim.na...@bluetreble.com> writes: On 2/14/17 1:18 PM, Tom Lane wrote: One point that could use further review is whether the de-duplication algorithm is actually correct. I'm only about 95% con

[HACKERS] Split conditions on relations

2017-03-15 Thread Jim Nasby
things fast again. It'd be nice if function execution could be delayed to a higher level of a query based on the cost. -- Jim Nasby, Chief Data Architect, OpenSCG http://OpenSCG.com -- Sent via pgsql-hackers mailing list (pgsql-hackers@postgresql.org) To make changes to your subscription: http

Re: [HACKERS] How to get the 'ctid' from a record type?

2017-03-11 Thread Jim Nasby
. Not a great bet to make though. Also, there should be a macro somewhere that will tell you whether you have a full tuple or not. You'd want to make sure to check that an throw an error if you weren't handed a full tuple. -- Jim Nasby, Chief Data Architect, OpenSCG http://OpenSCG.com -- Sent via

[HACKERS] INSERT INTO arr2(array[1].d, array[2].d)

2017-03-11 Thread Jim Nasby
───┤ │ {"(\"{1,2}\")","(\"{3,4}\")"} │ └───┘ -- Jim Nasby, Chief Data Architect, OpenSCG http://OpenSCG.com -- Sent via pgsql-hackers mailing list (pgsql-hackers@postgresql.org) To make changes to your subscription: http://www.postgresql.org/mailpref/pgsql-hackers

Re: [HACKERS] Index usage for elem-contained-by-const-range clauses

2017-03-11 Thread Jim Nasby
that. BTW, while we're wishing for things... Something else that would be nice is if there was a way to do these kind of transforms without hacking the backend... Also, I noticed that patch haven't regression tests. BTW, those tests need to pay special attention to inclusive vs exclusive

Re: [HACKERS] Need a builtin way to run all tests faster manner

2017-03-11 Thread Jim Nasby
On 3/11/17 2:06 PM, Tom Lane wrote: Jim Nasby <jim.na...@openscg.com> writes: It's actually a lot harder to mess up providing a git repo link than manually submitting patches to the mailing list. Yeah, we've heard that proposal before. We're still not doing it though. Insisting on p

Re: [HACKERS] Need a builtin way to run all tests faster manner

2017-03-11 Thread Jim Nasby
On 3/10/17 6:06 PM, Peter Eisentraut wrote: On 3/10/17 19:00, Jim Nasby wrote: Maybe instead of having the commitfest app try and divine patches from the list it should be able to send patches to the list from a specified git repo/branch. Anyone that provides that info would have tests run

Re: [HACKERS] Need a builtin way to run all tests faster manner

2017-03-10 Thread Jim Nasby
On 3/10/17 5:57 PM, Peter Eisentraut wrote: On 3/10/17 14:53, Jim Nasby wrote: The biggest win we'd get from something like Travis would be if the commitfest monitored for new patch files coming in for monitored threads and it created a new branch, applied the patches, and if they applied

Re: [HACKERS] Need a builtin way to run all tests faster manner

2017-03-10 Thread Jim Nasby
an ideal project for someone not on -hackers... do we have a list of "How you can help Postgres besides hacking database code" anywhere? -- Jim Nasby, Chief Data Architect, OpenSCG http://OpenSCG.com -- Sent via pgsql-hackers mailing list (pgsql-hackers@postgresql.org) To make chang

Re: [HACKERS] Need a builtin way to run all tests faster manner

2017-03-10 Thread Jim Nasby
ill applies, yes. If the rebase was pushed to github and travis was setup, travis would then test the changes as well. -- Jim Nasby, Chief Data Architect, OpenSCG http://OpenSCG.com -- Sent via pgsql-hackers mailing list (pgsql-hackers@postgresql.org) To make changes to your subscription: http://www.postgresql.org/mailpref/pgsql-hackers

Re: [HACKERS] ANALYZE command progress checker

2017-03-10 Thread Jim Nasby
On 3/10/17 1:06 PM, Andres Freund wrote: Hi, On 2017-03-10 02:11:18 -0600, Jim Nasby wrote: Perhaps instead of adding more clutter to \dvS we could just have a SRF for now. I don't see that as clutter, it's useful information, and keeping it discoverable is good, not bad. If we keep adding

Re: [HACKERS] Need a builtin way to run all tests faster manner

2017-03-10 Thread Jim Nasby
On 3/10/17 1:09 PM, Peter Eisentraut wrote: On 3/10/17 03:27, Jim Nasby wrote: Perhaps https://travis-ci.org/ or something similar could be used for this. That avoids any issues about random code. That doesn't achieve any platform coverage, which is the main point here. I don't think

Re: [HACKERS] Report the number of skipped frozen pages by manual VACUUM

2017-03-10 Thread Jim Nasby
On 3/10/17 5:08 AM, Masahiko Sawada wrote: BTW, I think there's already a function that handles the pluralization for you. IIRC it's one of the things you can add to an ereport() call. What is the function name? A quick `git grep plural` shows errdetail_plural and errmsg_plural. -- Jim Nasby

Re: [HACKERS] Need a builtin way to run all tests faster manner

2017-03-10 Thread Jim Nasby
that it basically amounts to downloading and running random code off the internet. Perhaps https://travis-ci.org/ or something similar could be used for this. That avoids any issues about random code. -- Jim Nasby, Chief Data Architect, OpenSCG http://OpenSCG.com -- Sent via pgsql-hackers mailing list (pgsql

Re: [HACKERS] ANALYZE command progress checker

2017-03-10 Thread Jim Nasby
lutter to \dvS we could just have a SRF for now. At over 2800 rows currently, you're not going to notice one more addition to \dfS. -- Jim Nasby, Chief Data Architect, OpenSCG http://OpenSCG.com -- Sent via pgsql-hackers mailing list (pgsql-hackers@postgresql.org) To make changes to your subscr

Re: [HACKERS] REINDEX CONCURRENTLY 2.0

2017-03-09 Thread Jim Nasby
be fairly easy to fire an event trigger as if someone had just renamed the index. 1: https://github.com/decibel/object_reference 2: https://github.com/decibel/pg_classy -- Jim Nasby, Chief Data Architect, OpenSCG http://OpenSCG.com -- Sent via pgsql-hackers mailing list (pgsql-hackers@post

Re: [HACKERS] Adding support for Default partition in partitioning

2017-03-09 Thread Jim Nasby
see a need for it to fail I agree that there should be a way to identify the default partition. either and not quite sure how that would even work? If they can't add a necessary child due to data being in the default, how can they ever get it out? Yeah, was wondering that as well... -- Jim

Re: [HACKERS] Report the number of skipped frozen pages by manual VACUUM

2017-03-09 Thread Jim Nasby
ncies like that unless there's a pretty good reason. BTW, I think there's already a function that handles the pluralization for you. IIRC it's one of the things you can add to an ereport() call. -- Jim Nasby, Chief Data Architect, OpenSCG http://OpenSCG.com -- Sent via pgsql-hackers mailing l

Re: [HACKERS] Faster methods for getting SPI results

2017-03-06 Thread Jim Nasby
On 3/2/17 8:03 AM, Peter Eisentraut wrote: On 12/20/16 23:14, Jim Nasby wrote: I've been looking at the performance of SPI calls within plpython. There's a roughly 1.5x difference from equivalent python code just in pulling data out of the SPI tuplestore. Some of that is due to an inefficiency

Re: [HACKERS] Change in "policy" on dump ordering?

2017-03-06 Thread Jim Nasby
. Maybe there's a better way to do that... -- Jim Nasby, Chief Data Architect, OpenSCG -- Sent via pgsql-hackers mailing list (pgsql-hackers@postgresql.org) To make changes to your subscription: http://www.postgresql.org/mailpref/pgsql-hackers

Re: [HACKERS] objsubid vs subobjid

2017-03-06 Thread Jim Nasby
On 3/1/17 9:24 AM, Peter Eisentraut wrote: On 3/1/17 09:51, Alvaro Herrera wrote: Peter Eisentraut wrote: On 2/22/17 19:35, Jim Nasby wrote: pg_get_object_address() currently returns a field called subobjid, while pg_depend calls that objsubid. I'm guessing that wasn't on purpose (especially

Re: [HACKERS] Faster methods for getting SPI results (460% improvement)

2017-03-06 Thread Jim Nasby
On 2/28/17 9:42 PM, Jim Nasby wrote: I'll post a plpython patch that doesn't add the output format control. I've attached the results of that. Unfortunately the speed improvement is only 27% at this point (with 999 tuples). Presumably that's because it's constructing a brand new

Re: [HACKERS] Two questions about Postgres parser

2017-03-01 Thread Jim Nasby
d a helper. Exporting those two and providing a hook would have done the trick in my case. -- Jim Nasby, Data Architect, Blue Treble Consulting, Austin TX Experts in Analytics, Data Architecture and PostgreSQL Data in Trouble? Get it in Treble! http://BlueTreble.com 855-TREBLE2 (855-873-2532) -- Sent

Re: [HACKERS] REINDEX CONCURRENTLY 2.0

2017-03-01 Thread Jim Nasby
will become invalid. Admittedly that's a pretty unusual use case, but it'd be nice if there was at least a way to let users fix things during the rename phase (perhaps via an event trigger). -- Jim Nasby, Data Architect, Blue Treble Consulting, Austin TX Experts in Analytics, Data Architecture

Re: [HACKERS] Disallowing multiple queries per PQexec()

2017-03-01 Thread Jim Nasby
be nice to allow disabling multiple statements via a GUC. -- Jim Nasby, Data Architect, Blue Treble Consulting, Austin TX Experts in Analytics, Data Architecture and PostgreSQL Data in Trouble? Get it in Treble! http://BlueTreble.com 855-TREBLE2 (855-873-2532) -- Sent via pgsql-hackers mailing

Re: [HACKERS] I propose killing PL/Tcl's "modules" infrastructure

2017-03-01 Thread Jim Nasby
hook functions (though presumably a field of regproc[] is a better way to handle that...) I'm also wondering if there'd be value to supporting code that runs on each function invocation. -- Jim Nasby, Data Architect, Blue Treble Consulting, Austin TX Experts in Analytics, Data Architecture

Re: [HACKERS] PATCH: Make pg_stop_backup() archive wait optional

2017-03-01 Thread Jim Nasby
it through the pg_stop_backup() function. Do the docs mention anywhere how to monitor WAL archiving to know if you've got all the necessary WAL? Perhaps a function to do that would be worth adding. -- Jim Nasby, Data Architect, Blue Treble Consulting, Austin TX Experts in Analytics, Data

Re: [HACKERS] GSoC 2017

2017-03-01 Thread Jim Nasby
On 2/27/17 4:52 PM, Thomas Munro wrote: By the way, that page claims that PostgreSQL runs on Irix and Tru64, which hasn't been true for a few years. There could be a GSoC project to add support for those back in... ;P -- Jim Nasby, Data Architect, Blue Treble Consulting, Austin TX Experts

Re: [HACKERS] Faster methods for getting SPI results (460% improvement)

2017-02-28 Thread Jim Nasby
On 1/24/17 10:43 PM, Jim Nasby wrote: I strongly suggest making this design effort a separate thread, and focusing on the SPI improvements that give "free" no-user-action performance boosts here. Fair enough. I posted the SPI portion of that yesterday. That should be usefu

Re: [HACKERS] increasing the default WAL segment size

2017-02-27 Thread Jim Nasby
file which I think is incorrect. Do you agree with that? Detecting correct WAL size based on the size of a random WAL file seems like a really bad idea to me. I also don't see the reason for #2... or is that how initdb writes out the correct control file? -- Jim Nasby, Data Architect, Blue

Re: [HACKERS] [PROPOSAL] Temporal query processing with range types

2017-02-24 Thread Jim Nasby
the answer is yes. -- Jim Nasby, Data Architect, Blue Treble Consulting, Austin TX Experts in Analytics, Data Architecture and PostgreSQL Data in Trouble? Get it in Treble! http://BlueTreble.com 855-TREBLE2 (855-873-2532) -- Sent via pgsql-hackers mailing list (pgsql-hackers@postgresql.org) To make

Re: [HACKERS] bytea_output output of base64

2017-02-24 Thread Jim Nasby
had a way to just spit out the raw compressed data (or a text-safe version of that), at least for COPY's purposes... -- Jim Nasby, Data Architect, Blue Treble Consulting, Austin TX Experts in Analytics, Data Architecture and PostgreSQL Data in Trouble? Get it in Treble! http://BlueTreble.com 855

Re: [HACKERS] FYI: git worktrees as replacement for "rsync the CVSROOT"

2017-02-24 Thread Jim Nasby
On 2/24/17 10:24 AM, Tom Lane wrote: Andrew Dunstan <andrew.duns...@2ndquadrant.com> writes: On 02/24/2017 02:36 AM, Craig Ringer wrote: On 16 January 2017 at 05:01, Jim Nasby <jim.na...@bluetreble.com> wrote: git worktree add ../9.6 REL9_6_STABLE Does this do anythng di

Re: [HACKERS] GUC for cleanup indexes threshold.

2017-02-24 Thread Jim Nasby
a big issue. Maybe it's safe to update the ctid map for every item that gets moved when a split happens. Would a ctid map work for other indexes as well? -- Jim Nasby, Data Architect, Blue Treble Consulting, Austin TX Experts in Analytics, Data Architecture and PostgreSQL Data in Trouble? Get

Re: [HACKERS] case_preservation_and_insensitivity = on

2017-02-24 Thread Jim Nasby
tually like to be able to use camelcase and still get easy to read output from \d & co. IOW, this is definitely NOT driven just by porting efforts. I think the only reason we don't hear more requests about it is people (grudgingly) just muddle on without it. -- Jim Nasby, Data Architect, B

Re: [HACKERS] case_preservation_and_insensitivity = on

2017-02-24 Thread Jim Nasby
pirate apps in plR... ;P) -- Jim Nasby, Data Architect, Blue Treble Consulting, Austin TX Experts in Analytics, Data Architecture and PostgreSQL Data in Trouble? Get it in Treble! http://BlueTreble.com 855-TREBLE2 (855-873-2532) -- Sent via pgsql-hackers mailing list (pgsql-hackers@postgresql.org

Re: [HACKERS] Checksums by default?

2017-02-24 Thread Jim Nasby
as well. -- Jim Nasby, Data Architect, Blue Treble Consulting, Austin TX Experts in Analytics, Data Architecture and PostgreSQL Data in Trouble? Get it in Treble! http://BlueTreble.com 855-TREBLE2 (855-873-2532) -- Sent via pgsql-hackers mailing list (pgsql-hackers@postgresql.org) To make changes

Re: [HACKERS] Automatic cleanup of oldest WAL segments with pg_receivexlog

2017-02-23 Thread Jim Nasby
spent on all the external ones. Of course, much of that is because the external tools have helped prove out what works and what doesn't. -- Jim Nasby, Data Architect, Blue Treble Consulting, Austin TX Experts in Analytics, Data Architecture and PostgreSQL Data in Trouble? Get it in Treble! http

Re: [HACKERS] Idea on how to simplify comparing two sets

2017-02-23 Thread Jim Nasby
the most latitude. Less load from (presumably) pointless copying too. -- Jim Nasby, Data Architect, Blue Treble Consulting, Austin TX Experts in Analytics, Data Architecture and PostgreSQL Data in Trouble? Get it in Treble! http://BlueTreble.com 855-TREBLE2 (855-873-2532) -- Sent via pgsql-hackers

Re: [HACKERS] Automatic cleanup of oldest WAL segments with pg_receivexlog

2017-02-23 Thread Jim Nasby
things) -- Jim Nasby, Data Architect, Blue Treble Consulting, Austin TX Experts in Analytics, Data Architecture and PostgreSQL Data in Trouble? Get it in Treble! http://BlueTreble.com 855-TREBLE2 (855-873-2532) -- Sent via pgsql-hackers mailing list (pgsql-hackers@postgresql.org) To make changes

Re: [HACKERS] Automatic cleanup of oldest WAL segments with pg_receivexlog

2017-02-23 Thread Jim Nasby
for this data before moving on to the next one. At least it gives an argument for having such a command. David Steele mentioned that he could make use of such a thing. BTW, I'm not opposed to an end-segment command; I'm just saying I don't think having it would really help users very much. -- Jim

Re: [HACKERS] bytea_output output of base64

2017-02-23 Thread Jim Nasby
, though I'm not sure how much that's worth since if you care at all about that you'll gzip it. But, the other thing it might do is speed up COPY, especially on input. Some performance tests of that might be interesting. -- Jim Nasby, Data Architect, Blue Treble Consulting, Austin TX Experts

Re: [HACKERS] Documentation improvements for partitioning

2017-02-23 Thread Jim Nasby
it right. It might be possible to provide some temporary work-arounds for some of this, which would be nice. But I agree that there's definitely not enough time to implement *good* solutions to even just automatic index creation, let alone somehow handling uniqueness. -- Jim Nasby, Data

Re: [HACKERS] Faster methods for getting SPI results (460% improvement)

2017-02-23 Thread Jim Nasby
On 1/23/17 9:23 PM, Jim Nasby wrote: I think the last step here is to figure out how to support switching between the current behavior and the "columnar" behavior of a dict of lists. I've thought more about this... instead of trying to switch from the current situation of 1 cho

Re: [HACKERS] PinBuffer() no longer makes use of strategy

2017-02-23 Thread Jim Nasby
it better. Patch is attached. I tried to make some comments, but probably they are not enough. Added to CF: https://commitfest.postgresql.org/13/1029/ -- Jim Nasby, Data Architect, Blue Treble Consulting, Austin TX Experts in Analytics, Data Architecture and PostgreSQL Data in Trouble? Get

Re: [HACKERS] Idea on how to simplify comparing two sets

2017-02-23 Thread Jim Nasby
a temp view). I've wondered about the possibility of allowing PLs the ability to dynamically define their return type based on their arguments. That would allow for an SRF to handle this case, and would be significantly more flexible than trying to do that using pseudotypes. -- Jim Nasby, Data

Re: [HACKERS] Add checklist item for psql completion to commitfest review

2017-02-23 Thread Jim Nasby
On 2/15/17 9:49 AM, Robert Haas wrote: On Tue, Feb 14, 2017 at 1:13 PM, Jim Nasby <jim.na...@bluetreble.com> wrote: After seeing Yet Another Missing Psql Tab Completion it occurred to me... why not add a checklist item to the commitfest review page? I realize most regular contributors don

Re: [HACKERS] Index corruption with CREATE INDEX CONCURRENTLY

2017-02-23 Thread Jim Nasby
likely to be a lot slower for small tables than a hash or nestloop-based approach. As I understand it, #3 is already in place for validate_index(). I think you'd just need a different callback that checks the heap key. -- Jim Nasby, Data Architect, Blue Treble Consulting, Austin TX Experts

Re: [HACKERS] Automatic cleanup of oldest WAL segments with pg_receivexlog

2017-02-23 Thread Jim Nasby
ore than 1 year old"). Perhaps a good starting point would be a tool that lets you list what base backups you have, what WAL those backups need, when the backups were taken, etc. -- Jim Nasby, Data Architect, Blue Treble Consulting, Austin TX Experts in Analytics, Data Architecture and Postgr

Re: [HACKERS] A typo in mcxt.c

2017-02-23 Thread Jim Nasby
On 2/23/17 6:38 AM, Thomas Munro wrote: I'm not so confident, but the "'tis" seems to me to be a typo of "it's". That is an archaic way of contracting the same words differently: Given the number of non-native English speakers we have, it's probably worth changing it...

Re: [HACKERS] case_preservation_and_insensitivity = on

2017-02-22 Thread Jim Nasby
that's most of them. -- Jim Nasby, Data Architect, Blue Treble Consulting, Austin TX Experts in Analytics, Data Architecture and PostgreSQL Data in Trouble? Get it in Treble! http://BlueTreble.com 855-TREBLE2 (855-873-2532) -- Sent via pgsql-hackers mailing list (pgsql-hackers@postgresql.org) To

Re: [HACKERS] [PATCH] Add pg_disable_checksums() and supporting infrastructure

2017-02-22 Thread Jim Nasby
ry similar; my issue is I don’t want to have to postpone handling a specific case for some future infrastructure. Yeah, I was just mentioning it. -- Jim Nasby, Data Architect, Blue Treble Consulting, Austin TX Experts in Analytics, Data Architecture and PostgreSQL Data in Trouble? Get it in Treble!

[HACKERS] objsubid vs subobjid

2017-02-22 Thread Jim Nasby
on the other functions for consistency. I stopped short of changing the instances of subobjid in the C code to reduce backpatch issues, but maybe that should be done too... -- Jim Nasby, Data Architect, Blue Treble Consulting, Austin TX Experts in Analytics, Data Architecture and PostgreSQL Data

Re: [HACKERS] Change in "policy" on dump ordering?

2017-02-22 Thread Jim Nasby
referenced a system view for something that was restored after DO_REFRESH_MATVIEW (such as subscriptions) then the view would be inaccurate after the restore. Stephen, hopefully that answers your question as well. :) -- Jim Nasby, Data Architect, Blue Treble Consulting, Austin TX Experts in Analy

Re: [HACKERS] pg_dump does not refresh matviews from extensions

2017-02-22 Thread Jim Nasby
at least document that. Now that I know that, I guess I'm kinda on the fence about doing it automatically, because AFAIK there'd be no way to override that automatic behavior. I can't really conceive of any reason you wouldn't want the refresh, but since it's not happening today... -- Jim

Re: [HACKERS] Change in "policy" on dump ordering?

2017-02-22 Thread Jim Nasby
On 2/22/17 12:29 PM, Peter Eisentraut wrote: On 2/22/17 10:14, Jim Nasby wrote: CREATE MATERIALIZED VIEW tmv AS SELECT * FROM pg_subscription; SELECT 0 IOW, you can create matviews that depend on any other table/view/matview, but right now if the matview includes certain items

Re: [HACKERS] Replication vs. float timestamps is a disaster

2017-02-22 Thread Jim Nasby
think you could just change the oid in the catalog the same as you would for a table column. -- Jim Nasby, Data Architect, Blue Treble Consulting, Austin TX Experts in Analytics, Data Architecture and PostgreSQL Data in Trouble? Get it in Treble! http://BlueTreble.com 855-TREBLE2 (855-873-2532

Re: [HACKERS] mat views stats

2017-02-22 Thread Jim Nasby
of inserted rows could make sense. +1 on both counts. And if sane analyze behavior does depend on the stats changes then there's no real advantage to a separate patch. -- Jim Nasby, Data Architect, Blue Treble Consulting, Austin TX Experts in Analytics, Data Architecture and PostgreSQL Data

Re: [HACKERS] GRANT EXECUTE ON FUNCTION foo() TO bar();

2017-02-22 Thread Jim Nasby
separate features. -- Jim Nasby, Data Architect, Blue Treble Consulting, Austin TX Experts in Analytics, Data Architecture and PostgreSQL Data in Trouble? Get it in Treble! http://BlueTreble.com 855-TREBLE2 (855-873-2532) -- Sent via pgsql-hackers mailing list (pgsql-hackers@postgresql.org

Re: [HACKERS] Change in "policy" on dump ordering?

2017-02-22 Thread Jim Nasby
it will mysteriously end up empty post-restore. -- Jim Nasby, Data Architect, Blue Treble Consulting, Austin TX Experts in Analytics, Data Architecture and PostgreSQL Data in Trouble? Get it in Treble! http://BlueTreble.com 855-TREBLE2 (855-873-2532) -- Sent via pgsql-hackers mailing list (pgsql

Re: [HACKERS] Replication vs. float timestamps is a disaster

2017-02-22 Thread Jim Nasby
On 2/22/17 7:56 AM, Andres Freund wrote: On 2017-02-22 08:43:28 -0500, Tom Lane wrote: Andres Freund <and...@anarazel.de> writes: On 2017-02-22 00:10:35 -0600, Jim Nasby wrote: I wounder if a separate "floatstamp" data type might fit the bill there. It might not be com

Re: [HACKERS] Replication vs. float timestamps is a disaster

2017-02-21 Thread Jim Nasby
for pg_upgrade using people with big clusters. So I think we should fix this regardless... :( I wounder if a separate "floatstamp" data type might fit the bill there. It might not be completely seamless, but it would be binary compatible. -- Jim Nasby, Data Architect, Blue Treble Consulting,

Re: [HACKERS] Replication vs. float timestamps is a disaster

2017-02-21 Thread Jim Nasby
\ FWIW, last time I looked it was also an option in FreeBSD's ports, though I think it's defaulted to int since forever ago (like, 7.4 era). -- Jim Nasby, Data Architect, Blue Treble Consulting, Austin TX Experts in Analytics, Data Architecture and PostgreSQL Data in Trouble? Get it in Treble! htt

Re: [HACKERS] Change in "policy" on dump ordering?

2017-02-21 Thread Jim Nasby
On 2/21/17 4:25 PM, Peter Eisentraut wrote: On 2/21/17 14:58, Jim Nasby wrote: AFAICT in older versions only object types that absolutely had to wait for DO_POST_DATA_BOUNDARY would do so. More recently though, objects are being added after that (presumably because it's easier than renumbering

Re: [HACKERS] mat views stats

2017-02-21 Thread Jim Nasby
You'd want a refresh count too. I think these should be two separate patches. We might want to backpatch the first one. +1; definitely sounds like a bug to me. -- Jim Nasby, Data Architect, Blue Treble Consulting, Austin TX Experts in Analytics, Data Architecture and PostgreSQL Data in Tr

Re: [HACKERS] Adding new output parameter of pg_stat_statements to identify operation of the query.

2017-02-21 Thread Jim Nasby
On 2/19/17 10:02 PM, Tom Lane wrote: Jim Nasby <jim.na...@bluetreble.com> writes: Something that needs to be considered with doing this in pg_stat_statement is that a query that's reported there can contain multiple SQL statements. I don't remember offhand if all statements get

[HACKERS] Change in "policy" on dump ordering?

2017-02-21 Thread Jim Nasby
? Should there be an official guide for where new things go? -- Jim Nasby, Data Architect, Blue Treble Consulting, Austin TX Experts in Analytics, Data Architecture and PostgreSQL Data in Trouble? Get it in Treble! http://BlueTreble.com 855-TREBLE2 (855-873-2532) -- Sent via pgsql-hackers mailing list

[HACKERS] pg_dump does not refresh matviews from extensions

2017-02-21 Thread Jim Nasby
uot; logic that processExtensionTables() uses. -- Jim Nasby, Data Architect, Blue Treble Consulting, Austin TX Experts in Analytics, Data Architecture and PostgreSQL Data in Trouble? Get it in Treble! http://BlueTreble.com 855-TREBLE2 (855-873-2532) -- Sent via pgsql-hackers mailing list (pgsql-hackers@post

Re: [HACKERS] GUC for cleanup indexes threshold.

2017-02-19 Thread Jim Nasby
you don't have to add support for this to every index type to start with. -- Jim Nasby, Data Architect, Blue Treble Consulting, Austin TX Experts in Analytics, Data Architecture and PostgreSQL Data in Trouble? Get it in Treble! http://BlueTreble.com 855-TREBLE2 (855-873-2532) -- Sent via pgsql

Re: [HACKERS] Adding new output parameter of pg_stat_statements to identify operation of the query.

2017-02-19 Thread Jim Nasby
the command tags are. Short of that, I'm not sure it would be a good idea to only support a single tag being visible at a time; it would be certain to induce users to create code that's going to be buggy as soon as someone starts using multiple statements. -- Jim Nasby, Data Architect, Blue

Re: [HACKERS] [PATCH] Add pg_disable_checksums() and supporting infrastructure

2017-02-19 Thread Jim Nasby
l progress to be had in this area before tackling the "page too small" problem. -- Jim Nasby, Data Architect, Blue Treble Consulting, Austin TX Experts in Analytics, Data Architecture and PostgreSQL Data in Trouble? Get it in Treble! http://BlueTreble.com 855-TREBLE2 (855-873-2532) -- Se

Re: [HACKERS] case_preservation_and_insensitivity = on

2017-02-19 Thread Jim Nasby
ew column would simply be left as NULL. With some extra effort you could probably allow changing that on a running database as well, just not with something as easy to change as a GUC. -- Jim Nasby, Data Architect, Blue Treble Consulting, Austin TX Experts in Analytics, Data Architecture and

Re: [HACKERS] pg_get_object_address() doesn't support composites

2017-02-19 Thread Jim Nasby
On 2/18/17 4:26 PM, Jim Nasby wrote: On 2/17/17 9:53 PM, Alvaro Herrera wrote: Jim Nasby wrote: See below. ISTM that pg_get_object_address should support everything pg_identify_object_as_address can output, no? I'm guessing the answer here is to have pg_identify_object_as_address complain

Re: [HACKERS] Reporting xmin from VACUUMs

2017-02-19 Thread Jim Nasby
. I think that last option is worth some serious study now that we have DSA, but it's currently not very high on my personal priority list. Hmm... so basically replace the temporary file with DSM? Something else I think would be useful is a way to subscribe to stats updates. -- Jim Nasby, Data

[HACKERS] Deprecate floating point timestamps.

2017-02-19 Thread Jim Nasby
ering if a different datatype for timestamps stored as floats would ease that pain. -- Jim Nasby, Data Architect, Blue Treble Consulting, Austin TX Experts in Analytics, Data Architecture and PostgreSQL Data in Trouble? Get it in Treble! http://BlueTreble.com 855-TREBLE2 (855-873-2532) -- Sent via pgsq

Re: [HACKERS] pg_get_object_address() doesn't support composites

2017-02-18 Thread Jim Nasby
On 2/17/17 9:53 PM, Alvaro Herrera wrote: Jim Nasby wrote: See below. ISTM that pg_get_object_address should support everything pg_identify_object_as_address can output, no? I'm guessing the answer here is to have pg_identify_object_as_address complain if you ask it for something that's

Re: [HACKERS] "SQL sentence"?

2017-02-18 Thread Jim Nasby
. You're speaking of https://www.postgresql.org/message-id/CACACo5Q_UXYwF117LBhjZ3xaMPyrgqnqE%3DmXvRhEfjJ51aCfwQ%40mail.gmail.com ? Can you reply to that to restart discussion? -- Jim Nasby, Data Architect, Blue Treble Consulting, Austin TX Experts in Analytics, Data Architecture and PostgreSQL

Re: [HACKERS] "SQL sentence"?

2017-02-17 Thread Jim Nasby
On 2/17/17 10:46 PM, Alvaro Herrera wrote: Jim Nasby wrote: On 2/17/17 10:19 PM, Alvaro Herrera wrote: (FWIW, I'm wondering because I was just looking to see why there's no details for things like altering a column in a table.) Do you mean you want to have access to the details of the alter

Re: [HACKERS] pg_get_object_address() doesn't support composites

2017-02-17 Thread Jim Nasby
it irritating) that some objname's squash schema and name into a single element. Not sure that's worth fixing at this point, though. -- Jim Nasby, Data Architect, Blue Treble Consulting, Austin TX Experts in Analytics, Data Architecture and PostgreSQL Data in Trouble? Get it in Treble! http

Re: [HACKERS] "SQL sentence"?

2017-02-17 Thread Jim Nasby
that alterTable.subcmds is a list of CollectedCommand, making things more fun. -- Jim Nasby, Data Architect, Blue Treble Consulting, Austin TX Experts in Analytics, Data Architecture and PostgreSQL Data in Trouble? Get it in Treble! http://BlueTreble.com 855-TREBLE2 (855-873-2532) -- Sent via pgsql

Re: [HACKERS] Official adoption of PGXN

2017-02-17 Thread Jim Nasby
he PG version), it wouldn't be hard to automate. Obviously if there's a bug in an extension we'd want to do something, but tying that to the release would be completely optional. -- Jim Nasby, Data Architect, Blue Treble Consulting, Austin TX Experts in Analytics, Data Architecture and Po

[HACKERS] "SQL sentence"?

2017-02-17 Thread Jim Nasby
there's no details for things like altering a column in a table.) -- Jim Nasby, Data Architect, Blue Treble Consulting, Austin TX Experts in Analytics, Data Architecture and PostgreSQL Data in Trouble? Get it in Treble! http://BlueTreble.com 855-TREBLE2 (855-873-2532) -- Sent via pgsql-hackers mailing

[HACKERS] pg_get_object_address() doesn't support composites

2017-02-17 Thread Jim Nasby
pg_get_object_address('composite type', '{public,comp}', '{}'); ERROR: unsupported object type "composite type" ~@decina.local/5621# -- Jim Nasby, Data Architect, Blue Treble Consulting, Austin TX Experts in Analytics, Data Architecture and PostgreSQL Data in Trouble? Get it in Treble! http://Blue

Re: [HACKERS] gitlab post-mortem: pg_basebackup waiting for checkpoint

2017-02-17 Thread Jim Nasby
gested because of confusion from pg_basebackup twiddling it's thumbs... -- Jim Nasby, Data Architect, Blue Treble Consulting, Austin TX Experts in Analytics, Data Architecture and PostgreSQL Data in Trouble? Get it in Treble! http://BlueTreble.com 855-TREBLE2 (855-873-2532) -- Sent via pgsql-h

Re: [HACKERS] Does having a NULL column automatically exclude the table from the tupleDesc cache?

2017-02-17 Thread Jim Nasby
ugh -- just set the first column to nullable. Thanks! Maybe I'll do some benchmarks. You'll probably want to do those at a C level, bypassing the executor. I would guess that executor overhead will completely swamp the effect of the cache in most cases. -- Jim Nasby, Data Architect, Blue Tre

  1   2   3   4   5   6   7   8   9   10   >