Re: [HACKERS] Renaming of pg_xlog and pg_clog

2016-08-29 Thread Jim Nasby
will create them for people that actually need them. -- Jim Nasby, Data Architect, Blue Treble Consulting, Austin TX Experts in Analytics, Data Architecture and PostgreSQL Data in Trouble? Get it in Treble! http://BlueTreble.com 855-TREBLE2 (855-873-2532) mobile: 512-569-9461 -- Sent via pgsql-

Re: [HACKERS] Renaming of pg_xlog and pg_clog

2016-08-28 Thread Jim Nasby
reference them. I think it's well worth renaming them. I actually like the idea of re-organizing everything too. It would be easy to include a tool that puts symlinks in place to all the original locations if you need that. -- Jim Nasby, Data Architect, Blue Treble Consulting, Austi

Re: [HACKERS] Why is a newly created index contains the invalid LSN?

2016-08-28 Thread Jim Nasby
n why you're interested in page lsns, that'd perhaps allow us to give more meaningful feedback. Yeah, especially since you mentioned this being for backups. I suspect you *want* those WAL records marked with 0, because that tells you that you can't rely on WAL when you back that da

Re: [HACKERS] pg_dump with tables created in schemas created by extensions

2016-08-23 Thread Jim Nasby
ones lived inside a schema (as opposed to globally), and which ones were shared/global (cross-database). I think I needed this for some automatic handling of comments, but it's been a while. Maybe something like that would help reduce the duplication... -- Jim Nasby, Data Architect, Blue Tre

Re: [HACKERS] Re: [BUGS] Re: Missing rows with index scan when collation is not "C" (PostgreSQL 9.5)

2016-08-23 Thread Jim Nasby
On 8/22/16 7:36 PM, Peter Geoghegan wrote: For some reason, both cases involved strings with code points from the Arabic alphabet, even though each case was from a totally unrelated customer database. Do those code points read right to left? Maybe that had an effect? -- Jim Nasby, Data

Re: [HACKERS] EXLCUDE constraints and Hash indexes

2016-08-19 Thread Jim Nasby
On 8/17/16 8:12 AM, Andrew Gierth wrote: I also recently found a case where using btree exclusion constraints was useful: a unique index on an expression can't be marked deferrable, but the equivalent exclusion constraint can be. That seems well worth documenting... -- Jim Nasby,

Re: [HACKERS] Curing plpgsql's memory leaks for statement-lifespan values

2016-08-19 Thread Jim Nasby
enough to negate the cost of resetting on every call though... -- Jim Nasby, Data Architect, Blue Treble Consulting, Austin TX Experts in Analytics, Data Architecture and PostgreSQL Data in Trouble? Get it in Treble! http://BlueTreble.com 855-TREBLE2 (855-873-2532) mobile: 512-569-9461 -- Sent

Re: [HACKERS] anyelement -> anyrange

2016-08-19 Thread Jim Nasby
On 8/18/16 6:02 PM, Corey Huinker wrote: I'd be happy to roll your code into the extension, and make it marked more stable. Yeah, I've been meaning to look at submitting a pull request; hopefully will get to it today. -- Jim Nasby, Data Architect, Blue Treble Consulting, Austin TX

Re: [HACKERS] [PATCH] add option to pg_dumpall to exclude tables from the dump

2016-08-19 Thread Jim Nasby
e the code between the two as well... -- Jim Nasby, Data Architect, Blue Treble Consulting, Austin TX Experts in Analytics, Data Architecture and PostgreSQL Data in Trouble? Get it in Treble! http://BlueTreble.com 855-TREBLE2 (855-873-2532) mobile: 512-569-9461 -- Sent via pgsql-hackers mailing l

Re: [HACKERS] Curing plpgsql's memory leaks for statement-lifespan values

2016-08-18 Thread Jim Nasby
context without much gain.) Some folks do create very large plpgsql functions, so if there's a handy way to estimate the size of the function (pg_proc.prosrc's varlena size perhaps) then it might be worth doing that for quite large functions. -- Jim Nasby, Data Architect, Blue Treb

Re: [HACKERS] [PATCH] add option to pg_dumpall to exclude tables from the dump

2016-08-18 Thread Jim Nasby
(which I suppose could be *) with the specifiers would solve that issue. Also, if we believe that this has a safe use-case, why only -T, and not pg_dump's other object selectivity options? +1. -- Jim Nasby, Data Architect, Blue Treble Consulting, Austin TX Experts in Analytics, Data Archite

Re: [HACKERS] anyelement -> anyrange

2016-08-18 Thread Jim Nasby
came up was your range_partitioning stuff, which AFAICT is unrelated. http://pgxn.org/dist/range_type_functions/ still doesn't show up in search, maybe because it's marked unstable? Rather frustrating that I've spent time creating an extension that duplicates your work. :( --

Re: [HACKERS] Add -c to rsync commands on SR tutorial wiki page

2016-08-18 Thread Jim Nasby
nuke that page and point at something in the docs? Something else? -- Jim Nasby, Data Architect, Blue Treble Consulting, Austin TX Experts in Analytics, Data Architecture and PostgreSQL Data in Trouble? Get it in Treble! http://BlueTreble.com 855-TREBLE2 (855-873-2532) mobile: 512-569-9461 -- Se

Re: [HACKERS] [Patch] New psql prompt substitution %r (m = master, r = replica)

2016-08-18 Thread Jim Nasby
someone that has the backend PID in his prompt... +1. Or alternatively, a command that is just run when the connection changes instead of every command... -- Jim Nasby, Data Architect, Blue Treble Consulting, Austin TX Experts in Analytics, Data Architecture and PostgreSQL Data in Trouble? Get it in

Re: [HACKERS] [PATCH] bigint txids vs 'xid' type, new txid_recent(bigint) => xid

2016-08-18 Thread Jim Nasby
ngs up the way they are today. -- Jim Nasby, Data Architect, Blue Treble Consulting, Austin TX Experts in Analytics, Data Architecture and PostgreSQL Data in Trouble? Get it in Treble! http://BlueTreble.com 855-TREBLE2 (855-873-2532) mobile: 512-569-9461 -- Sent via pgsql-hackers mailing list

Re: [HACKERS] synchronous_commit = remote_flush

2016-08-18 Thread Jim Nasby
ched and never going to change? I'm wondering if we've hit the point where trying to put all of this in a single GUC is a bad idea... changing that probably means a config compatibility break, but I don't think that's necessarily a bad thing at this point... -- Jim Nasby,

Re: [HACKERS] Add -c to rsync commands on SR tutorial wiki page

2016-08-18 Thread Jim Nasby
On 8/17/16 9:46 PM, Stephen Frost wrote: * Jim Nasby (jim.na...@bluetreble.com) wrote: > https://wiki.postgresql.org/wiki/Binary_Replication_Tutorial does > not specify -c for any of the rsync commands. That's maybe safe for > WAL, but I don't think it's safe for any

Re: [HACKERS] Why we lost Uber as a user

2016-08-17 Thread Jim Nasby
On 8/17/16 2:51 PM, Simon Riggs wrote: On 17 August 2016 at 12:19, Greg Stark wrote: On Wed, Aug 17, 2016 at 1:36 AM, Jim Nasby wrote: Something I didn't see mentioned that I think is a critical point: last I looked, HOT standby (and presumably SR) replays full page writes. That means

[HACKERS] Add -c to rsync commands on SR tutorial wiki page

2016-08-17 Thread Jim Nasby
is to just stick -c in all the commands. -- Jim Nasby, Data Architect, Blue Treble Consulting, Austin TX Experts in Analytics, Data Architecture and PostgreSQL Data in Trouble? Get it in Treble! http://BlueTreble.com 855-TREBLE2 (855-873-2532) mobile: 512-569-9461 -- Sent via pgsql-hackers

Re: [HACKERS] anyelement -> anyrange

2016-08-16 Thread Jim Nasby
On 8/16/16 6:56 PM, David G. Johnston wrote: On Tue, Aug 16, 2016 at 7:47 PM, Jim Nasby mailto:jim.na...@bluetreble.com>>wrote: On 8/15/16 10:12 PM, Tom Lane wrote: Jim Nasby writes: Any reason why we can create a function that accepts anyeleme

Re: [HACKERS] Why we lost Uber as a user

2016-08-16 Thread Jim Nasby
ly be REALLY happy you have it. Similarly, I always encourage people to run a weekly or monthly pg_dump if it's at all feasible... just to be safe. -- Jim Nasby, Data Architect, Blue Treble Consulting, Austin TX Experts in Analytics, Data Architecture and PostgreSQL Data in Trouble? Get it i

Re: [HACKERS] [Patch] Temporary tables that do not bloat pg_catalog (a.k.a fast temp tables)

2016-08-16 Thread Jim Nasby
his stuff. Is the idea of "partitioning" the catalogs to store temp objects separate from permanent fatally flawed? -- Jim Nasby, Data Architect, Blue Treble Consulting, Austin TX Experts in Analytics, Data Architecture and PostgreSQL Data in Trouble? Get it in Treble! http://BlueT

Re: [HACKERS] anyelement -> anyrange

2016-08-16 Thread Jim Nasby
On 8/15/16 10:12 PM, Tom Lane wrote: Jim Nasby writes: Any reason why we can create a function that accepts anyelement and returns anyarray, but can't do the same with anyrange? Because there can be more than one range type over the same element type, so we couldn't deduce which

Re: [HACKERS] [GENERAL] C++ port of Postgres

2016-08-16 Thread Jim Nasby
thetical, because no one could realistically propose a patch to use C++ (or maybe even Rust) features. -- Jim Nasby, Data Architect, Blue Treble Consulting, Austin TX Experts in Analytics, Data Architecture and PostgreSQL Data in Trouble? Get it in Treble! http://BlueTreble.com 855-TREBLE2 (855-87

Re: [HACKERS] [GENERAL] C++ port of Postgres

2016-08-16 Thread Jim Nasby
equirement to build Postgres. Maybe we'll eventually go that route, after demonstrating the significant benefits that would need to exist to make that work worthwhile. It's going to be FAR easier to demonstrate that if the native project at least supports using it, vs needing a comp

Re: [HACKERS] [GENERAL] C++ port of Postgres

2016-08-16 Thread Jim Nasby
wanted to add support for C++. Joy, do you have an idea what a *minimally invasive* patch for C++ support would look like? That's certainly the first step here. -- Jim Nasby, Data Architect, Blue Treble Consulting, Austin TX Experts in Analytics, Data Architecture and PostgreSQL Data in T

Re: [HACKERS] [GENERAL] C++ port of Postgres

2016-08-16 Thread Jim Nasby
d3EvRdo-Rd6eo8QPEqV8=shau2sjfo16wfe0r-h...@mail.gmail.com 2: https://petereisentraut.blogspot.com/2013/05/moving-to-c.html -- Jim Nasby, Data Architect, Blue Treble Consulting, Austin TX Experts in Analytics, Data Architecture and PostgreSQL Data in Trouble? Get it in Treble! http://BlueTreble.com

[HACKERS] anyelement -> anyrange

2016-08-15 Thread Jim Nasby
AGE plpgsql AS $body$ BEGIN RETURN array[$1,$2]; END$body$; CREATE FUNCTION -- Jim Nasby, Data Architect, Blue Treble Consulting, Austin TX Experts in Analytics, Data Architecture and PostgreSQL Data in Trouble? Get it in Treble! http://BlueTreble.com 855-TREBLE2 (855-873-2532) mobile: 512-5

Re: [HACKERS] PATCH: Exclude additional directories in pg_basebackup

2016-08-15 Thread Jim Nasby
a SAN). -- Jim Nasby, Data Architect, Blue Treble Consulting, Austin TX Experts in Analytics, Data Architecture and PostgreSQL Data in Trouble? Get it in Treble! http://BlueTreble.com 855-TREBLE2 (855-873-2532) mobile: 512-569-9461 -- Sent via pgsql-hackers mailing list (pgsql-hackers@postgresql.or

[HACKERS] Improve handling of ^C in psql / top-level transaction abort

2016-08-14 Thread Jim Nasby
ABORT. In particular, release snapshots. Since there's no substransaction, there's no possibility of running further commands. Is there risk to that with portals still open? -- Jim Nasby, Data Architect, Blue Treble Consulting, Austin TX Experts in Analytics, Data Architecture and Postgre

Re: [HACKERS] Add hint for function named "is"

2016-08-13 Thread Jim Nasby
contains spaces without being quoted. AFAIK nothing else in the system allows that, and I don't see why character varying and timestamp with* should get a special pass. I doubt we could get rid of this in CREATE TABLE, but I wonder how many people actually cast using the unquoted form. --

Re: [HACKERS] Add hint for function named "is"

2016-08-11 Thread Jim Nasby
; token, and have enough control to look for a relevant function? -- Jim Nasby, Data Architect, Blue Treble Consulting, Austin TX Experts in Analytics, Data Architecture and PostgreSQL Data in Trouble? Get it in Treble! http://BlueTreble.com 855-TREBLE2 (855-873-2532) mobile: 512-569-9461 --

Re: [HACKERS] new autovacuum criterion for visible pages

2016-08-11 Thread Jim Nasby
values to. I'm wondering if also creating the same options for all-frozen pages would be worthwhile. I don't see an obvious use for that, but maybe someone else does (and adding both at once would presumably be the least amount of work...) -- Jim Nasby, Data Architect, Blue Treble C

[HACKERS] Add hint for function named "is"

2016-08-11 Thread Jim Nasby
a way this could be hinted? FWIW, the real-world case here comes from using pgTap, which has an is() function. I've used that countless times by itself without quoting, so it never occurred to me that the syntax error was due to lack of quotes. -- Jim Nasby, Data Architect, Blue

Re: [HACKERS] Heap WARM Tuples - Design Draft

2016-08-11 Thread Jim Nasby
On 8/10/16 12:48 PM, Claudio Freire wrote: On Tue, Aug 9, 2016 at 11:39 PM, Jim Nasby wrote: On 8/9/16 6:44 PM, Claudio Freire wrote: Since we can lookup all occurrences of k1=a index=0 and k2=a index=0, and in fact we probably did so already as part of the update logic That's a c

Re: [HACKERS] dsm_unpin_segment

2016-08-09 Thread Jim Nasby
ed to be in shared memory, because we also want to protect against two *different* backends pinning it. Right, this would strictly protect from it happening within a single backend. Perhaps it's pointless for pin/unpin, but it seems like it would be a good thing to have for attach/detac

Re: [HACKERS] Heap WARM Tuples - Design Draft

2016-08-09 Thread Jim Nasby
uld reduce the cost of vacuum enormously. Orders of magnitude wouldn't surprise me in the least. If that's indeed a prerequisite to WARM it would be great to get that groundwork laid early so others could work on other optimizations it would enable. -- Jim Nasby, Data Architect, Blu

Re: [HACKERS] Heap WARM Tuples - Design Draft

2016-08-09 Thread Jim Nasby
2 3 4 k1 .. a a a k2 .. b a a i1 ^ i2 ^ lp u u r3 hot* FWIW, your ascii-art is unfortunately getting bungled somewhere I think :/. -- Jim Nasby, Data Architect, Blue Treble Consulting, Austin TX

Re: [HACKERS] Notice lock waits

2016-08-09 Thread Jim Nasby
? -- Jim Nasby, Data Architect, Blue Treble Consulting, Austin TX Experts in Analytics, Data Architecture and PostgreSQL Data in Trouble? Get it in Treble! http://BlueTreble.com 855-TREBLE2 (855-873-2532) mobile: 512-569-9461 -- Sent via pgsql-hackers mailing list (pgsql-hackers@postgresql.org

Re: [HACKERS] Wait events monitoring future development

2016-08-09 Thread Jim Nasby
veral of which I forgot even existed until just now. Since there's question over the actual overhead maybe that's a prudent approach for now, but I think we should be striving to enable these things ASAP. -- Jim Nasby, Data Architect, Blue Treble Consulting, Austin TX Experts in An

Re: [HACKERS] Heap WARM Tuples - Design Draft

2016-08-09 Thread Jim Nasby
ed value. What if some of this work happened asynchronously? I'm thinking something that runs through shared_buffers in front of bgwriter. -- Jim Nasby, Data Architect, Blue Treble Consulting, Austin TX Experts in Analytics, Data Architecture and PostgreSQL Data in Trouble? Get it in Treb

Re: [HACKERS] dsm_unpin_segment

2016-08-09 Thread Jim Nasby
he same segment. Could a couple of static variables be used to ensure multiple pin/unpin and attach/detach calls throw an assert() (or become a no-op if asserts are disabled)? It would be nice if we could protect users from this. -- Jim Nasby, Data Architect, Blue Treble Consulting, Austi

Re: [HACKERS] Oddity with NOT IN

2016-08-06 Thread Jim Nasby
Also, there's some other common gotchas that we could better warn users about, some of which involve DDL. One example is accidentally defining duplicate indexes. -- Jim Nasby, Data Architect, Blue Treble Consulting, Austin TX Experts in Analytics, Data Architecture and PostgreSQL Data in T

Re: [HACKERS] Oddity with NOT IN

2016-08-06 Thread Jim Nasby
that's a problem we already have in some places, so perhaps not worth worrying about. -- Jim Nasby, Data Architect, Blue Treble Consulting, Austin TX Experts in Analytics, Data Architecture and PostgreSQL Data in Trouble? Get it in Treble! http://BlueTreble.com 855-TREBLE2 (855-873-2532) mobil

Re: [HACKERS] No longer possible to query catalogs for index capabilities?

2016-08-06 Thread Jim Nasby
ad of doing that I elected to parse pg_get_triggerdef[1], but that's hardly satisfying either. 1: https://github.com/decibel/cat_tools/blob/master/sql/cat_tools.sql#L339 -- Jim Nasby, Data Architect, Blue Treble Consulting, Austin TX Experts in Analytics, Data Architecture and PostgreSQL Dat

Re: [HACKERS] Oddity with NOT IN

2016-08-06 Thread Jim Nasby
On 8/4/16 4:53 PM, Marko Tiikkaja wrote: On 2016-08-04 11:23 PM, Jim Nasby wrote: I've got a customer that discovered something odd... SELECT f1 FROM v1 WHERE f2 not in (SELECT bad FROM v2 WHERE f3 = 1); does not error, even though bad doesn't exist, but I'm guessing there&#x

Re: [HACKERS] System load consideration before spawning parallel workers

2016-08-05 Thread Jim Nasby
example. There's more reasons than just CPU that parallel workers can help (IO being an obvious one, but possible other things like GPU). Another example is allowing users to alter the selection process used by autovac workers. -- Jim Nasby, Data Architect, Blue Treble Consulting, Austin TX Ex

[HACKERS] Oddity with NOT IN

2016-08-04 Thread Jim Nasby
his is on 9.4.8, and both v1 and v2 are views. The only "odd" thing that I see is that v1 is a UNION ALL and v2 is a UNION. I don't think there's any tables in common between the two views. -- Jim Nasby, Data Architect, Blue Treble Consulting, Austin TX Experts in Analytics,

Re: [HACKERS] to_date_valid()

2016-07-29 Thread Jim Nasby
) that offers the old behavior. Users could even put that function before pg_catalog in search_path and get the old behavior back. -- Jim Nasby, Data Architect, Blue Treble Consulting, Austin TX Experts in Analytics, Data Architecture and PostgreSQL Data in Trouble? Get it in Treble! http://BlueT

Re: [HACKERS] "Strong sides of MySQL" talk from PgDay16Russia, translated

2016-07-29 Thread Jim Nasby
the problem. (Their docs actually used to say that anything other that table-level locking was a bad idea.) -- Jim Nasby, Data Architect, Blue Treble Consulting, Austin TX Experts in Analytics, Data Architecture and PostgreSQL Data in Trouble? Get it in Treble! http://BlueTreble.com 855-TREB

Re: [HACKERS] Why we lost Uber as a user

2016-07-29 Thread Jim Nasby
idea worth pursuing, but I don't see how you can make it work with our MVCC system unless we drop the aversion to scanning back into an index as part of an update. -- Jim Nasby, Data Architect, Blue Treble Consulting, Austin TX Experts in Analytics, Data Architecture and PostgreSQL Dat

Re: [HACKERS] Proposal: revert behavior of IS NULL on row types

2016-07-22 Thread Jim Nasby
the assumption that referencing NEW in a DELETE trigger would be legit and give you NULL with the new semantics, but trying to actually reference any of it's fields would produce an error). -- Jim Nasby, Data Architect, Blue Treble Consulting, Austin TX Experts in Analytics, Data Architectu

Re: [HACKERS] Design for In-Core Logical Replication

2016-07-22 Thread Jim Nasby
/communication features and a sketch of a design. -- Jim Nasby, Data Architect, Blue Treble Consulting, Austin TX Experts in Analytics, Data Architecture and PostgreSQL Data in Trouble? Get it in Treble! http://BlueTreble.com 855-TREBLE2 (855-873-2532) mobile: 512-569-9461 -- Sent via p

Re: [HACKERS] Design for In-Core Logical Replication

2016-07-22 Thread Jim Nasby
least of your worries. If we don't want to get too wrapped up in config/syntax I think there should at least be a read-only statement level trigger installed by default that users can then drop or disable if desired. -- Jim Nasby, Data Architect, Blue Treble Consulting, Austin TX Exper

Re: [HACKERS] Rethinking TupleTableSlot deforming

2016-07-22 Thread Jim Nasby
On 7/22/16 1:58 PM, Andres Freund wrote: On 2016-07-22 13:51:31 -0500, Jim Nasby wrote: Another option would be to remember the tuple offsets (NOT attcacheoff) that have been computed as well as whether a varlena attribute has actually been deformed. That eliminates the need to pre-declare what

Re: [HACKERS] Rethinking TupleTableSlot deforming

2016-07-22 Thread Jim Nasby
e additional support that would be needed in expanded objects themselves. -- Jim Nasby, Data Architect, Blue Treble Consulting, Austin TX Experts in Analytics, Data Architecture and PostgreSQL Data in Trouble? Get it in Treble! http://BlueTreble.com 855-TREBLE2 (855-873-2532) mobile: 512-569-9461

Re: [HACKERS] Bug with plpgsql handling of NULL argument of compound type

2016-07-22 Thread Jim Nasby
L::c).t IS NULL might be allowed (special case retrieving field values from a composite that's not actually defined). -- Jim Nasby, Data Architect, Blue Treble Consulting, Austin TX Experts in Analytics, Data Architecture and PostgreSQL Data in Trouble? Get it in Treble! http://BlueTreble.com

[HACKERS] Bug with plpgsql handling of NULL argument of compound type

2016-07-22 Thread Jim Nasby
ot supported, but it would be nice if I could just do CREATE TYPE c AS (t text NOT NULL, i int); -- Jim Nasby, Data Architect, Blue Treble Consulting, Austin TX Experts in Analytics, Data Architecture and PostgreSQL Data in Trouble? Get it in Treble! http://BlueTreble.com 855-TREBLE2 (855-873-2532)

Re: [HACKERS] PoC: Make it possible to disallow WHERE-less UPDATE and DELETE

2016-07-21 Thread Jim Nasby
On 7/21/16 11:46 AM, David Fetter wrote: > Can't you implement this as a extension? Yes. In that case, I'd want to make it a contrib extension, as it is at least in theory attached to specific major versions of the backend. Howso? -- Jim Nasby, Data Architect, Blue Treble Consu

Re: [HACKERS] A Modest Upgrade Proposal

2016-07-18 Thread Jim Nasby
a function in that extension: EXTENSION MODE citus; master_create_distributed_table 'github_events', 'created_at', 'append'; EXTENSION MODE; instead of SELECT master_create_distributed_table('github_events', 'created_at', 'append'); ob

Re: [HACKERS] One process per session lack of sharing

2016-07-17 Thread Jim Nasby
Depending on how it was structured, it might also insulate the database from having to panic if a function crashed it's process. -- Jim Nasby, Data Architect, Blue Treble Consulting, Austin TX Experts in Analytics, Data Architecture and PostgreSQL Data in Trouble? Get it in Treble! http://Blu

Re: [HACKERS] A Modest Upgrade Proposal

2016-07-17 Thread Jim Nasby
ta, and because of it's binary nature the odds of some kind of a corruption event happening are far higher than with something like londiste. Certainly many environments don't have those concerns though. Having options are good. -- Jim Nasby, Data Architect, Blue Treble Consulti

Re: [HACKERS] A Modest Upgrade Proposal

2016-07-17 Thread Jim Nasby
because arrays are a PITA? Is it too hard to call functions? -- Jim Nasby, Data Architect, Blue Treble Consulting, Austin TX Experts in Analytics, Data Architecture and PostgreSQL Data in Trouble? Get it in Treble! http://BlueTreble.com 855-TREBLE2 (855-873-2532) mobile: 512-569-9461 -- Sent

Re: [HACKERS] application_name in process name?

2016-07-16 Thread Jim Nasby
? In a lot of situations ("top" for instance) only a limited number of characters can be displayed from a process title. I'm hesitant to add fields to that string that we don't really need. Could we make this configurable, similar to log_line_prefix? -- Jim Nasby, Data Ar

Re: [HACKERS] Constraint merge and not valid status

2016-07-16 Thread Jim Nasby
t may have some. Is that an oversight? Seen as how you used to be able to illegally twerk NOT NULL status on children (and maybe still can), I'd bet this is a bug... -- Jim Nasby, Data Architect, Blue Treble Consulting, Austin TX Experts in Analytics, Data Architecture and PostgreSQL Data

Re: [HACKERS] Bug in batch tuplesort memory CLUSTER case (9.6 only)

2016-07-02 Thread Jim Nasby
testing. Though I do think something that's sorely needed is the ability to test stuff at the C level. Sometimes SQL is jut too high a level to verify things. -- Jim Nasby, Data Architect, Blue Treble Consulting, Austin TX Experts in Analytics, Data Architecture and PostgreSQL Data in Troubl

Re: [HACKERS] Reviewing freeze map code

2016-07-01 Thread Jim Nasby
On 7/1/16 3:43 PM, Andres Freund wrote: On 2016-07-01 15:42:22 -0500, Jim Nasby wrote: On 7/1/16 2:23 PM, Andres Freund wrote: The only cost of that is that vacuum will come along and mark the page all-visible again instead of skipping it, but that's probably not an enormous expense in

Re: [HACKERS] Reviewing freeze map code

2016-07-01 Thread Jim Nasby
s all-visible for index-only purposes. If it's an insert mostly table, it can be a long while till vacuum comes around. ISTM that's something that should be addressed anyway (and separately), no? -- Jim Nasby, Data Architect, Blue Treble Consulting, Austin TX Experts in Analytics, Data Archi

Re: [HACKERS] Bad behavior from plpython 'return []'

2016-07-01 Thread Jim Nasby
n't have a choice about that unless we expressly forbid arrays where any of the elements of *dims were 0 (which I suspect we should probably do anyway... I don't see how you can do anything with a 2x0x3 array...) -- Jim Nasby, Data Architect, Blue Treble Consulting, Austin TX Experts

[HACKERS] Bad behavior from plpython 'return []'

2016-06-30 Thread Jim Nasby
for everything that's varlena (AFAICT plperl already suffers from this). -- Jim Nasby, Data Architect, Blue Treble Consulting, Austin TX Experts in Analytics, Data Architecture and PostgreSQL Data in Trouble? Get it in Treble! http://BlueTreble.com 855-TREBLE2 (855-873-2532) mobile: 512-569-94

Re: [HACKERS] Bug in to_timestamp().

2016-06-23 Thread Jim Nasby
ctions. Not the nicest way to handle this problem, but it is workable and having a regex example available for people to start with would be very helpful. -- Jim Nasby, Data Architect, Blue Treble Consulting, Austin TX Experts in Analytics, Data Architecture and PostgreSQL Data in T

Re: [HACKERS] proposal: integration bloat tables (indexes) to core

2016-06-16 Thread Jim Nasby
views, but rather functions that serve specific purposes. For table bloat that means a function that returns what the heap size should be based on pg_stats. For locking, it means providing information about which PID is blocking which PID. After that, most everything else is just window dressing. --

Re: [HACKERS] 10.0

2016-06-15 Thread Jim Nasby
to pg_config? It's common to need to know what version you're handling in a Makefile, and today that's pretty ugly (especially when something is stamped as beta, since it breaks assumptions about numeric). -- Jim Nasby, Data Architect, Blue Treble Consulting, Austin TX Experts in

Re: [HACKERS] 10.0

2016-06-14 Thread Jim Nasby
On 6/14/16 3:56 PM, Tom Lane wrote: Jim Nasby writes: On 6/14/16 3:01 PM, Robert Haas wrote: This seems kind of silly, because anybody who is writing code that might have to run against an existing version of the database won't be able to use it. The one thing that absolutely has to be

Re: [HACKERS] 10.0

2016-06-14 Thread Jim Nasby
On 6/14/16 3:38 PM, Joshua D. Drake wrote: On 06/14/2016 12:46 PM, Jim Nasby wrote: Any ideas on naming for such a function? version_detail()? I suppose while we're at this we might as well provide the compile details as well. version(detail) or version(verbose) I don't think tha

Re: [HACKERS] 10.0

2016-06-14 Thread Jim Nasby
hat doesn't currently exist anyway. So no matter what, you won't be able to use it if you're interested in <10.0 (or <9.6 if we went with one of the other proposals). Unless folks were thinking this is something that would be backpatched? -- Jim Nasby, Data Architect, Blue Tr

Re: [HACKERS] Use of index for 50% column restriction

2016-06-14 Thread Jim Nasby
On 6/8/16 4:36 PM, Bruce Momjian wrote: Just a follow-up, but even with a randomized correlation order, it seems 25% restrictivity generates a Bitmap Index Scan: AFAIK we do the bitmap heap scan in heap order, thereby eliminating the effect of correlation? -- Jim Nasby, Data Architect, Blue

Re: [HACKERS] gettimeofday is at the end of its usefulness?

2016-06-14 Thread Jim Nasby
that presumably the explain penalty would be a moot point. -- Jim Nasby, Data Architect, Blue Treble Consulting, Austin TX Experts in Analytics, Data Architecture and PostgreSQL Data in Trouble? Get it in Treble! http://BlueTreble.com 855-TREBLE2 (855-873-2532) mobile: 512-569-9461 -- Sent vi

Re: [HACKERS] WIP: Data at rest encryption

2016-06-14 Thread Jim Nasby
ver an encrypted FS, other than a feature comparison checkmark...) -- Jim Nasby, Data Architect, Blue Treble Consulting, Austin TX Experts in Analytics, Data Architecture and PostgreSQL Data in Trouble? Get it in Treble! http://BlueTreble.com 855-TREBLE2 (855-873-2532) mobile: 512-569-9461 -- S

Re: [HACKERS] 10.0

2016-06-14 Thread Jim Nasby
ill has to support 3 numbers would also be a wart. We've lived with the parsing wart this long, so lets just add an explicit output version to 10.0. Any ideas on naming for such a function? version_detail()? I suppose while we're at this we might as well provide the compile details as

Re: [HACKERS] Reviewing freeze map code

2016-06-07 Thread Jim Nasby
n some of these scenarios, because it's so difficult to put the system into that state to begin with. Stuff that depends on burning through a large number of XIDs is an example of that. (To be clear, I'm talking about unit-test kind of stuff here, not validating an existing system.)

Re: [HACKERS] [BUGS] Routine analyze of single column prevents standard autoanalyze from running at all

2016-06-07 Thread Jim Nasby
scover; I doubt most users are aware that you *can* analyze individual columns. Is there any significant advantage to not analyzing all columns? Only case I can think of is if you have a fair number of columns that have been toasted; otherwise I'd think IO would completely swamp any other

[HACKERS] Typo in parallel comment of heap_delete()

2016-06-05 Thread Jim Nasby
I'm pretty sure this is a typo... -- Jim Nasby, Data Architect, Blue Treble Consulting, Austin TX Experts in Analytics, Data Architecture and PostgreSQL Data in Trouble? Get it in Treble! http://BlueTreble.com 855-TREBLE2 (855-873-2532) mobile: 512-569-9461 diff --git a/src/backend/access

Re: [HACKERS] array of domain types

2016-06-03 Thread Jim Nasby
as a table column So that's 5 x 2 (once for domain[], once for create type blah(x domain[])) test cases. There might be some other cases that are missing (what cast testing needs to happen?) -- Jim Nasby, Data Architect, Blue Treble Consulting, Austin TX Experts in Analytics, Data Architectur

Re: [HACKERS] regexp_match() returning text

2016-06-03 Thread Jim Nasby
On 5/30/16 1:01 PM, Andrew Gierth wrote: Returning an array containing the values of all capture groups might be more useful (substring returns the value of the first capture group if any, otherwise the matched string). +1. -- Jim Nasby, Data Architect, Blue Treble Consulting, Austin TX

Re: [HACKERS] Floating point comparison inconsistencies of the geometric types

2016-06-01 Thread Jim Nasby
not enough when different GRSes are involved? -- Jim Nasby, Data Architect, Blue Treble Consulting, Austin TX Experts in Analytics, Data Architecture and PostgreSQL Data in Trouble? Get it in Treble! http://BlueTreble.com 855-TREBLE2 (855-873-2532) mobile: 512-569-9461 -- Sent via pgsql-hacke

Re: [HACKERS] JSON[B] arrays are second-class citizens

2016-06-01 Thread Jim Nasby
o away, *especially* if the [] notation allowed things like a slice and a list of values (ie: json['foo', 'bar', 'baz'] = '[42,{"my": "nice object"},"with a random string"]'. Or = row(42, ...). -- Jim Nasby, Data Architect, Blu

Re: [HACKERS] Rename max_parallel_degree?

2016-06-01 Thread Jim Nasby
e confusing, and I don't see any options for parallelism that are any clearer. -- Jim Nasby, Data Architect, Blue Treble Consulting, Austin TX Experts in Analytics, Data Architecture and PostgreSQL Data in Trouble? Get it in Treble! http://BlueTreble.com 855-TREBLE2 (855-873-2532) mobile: 512-569-

Re: [HACKERS] Floating point comparison inconsistencies of the geometric types

2016-06-01 Thread Jim Nasby
ted if different projection methods are involved. I don't know if PostGIS depends on what these macros are doing or not. If it doesn't, perhaps it would be sufficient to lop of the last few bits of the significand. ISTM that'd be much better than what the macros currently do. BTW, I su

Re: [HACKERS] Does people favor to have matrix data type?

2016-06-01 Thread Jim Nasby
W, take a look at MADlib svec[1]... ISTM that's just a special case of what you're describing with entire grids being zero (or vice-versa). There might be some commonality there. [1] https://madlib.incubator.apache.org/docs/v1.8/group__grp__svec.html -- Jim Nasby, Data Architec

Re: [HACKERS] Inheritance

2016-05-26 Thread Jim Nasby
ain for *any* operations are most welcome! I think allowing queued backgrounded processes would be a huge win there. If we had real stored procedures (IE: ability to control transaction state) and a modest background scheduler then it wouldn't be hard to build that. -- Jim Nasby, Data Archi

Re: [HACKERS] Inheritance

2016-05-25 Thread Jim Nasby
#x27;ve moved from being an RDBMS to being a "Data Platform". Improving our OO capabilities just continues that. -- Jim Nasby, Data Architect, Blue Treble Consulting, Austin TX Experts in Analytics, Data Architecture and PostgreSQL Data in Trouble? Get it in Treble! http://BlueTreble.co

Re: [HACKERS] Does people favor to have matrix data type?

2016-05-25 Thread Jim Nasby
LL bitmap implementation). Related to this, Tom has mentioned in the past that perhaps we should support abstract use of the [] construct. Currently point finds a way to make use of [], but I think that's actually coded into the grammar. -- Jim Nasby, Data Architect, Blue Treble Consulting, Austin

Re: [HACKERS] To-Do item: skip table scan for adding column with provable check constraints

2016-05-25 Thread Jim Nasby
; that simply evaluate a boolean expression (and don't require defining a function). -- Jim Nasby, Data Architect, Blue Treble Consulting, Austin TX Experts in Analytics, Data Architecture and PostgreSQL Data in Trouble? Get it in Treble! http://BlueTreble.com 855-TREBLE2 (855-873-2532) mobile:

Re: [HACKERS] Lets (not) break all the things. Was: [pgsql-advocacy] 9.6 -> 10.0

2016-05-24 Thread Jim Nasby
dy know exactly how to fail over. -- Jim Nasby, Data Architect, Blue Treble Consulting, Austin TX Experts in Analytics, Data Architecture and PostgreSQL Data in Trouble? Get it in Treble! http://BlueTreble.com 855-TREBLE2 (855-873-2532) mobile: 512-569-9461 -- Sent via pgsql-hackers mailing list

Re: [HACKERS] Calling json_* functions with JSONB data

2016-05-24 Thread Jim Nasby
On 5/23/16 4:45 PM, David G. Johnston wrote: On Mon, May 23, 2016 at 5:38 PM, Jim Nasby mailto:jim.na...@bluetreble.com>>wrote: On 5/23/16 11:55 AM, Peter van Hardenberg wrote: Fortunately, this seems quite easy to resolve by taking advantage of our ability

Re: [HACKERS] pg_dump -j against standbys

2016-05-24 Thread Jim Nasby
urprise me that people would want to parallel dump from a replica... -- Jim Nasby, Data Architect, Blue Treble Consulting, Austin TX Experts in Analytics, Data Architecture and PostgreSQL Data in Trouble? Get it in Treble! http://BlueTreble.com 855-TREBLE2 (855-873-2532) mobile: 512-569-9461 -

Re: [HACKERS] PATCH: Batch/pipelining support for libpq

2016-05-24 Thread Jim Nasby
On 5/23/16 4:19 AM, Craig Ringer wrote: +Batching less useful when information from one operation is required by the SB "Batching is less useful". -- Jim Nasby, Data Architect, Blue Treble Consulting, Austin TX Experts in Analytics, Data Architecture and PostgreSQL Data in Troub

Re: [HACKERS] Inheritance

2016-05-24 Thread Jim Nasby
, we need to be doing *more* of this kind of work, not less. Lack of support for OO paradigms was one of the drivers for NoSQL. -- Jim Nasby, Data Architect, Blue Treble Consulting, Austin TX Experts in Analytics, Data Architecture and PostgreSQL Data in Trouble? Get it in Treble! http://BlueTrebl

Re: [HACKERS] Inheritance

2016-05-23 Thread Jim Nasby
itioning. I also disagree about PK:PK FK's between a bunch of completely independent tables being a good way to model this stuff. It doubles the complexity of every query against a child table and doesn't perform nearly as well, because your data locality goes down the tubes. -- J

<    1   2   3   4   5   6   7   8   9   10   >