Re: [HACKERS] list of credits for release notes

cies with some Japanese names: >>> - Fujii Masao should be Masao Fujii. >>> - KaiGai Kohei should be Kohei Kaigai. >> >> But his emails say Fujii Masao, not Masao Fujii. > > Michael is correct. > > Sometimes people choose family name first in the emails. Howeve

Re: [HACKERS] Float value 'Infinity' is cast to numeric 1 on Windows

Hello, Does it make sense to put a check of "isinf(val)" and ereport prior to the snprintf()? It is a lightweight check more than set_var_from_str(). Thanks, 2017-09-27 19:41 GMT+09:00 Taiki Kondo : > Hi all, > > I build PostgreSQL 9.6.5 by Visual Studio 2013 on

Re: ParallelFinish-hook of FDW/CSP (Re: [HACKERS] Steps inside ExecEndGather)

2017-02-25 1:40 GMT+09:00 Claudio Freire <klaussfre...@gmail.com>: > On Fri, Feb 24, 2017 at 1:24 PM, Robert Haas <robertmh...@gmail.com> wrote: >> On Fri, Feb 24, 2017 at 7:29 PM, Kohei KaiGai <kai...@kaigai.gr.jp> wrote: >>> This attached patch re-designed t

Re: ParallelFinish-hook of FDW/CSP (Re: [HACKERS] Steps inside ExecEndGather)

Hello, This attached patch re-designed the previous v2 according to Robert's comment. All I had to do is putting entrypoint for ForeignScan/CustomScan at ExecShutdownNode, because it is already modified to call child node first, earlier than ExecShutdownGather which releases DSM segment. Thanks,

Re: [HACKERS] PassDownLimitBound for ForeignScan/CustomScan [take-2]

Oops, I oversight this patch was marked as "returned with feedback", not "moved to the next CF". Its status has not been changed since the last update. (Code was revised according to the last comment by Jeevan, but CF-Nov was time up at that time.) How do I handle the patch? 2016-12-05 16:49

Re: [HACKERS] varlena beyond 1GB and matrix

2016-12-23 8:24 GMT+09:00 Robert Haas <robertmh...@gmail.com>: > On Wed, Dec 7, 2016 at 11:01 PM, Kohei KaiGai <kai...@kaigai.gr.jp> wrote: >> Regardless of the ExpandedObject, does the flatten format need to >> contain fully flatten data chunks? > > I suspec

Re: [HACKERS] varlena beyond 1GB and matrix

2016-12-23 8:23 GMT+09:00 Robert Haas <robertmh...@gmail.com>: > On Wed, Dec 7, 2016 at 10:44 PM, Kohei KaiGai <kai...@kaigai.gr.jp> wrote: >>> Handling objects >1GB at all seems like the harder part of the >>> problem. >>> >> I could get your p

Re: [HACKERS] varlena beyond 1GB and matrix

2016-12-08 16:11 GMT+09:00 Craig Ringer <cr...@2ndquadrant.com>: > On 8 December 2016 at 12:01, Kohei KaiGai <kai...@kaigai.gr.jp> wrote: > >>> At a higher level, I don't understand exactly where such giant >>> ExpandedObjects would come from. (As you point ou

Re: [HACKERS] varlena beyond 1GB and matrix

2016-12-08 8:36 GMT+09:00 Tom Lane <t...@sss.pgh.pa.us>: > Robert Haas <robertmh...@gmail.com> writes: >> On Wed, Dec 7, 2016 at 8:50 AM, Kohei KaiGai <kai...@kaigai.gr.jp> wrote: >>> I like to propose a new optional type handler 'typserialize' to >>

Re: [HACKERS] varlena beyond 1GB and matrix

2016-12-08 8:04 GMT+09:00 Robert Haas <robertmh...@gmail.com>: > On Wed, Dec 7, 2016 at 8:50 AM, Kohei KaiGai <kai...@kaigai.gr.jp> wrote: >> I like to propose a new optional type handler 'typserialize' to >> serialize an in-memory varlena structure (that can

[HACKERS] varlena beyond 1GB and matrix

This is a design proposal for matrix data type which can be larger than 1GB. Not only a new data type support, it also needs a platform enhancement because existing varlena has a hard limit (1GB). We had a discussion about this topic on the developer unconference at Tokyo/Akihabara, the day before

Re: [HACKERS] raw output from copy

2016-12-06 16:59 GMT+09:00 Pavel Stehule <pavel.steh...@gmail.com>: > > > 2016-12-06 1:50 GMT+01:00 Kohei KaiGai <kai...@kaigai.gr.jp>: >> >> 2016-12-05 22:45 GMT+09:00 Pavel Stehule <pavel.steh...@gmail.com>: >> > >> > There are more goals:

Re: [HACKERS] raw output from copy

2016-12-05 22:45 GMT+09:00 Pavel Stehule : > > There are more goals: > > 1. user friendly import of text or binary data - import text data (with > psql) from file is possible - but you have to load a content to psql > variable. For binary data you should to use workaround

Re: [HACKERS] raw output from copy

Sorry for my late response. I've briefly checked a series of discussion in the past. I understood the target/purpose of this patch is provision of a fast interface to import/export a particular cell of a relation, by skip of text<->binary transformation. Its typical use case are XML and JSON data

Re: [HACKERS] Use of pg_proc.probin is legal?

2016-11-16 7:46 GMT-08:00 Tom Lane <t...@sss.pgh.pa.us>: > Kohei KaiGai <kai...@kaigai.gr.jp> writes: >> On the other hands, interpret_AS_clause() raises an ereport if SQL >> function tries to use probin except >> for C-language. Is it illegal for other language

[HACKERS] Use of pg_proc.probin is legal?

Hello, I have a question as subject line. https://www.postgresql.org/docs/devel/static/catalog-pg-proc.html According to the documentation, the purpose of pg_proc.probin is introduced as follows: | Additional information about how to invoke the function. Again, the interpretation is

Re: [HACKERS] Academic help for Postgres

2016-05-11 23:20 GMT+09:00 Bruce Momjian : > I am giving a keynote at an IEEE database conference in Helsinki next > week (http://icde2016.fi/). (Yes, I am not attending PGCon Ottawa > because I accepted the Helsinki conference invitation before the PGCon > Ottawa date was

Re: [HACKERS] textlike under the LIKE operator for char(n)

2016-05-06 23:17 GMT+09:00 Kevin Grittner <kgri...@gmail.com>: > On Fri, May 6, 2016 at 8:58 AM, Kohei KaiGai <kai...@kaigai.gr.jp> wrote: > >> postgres=# select 'abcd'::char(20) LIKE 'ab%cd'; >> ?column? >> -- >> f >> (1 row) >

[HACKERS] textlike under the LIKE operator for char(n)

Hi, I found a mysterious behavior when we use LIKE operator on char(n) data type. postgres=# select 'abcd'::char(20) LIKE 'ab%cd'; ?column? -- f (1 row) postgres=# select 'abcd'::char(4) LIKE 'ab%cd'; ?column? -- t (1 row) LIKE operator (that is eventually processed by

Re: CustomScan in a larger structure (RE: [HACKERS] CustomScan support on readfuncs.c)

2016-02-13 0:11 GMT+09:00 Robert Haas : > On Fri, Feb 12, 2016 at 9:56 AM, Andres Freund wrote: >> On 2016-02-10 23:26:20 -0500, Robert Haas wrote: >>> I think the part about whacking around the FDW API is a little more >>> potentially objectionable to

[HACKERS] cash_mul_int8 / cash_div_int8

I noticed cash_mul_int8 / cash_div_int8 are defined in cash.c, however, pg_proc.h and pg_operator.h contains no relevant entries. Is it just a careless oversight? Thanks, -- KaiGai Kohei -- Sent via pgsql-hackers mailing list (pgsql-hackers@postgresql.org) To make

Re: [HACKERS] cash_mul_int8 / cash_div_int8

Also, cash_pl, cash_mi, cash_mul_int4 and so on... does not have overflow checks like as int8pl has. Of course, most of people don't need to worry about 64bit overflow for money... :-). 2015-10-08 0:03 GMT+09:00 Kohei KaiGai <kai...@kaigai.gr.jp>: > I noticed cash_mul_int8 / cash

Re: [HACKERS] DBT-3 with SF=20 got failed

2015-08-19 20:12 GMT+09:00 Simon Riggs si...@2ndquadrant.com: On 12 June 2015 at 00:29, Tomas Vondra tomas.von...@2ndquadrant.com wrote: I see two ways to fix this: (1) enforce the 1GB limit (probably better for back-patching, if that's necessary) (2) make it work with hash tables

Re: [HACKERS] DBT-3 with SF=20 got failed

2015-08-19 21:29 GMT+09:00 Simon Riggs si...@2ndquadrant.com: On 19 August 2015 at 12:55, Kohei KaiGai kai...@kaigai.gr.jp wrote: 2015-08-19 20:12 GMT+09:00 Simon Riggs si...@2ndquadrant.com: On 12 June 2015 at 00:29, Tomas Vondra tomas.von...@2ndquadrant.com wrote: I see two ways

Re: [HACKERS] security labels on databases are bad for dump restore

2015-07-15 2:39 GMT+09:00 Ted Toth txt...@gmail.com: That's exactly what I'm talking about like I said KaiGais branch was never merged into the mainline so I do not believe that it is used at all. It depends on the definition of integrated. The PostgreSQL core offers an infrastructure for

Re: [HACKERS] Foreign join pushdown vs EvalPlanQual

Does it make sense to put the result tuple of remote join on evety estate-es_epqTupleSet[] slot represented by this ForeignScan if scanrelid==0? It allows to recheck qualifier for each LockRow that intends to lock base foreign table underlying the remote join. ForeignScan-fdw_relids tells us

Re: [HACKERS] DBT-3 with SF=20 got failed

2015-06-11 23:20 GMT+09:00 Jan Wieck j...@wi3ck.info: On 06/11/2015 09:53 AM, Kouhei Kaigai wrote: curious: what was work_mem set to? work_mem=48GB My machine mounts 256GB physical RAM. work_mem can be allocated several times per backend. Nodes like sort and hash_aggregate may each

Re: [HACKERS] DBT-3 with SF=20 got failed

2015-06-11 23:33 GMT+09:00 Tomas Vondra tomas.von...@2ndquadrant.com: Hi, On 06/11/15 16:20, Jan Wieck wrote: On 06/11/2015 09:53 AM, Kouhei Kaigai wrote: curious: what was work_mem set to? work_mem=48GB My machine mounts 256GB physical RAM. work_mem can be allocated several times

Re: [HACKERS] DBT-3 with SF=20 got failed

2015-06-11 23:28 GMT+09:00 Robert Haas robertmh...@gmail.com: On Wed, Jun 10, 2015 at 10:57 PM, Kouhei Kaigai kai...@ak.jp.nec.com wrote: The attached patch replaces this palloc0() by MemoryContextAllocHuge() + memset(). Indeed, this hash table is constructed towards the relation with

Re: [HACKERS] trust authentication behavior

2015-05-18 15:15 GMT+09:00 Denis Kirjanov k...@itsirius.su: - Ursprüngliche Mail - Von: Kohei KaiGai kai...@kaigai.gr.jp An: Robert Haas robertmh...@gmail.com CC: David G. Johnston david.g.johns...@gmail.com, Denis Kirjanov k...@itsirius.su, pgsql-hackers@postgresql.org, Kohei

Re: [HACKERS] trust authentication behavior

2015-05-16 5:13 GMT+09:00 Robert Haas robertmh...@gmail.com: On Thu, May 14, 2015 at 3:52 PM, David G. Johnston david.g.johns...@gmail.com wrote: On Thu, May 14, 2015 at 12:22 PM, Denis Kirjanov k...@itsirius.su wrote: Yeah, but the idea is to do that without the pg_hba.conf You may want to

Re: [HACKERS] One question about security label command

2015-05-13 21:45 GMT+09:00 Robert Haas robertmh...@gmail.com: On Sun, May 10, 2015 at 3:15 AM, Kohei KaiGai kai...@kaigai.gr.jp wrote: 2015-05-01 9:52 GMT+09:00 Kohei KaiGai kai...@kaigai.gr.jp: 2015-05-01 7:40 GMT+09:00 Alvaro Herrera alvhe...@2ndquadrant.com: Kouhei Kaigai wrote: * Tom

Re: Custom/Foreign-Join-APIs (Re: [HACKERS] [v9.5] Custom Plan API)

Tom, I briefly checked your updates. Even though it is not described in the commit-log, I noticed a problematic change. This commit reverts create_plan_recurse() as static function. It means extension cannot have child node, even if it wants to add a custom-join logic. Please assume a simple

Re: Custom/Foreign-Join-APIs (Re: [HACKERS] [v9.5] Custom Plan API)

2015-05-09 11:21 GMT+09:00 Robert Haas robertmh...@gmail.com: On Fri, May 8, 2015 at 5:48 PM, Tom Lane t...@sss.pgh.pa.us wrote: ... btw, I just noticed something that had escaped me because it seems so obviously wrong that I had not even stopped to consider the possibility that the code was

Re: Custom/Foreign-Join-APIs (Re: [HACKERS] [v9.5] Custom Plan API)

2015-05-09 8:18 GMT+09:00 Kohei KaiGai kai...@kaigai.gr.jp: 2015-05-09 2:46 GMT+09:00 Tom Lane t...@sss.pgh.pa.us: Kouhei Kaigai kai...@ak.jp.nec.com writes: I've been trying to code-review this patch, because the documentation seemed several bricks shy of a load, and I find myself entirely

Re: Custom/Foreign-Join-APIs (Re: [HACKERS] [v9.5] Custom Plan API)

2015-05-09 8:32 GMT+09:00 Kohei KaiGai kai...@kaigai.gr.jp: 2015-05-09 3:51 GMT+09:00 Tom Lane t...@sss.pgh.pa.us: Robert Haas robertmh...@gmail.com writes: On Fri, May 8, 2015 at 1:46 PM, Tom Lane t...@sss.pgh.pa.us wrote: That's nice, but 9.5 feature freeze is only a week away. I don't have

Re: Custom/Foreign-Join-APIs (Re: [HACKERS] [v9.5] Custom Plan API)

2015-05-09 2:46 GMT+09:00 Tom Lane t...@sss.pgh.pa.us: Kouhei Kaigai kai...@ak.jp.nec.com writes: I've been trying to code-review this patch, because the documentation seemed several bricks shy of a load, and I find myself entirely confused by the fdw_ps_tlist and custom_ps_tlist fields.

Re: Custom/Foreign-Join-APIs (Re: [HACKERS] [v9.5] Custom Plan API)

2015-05-09 3:51 GMT+09:00 Tom Lane t...@sss.pgh.pa.us: Robert Haas robertmh...@gmail.com writes: On Fri, May 8, 2015 at 1:46 PM, Tom Lane t...@sss.pgh.pa.us wrote: That's nice, but 9.5 feature freeze is only a week away. I don't have a lot of confidence that this stuff is actually in a state

Re: Custom/Foreign-Join-APIs (Re: [HACKERS] [v9.5] Custom Plan API)

2015-05-09 6:48 GMT+09:00 Tom Lane t...@sss.pgh.pa.us: ... btw, I just noticed something that had escaped me because it seems so obviously wrong that I had not even stopped to consider the possibility that the code was doing what it's doing. To wit, that the planner supposes that two foreign

Re: [HACKERS] feature freeze and beta schedule

2015-05-02 1:37 GMT+09:00 Andres Freund and...@anarazel.de: * ctidscan as an example of custom-scan Hasn't really gotten sufficient review. = Move I have to agree. * Join pushdown support for foreign tables Hasn't gotten particularly much review yet. And it doesn't look entirely

Re: [HACKERS] One question about security label command

2015-05-01 7:40 GMT+09:00 Alvaro Herrera alvhe...@2ndquadrant.com: Kouhei Kaigai wrote: * Tom Lane (t...@sss.pgh.pa.us) wrote: The idea of making the regression test entirely independent of the system's policy would presumably solve this problem, so I'd kind of like to see progress on

Re: [HACKERS] One question about security label command

2015-03-12 1:27 GMT+09:00 Alvaro Herrera alvhe...@2ndquadrant.com: Robert Haas wrote: On Tue, Mar 10, 2015 at 6:58 PM, Kohei KaiGai kai...@kaigai.gr.jp wrote: ERRCODE_FEATURE_NOT_SUPPORTED is suitable error code here. Please see the attached one. Committed. I did not bother back-patching

Re: [HACKERS] One question about security label command

The attached patch revises error message when security label is specified on unsupported object. getObjectTypeDescription() may be better than oid of catalog. postgres=# SECURITY LABEL FOR selinux ON ROLE kaigai postgres-# IS 'system_u:object_r:unlabeled_t:s0'; ERROR: sepgsql provider does not

Re: [HACKERS] One question about security label command

ERRCODE_FEATURE_NOT_SUPPORTED is suitable error code here. Please see the attached one. Thanks, 2015-03-11 4:34 GMT+09:00 Robert Haas robertmh...@gmail.com: On Tue, Mar 10, 2015 at 9:41 AM, Alvaro Herrera alvhe...@2ndquadrant.com wrote: And perhaps make it an ereport also, with errcode etc.

Re: [HACKERS] Parallel Seq Scan

Amit and I had a long discussion about this on Friday while in Boston together. I previously argued that the master and the slave should be executing the same node, ParallelSeqScan. However, Amit argued persuasively that what the master is doing is really pretty different from what the

Re: [HACKERS] Commit fest 2015-12 enters money time

2015-02-16 12:25 GMT+09:00 Michael Paquier michael.paqu...@gmail.com: On Fri, Feb 13, 2015 at 10:06 AM, Michael Paquier michael.paqu...@gmail.com wrote: In order to move on to the next CF, I am going to go through all the remaining patches and update their status accordingly. And sorry for

Re: Custom/Foreign-Join-APIs (Re: [HACKERS] [v9.5] Custom Plan API)

2015-01-11 10:40 GMT+09:00 Jim Nasby jim.na...@bluetreble.com: On 1/9/15, 8:51 PM, Kohei KaiGai wrote: 2015-01-10 9:56 GMT+09:00 Jim Nasby jim.na...@bluetreble.com: On 1/9/15, 6:54 PM, Jim Nasby wrote: On 1/9/15, 6:44 PM, Petr Jelinek wrote: Yep, I had a same impression when I looked

Re: Custom/Foreign-Join-APIs (Re: [HACKERS] [v9.5] Custom Plan API)

2015-01-10 9:56 GMT+09:00 Jim Nasby jim.na...@bluetreble.com: On 1/9/15, 6:54 PM, Jim Nasby wrote: On 1/9/15, 6:44 PM, Petr Jelinek wrote: Yep, I had a same impression when I looked at the code first time, however, it is defined as below. Not a manner of custom-scan itself. /* *

Re: Custom/Foreign-Join-APIs (Re: [HACKERS] [v9.5] Custom Plan API)

2015-01-10 8:18 GMT+09:00 Jim Nasby jim.na...@bluetreble.com: On 1/6/15, 5:43 PM, Kouhei Kaigai wrote: scan_relid != InvalidOid Ideally, they should be OidIsValid(scan_relid) Scan.scanrelid is an index of range-tables list, not an object-id. So, InvalidOid or OidIsValid() are not a

[HACKERS] port/atomics/arch-*.h are missing from installation

I got the following error when I try to build my extension towards the latest master branch. Is the port/atomics/*.h files forgotten on make install? [kaigai@magro pg_strom]$ make gcc -O2 -Wall -Wmissing-prototypes -Wpointer-arith -Wdeclaration-after-statement -Wendif-labels

Re: [HACKERS] [v9.5] Custom Plan API

2014-09-29 20:26 GMT+09:00 Thom Brown t...@linux.com: On 29 September 2014 09:48, Kouhei Kaigai kai...@ak.jp.nec.com wrote: On Wed, Sep 17, 2014 at 7:40 PM, Kouhei Kaigai kai...@ak.jp.nec.com wrote: At this moment, I revised the above portion of the patches. create_custom_plan() was modified

Re: [HACKERS] [v9.5] Custom Plan API

2014-08-29 13:33 GMT-04:00 Robert Haas robertmh...@gmail.com: On Wed, Aug 27, 2014 at 6:51 PM, Kouhei Kaigai kai...@ak.jp.nec.com wrote: I'd like to follow this direction, and start stripping the DDL support. ...please make it so. The attached patch eliminates DDL support. Instead of the

Re: [HACKERS] [v9.5] Custom Plan API

2014-08-23 0:39 GMT+09:00 Robert Haas robertmh...@gmail.com: On Thu, Jul 17, 2014 at 3:38 PM, Tom Lane t...@sss.pgh.pa.us wrote: Alvaro Herrera alvhe...@2ndquadrant.com writes: I haven't followed this at all, but I just skimmed over it and noticed the CustomPlanMarkPos thingy; apologies if

Re: [HACKERS] RLS Design

2014-07-09 15:07 GMT+09:00 Stephen Frost sfr...@snowman.net: KaiGai, * Kohei KaiGai (kai...@kaigai.gr.jp) wrote: What I'd like to implement is adjustment of query like: SELECT * FROM t1 WHERE (x like '%abc%') AND (quals by built-in RLS) AND (quals by extension-1

Re: [HACKERS] RLS Design

2014-07-06 14:19 GMT+09:00 Stephen Frost sfr...@snowman.net: Kaigai, * Kouhei Kaigai (kai...@ak.jp.nec.com) wrote: Can you clarify where this is coming from..? It sounds like you're referring to an existing implementation and, if so, it'd be good to get more information on how that works

Re: [HACKERS] 9.5 CF1

Custom Plan API Shigeru Hanada has said he plans to post a design review soon. Any updates? Should this be moved to the next CF? Now I'm working to revise the patch according to his suggestion; will be completed within a couple of days. A few issues needs design-level suggestion from

Re: [HACKERS] No toast table for pg_shseclabel but for pg_seclabel

Here is no other reason than what Alvaro mentioned in the upthread. We intended to store security label of SELinux (less than 100bytes at most), so I didn't think it leads any problem actually. On the other hands, pg_seclabel was merged in another development cycle. We didn't have deep discussion

Re: [HACKERS] NUMA packaging and patch

Hello, Let me comment on this patch. It can be applied on head of the master branch, built and run regression test successfully. What this patch tries to do is quite simple and obvious. It suggests operating system to distribute physical pages to every numa nodes on allocation. One thing I

Re: [HACKERS] sepgsql: label regression test failed

2014-05-16 16:26 GMT+09:00 Heikki Linnakangas hlinnakan...@vmware.com: On 05/14/2014 07:33 AM, Sergey Muraviov wrote: I've got this compiler warning: relation.c: In function ‘sepgsql_relation_drop’: relation.c:472:25: warning: ‘tclass’ may be used uninitialized in this function

Re: [HACKERS] sepgsql: label regression test failed

I've got this compiler warning: relation.c: In function ‘sepgsql_relation_drop’: relation.c:472:25: warning: ‘tclass’ may be used uninitialized in this function [-Wmaybe-uninitialized] sepgsql_avc_check_perms(object, ^ 2013-12-25 0:34 GMT+04:00 Kohei KaiGai kai

Re: Custom Scan APIs (Re: [HACKERS] Custom Plan node)

Yeah. I'm still not exactly convinced that custom-scan will ever allow independent development of new plan types (which, with all due respect to Robert, is what it was being sold as last year in Ottawa). But I'm not opposed in principle to committing it, if we can find a way to have a

Re: [HACKERS] Creating tables for columns

I had implemented similar code on top of FDW API. https://github.com/kaigai/pg_strom/blob/old_cuda/utilcmds.c#L244 Probably, heap_create_with_catalog() is what you are finding out. 2014-03-21 22:57 GMT+09:00 Rajashree Mandaogane rajashree@gmail.com: We are working on a project in which we

[HACKERS] Best way to know frequency of column reference?

Hello, As people may know, I've implemented a relation cache mechanism on top of custom-plan interface, that holds contents of a particular columns only, thus it does not need to take storage access as long as user's query refers the columns on in-memory cache. The key factor of how this

Re: contrib/cache_scan (Re: [HACKERS] What's needed for cache-only table scan?)

2014-03-06 18:17 GMT+09:00 Haribabu Kommi kommi.harib...@gmail.com: On Tue, Mar 4, 2014 at 3:07 PM, Kouhei Kaigai kai...@ak.jp.nec.com wrote: 4. + cchunk = ccache_vacuum_tuple(ccache, ccache-root_chunk, ctid); + if (pchunk != NULL pchunk != cchunk) + ccache_merge_chunk(ccache,

Re: Custom Scan APIs (Re: [HACKERS] Custom Plan node)

2014-03-04 23:09 GMT+09:00 Robert Haas robertmh...@gmail.com: On Mon, Mar 3, 2014 at 5:15 PM, Stephen Frost sfr...@snowman.net wrote: As I mentioned up-thread, I'd really like to see FDW join push-down, FDW aggregate push-down, parallel query execution, and parallel remote-FDW execution and I

Re: Custom Scan APIs (Re: [HACKERS] Custom Plan node)

2014-03-04 23:10 GMT+09:00 Stephen Frost sfr...@snowman.net: The cache_scan module that I and Haribabu are discussing in another thread also might be a good demonstration for custom-scan interface, however, its code scale is a bit larger than ctidscan. That does sound interesting though I'm

Re: Custom Scan APIs (Re: [HACKERS] Custom Plan node)

2014-03-05 5:52 GMT+09:00 Stephen Frost sfr...@snowman.net: * Robert Haas (robertmh...@gmail.com) wrote: On Tue, Mar 4, 2014 at 2:34 PM, Stephen Frost sfr...@snowman.net wrote: Alright- so do you feel that the simple ctidscan use-case is a sufficient justification and example of how this can

Re: [HACKERS] Triggers on foreign tables

I tried to check the latest (v8) patch again, then could not find problem in your design change from the v7. As Noah pointed out, it uses per query-depth tuplestore being released on AfterTriggerEndSubXact. So, may I mark it as ready for committer? 2014-03-03 15:48 GMT+09:00 Ronan Dunklau

Re: Custom Scan APIs (Re: [HACKERS] Custom Plan node)

2014-03-01 22:38 GMT+09:00 Stephen Frost sfr...@snowman.net: KaiGai, * Kohei KaiGai (kai...@kaigai.gr.jp) wrote: BTW, this kind of discussion looks like a talk with a ghost because we cannot see the new interface according to the parallel execution right now, so we cannot have tangible

Re: Custom Scan APIs (Re: [HACKERS] Custom Plan node)

2014-03-02 9:51 GMT+09:00 Stephen Frost sfr...@snowman.net: KaiGai, * Kohei KaiGai (kai...@kaigai.gr.jp) wrote: Now we have two options for GPU programming: CUDA or OpenCL. Both of libraries and drivers are provided under the proprietary license, so it does not fit for the core

Re: Custom Scan APIs (Re: [HACKERS] Custom Plan node)

2014-03-02 10:29 GMT+09:00 Stephen Frost sfr...@snowman.net: * Kohei KaiGai (kai...@kaigai.gr.jp) wrote: As you mentioned, it is a headache for packagers, and does not make sense for us if packager disabled the feature that requires proprietary drivers. No, I disagree with that. I don't

Re: Custom Scan APIs (Re: [HACKERS] Custom Plan node)

2014-03-02 10:38 GMT+09:00 Robert Haas robertmh...@gmail.com: On Wed, Feb 26, 2014 at 10:23 AM, Stephen Frost sfr...@snowman.net wrote: * Kouhei Kaigai (kai...@ak.jp.nec.com) wrote: IIUC, his approach was integration of join-pushdown within FDW APIs, however, it does not mean the idea of

Re: Custom Scan APIs (Re: [HACKERS] Custom Plan node)

2014-03-01 0:36 GMT+09:00 Stephen Frost sfr...@snowman.net: * Kouhei Kaigai (kai...@ak.jp.nec.com) wrote: * Stephen Frost (sfr...@snowman.net) wrote: I don't see how you can be when there hasn't been any discussion that I've seen about how parallel query execution is going to change things

Re: Custom Scan APIs (Re: [HACKERS] Custom Plan node)

To: Kohei KaiGai Cc: Kaigai, Kouhei(海外, 浩平); Stephen Frost; Shigeru Hanada; Jim Mlodgenski; Robert Haas; Tom Lane; PgHacker; Peter Eisentraut Subject: Re: Custom Scan APIs (Re: [HACKERS] Custom Plan node) On Sun, Feb 23, 2014 at 6:54 PM, Kohei KaiGai kai...@kaigai.gr.jp wrote

Re: [HACKERS] New hook after raw parsing, before analyze

See the discussion of Custom-Scan API. https://commitfest.postgresql.org/action/patch_view?id=1282 I believe my third patch is what you really want to do... This rewritten query would be handled by the FDW table that I previously added to the catalog. The reason I want this new hook is that

Re: contrib/cache_scan (Re: [HACKERS] What's needed for cache-only table scan?)

2014-02-12 14:59 GMT+09:00 Haribabu Kommi kommi.harib...@gmail.com: I reviewed all the three patches. The first 1 and 2 core PostgreSQL patches are fine. And I have comments in the third patch related to cache scan. Thanks for your volunteering. 1. +# contrib/dbcache/Makefile Makefile

Re: [HACKERS] dynamic shared memory and locks

2014-02-08 4:52 GMT+09:00 Robert Haas robertmh...@gmail.com: On Tue, Jan 21, 2014 at 11:37 AM, Robert Haas robertmh...@gmail.com wrote: One idea I just had is to improve the dsm_toc module so that it can optionally set up a tranche of lwlocks for you, and provide some analogues of

Re: Custom Scan APIs (Re: [HACKERS] Custom Plan node)

2014-01-29 Christian Convey christian.con...@gmail.com: On Mon, Jan 27, 2014 at 7:14 PM, Kouhei Kaigai kai...@ak.jp.nec.com wrote: FDW's join pushing down is one of the valuable use-cases of this interface, but not all. As you might know, my motivation is to implement GPU acceleration

Re: [HACKERS] dynamic shared memory and locks

Isn't it necessary to have an interface to initialize LWLock structure being allocated on a dynamic shared memory segment? Even though LWLock structure is exposed at lwlock.h, we have no common way to initialize it. How about to have a following function? void InitLWLock(LWLock *lock) {

Re: [HACKERS] dynamic shared memory and locks

2014/1/23 Andres Freund and...@2ndquadrant.com: On 2014-01-23 23:03:40 +0900, Kohei KaiGai wrote: Isn't it necessary to have an interface to initialize LWLock structure being allocated on a dynamic shared memory segment? Even though LWLock structure is exposed at lwlock.h, we have no common

Re: [HACKERS] sepgsql: label regression test failed

different meaning by release. I'll make a patch. Please wait for a while. Thanks for your test reports. 2013/12/18 Sergey Muraviov sergey.k.murav...@gmail.com: # semodule -l | grep sepgslq sepgsql-regtest 1.07 Full list of modules is in attachment. 2013/12/18 Kohei KaiGai kai...@kaigai.gr.jp

Re: [HACKERS] sepgsql: label regression test failed

Could you show me semodule -l on your environment? I believe security policy has not been changed between F19 and F20... Thanks, 2013/12/18 Sergey Muraviov sergey.k.murav...@gmail.com: Hi I've tried to test postgres 9.3.2 and 9.4devel with selinux on Fedora 20 and met with a label regression

Re: [HACKERS] shared memory message queues

2013/12/6 Kohei KaiGai kai...@kaigai.gr.jp: What will happen if sender tries to send a large chunk that needs to be split into multiple sub-chunks and receiver concurrently detaches itself from the queue during the writes by sender? It seems to me the sender gets SHM_MQ_DETACHED and only

Re: [HACKERS] shared memory message queues

. The * handle must be for a background worker initialized with bgw_notify_pid * equal to our PID. Right now, that's all I can comment on. I'll do follow-up code reading in the weekend. Thanks, 2013/11/20 Robert Haas robertmh...@gmail.com: On Tue, Nov 19, 2013 at 12:33 AM, Kohei KaiGai

Re: Custom Scan APIs (Re: [HACKERS] Custom Plan node)

Hanada-san, Thanks for your reviewing, 2013/12/4 Shigeru Hanada shigeru.han...@gmail.com: I first reviewed postgres_fdw portion of the patches to learn the outline of Custom Plan. Wiki page is also a good textbook of the feature. I have some random comments about the basic design of Custom

Re: Custom Scan APIs (Re: [HACKERS] Custom Plan node)

Thanks for fixing many my carelessness. I didn't know seek was an irregular verb... Best regards, 2013/12/4 Shigeru Hanada shigeru.han...@gmail.com: 2013/11/29 Kohei KaiGai kai...@kaigai.gr.jp: I merged all the propositions from Jim. Thanks, it made the documentation quality better. Also, I

Re: [HACKERS] Status of FDW pushdowns

2013/11/21 Bruce Momjian br...@momjian.us: Where are we on the remaining possible pushdowns for foreign data wrappers, particularly the Postgres one? I know we do WHERE restriction pushdowns in 9.3, but what about join and aggregate pushdowns? Is anyone working on those? I know join

Re: [HACKERS] shared memory message queues

Hello, I tried to look at the patch #1 and #2 at first, but I shall rest of portion later. * basic checks All the patches (not only #1, #2) can be applied without any problem towards the latest master branch. Its build was succeeded with Werror. Regression test works fine on the core and

[HACKERS] What's needed for cache-only table scan?

Hello, It is a brief design proposal of a feature I'd like to implement on top of custom-scan APIs. Because it (probably) requires a few additional base features not only custom-scan, I'd like to see feedback from the hackers. The cache-only table scan, being in subject line, is an alternative

Re: [HACKERS] What's needed for cache-only table scan?

2013/11/12 Tom Lane t...@sss.pgh.pa.us: Kohei KaiGai kai...@kaigai.gr.jp writes: The cache-only table scan, being in subject line, is an alternative scan logic towards sequential scan if all the referenced columns are cached. This seems like a pretty dubious idea to me --- you're talking

Re: [HACKERS] What's needed for cache-only table scan?

2013/11/12 Robert Haas robertmh...@gmail.com: On Tue, Nov 12, 2013 at 9:45 AM, Kohei KaiGai kai...@kaigai.gr.jp wrote: It is a brief design proposal of a feature I'd like to implement on top of custom-scan APIs. Because it (probably) requires a few additional base features not only custom-scan

Re: [HACKERS] What's needed for cache-only table scan?

2013/11/12 Claudio Freire klaussfre...@gmail.com: On Tue, Nov 12, 2013 at 11:45 AM, Kohei KaiGai kai...@kaigai.gr.jp wrote: Hello, It is a brief design proposal of a feature I'd like to implement on top of custom-scan APIs. Because it (probably) requires a few additional base features

Re: [HACKERS] What's needed for cache-only table scan?

2013/11/12 Tom Lane t...@sss.pgh.pa.us: Kohei KaiGai kai...@kaigai.gr.jp writes: 2013/11/12 Tom Lane t...@sss.pgh.pa.us: There's no possible way you'll finish this for 9.4. Yes, I understand it is not possible to submit whole of the patch until CF3 deadline. So, I'd like to find out a way

Re: [HACKERS] What's needed for cache-only table scan?

2013/11/12 Tom Lane t...@sss.pgh.pa.us: Kohei KaiGai kai...@kaigai.gr.jp writes: So, are you thinking it is a feasible approach to focus on custom-scan APIs during the upcoming CF3, then table-caching feature as use-case of this APIs on CF4? Sure. If you work on this extension after CF3

[HACKERS] Re: Exempting superuser from row-security isn't enough. Run predicates as DEFINER?

Hi Craig, I'd like to vote the last options. It is a separate problem (or, might be specification), I think. According to the document of view, http://www.postgresql.org/docs/devel/static/sql-createview.html | Access to tables referenced in the view is determined by permissions of | the view

Re: Custom Scan APIs (Re: [HACKERS] Custom Plan node)

Hi, I tried to write up a wikipage to introduce how custom-scan works. https://wiki.postgresql.org/wiki/CustomScanAPI Any comments please. 2013/11/6 Kohei KaiGai kai...@kaigai.gr.jp: The attached patches provide a feature to implement custom scan node that allows extension to replace a part

Re: [HACKERS] [v9.4] row level security

2013/11/6 Craig Ringer cr...@2ndquadrant.com: On 11/05/2013 09:36 PM, Robert Haas wrote: I haven't studied this patch in detail, but I see why there's some unhappiness about that code: it's an RLS-specific kluge. Just shooting from the hip here, maybe we should attack the problem of making

Re: [HACKERS] How should row-security affects ON UPDATE RESTRICT / CASCADE ?

2013/10/29 Tom Lane t...@sss.pgh.pa.us: Craig Ringer cr...@2ndquadrant.com writes: During my testing of Kohei KaiGai's row-security patches I've been looking into how foreign keys should be and are handled. There are some interesting wrinkles around FK cascades, the rights under which FK

Re: [HACKERS] How should row-security affects ON UPDATE RESTRICT / CASCADE ?

2013/10/30 Craig Ringer cr...@2ndquadrant.com: On 10/30/2013 10:50 AM, Tom Lane wrote: Craig Ringer cr...@2ndquadrant.com writes: I'd kind of like to see FK constraints affected by RLS for non-superusers, at least as an option. I think that's a complete nonstarter. Aside from the fact that

Re: [HACKERS] [v9.4] row level security

Because of CF-2nd end, it was moved to the next commit-fest. In my personal opinion, it probably needs a few groundwork to get RLS commitable, prior to RLS itself. One is a correct handling towards the scenario that Korotkov pointed out. (How was it concluded?) I think it is a problem we can fix

  1   2   3   4   5   6   >