Re: [postgis-users] parallel spatial calculation

[David Haynes]

Thanks for the input.

My understanding of the parallel capabilities of PostgreSQL is somewhat
limited, but I believe the workers are done at the query level, without
partitioning. This likely result in different query performances compared
to a dataset that is partitioned. Also, the partitions scheme used on
spatial dataset can have a great effect on the performance of the spatial
query that you run. It is something I'm very interested in and I didn't
know if anyone in this group was working in this area.


On Thu, Aug 23, 2018 at 7:15 AM Cedric Duprez  wrote:

> Hi David,
>
> I remember two good posts on Paul Ramsey’s blog explaining query
> parallelism and PostGIS :
>
>- http://blog.cleverelephant.ca/2017/10/parallel-postgis-2.html
>- http://blog.cleverelephant.ca/2017/11/parallel-postgis-2A.html
>
> I hope it helps you.
>
> Regards.
>
> Le 22/08/2018 à 22:09, David Haynes a écrit :
>
> Hello,
>
> I have a few questions regarding parallel spatial calculations.
>
> Since PostgreSQL 10 is allowing for multiple workers is there any work on
> allowing parallel spatial calculations? Is there anyone potentially looking
> at VoltDB as a potential place for testing any parallel spatial
> calculations. VoltDB's spatial capabilities are completely undeveloped but
> it might be a place to start.
>
>
> ___
> postgis-users mailing 
> listpostgis-users@lists.osgeo.orghttps://lists.osgeo.org/mailman/listinfo/postgis-users
>
> ​
> ___
> postgis-users mailing list
> postgis-users@lists.osgeo.org
> https://lists.osgeo.org/mailman/listinfo/postgis-users
___
postgis-users mailing list
postgis-users@lists.osgeo.org
https://lists.osgeo.org/mailman/listinfo/postgis-users

Re: [postgis-users] parallel spatial calculation

[Cedric Duprez]

Hi David,

I remember two good posts on Paul Ramsey’s blog explaining query parallelism 
and PostGIS :

  *   http://blog.cleverelephant.ca/2017/10/parallel-postgis-2.html
  *   http://blog.cleverelephant.ca/2017/11/parallel-postgis-2A.html

I hope it helps you.

Regards.

Le 22/08/2018 à 22:09, David Haynes a écrit :

Hello,

I have a few questions regarding parallel spatial calculations.

Since PostgreSQL 10 is allowing for multiple workers is there any work on 
allowing parallel spatial calculations? Is there anyone potentially looking at 
VoltDB as a potential place for testing any parallel spatial calculations. 
VoltDB's spatial capabilities are completely undeveloped but it might be a 
place to start.



___
postgis-users mailing list
postgis-users@lists.osgeo.org
https://lists.osgeo.org/mailman/listinfo/postgis-users

​
___
postgis-users mailing list
postgis-users@lists.osgeo.org
https://lists.osgeo.org/mailman/listinfo/postgis-users

Re: [postgis-users] parallel spatial calculation

[Regina Obe]

Not sure what you mean by parallel spatial calculations.

 

In theory most functions in PostGIS can run in parallel assuming they are not 
restricted by the plan with the exception of most aggregates ( the MVT and 
ST_MemUnion (which no one uses) and I think possible ST_Extent (have to double 
check that) are the only aggregates that support parallel.  Even those are 
allowed in subplan nodes.  Most functions in PostGIS are marked as safe for 
parallel so should be able to run in parallel fine.

 

But PostgreSQL itself has many restrictions on parallelism – e.g. the cost, the 
number of tuples before it considers parallel, update/insert statements can't 
use parallel.  These restrictions are slowly being lifted with each new version 
e.g. 11 supports more kinds of plan nodes and allows CREATE TABLE AS to run in 
parallel.

 

Thanks,

Regina

 

From: postgis-users [mailto:postgis-users-boun...@lists.osgeo.org] On Behalf Of 
David Haynes
Sent: Wednesday, August 22, 2018 4:10 PM
To: postgis-users@lists.osgeo.org
Subject: [postgis-users] parallel spatial calculation

 

Hello,

 

I have a few questions regarding parallel spatial calculations.

 

Since PostgreSQL 10 is allowing for multiple workers is there any work on 
allowing parallel spatial calculations? Is there anyone potentially looking at 
VoltDB as a potential place for testing any parallel spatial calculations. 
VoltDB's spatial capabilities are completely undeveloped but it might be a 
place to start.

___
postgis-users mailing list
postgis-users@lists.osgeo.org
https://lists.osgeo.org/mailman/listinfo/postgis-users

[postgis-users] parallel spatial calculation

[David Haynes]

Hello,

I have a few questions regarding parallel spatial calculations.

Since PostgreSQL 10 is allowing for multiple workers is there any work on
allowing parallel spatial calculations? Is there anyone potentially looking
at VoltDB as a potential place for testing any parallel spatial
calculations. VoltDB's spatial capabilities are completely undeveloped but
it might be a place to start.
___
postgis-users mailing list
postgis-users@lists.osgeo.org
https://lists.osgeo.org/mailman/listinfo/postgis-users