Re: [Qgis-user] QGIS + PostGIS in production environment

[Cap Diniz]

Thanks for the responses so far!

Adding a bit more information.

We are using Dell PowerEdge-R430 [1] for the PostGIS server with OS Debian
8.7 on a 1gigabit network. For each topographic sheet we use one database,
this means that we have hundreds of databases in production. We divide the
databases in different ports by project, just for organization, I don't
know if that impacts performance.

As for clients we usually use Debian 8.4, Windows 7 or Windows 10 with
latest LTR QGIS. The clients are i7, 8gb RAM, 1gb video card.

We didn't do any tuning in PostgreSQL, I will try out the suggestions. As
configuration goes, we just disabled the Auto Vacuum, and run it by a
script at night (when no one is connected) along with backup.



Then main problem that we are facing is slow saving time at peak hours
(when about 50 clients are digitizing in different databases). Sometimes
can take up to 1 minute to save all layers. We work with autosave in QGIS
that saves every 5 minutes, so slow saving time is not ideal.
The reason that we save so much is that sometimes we have errors while
saving, such as null geometries, that we cannot fix and we have to discard
the edits. (also we have other errors that usually we discard the edits).



[1] https://i.dell.com/sites/doccontent/shared-content/data-
sheets/en/Documents/Dell-PowerEdge-R430-Spec-Sheet.pdf



Thanks Mike, I sent an email there also.


Regards,
Felipe Diniz

On Thu, Jun 15, 2017 at 2:53 PM, Michael Treglia  wrote:

> The other thing I might suggest is writing the postgis-users list to get
> any input from there, especially on the database end of things:
> https://lists.osgeo.org/mailman/listinfo/postgis-users
>
> Hope that helps!
> Cheers,
> mike
>
> On Thu, Jun 15, 2017 at 1:49 PM, Árni Geirsson  wrote:
>
>> Hello Felipe
>> I use these systems but not at this large scale and can therefore
>> probably not help you, but I find the question interesting. Could you be
>> more specific about the performance and reliability bottlenecks that you
>> would like to address? Have you experienced problems as the number of users
>> grows?
>>
>> Árni
>>
>>
>> Árni Geirsson
>> *Alta ehf* // +354 582 5000 <+354%20582%205000> // +354 897 9549
>> <+354%20897%209549>
>>
>> On 15 June 2017 at 17:25, Cap Diniz  wrote:
>>
>>> Hello,
>>>
>>> I am from the Cartographic Production Department from the Brazilian
>>> Army, and we are trying to migrate from ArcGIS to QGIS+PostGIS.
>>>
>>> We are currently using QGIS 2.14.15, and we mostly do data digitizing
>>> over an orthoimage. We have about 50 simultaneous users in a single PostGIS
>>> server, but in different databases.
>>>
>>> I would like to know if there are any tips to improve performance and
>>> QGIS reliability, such as tuning PostgreSQL, operating systems, hardware
>>> recommendations, or QGIS specifics.
>>>
>>>
>>> Regards,
>>> Felipe Diniz
>>>
>>> ___
>>> Qgis-user mailing list
>>> Qgis-user@lists.osgeo.org
>>> List info: https://lists.osgeo.org/mailman/listinfo/qgis-user
>>> Unsubscribe: https://lists.osgeo.org/mailman/listinfo/qgis-user
>>>
>>
>>
>> ___
>> Qgis-user mailing list
>> Qgis-user@lists.osgeo.org
>> List info: https://lists.osgeo.org/mailman/listinfo/qgis-user
>> Unsubscribe: https://lists.osgeo.org/mailman/listinfo/qgis-user
>>
>
>
___
Qgis-user mailing list
Qgis-user@lists.osgeo.org
List info: https://lists.osgeo.org/mailman/listinfo/qgis-user
Unsubscribe: https://lists.osgeo.org/mailman/listinfo/qgis-user

Re: [Qgis-user] QGIS + PostGIS in production environment

[Michael Treglia]

The other thing I might suggest is writing the postgis-users list to get
any input from there, especially on the database end of things:
https://lists.osgeo.org/mailman/listinfo/postgis-users

Hope that helps!
Cheers,
mike

On Thu, Jun 15, 2017 at 1:49 PM, Árni Geirsson  wrote:

> Hello Felipe
> I use these systems but not at this large scale and can therefore probably
> not help you, but I find the question interesting. Could you be more
> specific about the performance and reliability bottlenecks that you would
> like to address? Have you experienced problems as the number of users grows?
>
> Árni
>
>
> Árni Geirsson
> *Alta ehf* // +354 582 5000 <+354%20582%205000> // +354 897 9549
> <+354%20897%209549>
>
> On 15 June 2017 at 17:25, Cap Diniz  wrote:
>
>> Hello,
>>
>> I am from the Cartographic Production Department from the Brazilian Army,
>> and we are trying to migrate from ArcGIS to QGIS+PostGIS.
>>
>> We are currently using QGIS 2.14.15, and we mostly do data digitizing
>> over an orthoimage. We have about 50 simultaneous users in a single PostGIS
>> server, but in different databases.
>>
>> I would like to know if there are any tips to improve performance and
>> QGIS reliability, such as tuning PostgreSQL, operating systems, hardware
>> recommendations, or QGIS specifics.
>>
>>
>> Regards,
>> Felipe Diniz
>>
>> ___
>> Qgis-user mailing list
>> Qgis-user@lists.osgeo.org
>> List info: https://lists.osgeo.org/mailman/listinfo/qgis-user
>> Unsubscribe: https://lists.osgeo.org/mailman/listinfo/qgis-user
>>
>
>
> ___
> Qgis-user mailing list
> Qgis-user@lists.osgeo.org
> List info: https://lists.osgeo.org/mailman/listinfo/qgis-user
> Unsubscribe: https://lists.osgeo.org/mailman/listinfo/qgis-user
>
___
Qgis-user mailing list
Qgis-user@lists.osgeo.org
List info: https://lists.osgeo.org/mailman/listinfo/qgis-user
Unsubscribe: https://lists.osgeo.org/mailman/listinfo/qgis-user

Re: [Qgis-user] QGIS + PostGIS in production environment

[Árni Geirsson]

Hello Felipe
I use these systems but not at this large scale and can therefore probably
not help you, but I find the question interesting. Could you be more
specific about the performance and reliability bottlenecks that you would
like to address? Have you experienced problems as the number of users grows?

Árni


Árni Geirsson
*Alta ehf* // +354 582 5000 // +354 897 9549

On 15 June 2017 at 17:25, Cap Diniz  wrote:

> Hello,
>
> I am from the Cartographic Production Department from the Brazilian Army,
> and we are trying to migrate from ArcGIS to QGIS+PostGIS.
>
> We are currently using QGIS 2.14.15, and we mostly do data digitizing over
> an orthoimage. We have about 50 simultaneous users in a single PostGIS
> server, but in different databases.
>
> I would like to know if there are any tips to improve performance and QGIS
> reliability, such as tuning PostgreSQL, operating systems, hardware
> recommendations, or QGIS specifics.
>
>
> Regards,
> Felipe Diniz
>
> ___
> Qgis-user mailing list
> Qgis-user@lists.osgeo.org
> List info: https://lists.osgeo.org/mailman/listinfo/qgis-user
> Unsubscribe: https://lists.osgeo.org/mailman/listinfo/qgis-user
>
___
Qgis-user mailing list
Qgis-user@lists.osgeo.org
List info: https://lists.osgeo.org/mailman/listinfo/qgis-user
Unsubscribe: https://lists.osgeo.org/mailman/listinfo/qgis-user