Re: Considerable performance downgrade of v11 and 12 on Windows

2019-12-02 Thread Eugene Podshivalov
I have managed to split the 365GB file into 2GB chunks with the help of 'split' unix utility in mingw shell like so split -C 2GB ways.txt Then I imported the files into a clean database with the help of the following cmd command for /f %f in ('dir /b') do psql -U postgres -w -d osm -t -c "set clien

Re: Considerable performance downgrade of v11 and 12 on Windows

2019-12-02 Thread Laurenz Albe
On Sat, 2019-11-30 at 22:47 +0300, Eugene Podshivalov wrote: > It sounds strange but the "type" is indeed impacting the overall > performance somehow. > I've just tried to execute the following sequence of commands on a > fresh new database with PostreSQL v10 and both the copy and primary > key com

Re: Considerable performance downgrade of v11 and 12 on Windows

2019-11-30 Thread Eugene Podshivalov
It sounds strange but the "type" is indeed impacting the overall performance somehow. I've just tried to execute the following sequence of commands on a fresh new database with PostreSQL v10 and both the copy and primary key commands performed as slow as in v11 and 12. SET synchronous_commit TO OF

Re: Considerable performance downgrade of v11 and 12 on Windows

2019-11-29 Thread Eugene Podshivalov
Laurenz, There is no way to run copy without the "type" on v11. See this thread https://www.postgresql.org/message-id/CAKHmqNCfTMM6%3DPqc6RUMEQ_2BPfo5KGGG-0fzRXZCVooo%3DwdNA%40mail.gmail.com My machine is running on NVMe disks, so the I/O subsystem very strong. The 100% overload is not constant bu

Re: Considerable performance downgrade of v11 and 12 on Windows

2019-11-29 Thread Laurenz Albe
On Fri, 2019-11-29 at 13:04 +0300, Eugene Podshivalov wrote: > I'm using PostgreSQL on Windows for Planet OSM database and have > noticed considirable decrease in performance when upgrading from v10 > to 11 or 12. Here are the details of the experiment I conducted trying > to figure out what is cau

Re: Considerable performance downgrade of v11 and 12 on Windows

2019-11-29 Thread Eugene Podshivalov
I don't think so. Why adding primary key shows the same downgraded performance as well then? пт, 29 нояб. 2019 г. в 13:37, Thomas Kellerer : > > Eugene Podshivalov schrieb am 29.11.2019 um 11:04: > > Imported ways data from a file and added a primary key. > > > > SET synchronous_commit TO OFF; > >

Re: Considerable performance downgrade of v11 and 12 on Windows

2019-11-29 Thread Thomas Kellerer
Eugene Podshivalov schrieb am 29.11.2019 um 11:04: > Imported ways data from a file and added a primary key. > > SET synchronous_commit TO OFF; > COPY ways FROM 'E:\ways.txt'; > ... > COPY ways FROM PROGRAM 'cmd /c "type E:\ways.txt"'; Those two commands are not doing the same thing - the piping

Considerable performance downgrade of v11 and 12 on Windows

2019-11-29 Thread Eugene Podshivalov
Hi, I'm using PostgreSQL on Windows for Planet OSM database and have noticed considirable decrease in performance when upgrading from v10 to 11 or 12. Here are the details of the experiment I conducted trying to figure out what is causing the issue. Installed PostgreSQL 10 from scratch. Created a