Yah if you had 2.5.3, you definitely didn’t need to bother with the create view part.
I still think you’ve got PostGIS installed in postgres database. Try doing this: \connect postgres DROP EXTENSION postgis; See if it drops – I bet it does. Then run your upgrade again. From: postgis-users [mailto:postgis-users-boun...@lists.osgeo.org] On Behalf Of Bo Guo Sent: Monday, December 23, 2019 5:50 PM To: postgis-users@lists.osgeo.org Subject: Re: [postgis-users] PostgreSQL 12 and PostGIS Regina, the saga goes on, but we are getting closer... First of all, I removed a stray "topology" schema from the "postgres" database. With that, I am certain that there is no other postgis installs on the Test Server. Then I ran the postgis extention upgrade in the targeted database (LB) and saw the current version is 2.5.3. Then I recreated the geometry_columns view by modifying the source you provided with the postgis schema prefix "postgis" so the view is not created in the "public" schema. Finally, I ran sudo pg_upgradecluster -m upgrade 11 main with the following console msg Stopping old cluster... Creating new PostgreSQL cluster 12/main ... /usr/lib/postgresql/12/bin/initdb -D /var/lib/postgresql/12/main --auth-local peer --auth-host md5 --encoding UTF8 --lc-collate en_US.UTF-8 --lc-ctype en_US.UTF-8 The files belonging to this database system will be owned by user "postgres". This user must also own the server process. The database cluster will be initialized with locale "en_US.UTF-8". The default text search configuration will be set to "english". Data page checksums are disabled. fixing permissions on existing directory /var/lib/postgresql/12/main ... ok creating subdirectories ... ok selecting dynamic shared memory implementation ... posix selecting default max_connections ... 100 selecting default shared_buffers ... 128MB selecting default time zone ... America/Phoenix creating configuration files ... ok running bootstrap script ... ok performing post-bootstrap initialization ... ok syncing data to disk ... ok Success. You can now start the database server using: pg_ctlcluster 12 main start Ver Cluster Port Status Owner Data directory Log file 12 main 5433 down postgres /var/lib/postgresql/12/main /var/log/postgresql/postgresql-12-main.log /usr/lib/postgresql/12/bin/pg_upgrade -b /usr/lib/postgresql/11/bin -B /usr/lib/postgresql/12/bin -p 5432 -P 5433 -d /etc/postgresql/11/main -D /etc/postgresql/12/main Finding the real data directory for the source cluster ok Finding the real data directory for the target cluster ok Performing Consistency Checks ----------------------------- Checking cluster versions ok Checking database user is the install user ok Checking database connection settings ok Checking for prepared transactions ok Checking for reg* data types in user tables ok Checking for contrib/isn with bigint-passing mismatch ok Checking for tables WITH OIDS ok Checking for invalid "sql_identifier" user columns ok Creating dump of global objects ok Creating dump of database schemas ok Checking for presence of required libraries ok Checking database user is the install user ok Checking for prepared transactions ok If pg_upgrade fails after this point, you must re-initdb the new cluster before continuing. Performing Upgrade ------------------ Analyzing all rows in the new cluster ok Freezing all rows in the new cluster ok Deleting files from new pg_xact ok Copying old pg_xact to new server ok Setting next transaction ID and epoch for new cluster ok Deleting files from new pg_multixact/offsets ok Copying old pg_multixact/offsets to new server ok Deleting files from new pg_multixact/members ok Copying old pg_multixact/members to new server ok Setting next multixact ID and offset for new cluster ok Resetting WAL archives ok Setting frozenxid and minmxid counters in new cluster ok Restoring global objects in the new cluster ok Restoring database schemas in the new cluster postgres *failure* Consult the last few lines of "pg_upgrade_dump_19530.log" for the probable cause of the failure. Failure, exiting Error: pg_upgrade run failed. Logfiles are in /var/log/postgresql/pg_upgradecluster-11-12-main.kFdl Error during cluster dumping, removing new cluster Cluster is not running. Error: could not stop old cluster, please do that manually The last few line of the dump log is different from the dump log I reported yesterday in the schema name - "public." vs "postgis." I am baffled why today why the installer wanted to install the view in "public" pg_restore: creating VIEW "public.geography_columns" pg_restore: creating VIEW "public.geometry_columns" pg_restore: while PROCESSING TOC: pg_restore: from TOC entry 204; 1259 64516 VIEW geometry_columns postgres pg_restore: error: could not execute query: ERROR: column s.consrc does not exist LINE 28: "replace"("split_part"("s"."consrc", ''''::"text... ^ HINT: Perhaps you meant to reference the column "s.conkey" or the column "s.conbin". Command was: -- For binary upgrade, must preserve pg_type oid SELECT pg_catalog.binary_upgrade_set_next_pg_type_oid('64518'::pg_catalog.oid); -- For binary upgrade, must preserve pg_type array oid SELECT pg_catalog.binary_upgrade_set_next_array_pg_type_oid('64517'::pg_catalog.oid); -- For binary upgrade, must preserve pg_class oids SELECT pg_catalog.binary_upgrade_set_next_heap_pg_class_oid('64516'::pg_catalog.oid); CREATE VIEW "public"."geometry_columns" AS SELECT ("current_database"())::character varying(256) AS "f_table_catalog", "n"."nspname" AS "f_table_schema", "c"."relname" AS "f_table_name", "a"."attname" AS "f_geometry_column", COALESCE("public"."postgis_typmod_dims"("a"."atttypmod"), "sn"."ndims", 2) AS "coord_dimension", COALESCE(NULLIF("public"."postgis_typmod_srid"("a"."atttypmod"), 0), "sr"."srid", 0) AS "srid", ("replace"("replace"(COALESCE(NULLIF("upper"("public"."postgis_typmod_type"("a"."atttypmod")), 'GEOMETRY'::"text"), "st"."t$ FROM (((((("pg_class" "c" JOIN "pg_attribute" "a" ON ((("a"."attrelid" = "c"."oid") AND (NOT "a"."attisdropped")))) JOIN "pg_namespace" "n" ON (("c"."relnamespace" = "n"."oid"))) JOIN "pg_type" "t" ON (("a"."atttypid" = "t"."oid"))) LEFT JOIN ( SELECT "s"."connamespace", "s"."conrelid", "s"."conkey", ("replace"("split_part"("s"."consrc", ' = '::"text", 2), ')'::"text", ''::"text"))::integer AS "ndims" FROM "pg_constraint" "s" WHERE ("s"."consrc" ~~* '%ndims(% = %'::"text")) "sn" ON ((("sn"."connamespace" = "n"."oid") AND ("sn"."conrelid" = "$ LEFT JOIN ( SELECT "s"."connamespace", "s"."conrelid", "s"."conkey", ("replace"("replace"("split_part"("s"."consrc", ' = '::"text", 2), ')'::"text", ''::"text"), '('::"text", ''::"text$ FROM "pg_constraint" "s" WHERE ("s"."consrc" ~~* '%srid(% = %'::"text")) "sr" ON ((("sr"."connamespace" = "n"."oid") AND ("sr"."conrelid" = "c$ WHERE (("c"."relkind" = ANY (ARRAY['r'::"char", 'v'::"char", 'm'::"char", 'f'::"char", 'p'::"char"])) AND (NOT ("c"."relname"$ -- For binary upgrade, handle extension membership the hard way ALTER EXTENSION "postgis" ADD VIEW "public"."geometry_columns"; On 12/23/19 12:26 PM, Regina Obe wrote: That looks good as it’s not showing the scripts procs need upgrade Message any more Do you by chance have more than one database with PostGIS installed? You’d need to run it on every database if you do. That’s the only thing I can think of that might be causing the issue. It is possible that the update didn’t happen in 2.5.2 and instead in 2.5.3, but I thought it was in 2.5.2. That said – you could overwrite the views in your 11 cluster with the patched ones. geometry_columns https://git.osgeo.org/gitea/postgis/postgis/src/tag/2.5.3/postgis/postgis.sql.in#L5608 (make sure to prefix with the schema you have postgis installed in so doesn’t try to create a new view) From: postgis-users [mailto:postgis-users-boun...@lists.osgeo.org] On Behalf Of Bo Guo Sent: Monday, December 23, 2019 10:54 AM To: postgis-users@lists.osgeo.org <mailto:postgis-users@lists.osgeo.org> Subject: Re: [postgis-users] PostgreSQL 12 and PostGIS Regina, Since the new cluster was never created so I just upgraded the extension by running your select statement which returned: POSTGIS="2.5.2 r17328" [EXTENSION] PGSQL="110" GEOS="3.7.1-CAPI-1.11.1 27a5e771" PROJ="Rel. 4.9.2, 08 September 2015" GDAL="GDAL 1.11.3, released 2015/09/16" LIBXML="2.9.3" LIBJSON="0.11.99" LIBPROTOBUF="1.2.1" TOPOLOGY RASTER Not sure if the postgis gets updated though, as my problem persisted with the same error message. Cheers, Bo On 12/22/19 11:03 PM, Regina Obe wrote: Okay this one is caused by a change in PostgreSQL 12 catalogs. Fixed in PostGIS 2.5.2 I believe - https://git.osgeo.org/gitea/postgis/postgis/raw/tag/2.5.2/NEWS (the pg_constraint change) So to upgrade, what you need to do is 1) Reinit your new cluster (as I think at this point your new cluster is in an unstable state) 2) Restart up your old cluster and run the upgrade on it - SELECT postgis_extensions_upgrade(); - that will bring it up to 2.5.2 and fix the views so they are compatible with 12. 3) Then do your migration again From: postgis-users [mailto:postgis-users-boun...@lists.osgeo.org] On Behalf Of Bo Guo Sent: Monday, December 23, 2019 12:47 AM To: postgis-users@lists.osgeo.org <mailto:postgis-users@lists.osgeo.org> Subject: Re: [postgis-users] PostgreSQL 12 and PostGIS Hi, Regina, After sucessful upgrade to the Dev server, I started upgrading the Test server which had the following version profile; select version(); PostgreSQL 11.3 (Ubuntu 11.3-1.pgdg16.04+1) on x86_64-pc-linux-gnu, compiled by gcc (Ubuntu 5.4.0-6ubuntu1~16.04.11) 5.4.0 20160609, 64-bit and select postgis_full_version(); POSTGIS="2.5.2 r17328" [EXTENSION] PGSQL="100" (procs need upgrade for use with "110") GEOS="3.7.1-CAPI-1.11.1 27a5e771" PROJ="Rel. 4.9.2, 08 September 2015" GDAL="GDAL 1.11.3, released 2015/09/16" LIBXML="2.9.3" LIBJSON="0.11.99" LIBPROTOBUF="1.2.1" (core procs from "2.5.1 r17027" need upgrade) TOPOLOGY (topology procs from "2.5.1 r17027" need upgrade) RASTER (raster procs from "2.5.1 r17027" need upgrade) However the pg_upgradecluster command failed for different reason as shown in the last few lines in the log file. I thought Dev and Test servers had been identical in terms of OS and Postgres/PostGIS install. Look like there was some difference... pg_restore: creating VIEW "postgis.geography_columns" pg_restore: creating VIEW "postgis.geometry_columns" pg_restore: while PROCESSING TOC: pg_restore: from TOC entry 496; 1259 54951 VIEW geometry_columns postgres pg_restore: error: could not execute query: ERROR: column s.consrc does not exist LINE 28: "replace"("split_part"("s"."consrc", ''''::"text... ^ HINT: Perhaps you meant to reference the column "s.conkey" or the column "s.conbin". Command was: -- For binary upgrade, must preserve pg_type oid SELECT pg_catalog.binary_upgrade_set_next_pg_type_oid('54953'::pg_catalog.oid); -- For binary upgrade, must preserve pg_type array oid SELECT pg_catalog.binary_upgrade_set_next_array_pg_type_oid('54952'::pg_catalog.oid); -- For binary upgrade, must preserve pg_class oids SELECT pg_catalog.binary_upgrade_set_next_heap_pg_class_oid('54951'::pg_catalog.oid); CREATE VIEW "postgis"."geometry_columns" AS SELECT ("current_database"())::character varying(256) AS "f_table_catalog", "n"."nspname" AS "f_table_schema", "c"."relname" AS "f_table_name", "a"."attname" AS "f_geometry_column", COALESCE("postgis"."postgis_typmod_dims"("a"."atttypmod"), "sn"."ndims", 2) AS "coord_dimension", COALESCE(NULLIF("postgis"."postgis_typmod_srid"("a"."atttypmod"), 0), "sr"."srid", 0) AS "srid", ("replace"("replace"(COALESCE(NULLIF("upper"("postgis"."postgis_typmod_type"("a"."atttypmod")), 'GEOMETRY'::"text"), "st"."$ FROM (((((("pg_class" "c" JOIN "pg_attribute" "a" ON ((("a"."attrelid" = "c"."oid") AND (NOT "a"."attisdropped")))) JOIN "pg_namespace" "n" ON (("c"."relnamespace" = "n"."oid"))) JOIN "pg_type" "t" ON (("a"."atttypid" = "t"."oid"))) LEFT JOIN ( SELECT "s"."connamespace", "s"."conrelid", "s"."conkey", "replace"("split_part"("s"."consrc", ''''::"text", 2), ')'::"text", ''::"text") AS "type" FROM "pg_constraint" "s" WHERE ("s"."consrc" ~~* '%geometrytype(% = %'::"text")) "st" ON ((("st"."connamespace" = "n"."oid") AND ("st"."conrel$ LEFT JOIN ( SELECT "s"."connamespace", "s"."conrelid", "s"."conkey", ("replace"("split_part"("s"."consrc", ' = '::"text", 2), ')'::"text", ''::"text"))::integer AS "ndims" FROM "pg_constraint" "s" WHERE ("s"."consrc" ~~* '%ndims(% = %'::"text")) "sn" ON ((("sn"."connamespace" = "n"."oid") AND ("sn"."conrelid" = "$ LEFT JOIN ( SELECT "s"."connamespace", "s"."conrelid", "s"."conkey", ("replace"("replace"("split_part"("s"."consrc", ' = '::"text", 2), ')'::"text", ''::"text"), '('::"text", ''::"text$ FROM "pg_constraint" "s" WHERE ("s"."consrc" ~~* '%srid(% = %'::"text")) "sr" ON ((("sr"."connamespace" = "n"."oid") AND ("sr"."conrelid" = "c$ WHERE (("c"."relkind" = ANY (ARRAY['r'::"char", 'v'::"char", 'm'::"char", 'f'::"char", 'p'::"char"])) AND (NOT ("c"."relname"$ -- For binary upgrade, handle extension membership the hard way ALTER EXTENSION "postgis" ADD VIEW "postgis"."geometry_columns"; On 12/22/19 9:11 PM, Bo Guo wrote: Yeh! Thanks you, Regina! On 12/22/19 8:54 PM, Regina Obe wrote: Okay I ran into that issue too. It happens if you have PostGIS not installed in public. I have the issue ticketed here – I thought I had fixed this already in 3.0.1 (not yet released yet), but evidentally I haven’t or forgot to close this ticket. https://trac.osgeo.org/postgis/ticket/4555 The workaround is to do this: CREATE EXTENSION postgis_raster FROM unpackaged VERSION "3.0.0" SCHEMA <schema where you installed postgis>; From: postgis-users [mailto:postgis-users-boun...@lists.osgeo.org] On Behalf Of Bo Guo Sent: Sunday, December 22, 2019 10:36 PM To: postgis-users@lists.osgeo.org <mailto:postgis-users@lists.osgeo.org> Subject: Re: [postgis-users] PostgreSQL 12 and PostGIS Thanks, Regina! I am running PostgeSQL 12 now! However, when I ran SELECT PostGIS_Extensions_Upgrade(); the second time, I have the following msg. NOTICE: Extension postgis_sfcgal is not available or not packagable for some reason NOTICE: Packaging extension postgis_raster WARNING: 'postgis.gdal_datapath' is already set and cannot be changed until you reconnect WARNING: 'postgis.gdal_enabled_drivers' is already set and cannot be changed until you reconnect WARNING: 'postgis.enable_outdb_rasters' is already set and cannot be changed until you reconnect ERROR: function public.st_srid(geometry) does not exist LINE 1: ..._makeemptyraster($1, $2, $3, $4, $5, -($5), 0, 0, public.ST_... ^ HINT: No function matches the given name and argument types. You might need to add explicit type casts. QUERY: SELECT public.ST_makeemptyraster($1, $2, $3, $4, $5, -($5), 0, 0, public.ST_SRID('POINT(0 0)'::geometry)) CONTEXT: SQL statement "CREATE EXTENSION postgis_raster FROM unpackaged" PL/pgSQL function postgis_extensions_upgrade() line 48 at EXECUTE SQL state: 42883 On 12/22/19 8:09 PM, Regina Obe wrote: NO NO don’t do that. Those set of libraries aren’t compatible with each other. The PostGIS 3.0 and 2.5 from 12 are compatible with each other however. So What you want to do is cp /usr/lib/postgresql/12/lib/postgis-3.so /usr/lib/postgresql/12/lib/postgis-2.5.so cp /usr/lib/postgresql/12/lib/postgis_raster-3.so /usr/lib/postgresql/12/lib/rtpostgis-2.5.so cp /usr/lib/postgresql/12/lib/postgis_topology-3.so /usr/lib/postgresql/12/lib/postgis_topology-2.5.so Then after the upgrade in each of your databases run: SELECT PostGIS_Extensions_Upgrade(); And then run it again to rebundle the raster into it’s own extension SELECT PostGIS_Extensions_Upgrade(); Then if you don’t need raster, you can DROP EXTENSION postgis_raster; Once you are done upgrading your databases, you can delete thr *-2.5.so files you created in the 12 cluster. From: postgis-users [mailto:postgis-users-boun...@lists.osgeo.org] On Behalf Of Bo Guo Sent: Sunday, December 22, 2019 10:01 PM To: postgis-users@lists.osgeo.org <mailto:postgis-users@lists.osgeo.org> Subject: Re: [postgis-users] PostgreSQL 12 and PostGIS Thanks, Regina, I copied the three 2.5 lib files from /usr/lib/postgresql/11/lib to /usr/lib/postgresql/12/lib: guob@yuma:/usr/lib/postgresql/12/lib$ ls -al *post* -rw-r--r-- 1 root root 456832 Dec 22 19:49 postgis-2.5.so -rw-r--r-- 1 root root 1351536 Oct 28 21:24 postgis-3.so -rw-r--r-- 1 root root 847424 Oct 28 21:24 postgis_raster-3.so -rw-r--r-- 1 root root 364224 Dec 22 19:49 postgis_topology-2.5.so -rw-r--r-- 1 root root 569152 Oct 28 21:24 postgis_topology-3.so -rw-r--r-- 1 root root 100264 Nov 12 03:33 postgres_fdw.so -rw-r--r-- 1 root root 399136 Dec 22 19:50 rtpostgis-2.5.so However, the three lib files are still in the loadable_libraries.txt file. Bo On 12/22/19 7:42 PM, Regina Obe wrote: Bo, Do you have the postgis-2.5.so, rtpostgis-2.5.so, postgis_topology-2.5.so files in /usr/lib/postgresql/11/lib And /usr/lib/postgresql/12/lib Those are the files it's complaining about. From: postgis-users [mailto:postgis-users-boun...@lists.osgeo.org] On Behalf Of Bo Guo Sent: Sunday, December 22, 2019 9:16 PM To: postgis-users@lists.osgeo.org <mailto:postgis-users@lists.osgeo.org> Subject: Re: [postgis-users] PostgreSQL 12 and PostGIS Regina and Stefan, I might have run into a similar issues today as I was trying to upgrade PostgreSQL 11 w/ PostGIS 2.5 to PostgreSQL 12 w/ PostGIS 3.0. The pg_upgradecluster command (sudo pg_upgradecluster -m upgrade 11 main) failed its check for the following required libraries: could not load library "$libdir/postgis-2.5": ERROR: could not access file "$libdir/postgis-2.5": No such file or directory could not load library "$libdir/rtpostgis-2.5": ERROR: could not access file "$libdir/rtpostgis-2.5": No such file or directory could not load library "$libdir/postgis_topology-2.5": ERROR: could not access file "$libdir/postgis_topology-2.5": No such file or directory I have postgis-2.5 in the /usr/share/postgresql/11/contrib/ folder AND /usr/share/postgresql/12/contrib/ folder. I also have postgis-3.0 under /usr/share/postgresql/12/contrib/. Thanks for your help! Bo Gistic Research, Inc. On 10/4/19 8:16 AM, Regina Obe wrote: Stefan, Which distro do you get your PostgreSQL 12 from. I’m assuming apt.postgresql.org If so you should report on their mailing list, as that would be a packaging bug,not a PostGIS one and no one on the PostGIS project is on the apt team. https://www.postgresql.org/list/pgsql-pkg-debian/ Thanks, Regina From: postgis-users [mailto:postgis-users-boun...@lists.osgeo.org] On Behalf Of Stefan Wolf Sent: Friday, October 4, 2019 6:19 AM To: postgis-users@lists.osgeo.org <mailto:postgis-users@lists.osgeo.org> Subject: [postgis-users] PostgreSQL 12 and PostGIS Today I’ve installed the brand new PostgreSQL 12 on Ubuntu 18.04 “apt-get install postgis” will install PostGIS 2.5.2, but the PATH is wrong: /usr/share/postgresql/11/… So CREATE EXTENSION postgis will fail. Greetings from Berlin -Stefan Wolf- _______________________________________________ postgis-users mailing list postgis-users@lists.osgeo.org <mailto:postgis-users@lists.osgeo.org> https://lists.osgeo.org/mailman/listinfo/postgis-users _______________________________________________ postgis-users mailing list postgis-users@lists.osgeo.org <mailto:postgis-users@lists.osgeo.org> https://lists.osgeo.org/mailman/listinfo/postgis-users -- Regards, Bo Guo, PhD, PE President Gistic Research, Inc. 2033 E Warner Rd Ste 105 Tempe, AZ 85284 www.gisticinc.com <http://www.gisticinc.com> www.youtube.com/linearbench <http://www.youtube.com/linearbench> Office: 480-656-9962 Cell: 602-570-4697 _______________________________________________ postgis-users mailing list postgis-users@lists.osgeo.org <mailto:postgis-users@lists.osgeo.org> https://lists.osgeo.org/mailman/listinfo/postgis-users -- Regards, Bo Guo, PhD, PE President Gistic Research, Inc. 2033 E Warner Rd Ste 105 Tempe, AZ 85284 www.gisticinc.com <http://www.gisticinc.com> www.youtube.com/linearbench <http://www.youtube.com/linearbench> Office: 480-656-9962 Cell: 602-570-4697 _______________________________________________ postgis-users mailing list postgis-users@lists.osgeo.org <mailto:postgis-users@lists.osgeo.org> https://lists.osgeo.org/mailman/listinfo/postgis-users -- Regards, Bo Guo, PhD, PE President Gistic Research, Inc. 2033 E Warner Rd Ste 105 Tempe, AZ 85284 www.gisticinc.com <http://www.gisticinc.com> www.youtube.com/linearbench <http://www.youtube.com/linearbench> Office: 480-656-9962 Cell: 602-570-4697 -- Regards, Bo Guo, PhD, PE President Gistic Research, Inc. 2033 E Warner Rd Ste 105 Tempe, AZ 85284 www.gisticinc.com <http://www.gisticinc.com> www.youtube.com/linearbench <http://www.youtube.com/linearbench> Office: 480-656-9962 Cell: 602-570-4697 _______________________________________________ postgis-users mailing list postgis-users@lists.osgeo.org <mailto:postgis-users@lists.osgeo.org> https://lists.osgeo.org/mailman/listinfo/postgis-users _______________________________________________ postgis-users mailing list postgis-users@lists.osgeo.org <mailto:postgis-users@lists.osgeo.org> https://lists.osgeo.org/mailman/listinfo/postgis-users -- Regards, Bo Guo, PhD, PE President Gistic Research, Inc. 2033 E Warner Rd Ste 105 Tempe, AZ 85284 www.gisticinc.com <http://www.gisticinc.com> www.youtube.com/linearbench <http://www.youtube.com/linearbench> Office: 480-656-9962 Cell: 602-570-4697
_______________________________________________ postgis-users mailing list postgis-users@lists.osgeo.org https://lists.osgeo.org/mailman/listinfo/postgis-users
