bchapuis commented on issue #726: URL: https://github.com/apache/incubator-baremaps/issues/726#issuecomment-1691328443
I just did a planet export and it now takes a reasonable time to generate the mbtiles (2.5 days for 132G). Here is an excerpt of the log: ``` [INFO ] 2023-08-22 20:08:04.435 [main] PostgresUtils - HikariConfig: com.zaxxer.hikari.HikariConfig@181b8c4b [INFO ] 2023-08-22 20:08:04.437 [main] HikariDataSource - baremaps - Starting... [INFO ] 2023-08-22 20:08:04.590 [main] HikariPool - baremaps - Added connection org.postgresql.jdbc.PgConnection@71ed560f [INFO ] 2023-08-22 20:08:04.590 [main] HikariDataSource - baremaps - Start completed. [INFO ] 2023-08-22 20:08:04.643 [main] HikariDataSource - HikariPool-1 - Starting... [INFO ] 2023-08-22 20:08:04.678 [main] HikariPool - HikariPool-1 - Added connection org.sqlite.jdbc4.JDBC4Connection@6c8f60f3 [INFO ] 2023-08-22 20:08:04.678 [main] HikariDataSource - HikariPool-1 - Start completed. [INFO ] 2023-08-22 20:08:09.722 [ForkJoinPool.commonPool-worker-2] ProgressLogger - 0.0% ... [INFO ] 2023-08-24 05:32:29.550 [ForkJoinPool.commonPool-worker-30] ProgressLogger - 99.96% [INFO ] 2023-08-24 05:32:34.550 [ForkJoinPool.commonPool-worker-20] ProgressLogger - 99.97% [INFO ] 2023-08-24 05:32:39.550 [ForkJoinPool.commonPool-worker-18] ProgressLogger - 99.98% [INFO ] 2023-08-24 05:32:44.550 [ForkJoinPool.commonPool-worker-20] ProgressLogger - 99.99% [INFO ] 2023-08-24 05:32:49.550 [ForkJoinPool.commonPool-worker-24] ProgressLogger - 99.99% [INFO ] 2023-08-24 05:32:53.378 [ForkJoinPool.commonPool-worker-30] ProgressLogger - 100.0% ``` The issue was related to poorly optimized postgresql queries that have been fixed in #753. The long queries are now logged with a warning to help user optimize the pipeline. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
