Hi Eric, sorry for the slow reply. Size of /var/lib/pulp is 176GB - is that what you're after re mongoDB size?
As far as /var/log/messages goes - its "Applying pulp_rpm.plugins.migrations version 28" that takes so long Jul 2 09:14:07 wellkatello.niwa.local pulp: pulp.server.db.manage:INFO: Migration to pulp_rpm.plugins.migrations version 23 complete. Jul 2 09:14:07 wellkatello.niwa.local pulp: pulp.server.db.manage:INFO: Applying pulp_rpm.plugins.migrations version 24 Jul 2 09:14:07 wellkatello.niwa.local pulp: pulp.server.db.manage:INFO: Migration to pulp_rpm.plugins.migrations version 24 complete. Jul 2 09:14:07 wellkatello.niwa.local pulp: pulp.server.db.manage:INFO: Applying pulp_rpm.plugins.migrations version 25 Jul 2 09:14:07 wellkatello.niwa.local pulp: pulp.server.db.manage:INFO: Migration to pulp_rpm.plugins.migrations version 25 complete. Jul 2 09:14:07 wellkatello.niwa.local pulp: pulp.server.db.manage:INFO: Applying pulp_rpm.plugins.migrations version 26 Jul 2 09:14:07 wellkatello.niwa.local pulp: py.warnings:WARNING: (25904-01664) /usr/lib/python2.7/site-packages/pulp_rpm/plugins/migrations/0026_remove_distribution_field.py:23: DeprecationWarning: update is deprecated. Use replace_one, update_one or update_many instead. Jul 2 09:14:07 wellkatello.niwa.local pulp: py.warnings:WARNING: (25904-01664) multi=True Jul 2 09:14:07 wellkatello.niwa.local pulp: py.warnings:WARNING: (25904-01664) Jul 2 09:14:07 wellkatello.niwa.local pulp: pulp.server.db.manage:INFO: Migration to pulp_rpm.plugins.migrations version 26 complete. Jul 2 09:14:07 wellkatello.niwa.local pulp: pulp.server.db.manage:INFO: Applying pulp_rpm.plugins.migrations version 27 Jul 2 09:14:07 wellkatello.niwa.local pulp: py.warnings:WARNING: (25904-01664) /usr/lib/python2.7/site-packages/pulp_rpm/plugins/migrations/0027_remove_checksum_type_field.py:21: DeprecationWarning: update is deprecated. Use replace_one, update_one or update_many instead. Jul 2 09:14:07 wellkatello.niwa.local pulp: py.warnings:WARNING: (25904-01664) multi=True) Jul 2 09:14:07 wellkatello.niwa.local pulp: py.warnings:WARNING: (25904-01664) Jul 2 09:14:08 wellkatello.niwa.local pulp: pulp.server.db.manage:INFO: Migration to pulp_rpm.plugins.migrations version 27 complete. Jul 2 09:14:08 wellkatello.niwa.local pulp: pulp.server.db.manage:INFO: Applying pulp_rpm.plugins.migrations version 28 Jul 2 15:46:39 wellkatello.niwa.local pulp: pulp.server.db.manage:INFO: Migration to pulp_rpm.plugins.migrations version 28 complete. Jul 2 15:46:39 wellkatello.niwa.local pulp: pulp.server.db.manage:INFO: Applying pulp_rpm.plugins.migrations version 29 Jul 2 15:46:39 wellkatello.niwa.local pulp: py.warnings:WARNING: (25904-01664) /usr/lib/python2.7/site-packages/pulp_rpm/plugins/migrations/0029_remove_rpm_unused_fields.py:23: DeprecationWarning: update is deprecated. Use replace_one, update_one or update_many instead. Jul 2 15:46:39 wellkatello.niwa.local pulp: py.warnings:WARNING: (25904-01664) multi=True Jul 2 15:46:39 wellkatello.niwa.local pulp: py.warnings:WARNING: (25904-01664) Jul 2 15:46:40 wellkatello.niwa.local pulp: py.warnings:WARNING: (25904-01664) /usr/lib/python2.7/site-packages/pulp_rpm/plugins/migrations/0029_remove_rpm_unused_fields.py:28: DeprecationWarning: update is deprecated. Use replace_one, update_one or update_many instead. Jul 2 15:46:40 wellkatello.niwa.local pulp: py.warnings:WARNING: (25904-01664) multi=True Jul 2 15:46:40 wellkatello.niwa.local pulp: py.warnings:WARNING: (25904-01664) Jul 2 15:46:40 wellkatello.niwa.local pulp: pulp.server.db.manage:INFO: Migration to pulp_rpm.plugins.migrations version 29 complete. Jul 2 15:46:40 wellkatello.niwa.local pulp: pulp.server.db.manage:INFO: Applying pulp_rpm.plugins.migrations version 30 Jul 2 15:46:40 wellkatello.niwa.local pulp: py.warnings:WARNING: (25904-01664) /usr/lib/python2.7/site-packages/pulp_rpm/plugins/migrations/0030_remove_errata_unused_fields.py:23: DeprecationWarning: update is deprecated. Use replace_one, update_one or update_many instead. Jul 2 15:46:40 wellkatello.niwa.local pulp: py.warnings:WARNING: (25904-01664) multi=True Jul 2 15:46:40 wellkatello.niwa.local pulp: py.warnings:WARNING: (25904-01664) Jul 2 15:46:42 wellkatello.niwa.local pulp: pulp.server.db.manage:INFO: Migration to pulp_rpm.plugins.migrations version 30 complete. Happy to supply the whole log if its helpful! Dylan On Saturday, July 2, 2016 at 12:50:07 AM UTC+12, Eric Helms wrote: > > Also, if you were to look at /var/log/messages for the parts during the > upgrade, are you able to pickout which particular Pulp migration step > seemed to take the longest? > > On Fri, Jul 1, 2016 at 7:26 AM, Eric D Helms <[email protected] > <javascript:>> wrote: > >> Jason and Dylan, >> >> Could you also quote the size of your MongoDBs? I'd like to report all of >> this data to the Pulp team. >> >> Thanks, >> Eric >> >> On Fri, Jul 1, 2016 at 12:10 AM, Dylan Baars <[email protected] >> <javascript:>> wrote: >> >>> haha - it must have heard me, it just finished and carried on to the >>> next steps, go figure! So 176GB of pulp data takes roughly 6 hours ;-) >>> (suppose it'll be different based on hardware etc!) >>> >>> Dylan >>> >>> On Friday, July 1, 2016 at 4:03:29 PM UTC+12, Dylan Baars wrote: >>>> >>>> Hi Jason, >>>> >>>> how long did it take in the end? I am upgrading our production katello >>>> instance from 2.4.4 to 3.0, and the pulp_migrate step has taken 6 hours so >>>> far - I see no errors in the logs and pulp-manage-db seems to be running, >>>> taking CPU and memory time up. Our production system has a much larger >>>> pulp >>>> repository than the test instance I've done this on, but is there any >>>> advice on how long this step should take? (more a question for the Katello >>>> devs I guess!) It is 4pm here now, but the last logs in /var/log/messages >>>> from pulp are below (from 10:15am) >>>> >>>> Jul 1 10:15:49 wellkatello.niwa.local pulp: py.warnings:WARNING: >>>> (21830-39488) multi=True) >>>> Jul 1 10:15:49 wellkatello.niwa.local pulp: py.warnings:WARNING: >>>> (21830-39488) >>>> Jul 1 10:15:49 wellkatello.niwa.local pulp: >>>> pulp.server.db.manage:INFO: Migration to pulp_rpm.plugins.migrations >>>> version 27 complete. >>>> Jul 1 10:15:49 wellkatello.niwa.local pulp: >>>> pulp.server.db.manage:INFO: Applying pulp_rpm.plugins.migrations version 28 >>>> >>>> /var/lib/pulp is 176G vs the 42GB on the test instance >>>> >>>> Thanks, >>>> Dylan >>>> >>> -- >>> You received this message because you are subscribed to the Google >>> Groups "Foreman users" group. >>> To unsubscribe from this group and stop receiving emails from it, send >>> an email to [email protected] <javascript:>. >>> To post to this group, send email to [email protected] >>> <javascript:>. >>> Visit this group at https://groups.google.com/group/foreman-users. >>> For more options, visit https://groups.google.com/d/optout. >>> >> >> >> >> -- >> Eric D. Helms >> Red Hat Engineering >> Ph.D. Student - North Carolina State University >> > > > > -- > Eric D. Helms > Red Hat Engineering > Ph.D. Student - North Carolina State University > -- You received this message because you are subscribed to the Google Groups "Foreman users" group. To unsubscribe from this group and stop receiving emails from it, send an email to [email protected]. To post to this group, send email to [email protected]. Visit this group at https://groups.google.com/group/foreman-users. For more options, visit https://groups.google.com/d/optout.
