Public bug reported: The original code of the `add`[1] method (upload) is inefficient and takes more time to upload images. It's significantly improving after using the `python-swiftclient` library API. Additionally `add` method became simpler.
[1] https://github.com/openstack/glance_store/blob/stable/victoria/glance_store/_drivers/swift/store.py#L915 # The original implementation > time glance image-create --protected=False --name=some-large-image --progress > --disk-format=vmdk --visibility=private --file some-large-image > --container-format=bare [=============================>] 100% +------------------+----------------------------------------------------------------------------------+ | Property | Value | +------------------+----------------------------------------------------------------------------------+ | checksum | aa7399679400faa31fb9f01bbae6758f | | container_format | bare | | created_at | 2021-03-30T20:00:26Z | | direct_url | swift+https://objectstore-3.cloud:443/v1/AUTH_e9141fb24eee4b3e9f27ae | | | 69cda31132/glance_7d0607a8-80c1-465f-aecc-0c9129366a0e/7d0607a8-80c1-465f-aecc-0 | | | c9129366a0e | | disk_format | vmdk | | id | 7d0607a8-80c1-465f-aecc-0c9129366a0e | | min_disk | 0 | | min_ram | 0 | | name | some-large-image | | os_hash_algo | sha512 | | os_hash_value | e9d5babf23f24643f06a2bbd2e48f7a9a04109e176d46c6930ae0a3f76c571440367d6a400d45fd4 | | | f07f0ed5e36d422825b33ae00d287ffad07a2ea16800f6cf | | os_hidden | False | | owner | e9141fb24eee4b3e9f25ae69cda31132 | | protected | False | | size | 7980414976 | | status | active | | tags | [] | | updated_at | 2021-03-30T20:04:33Z | | virtual_size | 64424509440 | | visibility | private | +------------------+----------------------------------------------------------------------------------+ real 4m9.821s user 0m18.227s sys 0m15.272s # The improved version using `SwiftService` from `python-swiftclient` > time glance image-create --protected=False --name=some-large-image --progress > --disk-format=vmdk --visibility=private --file some-large-image > -container-format=bare [=============================>] 100% +------------------+----------------------------------------------------------------------------------+ | Property | Value | +------------------+----------------------------------------------------------------------------------+ | checksum | 818971a4539213d56f1d5b5f37efeab6 | | container_format | bare | | created_at | 2021-03-30T19:53:27Z | | direct_url | swift+https://objectstore-3.cloud:443/v1/AUTH_e9141fb24eee4b3e9f27ae | | | 69cda31132/glance_b6f49875-7769-45d3-8b07-e7c0118f4a02/b6f49875-7769-45d3-8b07-e | | | 7c0118f4a02 | | disk_format | vmdk | | id | b6f49875-7769-45d3-8b07-e7c0118f4a02 | | min_disk | 0 | | min_ram | 0 | | name | some-large-image | | os_hash_algo | sha512 | | os_hash_value | 7fa67ff22a1bc180b5821f86a78370f4 | | os_hidden | False | | owner | e9141fb24eee4b3e9f25ae69cda31132 | | protected | False | | size | 0 | | status | active | | tags | [] | | updated_at | 2021-03-30T19:56:13Z | | virtual_size | 64424509440 | | visibility | private | +------------------+----------------------------------------------------------------------------------+ real 2m48.374s user 0m19.205s sys 0m16.002s Release: Victoria glance-21.0.0 glance_store-2.3.0 ** Affects: glance Importance: Undecided Status: New -- You received this bug notification because you are a member of Yahoo! Engineering Team, which is subscribed to Glance. https://bugs.launchpad.net/bugs/1921953 Title: The upload of image is slow Status in Glance: New Bug description: The original code of the `add`[1] method (upload) is inefficient and takes more time to upload images. It's significantly improving after using the `python-swiftclient` library API. Additionally `add` method became simpler. [1] https://github.com/openstack/glance_store/blob/stable/victoria/glance_store/_drivers/swift/store.py#L915 # The original implementation > time glance image-create --protected=False --name=some-large-image --progress --disk-format=vmdk --visibility=private --file some-large-image --container-format=bare [=============================>] 100% +------------------+----------------------------------------------------------------------------------+ | Property | Value | +------------------+----------------------------------------------------------------------------------+ | checksum | aa7399679400faa31fb9f01bbae6758f | | container_format | bare | | created_at | 2021-03-30T20:00:26Z | | direct_url | swift+https://objectstore-3.cloud:443/v1/AUTH_e9141fb24eee4b3e9f27ae | | | 69cda31132/glance_7d0607a8-80c1-465f-aecc-0c9129366a0e/7d0607a8-80c1-465f-aecc-0 | | | c9129366a0e | | disk_format | vmdk | | id | 7d0607a8-80c1-465f-aecc-0c9129366a0e | | min_disk | 0 | | min_ram | 0 | | name | some-large-image | | os_hash_algo | sha512 | | os_hash_value | e9d5babf23f24643f06a2bbd2e48f7a9a04109e176d46c6930ae0a3f76c571440367d6a400d45fd4 | | | f07f0ed5e36d422825b33ae00d287ffad07a2ea16800f6cf | | os_hidden | False | | owner | e9141fb24eee4b3e9f25ae69cda31132 | | protected | False | | size | 7980414976 | | status | active | | tags | [] | | updated_at | 2021-03-30T20:04:33Z | | virtual_size | 64424509440 | | visibility | private | +------------------+----------------------------------------------------------------------------------+ real 4m9.821s user 0m18.227s sys 0m15.272s # The improved version using `SwiftService` from `python-swiftclient` > time glance image-create --protected=False --name=some-large-image --progress --disk-format=vmdk --visibility=private --file some-large-image -container-format=bare [=============================>] 100% +------------------+----------------------------------------------------------------------------------+ | Property | Value | +------------------+----------------------------------------------------------------------------------+ | checksum | 818971a4539213d56f1d5b5f37efeab6 | | container_format | bare | | created_at | 2021-03-30T19:53:27Z | | direct_url | swift+https://objectstore-3.cloud:443/v1/AUTH_e9141fb24eee4b3e9f27ae | | | 69cda31132/glance_b6f49875-7769-45d3-8b07-e7c0118f4a02/b6f49875-7769-45d3-8b07-e | | | 7c0118f4a02 | | disk_format | vmdk | | id | b6f49875-7769-45d3-8b07-e7c0118f4a02 | | min_disk | 0 | | min_ram | 0 | | name | some-large-image | | os_hash_algo | sha512 | | os_hash_value | 7fa67ff22a1bc180b5821f86a78370f4 | | os_hidden | False | | owner | e9141fb24eee4b3e9f25ae69cda31132 | | protected | False | | size | 0 | | status | active | | tags | [] | | updated_at | 2021-03-30T19:56:13Z | | virtual_size | 64424509440 | | visibility | private | +------------------+----------------------------------------------------------------------------------+ real 2m48.374s user 0m19.205s sys 0m16.002s Release: Victoria glance-21.0.0 glance_store-2.3.0 To manage notifications about this bug go to: https://bugs.launchpad.net/glance/+bug/1921953/+subscriptions -- Mailing list: https://launchpad.net/~yahoo-eng-team Post to : [email protected] Unsubscribe : https://launchpad.net/~yahoo-eng-team More help : https://help.launchpad.net/ListHelp
