[openstack-dev] [Swift3] improve multi-delete performance

Hi, The multi_delete in swift3, perform sequential DELETE. In my 3 storage-node configuration to delete a 1000 objects, it took 30 second. Following code change to create 100 thread pool to delete 1000 object took only 12 second. (This may even reduce if more storage nodes in picture). If

[openstack-dev] [swift] zones and partition

Hi, I have 3 ZONEs, with different capacity in each. Say I have 4 X 1TB disk (r0z1 - 1TB, r0z2 - 1TB,r0 z3 - 2TB ). The ring builder (rebalance code), keep ¼-partitions of all 3 replica in Zone-3. This is the current default behavior from the rebalance code. This puts pressure to the stora

[openstack-dev] profiling Latency of single PUT operation on proxy + storage

p.py does TCP connect for every BufferedHTTPConnection::connect(). *Optimization:* Maintain TCP connection pool below bufferedhttp.py. refcounted pool. Connection pool manager periodically cleans up unreferenced connections. Re-use past tcp connections for quicker HTTPConnection --Shyam *From:* Kirubakara

[openstack-dev] [Swift] ObjectController::async_update() latest change

Hi, Regarding https://github.com/openstack/swift/commit/2289137164231d7872731c2cf3d81b86f34f01a4 I am profiling each section of the swift code. Notice ObjectController::async_update()has high latency, and tried to use threads to parallelize the container_update. Noticed the above changes, and I p

[openstack-dev] swift-dispersion-populate for different storage policies

Hi I am working on making the swift-dispersion-populate and -report to work on different storage policies (different rings). Looks like internally the container objects are hardcoded. Is there anyone working on improving this or am I the first one ? Thanks kiru __