https://bugzilla.wikimedia.org/show_bug.cgi?id=34785

--- Comment #19 from Aaron Schulz <[email protected]> 2012-05-22 15:56:42 
UTC ---
(In reply to comment #18)
> Asher and I our still tracking down additional problems. I've made
> https://gerrit.wikimedia.org/r/8006 to add more profiling. The problem is
> tracked down to LocalFile::upload.

For upload profiling: The edit portions tends to be around <=1 sec at all
times. p90 for purging from swift goes up to 11 sec for much of the day. As a
workaround, perhaps the thumbnails purging could be skipped for brand-new
uploads, since there should be nothing to purge.

The problem (same as bug 34717), is that the Swift container DBs have extremely
poor performance and while likely need to be mapped to SSD devices instead of
HDD.
SELECT queries go fast when the sqlite3 db file is paged in memory, but slow
otherwise (much of the time). The slowness just comes from the listings, the
actual concurrent DELETEs are very fast (<1 second even for p90).

-- 
Configure bugmail: https://bugzilla.wikimedia.org/userprefs.cgi?tab=email
------- You are receiving this mail because: -------
You are on the CC list for the bug.

_______________________________________________
Wikibugs-l mailing list
[email protected]
https://lists.wikimedia.org/mailman/listinfo/wikibugs-l

Reply via email to