On Tue, Aug 20, 2013 at 10:27:29AM +0900, Thomas O'Dowd wrote: > For S3 secondary storage, I'm wondering exactly what types of objects we > are storing in S3: > > 1. templates - working. > 2. snapshots - working. > 3. vmsnapshots - not working (at least I don't see these going to s3) > 4. volumes - n/a > 5. other? > > How do files on the secondary storage staging area get cleaned up > currently?
Every DataObject (Template, Snapshot, Volume) that passes through the staging area gets its ref_cnt incremented on entry and decremented on successfully moving to its destination (srcTO -> destTO). When the ref_cnt is 0 the object is stale and can be removed. I'm not sure how often the thread that does the cleanup is called and the error handling/concurrency around the reference count, you'll have to dig into the storage core for that. But reference counting is the basic idea behind cleaning up of the staging area. You can see some of the discussion around the aging policy at [1] http://markmail.org/message/gnpn3xa5o2i3wrx4 [2] http://markmail.org/message/u3c3m35loniqumo2 > > Tom. > -- > Cloudian KK - http://www.cloudian.com/get-started.html > Fancy 100TB of full featured S3 Storage? > Checkout the Cloudian?? Community Edition! -- Prasanna., ------------------------ Powered by BigRock.com
