Jason was more diligent than me and dug enough to realize that we print out the "raw pg", which we are printing out because we haven't gotten far enough in the pipeline to decode the actual object name. You'll note that it ends with the same characters as the PG does, and unlike a pgid, the raw pg is a full-length hash and resistant to operations like pg split. :) -Greg
On Tue, Dec 12, 2017 at 11:12 AM Jason Dillaman <[email protected]> wrote: > That doesn't look like an RBD object -- any idea who is > "client.34720596.1:212637720"? > > On Tue, Dec 12, 2017 at 12:36 PM, Nick Fisk <[email protected]> wrote: > > Does anyone know what this object (0.ae78c1cf) might be, it's not your > > normal run of the mill RBD object and I can't seem to find it in the pool > > using rados --all ls . It seems to be leaving the 0.1cf PG stuck in an > > activating+remapped state and blocking IO. Pool 0 is just a pure RBD pool > > with a cache tier above it. There is no current mention of unfound > objects > > or any other obvious issues. > > > > There is some backfilling going on, on another OSD which was upgraded to > > bluestore, which was when the issue started. But I can't see any link in > the > > PG dump with upgraded OSD. My only thought so far is to wait for this > > backfilling to finish and then deep-scrub this PG and see if that reveals > > anything? > > > > Thanks, > > Nick > > > > "description": "osd_op(client.34720596.1:212637720 0.1cf 0.ae78c1cf > > (undecoded) > > ondisk+retry+write+ignore_cache+ignore_overlay+known_if_redirected > > e105014)", > > "initiated_at": "2017-12-12 17:10:50.030660", > > "age": 335.948290, > > "duration": 335.948383, > > "type_data": { > > "flag_point": "delayed", > > "events": [ > > { > > "time": "2017-12-12 17:10:50.030660", > > "event": "initiated" > > }, > > { > > "time": "2017-12-12 17:10:50.030692", > > "event": "queued_for_pg" > > }, > > { > > "time": "2017-12-12 17:10:50.030719", > > "event": "reached_pg" > > }, > > { > > "time": "2017-12-12 17:10:50.030727", > > "event": "waiting for peered" > > }, > > { > > "time": "2017-12-12 17:10:50.197353", > > "event": "reached_pg" > > }, > > { > > "time": "2017-12-12 17:10:50.197355", > > "event": "waiting for peered" > > > > _______________________________________________ > > ceph-users mailing list > > [email protected] > > http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com > > > > -- > Jason > _______________________________________________ > ceph-users mailing list > [email protected] > http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com >
_______________________________________________ ceph-users mailing list [email protected] http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com
