Hi, I finaly managed to delete the bucket, I wrote a script that reads the omap keys from the bucket index and deletes every key without a matching object on the data pool.
Not sure if this has any negative repercussions, but after the script deleted thousands of keys from the index, i was able to delete the bucket with: radosgw-admin --id radosgw.rgw bucket rm --bucket my-bucket --bypass-gc --purge-objects I have started an "orpands find" process, to clean up any remaining objects. I suspect that automatic resharding somehow lead to this problem, maybe there is something wrong with handling multiparts. I had a handful of normal, but 800k multipart objects, the index had only 2 shards (should be around 16 I think). Radosgw frequently triggerd resharding of this index, but the new index allso only had 2 shards. Maybe something goes wrong when multipart uploads are aborted/completed during resharding? Micha Krause On 04.04.2018 16:14, Micha Krause wrote:
Hi, I have a Bucket with multiple broken multipart uploads, which can't be aborted. radosgw-admin bucket check shows thousands of _multipart_ objects, unfortunately the --fix and --check-objects don't change anything. I decided to get rid of the bucket completely, but even this command: radosgw-admin --id radosgw.rgw bucket rm --bucket my-bucket --inconsistent-index --yes-i-really-mean-it --bypass-gc --purge-objects Is not able to do it, and shows: 7fe7cdceab80 -1 ERROR: unable to remove bucket(2) No such file or directory --debug-ms=1 shows that the error occurs after: 2018-04-04 15:59:58.884901 7f6f500c5700 1 -- 10.210.64.16:0/772895100 <== osd.458 10.210.34.34:6804/2673 1 ==== osd_op_reply(13121 default.193458319.2__multipart_my/object.2~p8vFLOvgFKMGOSLeEc8WGT2Bgw5ehg9.meta [omap-get-vals] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 346+0+0 (2461758253 0 0) 0x7f6f48268ba0 con 0x5626ec47ee20 And indeed when I try to get the object with the rados get command, it also shows "No such file or directory" I tried to rados put -p .rgw.buckets default.193458319.2__multipart_my/object.2~p8vFLOvgFKMGOSLeEc8WGT2Bgw5ehg9.meta emptyfile in it's place, but the error stays the same. Any ideas how I can get rid of my bucket? Micha Krause _______________________________________________ ceph-users mailing list ceph-users@lists.ceph.com http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com
_______________________________________________ ceph-users mailing list ceph-users@lists.ceph.com http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com
