Hi Boris, Does the bucket have object versioning enabled? We saw something like this once a while ago: `s3cmd ls` showed an entry for an object, but when we tried to get it we had 404. We didn't find a good explanation in the end -- our user was able to re-upload the object and it didn't recur so we didn't debug further.
I suggest you open a ticket in the tracker with all the evidence so the developers can help diagnose the problem. Cheers, Dan On Fri, Jul 16, 2021 at 6:45 PM Boris Behrens <[email protected]> wrote: > > Hi Jean-Sebastien, > > I have the exact opposite. Files can be listed (the are in the bucket > index), but are not available anymore. > > Am Fr., 16. Juli 2021 um 18:41 Uhr schrieb Jean-Sebastien Landry > <[email protected]>: > > > > Hi Boris, I don't have any answer for you, but I have situation similar > > to yours. > > > > https://lists.ceph.io/hyperkitty/list/[email protected]/message/7E6O6ILGE5JCI4ISU66HZ6ZVZP6N6T3M/ > > > > I didn't try radoslist, I should have. > > > > Is this new, or it just that the client realised this lately? > > All the data seems missing or just some paths? > > Did you reshard lately? > > Did you test using client programs like s3cmd & rclone...? > > > > I didn't have time to work on that this week, but I have to find a > > solution too. > > Meanwhile, I run with a lower shard number and my customer can access > > all his data. > > Cheers! > > > > On 7/16/21 11:36 AM, Boris Behrens wrote: > > > [Externe UL*] > > > > > > Hi everybody, > > > a customer mentioned that he got problems in accessing hist rgw data. > > > I checked the bucket index and the file should be available. Then I > > > pulled a list with radosgw-admin radoslist --bucket BUCKET and it > > > seems that the file is gone. > > > > > > beside the "yaiks, is there a way the file might be somewhere else in > > > ceph?" how can this happen? > > > > > > We do occational orphan objects cleanups but this does not pull the > > > bucket index into account. > > > > > > It is a large bucket with 2.1m files in it and with 34 shards. > > > > > > Cheers and happy weekend > > > Boris > > > > > > -- > > > Die Selbsthilfegruppe "UTF-8-Probleme" trifft sich diesmal abweichend > > > im groüen Saal. > > > _______________________________________________ > > > ceph-users mailing list -- [email protected] > > > To unsubscribe send an email to [email protected] > > > *ATTENTION : L’émetteur de ce courriel est externe à l’Université Laval. > > > Évitez de cliquer sur un hyperlien, d’ouvrir une pièce jointe ou de > > > transmettre des informations si vous ne connaissez pas l’expéditeur du > > > courriel. En cas de doute, contactez l’équipe de soutien informatique de > > > votre unité ou [email protected]. > > > ________________________________ > > > > > _______________________________________________ > > ceph-users mailing list -- [email protected] > > To unsubscribe send an email to [email protected] > > > > -- > Die Selbsthilfegruppe "UTF-8-Probleme" trifft sich diesmal abweichend > im groüen Saal. > _______________________________________________ > ceph-users mailing list -- [email protected] > To unsubscribe send an email to [email protected] _______________________________________________ ceph-users mailing list -- [email protected] To unsubscribe send an email to [email protected]
