On Sat, Aug 5, 2017 at 1:21 AM, Marc Roos <m.r...@f1-outsourcing.eu> wrote:
>
> I have got a placement group inconsistency, and saw some manual where
> you can export and import this on another osd. But I am getting an
> export error on every osd.
>
> What does this export_files error -5 actually mean? I thought 3 copies

#define EIO              5      /* I/O error */

> should be enough to secure your data.
>
>
>> PG_DAMAGED Possible data damage: 1 pg inconsistent
>>    pg 17.36 is active+clean+inconsistent, acting [9,0,12]
>
>
>> 2017-08-04 05:39:51.534489 7f2f623d6700 -1 log_channel(cluster) log
> [ERR] : 17.36 soid
> 17:6ca1f70a:::rbd_data.1f114174b0dc51.0000000000000974:4: failed to pick
> suitable object info
>> 2017-08-04 05:41:12.715393 7f2f623d6700 -1 log_channel(cluster) log
> [ERR] : 17.36 deep-scrub 3 errors
>> 2017-08-04 15:21:12.445799 7f2f623d6700 -1 log_channel(cluster) log
> [ERR] : 17.36 soid
> 17:6ca1f70a:::rbd_data.1f114174b0dc51.0000000000000974:4: failed to pick
> suitable object info
>> 2017-08-04 15:22:35.646635 7f2f623d6700 -1 log_channel(cluster) log
> [ERR] : 17.36 repair 3 errors, 0 fixed
>
> ceph-objectstore-tool --data-path /var/lib/ceph/osd/ceph-12 --pgid 17.36
> --op export --file /tmp/recover.17.36

Can you run this command under strace like so?

# strace -fvttyyTo /tmp/strace.out -s 1024 ceph-objectstore-tool --data-path 
/var/lib/ceph/osd/ceph-12 --pgid 17.36 --op export --file /tmp/recover.17.36

Then see if you can find which syscall is returning EIO.

# grep "= \-5" /tmp/strace.out

>
> ...
> Read #17:6c9f811c:::rbd_data.1b42f52ae8944a.0000000000001a32:head#
> Read #17:6ca035fc:::rbd_data.1fff61238e1f29.000000000000b31a:head#
> Read #17:6ca0b4f8:::rbd_data.1fff61238e1f29.0000000000006fcc:head#
> Read #17:6ca0ffbc:::rbd_data.1fff61238e1f29.000000000000a214:head#
> Read #17:6ca10b29:::rbd_data.1fff61238e1f29.0000000000009923:head#
> Read #17:6ca11ab9:::rbd_data.1fa8ef2ae8944a.00000000000011b4:head#
> Read #17:6ca13bed:::rbd_data.1f114174b0dc51.00000000000002c6:head#
> Read #17:6ca1a791:::rbd_data.1fff61238e1f29.000000000000f101:head#
> Read #17:6ca1f70a:::rbd_data.1f114174b0dc51.0000000000000974:4#
> export_files error -5

Running the command with "--debug" appended will give more output which may shed
more light as well.

> _______________________________________________
> ceph-users mailing list
> ceph-users@lists.ceph.com
> http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com



-- 
Cheers,
Brad
_______________________________________________
ceph-users mailing list
ceph-users@lists.ceph.com
http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com

Reply via email to