[ceph-users] Re: RGW access logs with bucket name

2023-11-02 Thread Dan van der Ster
Using the ops log is a good option -- I had missed that it can now log to a file. In Quincy: # ceph config set global rgw_ops_log_rados false # ceph config set global rgw_ops_log_file_path '/var/log/ceph/ops-log-$cluster-$name.log' # ceph config set global rgw_enable_ops_log true Then restart

[ceph-users] Re: RGW access logs with bucket name

2023-10-30 Thread Casey Bodley
another option is to enable the rgw ops log, which includes the bucket name for each request the http access log line that's visible at log level 1 follows a known apache format that users can scrape, so i've resisted adding extra s3-specific stuff like bucket/object names there. there was some

[ceph-users] Re: RGW access logs with bucket name

2023-10-30 Thread Boris Behrens
Hi Dan, we are currently moving all the logging into lua scripts, so it is not an issue anymore for us. Thanks ps: the ceph analyzer is really cool. plusplus Am Sa., 28. Okt. 2023 um 22:03 Uhr schrieb Dan van der Ster < dan.vanders...@clyso.com>: > Hi Boris, > > I found that you need to use

[ceph-users] Re: RGW access logs with bucket name

2023-10-28 Thread Dan van der Ster
Hi Boris, I found that you need to use debug_rgw=10 to see the bucket name :-/ e.g. 2023-10-28T19:55:42.288+ 7f34dde06700 10 req 3268931155513085118 0.0s s->object=... s->bucket=xyz-bucket-123 Did you find a more convenient way in the meantime? I think we should log bucket name at

[ceph-users] Re: RGW access logs with bucket name

2023-03-30 Thread Boris Behrens
Sadly not. I only see the the path/query of a request, but not the hostname. So when a bucket is accessed via hostname (https://bucket.TLD/object?query) I only see the object and the query (GET /object?query). When a bucket is accessed bia path (https://TLD/bucket/object?query) I can see also the

[ceph-users] Re: RGW access logs with bucket name

2023-03-30 Thread Szabo, Istvan (Agoda)
It has the full url begins with the bucket name in the beast logs http requests, hasn’t it? Istvan Szabo Staff Infrastructure Engineer --- Agoda Services Co., Ltd. e: istvan.sz...@agoda.com

[ceph-users] Re: RGW access logs with bucket name

2023-03-30 Thread Boris Behrens
Bringing up that topic again: is it possible to log the bucket name in the rgw client logs? currently I am only to know the bucket name when someone access the bucket via https://TLD/bucket/object instead of https://bucket.TLD/object. Am Di., 3. Jan. 2023 um 10:25 Uhr schrieb Boris Behrens : >