[ceph-users] Re: logging with container

2022-03-21 Thread Tony Liu
Hi Adam, When I do "ceph tell mon.ceph-1 config set log_to_file true", I see the log file is created. That confirms that those options in command line can only be override by runtime config change. Could you check mon and mgr logging on your setup? Can we remove those options in command line and

[ceph-users] Re: logging with container

2022-03-21 Thread Tony Liu
Hi Adam, # ceph config get mgr log_to_file true # ceph config get mgr log_file /var/log/ceph/$cluster-$name.log # ceph config get osd log_to_file true # ceph config get osd log_file /var/log/ceph/$cluster-$name.log # ls /var/log/ceph/fa771070-a975-11ec-86c7-e4434be9cb2e/ ceph-osd.10.log

[ceph-users] Re: bind monitoring service to specific network and port

2022-03-21 Thread Tony Liu
It's probably again related to podman. After switching back to Docker, this works fine. Thanks! Tony From: Tony Liu Sent: March 20, 2022 06:31 PM To: ceph-users@ceph.io; d...@ceph.io Subject: [ceph-users] bind monitoring service to specific network and

[ceph-users] Re: orch apply failed to use insecure private registry

2022-03-21 Thread Tony Liu
It's podman issue. https://github.com/containers/podman/issues/11933 Switch back to Docker. Thanks! Tony From: Eugen Block Sent: March 21, 2022 06:11 AM To: ceph-users@ceph.io Subject: [ceph-users] Re: orch apply failed to use insecure private registry

[ceph-users] Re: Ceph RADOSGW with Keycloak ODIC

2022-03-21 Thread Seth Cagampang
Good news! I figured out what was going on. I found in my ceph.conf where the debug logging location was: [client.radosgw.gateway_name] debug ms = 1 debug rgw = 20 host = gateway_name keyring = /etc/ceph/ceph.client.radosgw.keyring log file =

[ceph-users] Re: Ceph RADOSGW with Keycloak ODIC

2022-03-21 Thread Seth Cagampang
I think that the app_id condition was a typo. After I run the python script to create the role I get the following role: { "Roles": [ { "Path": "/", "RoleName": "S3Access", "RoleId": "2097f1fc-8a56-454c-8f00-23ded3c3c3b4", "Arn":

[ceph-users] Re: logging with container

2022-03-21 Thread Adam King
Hi Tony, Afaik those container flags just set the defaults and the config options override them. Setting the necessary flags ( https://docs.ceph.com/en/latest/cephadm/operations/#logging-to-files) seemed to work for me. [ceph: root@vm-00 /]# ceph config get osd.0 log_to_file false [ceph:

[ceph-users] Re: RadosGW S3 range on a 0 byte object gives 416 Range Not Satisfiable

2022-03-21 Thread Ulrich Klein
RFC 7233 4.4 . 416 Range Not Satisfiable The 416 (Range Not Satisfiable) status code indicates that none of the ranges in the request's Range header field (Section 3.1 )

[ceph-users] Re: RadosGW S3 range on a 0 byte object gives 416 Range Not Satisfiable

2022-03-21 Thread Ulrich Klein
With a bit of HTTP background I’d say: bytes=0-100 means: First byte to to 100nd byte. First byte is byte #0 On an empty object there is no first byte, i.e. not satisfiable ==> 416 Should be the same as on a single byte object and bytes=1-100 200 OK should only be correct, if the

[ceph-users] Re: Cephfs default data pool (inode backtrace) no longer a thing?

2022-03-21 Thread Gregory Farnum
The backtraces are written out asynchronously by the MDS to those objects, so there can be a delay between file creation and when they appear. In fact I think backtraces only get written when the inode in question is falling out of the MDS journal, so if you have a relatively small number of flies

[ceph-users] RadosGW S3 range on a 0 byte object gives 416 Range Not Satisfiable

2022-03-21 Thread Kai Stian Olstad
Hi Ceph v16.2.6. Using GET with Range: bytes=0-100 it fails with 416 if the object is 0 byte. I tried reading the http specification[1] on the subject but did not get any wiser unfortunately. I did a test with curl and range against a 0 byte file on Nginx and it returned 200 OK. Does

[ceph-users] Re: orch apply failed to use insecure private registry

2022-03-21 Thread Eugen Block
Hi, Setting mgr/cephadm/registry_insecure to false doesn't help. if you want to use an insecure registry you would need to set this option to true, not false. I am using podman and /etc/containers/registries.conf is set with that insecure private registry. Can you paste the whole

[ceph-users] Re: Ceph OSD's take 10+ minutes to start on reboot

2022-03-21 Thread Igor Fedotov
Hi Chris, Such meta growth is completely unexpected to me. And IIUC you've got custom rocksdb settings, right? What's the rationale for that? I would strongly discourage to alter them without deep understanding of the consequences... My current working hypothesis is that DB compaction is

[ceph-users] OSD encryption

2022-03-21 Thread Stephen Smith6
A couple of questions around OSD encryption: 1. Was support for an external key management solution ever implemented (Specifically for the OSD encryption key)? 2. Is there an easy wrapper key rotation utility or process for the existing solution? Thanks, Eric