Greetings, I'm having an issue with the internal OKD registry, I can no longer pull images from it, throws a manifest unknown error.
time="2020-05-09T19:03:43.889470214Z" level=error msg="response completed with error" err.code="manifest unknown" err.detail="unknown manifest name=techops-prod/ftp-service revision=sha256:45bf878fbb338f80c2cecd5ce165e5fd5df485e672397b40a6577a89d5553440" err.message="manifest unknown" go.version=go1.10.3 http.request.host="docker-registry.default.svc:5000" http.request.id=3222d5fc-22f9-41b6-b6d0-49c1452052c0 http.request.method=GET http.request.remoteaddr="10.128.2.1:45720" http.request.uri="/v2/techops-prod/ftp-service/manifests/sha256:45bf878fbb338f80c2cecd5ce165e5fd5df485e672397b40a6577a89d5553440" http.request.useragent="docker/1.13.1 go/go1.9.4 kernel/3.10.0-957.10.1.el7.x86_64 os/linux arch/amd64 UpstreamClient(Go-http-client/1.1)" http.response.contenttype="application/json; charset=utf-8" http.response.duration=19.45725ms http.response.status=404 http.response.written=200 instance.id=16d1a04e-05cb-49bb-aa67-99e7f3427910 openshift.auth.user="system:serviceaccount:techops-prod:default" openshift.auth.userid=f5ca6924-4b2e-11e9-9fba-005056a2f8a3 vars.name=techops-prod/ftp-service vars.reference="sha256:45bf878fbb338f80c2cecd5ce165e5fd5df485e672397b40a6577a89d5553440" The image does exist, I can see it in the registry console. Any help would be greatly appreciated, thanks. Registry pod logs: time="2020-05-09T19:00:09Z" level=warning msg="Ignoring unrecognized environment variable REGISTRY_CONSOLE_PORT" time="2020-05-09T19:00:09Z" level=warning msg="Ignoring unrecognized environment variable REGISTRY_CONSOLE_PORT_9000_TCP" time="2020-05-09T19:00:09Z" level=warning msg="Ignoring unrecognized environment variable REGISTRY_CONSOLE_PORT_9000_TCP_ADDR" time="2020-05-09T19:00:09Z" level=warning msg="Ignoring unrecognized environment variable REGISTRY_CONSOLE_PORT_9000_TCP_PORT" time="2020-05-09T19:00:09Z" level=warning msg="Ignoring unrecognized environment variable REGISTRY_CONSOLE_PORT_9000_TCP_PROTO" time="2020-05-09T19:00:09Z" level=warning msg="Ignoring unrecognized environment variable REGISTRY_CONSOLE_SERVICE_HOST" time="2020-05-09T19:00:09Z" level=warning msg="Ignoring unrecognized environment variable REGISTRY_CONSOLE_SERVICE_PORT" time="2020-05-09T19:00:09Z" level=warning msg="Ignoring unrecognized environment variable REGISTRY_CONSOLE_SERVICE_PORT_REGISTRY_CONSOLE" time="2020-05-09T19:00:09Z" level=info msg="DEPRECATED: \"OPENSHIFT_DEFAULT_REGISTRY\" is deprecated, use the 'REGISTRY_OPENSHIFT_SERVER_ADDR' instead" time="2020-05-09T19:00:09.391590095Z" level=info msg="start registry" distribution_version=v2.6.2+unknown go.version=go1.10.3 instance.id=16d1a04e-05cb-49bb-aa67-99e7f3427910 openshift_version=v3.11.0+9cca740-6 time="2020-05-09T19:00:09.392354652Z" level=info msg="quota enforcement disabled" go.version=go1.10.3 instance.id=16d1a04e-05cb-49bb-aa67-99e7f3427910 time="2020-05-09T19:00:09.394118711Z" level=info msg="redis not configured" go.version=go1.10.3 instance.id=16d1a04e-05cb-49bb-aa67-99e7f3427910 time="2020-05-09T19:00:09.39495307Z" level=info msg="Starting upload purge in 38m0s" go.version=go1.10.3 instance.id=16d1a04e-05cb-49bb-aa67-99e7f3427910 time="2020-05-09T19:00:09.414781192Z" level=info msg="using openshift blob descriptor cache" go.version=go1.10.3 instance.id=16d1a04e-05cb-49bb-aa67-99e7f3427910 time="2020-05-09T19:00:09.416061921Z" level=info msg="Using \"docker-registry.default.svc:5000\" as Docker Registry URL" go.version=go1.10.3 instance.id=16d1a04e-05cb-49bb-aa67-99e7f3427910 time="2020-05-09T19:00:09.416241226Z" level=info msg="listening on :5000, tls" go.version=go1.10.3 instance.id=16d1a04e-05cb-49bb-aa67-99e7f3427910 oc describe pod/docker-registry-3-t5wsx Name: docker-registry-3-t5wsx Namespace: default Priority: 0 PriorityClassName: <none> Node: lnx886.mm-corp.net/10.111.11.136 Start Time: Sat, 09 May 2020 13:00:04 -0600 Labels: deployment=docker-registry-3 deploymentconfig=docker-registry docker-registry=default Annotations: openshift.io/deployment-config.latest-version=3 openshift.io/deployment-config.name=docker-registry openshift.io/deployment.name=docker-registry-3 openshift.io/scc=restricted Status: Running IP: 10.130.2.7 Controlled By: ReplicationController/docker-registry-3 Containers: registry: Container ID: docker://18958932c4d6e5234de72957fe0bd60e3c1775207f73f66402fa9003efc6530d Image: docker.io/openshift/origin-docker-registry:v3.11 Image ID: docker-pullable://docker.io/openshift/origin-docker-registry@sha256:5c2fe22619668face238d1ba8602a95b3102b81e667b54ba2888f1f0ee261ffd Port: 5000/TCP Host Port: 0/TCP State: Running Started: Sat, 09 May 2020 13:00:08 -0600 Ready: True Restart Count: 0 Requests: cpu: 100m memory: 256Mi Liveness: http-get https://:5000/healthz delay=10s timeout=5s period=10s #success=1 #failure=3 Readiness: http-get https://:5000/healthz delay=0s timeout=5s period=10s #success=1 #failure=3 Environment: REGISTRY_HTTP_ADDR: :5000 REGISTRY_HTTP_NET: tcp REGISTRY_HTTP_SECRET: 7nrIHFJEqPCSvRvjywJItPv8EIC2wxrlHD0VLzB+UB8= REGISTRY_MIDDLEWARE_REPOSITORY_OPENSHIFT_ENFORCEQUOTA: false OPENSHIFT_DEFAULT_REGISTRY: docker-registry.default.svc:5000 REGISTRY_HTTP_TLS_CERTIFICATE: /etc/secrets/registry.crt REGISTRY_OPENSHIFT_SERVER_ADDR: docker-registry.default.svc:5000 REGISTRY_HTTP_TLS_KEY: /etc/secrets/registry.key Mounts: /etc/secrets from registry-certificates (rw) /registry from registry-storage (rw) /var/run/secrets/kubernetes.io/serviceaccount from registry-token-dfm2c (ro) Conditions: Type Status Initialized True Ready True ContainersReady True PodScheduled True Volumes: registry-storage: Type: EmptyDir (a temporary directory that shares a pod's lifetime) Medium: registry-certificates: Type: Secret (a volume populated by a Secret) SecretName: registry-certificates Optional: false registry-token-dfm2c: Type: Secret (a volume populated by a Secret) SecretName: registry-token-dfm2c Optional: false QoS Class: Burstable Node-Selectors: node-role.kubernetes.io/infra=true Tolerations: node.kubernetes.io/memory-pressure:NoSchedule Events: <none>
_______________________________________________ users mailing list users@lists.openshift.redhat.com http://lists.openshift.redhat.com/openshiftmm/listinfo/users