Re: Openshift and Power loss

2018-07-03 Thread Hetz Ben Hamo 
Yup, you're right.

BTW, I'm just curious - it seems to save a generated image, but not the
images that it downloads from docket.io etc. Is there a way to keep them
also?

תודה,
*חץ בן חמו*
אתם מוזמנים לבקר בבלוג היעוץ  או בבלוג הפרטי שלי


On Mon, Jul 2, 2018 at 7:04 PM, Erik Jacobs  wrote:

> Did you perhaps not have persistent storage for your registry, and that's
> the host that lost power?
>
> This would cause etcd to think something is a certain way, but the
> registry wouldn't actually have that image
>
> ?
>
> ---
>
> ERIK JACOBS
>
> PRINCIPAL TECHNICAL MARKETING MANAGER, CLOUD PLATFORMS
>
> Red Hat Inc 
>
> ejac...@redhat.comM: 646.462.3745 @: erikonopen
> 
> TRIED. TESTED. TRUSTED. 
>
>
> On Wed, Jun 20, 2018 at 9:42 AM Hetz Ben Hamo  wrote:
>
>> Looking directly at one of the nodes, I see it as this:
>>
>> docker-registry.default.svc:5000/image-uploader/app-cli 
>> 7234ee8e02152 days ago  647 MB
>>
>> However, trying to pull it, I get:
>>
>> # docker pull docker-registry.default.svc:5000/image-uploader/app-cli
>> Using default tag: latest
>> Trying to pull repository 
>> docker-registry.default.svc:5000/image-uploader/app-cli
>> ...
>> Pulling repository docker-registry.default.svc:
>> 5000/image-uploader/app-cli
>> Error: image image-uploader/app-cli:latest not found
>>
>>
>> On Wed, Jun 20, 2018 at 4:21 PM, Clayton Coleman 
>> wrote:
>>
>>>
>>>
>>> On Jun 20, 2018, at 7:32 AM, Hetz Ben Hamo  wrote:
>>>
>>> With all redundant hardware these days, with UPS - power loss can happen.
>>>
>>> I just got a power loss and upon powering on those machines, most of the
>>> services weren't working. Checking the pods shows almost all of them in
>>> error state. I deleted the pods and they were automatically recreated so
>>> most of the services were running, but the images inside this Openshift
>>> system wen't dead (redeployed my stuff gave an error that images cannot be
>>> pulled).
>>>
>>>
>>> If you get “images cannot be pulled” it usually means those images don’t
>>> exist anymore.  If you try to docker pull those images, what happens?
>>>
>>>
>>> I looked at the documents, both the commercial and the origin version,
>>> but there is nothing which talks about this issue, nor any script that will
>>> fix this issue after powering on this system.
>>>
>>> Is there such a document or any script that fixes such an issue?
>>>
>>> Thanks,
>>> Hetz
>>>
>>> ___
>>> dev mailing list
>>> dev@lists.openshift.redhat.com
>>> http://lists.openshift.redhat.com/openshiftmm/listinfo/dev
>>>
>>>
>> ___
>> dev mailing list
>> dev@lists.openshift.redhat.com
>> http://lists.openshift.redhat.com/openshiftmm/listinfo/dev
>>
>
___
dev mailing list
dev@lists.openshift.redhat.com
http://lists.openshift.redhat.com/openshiftmm/listinfo/dev

Re: Openshift and Power loss

2018-07-02 Thread Erik Jacobs 
Did you perhaps not have persistent storage for your registry, and that's
the host that lost power?

This would cause etcd to think something is a certain way, but the registry
wouldn't actually have that image

?

---

ERIK JACOBS

PRINCIPAL TECHNICAL MARKETING MANAGER, CLOUD PLATFORMS

Red Hat Inc 

ejac...@redhat.comM: 646.462.3745  @:
erikonopen

TRIED. TESTED. TRUSTED. 


On Wed, Jun 20, 2018 at 9:42 AM Hetz Ben Hamo  wrote:

> Looking directly at one of the nodes, I see it as this:
>
> docker-registry.default.svc:5000/image-uploader/app-cli 
>   7234ee8e02152 days ago  647 MB
>
> However, trying to pull it, I get:
>
> # docker pull docker-registry.default.svc:5000/image-uploader/app-cli
> Using default tag: latest
> Trying to pull repository
> docker-registry.default.svc:5000/image-uploader/app-cli ...
> Pulling repository docker-registry.default.svc:5000/image-uploader/app-cli
> Error: image image-uploader/app-cli:latest not found
>
>
> On Wed, Jun 20, 2018 at 4:21 PM, Clayton Coleman 
> wrote:
>
>>
>>
>> On Jun 20, 2018, at 7:32 AM, Hetz Ben Hamo  wrote:
>>
>> With all redundant hardware these days, with UPS - power loss can happen.
>>
>> I just got a power loss and upon powering on those machines, most of the
>> services weren't working. Checking the pods shows almost all of them in
>> error state. I deleted the pods and they were automatically recreated so
>> most of the services were running, but the images inside this Openshift
>> system wen't dead (redeployed my stuff gave an error that images cannot be
>> pulled).
>>
>>
>> If you get “images cannot be pulled” it usually means those images don’t
>> exist anymore.  If you try to docker pull those images, what happens?
>>
>>
>> I looked at the documents, both the commercial and the origin version,
>> but there is nothing which talks about this issue, nor any script that will
>> fix this issue after powering on this system.
>>
>> Is there such a document or any script that fixes such an issue?
>>
>> Thanks,
>> Hetz
>>
>> ___
>> dev mailing list
>> dev@lists.openshift.redhat.com
>> http://lists.openshift.redhat.com/openshiftmm/listinfo/dev
>>
>>
> ___
> dev mailing list
> dev@lists.openshift.redhat.com
> http://lists.openshift.redhat.com/openshiftmm/listinfo/dev
>
___
dev mailing list
dev@lists.openshift.redhat.com
http://lists.openshift.redhat.com/openshiftmm/listinfo/dev

Re: Openshift and Power loss

2018-06-20 Thread Hetz Ben Hamo 
Looking directly at one of the nodes, I see it as this:

docker-registry.default.svc:5000/image-uploader/app-cli 
7234ee8e02152 days ago  647 MB

However, trying to pull it, I get:

# docker pull docker-registry.default.svc:5000/image-uploader/app-cli
Using default tag: latest
Trying to pull repository
docker-registry.default.svc:5000/image-uploader/app-cli ...
Pulling repository docker-registry.default.svc:5000/image-uploader/app-cli
Error: image image-uploader/app-cli:latest not found


On Wed, Jun 20, 2018 at 4:21 PM, Clayton Coleman 
wrote:

>
>
> On Jun 20, 2018, at 7:32 AM, Hetz Ben Hamo  wrote:
>
> With all redundant hardware these days, with UPS - power loss can happen.
>
> I just got a power loss and upon powering on those machines, most of the
> services weren't working. Checking the pods shows almost all of them in
> error state. I deleted the pods and they were automatically recreated so
> most of the services were running, but the images inside this Openshift
> system wen't dead (redeployed my stuff gave an error that images cannot be
> pulled).
>
>
> If you get “images cannot be pulled” it usually means those images don’t
> exist anymore.  If you try to docker pull those images, what happens?
>
>
> I looked at the documents, both the commercial and the origin version, but
> there is nothing which talks about this issue, nor any script that will fix
> this issue after powering on this system.
>
> Is there such a document or any script that fixes such an issue?
>
> Thanks,
> Hetz
>
> ___
> dev mailing list
> dev@lists.openshift.redhat.com
> http://lists.openshift.redhat.com/openshiftmm/listinfo/dev
>
>
___
dev mailing list
dev@lists.openshift.redhat.com
http://lists.openshift.redhat.com/openshiftmm/listinfo/dev

Re: Openshift and Power loss

2018-06-20 Thread Clayton Coleman 
On Jun 20, 2018, at 7:32 AM, Hetz Ben Hamo  wrote:

With all redundant hardware these days, with UPS - power loss can happen.

I just got a power loss and upon powering on those machines, most of the
services weren't working. Checking the pods shows almost all of them in
error state. I deleted the pods and they were automatically recreated so
most of the services were running, but the images inside this Openshift
system wen't dead (redeployed my stuff gave an error that images cannot be
pulled).


If you get “images cannot be pulled” it usually means those images don’t
exist anymore.  If you try to docker pull those images, what happens?


I looked at the documents, both the commercial and the origin version, but
there is nothing which talks about this issue, nor any script that will fix
this issue after powering on this system.

Is there such a document or any script that fixes such an issue?

Thanks,
Hetz

___
dev mailing list
dev@lists.openshift.redhat.com
http://lists.openshift.redhat.com/openshiftmm/listinfo/dev
___
dev mailing list
dev@lists.openshift.redhat.com
http://lists.openshift.redhat.com/openshiftmm/listinfo/dev