Re: JPL-CMU integration

[Qihao Bao]

Lei,
Did you run $ docker login ?
You need to have authentication in order to update someone's repository.

Actually i have been searching for solutions for the docker-push problem.
But i found no official solutions nor any specific and effective solutions
for such issue.
Someone said docker hub may be able to take containers larger than 10GB in
theory. However, when the size is very big, the push process may not be
successful due to unknown issues.

Right now, before any solution is found, what we can do is trying to shrink
the size a little bit and see if it works.
Thanks.

Qihao

On Thu, May 26, 2016 at 2:59 PM, Pan, Lei (398K) <lei....@jpl.nasa.gov>
wrote:

> Probably not. So that is why I failed? How do we
> deal with this? If necessary, we might be able to
> remove some things inside the container. But
> our integration might increase the size again.
> So it is better if we can figure out a way to
> accommodate a >10GB container.
>
> Thanks,
> -Lei
>
> From: Qihao Bao <qihao...@cmu.edu<mailto:qihao...@cmu.edu>>
> Date: Thursday, May 26, 2016 at 2:44 PM
> To: JPL <lei....@jpl.nasa.gov<mailto:lei....@jpl.nasa.gov>>
> Cc: Jia Zhang <jia.zh...@west.cmu.edu<mailto:jia.zh...@west.cmu.edu>>,
> Seungwon Lee <seungwon....@jpl.nasa.gov<mailto:seungwon....@jpl.nasa.gov>>,
> Benyang Tang <benyang.t...@jpl.nasa.gov<mailto:benyang.t...@jpl.nasa.gov>>,
> "Zhai, Chengxing (398K)" <chengxing.z...@jpl.nasa.gov<mailto:
> chengxing.z...@jpl.nasa.gov>>, "dev@cmda.incubator.apache.org<mailto:
> dev@cmda.incubator.apache.org>" <dev@cmda.incubator.apache.org<mailto:
> dev@cmda.incubator.apache.org>>
> Subject: Re: JPL-CMU integration
>
> Hi Lei,
>
> Have you ever successfully pushed a container which is larger than 10GB to
> Docker Hub?
>
> Docker container has 10GB size limit.
>
>
> Qihao
>
> On Thu, May 26, 2016 at 2:26 PM, Pan, Lei (398K) <lei....@jpl.nasa.gov
> <mailto:lei....@jpl.nasa.gov>> wrote:
> Qihao:
>
> You cannot pull yet. I tried to push several times
> but all failed. Could you please help me in identifying
> what might be the cause of this failure?
>
> Thanks,
> -Lei
>
> leipan@cmda-test:~$ docker push flytosky/server:v1.1
> The push refers to a repository [docker.io/flytosky/server<
> http://docker.io/flytosky/server>] (len: 1)
> 2c3f9829d5b6: Pushing
> [==================================================>] 10.15 GB
> Received unexpected HTTP status: 500 Internal Server Error
> leipan@cmda-test:~$ docker commit -m 'the container for the yearly
> review; ready for CMU-JPL integration; with all code checked in and pushed
> to github' dfdcbde445f2 flytosky/server:v1.1
> 502e0e6435a80230dcaad038d165783beb5e4c825aa3fc6461a918edfc79723c
> leipan@cmda-test:~$ docker push flytosky/server:v1.1
> The push refers to a repository [docker.io/flytosky/server<
> http://docker.io/flytosky/server>] (len: 1)
> 502e0e6435a8: Pushing
> [==================================================>] 10.86 GB
> Received unexpected HTTP status: 500 Internal Server Error
> leipan@cmda-test:~$ docker push flytosky/server:v1.1
> The push refers to a repository [docker.io/flytosky/server<
> http://docker.io/flytosky/server>] (len: 1)
> 502e0e6435a8: Pushing
> [==================================================>] 10.86 GB
> Received unexpected HTTP status: 500 Internal Server Error
> leipan@cmda-test:~$
>
>
> From: JPL <lei....@jpl.nasa.gov<mailto:lei....@jpl.nasa.gov>>
> Date: Thursday, May 26, 2016 at 1:18 PM
> To: Qihao Bao <qihao...@cmu.edu<mailto:qihao...@cmu.edu>>, Jia Zhang <
> jia.zh...@west.cmu.edu<mailto:jia.zh...@west.cmu.edu>>
> Cc: Seungwon Lee <seungwon....@jpl.nasa.gov<mailto:
> seungwon....@jpl.nasa.gov>>, Benyang Tang <benyang.t...@jpl.nasa.gov
> <mailto:benyang.t...@jpl.nasa.gov>>, "Zhai, Chengxing (398K)" <
> chengxing.z...@jpl.nasa.gov<mailto:chengxing.z...@jpl.nasa.gov>>, "
> dev@cmda.incubator.apache.org<mailto:dev@cmda.incubator.apache.org>" <
> dev@cmda.incubator.apache.org<mailto:dev@cmda.incubator.apache.org>>
> Subject: JPL-CMU integration
>
> Hi Jia and Qihao:
>
> I have checked in the Docker container and pushed it to the Docker
> container:
> docker commit -m 'the container for the yearly review; ready for CMU-JPL
> integration; with all code checked in and pushed to github' dfdcbde445f2
> flytosky/server:v1.1
> docker push flytosky/server:v1.1
>
> Please pull it and use it as the container for our integration.
> In particular, we would like to:
>
> . deploy those CMU services that are to be co-located with
>   the JPL services running in Cloud;
> . make all services auto-start when the Docker container is played:
>   . for the JPL services:
>     . log in as the user “svc"
>     . front end: cd /home/svc/new_github/JPL-WebService/JPL_CMDA/frontend;
> sh start.sh
>     . back end: cd
> /home/svc/new_github/JPL-WebService/JPL_CMDA/services/svc; sh start.sh
>   . for the CMU services:
>     . ??
> . develop a restful API for the JPL backend to find out the login userid
> on the CMU server
> . address other integration requirements
>
> Please let me know if you have any questions and comments.
>
> Thanks,
> -Lei
>
>