Re: [Arches] Re: Hosting Arches on Azure as a Web App for Containers
>>>>>>>> When your project gets initialized (at first startup), that >>>>>>>>> settings_local.py is copied to /web_root//>>>>>>>> project>/settings_local.py. >>>>>>>>> Here is the source for reference: >>>>>>>>> https://github.com/archesproject/arches/blob/master/docker/settings_local.py >>>>>>>>> >>>>>>>>> >>>>>>>>> With that setup, all you should have to do is set your db >>>>>>>>> credentials in your docker-compose.yml: >>>>>>>>> - PGUSERNAME=username@your-db-server >>>>>>>>> >>>>>>>>> If you still receive above errors, something else is up and we >>>>>>>>> need to investigate :) >>>>>>>>> >>>>>>>>> By the way, which version of Arches are you using right now? >>>>>>>>> >>>>>>>>> Also, if you encounter any errors in the Docker Readme, especially >>>>>>>>> in the 'Setting up your own Arches project' section, please let us >>>>>>>>> know! :) >>>>>>>>> >>>>>>>>> https://github.com/archesproject/arches/tree/master/docker#setting-up-your-own-arches-project >>>>>>>>> >>>>>>>>> >>>>>>>>> On Friday, 26 October 2018 05:43:11 UTC+2, Lawrence Goh wrote: >>>>>>>>>> >>>>>>>>>> Hi Vincent, >>>>>>>>>> >>>>>>>>>> I noticed another odd thing. When it does the import_graphs >>>>>>>>>> after creating the database, it has this error. >>>>>>>>>> >>>>>>>>>> arches | FATAL: Invalid Username specified. Please >>>>>>>>>> check the Username and retry connection. The Username should be in >>>>>>>>>> format. >>>>>>>>>> arches | FATAL: Invalid Username specified. Please >>>>>>>>>> check the Username and retry connection. The Username should be in >>>>>>>>>> format. >>>>>>>>>> arches | Running: python manage.py packages -o >>>>>>>>>> import_reference_data -s >>>>>>>>>> "arches/db/schemes/arches_concept_scheme.rdf" >>>>>>>>>> >>>>>>>>>> Any idea where in the code is going nuts? :) >>>>>>>>>> >>>>>>>>>> Thanks. >>>>>>>>>> >>>>>>>>>> Regards, >>>>>>>>>> Lawrence >>>>>>>>>> >>>>>>>>>> >>>>>>>>>> >>>>>>>>>> On Fri, Oct 26, 2018 at 4:03 PM Lawrence Goh >>>>>>>>>> wrote: >>>>>>>>>> >>>>>>>>>>> Hi Vincent, >>>>>>>>>>> >>>>>>>>>>> Been digging further into the postgres libs. It seems the dsn >>>>>>>>>>> and kwargs in them are getting values from the 's >>>>>>>>>>> settings.py >>>>>>>>>>> which contains the default db credentials (postgres; postgis). >>>>>>>>>>> Normally, I >>>>>>>>>>> assumed it will get it from the arches' settings.py file. >>>>>>>>>>> >>>>>>>>>>> In case I am confusing :) When you browse the container, you >>>>>>>>>>> would be landed into \web_root\arches. Back down, it would be ENV, >>>>>>>>>>> arches, >>>>>>>>>>> folders. >>>>>>>>>>> >>>>>>>>>>> Probably I might need a new pull from arches again and work from >>>>>>>>>>> there. I am unsure if my own is corrupted. >>>>>>>>>>> >>>>>>>>>>> Thanks. >>>>>>>>>>> >>>>>>>>>>> Regards, >>>>>>>>>>> Law
Re: [Arches] Re: Hosting Arches on Azure as a Web App for Containers
;>>>>> https://github.com/archesproject/arches/tree/master/docker#setting-up-your-own-arches-project >>>>>>>> >>>>>>>> >>>>>>>> On Friday, 26 October 2018 05:43:11 UTC+2, Lawrence Goh wrote: >>>>>>>>> >>>>>>>>> Hi Vincent, >>>>>>>>> >>>>>>>>> I noticed another odd thing. When it does the import_graphs after >>>>>>>>> creating the database, it has this error. >>>>>>>>> >>>>>>>>> arches | FATAL: Invalid Username specified. Please >>>>>>>>> check the Username and retry connection. The Username should be in >>>>>>>>> format. >>>>>>>>> arches | FATAL: Invalid Username specified. Please >>>>>>>>> check the Username and retry connection. The Username should be in >>>>>>>>> format. >>>>>>>>> arches | Running: python manage.py packages -o >>>>>>>>> import_reference_data -s "arches/db/schemes/arches_concept_scheme.rdf" >>>>>>>>> >>>>>>>>> Any idea where in the code is going nuts? :) >>>>>>>>> >>>>>>>>> Thanks. >>>>>>>>> >>>>>>>>> Regards, >>>>>>>>> Lawrence >>>>>>>>> >>>>>>>>> >>>>>>>>> >>>>>>>>> On Fri, Oct 26, 2018 at 4:03 PM Lawrence Goh >>>>>>>>> wrote: >>>>>>>>> >>>>>>>>>> Hi Vincent, >>>>>>>>>> >>>>>>>>>> Been digging further into the postgres libs. It seems the dsn >>>>>>>>>> and kwargs in them are getting values from the 's >>>>>>>>>> settings.py >>>>>>>>>> which contains the default db credentials (postgres; postgis). >>>>>>>>>> Normally, I >>>>>>>>>> assumed it will get it from the arches' settings.py file. >>>>>>>>>> >>>>>>>>>> In case I am confusing :) When you browse the container, you >>>>>>>>>> would be landed into \web_root\arches. Back down, it would be ENV, >>>>>>>>>> arches, >>>>>>>>>> folders. >>>>>>>>>> >>>>>>>>>> Probably I might need a new pull from arches again and work from >>>>>>>>>> there. I am unsure if my own is corrupted. >>>>>>>>>> >>>>>>>>>> Thanks. >>>>>>>>>> >>>>>>>>>> Regards, >>>>>>>>>> Lawrence >>>>>>>>>> >>>>>>>>>> >>>>>>>>>> On Thu, Oct 25, 2018 at 5:30 AM Vincent Meijer < >>>>>>>>>> meijer@gmail.com> wrote: >>>>>>>>>> >>>>>>>>>>> Ah I can see the image now (in email). Looks like a regular >>>>>>>>>>> firewall misconfiguration. >>>>>>>>>>> Can you show us your current settings? >>>>>>>>>>> >>>>>>>>>>> There is also the option 'Enforce SSL Connection' under 'SSL >>>>>>>>>>> Settings' in your Azure DB. Is this set to Disabled? >>>>>>>>>>> >>>>>>>>>>> And can you connect to it from your local machine if you >>>>>>>>>>> whitelist your ip in that same screen? >>>>>>>>>>> >>>>>>>>>>> >>>>>>>>>>> On Tuesday, 23 October 2018 23:45:06 UTC+2, Lawrence Goh wrote: >>>>>>>>>>>> >>>>>>>>>>>> Hi Vincent, >>>>>>>>>>>> >>>>>>>>>>>> Apologies for another set up question. Been going everywhere >>>>>>>>>>>> and sadly to nowhere. We have set up a Azure Database for
Re: [Arches] Re: Hosting Arches on Azure as a Web App for Containers
or the reply. Found the issue to be on entrypoint.sh. The >>>>>> validations have yet to be updated. Currently, using 4.3.x branch but >>>>>> will >>>>>> probably move to 4.3.2 since it was just released. >>>>>> >>>>>> Thanks. >>>>>> >>>>>> Regards, >>>>>> Lawrence >>>>>> >>>>>> On Tue, Oct 30, 2018 at 10:07 PM Vincent Meijer >>>>>> wrote: >>>>>> >>>>>>> Hey Lawrence, sorry for the late response. >>>>>>> >>>>>>> Regarding settings.py: your project's settings.py take precedence >>>>>>> over the default arches settings.py. >>>>>>> *However*, in the docker version of Arches, a settings_local.py is >>>>>>> also copied to your project folder. >>>>>>> This settings_local.py should contain the postgres db settings that >>>>>>> you set through the environment variables in your docker-compose.yml. >>>>>>> It should already be imported by default in your settings.py. Notice >>>>>>> these lines at the bottom of that file: >>>>>>> try: >>>>>>> from settings_local import * >>>>>>> except ImportError: >>>>>>> pass >>>>>>> >>>>>>> When your project gets initialized (at first startup), that >>>>>>> settings_local.py is copied to /web_root//>>>>>> project>/settings_local.py. >>>>>>> Here is the source for reference: >>>>>>> https://github.com/archesproject/arches/blob/master/docker/settings_local.py >>>>>>> >>>>>>> >>>>>>> With that setup, all you should have to do is set your db >>>>>>> credentials in your docker-compose.yml: >>>>>>> - PGUSERNAME=username@your-db-server >>>>>>> >>>>>>> If you still receive above errors, something else is up and we need >>>>>>> to investigate :) >>>>>>> >>>>>>> By the way, which version of Arches are you using right now? >>>>>>> >>>>>>> Also, if you encounter any errors in the Docker Readme, especially >>>>>>> in the 'Setting up your own Arches project' section, please let us >>>>>>> know! :) >>>>>>> >>>>>>> https://github.com/archesproject/arches/tree/master/docker#setting-up-your-own-arches-project >>>>>>> >>>>>>> >>>>>>> On Friday, 26 October 2018 05:43:11 UTC+2, Lawrence Goh wrote: >>>>>>>> >>>>>>>> Hi Vincent, >>>>>>>> >>>>>>>> I noticed another odd thing. When it does the import_graphs after >>>>>>>> creating the database, it has this error. >>>>>>>> >>>>>>>> arches | FATAL: Invalid Username specified. Please check >>>>>>>> the Username and retry connection. The Username should be in >>>>>>>> format. >>>>>>>> arches | FATAL: Invalid Username specified. Please check >>>>>>>> the Username and retry connection. The Username should be in >>>>>>>> format. >>>>>>>> arches | Running: python manage.py packages -o >>>>>>>> import_reference_data -s "arches/db/schemes/arches_concept_scheme.rdf" >>>>>>>> >>>>>>>> Any idea where in the code is going nuts? :) >>>>>>>> >>>>>>>> Thanks. >>>>>>>> >>>>>>>> Regards, >>>>>>>> Lawrence >>>>>>>> >>>>>>>> >>>>>>>> >>>>>>>> On Fri, Oct 26, 2018 at 4:03 PM Lawrence Goh >>>>>>>> wrote: >>>>>>>> >>>>>>>>> Hi Vincent, >>>>>>>>> >>>>>>>>> Been digging further into the postgres libs. It seems the dsn and >>>>>>>>> kwargs in them are getting values from the 's >>>>>>>>> settings.py >>>>>>>>> whic
Re: [Arches] Re: Hosting Arches on Azure as a Web App for Containers
ject folder. >>>>>> This settings_local.py should contain the postgres db settings that >>>>>> you set through the environment variables in your docker-compose.yml. >>>>>> It should already be imported by default in your settings.py. Notice >>>>>> these lines at the bottom of that file: >>>>>> try: >>>>>> from settings_local import * >>>>>> except ImportError: >>>>>> pass >>>>>> >>>>>> When your project gets initialized (at first startup), that >>>>>> settings_local.py is copied to /web_root//>>>>> project>/settings_local.py. >>>>>> Here is the source for reference: >>>>>> https://github.com/archesproject/arches/blob/master/docker/settings_local.py >>>>>> >>>>>> >>>>>> With that setup, all you should have to do is set your db credentials >>>>>> in your docker-compose.yml: >>>>>> - PGUSERNAME=username@your-db-server >>>>>> >>>>>> If you still receive above errors, something else is up and we need >>>>>> to investigate :) >>>>>> >>>>>> By the way, which version of Arches are you using right now? >>>>>> >>>>>> Also, if you encounter any errors in the Docker Readme, especially in >>>>>> the 'Setting up your own Arches project' section, please let us know! :) >>>>>> >>>>>> https://github.com/archesproject/arches/tree/master/docker#setting-up-your-own-arches-project >>>>>> >>>>>> >>>>>> On Friday, 26 October 2018 05:43:11 UTC+2, Lawrence Goh wrote: >>>>>>> >>>>>>> Hi Vincent, >>>>>>> >>>>>>> I noticed another odd thing. When it does the import_graphs after >>>>>>> creating the database, it has this error. >>>>>>> >>>>>>> arches | FATAL: Invalid Username specified. Please check >>>>>>> the Username and retry connection. The Username should be in >>>>>>> format. >>>>>>> arches | FATAL: Invalid Username specified. Please check >>>>>>> the Username and retry connection. The Username should be in >>>>>>> format. >>>>>>> arches | Running: python manage.py packages -o >>>>>>> import_reference_data -s "arches/db/schemes/arches_concept_scheme.rdf" >>>>>>> >>>>>>> Any idea where in the code is going nuts? :) >>>>>>> >>>>>>> Thanks. >>>>>>> >>>>>>> Regards, >>>>>>> Lawrence >>>>>>> >>>>>>> >>>>>>> >>>>>>> On Fri, Oct 26, 2018 at 4:03 PM Lawrence Goh >>>>>>> wrote: >>>>>>> >>>>>>>> Hi Vincent, >>>>>>>> >>>>>>>> Been digging further into the postgres libs. It seems the dsn and >>>>>>>> kwargs in them are getting values from the 's settings.py >>>>>>>> which contains the default db credentials (postgres; postgis). >>>>>>>> Normally, I >>>>>>>> assumed it will get it from the arches' settings.py file. >>>>>>>> >>>>>>>> In case I am confusing :) When you browse the container, you would >>>>>>>> be landed into \web_root\arches. Back down, it would be ENV, arches, >>>>>>>> folders. >>>>>>>> >>>>>>>> Probably I might need a new pull from arches again and work from >>>>>>>> there. I am unsure if my own is corrupted. >>>>>>>> >>>>>>>> Thanks. >>>>>>>> >>>>>>>> Regards, >>>>>>>> Lawrence >>>>>>>> >>>>>>>> >>>>>>>> On Thu, Oct 25, 2018 at 5:30 AM Vincent Meijer < >>>>>>>> meijer@gmail.com> wrote: >>>>>>>> >>>>>>>>> Ah I can see the image now (in email). Looks like a regular >>>>>>>>> firewall misconfigurati
Re: [Arches] Re: Hosting Arches on Azure as a Web App for Containers
e@your-db-server >>>>> >>>>> If you still receive above errors, something else is up and we need to >>>>> investigate :) >>>>> >>>>> By the way, which version of Arches are you using right now? >>>>> >>>>> Also, if you encounter any errors in the Docker Readme, especially in >>>>> the 'Setting up your own Arches project' section, please let us know! :) >>>>> >>>>> https://github.com/archesproject/arches/tree/master/docker#setting-up-your-own-arches-project >>>>> >>>>> >>>>> On Friday, 26 October 2018 05:43:11 UTC+2, Lawrence Goh wrote: >>>>>> >>>>>> Hi Vincent, >>>>>> >>>>>> I noticed another odd thing. When it does the import_graphs after >>>>>> creating the database, it has this error. >>>>>> >>>>>> arches | FATAL: Invalid Username specified. Please check >>>>>> the Username and retry connection. The Username should be in >>>>>> format. >>>>>> arches | FATAL: Invalid Username specified. Please check >>>>>> the Username and retry connection. The Username should be in >>>>>> format. >>>>>> arches | Running: python manage.py packages -o >>>>>> import_reference_data -s "arches/db/schemes/arches_concept_scheme.rdf" >>>>>> >>>>>> Any idea where in the code is going nuts? :) >>>>>> >>>>>> Thanks. >>>>>> >>>>>> Regards, >>>>>> Lawrence >>>>>> >>>>>> >>>>>> >>>>>> On Fri, Oct 26, 2018 at 4:03 PM Lawrence Goh >>>>>> wrote: >>>>>> >>>>>>> Hi Vincent, >>>>>>> >>>>>>> Been digging further into the postgres libs. It seems the dsn and >>>>>>> kwargs in them are getting values from the 's settings.py >>>>>>> which contains the default db credentials (postgres; postgis). >>>>>>> Normally, I >>>>>>> assumed it will get it from the arches' settings.py file. >>>>>>> >>>>>>> In case I am confusing :) When you browse the container, you would >>>>>>> be landed into \web_root\arches. Back down, it would be ENV, arches, >>>>>>> folders. >>>>>>> >>>>>>> Probably I might need a new pull from arches again and work from >>>>>>> there. I am unsure if my own is corrupted. >>>>>>> >>>>>>> Thanks. >>>>>>> >>>>>>> Regards, >>>>>>> Lawrence >>>>>>> >>>>>>> >>>>>>> On Thu, Oct 25, 2018 at 5:30 AM Vincent Meijer >>>>>>> wrote: >>>>>>> >>>>>>>> Ah I can see the image now (in email). Looks like a regular >>>>>>>> firewall misconfiguration. >>>>>>>> Can you show us your current settings? >>>>>>>> >>>>>>>> There is also the option 'Enforce SSL Connection' under 'SSL >>>>>>>> Settings' in your Azure DB. Is this set to Disabled? >>>>>>>> >>>>>>>> And can you connect to it from your local machine if you whitelist >>>>>>>> your ip in that same screen? >>>>>>>> >>>>>>>> >>>>>>>> On Tuesday, 23 October 2018 23:45:06 UTC+2, Lawrence Goh wrote: >>>>>>>>> >>>>>>>>> Hi Vincent, >>>>>>>>> >>>>>>>>> Apologies for another set up question. Been going everywhere and >>>>>>>>> sadly to nowhere. We have set up a Azure Database for Postgresql. We >>>>>>>>> could get the docker compose to create the DB. But the arches >>>>>>>>> container >>>>>>>>> failed due to some weird network restriction. >>>>>>>>> >>>>>>>>> [image: image.png] >>>>>>>>> >>>>>>>>> I have added IPs to the firewall. Even having it being from >>>>>>>>> 0.0.0.
Re: [Arches] Re: Hosting Arches on Azure as a Web App for Containers
>> format. >>>>> arches | FATAL: Invalid Username specified. Please check >>>>> the Username and retry connection. The Username should be in >>>>> format. >>>>> arches | Running: python manage.py packages -o >>>>> import_reference_data -s "arches/db/schemes/arches_concept_scheme.rdf" >>>>> >>>>> Any idea where in the code is going nuts? :) >>>>> >>>>> Thanks. >>>>> >>>>> Regards, >>>>> Lawrence >>>>> >>>>> >>>>> >>>>> On Fri, Oct 26, 2018 at 4:03 PM Lawrence Goh >>>>> wrote: >>>>> >>>>>> Hi Vincent, >>>>>> >>>>>> Been digging further into the postgres libs. It seems the dsn and >>>>>> kwargs in them are getting values from the 's settings.py >>>>>> which contains the default db credentials (postgres; postgis). >>>>>> Normally, I >>>>>> assumed it will get it from the arches' settings.py file. >>>>>> >>>>>> In case I am confusing :) When you browse the container, you would be >>>>>> landed into \web_root\arches. Back down, it would be ENV, arches, >>>>>> folders. >>>>>> >>>>>> Probably I might need a new pull from arches again and work from >>>>>> there. I am unsure if my own is corrupted. >>>>>> >>>>>> Thanks. >>>>>> >>>>>> Regards, >>>>>> Lawrence >>>>>> >>>>>> >>>>>> On Thu, Oct 25, 2018 at 5:30 AM Vincent Meijer >>>>>> wrote: >>>>>> >>>>>>> Ah I can see the image now (in email). Looks like a regular firewall >>>>>>> misconfiguration. >>>>>>> Can you show us your current settings? >>>>>>> >>>>>>> There is also the option 'Enforce SSL Connection' under 'SSL >>>>>>> Settings' in your Azure DB. Is this set to Disabled? >>>>>>> >>>>>>> And can you connect to it from your local machine if you whitelist >>>>>>> your ip in that same screen? >>>>>>> >>>>>>> >>>>>>> On Tuesday, 23 October 2018 23:45:06 UTC+2, Lawrence Goh wrote: >>>>>>>> >>>>>>>> Hi Vincent, >>>>>>>> >>>>>>>> Apologies for another set up question. Been going everywhere and >>>>>>>> sadly to nowhere. We have set up a Azure Database for Postgresql. We >>>>>>>> could get the docker compose to create the DB. But the arches >>>>>>>> container >>>>>>>> failed due to some weird network restriction. >>>>>>>> >>>>>>>> [image: image.png] >>>>>>>> >>>>>>>> I have added IPs to the firewall. Even having it being from >>>>>>>> 0.0.0.0 to 255.255.255.255. The "Allow access to Azure services" >>>>>>>> is on. >>>>>>>> >>>>>>>> Any ideas? >>>>>>>> >>>>>>>> Thanks. >>>>>>>> >>>>>>>> Regards, >>>>>>>> Lawrence >>>>>>>> >>>>>>>> On Fri, Oct 19, 2018 at 10:32 PM Vincent Meijer < >>>>>>>> meijer@gmail.com> wrote: >>>>>>>> >>>>>>>>> Yeah it's a weird choice from Microsoft to do things differently >>>>>>>>> and arches wasn't prepared for that @... >>>>>>>>> >>>>>>>>> >>>>>>>>> >>>>>>>>> On Fri, 19 Oct 2018, 11:23 larrygoh84, wrote: >>>>>>>>> >>>>>>>>>> using 4.3.1. does this mean its a known issue? it doesn't handle >>>>>>>>>> the @ well? :) >>>>>>>>>> >>>>>>>>>> Original message >>>>>>>>>> From: Vincent Meijer >>>>>>>>>> Date: 10/19/18 10:02 PM (GMT+12:00) >>>>>>>>>&
Re: [Arches] Re: Hosting Arches on Azure as a Web App for Containers
gt;>>> >>>>> In case I am confusing :) When you browse the container, you would be >>>>> landed into \web_root\arches. Back down, it would be ENV, arches, >>>>> folders. >>>>> >>>>> Probably I might need a new pull from arches again and work from >>>>> there. I am unsure if my own is corrupted. >>>>> >>>>> Thanks. >>>>> >>>>> Regards, >>>>> Lawrence >>>>> >>>>> >>>>> On Thu, Oct 25, 2018 at 5:30 AM Vincent Meijer >>>>> wrote: >>>>> >>>>>> Ah I can see the image now (in email). Looks like a regular firewall >>>>>> misconfiguration. >>>>>> Can you show us your current settings? >>>>>> >>>>>> There is also the option 'Enforce SSL Connection' under 'SSL >>>>>> Settings' in your Azure DB. Is this set to Disabled? >>>>>> >>>>>> And can you connect to it from your local machine if you whitelist >>>>>> your ip in that same screen? >>>>>> >>>>>> >>>>>> On Tuesday, 23 October 2018 23:45:06 UTC+2, Lawrence Goh wrote: >>>>>>> >>>>>>> Hi Vincent, >>>>>>> >>>>>>> Apologies for another set up question. Been going everywhere and >>>>>>> sadly to nowhere. We have set up a Azure Database for Postgresql. We >>>>>>> could get the docker compose to create the DB. But the arches >>>>>>> container >>>>>>> failed due to some weird network restriction. >>>>>>> >>>>>>> [image: image.png] >>>>>>> >>>>>>> I have added IPs to the firewall. Even having it being from 0.0.0.0 >>>>>>> to 255.255.255.255. The "Allow access to Azure services" is on. >>>>>>> >>>>>>> Any ideas? >>>>>>> >>>>>>> Thanks. >>>>>>> >>>>>>> Regards, >>>>>>> Lawrence >>>>>>> >>>>>>> On Fri, Oct 19, 2018 at 10:32 PM Vincent Meijer < >>>>>>> meijer@gmail.com> wrote: >>>>>>> >>>>>>>> Yeah it's a weird choice from Microsoft to do things differently >>>>>>>> and arches wasn't prepared for that @... >>>>>>>> >>>>>>>> >>>>>>>> >>>>>>>> On Fri, 19 Oct 2018, 11:23 larrygoh84, wrote: >>>>>>>> >>>>>>>>> using 4.3.1. does this mean its a known issue? it doesn't handle >>>>>>>>> the @ well? :) >>>>>>>>> >>>>>>>>> Original message >>>>>>>>> From: Vincent Meijer >>>>>>>>> Date: 10/19/18 10:02 PM (GMT+12:00) >>>>>>>>> To: Arches Project >>>>>>>>> Subject: Re: [Arches] Re: Hosting Arches on Azure as a Web App for >>>>>>>>> Containers >>>>>>>>> >>>>>>>>> Which version of Arches are you using? >>>>>>>>> I created a PR (for #4099) for this earlier, but it was after >>>>>>>>> 4.3.1 was released. >>>>>>>>> >>>>>>>>> Until the next release you could use the master branch (there are >>>>>>>>> docker images built for that in Docker Hub for every new push: >>>>>>>>> https://hub.docker.com/r/archesproject/arches/tags/ ) >>>>>>>>> >>>>>>>>> However, if you want something more stable, you are also free to >>>>>>>>> use my own arches base images: >>>>>>>>> https://hub.docker.com/r/globaldigitalheritage/arches/tags/ >>>>>>>>> The current tags in there are all based on Arches 4.3.1 and I push >>>>>>>>> a new version every time I created some additional functionality / >>>>>>>>> fixes >>>>>>>>> for a PR, such as the one with '@' in Azure database names. >>>>>>>>> >>>>>>>>> Currently the lates
Re: [Arches] Re: Hosting Arches on Azure as a Web App for Containers
l machine if you whitelist >>>>> your ip in that same screen? >>>>> >>>>> >>>>> On Tuesday, 23 October 2018 23:45:06 UTC+2, Lawrence Goh wrote: >>>>>> >>>>>> Hi Vincent, >>>>>> >>>>>> Apologies for another set up question. Been going everywhere and >>>>>> sadly to nowhere. We have set up a Azure Database for Postgresql. We >>>>>> could get the docker compose to create the DB. But the arches container >>>>>> failed due to some weird network restriction. >>>>>> >>>>>> [image: image.png] >>>>>> >>>>>> I have added IPs to the firewall. Even having it being from 0.0.0.0 >>>>>> to 255.255.255.255. The "Allow access to Azure services" is on. >>>>>> >>>>>> Any ideas? >>>>>> >>>>>> Thanks. >>>>>> >>>>>> Regards, >>>>>> Lawrence >>>>>> >>>>>> On Fri, Oct 19, 2018 at 10:32 PM Vincent Meijer >>>>>> wrote: >>>>>> >>>>>>> Yeah it's a weird choice from Microsoft to do things differently and >>>>>>> arches wasn't prepared for that @... >>>>>>> >>>>>>> >>>>>>> >>>>>>> On Fri, 19 Oct 2018, 11:23 larrygoh84, wrote: >>>>>>> >>>>>>>> using 4.3.1. does this mean its a known issue? it doesn't handle >>>>>>>> the @ well? :) >>>>>>>> >>>>>>>> Original message >>>>>>>> From: Vincent Meijer >>>>>>>> Date: 10/19/18 10:02 PM (GMT+12:00) >>>>>>>> To: Arches Project >>>>>>>> Subject: Re: [Arches] Re: Hosting Arches on Azure as a Web App for >>>>>>>> Containers >>>>>>>> >>>>>>>> Which version of Arches are you using? >>>>>>>> I created a PR (for #4099) for this earlier, but it was after 4.3.1 >>>>>>>> was released. >>>>>>>> >>>>>>>> Until the next release you could use the master branch (there are >>>>>>>> docker images built for that in Docker Hub for every new push: >>>>>>>> https://hub.docker.com/r/archesproject/arches/tags/ ) >>>>>>>> >>>>>>>> However, if you want something more stable, you are also free to >>>>>>>> use my own arches base images: >>>>>>>> https://hub.docker.com/r/globaldigitalheritage/arches/tags/ >>>>>>>> The current tags in there are all based on Arches 4.3.1 and I push >>>>>>>> a new version every time I created some additional functionality / >>>>>>>> fixes >>>>>>>> for a PR, such as the one with '@' in Azure database names. >>>>>>>> >>>>>>>> Currently the latest I got is globaldigitalheritage/arches:4.3.1.11 >>>>>>>> >>>>>>>> >>>>>>>> I use these images as a base in my own Dockerfile >>>>>>>> (as described in step 7 of 'Setting up your own Arches project': >>>>>>>> https://github.com/archesproject/arches/blob/master/docker/Readme.md#setting-up-your-own-arches-project >>>>>>>> ) >>>>>>>> >>>>>>>> I recommend to follow these steps to create your own Arches >>>>>>>> project, rather than editing the core Arches app. >>>>>>>> >>>>>>>> Hope this helps! >>>>>>>> Vincent >>>>>>>> >>>>>>>> >>>>>>>> On Friday, 19 October 2018 05:14:57 UTC+2, Lawrence Goh wrote: >>>>>>>>> >>>>>>>>> Hi Vincent, >>>>>>>>> >>>>>>>>> Had you faced this issue before? We are now trying to connect to >>>>>>>>> Azure DB for Postgresql. The container log just freezes at Testing if >>>>>>>>> database server is up.. Is it senstive to the @? thanks. >>>>>>>>> >>>>>>>>> On Fr
Re: [Arches] Re: Hosting Arches on Azure as a Web App for Containers
Hey Lawrence, sorry for the late response. Regarding settings.py: your project's settings.py take precedence over the default arches settings.py. *However*, in the docker version of Arches, a settings_local.py is also copied to your project folder. This settings_local.py should contain the postgres db settings that you set through the environment variables in your docker-compose.yml. It should already be imported by default in your settings.py. Notice these lines at the bottom of that file: try: from settings_local import * except ImportError: pass When your project gets initialized (at first startup), that settings_local.py is copied to /web_root///settings_local.py. Here is the source for reference: https://github.com/archesproject/arches/blob/master/docker/settings_local.py With that setup, all you should have to do is set your db credentials in your docker-compose.yml: - PGUSERNAME=username@your-db-server If you still receive above errors, something else is up and we need to investigate :) By the way, which version of Arches are you using right now? Also, if you encounter any errors in the Docker Readme, especially in the 'Setting up your own Arches project' section, please let us know! :) https://github.com/archesproject/arches/tree/master/docker#setting-up-your-own-arches-project On Friday, 26 October 2018 05:43:11 UTC+2, Lawrence Goh wrote: > > Hi Vincent, > > I noticed another odd thing. When it does the import_graphs after > creating the database, it has this error. > > arches | FATAL: Invalid Username specified. Please check the > Username and retry connection. The Username should be in > format. > arches | FATAL: Invalid Username specified. Please check the > Username and retry connection. The Username should be in > format. > arches | Running: python manage.py packages -o > import_reference_data -s "arches/db/schemes/arches_concept_scheme.rdf" > > Any idea where in the code is going nuts? :) > > Thanks. > > Regards, > Lawrence > > > > On Fri, Oct 26, 2018 at 4:03 PM Lawrence Goh > wrote: > >> Hi Vincent, >> >> Been digging further into the postgres libs. It seems the dsn and kwargs >> in them are getting values from the 's settings.py which >> contains the default db credentials (postgres; postgis). Normally, I >> assumed it will get it from the arches' settings.py file. >> >> In case I am confusing :) When you browse the container, you would be >> landed into \web_root\arches. Back down, it would be ENV, arches, >> folders. >> >> Probably I might need a new pull from arches again and work from there. >> I am unsure if my own is corrupted. >> >> Thanks. >> >> Regards, >> Lawrence >> >> >> On Thu, Oct 25, 2018 at 5:30 AM Vincent Meijer > > wrote: >> >>> Ah I can see the image now (in email). Looks like a regular firewall >>> misconfiguration. >>> Can you show us your current settings? >>> >>> There is also the option 'Enforce SSL Connection' under 'SSL Settings' >>> in your Azure DB. Is this set to Disabled? >>> >>> And can you connect to it from your local machine if you whitelist your >>> ip in that same screen? >>> >>> >>> On Tuesday, 23 October 2018 23:45:06 UTC+2, Lawrence Goh wrote: >>>> >>>> Hi Vincent, >>>> >>>> Apologies for another set up question. Been going everywhere and sadly >>>> to nowhere. We have set up a Azure Database for Postgresql. We could get >>>> the docker compose to create the DB. But the arches container failed due >>>> to some weird network restriction. >>>> >>>> [image: image.png] >>>> >>>> I have added IPs to the firewall. Even having it being from 0.0.0.0 to >>>> 255.255.255.255. The "Allow access to Azure services" is on. >>>> >>>> Any ideas? >>>> >>>> Thanks. >>>> >>>> Regards, >>>> Lawrence >>>> >>>> On Fri, Oct 19, 2018 at 10:32 PM Vincent Meijer >>>> wrote: >>>> >>>>> Yeah it's a weird choice from Microsoft to do things differently and >>>>> arches wasn't prepared for that @... >>>>> >>>>> >>>>> >>>>> On Fri, 19 Oct 2018, 11:23 larrygoh84, wrote: >>>>> >>>>>> using 4.3.1. does this mean its a known issue? it doesn't handle the >>>>>> @ well? :) >>>>>> >>>>>>
Re: [Arches] Re: Hosting Arches on Azure as a Web App for Containers
Hi Vincent, I noticed another odd thing. When it does the import_graphs after creating the database, it has this error. arches | FATAL: Invalid Username specified. Please check the Username and retry connection. The Username should be in format. arches | FATAL: Invalid Username specified. Please check the Username and retry connection. The Username should be in format. arches | Running: python manage.py packages -o import_reference_data -s "arches/db/schemes/arches_concept_scheme.rdf" Any idea where in the code is going nuts? :) Thanks. Regards, Lawrence On Fri, Oct 26, 2018 at 4:03 PM Lawrence Goh wrote: > Hi Vincent, > > Been digging further into the postgres libs. It seems the dsn and kwargs > in them are getting values from the 's settings.py which > contains the default db credentials (postgres; postgis). Normally, I > assumed it will get it from the arches' settings.py file. > > In case I am confusing :) When you browse the container, you would be > landed into \web_root\arches. Back down, it would be ENV, arches, > folders. > > Probably I might need a new pull from arches again and work from there. I > am unsure if my own is corrupted. > > Thanks. > > Regards, > Lawrence > > > On Thu, Oct 25, 2018 at 5:30 AM Vincent Meijer > wrote: > >> Ah I can see the image now (in email). Looks like a regular firewall >> misconfiguration. >> Can you show us your current settings? >> >> There is also the option 'Enforce SSL Connection' under 'SSL Settings' in >> your Azure DB. Is this set to Disabled? >> >> And can you connect to it from your local machine if you whitelist your >> ip in that same screen? >> >> >> On Tuesday, 23 October 2018 23:45:06 UTC+2, Lawrence Goh wrote: >>> >>> Hi Vincent, >>> >>> Apologies for another set up question. Been going everywhere and sadly >>> to nowhere. We have set up a Azure Database for Postgresql. We could get >>> the docker compose to create the DB. But the arches container failed due >>> to some weird network restriction. >>> >>> [image: image.png] >>> >>> I have added IPs to the firewall. Even having it being from 0.0.0.0 to >>> 255.255.255.255. The "Allow access to Azure services" is on. >>> >>> Any ideas? >>> >>> Thanks. >>> >>> Regards, >>> Lawrence >>> >>> On Fri, Oct 19, 2018 at 10:32 PM Vincent Meijer >>> wrote: >>> >>>> Yeah it's a weird choice from Microsoft to do things differently and >>>> arches wasn't prepared for that @... >>>> >>>> >>>> >>>> On Fri, 19 Oct 2018, 11:23 larrygoh84, wrote: >>>> >>>>> using 4.3.1. does this mean its a known issue? it doesn't handle the >>>>> @ well? :) >>>>> >>>>> Original message >>>>> From: Vincent Meijer >>>>> Date: 10/19/18 10:02 PM (GMT+12:00) >>>>> To: Arches Project >>>>> Subject: Re: [Arches] Re: Hosting Arches on Azure as a Web App for >>>>> Containers >>>>> >>>>> Which version of Arches are you using? >>>>> I created a PR (for #4099) for this earlier, but it was after 4.3.1 >>>>> was released. >>>>> >>>>> Until the next release you could use the master branch (there are >>>>> docker images built for that in Docker Hub for every new push: >>>>> https://hub.docker.com/r/archesproject/arches/tags/ ) >>>>> >>>>> However, if you want something more stable, you are also free to use >>>>> my own arches base images: >>>>> https://hub.docker.com/r/globaldigitalheritage/arches/tags/ >>>>> The current tags in there are all based on Arches 4.3.1 and I push a >>>>> new version every time I created some additional functionality / fixes for >>>>> a PR, such as the one with '@' in Azure database names. >>>>> >>>>> Currently the latest I got is globaldigitalheritage/arches:4.3.1.11 >>>>> >>>>> >>>>> I use these images as a base in my own Dockerfile >>>>> (as described in step 7 of 'Setting up your own Arches project': >>>>> https://github.com/archesproject/arches/blob/master/docker/Readme.md#setting-up-your-own-arches-project >>>>> ) >>>>> >>>>> I recommend to follow these steps to create your own Arches projec
Re: [Arches] Re: Hosting Arches on Azure as a Web App for Containers
Hi Vincent, Been digging further into the postgres libs. It seems the dsn and kwargs in them are getting values from the 's settings.py which contains the default db credentials (postgres; postgis). Normally, I assumed it will get it from the arches' settings.py file. In case I am confusing :) When you browse the container, you would be landed into \web_root\arches. Back down, it would be ENV, arches, folders. Probably I might need a new pull from arches again and work from there. I am unsure if my own is corrupted. Thanks. Regards, Lawrence On Thu, Oct 25, 2018 at 5:30 AM Vincent Meijer wrote: > Ah I can see the image now (in email). Looks like a regular firewall > misconfiguration. > Can you show us your current settings? > > There is also the option 'Enforce SSL Connection' under 'SSL Settings' in > your Azure DB. Is this set to Disabled? > > And can you connect to it from your local machine if you whitelist your ip > in that same screen? > > > On Tuesday, 23 October 2018 23:45:06 UTC+2, Lawrence Goh wrote: >> >> Hi Vincent, >> >> Apologies for another set up question. Been going everywhere and sadly >> to nowhere. We have set up a Azure Database for Postgresql. We could get >> the docker compose to create the DB. But the arches container failed due >> to some weird network restriction. >> >> [image: image.png] >> >> I have added IPs to the firewall. Even having it being from 0.0.0.0 to >> 255.255.255.255. The "Allow access to Azure services" is on. >> >> Any ideas? >> >> Thanks. >> >> Regards, >> Lawrence >> >> On Fri, Oct 19, 2018 at 10:32 PM Vincent Meijer >> wrote: >> >>> Yeah it's a weird choice from Microsoft to do things differently and >>> arches wasn't prepared for that @... >>> >>> >>> >>> On Fri, 19 Oct 2018, 11:23 larrygoh84, wrote: >>> >>>> using 4.3.1. does this mean its a known issue? it doesn't handle the @ >>>> well? :) >>>> >>>> Original message >>>> From: Vincent Meijer >>>> Date: 10/19/18 10:02 PM (GMT+12:00) >>>> To: Arches Project >>>> Subject: Re: [Arches] Re: Hosting Arches on Azure as a Web App for >>>> Containers >>>> >>>> Which version of Arches are you using? >>>> I created a PR (for #4099) for this earlier, but it was after 4.3.1 was >>>> released. >>>> >>>> Until the next release you could use the master branch (there are >>>> docker images built for that in Docker Hub for every new push: >>>> https://hub.docker.com/r/archesproject/arches/tags/ ) >>>> >>>> However, if you want something more stable, you are also free to use my >>>> own arches base images: >>>> https://hub.docker.com/r/globaldigitalheritage/arches/tags/ >>>> The current tags in there are all based on Arches 4.3.1 and I push a >>>> new version every time I created some additional functionality / fixes for >>>> a PR, such as the one with '@' in Azure database names. >>>> >>>> Currently the latest I got is globaldigitalheritage/arches:4.3.1.11 >>>> >>>> >>>> I use these images as a base in my own Dockerfile >>>> (as described in step 7 of 'Setting up your own Arches project': >>>> https://github.com/archesproject/arches/blob/master/docker/Readme.md#setting-up-your-own-arches-project >>>> ) >>>> >>>> I recommend to follow these steps to create your own Arches project, >>>> rather than editing the core Arches app. >>>> >>>> Hope this helps! >>>> Vincent >>>> >>>> >>>> On Friday, 19 October 2018 05:14:57 UTC+2, Lawrence Goh wrote: >>>>> >>>>> Hi Vincent, >>>>> >>>>> Had you faced this issue before? We are now trying to connect to >>>>> Azure DB for Postgresql. The container log just freezes at Testing if >>>>> database server is up.. Is it senstive to the @? thanks. >>>>> >>>>> On Friday, October 19, 2018 at 3:03:47 PM UTC+13, Lawrence Goh wrote: >>>>>> >>>>>> Hi Vincent, >>>>>> >>>>>> Yups. Was poking around the codes yesterday and had a go with >>>>>> removing the staticfiles_storage and all went well :) >>>>>> >>>>>> Thanks. >>>>>> >>>>>> Regards, >>>>
Re: [Arches] Re: Hosting Arches on Azure as a Web App for Containers
Ah I can see the image now (in email). Looks like a regular firewall misconfiguration. Can you show us your current settings? There is also the option 'Enforce SSL Connection' under 'SSL Settings' in your Azure DB. Is this set to Disabled? And can you connect to it from your local machine if you whitelist your ip in that same screen? On Tuesday, 23 October 2018 23:45:06 UTC+2, Lawrence Goh wrote: > > Hi Vincent, > > Apologies for another set up question. Been going everywhere and sadly to > nowhere. We have set up a Azure Database for Postgresql. We could get the > docker compose to create the DB. But the arches container failed due to > some weird network restriction. > > [image: image.png] > > I have added IPs to the firewall. Even having it being from 0.0.0.0 to > 255.255.255.255. The "Allow access to Azure services" is on. > > Any ideas? > > Thanks. > > Regards, > Lawrence > > On Fri, Oct 19, 2018 at 10:32 PM Vincent Meijer > wrote: > >> Yeah it's a weird choice from Microsoft to do things differently and >> arches wasn't prepared for that @... >> >> >> >> On Fri, 19 Oct 2018, 11:23 larrygoh84, > >> wrote: >> >>> using 4.3.1. does this mean its a known issue? it doesn't handle the @ >>> well? :) >>> >>> ---- Original message ---- >>> From: Vincent Meijer > >>> Date: 10/19/18 10:02 PM (GMT+12:00) >>> To: Arches Project > >>> Subject: Re: [Arches] Re: Hosting Arches on Azure as a Web App for >>> Containers >>> >>> Which version of Arches are you using? >>> I created a PR (for #4099) for this earlier, but it was after 4.3.1 was >>> released. >>> >>> Until the next release you could use the master branch (there are docker >>> images built for that in Docker Hub for every new push: >>> https://hub.docker.com/r/archesproject/arches/tags/ ) >>> >>> However, if you want something more stable, you are also free to use my >>> own arches base images: >>> https://hub.docker.com/r/globaldigitalheritage/arches/tags/ >>> The current tags in there are all based on Arches 4.3.1 and I push a new >>> version every time I created some additional functionality / fixes for a >>> PR, such as the one with '@' in Azure database names. >>> >>> Currently the latest I got is globaldigitalheritage/arches:4.3.1.11 >>> >>> >>> I use these images as a base in my own Dockerfile >>> (as described in step 7 of 'Setting up your own Arches project': >>> https://github.com/archesproject/arches/blob/master/docker/Readme.md#setting-up-your-own-arches-project >>> >>> ) >>> >>> I recommend to follow these steps to create your own Arches project, >>> rather than editing the core Arches app. >>> >>> Hope this helps! >>> Vincent >>> >>> >>> On Friday, 19 October 2018 05:14:57 UTC+2, Lawrence Goh wrote: >>>> >>>> Hi Vincent, >>>> >>>> Had you faced this issue before? We are now trying to connect to Azure >>>> DB for Postgresql. The container log just freezes at Testing if database >>>> server is up.. Is it senstive to the @? thanks. >>>> >>>> On Friday, October 19, 2018 at 3:03:47 PM UTC+13, Lawrence Goh wrote: >>>>> >>>>> Hi Vincent, >>>>> >>>>> Yups. Was poking around the codes yesterday and had a go with >>>>> removing the staticfiles_storage and all went well :) >>>>> >>>>> Thanks. >>>>> >>>>> Regards, >>>>> Lawrence >>>>> >>>>> On Thu, Oct 18, 2018 at 9:00 PM Vincent Meijer >>>>> wrote: >>>>> >>>>>> If I'm understanding you correctly, you want to serve static files >>>>>> the 'standard' way (directly from the Arches app using Whitenoise) and >>>>>> serve uploaded files from Azure Blob Storage? >>>>>> I do the same at the moment. For that, use: >>>>>> DEFAULT_FILE_STORAGE='storages.backends.azure_storage.AzureStorage' >>>>>> and >>>>>> STATICFILES_STORAGE = >>>>>> 'whitenoise.storage.CompressedStaticFilesStorage' >>>>>> >>>>>> (together with the other appropriate settings for Azure and >>>>>> Whitenoise, that you probably already have). >>>>>> >>>>
Re: [Arches] Re: Hosting Arches on Azure as a Web App for Containers
Hey your image is not loading. What sort of error did you receive? Since you managed to get the DB created in the first place, something must be going right! :) On Tuesday, 23 October 2018 23:45:06 UTC+2, Lawrence Goh wrote: > > Hi Vincent, > > Apologies for another set up question. Been going everywhere and sadly to > nowhere. We have set up a Azure Database for Postgresql. We could get the > docker compose to create the DB. But the arches container failed due to > some weird network restriction. > > [image: image.png] > > I have added IPs to the firewall. Even having it being from 0.0.0.0 to > 255.255.255.255. The "Allow access to Azure services" is on. > > Any ideas? > > Thanks. > > Regards, > Lawrence > > On Fri, Oct 19, 2018 at 10:32 PM Vincent Meijer > wrote: > >> Yeah it's a weird choice from Microsoft to do things differently and >> arches wasn't prepared for that @... >> >> >> >> On Fri, 19 Oct 2018, 11:23 larrygoh84, > >> wrote: >> >>> using 4.3.1. does this mean its a known issue? it doesn't handle the @ >>> well? :) >>> >>> ---- Original message ---- >>> From: Vincent Meijer > >>> Date: 10/19/18 10:02 PM (GMT+12:00) >>> To: Arches Project > >>> Subject: Re: [Arches] Re: Hosting Arches on Azure as a Web App for >>> Containers >>> >>> Which version of Arches are you using? >>> I created a PR (for #4099) for this earlier, but it was after 4.3.1 was >>> released. >>> >>> Until the next release you could use the master branch (there are docker >>> images built for that in Docker Hub for every new push: >>> https://hub.docker.com/r/archesproject/arches/tags/ ) >>> >>> However, if you want something more stable, you are also free to use my >>> own arches base images: >>> https://hub.docker.com/r/globaldigitalheritage/arches/tags/ >>> The current tags in there are all based on Arches 4.3.1 and I push a new >>> version every time I created some additional functionality / fixes for a >>> PR, such as the one with '@' in Azure database names. >>> >>> Currently the latest I got is globaldigitalheritage/arches:4.3.1.11 >>> >>> >>> I use these images as a base in my own Dockerfile >>> (as described in step 7 of 'Setting up your own Arches project': >>> https://github.com/archesproject/arches/blob/master/docker/Readme.md#setting-up-your-own-arches-project >>> >>> ) >>> >>> I recommend to follow these steps to create your own Arches project, >>> rather than editing the core Arches app. >>> >>> Hope this helps! >>> Vincent >>> >>> >>> On Friday, 19 October 2018 05:14:57 UTC+2, Lawrence Goh wrote: >>>> >>>> Hi Vincent, >>>> >>>> Had you faced this issue before? We are now trying to connect to Azure >>>> DB for Postgresql. The container log just freezes at Testing if database >>>> server is up.. Is it senstive to the @? thanks. >>>> >>>> On Friday, October 19, 2018 at 3:03:47 PM UTC+13, Lawrence Goh wrote: >>>>> >>>>> Hi Vincent, >>>>> >>>>> Yups. Was poking around the codes yesterday and had a go with >>>>> removing the staticfiles_storage and all went well :) >>>>> >>>>> Thanks. >>>>> >>>>> Regards, >>>>> Lawrence >>>>> >>>>> On Thu, Oct 18, 2018 at 9:00 PM Vincent Meijer >>>>> wrote: >>>>> >>>>>> If I'm understanding you correctly, you want to serve static files >>>>>> the 'standard' way (directly from the Arches app using Whitenoise) and >>>>>> serve uploaded files from Azure Blob Storage? >>>>>> I do the same at the moment. For that, use: >>>>>> DEFAULT_FILE_STORAGE='storages.backends.azure_storage.AzureStorage' >>>>>> and >>>>>> STATICFILES_STORAGE = >>>>>> 'whitenoise.storage.CompressedStaticFilesStorage' >>>>>> >>>>>> (together with the other appropriate settings for Azure and >>>>>> Whitenoise, that you probably already have). >>>>>> >>>>>> Does that make sense? >>>>>> >>>>>> >>>>>> On Wednesday, 17 October 2018 23:04:35 UTC+2, Lawrence Goh wrote: >&
Re: [Arches] Re: Hosting Arches on Azure as a Web App for Containers
Hi Vincent, Apologies for another set up question. Been going everywhere and sadly to nowhere. We have set up a Azure Database for Postgresql. We could get the docker compose to create the DB. But the arches container failed due to some weird network restriction. [image: image.png] I have added IPs to the firewall. Even having it being from 0.0.0.0 to 255.255.255.255. The "Allow access to Azure services" is on. Any ideas? Thanks. Regards, Lawrence On Fri, Oct 19, 2018 at 10:32 PM Vincent Meijer wrote: > Yeah it's a weird choice from Microsoft to do things differently and > arches wasn't prepared for that @... > > > > On Fri, 19 Oct 2018, 11:23 larrygoh84, wrote: > >> using 4.3.1. does this mean its a known issue? it doesn't handle the @ >> well? :) >> >> Original message >> From: Vincent Meijer >> Date: 10/19/18 10:02 PM (GMT+12:00) >> To: Arches Project >> Subject: Re: [Arches] Re: Hosting Arches on Azure as a Web App for >> Containers >> >> Which version of Arches are you using? >> I created a PR (for #4099) for this earlier, but it was after 4.3.1 was >> released. >> >> Until the next release you could use the master branch (there are docker >> images built for that in Docker Hub for every new push: >> https://hub.docker.com/r/archesproject/arches/tags/ ) >> >> However, if you want something more stable, you are also free to use my >> own arches base images: >> https://hub.docker.com/r/globaldigitalheritage/arches/tags/ >> The current tags in there are all based on Arches 4.3.1 and I push a new >> version every time I created some additional functionality / fixes for a >> PR, such as the one with '@' in Azure database names. >> >> Currently the latest I got is globaldigitalheritage/arches:4.3.1.11 >> >> >> I use these images as a base in my own Dockerfile >> (as described in step 7 of 'Setting up your own Arches project': >> https://github.com/archesproject/arches/blob/master/docker/Readme.md#setting-up-your-own-arches-project >> ) >> >> I recommend to follow these steps to create your own Arches project, >> rather than editing the core Arches app. >> >> Hope this helps! >> Vincent >> >> >> On Friday, 19 October 2018 05:14:57 UTC+2, Lawrence Goh wrote: >>> >>> Hi Vincent, >>> >>> Had you faced this issue before? We are now trying to connect to Azure >>> DB for Postgresql. The container log just freezes at Testing if database >>> server is up.. Is it senstive to the @? thanks. >>> >>> On Friday, October 19, 2018 at 3:03:47 PM UTC+13, Lawrence Goh wrote: >>>> >>>> Hi Vincent, >>>> >>>> Yups. Was poking around the codes yesterday and had a go with removing >>>> the staticfiles_storage and all went well :) >>>> >>>> Thanks. >>>> >>>> Regards, >>>> Lawrence >>>> >>>> On Thu, Oct 18, 2018 at 9:00 PM Vincent Meijer >>>> wrote: >>>> >>>>> If I'm understanding you correctly, you want to serve static files the >>>>> 'standard' way (directly from the Arches app using Whitenoise) and serve >>>>> uploaded files from Azure Blob Storage? >>>>> I do the same at the moment. For that, use: >>>>> DEFAULT_FILE_STORAGE='storages.backends.azure_storage.AzureStorage' >>>>> and >>>>> STATICFILES_STORAGE = 'whitenoise.storage.CompressedStaticFilesStorage' >>>>> >>>>> (together with the other appropriate settings for Azure and >>>>> Whitenoise, that you probably already have). >>>>> >>>>> Does that make sense? >>>>> >>>>> >>>>> On Wednesday, 17 October 2018 23:04:35 UTC+2, Lawrence Goh wrote: >>>>>> >>>>>> Hi Vincent, >>>>>> >>>>>> Thanks for that link. Will need to figure to adapt it for Azure use. >>>>>> >>>>>> Besides that, I noticed it loads all the static files into the blob. >>>>>> Was thinking to have the static files be in the container. Only push the >>>>>> uploaded 'media files' into the blob. I guess it doesn't do that right? >>>>>> :) >>>>>> >>>>>> Thanks. >>>>>> >>>>>> Regards, >>>>>> Lawrence >>>>>> >>>>>> On Thu, Oct 18, 2018 at 2:12 AM Vincent Meijer >
Re: [Arches] Re: Hosting Arches on Azure as a Web App for Containers
Yeah it's a weird choice from Microsoft to do things differently and arches wasn't prepared for that @... On Fri, 19 Oct 2018, 11:23 larrygoh84, wrote: > using 4.3.1. does this mean its a known issue? it doesn't handle the @ > well? :) > > Original message > From: Vincent Meijer > Date: 10/19/18 10:02 PM (GMT+12:00) > To: Arches Project > Subject: Re: [Arches] Re: Hosting Arches on Azure as a Web App for > Containers > > Which version of Arches are you using? > I created a PR (for #4099) for this earlier, but it was after 4.3.1 was > released. > > Until the next release you could use the master branch (there are docker > images built for that in Docker Hub for every new push: > https://hub.docker.com/r/archesproject/arches/tags/ ) > > However, if you want something more stable, you are also free to use my > own arches base images: > https://hub.docker.com/r/globaldigitalheritage/arches/tags/ > The current tags in there are all based on Arches 4.3.1 and I push a new > version every time I created some additional functionality / fixes for a > PR, such as the one with '@' in Azure database names. > > Currently the latest I got is globaldigitalheritage/arches:4.3.1.11 > > > I use these images as a base in my own Dockerfile > (as described in step 7 of 'Setting up your own Arches project': > https://github.com/archesproject/arches/blob/master/docker/Readme.md#setting-up-your-own-arches-project > ) > > I recommend to follow these steps to create your own Arches project, > rather than editing the core Arches app. > > Hope this helps! > Vincent > > > On Friday, 19 October 2018 05:14:57 UTC+2, Lawrence Goh wrote: >> >> Hi Vincent, >> >> Had you faced this issue before? We are now trying to connect to Azure >> DB for Postgresql. The container log just freezes at Testing if database >> server is up.. Is it senstive to the @? thanks. >> >> On Friday, October 19, 2018 at 3:03:47 PM UTC+13, Lawrence Goh wrote: >>> >>> Hi Vincent, >>> >>> Yups. Was poking around the codes yesterday and had a go with removing >>> the staticfiles_storage and all went well :) >>> >>> Thanks. >>> >>> Regards, >>> Lawrence >>> >>> On Thu, Oct 18, 2018 at 9:00 PM Vincent Meijer >>> wrote: >>> >>>> If I'm understanding you correctly, you want to serve static files the >>>> 'standard' way (directly from the Arches app using Whitenoise) and serve >>>> uploaded files from Azure Blob Storage? >>>> I do the same at the moment. For that, use: >>>> DEFAULT_FILE_STORAGE='storages.backends.azure_storage.AzureStorage' >>>> and >>>> STATICFILES_STORAGE = 'whitenoise.storage.CompressedStaticFilesStorage' >>>> >>>> (together with the other appropriate settings for Azure and Whitenoise, >>>> that you probably already have). >>>> >>>> Does that make sense? >>>> >>>> >>>> On Wednesday, 17 October 2018 23:04:35 UTC+2, Lawrence Goh wrote: >>>>> >>>>> Hi Vincent, >>>>> >>>>> Thanks for that link. Will need to figure to adapt it for Azure use. >>>>> >>>>> Besides that, I noticed it loads all the static files into the blob. >>>>> Was thinking to have the static files be in the container. Only push the >>>>> uploaded 'media files' into the blob. I guess it doesn't do that right? >>>>> :) >>>>> >>>>> Thanks. >>>>> >>>>> Regards, >>>>> Lawrence >>>>> >>>>> On Thu, Oct 18, 2018 at 2:12 AM Vincent Meijer >>>>> wrote: >>>>> >>>>>> The collectfast package looks promising: >>>>>> https://stackoverflow.com/questions/16805232/faster-alternative-to-manage-py-collectstatic-w-s3boto-storage-backend-to-syn >>>>>> >>>>>> -- >>>>>> -- To post, send email to arches...@googlegroups.com. To >>>>>> unsubscribe, send email to archesprojec...@googlegroups.com. For >>>>>> more information, visit >>>>>> https://groups.google.com/d/forum/archesproject?hl=en >>>>>> --- >>>>>> You received this message because you are subscribed to the Google >>>>>> Groups "Arches Project" group. >>>>>> To unsubscribe from this group and stop receiving emails from it, >>>>>> send an email to arches
Re: [Arches] Re: Hosting Arches on Azure as a Web App for Containers
Which version of Arches are you using? I created a PR (for #4099) for this earlier, but it was after 4.3.1 was released. Until the next release you could use the master branch (there are docker images built for that in Docker Hub for every new push: https://hub.docker.com/r/archesproject/arches/tags/ ) However, if you want something more stable, you are also free to use my own arches base images: https://hub.docker.com/r/globaldigitalheritage/arches/tags/ The current tags in there are all based on Arches 4.3.1 and I push a new version every time I created some additional functionality / fixes for a PR, such as the one with '@' in Azure database names. Currently the latest I got is globaldigitalheritage/arches:4.3.1.11 I use these images as a base in my own Dockerfile (as described in step 7 of 'Setting up your own Arches project': https://github.com/archesproject/arches/blob/master/docker/Readme.md#setting-up-your-own-arches-project ) I recommend to follow these steps to create your own Arches project, rather than editing the core Arches app. Hope this helps! Vincent On Friday, 19 October 2018 05:14:57 UTC+2, Lawrence Goh wrote: > > Hi Vincent, > > Had you faced this issue before? We are now trying to connect to Azure DB > for Postgresql. The container log just freezes at Testing if database > server is up.. Is it senstive to the @? thanks. > > On Friday, October 19, 2018 at 3:03:47 PM UTC+13, Lawrence Goh wrote: >> >> Hi Vincent, >> >> Yups. Was poking around the codes yesterday and had a go with removing >> the staticfiles_storage and all went well :) >> >> Thanks. >> >> Regards, >> Lawrence >> >> On Thu, Oct 18, 2018 at 9:00 PM Vincent Meijer > > wrote: >> >>> If I'm understanding you correctly, you want to serve static files the >>> 'standard' way (directly from the Arches app using Whitenoise) and serve >>> uploaded files from Azure Blob Storage? >>> I do the same at the moment. For that, use: >>> DEFAULT_FILE_STORAGE='storages.backends.azure_storage.AzureStorage' >>> and >>> STATICFILES_STORAGE = 'whitenoise.storage.CompressedStaticFilesStorage' >>> >>> (together with the other appropriate settings for Azure and Whitenoise, >>> that you probably already have). >>> >>> Does that make sense? >>> >>> >>> On Wednesday, 17 October 2018 23:04:35 UTC+2, Lawrence Goh wrote: Hi Vincent, Thanks for that link. Will need to figure to adapt it for Azure use. Besides that, I noticed it loads all the static files into the blob. Was thinking to have the static files be in the container. Only push the uploaded 'media files' into the blob. I guess it doesn't do that right? :) Thanks. Regards, Lawrence On Thu, Oct 18, 2018 at 2:12 AM Vincent Meijer wrote: > The collectfast package looks promising: > https://stackoverflow.com/questions/16805232/faster-alternative-to-manage-py-collectstatic-w-s3boto-storage-backend-to-syn > > -- > -- To post, send email to arches...@googlegroups.com. To unsubscribe, > send email to archesprojec...@googlegroups.com. For more information, > visit https://groups.google.com/d/forum/archesproject?hl=en > --- > You received this message because you are subscribed to the Google > Groups "Arches Project" group. > To unsubscribe from this group and stop receiving emails from it, send > an email to archesprojec...@googlegroups.com. > For more options, visit https://groups.google.com/d/optout. > -- >>> -- To post, send email to arches...@googlegroups.com . To >>> unsubscribe, send email to archesprojec...@googlegroups.com >>> . For more information, visit >>> https://groups.google.com/d/forum/archesproject?hl=en >>> --- >>> You received this message because you are subscribed to the Google >>> Groups "Arches Project" group. >>> To unsubscribe from this group and stop receiving emails from it, send >>> an email to archesprojec...@googlegroups.com . >>> For more options, visit https://groups.google.com/d/optout. >>> >> -- -- To post, send email to archesproject@googlegroups.com. To unsubscribe, send email to archesproject+unsubscr...@googlegroups.com. For more information, visit https://groups.google.com/d/forum/archesproject?hl=en --- You received this message because you are subscribed to the Google Groups "Arches Project" group. To unsubscribe from this group and stop receiving emails from it, send an email to archesproject+unsubscr...@googlegroups.com. For more options, visit https://groups.google.com/d/optout.
Re: [Arches] Re: Hosting Arches on Azure as a Web App for Containers
Hi Vincent, Yups. Was poking around the codes yesterday and had a go with removing the staticfiles_storage and all went well :) Thanks. Regards, Lawrence On Thu, Oct 18, 2018 at 9:00 PM Vincent Meijer wrote: > If I'm understanding you correctly, you want to serve static files the > 'standard' way (directly from the Arches app using Whitenoise) and serve > uploaded files from Azure Blob Storage? > I do the same at the moment. For that, use: > DEFAULT_FILE_STORAGE='storages.backends.azure_storage.AzureStorage' > and > STATICFILES_STORAGE = 'whitenoise.storage.CompressedStaticFilesStorage' > > (together with the other appropriate settings for Azure and Whitenoise, > that you probably already have). > > Does that make sense? > > > On Wednesday, 17 October 2018 23:04:35 UTC+2, Lawrence Goh wrote: >> >> Hi Vincent, >> >> Thanks for that link. Will need to figure to adapt it for Azure use. >> >> Besides that, I noticed it loads all the static files into the blob. Was >> thinking to have the static files be in the container. Only push the >> uploaded 'media files' into the blob. I guess it doesn't do that right? :) >> >> Thanks. >> >> Regards, >> Lawrence >> >> On Thu, Oct 18, 2018 at 2:12 AM Vincent Meijer >> wrote: >> >>> The collectfast package looks promising: >>> https://stackoverflow.com/questions/16805232/faster-alternative-to-manage-py-collectstatic-w-s3boto-storage-backend-to-syn >>> >>> -- >>> -- To post, send email to arches...@googlegroups.com. To unsubscribe, >>> send email to archesprojec...@googlegroups.com. For more information, >>> visit https://groups.google.com/d/forum/archesproject?hl=en >>> --- >>> You received this message because you are subscribed to the Google >>> Groups "Arches Project" group. >>> To unsubscribe from this group and stop receiving emails from it, send >>> an email to archesprojec...@googlegroups.com. >>> For more options, visit https://groups.google.com/d/optout. >>> >> -- > -- To post, send email to archesproject@googlegroups.com. To unsubscribe, > send email to archesproject+unsubscr...@googlegroups.com. For more > information, visit https://groups.google.com/d/forum/archesproject?hl=en > --- > You received this message because you are subscribed to the Google Groups > "Arches Project" group. > To unsubscribe from this group and stop receiving emails from it, send an > email to archesproject+unsubscr...@googlegroups.com. > For more options, visit https://groups.google.com/d/optout. > -- -- To post, send email to archesproject@googlegroups.com. To unsubscribe, send email to archesproject+unsubscr...@googlegroups.com. For more information, visit https://groups.google.com/d/forum/archesproject?hl=en --- You received this message because you are subscribed to the Google Groups "Arches Project" group. To unsubscribe from this group and stop receiving emails from it, send an email to archesproject+unsubscr...@googlegroups.com. For more options, visit https://groups.google.com/d/optout.
Re: [Arches] Re: Hosting Arches on Azure as a Web App for Containers
If I'm understanding you correctly, you want to serve static files the 'standard' way (directly from the Arches app using Whitenoise) and serve uploaded files from Azure Blob Storage? I do the same at the moment. For that, use: DEFAULT_FILE_STORAGE='storages.backends.azure_storage.AzureStorage' and STATICFILES_STORAGE = 'whitenoise.storage.CompressedStaticFilesStorage' (together with the other appropriate settings for Azure and Whitenoise, that you probably already have). Does that make sense? On Wednesday, 17 October 2018 23:04:35 UTC+2, Lawrence Goh wrote: > > Hi Vincent, > > Thanks for that link. Will need to figure to adapt it for Azure use. > > Besides that, I noticed it loads all the static files into the blob. Was > thinking to have the static files be in the container. Only push the > uploaded 'media files' into the blob. I guess it doesn't do that right? :) > > Thanks. > > Regards, > Lawrence > > On Thu, Oct 18, 2018 at 2:12 AM Vincent Meijer > wrote: > >> The collectfast package looks promising: >> https://stackoverflow.com/questions/16805232/faster-alternative-to-manage-py-collectstatic-w-s3boto-storage-backend-to-syn >> >> -- >> -- To post, send email to arches...@googlegroups.com . To >> unsubscribe, send email to archesprojec...@googlegroups.com . >> For more information, visit >> https://groups.google.com/d/forum/archesproject?hl=en >> --- >> You received this message because you are subscribed to the Google Groups >> "Arches Project" group. >> To unsubscribe from this group and stop receiving emails from it, send an >> email to archesprojec...@googlegroups.com . >> For more options, visit https://groups.google.com/d/optout. >> > -- -- To post, send email to archesproject@googlegroups.com. To unsubscribe, send email to archesproject+unsubscr...@googlegroups.com. For more information, visit https://groups.google.com/d/forum/archesproject?hl=en --- You received this message because you are subscribed to the Google Groups "Arches Project" group. To unsubscribe from this group and stop receiving emails from it, send an email to archesproject+unsubscr...@googlegroups.com. For more options, visit https://groups.google.com/d/optout.
Re: [Arches] Re: Hosting Arches on Azure as a Web App for Containers
Hi Vincent, Thanks for that link. Will need to figure to adapt it for Azure use. Besides that, I noticed it loads all the static files into the blob. Was thinking to have the static files be in the container. Only push the uploaded 'media files' into the blob. I guess it doesn't do that right? :) Thanks. Regards, Lawrence On Thu, Oct 18, 2018 at 2:12 AM Vincent Meijer wrote: > The collectfast package looks promising: > https://stackoverflow.com/questions/16805232/faster-alternative-to-manage-py-collectstatic-w-s3boto-storage-backend-to-syn > > -- > -- To post, send email to archesproject@googlegroups.com. To unsubscribe, > send email to archesproject+unsubscr...@googlegroups.com. For more > information, visit https://groups.google.com/d/forum/archesproject?hl=en > --- > You received this message because you are subscribed to the Google Groups > "Arches Project" group. > To unsubscribe from this group and stop receiving emails from it, send an > email to archesproject+unsubscr...@googlegroups.com. > For more options, visit https://groups.google.com/d/optout. > -- -- To post, send email to archesproject@googlegroups.com. To unsubscribe, send email to archesproject+unsubscr...@googlegroups.com. For more information, visit https://groups.google.com/d/forum/archesproject?hl=en --- You received this message because you are subscribed to the Google Groups "Arches Project" group. To unsubscribe from this group and stop receiving emails from it, send an email to archesproject+unsubscr...@googlegroups.com. For more options, visit https://groups.google.com/d/optout.
Re: [Arches] Re: Hosting Arches on Azure as a Web App for Containers
The collectfast package looks promising: https://stackoverflow.com/questions/16805232/faster-alternative-to-manage-py-collectstatic-w-s3boto-storage-backend-to-syn -- -- To post, send email to archesproject@googlegroups.com. To unsubscribe, send email to archesproject+unsubscr...@googlegroups.com. For more information, visit https://groups.google.com/d/forum/archesproject?hl=en --- You received this message because you are subscribed to the Google Groups "Arches Project" group. To unsubscribe from this group and stop receiving emails from it, send an email to archesproject+unsubscr...@googlegroups.com. For more options, visit https://groups.google.com/d/optout.
Re: [Arches] Re: Hosting Arches on Azure as a Web App for Containers
I haven't, but now that you mention that it sounds familiar. I did notice that the collectstatic method takes very long when using blob storage for static files, I think sometimes even 30 minutes or so when running locally on my laptop. I think it has to do with the fact that it rechecks all the existing files in blob storage to see if they are updated. To be honest I currently don't have a solution for that... So I hope you will find one and share! :) On Wed, Oct 17, 2018 at 2:01 PM Lawrence Goh wrote: > Hi Vincent, > > I saw the post on static files with azure storage. Have you come across > where the first time it loads all the files in the blob, but the container > fails/gets stuck on the second time when it does the static files? > > Thanks. > > Regards, > Lawrence > > On Tue, Oct 16, 2018, 10:46 PM Vincent Meijer > wrote: > >> Sounds familiar, the loading of static files took a long time. Once they >> are cached everything is fine, but an initial page load of 2 minutes was a >> bit much in my opinion :) >> Azure CDN might help with that. >> >> Anyway, good luck and keep us posted! >> Vincent >> >> >> On Monday, 15 October 2018 22:58:48 UTC+2, Lawrence Goh wrote: >>> >>> Hi Vincent, >>> >>> We have yet to populate data within. So couldn't do much search >>> though. However, I noticed on some devices it would be slow first time, >>> while some just in a flash. >>> >>> Once it is loaded, the following sessions is like a breeze. >>> >>> Now we are trying to create a blob storage for the media files. >>> >>> Thanks. >>> >>> Regards, >>> Lawrence >>> >>> On Mon, Oct 15, 2018 at 11:33 PM Vincent Meijer >>> wrote: >>> How is Web App's performance for you? How long does a GET request of e.g. the /search page take? Best, Vincent -- -- To post, send email to arches...@googlegroups.com. To unsubscribe, send email to archesprojec...@googlegroups.com. For more information, visit https://groups.google.com/d/forum/archesproject?hl=en --- You received this message because you are subscribed to the Google Groups "Arches Project" group. To unsubscribe from this group and stop receiving emails from it, send an email to archesprojec...@googlegroups.com. For more options, visit https://groups.google.com/d/optout. >>> -- >> -- To post, send email to archesproject@googlegroups.com. To >> unsubscribe, send email to archesproject+unsubscr...@googlegroups.com. >> For more information, visit >> https://groups.google.com/d/forum/archesproject?hl=en >> --- >> You received this message because you are subscribed to the Google Groups >> "Arches Project" group. >> To unsubscribe from this group and stop receiving emails from it, send an >> email to archesproject+unsubscr...@googlegroups.com. >> For more options, visit https://groups.google.com/d/optout. >> > -- -- To post, send email to archesproject@googlegroups.com. To unsubscribe, send email to archesproject+unsubscr...@googlegroups.com. For more information, visit https://groups.google.com/d/forum/archesproject?hl=en --- You received this message because you are subscribed to the Google Groups "Arches Project" group. To unsubscribe from this group and stop receiving emails from it, send an email to archesproject+unsubscr...@googlegroups.com. For more options, visit https://groups.google.com/d/optout.
Re: [Arches] Re: Hosting Arches on Azure as a Web App for Containers
Hi Vincent, I saw the post on static files with azure storage. Have you come across where the first time it loads all the files in the blob, but the container fails/gets stuck on the second time when it does the static files? Thanks. Regards, Lawrence On Tue, Oct 16, 2018, 10:46 PM Vincent Meijer wrote: > Sounds familiar, the loading of static files took a long time. Once they > are cached everything is fine, but an initial page load of 2 minutes was a > bit much in my opinion :) > Azure CDN might help with that. > > Anyway, good luck and keep us posted! > Vincent > > > On Monday, 15 October 2018 22:58:48 UTC+2, Lawrence Goh wrote: >> >> Hi Vincent, >> >> We have yet to populate data within. So couldn't do much search though. >> However, I noticed on some devices it would be slow first time, while some >> just in a flash. >> >> Once it is loaded, the following sessions is like a breeze. >> >> Now we are trying to create a blob storage for the media files. >> >> Thanks. >> >> Regards, >> Lawrence >> >> On Mon, Oct 15, 2018 at 11:33 PM Vincent Meijer >> wrote: >> >>> How is Web App's performance for you? >>> How long does a GET request of e.g. the /search page take? >>> >>> Best, >>> Vincent >>> >>> -- >>> -- To post, send email to arches...@googlegroups.com. To unsubscribe, >>> send email to archesprojec...@googlegroups.com. For more information, >>> visit https://groups.google.com/d/forum/archesproject?hl=en >>> --- >>> You received this message because you are subscribed to the Google >>> Groups "Arches Project" group. >>> To unsubscribe from this group and stop receiving emails from it, send >>> an email to archesprojec...@googlegroups.com. >>> For more options, visit https://groups.google.com/d/optout. >>> >> -- > -- To post, send email to archesproject@googlegroups.com. To unsubscribe, > send email to archesproject+unsubscr...@googlegroups.com. For more > information, visit https://groups.google.com/d/forum/archesproject?hl=en > --- > You received this message because you are subscribed to the Google Groups > "Arches Project" group. > To unsubscribe from this group and stop receiving emails from it, send an > email to archesproject+unsubscr...@googlegroups.com. > For more options, visit https://groups.google.com/d/optout. > -- -- To post, send email to archesproject@googlegroups.com. To unsubscribe, send email to archesproject+unsubscr...@googlegroups.com. For more information, visit https://groups.google.com/d/forum/archesproject?hl=en --- You received this message because you are subscribed to the Google Groups "Arches Project" group. To unsubscribe from this group and stop receiving emails from it, send an email to archesproject+unsubscr...@googlegroups.com. For more options, visit https://groups.google.com/d/optout.
Re: [Arches] Re: Hosting Arches on Azure as a Web App for Containers
Sounds familiar, the loading of static files took a long time. Once they are cached everything is fine, but an initial page load of 2 minutes was a bit much in my opinion :) Azure CDN might help with that. Anyway, good luck and keep us posted! Vincent On Monday, 15 October 2018 22:58:48 UTC+2, Lawrence Goh wrote: > > Hi Vincent, > > We have yet to populate data within. So couldn't do much search though. > However, I noticed on some devices it would be slow first time, while some > just in a flash. > > Once it is loaded, the following sessions is like a breeze. > > Now we are trying to create a blob storage for the media files. > > Thanks. > > Regards, > Lawrence > > On Mon, Oct 15, 2018 at 11:33 PM Vincent Meijer > wrote: > >> How is Web App's performance for you? >> How long does a GET request of e.g. the /search page take? >> >> Best, >> Vincent >> >> -- >> -- To post, send email to arches...@googlegroups.com . To >> unsubscribe, send email to archesprojec...@googlegroups.com . >> For more information, visit >> https://groups.google.com/d/forum/archesproject?hl=en >> --- >> You received this message because you are subscribed to the Google Groups >> "Arches Project" group. >> To unsubscribe from this group and stop receiving emails from it, send an >> email to archesprojec...@googlegroups.com . >> For more options, visit https://groups.google.com/d/optout. >> > -- -- To post, send email to archesproject@googlegroups.com. To unsubscribe, send email to archesproject+unsubscr...@googlegroups.com. For more information, visit https://groups.google.com/d/forum/archesproject?hl=en --- You received this message because you are subscribed to the Google Groups "Arches Project" group. To unsubscribe from this group and stop receiving emails from it, send an email to archesproject+unsubscr...@googlegroups.com. For more options, visit https://groups.google.com/d/optout.
Re: [Arches] Re: Hosting Arches on Azure as a Web App for Containers
Hi Vincent, We have yet to populate data within. So couldn't do much search though. However, I noticed on some devices it would be slow first time, while some just in a flash. Once it is loaded, the following sessions is like a breeze. Now we are trying to create a blob storage for the media files. Thanks. Regards, Lawrence On Mon, Oct 15, 2018 at 11:33 PM Vincent Meijer wrote: > How is Web App's performance for you? > How long does a GET request of e.g. the /search page take? > > Best, > Vincent > > -- > -- To post, send email to archesproject@googlegroups.com. To unsubscribe, > send email to archesproject+unsubscr...@googlegroups.com. For more > information, visit https://groups.google.com/d/forum/archesproject?hl=en > --- > You received this message because you are subscribed to the Google Groups > "Arches Project" group. > To unsubscribe from this group and stop receiving emails from it, send an > email to archesproject+unsubscr...@googlegroups.com. > For more options, visit https://groups.google.com/d/optout. > -- -- To post, send email to archesproject@googlegroups.com. To unsubscribe, send email to archesproject+unsubscr...@googlegroups.com. For more information, visit https://groups.google.com/d/forum/archesproject?hl=en --- You received this message because you are subscribed to the Google Groups "Arches Project" group. To unsubscribe from this group and stop receiving emails from it, send an email to archesproject+unsubscr...@googlegroups.com. For more options, visit https://groups.google.com/d/optout.
Re: [Arches] Re: Hosting Arches on Azure as a Web App for Containers
How is Web App's performance for you? How long does a GET request of e.g. the /search page take? Best, Vincent -- -- To post, send email to archesproject@googlegroups.com. To unsubscribe, send email to archesproject+unsubscr...@googlegroups.com. For more information, visit https://groups.google.com/d/forum/archesproject?hl=en --- You received this message because you are subscribed to the Google Groups "Arches Project" group. To unsubscribe from this group and stop receiving emails from it, send an email to archesproject+unsubscr...@googlegroups.com. For more options, visit https://groups.google.com/d/optout.
Re: [Arches] Re: Hosting Arches on Azure as a Web App for Containers
Excellent news, glad to hear it! On Fri, 12 Oct 2018, 02:41 Lawrence Goh, wrote: > Hi Vincent, > > Thank you so much for all the help and information. I finally got it > running on Azure. Adding on, I have changed the ports back to 8000:8000. > > Thanks again. > > Regards, > Lawrence > > On Thu, Oct 11, 2018 at 8:11 PM Vincent Meijer > wrote: > >> In your case the Azure Web App takes on the role of Nginx, so you don't >> need that. >> Gunicorn is already built into the Arches image (see the command in the >> entrypoint.sh), which is going to talk to your Web App. >> >> >> Regarding whitenoise, you don't need to set STATIC_ROOT, as it is already >> set for you (see docker/settings_local.py). Default value is / >> static_root which is fine. >> Also, don't add the 'from whitenoise import WhiteNoise' line to your >> wsgi.py file, those steps are for other systems besides Django (skip >> everything after 'QuickStart for other WSGI apps'). >> >> Tip: you can add whitenoise to your requirements.txt so you have all your >> requirements in one place, preferably with a version number: >> whitenoise==4.1 >> Then remove it from your entrypoint.sh >> >> If you can't get it to work: start with the simplest set up. >> You can first try to get it running locally instead of in Azure Web App. >> Perhaps first with DJANGO_MODE=DEV and DJANGO_DEBUG=True (in your >> docker-compose.yml) >> With those settings you don't need Whitenoise (but dev mode is not safe >> for production environments). >> If that works, set those settings back to PROD and False and try to get >> Whitenoise working. >> Then if that works, move over to Web App. >> >> Also be sure to remove nginx from your local docker-compose.yml, since >> your goal is to run Arches without it in your Web App. >> >> Good luck and let me know how it goes! >> Vincent >> >> On Thursday, 11 October 2018 05:48:18 UTC+2, Lawrence Goh wrote: >>> >>> Hi Vincent, >>> >>> I found more info on gunicorn and nginx. it seems they need each other. >>> >>> >>> https://stackoverflow.com/questions/12800862/how-to-make-django-serve-static-files-with-gunicorn >>> >>> What do you think? >>> >>> Thanks. >>> >>> Regards, >>> Lawrence >>> >>> On Thu, Oct 11, 2018, 3:58 PM Lawrence Goh wrote: >>> Hi Vincent, I am trying to have whitenoise in. Have you done it before? I have modified entrypoint.sh to include 'pip install whitenoise' after the virtual environment creation. Modified settings.py to have STATIC_ROOT with this 'os.path.join(ROOT_DIR, 'staticfiles') and the entry in MIDDLEWARE. Plus, wsgi.py file to have 'from whitenoise import WhiteNoise'. Unsure if anywhere else was missed. Thanks. Regards, Lawrence On Wed, Oct 10, 2018 at 9:09 PM Vincent Meijer wrote: > Ah, I think I know what the problem is. Didn't think of this before, > but Django does not want to serve static files (css, js, images, etc) when > in PROD mode (and DEBUG=False). > > There are two routes I can think of right now: > 1. Set up White Noise to make Django serve static files ( > http://whitenoise.evans.io/en/stable/) > 2. Set up the Azure CDN I described above > > I would personally go with option 2, because for me that made a big > difference in terms of performance. > > > On Wednesday, 10 October 2018 05:04:14 UTC+2, Lawrence Goh wrote: >> >> Hi Vincent, >> >> I guess I celebrated too early. I removed the cache and now the site >> on port 80 is broken as the images and JS are not downloaded. Any idea >> on >> this? >> >> Thanks. >> >> Regards, >> Lawrence >> >> On Wed, Oct 10, 2018 at 2:36 PM Lawrence Goh >> wrote: >> >>> Hi Vincent, >>> >>> Thanks a lot of the suggestion. I tried the suggestion on dumping >>> nginx and changing the port number but I kept couchdb as it is though. >>> It >>> is working as a web app for containers using multi-container. >>> >>> Will put the single container approach on the pipeline :) >>> >>> Thanks again! >>> >>> Regards, >>> Lawrence >>> >>> On Wed, Oct 10, 2018 at 12:13 AM Vincent Meijer < >>> meijer@gmail.com> wrote: >>> No worries, I come from a .net environment myself. As for the App Service, I realized that I set up Postgres and Elasticsearch separately, that is why I was able to use the Single Container approach (see below for future reference). I just remembered I wasn't able to get the docker-compose approach working in the App Service. If you like to give it another try, you could remove the nginx service from your docker-compose.yml. Then add a port mapping on your arches service in your docker-compose.yml from 80 on the host (App Service) to 8000 on the container:
Re: [Arches] Re: Hosting Arches on Azure as a Web App for Containers
Hi Vincent, Thank you so much for all the help and information. I finally got it running on Azure. Adding on, I have changed the ports back to 8000:8000. Thanks again. Regards, Lawrence On Thu, Oct 11, 2018 at 8:11 PM Vincent Meijer wrote: > In your case the Azure Web App takes on the role of Nginx, so you don't > need that. > Gunicorn is already built into the Arches image (see the command in the > entrypoint.sh), which is going to talk to your Web App. > > > Regarding whitenoise, you don't need to set STATIC_ROOT, as it is already > set for you (see docker/settings_local.py). Default value is /static_root > which > is fine. > Also, don't add the 'from whitenoise import WhiteNoise' line to your > wsgi.py file, those steps are for other systems besides Django (skip > everything after 'QuickStart for other WSGI apps'). > > Tip: you can add whitenoise to your requirements.txt so you have all your > requirements in one place, preferably with a version number: > whitenoise==4.1 > Then remove it from your entrypoint.sh > > If you can't get it to work: start with the simplest set up. > You can first try to get it running locally instead of in Azure Web App. > Perhaps first with DJANGO_MODE=DEV and DJANGO_DEBUG=True (in your > docker-compose.yml) > With those settings you don't need Whitenoise (but dev mode is not safe > for production environments). > If that works, set those settings back to PROD and False and try to get > Whitenoise working. > Then if that works, move over to Web App. > > Also be sure to remove nginx from your local docker-compose.yml, since > your goal is to run Arches without it in your Web App. > > Good luck and let me know how it goes! > Vincent > > On Thursday, 11 October 2018 05:48:18 UTC+2, Lawrence Goh wrote: >> >> Hi Vincent, >> >> I found more info on gunicorn and nginx. it seems they need each other. >> >> >> https://stackoverflow.com/questions/12800862/how-to-make-django-serve-static-files-with-gunicorn >> >> What do you think? >> >> Thanks. >> >> Regards, >> Lawrence >> >> On Thu, Oct 11, 2018, 3:58 PM Lawrence Goh wrote: >> >>> Hi Vincent, >>> >>> I am trying to have whitenoise in. Have you done it before? >>> >>> I have modified entrypoint.sh to include 'pip install whitenoise' after >>> the virtual environment creation. Modified settings.py to have STATIC_ROOT >>> with this 'os.path.join(ROOT_DIR, 'staticfiles') and the entry in >>> MIDDLEWARE. Plus, wsgi.py file to have 'from whitenoise import WhiteNoise'. >>> >>> Unsure if anywhere else was missed. >>> >>> Thanks. >>> >>> Regards, >>> Lawrence >>> >>> On Wed, Oct 10, 2018 at 9:09 PM Vincent Meijer >>> wrote: >>> Ah, I think I know what the problem is. Didn't think of this before, but Django does not want to serve static files (css, js, images, etc) when in PROD mode (and DEBUG=False). There are two routes I can think of right now: 1. Set up White Noise to make Django serve static files ( http://whitenoise.evans.io/en/stable/) 2. Set up the Azure CDN I described above I would personally go with option 2, because for me that made a big difference in terms of performance. On Wednesday, 10 October 2018 05:04:14 UTC+2, Lawrence Goh wrote: > > Hi Vincent, > > I guess I celebrated too early. I removed the cache and now the site > on port 80 is broken as the images and JS are not downloaded. Any idea on > this? > > Thanks. > > Regards, > Lawrence > > On Wed, Oct 10, 2018 at 2:36 PM Lawrence Goh > wrote: > >> Hi Vincent, >> >> Thanks a lot of the suggestion. I tried the suggestion on dumping >> nginx and changing the port number but I kept couchdb as it is though. >> It >> is working as a web app for containers using multi-container. >> >> Will put the single container approach on the pipeline :) >> >> Thanks again! >> >> Regards, >> Lawrence >> >> On Wed, Oct 10, 2018 at 12:13 AM Vincent Meijer >> wrote: >> >>> No worries, I come from a .net environment myself. >>> As for the App Service, I realized that I set up Postgres and >>> Elasticsearch separately, that is why I was able to use the Single >>> Container approach (see below for future reference). >>> >>> I just remembered I wasn't able to get the docker-compose approach >>> working in the App Service. >>> If you like to give it another try, you could remove the nginx >>> service from your docker-compose.yml. >>> Then add a port mapping on your arches service in your >>> docker-compose.yml from 80 on the host (App Service) to 8000 on the >>> container: >>> Change: >>> ports: >>> - '8000:8000' >>> To: >>> ports: >>> - '80:8000' >>> >>> Also be sure to set the DOMAIN_NAMES setting in your >>> docker-compose.yml to the address of your web app. >>> >>> Finally, you may try
Re: [Arches] Re: Hosting Arches on Azure as a Web App for Containers
In your case the Azure Web App takes on the role of Nginx, so you don't need that. Gunicorn is already built into the Arches image (see the command in the entrypoint.sh), which is going to talk to your Web App. Regarding whitenoise, you don't need to set STATIC_ROOT, as it is already set for you (see docker/settings_local.py). Default value is /static_root which is fine. Also, don't add the 'from whitenoise import WhiteNoise' line to your wsgi.py file, those steps are for other systems besides Django (skip everything after 'QuickStart for other WSGI apps'). Tip: you can add whitenoise to your requirements.txt so you have all your requirements in one place, preferably with a version number: whitenoise==4.1 Then remove it from your entrypoint.sh If you can't get it to work: start with the simplest set up. You can first try to get it running locally instead of in Azure Web App. Perhaps first with DJANGO_MODE=DEV and DJANGO_DEBUG=True (in your docker-compose.yml) With those settings you don't need Whitenoise (but dev mode is not safe for production environments). If that works, set those settings back to PROD and False and try to get Whitenoise working. Then if that works, move over to Web App. Also be sure to remove nginx from your local docker-compose.yml, since your goal is to run Arches without it in your Web App. Good luck and let me know how it goes! Vincent On Thursday, 11 October 2018 05:48:18 UTC+2, Lawrence Goh wrote: > > Hi Vincent, > > I found more info on gunicorn and nginx. it seems they need each other. > > > https://stackoverflow.com/questions/12800862/how-to-make-django-serve-static-files-with-gunicorn > > What do you think? > > Thanks. > > Regards, > Lawrence > > On Thu, Oct 11, 2018, 3:58 PM Lawrence Goh > wrote: > >> Hi Vincent, >> >> I am trying to have whitenoise in. Have you done it before? >> >> I have modified entrypoint.sh to include 'pip install whitenoise' after >> the virtual environment creation. Modified settings.py to have STATIC_ROOT >> with this 'os.path.join(ROOT_DIR, 'staticfiles') and the entry in >> MIDDLEWARE. Plus, wsgi.py file to have 'from whitenoise import WhiteNoise'. >> >> Unsure if anywhere else was missed. >> >> Thanks. >> >> Regards, >> Lawrence >> >> On Wed, Oct 10, 2018 at 9:09 PM Vincent Meijer > > wrote: >> >>> Ah, I think I know what the problem is. Didn't think of this before, but >>> Django does not want to serve static files (css, js, images, etc) when in >>> PROD mode (and DEBUG=False). >>> >>> There are two routes I can think of right now: >>> 1. Set up White Noise to make Django serve static files ( >>> http://whitenoise.evans.io/en/stable/) >>> 2. Set up the Azure CDN I described above >>> >>> I would personally go with option 2, because for me that made a big >>> difference in terms of performance. >>> >>> >>> On Wednesday, 10 October 2018 05:04:14 UTC+2, Lawrence Goh wrote: Hi Vincent, I guess I celebrated too early. I removed the cache and now the site on port 80 is broken as the images and JS are not downloaded. Any idea on this? Thanks. Regards, Lawrence On Wed, Oct 10, 2018 at 2:36 PM Lawrence Goh wrote: > Hi Vincent, > > Thanks a lot of the suggestion. I tried the suggestion on dumping > nginx and changing the port number but I kept couchdb as it is though. > It > is working as a web app for containers using multi-container. > > Will put the single container approach on the pipeline :) > > Thanks again! > > Regards, > Lawrence > > On Wed, Oct 10, 2018 at 12:13 AM Vincent Meijer > wrote: > >> No worries, I come from a .net environment myself. >> As for the App Service, I realized that I set up Postgres and >> Elasticsearch separately, that is why I was able to use the Single >> Container approach (see below for future reference). >> >> I just remembered I wasn't able to get the docker-compose approach >> working in the App Service. >> If you like to give it another try, you could remove the nginx >> service from your docker-compose.yml. >> Then add a port mapping on your arches service in your >> docker-compose.yml from 80 on the host (App Service) to 8000 on the >> container: >> Change: >> ports: >> - '8000:8000' >> To: >> ports: >> - '80:8000' >> >> Also be sure to set the DOMAIN_NAMES setting in your >> docker-compose.yml to the address of your web app. >> >> Finally, you may try removing the couchdb service from your >> docker-compose.yml, as this db is not (yet) used by arches at the moment >> (saves some resources). >> Be sure to *keep* the couchdb environment variables in your Arches >> service though (their values don't matter, but they are expected to be >> present). >> >> >> Here is some background info that
Re: [Arches] Re: Hosting Arches on Azure as a Web App for Containers
Hi Vincent, I found more info on gunicorn and nginx. it seems they need each other. https://stackoverflow.com/questions/12800862/how-to-make-django-serve-static-files-with-gunicorn What do you think? Thanks. Regards, Lawrence On Thu, Oct 11, 2018, 3:58 PM Lawrence Goh wrote: > Hi Vincent, > > I am trying to have whitenoise in. Have you done it before? > > I have modified entrypoint.sh to include 'pip install whitenoise' after > the virtual environment creation. Modified settings.py to have STATIC_ROOT > with this 'os.path.join(ROOT_DIR, 'staticfiles') and the entry in > MIDDLEWARE. Plus, wsgi.py file to have 'from whitenoise import WhiteNoise'. > > Unsure if anywhere else was missed. > > Thanks. > > Regards, > Lawrence > > On Wed, Oct 10, 2018 at 9:09 PM Vincent Meijer > wrote: > >> Ah, I think I know what the problem is. Didn't think of this before, but >> Django does not want to serve static files (css, js, images, etc) when in >> PROD mode (and DEBUG=False). >> >> There are two routes I can think of right now: >> 1. Set up White Noise to make Django serve static files ( >> http://whitenoise.evans.io/en/stable/) >> 2. Set up the Azure CDN I described above >> >> I would personally go with option 2, because for me that made a big >> difference in terms of performance. >> >> >> On Wednesday, 10 October 2018 05:04:14 UTC+2, Lawrence Goh wrote: >>> >>> Hi Vincent, >>> >>> I guess I celebrated too early. I removed the cache and now the site on >>> port 80 is broken as the images and JS are not downloaded. Any idea on >>> this? >>> >>> Thanks. >>> >>> Regards, >>> Lawrence >>> >>> On Wed, Oct 10, 2018 at 2:36 PM Lawrence Goh wrote: >>> Hi Vincent, Thanks a lot of the suggestion. I tried the suggestion on dumping nginx and changing the port number but I kept couchdb as it is though. It is working as a web app for containers using multi-container. Will put the single container approach on the pipeline :) Thanks again! Regards, Lawrence On Wed, Oct 10, 2018 at 12:13 AM Vincent Meijer wrote: > No worries, I come from a .net environment myself. > As for the App Service, I realized that I set up Postgres and > Elasticsearch separately, that is why I was able to use the Single > Container approach (see below for future reference). > > I just remembered I wasn't able to get the docker-compose approach > working in the App Service. > If you like to give it another try, you could remove the nginx service > from your docker-compose.yml. > Then add a port mapping on your arches service in your > docker-compose.yml from 80 on the host (App Service) to 8000 on the > container: > Change: > ports: > - '8000:8000' > To: > ports: > - '80:8000' > > Also be sure to set the DOMAIN_NAMES setting in your > docker-compose.yml to the address of your web app. > > Finally, you may try removing the couchdb service from your > docker-compose.yml, as this db is not (yet) used by arches at the moment > (saves some resources). > Be sure to *keep* the couchdb environment variables in your Arches > service though (their values don't matter, but they are expected to be > present). > > > Here is some background info that might be useful: > https://blogs.msdn.microsoft.com/appserviceteam/2018/05/07/multi-container/ > > > > *Single Container *approach > For the Single Container approach you wouldn't use a compose file at > all, but that is assuming you run Postgres and Elasticsearch elsewhere. > - On the App Service blade, select Container Settings (step 1 in the > screenshot below). > - Select 'Single Container' (step 2) > - Configure that page, ie. select the right image etc. > - Go to 'Application Settings' (step 3 on screenshot) and fill out all > environment variables you have in your docker-compose.yml as individual > app > settings > > > [image: Azure App Service.png] > > > On Tuesday, 9 October 2018 12:26:15 UTC+2, Lawrence Goh wrote: >> >> Hi Vincent, >> >> Thanks for the reply. I am not so well verse in the web development >> in open source space. Last I knew something related was Apache :) Pardon >> my knowledge as I am from .net. Some help would be very much appreciated >> to implement this. >> >> Based on the docker compose file, we have these containers - arches, >> nginx, db, elasticsearch, couchdb and letsencrypt. The single container >> would be having multiple single containers excluding nginx? >> >> What would be the best approach? >> >> Thanks. >> >> Regards, >> Lawrence >> >> >> >> >> On Tue, Oct 9, 2018, 8:46 PM Vincent Meijer >> wrote: >> >>> Hi Lawrence, >>> >>> The Azure App Service is meant to take over
Re: [Arches] Re: Hosting Arches on Azure as a Web App for Containers
Ah, I think I know what the problem is. Didn't think of this before, but Django does not want to serve static files (css, js, images, etc) when in PROD mode (and DEBUG=False). There are two routes I can think of right now: 1. Set up White Noise to make Django serve static files (http://whitenoise.evans.io/en/stable/) 2. Set up the Azure CDN I described above I would personally go with option 2, because for me that made a big difference in terms of performance. On Wednesday, 10 October 2018 05:04:14 UTC+2, Lawrence Goh wrote: > > Hi Vincent, > > I guess I celebrated too early. I removed the cache and now the site on > port 80 is broken as the images and JS are not downloaded. Any idea on > this? > > Thanks. > > Regards, > Lawrence > > On Wed, Oct 10, 2018 at 2:36 PM Lawrence Goh > wrote: > >> Hi Vincent, >> >> Thanks a lot of the suggestion. I tried the suggestion on dumping nginx >> and changing the port number but I kept couchdb as it is though. It is >> working as a web app for containers using multi-container. >> >> Will put the single container approach on the pipeline :) >> >> Thanks again! >> >> Regards, >> Lawrence >> >> On Wed, Oct 10, 2018 at 12:13 AM Vincent Meijer > > wrote: >> >>> No worries, I come from a .net environment myself. >>> As for the App Service, I realized that I set up Postgres and >>> Elasticsearch separately, that is why I was able to use the Single >>> Container approach (see below for future reference). >>> >>> I just remembered I wasn't able to get the docker-compose approach >>> working in the App Service. >>> If you like to give it another try, you could remove the nginx service >>> from your docker-compose.yml. >>> Then add a port mapping on your arches service in your >>> docker-compose.yml from 80 on the host (App Service) to 8000 on the >>> container: >>> Change: >>> ports: >>> - '8000:8000' >>> To: >>> ports: >>> - '80:8000' >>> >>> Also be sure to set the DOMAIN_NAMES setting in your docker-compose.yml >>> to the address of your web app. >>> >>> Finally, you may try removing the couchdb service from your >>> docker-compose.yml, as this db is not (yet) used by arches at the moment >>> (saves some resources). >>> Be sure to *keep* the couchdb environment variables in your Arches >>> service though (their values don't matter, but they are expected to be >>> present). >>> >>> >>> Here is some background info that might be useful: >>> https://blogs.msdn.microsoft.com/appserviceteam/2018/05/07/multi-container/ >>> >>> >>> >>> *Single Container *approach >>> For the Single Container approach you wouldn't use a compose file at >>> all, but that is assuming you run Postgres and Elasticsearch elsewhere. >>> - On the App Service blade, select Container Settings (step 1 in the >>> screenshot below). >>> - Select 'Single Container' (step 2) >>> - Configure that page, ie. select the right image etc. >>> - Go to 'Application Settings' (step 3 on screenshot) and fill out all >>> environment variables you have in your docker-compose.yml as individual app >>> settings >>> >>> >>> [image: Azure App Service.png] >>> >>> >>> On Tuesday, 9 October 2018 12:26:15 UTC+2, Lawrence Goh wrote: Hi Vincent, Thanks for the reply. I am not so well verse in the web development in open source space. Last I knew something related was Apache :) Pardon my knowledge as I am from .net. Some help would be very much appreciated to implement this. Based on the docker compose file, we have these containers - arches, nginx, db, elasticsearch, couchdb and letsencrypt. The single container would be having multiple single containers excluding nginx? What would be the best approach? Thanks. Regards, Lawrence On Tue, Oct 9, 2018, 8:46 PM Vincent Meijer wrote: > Hi Lawrence, > > The Azure App Service is meant to take over everything but the app > itself, so running it with an nginx container is not necessary. > I used the App Service for a short while and only could get it to work > when using the single container approach. > > That being said, I found the App Service to be extremely slow (and > expensive), so I am eager to hear your experiences with it. > > For me it did help to set up Azure CDN to serve static files. > Roughly: > 1. Set up an Azure Blob Storage account > 2. Configure Django to use the azure-storage package ( > https://django-storages.readthedocs.io/en/latest/backends/azure.html > -> don't do the static files steps) > 3. Set up Azure CDN with the storage account from step 1 as origin. > 4. Set `STATIC_URL` in settings.py to the CDN endpoint. > > > I hope this helps and please share your experiences with us :) > Vincent > > > On Tuesday, 9 October 2018 04:19:42 UTC+2, Lawrence Goh wrote: >> >> Hi! I am trying to
Re: [Arches] Re: Hosting Arches on Azure as a Web App for Containers
Hi Vincent, I guess I celebrated too early. I removed the cache and now the site on port 80 is broken as the images and JS are not downloaded. Any idea on this? Thanks. Regards, Lawrence On Wed, Oct 10, 2018 at 2:36 PM Lawrence Goh wrote: > Hi Vincent, > > Thanks a lot of the suggestion. I tried the suggestion on dumping nginx > and changing the port number but I kept couchdb as it is though. It is > working as a web app for containers using multi-container. > > Will put the single container approach on the pipeline :) > > Thanks again! > > Regards, > Lawrence > > On Wed, Oct 10, 2018 at 12:13 AM Vincent Meijer > wrote: > >> No worries, I come from a .net environment myself. >> As for the App Service, I realized that I set up Postgres and >> Elasticsearch separately, that is why I was able to use the Single >> Container approach (see below for future reference). >> >> I just remembered I wasn't able to get the docker-compose approach >> working in the App Service. >> If you like to give it another try, you could remove the nginx service >> from your docker-compose.yml. >> Then add a port mapping on your arches service in your docker-compose.yml >> from 80 on the host (App Service) to 8000 on the container: >> Change: >> ports: >> - '8000:8000' >> To: >> ports: >> - '80:8000' >> >> Also be sure to set the DOMAIN_NAMES setting in your docker-compose.yml >> to the address of your web app. >> >> Finally, you may try removing the couchdb service from your >> docker-compose.yml, as this db is not (yet) used by arches at the moment >> (saves some resources). >> Be sure to *keep* the couchdb environment variables in your Arches >> service though (their values don't matter, but they are expected to be >> present). >> >> >> Here is some background info that might be useful: >> https://blogs.msdn.microsoft.com/appserviceteam/2018/05/07/multi-container/ >> >> >> >> *Single Container *approach >> For the Single Container approach you wouldn't use a compose file at all, >> but that is assuming you run Postgres and Elasticsearch elsewhere. >> - On the App Service blade, select Container Settings (step 1 in the >> screenshot below). >> - Select 'Single Container' (step 2) >> - Configure that page, ie. select the right image etc. >> - Go to 'Application Settings' (step 3 on screenshot) and fill out all >> environment variables you have in your docker-compose.yml as individual app >> settings >> >> >> [image: Azure App Service.png] >> >> >> On Tuesday, 9 October 2018 12:26:15 UTC+2, Lawrence Goh wrote: >>> >>> Hi Vincent, >>> >>> Thanks for the reply. I am not so well verse in the web development in >>> open source space. Last I knew something related was Apache :) Pardon my >>> knowledge as I am from .net. Some help would be very much appreciated to >>> implement this. >>> >>> Based on the docker compose file, we have these containers - arches, >>> nginx, db, elasticsearch, couchdb and letsencrypt. The single container >>> would be having multiple single containers excluding nginx? >>> >>> What would be the best approach? >>> >>> Thanks. >>> >>> Regards, >>> Lawrence >>> >>> >>> >>> >>> On Tue, Oct 9, 2018, 8:46 PM Vincent Meijer >>> wrote: >>> Hi Lawrence, The Azure App Service is meant to take over everything but the app itself, so running it with an nginx container is not necessary. I used the App Service for a short while and only could get it to work when using the single container approach. That being said, I found the App Service to be extremely slow (and expensive), so I am eager to hear your experiences with it. For me it did help to set up Azure CDN to serve static files. Roughly: 1. Set up an Azure Blob Storage account 2. Configure Django to use the azure-storage package ( https://django-storages.readthedocs.io/en/latest/backends/azure.html -> don't do the static files steps) 3. Set up Azure CDN with the storage account from step 1 as origin. 4. Set `STATIC_URL` in settings.py to the CDN endpoint. I hope this helps and please share your experiences with us :) Vincent On Tuesday, 9 October 2018 04:19:42 UTC+2, Lawrence Goh wrote: > > Hi! I am trying to set up the Arches Project on Azure using its Web > App for Containers. But I hit a roadblock where I will get a '400 Bad > Request' when browsing it. I see the Azure logs are displaying that the > NGINX got called when I triggered it on a browser. Hope to get some help > on this. Thanks. > -- -- To post, send email to arches...@googlegroups.com. To unsubscribe, send email to archesprojec...@googlegroups.com. For more information, visit https://groups.google.com/d/forum/archesproject?hl=en --- You received this message because you are subscribed to the Google Groups "Arches Project" group. To unsubscribe from this group and stop receiving emails from it,
Re: [Arches] Re: Hosting Arches on Azure as a Web App for Containers
Hi Vincent, Thanks a lot of the suggestion. I tried the suggestion on dumping nginx and changing the port number but I kept couchdb as it is though. It is working as a web app for containers using multi-container. Will put the single container approach on the pipeline :) Thanks again! Regards, Lawrence On Wed, Oct 10, 2018 at 12:13 AM Vincent Meijer wrote: > No worries, I come from a .net environment myself. > As for the App Service, I realized that I set up Postgres and > Elasticsearch separately, that is why I was able to use the Single > Container approach (see below for future reference). > > I just remembered I wasn't able to get the docker-compose approach working > in the App Service. > If you like to give it another try, you could remove the nginx service > from your docker-compose.yml. > Then add a port mapping on your arches service in your docker-compose.yml > from 80 on the host (App Service) to 8000 on the container: > Change: > ports: > - '8000:8000' > To: > ports: > - '80:8000' > > Also be sure to set the DOMAIN_NAMES setting in your docker-compose.yml > to the address of your web app. > > Finally, you may try removing the couchdb service from your > docker-compose.yml, as this db is not (yet) used by arches at the moment > (saves some resources). > Be sure to *keep* the couchdb environment variables in your Arches > service though (their values don't matter, but they are expected to be > present). > > > Here is some background info that might be useful: > https://blogs.msdn.microsoft.com/appserviceteam/2018/05/07/multi-container/ > > > > *Single Container *approach > For the Single Container approach you wouldn't use a compose file at all, > but that is assuming you run Postgres and Elasticsearch elsewhere. > - On the App Service blade, select Container Settings (step 1 in the > screenshot below). > - Select 'Single Container' (step 2) > - Configure that page, ie. select the right image etc. > - Go to 'Application Settings' (step 3 on screenshot) and fill out all > environment variables you have in your docker-compose.yml as individual app > settings > > > [image: Azure App Service.png] > > > On Tuesday, 9 October 2018 12:26:15 UTC+2, Lawrence Goh wrote: >> >> Hi Vincent, >> >> Thanks for the reply. I am not so well verse in the web development in >> open source space. Last I knew something related was Apache :) Pardon my >> knowledge as I am from .net. Some help would be very much appreciated to >> implement this. >> >> Based on the docker compose file, we have these containers - arches, >> nginx, db, elasticsearch, couchdb and letsencrypt. The single container >> would be having multiple single containers excluding nginx? >> >> What would be the best approach? >> >> Thanks. >> >> Regards, >> Lawrence >> >> >> >> >> On Tue, Oct 9, 2018, 8:46 PM Vincent Meijer wrote: >> >>> Hi Lawrence, >>> >>> The Azure App Service is meant to take over everything but the app >>> itself, so running it with an nginx container is not necessary. >>> I used the App Service for a short while and only could get it to work >>> when using the single container approach. >>> >>> That being said, I found the App Service to be extremely slow (and >>> expensive), so I am eager to hear your experiences with it. >>> >>> For me it did help to set up Azure CDN to serve static files. >>> Roughly: >>> 1. Set up an Azure Blob Storage account >>> 2. Configure Django to use the azure-storage package ( >>> https://django-storages.readthedocs.io/en/latest/backends/azure.html >>> -> don't do the static files steps) >>> 3. Set up Azure CDN with the storage account from step 1 as origin. >>> 4. Set `STATIC_URL` in settings.py to the CDN endpoint. >>> >>> >>> I hope this helps and please share your experiences with us :) >>> Vincent >>> >>> >>> On Tuesday, 9 October 2018 04:19:42 UTC+2, Lawrence Goh wrote: Hi! I am trying to set up the Arches Project on Azure using its Web App for Containers. But I hit a roadblock where I will get a '400 Bad Request' when browsing it. I see the Azure logs are displaying that the NGINX got called when I triggered it on a browser. Hope to get some help on this. Thanks. >>> -- >>> -- To post, send email to arches...@googlegroups.com. To unsubscribe, >>> send email to archesprojec...@googlegroups.com. For more information, >>> visit https://groups.google.com/d/forum/archesproject?hl=en >>> --- >>> You received this message because you are subscribed to the Google >>> Groups "Arches Project" group. >>> To unsubscribe from this group and stop receiving emails from it, send >>> an email to archesprojec...@googlegroups.com. >>> For more options, visit https://groups.google.com/d/optout. >>> >> -- > -- To post, send email to archesproject@googlegroups.com. To unsubscribe, > send email to archesproject+unsubscr...@googlegroups.com. For more > information, visit https://groups.google.com/d/forum/archesproject?hl=en > --- > You received this message because
Re: [Arches] Re: Hosting Arches on Azure as a Web App for Containers
No worries, I come from a .net environment myself. As for the App Service, I realized that I set up Postgres and Elasticsearch separately, that is why I was able to use the Single Container approach (see below for future reference). I just remembered I wasn't able to get the docker-compose approach working in the App Service. If you like to give it another try, you could remove the nginx service from your docker-compose.yml. Then add a port mapping on your arches service in your docker-compose.yml from 80 on the host (App Service) to 8000 on the container: Change: ports: - '8000:8000' To: ports: - '80:8000' Also be sure to set the DOMAIN_NAMES setting in your docker-compose.yml to the address of your web app. Finally, you may try removing the couchdb service from your docker-compose.yml, as this db is not (yet) used by arches at the moment (saves some resources). Be sure to *keep* the couchdb environment variables in your Arches service though (their values don't matter, but they are expected to be present). Here is some background info that might be useful: https://blogs.msdn.microsoft.com/appserviceteam/2018/05/07/multi-container/ *Single Container *approach For the Single Container approach you wouldn't use a compose file at all, but that is assuming you run Postgres and Elasticsearch elsewhere. - On the App Service blade, select Container Settings (step 1 in the screenshot below). - Select 'Single Container' (step 2) - Configure that page, ie. select the right image etc. - Go to 'Application Settings' (step 3 on screenshot) and fill out all environment variables you have in your docker-compose.yml as individual app settings [image: Azure App Service.png] On Tuesday, 9 October 2018 12:26:15 UTC+2, Lawrence Goh wrote: > > Hi Vincent, > > Thanks for the reply. I am not so well verse in the web development in > open source space. Last I knew something related was Apache :) Pardon my > knowledge as I am from .net. Some help would be very much appreciated to > implement this. > > Based on the docker compose file, we have these containers - arches, > nginx, db, elasticsearch, couchdb and letsencrypt. The single container > would be having multiple single containers excluding nginx? > > What would be the best approach? > > Thanks. > > Regards, > Lawrence > > > > > On Tue, Oct 9, 2018, 8:46 PM Vincent Meijer > wrote: > >> Hi Lawrence, >> >> The Azure App Service is meant to take over everything but the app >> itself, so running it with an nginx container is not necessary. >> I used the App Service for a short while and only could get it to work >> when using the single container approach. >> >> That being said, I found the App Service to be extremely slow (and >> expensive), so I am eager to hear your experiences with it. >> >> For me it did help to set up Azure CDN to serve static files. >> Roughly: >> 1. Set up an Azure Blob Storage account >> 2. Configure Django to use the azure-storage package ( >> https://django-storages.readthedocs.io/en/latest/backends/azure.html -> >> don't do the static files steps) >> 3. Set up Azure CDN with the storage account from step 1 as origin. >> 4. Set `STATIC_URL` in settings.py to the CDN endpoint. >> >> >> I hope this helps and please share your experiences with us :) >> Vincent >> >> >> On Tuesday, 9 October 2018 04:19:42 UTC+2, Lawrence Goh wrote: >>> >>> Hi! I am trying to set up the Arches Project on Azure using its Web App >>> for Containers. But I hit a roadblock where I will get a '400 Bad Request' >>> when browsing it. I see the Azure logs are displaying that the NGINX got >>> called when I triggered it on a browser. Hope to get some help on this. >>> Thanks. >>> >> -- >> -- To post, send email to arches...@googlegroups.com . To >> unsubscribe, send email to archesprojec...@googlegroups.com . >> For more information, visit >> https://groups.google.com/d/forum/archesproject?hl=en >> --- >> You received this message because you are subscribed to the Google Groups >> "Arches Project" group. >> To unsubscribe from this group and stop receiving emails from it, send an >> email to archesprojec...@googlegroups.com . >> For more options, visit https://groups.google.com/d/optout. >> > -- -- To post, send email to archesproject@googlegroups.com. To unsubscribe, send email to archesproject+unsubscr...@googlegroups.com. For more information, visit https://groups.google.com/d/forum/archesproject?hl=en --- You received this message because you are subscribed to the Google Groups "Arches Project" group. To unsubscribe from this group and stop receiving emails from it, send an email to archesproject+unsubscr...@googlegroups.com. For more options, visit https://groups.google.com/d/optout.
Re: [Arches] Re: Hosting Arches on Azure as a Web App for Containers
Hi Vincent, Thanks for the reply. I am not so well verse in the web development in open source space. Last I knew something related was Apache :) Pardon my knowledge as I am from .net. Some help would be very much appreciated to implement this. Based on the docker compose file, we have these containers - arches, nginx, db, elasticsearch, couchdb and letsencrypt. The single container would be having multiple single containers excluding nginx? What would be the best approach? Thanks. Regards, Lawrence On Tue, Oct 9, 2018, 8:46 PM Vincent Meijer wrote: > Hi Lawrence, > > The Azure App Service is meant to take over everything but the app itself, > so running it with an nginx container is not necessary. > I used the App Service for a short while and only could get it to work > when using the single container approach. > > That being said, I found the App Service to be extremely slow (and > expensive), so I am eager to hear your experiences with it. > > For me it did help to set up Azure CDN to serve static files. > Roughly: > 1. Set up an Azure Blob Storage account > 2. Configure Django to use the azure-storage package ( > https://django-storages.readthedocs.io/en/latest/backends/azure.html -> > don't do the static files steps) > 3. Set up Azure CDN with the storage account from step 1 as origin. > 4. Set `STATIC_URL` in settings.py to the CDN endpoint. > > > I hope this helps and please share your experiences with us :) > Vincent > > > On Tuesday, 9 October 2018 04:19:42 UTC+2, Lawrence Goh wrote: >> >> Hi! I am trying to set up the Arches Project on Azure using its Web App >> for Containers. But I hit a roadblock where I will get a '400 Bad Request' >> when browsing it. I see the Azure logs are displaying that the NGINX got >> called when I triggered it on a browser. Hope to get some help on this. >> Thanks. >> > -- > -- To post, send email to archesproject@googlegroups.com. To unsubscribe, > send email to archesproject+unsubscr...@googlegroups.com. For more > information, visit https://groups.google.com/d/forum/archesproject?hl=en > --- > You received this message because you are subscribed to the Google Groups > "Arches Project" group. > To unsubscribe from this group and stop receiving emails from it, send an > email to archesproject+unsubscr...@googlegroups.com. > For more options, visit https://groups.google.com/d/optout. > -- -- To post, send email to archesproject@googlegroups.com. To unsubscribe, send email to archesproject+unsubscr...@googlegroups.com. For more information, visit https://groups.google.com/d/forum/archesproject?hl=en --- You received this message because you are subscribed to the Google Groups "Arches Project" group. To unsubscribe from this group and stop receiving emails from it, send an email to archesproject+unsubscr...@googlegroups.com. For more options, visit https://groups.google.com/d/optout.
