Re: [Arches] Sketchfab 3D model - can I embed to view in Arches resource?

[Vincent Meijer]

Hi all,

Implementing the Sketchfab 3d-viewer would indeed work the same as 3DHOP as 
outlined in that post (just look for the Sketchfab files in the same 
folders).
However, this was made for Arches 4 and I have not been up to date since 
Arches 5 came out (I have another job now).
If these viewers need to be implemented for Arches 5, we would need some 
help from the Arches development team (please :) ).

All best,
Vincent

On Friday, 23 October 2020 at 23:53:28 UTC+2 David Myers wrote:

> Hi Jude
>
> I suggest you take a look at this post from 2019 on the topic of viewing 
> 3D models in Arches, including via Sketchfab
>
> https://groups.google.com/g/archesproject/c/WM0Yc8AbNcM/m/2fKOPZsBAQAJ
>
>  
>
> relating to Vincent Meijer’s work on the Global Digital Heritage 
> implementation of Arches. I’ve copied Vincent on this post to make sure he 
> sees your query.
>
>  
>
> Best,
>
> David
>
>  
>
> *From:* arches...@googlegroups.com [mailto:arches...@googlegroups.com] *On 
> Behalf Of *manxnation...@gmail.com
> *Sent:* Friday, October 23, 2020 8:03 AM
> *To:* Arches Project 
> *Subject:* [Arches] Sketchfab 3D model - can I embed to view in Arches 
> resource?
>
>  
>
> Hello, 
>
>  
>
> I remember (I think) a demo by Getty of an Arches where they had a 
> Sketchfab 3D model embedded and playable within Arches.  
>
>  
>
> I'd like to do this for a number of 3D models we have on Sketchfab, e.g.:
>
>  
>
>
> https://sketchfab.com/3d-models/ballaqueeney-ogham-stone-manx-cross-1-efc3645a72bf4206aeae95db0de2a0e6
>
>  
>
> I'd like to add this - not only as a link - but viewable within Arches in 
> an Activity resource linked to a Monument resource.
>
>  
>
> Is this possible by me copying the embed link from Sketchfab?
>
>  
>
> Thanks,
>
>  
>
> Jude.
>
> -- 
> -- To post, send email to arches...@googlegroups.com. To unsubscribe, 
> send email to archesprojec...@googlegroups.com. For more information, 
> visit https://groups.google.com/d/forum/archesproject?hl=en
> --- 
> You received this message because you are subscribed to the Google Groups 
> "Arches Project" group.
> To unsubscribe from this group and stop receiving emails from it, send an 
> email to archesprojec...@googlegroups.com.
> To view this discussion on the web visit 
> https://groups.google.com/d/msgid/archesproject/f041645e-5539-496d-9731-c8a77ca557e9n%40googlegroups.com
>  
> 
> .
>
>  
>
> *CAUTION: This email originated from outside of the Getty. Do not click 
> links or open attachments unless you verify the sender and know the content 
> is safe.*
>
>  
>

-- 
-- To post, send email to archesproject@googlegroups.com. To unsubscribe, send 
email to archesproject+unsubscr...@googlegroups.com. For more information, 
visit https://groups.google.com/d/forum/archesproject?hl=en
--- 
You received this message because you are subscribed to the Google Groups 
"Arches Project" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to archesproject+unsubscr...@googlegroups.com.
To view this discussion on the web visit 
https://groups.google.com/d/msgid/archesproject/ea85970a-0ef4-4e25-b074-f834d640ea3fn%40googlegroups.com.

[Arches] Re: Digital Spatial Documentation of Heritage - Arches Newbie

[Vincent Meijer]

It has been a while since I posted this and I was wondering how relevant 
this is for Arches 5. Are there significant changes to how reports are 
created and registered? 

Hopefully someone from the Arches team can help us and others with 
directions for upgrading. :)

Best,
Vincent

On Monday, 9 September 2019 at 13:42:57 UTC+2 Vincent Meijer wrote:

> Hi Sarah and welcome,
>
> With regards to using 3D viewers in Arches, have a look at my 
> implementation here:
> https://github.com/globaldigitalheritage/arches-3d
>
> Perhaps this is a bit too 'head-first' (take your time to familiarize 
> yourself with Arches), but if you want to implement 3D HOP into Arches, you 
> can copy/paste the following code into your own implementation:
>
> *Javascript:*
>
> https://github.com/globaldigitalheritage/arches-3d/tree/master/arches_3d/arches_3d/media/js/reports/three-d-hop
>
> *Html templates:*
>
> https://github.com/globaldigitalheritage/arches-3d/blob/master/arches_3d/arches_3d/templates/views/report-templates/three-d-hop.htm
>
> https://github.com/globaldigitalheritage/arches-3d/tree/master/arches_3d/arches_3d/templates/views/components/three-d-hop
>
> *Css:*
>
> https://github.com/globaldigitalheritage/arches-3d/blob/master/arches_3d/arches_3d/media/css/three-d-hop.css
>
> *Migration to register the 3D HOP report template:*
>
> https://github.com/globaldigitalheritage/arches-3d/blob/master/arches_3d/arches_3d/migrations/002_three_d_hop_report_template.py
>
>
> Look in the same folders for implementations of e.g. Sketchfab and Potree 
> as well.
>
> See it in action *here* 
> <https://globaldigitalheritage.org/search?typeFilter=%5B%7B%22graphid%22%3A%2236bcaff4-b82f-11e8-8598-0242ac120004%22%2C%22name%22%3A%223D%20HOP%20Model%22%2C%22inverted%22%3Afalse%7D%5D_filters=false=1>
> .
>
> Let me know if I can help with anything!
>
> All best,
> Vincent
>
>
> On Thursday, 5 September 2019 15:53:42 UTC+2, Sarah Schäfer wrote:
>>
>> Hi all, 
>>
>> I'm in the process of educating myself as much as I can about Arches 
>> before I begin implementation and am finding this forum so valuable - thank 
>> you!
>>
>> I’ve recently joined a small digital cultural heritage organisation based 
>> at a university in Cape Town, South Africa, and am working with them in my 
>> capacity as digital curator. The team does digital spatial documentation of 
>> cultural heritage sites, and has an incredible archive of documentation 
>> from the past 15 years. As a team, we are really excited about the 
>> possibilities of using Arches, especially because of the GIS functionality 
>> and viewers like 3D HOP and Sketchfab. The datasets that we have are 
>> heterogenous, and our metadata is not where it should be. 
>>
>> I’ll be overseeing the implementation, and although I have a good 
>> knowledge of and experience in digital cultural heritage and some very 
>> basic developing in my background, it is quite an intimidating task! I’d 
>> love to know if there is a resource (or some kind of support group :-/) 
>> available for Arches newbies like me?
>>
>> Thanks, 
>> Sarah
>>
>

-- 
-- To post, send email to archesproject@googlegroups.com. To unsubscribe, send 
email to archesproject+unsubscr...@googlegroups.com. For more information, 
visit https://groups.google.com/d/forum/archesproject?hl=en
--- 
You received this message because you are subscribed to the Google Groups 
"Arches Project" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to archesproject+unsubscr...@googlegroups.com.
To view this discussion on the web visit 
https://groups.google.com/d/msgid/archesproject/e3ad7313-51b4-405e-bd71-923e9ecceed3n%40googlegroups.com.

[Arches] Re: Digital Spatial Documentation of Heritage - Arches Newbie

[Vincent Meijer]

ob/master/arches_3d/arches_3d/db/graphs/resource_models/Video.json>*
  '. 
  - For raw data I used '*3D Data As Captured 
  
<https://github.com/globaldigitalheritage/arches-3d/blob/master/arches_3d/arches_3d/db/graphs/resource_models/3D%20Data%20As%20Captured.json>*'
 
  (Early stages, still working on that).
  - Instead of 'Architectural Resource' I used '*Heritage Site 
  
<https://github.com/globaldigitalheritage/arches-3d/blob/master/arches_3d/arches_3d/db/graphs/resource_models/Heritage%20Site.json>*'
 
  (more or less comprises everything that is not a 'Heritage Object' 
  ('portable' stuff)). 
   
I hope this helps. Good luck!
Vincent

On Thursday, 12 September 2019 12:11:30 UTC+2, Sarah Schäfer wrote:
>
> Wonderful to get such a detailed response from you, thanks Vincent. 
>
> I've actually realised that my colleague Roshan and you were in touch 
> about this a few years ago - here's 
> <https://groups.google.com/forum/#!starred/archesproject/v02grD04ofc>the 
> link to the conversation. I've now joined the team at the Zamani Project 
> <http://www.zamaniproject.org> and really want to get us going with 
> Arches. I recently attended the Digital Humanities conference in the 
> Netherlands, and it seems like Arches is really gaining ground. 
>
> I've been educating myself with the documentation and am very inspired by 
> your implementation with Global Digital Heritage! 
>
> I have a few questions that I hope you can help with: 
>
>- Would you advise that I become very familiar with the CDOC CRM 
>documentation before I get started? 
>- Because we are based at a university, am I correct that it would 
>make more sense to install Arches on a server? 
>- Our database is in the process of being migrated to the university's 
>repository, and I want to make any data of ours on Arches link back to 
>those DOIs, so that our website+Arches and our data in the university's 
>repository all speak to each other. Does that make sense? 
>- We want to make our raw data as well as our visualisations (3D 
>models etc) available through Arches. We would need some kind of access 
>control, so that viewing models is open to all guests, but access to our 
>raw data would need registration. 
>- Your description of how you envision our data (from your 
>conversation with Roshan in 2017) is really useful. Would you change 
>anything about it with regard to Zamani’s specific data and updates to 
>Arches? I had something like this in mind, but am very open to any 
>suggestions and insight:
>
> *Activity Resource* 
> Describes the project in general. 
> *i.e. Spatial documentation of temples and pagodas in Bagan, Myanmar*
> *Documentation/Digitization Event* 
> More detailed, short-term documentation of the 'how' and 'when' of the 
> sessions. There could be several events here for the same activity 
> resource. Can be as descriptive as needed about equipment, conditions and 
> settings.  
> *i.e. 20-30 January 2016 - terrestrial laser scans and drone footage of 
> Temple 1 and Pagoda 2; F+H scanner model XXX with settings XXX. Team 
> members A, B, and C were present. *
> *1-5 June 2019 - more documentation events*.
> *Resource* 
> Documents heritage sites, structures, buildings, etc. There could be many 
> resources here.
> *i.e. Temple 1; Temple 2; Temple 99; Pagoda 1; Pagoda 2; Pagoda 99 etc.   *
> *File set/Raw data* 
> Datasets from acquired documentation. This lives in the university’s 
> repository, and can be accessed with a DOI.  
> *i.e. http://dx.doi.org/10.1037/a0028240 
> <http://dx.doi.org/10.1037/a0028240>*
> *File (set)* 
> The actual 3D model gets uploaded to Arches.
>
> Best, 
> Sarah
>
> On Monday, 9 September 2019 13:42:57 UTC+2, Vincent Meijer wrote:
>>
>> Hi Sarah and welcome,
>>
>> With regards to using 3D viewers in Arches, have a look at my 
>> implementation here:
>> https://github.com/globaldigitalheritage/arches-3d
>>
>> Perhaps this is a bit too 'head-first' (take your time to familiarize 
>> yourself with Arches), but if you want to implement 3D HOP into Arches, you 
>> can copy/paste the following code into your own implementation:
>>
>> *Javascript:*
>>
>> https://github.com/globaldigitalheritage/arches-3d/tree/master/arches_3d/arches_3d/media/js/reports/three-d-hop
>>
>> *Html templates:*
>>
>> https://github.com/globaldigitalheritage/arches-3d/blob/master/arches_3d/arches_3d/templates/views/report-templates/three-d-hop.htm
>>
>> https://github.com/globaldigitalheritage/arches-3d/tree/master/arches_3d/arches_3d/templates/views/components/three-d-hop
>>
>&

[Arches] Re: Digital Spatial Documentation of Heritage - Arches Newbie

[Vincent Meijer]

Hi Sarah and welcome,

With regards to using 3D viewers in Arches, have a look at my 
implementation here:
https://github.com/globaldigitalheritage/arches-3d

Perhaps this is a bit too 'head-first' (take your time to familiarize 
yourself with Arches), but if you want to implement 3D HOP into Arches, you 
can copy/paste the following code into your own implementation:

*Javascript:*
https://github.com/globaldigitalheritage/arches-3d/tree/master/arches_3d/arches_3d/media/js/reports/three-d-hop

*Html templates:*
https://github.com/globaldigitalheritage/arches-3d/blob/master/arches_3d/arches_3d/templates/views/report-templates/three-d-hop.htm
https://github.com/globaldigitalheritage/arches-3d/tree/master/arches_3d/arches_3d/templates/views/components/three-d-hop

*Css:*
https://github.com/globaldigitalheritage/arches-3d/blob/master/arches_3d/arches_3d/media/css/three-d-hop.css

*Migration to register the 3D HOP report template:*
https://github.com/globaldigitalheritage/arches-3d/blob/master/arches_3d/arches_3d/migrations/002_three_d_hop_report_template.py


Look in the same folders for implementations of e.g. Sketchfab and Potree 
as well.

See it in action *here* 

.

Let me know if I can help with anything!

All best,
Vincent


On Thursday, 5 September 2019 15:53:42 UTC+2, Sarah Schäfer wrote:
>
> Hi all, 
>
> I'm in the process of educating myself as much as I can about Arches 
> before I begin implementation and am finding this forum so valuable - thank 
> you!
>
> I’ve recently joined a small digital cultural heritage organisation based 
> at a university in Cape Town, South Africa, and am working with them in my 
> capacity as digital curator. The team does digital spatial documentation of 
> cultural heritage sites, and has an incredible archive of documentation 
> from the past 15 years. As a team, we are really excited about the 
> possibilities of using Arches, especially because of the GIS functionality 
> and viewers like 3D HOP and Sketchfab. The datasets that we have are 
> heterogenous, and our metadata is not where it should be. 
>
> I’ll be overseeing the implementation, and although I have a good 
> knowledge of and experience in digital cultural heritage and some very 
> basic developing in my background, it is quite an intimidating task! I’d 
> love to know if there is a resource (or some kind of support group :-/) 
> available for Arches newbies like me?
>
> Thanks, 
> Sarah
>

-- 
-- To post, send email to archesproject@googlegroups.com. To unsubscribe, send 
email to archesproject+unsubscr...@googlegroups.com. For more information, 
visit https://groups.google.com/d/forum/archesproject?hl=en
--- 
You received this message because you are subscribed to the Google Groups 
"Arches Project" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to archesproject+unsubscr...@googlegroups.com.
To view this discussion on the web visit 
https://groups.google.com/d/msgid/archesproject/4d5190a4-1c1c-4632-a56f-be273481b266%40googlegroups.com.

[Arches] Re: Arches Webinar: Participate in the first Arches Project LIVE Q!

[Vincent Meijer]

Great idea Alina. Some topics that spring to mind:

- Displaying resources on the map: an overview of the possibilities of 
displaying spatial data in Arches. Preferably explained for a 
non-GIS-specialist audience. E.g. what can I tell my client(s) about this 
topic so that they are able to express their needs/wishes. From simple 
things like grouping and color coding resource instances to more complex 
topics such as overlays.

- Arches Functions: an explanation of how it works and what the use cases 
are, preferably with a number of different concrete examples. 


On Tuesday, 30 July 2019 00:19:15 UTC+2, Alina Myklebust wrote:
>
> Arches Webinar:  Participate in the first Arches Project LIVE Q! 
>  
> We want to know what’s important to you and answer your questions.  In 
> addition to this community forum, Arches webinars are another way 
> to engage on topics that matter the most to you and find answers to your 
> Arches related questions. 
>
> Please share your ideas for topics and submit your questions by emailing 
> us at con...@archesproject.org  or by replying here.  August 
> webinar 
> dates will be announced this week!
>
> Cheers,
>
> Alina & The Arches Project Team
>

-- 
-- To post, send email to archesproject@googlegroups.com. To unsubscribe, send 
email to archesproject+unsubscr...@googlegroups.com. For more information, 
visit https://groups.google.com/d/forum/archesproject?hl=en
--- 
You received this message because you are subscribed to the Google Groups 
"Arches Project" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to archesproject+unsubscr...@googlegroups.com.
To view this discussion on the web visit 
https://groups.google.com/d/msgid/archesproject/e480995a-4dda-435a-b6fc-0bd8f60a1259%40googlegroups.com.

Re: [Arches] Re: Arches 4.4.2 released

[Vincent Meijer]

Sweet!

On Wed, Jul 3, 2019, 11:51 Adam Cox  wrote:

> Hey Joel,
>
> Yes, you will be able to go straight to 4.4.2 from v3.
>
> However, during the lead up to the 4.4.2 release I found some deficiencies
> with v3 exports which hinder migration efforts (as you found, not even
> every v3 release allows the export of resources!). So, the outcome is that
> I will be working on putting together a very simple patch that v3 users can
> download and place inside their v3 app to enable the proper exports. I
> think the day to work on that has come. I'll get back in touch with you
> soon.
>
> On Wed, Jul 3, 2019 at 10:36 AM Cyrus Hiatt  wrote:
>
>> Hi Joel -
>>
>> I haven't worked on a v3 to v4 migration myself, so Adam Cox could speak
>> more to that, but yeah, I would go directly from v3 to v4.4.2 rather than
>> first upgrading to 4.4.1.
>>
>> Cheers,
>>
>> Cyrus
>>
>> On Tue, Jul 2, 2019 at 5:59 PM Joel Aldor  wrote:
>>
>>> Thanks for the update, Cyrus. Does this mean we could upgrade directly
>>> from v3 to v4.4.2 without going first to v4.4.1?
>>>
>>> Regards,
>>>
>>> Joel
>>>
>>>
>>> On Saturday, June 29, 2019 at 2:36:04 AM UTC+8, Cyrus Hiatt wrote:

 The Arches team is happy to announce the 4.4.2 release which includes a
 number performance improvements and bug fixes:

 Here some of the release highlights:

- Fixes issue preventing Resource editors from editing without
being members of the Graph Editor group
- Improves error logging particularly for collector sync
transactions
- Fixes top margin of the default report
- Fixes bug preventing app from loading without the DEFAULT_BOUNDS
defined
- Deletes uploaded files when their respective tiles are deleted
- Improves v3 to v4 migration process
- Adds support for jsonl, multiprocessing data load
- Allows setup_db to be executed without superuser permissions
- You can find the detailed release notes here: 4.4.2 release notes

 

 Users are encouraged to update at their earliest convenience. If you
 are upgrading from Arches 4.3, be sure to follow the project upgrade
 instructions to 4.4.1
 
 before proceeding.

 As always the documentation can be found at <
 http://arches.readthedocs.io>

>>> --
>>> -- To post, send email to archesproject@googlegroups.com. To
>>> unsubscribe, send email to archesproject+unsubscr...@googlegroups.com.
>>> For more information, visit
>>> https://groups.google.com/d/forum/archesproject?hl=en
>>> ---
>>> You received this message because you are subscribed to the Google
>>> Groups "Arches Project" group.
>>> To unsubscribe from this group and stop receiving emails from it, send
>>> an email to archesproject+unsubscr...@googlegroups.com.
>>> To view this discussion on the web visit
>>> https://groups.google.com/d/msgid/archesproject/5786eee6-cb14-49f7-9597-6c4de8e2968e%40googlegroups.com
>>> 
>>> .
>>>
>> --
>> -- To post, send email to archesproject@googlegroups.com. To
>> unsubscribe, send email to archesproject+unsubscr...@googlegroups.com.
>> For more information, visit
>> https://groups.google.com/d/forum/archesproject?hl=en
>> ---
>> You received this message because you are subscribed to the Google Groups
>> "Arches Project" group.
>> To unsubscribe from this group and stop receiving emails from it, send an
>> email to archesproject+unsubscr...@googlegroups.com.
>> To view this discussion on the web visit
>> https://groups.google.com/d/msgid/archesproject/CAHVjc3W9BvtRpPfuP1D_i9b4yH%2BT%3Dq2wkPBpxBqPK1RdpdT9Fw%40mail.gmail.com
>> 
>> .
>>
> --
> -- To post, send email to archesproject@googlegroups.com. To unsubscribe,
> send email to archesproject+unsubscr...@googlegroups.com. For more
> information, visit https://groups.google.com/d/forum/archesproject?hl=en
> ---
> You received this message because you are subscribed to the Google Groups
> "Arches Project" group.
> To unsubscribe from this group and stop receiving emails from it, send an
> email to archesproject+unsubscr...@googlegroups.com.
> To view this discussion on the web visit
> https://groups.google.com/d/msgid/archesproject/CAGYBTatgU8mO1Z7OgwbOYwVvCFCHX3FBi9mJvO5_3r8TdY%2BkoA%40mail.gmail.com
> 
> .
>

-- 
-- To post, send email to archesproject@googlegroups.com. To unsubscribe, send 
email to 

Re: [Arches] Docker-compose image have 404 for all static assets.

[Vincent Meijer]

Nice!
Sounds like that is a regular assertion error and independent of the
environment, or does the test succeed locally?

On Tue, Apr 23, 2019 at 6:46 PM Ben O'Steen  wrote:

> Good news, Bad news I'm afraid:
>
> Good news? the environment flag seems to have done the trick and the
> Elasticsearch container doesn't quit after running its checks.
>
> Bad news? There is a failing test:
>
> FAIL: Test bulk deleting of documents in Elasticsearch
> --
> Traceback (most recent call last):
> File "/web_root/arches/tests/search/search_tests.py", line 66, in
> test_bulk_delete
> self.assertEqual(se.count(index='test'), 10)
> AssertionError: 11 != 10
>
>
> https://cloud.docker.com/repository/registry-1.docker.io/benosteen/arches/builds/88c8a09d-9fa6-44f5-a86a-fc960ba2f327
>
>
>
> On Tue, 23 Apr 2019 at 08:23, Ben O'Steen  wrote:
>
>> That is an odd error, certainly works locally but not when docker hub
>> runs the test setup.
>>
>> One thing it could be is that if docker hub are using default EC2
>> instances, they have the vm.max_map_count set too low for Elasticsearch. It
>> is high enough that Elasticsearch will boot but not enough to stop it
>> erroring out after a very short period. I've been using 'sudo sysctl -w
>> vm.max_map_count=262144' on the host to avoid this which is why it is not
>> erroring for me during Elasticsearch's bootstrap checks.
>>
>> We should be able to disable the checks (turn them from hard errors to
>> soft warnings in the logs) by passing the ES container
>> "discovery.type=single-node" as an environment variable. I'll try this on
>> my docker hub account and see if that can fix it.
>>
>> Ben
>>
>> On Tue, 23 Apr 2019 at 03:12, Vincent Meijer 
>> wrote:
>>
>>> It seems there are problems with our automated docker builds, which is
>>> presumably the cause of the 4.4.1 tag not existing.
>>>
>>> Latest build of the master branch failed: the Elasticsearch endpoint
>>> cannot be reached during the unit tests.
>>> Failed to establish a new connection: [Errno -2] Name or service not
>>> known)
>>>
>>> https://cloud.docker.com/u/archesproject/repository/registry-1.docker.io/archesproject/arches/builds/ca27a312-4d02-4e1b-b65c-2f34cb22ef79
>>>
>>>
>>> Not sure why this is, as the Elasticsearch container seems to be up and
>>> running during the test.
>>>
>>> Full command: run_tests
>>> Command: run_tests
>>> Testing if database server is up...
>>> Database server is up
>>> Testing if Elasticsearch is up...
>>> Elasticsearch is up
>>>
>>> However, the 4.4.1 build does not seem be have been triggered at all,
>>> and I'm at a loss as to why this hasn't happened...
>>> Possibly someone with more permissions than me could check the webhook
>>> settings in the Github repo? :)
>>>
>>> Vincent
>>>
>>> On Fri, Apr 19, 2019 at 12:40 AM Ben O'Steen  wrote:
>>>
>>>>
>>>> - As for Docker 4.4.1 not being put onto Docker Hub, I'm not sure why
>>>> that is. I've been making my own images of the codebase in lieu of that.
>>>>
>>>> - I don't get the System settings errors you mention, though I am using
>>>> Arches based on a much more recent codebase (I created my Arches base image
>>>> last week or so from the master branch).
>>>>
>>>> Ben
>>>>
>>>> On Tue, 16 Apr 2019 at 14:39, Matthias Bussonnier <
>>>> bussonniermatth...@gmail.com> wrote:
>>>>
>>>>> Thanks Ben,
>>>>>
>>>>> That was useful, I guess I got confused between DEV mode 8000 and PROD
>>>>> port 80, I got it to work now.
>>>>>
>>>>> 2 followup questions; now that I can see the website and login:
>>>>>   - I see on dockerhub that 4.4.1 has not been published; is that
>>>>> expected ?
>>>>>   - once logged-in I can't seem to access any of the 3 "System
>>>>> settings" pages, they give me a 500,  Is that expected ? (I haven't 
>>>>> managed
>>>>> to get both my deployment working and django to spit out a traceback,
>>>>> otherwise I would give up more info)
>>>>>
>>>>> I'm happy to start this as another thread if this is better suited.
>>>>> --
>>>>> Matthias
>>>>>
>>>&g

Re: [Arches] Docker-compose image have 404 for all static assets.

[Vincent Meijer]

It seems there are problems with our automated docker builds, which is
presumably the cause of the 4.4.1 tag not existing.

Latest build of the master branch failed: the Elasticsearch endpoint cannot
be reached during the unit tests.
Failed to establish a new connection: [Errno -2] Name or service not known)

https://cloud.docker.com/u/archesproject/repository/registry-1.docker.io/archesproject/arches/builds/ca27a312-4d02-4e1b-b65c-2f34cb22ef79


Not sure why this is, as the Elasticsearch container seems to be up and
running during the test.

Full command: run_tests
Command: run_tests
Testing if database server is up...
Database server is up
Testing if Elasticsearch is up...
Elasticsearch is up

However, the 4.4.1 build does not seem be have been triggered at all, and
I'm at a loss as to why this hasn't happened...
Possibly someone with more permissions than me could check the webhook
settings in the Github repo? :)

Vincent

On Fri, Apr 19, 2019 at 12:40 AM Ben O'Steen  wrote:

>
> - As for Docker 4.4.1 not being put onto Docker Hub, I'm not sure why that
> is. I've been making my own images of the codebase in lieu of that.
>
> - I don't get the System settings errors you mention, though I am using
> Arches based on a much more recent codebase (I created my Arches base image
> last week or so from the master branch).
>
> Ben
>
> On Tue, 16 Apr 2019 at 14:39, Matthias Bussonnier <
> bussonniermatth...@gmail.com> wrote:
>
>> Thanks Ben,
>>
>> That was useful, I guess I got confused between DEV mode 8000 and PROD
>> port 80, I got it to work now.
>>
>> 2 followup questions; now that I can see the website and login:
>>   - I see on dockerhub that 4.4.1 has not been published; is that
>> expected ?
>>   - once logged-in I can't seem to access any of the 3 "System settings"
>> pages, they give me a 500,  Is that expected ? (I haven't managed to get
>> both my deployment working and django to spit out a traceback, otherwise I
>> would give up more info)
>>
>> I'm happy to start this as another thread if this is better suited.
>> --
>> Matthias
>>
>>
>>
>> On Tue, 16 Apr 2019 at 10:12, Ben O'Steen  wrote:
>>
>>> I should also make it clear that all of what I mentioned above is the
>>> default behaviour and doesn't need you to do anything more to make it work.
>>>
>> --
> -- To post, send email to archesproject@googlegroups.com. To unsubscribe,
> send email to archesproject+unsubscr...@googlegroups.com. For more
> information, visit https://groups.google.com/d/forum/archesproject?hl=en
> ---
> You received this message because you are subscribed to the Google Groups
> "Arches Project" group.
> To unsubscribe from this group and stop receiving emails from it, send an
> email to archesproject+unsubscr...@googlegroups.com.
> For more options, visit https://groups.google.com/d/optout.
>

-- 
-- To post, send email to archesproject@googlegroups.com. To unsubscribe, send 
email to archesproject+unsubscr...@googlegroups.com. For more information, 
visit https://groups.google.com/d/forum/archesproject?hl=en
--- 
You received this message because you are subscribed to the Google Groups 
"Arches Project" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to archesproject+unsubscr...@googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

Re: [Arches] Uploading files to different folders based on their filename

[Vincent Meijer]

Hi Bryan,

It sounds like your best bet would be to implement a custom storage backend:
https://docs.djangoproject.com/en/1.11/howto/custom-file-storage/

You are probably looking to override the _save() method.
Examples of how this could work:
https://stackoverflow.com/questions/4894976/django-custom-file-storage-system

https://github.com/globaldigitalheritage/arches-3d/blob/857c891aa8a885efe4cfaeadb6ac3f25a18d594c/arches_3d/arches_3d/storage/arches_3d_custom_storage.py#L63


Hope this helps!
Vincent

On Mon, Apr 8, 2019 at 3:59 PM Bryan Alvey  wrote:

> Hi guys
>
> We have many thousands of files we wish to upload to different folders on
> the server based on their filename.  Has anyone else tried this? Can anyone
> direct me to the code for the file upload so that I can see what's going on?
>
> Best wishes,
>
>
> Bryan
>
> --
> -- To post, send email to archesproject@googlegroups.com. To unsubscribe,
> send email to archesproject+unsubscr...@googlegroups.com. For more
> information, visit https://groups.google.com/d/forum/archesproject?hl=en
> ---
> You received this message because you are subscribed to the Google Groups
> "Arches Project" group.
> To unsubscribe from this group and stop receiving emails from it, send an
> email to archesproject+unsubscr...@googlegroups.com.
> For more options, visit https://groups.google.com/d/optout.
>

-- 
-- To post, send email to archesproject@googlegroups.com. To unsubscribe, send 
email to archesproject+unsubscr...@googlegroups.com. For more information, 
visit https://groups.google.com/d/forum/archesproject?hl=en
--- 
You received this message because you are subscribed to the Google Groups 
"Arches Project" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to archesproject+unsubscr...@googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

Re: [Arches] Re: Exception in search

[Vincent Meijer]

+1 now that you mention it, Adam, I get these as well for the same reason.
Nothing to worry about.

On Wed, Mar 20, 2019, 19:47 Adam Cox  wrote:

> I think this is a "broken socket" that happens sometimes using the dev
> server when a new request is made before an existing one is completed. I've
> seen it before, but it's never caused any actual problems for me.
>
> Adam
>
> On Wed, Mar 20, 2019 at 1:34 PM Cyrus Hiatt  wrote:
>
>> Hi Yuval,
>>
>> Are you still seeing this error? Unfortunately I'm not able to reproduce
>> it on my machine.  What version of Arches are you running?
>>
>> Thanks,
>>
>> Cyrus
>>
>> On Tuesday, March 12, 2019 at 3:40:47 AM UTC-7, Yuval Krymolowski wrote:
>>>
>>> Hello,
>>>
>>>   In the search screen, Arches begins to search for candidates as I type
>>> the query. It gets exceptions in the process (see below).
>>>
>>> The search for the complete term succeeds without exceptions.
>>>
>>> Yuval
>>> 
>>> Exception happened during processing of request from ('127.0.0.1', 57593)
>>> Traceback (most recent call last):
>>>   File "C:\Python27\Lib\SocketServer.py", line 596, in
>>> process_request_thread
>>> self.finish_request(request, client_address)
>>>   File "C:\Python27\Lib\SocketServer.py", line 331, in finish_request
>>> self.RequestHandlerClass(request, client_address, self)
>>>   File "C:\Python27\Lib\SocketServer.py", line 654, in __init__
>>> self.finish()
>>>   File "C:\Python27\Lib\SocketServer.py", line 713, in finish
>>> self.wfile.close()
>>>   File "C:\Python27\Lib\socket.py", line 283, in close
>>> self.flush()
>>>   File "C:\Python27\Lib\socket.py", line 307, in flush
>>> self._sock.sendall(view[write_offset:write_offset+buffer_size])
>>> error: [Errno 10054] An existing connection was forcibly closed by the
>>> remote host
>>> 
>>> [
>>>
>> --
>> -- To post, send email to archesproject@googlegroups.com. To
>> unsubscribe, send email to archesproject+unsubscr...@googlegroups.com.
>> For more information, visit
>> https://groups.google.com/d/forum/archesproject?hl=en
>> ---
>> You received this message because you are subscribed to the Google Groups
>> "Arches Project" group.
>> To unsubscribe from this group and stop receiving emails from it, send an
>> email to archesproject+unsubscr...@googlegroups.com.
>> For more options, visit https://groups.google.com/d/optout.
>>
> --
> -- To post, send email to archesproject@googlegroups.com. To unsubscribe,
> send email to archesproject+unsubscr...@googlegroups.com. For more
> information, visit https://groups.google.com/d/forum/archesproject?hl=en
> ---
> You received this message because you are subscribed to the Google Groups
> "Arches Project" group.
> To unsubscribe from this group and stop receiving emails from it, send an
> email to archesproject+unsubscr...@googlegroups.com.
> For more options, visit https://groups.google.com/d/optout.
>

-- 
-- To post, send email to archesproject@googlegroups.com. To unsubscribe, send 
email to archesproject+unsubscr...@googlegroups.com. For more information, 
visit https://groups.google.com/d/forum/archesproject?hl=en
--- 
You received this message because you are subscribed to the Google Groups 
"Arches Project" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to archesproject+unsubscr...@googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

[Arches] Re: Other Arches live installations

[Vincent Meijer]

Hi Alina,

They do post updates on their Facebook page 
occasionally: https://www.facebook.com/globaldigitalheritage/

Also they have a Sketchfab account for 3D 
models: https://sketchfab.com/GlobalDigitalHeritage 
Although those models don't really come with write-ups. 

Youtube is here: https://www.youtube.com/channel/UCwxvv0crLxT0NSfbGD4hSOQ

Well hidden on our website is also this overview of 
publications: https://globaldigitalheritage.org/publications/ 
And there is an overview of links to news 
reports: https://globaldigitalheritage.org/news/

Spreading the word is always appreciated! 

Vincent


On Tuesday, 26 February 2019 20:37:29 UTC+1, Alina Myklebust wrote:
>
> Hi Vincent, I started looking through the various records and it's very 
> impressive.  Thank you so much for sharing it here.  
>
> Has Global Digital Heritage shared any of this on social media yet or any 
> write-ups on their website/blog?  At first glance, I didn't come across any 
> published content.  We would be interested in spreading the word.  Thanks 
> again for bringing this to our attention!
>
> Alina
> Arches Project Team
>
>
> On Sunday, February 24, 2019 at 9:27:26 AM UTC-8, Vincent Meijer wrote:
>>
>> A while ago we launched our Arches v4 implementation for Global Digital 
>> Heritage, a non-profit organization in Florida that digitizes heritage 
>> through 3D terrestrial laser scanning and other 3D and GIS techniques.
>>
>> Among their projects are crusader castles in Spain and 18th century 
>> chateaus in France, as well as museum objects from for example Greek and 
>> Roman periods. 
>>
>> I added a number of viewers to the Arches reports, such as 3D HOP (3D 
>> meshed models), Sketchfab (3D meshed models), Potree (pointclouds), Virtual 
>> Tours (like Google Streetview) and Pannellum (360 photos).
>>
>>
>> Version 1.0.0 is now live and we're working hard on many improvements.
>>
>> https://globaldigitalheritage.org 
>>
>>
>> *Highlighted pages: *
>>
>> Castilla-La Mancha project: 
>> https://globaldigitalheritage.org/report/9d3160b6-fbc5-11e8-a5fb-0242c0a8d002
>>
>> Chateau La Roche-Guyon: 
>> https://globaldigitalheritage.org/report/afcf04dc-f704-11e8-b785-0242c0a8a002
>>
>> Archaeological Museum of Aidone: 
>> https://globaldigitalheritage.org/report/dcbad7ae-18c5-11e9-aee2-0242ac130002
>>
>> Yulee Sugar Mill (Florida): 
>> https://globaldigitalheritage.org/report/3d9934f0-14f0-11e9-b73a-0242ac120002
>>
>>
>>
>> Enjoy! And feedback is always welcome.
>>
>> Vincent
>>
>>
>> On Friday, 4 January 2019 18:46:41 UTC+1, sara...@lacity.org wrote:
>>>
>>> Greetings from Los Angeles,
>>>
>>> We are excited to begin work on our migration to v4 in the very near 
>>> future. HistoricPlacesLA, the City of Los Angeles’ Arches installation, is 
>>> going to greatly benefit from the v3-v4 migration workflow Adam mentioned 
>>> in his post.
>>>
>>> In 2018 the Office of Historic Resources, which manages HistoricPlacesLA 
>>> and provides technical expertise to the Los Angeles Department of City 
>>> Planning regarding historic resources, has witnessed an increase in use of 
>>> the data housed within HistoricPlacesLA and datasets soon to be part of the 
>>> v4 installation. This data includes information pertaining to designated 
>>> historic resources, surveyed historic resources, and resources identified 
>>> as significant in relation to multiple ethnic/cultural communities within 
>>> the city of Los Angeles.
>>>
>>> As the Los Angeles Department of City Planning begins work on updating 
>>> nine new community plans that guide the evolution and future development of 
>>> hundreds of unique neighborhoods in the city, historic resources data is 
>>> being utilized by planners to understand whole communities while also 
>>> informing the vision for these neighborhoods into the future. The data is 
>>> currently assisting in the creation of conservation tools that elevate 
>>> community character, encompassing both architecturally and culturally 
>>> significant historic resources.
>>>
>>> We look forward to sharing more of Los Angeles’ progress with 
>>> HistoricPlacesLA and the many ways our inventory is informing local 
>>> planning and the conservation of historic resources.
>>>
>>> Happy New Year!
>>> Sara Delgadillo Cruz
>>>
>>>
>>> On Wednesday, January 2, 2019 at 10:19:45 AM UTC-8, Adam Cox wrote:
>>>>
>>

Re: [Arches] Re: Illegal byte sequence - installing on windows

[Vincent Meijer]

That is quite surprising indeed :)
Glad I could help!

On Wed, Feb 27, 2019 at 10:43 AM Yuval Krymolowski 
wrote:

> Thanks Vincent, disabling the progress bar helped! Surprising, isn't it?
>
> I use pip 9.0.3:
> C:\Users\yuval>python -m pip --version
> pip 9.0.3 from C:\Python27\lib\site-packages (python 2.7)
>
>Yuval
>
> בתאריך יום רביעי, 27 בפברואר 2019 בשעה 10:04:46 UTC+2, מאת Vincent Meijer:
>>
>> Hi Yuval,
>>
>> What version of pip are you using? It is reported here that 18.0 and 18.1
>> are related to this error:
>> https://github.com/pypa/pip/issues/5665
>>
>> You could try up- or downgrading pip to another version.
>> One of the other solutions posted there is disabling the progress
>> bar: --progress-bar=off
>> (I am assuming the complete command would be:
>>python -m pip install arches --progress-bar=off --no-binary :all:
>> )
>>
>> Or similar with: pip install  arches-q --no-binary :all:
>> (Downside of this is that you cannot see the progress of the installation)
>>
>> I hope this helps,
>> Vincent
>>
>> On Wed, Feb 27, 2019 at 5:57 AM Yuval Krymolowski 
>> wrote:
>>
>>> Yes, python 2.7.19 and I updated the PATH as instructed. I also added
>>> c:\python27 to the system's path .
>>>
>>> Yuval
>>>
>>> On Tuesday, February 26, 2019 at 8:12:07 PM UTC+2, Yuval Krymolowski
>>> wrote:
>>>>
>>>> Hello,
>>>>
>>>>  I followed the installation insttructions on windows and  got thie
>>>> error message, please help:
>>>>
>>>> (ENV) C:\Users\yuval\Documents\Projects>python -m pip install arches
>>>> --no-binary :all:
>>>> Collecting arches
>>>>   Downloading
>>>> https://files.pythonhosted.org/packages/86/f5/d49a1a94feec4859706672495c103a1ef1cca175b466c58880e16f45b6bc/arches-4.3.3.tar.gz
>>>> (39.7MB)
>>>> 1% |Could not install packages due to an EnvironmentError: [Errno
>>>> 42] Illegal byte sequence
>>>>
>>> --
>>> -- To post, send email to arches...@googlegroups.com. To unsubscribe,
>>> send email to archesprojec...@googlegroups.com. For more information,
>>> visit https://groups.google.com/d/forum/archesproject?hl=en
>>> ---
>>> You received this message because you are subscribed to the Google
>>> Groups "Arches Project" group.
>>> To unsubscribe from this group and stop receiving emails from it, send
>>> an email to archesprojec...@googlegroups.com.
>>> For more options, visit https://groups.google.com/d/optout.
>>>
>> --
> -- To post, send email to archesproject@googlegroups.com. To unsubscribe,
> send email to archesproject+unsubscr...@googlegroups.com. For more
> information, visit https://groups.google.com/d/forum/archesproject?hl=en
> ---
> You received this message because you are subscribed to the Google Groups
> "Arches Project" group.
> To unsubscribe from this group and stop receiving emails from it, send an
> email to archesproject+unsubscr...@googlegroups.com.
> For more options, visit https://groups.google.com/d/optout.
>

-- 
-- To post, send email to archesproject@googlegroups.com. To unsubscribe, send 
email to archesproject+unsubscr...@googlegroups.com. For more information, 
visit https://groups.google.com/d/forum/archesproject?hl=en
--- 
You received this message because you are subscribed to the Google Groups 
"Arches Project" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to archesproject+unsubscr...@googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

Re: [Arches] Re: Illegal byte sequence - installing on windows

[Vincent Meijer]

Hi Yuval,

What version of pip are you using? It is reported here that 18.0 and 18.1
are related to this error:
https://github.com/pypa/pip/issues/5665

You could try up- or downgrading pip to another version.
One of the other solutions posted there is disabling the progress
bar: --progress-bar=off
(I am assuming the complete command would be:
   python -m pip install arches --progress-bar=off --no-binary :all:
)

Or similar with: pip install  arches-q --no-binary :all:
(Downside of this is that you cannot see the progress of the installation)

I hope this helps,
Vincent

On Wed, Feb 27, 2019 at 5:57 AM Yuval Krymolowski 
wrote:

> Yes, python 2.7.19 and I updated the PATH as instructed. I also added
> c:\python27 to the system's path .
>
> Yuval
>
> On Tuesday, February 26, 2019 at 8:12:07 PM UTC+2, Yuval Krymolowski wrote:
>>
>> Hello,
>>
>>  I followed the installation insttructions on windows and  got thie error
>> message, please help:
>>
>> (ENV) C:\Users\yuval\Documents\Projects>python -m pip install arches
>> --no-binary :all:
>> Collecting arches
>>   Downloading
>> https://files.pythonhosted.org/packages/86/f5/d49a1a94feec4859706672495c103a1ef1cca175b466c58880e16f45b6bc/arches-4.3.3.tar.gz
>> (39.7MB)
>> 1% |Could not install packages due to an EnvironmentError: [Errno 42]
>> Illegal byte sequence
>>
> --
> -- To post, send email to archesproject@googlegroups.com. To unsubscribe,
> send email to archesproject+unsubscr...@googlegroups.com. For more
> information, visit https://groups.google.com/d/forum/archesproject?hl=en
> ---
> You received this message because you are subscribed to the Google Groups
> "Arches Project" group.
> To unsubscribe from this group and stop receiving emails from it, send an
> email to archesproject+unsubscr...@googlegroups.com.
> For more options, visit https://groups.google.com/d/optout.
>

-- 
-- To post, send email to archesproject@googlegroups.com. To unsubscribe, send 
email to archesproject+unsubscr...@googlegroups.com. For more information, 
visit https://groups.google.com/d/forum/archesproject?hl=en
--- 
You received this message because you are subscribed to the Google Groups 
"Arches Project" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to archesproject+unsubscr...@googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

[Arches] Re: Other Arches live installations

[Vincent Meijer]

A while ago we launched our Arches v4 implementation for Global Digital 
Heritage, a non-profit organization in Florida that digitizes heritage 
through 3D terrestrial laser scanning and other 3D and GIS techniques.

Among their projects are crusader castles in Spain and 18th century 
chateaus in France, as well as museum objects from for example Greek and 
Roman periods. 

I added a number of viewers to the Arches reports, such as 3D HOP (3D 
meshed models), Sketchfab (3D meshed models), Potree (pointclouds), Virtual 
Tours (like Google Streetview) and Pannellum (360 photos).


Version 1.0.0 is now live and we're working hard on many improvements.

https://globaldigitalheritage.org 


*Highlighted pages: *

Castilla-La Mancha project: 
https://globaldigitalheritage.org/report/9d3160b6-fbc5-11e8-a5fb-0242c0a8d002

Chateau La 
Roche-Guyon: 
https://globaldigitalheritage.org/report/afcf04dc-f704-11e8-b785-0242c0a8a002

Archaeological Museum of Aidone: 
https://globaldigitalheritage.org/report/dcbad7ae-18c5-11e9-aee2-0242ac130002

Yulee Sugar Mill 
(Florida): 
https://globaldigitalheritage.org/report/3d9934f0-14f0-11e9-b73a-0242ac120002



Enjoy! And feedback is always welcome.

Vincent


On Friday, 4 January 2019 18:46:41 UTC+1, sara...@lacity.org wrote:
>
> Greetings from Los Angeles,
>
> We are excited to begin work on our migration to v4 in the very near 
> future. HistoricPlacesLA, the City of Los Angeles’ Arches installation, is 
> going to greatly benefit from the v3-v4 migration workflow Adam mentioned 
> in his post.
>
> In 2018 the Office of Historic Resources, which manages HistoricPlacesLA 
> and provides technical expertise to the Los Angeles Department of City 
> Planning regarding historic resources, has witnessed an increase in use of 
> the data housed within HistoricPlacesLA and datasets soon to be part of the 
> v4 installation. This data includes information pertaining to designated 
> historic resources, surveyed historic resources, and resources identified 
> as significant in relation to multiple ethnic/cultural communities within 
> the city of Los Angeles.
>
> As the Los Angeles Department of City Planning begins work on updating 
> nine new community plans that guide the evolution and future development of 
> hundreds of unique neighborhoods in the city, historic resources data is 
> being utilized by planners to understand whole communities while also 
> informing the vision for these neighborhoods into the future. The data is 
> currently assisting in the creation of conservation tools that elevate 
> community character, encompassing both architecturally and culturally 
> significant historic resources.
>
> We look forward to sharing more of Los Angeles’ progress with 
> HistoricPlacesLA and the many ways our inventory is informing local 
> planning and the conservation of historic resources.
>
> Happy New Year!
> Sara Delgadillo Cruz
>
>
> On Wednesday, January 2, 2019 at 10:19:45 AM UTC-8, Adam Cox wrote:
>>
>> Hello Edmund!
>>
>> Apologies for such a late reply to this query, because I do indeed have 
>> updates from 2018.
>>
>> The biggest Arches project I finished last year was the Heritage 
>> Monitoring Scout database for the Florida Public Archaeology Network. The 
>> HMS program allows citizens to contribute condition assessments on 
>> archaeological and historic sites all around Florida, with a special focus 
>> on sites that are affected by sea level rise. It was a project that 
>> required significant alterations to Arches, mostly enhancements to the 
>> permissions system, user signup, and a dual log in system to accommodate 
>> both citizen "scouts" and state employees who will use the same system. You 
>> can read about the release here: 
>> http://fpangoingpublic.blogspot.com/2018/08/hms-florida-arches-launch.html, 
>> or visit https://fpan.us/projects/HMSflorida.php to learn more about the 
>> HMS program itself. The Arches database is https://hms.fpan.us.
>>
>> Near the end of 2018 we at Legion GIS also finished a v3-v4 migration 
>> workflow while working with Hong Kong University. At present, you can see 
>> their new v4 databases at hk.legiongis.com, the Hong Kong heritage 
>> database, and yg.legiongis.com, showing heritage in Yangon. (Note these 
>> web addresses will likely change in the future.) To my knowledge, this is 
>> the first large-scale migration of v3 Arches-HIP databases to an Arches v4 
>> environment. We are currently working to publish this workflow, which v3 
>> users can look forward to in early 2019.
>>
>> Happy New Year!
>> Adam
>>
>> On Friday, December 7, 2018 at 7:55:54 AM UTC-6, Edmund Lee wrote:
>>>
>>> Hello all,
>>>
>>> It's been a while (2 years!) since this thread went quiet, so I thought 
>>> the year end for those of us on the Gregorian calendar might be a good 
>>> moment to put out a call for news of live Arches installations around the 
>>> globe. Why not share a link to your Arches-based system here and bask in 
>>> the 

[Arches] Re: Security testing/audit

[Vincent Meijer]

Hi John,

I haven't heard of anyone doing a security audit for Arches, but if so I 
would also be quite interested in hearing about it.

Best,
Vincent

On Monday, 17 December 2018 10:49:03 UTC+1, John Murphy wrote:
>
> Good morning everyone!
>
> I was wondering if has anyone has had to commission a security audit of 
> Arches yet and, if so, what have your experiences been? Our corporate IT 
> are going to require one before they allow me to set this loose on our 
> network and it would be good to know what I need to look out for.
>
> Many thanks,
>
> John 
>

-- 
-- To post, send email to archesproject@googlegroups.com. To unsubscribe, send 
email to archesproject+unsubscr...@googlegroups.com. For more information, 
visit https://groups.google.com/d/forum/archesproject?hl=en
--- 
You received this message because you are subscribed to the Google Groups 
"Arches Project" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to archesproject+unsubscr...@googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

[Arches] Re: Google Analytics

[Vincent Meijer]

Found the potential culprit: I need to add www.google-analytics.com to 
my Content Security Policy ('script-src') directive.
I'll update here once I am able to test this again.


On Sunday, 25 November 2018 11:17:38 UTC+1, Vincent Meijer wrote:
>
> Has anyone used the Google Analytics feature built into Arches?
>
> It doesn't seem to be working for me. I created a GA account and pasted my 
> tracking id in the 'Google Analytics Key' field in Arches System Settings.
> However, no traffic is being recorded, according to the GA website.
>
> Also, for some reason the analytics.js snippet is only present on about 
> every other page refresh (50% of the time), which is odd by itself.
>   
>
> [image: ga.png]
>
> Thanks!
> Vincent
>

-- 
-- To post, send email to archesproject@googlegroups.com. To unsubscribe, send 
email to archesproject+unsubscr...@googlegroups.com. For more information, 
visit https://groups.google.com/d/forum/archesproject?hl=en
--- 
You received this message because you are subscribed to the Google Groups 
"Arches Project" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to archesproject+unsubscr...@googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

[Arches] Google Analytics

[Vincent Meijer]

Has anyone used the Google Analytics feature built into Arches?

It doesn't seem to be working for me. I created a GA account and pasted my 
tracking id in the 'Google Analytics Key' field in Arches System Settings.
However, no traffic is being recorded, according to the GA website.

Also, for some reason the analytics.js snippet is only present on about 
every other page refresh (50% of the time), which is odd by itself.
  

[image: ga.png]

Thanks!
Vincent

-- 
-- To post, send email to archesproject@googlegroups.com. To unsubscribe, send 
email to archesproject+unsubscr...@googlegroups.com. For more information, 
visit https://groups.google.com/d/forum/archesproject?hl=en
--- 
You received this message because you are subscribed to the Google Groups 
"Arches Project" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to archesproject+unsubscr...@googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

Re: [Arches] Fuzzy dates

[Vincent Meijer]

There you go: https://github.com/archesproject/arches-docs/issues/76

On Mon, Nov 19, 2018 at 6:45 PM Adam Cox  wrote:

> Ok, thanks for chiming in Alexei. I agree Vincent, that more could be
> added to the help to explain ETDF dates. If you have a minute, a ticket in
> the https://github.com/archesproject/arches-docs would be appreciated,
> especially if you have a specific idea of where it would be most
> appropriate to put that info.
>
> Thanks!
> Adam
>
> On Mon, Nov 19, 2018 at 5:42 PM Alexei Peters  wrote:
>
>> Adam, the link (https://www.loc.gov/standards/datetime/edtf.html) that
>> Vincent just posted is the new (official) spec, which appears to have just
>> been posted last month.
>> Unfortunately, the library we use still references the old draft, so for
>> now we need to stick with the old link in our docs.
>> -Alexei
>>
>> Director of Web Development - Farallon Geographics, Inc. - 971.227.3173
>>
>>
>> On Mon, Nov 19, 2018 at 8:14 AM Vincent Meijer 
>> wrote:
>>
>>> Adam, here is a recently posted page that might be even better:
>>> https://www.loc.gov/standards/datetime/edtf.html
>>>
>>> Generally speaking though, a few words of introduction on fuzzy dates
>>> and some pointers, e.g. that the data type in Arches can be found as
>>> 'edtf', and also some examples of what values can be entered, would be most
>>> helpful.
>>>
>>> I just discovered that using dates like 'Early 2nd Century' actually
>>> works well together with the time wheel! Quite impressive, that's a great
>>> feature.
>>>
>>> Now if only I could get periods B.C. to work... But I understand we
>>> can't have everything :)
>>>
>>>
>>> On Friday, 7 September 2018 19:06:22 UTC+2, Adam Cox wrote:
>>>>
>>>> Vincent, the in-app help on the graph tab of the graph designer has a
>>>> section called "Default Data Types" which includes a link to this page
>>>> https://www.loc.gov/standards/datetime/ in the edtf row. Do you think
>>>> the link alexei shared above would be more helpful there? Very open to
>>>> suggestions.
>>>>
>>>> On Fri, Sep 7, 2018 at 5:49 AM, Vincent Meijer 
>>>> wrote:
>>>>
>>>>> Thanks, i'll look into that. If anyone is already using fuzzy dates in
>>>>> Arches, I would love to hear from them!
>>>>>
>>>>> On Thu, Sep 6, 2018 at 10:41 PM Alexei Peters 
>>>>> wrote:
>>>>>
>>>>>> Oops! Here's the link...
>>>>>> http://www.loc.gov/standards/datetime/pre-submission.html
>>>>>>
>>>>>>
>>>>>>
>>>>>> Director of Web Development - Farallon Geographics, Inc. -
>>>>>> 971.227.3173
>>>>>>
>>>>>> On Thu, Sep 6, 2018 at 11:36 AM, Alexei Peters 
>>>>>> wrote:
>>>>>>
>>>>>>> Hi Vincent,
>>>>>>> Here's a link to the EDTF proposal.  It has a bunch of examples of
>>>>>>> EDTF strings and what they mean and how they should be interpreted.
>>>>>>> -Alexei
>>>>>>>
>>>>>>>
>>>>>>> Director of Web Development - Farallon Geographics, Inc. -
>>>>>>> 971.227.3173
>>>>>>>
>>>>>>> On Thu, Sep 6, 2018 at 3:12 AM, Vincent Meijer >>>>>> > wrote:
>>>>>>>
>>>>>>>> Since Arches 4.2 fuzzy dates are supported. I am looking for a few
>>>>>>>> pointers on how this works and how to use them.
>>>>>>>>
>>>>>>>> Thanks!
>>>>>>>>
>>>>>>>> --
>>>>>>>> -- To post, send email to arches...@googlegroups.com. To
>>>>>>>> unsubscribe, send email to archesprojec...@googlegroups.com. For
>>>>>>>> more information, visit
>>>>>>>> https://groups.google.com/d/forum/archesproject?hl=en
>>>>>>>> ---
>>>>>>>> You received this message because you are subscribed to the Google
>>>>>>>> Groups "Arches Project" group.
>>>>>>>> To unsubscribe from this group and stop receiving emails from it,
>>>>>>>> send an email to archesprojec...@googlegroups.com.
>>>>>>>> For more

Re: [Arches] Re: RequireJS timed out

[Vincent Meijer]

Yes please, that way I wouldn't have to override base.htm either :)

On Mon, 19 Nov 2018, 18:51 Adam Cox  Vincent, this illustrates a great way to normalize the inclusion of extra
> Javascript libraries in an Arches project:
>
> I think a dummy file, perhaps called "javascript_project.htm" should be
> put into a project by default, and then a line added to the real base.htm
> to include it (or something along these lines). This would set up a good
> scaffolding for developers who need to make widgets that use extra
> javascript libraries.
>
> Adam
>
> On Mon, Nov 19, 2018 at 5:34 PM Vincent Meijer 
> wrote:
>
>> I extend require.config() this way:
>> https://github.com/globaldigitalheritage/arches-3d/blob/master/arches_3d/arches_3d/templates/config.htm
>>
>> Then I include that template like so:
>> https://github.com/globaldigitalheritage/arches-3d/blob/master/arches_3d/arches_3d/templates/base.htm#L63
>> (I copy/pasted that base.htm from the official Arches repo so it
>> effectively overrides that.  Then I added that highlighted line)
>>
>>
>> On Monday, 19 November 2018 18:15:37 UTC+1, Lawrence Goh wrote:
>>>
>>> Hi Vincent,
>>>
>>> Just checking, is there a variable in the code base for the waitseconds?
>>>
>>> By default, i think its 7 sec.
>>>
>>> Thanks.
>>>
>>> Regards,
>>> Lawrence
>>>
>>>  Original message 
>>> From: Vincent Meijer 
>>> Date: 11/20/18 5:52 AM (GMT+12:00)
>>> To: Arches Project 
>>> Subject: [Arches] Re: RequireJS timed out
>>>
>>> Hey Lawrence,
>>>
>>> Not sure if I ever had the same problem, but at some point I set my
>>> waitSeconds to 0, so I must have at least some issues with loading
>>> javascipt modules.
>>>
>>>
>>> On Tuesday, 13 November 2018 03:46:24 UTC+1, Lawrence Goh wrote:
>>>>
>>>> Hi all,  has anyone experienced this where you have defined the data
>>>> type 'concept' and the 'concept collection' dropdown doesn't appear? In
>>>> console, you will get a RequireJS timed out.
>>>>
>>>> I had to change the requireJS's waitSeconds to 60 for it to work.
>>>>
>>>> [image: Screenshot from 2018-11-13 13-38-10.png]
>>>>
>>>> [image: Screenshot from 2018-11-13 12-12-44.png]
>>>>
>>>> [image: Screenshot from 2018-11-13 12-47-13.png]
>>>>
>>>> --
>>> -- To post, send email to arches...@googlegroups.com. To unsubscribe,
>>> send email to archesprojec...@googlegroups.com. For more information,
>>> visit https://groups.google.com/d/forum/archesproject?hl=en
>>> ---
>>> You received this message because you are subscribed to the Google
>>> Groups "Arches Project" group.
>>> To unsubscribe from this group and stop receiving emails from it, send
>>> an email to archesprojec...@googlegroups.com.
>>> For more options, visit https://groups.google.com/d/optout.
>>>
>> --
>> -- To post, send email to archesproject@googlegroups.com. To
>> unsubscribe, send email to archesproject+unsubscr...@googlegroups.com.
>> For more information, visit
>> https://groups.google.com/d/forum/archesproject?hl=en
>> ---
>> You received this message because you are subscribed to the Google Groups
>> "Arches Project" group.
>> To unsubscribe from this group and stop receiving emails from it, send an
>> email to archesproject+unsubscr...@googlegroups.com.
>> For more options, visit https://groups.google.com/d/optout.
>>
>

-- 
-- To post, send email to archesproject@googlegroups.com. To unsubscribe, send 
email to archesproject+unsubscr...@googlegroups.com. For more information, 
visit https://groups.google.com/d/forum/archesproject?hl=en
--- 
You received this message because you are subscribed to the Google Groups 
"Arches Project" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to archesproject+unsubscr...@googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

Re: [Arches] Re: RequireJS timed out

[Vincent Meijer]

I extend require.config() this 
way: 
https://github.com/globaldigitalheritage/arches-3d/blob/master/arches_3d/arches_3d/templates/config.htm

Then I include that template like 
so: 
https://github.com/globaldigitalheritage/arches-3d/blob/master/arches_3d/arches_3d/templates/base.htm#L63
(I copy/pasted that base.htm from the official Arches repo so it 
effectively overrides that.  Then I added that highlighted line)


On Monday, 19 November 2018 18:15:37 UTC+1, Lawrence Goh wrote:
>
> Hi Vincent,
>
> Just checking, is there a variable in the code base for the waitseconds?
>
> By default, i think its 7 sec.
>
> Thanks. 
>
> Regards,
> Lawrence 
>
>  Original message 
> From: Vincent Meijer > 
> Date: 11/20/18 5:52 AM (GMT+12:00) 
> To: Arches Project > 
> Subject: [Arches] Re: RequireJS timed out 
>
> Hey Lawrence,
>
> Not sure if I ever had the same problem, but at some point I set my 
> waitSeconds to 0, so I must have at least some issues with loading 
> javascipt modules.
>
>
> On Tuesday, 13 November 2018 03:46:24 UTC+1, Lawrence Goh wrote:
>>
>> Hi all,  has anyone experienced this where you have defined the data type 
>> 'concept' and the 'concept collection' dropdown doesn't appear? In console, 
>> you will get a RequireJS timed out.
>>
>> I had to change the requireJS's waitSeconds to 60 for it to work.
>>
>> [image: Screenshot from 2018-11-13 13-38-10.png]
>>
>> [image: Screenshot from 2018-11-13 12-12-44.png]
>>
>> [image: Screenshot from 2018-11-13 12-47-13.png]
>>
>> -- 
> -- To post, send email to arches...@googlegroups.com . To 
> unsubscribe, send email to archesprojec...@googlegroups.com . 
> For more information, visit 
> https://groups.google.com/d/forum/archesproject?hl=en
> --- 
> You received this message because you are subscribed to the Google Groups 
> "Arches Project" group.
> To unsubscribe from this group and stop receiving emails from it, send an 
> email to archesprojec...@googlegroups.com .
> For more options, visit https://groups.google.com/d/optout.
>

-- 
-- To post, send email to archesproject@googlegroups.com. To unsubscribe, send 
email to archesproject+unsubscr...@googlegroups.com. For more information, 
visit https://groups.google.com/d/forum/archesproject?hl=en
--- 
You received this message because you are subscribed to the Google Groups 
"Arches Project" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to archesproject+unsubscr...@googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

[Arches] Re: RequireJS timed out

[Vincent Meijer]

Hey Lawrence,

Not sure if I ever had the same problem, but at some point I set my 
waitSeconds to 0, so I must have at least some issues with loading 
javascipt modules.


On Tuesday, 13 November 2018 03:46:24 UTC+1, Lawrence Goh wrote:
>
> Hi all,  has anyone experienced this where you have defined the data type 
> 'concept' and the 'concept collection' dropdown doesn't appear? In console, 
> you will get a RequireJS timed out.
>
> I had to change the requireJS's waitSeconds to 60 for it to work.
>
> [image: Screenshot from 2018-11-13 13-38-10.png]
>
> [image: Screenshot from 2018-11-13 12-12-44.png]
>
> [image: Screenshot from 2018-11-13 12-47-13.png]
>
>

-- 
-- To post, send email to archesproject@googlegroups.com. To unsubscribe, send 
email to archesproject+unsubscr...@googlegroups.com. For more information, 
visit https://groups.google.com/d/forum/archesproject?hl=en
--- 
You received this message because you are subscribed to the Google Groups 
"Arches Project" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to archesproject+unsubscr...@googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

Re: [Arches] Fuzzy dates

[Vincent Meijer]

Adam, here is a recently posted page that might be even 
better: https://www.loc.gov/standards/datetime/edtf.html

Generally speaking though, a few words of introduction on fuzzy dates and 
some pointers, e.g. that the data type in Arches can be found as 'edtf', 
and also some examples of what values can be entered, would be most helpful.

I just discovered that using dates like 'Early 2nd Century' actually works 
well together with the time wheel! Quite impressive, that's a great feature.

Now if only I could get periods B.C. to work... But I understand we can't 
have everything :)


On Friday, 7 September 2018 19:06:22 UTC+2, Adam Cox wrote:
>
> Vincent, the in-app help on the graph tab of the graph designer has a 
> section called "Default Data Types" which includes a link to this page 
> https://www.loc.gov/standards/datetime/ in the edtf row. Do you think the 
> link alexei shared above would be more helpful there? Very open to 
> suggestions.
>
> On Fri, Sep 7, 2018 at 5:49 AM, Vincent Meijer  > wrote:
>
>> Thanks, i'll look into that. If anyone is already using fuzzy dates in 
>> Arches, I would love to hear from them!
>>
>> On Thu, Sep 6, 2018 at 10:41 PM Alexei Peters > > wrote:
>>
>>> Oops! Here's the link...  
>>> http://www.loc.gov/standards/datetime/pre-submission.html
>>>
>>>
>>>
>>> Director of Web Development - Farallon Geographics, Inc. - 971.227.3173
>>>
>>> On Thu, Sep 6, 2018 at 11:36 AM, Alexei Peters >> > wrote:
>>>
>>>> Hi Vincent,
>>>> Here's a link to the EDTF proposal.  It has a bunch of examples of EDTF 
>>>> strings and what they mean and how they should be interpreted.
>>>> -Alexei
>>>>
>>>>
>>>> Director of Web Development - Farallon Geographics, Inc. - 971.227.3173
>>>>
>>>> On Thu, Sep 6, 2018 at 3:12 AM, Vincent Meijer >>> > wrote:
>>>>
>>>>> Since Arches 4.2 fuzzy dates are supported. I am looking for a few 
>>>>> pointers on how this works and how to use them.
>>>>>
>>>>> Thanks!
>>>>>
>>>>> -- 
>>>>> -- To post, send email to arches...@googlegroups.com . 
>>>>> To unsubscribe, send email to archesprojec...@googlegroups.com 
>>>>> . For more information, visit 
>>>>> https://groups.google.com/d/forum/archesproject?hl=en
>>>>> --- 
>>>>> You received this message because you are subscribed to the Google 
>>>>> Groups "Arches Project" group.
>>>>> To unsubscribe from this group and stop receiving emails from it, send 
>>>>> an email to archesprojec...@googlegroups.com .
>>>>> For more options, visit https://groups.google.com/d/optout.
>>>>>
>>>>
>>>>
>>> -- 
>> -- To post, send email to arches...@googlegroups.com . To 
>> unsubscribe, send email to archesprojec...@googlegroups.com . 
>> For more information, visit 
>> https://groups.google.com/d/forum/archesproject?hl=en
>> --- 
>> You received this message because you are subscribed to the Google Groups 
>> "Arches Project" group.
>> To unsubscribe from this group and stop receiving emails from it, send an 
>> email to archesprojec...@googlegroups.com .
>> For more options, visit https://groups.google.com/d/optout.
>>
>
>

-- 
-- To post, send email to archesproject@googlegroups.com. To unsubscribe, send 
email to archesproject+unsubscr...@googlegroups.com. For more information, 
visit https://groups.google.com/d/forum/archesproject?hl=en
--- 
You received this message because you are subscribed to the Google Groups 
"Arches Project" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to archesproject+unsubscr...@googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

[Arches] Unit tests in custom Arches app

[Vincent Meijer]

I was wondering what the recommended method is for adding unit tests to my 
own Arches app.

The unit test section in Arches core looks like an isolated python module 
and I can't seem to import e.g. the test_settings.py file from my own app.
Also, when I try copying that settings file to my own app and then try to 
run my own unit tests with it (from manage.py in my own app), the process 
still looks for database init (sql) files in core Arches folders.

And if I should copy/paste test_settings.py into my own app, what should I 
set settings like ROOT_DIR and TEST_ROOT to?

My current settings:
ROOT_DIR = 
os.path.dirname(os.path.abspath(inspect.getfile(inspect.currentframe(
ROOT_DIR = os.path.normpath(os.path.join(ROOT_DIR, '..' ,'..', 'arches', 
'arches'))
TEST_ROOT = os.path.normpath(os.path.join(ROOT_DIR, '..', 'tests'))


But now I'm getting this stack:
Destroying old test database for alias 'default'...
Traceback (most recent call last):
  File "manage.py", line 35, in 
execute_from_command_line(sys.argv)
  File 
"/web_root/ENV/local/lib/python2.7/site-packages/django/core/management/__init__.py"
, line 364, in execute_from_command_line
utility.execute()
  File 
"/web_root/ENV/local/lib/python2.7/site-packages/django/core/management/__init__.py"
, line 356, in execute
self.fetch_command(subcommand).run_from_argv(self.argv)
  File 
"/web_root/ENV/local/lib/python2.7/site-packages/django/core/management/commands/test.py"
, line 29, in run_from_argv
super(Command, self).run_from_argv(argv)
  File 
"/web_root/ENV/local/lib/python2.7/site-packages/django/core/management/base.py"
, line 283, in run_from_argv
self.execute(*args, **cmd_options)
  File 
"/web_root/ENV/local/lib/python2.7/site-packages/django/core/management/base.py"
, line 330, in execute
output = self.handle(*args, **options)
  File 
"/web_root/ENV/local/lib/python2.7/site-packages/django/core/management/commands/test.py"
, line 62, in handle
failures = test_runner.run_tests(test_labels)
  File 
"/web_root/ENV/local/lib/python2.7/site-packages/django/test/runner.py", 
line 601, in run_tests
old_config = self.setup_databases()
  File 
"/web_root/ENV/local/lib/python2.7/site-packages/django/test/runner.py", 
line 546, in setup_databases
self.parallel, **kwargs
  File 
"/web_root/ENV/local/lib/python2.7/site-packages/django/test/utils.py", 
line 187, in setup_databases
serialize=connection.settings_dict.get('TEST', {}).get('SERIALIZE', True
),
  File 
"/web_root/ENV/local/lib/python2.7/site-packages/django/db/backends/base/creation.py"
, line 69, in create_test_db
run_syncdb=True,
  File 
"/web_root/ENV/local/lib/python2.7/site-packages/django/core/management/__init__.py"
, line 131, in call_command
return command.execute(*args, **defaults)
  File 
"/web_root/ENV/local/lib/python2.7/site-packages/django/core/management/base.py"
, line 330, in execute
output = self.handle(*args, **options)
  File 
"/web_root/ENV/local/lib/python2.7/site-packages/django/core/management/commands/migrate.py"
, line 204, in handle
fake_initial=fake_initial,
  File 
"/web_root/ENV/local/lib/python2.7/site-packages/django/db/migrations/executor.py"
, line 115, in migrate
state = self._migrate_all_forwards(state, plan, full_plan, fake=fake, 
fake_initial=fake_initial)
  File 
"/web_root/ENV/local/lib/python2.7/site-packages/django/db/migrations/executor.py"
, line 145, in _migrate_all_forwards
state = self.apply_migration(state, migration, fake=fake, fake_initial=
fake_initial)
  File 
"/web_root/ENV/local/lib/python2.7/site-packages/django/db/migrations/executor.py"
, line 244, in apply_migration
state = migration.apply(state, schema_editor)
  File 
"/web_root/ENV/local/lib/python2.7/site-packages/django/db/migrations/migration.py"
, line 129, in apply
operation.database_forwards(self.app_label, schema_editor, old_state, 
project_state)
  File 
"/web_root/ENV/local/lib/python2.7/site-packages/django/db/migrations/operations/special.py"
, line 193, in database_forwards
self.code(from_state.apps, schema_editor)
  File "/web_root/arches/arches/app/models/migrations/0001_initial.py", 
line 55, in make_permissions
create_permissions(model_app, verbosity=0)
  File 
"/web_root/ENV/local/lib/python2.7/site-packages/django/contrib/auth/management/__init__.py"
, line 63, in create_permissions
ctype = ContentType.objects.db_manager(using).get_for_model(klass)
  File 
"/web_root/ENV/local/lib/python2.7/site-packages/django/contrib/contenttypes/models.py"
, line 60, in get_for_model
model=opts.model_name,
  File 
"/web_root/ENV/local/lib/python2.7/site-packages/django/db/models/manager.py"
, line 85, in manager_method
return getattr(self.get_queryset(), name)(*args, **kwargs)
  File 
"/web_root/ENV/local/lib/python2.7/site-packages/django/db/models/query.py", 
line 466, in get_or_create
return self._create_object_from_params(lookup, params)
  File 

Re: [Arches] Re: Hosting Arches on Azure as a Web App for Containers

[Vincent Meijer]

Hey Lawrence, 

Sorry for not replying, I was rather swamped in work and things...
Great to hear you got ES (and the complete Arches environment?) up and 
running!

I am currently struggling with Elasticsearch myself. I have a single Azure 
VM setup with two docker containers:
version: '2'

services:
elasticsearch:
container_name: elasticsearch
image: elasticsearch:5.2
restart: always
volumes:
- elasticsearch-data:/usr/share/elasticsearch/data
environment:
- cluster.name=docker-cluster
- bootstrap.memory_lock=true
- ES_JAVA_OPTS=-Xms2g -Xmx2g
- TZ=EST
ulimits:
memlock:
soft: -1
hard: -1
ports:
- "9200:9200"
- "9300:9300"
networks:
- esnet

elasticsearch2:
container_name: elasticsearch2
image: elasticsearch:5.2
restart: always
volumes:
- elasticsearch-data2:/usr/share/elasticsearch/data
environment:
- cluster.name=docker-cluster
- bootstrap.memory_lock=true
- ES_JAVA_OPTS=-Xms2g -Xmx2g
- discovery.zen.ping.unicast.hosts=elasticsearch
- TZ=EST
ulimits:
memlock:
soft: -1
hard: -1
networks:
- esnet

volumes:
elasticsearch-data:
elasticsearch-data2:

networks:
esnet:

I just noted, however, that it seems the two nodes don't seem to form a 
cluster, potentially causing the performance issues I am investigating...

How did you set up your ES in Azure?

Best,
Vincent


On Tuesday, 6 November 2018 11:06:16 UTC+1, Lawrence Goh wrote:
>
> Hi Vincent,
>
> Just some updates on my progress.  Wonderful news is that I got a VM up 
> and running with Elasticsearch stack.   Plus, I got the web app to connect 
> to it.  Found out there's more to it for Elasticsearch, especially on the 
> indices.  More stuff to read up on.
>
> At this point fingers crossed, my environment is up and running.  
>
> Thanks for all the help :)
>
> Regards,
> Lawrence
>
> On Tue, Nov 6, 2018 at 12:34 AM Lawrence Goh  > wrote:
>
>> Hi Vincent,
>>
>> I think there's a huge possibility that my azure web app is not talking 
>> to elasticsearch.  Tracing the code further, it all leads to 
>> search/resources and it seems to be calling ES from there.  Currently, 
>> trying to set up a VM with ES, Logstash and Kibana.  Once I figure out on 
>> opening the VM's ES up for connection, then will try to point my web app 
>> towards it to see it works.  It still feels weird that local has no issues 
>> but in Azure, it just like being a 3 year old.
>>
>> By the way, upgraded to 4.3.3.
>>
>> Thanks.
>>
>> Regards,
>> Lawrence
>>
>> On Mon, Nov 5, 2018 at 4:15 PM Lawrence Goh > > wrote:
>>
>>> Hi Vincent, 
>>>
>>> Dug further, that javascript error was not related. I am getting errors 
>>> when it is retrieving search results.  Search would build up a JSON query 
>>> (/search/resources?no_filters=true=1), it gave me a "There was an 
>>> error retrieving the search results".  Found it in the code 
>>> (search.py:264).  Still thinking on how can I debug the code when it 
>>> actually works on my local.  Both are pointing to the azure postgresql DB.
>>>
>>> Unsure if there's any missing configuration where it is not allowed when 
>>> azure web app - azure db, but all is good with local web app - azure db.
>>>
>>> Very strange.
>>>
>>> Thanks.
>>>
>>> Regards,
>>> Lawrence
>>>
>>>
>>>
>>>
>>>
>>> On Mon, Nov 5, 2018 at 11:45 AM Lawrence Goh >> > wrote:
>>>
>>>> Hi Vincent,
>>>>
>>>> No logs sadly.  But I found this weird javascript error when I click on 
>>>> Search.
>>>>
>>>> jquery.min.js:2 Uncaught Error: Syntax error, unrecognized expression: 
>>>> /search
>>>> at Function.fa.error (jquery.min.js:2)
>>>> at fa.tokenize (jquery.min.js:2)
>>>> at fa.select (jquery.min.js:2)
>>>> at Function.fa [as find] (jquery.min.js:2)
>>>> at n.fn.init.find (jquery.min.js:2)
>>>> at n.fn.init.a.fn.find (jquery-migrate.min.js:2)
>>>> at a.fn.init.n.fn.init (jquery.min.js:2)
>>>> at new a.fn.init (jquery-migrate.min.js:2)
>>>> at n (jquery.min.js:2)
>>>> at HTMLAnchorElement. (one.app.js:111)
>>>>
>>>> About your elasticsearch instance, you created a VM just for it?
>>>>
>>>> Still working things out.  Will update you if i had any breakthroughs.  
>>>>
>>>> Thanks.
>>>>
>>>> Regards,
>>>> Lawrence
>>>>
>>>> On Sat, Nov 3, 2018 at 12:24 AM Vincent Meijer >>> > wrote:

Re: [Arches] Uploading File using Azure Blob Storage

[Vincent Meijer]

Nice :)

On Thu, 8 Nov 2018, 01:21 Lawrence Goh  Hi Vincent,
>
> Found the issue was the azure-storage version.  Initially, I had it at
> 0.20.0 and it didn't work.  The 0.36.0 actually fixed it.
>
> Thanks.
>
> Regards,
> Lawrence
>
> On Thu, Nov 8, 2018 at 11:06 AM Vincent Meijer 
> wrote:
>
>> Could this be the culprit? azure-storage==0.36.0
>> Perhaps conflicting versions with django-storages dependencies. What
>> happens if you leave that one out?
>>
>>
>> On Wed, 7 Nov 2018, 23:00 Lawrence Goh >
>>> Hi Vincent,
>>>
>>> Did the usual settings in settings.py. In requirement.txt, I have these.
>>>
>>> django-storages==1.7.1
>>> django-storages[azure]==1.7.1
>>> azure==4.0.0
>>> azure-storage==0.36.0
>>> azure-servicebus==0.21.1
>>> azure-mgmt==4.0.0
>>> azure-servicemanagement-legacy==0.20.6
>>>
>>> Thanks.
>>>
>>> Regards,
>>> Lawrence
>>>
>>> On Thu, Nov 8, 2018 at 10:51 AM Vincent Meijer 
>>> wrote:
>>>
>>>> Haven't seen this one before. How exactly did you install Azure
>>>> Storage? And which version?
>>>>
>>>> On Wed, 7 Nov 2018, 04:29 Lawrence Goh >>>
>>>>> Hi all,  would need some help on this issue I am facing. It's weird
>>>>> and odd.  I have the needed azure settings in settings.py, but I got this
>>>>> error.
>>>>>
>>>>> DEFAULT_FILE_STORAGE = 'storages.backends.azure_storage.AzureStorage'
>>>>> AZURE_ACCOUNT_NAME = 
>>>>> AZURE_ACCOUNT_KEY = 
>>>>> AZURE_CONTAINER = 
>>>>> MEDIA_ROOT = 
>>>>>
>>>>> I tried running purely "from azure.storage.blob import
>>>>> BlobPermissions" in python, no issues.  Any thoughts?  Thanks.
>>>>>
>>>>> arches| Internal Server Error: /tile
>>>>> arches| Traceback (most recent call last):
>>>>> arches|   File
>>>>> "/web_root/ENV/local/lib/python2.7/site-packages/django/core/handlers/exception.py",
>>>>> line 41, in inner
>>>>> arches| response = get_response(request)
>>>>> arches|   File
>>>>> "/web_root/ENV/local/lib/python2.7/site-packages/django/core/handlers/base.py",
>>>>> line 187, in _get_response
>>>>> arches| response = self.process_exception_by_middleware(e,
>>>>> request)
>>>>> arches|   File
>>>>> "/web_root/ENV/local/lib/python2.7/site-packages/django/core/handlers/base.py",
>>>>> line 185, in _get_response
>>>>> arches| response = wrapped_callback(request, *callback_args,
>>>>> **callback_kwargs)
>>>>> arches|   File
>>>>> "/web_root/ENV/local/lib/python2.7/site-packages/django/views/generic/base.py",
>>>>> line 68, in view
>>>>> arches| return self.dispatch(request, *args, **kwargs)
>>>>> arches|   File
>>>>> "/web_root/ENV/local/lib/python2.7/site-packages/django/utils/decorators.py",
>>>>> line 67, in _wrapper
>>>>> arches| return bound_func(*args, **kwargs)
>>>>> arches|   File
>>>>> "/web_root/ENV/local/lib/python2.7/site-packages/django/contrib/auth/decorators.py",
>>>>> line 23, in _wrapped_view
>>>>> arches| return view_func(request, *args, **kwargs)
>>>>> arches|   File
>>>>> "/web_root/ENV/local/lib/python2.7/site-packages/django/utils/decorators.py",
>>>>> line 63, in bound_func
>>>>> arches| return func.__get__(self, type(self))(*args2,
>>>>> **kwargs2)
>>>>> arches|   File
>>>>> "/web_root/ENV/local/lib/python2.7/site-packages/django/views/generic/base.py",
>>>>> line 88, in dispatch
>>>>> arches| return handler(request, *args, **kwargs)
>>>>> arches|   File "/web_root/arches/arches/app/views/tile.py", line
>>>>> 88, in post
>>>>> arches| tile.save(request=request)
>>>>> arches|   File "/web_root/arches/arches/app/models/tile.py", line
>>>>> 228, in save
>>>>> arches| self.check_for_missing_nodes(request)
>>>>> arches|   File "/web_root/arches

Re: [Arches] Uploading File using Azure Blob Storage

[Vincent Meijer]

Could this be the culprit? azure-storage==0.36.0
Perhaps conflicting versions with django-storages dependencies. What
happens if you leave that one out?


On Wed, 7 Nov 2018, 23:00 Lawrence Goh  Hi Vincent,
>
> Did the usual settings in settings.py. In requirement.txt, I have these.
>
> django-storages==1.7.1
> django-storages[azure]==1.7.1
> azure==4.0.0
> azure-storage==0.36.0
> azure-servicebus==0.21.1
> azure-mgmt==4.0.0
> azure-servicemanagement-legacy==0.20.6
>
> Thanks.
>
> Regards,
> Lawrence
>
> On Thu, Nov 8, 2018 at 10:51 AM Vincent Meijer 
> wrote:
>
>> Haven't seen this one before. How exactly did you install Azure Storage?
>> And which version?
>>
>> On Wed, 7 Nov 2018, 04:29 Lawrence Goh >
>>> Hi all,  would need some help on this issue I am facing. It's weird and
>>> odd.  I have the needed azure settings in settings.py, but I got this
>>> error.
>>>
>>> DEFAULT_FILE_STORAGE = 'storages.backends.azure_storage.AzureStorage'
>>> AZURE_ACCOUNT_NAME = 
>>> AZURE_ACCOUNT_KEY = 
>>> AZURE_CONTAINER = 
>>> MEDIA_ROOT = 
>>>
>>> I tried running purely "from azure.storage.blob import BlobPermissions"
>>> in python, no issues.  Any thoughts?  Thanks.
>>>
>>> arches| Internal Server Error: /tile
>>> arches| Traceback (most recent call last):
>>> arches|   File
>>> "/web_root/ENV/local/lib/python2.7/site-packages/django/core/handlers/exception.py",
>>> line 41, in inner
>>> arches| response = get_response(request)
>>> arches|   File
>>> "/web_root/ENV/local/lib/python2.7/site-packages/django/core/handlers/base.py",
>>> line 187, in _get_response
>>> arches| response = self.process_exception_by_middleware(e,
>>> request)
>>> arches|   File
>>> "/web_root/ENV/local/lib/python2.7/site-packages/django/core/handlers/base.py",
>>> line 185, in _get_response
>>> arches| response = wrapped_callback(request, *callback_args,
>>> **callback_kwargs)
>>> arches|   File
>>> "/web_root/ENV/local/lib/python2.7/site-packages/django/views/generic/base.py",
>>> line 68, in view
>>> arches| return self.dispatch(request, *args, **kwargs)
>>> arches|   File
>>> "/web_root/ENV/local/lib/python2.7/site-packages/django/utils/decorators.py",
>>> line 67, in _wrapper
>>> arches| return bound_func(*args, **kwargs)
>>> arches|   File
>>> "/web_root/ENV/local/lib/python2.7/site-packages/django/contrib/auth/decorators.py",
>>> line 23, in _wrapped_view
>>> arches| return view_func(request, *args, **kwargs)
>>> arches|   File
>>> "/web_root/ENV/local/lib/python2.7/site-packages/django/utils/decorators.py",
>>> line 63, in bound_func
>>> arches| return func.__get__(self, type(self))(*args2, **kwargs2)
>>> arches|   File
>>> "/web_root/ENV/local/lib/python2.7/site-packages/django/views/generic/base.py",
>>> line 88, in dispatch
>>> arches| return handler(request, *args, **kwargs)
>>> arches|   File "/web_root/arches/arches/app/views/tile.py", line 88,
>>> in post
>>> arches| tile.save(request=request)
>>> arches|   File "/web_root/arches/arches/app/models/tile.py", line
>>> 228, in save
>>> arches| self.check_for_missing_nodes(request)
>>> arches|   File "/web_root/arches/arches/app/models/tile.py", line
>>> 197, in check_for_missing_nodes
>>> arches| datatype.handle_request(self, request, node)
>>> arches|   File "/web_root/arches/arches/app/datatypes/datatypes.py",
>>> line 942, in handle_request
>>> arches| file_model.save()
>>> arches|   File
>>> "/web_root/ENV/local/lib/python2.7/site-packages/django/db/models/base.py",
>>> line 808, in save
>>> arches| force_update=force_update, update_fields=update_fields)
>>> arches|   File
>>> "/web_root/ENV/local/lib/python2.7/site-packages/django/db/models/base.py",
>>> line 838, in save_base
>>> arches| updated = self._save_table(raw, cls, force_insert,
>>> force_update, using, update_fields)
>>> arches|   File
>>> "/web_root/ENV/local/lib/python2.7/site-packages/django/db/models/base.py",
>>> line 902, in _save_table
>>&g

Re: [Arches] Uploading File using Azure Blob Storage

[Vincent Meijer]

Haven't seen this one before. How exactly did you install Azure Storage?
And which version?

On Wed, 7 Nov 2018, 04:29 Lawrence Goh  Hi all,  would need some help on this issue I am facing. It's weird and
> odd.  I have the needed azure settings in settings.py, but I got this
> error.
>
> DEFAULT_FILE_STORAGE = 'storages.backends.azure_storage.AzureStorage'
> AZURE_ACCOUNT_NAME = 
> AZURE_ACCOUNT_KEY = 
> AZURE_CONTAINER = 
> MEDIA_ROOT = 
>
> I tried running purely "from azure.storage.blob import BlobPermissions" in
> python, no issues.  Any thoughts?  Thanks.
>
> arches| Internal Server Error: /tile
> arches| Traceback (most recent call last):
> arches|   File
> "/web_root/ENV/local/lib/python2.7/site-packages/django/core/handlers/exception.py",
> line 41, in inner
> arches| response = get_response(request)
> arches|   File
> "/web_root/ENV/local/lib/python2.7/site-packages/django/core/handlers/base.py",
> line 187, in _get_response
> arches| response = self.process_exception_by_middleware(e, request)
> arches|   File
> "/web_root/ENV/local/lib/python2.7/site-packages/django/core/handlers/base.py",
> line 185, in _get_response
> arches| response = wrapped_callback(request, *callback_args,
> **callback_kwargs)
> arches|   File
> "/web_root/ENV/local/lib/python2.7/site-packages/django/views/generic/base.py",
> line 68, in view
> arches| return self.dispatch(request, *args, **kwargs)
> arches|   File
> "/web_root/ENV/local/lib/python2.7/site-packages/django/utils/decorators.py",
> line 67, in _wrapper
> arches| return bound_func(*args, **kwargs)
> arches|   File
> "/web_root/ENV/local/lib/python2.7/site-packages/django/contrib/auth/decorators.py",
> line 23, in _wrapped_view
> arches| return view_func(request, *args, **kwargs)
> arches|   File
> "/web_root/ENV/local/lib/python2.7/site-packages/django/utils/decorators.py",
> line 63, in bound_func
> arches| return func.__get__(self, type(self))(*args2, **kwargs2)
> arches|   File
> "/web_root/ENV/local/lib/python2.7/site-packages/django/views/generic/base.py",
> line 88, in dispatch
> arches| return handler(request, *args, **kwargs)
> arches|   File "/web_root/arches/arches/app/views/tile.py", line 88,
> in post
> arches| tile.save(request=request)
> arches|   File "/web_root/arches/arches/app/models/tile.py", line 228,
> in save
> arches| self.check_for_missing_nodes(request)
> arches|   File "/web_root/arches/arches/app/models/tile.py", line 197,
> in check_for_missing_nodes
> arches| datatype.handle_request(self, request, node)
> arches|   File "/web_root/arches/arches/app/datatypes/datatypes.py",
> line 942, in handle_request
> arches| file_model.save()
> arches|   File
> "/web_root/ENV/local/lib/python2.7/site-packages/django/db/models/base.py",
> line 808, in save
> arches| force_update=force_update, update_fields=update_fields)
> arches|   File
> "/web_root/ENV/local/lib/python2.7/site-packages/django/db/models/base.py",
> line 838, in save_base
> arches| updated = self._save_table(raw, cls, force_insert,
> force_update, using, update_fields)
> arches|   File
> "/web_root/ENV/local/lib/python2.7/site-packages/django/db/models/base.py",
> line 902, in _save_table
> arches| for f in non_pks]
> arches|   File
> "/web_root/ENV/local/lib/python2.7/site-packages/django/db/models/fields/files.py",
> line 296, in pre_save
> arches| file.save(file.name, file.file, save=False)
> arches|   File
> "/web_root/ENV/local/lib/python2.7/site-packages/django/db/models/fields/files.py",
> line 93, in save
> arches| name = self.field.generate_filename(self.instance, name)
> arches|   File
> "/web_root/ENV/local/lib/python2.7/site-packages/django/db/models/fields/files.py",
> line 331, in generate_filename
> arches| return self.storage.generate_filename(filename)
> arches|   File
> "/web_root/ENV/local/lib/python2.7/site-packages/django/utils/functional.py",
> line 238, in inner
> arches| self._setup()
> arches|   File
> "/web_root/ENV/local/lib/python2.7/site-packages/django/core/files/storage.py",
> line 472, in _setup
> arches| self._wrapped = get_storage_class()()
> arches|   File
> "/web_root/ENV/local/lib/python2.7/site-packages/django/core/files/storage.py",
> line 467, in get_storage_class
> arches| return import_string(import_path or
> settings.DEFAULT_FILE_STORAGE)
> arches|   File
> "/web_root/ENV/local/lib/python2.7/site-packages/django/utils/module_loading.py",
> line 20, in import_string
> arches| module = import_module(module_path)
> arches|   File "/usr/lib/python2.7/importlib/__init__.py", line 37, in
> import_module
> arches| __import__(name)
> arches|   File
> "/web_root/ENV/local/lib/python2.7/site-packages/storages/backends/azure_storage.py",
> line 9, in 
> arches

Re: [Arches] Re: robots.txt

[Vincent Meijer]

Nice!

On Fri, 2 Nov 2018, 18:47 Dale Lloyd  Thanks Vincent!
>
> In the Apache config, i just put
>
> Alias /robots.txt /var/www/html/robots.txt
>
> Which works.
>
> Dale
>
> --
> -- To post, send email to archesproject@googlegroups.com. To unsubscribe,
> send email to archesproject+unsubscr...@googlegroups.com. For more
> information, visit https://groups.google.com/d/forum/archesproject?hl=en
> ---
> You received this message because you are subscribed to the Google Groups
> "Arches Project" group.
> To unsubscribe from this group and stop receiving emails from it, send an
> email to archesproject+unsubscr...@googlegroups.com.
> For more options, visit https://groups.google.com/d/optout.
>

-- 
-- To post, send email to archesproject@googlegroups.com. To unsubscribe, send 
email to archesproject+unsubscr...@googlegroups.com. For more information, 
visit https://groups.google.com/d/forum/archesproject?hl=en
--- 
You received this message because you are subscribed to the Google Groups 
"Arches Project" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to archesproject+unsubscr...@googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

Re: [Arches] Re: Hosting Arches on Azure as a Web App for Containers

[Vincent Meijer]

The errors you are getting don't seem familiar, probably because I set up 
Elasticsearch on a separate virtual machine (I think using the Bitnami 
Elasticsearch Cluster template, but can't remember), rather than include it 
in the Web App.
The difference in version doesn't sound like the culprit here though...

As far as 500 errors go, they can be anything, but mostly they are uncaught 
exceptions in my experience. Could be related to your Elasticsearch 
problems. Do you have the logs?


On Wednesday, 31 October 2018 10:25:38 UTC+1, Lawrence Goh wrote:
>
> Hi Vincent,
>
> Just wondering.  When running in Azure's Web App for Containers, did your 
> search give you an error?  I noticed the elasticsearch had an error where 
> all shards failed.  By the way, I noticed I had errors starting up with 
> v5.2, so I used v5.6.
>
> Another, for recent edits, when I clicked on view report, it gives a 
> Server Error 500.
>
> The oddity is that it works on my local :)
>
> Thanks.
>
> Regards,
> Lawrence
>
> On Wed, Oct 31, 2018 at 9:22 AM Lawrence Goh  > wrote:
>
>> Hi Vincent, 
>>
>> Thanks for the reply.  Found the issue to be on entrypoint.sh.  The 
>> validations have yet to be updated.  Currently, using 4.3.x branch but will 
>> probably move to 4.3.2 since it was just released.
>>
>> Thanks.
>>
>> Regards,
>> Lawrence 
>>
>> On Tue, Oct 30, 2018 at 10:07 PM Vincent Meijer > > wrote:
>>
>>> Hey Lawrence, sorry for the late response. 
>>>
>>> Regarding settings.py: your project's settings.py take precedence over 
>>> the default arches settings.py. 
>>> *However*, in the docker version of Arches, a settings_local.py is also 
>>> copied to your project folder.
>>> This settings_local.py should contain the postgres db settings that you 
>>> set through the environment variables in your docker-compose.yml.
>>> It should already be imported by default in your settings.py. Notice 
>>> these lines at the bottom of that file:
>>> try:
>>> from settings_local import *
>>> except ImportError:
>>> pass
>>>
>>> When your project gets initialized (at first startup), that 
>>> settings_local.py is copied to /web_root//>> project>/settings_local.py.
>>> Here is the source for reference: 
>>> https://github.com/archesproject/arches/blob/master/docker/settings_local.py
>>>  
>>>
>>> With that setup, all you should have to do is set your db credentials in 
>>> your docker-compose.yml:
>>> - PGUSERNAME=username@your-db-server
>>>
>>> If you still receive above errors, something else is up and we need to 
>>> investigate :)
>>>
>>> By the way, which version of Arches are you using right now?
>>>
>>> Also, if you encounter any errors in the Docker Readme, especially in 
>>> the 'Setting up your own Arches project' section, please let us know! :)
>>>
>>> https://github.com/archesproject/arches/tree/master/docker#setting-up-your-own-arches-project
>>>
>>>
>>> On Friday, 26 October 2018 05:43:11 UTC+2, Lawrence Goh wrote:
>>>>
>>>> Hi Vincent,
>>>>
>>>> I noticed another odd thing.  When it does the import_graphs after 
>>>> creating the database, it has this error.
>>>>
>>>> arches   | FATAL:  Invalid Username specified. Please check the 
>>>> Username and retry connection. The Username should be in 
>>>>  format.
>>>> arches   | FATAL:  Invalid Username specified. Please check the 
>>>> Username and retry connection. The Username should be in 
>>>>  format.
>>>> arches   | Running: python manage.py packages -o 
>>>> import_reference_data -s "arches/db/schemes/arches_concept_scheme.rdf"
>>>>
>>>> Any idea where in the code is going nuts? :)
>>>>
>>>> Thanks.
>>>>
>>>> Regards,
>>>> Lawrence
>>>>
>>>>
>>>>
>>>> On Fri, Oct 26, 2018 at 4:03 PM Lawrence Goh  
>>>> wrote:
>>>>
>>>>> Hi Vincent,
>>>>>
>>>>> Been digging further into the postgres libs.  It seems the dsn and 
>>>>> kwargs in them are getting values from the 's settings.py 
>>>>> which contains the default db credentials (postgres; postgis).  Normally, 
>>>>> I 
>>>>> assumed it will get it from the arches' settings.py file.
>&

[Arches] Re: robots.txt

[Vincent Meijer]

Hi Dale,

Search engines look for robots.txt behind this url: /robots.txt
Where exactly you store this file on the file system does not matter as 
much. 
What matters is how you configure your routing in either Apache (common) or 
in Django's urls.py (less commonly done).

In my case I use the Nginx webserver (similar to Apache). I set it up to 
simply return a string when clients hit that url:

location /robots.txt {
 return 200 "User-agent: *\nDisallow:\n";
 }


Which in readable text would look something like:

User-agent: *
Disallow:



To disallow:
location /robots.txt {
 return 200 "User-agent: *\nDisallow: /\n";
 }

(note the forward slash after Disallow:)

This will probably look a little different in Apache, but I hope this will 
get you started.

Best,
Vincent


On Friday, 2 November 2018 11:29:51 UTC+1, Dale Lloyd wrote:
>
> We are running Arches 4.3.3, installed by pip, on Ubuntu 16.04, served by 
> Apache.
>
> If i wanted to use a robots.txt file, where would I put it?
>
> I am not sure where the root directory for the website is. I tried putting 
> it in /templates, next to index.htm, but that 
> does not work. 
>
>

-- 
-- To post, send email to archesproject@googlegroups.com. To unsubscribe, send 
email to archesproject+unsubscr...@googlegroups.com. For more information, 
visit https://groups.google.com/d/forum/archesproject?hl=en
--- 
You received this message because you are subscribed to the Google Groups 
"Arches Project" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to archesproject+unsubscr...@googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

Re: [Arches] Taking a break

[Vincent Meijer]

Bon voyage! :)

On Thu, 1 Nov 2018, 15:31 Pat Lurcock  Hello, I have run out of time to get Arches up and running. I think I have
> a sort of setup but have not polished the installation script as I wanted
> nor tested things like maps and so on. I am now off to sea (guiding and
> lecturing on an Antarctic cruise ship) but will have another go next year.
> It's only a sideline so no time pressure anyway. Thanks to those who gave
> me a bit of help and encouragement. See you next year!
> Pat
>
> --
> -- To post, send email to archesproject@googlegroups.com. To unsubscribe,
> send email to archesproject+unsubscr...@googlegroups.com. For more
> information, visit https://groups.google.com/d/forum/archesproject?hl=en
> ---
> You received this message because you are subscribed to the Google Groups
> "Arches Project" group.
> To unsubscribe from this group and stop receiving emails from it, send an
> email to archesproject+unsubscr...@googlegroups.com.
> For more options, visit https://groups.google.com/d/optout.
>

-- 
-- To post, send email to archesproject@googlegroups.com. To unsubscribe, send 
email to archesproject+unsubscr...@googlegroups.com. For more information, 
visit https://groups.google.com/d/forum/archesproject?hl=en
--- 
You received this message because you are subscribed to the Google Groups 
"Arches Project" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to archesproject+unsubscr...@googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

Re: [Arches] Re: Hosting Arches on Azure as a Web App for Containers

[Vincent Meijer]

Hey Lawrence, sorry for the late response. 

Regarding settings.py: your project's settings.py take precedence over the 
default arches settings.py. 
*However*, in the docker version of Arches, a settings_local.py is also 
copied to your project folder.
This settings_local.py should contain the postgres db settings that you set 
through the environment variables in your docker-compose.yml.
It should already be imported by default in your settings.py. Notice these 
lines at the bottom of that file:
try:
from settings_local import *
except ImportError:
pass

When your project gets initialized (at first startup), that 
settings_local.py is copied to /web_root///settings_local.py.
Here is the source for 
reference: 
https://github.com/archesproject/arches/blob/master/docker/settings_local.py 

With that setup, all you should have to do is set your db credentials in 
your docker-compose.yml:
- PGUSERNAME=username@your-db-server

If you still receive above errors, something else is up and we need to 
investigate :)

By the way, which version of Arches are you using right now?

Also, if you encounter any errors in the Docker Readme, especially in the 
'Setting up your own Arches project' section, please let us know! :)
https://github.com/archesproject/arches/tree/master/docker#setting-up-your-own-arches-project


On Friday, 26 October 2018 05:43:11 UTC+2, Lawrence Goh wrote:
>
> Hi Vincent,
>
> I noticed another odd thing.  When it does the import_graphs after 
> creating the database, it has this error.
>
> arches   | FATAL:  Invalid Username specified. Please check the 
> Username and retry connection. The Username should be in 
>  format.
> arches   | FATAL:  Invalid Username specified. Please check the 
> Username and retry connection. The Username should be in 
>  format.
> arches   | Running: python manage.py packages -o 
> import_reference_data -s "arches/db/schemes/arches_concept_scheme.rdf"
>
> Any idea where in the code is going nuts? :)
>
> Thanks.
>
> Regards,
> Lawrence
>
>
>
> On Fri, Oct 26, 2018 at 4:03 PM Lawrence Goh  > wrote:
>
>> Hi Vincent,
>>
>> Been digging further into the postgres libs.  It seems the dsn and kwargs 
>> in them are getting values from the 's settings.py which 
>> contains the default db credentials (postgres; postgis).  Normally, I 
>> assumed it will get it from the arches' settings.py file.
>>
>> In case I am confusing :) When you browse the container, you would be 
>> landed into \web_root\arches.  Back down, it would be ENV, arches, 
>>  folders.  
>>
>> Probably I might need a new pull from arches again and work from there.  
>> I am unsure if my own is corrupted.  
>>
>> Thanks.
>>
>> Regards,
>> Lawrence
>>
>>
>> On Thu, Oct 25, 2018 at 5:30 AM Vincent Meijer > > wrote:
>>
>>> Ah I can see the image now (in email). Looks like a regular firewall 
>>> misconfiguration. 
>>> Can you show us your current settings?
>>>
>>> There is also the option 'Enforce SSL Connection' under 'SSL Settings' 
>>> in your Azure DB. Is this set to Disabled?
>>>
>>> And can you connect to it from your local machine if you whitelist your 
>>> ip in that same screen?
>>>
>>>
>>> On Tuesday, 23 October 2018 23:45:06 UTC+2, Lawrence Goh wrote:
>>>>
>>>> Hi Vincent,
>>>>
>>>> Apologies for another set up question.  Been going everywhere and sadly 
>>>> to nowhere.  We have set up a Azure Database for Postgresql.  We could get 
>>>> the docker compose to create the DB.  But the arches container failed due 
>>>> to some weird network restriction.  
>>>>
>>>> [image: image.png]
>>>>
>>>> I have added IPs to the firewall.  Even having it being from 0.0.0.0 to 
>>>> 255.255.255.255.  The "Allow access to Azure services" is on.
>>>>
>>>> Any ideas?
>>>>
>>>> Thanks.
>>>>
>>>> Regards,
>>>> Lawrence
>>>>
>>>> On Fri, Oct 19, 2018 at 10:32 PM Vincent Meijer  
>>>> wrote:
>>>>
>>>>> Yeah it's a weird choice from Microsoft to do things differently and 
>>>>> arches wasn't prepared for that @...
>>>>>
>>>>>
>>>>>
>>>>> On Fri, 19 Oct 2018, 11:23 larrygoh84,  wrote:
>>>>>
>>>>>> using 4.3.1.  does this mean its a known issue? it doesn't handle the 
>>>>>> @ well? :)
>>>>>>
>>>>>> 

Re: [Arches] Re: Hosting Arches on Azure as a Web App for Containers

[Vincent Meijer]

Ah I can see the image now (in email). Looks like a regular firewall 
misconfiguration. 
Can you show us your current settings?

There is also the option 'Enforce SSL Connection' under 'SSL Settings' in 
your Azure DB. Is this set to Disabled?

And can you connect to it from your local machine if you whitelist your ip 
in that same screen?


On Tuesday, 23 October 2018 23:45:06 UTC+2, Lawrence Goh wrote:
>
> Hi Vincent,
>
> Apologies for another set up question.  Been going everywhere and sadly to 
> nowhere.  We have set up a Azure Database for Postgresql.  We could get the 
> docker compose to create the DB.  But the arches container failed due to 
> some weird network restriction.  
>
> [image: image.png]
>
> I have added IPs to the firewall.  Even having it being from 0.0.0.0 to 
> 255.255.255.255.  The "Allow access to Azure services" is on.
>
> Any ideas?
>
> Thanks.
>
> Regards,
> Lawrence
>
> On Fri, Oct 19, 2018 at 10:32 PM Vincent Meijer  > wrote:
>
>> Yeah it's a weird choice from Microsoft to do things differently and 
>> arches wasn't prepared for that @...
>>
>>
>>
>> On Fri, 19 Oct 2018, 11:23 larrygoh84, > 
>> wrote:
>>
>>> using 4.3.1.  does this mean its a known issue? it doesn't handle the @ 
>>> well? :)
>>>
>>>  Original message 
>>> From: Vincent Meijer > 
>>> Date: 10/19/18 10:02 PM (GMT+12:00) 
>>> To: Arches Project > 
>>> Subject: Re: [Arches] Re: Hosting Arches on Azure as a Web App for 
>>> Containers 
>>>
>>> Which version of Arches are you using? 
>>> I created a PR (for #4099) for this earlier, but it was after 4.3.1 was 
>>> released.
>>>
>>> Until the next release you could use the master branch (there are docker 
>>> images built for that in Docker Hub for every new push: 
>>> https://hub.docker.com/r/archesproject/arches/tags/ )
>>>
>>> However, if you want something more stable, you are also free to use my 
>>> own arches base images: 
>>> https://hub.docker.com/r/globaldigitalheritage/arches/tags/
>>> The current tags in there are all based on Arches 4.3.1 and I push a new 
>>> version every time I created some additional functionality / fixes for a 
>>> PR, such as the one with '@' in Azure database names.
>>>
>>> Currently the latest I got is globaldigitalheritage/arches:4.3.1.11
>>>
>>>
>>> I use these images as a base in my own Dockerfile 
>>> (as described in step 7 of 'Setting up your own Arches project': 
>>> https://github.com/archesproject/arches/blob/master/docker/Readme.md#setting-up-your-own-arches-project
>>>  
>>> )
>>>
>>> I recommend to follow these steps to create your own Arches project, 
>>> rather than editing the core Arches app.
>>>
>>> Hope this helps!
>>> Vincent
>>>
>>>
>>> On Friday, 19 October 2018 05:14:57 UTC+2, Lawrence Goh wrote:
>>>>
>>>> Hi Vincent,
>>>>
>>>> Had you faced this issue before?  We are now trying to connect to Azure 
>>>> DB for Postgresql.  The container log just freezes at Testing if database 
>>>> server is up.. Is it senstive to the @?  thanks.
>>>>
>>>> On Friday, October 19, 2018 at 3:03:47 PM UTC+13, Lawrence Goh wrote:
>>>>>
>>>>> Hi Vincent,
>>>>>
>>>>> Yups.  Was poking around the codes yesterday and had a go with 
>>>>> removing the staticfiles_storage and all went well :)
>>>>>
>>>>> Thanks.
>>>>>
>>>>> Regards,
>>>>> Lawrence
>>>>>
>>>>> On Thu, Oct 18, 2018 at 9:00 PM Vincent Meijer  
>>>>> wrote:
>>>>>
>>>>>> If I'm understanding you correctly, you want to serve static files 
>>>>>> the 'standard' way (directly from the Arches app using Whitenoise) and 
>>>>>> serve uploaded files from Azure Blob Storage?
>>>>>> I do the same at the moment. For that, use: 
>>>>>> DEFAULT_FILE_STORAGE='storages.backends.azure_storage.AzureStorage'
>>>>>> and
>>>>>> STATICFILES_STORAGE = 
>>>>>> 'whitenoise.storage.CompressedStaticFilesStorage'
>>>>>>
>>>>>> (together with the other appropriate settings for Azure and 
>>>>>> Whitenoise, that you probably already have).
>>>>>>
>>>>

Re: [Arches] Re: Hosting Arches on Azure as a Web App for Containers

[Vincent Meijer]

Hey your image is not loading. What sort of error did you receive?
Since you managed to get the DB created in the first place, something must 
be going right! :)


On Tuesday, 23 October 2018 23:45:06 UTC+2, Lawrence Goh wrote:
>
> Hi Vincent,
>
> Apologies for another set up question.  Been going everywhere and sadly to 
> nowhere.  We have set up a Azure Database for Postgresql.  We could get the 
> docker compose to create the DB.  But the arches container failed due to 
> some weird network restriction.  
>
> [image: image.png]
>
> I have added IPs to the firewall.  Even having it being from 0.0.0.0 to 
> 255.255.255.255.  The "Allow access to Azure services" is on.
>
> Any ideas?
>
> Thanks.
>
> Regards,
> Lawrence
>
> On Fri, Oct 19, 2018 at 10:32 PM Vincent Meijer  > wrote:
>
>> Yeah it's a weird choice from Microsoft to do things differently and 
>> arches wasn't prepared for that @...
>>
>>
>>
>> On Fri, 19 Oct 2018, 11:23 larrygoh84, > 
>> wrote:
>>
>>> using 4.3.1.  does this mean its a known issue? it doesn't handle the @ 
>>> well? :)
>>>
>>>  Original message 
>>> From: Vincent Meijer > 
>>> Date: 10/19/18 10:02 PM (GMT+12:00) 
>>> To: Arches Project > 
>>> Subject: Re: [Arches] Re: Hosting Arches on Azure as a Web App for 
>>> Containers 
>>>
>>> Which version of Arches are you using? 
>>> I created a PR (for #4099) for this earlier, but it was after 4.3.1 was 
>>> released.
>>>
>>> Until the next release you could use the master branch (there are docker 
>>> images built for that in Docker Hub for every new push: 
>>> https://hub.docker.com/r/archesproject/arches/tags/ )
>>>
>>> However, if you want something more stable, you are also free to use my 
>>> own arches base images: 
>>> https://hub.docker.com/r/globaldigitalheritage/arches/tags/
>>> The current tags in there are all based on Arches 4.3.1 and I push a new 
>>> version every time I created some additional functionality / fixes for a 
>>> PR, such as the one with '@' in Azure database names.
>>>
>>> Currently the latest I got is globaldigitalheritage/arches:4.3.1.11
>>>
>>>
>>> I use these images as a base in my own Dockerfile 
>>> (as described in step 7 of 'Setting up your own Arches project': 
>>> https://github.com/archesproject/arches/blob/master/docker/Readme.md#setting-up-your-own-arches-project
>>>  
>>> )
>>>
>>> I recommend to follow these steps to create your own Arches project, 
>>> rather than editing the core Arches app.
>>>
>>> Hope this helps!
>>> Vincent
>>>
>>>
>>> On Friday, 19 October 2018 05:14:57 UTC+2, Lawrence Goh wrote:
>>>>
>>>> Hi Vincent,
>>>>
>>>> Had you faced this issue before?  We are now trying to connect to Azure 
>>>> DB for Postgresql.  The container log just freezes at Testing if database 
>>>> server is up.. Is it senstive to the @?  thanks.
>>>>
>>>> On Friday, October 19, 2018 at 3:03:47 PM UTC+13, Lawrence Goh wrote:
>>>>>
>>>>> Hi Vincent,
>>>>>
>>>>> Yups.  Was poking around the codes yesterday and had a go with 
>>>>> removing the staticfiles_storage and all went well :)
>>>>>
>>>>> Thanks.
>>>>>
>>>>> Regards,
>>>>> Lawrence
>>>>>
>>>>> On Thu, Oct 18, 2018 at 9:00 PM Vincent Meijer  
>>>>> wrote:
>>>>>
>>>>>> If I'm understanding you correctly, you want to serve static files 
>>>>>> the 'standard' way (directly from the Arches app using Whitenoise) and 
>>>>>> serve uploaded files from Azure Blob Storage?
>>>>>> I do the same at the moment. For that, use: 
>>>>>> DEFAULT_FILE_STORAGE='storages.backends.azure_storage.AzureStorage'
>>>>>> and
>>>>>> STATICFILES_STORAGE = 
>>>>>> 'whitenoise.storage.CompressedStaticFilesStorage'
>>>>>>
>>>>>> (together with the other appropriate settings for Azure and 
>>>>>> Whitenoise, that you probably already have).
>>>>>>
>>>>>> Does that make sense?
>>>>>>
>>>>>>
>>>>>> On Wednesday, 17 October 2018 23:04:35 UTC+2, Lawrence Goh wrote:
>&

Re: [Arches] Re: Hosting Arches on Azure as a Web App for Containers

[Vincent Meijer]

Yeah it's a weird choice from Microsoft to do things differently and arches
wasn't prepared for that @...



On Fri, 19 Oct 2018, 11:23 larrygoh84,  wrote:

> using 4.3.1.  does this mean its a known issue? it doesn't handle the @
> well? :)
>
>  Original message ----
> From: Vincent Meijer 
> Date: 10/19/18 10:02 PM (GMT+12:00)
> To: Arches Project 
> Subject: Re: [Arches] Re: Hosting Arches on Azure as a Web App for
> Containers
>
> Which version of Arches are you using?
> I created a PR (for #4099) for this earlier, but it was after 4.3.1 was
> released.
>
> Until the next release you could use the master branch (there are docker
> images built for that in Docker Hub for every new push:
> https://hub.docker.com/r/archesproject/arches/tags/ )
>
> However, if you want something more stable, you are also free to use my
> own arches base images:
> https://hub.docker.com/r/globaldigitalheritage/arches/tags/
> The current tags in there are all based on Arches 4.3.1 and I push a new
> version every time I created some additional functionality / fixes for a
> PR, such as the one with '@' in Azure database names.
>
> Currently the latest I got is globaldigitalheritage/arches:4.3.1.11
>
>
> I use these images as a base in my own Dockerfile
> (as described in step 7 of 'Setting up your own Arches project':
> https://github.com/archesproject/arches/blob/master/docker/Readme.md#setting-up-your-own-arches-project
> )
>
> I recommend to follow these steps to create your own Arches project,
> rather than editing the core Arches app.
>
> Hope this helps!
> Vincent
>
>
> On Friday, 19 October 2018 05:14:57 UTC+2, Lawrence Goh wrote:
>>
>> Hi Vincent,
>>
>> Had you faced this issue before?  We are now trying to connect to Azure
>> DB for Postgresql.  The container log just freezes at Testing if database
>> server is up.. Is it senstive to the @?  thanks.
>>
>> On Friday, October 19, 2018 at 3:03:47 PM UTC+13, Lawrence Goh wrote:
>>>
>>> Hi Vincent,
>>>
>>> Yups.  Was poking around the codes yesterday and had a go with removing
>>> the staticfiles_storage and all went well :)
>>>
>>> Thanks.
>>>
>>> Regards,
>>> Lawrence
>>>
>>> On Thu, Oct 18, 2018 at 9:00 PM Vincent Meijer 
>>> wrote:
>>>
>>>> If I'm understanding you correctly, you want to serve static files the
>>>> 'standard' way (directly from the Arches app using Whitenoise) and serve
>>>> uploaded files from Azure Blob Storage?
>>>> I do the same at the moment. For that, use:
>>>> DEFAULT_FILE_STORAGE='storages.backends.azure_storage.AzureStorage'
>>>> and
>>>> STATICFILES_STORAGE = 'whitenoise.storage.CompressedStaticFilesStorage'
>>>>
>>>> (together with the other appropriate settings for Azure and Whitenoise,
>>>> that you probably already have).
>>>>
>>>> Does that make sense?
>>>>
>>>>
>>>> On Wednesday, 17 October 2018 23:04:35 UTC+2, Lawrence Goh wrote:
>>>>>
>>>>> Hi Vincent,
>>>>>
>>>>> Thanks for that link.  Will need to figure to adapt it for Azure use.
>>>>>
>>>>> Besides that, I noticed it loads all the static files into the blob.
>>>>> Was thinking to have the static files be in the container.  Only push the
>>>>> uploaded 'media files' into the blob.  I guess it doesn't do that right? 
>>>>> :)
>>>>>
>>>>> Thanks.
>>>>>
>>>>> Regards,
>>>>> Lawrence
>>>>>
>>>>> On Thu, Oct 18, 2018 at 2:12 AM Vincent Meijer 
>>>>> wrote:
>>>>>
>>>>>> The collectfast package looks promising:
>>>>>> https://stackoverflow.com/questions/16805232/faster-alternative-to-manage-py-collectstatic-w-s3boto-storage-backend-to-syn
>>>>>>
>>>>>> --
>>>>>> -- To post, send email to arches...@googlegroups.com. To
>>>>>> unsubscribe, send email to archesprojec...@googlegroups.com. For
>>>>>> more information, visit
>>>>>> https://groups.google.com/d/forum/archesproject?hl=en
>>>>>> ---
>>>>>> You received this message because you are subscribed to the Google
>>>>>> Groups "Arches Project" group.
>>>>>> To unsubscribe from this group and stop receiving emails from it,
>>>>>> send an email to arches

Re: [Arches] Re: Hosting Arches on Azure as a Web App for Containers

[Vincent Meijer]

Which version of Arches are you using? 
I created a PR (for #4099) for this earlier, but it was after 4.3.1 was 
released.

Until the next release you could use the master branch (there are docker 
images built for that in Docker Hub for every new push: 
https://hub.docker.com/r/archesproject/arches/tags/ )

However, if you want something more stable, you are also free to use my own 
arches base images: 
https://hub.docker.com/r/globaldigitalheritage/arches/tags/
The current tags in there are all based on Arches 4.3.1 and I push a new 
version every time I created some additional functionality / fixes for a 
PR, such as the one with '@' in Azure database names.

Currently the latest I got is globaldigitalheritage/arches:4.3.1.11


I use these images as a base in my own Dockerfile 
(as described in step 7 of 'Setting up your own Arches 
project': 
https://github.com/archesproject/arches/blob/master/docker/Readme.md#setting-up-your-own-arches-project
 
)

I recommend to follow these steps to create your own Arches project, rather 
than editing the core Arches app.

Hope this helps!
Vincent


On Friday, 19 October 2018 05:14:57 UTC+2, Lawrence Goh wrote:
>
> Hi Vincent,
>
> Had you faced this issue before?  We are now trying to connect to Azure DB 
> for Postgresql.  The container log just freezes at Testing if database 
> server is up.. Is it senstive to the @?  thanks.
>
> On Friday, October 19, 2018 at 3:03:47 PM UTC+13, Lawrence Goh wrote:
>>
>> Hi Vincent,
>>
>> Yups.  Was poking around the codes yesterday and had a go with removing 
>> the staticfiles_storage and all went well :)
>>
>> Thanks.
>>
>> Regards,
>> Lawrence
>>
>> On Thu, Oct 18, 2018 at 9:00 PM Vincent Meijer > > wrote:
>>
>>> If I'm understanding you correctly, you want to serve static files the 
>>> 'standard' way (directly from the Arches app using Whitenoise) and serve 
>>> uploaded files from Azure Blob Storage?
>>> I do the same at the moment. For that, use: 
>>> DEFAULT_FILE_STORAGE='storages.backends.azure_storage.AzureStorage'
>>> and
>>> STATICFILES_STORAGE = 'whitenoise.storage.CompressedStaticFilesStorage'
>>>
>>> (together with the other appropriate settings for Azure and Whitenoise, 
>>> that you probably already have).
>>>
>>> Does that make sense?
>>>
>>>
>>> On Wednesday, 17 October 2018 23:04:35 UTC+2, Lawrence Goh wrote:
>>>>
>>>> Hi Vincent,
>>>>
>>>> Thanks for that link.  Will need to figure to adapt it for Azure use.
>>>>
>>>> Besides that, I noticed it loads all the static files into the blob.  
>>>> Was thinking to have the static files be in the container.  Only push the 
>>>> uploaded 'media files' into the blob.  I guess it doesn't do that right? :)
>>>>
>>>> Thanks.
>>>>
>>>> Regards,
>>>> Lawrence
>>>>
>>>> On Thu, Oct 18, 2018 at 2:12 AM Vincent Meijer  
>>>> wrote:
>>>>
>>>>> The collectfast package looks promising: 
>>>>> https://stackoverflow.com/questions/16805232/faster-alternative-to-manage-py-collectstatic-w-s3boto-storage-backend-to-syn
>>>>>
>>>>> -- 
>>>>> -- To post, send email to arches...@googlegroups.com. To unsubscribe, 
>>>>> send email to archesprojec...@googlegroups.com. For more information, 
>>>>> visit https://groups.google.com/d/forum/archesproject?hl=en
>>>>> --- 
>>>>> You received this message because you are subscribed to the Google 
>>>>> Groups "Arches Project" group.
>>>>> To unsubscribe from this group and stop receiving emails from it, send 
>>>>> an email to archesprojec...@googlegroups.com.
>>>>> For more options, visit https://groups.google.com/d/optout.
>>>>>
>>>> -- 
>>> -- To post, send email to arches...@googlegroups.com . To 
>>> unsubscribe, send email to archesprojec...@googlegroups.com 
>>> . For more information, visit 
>>> https://groups.google.com/d/forum/archesproject?hl=en
>>> --- 
>>> You received this message because you are subscribed to the Google 
>>> Groups "Arches Project" group.
>>> To unsubscribe from this group and stop receiving emails from it, send 
>>> an email to archesprojec...@googlegroups.com .
>>> For more options, visit https://groups.google.com/d/optout.
>>>
>>

-- 
-- To post, send email to archesproject@googlegroups.com. To unsubscribe, send 
email to archesproject+unsubscr...@googlegroups.com. For more information, 
visit https://groups.google.com/d/forum/archesproject?hl=en
--- 
You received this message because you are subscribed to the Google Groups 
"Arches Project" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to archesproject+unsubscr...@googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

Re: [Arches] Re: Signing in

[Vincent Meijer]

Also, any contributions towards running Arches offline would be great! ;)

On Wednesday, 17 October 2018 16:50:02 UTC+2, Pat Lurcock wrote:
>
> Thanks Vincent,
>
> Glad you like it. It is very rewarding as I get a message from a relative 
> every year or two, grateful to see where their relative's grave is. Often 
> they supply more info, which is interesting.
>
> Good to know about potential banana skins when working off line thanks. I 
> hopw to have a good play before I leave, and will unplug from the web to do 
> that. I can see that mapping will not work with no access to online maps, 
> though that is OK as there will be plenty more to do.
>
> Cheers,
> Pat
>
>
>

-- 
-- To post, send email to archesproject@googlegroups.com. To unsubscribe, send 
email to archesproject+unsubscr...@googlegroups.com. For more information, 
visit https://groups.google.com/d/forum/archesproject?hl=en
--- 
You received this message because you are subscribed to the Google Groups 
"Arches Project" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to archesproject+unsubscr...@googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

Re: [Arches] Installing dependencies in Ubuntu - pip version

[Vincent Meijer]

I don't think it makes a big difference what version you use. Our Docker 
image currently uses 18.0 I believe.

P.s. Since you are interested in the Ubuntu installation, you may also want 
to check out our Dockerfile.
If you were to leave out the capitalized commands at the start of the 
sentences, it is basically a shell script.
In terms of Arches itself, the script has everything you need to install on 
Ubuntu, except that it does not install Postgres server and Elasticsearch.
Could be a useful reference, if nothing else.

Best,
Vincent

On Thursday, 18 October 2018 00:17:35 UTC+2, Adam Cox wrote:
>
> Yeah, updating pip is good, but I don't think necessary on Ubuntu.
>
> Adam
>
> On Wed, Oct 17, 2018, 3:40 PM Pat Lurcock  > wrote:
>
>> Evening all,
>>
>> I have started installing the dependencies as per the script on the git 
>> hub, one step at a time.
>> The first few went OK. When running the line:
>>  $sudo apt-get install python-pip -y
>> I got a couple of messages:
>> The directory '/home/arches/.cache/pip/http' or its parent directory is 
>> not owned by the current user and the cache has been disabled. Please check 
>> the permissions and owner of that directory. If executing pip with sudo, 
>> you may want sudo's -H flag.
>> and
>> The directory '/home/arches/.cache/pip' or its parent directory is not 
>> owned by the current user and caching wheels has been disabled. check the 
>> permissions and owner of that directory. If executing pip with sudo, you 
>> may want sudo's -H flag.
>>
>> I rewound a bit (I am using a virtual machine and taking regular 
>> snapshots) and,as advised, replaced the line with
>>  $sudo -H apt-get install python-pip -y
>> and this time did not get any warnings.
>>
>> The next step runs the line:
>>   $pip install virtualenv==13.1.2
>> which works OK but ends with a message:
>> You are using pip version 8.1.1, however version 18.1 is available.
>> You should consider upgrading via the 'pip install --upgrade pip' command.
>>
>> I understand that Arches is written in a legacy version of python (2.7) 
>> and would like to check that it is OK to use the latest version of pip or 
>> should we stick with the old one that gets installed? I don't really 
>> understand  how it ties together, and whether versions of pip are tied to 
>> versions of python.
>>
>> Thanks in advance,
>> Pat
>>
>> -- 
>> -- To post, send email to arches...@googlegroups.com . To 
>> unsubscribe, send email to archesprojec...@googlegroups.com . 
>> For more information, visit 
>> https://groups.google.com/d/forum/archesproject?hl=en
>> --- 
>> You received this message because you are subscribed to the Google Groups 
>> "Arches Project" group.
>> To unsubscribe from this group and stop receiving emails from it, send an 
>> email to archesprojec...@googlegroups.com .
>> For more options, visit https://groups.google.com/d/optout.
>>
>

-- 
-- To post, send email to archesproject@googlegroups.com. To unsubscribe, send 
email to archesproject+unsubscr...@googlegroups.com. For more information, 
visit https://groups.google.com/d/forum/archesproject?hl=en
--- 
You received this message because you are subscribed to the Google Groups 
"Arches Project" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to archesproject+unsubscr...@googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

Re: [Arches] Re: Hosting Arches on Azure as a Web App for Containers

[Vincent Meijer]

If I'm understanding you correctly, you want to serve static files the 
'standard' way (directly from the Arches app using Whitenoise) and serve 
uploaded files from Azure Blob Storage?
I do the same at the moment. For that, use: 
DEFAULT_FILE_STORAGE='storages.backends.azure_storage.AzureStorage'
and
STATICFILES_STORAGE = 'whitenoise.storage.CompressedStaticFilesStorage'

(together with the other appropriate settings for Azure and Whitenoise, 
that you probably already have).

Does that make sense?


On Wednesday, 17 October 2018 23:04:35 UTC+2, Lawrence Goh wrote:
>
> Hi Vincent,
>
> Thanks for that link.  Will need to figure to adapt it for Azure use.
>
> Besides that, I noticed it loads all the static files into the blob.  Was 
> thinking to have the static files be in the container.  Only push the 
> uploaded 'media files' into the blob.  I guess it doesn't do that right? :)
>
> Thanks.
>
> Regards,
> Lawrence
>
> On Thu, Oct 18, 2018 at 2:12 AM Vincent Meijer  > wrote:
>
>> The collectfast package looks promising: 
>> https://stackoverflow.com/questions/16805232/faster-alternative-to-manage-py-collectstatic-w-s3boto-storage-backend-to-syn
>>
>> -- 
>> -- To post, send email to arches...@googlegroups.com . To 
>> unsubscribe, send email to archesprojec...@googlegroups.com . 
>> For more information, visit 
>> https://groups.google.com/d/forum/archesproject?hl=en
>> --- 
>> You received this message because you are subscribed to the Google Groups 
>> "Arches Project" group.
>> To unsubscribe from this group and stop receiving emails from it, send an 
>> email to archesprojec...@googlegroups.com .
>> For more options, visit https://groups.google.com/d/optout.
>>
>

-- 
-- To post, send email to archesproject@googlegroups.com. To unsubscribe, send 
email to archesproject+unsubscr...@googlegroups.com. For more information, 
visit https://groups.google.com/d/forum/archesproject?hl=en
--- 
You received this message because you are subscribed to the Google Groups 
"Arches Project" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to archesproject+unsubscr...@googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

Re: [Arches] Re: Hosting Arches on Azure as a Web App for Containers

[Vincent Meijer]

The collectfast package looks 
promising: 
https://stackoverflow.com/questions/16805232/faster-alternative-to-manage-py-collectstatic-w-s3boto-storage-backend-to-syn

-- 
-- To post, send email to archesproject@googlegroups.com. To unsubscribe, send 
email to archesproject+unsubscr...@googlegroups.com. For more information, 
visit https://groups.google.com/d/forum/archesproject?hl=en
--- 
You received this message because you are subscribed to the Google Groups 
"Arches Project" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to archesproject+unsubscr...@googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

Re: [Arches] Re: Signing in

[Vincent Meijer]

Welcome Pat! I enjoyed browsing your cemetery website, quite interesting :)

I just wanted to give a heads up regarding developing Arches offline: last
time I tried this on an airplane I ran into trouble loading static files
(javascript, css).
I think at that time some of those files were loaded over an (online) CDN.
A quick look through the code indicates that this is not the case anymore,
but I would be sure to test it before boarding!

(Background info:
https://www.hanselman.com/blog/CDNsFailButYourScriptsDontHaveToFallbackFromCDNToLocalJQuery.aspx
)

Best,
Vincent

On Wed, Oct 17, 2018 at 1:03 PM Edmund Lee <
edmund@historicengland.org.uk> wrote:

> Welcome! Many thanks for signing in Pat and sharing your experience and
> interests with us all. What a fascinating life! You have definitely come to
> the right place. Here you will find the gurus that you seek to help you on
> the next stage of your learning journey, and make sure you are not 'all at
> sea' when you are at sea.
>
> Contributions to improve the install script based on your experience would
> be a great help. Do start that as a separate thread if you want to discuss
> it with the group.
>
> All the best
>
> Ed
>
> On Wednesday, October 17, 2018 at 12:05:47 AM UTC+1, Pat Lurcock wrote:
>>
>> Hi,
>>
>> After half a lifetime working as a government administrator in South
>> Georgia in the south atlantic, where I slowly developed a strong interest
>> in the cultural heritage (whaling, sealing, military, cemeteries) I am now
>> back in the UK and want to develop an online register of the Island's
>> Cultural Heritage sites as a public resource. Arches looks like the perfect
>> tool for the job. It covers all the angles that I have learned are
>> important for data management, is spatial, and free.
>>
>> My background is quite IT strongish - I developed a lot of fishery and
>> harbour management databases, learning by reverse-engineering Access and
>> then MySQL databases to improve them. So I have set up MySQL servers,
>> apache, Access, MySQL (with Access front end). Also self-taught web
>> programming to develop my website documenting the island's cemeteries (
>> http://www.cems.wildisland.gs)  first with a text editor then learning
>> to use a CMS (Joomla). More recently I have started learning GIS stuff
>> using QGIS, providing mapping and GPS support for a six-month rodent
>> monitoring project on South Georgia.
>>
>> So now I am learning again. Virtual machine on my windows laptop running
>> Ubuntu - the Xenial version for Arches specifically. That was an uphill
>> struggle but I think I am there now.
>>
>> Now I am installing Arches. The first try failed and I am hoping some
>> patient guru(s) might kindly guide me when I hit problems that I cannot
>> easily solve. I am dealing with a whole raft of new (to me) technologies so
>> there will be some very basic stuff that will have you rolling your eyes
>> skywards.
>>
>> It seems the install script is not quite perfect and I'd like to
>> contribute by tweaking it in the light of my experience so that it will be
>> a smoother job for the next person.
>>
>> My aim is to have a working installation on the laptop by the end of the
>> month. Then I can develop the actual application over the next few months
>> when I will be at sea without Internet. Then next year I want to put it
>> online, probably using AWS. More learning.
>>
>> Out of the window? The south Devon coast. On a good day, the heritage
>> coast of Dorset glows red in the distance. And just over the sea wall is a
>> post that used to stretch a chain to keep the U-Boats out of Teignmouth.
>>
>> Cheers all,
>> Pat
>>
>> On Thursday, August 22, 2013 at 4:29:37 PM UTC+1, Edmund Lee wrote:
>>>
>>> Hello all, ... and welcome in particular to those who have joined the
>>> Arches Discussion Forum recently.
>>>
>>> This online group was initially set up for the project team, and has
>>> just recently been opened up as the public, so some of us haven't met
>>> before. How about we all share a bit of background, just like we would if
>>> we were meeting in the real world? If that sounds good to you, reply to
>>> this thread and share with the group some or all of the following:
>>>
>>>- what is your interest in Arches?
>>>
>>>
>>>- where in the world are you working?
>>>
>>> and, just to make it a bit more fun,
>>>
>>>- what can you see out of the window? Is there any heritage in your
>>>view?
>>>
>>> I look forward to getting to know everyone a bit better!
>>>
>>>
>>> Ed
>>>
>> --
> -- To post, send email to archesproject@googlegroups.com. To unsubscribe,
> send email to archesproject+unsubscr...@googlegroups.com. For more
> information, visit https://groups.google.com/d/forum/archesproject?hl=en
> ---
> You received this message because you are subscribed to the Google Groups
> "Arches Project" group.
> To unsubscribe from this group and stop receiving emails from it, send an
> email to 

Re: [Arches] Re: Hosting Arches on Azure as a Web App for Containers

[Vincent Meijer]

I haven't, but now that you mention that it sounds familiar.
I did notice that the collectstatic method takes very long when using blob
storage for static files, I think sometimes even 30 minutes or so when
running locally on my laptop.
I think it has to do with the fact that it rechecks all the existing files
in blob storage to see if they are updated.

To be honest I currently don't have a solution for that... So I hope you
will find one and share! :)

On Wed, Oct 17, 2018 at 2:01 PM Lawrence Goh  wrote:

> Hi Vincent,
>
> I saw the post on static files with azure storage.  Have you come across
> where the first time it loads all the files in the blob, but the container
> fails/gets stuck on the second time when it does the static files?
>
> Thanks.
>
> Regards,
> Lawrence
>
> On Tue, Oct 16, 2018, 10:46 PM Vincent Meijer 
> wrote:
>
>> Sounds familiar, the loading of static files took a long time. Once they
>> are cached everything is fine, but an initial page load of 2 minutes was a
>> bit much in my opinion :)
>> Azure CDN might help with that.
>>
>> Anyway, good luck and keep us posted!
>> Vincent
>>
>>
>> On Monday, 15 October 2018 22:58:48 UTC+2, Lawrence Goh wrote:
>>>
>>> Hi Vincent,
>>>
>>> We have yet to populate data within.  So couldn't do much search
>>> though.  However, I noticed on some devices it would be slow first time,
>>> while some just in a flash.
>>>
>>> Once it is loaded, the following sessions is like a breeze.
>>>
>>> Now we are trying to create a blob storage for the media files.
>>>
>>> Thanks.
>>>
>>> Regards,
>>> Lawrence
>>>
>>> On Mon, Oct 15, 2018 at 11:33 PM Vincent Meijer 
>>> wrote:
>>>
>>>> How is Web App's performance for you?
>>>> How long does a GET request of e.g. the /search page take?
>>>>
>>>> Best,
>>>> Vincent
>>>>
>>>> --
>>>> -- To post, send email to arches...@googlegroups.com. To unsubscribe,
>>>> send email to archesprojec...@googlegroups.com. For more information,
>>>> visit https://groups.google.com/d/forum/archesproject?hl=en
>>>> ---
>>>> You received this message because you are subscribed to the Google
>>>> Groups "Arches Project" group.
>>>> To unsubscribe from this group and stop receiving emails from it, send
>>>> an email to archesprojec...@googlegroups.com.
>>>> For more options, visit https://groups.google.com/d/optout.
>>>>
>>> --
>> -- To post, send email to archesproject@googlegroups.com. To
>> unsubscribe, send email to archesproject+unsubscr...@googlegroups.com.
>> For more information, visit
>> https://groups.google.com/d/forum/archesproject?hl=en
>> ---
>> You received this message because you are subscribed to the Google Groups
>> "Arches Project" group.
>> To unsubscribe from this group and stop receiving emails from it, send an
>> email to archesproject+unsubscr...@googlegroups.com.
>> For more options, visit https://groups.google.com/d/optout.
>>
>

-- 
-- To post, send email to archesproject@googlegroups.com. To unsubscribe, send 
email to archesproject+unsubscr...@googlegroups.com. For more information, 
visit https://groups.google.com/d/forum/archesproject?hl=en
--- 
You received this message because you are subscribed to the Google Groups 
"Arches Project" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to archesproject+unsubscr...@googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

[Arches] Re: Arches Repository Contribution Guidelines

[Vincent Meijer]

Looks good. If I had to comment, maybe these minor points:

- Creating a PR is easiest when you just go to your repository home page on 
Github after you pushed your branch and it will display a 'Create Pull 
Request' button for that specific branch. Easy!
- Explain the [ci skip] command in commit messages a bit more (Commit 
Message Format chapter)

Best,
Vincent


On Tuesday, 16 October 2018 00:37:17 UTC+2, Adam Cox wrote:
>
> Hello all,
>
> We have been working on consolidating our instructions for how to 
> contribute code back to the Arches project. We are pleased to announce that 
> the guidelines are now ready for you to inspect and comment on.
>
> Contributing Guidelines: 
> https://github.com/archesproject/arches/blob/master/CONTRIBUTING.md
> Committer Guidelines: 
> https://github.com/archesproject/arches/wiki/Becoming-a-Committer
>
> If you are an Arches user who is interested in reporting bugs, suggesting 
> new features, or someone who has the capacity to contribute code to the 
> repository, the Contributing Guidelines are where you should start.
>
> Furthermore, if you are a developer that hopes to eventually gain 
> "committer" privileges to the main repo (meaning you can merge pull 
> requests, etc.), please see the Committer Guidelines.
>
> We are considering both of these documents to be in a "public comment" 
> phase, where we hope to get feedback from the greater Arches community on 
> their content. Please reply to this thread, or these github tickets (
> contributor , 
> committer ) with 
> your thoughts. This phase will last about a month, until the Arches 
> Technical Training workshop that will take place in Swindon, U.K., from 
> November 12-15, at which point we will officially adopt them.
>
> Thanks you for your interest!
>
> Adam
>

-- 
-- To post, send email to archesproject@googlegroups.com. To unsubscribe, send 
email to archesproject+unsubscr...@googlegroups.com. For more information, 
visit https://groups.google.com/d/forum/archesproject?hl=en
--- 
You received this message because you are subscribed to the Google Groups 
"Arches Project" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to archesproject+unsubscr...@googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

Re: [Arches] Re: Hosting Arches on Azure as a Web App for Containers

[Vincent Meijer]

Sounds familiar, the loading of static files took a long time. Once they 
are cached everything is fine, but an initial page load of 2 minutes was a 
bit much in my opinion :)
Azure CDN might help with that.

Anyway, good luck and keep us posted!
Vincent


On Monday, 15 October 2018 22:58:48 UTC+2, Lawrence Goh wrote:
>
> Hi Vincent,
>
> We have yet to populate data within.  So couldn't do much search though.  
> However, I noticed on some devices it would be slow first time, while some 
> just in a flash.
>
> Once it is loaded, the following sessions is like a breeze.
>
> Now we are trying to create a blob storage for the media files.
>
> Thanks.
>
> Regards,
> Lawrence
>
> On Mon, Oct 15, 2018 at 11:33 PM Vincent Meijer  > wrote:
>
>> How is Web App's performance for you? 
>> How long does a GET request of e.g. the /search page take?
>>
>> Best,
>> Vincent
>>
>> -- 
>> -- To post, send email to arches...@googlegroups.com . To 
>> unsubscribe, send email to archesprojec...@googlegroups.com . 
>> For more information, visit 
>> https://groups.google.com/d/forum/archesproject?hl=en
>> --- 
>> You received this message because you are subscribed to the Google Groups 
>> "Arches Project" group.
>> To unsubscribe from this group and stop receiving emails from it, send an 
>> email to archesprojec...@googlegroups.com .
>> For more options, visit https://groups.google.com/d/optout.
>>
>

-- 
-- To post, send email to archesproject@googlegroups.com. To unsubscribe, send 
email to archesproject+unsubscr...@googlegroups.com. For more information, 
visit https://groups.google.com/d/forum/archesproject?hl=en
--- 
You received this message because you are subscribed to the Google Groups 
"Arches Project" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to archesproject+unsubscr...@googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

Re: [Arches] Re: Uploaded files status: "queued"

[Vincent Meijer]

Thanks Adam, I'll dive into that


On Monday, 15 October 2018 16:42:17 UTC+2, Adam Cox wrote:
>
> Vincent, here's where the value should be set, it's at the end of the 
> method that handles the filelist request.
>
>
> https://github.com/archesproject/arches/blob/master/arches/app/datatypes/datatypes.py#L948
>
> I'd suggest adding some step-by-step print statements in that function, 
> because it seems to be failing silently for you, and indeed it could be a 
> bug...
>
> Adam
>
> On Mon, Oct 15, 2018 at 9:28 AM Vincent Meijer  > wrote:
>
>> I am still seemingly randomly getting uploaded file tiles that have the 
>> 'queued' status. This is preventing me from getting the download url of the 
>> file (and thus displaying its contents).
>>
>> Could this be a bug in Arches? It is quite a big problem for my project 
>> at the moment. 
>>
>> Thanks!
>> Vincent
>>
>>
>> On Friday, 12 October 2018 14:41:47 UTC+2, Vincent Meijer wrote:
>>>
>>> And there is also this: 
>>> https://github.com/archesproject/arches/blob/07d5ac0652af60f435ff1316ee7d26c06c9e0e56/arches/app/media/js/views/components/widgets/file.js#L121
>>> But I still can't find where it could get that 'status = queued' value.
>>>
>>>
>>> On Friday, 12 October 2018 13:50:24 UTC+2, Vincent Meijer wrote:
>>>>
>>>> My main problem now is that when status = queued, the url property is 
>>>> also null. 
>>>> I can't find any Arches code that even hints at setting these 
>>>> properties, except in datatypes.FileListDataType where status is set 
>>>> to "uploaded":
>>>>
>>>> https://github.com/archesproject/arches/blob/07d5ac0652af60f435ff1316ee7d26c06c9e0e56/arches/app/datatypes/datatypes.py#L948
>>>>
>>>>
>>>> On Thursday, 11 October 2018 16:58:48 UTC+2, Adam Cox wrote:
>>>>>
>>>>> Hi Vincent, this touches on something we at Legion GIS came across 
>>>>> recently, while trying to include file pathsd in a CSV upload. Turns out 
>>>>> that because the actual upload process isn't run, even if the files exist 
>>>>> in the file system before the import their status is never updated to 
>>>>> "uploaded". Our first work around is a management command that goes in 
>>>>> after the fact and manually changes all statuses to "uploaded".
>>>>>
>>>>> This is only tangentially related to your question, as it doesn't 
>>>>> address the "queued" value, but I wanted to mention it because ultimately 
>>>>> we too are wondering what the status property is for...
>>>>>
>>>>> On Thursday, October 11, 2018 at 3:06:05 AM UTC-5, Vincent Meijer 
>>>>> wrote:
>>>>>>
>>>>>> Sometimes after I uploaded a file and then try to display them in the 
>>>>>> frontend, the item has a status 'queued', where I would expect the 
>>>>>> status 
>>>>>> to be 'uploaded'.
>>>>>> This property is used e.g. in the Image Header template  (image.js):
>>>>>>
>>>>>> if (item.status &&
>>>>>> item.type &&
>>>>>> item.status === 'uploaded' &&
>>>>>> item.type.indexOf('image') > -1 &&
>>>>>> _.contains(nodes, key)
>>>>>> ) {
>>>>>> imgs.push({
>>>>>> src: item.url,
>>>>>> alt: item.name
>>>>>> });
>>>>>> }
>>>>>>
>>>>>> I am using a similar approach on a custom template to read file names 
>>>>>> of uploaded zips:
>>>>>>
>>>>>> if (item.status &&
>>>>>> item.status === 'uploaded' &&
>>>>>> (item.name.split('.').pop() == 'zip')
>>>>>> ) {
>>>>>> potreeZipFiles.push({
>>>>>> src: item.url,
>>>>>> name: item.name
>>>>>> });
>>>>>> }
>>>>>>
>>>>>>
>>>>>> What is the function of this status property and why does it still 
>>>>>> have the 'queued' value while the upload has already finished?
>>>>>>
>>>>>> -- 
>> -- To post, send email to arches...@googlegroups.com . To 
>> unsubscribe, send email to archesprojec...@googlegroups.com . 
>> For more information, visit 
>> https://groups.google.com/d/forum/archesproject?hl=en
>> --- 
>> You received this message because you are subscribed to the Google Groups 
>> "Arches Project" group.
>> To unsubscribe from this group and stop receiving emails from it, send an 
>> email to archesprojec...@googlegroups.com .
>> For more options, visit https://groups.google.com/d/optout.
>>
>

-- 
-- To post, send email to archesproject@googlegroups.com. To unsubscribe, send 
email to archesproject+unsubscr...@googlegroups.com. For more information, 
visit https://groups.google.com/d/forum/archesproject?hl=en
--- 
You received this message because you are subscribed to the Google Groups 
"Arches Project" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to archesproject+unsubscr...@googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

[Arches] Re: Uploaded files status: "queued"

[Vincent Meijer]

I am still seemingly randomly getting uploaded file tiles that have the 
'queued' status. This is preventing me from getting the download url of the 
file (and thus displaying its contents).

Could this be a bug in Arches? It is quite a big problem for my project at 
the moment. 

Thanks!
Vincent


On Friday, 12 October 2018 14:41:47 UTC+2, Vincent Meijer wrote:
>
> And there is also this: 
> https://github.com/archesproject/arches/blob/07d5ac0652af60f435ff1316ee7d26c06c9e0e56/arches/app/media/js/views/components/widgets/file.js#L121
> But I still can't find where it could get that 'status = queued' value.
>
>
> On Friday, 12 October 2018 13:50:24 UTC+2, Vincent Meijer wrote:
>>
>> My main problem now is that when status = queued, the url property is 
>> also null. 
>> I can't find any Arches code that even hints at setting these properties, 
>> except in datatypes.FileListDataType where status is set to "uploaded":
>>
>> https://github.com/archesproject/arches/blob/07d5ac0652af60f435ff1316ee7d26c06c9e0e56/arches/app/datatypes/datatypes.py#L948
>>
>>
>> On Thursday, 11 October 2018 16:58:48 UTC+2, Adam Cox wrote:
>>>
>>> Hi Vincent, this touches on something we at Legion GIS came across 
>>> recently, while trying to include file pathsd in a CSV upload. Turns out 
>>> that because the actual upload process isn't run, even if the files exist 
>>> in the file system before the import their status is never updated to 
>>> "uploaded". Our first work around is a management command that goes in 
>>> after the fact and manually changes all statuses to "uploaded".
>>>
>>> This is only tangentially related to your question, as it doesn't 
>>> address the "queued" value, but I wanted to mention it because ultimately 
>>> we too are wondering what the status property is for...
>>>
>>> On Thursday, October 11, 2018 at 3:06:05 AM UTC-5, Vincent Meijer wrote:
>>>>
>>>> Sometimes after I uploaded a file and then try to display them in the 
>>>> frontend, the item has a status 'queued', where I would expect the status 
>>>> to be 'uploaded'.
>>>> This property is used e.g. in the Image Header template  (image.js):
>>>>
>>>> if (item.status &&
>>>> item.type &&
>>>> item.status === 'uploaded' &&
>>>> item.type.indexOf('image') > -1 &&
>>>> _.contains(nodes, key)
>>>> ) {
>>>> imgs.push({
>>>> src: item.url,
>>>> alt: item.name
>>>> });
>>>> }
>>>>
>>>> I am using a similar approach on a custom template to read file names 
>>>> of uploaded zips:
>>>>
>>>> if (item.status &&
>>>> item.status === 'uploaded' &&
>>>> (item.name.split('.').pop() == 'zip')
>>>> ) {
>>>> potreeZipFiles.push({
>>>> src: item.url,
>>>> name: item.name
>>>> });
>>>> }
>>>>
>>>>
>>>> What is the function of this status property and why does it still have 
>>>> the 'queued' value while the upload has already finished?
>>>>
>>>>

-- 
-- To post, send email to archesproject@googlegroups.com. To unsubscribe, send 
email to archesproject+unsubscr...@googlegroups.com. For more information, 
visit https://groups.google.com/d/forum/archesproject?hl=en
--- 
You received this message because you are subscribed to the Google Groups 
"Arches Project" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to archesproject+unsubscr...@googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

[Arches] Re: Collector nodes in RDM

[Vincent Meijer]

Hi Adam,

I thought this was done through a concept Value, for which you can select 
'collector' from the dropdown and add the concept name as its value in the 
free text field.
However, I wasn't able to make collectors not clickable, so I made this 
issue a while back:

https://github.com/archesproject/arches/issues/4134 

Best,
Vincent

On Saturday, 13 October 2018 02:40:49 UTC+2, Adam Lodge wrote:
>
> Does anyone (maybe @ryan or @adamcox) remember how to flag a given RDM 
> concept as a collector in order to prevent it from actually being picked in 
> a given dropdown field? I cant find any documentation on it, and trying to 
> do it by memory and failing. It might not be supported in 4.3 and if so, 
> I'll just write a bug/enhancement ticket, but would like for someone else 
> to try before i do so.
>
> Adam L.
>

-- 
-- To post, send email to archesproject@googlegroups.com. To unsubscribe, send 
email to archesproject+unsubscr...@googlegroups.com. For more information, 
visit https://groups.google.com/d/forum/archesproject?hl=en
--- 
You received this message because you are subscribed to the Google Groups 
"Arches Project" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to archesproject+unsubscr...@googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

Re: [Arches] Re: Hosting Arches on Azure as a Web App for Containers

[Vincent Meijer]

How is Web App's performance for you? 
How long does a GET request of e.g. the /search page take?

Best,
Vincent

-- 
-- To post, send email to archesproject@googlegroups.com. To unsubscribe, send 
email to archesproject+unsubscr...@googlegroups.com. For more information, 
visit https://groups.google.com/d/forum/archesproject?hl=en
--- 
You received this message because you are subscribed to the Google Groups 
"Arches Project" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to archesproject+unsubscr...@googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

[Arches] Re: Uploaded files status: "queued"

[Vincent Meijer]

And there is also 
this: 
https://github.com/archesproject/arches/blob/07d5ac0652af60f435ff1316ee7d26c06c9e0e56/arches/app/media/js/views/components/widgets/file.js#L121
But I still can't find where it could get that 'status = queued' value.


On Friday, 12 October 2018 13:50:24 UTC+2, Vincent Meijer wrote:
>
> My main problem now is that when status = queued, the url property is also 
> null. 
> I can't find any Arches code that even hints at setting these properties, 
> except in datatypes.FileListDataType where status is set to "uploaded":
>
> https://github.com/archesproject/arches/blob/07d5ac0652af60f435ff1316ee7d26c06c9e0e56/arches/app/datatypes/datatypes.py#L948
>
>
> On Thursday, 11 October 2018 16:58:48 UTC+2, Adam Cox wrote:
>>
>> Hi Vincent, this touches on something we at Legion GIS came across 
>> recently, while trying to include file pathsd in a CSV upload. Turns out 
>> that because the actual upload process isn't run, even if the files exist 
>> in the file system before the import their status is never updated to 
>> "uploaded". Our first work around is a management command that goes in 
>> after the fact and manually changes all statuses to "uploaded".
>>
>> This is only tangentially related to your question, as it doesn't address 
>> the "queued" value, but I wanted to mention it because ultimately we too 
>> are wondering what the status property is for...
>>
>> On Thursday, October 11, 2018 at 3:06:05 AM UTC-5, Vincent Meijer wrote:
>>>
>>> Sometimes after I uploaded a file and then try to display them in the 
>>> frontend, the item has a status 'queued', where I would expect the status 
>>> to be 'uploaded'.
>>> This property is used e.g. in the Image Header template  (image.js):
>>>
>>> if (item.status &&
>>> item.type &&
>>> item.status === 'uploaded' &&
>>> item.type.indexOf('image') > -1 &&
>>> _.contains(nodes, key)
>>> ) {
>>> imgs.push({
>>> src: item.url,
>>> alt: item.name
>>> });
>>> }
>>>
>>> I am using a similar approach on a custom template to read file names of 
>>> uploaded zips:
>>>
>>> if (item.status &&
>>> item.status === 'uploaded' &&
>>> (item.name.split('.').pop() == 'zip')
>>> ) {
>>> potreeZipFiles.push({
>>> src: item.url,
>>> name: item.name
>>> });
>>> }
>>>
>>>
>>> What is the function of this status property and why does it still have 
>>> the 'queued' value while the upload has already finished?
>>>
>>>

-- 
-- To post, send email to archesproject@googlegroups.com. To unsubscribe, send 
email to archesproject+unsubscr...@googlegroups.com. For more information, 
visit https://groups.google.com/d/forum/archesproject?hl=en
--- 
You received this message because you are subscribed to the Google Groups 
"Arches Project" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to archesproject+unsubscr...@googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

[Arches] Re: Uploaded files status: "queued"

[Vincent Meijer]

My main problem now is that when status = queued, the url property is also 
null. 
I can't find any Arches code that even hints at setting these properties, 
except in datatypes.FileListDataType where status is set to "uploaded":
https://github.com/archesproject/arches/blob/07d5ac0652af60f435ff1316ee7d26c06c9e0e56/arches/app/datatypes/datatypes.py#L948


On Thursday, 11 October 2018 16:58:48 UTC+2, Adam Cox wrote:
>
> Hi Vincent, this touches on something we at Legion GIS came across 
> recently, while trying to include file pathsd in a CSV upload. Turns out 
> that because the actual upload process isn't run, even if the files exist 
> in the file system before the import their status is never updated to 
> "uploaded". Our first work around is a management command that goes in 
> after the fact and manually changes all statuses to "uploaded".
>
> This is only tangentially related to your question, as it doesn't address 
> the "queued" value, but I wanted to mention it because ultimately we too 
> are wondering what the status property is for...
>
> On Thursday, October 11, 2018 at 3:06:05 AM UTC-5, Vincent Meijer wrote:
>>
>> Sometimes after I uploaded a file and then try to display them in the 
>> frontend, the item has a status 'queued', where I would expect the status 
>> to be 'uploaded'.
>> This property is used e.g. in the Image Header template  (image.js):
>>
>> if (item.status &&
>> item.type &&
>> item.status === 'uploaded' &&
>> item.type.indexOf('image') > -1 &&
>> _.contains(nodes, key)
>> ) {
>> imgs.push({
>> src: item.url,
>> alt: item.name
>> });
>> }
>>
>> I am using a similar approach on a custom template to read file names of 
>> uploaded zips:
>>
>> if (item.status &&
>> item.status === 'uploaded' &&
>> (item.name.split('.').pop() == 'zip')
>> ) {
>> potreeZipFiles.push({
>> src: item.url,
>> name: item.name
>> });
>> }
>>
>>
>> What is the function of this status property and why does it still have 
>> the 'queued' value while the upload has already finished?
>>
>>

-- 
-- To post, send email to archesproject@googlegroups.com. To unsubscribe, send 
email to archesproject+unsubscr...@googlegroups.com. For more information, 
visit https://groups.google.com/d/forum/archesproject?hl=en
--- 
You received this message because you are subscribed to the Google Groups 
"Arches Project" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to archesproject+unsubscr...@googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

Re: [Arches] Re: Hosting Arches on Azure as a Web App for Containers

[Vincent Meijer]

Excellent news, glad to hear it!

On Fri, 12 Oct 2018, 02:41 Lawrence Goh,  wrote:

> Hi Vincent,
>
> Thank you so much for all the help and information.  I finally got it
> running on Azure.  Adding on, I have changed the ports back to 8000:8000.
>
> Thanks again.
>
> Regards,
> Lawrence
>
> On Thu, Oct 11, 2018 at 8:11 PM Vincent Meijer 
> wrote:
>
>> In your case the Azure Web App takes on the role of Nginx, so you don't
>> need that.
>> Gunicorn is already built into the Arches image (see the command in the
>> entrypoint.sh), which is going to talk to your Web App.
>>
>>
>> Regarding whitenoise, you don't need to set STATIC_ROOT, as it is already
>> set for you (see docker/settings_local.py). Default value is /
>> static_root which is fine.
>> Also, don't add the 'from whitenoise import WhiteNoise' line to your
>> wsgi.py file, those steps are for other systems besides Django (skip
>> everything after 'QuickStart for other WSGI apps').
>>
>> Tip: you can add whitenoise to your requirements.txt so you have all your
>> requirements in one place, preferably with a version number:
>> whitenoise==4.1
>> Then remove it from your entrypoint.sh
>>
>> If you can't get it to work: start with the simplest set up.
>> You can first try to get it running locally instead of in Azure Web App.
>> Perhaps first with DJANGO_MODE=DEV and DJANGO_DEBUG=True (in your
>> docker-compose.yml)
>> With those settings you don't need Whitenoise (but dev mode is not safe
>> for production environments).
>> If that works, set those settings back to PROD and False and try to get
>> Whitenoise working.
>> Then if that works, move over to Web App.
>>
>> Also be sure to remove nginx from your local docker-compose.yml, since
>> your goal is to run Arches without it in your Web App.
>>
>> Good luck and let me know how it goes!
>> Vincent
>>
>> On Thursday, 11 October 2018 05:48:18 UTC+2, Lawrence Goh wrote:
>>>
>>> Hi Vincent,
>>>
>>> I found more info on gunicorn and nginx.  it seems they need each other.
>>>
>>>
>>> https://stackoverflow.com/questions/12800862/how-to-make-django-serve-static-files-with-gunicorn
>>>
>>> What do you think?
>>>
>>> Thanks.
>>>
>>> Regards,
>>> Lawrence
>>>
>>> On Thu, Oct 11, 2018, 3:58 PM Lawrence Goh  wrote:
>>>
>>>> Hi Vincent,
>>>>
>>>> I am trying to have whitenoise in.  Have you done it before?
>>>>
>>>> I have modified entrypoint.sh to include 'pip install whitenoise' after
>>>> the virtual environment creation.  Modified settings.py to have STATIC_ROOT
>>>> with this 'os.path.join(ROOT_DIR, 'staticfiles') and the entry in
>>>> MIDDLEWARE.  Plus, wsgi.py file to have 'from whitenoise import 
>>>> WhiteNoise'.
>>>>
>>>> Unsure if anywhere else was missed.
>>>>
>>>> Thanks.
>>>>
>>>> Regards,
>>>> Lawrence
>>>>
>>>> On Wed, Oct 10, 2018 at 9:09 PM Vincent Meijer 
>>>> wrote:
>>>>
>>>>> Ah, I think I know what the problem is. Didn't think of this before,
>>>>> but Django does not want to serve static files (css, js, images, etc) when
>>>>> in PROD mode (and DEBUG=False).
>>>>>
>>>>> There are two routes I can think of right now:
>>>>> 1. Set up White Noise to make Django serve static files (
>>>>> http://whitenoise.evans.io/en/stable/)
>>>>> 2. Set up the Azure CDN I described above
>>>>>
>>>>> I would personally go with option 2, because for me that made a big
>>>>> difference in terms of performance.
>>>>>
>>>>>
>>>>> On Wednesday, 10 October 2018 05:04:14 UTC+2, Lawrence Goh wrote:
>>>>>>
>>>>>> Hi Vincent,
>>>>>>
>>>>>> I guess I celebrated too early. I removed the cache and now the site
>>>>>> on port 80 is broken as the images and JS are not downloaded.  Any idea 
>>>>>> on
>>>>>> this?
>>>>>>
>>>>>> Thanks.
>>>>>>
>>>>>> Regards,
>>>>>> Lawrence
>>>>>>
>>>>>> On Wed, Oct 10, 2018 at 2:36 PM Lawrence Goh 
>>>>>> wrote:
>>>>>>
>>>>>>> Hi Vincent,
>>&g

[Arches] Uploaded files status: "queued"

[Vincent Meijer]

Sometimes after I uploaded a file and then try to display them in the 
frontend, the item has a status 'queued', where I would expect the status 
to be 'uploaded'.
This property is used e.g. in the Image Header template  (image.js):

if (item.status &&
item.type &&
item.status === 'uploaded' &&
item.type.indexOf('image') > -1 &&
_.contains(nodes, key)
) {
imgs.push({
src: item.url,
alt: item.name
});
}

I am using a similar approach on a custom template to read file names of 
uploaded zips:

if (item.status &&
item.status === 'uploaded' &&
(item.name.split('.').pop() == 'zip')
) {
potreeZipFiles.push({
src: item.url,
name: item.name
});
}


What is the function of this status property and why does it still have the 
'queued' value while the upload has already finished?

-- 
-- To post, send email to archesproject@googlegroups.com. To unsubscribe, send 
email to archesproject+unsubscr...@googlegroups.com. For more information, 
visit https://groups.google.com/d/forum/archesproject?hl=en
--- 
You received this message because you are subscribed to the Google Groups 
"Arches Project" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to archesproject+unsubscr...@googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

Re: [Arches] Re: Hosting Arches on Azure as a Web App for Containers

[Vincent Meijer]

In your case the Azure Web App takes on the role of Nginx, so you don't 
need that.
Gunicorn is already built into the Arches image (see the command in the 
entrypoint.sh), which is going to talk to your Web App. 


Regarding whitenoise, you don't need to set STATIC_ROOT, as it is already 
set for you (see docker/settings_local.py). Default value is /static_root which 
is fine.
Also, don't add the 'from whitenoise import WhiteNoise' line to your 
wsgi.py file, those steps are for other systems besides Django (skip 
everything after 'QuickStart for other WSGI apps').

Tip: you can add whitenoise to your requirements.txt so you have all your 
requirements in one place, preferably with a version number: 
whitenoise==4.1 
Then remove it from your entrypoint.sh

If you can't get it to work: start with the simplest set up.
You can first try to get it running locally instead of in Azure Web App.
Perhaps first with DJANGO_MODE=DEV and DJANGO_DEBUG=True (in your 
docker-compose.yml)
With those settings you don't need Whitenoise (but dev mode is not safe for 
production environments).
If that works, set those settings back to PROD and False and try to get 
Whitenoise working.
Then if that works, move over to Web App.

Also be sure to remove nginx from your local docker-compose.yml, since your 
goal is to run Arches without it in your Web App.

Good luck and let me know how it goes!
Vincent

On Thursday, 11 October 2018 05:48:18 UTC+2, Lawrence Goh wrote:
>
> Hi Vincent,
>
> I found more info on gunicorn and nginx.  it seems they need each other.
>
>
> https://stackoverflow.com/questions/12800862/how-to-make-django-serve-static-files-with-gunicorn
>
> What do you think?
>
> Thanks.
>
> Regards,
> Lawrence 
>
> On Thu, Oct 11, 2018, 3:58 PM Lawrence Goh  > wrote:
>
>> Hi Vincent,
>>
>> I am trying to have whitenoise in.  Have you done it before?
>>
>> I have modified entrypoint.sh to include 'pip install whitenoise' after 
>> the virtual environment creation.  Modified settings.py to have STATIC_ROOT 
>> with this 'os.path.join(ROOT_DIR, 'staticfiles') and the entry in 
>> MIDDLEWARE.  Plus, wsgi.py file to have 'from whitenoise import WhiteNoise'.
>>
>> Unsure if anywhere else was missed.
>>
>> Thanks.
>>
>> Regards,
>> Lawrence 
>>
>> On Wed, Oct 10, 2018 at 9:09 PM Vincent Meijer > > wrote:
>>
>>> Ah, I think I know what the problem is. Didn't think of this before, but 
>>> Django does not want to serve static files (css, js, images, etc) when in 
>>> PROD mode (and DEBUG=False).
>>>
>>> There are two routes I can think of right now: 
>>> 1. Set up White Noise to make Django serve static files (
>>> http://whitenoise.evans.io/en/stable/)
>>> 2. Set up the Azure CDN I described above
>>>
>>> I would personally go with option 2, because for me that made a big 
>>> difference in terms of performance. 
>>>
>>>
>>> On Wednesday, 10 October 2018 05:04:14 UTC+2, Lawrence Goh wrote:
>>>>
>>>> Hi Vincent,
>>>>
>>>> I guess I celebrated too early. I removed the cache and now the site on 
>>>> port 80 is broken as the images and JS are not downloaded.  Any idea on 
>>>> this?
>>>>
>>>> Thanks.
>>>>
>>>> Regards,
>>>> Lawrence
>>>>
>>>> On Wed, Oct 10, 2018 at 2:36 PM Lawrence Goh  
>>>> wrote:
>>>>
>>>>> Hi Vincent,
>>>>>
>>>>> Thanks a lot of the suggestion.  I tried the suggestion on dumping 
>>>>> nginx and changing the port number but I kept couchdb as it is though.  
>>>>> It 
>>>>> is working as a web app for containers using multi-container.
>>>>>
>>>>> Will put the single container approach on the pipeline :)
>>>>>
>>>>> Thanks again!
>>>>>
>>>>> Regards,
>>>>> Lawrence
>>>>>
>>>>> On Wed, Oct 10, 2018 at 12:13 AM Vincent Meijer  
>>>>> wrote:
>>>>>
>>>>>> No worries, I come from a .net environment myself. 
>>>>>> As for the App Service, I realized that I set up Postgres and 
>>>>>> Elasticsearch separately, that is why I was able to use the Single 
>>>>>> Container approach (see below for future reference). 
>>>>>>
>>>>>> I just remembered I wasn't able to get the docker-compose approach 
>>>>>> working in the App Service.
>>>>>> If you like to give it

Re: [Arches] Re: Hosting Arches on Azure as a Web App for Containers

[Vincent Meijer]

Ah, I think I know what the problem is. Didn't think of this before, but 
Django does not want to serve static files (css, js, images, etc) when in 
PROD mode (and DEBUG=False).

There are two routes I can think of right now: 
1. Set up White Noise to make Django serve static files 
(http://whitenoise.evans.io/en/stable/)
2. Set up the Azure CDN I described above

I would personally go with option 2, because for me that made a big 
difference in terms of performance. 


On Wednesday, 10 October 2018 05:04:14 UTC+2, Lawrence Goh wrote:
>
> Hi Vincent,
>
> I guess I celebrated too early. I removed the cache and now the site on 
> port 80 is broken as the images and JS are not downloaded.  Any idea on 
> this?
>
> Thanks.
>
> Regards,
> Lawrence
>
> On Wed, Oct 10, 2018 at 2:36 PM Lawrence Goh  > wrote:
>
>> Hi Vincent,
>>
>> Thanks a lot of the suggestion.  I tried the suggestion on dumping nginx 
>> and changing the port number but I kept couchdb as it is though.  It is 
>> working as a web app for containers using multi-container.
>>
>> Will put the single container approach on the pipeline :)
>>
>> Thanks again!
>>
>> Regards,
>> Lawrence
>>
>> On Wed, Oct 10, 2018 at 12:13 AM Vincent Meijer > > wrote:
>>
>>> No worries, I come from a .net environment myself. 
>>> As for the App Service, I realized that I set up Postgres and 
>>> Elasticsearch separately, that is why I was able to use the Single 
>>> Container approach (see below for future reference). 
>>>
>>> I just remembered I wasn't able to get the docker-compose approach 
>>> working in the App Service.
>>> If you like to give it another try, you could remove the nginx service 
>>> from your docker-compose.yml.
>>> Then add a port mapping on your arches service in your 
>>> docker-compose.yml from 80 on the host (App Service) to 8000 on the 
>>> container:
>>> Change:
>>> ports:
>>> - '8000:8000'
>>> To:
>>> ports:
>>> - '80:8000'
>>>
>>> Also be sure to set the DOMAIN_NAMES setting in your docker-compose.yml 
>>> to the address of your web app.
>>>
>>> Finally, you may try removing the couchdb service from your 
>>> docker-compose.yml, as this db is not (yet) used by arches at the moment 
>>> (saves some resources). 
>>> Be sure to *keep* the couchdb environment variables in your Arches 
>>> service though (their values don't matter, but they are expected to be 
>>> present). 
>>>
>>>
>>> Here is some background info that might be useful: 
>>> https://blogs.msdn.microsoft.com/appserviceteam/2018/05/07/multi-container/
>>>
>>>
>>>
>>> *Single Container *approach
>>> For the Single Container approach you wouldn't use a compose file at 
>>> all, but that is assuming you run Postgres and Elasticsearch elsewhere.
>>> - On the App Service blade, select Container Settings (step 1 in the 
>>> screenshot below).
>>> - Select 'Single Container' (step 2)
>>> - Configure that page, ie. select the right image etc.
>>> - Go to 'Application Settings' (step 3 on screenshot) and fill out all 
>>> environment variables you have in your docker-compose.yml as individual app 
>>> settings
>>>
>>>
>>> [image: Azure App Service.png]
>>>
>>>
>>> On Tuesday, 9 October 2018 12:26:15 UTC+2, Lawrence Goh wrote:
>>>>
>>>> Hi Vincent,
>>>>
>>>> Thanks for the reply.  I am not so well verse in the web development in 
>>>> open source space.  Last I knew something related was Apache :) Pardon my 
>>>> knowledge as I am from .net.  Some help would be very much appreciated to 
>>>> implement this.  
>>>>
>>>> Based on the docker compose file, we have these containers - arches, 
>>>> nginx, db, elasticsearch, couchdb and letsencrypt. The single container 
>>>> would be having multiple single containers excluding nginx?
>>>>
>>>> What would be the best approach?
>>>>
>>>> Thanks.
>>>>
>>>> Regards,
>>>> Lawrence 
>>>>
>>>>
>>>>
>>>>
>>>> On Tue, Oct 9, 2018, 8:46 PM Vincent Meijer  
>>>> wrote:
>>>>
>>>>> Hi Lawrence,
>>>>>
>>>>> The Azure App Service is meant to take over everything but the app 
>>>>> itself, so running it with an nginx 

Re: [Arches] Re: Hosting Arches on Azure as a Web App for Containers

[Vincent Meijer]

No worries, I come from a .net environment myself. 
As for the App Service, I realized that I set up Postgres and Elasticsearch 
separately, that is why I was able to use the Single Container approach 
(see below for future reference). 

I just remembered I wasn't able to get the docker-compose approach working 
in the App Service.
If you like to give it another try, you could remove the nginx service from 
your docker-compose.yml.
Then add a port mapping on your arches service in your docker-compose.yml 
from 80 on the host (App Service) to 8000 on the container:
Change:
ports:
- '8000:8000'
To:
ports:
- '80:8000'

Also be sure to set the DOMAIN_NAMES setting in your docker-compose.yml to 
the address of your web app.

Finally, you may try removing the couchdb service from your 
docker-compose.yml, as this db is not (yet) used by arches at the moment 
(saves some resources). 
Be sure to *keep* the couchdb environment variables in your Arches service 
though (their values don't matter, but they are expected to be present). 


Here is some background info that might be 
useful: 
https://blogs.msdn.microsoft.com/appserviceteam/2018/05/07/multi-container/



*Single Container *approach
For the Single Container approach you wouldn't use a compose file at all, 
but that is assuming you run Postgres and Elasticsearch elsewhere.
- On the App Service blade, select Container Settings (step 1 in the 
screenshot below).
- Select 'Single Container' (step 2)
- Configure that page, ie. select the right image etc.
- Go to 'Application Settings' (step 3 on screenshot) and fill out all 
environment variables you have in your docker-compose.yml as individual app 
settings


[image: Azure App Service.png]


On Tuesday, 9 October 2018 12:26:15 UTC+2, Lawrence Goh wrote:
>
> Hi Vincent,
>
> Thanks for the reply.  I am not so well verse in the web development in 
> open source space.  Last I knew something related was Apache :) Pardon my 
> knowledge as I am from .net.  Some help would be very much appreciated to 
> implement this.  
>
> Based on the docker compose file, we have these containers - arches, 
> nginx, db, elasticsearch, couchdb and letsencrypt. The single container 
> would be having multiple single containers excluding nginx?
>
> What would be the best approach?
>
> Thanks.
>
> Regards,
> Lawrence 
>
>
>
>
> On Tue, Oct 9, 2018, 8:46 PM Vincent Meijer  > wrote:
>
>> Hi Lawrence,
>>
>> The Azure App Service is meant to take over everything but the app 
>> itself, so running it with an nginx container is not necessary. 
>> I used the App Service for a short while and only could get it to work 
>> when using the single container approach. 
>>
>> That being said, I found the App Service to be extremely slow (and 
>> expensive), so I am eager to hear your experiences with it. 
>>
>> For me it did help to set up Azure CDN to serve static files.
>> Roughly:
>> 1. Set up an Azure Blob Storage account
>> 2. Configure Django to use the azure-storage package (
>> https://django-storages.readthedocs.io/en/latest/backends/azure.html  -> 
>> don't do the static files steps)
>> 3. Set up Azure CDN with the storage account from step 1 as origin.
>> 4. Set `STATIC_URL` in settings.py to the CDN endpoint.
>>
>>
>> I hope this helps and please share your experiences with us :)
>> Vincent
>>
>>
>> On Tuesday, 9 October 2018 04:19:42 UTC+2, Lawrence Goh wrote:
>>>
>>> Hi!  I am trying to set up the Arches Project on Azure using its Web App 
>>> for Containers.  But I hit a roadblock where I will get a '400 Bad Request' 
>>> when browsing it.  I see the Azure logs are displaying that the NGINX got 
>>> called when I triggered it on a browser.  Hope to get some help on this.  
>>> Thanks.
>>>
>> -- 
>> -- To post, send email to arches...@googlegroups.com . To 
>> unsubscribe, send email to archesprojec...@googlegroups.com . 
>> For more information, visit 
>> https://groups.google.com/d/forum/archesproject?hl=en
>> --- 
>> You received this message because you are subscribed to the Google Groups 
>> "Arches Project" group.
>> To unsubscribe from this group and stop receiving emails from it, send an 
>> email to archesprojec...@googlegroups.com .
>> For more options, visit https://groups.google.com/d/optout.
>>
>

-- 
-- To post, send email to archesproject@googlegroups.com. To unsubscribe, send 
email to archesproject+unsubscr...@googlegroups.com. For more information, 
visit https://groups.google.com/d/forum/archesproject?hl=en
--- 
You received this message because you are subscribed to the Google Groups 
"Arches Project" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to archesproject+unsubscr...@googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

[Arches] Re: Hosting Arches on Azure as a Web App for Containers

[Vincent Meijer]

Hi Lawrence,

The Azure App Service is meant to take over everything but the app itself, 
so running it with an nginx container is not necessary. 
I used the App Service for a short while and only could get it to work when 
using the single container approach. 

That being said, I found the App Service to be extremely slow (and 
expensive), so I am eager to hear your experiences with it. 

For me it did help to set up Azure CDN to serve static files.
Roughly:
1. Set up an Azure Blob Storage account
2. Configure Django to use the azure-storage package 
(https://django-storages.readthedocs.io/en/latest/backends/azure.html  -> 
don't do the static files steps)
3. Set up Azure CDN with the storage account from step 1 as origin.
4. Set `STATIC_URL` in settings.py to the CDN endpoint.


I hope this helps and please share your experiences with us :)
Vincent


On Tuesday, 9 October 2018 04:19:42 UTC+2, Lawrence Goh wrote:
>
> Hi!  I am trying to set up the Arches Project on Azure using its Web App 
> for Containers.  But I hit a roadblock where I will get a '400 Bad Request' 
> when browsing it.  I see the Azure logs are displaying that the NGINX got 
> called when I triggered it on a browser.  Hope to get some help on this.  
> Thanks.
>

-- 
-- To post, send email to archesproject@googlegroups.com. To unsubscribe, send 
email to archesproject+unsubscr...@googlegroups.com. For more information, 
visit https://groups.google.com/d/forum/archesproject?hl=en
--- 
You received this message because you are subscribed to the Google Groups 
"Arches Project" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to archesproject+unsubscr...@googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

[Arches] Re: Heritage Resource Phase Type Assignment - Widget Manager - Drop Down 'loading failed'

[Vincent Meijer]

All I can think of is re-indexing elasticsearch:
(after activating your virtualenv)

python manage.py es delete_indexes
python manage.py es setup_indexes
python manage.py es index_database

Not sure if this will help you, but give it a try! 

Vincent


On Friday, 14 September 2018 17:32:37 UTC+2, Dale Lloyd wrote:
>
> Hi,
>
> When in -
>
> Heritage Resource Phase Type Assignment
> Heritage Resource Type
> Widget Manager
>
> And when clicking the Default Value drop down, I get 'loading failed' and 
> the following error shows in the Apache log:
>
> [Fri Sep 14 16:09:17.188339 2018] [wsgi:error] [pid 31290:tid 
> 139948209968896] Internal Server Error: /concepts/paged_dropdown
> [Fri Sep 14 16:09:17.188451 2018] [wsgi:error] [pid 31290:tid 
> 139948209968896] Traceback (most recent call last):
> [Fri Sep 14 16:09:17.188461 2018] [wsgi:error] [pid 31290:tid 
> 139948209968896]   File 
> "/opt/Projects/ENV/lib/python2.7/site-packages/django/core/handlers/exception.py",
>  
> line 41, in inner
> [Fri Sep 14 16:09:17.188467 2018] [wsgi:error] [pid 31290:tid 
> 139948209968896] response = get_response(request)
> [Fri Sep 14 16:09:17.188472 2018] [wsgi:error] [pid 31290:tid 
> 139948209968896]   File 
> "/opt/Projects/ENV/lib/python2.7/site-packages/django/core/handlers/base.py", 
> line 187, in _get_response
> [Fri Sep 14 16:09:17.188478 2018] [wsgi:error] [pid 31290:tid 
> 139948209968896] response = self.process_exception_by_middleware(e, 
> request)
> [Fri Sep 14 16:09:17.188484 2018] [wsgi:error] [pid 31290:tid 
> 139948209968896]   File 
> "/opt/Projects/ENV/lib/python2.7/site-packages/django/core/handlers/base.py", 
> line 185, in _get_response
> [Fri Sep 14 16:09:17.188490 2018] [wsgi:error] [pid 31290:tid 
> 139948209968896] response = wrapped_callback(request, *callback_args, 
> **callback_kwargs)
> [Fri Sep 14 16:09:17.188495 2018] [wsgi:error] [pid 31290:tid 
> 139948209968896]   File 
> "/opt/Projects/ENV/lib/python2.7/site-packages/arches/app/views/concept.py", 
> line 330, in paged_dropdown
> [Fri Sep 14 16:09:17.188501 2018] [wsgi:error] [pid 31290:tid 
> 139948209968896] data = [dict(zip(['conceptid', 'id', 'type', 'text', 
> 'language'], d['valueto'].values()), depth=d['depth']) for d in data]
> [Fri Sep 14 16:09:17.188507 2018] [wsgi:error] [pid 31290:tid 
> 139948209968896] AttributeError: 'NoneType' object has no attribute 'values'
> [Fri Sep 14 16:09:17.571416 2018] [wsgi:error] [pid 31290:tid 
> 139948167964416] Internal Server Error: /concepts/paged_dropdown
> [Fri Sep 14 16:09:17.571461 2018] [wsgi:error] [pid 31290:tid 
> 139948167964416] Traceback (most recent call last):
> [Fri Sep 14 16:09:17.571468 2018] [wsgi:error] [pid 31290:tid 
> 139948167964416]   File 
> "/opt/Projects/ENV/lib/python2.7/site-packages/django/core/handlers/exception.py",
>  
> line 41, in inner
> [Fri Sep 14 16:09:17.571474 2018] [wsgi:error] [pid 31290:tid 
> 139948167964416] response = get_response(request)
> [Fri Sep 14 16:09:17.571480 2018] [wsgi:error] [pid 31290:tid 
> 139948167964416]   File 
> "/opt/Projects/ENV/lib/python2.7/site-packages/django/core/handlers/base.py", 
> line 187, in _get_response
> [Fri Sep 14 16:09:17.571503 2018] [wsgi:error] [pid 31290:tid 
> 139948167964416] response = self.process_exception_by_middleware(e, 
> request)
> [Fri Sep 14 16:09:17.571509 2018] [wsgi:error] [pid 31290:tid 
> 139948167964416]   File 
> "/opt/Projects/ENV/lib/python2.7/site-packages/django/core/handlers/base.py", 
> line 185, in _get_response
> [Fri Sep 14 16:09:17.571514 2018] [wsgi:error] [pid 31290:tid 
> 139948167964416] response = wrapped_callback(request, *callback_args, 
> **callback_kwargs)
> [Fri Sep 14 16:09:17.571519 2018] [wsgi:error] [pid 31290:tid 
> 139948167964416]   File 
> "/opt/Projects/ENV/lib/python2.7/site-packages/arches/app/views/concept.py", 
> line 330, in paged_dropdown
> [Fri Sep 14 16:09:17.571524 2018] [wsgi:error] [pid 31290:tid 
> 139948167964416] data = [dict(zip(['conceptid', 'id', 'type', 'text', 
> 'language'], d['valueto'].values()), depth=d['depth']) for d in data]
> [Fri Sep 14 16:09:17.571529 2018] [wsgi:error] [pid 31290:tid 
> 139948167964416] AttributeError: 'NoneType' object has no attribute 'values'
>
> The concept collection is showing in the graph
>
> Any help greatly appreciated
>

-- 
-- To post, send email to archesproject@googlegroups.com. To unsubscribe, send 
email to archesproject+unsubscr...@googlegroups.com. For more information, 
visit https://groups.google.com/d/forum/archesproject?hl=en
--- 
You received this message because you are subscribed to the Google Groups 
"Arches Project" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to archesproject+unsubscr...@googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

[Arches] Related Resource nodes

[Vincent Meijer]

I am trying to display additional information in the Related Resources 
section of a report.
More specifically: if the related resource type has a node 
'thumbnail_image', I want to display this.

But how do I get this information? 

I already found that the information is gathered in the frontend over here: 
https://github.com/archesproject/arches/blob/a6100830bc6628b365aa1bee9a26723828bf3099/arches/app/media/js/models/report.js#L123-L132

Now I need to find out where in the backend this information is coming from.
I am currently looking in views/resources.py and models/resources.py. 
I figured the data is queried in resource.get_related_resources() in 
models/resources.py, and that the desired properties are appended in 
views/resources.py here:
https://github.com/archesproject/arches/blob/a6100830bc6628b365aa1bee9a26723828bf3099/arches/app/views/resource.py#L542-L543
 

It seems my question is twofold:
- Do I need to specify specific graph nodes in 
resource.get_related_resources() in order to send them to the frontend?
- and if so, how? Also: how do find the name of the specific node I'm after?


 Thanks!
Vincent

-- 
-- To post, send email to archesproject@googlegroups.com. To unsubscribe, send 
email to archesproject+unsubscr...@googlegroups.com. For more information, 
visit https://groups.google.com/d/forum/archesproject?hl=en
--- 
You received this message because you are subscribed to the Google Groups 
"Arches Project" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to archesproject+unsubscr...@googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

[Arches] Re: Static files performance issue

[Vincent Meijer]

Update: collectstatic has been running for almost an hour on my laptop and 
still didn't finish. 
That can't be right. Is there anybody here with a comparable setup?


On Friday, 14 September 2018 13:13:46 UTC+2, Vincent Meijer wrote:
>
> I am running into difficulties related to static files. More specifically: 
> the amount of static files.
>
> When static files are stored and collected locally on the Arches server 
> there is no real problem. 
> However, when using cloud storage such as Azure, the collectstatic command 
> takes around 4 minutes to run from a cloud server, even over 15 minutes 
> when I run it on my laptop.
>
> I noticed there are 15.000 files in my packages folder. Are there any 
> obsolete packages that we might delete to free up some space?
>

-- 
-- To post, send email to archesproject@googlegroups.com. To unsubscribe, send 
email to archesproject+unsubscr...@googlegroups.com. For more information, 
visit https://groups.google.com/d/forum/archesproject?hl=en
--- 
You received this message because you are subscribed to the Google Groups 
"Arches Project" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to archesproject+unsubscr...@googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

[Arches] Re: STEPS: Arches 3 server migration from AWS to Azure

[Vincent Meijer]

As a workaround I created this script, which renames the /packages/mapbox 
and /packages/turf folders to include their original '@':
https://github.com/globaldigitalheritage/arches-3d/blob/49-fix-static-paths/arches_3d/arches_3d/management/commands/azure_storage_service.py

Usage:
python manage.py azure_storage_service fix_static_paths



On Thursday, 13 September 2018 11:32:48 UTC+2, Vincent Meijer wrote:
>
> Usage:
>
>
> python manage.py azure_storage_service fix_static_paths
>
>
>
>
> On Thursday, 13 September 2018 11:32:48 UTC+2, Vincent Meijer wrote:
> I am currently setting up Arches in Azure and I encountered the following 
> problem:
>
>
> Uploaded static files where the original folder contains a special 
> character, e.g. '@Mapbox/', results in those folders being uploaded without 
> the special characters, e.g. 'Mapbox/'.
>
>
> I use this setting:
> STATICFILES_STORAGE = 'storages.backends.azure_storage.AzureStorage'
>
>
> And added this to my requirements.txt:
> django-storages[azure]==1.7.1
>
>
> I noticed that Joel steered clear of django-storages because it had nog 
> been updated at that time, but the projects seems to be alive and kicking 
> at the moment:
> https://github.com/jschneier/django-storages
>
> *Update*: django-storages-redux is now called django-storages:
> /web_root/ENV/local/lib/python2.7/site-packages/storages/__init__.py:9: 
> UserWarning: This library has been designated as the official successor 
> of django-storages and releases under that namespace. Please update your 
> requirements files to point to django-storages.
>
>
> Does anybody have experience with this?
>
> Thanks!
> Vincent
>
>
> On Thursday, 20 July 2017 09:39:11 UTC+2, Joel Aldor wrote:
>>
>> Another update: if you're using Azure storage, make sure you do this 
>> following install on your virtual environment:
>>
>> pip install azure-storage==0.20.0
>>
>>
>> On Sunday, March 19, 2017 at 3:33:16 PM UTC+8, Joel Aldor wrote:
>>>
>>> Good day,
>>>
>>> I will need to update this migration guide to add an important step. 
>>> Between steps #7 and #8, you need to install the Azure packages in order 
>>> for Arches to bind properly to your storage container.
>>>
>>> sudo pip install azure azure-storage azure-servicebus azure-mgmt 
>>> azure-servicemanagement-legacy
>>>
>>>
>>> Thanks,
>>>
>>> Joel
>>>
>>> On Tuesday, February 21, 2017 at 3:00:05 PM UTC+8, Joel Aldor wrote:
>>>>
>>>> Hi guys!
>>>>
>>>> If you plan to migrate from AWS to Microsoft Azure, I'm sharing to you 
>>>> these steps which I created on my own. I must admit the whole migration 
>>>> was 
>>>> pretty hard, since AWS doesn't allow you to export your Linux EC2 
>>>> instances 
>>>> to another cloud provider. But after weeks of trial and error, and lots of 
>>>> research, I'm finally able to migrate Arches completely. :)
>>>>
>>>> These steps will work, assuming your Arches is installed on an Ubuntu 
>>>> server running on an EC2 instance, and you're using S3 for your image and 
>>>> file storage.
>>>>
>>>> 1.) Launch an Ubuntu 14.04 LTS virtual machine on your Azure portal. 
>>>> Make sure your virtual machine has the same security group settings that 
>>>> you have on your AWS EC2 instance.
>>>>
>>>> 2.) Log in to your Ubuntu server, then change your root password 
>>>> sudo passwd root
>>>>
>>>> To allow remote login using root, you also need to edit the file 
>>>> /etc/ssh/sshd_config, and comment out the following line:
>>>> PermitRootLogin without-password 
>>>>
>>>> Just below it, add the following line:
>>>> PermitRootLogin yes 
>>>>
>>>> Save the file, then restart SSH:
>>>> service ssh restart
>>>>
>>>> *Note: Take note of your root password, because you will need it on 
>>>> step #6 as you go through the rsync shell script.*
>>>>
>>>> 3.) Create an Azure storage account, then launch an Azure storage 
>>>> container. Once you created the container, get the Azure container name 
>>>> and 
>>>> access key, which you will use on step #5.
>>>>
>>>> 4.) Get your AWS Access Key ID and Secret Access Key from your AWS 
>>>> Console's IAM, which you will use on step #5.
>>>>
>>>> 5.) Migrate your AWS

[Arches] Static files performance issue

[Vincent Meijer]

I am running into difficulties related to static files. More specifically: 
the amount of static files.

When static files are stored and collected locally on the Arches server 
there is no real problem. 
However, when using cloud storage such as Azure, the collectstatic command 
takes around 4 minutes to run from a cloud server, even over 15 minutes 
when I run it on my laptop.

I noticed there are 15.000 files in my packages folder. Are there any 
obsolete packages that we might delete to free up some space?

-- 
-- To post, send email to archesproject@googlegroups.com. To unsubscribe, send 
email to archesproject+unsubscr...@googlegroups.com. For more information, 
visit https://groups.google.com/d/forum/archesproject?hl=en
--- 
You received this message because you are subscribed to the Google Groups 
"Arches Project" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to archesproject+unsubscr...@googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

[Arches] Re: STEPS: Arches 3 server migration from AWS to Azure

[Vincent Meijer]

I am currently setting up Arches in Azure and I encountered the following 
problem:


Uploaded static files where the original folder contains a special 
character, e.g. '@Mapbox/', results in those folders being uploaded without 
the special characters, e.g. 'Mapbox/'.


I use this setting:
STATICFILES_STORAGE = 'storages.backends.azure_storage.AzureStorage'


And added this to my requirements.txt:
django-storages[azure]==1.7.1


I noticed that Joel steered clear of django-storages because it had nog 
been updated at that time, but the projects seems to be alive and kicking 
at the moment:
https://github.com/jschneier/django-storages


Thanks!
Vincent


On Thursday, 20 July 2017 09:39:11 UTC+2, Joel Aldor wrote:
>
> Another update: if you're using Azure storage, make sure you do this 
> following install on your virtual environment:
>
> pip install azure-storage==0.20.0
>
>
> On Sunday, March 19, 2017 at 3:33:16 PM UTC+8, Joel Aldor wrote:
>>
>> Good day,
>>
>> I will need to update this migration guide to add an important step. 
>> Between steps #7 and #8, you need to install the Azure packages in order 
>> for Arches to bind properly to your storage container.
>>
>> sudo pip install azure azure-storage azure-servicebus azure-mgmt 
>> azure-servicemanagement-legacy
>>
>>
>> Thanks,
>>
>> Joel
>>
>> On Tuesday, February 21, 2017 at 3:00:05 PM UTC+8, Joel Aldor wrote:
>>>
>>> Hi guys!
>>>
>>> If you plan to migrate from AWS to Microsoft Azure, I'm sharing to you 
>>> these steps which I created on my own. I must admit the whole migration was 
>>> pretty hard, since AWS doesn't allow you to export your Linux EC2 instances 
>>> to another cloud provider. But after weeks of trial and error, and lots of 
>>> research, I'm finally able to migrate Arches completely. :)
>>>
>>> These steps will work, assuming your Arches is installed on an Ubuntu 
>>> server running on an EC2 instance, and you're using S3 for your image and 
>>> file storage.
>>>
>>> 1.) Launch an Ubuntu 14.04 LTS virtual machine on your Azure portal. 
>>> Make sure your virtual machine has the same security group settings that 
>>> you have on your AWS EC2 instance.
>>>
>>> 2.) Log in to your Ubuntu server, then change your root password 
>>> sudo passwd root
>>>
>>> To allow remote login using root, you also need to edit the file 
>>> /etc/ssh/sshd_config, and comment out the following line:
>>> PermitRootLogin without-password 
>>>
>>> Just below it, add the following line:
>>> PermitRootLogin yes 
>>>
>>> Save the file, then restart SSH:
>>> service ssh restart
>>>
>>> *Note: Take note of your root password, because you will need it on step 
>>> #6 as you go through the rsync shell script.*
>>>
>>> 3.) Create an Azure storage account, then launch an Azure storage 
>>> container. Once you created the container, get the Azure container name and 
>>> access key, which you will use on step #5.
>>>
>>> 4.) Get your AWS Access Key ID and Secret Access Key from your AWS 
>>> Console's IAM, which you will use on step #5.
>>>
>>> 5.) Migrate your AWS S3 bucket to the new Azure storage container using 
>>> Flexify.io. Create a free account on Flexify, then launch a migration 
>>> task. I was able to migrate all my files totalling 6.5GB in just about 20 
>>> minutes.
>>>
>>> 6.) Start the server migration process from AWS EC2 to Azure using a 
>>> custom rsync shell script. Follow the pretty straightforward steps from 
>>> this link here: https://cloudnull.io/2012/07/cloud-server-migration (Go 
>>> to the section that says *Migrate using RSYNC The Easy Way *and follow 
>>> the steps there). After the migration, the new server will automatically 
>>> reboot itself.
>>>
>>> *Note: the rsync shell script uses Rackspace directory defaults, but it 
>>> worked pretty fine on me, so just hit ENTER to continue when you're 
>>> prompted to apply the default*
>>>
>>> 7.) Login to the new server, then restart Elasticsearch and Apache. By 
>>> this point, your new server is now hosting Arches, and you can already open 
>>> Arches on your browser. However it's still pointing to the old S3 bucket.
>>>
>>> 8.) Install the django-storages-redux by following the steps from here: 
>>> https://github.com/schumannd/django-storages. This is a forked 
>>> django-storages package, because the original django-storages has seen no 
>>> commit applied since March 2014, and there were errors on the AzureStorage 
>>> library.
>>>
>>> 9.) Comment out the AWS variables on settings.py and instead add these 
>>> variables:
>>>
>>> DEFAULT_FILE_STORAGE = 'storages.backends.azure_storage.AzureStorage'
>>> AZURE_ACCOUNT_NAME = ''
>>> AZURE_ACCOUNT_KEY = ''
>>> AZURE_CONTAINER = ''
>>> MEDIA_URL = '>> https://your_azure_account_name.blob.core.windows.net/your_azure_container
>>> >'
>>>
>>> 10.) Save your settings.py file, then restart your Apache server. 
>>>
>>> *And you're done! *You can now point your domain to the new Azure 
>>> virtual machine and start decommissioning your AWS 

[Arches] Extending base.htm

[Vincent Meijer]

I would like to run a require.config() call around the same time 
javascript.htm is loaded in base.htm. For this I created 
templates/config.htm in my own Arches app.

What is the recommended way of doing this? Do I need to make a copy of 
base.htm and include my templates/config.htm there?
If I do that I get this error:

RuntimeError at /searchmaximum recursion depth exceeded while calling a Python 
object

Request Method: GET
Request URL: http://localhost:8000/search
Django Version: 1.11.14
Exception Type: RuntimeError
Exception Value: maximum recursion depth exceeded while calling a Python object

Exception Location: 
/web_root/ENV/local/lib/python2.7/site-packages/django/template/base.py in 
parse, line 515
Python Executable: /web_root/ENV/bin/python
Python Version: 2.7.12
Python Path: ['/web_root/arches_3d',
 '/web_root/ENV/lib/python2.7',
 '/web_root/ENV/lib/python2.7/plat-x86_64-linux-gnu',
 '/web_root/ENV/lib/python2.7/lib-tk',
 '/web_root/ENV/lib/python2.7/lib-old',
 '/web_root/ENV/lib/python2.7/lib-dynload',
 '/usr/lib/python2.7',
 '/usr/lib/python2.7/plat-x86_64-linux-gnu',
 '/usr/lib/python2.7/lib-tk',
 '/web_root/ENV/local/lib/python2.7/site-packages',
 '/web_root/arches',
 '/web_root/ENV/lib/python2.7/site-packages',
 '/web_root/arches_3d/arches_3d']

Server time: Tue, 11 Sep 2018 07:18:23 -0500


With the following highlighted code as the culprit:

{% if use_livereload %}



I would prefer not to copy base.htm, but I can't find a way to inject my 
code. e.g. with the {% block pre_require_js %} block.

-- 
-- To post, send email to archesproject@googlegroups.com. To unsubscribe, send 
email to archesproject+unsubscr...@googlegroups.com. For more information, 
visit https://groups.google.com/d/forum/archesproject?hl=en
--- 
You received this message because you are subscribed to the Google Groups 
"Arches Project" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to archesproject+unsubscr...@googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

Re: [Arches] Fuzzy dates

[Vincent Meijer]

Thanks, i'll look into that. If anyone is already using fuzzy dates in
Arches, I would love to hear from them!

On Thu, Sep 6, 2018 at 10:41 PM Alexei Peters  wrote:

> Oops! Here's the link...
> http://www.loc.gov/standards/datetime/pre-submission.html
>
>
>
> Director of Web Development - Farallon Geographics, Inc. - 971.227.3173
>
> On Thu, Sep 6, 2018 at 11:36 AM, Alexei Peters  wrote:
>
>> Hi Vincent,
>> Here's a link to the EDTF proposal.  It has a bunch of examples of EDTF
>> strings and what they mean and how they should be interpreted.
>> -Alexei
>>
>>
>> Director of Web Development - Farallon Geographics, Inc. - 971.227.3173
>>
>> On Thu, Sep 6, 2018 at 3:12 AM, Vincent Meijer 
>> wrote:
>>
>>> Since Arches 4.2 fuzzy dates are supported. I am looking for a few
>>> pointers on how this works and how to use them.
>>>
>>> Thanks!
>>>
>>> --
>>> -- To post, send email to archesproject@googlegroups.com. To
>>> unsubscribe, send email to archesproject+unsubscr...@googlegroups.com.
>>> For more information, visit
>>> https://groups.google.com/d/forum/archesproject?hl=en
>>> ---
>>> You received this message because you are subscribed to the Google
>>> Groups "Arches Project" group.
>>> To unsubscribe from this group and stop receiving emails from it, send
>>> an email to archesproject+unsubscr...@googlegroups.com.
>>> For more options, visit https://groups.google.com/d/optout.
>>>
>>
>>
>

-- 
-- To post, send email to archesproject@googlegroups.com. To unsubscribe, send 
email to archesproject+unsubscr...@googlegroups.com. For more information, 
visit https://groups.google.com/d/forum/archesproject?hl=en
--- 
You received this message because you are subscribed to the Google Groups 
"Arches Project" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to archesproject+unsubscr...@googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

Re: [Arches] Resource Model does not import

[Vincent Meijer]

Hooray! It was indeed the reference to report templates. After deleting 
those it worked. Thanks!

I do have a custom template, but I can't find the documentation to 
register/activate it. 
It doesn't show up where I select reports in the Resource Editor.

This one is empty: https://arches.readthedocs.io/en/stable/create-report/ 

[image: Reports.PNG] 





On Wednesday, 5 September 2018 20:00:17 UTC+2, Adam Cox wrote:
>
> Ah, I see you already had :)
>
> When I first imported I got a ReportTemplate matching query does not 
> exist error, but when I deleted the report section from the graph and 
> tried again, it worked correctly... so maybe it's something on your end? 
> Good luck!
>
> Adam
>
> On Wed, Sep 5, 2018 at 12:35 PM, Vincent Meijer  > wrote:
>
>> You betcha: 
>> https://github.com/globaldigitalheritage/arches-3d/blob/testing-file-resource-import/arches_3d/arches_3d/db/graphs/resource_models/File%20(set).json
>>
>> On Wednesday, 5 September 2018 19:16:44 UTC+2, Adam Cox wrote:
>>>
>>> Oh that's strange! Would you be able to share the json file here so 
>>> others could try importing it?
>>>
>>> On Wed, Sep 5, 2018 at 12:07 PM, Vincent Meijer  
>>> wrote:
>>>
>>>> That would make sense indeed. However, I removed all references to 
>>>> functions and I still can't import the resource model. 
>>>>
>>>> Function section of the json now looks like this:
>>>> "functions_x_graphs": [],
>>>>
>>>>
>>>>
>>>> On Wednesday, 5 September 2018 18:23:22 UTC+2, Adam Cox wrote:
>>>>>
>>>>> Hi Vincent, this means that the graph references a function that 
>>>>> doesn't exist in your database. My guess is that this is the file upload 
>>>>> function, in your Information Resource graph. I'd recommend going into 
>>>>> the 
>>>>> json directly and removing the association with this function, and then 
>>>>> trying to import again.
>>>>>
>>>>> Adam
>>>>>
>>>>> On Wed, Sep 5, 2018 at 10:13 AM, Vincent Meijer  
>>>>> wrote:
>>>>>
>>>>>> I am trying to revive my Arches 4.0 graphs. All of them import fine, 
>>>>>> except this one:
>>>>>>
>>>>>> https://github.com/globaldigitalheritage/arches-3d/blob/master/arches_3d/arches_3d/db/graphs/resource_models/File%20(set).json
>>>>>>
>>>>>>
>>>>>>
>>>>>> When I import it in the browser nothing happens. When I run 
>>>>>> python manage.py packages -o import_graphs
>>>>>>
>>>>>> I see this output:
>>>>>> arches   | operation: import_graphs
>>>>>> arches   | creating index : arches_3d_resource/ccbd1537-ac5e-
>>>>>> 11e6-84a5-026d961c88e6
>>>>>> arches   | creating index : arches_3d_resource/99417385-b8fa-
>>>>>> 11e6-84a5-026d961c88e6
>>>>>> arches   | creating index : arches_3d_resource/64ae35a0-2b53-
>>>>>> 11e7-9130-0242ac140004
>>>>>> arches   | Function matching query does not exist.
>>>>>> arches   | creating index : arches_3d_resource/3854b1f2-14a9-
>>>>>> 11e7-b06e-0242ac150005
>>>>>> arches   | creating index : arches_3d_resource/fad0563b-b8f8-
>>>>>> 11e6-84a5-026d961c88e6
>>>>>> arches   | creating index : arches_3d_resource/f5624ce7-b66c-
>>>>>> 11e6-84a5-026d961c88e6
>>>>>> arches   | creating index : arches_3d_resource/243f8689-b8f6-
>>>>>> 11e6-84a5-026d961c88e6
>>>>>>
>>>>>> What could this be?
>>>>>>
>>>>>> Thanks!
>>>>>> Vincent
>>>>>>
>>>>>> -- 
>>>>>> -- To post, send email to arches...@googlegroups.com. To 
>>>>>> unsubscribe, send email to archesprojec...@googlegroups.com. For 
>>>>>> more information, visit 
>>>>>> https://groups.google.com/d/forum/archesproject?hl=en
>>>>>> --- 
>>>>>> You received this message because you are subscribed to the Google 
>>>>>> Groups "Arches Project" group.
>>>>>> To unsubscribe from this group and stop receiving emails from it, 
>>>>>> send an email to

Re: [Arches] Resource Model does not import

[Vincent Meijer]

You 
betcha: 
https://github.com/globaldigitalheritage/arches-3d/blob/testing-file-resource-import/arches_3d/arches_3d/db/graphs/resource_models/File%20(set).json

On Wednesday, 5 September 2018 19:16:44 UTC+2, Adam Cox wrote:
>
> Oh that's strange! Would you be able to share the json file here so others 
> could try importing it?
>
> On Wed, Sep 5, 2018 at 12:07 PM, Vincent Meijer  > wrote:
>
>> That would make sense indeed. However, I removed all references to 
>> functions and I still can't import the resource model. 
>>
>> Function section of the json now looks like this:
>> "functions_x_graphs": [],
>>
>>
>>
>> On Wednesday, 5 September 2018 18:23:22 UTC+2, Adam Cox wrote:
>>>
>>> Hi Vincent, this means that the graph references a function that doesn't 
>>> exist in your database. My guess is that this is the file upload function, 
>>> in your Information Resource graph. I'd recommend going into the json 
>>> directly and removing the association with this function, and then trying 
>>> to import again.
>>>
>>> Adam
>>>
>>> On Wed, Sep 5, 2018 at 10:13 AM, Vincent Meijer  
>>> wrote:
>>>
>>>> I am trying to revive my Arches 4.0 graphs. All of them import fine, 
>>>> except this one:
>>>>
>>>> https://github.com/globaldigitalheritage/arches-3d/blob/master/arches_3d/arches_3d/db/graphs/resource_models/File%20(set).json
>>>>
>>>>
>>>>
>>>> When I import it in the browser nothing happens. When I run 
>>>> python manage.py packages -o import_graphs
>>>>
>>>> I see this output:
>>>> arches   | operation: import_graphs
>>>> arches   | creating index : arches_3d_resource/ccbd1537-ac5e-
>>>> 11e6-84a5-026d961c88e6
>>>> arches   | creating index : arches_3d_resource/99417385-b8fa-
>>>> 11e6-84a5-026d961c88e6
>>>> arches   | creating index : arches_3d_resource/64ae35a0-2b53-
>>>> 11e7-9130-0242ac140004
>>>> arches   | Function matching query does not exist.
>>>> arches   | creating index : arches_3d_resource/3854b1f2-14a9-
>>>> 11e7-b06e-0242ac150005
>>>> arches   | creating index : arches_3d_resource/fad0563b-b8f8-
>>>> 11e6-84a5-026d961c88e6
>>>> arches   | creating index : arches_3d_resource/f5624ce7-b66c-
>>>> 11e6-84a5-026d961c88e6
>>>> arches   | creating index : arches_3d_resource/243f8689-b8f6-
>>>> 11e6-84a5-026d961c88e6
>>>>
>>>> What could this be?
>>>>
>>>> Thanks!
>>>> Vincent
>>>>
>>>> -- 
>>>> -- To post, send email to arches...@googlegroups.com. To unsubscribe, 
>>>> send email to archesprojec...@googlegroups.com. For more information, 
>>>> visit https://groups.google.com/d/forum/archesproject?hl=en
>>>> --- 
>>>> You received this message because you are subscribed to the Google 
>>>> Groups "Arches Project" group.
>>>> To unsubscribe from this group and stop receiving emails from it, send 
>>>> an email to archesprojec...@googlegroups.com.
>>>> For more options, visit https://groups.google.com/d/optout.
>>>>
>>>
>>> -- 
>> -- To post, send email to arches...@googlegroups.com . To 
>> unsubscribe, send email to archesprojec...@googlegroups.com . 
>> For more information, visit 
>> https://groups.google.com/d/forum/archesproject?hl=en
>> --- 
>> You received this message because you are subscribed to the Google Groups 
>> "Arches Project" group.
>> To unsubscribe from this group and stop receiving emails from it, send an 
>> email to archesprojec...@googlegroups.com .
>> For more options, visit https://groups.google.com/d/optout.
>>
>
>

-- 
-- To post, send email to archesproject@googlegroups.com. To unsubscribe, send 
email to archesproject+unsubscr...@googlegroups.com. For more information, 
visit https://groups.google.com/d/forum/archesproject?hl=en
--- 
You received this message because you are subscribed to the Google Groups 
"Arches Project" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to archesproject+unsubscr...@googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

Re: [Arches] Resource Model does not import

[Vincent Meijer]

That would make sense indeed. However, I removed all references to 
functions and I still can't import the resource model. 

Function section of the json now looks like this:
"functions_x_graphs": [],



On Wednesday, 5 September 2018 18:23:22 UTC+2, Adam Cox wrote:
>
> Hi Vincent, this means that the graph references a function that doesn't 
> exist in your database. My guess is that this is the file upload function, 
> in your Information Resource graph. I'd recommend going into the json 
> directly and removing the association with this function, and then trying 
> to import again.
>
> Adam
>
> On Wed, Sep 5, 2018 at 10:13 AM, Vincent Meijer  > wrote:
>
>> I am trying to revive my Arches 4.0 graphs. All of them import fine, 
>> except this one:
>>
>> https://github.com/globaldigitalheritage/arches-3d/blob/master/arches_3d/arches_3d/db/graphs/resource_models/File%20(set).json
>>
>>
>>
>> When I import it in the browser nothing happens. When I run 
>> python manage.py packages -o import_graphs
>>
>> I see this output:
>> arches   | operation: import_graphs
>> arches   | creating index : arches_3d_resource/ccbd1537-ac5e-11e6
>> -84a5-026d961c88e6
>> arches   | creating index : arches_3d_resource/99417385-b8fa-11e6
>> -84a5-026d961c88e6
>> arches   | creating index : arches_3d_resource/64ae35a0-2b53-11e7
>> -9130-0242ac140004
>> arches   | Function matching query does not exist.
>> arches   | creating index : arches_3d_resource/3854b1f2-14a9-11e7
>> -b06e-0242ac150005
>> arches   | creating index : arches_3d_resource/fad0563b-b8f8-11e6
>> -84a5-026d961c88e6
>> arches   | creating index : arches_3d_resource/f5624ce7-b66c-11e6
>> -84a5-026d961c88e6
>> arches   | creating index : arches_3d_resource/243f8689-b8f6-11e6
>> -84a5-026d961c88e6
>>
>> What could this be?
>>
>> Thanks!
>> Vincent
>>
>> -- 
>> -- To post, send email to arches...@googlegroups.com . To 
>> unsubscribe, send email to archesprojec...@googlegroups.com . 
>> For more information, visit 
>> https://groups.google.com/d/forum/archesproject?hl=en
>> --- 
>> You received this message because you are subscribed to the Google Groups 
>> "Arches Project" group.
>> To unsubscribe from this group and stop receiving emails from it, send an 
>> email to archesprojec...@googlegroups.com .
>> For more options, visit https://groups.google.com/d/optout.
>>
>
>

-- 
-- To post, send email to archesproject@googlegroups.com. To unsubscribe, send 
email to archesproject+unsubscr...@googlegroups.com. For more information, 
visit https://groups.google.com/d/forum/archesproject?hl=en
--- 
You received this message because you are subscribed to the Google Groups 
"Arches Project" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to archesproject+unsubscr...@googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

[Arches] Re: Marking the day - 5 years of open sharing of Arches expertise

[Vincent Meijer]

+1 Gefeliciteerd!

On Wednesday, 22 August 2018 17:03:21 UTC+2, Edmund Lee wrote:
>
> Hey everybody,
>
> We reach what feels like an important milestone today - 5 years since the 
> Arches Project Google group was opened up as a public resource. If you dig 
> into the message archive you'll see that the group first started up a year 
> or more before that, following a project meeting hosted by the Getty in LA 
> in June 2012. But from 22nd August 2013 this group was open up for everyone 
> with an interest in the Arches software.
>
> It's a day to acknowledge the sharing of expertise, and the attention 
> given by 400+ members from pretty much every continent (don't think there's 
> an Arches installation in Antarctica... yet) talking about 600+ different 
> topics.
>
> I say "Happy Birthday", "Feliz Compleanos", "Eid milad said", "Bon 
> Anniversaire", "alles Gute zum Geburtstag"  Arches experts! ( ...and 
> please do add your own translation...)
>
> Ed
>

-- 
-- To post, send email to archesproject@googlegroups.com. To unsubscribe, send 
email to archesproject+unsubscr...@googlegroups.com. For more information, 
visit https://groups.google.com/d/forum/archesproject?hl=en
--- 
You received this message because you are subscribed to the Google Groups 
"Arches Project" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to archesproject+unsubscr...@googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

[Arches] Re: Arches v4 demo now available

[Vincent Meijer]

+1 !

On Friday, 18 May 2018 20:42:45 UTC+2, Annabel Enriquez wrote:
>
> The new Arches Version 4 demonstration site is now available! It features 
> a new time wheel date visualization tool, advanced search, enhanced related 
> resources display, the ability to record and search fuzzy dates, and more! 
> For additional information, including how to access it, visit: 
> https://www.archesproject.org/demo
>
> Annabel
> For the Arches Team
>

-- 
-- To post, send email to archesproject@googlegroups.com. To unsubscribe, send 
email to archesproject+unsubscr...@googlegroups.com. For more information, 
visit https://groups.google.com/d/forum/archesproject?hl=en
--- 
You received this message because you are subscribed to the Google Groups 
"Arches Project" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to archesproject+unsubscr...@googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

[Arches] Re: Arches 4: Report map javascript errors

[Vincent Meijer]

Not seeing this issue anymore, closing... 

On Friday, October 6, 2017 at 3:49:19 PM UTC+2, Vincent Meijer wrote:
>
> I am seeing these errors when loading a resource report with the map 
> report template (in both Chrome and Firefox):
>
> Deprecated include of L.Mixin.Events: this property will be removed in 
> future releases, please inherit from L.Evented instead. y@https://
> demo.usfcvast.org/database/media/bower_components/leaflet/dist/leaflet.js:1:2054
> v.extend@https://
> demo.usfcvast.org/database/media/bower_components/leaflet/dist/leaflet.js:1:15082
> @https://
> demo.usfcvast.org/database/media/bower_components/leaflet-draw/dist/leaflet.draw.js:8:2203
> @https://
> demo.usfcvast.org/database/media/bower_components/leaflet-draw/dist/leaflet.draw.js:8:2
>   Class.js:121:3
>
>
> TypeError: can't define property "segmentsIntersect": Object is not 
> extensible[Learn More]  Util.js:15:3
>
>
> Error: Unable to process binding "if: function(){return !configForm  && 
> state ==='form' }"
> Message: Unable to process binding "foreach: function(){return { 
> data:[$data],as:'self'} }"
> Message: Unable to process binding "component: function(){return {
> name:geocodeProviderDetails.component,params:{
> 
> placeholder:geocodePlaceholder,map:map,anchorLayerId:anchorLayerId,api_key:geocodeProviderDetails.api_key,geocodeProvider:geocodeProvider}}
>  
> }"
> Message: No component name specified
>
>
>
> I only see the first two errors when loading a report that has no map 
> header (but e.g. an image or no header).
>
>
> Thoughts? Thanks!
> Vincent 
>

-- 
-- To post, send email to archesproject@googlegroups.com. To unsubscribe, send 
email to archesproject+unsubscr...@googlegroups.com. For more information, 
visit https://groups.google.com/d/forum/archesproject?hl=en
--- 
You received this message because you are subscribed to the Google Groups 
"Arches Project" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to archesproject+unsubscr...@googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

Re: [Arches] Disallowed host

[Vincent Meijer]

For future reference (but not yet directly relevant for Andy's use case):

If you run AWS EC2 instances behind an Elastic Load Balancer, you also need 
to add the EC2 instance's private IP (and potentially its public hostname) 
to the ALLOWED_HOSTS setting.
This is because the load balancer uses the private IP to address your EC2 
instances for health checks, instead of the hostname you chose.

Here is how to do that. Simply add this to your settings.py:

# Fix for AWS ELB returning false bad health: ELB contacts EC2 instances 
through their private ip.
# An AWS service is called to get this private IP of the current EC2 node. 
Then the IP is added to ALLOWS_HOSTS so that Django answers to it.
EC2_PRIVATE_IP = None
try:
EC2_PRIVATE_IP = requests.get(
'http://169.254.169.254/latest/meta-data/local-ipv4', timeout=0.01).text
except requests.exceptions.RequestException:
pass
if EC2_PRIVATE_IP:
ALLOWED_HOSTS.append(EC2_PRIVATE_IP)
EC2_PUBLIC_HOSTNAME = None
try:
EC2_PUBLIC_HOSTNAME = requests.get(
'http://169.254.169.254/latest/meta-data/public-hostname', timeout=0.01
).text
except requests.exceptions.RequestException:
pass
if EC2_PUBLIC_HOSTNAME:
ALLOWED_HOSTS.append(EC2_PUBLIC_HOSTNAME)



On Wednesday, 8 November 2017 12:42:58 UTC-5, Adam Cox wrote:
>
> Hey Andy, that's great, glad to hear it's working well. Good note about 
> the Projects folder too. It is a small detail, but could trip someone up 
> for a minute if they are looking for an exact replica of the installation 
> instructions.
>
> Adam
>
> On Wed, Nov 8, 2017 at 10:53 AM, Andy Graham  > wrote:
>
>> Thanks much Adam, very helpful.
>>
>> The AMI worked great and didn't have any issues once I updated.  Only 
>> thing I would point out is that the AMI doesn't nest the arches and ENV 
>> folder in a Projects folder as recommended in the installation 
>> instructions.  Not that big of a deal, just thought I would point it out.  
>> Once again, thanks for the help.
>>
>> Andy 
>>
>> On Tuesday, November 7, 2017 at 4:26:38 PM UTC-8, Adam Cox wrote:
>>>
>>> Hey Andy, great question. ALLOWED_HOSTS is actually a variable that you 
>>> can define in your settings.py or settings_local.py file. It should be a 
>>> list, so something like
>>>
>>> ALLOWED_HOSTS = ["12.34.56.78","arches4.andygraham.com"]
>>>
>>> would be a valid entry. You can also use ["*"] to allow all hosts. Not 
>>> recommended for production of course, but could get past a the problem in a 
>>> pinch if you ip or domain is changing a lot...
>>>
>>> I am glad to hear you were able to use that AMI. I made it a while ago, 
>>> so it could probably stand some updates. Let me know if you find any 
>>> problems with dependencies and such.
>>>
>>> Adam
>>>
>>> On Nov 7, 2017 4:53 PM, "Andy Graham"  wrote:
>>>
 Attempted to install Arch V4 to test out some of the features.  Set up 
 an instance on AWS, downloaded the Arches 4 community instance that I 
 think 
 Adam put up there a while ago.  Once that was set up I went through and 
 and 
 followed the Developer Installation instruction to make sure everything 
 was 
 up to date and set up correctly.  I then ran the runsever command, went to 
 the website (public IP:8000) and got an error page that said 
 "DisallowedHost at /Invalid HTTP_HOST header: 'xx.xx.xx.xx.:8000'. You 
 may need to add u'xx.xx.xx.xx' to ALLOWED_HOSTS.", with the xx as my 
 public 
 IP.  Based on additional information I went to the request.py file in 
 ENV/lib/python2.7/site-packages/django/http and edited the "allowed_hosts" 
 on line 102 to include my IP.  Everything worked fine after that but I am 
 guessing that this isn't standard protocol.  Any suggestions on what I did 
 wrong and how to fix it so I don't have to add that info when spin up 
 another instance?  Thanks.

 Andy

 -- 
 -- To post, send email to arches...@googlegroups.com. To unsubscribe, 
 send email to archesprojec...@googlegroups.com. For more information, 
 visit https://groups.google.com/d/forum/archesproject?hl=en
 --- 
 You received this message because you are subscribed to the Google 
 Groups "Arches Project" group.
 To unsubscribe from this group and stop receiving emails from it, send 
 an email to archesprojec...@googlegroups.com.
 For more options, visit https://groups.google.com/d/optout.

>>> -- 
>> -- To post, send email to arches...@googlegroups.com . To 
>> unsubscribe, send email to archesprojec...@googlegroups.com . 
>> For more information, visit 
>> https://groups.google.com/d/forum/archesproject?hl=en
>> --- 
>> You received this message because you are subscribed to the Google Groups 
>> "Arches Project" group.
>> To unsubscribe from this group and stop receiving emails from it, send an 
>> email to archesprojec...@googlegroups.com .
>> For more options, visit https://groups.google.com/d/optout.
>>
>
>

-- 
-- 

Re: [Arches] Re: Is Arches suitable for this project ?

[Vincent Meijer]

Hi David,

Sorry again for the late response :)
I answered Roshans questions on the forum:
https://groups.google.com/forum/#!topic/archesproject/v02grD04ofc

I don't mind if you give him my email address at all, however it would be
more helpful for others to have these discussions on the forum.
That way people with similar problems/questions can read them, and other
people from the Arches team can chip in with their knowledge.

Anyway, thanks for reaching out!

Vincent

On Sun, Nov 19, 2017 at 2:35 PM, Vincent Meijer <meijer.vinc...@gmail.com>
wrote:

> Hello Roshan,
>
> Until recently I worked for CVAST and set up an initial (albeit
> unfinished) first version of Arches for our 3D cultural heritage data.
> What I did for our 3D models was set up the 3D web viewer called 3D HOP as
> a plugin in Arches reports (a.k.a. detail page for heritage resource).
> I am currently quite busy (moving oversees back to Europe), but I plan to
> create a more detailed write-up of how I did that.
>
> In the meantime:
> 3D HOP: http://vcg.isti.cnr.it/3dhop/
> For the best results, convert your 3D models to the Nexus (.nxs) format:
> http://vcg.isti.cnr.it/nexus/
> I read (but have not tested) that the .nxs format can also handle point
> clouds, which will come in handy for your heritage site models.
>
> Our Arches project source code: https://github.com/cvast/cvast-arches
> In particular:
>  - Html templates: https://github.com/cvast/cvast-arches/tree/master
> /cvast_arches/cvast_arches/templates/views
>  - Javascript: https://github.com/cvast/cvast-arches/tree/maste
> r/cvast_arches/cvast_arches/media/js
>  - Django migration: https://github.com/cvast/cvast-arches/blob/master
> /cvast_arches/cvast_arches/migrations/0001_report_template.py
>
>
>
> For documenting the 3D scans I had the following in mind:
> - Activity Resource: Describes the project in general (e.g. a field trip
> of a month or a long-term project of scanning in a particular
> area/country).
> - Digitization Event: More detailed, short-term documentation of the 'how'
> and 'when' of the scan sessions. With this you can e.g. document settings
> in your scanners (to show how you created your 3D models) and also when
> exactly you made the scan (mostly useful for yourself).
> - Architectural Resource: Documents sites, buildings, etc.
> - Heritage Object: Documents 'portable' heritage objects
> - File (set): The actual 3D model. This is where you upload the file and
> record e.g. the file type and if it's a mesh or a point cloud.
>
>
> <https://lh3.googleusercontent.com/-r4HTJcgb0-k/WhHXi1A5NgI/CE4/5quVbjZ_63ktFbqqHMDR75PvvRfmZ_7SACLcBGAs/s1600/Digitization%2BEvent.PNG>
>
>
>
>
> As for your first question: yes I think Arches is definitely worth your
> while.
> I would *strongly* recommend, though, to use Arches v4 instead of v3.
>
> Regarding importing: it is definitely possible to import your data.
> The process is described here: http://arches4.readthedocs.io/
> en/latest/import-export/
> Personally I prefer to do a migration like this manually, ie. without
> import scripts, just entering the data through the web frontend.
> It gives more control and when the dataset is not too large it can be
> faster than learning how to prepare the automated import.
>
> Regarding Dublin Core, it can definitely be mapped to CIDOC CRM. The
> latter is quite more complex, but here is a useful article on how to map
> the two:
> dcpapers.dublincore.org/pubs/article/download/3779/1969
> More details (if required, but might make things overly complicated):
> http://www.cidoc-crm.org/Resources/the-dublin-core-element-set
>
>
> And finally: suggestions. My pitfall was that I wanted to make things too
> perfect and complete right from the start.
> It's important here to take things in small steps, otherwise it can be
> overwhelming. For example: start with creating just the File (set) resource
> model.
> This is the bare minimum to publish your 3D models to the world. The
> metadata describing the site (e.g. Architectural Resource) and the scanning
> process (Digitization Event) can follow later.
>
>
> I hope this helps and I'll be in touch soon with a more detailed write-up
> regarding 3D HOP!
>
> Vincent
>
>
> On Friday, 17 November 2017 07:54:02 UTC-5, Roshan Bhurtha wrote:
>>
>> Thanks Dennis.  I already had a look at the CVAST project. Impressive.
>>
>> Warm regards
>> Roshan
>>
>> On Wednesday, 15 November 2017 19:47:31 UTC+2, Dennis Wuthrich wrote:
>>>
>>> Hi Roshan,
>>>
>>> I'm aware of at least 2 projects that use Arches in a way very similar
>>> to your description:
>>> http://www.earlywatercraft.org/index.ht

[Arches] Re: Is Arches suitable for this project ?

[Vincent Meijer]

Hello Roshan,

Until recently I worked for CVAST and set up an initial (albeit unfinished) 
first version of Arches for our 3D cultural heritage data. 
What I did for our 3D models was set up the 3D web viewer called 3D HOP as 
a plugin in Arches reports (a.k.a. detail page for heritage resource). 
I am currently quite busy (moving oversees back to Europe), but I plan to 
create a more detailed write-up of how I did that.

In the meantime: 
3D HOP: http://vcg.isti.cnr.it/3dhop/ 
For the best results, convert your 3D models to the Nexus (.nxs) format: 
http://vcg.isti.cnr.it/nexus/ 
I read (but have not tested) that the .nxs format can also handle point 
clouds, which will come in handy for your heritage site models.

Our Arches project source code: https://github.com/cvast/cvast-arches
In particular:
 - Html templates: 
https://github.com/cvast/cvast-arches/tree/master/cvast_arches/cvast_arches/templates/views
 - Javascript: 
https://github.com/cvast/cvast-arches/tree/master/cvast_arches/cvast_arches/media/js
 
 - Django migration: 
https://github.com/cvast/cvast-arches/blob/master/cvast_arches/cvast_arches/migrations/0001_report_template.py



For documenting the 3D scans I had the following in mind:
- Activity Resource: Describes the project in general (e.g. a field trip of 
a month or a long-term project of scanning in a particular area/country). 
- Digitization Event: More detailed, short-term documentation of the 'how' 
and 'when' of the scan sessions. With this you can e.g. document settings 
in your scanners (to show how you created your 3D models) and also when 
exactly you made the scan (mostly useful for yourself).
- Architectural Resource: Documents sites, buildings, etc.
- Heritage Object: Documents 'portable' heritage objects
- File (set): The actual 3D model. This is where you upload the file and 
record e.g. the file type and if it's a mesh or a point cloud. 






As for your first question: yes I think Arches is definitely worth your 
while. 
I would *strongly* recommend, though, to use Arches v4 instead of v3.
 
Regarding importing: it is definitely possible to import your data. 
The process is described here: 
http://arches4.readthedocs.io/en/latest/import-export/
Personally I prefer to do a migration like this manually, ie. without 
import scripts, just entering the data through the web frontend. 
It gives more control and when the dataset is not too large it can be 
faster than learning how to prepare the automated import.

Regarding Dublin Core, it can definitely be mapped to CIDOC CRM. The latter 
is quite more complex, but here is a useful article on how to map the two:
dcpapers.dublincore.org/pubs/article/download/3779/1969 
More details (if required, but might make things overly complicated): 
http://www.cidoc-crm.org/Resources/the-dublin-core-element-set


And finally: suggestions. My pitfall was that I wanted to make things too 
perfect and complete right from the start. 
It's important here to take things in small steps, otherwise it can be 
overwhelming. For example: start with creating just the File (set) resource 
model. 
This is the bare minimum to publish your 3D models to the world. The 
metadata describing the site (e.g. Architectural Resource) and the scanning 
process (Digitization Event) can follow later. 


I hope this helps and I'll be in touch soon with a more detailed write-up 
regarding 3D HOP!

Vincent


On Friday, 17 November 2017 07:54:02 UTC-5, Roshan Bhurtha wrote:
>
> Thanks Dennis.  I already had a look at the CVAST project. Impressive. 
>
> Warm regards
> Roshan
>
> On Wednesday, 15 November 2017 19:47:31 UTC+2, Dennis Wuthrich wrote:
>>
>> Hi Roshan,
>>
>> I'm aware of at least 2 projects that use Arches in a way very similar to 
>> your description:
>> http://www.earlywatercraft.org/index.htm (using Arches v3)
>> CVAST (https://cvast.usf.edu/news/)
>>
>> Hope this points you in the proper direction.
>>
>> -Dennis
>>
>> On Monday, November 13, 2017 at 3:03:39 AM UTC-8, Roshan Bhurtha wrote:
>>>
>>> Dear Forum users, 
>>>
>>> I have a couple of questions regarding the applicability of Arches to 
>>> our spatial heritage documentation project. I want to know if you think, 
>>> Arches is overkill or not applicable for our project.
>>>
>>> Website: www.zamaniproject.org
>>>
>>> Our team documents heritage sites and creates associated metadata using 
>>> the Dublin Core Standards. 
>>>
>>> We create 
>>>
>>>1. 
>>>
>>>High resolution 3D models using laser scans (textured & untextured)
>>>2. 
>>>
>>>Plans & sections derived from the laser scans
>>>3. 
>>>
>>>GIS’s of the sites
>>>4. 
>>>
>>>Full dome Panoramas
>>>5. 
>>>
>>>Collection of Casual photos
>>>6. 
>>>
>>>Drone imagery
>>>
>>>
>>> I would like to use Arches to make our data more 

[Arches] Re: Arches v4 on Windows 10 running issue

[Vincent Meijer]

Hi Riccardo,

Perhaps a bit too obvious, but are you sure you typed the password 
correctly?

Also, have you tried the default password 'postgres' ?

Best,
Vincent


On Monday, 16 October 2017 14:58:00 UTC-4, Riccardo Giovanelli wrote:
>
> Good Evening,
> I followed the installation guide step by step and after multiple errors 
> I've got to get through to the final stage.
> Unfortunately, Step 8 stops me, with a final error of "autentication 
> password failed for user "postgres".
> And I can't get though this.
> Can somebody help me? Thanx
>
>
> (ENV) C:\Projects\arches>python manage.py runserver
> Performing system checks...
>
> System check identified no issues (0 silenced).
> Unhandled exception in thread started by  0x04F177B8>
> Traceback (most recent call last):
>   File "C:\Projects\ENV\lib\site-packages\django\utils\autoreload.py", 
> line 226, in wrapper
> fn(*args, **kwargs)
>   File 
> "C:\Projects\ENV\lib\site-packages\django\core\management\commands\runserver.py",
>  
> line 117, in inner_run
> self.check_migrations()
>   File 
> "C:\Projects\ENV\lib\site-packages\django\core\management\commands\runserver.py",
>  
> line 163, in check_migrations
> executor = MigrationExecutor(connections[DEFAULT_DB_ALIAS])
>   File 
> "C:\Projects\ENV\lib\site-packages\django\db\migrations\executor.py", line 
> 20, in __init__
> self.loader = MigrationLoader(self.connection)
>   File "C:\Projects\ENV\lib\site-packages\django\db\migrations\loader.py", 
> line 49, in __init__
> self.build_graph()
>   File "C:\Projects\ENV\lib\site-packages\django\db\migrations\loader.py", 
> line 176, in build_graph
> self.applied_migrations = recorder.applied_migrations()
>   File 
> "C:\Projects\ENV\lib\site-packages\django\db\migrations\recorder.py", line 
> 65, in applied_migrations
> self.ensure_schema()
>   File 
> "C:\Projects\ENV\lib\site-packages\django\db\migrations\recorder.py", line 
> 52, in ensure_schema
> if self.Migration._meta.db_table in 
> self.connection.introspection.table_names(self.connection.cursor()):
>   File 
> "C:\Projects\ENV\lib\site-packages\django\db\backends\base\base.py", line 
> 231, in cursor
> cursor = self.make_debug_cursor(self._cursor())
>   File 
> "C:\Projects\ENV\lib\site-packages\django\db\backends\base\base.py", line 
> 204, in _cursor
> self.ensure_connection()
>   File 
> "C:\Projects\ENV\lib\site-packages\django\db\backends\base\base.py", line 
> 199, in ensure_connection
> self.connect()
>   File "C:\Projects\ENV\lib\site-packages\django\db\utils.py", line 95, in 
> __exit__
> six.reraise(dj_exc_type, dj_exc_value, traceback)
>   File 
> "C:\Projects\ENV\lib\site-packages\django\db\backends\base\base.py", line 
> 199, in ensure_connection
> self.connect()
>   File 
> "C:\Projects\ENV\lib\site-packages\django\db\backends\base\base.py", line 
> 171, in connect
> self.connection = self.get_new_connection(conn_params)
>   File 
> "C:\Projects\ENV\lib\site-packages\django\db\backends\postgresql\base.py", 
> line 175, in get_new_connection
> connection = Database.connect(**conn_params)
>   File "C:\Projects\ENV\lib\site-packages\psycopg2\__init__.py", line 130, 
> in connect
> conn = _connect(dsn, connection_factory=connection_factory, **kwasync)
> django.db.utils.OperationalError: FATALE:  autenticazione con password 
> fallita per l'utente "postgres"
>
>

-- 
-- To post, send email to archesproject@googlegroups.com. To unsubscribe, send 
email to archesproject+unsubscr...@googlegroups.com. For more information, 
visit https://groups.google.com/d/forum/archesproject?hl=en
--- 
You received this message because you are subscribed to the Google Groups 
"Arches Project" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to archesproject+unsubscr...@googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

[Arches] Re: Arches 4.0.1 released

[Vincent Meijer]

Yay! Congratulations :D

On Monday, 16 October 2017 14:21:39 UTC-4, Alexei Peters wrote:
>
> *Arches 4.0.1 released!*
>
> The Arches team has been busy trying to improve Arches and fix a several 
> bugs as well.
> Below you'll find a listing of all the changes that are included in the 
> latest release.
>
> Some of the highlights:
> - Added advanced search capability
> - Added the ability to import shapefiles into Arches
> - Containerized Arches with Docker ([readme](
> https://github.com/archesproject/arches/blob/master/docker/Readme.md))  - 
> Thanks to Vincent Meijer!
> - Several performance improvements
> - Many small improvements to the RDM
> - Upgraded to Postgres 9.6
> - Many other small improvements
>
> *Upgrading Postgres*
> Because of the upgrade to Postgres 9.6, users will have to install 
> Postgres 9.6 and migrate any Arches databases to the 9.6 version.  Be aware 
> that multiple versions of Postgres can be run simultaneously on different 
> ports, so users can maintain their older versions of the Arches database 
> until they are satisfied that the migration was successful.  Using the 
> backup/restore options with PgAdmin4 is probably the easiest way to perform 
> the upgrade.
>
> *Upgrading Arches*
> Users are encouraged to update at their earliest convenience.  Completely 
> re-installing Arches is the easiest way to accomplish this.
>
> If you can't completely re-install Arches (because you have data in the 
> system that you want to preserve) then you'll need to upgrade by running 
> the following commands in your activated virtual environment (make sure you 
> migrate your database to Postges 9.6 first):
>
> ```
> pip install arches --upgrade
> python manage.py migrate
> ```
>
> As always the documentation can be found at 
> http://arches4.readthedocs.io/en/latest/
>
> *Changes*
>
> - Change Postgres version from 9.5 to 9.6
> - Add Docker integration, re #1650 - Thanks to Vincent Meijer!
> - Updated project templates with TILE_CACHE_CONFIG setting, re #1662
> - Don't allow the system settings graph to be managed as a resource graph, 
> re #1636
> - Add vector simplification and make a system setting
> - Add resource instance datatype and widget #2305
> - Changing the ResourceXResource relationshiptype property from a foreign 
> key to the Value table to a string so that it supports both concept value 
> uuids (as strings) and ontology property strings., re #2300
> - Remove Networkx package anymore, re #2306
> - Added advanced search component re #2315
> - Implemented xy input in search, re #2323
> - Add our own arches specific additions to the crm, re #2306
> - Loading selected point coordinates into xy tool, re #2323
> - make sure users don't reload the same ontology multiple times (based on 
> file name), re #2306
> - Refactored code to be more readable and use revised folder structure. 
> Also started supporting loading from a local zip file. re #2335
> - Clean up positioning of map widget tools, support scroll of overlay grid
> - Added functions to load custom widgets, functions, and datatypes, re 
> #2335
> - Fix business data export bugs. Add support for universal new line mode 
> on import. Add info about non-contiguous groups on import. re #2360 re #2361
> - Fix bug with csv export of grouped business data. Add default 
> 'file_field_name' to mapping file template. re #2367
> - Added user prompt to overwrite existing graphs
> - Add rdf format for resource export, re #2307
> - Simplify the export of resource relations, re #2307
> - Add Easting/Northing map widget geometry creation tool
> - Use fully qualified ontology class and property names, re #2307
> - Add create_package command, re #2335
> - Modify json import to overwrite existing tiles on import. re #2394
> - Added the ability to copy a resource instance, re #2346
> - Allow a super user to access the system settings page regardless of 
> whether there are resource graphs in the system, re #2316
> - Upgraded mapbox gl js (& draw tools) re #2410
> - Making a collection from a given concept, re #2200
> - Permit users to change node configs when a node belongs to a nodegroup 
> to which business data has not been saved, re #2342
> - Add support for shapefiles import, re #1543
> - Add label based concept business data import, re #2426
> - Change name of mapbox_styles directory to mapbox_spec_styes for 
> clarification, re #2335
> - Make the RDM ui a bit more responsive, re #2199
> - Added ability to load additional resources from the node list entry, re 
> #2112
> - Added the ability to change your password, re #282
> - Add a bulk indexing method for concepts, re #2199
> - Improve performance when listing parent concepts in the manage

Re: [Arches] Re: Arches 4: Icons on map

[Vincent Meijer]

Awesome, thanks!

On Oct 11, 2017 5:46 PM, "Rob Gaston" <rgas...@fargeo.com> wrote:

> Hi Vincent,
>
> The layer you are looking at in the map layer manager is a resource layer,
> not the layer that contains search markers.  For this, from the map layer
> manager, go to Overlays > Search Markers.
>
> The marker looks “grainy” because it is expanded to 2x it’s regular size.
> You can customize the styling here however you see fit.  The glyphs that
> are available in mapbox gl js by default can be seen here:
> https://github.com/mapbox/mapbox-gl-styles#standard-icons
>
> The console warning can be ignored.  The python mapbox vector tile
> renderer does not support the v3 spec yet.
>
> - Rob
>
>
>
> On Oct 11, 2017, at 11:51 AM, Vincent Meijer <meijer.vinc...@gmail.com>
> wrote:
>
> Hi Dennis,
>
> Sorry for the late reply.
> I was confused by/suspicious of this behavior for two reasons:
> - The hexagons keep their size when I zoom in, so they become huge (see
> first screenshot below). But I see now that I can change this in Map
> Settings -> Search Results Grid.
> - The black markers are quite grainy, which made me think it was some
> javascript bug.
>
>
> Regarding the second point, when I go to Map Manager that black marker is
> displayed as a small dot (please see second screenshot below).
> I expected that icon to be the Android figure I selected from the list
> below. Am I misinterpreting the role of that icon?
> I did find out I can change the size and color of that black dot. Is there
> a way to change the black marker?
>
> Please also note the warning in the browser console in the bottom. Is
> anybody else seeing this?
>
>
> Anyway, thanks for your help!
>
> Vincent
>
>
>
> <https://lh3.googleusercontent.com/--A8TWFWn5kY/Wd5hWh5vgGI/CBc/OZYjm8uppXsfDP_HSLIJrR9xsahPKCF8gCLcBGAs/s1600/Hexagon.PNG>
>
>
>
>
>
>
>
> <https://lh3.googleusercontent.com/-4Zp35zQlSIw/Wd5h-g2RZKI/CBg/ZnHB0BiiJfEQWFS545jQX1SjixRx3f7rQCLcBGAs/s1600/Map%2BManager.PNG>
>
>
> On Friday, 6 October 2017 13:13:44 UTC-4, Dennis Wuthrich wrote:
>>
>> Hi Vincent
>>
>> Arches provides a way to show the full set of resources that meet your
>> search criteria, and uses the purple hexagons to display a binned
>> distribution of all resources in your query.  The black markers show the
>> location of a specific resource instance on the map.  Another way to say
>> this: the purple polygons aggregate all the resource instances in your
>> query, the markers show the location of each instance.
>>
>> Of course, you are not required to show the hexagons (e.g.; an overlay
>> that we call the "search results" layer) on your map.  You can hide the
>> layer by default (or delete it if you prefer) in the map manager.
>>
>> Hope this helps.
>>
>> Dennis
>>
>> On Friday, October 6, 2017 at 6:20:19 AM UTC-7, Vincent Meijer wrote:
>>>
>>> The location icons on my Arches 4 map seem to be a bit off.
>>>
>>> All georeferenced items in my database show up as purple hexagons. Those
>>> resources that are currently visible in the results bar on the left show an
>>> additional black location icon.
>>>
>>> No errors are shown in the browser console.
>>>
>>> Thoughts?
>>>
>>> Thanks!
>>> Vincent
>>>
>>>
>>> <https://lh3.googleusercontent.com/-iinJmI-Jg8k/WdeBZxSA6rI/CBA/47KoYXS549c_wmyiyBT2UB8VX6DsMpLqwCLcBGAs/s1600/arches_map.PNG>
>>>
>>>
> --
> -- To post, send email to archesproject@googlegroups.com. To unsubscribe,
> send email to archesproject+unsubscr...@googlegroups.com. For more
> information, visit https://groups.google.com/d/forum/archesproject?hl=en
> ---
> You received this message because you are subscribed to the Google Groups
> "Arches Project" group.
> To unsubscribe from this group and stop receiving emails from it, send an
> email to archesproject+unsubscr...@googlegroups.com.
> For more options, visit https://groups.google.com/d/optout.
>
>
>

-- 
-- To post, send email to archesproject@googlegroups.com. To unsubscribe, send 
email to archesproject+unsubscr...@googlegroups.com. For more information, 
visit https://groups.google.com/d/forum/archesproject?hl=en
--- 
You received this message because you are subscribed to the Google Groups 
"Arches Project" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to archesproject+unsubscr...@googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

[Arches] Re: Arches 4: Icons on map

[Vincent Meijer]

Hi Dennis,

Sorry for the late reply. 
I was confused by/suspicious of this behavior for two reasons:
- The hexagons keep their size when I zoom in, so they become huge (see 
first screenshot below). But I see now that I can change this in Map 
Settings -> Search Results Grid.
- The black markers are quite grainy, which made me think it was some 
javascript bug.


Regarding the second point, when I go to Map Manager that black marker is 
displayed as a small dot (please see second screenshot below). 
I expected that icon to be the Android figure I selected from the list 
below. Am I misinterpreting the role of that icon? 
I did find out I can change the size and color of that black dot. Is there 
a way to change the black marker?

Please also note the warning in the browser console in the bottom. Is 
anybody else seeing this?


Anyway, thanks for your help!

Vincent


<https://lh3.googleusercontent.com/--A8TWFWn5kY/Wd5hWh5vgGI/CBc/OZYjm8uppXsfDP_HSLIJrR9xsahPKCF8gCLcBGAs/s1600/Hexagon.PNG>






<https://lh3.googleusercontent.com/-4Zp35zQlSIw/Wd5h-g2RZKI/CBg/ZnHB0BiiJfEQWFS545jQX1SjixRx3f7rQCLcBGAs/s1600/Map%2BManager.PNG>


On Friday, 6 October 2017 13:13:44 UTC-4, Dennis Wuthrich wrote:
>
> Hi Vincent
>
> Arches provides a way to show the full set of resources that meet your 
> search criteria, and uses the purple hexagons to display a binned 
> distribution of all resources in your query.  The black markers show the 
> location of a specific resource instance on the map.  Another way to say 
> this: the purple polygons aggregate all the resource instances in your 
> query, the markers show the location of each instance.
>
> Of course, you are not required to show the hexagons (e.g.; an overlay 
> that we call the "search results" layer) on your map.  You can hide the 
> layer by default (or delete it if you prefer) in the map manager.
>
> Hope this helps.
>
> Dennis
>
> On Friday, October 6, 2017 at 6:20:19 AM UTC-7, Vincent Meijer wrote:
>>
>> The location icons on my Arches 4 map seem to be a bit off.
>>
>> All georeferenced items in my database show up as purple hexagons. Those 
>> resources that are currently visible in the results bar on the left show an 
>> additional black location icon.
>>
>> No errors are shown in the browser console. 
>>
>> Thoughts?
>>
>> Thanks!
>> Vincent
>>
>>
>> <https://lh3.googleusercontent.com/-iinJmI-Jg8k/WdeBZxSA6rI/CBA/47KoYXS549c_wmyiyBT2UB8VX6DsMpLqwCLcBGAs/s1600/arches_map.PNG>
>>
>>

-- 
-- To post, send email to archesproject@googlegroups.com. To unsubscribe, send 
email to archesproject+unsubscr...@googlegroups.com. For more information, 
visit https://groups.google.com/d/forum/archesproject?hl=en
--- 
You received this message because you are subscribed to the Google Groups 
"Arches Project" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to archesproject+unsubscr...@googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

[Arches] Arches 4: Report map javascript errors

[Vincent Meijer]

I am seeing these errors when loading a resource report with the map report 
template (in both Chrome and Firefox):

Deprecated include of L.Mixin.Events: this property will be removed in 
future releases, please inherit from L.Evented instead. y@https:
//demo.usfcvast.org/database/media/bower_components/leaflet/dist/leaflet.js:1:2054
v.extend@https:
//demo.usfcvast.org/database/media/bower_components/leaflet/dist/leaflet.js:1:15082
@https:
//demo.usfcvast.org/database/media/bower_components/leaflet-draw/dist/leaflet.draw.js:8:2203
@https:
//demo.usfcvast.org/database/media/bower_components/leaflet-draw/dist/leaflet.draw.js:8:2
  Class.js:121:3


TypeError: can't define property "segmentsIntersect": Object is not 
extensible[Learn More]  Util.js:15:3


Error: Unable to process binding "if: function(){return !configForm  && 
state ==='form' }"
Message: Unable to process binding "foreach: function(){return { 
data:[$data],as:'self'} }"
Message: Unable to process binding "component: function(){return {
name:geocodeProviderDetails.component,params:{

placeholder:geocodePlaceholder,map:map,anchorLayerId:anchorLayerId,api_key:geocodeProviderDetails.api_key,geocodeProvider:geocodeProvider}}
 
}"
Message: No component name specified



I only see the first two errors when loading a report that has no map 
header (but e.g. an image or no header).


Thoughts? Thanks!
Vincent 

-- 
-- To post, send email to archesproject@googlegroups.com. To unsubscribe, send 
email to archesproject+unsubscr...@googlegroups.com. For more information, 
visit https://groups.google.com/d/forum/archesproject?hl=en
--- 
You received this message because you are subscribed to the Google Groups 
"Arches Project" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to archesproject+unsubscr...@googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

[Arches] Arches 4: Icons on map

[Vincent Meijer]

The location icons on my Arches 4 map seem to be a bit off.

All georeferenced items in my database show up as purple hexagons. Those 
resources that are currently visible in the results bar on the left show an 
additional black location icon.

No errors are shown in the browser console. 

Thoughts?

Thanks!
Vincent



-- 
-- To post, send email to archesproject@googlegroups.com. To unsubscribe, send 
email to archesproject+unsubscr...@googlegroups.com. For more information, 
visit https://groups.google.com/d/forum/archesproject?hl=en
--- 
You received this message because you are subscribed to the Google Groups 
"Arches Project" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to archesproject+unsubscr...@googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

[Arches] Re: Confusion with initial setup of v4

[Vincent Meijer]

Hey Darcy,

Using instance in the link you provided, I was able to go to System 
Settings and see the Mapbox API 
field: 
http://heritage.hku.hk/hongkong_v4/settings/#9cbea111-3cda-11e7-b374-c4b301baab9f
 

What browser are you on? I am using Chrome without trouble (albeit your 
instance is a little slow). 


As for the bower_components 404 errors, could it be that your Arches custom 
app has an outdated bower.json ? 
Are the packages you see errors for present in your bower.json? 
See if this version differs from 
yours: 
https://github.com/archesproject/arches/blob/4.0.0/arches/install/arches-templates/project_name/bower.json
 


Best,
Vincent


On Thursday, 21 September 2017 02:14:28 UTC-4, Darcy Christ wrote:
>
> Hi,
>
> I am still fumbling around trying to understand v4. After several attempts 
> to get it installed on both my dev machine (mac osx) and our production 
> (centos), I seem to have a working version. However, something doesn't seem 
> quite right. It may be a matter of me not understanding what I am looking 
> at.
>
> To begin with, I cannot for the life of me find Map Settings –> Mapbox 
> API, as stated in this documentation: 
> https://arches4.readthedocs.io/en/latest/initial-configuration/#map-settings
>
> I have logged on with admin/admin.
>
> So many of the icons on the left side do nothing, including 'Dashboard', 
> 'System Settings', 'Field Project Manager', 'Import/Export Manager' and 
> 'Profile Manager'. I suspect my installation is not good, but I am not sure 
> what is wrong or what to do about it.
>
> Here is an example of one version I have tried to configure: 
> http://heritage.hku.hk/hongkong_v4/
>
>
> One last thing, which might point to an issue. Although I have installed 
> bower, when I access the search, I see this in the log:
>
> [21/Sep/2017 01:05:07] "GET /search HTTP/1.1" 200 143878
> [21/Sep/2017 01:05:07] "GET 
> /media/bower_components/nvd3/build/nv.d3.min.css HTTP/1.1" 404 1848
> [21/Sep/2017 01:05:07] "GET 
> /media/bower_components/leaflet/dist/leaflet.css HTTP/1.1" 404 1848
> [21/Sep/2017 01:05:07] "GET 
> /media/bower_components/leaflet-draw/dist/leaflet.draw.css HTTP/1.1" 404 
> 1878
> [21/Sep/2017 01:05:08] "GET 
> /media/bower_components/mapbox-gl-draw/index.js HTTP/1.1" 404 1845
>
>
> Any help is appreciated
>
>
> Regards,
> Darcy
>

-- 
-- To post, send email to archesproject@googlegroups.com. To unsubscribe, send 
email to archesproject+unsubscr...@googlegroups.com. For more information, 
visit https://groups.google.com/d/forum/archesproject?hl=en
--- 
You received this message because you are subscribed to the Google Groups 
"Arches Project" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to archesproject+unsubscr...@googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

[Arches] Re: Making an offline database from Arches, or some version of it

[Vincent Meijer]

Hi Allison,

Phil is right in that you can run Arches on a local network or even a local 
laptop without having to be online (at all times). 
Although this might limit the functioning of the maps, because Arches 
downloads these from the internet. But there are solutions for that (with 
which others here can help you). 

Arches does not have any automated synchronization of data between 
instances (separate Arches installations), so for that you would need to 
export your data from one instance and import it into the other instance. 

You will require internet for the installation of Arches, though.

Hope this helps,
Vincent 



On Monday, 18 September 2017 05:43:37 UTC-4, Allison Lee wrote:
>
> Hello everyone,
>
> We have a request for Arches to function as an offline database, due to 
> the limited broadband of one of our partners.  From my knowledge, there is 
> no offline ability of Arches.  The only downloadable version is through 
> exporting data to .SHP, .CSV, or .KML formats which act more as codes to 
> communicate to Arches rather than readable data for people.  There doesn't 
> seem to be any way to download Resource Reports either.
>
> Does anyone have any suggestions for this?  If our partner wants to have 
> an online heritage database (Arches) PLUS an offline database, what would 
> you recommend?  Is there a way to download Resource Reports, perhaps to be 
> stored in a hard drive?  I realize by taking the data offline, we will be 
> losing features such as Related Resources.
>
> Thanks for any comments!
>
> Allison (Hong Kong)
>

-- 
-- To post, send email to archesproject@googlegroups.com. To unsubscribe, send 
email to archesproject+unsubscr...@googlegroups.com. For more information, 
visit https://groups.google.com/d/forum/archesproject?hl=en
--- 
You received this message because you are subscribed to the Google Groups 
"Arches Project" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to archesproject+unsubscr...@googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

[Arches] Re: Choosing a cloud service for Arches

[Vincent Meijer]

Hi David,

We at CVAST (University of South Florida) use AWS as well and had good 
experiences with it so far. 
There are people working for AWS that are dedicated to supporting 
educational instances at no cost. I talk regularly with their account 
manager and their solution architect. 

AWS also provides PostgreSQL as a service. We use it and so far it saved me 
a lot of work configuring and hosting my own Postgres instance. 

Our Arches instances (not in production yet) run in Docker containers in 
the AWS service called EC2 Container Service (ECS)

Best,
Vincent


On Sunday, 20 August 2017 10:28:50 UTC-4, David Osborne wrote:
>
> Does anyone using a cloud implementation of Arches have recommendations 
> for choosing a provider? For our project, I'm considering Amazon AWS, 
> Google's Cloud Platform and Microsoft Azure. This is a new installation, so 
> there are no legacy systems to be considered. In the past, I've read about 
> AWS but I don't yet know very much about Google's offering. At the 
> university where I work, we're starting to deploy some new services in 
> Azure, so I've had a little more exposure to that and it does seem to offer 
> some useful services, with PostgreSQL as a supported database, for example. 
> However, my work on Arches is not related to the university.
>
> How do the costs compare for the three providers? Similarly, how are they 
> for support? I'll be grateful for any comments.
>
> Thanks
> David
>
>
>

-- 
-- To post, send email to archesproject@googlegroups.com. To unsubscribe, send 
email to archesproject+unsubscr...@googlegroups.com. For more information, 
visit https://groups.google.com/d/forum/archesproject?hl=en
--- 
You received this message because you are subscribed to the Google Groups 
"Arches Project" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to archesproject+unsubscr...@googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

[Arches] Re: Upgrading from Arches v4.0b3 project to v4.0

[Vincent Meijer]

Thanks Alexei, the update script works fine.

Vincent

On Friday, 28 July 2017 15:56:44 UTC-4, Alexei Peters wrote:
>
> Hello Everyone,
> If you happened to install Arches v4.0b3 and created a project using the 
> "arches-project create" command and want to keep that project then the 
> following instructions are for you!
>
> The first thing to do is download the attached python script file 
> (update_project.py).
>
> The script file takes the path of the project root as the only positional 
> argument. Example:
>
> *python update_project.py 
> ~/Documents/projects/GCI/arches_v4/myproject/myproject*
>
>
> Running this script will do the following:
>
>1. Add an empty arches.log file in root.
>2. Create a directory called logs in root if it doesn't exist and add 
>an empty file called 'resource_import.log'.
>3. Create a file in root called 'proposed_settings.py' which is a copy 
>of the project's original settings.py file plus the new v4 settings.
>4. Download the bower.json file to root and name it 
>'proposed_bower.json'
>
> Once you run this file you just need to:
>
>1. Review 'proposed_settings.py' and either rename it 'settings.py' or 
>copy its contents to 'settings.py'.
>2. Rename 'proposed_bower.json' to 'bower.json' or copy its contents 
>to 'bower.json'.
>
> Finally, *MAKE A BACKUP OF YOUR DATABASE**,* then cd into the root of the 
> project and then run the following commands from an activated virtual 
> environment:
>
>1. pip install arches --upgrade
>2. python manage.py migrate
>3. bower install (from the directory where the bower.json file exists)
>4. bower prune
>
> Go into your /templates directory and remove the following files, unless 
> you've modified them, in which case you'll need to get new copies of those 
> files from here (
> https://github.com/archesproject/arches/tree/4.0.0/arches/app/templates) 
> and apply your modifications to those new files:
>
>1. base-manager.htm
>2. login.htm
>
> Now start Arches.
>
>1. open a browser (Google chrome)
>2. login to Arches as 'admin'
>3. navigate to /settings
>4. update your Mapbox API Key (Go to Map Settings –> Mapbox API) (the 
>old location for the key is in settings.py)
>
>
> For further settings help go here: 
> http://arches4.readthedocs.io/en/latest/initial-configuration/
> That's it!  Arches v4 should be running properly!
> If you have any further questions please post them to the forum and we'll 
> try to answer them as soon as we can.
>
> Cheers,
> The Arches Team
>

-- 
-- To post, send email to archesproject@googlegroups.com. To unsubscribe, send 
email to archesproject+unsubscr...@googlegroups.com. For more information, 
visit https://groups.google.com/d/forum/archesproject?hl=en
--- 
You received this message because you are subscribed to the Google Groups 
"Arches Project" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to archesproject+unsubscr...@googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

[Arches] Re: Arches v4.0 released

[Vincent Meijer]

Great news! Congratulations.

I created a Docker image for this release. It can be found in the Docker 
registry as `arches/arches:4.0.0`

Vincent

On Thursday, 27 July 2017 18:43:51 UTC-4, Alexei Peters wrote:
>
> Hi Everyone,
>
> The Arches team is happy to announce the v4.0 release of Arches!  We're 
> super excited about this new version and hope you are too!
> Once you have Arches installed we strongly recommend reviewing the 
> documentation found here: (http://arches4.readthedocs.io/en/latest/).
>
> If you're insalling Arches for the first time, please follow the 
> instructions found here: 
> http://arches4.readthedocs.io/en/latest/installation/
> and then here:
> http://arches4.readthedocs.io/en/latest/initial-configuration/
>
> If you're upgrading from v4.0b3, look for more information about upgrading 
> shortly.
>
> If you have any further questions please post them to the forum and we'll 
> try to answer them as soon as we can.
>
> Cheers,
> The Arches Team
>

-- 
-- To post, send email to archesproject@googlegroups.com. To unsubscribe, send 
email to archesproject+unsubscr...@googlegroups.com. For more information, 
visit https://groups.google.com/d/forum/archesproject?hl=en
--- 
You received this message because you are subscribed to the Google Groups 
"Arches Project" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to archesproject+unsubscr...@googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

Re: [Arches] Supporting "fuzzy dates", approximations, and uncertain dates in Arches

[Vincent Meijer]

I second that, awesome to hear that this is in scope for the near future!

Thanks Alexei,

Vincent


On Jul 22, 2017 4:32 AM, "Joel Aldor" <joel.al...@gmail.com> wrote:

Hi Alexei,

This is something we're really looking forward to. Thanks a lot!

Regards,

Joel


On Saturday, July 22, 2017 at 2:18:20 AM UTC+8, Alexei Peters wrote:

> Hi Vincent,
> Here's the status of dates and the collection of date information in v4.
> As it stands v4.0.0 will only be able to collect date information in the
> few specific formats that you mention above: -MM-DD, -MM and 
> If you only want to collect  then you need to remember to set the
> format in the Card Designer (see attached screen shot).  I've verified that
> this will not add -01-01 to the date saved.
> As for the backend validation, we will try to sync that up before the
> release of v4.
>
> In the very near future(next couple of months) we will be addressing the
> "fuzzy date" issue so that users can collect anything that relates to a
> point or range of time and that won't force users to enter specific
> formats.  Eg: you could just specify the string  '*late third century
> B.C.*'
> Allowing something like this to participate in search will be the real
> trick, but I think it's at least partially achievable!
>
> Hope this helps.
> Cheers,
> Alexei
>
>
> Director of Web Development - Farallon Geographics, Inc. - 971.227.3173
> <(971)%20227-3173>
>
> On Tue, Jul 18, 2017 at 4:14 AM, Vincent Meijer <meijer@gmail.com>
> wrote:
>
>> Hi Alexei,
>>
>> What is the current status of fuzzy dates in Arches 4?
>>
>> I have been looking at the Arches code, and it seems the frontend
>> DatePicker only allows -MM-DD, -MM and  (*but no B.C.*).
>> However, in practice the datepicker automatically adds 01-01 when I only
>> enter a year.
>> The backend seems to have it's own date validation: 
>> '-%Y','%Y','%Y-%m-%d','%B-%m-%d','%Y-%m-%d
>> %H:%M:%S'
>>
>> I think being able to specify years only and B.C. years would be a good
>> start for our use case, but this would require that our users translate 
>> '*late
>> third century B.C.*' to something like '*-210*'. Seems sketchy.
>>
>> However, I just started thinking about this and maybe there are better
>> solutions. Thoughts welcome!
>>
>> Thanks!
>> Vincent
>>
>>
>> On Tuesday, 17 May 2016 17:57:30 UTC+2, Angela Labrador wrote:
>>
>>> Good thought, Adam - thanks for the feedback -- and great news that
>>> native support for a broader range of date types will be in version 4!
>>>
>>> On Wednesday, May 11, 2016 at 7:28:09 PM UTC-4, Adam Cox wrote:
>>>>
>>>> Hi Angela, this looks good and I appreciate the detailed documentation
>>>> on how to install the extension.
>>>>
>>>> One thought I had is that you could move your validation into a new
>>>> dedicated file, and then leave branch-list.js alone.  I did this in my
>>>> current project, in order to create a centralized location for validation
>>>> functions so I could apply them in any form. I created validation.js
>>>> <https://github.com/mradamcox/afrh/blob/master/afrh/media/js/views/forms/sections/validation.js>,
>>>> and then used it in each form like this
>>>> <https://github.com/mradamcox/afrh/blob/master/afrh/media/js/views/forms/inventory-evaluation.js>
>>>> (see lines 5, 9, and 80).  I have two basic functions in there now, but
>>>> have thought that a simple nodeIsDigit() would be good to add.
>>>>
>>>> I set things up this way because I didn't want to bloat branch-list.js,
>>>> in fact, I don't even need it in my app at all.
>>>>
>>>> Anyway, the extension looks useful, and I look forward to giving it a
>>>> try soon.
>>>>
>>>> Adam
>>>>
>>>> On Wed, May 11, 2016 at 11:12 AM, Alexei Peters <ape...@fargeo.com>
>>>> wrote:
>>>>
>>>>> Hi Angela,
>>>>> It's great that you guys were able to extend Arches v3 to support
>>>>> fuzzy dates.  Including fuzzy dates natively has definitely been on our
>>>>> radar and will be included in v4.
>>>>> Thanks for contributing back to the community!
>>>>> Cheers,
>>>>> Alexei
>>>>>
>>>>>
>>>>> Director of Web Development - Farallon Geographics, Inc. -
>>>>> 971.227.3173
>>>>>
>>>>> On

Re: [Arches] Supporting "fuzzy dates", approximations, and uncertain dates in Arches

[Vincent Meijer]

Hi Alexei,

What is the current status of fuzzy dates in Arches 4? 

I have been looking at the Arches code, and it seems the frontend 
DatePicker only allows -MM-DD, -MM and  (*but no B.C.*).
However, in practice the datepicker automatically adds 01-01 when I only 
enter a year.
The backend seems to have it's own date 
validation: '-%Y','%Y','%Y-%m-%d','%B-%m-%d','%Y-%m-%d %H:%M:%S'

I think being able to specify years only and B.C. years would be a good 
start for our use case, but this would require that our users translate '*late 
third century B.C.*' to something like '*-210*'. Seems sketchy. 

However, I just started thinking about this and maybe there are better 
solutions. Thoughts welcome!

Thanks!
Vincent


On Tuesday, 17 May 2016 17:57:30 UTC+2, Angela Labrador wrote:

> Good thought, Adam - thanks for the feedback -- and great news that native 
> support for a broader range of date types will be in version 4! 
>
> On Wednesday, May 11, 2016 at 7:28:09 PM UTC-4, Adam Cox wrote:
>>
>> Hi Angela, this looks good and I appreciate the detailed documentation on 
>> how to install the extension.
>>
>> One thought I had is that you could move your validation into a new 
>> dedicated file, and then leave branch-list.js alone.  I did this in my 
>> current project, in order to create a centralized location for validation 
>> functions so I could apply them in any form. I created validation.js 
>> ,
>>  
>> and then used it in each form like this 
>> 
>>  
>> (see lines 5, 9, and 80).  I have two basic functions in there now, but 
>> have thought that a simple nodeIsDigit() would be good to add.
>>
>> I set things up this way because I didn't want to bloat branch-list.js, 
>> in fact, I don't even need it in my app at all.
>>
>> Anyway, the extension looks useful, and I look forward to giving it a try 
>> soon.
>>
>> Adam
>>
>> On Wed, May 11, 2016 at 11:12 AM, Alexei Peters  
>> wrote:
>>
>>> Hi Angela,
>>> It's great that you guys were able to extend Arches v3 to support fuzzy 
>>> dates.  Including fuzzy dates natively has definitely been on our radar and 
>>> will be included in v4.
>>> Thanks for contributing back to the community!
>>> Cheers,
>>> Alexei
>>>
>>>
>>> Director of Web Development - Farallon Geographics, Inc. - 971.227.3173
>>>
>>> On Fri, May 6, 2016 at 2:17 PM, Angela Labrador  
>>> wrote:
>>>
 Greetings!

 While learning how Arches works and testing it out in house, we found 
 that adding Extended Date/Time Format 
 support to 
 Arches date fields would possibly benefit users who need to manage a wider 
 range of dates in their inventory system: dates such as "about 1800" or 
 date ranges such as "1934 - present". 

 We've developed a validation function that can handle such date strings 
 while maintaining consistency and basic integrity for search in Arches. 
 The 
 feature is available to the community at our Github repository along 
 with more detailed technical documentation 
  for installing and 
 testing. Our recent blog article 
  provides some 
 background as well. 

 Please try it out -- we welcome all contributions and issue reports at 
 our repo!

 Hope this helps out some folks,
 Angela Labrador, PhD.
 Coherit Associates, LLC

 -- 
 -- To post, send email to arches...@googlegroups.com. To unsubscribe, 
 send email to archesprojec...@googlegroups.com. For more information, 
 visit https://groups.google.com/d/forum/archesproject?hl=en
 --- 
 You received this message because you are subscribed to the Google 
 Groups "Arches Project" group.
 To unsubscribe from this group and stop receiving emails from it, send 
 an email to archesprojec...@googlegroups.com.
 For more options, visit https://groups.google.com/d/optout.

>>>
>>> -- 
>>> -- To post, send email to arches...@googlegroups.com. To unsubscribe, 
>>> send email to archesprojec...@googlegroups.com. For more information, 
>>> visit https://groups.google.com/d/forum/archesproject?hl=en
>>> --- 
>>> You received this message because you are subscribed to the Google 
>>> Groups "Arches Project" group.
>>> To unsubscribe from this group and stop receiving emails from it, send 
>>> an email to archesprojec...@googlegroups.com.
>>> For more options, visit https://groups.google.com/d/optout.
>>>
>>
>>

-- 
-- To post, send email to archesproject@googlegroups.com. To unsubscribe, send 
email to archesproject+unsubscr...@googlegroups.com. For more information, 
visit 

[Arches] Re: Importing and exporting the collections (drop down menus for the ressource graph)

[Vincent Meijer]

Hi Hiba,

You can export your concepts and collections from the RDM screen. 
You are right that this is separate from the graph export. 

I'm not able at the moment to provide you with a screenshot of the right 
button, but it should be pretty straightforward if you have the RDM open. 


Let us know if you need any more help!

Vincent


On Wednesday, 5 July 2017 19:18:22 UTC+2, hiba.b@gmail.com wrote:
>
> Hi All,
>
>  I have created a resource graph and I can import it and export it 
> whenever I modify it, also I created the drop down menus , The question is 
> : How can I import and export the collections because is not exported with 
> resources graph although I linked the collection to the required nodes!
>
>
> Thanks 
> hiba
>
>

-- 
-- To post, send email to archesproject@googlegroups.com. To unsubscribe, send 
email to archesproject+unsubscr...@googlegroups.com. For more information, 
visit https://groups.google.com/d/forum/archesproject?hl=en
--- 
You received this message because you are subscribed to the Google Groups 
"Arches Project" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to archesproject+unsubscr...@googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

[Arches] Re: Inference Making and multiple values

[Vincent Meijer]

I (partly) solved this by creating three separate branches from the main 
node (value, biblio reference, actor reference). 
All three are configured as Sub-Cards, which allows the user to add 
multiple of each separately. 
Under 'cards' I also enabled multiple values. 

I was wrong in thinking this would remove the relation between the three 
branches: the user still saves the whole 'bundle' by clicking the 'Save' 
button at the bottom.

Screenshots;
<https://lh3.googleusercontent.com/-QA3LPQTOEL0/WU11iRnyanI/B9s/rY1dF_x37GkPPK_xKU6ak0-bbvegKeG1QCLcBGAs/s1600/Iconography%2Bbranch%2Bcards.PNG>
 
<https://lh3.googleusercontent.com/-eHyA_eQXFwQ/WU11snSI81I/B9w/44YcvjYOTG4s4ckGnxKpqVHdX0SmAE0_QCLcBGAs/s1600/Iconography%2Bbranch%2Bgraph.PNG>












<https://lh3.googleusercontent.com/-QA3LPQTOEL0/WU11iRnyanI/B9s/rY1dF_x37GkPPK_xKU6ak0-bbvegKeG1QCLcBGAs/s1600/Iconography%2Bbranch%2Bcards.PNG>
 
<https://lh3.googleusercontent.com/-l2lpgfm3v08/WU11ykFITnI/B90/JTenG_7Pl24dGeF9oZEFFP5GC0Dt8lU0wCLcBGAs/s1600/Iconography%2Bbranch%2BResource%2BEditor.PNG>



























On Thursday, 22 June 2017 09:11:33 UTC+2, Vincent Meijer wrote:
>
> P.s. in the future I would like to convert the bibliographical references 
> and actors to actual resources instead of concept lists.
> This is not yet possible in Arches at the moment. 
>
>
> On Wednesday, 21 June 2017 22:02:36 UTC+2, Vincent Meijer wrote:
>>
>> I would like to use CIDOC's Inference Making plugin to document decisions 
>> regarding cultural heritage, e.g. iconographic identifications.
>>
>> I am trying to configure a graph so that a user can list 
>> - One or more values (strings)
>> - A set of bibliographical references (currently a concept list) *with a 
>> page number *
>> - and/or a set of actors (currently a concept list) that are the 
>> authority behind that set of values.
>>
>> So far I have only been able to:
>>
>> - Create separate sub-cards for 'value', 'bibliographical reference' and 
>> 'actor'. This does not do what I need, because these are all independent of 
>> each other. I.e. a user can create multiple values and multiple 
>> bibliographical references, but there is no way of telling which is 
>> connected to which. 
>>
>> - Create all nodes in a single card. This means I can only have a single 
>> string, a single bibliographical reference and multiple actors. (Because 
>> the bibliographical reference has the related 'page number' field, I cannot 
>> make that a concept-list, as it would lose the relation between biblio ref 
>> and page number). 
>>
>>
>> Does anybody else have experience with or thoughts about this?
>>
>> Thanks!
>> Vincent
>>
>>
>>
>>

-- 
-- To post, send email to archesproject@googlegroups.com. To unsubscribe, send 
email to archesproject+unsubscr...@googlegroups.com. For more information, 
visit https://groups.google.com/d/forum/archesproject?hl=en
--- 
You received this message because you are subscribed to the Google Groups 
"Arches Project" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to archesproject+unsubscr...@googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

[Arches] Re: Inference Making and multiple values

[Vincent Meijer]

P.s. in the future I would like to convert the bibliographical references 
and actors to actual resources instead of concept lists.
This is not yet possible in Arches at the moment. 


On Wednesday, 21 June 2017 22:02:36 UTC+2, Vincent Meijer wrote:
>
> I would like to use CIDOC's Inference Making plugin to document decisions 
> regarding cultural heritage, e.g. iconographic identifications.
>
> I am trying to configure a graph so that a user can list 
> - One or more values (strings)
> - A set of bibliographical references (currently a concept list) *with a 
> page number *
> - and/or a set of actors (currently a concept list) that are the authority 
> behind that set of values.
>
> So far I have only been able to:
>
> - Create separate sub-cards for 'value', 'bibliographical reference' and 
> 'actor'. This does not do what I need, because these are all independent of 
> each other. I.e. a user can create multiple values and multiple 
> bibliographical references, but there is no way of telling which is 
> connected to which. 
>
> - Create all nodes in a single card. This means I can only have a single 
> string, a single bibliographical reference and multiple actors. (Because 
> the bibliographical reference has the related 'page number' field, I cannot 
> make that a concept-list, as it would lose the relation between biblio ref 
> and page number). 
>
>
> Does anybody else have experience with or thoughts about this?
>
> Thanks!
> Vincent
>
>
>
>

-- 
-- To post, send email to archesproject@googlegroups.com. To unsubscribe, send 
email to archesproject+unsubscr...@googlegroups.com. For more information, 
visit https://groups.google.com/d/forum/archesproject?hl=en
--- 
You received this message because you are subscribed to the Google Groups 
"Arches Project" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to archesproject+unsubscr...@googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

[Arches] Inference Making and multiple values

[Vincent Meijer]

I would like to use CIDOC's Inference Making plugin to document decisions 
regarding cultural heritage, e.g. iconographic identifications.

I am trying to configure a graph so that a user can list 
- One or more values (strings)
- A set of bibliographical references (currently a concept list) *with a 
page number *
- and/or a set of actors (currently a concept list) that are the authority 
behind that set of values.

So far I have only been able to:

- Create separate sub-cards for 'value', 'bibliographical reference' and 
'actor'. This does not do what I need, because these are all independent of 
each other. I.e. a user can create multiple values and multiple 
bibliographical references, but there is no way of telling which is 
connected to which. 

- Create all nodes in a single card. This means I can only have a single 
string, a single bibliographical reference and multiple actors. (Because 
the bibliographical reference has the related 'page number' field, I cannot 
make that a concept-list, as it would lose the relation between biblio ref 
and page number). 


Does anybody else have experience with or thoughts about this?

Thanks!
Vincent



-- 
-- To post, send email to archesproject@googlegroups.com. To unsubscribe, send 
email to archesproject+unsubscr...@googlegroups.com. For more information, 
visit https://groups.google.com/d/forum/archesproject?hl=en
--- 
You received this message because you are subscribed to the Google Groups 
"Arches Project" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to archesproject+unsubscr...@googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

[Arches] Re: Using Docker for deploying Arches

[Vincent Meijer]

Hey Kepa, 

Sorry for the late reply. I'm currently on fieldwork. 

Check out the Readme to see how you can set up your own custom Arches 
app: https://github.com/cvast/arches/tree/1650_docker_support/docker


Here is how I implemented my own custom Arches 
app: https://github.com/cvast/cvast-arches
Also have a look at my entrypoint to see how I load my custom database 
graphs and 
concepts: 
https://github.com/cvast/cvast-arches/blob/master/docker/entrypoint/cvast-entrypoint.sh
 

Make sure you place your own entrypoint file into the `/docker/entrypoint` 
folder in the Docker container:
E.g. like I do in my Dockerfile: `COPY ./docker/entrypoint 
/docker/entrypoint`


Let me know how it goes!

Vincent


On Tuesday, 13 June 2017 14:15:22 UTC+2, Vincent Meijer wrote:
>
> Posting Kepa's reply:
>
>
> Hi Vincent, thanks for that link! No problems pulling and running Arches, 
> works great!
> Really appreciate an easy to use version of Arches to test it out now 
> while writing a proposal to deploy it more permanently. Especially as 
> you're in between major version numbers...
>
> Can you recommend how to best add some existing sample datasets into the 
> docker instance, like the one at 
> https://github.com/archesproject/disco_data ? Do you know of any others 
> more archaeological-site specific?
>
> Thanks!
>
> Kepa
>
>
> On Thursday, 8 January 2015 14:53:40 UTC+1, Rita Sinha wrote:
>>
>> Hi,
>>
>>  I have been recently lurking around open source projects when I came 
>> across  The Arches Project and developed keen interest in contributing to 
>> the org.
>>
>> After going through the project, I'm eager to improve the existing 
>> installation of Arches.
>>
>> After going through the current installation guide, I would like to 
>> suggest using Docker to deploy Arches. 
>>
>> For those not familiar with docker, can take the reference from here-
>>
>> http://en.wikipedia.org/wiki/Docker_(software)
>>
>> Regards,
>> Rita Sinha
>>
>

-- 
-- To post, send email to archesproject@googlegroups.com. To unsubscribe, send 
email to archesproject+unsubscr...@googlegroups.com. For more information, 
visit https://groups.google.com/d/forum/archesproject?hl=en
--- 
You received this message because you are subscribed to the Google Groups 
"Arches Project" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to archesproject+unsubscr...@googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

[Arches] Re: Using Docker for deploying Arches

[Vincent Meijer]

Posting Kepa's reply:


Hi Vincent, thanks for that link! No problems pulling and running Arches, 
works great!
Really appreciate an easy to use version of Arches to test it out now while 
writing a proposal to deploy it more permanently. Especially as you're in 
between major version numbers...

Can you recommend how to best add some existing sample datasets into the 
docker instance, like the one at https://github.com/archesproject/disco_data ? 
Do you know of any others more archaeological-site specific?

Thanks!

Kepa


On Thursday, 8 January 2015 14:53:40 UTC+1, Rita Sinha wrote:
>
> Hi,
>
>  I have been recently lurking around open source projects when I came 
> across  The Arches Project and developed keen interest in contributing to 
> the org.
>
> After going through the project, I'm eager to improve the existing 
> installation of Arches.
>
> After going through the current installation guide, I would like to 
> suggest using Docker to deploy Arches. 
>
> For those not familiar with docker, can take the reference from here-
>
> http://en.wikipedia.org/wiki/Docker_(software)
>
> Regards,
> Rita Sinha
>

-- 
-- To post, send email to archesproject@googlegroups.com. To unsubscribe, send 
email to archesproject+unsubscr...@googlegroups.com. For more information, 
visit https://groups.google.com/d/forum/archesproject?hl=en
--- 
You received this message because you are subscribed to the Google Groups 
"Arches Project" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to archesproject+unsubscr...@googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

[Arches] Re: Using Docker for deploying Arches

[Vincent Meijer]

Hey lymankj,

Check out this fork of Arches, which will be included in the official 
Arches repo soon: https://github.com/cvast/arches/tree/1650_docker_support 

The Readme is 
here: https://github.com/cvast/arches/tree/1650_docker_support/docker 

Please note that this is Arches v4 and it's still in beta (both the Docker 
image and Arches itself). 
If you need v3, let me know and I can send you a Dockerfile that does more 
or less what you need.


Vincent


On Wednesday, June 7, 2017 at 2:03:58 AM UTC+2, lymankj wrote:
>
> Hi! Is this version still in development? Could not get it to run 
> successfully by running 'docker-compose up'. Do you have any other 
> instructions? Also, does it support data volumes for persistent data?
>
> On Monday, December 12, 2016 at 7:01:17 AM UTC-10, Vincent Meijer wrote:
>>
>> Hi everyone, 
>>
>> I was wondering if anyone ever had any success with using Jae's or my 
>> Docker-ready version of Arches.
>>
>>
>> FYI: We moved our repositories to Github. Our Arches implementation can 
>> now be found here: https://github.com/cvast/cvast-arches 
>> (At the moment I only use static pages, as we are still working on the 
>> database part.)
>>
>> For other useful tools, see: https://github.com/cvast/
>>
>>
>> Vincent
>>
>> On Thursday, 8 January 2015 08:53:40 UTC-5, Rita Sinha wrote:
>>>
>>> Hi,
>>>
>>>  I have been recently lurking around open source projects when I came 
>>> across  The Arches Project and developed keen interest in contributing to 
>>> the org.
>>>
>>> After going through the project, I'm eager to improve the existing 
>>> installation of Arches.
>>>
>>> After going through the current installation guide, I would like to 
>>> suggest using Docker to deploy Arches. 
>>>
>>> For those not familiar with docker, can take the reference from here-
>>>
>>> http://en.wikipedia.org/wiki/Docker_(software)
>>>
>>> Regards,
>>> Rita Sinha
>>>
>>

-- 
-- To post, send email to archesproject@googlegroups.com. To unsubscribe, send 
email to archesproject+unsubscr...@googlegroups.com. For more information, 
visit https://groups.google.com/d/forum/archesproject?hl=en
--- 
You received this message because you are subscribed to the Google Groups 
"Arches Project" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to archesproject+unsubscr...@googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

[Arches] Re: First install - missing components?

[Vincent Meijer]

Hi Bastien,

When you run `python manage.py packages -o livereload`, did you first 
activate the virtualenv?

`source /ENV/bin/activate` on linux


As far as buttons doing nothing, that could be because not all parts in 
Arches v4 are finished yet. 
I sometimes get javascript errors when I have no actual resources/data in 
my database. Try adding e.g. a Heritage Resource and see if the errors 
persist. 

Vincent

On Saturday, 20 May 2017 05:01:59 UTC-4, Bastien Guerry wrote:
>
> Dear all, 
>
> I tried to install Arches 4 on my machine (Ubuntu 16.04) by following 
> the instructions here: http://arches4.readthedocs.io/en/latest/ 
>
> The app runs fine, I can login as an admin, but while exploring the 
> dashboard, I had some problems: 
>
> - Failed to load resource: net::ERR_CONNECTION_REFUSED livereload.js 
>   (localhost:35729) -- browsing through the issues on github, I then 
>   figured out I could use this: 
>
>   python manage.py packages -o livereload 
>
>   but I get this error: ImportError: No module named livereload 
>
> - When clicking on the Map Layer Manager icon, the js console says: 
>
>   Uncaught TypeError: Unable to process binding "if: function 
>   (){return selection().nodeid }" Message: Cannot read property 
>   'nodeid' of null at if (eval at parseBindingsString 
>   (knockout.js:68), :3:73) 
>
> In general, several buttons in the dashboard are not triggering any 
> action, and I'm not sure how to test the installation further, it 
> looks like some js components are missing (e.g. there is no leaflet 
> in media/bower_components) and some service should be started (like 
> livereload.) 
>
> Any hint on how to fix these problems? 
>
> I'm running Chromium version 58.0.3029.110 Built on Ubuntu 16.04. 
>
> Thanks a lot! 
>
> -- 
>  Bastien 
>

-- 
-- To post, send email to archesproject@googlegroups.com. To unsubscribe, send 
email to archesproject+unsubscr...@googlegroups.com. For more information, 
visit https://groups.google.com/d/forum/archesproject?hl=en
--- 
You received this message because you are subscribed to the Google Groups 
"Arches Project" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to archesproject+unsubscr...@googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

[Arches] AWS Elasticsearch authentication

[Vincent Meijer]

I use AWS Elasticsearch Service and I am having trouble setting its access 
policy.

One option to manage access to ES is whitelisting individual IP addresses, 
which is not a real option for me, as I run everything in clusters and I 
create and destroy EC2 instances all the time.

Another option is to set up an Nginx proxy through which I route all 
traffic to ES, so that I only have to whitelist a single IP. Yet, this 
implies overhead and additional cost.

The third option is to use IAM roles, which can be thought of as user 
accounts (with id and secret key). However, in this case requests sent to 
Elasticsearch need to be signed by Arches.
E.g. using this tool: https://github.com/DavidMuller/aws-requests-auth 


Would this use case be general enough to include this in Arches?
If not, how would I go about editing and overwriting the code in 
arches/app/search to accomplish this?
Especially since Arches does not seem to use the `requests` module.

Thanks very much,
Vincent 

-- 
-- To post, send email to archesproject@googlegroups.com. To unsubscribe, send 
email to archesproject+unsubscr...@googlegroups.com. For more information, 
visit https://groups.google.com/d/forum/archesproject?hl=en
--- 
You received this message because you are subscribed to the Google Groups 
"Arches Project" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to archesproject+unsubscr...@googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

Re: [Arches] IDE for Django

[Vincent Meijer]

https://xkcd.com/1823/

On Friday, 12 May 2017 09:19:02 UTC-4, Vincent Meijer wrote:
>
> I'll have a look at them, thanks!
>
> On Thursday, 11 May 2017 13:04:13 UTC-4, Alexei Peters wrote:
>>
>> Hi Vincent,
>> I personally use Sublime Text (https://www.sublimetext.com/) and there 
>> are others in our office that use Atom (https://atom.io/).
>> I don't use any kind of automatic linter, but sublime as well as atom 
>> both support a rich ecosystem of plugins.  A little googing found these (
>> https://github.com/squ1b3r/Djaneiro) and (
>> https://atom.io/packages/django-atom).  There are more.
>> Hope that helps,
>> Alexei
>>
>>
>> Director of Web Development - Farallon Geographics, Inc. - 971.227.3173
>>
>> On Tue, May 9, 2017 at 10:27 AM, Vincent Meijer <meijer@gmail.com> 
>> wrote:
>>
>>> I'm curious to learn which IDE people use to develop Arches (core) or 
>>> their Arches custom app.
>>>
>>> I currently use Visual Studio Code with the python and Django Template 
>>> extensions.
>>> Although I really like VSC, when developing Django templates I get a lot 
>>> of false linting errors, as it doesn't seem to understand Django all tags 
>>> (e.g. tags like {% autoescape off %}  in 
>>> arches/app/templates/base-manager.htm).
>>>
>>> Do other people have more success with Django development?
>>>
>>> Best,
>>> Vincent
>>>
>>>
>>> -- 
>>> -- To post, send email to arches...@googlegroups.com. To unsubscribe, 
>>> send email to archesprojec...@googlegroups.com. For more information, 
>>> visit https://groups.google.com/d/forum/archesproject?hl=en
>>> --- 
>>> You received this message because you are subscribed to the Google 
>>> Groups "Arches Project" group.
>>> To unsubscribe from this group and stop receiving emails from it, send 
>>> an email to archesprojec...@googlegroups.com.
>>> For more options, visit https://groups.google.com/d/optout.
>>>
>>
>>

-- 
-- To post, send email to archesproject@googlegroups.com. To unsubscribe, send 
email to archesproject+unsubscr...@googlegroups.com. For more information, 
visit https://groups.google.com/d/forum/archesproject?hl=en
--- 
You received this message because you are subscribed to the Google Groups 
"Arches Project" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to archesproject+unsubscr...@googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

Re: [Arches] IDE for Django

[Vincent Meijer]

I'll have a look at them, thanks!

On Thursday, 11 May 2017 13:04:13 UTC-4, Alexei Peters wrote:
>
> Hi Vincent,
> I personally use Sublime Text (https://www.sublimetext.com/) and there 
> are others in our office that use Atom (https://atom.io/).
> I don't use any kind of automatic linter, but sublime as well as atom both 
> support a rich ecosystem of plugins.  A little googing found these (
> https://github.com/squ1b3r/Djaneiro) and (
> https://atom.io/packages/django-atom).  There are more.
> Hope that helps,
> Alexei
>
>
> Director of Web Development - Farallon Geographics, Inc. - 971.227.3173
>
> On Tue, May 9, 2017 at 10:27 AM, Vincent Meijer <meijer@gmail.com 
> > wrote:
>
>> I'm curious to learn which IDE people use to develop Arches (core) or 
>> their Arches custom app.
>>
>> I currently use Visual Studio Code with the python and Django Template 
>> extensions.
>> Although I really like VSC, when developing Django templates I get a lot 
>> of false linting errors, as it doesn't seem to understand Django all tags 
>> (e.g. tags like {% autoescape off %}  in 
>> arches/app/templates/base-manager.htm).
>>
>> Do other people have more success with Django development?
>>
>> Best,
>> Vincent
>>
>>
>> -- 
>> -- To post, send email to arches...@googlegroups.com . To 
>> unsubscribe, send email to archesprojec...@googlegroups.com . 
>> For more information, visit 
>> https://groups.google.com/d/forum/archesproject?hl=en
>> --- 
>> You received this message because you are subscribed to the Google Groups 
>> "Arches Project" group.
>> To unsubscribe from this group and stop receiving emails from it, send an 
>> email to archesprojec...@googlegroups.com .
>> For more options, visit https://groups.google.com/d/optout.
>>
>
>

-- 
-- To post, send email to archesproject@googlegroups.com. To unsubscribe, send 
email to archesproject+unsubscr...@googlegroups.com. For more information, 
visit https://groups.google.com/d/forum/archesproject?hl=en
--- 
You received this message because you are subscribed to the Google Groups 
"Arches Project" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to archesproject+unsubscr...@googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

[Arches] IDE for Django

[Vincent Meijer]

I'm curious to learn which IDE people use to develop Arches (core) or their 
Arches custom app.

I currently use Visual Studio Code with the python and Django Template 
extensions.
Although I really like VSC, when developing Django templates I get a lot of 
false linting errors, as it doesn't seem to understand Django all tags 
(e.g. tags like {% autoescape off %}  in 
arches/app/templates/base-manager.htm).

Do other people have more success with Django development?

Best,
Vincent


-- 
-- To post, send email to archesproject@googlegroups.com. To unsubscribe, send 
email to archesproject+unsubscr...@googlegroups.com. For more information, 
visit https://groups.google.com/d/forum/archesproject?hl=en
--- 
You received this message because you are subscribed to the Google Groups 
"Arches Project" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to archesproject+unsubscr...@googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

[Arches] bower.json

[Vincent Meijer]

I noticed the bower.json in `arches/install/arches-templates/project_name/` 
changed since I created my custom app.

Is there a recommended way to keep up with these changes?
I assume this will cause breaking changes when upgrading our custom apps to 
use future Arches v4 releases.

Vincent

-- 
-- To post, send email to archesproject@googlegroups.com. To unsubscribe, send 
email to archesproject+unsubscr...@googlegroups.com. For more information, 
visit https://groups.google.com/d/forum/archesproject?hl=en
--- 
You received this message because you are subscribed to the Google Groups 
"Arches Project" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to archesproject+unsubscr...@googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

[Arches] Re: Migrating from Arches v3 to v4

[Vincent Meijer]

Hello Joel,

The graphs that come default with v4 are 
here: 
https://github.com/archesproject/arches/tree/master/arches/db/graphs/resource_models

Is that what you were looking for? 

Best,
Vincent

On Sunday, 30 April 2017 04:06:35 UTC-4, Joel Aldor wrote:
>
> Hi Dennis,
>
> I'm done with Step 1 of the migration. For Step 2, we wish to retain first 
> the default HIP graphs we had for version 3, before we make any changes to 
> our data models using the Arches Designer. Could you provide us the updated 
> graphs for version 4?
>
> Thank you,
>
> Joel
>
> On Friday, April 7, 2017 at 3:20:47 AM UTC+8, Dennis Wuthrich wrote:
>>
>> Migrating from v3 to v4
>>
>> We've heard from a few people, asking about migrating from Arches v3 to 
>> v4.  To help you understand the basic approach, we've outlined the workflow 
>> as a series of steps:
>>
>> Step 1. Export your RDM/Reference data from v3
>> Step 2. Create graphs in v4
>> Step 3. Migrate business data from v3 to v4
>>
>> Of course, the devil is in the details!
>>
>> *Step 1: Export RDM data from v3.*
>> We're working on a patch that will allow you to use the RDM SKOS exporter 
>> (Tools -> Export Scheme) to export your existing RDM from v3 into a format 
>> that v4 can read.  Once you've exported your existing concepts, use the v4 
>> RDM to import them.
>>
>> We've introduced a new feature in v4 called "collections" that allow you 
>> to manage dropdowns in data entry forms in a manner that adhers to the skos 
>> standard.  You'll need to use the RDM to create collections for your 
>> dropdowns.
>>
>>
>> *Step 2: Create graphs in v4*
>> In v4, Arches provides a way to create and validate graphs interactively. 
>>  The "Arches Designer" in v4 offers visual graph creation tools that you'll 
>> need to use to create graphs.
>>
>> If you're using the default HIP graphs in v3, this step is pretty easy as 
>> we'll provide updated versions for v4.  If you've created your own graphs 
>> (or modified the existing v3 HIP graphs), you'll need to use the Arches 
>> Desiger to create your graphs in v4.  
>>
>> In either case, migrating from v3 to v4 is a chance for you to 
>> re-evaluate your data models and implement improvements based on your 
>> experience with v3.  You'll find that v4 comes with a library of re-usable 
>> "branches" (or sub-graphs) that make designer a graph much easier than for 
>> v3.
>>
>> One last note: v4 validates graphs to ensure that they are consistent 
>> with the CIDOC CRM classes and properties.  This means that graphs in v4 
>> need to be semantically valid (NOT a requirement of v3).
>>
>>
>> *Step 3: Migrate business data from v3 to v4*
>> After configuring the RDM and defining graphs in v4, you're ready to 
>> import your v3 data.
>>
>> To start, export data from your v3 instance of Arches.  V3 comes with a 
>> command that will export your business data to JSON.  You'll need to use a 
>> JSON to csv converter (or write a script to do it), then use v4's CSV 
>> import tools to pull your data into Arches.  V4 comes with mapping tools 
>> that allow you to map information in a CSV file to specific nodes in a 
>> resource model.
>>
>> Of course, there are always lots of details when working with a specific 
>> dataset.  But the basic process can be broken down to the 3 steps outlined.
>>
>> We at Farallon will be supporting v3 to v4 migrations, but there's no 
>> reason you can't do it yourself.
>>
>> Hope this helps...  
>>
>> Cheers,
>>
>> Dennis
>>
>

-- 
-- To post, send email to archesproject@googlegroups.com. To unsubscribe, send 
email to archesproject+unsubscr...@googlegroups.com. For more information, 
visit https://groups.google.com/d/forum/archesproject?hl=en
--- 
You received this message because you are subscribed to the Google Groups 
"Arches Project" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to archesproject+unsubscr...@googlegroups.com.
For more options, visit https://groups.google.com/d/optout.