Re: [Arches] Loading Reference Data in v4?

[Bojan Kastelic]

Hi Adam,
thanks for such a quick reply. I'll look into it in the following days. It 
looks exactly what I was looking for :)

Best, 
Bojan

On Thursday, September 14, 2017 at 5:59:08 AM UTC+2, Adam Cox wrote:
>
> Hi Bojan, I am actually working on this exact process right now, because I 
> had a similar need.
>
> The scripts I have been working on, along with some example data, are in 
> this repo https://github.com/legiongis/fpan-data in the utils directory. 
> The main script, thesaurus_from_csvs.py, will create an entire thesaurus 
> from a directory full of csv files. A new top concept is created for each 
> file, and a concept is made for every row within it. Also, a collection is 
> made for each csv. In the script you are able to define some information 
> about the files -- whether an alphabetical sortorder is applied to the 
> contents of each one, which column index holds the label, etc. You can also 
> choose to reuse UUIDs that are already present in the csvs. This is 
> important, because in v4 these UUIDs need to be consistent in the business 
> data (in v3 the conceptids in the authority files where used instead). To 
> this end, I made the other script, which will take the csv files and add a 
> column of UUIDs to each one, if one doesn't exist.
>
> The whole setup is pretty limited though, no capacity for altlabels, and, 
> more importantly, no ability to indicate "collector" concepts or 
> hierarchies beneath a top concept at this time. But it should be easy to 
> augment if necessary; I tried to construct it a modular way. I would 
> welcome additions to that repo if you end up using those scripts.
>
> Adam
>
>
>
> On Wed, Sep 13, 2017 at 4:03 PM, Bojan Kastelic  > wrote:
>
>> Hi,
>> is there any way to import of concepts like it was in v3 (via 
>> CSV file)? I'am migrating my project from v3 to v4 and all my data 
>> (concepts data) are imported from a backend system (import files 
>> (.csv & .arches in v3) are created via VBA scripts)). I managed to prepare 
>> a new CSV file for importing business data, but I can not find a way of 
>> importing data for concepts (dropdown lists) from a CSV file like it was 
>> possible in v3. Is there any other option for importing large lists of 
>> concepts (other than via RDF which is much more complicated to generate 
>> than a CSV file)? Like in v3 I would like to automate the whole process of 
>> preparing and importing all neccessary data to Arches, so manual input of 
>> concepts via RDM is not acceptable (all changes of these lists are made in 
>> backend system).
>>
>> Thanks, Bojan
>>
>> -- 
>> -- To post, send email to arches...@googlegroups.com . To 
>> unsubscribe, send email to archesprojec...@googlegroups.com . 
>> For more information, visit 
>> https://groups.google.com/d/forum/archesproject?hl=en
>> --- 
>> You received this message because you are subscribed to the Google Groups 
>> "Arches Project" group.
>> To unsubscribe from this group and stop receiving emails from it, send an 
>> email to archesprojec...@googlegroups.com .
>> For more options, visit https://groups.google.com/d/optout.
>>
>
>

-- 
-- To post, send email to archesproject@googlegroups.com. To unsubscribe, send 
email to archesproject+unsubscr...@googlegroups.com. For more information, 
visit https://groups.google.com/d/forum/archesproject?hl=en
--- 
You received this message because you are subscribed to the Google Groups 
"Arches Project" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to archesproject+unsubscr...@googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

Re: [Arches] Loading Reference Data in v4?

[Adam Cox]

Hi Bojan, I am actually working on this exact process right now, because I
had a similar need.

The scripts I have been working on, along with some example data, are in
this repo https://github.com/legiongis/fpan-data in the utils directory.
The main script, thesaurus_from_csvs.py, will create an entire thesaurus
from a directory full of csv files. A new top concept is created for each
file, and a concept is made for every row within it. Also, a collection is
made for each csv. In the script you are able to define some information
about the files -- whether an alphabetical sortorder is applied to the
contents of each one, which column index holds the label, etc. You can also
choose to reuse UUIDs that are already present in the csvs. This is
important, because in v4 these UUIDs need to be consistent in the business
data (in v3 the conceptids in the authority files where used instead). To
this end, I made the other script, which will take the csv files and add a
column of UUIDs to each one, if one doesn't exist.

The whole setup is pretty limited though, no capacity for altlabels, and,
more importantly, no ability to indicate "collector" concepts or
hierarchies beneath a top concept at this time. But it should be easy to
augment if necessary; I tried to construct it a modular way. I would
welcome additions to that repo if you end up using those scripts.

Adam



On Wed, Sep 13, 2017 at 4:03 PM, Bojan Kastelic <
bojan.kastelic@gmail.com> wrote:

> Hi,
> is there any way to import of concepts like it was in v3 (via
> CSV file)? I'am migrating my project from v3 to v4 and all my data
> (concepts data) are imported from a backend system (import files
> (.csv & .arches in v3) are created via VBA scripts)). I managed to prepare
> a new CSV file for importing business data, but I can not find a way of
> importing data for concepts (dropdown lists) from a CSV file like it was
> possible in v3. Is there any other option for importing large lists of
> concepts (other than via RDF which is much more complicated to generate
> than a CSV file)? Like in v3 I would like to automate the whole process of
> preparing and importing all neccessary data to Arches, so manual input of
> concepts via RDM is not acceptable (all changes of these lists are made in
> backend system).
>
> Thanks, Bojan
>
> --
> -- To post, send email to archesproject@googlegroups.com. To unsubscribe,
> send email to archesproject+unsubscr...@googlegroups.com. For more
> information, visit https://groups.google.com/d/forum/archesproject?hl=en
> ---
> You received this message because you are subscribed to the Google Groups
> "Arches Project" group.
> To unsubscribe from this group and stop receiving emails from it, send an
> email to archesproject+unsubscr...@googlegroups.com.
> For more options, visit https://groups.google.com/d/optout.
>

-- 
-- To post, send email to archesproject@googlegroups.com. To unsubscribe, send 
email to archesproject+unsubscr...@googlegroups.com. For more information, 
visit https://groups.google.com/d/forum/archesproject?hl=en
--- 
You received this message because you are subscribed to the Google Groups 
"Arches Project" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to archesproject+unsubscr...@googlegroups.com.
For more options, visit https://groups.google.com/d/optout.