Good thought Rob. I haven't worked with any extended vocabularies. If you would like to share them here (if appropriate) and let me know how to load them that may be as good a place as any to start.
Adam On Wed, Jan 10, 2018 at 2:22 PM, Robert Sanderson <[email protected]> wrote: > > HI Adam, > > Yes, this uses the extended vocabulary features that were added mid-late > last year. I'm happy to provide the latest ontology files if that would be > useful, but maybe there's a better way to share such configurations with > the Arches community as a whole? > > Thanks! > > Rob > > On Wed, Jan 10, 2018 at 12:16 PM, Adam Cox <[email protected]> wrote: > >> Hi Nathan and Joshua, thanks for the data for testing. I had errors while >> importing your graphs into a new 4.0.1 arches installation >> >> u"'https://linked.art/ns/Payment' is not a valid CIDOC CRM v6.2 ontology >> class" >> u"'http://www.w3.org/2001/XMLSchema#string' is not a valid CIDOC CRM >> v6.2 ontology class" >> >> perhaps you are using a different ontology than I have. >> >> However, in looking through the Person.json resource model it looks like >> the nodegroup for the "part value" and "Part Type" nodes is "1", meaning >> that only one value is allowed for it. To change this, you'll need to go >> into the card manager, find the card that holds these two nodes, and switch >> the "Allow multiple values" option in the Settings for that card. After >> that you should be able to import the CSV. >> >> Joshua, I encountered the exact same problems a couple months ago, and >> you'll see that Ryan made basically the same fix >> https://github.com/archesproject/arches/blob/master/arches/ >> app/utils/data_management/resources/formats/csvfile.py#L526. I actually >> just tested this and closed the issue earlier today :) >> https://github.com/archesproject/arches/issues/2732. >> >> Hope that helps, >> >> Adam >> >> >> On Wed, Jan 10, 2018 at 1:33 PM, Joshua Gomez <[email protected]> >> wrote: >> >>> We should also mention that a few edits to the code were made before the >>> CSV importer worked. I have not submitted these changes in a Pull Request >>> yet, as I am still 100% certain that those changes are unrelated to the >>> problem described by Nathan. For reference, here is the diff to the code: >>> >>> diff --git a/arches/app/utils/data_management/resources/formats/csvfile.py >>> b/arches/app/utils/data_management/resources/formats/csvfile.py >>> index dbecd9a..7a11e08 100644 >>> --- a/arches/app/utils/data_management/resources/formats/csvfile.py >>> +++ b/arches/app/utils/data_management/resources/formats/csvfile.py >>> @@ -396,18 +396,18 @@ class CsvReader(Reader): >>> # return deepcopy(blank_tile) >>> return cPickle.loads(cPickle.dumps(blank_tile, -1)) >>> >>> - def check_required_nodes(tile, required_nodes, >>> all_nodes): >>> + def check_required_nodes(target_tile, required_nodes, >>> all_nodes): >>> # Check that each required node in a tile is >>> populated. >>> errors = [] >>> if len(required_nodes) > 0: >>> - if target_tile.data != {}: >>> - for target_k, target_v in >>> target_tile.data.iteritems(): >>> + if getattr(target_tile, 'data', None) != {}: >>> + for target_k, target_v in >>> getattr(target_tile, 'data', {}).iteritems(): >>> if target_k in required_nodes.keys() >>> and target_v is None: >>> populated_tiles.pop(populated >>> _tiles.index(target_tile)) >>> errors.append({'type': 'WARNING', >>> 'message': 'The {0} node is required and must be populated in order to >>> populate the {1} nodes. This data was not i >>> elif target_tile.tiles != None: >>> - for tile in tiles: >>> - check_required_nodes(tile) >>> + for tile in target_tile.tiles: >>> + check_required_nodes(tile, >>> required_nodes, all_nodes) >>> if len(errors) > 0: >>> self.errors += errors >>> >>> >>> >>> >>> On Wednesday, January 10, 2018 at 11:26:04 AM UTC-8, Nathan Lomeli wrote: >>>> >>>> Here's a Dropbox link to the files mentioned below: >>>> >>>> https://www.dropbox.com/sh/1wx9x4kdk5b7a33/AACqzIROyoT2R-03l >>>> AgXE-qta?dl=0 >>>> >>>> >>>> >>>> We are performing a CSV resources import (for our "Person" model) using >>>> the included mapping file. Everything seems to be importing properly >>>> except for this pair of columns: >>>> >>>> *name_part_type name_part_value* >>>> >>>> In accordance with the CSV import formatting described in the Arches >>>> documention (link below), each new concept type and value appears on a new >>>> row. >>>> >>>> http://arches4.readthedocs.io/en/latest/import-export/#conce >>>> pt-values-in-csvs-and-the-concepts-file >>>> >>>> The import process seems to run successfully, but when we inspect the >>>> imported data, only the first concept-value pair has been loaded, not those >>>> on subsequent CSV rows for a given resource. >>>> >>>> We are not sure if this failure to load a list of concept-values is >>>> problem with the graph, our card settings, our import process, or the >>>> formatting of our CSV or mapping files. >>>> >>>> Our Arches graph data is included in order for the problem to be >>>> reproduced (again, see link to Dropbox above). >>>> >>>> -- >>> -- To post, send email to [email protected]. To >>> unsubscribe, send email to [email protected]. >>> For more information, visit https://groups.google.com/d/fo >>> rum/archesproject?hl=en >>> --- >>> You received this message because you are subscribed to the Google >>> Groups "Arches Project" group. >>> To unsubscribe from this group and stop receiving emails from it, send >>> an email to [email protected]. >>> For more options, visit https://groups.google.com/d/optout. >>> >> >> -- >> -- To post, send email to [email protected]. To >> unsubscribe, send email to [email protected]. >> For more information, visit https://groups.google.com/d/fo >> rum/archesproject?hl=en >> --- >> You received this message because you are subscribed to the Google Groups >> "Arches Project" group. >> To unsubscribe from this group and stop receiving emails from it, send an >> email to [email protected]. >> For more options, visit https://groups.google.com/d/optout. >> > > > > -- > Rob Sanderson > Semantic Architect > The Getty Trust > Los Angeles, CA 90049 > -- -- To post, send email to [email protected]. To unsubscribe, send email to [email protected]. For more information, visit https://groups.google.com/d/forum/archesproject?hl=en --- You received this message because you are subscribed to the Google Groups "Arches Project" group. To unsubscribe from this group and stop receiving emails from it, send an email to [email protected]. For more options, visit https://groups.google.com/d/optout.
