I'll have Nathan load them to that same Dropbox folder On Wed, Jan 10, 2018 at 12:25 PM, Adam Cox <[email protected]> wrote:
> Good thought Rob. I haven't worked with any extended vocabularies. If you > would like to share them here (if appropriate) and let me know how to load > them that may be as good a place as any to start. > > Adam > > On Wed, Jan 10, 2018 at 2:22 PM, Robert Sanderson <[email protected]> > wrote: > >> >> HI Adam, >> >> Yes, this uses the extended vocabulary features that were added mid-late >> last year. I'm happy to provide the latest ontology files if that would be >> useful, but maybe there's a better way to share such configurations with >> the Arches community as a whole? >> >> Thanks! >> >> Rob >> >> On Wed, Jan 10, 2018 at 12:16 PM, Adam Cox <[email protected]> wrote: >> >>> Hi Nathan and Joshua, thanks for the data for testing. I had errors >>> while importing your graphs into a new 4.0.1 arches installation >>> >>> u"'https://linked.art/ns/Payment' is not a valid CIDOC CRM v6.2 >>> ontology class" >>> u"'http://www.w3.org/2001/XMLSchema#string' is not a valid CIDOC CRM >>> v6.2 ontology class" >>> >>> perhaps you are using a different ontology than I have. >>> >>> However, in looking through the Person.json resource model it looks like >>> the nodegroup for the "part value" and "Part Type" nodes is "1", meaning >>> that only one value is allowed for it. To change this, you'll need to go >>> into the card manager, find the card that holds these two nodes, and switch >>> the "Allow multiple values" option in the Settings for that card. After >>> that you should be able to import the CSV. >>> >>> Joshua, I encountered the exact same problems a couple months ago, and >>> you'll see that Ryan made basically the same fix >>> https://github.com/archesproject/arches/blob/master/arches/a >>> pp/utils/data_management/resources/formats/csvfile.py#L526. I actually >>> just tested this and closed the issue earlier today :) >>> https://github.com/archesproject/arches/issues/2732. >>> >>> Hope that helps, >>> >>> Adam >>> >>> >>> On Wed, Jan 10, 2018 at 1:33 PM, Joshua Gomez <[email protected]> >>> wrote: >>> >>>> We should also mention that a few edits to the code were made before >>>> the CSV importer worked. I have not submitted these changes in a Pull >>>> Request yet, as I am still 100% certain that those changes are unrelated to >>>> the problem described by Nathan. For reference, here is the diff to the >>>> code: >>>> >>>> diff --git a/arches/app/utils/data_management/resources/formats/csvfile.py >>>> b/arches/app/utils/data_management/resources/formats/csvfile.py >>>> index dbecd9a..7a11e08 100644 >>>> --- a/arches/app/utils/data_management/resources/formats/csvfile.py >>>> +++ b/arches/app/utils/data_management/resources/formats/csvfile.py >>>> @@ -396,18 +396,18 @@ class CsvReader(Reader): >>>> # return deepcopy(blank_tile) >>>> return cPickle.loads(cPickle.dumps(blank_tile, >>>> -1)) >>>> >>>> - def check_required_nodes(tile, required_nodes, >>>> all_nodes): >>>> + def check_required_nodes(target_tile, required_nodes, >>>> all_nodes): >>>> # Check that each required node in a tile is >>>> populated. >>>> errors = [] >>>> if len(required_nodes) > 0: >>>> - if target_tile.data != {}: >>>> - for target_k, target_v in >>>> target_tile.data.iteritems(): >>>> + if getattr(target_tile, 'data', None) != {}: >>>> + for target_k, target_v in >>>> getattr(target_tile, 'data', {}).iteritems(): >>>> if target_k in required_nodes.keys() >>>> and target_v is None: >>>> populated_tiles.pop(populated >>>> _tiles.index(target_tile)) >>>> errors.append({'type': 'WARNING', >>>> 'message': 'The {0} node is required and must be populated in order to >>>> populate the {1} nodes. This data was not i >>>> elif target_tile.tiles != None: >>>> - for tile in tiles: >>>> - check_required_nodes(tile) >>>> + for tile in target_tile.tiles: >>>> + check_required_nodes(tile, >>>> required_nodes, all_nodes) >>>> if len(errors) > 0: >>>> self.errors += errors >>>> >>>> >>>> >>>> >>>> On Wednesday, January 10, 2018 at 11:26:04 AM UTC-8, Nathan Lomeli >>>> wrote: >>>>> >>>>> Here's a Dropbox link to the files mentioned below: >>>>> >>>>> https://www.dropbox.com/sh/1wx9x4kdk5b7a33/AACqzIROyoT2R-03l >>>>> AgXE-qta?dl=0 >>>>> >>>>> >>>>> >>>>> We are performing a CSV resources import (for our "Person" model) >>>>> using the included mapping file. Everything seems to be importing >>>>> properly >>>>> except for this pair of columns: >>>>> >>>>> *name_part_type name_part_value* >>>>> >>>>> In accordance with the CSV import formatting described in the Arches >>>>> documention (link below), each new concept type and value appears on a new >>>>> row. >>>>> >>>>> http://arches4.readthedocs.io/en/latest/import-export/#conce >>>>> pt-values-in-csvs-and-the-concepts-file >>>>> >>>>> The import process seems to run successfully, but when we inspect the >>>>> imported data, only the first concept-value pair has been loaded, not >>>>> those >>>>> on subsequent CSV rows for a given resource. >>>>> >>>>> We are not sure if this failure to load a list of concept-values is >>>>> problem with the graph, our card settings, our import process, or the >>>>> formatting of our CSV or mapping files. >>>>> >>>>> Our Arches graph data is included in order for the problem to be >>>>> reproduced (again, see link to Dropbox above). >>>>> >>>>> -- >>>> -- To post, send email to [email protected]. To >>>> unsubscribe, send email to [email protected]. >>>> For more information, visit https://groups.google.com/d/fo >>>> rum/archesproject?hl=en >>>> --- >>>> You received this message because you are subscribed to the Google >>>> Groups "Arches Project" group. >>>> To unsubscribe from this group and stop receiving emails from it, send >>>> an email to [email protected]. >>>> For more options, visit https://groups.google.com/d/optout. >>>> >>> >>> -- >>> -- To post, send email to [email protected]. To >>> unsubscribe, send email to [email protected]. >>> For more information, visit https://groups.google.com/d/fo >>> rum/archesproject?hl=en >>> --- >>> You received this message because you are subscribed to the Google >>> Groups "Arches Project" group. >>> To unsubscribe from this group and stop receiving emails from it, send >>> an email to [email protected]. >>> For more options, visit https://groups.google.com/d/optout. >>> >> >> >> >> -- >> Rob Sanderson >> Semantic Architect >> The Getty Trust >> Los Angeles, CA 90049 >> > > -- -- To post, send email to [email protected]. To unsubscribe, send email to [email protected]. For more information, visit https://groups.google.com/d/forum/archesproject?hl=en --- You received this message because you are subscribed to the Google Groups "Arches Project" group. To unsubscribe from this group and stop receiving emails from it, send an email to [email protected]. For more options, visit https://groups.google.com/d/optout.
