Hi Alexei, thanks for your detailed indications!
Indeed there were errors in our imported graph (missing node and edges). We hadn't imported our latest version:-( After correcting these errors our legacy data seems to get imported into Arches: install_packages.sh runs through and tells "successfully_saved" for all sites However, when calling Arches in the browser now the "Initializing..." window gets stuck with the following JS errors: TypeError: Arches.config.App.primaryNameInfo is null ...Column1' : 'Name','additembuttontext' : 'Add Name','missingTypeInvalidMsg' : 'Al... en-us.js (line 27) TypeError: Arches.forms.OrganizationName is undefined ...Column1' : 'Name','additembuttontext' : 'Add Name','missingTypeInvalidMsg' : 'Al... en-us.js (line 27) TypeError: Arches.i18n.MapLayers is undefined data: Arches.i18n.MapLayers.basemaps Arches...ctor.js (line 51) Running build.sh again doesn't help. Which script builds the en-us.js? Could you send us a default version of this file? Ours should be the default version, but we have touched it in the past (not line 27). Any other ideas here? Thanks! -Tobias 2014-04-16 22:28 GMT+02:00 Alexei Peters <[email protected]>: > Hi Tobias, > I suspect some issue with the schema(essentially the db version of the > resource graph). > > Looking at the error, try this: > > Open a browser and point it to this endpoint (make sure runserver is > running): > Arches/EntityTypes/ARCHAEOLOGICAL HERITAGE (SITE).E27?f=json > > I'll spit out a json representation of your ARCHAEOLOGICAL HERITAGE (SITE).E27 > resource graph. > I'm guessing that it's somehow incomplete (maybe missing some key > Entitytypes) > You should see a top level node called ARCHAEOLOGICAL HERITAGE (SITE).E27 > followed by sub nodes that define the Entitytypes that actually collect > business data (like PLACE_CADASTRAL REFERENCE.E53). > Below that you should see a "steps" node. This node defines all the > intermediate nodes that need to be created from root to leaf in order to > create a valid branch within the graph. > > If you're missing entitytypes like PLACE_CADASTRAL REFERENCE.E53 then > somehow the graph didn't get imported into the system correctly. > If you look in the install directory of your package you should see a file > called resource_graphs.py and in that a method call "load_graphs". It's > that method that get's called to parse and load the csv files that define > your graphs. > I would start looking there for potential issues. > > Cheers > Alexei > > > Director of Web Development - Farallon Geographics, Inc. - 971.227.3173 > > > On Tue, Apr 15, 2014 at 9:12 AM, Tobias Kohr <[email protected]> wrote: > >> Hi Alexei, >> >> if we don't limit the list of resource types in settings.py, we are still >> stuck when running install_packages.sh with a different error: >> >> >> Traceback (most recent call last): >> File "../manage.py", line 28, in <module> >> execute_from_command_line(sys.argv) >> File >> "/arches-web/archesproject/virtualenv/ENV/local/lib/python2.7/site-packages/django/core/management/__init__.py", >> line 399, in execute_from_command_line >> utility.execute() >> File >> "/arches-web/archesproject/virtualenv/ENV/local/lib/python2.7/site-packages/django/core/management/__init__.py", >> line 392, in execute >> self.fetch_command(subcommand).run_from_argv(self.argv) >> File >> "/arches-web/archesproject/virtualenv/ENV/local/lib/python2.7/site-packages/django/core/management/base.py", >> line 242, in run_from_argv >> self.execute(*args, **options.__dict__) >> File >> "/arches-web/archesproject/virtualenv/ENV/local/lib/python2.7/site-packages/django/core/management/base.py", >> line 285, in execute >> output = self.handle(*args, **options) >> File "/arches-web/archesproject/build/management/commands/packages.py", >> line 41, in handle >> self.load_package(package) >> File "/arches-web/archesproject/build/management/commands/packages.py", >> line 46, in load_package >> install(settings.ROOT_DIR) >> File "/arches-web/archesproject/packages/i3mainz/setup.py", line 77, in >> install >> test_data.DataLoader().load(filepath) >> File "/arches-web/archesproject/db/Data/load_from_csv.py", line 95, in >> load >> return self.resourceListToEntities(resourceList) >> File "/arches-web/archesproject/db/Data/load_from_csv.py", line 123, in >> resourceListToEntities >> entity.create_from_mapping(row.resourcetype, >> schema[row.attributename]['steps'], row.attributename, row.attributevalue) >> KeyError: 'PLACE_CADASTRAL REFERENCE.E53' >> >> The odd underscore/no underscore syntax is consistent with the syntax in >> the files defining the graph. >> The error is provoked by an import csv that looks like this (first site): >> >> 1|ARCHAEOLOGICAL HERITAGE (SITE).E27|EXTERNAL XREF.E42|1|MONUMENT:1 >> 1|ARCHAEOLOGICAL HERITAGE (SITE).E27|EXTERNAL XREF >> TYPE.E55|EXTERNAL_XREF_TYPE_1000|MONUMENT:1 >> 1|ARCHAEOLOGICAL HERITAGE (SITE).E27|EXTERNAL XREF.E42|853|MONUMENT:1 >> 1|ARCHAEOLOGICAL HERITAGE (SITE).E27|EXTERNAL XREF >> TYPE.E55|EXTERNAL_XREF_TYPE_1001|MONUMENT:1 >> 1|ARCHAEOLOGICAL HERITAGE (SITE).E27|EXTERNAL XREF.E42|5|MONUMENT:1 >> 1|ARCHAEOLOGICAL HERITAGE (SITE).E27|EXTERNAL XREF >> TYPE.E55|EXTERNAL_XREF_TYPE_2000|MONUMENT:1 >> 1|ARCHAEOLOGICAL HERITAGE >> (SITE).E27|ADDRESS_TOWN/CITY.E45|ALBACH|ADDRESS-0 >> 1|ARCHAEOLOGICAL HERITAGE (SITE).E27|COMPILER.E82|FETSCH|COMPILER.E82-0 >> 1|ARCHAEOLOGICAL HERITAGE (SITE).E27|NAME TYPE.E55|NAME_TYPE_1|NAME.E41-1 >> 1|ARCHAEOLOGICAL HERITAGE (SITE).E27|NAME.E41|Albach|NAME.E41-1 >> 1|ARCHAEOLOGICAL HERITAGE (SITE).E27|SPATIAL >> COORDINATES_GEOMETRY.E47|POINT (8.79912945 50.55867308)|SPATIAL >> COORDINATES_GEOMETRY.E47-0 >> 1|ARCHAEOLOGICAL HERITAGE (SITE).E27|PLACE_CADASTRAL >> REFERENCE.E53|Reutereck|PLACE_CADASTRAL REFERENCE.E53-0 >> 1|ARCHAEOLOGICAL HERITAGE (SITE).E27|GEOMETRY >> QUALIFIER.E55|GEOMETRY_QUALIFIER_1000|SPATIAL COORDINATES_GEOMETRY.E47-0 >> 1|ARCHAEOLOGICAL HERITAGE (SITE).E27|INVESTIGATION >> TYPE.E55|INVESTIGATION_TYPE_2_1_3|INVESTIGATION TYPE.E55-0 >> 1|ARCHAEOLOGICAL HERITAGE (SITE).E27|ARCHAEOLOGICAL COMPONENT >> TYPE.E55|ARCHAEOLOGICAL_COMPONENT_ARCHAEOLOGICAL_COMPONENT_2100|COMPONENT.E18-0 >> 1|ARCHAEOLOGICAL HERITAGE (SITE).E27|COMPONENT CERTAINTY >> TYPE.E55|COMPONENT_CERTAINTY_1|COMPONENT.E18-0 >> 1|ARCHAEOLOGICAL HERITAGE (SITE).E27|CULTURAL >> PERIOD.E55|PERIOD_1310213|PHASE TYPE ASSIGNMENT.E17-0 >> 1|ARCHAEOLOGICAL HERITAGE (SITE).E27|PHASE TYPE ASSIGNMENT CERTAINTY >> TYPE.E55|PHASE_TYPE_ASSIGNMENT_CERTAINTY_2|PHASE TYPE ASSIGNMENT.E17-0 >> 1|ARCHAEOLOGICAL HERITAGE (SITE).E27|ARCHAEOLOGICAL HERITAGE (SITE) >> TYPE.E55|SITE_7|PHASE TYPE ASSIGNMENT.E17-0 >> 1|ARCHAEOLOGICAL HERITAGE (SITE).E27|SCIENTIFIC DATING >> METHOD.E55|DATING_10002|SCIENTIFIC DATING EVENT.E5-0 >> 1|ARCHAEOLOGICAL HERITAGE (SITE).E27|SUMMARY.E62|Datierendes Material: ; >> |SUMMARY.E62-0 >> >> When we leave out the PLACE_CADASTRAL REFERENCE.E53 information, >> INVESTIGATION TYPE.E55 throws the same error. >> >> We haven't finished building all authority files for our graph. Is this >> the problem or should the import process already work beforehand? >> >> I don't understand why PLACE_CADASTRAL REFERENCE.E53 causes an error, as >> it is already included in the default graph and shouldn't be affected by >> the authority files. >> >> The third column in the import csv should contain the node's name/label, >> however, and not the ID, correct? (e.g. PLACE_CADASTRAL REFERENCE.E53 >> instead of ARCHAEOLOGICAL HERITAGE.E27:PLACE_CADASTRAL REFERENCE.E53) >> >> Thanks for your help! >> Tobias >> >> >> 2014-04-12 4:55 GMT+02:00 Alexei Peters <[email protected]>: >> >> Hi Tobias, >>> You may have just found a bug that cropped up during the development of >>> version 2. I haven't had a chance to confirm myself buy I'll let the >>> community know what I find out. >>> Cheers, >>> Alexei >>> >>> Sent from my Windows Phone >>> ------------------------------ >>> From: Tobias Kohr <[email protected]> >>> Sent: 4/10/2014 6:36 AM >>> To: [email protected] >>> Subject: [Arches] Re: Integrating modified Authority Documents >>> >>> OK, the error did not have anything to do with our modified Authority >>> Documents. >>> >>> It was caused by the entry to limit Resource Types in the global >>> settings.py: >>> LIMIT_ENTITY_TYPES_TO_LOAD = ( >>> # override this setting in your packages settings.py file >>> 'ARCHAEOLOGICAL HERITAGE (SITE).E27', >>> ) >>> >>> I guess this provokes inconsistencies when authority_files.py tries to >>> link data to the entities of the Resource Types that weren't loaded. Is >>> this correct? >>> >>> Putting the same entry in the settings.py of the package to overwrite >>> the global setting doesn't take any effect. Is there a different syntax >>> needed? >>> >>> Cheers, >>> Tobias >>> >>> >>> On Thursday, April 10, 2014 1:11:16 PM UTC+2, Tobias Kohr wrote: >>>> >>>> Dear Archeslist, >>>> >>>> we have extended the ARCHAEOLOGICAL HERITAGE (SITE).E27 Resource Type >>>> and defined our own vocabularies in the according Authority Files. >>>> >>>> (After running install_arches_db.sh and build.sh), install_packages.sh >>>> loads all Authority Files. However the function >>>> create_link_to_entity_types() in authority_files.py aborts with the >>>> following error: >>>> >>>> Traceback (most recent call last): >>>> File "../manage.py", line 28, in <module> >>>> execute_from_command_line(sys.argv) >>>> File >>>> "/arches-web/archesproject/virtualenv/ENV/local/lib/python2.7/site-packages/django/core/management/__init__.py", >>>> line 399, in execute_from_command_line >>>> utility.execute() >>>> File >>>> "/arches-web/archesproject/virtualenv/ENV/local/lib/python2.7/site-packages/django/core/management/__init__.py", >>>> line 392, in execute >>>> self.fetch_command(subcommand).run_from_argv(self.argv) >>>> File >>>> "/arches-web/archesproject/virtualenv/ENV/local/lib/python2.7/site-packages/django/core/management/base.py", >>>> line 242, in run_from_argv >>>> self.execute(*args, **options.__dict__) >>>> File >>>> "/arches-web/archesproject/virtualenv/ENV/local/lib/python2.7/site-packages/django/core/management/base.py", >>>> line 285, in execute >>>> output = self.handle(*args, **options) >>>> File >>>> "/arches-web/archesproject/build/management/commands/packages.py", line 47, >>>> in handle >>>> self.load_package(package) >>>> File >>>> "/arches-web/archesproject/build/management/commands/packages.py", line 52, >>>> in load_package >>>> install(settings.ROOT_DIR) >>>> File "/arches-web/archesproject/packages/i3mainz/setup.py", line 60, >>>> in install >>>> authority_files.load_authority_files(package_settings.ROOT_DIR) >>>> File >>>> "/arches-web/archesproject/packages/i3mainz/install/authority_files.py", >>>> line 24, in load_authority_files >>>> create_link_to_entity_types(cursor, packagepath) >>>> File >>>> "/arches-web/archesproject/packages/i3mainz/install/authority_files.py", >>>> line 125, in create_link_to_entity_types >>>> entity_type = str(cursor.fetchone()[0]) >>>> TypeError: 'NoneType' object has no attribute '__getitem__' >>>> >>>> Any ideas what the cause for this could be? >>>> >>>> What does create_link_to_entity_types() / entity_type = >>>> str(cursor.fetchone()[0]) exactly do? >>>> >>>> Best, >>>> Tobias >>>> >>> -- >>> -- To post, send email to [email protected]. To >>> unsubscribe, send email to [email protected]. >>> For more information, visit >>> https://groups.google.com/d/forum/archesproject?hl=en >>> --- >>> You received this message because you are subscribed to the Google >>> Groups "Arches Project" group. >>> To unsubscribe from this group and stop receiving emails from it, send >>> an email to [email protected]. >>> For more options, visit https://groups.google.com/d/optout. >>> >> >> > -- -- To post, send email to [email protected]. To unsubscribe, send email to [email protected]. For more information, visit https://groups.google.com/d/forum/archesproject?hl=en --- You received this message because you are subscribed to the Google Groups "Arches Project" group. To unsubscribe from this group and stop receiving emails from it, send an email to [email protected]. For more options, visit https://groups.google.com/d/optout.
