Hi Adam, I did change the DATABASES setting to point to our phm2app production instance, as well as the ROOT_URLCONF setting. But I don't see a settings_local.py file on my 3.1.2 installation.
On Tuesday, April 23, 2019 at 1:21:52 AM UTC+8, Adam Cox wrote: > > Hi Joel, have you changed your DATABASES setting at all? I have a guess at > what the issue may be, but it would be best to start with knowing exactly > what is in your settings.py and settings_local.py files for databases > (excluding passwords of course). > > On Sat, Apr 20, 2019 at 8:12 PM Joel Aldor <[email protected] > <javascript:>> wrote: > >> Hi Adam, >> >> OK, so I found out that the subsequent runs of the export_resources >> command gave me which libraries are missing, and I installed rdflib and >> SPARQLWrapper via pip. Now I tried to run again the command and it gives me >> this info: >> >> (ENV4)ubuntu@PHMARCHES3PROD:~/Projects/phmapp312test$ python manage.py >> packages -o export_resources -d v3fullexport.json >> operation: export_resources >> package: phmapp312test >> Writing 5290 HERITAGE_RESOURCE.E18 resources >> relation "strings" does not exist >> LINE 1: SELECT "strings"."entityid", "strings"."val" FROM "strings" ... >> ^ >> : 5274 >> Writing 3712 INFORMATION_RESOURCE.E73 resources >> relation "strings" does not exist >> LINE 1: SELECT "strings"."entityid", "strings"."val" FROM "strings" ... >> ^ >> : 3712 >> Writing 2 ACTIVITY.E7 resources >> relation "strings" does not exist >> LINE 1: SELECT "strings"."entityid", "strings"."val" FROM "strings" ... >> ^ >> : 2 >> Writing 4 HISTORICAL_EVENT.E5 resources >> relation "strings" does not exist >> LINE 1: SELECT "strings"."entityid", "strings"."val" FROM "strings" ... >> ^ >> : 4 >> Writing 7 HERITAGE_RESOURCE_GROUP.E27 resources >> relation "domains" does not exist >> LINE 1: SELECT "domains"."entityid", "domains"."val" FROM "domains" ... >> ^ >> : 6 >> Writing 8 ACTOR.E39 resources >> relation "rules" does not exist >> LINE 1: ...les"."entitytyperange", "rules"."propertyid" FROM "rules" >> WH... >> ^ >> : 8 >> >> The subsequent v3fullexport.json file has more strings, but most of it >> has "null" on it: >> >> {"resources":[{"form_groups":null,"child_entities":[],"label":"","value": >> "","entitytypeid":"HERITAGE_RESOURCE.E18","entityid": >> "70576571-58f2-4922-aac4-3033cd724a15","property":"","businesstablename": >> ""},{"form_groups":null,"child_entities":[],"label":"","value":"", >> "entitytypeid":"HERITAGE_RESOURCE.E18","entityid": >> "216a290b-9bc6-4a3c-8066-7e0b776a4b6d","property":"","businesstablename": >> ""},{"form_groups":null,"child_entities":[],"label":"","value":"", >> "entitytypeid":"HERITAGE_RESOURCE.E18","entityid": >> "fc2a1c29-0d5e-44c9-b7ff-73fd3f3712ba","property":"","businesstablename": >> ""},{"form_groups":null,"child_entities":[],"label":"","value":"", >> "entitytypeid":"HERITAGE_RESOURCE.E18","entityid": >> "5470886e-92da-48c8-9e7e-0cb9f6a0f3cf","property":"","businesstablename": >> ""},{"form_groups":null,"child_entities":[],"label":"","value":"", >> "entitytypeid":"HERITAGE_RESOURCE.E18","entityid": >> "a67a5cb7-57e6-4d61-8d13-6bf27e327dab","property":"","businesstablename": >> ""},{"form_groups":null,"child_entities":[],"label":"","value":"", >> "entitytypeid":"HERITAGE_RESOURCE.E18","entityid": >> "188c9c73-242c-4dba-bebb-d72f7924303d","property":"","businesstablename": >> ""},{"form_groups":null,"child_entities":[],"label":"","value":"", >> "entitytypeid":"HERITAGE_RESOURCE.E18","entityid": >> "9dc90525-2f98-493e-97b9-73b9234defbe","property":"","businesstablename": >> ""},{"form_groups":null,"child_entities":[],"label":"","value":"", >> "entitytypeid":"HERITAGE_RESOURCE.E18","entityid": >> "56e375cf-3ff7-47fd-a198-15dcd107d984","property":"","businesstablename": >> ""},{"form_groups":null,"child_entities":[],"label":"","value":"", >> "entitytypeid":"HERITAGE_RESOURCE.E18","entityid": >> "30cc57e1-0425-48a6-9ee3-a2445a93d6a9","property":"","businesstablename": >> ""},{"form_groups":null,"child_entities":[],"label":"","value":"", >> "entitytypeid":"HERITAGE_RESOURCE.E18","entityid": >> "bfd47a61-4f6f-49ca-ad35-33c5a8e148b2","property":"","businesstablename": >> ""},{"form_groups":null,"child_entities":[],"label":"","value":"", >> "entitytypeid":"HERITAGE_RESOURCE.E18","entityid": >> "a396985d-79d2-426a-be2e-c170d2e4ca34","property":"","businesstablename": >> ""},{"form_groups":null,"child_entities":[],"label":"","value":"", >> "entitytypeid":"HERITAGE_RESOURCE.E18","entityid": >> "6ed80815-33d2-4dff-a39c-451126529756","property":"","businesstablename": >> ""},{"form_groups":null,"child_entities":[],"label":"","value":"", >> "entitytypeid":"HERITAGE_RESOURCE.E18","entityid": >> "92c85fd4-f41f-4464-a6f3-4ac907951de8","property":"","businesstablename": >> ""},{"form_groups":null,"child_entities":[],"label":"","value":"", >> "entitytypeid":"HERITAGE_RESOURCE.E18","entityid": >> "dec01562-3061-43e3-819c-f33f3da1b02f","property":"","businesstablename": >> ""},{"form_groups":null,"child_entities":[],"label":"","value":"", >> "entitytypeid":"HERITAGE_RESOURCE.E18","entityid": >> "671c624b-bb2e-47d4-ac70-3938314f8781","property":"","businesstablename": >> ""},{"form_groups":null,"child_entities":[],"label":"","value":"", >> "entitytypeid":"HERITAGE_RESOURCE.E18","entityid": >> "20c362a4-e7d1-4fe1-995a-9151fefa9921","property":"","businesstablename": >> ""},{"form_groups":null,"child_entities":[],"label":"","value":"", >> "entitytypeid":"HERITAGE_RESOURCE_GROUP.E27","entityid": >> "9a003427-6a66-4283-b420-6a5744d7cfb9","property":"","businesstablename": >> ""}]} >> >> Not sure at this point what to do next. Please let me know what to look >> further. >> >> Thanks, >> >> Joel >> >> On Sunday, April 21, 2019 at 9:01:39 AM UTC+8, Joel Aldor wrote: >>> >>> Hi Adam, >>> >>> Tried installing Pillow, version installed is 6.0.0. Then I ran the >>> export_resources command again. Still produced the same export files with >>> empty resources file. >>> >>> Regards, >>> >>> Joel >>> >>> On Sunday, April 21, 2019 at 8:50:38 AM UTC+8, Adam Cox wrote: >>>> >>>> Hi Joel, if you have the new virtual environment activated you want >>>> have to change the settings file at all. >>>> >>>> The PIL error indicates that that python library (and potentially >>>> others) didn't install correctly... Not sure why. You could try pip >>>> installing PIL. I can't look it up right now but it may be actually be >>>> called Pillow in pip. >>>> >>>> Adam >>>> >>>> On Sat, Apr 20, 2019, 7:37 PM Joel Aldor <[email protected]> wrote: >>>> >>>>> Hi Adam, >>>>> >>>>> I'd like to think we need to explicitly point the settings.py to our >>>>> phm2app instance in order for the export_resources command to run >>>>> properly, >>>>> but I'm not sure which parts I will need to edit, apart from the >>>>> DATABASES >>>>> settings. You think this might be the problem? >>>>> >>>>> Regards, >>>>> >>>>> Joel >>>>> >>>>> On Sunday, April 21, 2019 at 8:25:41 AM UTC+8, Joel Aldor wrote: >>>>>> >>>>>> Hi Adam, >>>>>> >>>>>> I tried to install arches v3.1.2 and pointed the instance into our >>>>>> existing database on settings.py, then I ran the export_resources >>>>>> command, >>>>>> which produced those export files. However, the console update gave me >>>>>> this >>>>>> info: >>>>>> >>>>>> (ENV4)ubuntu@PHMARCHES3PROD:~/Projects/phmapp312test$ python manage.py >>>>>> packages -o export_resources -d v3fullexport.json >>>>>> operation: export_resources >>>>>> package: phmapp312test >>>>>> Writing 5290 HERITAGE_RESOURCE.E18 resources >>>>>> No module named PIL : 5290 >>>>>> Writing 3712 INFORMATION_RESOURCE.E73 resources >>>>>> No module named PIL : 3712 >>>>>> Writing 2 ACTIVITY.E7 resources >>>>>> No module named PIL : 2 >>>>>> Writing 4 HISTORICAL_EVENT.E5 resources >>>>>> No module named PIL : 4 >>>>>> Writing 7 HERITAGE_RESOURCE_GROUP.E27 resources >>>>>> No module named PIL : 7 >>>>>> Writing 8 ACTOR.E39 resources >>>>>> No module named PIL : 8 >>>>>> >>>>>> When I checked the v3fullexport.json file it was almost empty. All it >>>>>> has inside the file is this string: >>>>>> >>>>>> {"resources":[]} >>>>>> >>>>>> The v3fullexport.relations file is full of all the relationships. >>>>>> >>>>>> I have a feeling I might be missing something here. Please let me >>>>>> know what I should do further. Thank you. >>>>>> >>>>>> Regards, >>>>>> >>>>>> Joel >>>>>> >>>>>> >>>>>> On Saturday, April 20, 2019 at 8:59:12 PM UTC+8, Adam Cox wrote: >>>>>>> >>>>>>> Hi Joel, indeed, exporting the v3 resources is a crucial step in the >>>>>>> migration process!! >>>>>>> >>>>>>> I'm unable to look into this deeply right now but I have a feeling >>>>>>> that this means you don't have the latest version of Arches 3, which is >>>>>>> 3.1.2. When I can, I'll look back through the version history and see >>>>>>> where >>>>>>> that command was introduced. >>>>>>> >>>>>>> I'm the meantime, you could create a new virtual environment and >>>>>>> explicitly install arches 3.1.2 into that environment with >>>>>>> >>>>>>> pip install arches==3.1.2 >>>>>>> >>>>>>> Then activate that new environment and try exporting again. This >>>>>>> would leave your old env untouched. >>>>>>> >>>>>>> Adam >>>>>>> >>>>>>> On Sat, Apr 20, 2019, 6:23 AM Joel Aldor <[email protected]> wrote: >>>>>>> >>>>>>>> Hi all, >>>>>>>> >>>>>>>> We're supposed to migrate our v3 data into v4 this Easter weekend >>>>>>>> using >>>>>>>> the instructions from this link >>>>>>>> <https://arches.readthedocs.io/en/stable/exporting-v3-data/>, but >>>>>>>> we ran into a problem. Apparently, our v3 instance doesn't have the >>>>>>>> export_resources option when we execute this command: >>>>>>>> >>>>>>>> (ENV)ubuntu@PHMARCHES3PROD:~/Projects/phm2app$ python manage.py >>>>>>>> packages -o export_resources -d v3fullexport.json >>>>>>>> Usage: manage.py packages [options] >>>>>>>> >>>>>>>> manage.py: error: option -o: invalid choice: 'export_resources' >>>>>>>> (choose >>>>>>>> from 'setup', 'install', 'setup_db', 'start_elasticsearch', >>>>>>>> 'setup_elasticsearch', 'build_permissions', 'livereload', >>>>>>>> 'load_resources', 'remove_resources', 'load_concept_scheme', >>>>>>>> 'index_database', 'export_resource_graphs') >>>>>>>> >>>>>>>> How can I export the business data from here? >>>>>>>> >>>>>>>> Thank you, >>>>>>>> >>>>>>>> Joel >>>>>>>> >>>>>>>> -- >>>>>>>> -- To post, send email to [email protected]. To >>>>>>>> unsubscribe, send email to [email protected]. For more >>>>>>>> information, visit >>>>>>>> https://groups.google.com/d/forum/archesproject?hl=en >>>>>>>> --- >>>>>>>> You received this message because you are subscribed to the Google >>>>>>>> Groups "Arches Project" group. >>>>>>>> To unsubscribe from this group and stop receiving emails from it, >>>>>>>> send an email to [email protected]. >>>>>>>> For more options, visit https://groups.google.com/d/optout. >>>>>>>> >>>>>>> -- >>>>> -- To post, send email to [email protected]. To unsubscribe, >>>>> send email to [email protected]. For more information, visit >>>>> https://groups.google.com/d/forum/archesproject?hl=en >>>>> --- >>>>> You received this message because you are subscribed to the Google >>>>> Groups "Arches Project" group. >>>>> To unsubscribe from this group and stop receiving emails from it, send >>>>> an email to [email protected]. >>>>> For more options, visit https://groups.google.com/d/optout. >>>>> >>>> -- >> -- To post, send email to [email protected] <javascript:>. To >> unsubscribe, send email to [email protected] <javascript:>. For >> more information, visit >> https://groups.google.com/d/forum/archesproject?hl=en >> --- >> You received this message because you are subscribed to the Google Groups >> "Arches Project" group. >> To unsubscribe from this group and stop receiving emails from it, send an >> email to [email protected] <javascript:>. >> For more options, visit https://groups.google.com/d/optout. >> > -- -- To post, send email to [email protected]. To unsubscribe, send email to [email protected]. For more information, visit https://groups.google.com/d/forum/archesproject?hl=en --- You received this message because you are subscribed to the Google Groups "Arches Project" group. To unsubscribe from this group and stop receiving emails from it, send an email to [email protected]. For more options, visit https://groups.google.com/d/optout.
