Hi Joel, have you changed your DATABASES setting at all? I have a guess at what the issue may be, but it would be best to start with knowing exactly what is in your settings.py and settings_local.py files for databases (excluding passwords of course).
On Sat, Apr 20, 2019 at 8:12 PM Joel Aldor <[email protected]> wrote: > Hi Adam, > > OK, so I found out that the subsequent runs of the export_resources > command gave me which libraries are missing, and I installed rdflib and > SPARQLWrapper via pip. Now I tried to run again the command and it gives me > this info: > > (ENV4)ubuntu@PHMARCHES3PROD:~/Projects/phmapp312test$ python manage.py > packages -o export_resources -d v3fullexport.json > operation: export_resources > package: phmapp312test > Writing 5290 HERITAGE_RESOURCE.E18 resources > relation "strings" does not exist > LINE 1: SELECT "strings"."entityid", "strings"."val" FROM "strings" ... > ^ > : 5274 > Writing 3712 INFORMATION_RESOURCE.E73 resources > relation "strings" does not exist > LINE 1: SELECT "strings"."entityid", "strings"."val" FROM "strings" ... > ^ > : 3712 > Writing 2 ACTIVITY.E7 resources > relation "strings" does not exist > LINE 1: SELECT "strings"."entityid", "strings"."val" FROM "strings" ... > ^ > : 2 > Writing 4 HISTORICAL_EVENT.E5 resources > relation "strings" does not exist > LINE 1: SELECT "strings"."entityid", "strings"."val" FROM "strings" ... > ^ > : 4 > Writing 7 HERITAGE_RESOURCE_GROUP.E27 resources > relation "domains" does not exist > LINE 1: SELECT "domains"."entityid", "domains"."val" FROM "domains" ... > ^ > : 6 > Writing 8 ACTOR.E39 resources > relation "rules" does not exist > LINE 1: ...les"."entitytyperange", "rules"."propertyid" FROM "rules" WH... > ^ > : 8 > > The subsequent v3fullexport.json file has more strings, but most of it has > "null" on it: > > {"resources":[{"form_groups":null,"child_entities":[],"label":"","value": > "","entitytypeid":"HERITAGE_RESOURCE.E18","entityid": > "70576571-58f2-4922-aac4-3033cd724a15","property":"","businesstablename": > ""},{"form_groups":null,"child_entities":[],"label":"","value":"", > "entitytypeid":"HERITAGE_RESOURCE.E18","entityid": > "216a290b-9bc6-4a3c-8066-7e0b776a4b6d","property":"","businesstablename": > ""},{"form_groups":null,"child_entities":[],"label":"","value":"", > "entitytypeid":"HERITAGE_RESOURCE.E18","entityid": > "fc2a1c29-0d5e-44c9-b7ff-73fd3f3712ba","property":"","businesstablename": > ""},{"form_groups":null,"child_entities":[],"label":"","value":"", > "entitytypeid":"HERITAGE_RESOURCE.E18","entityid": > "5470886e-92da-48c8-9e7e-0cb9f6a0f3cf","property":"","businesstablename": > ""},{"form_groups":null,"child_entities":[],"label":"","value":"", > "entitytypeid":"HERITAGE_RESOURCE.E18","entityid": > "a67a5cb7-57e6-4d61-8d13-6bf27e327dab","property":"","businesstablename": > ""},{"form_groups":null,"child_entities":[],"label":"","value":"", > "entitytypeid":"HERITAGE_RESOURCE.E18","entityid": > "188c9c73-242c-4dba-bebb-d72f7924303d","property":"","businesstablename": > ""},{"form_groups":null,"child_entities":[],"label":"","value":"", > "entitytypeid":"HERITAGE_RESOURCE.E18","entityid": > "9dc90525-2f98-493e-97b9-73b9234defbe","property":"","businesstablename": > ""},{"form_groups":null,"child_entities":[],"label":"","value":"", > "entitytypeid":"HERITAGE_RESOURCE.E18","entityid": > "56e375cf-3ff7-47fd-a198-15dcd107d984","property":"","businesstablename": > ""},{"form_groups":null,"child_entities":[],"label":"","value":"", > "entitytypeid":"HERITAGE_RESOURCE.E18","entityid": > "30cc57e1-0425-48a6-9ee3-a2445a93d6a9","property":"","businesstablename": > ""},{"form_groups":null,"child_entities":[],"label":"","value":"", > "entitytypeid":"HERITAGE_RESOURCE.E18","entityid": > "bfd47a61-4f6f-49ca-ad35-33c5a8e148b2","property":"","businesstablename": > ""},{"form_groups":null,"child_entities":[],"label":"","value":"", > "entitytypeid":"HERITAGE_RESOURCE.E18","entityid": > "a396985d-79d2-426a-be2e-c170d2e4ca34","property":"","businesstablename": > ""},{"form_groups":null,"child_entities":[],"label":"","value":"", > "entitytypeid":"HERITAGE_RESOURCE.E18","entityid": > "6ed80815-33d2-4dff-a39c-451126529756","property":"","businesstablename": > ""},{"form_groups":null,"child_entities":[],"label":"","value":"", > "entitytypeid":"HERITAGE_RESOURCE.E18","entityid": > "92c85fd4-f41f-4464-a6f3-4ac907951de8","property":"","businesstablename": > ""},{"form_groups":null,"child_entities":[],"label":"","value":"", > "entitytypeid":"HERITAGE_RESOURCE.E18","entityid": > "dec01562-3061-43e3-819c-f33f3da1b02f","property":"","businesstablename": > ""},{"form_groups":null,"child_entities":[],"label":"","value":"", > "entitytypeid":"HERITAGE_RESOURCE.E18","entityid": > "671c624b-bb2e-47d4-ac70-3938314f8781","property":"","businesstablename": > ""},{"form_groups":null,"child_entities":[],"label":"","value":"", > "entitytypeid":"HERITAGE_RESOURCE.E18","entityid": > "20c362a4-e7d1-4fe1-995a-9151fefa9921","property":"","businesstablename": > ""},{"form_groups":null,"child_entities":[],"label":"","value":"", > "entitytypeid":"HERITAGE_RESOURCE_GROUP.E27","entityid": > "9a003427-6a66-4283-b420-6a5744d7cfb9","property":"","businesstablename": > ""}]} > > Not sure at this point what to do next. Please let me know what to look > further. > > Thanks, > > Joel > > On Sunday, April 21, 2019 at 9:01:39 AM UTC+8, Joel Aldor wrote: >> >> Hi Adam, >> >> Tried installing Pillow, version installed is 6.0.0. Then I ran the >> export_resources command again. Still produced the same export files with >> empty resources file. >> >> Regards, >> >> Joel >> >> On Sunday, April 21, 2019 at 8:50:38 AM UTC+8, Adam Cox wrote: >>> >>> Hi Joel, if you have the new virtual environment activated you want have >>> to change the settings file at all. >>> >>> The PIL error indicates that that python library (and potentially >>> others) didn't install correctly... Not sure why. You could try pip >>> installing PIL. I can't look it up right now but it may be actually be >>> called Pillow in pip. >>> >>> Adam >>> >>> On Sat, Apr 20, 2019, 7:37 PM Joel Aldor <[email protected]> wrote: >>> >>>> Hi Adam, >>>> >>>> I'd like to think we need to explicitly point the settings.py to our >>>> phm2app instance in order for the export_resources command to run properly, >>>> but I'm not sure which parts I will need to edit, apart from the DATABASES >>>> settings. You think this might be the problem? >>>> >>>> Regards, >>>> >>>> Joel >>>> >>>> On Sunday, April 21, 2019 at 8:25:41 AM UTC+8, Joel Aldor wrote: >>>>> >>>>> Hi Adam, >>>>> >>>>> I tried to install arches v3.1.2 and pointed the instance into our >>>>> existing database on settings.py, then I ran the export_resources command, >>>>> which produced those export files. However, the console update gave me >>>>> this >>>>> info: >>>>> >>>>> (ENV4)ubuntu@PHMARCHES3PROD:~/Projects/phmapp312test$ python manage.py >>>>> packages -o export_resources -d v3fullexport.json >>>>> operation: export_resources >>>>> package: phmapp312test >>>>> Writing 5290 HERITAGE_RESOURCE.E18 resources >>>>> No module named PIL : 5290 >>>>> Writing 3712 INFORMATION_RESOURCE.E73 resources >>>>> No module named PIL : 3712 >>>>> Writing 2 ACTIVITY.E7 resources >>>>> No module named PIL : 2 >>>>> Writing 4 HISTORICAL_EVENT.E5 resources >>>>> No module named PIL : 4 >>>>> Writing 7 HERITAGE_RESOURCE_GROUP.E27 resources >>>>> No module named PIL : 7 >>>>> Writing 8 ACTOR.E39 resources >>>>> No module named PIL : 8 >>>>> >>>>> When I checked the v3fullexport.json file it was almost empty. All it >>>>> has inside the file is this string: >>>>> >>>>> {"resources":[]} >>>>> >>>>> The v3fullexport.relations file is full of all the relationships. >>>>> >>>>> I have a feeling I might be missing something here. Please let me know >>>>> what I should do further. Thank you. >>>>> >>>>> Regards, >>>>> >>>>> Joel >>>>> >>>>> >>>>> On Saturday, April 20, 2019 at 8:59:12 PM UTC+8, Adam Cox wrote: >>>>>> >>>>>> Hi Joel, indeed, exporting the v3 resources is a crucial step in the >>>>>> migration process!! >>>>>> >>>>>> I'm unable to look into this deeply right now but I have a feeling >>>>>> that this means you don't have the latest version of Arches 3, which is >>>>>> 3.1.2. When I can, I'll look back through the version history and see >>>>>> where >>>>>> that command was introduced. >>>>>> >>>>>> I'm the meantime, you could create a new virtual environment and >>>>>> explicitly install arches 3.1.2 into that environment with >>>>>> >>>>>> pip install arches==3.1.2 >>>>>> >>>>>> Then activate that new environment and try exporting again. This >>>>>> would leave your old env untouched. >>>>>> >>>>>> Adam >>>>>> >>>>>> On Sat, Apr 20, 2019, 6:23 AM Joel Aldor <[email protected]> wrote: >>>>>> >>>>>>> Hi all, >>>>>>> >>>>>>> We're supposed to migrate our v3 data into v4 this Easter weekend using >>>>>>> the instructions from this link >>>>>>> <https://arches.readthedocs.io/en/stable/exporting-v3-data/>, but >>>>>>> we ran into a problem. Apparently, our v3 instance doesn't have the >>>>>>> export_resources option when we execute this command: >>>>>>> >>>>>>> (ENV)ubuntu@PHMARCHES3PROD:~/Projects/phm2app$ python manage.py >>>>>>> packages -o export_resources -d v3fullexport.json >>>>>>> Usage: manage.py packages [options] >>>>>>> >>>>>>> manage.py: error: option -o: invalid choice: 'export_resources' (choose >>>>>>> from 'setup', 'install', 'setup_db', 'start_elasticsearch', >>>>>>> 'setup_elasticsearch', 'build_permissions', 'livereload', >>>>>>> 'load_resources', 'remove_resources', 'load_concept_scheme', >>>>>>> 'index_database', 'export_resource_graphs') >>>>>>> >>>>>>> How can I export the business data from here? >>>>>>> >>>>>>> Thank you, >>>>>>> >>>>>>> Joel >>>>>>> >>>>>>> -- >>>>>>> -- To post, send email to [email protected]. To >>>>>>> unsubscribe, send email to [email protected]. For more >>>>>>> information, visit >>>>>>> https://groups.google.com/d/forum/archesproject?hl=en >>>>>>> --- >>>>>>> You received this message because you are subscribed to the Google >>>>>>> Groups "Arches Project" group. >>>>>>> To unsubscribe from this group and stop receiving emails from it, >>>>>>> send an email to [email protected]. >>>>>>> For more options, visit https://groups.google.com/d/optout. >>>>>>> >>>>>> -- >>>> -- To post, send email to [email protected]. To unsubscribe, >>>> send email to [email protected]. For more information, visit >>>> https://groups.google.com/d/forum/archesproject?hl=en >>>> --- >>>> You received this message because you are subscribed to the Google >>>> Groups "Arches Project" group. >>>> To unsubscribe from this group and stop receiving emails from it, send >>>> an email to [email protected]. >>>> For more options, visit https://groups.google.com/d/optout. >>>> >>> -- > -- To post, send email to [email protected]. To unsubscribe, > send email to [email protected]. For more > information, visit https://groups.google.com/d/forum/archesproject?hl=en > --- > You received this message because you are subscribed to the Google Groups > "Arches Project" group. > To unsubscribe from this group and stop receiving emails from it, send an > email to [email protected]. > For more options, visit https://groups.google.com/d/optout. > -- -- To post, send email to [email protected]. To unsubscribe, send email to [email protected]. For more information, visit https://groups.google.com/d/forum/archesproject?hl=en --- You received this message because you are subscribed to the Google Groups "Arches Project" group. To unsubscribe from this group and stop receiving emails from it, send an email to [email protected]. For more options, visit https://groups.google.com/d/optout.
