Re: [Arches] Cannot import sample dropdowns reference data for Arches v4 dev

[Ryan Anderson]

Hi Scott,

It looks like you've uncovered a bug with business data import on windows. 
Turns out sys.maxsize is not an integer on windows. I've updated the latest 
to use sys.maxint instead(this should be an integer). Go ahead and pull the 
latest and give it a try.

Cheers,
Ryan

On Tuesday, April 11, 2017 at 9:40:56 AM UTC-7, Scott Branting wrote:
>
> Dear Alexi and Ryan,
>
> I also just hit an absolute path needed error, even after the 
> documentation was updated.  I changed it to the absolute path and received 
> the following error:
>
> (ENV) C:\ArchesProjects\arches>python manage.py packages -o 
> import_business_data
>  -s 
> C:\ArchesProjects\arches\tests\fixtures\data\csv\heritage_resource_model.csv
>  -ow overwrite
> operation: import_business_data
> package: arches
> Traceback (most recent call last):
>   File "manage.py", line 27, in 
> execute_from_command_line(sys.argv)
>   File 
> "C:\ArchesProjects\ENV\lib\site-packages\django\core\management\__init__.
> py", line 353, in execute_from_command_line
> utility.execute()
>   File 
> "C:\ArchesProjects\ENV\lib\site-packages\django\core\management\__init__.
> py", line 345, in execute
> self.fetch_command(subcommand).run_from_argv(self.argv)
>   File 
> "C:\ArchesProjects\ENV\lib\site-packages\django\core\management\base.py",
>  line 348, in run_from_argv
> self.execute(*args, **cmd_options)
>   File 
> "C:\ArchesProjects\ENV\lib\site-packages\django\core\management\base.py",
>  line 399, in execute
> output = self.handle(*args, **options)
>   File "C:\ArchesProjects\arches\arches\management\commands\packages.py", 
> line 1
> 66, in handle
> self.import_business_data(options['source'], options['config_file'], 
> options
> ['overwrite'], options['bulk_load'])
>   File "C:\ArchesProjects\arches\arches\management\commands\packages.py", 
> line 3
> 74, in import_business_data
> BusinessDataImporter(path, 
> config_file).import_business_data(overwrite=overw
> rite, bulk=bulk_load)
>   File 
> "C:\ArchesProjects\arches\arches\app\utils\data_management\resources\impo
> rter.py", line 52, in __init__
> csv.field_size_limit(sys.maxsize)
> TypeError: limit must be an integer
>
> Thanks,
>
> Scott
> ASORCHI
>

-- 
-- To post, send email to archesproject@googlegroups.com. To unsubscribe, send 
email to archesproject+unsubscr...@googlegroups.com. For more information, 
visit https://groups.google.com/d/forum/archesproject?hl=en
--- 
You received this message because you are subscribed to the Google Groups 
"Arches Project" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to archesproject+unsubscr...@googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

Re: [Arches] Cannot import sample dropdowns reference data for Arches v4 dev

[Alexei Peters]

Thanks Joel, I think Ryan updated the documentation to reflect that.
Cheers,
Alexei


Director of Web Development - Farallon Geographics, Inc. - 971.227.3173

On Mon, Apr 10, 2017 at 12:01 PM, Joel Aldor  wrote:

> Thank you very much Alex. Now I got the Arches v4 dev environment up and
> running!
>
> However I noticed that I got this error when importing business data.
>
> (ENV) ubuntu@ARCHESv4PROD:~/Projects/arches$ python manage.py packages -o
> import_business_data -s tests/fixtures/data/csv/
> heritage_resource_model.csv
> operation: import_business_data
> package: arches
> 
> 
> No overwrite option indicated. Please rerun command with '-ow' parameter.
> 
> 
>
>
>
> May I suggest an edit to this command: it should be run like this:
>
> (ENV) ubuntu@ARCHESv4PROD:~/Projects/arches$ python manage.py packages -o
> import_business_data -s /home/ubuntu/Projects/arches/
> tests/fixtures/data/csv/heritage_resource_model.csv -ow overwrite
> operation: import_business_data
> package: arches
> Time to import_business_data = 0:00:40.954979
> No import errors
>
>
> The reason is because the* -ow overwrite* parameter needs the absolute
> path of the CSV file, in order to import the business data properly.
>
> Thanks,
>
> Joel
>
> On Tuesday, April 11, 2017 at 1:42:03 AM UTC+8, Alexei Peters wrote:
>>
>> Hi Joel,
>> The name of the file has changed actually.  Instead of dropdowns.rdf it's
>> now "arches_concept_collections.rdf".  I've updated the wiki to reflect
>> the change.  You should be able to run the following command now.
>>
>> *python manage.py packages -o import_reference_data -s
>> arches/db/schemes/arches_concept_collections.rdf -ow overwrite -st keep*
>>
>> Cheers
>> Alexei
>>
>>
>> Director of Web Development - Farallon Geographics, Inc. - 971.227.3173
>> <(971)%20227-3173>
>>
>> On Mon, Apr 10, 2017 at 10:21 AM, Alexei Peters 
>> wrote:
>>
>>> Hi Joel,
>>> That file needs to be fixed.  It was messed up recently and just hasn't
>>> been fixed.  I"ll make sure that gets fixed today.
>>> Cheers,
>>> Alexei
>>>
>>>
>>> Director of Web Development - Farallon Geographics, Inc. - 971.227.3173
>>>
>>> On Fri, Apr 7, 2017 at 9:02 PM, Joel Aldor  wrote:
>>>
 Hi all,

 Tried to follow the instructions on https://github.com/archespr
 oject/arches/wiki/Developer-Installation and I get this error when I
 started to import the dropdown lists reference data:

 ubuntu@ARCHESv4PROD:~/Projects/arches$ python manage.py packages -o
 impo
  _reference_data -s arches/db/schemes/dropdowns.rdf
 -ow overwrite -st keep
 operation: import_reference_data
 package: arches
 Traceback (most recent call last):
   File "manage.py", line 27, in 
 execute_from_command_line(sys.argv)
   File 
 "/home/ubuntu/Projects/ENV/local/lib/python2.7/site-packages/django/core/

management/__init__.py", line 353, in execute_from_command_line
 utility.execute()
   File 
 "/home/ubuntu/Projects/ENV/local/lib/python2.7/site-packages/django/core/

management/__init__.py", line 345, in execute
 self.fetch_command(subcommand).run_from_argv(self.argv)
   File 
 "/home/ubuntu/Projects/ENV/local/lib/python2.7/site-packages/django/core/

management/base.py", line 348, in run_from_argv
 self.execute(*args, **cmd_options)
   File 
 "/home/ubuntu/Projects/ENV/local/lib/python2.7/site-packages/django/core/

management/base.py", line 399, in execute
 output = self.handle(*args, **options)
   File 
 "/home/ubuntu/Projects/arches/arches/management/commands/packages.py",
 li
ne 160, in handle
 self.import_reference_data(options['source'],
 options['overwrite'], options[
'stage'])
   File 
 "/home/ubuntu/Projects/arches/arches/management/commands/packages.py",
 li
ne 351, in import_reference_data
 rdf = skos.read_file(data_source)
   File "/home/ubuntu/Projects/arches/arches/app/utils/skos.py", line
 56, in read
_file
 raise Exception('Error occurred while parsing the file %s' %
 path_to_file)
 Exception: Error occurred while parsing the file
 arches/db/schemes/dropdowns.rdf

 This is the first error I've encountered with the installation process.

 Thanks for the help!

 Joel

 --
 -- To post, send email to arches...@googlegroups.com. To unsubscribe,
 send email to archesprojec...@googlegroups.com. For more information,
 visit https://groups.google.com/d/forum/archesproject?hl=en
 ---
 You 

Re: [Arches] Cannot import sample dropdowns reference data for Arches v4 dev

[Joel Aldor]

Thank you very much Alex. Now I got the Arches v4 dev environment up and 
running!

However I noticed that I got this error when importing business data. 

(ENV) ubuntu@ARCHESv4PROD:~/Projects/arches$ python manage.py packages -o 
import_business_data -s tests/fixtures/data/csv/heritage_resource_model.csv
operation: import_business_data
package: arches

No overwrite option indicated. Please rerun command with '-ow' parameter.




May I suggest an edit to this command: it should be run like this: 

(ENV) ubuntu@ARCHESv4PROD:~/Projects/arches$ python manage.py packages -o 
import_business_data -s 
/home/ubuntu/Projects/arches/tests/fixtures/data/csv/heritage_resource_model.csv
 
-ow overwrite
operation: import_business_data
package: arches
Time to import_business_data = 0:00:40.954979
No import errors


The reason is because the* -ow overwrite* parameter needs the absolute path 
of the CSV file, in order to import the business data properly.

Thanks,

Joel

On Tuesday, April 11, 2017 at 1:42:03 AM UTC+8, Alexei Peters wrote:
>
> Hi Joel,
> The name of the file has changed actually.  Instead of dropdowns.rdf it's 
> now "arches_concept_collections.rdf".  I've updated the wiki to reflect the 
> change.  You should be able to run the following command now.
>
> *python manage.py packages -o import_reference_data -s 
> arches/db/schemes/arches_concept_collections.rdf -ow overwrite -st keep*
>
> Cheers
> Alexei
>
>
> Director of Web Development - Farallon Geographics, Inc. - 971.227.3173
>
> On Mon, Apr 10, 2017 at 10:21 AM, Alexei Peters  > wrote:
>
>> Hi Joel,
>> That file needs to be fixed.  It was messed up recently and just hasn't 
>> been fixed.  I"ll make sure that gets fixed today.
>> Cheers,
>> Alexei
>>
>>
>> Director of Web Development - Farallon Geographics, Inc. - 971.227.3173
>>
>> On Fri, Apr 7, 2017 at 9:02 PM, Joel Aldor > > wrote:
>>
>>> Hi all,
>>>
>>> Tried to follow the instructions on 
>>> https://github.com/archesproject/arches/wiki/Developer-Installation and 
>>> I get this error when I started to import the dropdown lists reference data:
>>>
>>> ubuntu@ARCHESv4PROD:~/Projects/arches$ python manage.py packages -o impo 
>>> 
>>>_reference_data -s arches/db/schemes/dropdowns.rdf -ow overwrite 
>>> -st keep
>>> operation: import_reference_data
>>> package: arches
>>> Traceback (most recent call last):
>>>   File "manage.py", line 27, in 
>>> execute_from_command_line(sys.argv)
>>>   File 
>>> "/home/ubuntu/Projects/ENV/local/lib/python2.7/site-packages/django/core/   
>>> 
>>>  management/__init__.py", line 353, in execute_from_command_line
>>> utility.execute()
>>>   File 
>>> "/home/ubuntu/Projects/ENV/local/lib/python2.7/site-packages/django/core/   
>>> 
>>>  management/__init__.py", line 345, in execute
>>> self.fetch_command(subcommand).run_from_argv(self.argv)
>>>   File 
>>> "/home/ubuntu/Projects/ENV/local/lib/python2.7/site-packages/django/core/   
>>> 
>>>  management/base.py", line 348, in run_from_argv
>>> self.execute(*args, **cmd_options)
>>>   File 
>>> "/home/ubuntu/Projects/ENV/local/lib/python2.7/site-packages/django/core/   
>>> 
>>>  management/base.py", line 399, in execute
>>> output = self.handle(*args, **options)
>>>   File 
>>> "/home/ubuntu/Projects/arches/arches/management/commands/packages.py", li   
>>> 
>>>  ne 160, in handle
>>> self.import_reference_data(options['source'], options['overwrite'], 
>>> options[   
>>>  'stage'])
>>>   File 
>>> "/home/ubuntu/Projects/arches/arches/management/commands/packages.py", li   
>>> 
>>>  ne 351, in import_reference_data
>>> rdf = skos.read_file(data_source)
>>>   File "/home/ubuntu/Projects/arches/arches/app/utils/skos.py", line 56, 
>>> in read 
>>>_file
>>> raise Exception('Error occurred while parsing the file %s' % 
>>> path_to_file)
>>> Exception: Error occurred while parsing the file 
>>> arches/db/schemes/dropdowns.rdf
>>>
>>> This is the first error I've encountered with the installation process. 
>>>
>>> Thanks for the help!
>>>
>>> 

Re: [Arches] Cannot import sample dropdowns reference data for Arches v4 dev

[Alexei Peters]

Hi Joel,
The name of the file has changed actually.  Instead of dropdowns.rdf it's
now "arches_concept_collections.rdf".  I've updated the wiki to reflect the
change.  You should be able to run the following command now.

*python manage.py packages -o import_reference_data -s
arches/db/schemes/arches_concept_collections.rdf -ow overwrite -st keep*

Cheers
Alexei


Director of Web Development - Farallon Geographics, Inc. - 971.227.3173

On Mon, Apr 10, 2017 at 10:21 AM, Alexei Peters  wrote:

> Hi Joel,
> That file needs to be fixed.  It was messed up recently and just hasn't
> been fixed.  I"ll make sure that gets fixed today.
> Cheers,
> Alexei
>
>
> Director of Web Development - Farallon Geographics, Inc. - 971.227.3173
> <(971)%20227-3173>
>
> On Fri, Apr 7, 2017 at 9:02 PM, Joel Aldor  wrote:
>
>> Hi all,
>>
>> Tried to follow the instructions on https://github.com/archespr
>> oject/arches/wiki/Developer-Installation and I get this error when I
>> started to import the dropdown lists reference data:
>>
>> ubuntu@ARCHESv4PROD:~/Projects/arches$ python manage.py packages -o impo
>>
>>_reference_data -s arches/db/schemes/dropdowns.rdf -ow
>> overwrite -st keep
>> operation: import_reference_data
>> package: arches
>> Traceback (most recent call last):
>>   File "manage.py", line 27, in 
>> execute_from_command_line(sys.argv)
>>   File 
>> "/home/ubuntu/Projects/ENV/local/lib/python2.7/site-packages/django/core/
>>
>>management/__init__.py", line 353, in execute_from_command_line
>> utility.execute()
>>   File 
>> "/home/ubuntu/Projects/ENV/local/lib/python2.7/site-packages/django/core/
>>
>>management/__init__.py", line 345, in execute
>> self.fetch_command(subcommand).run_from_argv(self.argv)
>>   File 
>> "/home/ubuntu/Projects/ENV/local/lib/python2.7/site-packages/django/core/
>>
>>management/base.py", line 348, in run_from_argv
>> self.execute(*args, **cmd_options)
>>   File 
>> "/home/ubuntu/Projects/ENV/local/lib/python2.7/site-packages/django/core/
>>
>>management/base.py", line 399, in execute
>> output = self.handle(*args, **options)
>>   File "/home/ubuntu/Projects/arches/arches/management/commands/packages.py",
>> li
>>ne 160, in handle
>> self.import_reference_data(options['source'], options['overwrite'],
>> options[
>>  'stage'])
>>   File "/home/ubuntu/Projects/arches/arches/management/commands/packages.py",
>> li
>>ne 351, in import_reference_data
>> rdf = skos.read_file(data_source)
>>   File "/home/ubuntu/Projects/arches/arches/app/utils/skos.py", line 56,
>> in read
>>_file
>> raise Exception('Error occurred while parsing the file %s' %
>> path_to_file)
>> Exception: Error occurred while parsing the file
>> arches/db/schemes/dropdowns.rdf
>>
>> This is the first error I've encountered with the installation process.
>>
>> Thanks for the help!
>>
>> Joel
>>
>> --
>> -- To post, send email to archesproject@googlegroups.com. To
>> unsubscribe, send email to archesproject+unsubscr...@googlegroups.com.
>> For more information, visit https://groups.google.com/d/fo
>> rum/archesproject?hl=en
>> ---
>> You received this message because you are subscribed to the Google Groups
>> "Arches Project" group.
>> To unsubscribe from this group and stop receiving emails from it, send an
>> email to archesproject+unsubscr...@googlegroups.com.
>> For more options, visit https://groups.google.com/d/optout.
>>
>
>

-- 
-- To post, send email to archesproject@googlegroups.com. To unsubscribe, send 
email to archesproject+unsubscr...@googlegroups.com. For more information, 
visit https://groups.google.com/d/forum/archesproject?hl=en
--- 
You received this message because you are subscribed to the Google Groups 
"Arches Project" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to archesproject+unsubscr...@googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

Re: [Arches] Cannot import sample dropdowns reference data for Arches v4 dev

[Alexei Peters]

Hi Joel,
That file needs to be fixed.  It was messed up recently and just hasn't
been fixed.  I"ll make sure that gets fixed today.
Cheers,
Alexei


Director of Web Development - Farallon Geographics, Inc. - 971.227.3173

On Fri, Apr 7, 2017 at 9:02 PM, Joel Aldor  wrote:

> Hi all,
>
> Tried to follow the instructions on https://github.com/
> archesproject/arches/wiki/Developer-Installation and I get this error
> when I started to import the dropdown lists reference data:
>
> ubuntu@ARCHESv4PROD:~/Projects/arches$ python manage.py packages -o impo
>
>_reference_data -s arches/db/schemes/dropdowns.rdf -ow
> overwrite -st keep
> operation: import_reference_data
> package: arches
> Traceback (most recent call last):
>   File "manage.py", line 27, in 
> execute_from_command_line(sys.argv)
>   File 
> "/home/ubuntu/Projects/ENV/local/lib/python2.7/site-packages/django/core/
>
>management/__init__.py", line 353, in execute_from_command_line
> utility.execute()
>   File 
> "/home/ubuntu/Projects/ENV/local/lib/python2.7/site-packages/django/core/
>
>management/__init__.py", line 345, in execute
> self.fetch_command(subcommand).run_from_argv(self.argv)
>   File 
> "/home/ubuntu/Projects/ENV/local/lib/python2.7/site-packages/django/core/
>
>management/base.py", line 348, in run_from_argv
> self.execute(*args, **cmd_options)
>   File 
> "/home/ubuntu/Projects/ENV/local/lib/python2.7/site-packages/django/core/
>
>management/base.py", line 399, in execute
> output = self.handle(*args, **options)
>   File "/home/ubuntu/Projects/arches/arches/management/commands/packages.py",
> li
>ne 160, in handle
> self.import_reference_data(options['source'], options['overwrite'],
> options[
>  'stage'])
>   File "/home/ubuntu/Projects/arches/arches/management/commands/packages.py",
> li
>ne 351, in import_reference_data
> rdf = skos.read_file(data_source)
>   File "/home/ubuntu/Projects/arches/arches/app/utils/skos.py", line 56,
> in read
>_file
> raise Exception('Error occurred while parsing the file %s' %
> path_to_file)
> Exception: Error occurred while parsing the file
> arches/db/schemes/dropdowns.rdf
>
> This is the first error I've encountered with the installation process.
>
> Thanks for the help!
>
> Joel
>
> --
> -- To post, send email to archesproject@googlegroups.com. To unsubscribe,
> send email to archesproject+unsubscr...@googlegroups.com. For more
> information, visit https://groups.google.com/d/forum/archesproject?hl=en
> ---
> You received this message because you are subscribed to the Google Groups
> "Arches Project" group.
> To unsubscribe from this group and stop receiving emails from it, send an
> email to archesproject+unsubscr...@googlegroups.com.
> For more options, visit https://groups.google.com/d/optout.
>

-- 
-- To post, send email to archesproject@googlegroups.com. To unsubscribe, send 
email to archesproject+unsubscr...@googlegroups.com. For more information, 
visit https://groups.google.com/d/forum/archesproject?hl=en
--- 
You received this message because you are subscribed to the Google Groups 
"Arches Project" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to archesproject+unsubscr...@googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

[Arches] Cannot import sample dropdowns reference data for Arches v4 dev

[Joel Aldor]

Hi all,

Tried to follow the instructions on 
https://github.com/archesproject/arches/wiki/Developer-Installation and I 
get this error when I started to import the dropdown lists reference data:

ubuntu@ARCHESv4PROD:~/Projects/arches$ python manage.py packages -o impo   

 _reference_data -s arches/db/schemes/dropdowns.rdf -ow overwrite 
-st keep
operation: import_reference_data
package: arches
Traceback (most recent call last):
  File "manage.py", line 27, in 
execute_from_command_line(sys.argv)
  File 
"/home/ubuntu/Projects/ENV/local/lib/python2.7/site-packages/django/core/   

 management/__init__.py", line 353, in execute_from_command_line
utility.execute()
  File 
"/home/ubuntu/Projects/ENV/local/lib/python2.7/site-packages/django/core/   

 management/__init__.py", line 345, in execute
self.fetch_command(subcommand).run_from_argv(self.argv)
  File 
"/home/ubuntu/Projects/ENV/local/lib/python2.7/site-packages/django/core/   

 management/base.py", line 348, in run_from_argv
self.execute(*args, **cmd_options)
  File 
"/home/ubuntu/Projects/ENV/local/lib/python2.7/site-packages/django/core/   

 management/base.py", line 399, in execute
output = self.handle(*args, **options)
  File 
"/home/ubuntu/Projects/arches/arches/management/commands/packages.py", li   

 ne 160, in handle
self.import_reference_data(options['source'], options['overwrite'], 
options[   
 'stage'])
  File 
"/home/ubuntu/Projects/arches/arches/management/commands/packages.py", li   

 ne 351, in import_reference_data
rdf = skos.read_file(data_source)
  File "/home/ubuntu/Projects/arches/arches/app/utils/skos.py", line 56, in 
read   
 _file
raise Exception('Error occurred while parsing the file %s' % 
path_to_file)
Exception: Error occurred while parsing the file 
arches/db/schemes/dropdowns.rdf

This is the first error I've encountered with the installation process. 

Thanks for the help!

Joel

-- 
-- To post, send email to archesproject@googlegroups.com. To unsubscribe, send 
email to archesproject+unsubscr...@googlegroups.com. For more information, 
visit https://groups.google.com/d/forum/archesproject?hl=en
--- 
You received this message because you are subscribed to the Google Groups 
"Arches Project" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to archesproject+unsubscr...@googlegroups.com.
For more options, visit https://groups.google.com/d/optout.