Hi Gonzalo,
CATALINA_OPTS are only used when your run tomcat. The script run outside tomcat
so you should configure the JAVA_OPTS to raise the memory
Andrea
Il 09/01/2018 16:03, gonzalo perl ha scritto:
Hello
I have running ScopusFeed module, but i get Java memory error again:
C:\dspace\bin>dspace dsrun org.dspace.app.cris.batch.ScopusFeed -p
<email-address-of-an-administrator -s 2017-01-01 -e 2017-12-31 -c 2
Using DSpace installation in: C:\dspace
Exception: Java heap space
java.lang.OutOfMemoryError: Java heap space
at org.dspace.app.util.XMLUtils.getElementList(XMLUtils.java:38)
at org.dspace.app.util.XMLUtils.getSingleElement(XMLUtils.java:116)
at org.dspace.app.util.XMLUtils.getElementValue(XMLUtils.java:90)
at
org.dspace.submit.lookup.ScopusUtils.convertScopusDomToRecord(ScopusUtils.java:118)
at org.dspace.submit.lookup.ScopusService.search(ScopusService.java:164)
at
org.dspace.submit.lookup.ScopusOnlineDataLoader.search(ScopusOnlineDataLoader.java:152)
at
org.dspace.app.cris.batch.ScopusFeed.convertToImpRecordItem(ScopusFeed.java:316)
at org.dspace.app.cris.batch.ScopusFeed.main(ScopusFeed.java:212)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(Unknown Source)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source)
at java.lang.reflect.Method.invoke(Unknown Source)
at
org.dspace.app.launcher.ScriptLauncher.runOneCommand(ScriptLauncher.java:226)
at org.dspace.app.launcher.ScriptLauncher.main(ScriptLauncher.java:78)
C:\dspace\bin>
My enviroment variables have the following values:
CATALINA OPTS= -Xmx2048M -Xms1024M -Dfile.encoding=UTF-8
-Dorg.apache.el.parser.SKIP_IDENTIFIER_CHECK=true
Any idea about the error?
Cheers
Gonzalo
El lunes, 8 de enero de 2018, 13:24:52 (UTC), gonzalo perl escribió:
I added more memory to Jave but, don´t added the publications to workflow.
C:\dspace\bin>dspace dsrun org.dspace.app.cris.batch.ScopusFeed -p
<email-address-of-an-administrator -s 2016-01-01 -e 2016-12-31 -c 2
----
Imported 0 record; 0 marked as removed
Any idea?
Cheers
Gonzalo
El lunes, 8 de enero de 2018, 11:14:44 (UTC), gonzalo perl escribió:
Hi Andrea
I have changed the date and i have added the affilation in dspace.cfg (via
build.propierties) and i haven´t changed scopusfeed.cfg
(Build. propierties)
#query.param.default=affilorg("Your institution")
scopus.query.param.default=affilorg(Universidad de Las Palmas de Gran Canaria)
Scopusfeed.cfg
scopus.query.param.default=${scopus.query.param.default}
And i get the following error:
C:\dspace\bin>dspace dsrun org.dspace.app.cris.batch.ScopusFeed -p
<email-address-of-an-administrator -s 2016-01-01 -e 2016-12-31 -c 2
Using DSpace installation in: C:\dspace
Exception: Java heap space
java.lang.OutOfMemoryError: Java heap space
at java.util.Arrays.copyOf(Unknown Source)
at java.util.Arrays.copyOf(Unknown Source)
at java.util.ArrayList.grow(Unknown Source)
at java.util.ArrayList.ensureExplicitCapacity(Unknown Source)
at java.util.ArrayList.ensureCapacityInternal(Unknown Source)
at java.util.ArrayList.add(Unknown Source)
at org.dspace.app.util.XMLUtils.getElementList(XMLUtils.java:44)
at org.dspace.app.util.XMLUtils.getSingleElement(XMLUtils.java:116)
at org.dspace.app.util.XMLUtils.getElementValue(XMLUtils.java:90)
at
org.dspace.submit.lookup.ScopusUtils.convertScopusDomToRecord(ScopusUtils.java:152)
at org.dspace.submit.lookup.ScopusService.search(ScopusService.java:164)
at
org.dspace.submit.lookup.ScopusOnlineDataLoader.search(ScopusOnlineDataLoader.java:152)
at
org.dspace.app.cris.batch.ScopusFeed.convertToImpRecordItem(ScopusFeed.java:316)
at org.dspace.app.cris.batch.ScopusFeed.main(ScopusFeed.java:212)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(Unknown Source)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source)
at java.lang.reflect.Method.invoke(Unknown Source)
at
org.dspace.app.launcher.ScriptLauncher.runOneCommand(ScriptLauncher.java:226)
at org.dspace.app.launcher.ScriptLauncher.main(ScriptLauncher.java:78)
C:\dspace\bin>
Cheers
Gonzalo
El domingo, 7 de enero de 2018, 19:15:20 (UTC), Bollini Andrea escribió:
Hi Gonzalo,
are you sure that Scopus has published record matching the query set in the
scopusfeed.cfg file on the 1st Jan 2018?
you could try with a larger timeframe, -s 2017-01-01 -e 2018-01-01 to get all
the records published in 2017.
You should provide a custom query on the command line -q or you should
customize the value in
https://github.com/4Science/DSpace/blob/dspace-5_x_x-cris/dspace/config/modules/scopusfeed.cfg#L1<https://urlsand.esvalabs.com/?u=https%3A%2F%2Fgithub.com%2F4Science%2FDSpace%2Fblob%2Fdspace-5_x_x-cris%2Fdspace%2Fconfig%2Fmodules%2Fscopusfeed.cfg%23L1&e=8ef37f15&h=53337279&f=n&p=y>
https://github.com/4Science/DSpace/blob/dspace-5_x_x-cris/build.properties#L264<https://urlsand.esvalabs.com/?u=https%3A%2F%2Fgithub.com%2F4Science%2FDSpace%2Fblob%2Fdspace-5_x_x-cris%2Fbuild.properties%23L264&e=8ef37f15&h=4e37f46d&f=n&p=y>
Hope this help,
Andrea
Il 07/01/2018 10:14, gonzalo perl ha scritto:
Hi Andrea
I run the Scopus feed script and get the following result
C:\dspace\bin>dspace dsrun org.dspace.app.cris.batch.ScopusFeed -p
<email-address-of-an-administrator> -s 2018-01-01 -e 2018-01-02 -c 2
Using DSpace installation in: C:\dspace
Imported 0 record; 0 marked as removed
And i check if the imp_record has content, but I see that it is empty
[https://lh3.googleusercontent.com/-SJRna_fWjFU/WlHjaC_ARbI/AAAAAAAAAw8/YOzBAlfw52gb4nDYgTuPt71U2VpA7VL8ACLcBGAs/s320/imp_record.jpg]<https://urlsand.esvalabs.com/?u=https%3A%2F%2Flh3.googleusercontent.com%2F-SJRna_fWjFU%2FWlHjaC_ARbI%2FAAAAAAAAAw8%2FYOzBAlfw52gb4nDYgTuPt71U2VpA7VL8ACLcBGAs%2Fs1600%2Fimp_record.jpg&e=8ef37f15&h=d2f306de&f=n&p=y>
Regards
Gonzalo
El miércoles, 3 de enero de 2018, 13:35:03 (UTC), Bollini Andrea escribió:
Hi Gonzalo,
this is a two step process. The periodic scanning script populates the imp_*
tables after that you will need to run the import script
./dspace dsrun org.dspace.app.cris.batch.ItemImportMainOA -E
<email-address-of-an-administrator>
see
https://wiki.duraspace.org/display/DSPACECRIS/DBMS+Import+framework<https://urlsand.esvalabs.com/?u=https%3A%2F%2Fwiki.duraspace.org%2Fdisplay%2FDSPACECRIS%2FDBMS%2BImport%2Bframework&e=8ef37f15&h=2945f1c9&f=n&p=y>
Can you check if you have content in the imp_records table?
Andrea
Il 01/01/2018 19:52, gonzalo perl ha scritto:
Hello everybody
I am trying to download the articles using the periodic scanning of external
database scripts, but the script does not save the articles in the database.
The script only downloads the articles and then deletes them. I can not find
what I have to do to have the script download and save the articles in a
workflow.
Is it possible to save the downloaded articles in the workflow or database?
Thank you
Gonzalo
--
You received this message because you are subscribed to the Google Groups
"DSpace Technical Support" group.
To unsubscribe from this group and stop receiving emails from it, send an email
to [email protected].
To post to this group, send email to [email protected].
Visit this group at
https://groups.google.com/group/dspace-tech<https://urlsand.esvalabs.com/?u=https%3A%2F%2Fgroups.google.com%2Fgroup%2Fdspace-tech&e=8ef37f15&h=f69ab701&f=n&p=y>.
For more options, visit
https://groups.google.com/d/optout<https://urlsand.esvalabs.com/?u=https%3A%2F%2Fgroups.google.com%2Fd%2Foptout&e=8ef37f15&h=9ae39a8b&f=n&p=y>.
--
Questo messaggio e' stato analizzato con Libra ESVA ed e' risultato non infetto.
Clicca qui per segnalarlo come
spam.<https://urlsand.esvalabs.com/?u=http%3A%2F%2Fesva1.business-e.it%2Fcgi-bin%2Flearn-msg.cgi%3Fid%3DC0FD7400EE.A3C6B&e=8ef37f15&h=b54131ea&f=n&p=y>
--
Andrea Bollini
Chief Technology and Innovation Officer
4Science,
www.4science.it<https://urlsand.esvalabs.com/?u=http%3A%2F%2Fwww.4science.it&e=8ef37f15&h=90f9bb84&f=n&p=y>
office: Via Edoardo D'Onofrio 304, 00155 Roma, Italy
mobile: +39 333 934 1808
skype: a.bollini
linkedin: andreabollini
orcid: 0000-0002-9029-1854
an Itway Group Company
Italy, France, Spain, Portugal, Greece, Turkey, Lebanon, Qatar, U.A.Emirates
--
This message has been checked by Libra ESVA and is believed to be clean.
--
You received this message because you are subscribed to the Google Groups
"DSpace Technical Support" group.
To unsubscribe from this group and stop receiving emails from it, send an email
to [email protected].
To post to this group, send email to [email protected].
Visit this group at
https://groups.google.com/group/dspace-tech<https://urlsand.esvalabs.com/?u=https%3A%2F%2Fgroups.google.com%2Fgroup%2Fdspace-tech&e=8ef37f15&h=f69ab701&f=n&p=y>.
For more options, visit
https://groups.google.com/d/optout<https://urlsand.esvalabs.com/?u=https%3A%2F%2Fgroups.google.com%2Fd%2Foptout&e=8ef37f15&h=9ae39a8b&f=n&p=y>.
--
Questo messaggio e' stato analizzato con Libra ESVA ed e' risultato non infetto.
Clicca qui per segnalarlo come
spam.<https://urlsand.esvalabs.com/?u=http%3A%2F%2Fesva1.business-e.it%2Fcgi-bin%2Flearn-msg.cgi%3Fid%3D4A4B1400CF.A1B05&e=8ef37f15&h=56da991f&f=n&p=y>
--
Andrea Bollini
Chief Technology and Innovation Officer
4Science,
www.4science.it<https://urlsand.esvalabs.com/?u=http%3A%2F%2Fwww.4science.it&e=8ef37f15&h=90f9bb84&f=n&p=y>
office: Via Edoardo D'Onofrio 304, 00155 Roma, Italy
mobile: +39 333 934 1808
skype: a.bollini
linkedin: andreabollini
orcid: 0000-0002-9029-1854
an Itway Group Company
Italy, France, Spain, Portugal, Greece, Turkey, Lebanon, Qatar, U.A.Emirates
--
This message has been checked by Libra ESVA and is believed to be clean.
--
You received this message because you are subscribed to the Google Groups
"DSpace Technical Support" group.
To unsubscribe from this group and stop receiving emails from it, send an email
to
[email protected]<mailto:[email protected]>.
To post to this group, send email to
[email protected]<mailto:[email protected]>.
Visit this group at
https://groups.google.com/group/dspace-tech<https://urlsand.esvalabs.com/?u=https%3A%2F%2Fgroups.google.com%2Fgroup%2Fdspace-tech&e=8ef37f15&h=f69ab701&f=n&p=y>.
For more options, visit
https://groups.google.com/d/optout<https://urlsand.esvalabs.com/?u=https%3A%2F%2Fgroups.google.com%2Fd%2Foptout&e=8ef37f15&h=9ae39a8b&f=n&p=y>.
--
Questo messaggio e' stato analizzato con Libra ESVA ed e' risultato non infetto.
Clicca qui per segnalarlo come
spam.<http://esva1.business-e.it/cgi-bin/learn-msg.cgi?id=E4C53400D3.A3008>
--
Andrea Bollini
Chief Technology and Innovation Officer
4Science, www.4science.it<http://www.4science.it>
office: Via Edoardo D'Onofrio 304, 00155 Roma, Italy
mobile: +39 333 934 1808
skype: a.bollini
linkedin: andreabollini
orcid: 0000-0002-9029-1854
an Itway Group Company
Italy, France, Spain, Portugal, Greece, Turkey, Lebanon, Qatar, U.A.Emirates
--
Questo messaggio e' stato analizzato da Libra ESVA ed e' risultato non infetto.
This message was scanned by Libra ESVA and is believed to be clean.
--
You received this message because you are subscribed to the Google Groups
"DSpace Technical Support" group.
To unsubscribe from this group and stop receiving emails from it, send an email
to [email protected].
To post to this group, send email to [email protected].
Visit this group at https://groups.google.com/group/dspace-tech.
For more options, visit https://groups.google.com/d/optout.
