[dspace-tech]

2018-09-28 Thread Mahendra K Sahu
Dear sir
Anyone, please give me the stepwise procedure to configure the local id
from existing id. At present, I am using Dspace6.2.

Thanks & Regards



Dr.Mahendra K Sahu,
Librarian, GIMS,
Gandhi Group of Institutions,
Gunupur-765022.
mob: 9437598807
Google Scholar Profile
https://scholar.google.co.in/citations?hl=en&user=VrsOKrEJ&imq=Dr+Mahend

-- 
All messages to this mailing list should adhere to the DuraSpace Code of 
Conduct: https://duraspace.org/about/policies/code-of-conduct/
--- 
You received this message because you are subscribed to the Google Groups 
"DSpace Technical Support" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to dspace-tech+unsubscr...@googlegroups.com.
To post to this group, send email to dspace-tech@googlegroups.com.
Visit this group at https://groups.google.com/group/dspace-tech.
For more options, visit https://groups.google.com/d/optout.


Re: [dspace-tech] Fwd: Dspace Stops Responding

2018-09-28 Thread Tim Donohue
Hi Keith,

This is a difficult question to answer, without better understanding the
reason for a system going down.  It's possible the site becomes overwhelmed
(either from normal behavior or a badly behaving bot crawling your site).
It's also possible that your site is hitting up against memory limits &
needs more optimization and/or memory.

I'd encourage you to keep an eye on the DSpace & Tomcat logs when your site
becomes unresponsive.  It could be that an error message appears there that
could provide you with a clue -- you also may want to try and consider
monitoring whether a single IP address is hitting your site excessively
(which could mean there's a bad behaving bot that is bringing your site
down).

Finally, we do have some documentation on optimization hints/tips, if
memory issues turn out to be the problem:
https://wiki.duraspace.org/display/DSDOC5x/Performance+Tuning+DSpace

Good luck, and let us know on this list if you notice anything more
specific.

Tim

On Wed, Sep 19, 2018 at 12:07 PM Keith Jones  wrote:

>
>
>
>
> Hi All,
>
> My institution is currently running Dspace version 5.3 in Tomcat backed by
> Postgres and we've recently been experiencing an uptick in our system being
> non-responsive. I can restart tomcat and everything returns. Have others
> been experiencing this and are there was to reduce the system from going
> down.
>
> Thanks
> Keith
>
> --
> All messages to this mailing list should adhere to the DuraSpace Code of
> Conduct: https://duraspace.org/about/policies/code-of-conduct/
> ---
> You received this message because you are subscribed to the Google Groups
> "DSpace Technical Support" group.
> To unsubscribe from this group and stop receiving emails from it, send an
> email to dspace-tech+unsubscr...@googlegroups.com.
> To post to this group, send email to dspace-tech@googlegroups.com.
> Visit this group at https://groups.google.com/group/dspace-tech.
> For more options, visit https://groups.google.com/d/optout.
>
-- 
Tim Donohue
Technical Lead for DSpace & DSpaceDirect
DuraSpace.org | DSpace.org | DSpaceDirect.org

-- 
All messages to this mailing list should adhere to the DuraSpace Code of 
Conduct: https://duraspace.org/about/policies/code-of-conduct/
--- 
You received this message because you are subscribed to the Google Groups 
"DSpace Technical Support" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to dspace-tech+unsubscr...@googlegroups.com.
To post to this group, send email to dspace-tech@googlegroups.com.
Visit this group at https://groups.google.com/group/dspace-tech.
For more options, visit https://groups.google.com/d/optout.


Re: [dspace-tech] Re: Export an item without losing its statistics

2018-09-28 Thread Tim Donohue
Hi Freddy,

DSpace does not have a built-in way to *automatically* restore deleted
records.  However, if you have been performing backups, you should be able
to restore from a backup.

To avoid this sort of thing in the future, you might want to ensure you are
backing up your data.  You can either backup at the database level, or you
can use DSpace's AIP backup solution:
https://wiki.duraspace.org/display/DSDOC6x/AIP+Backup+and+Restore   The
DSpace AIP backup solution *does* let you restore individual deleted
items...but it is NOT enabled by default (as AIP backups require extra
storage space).

DSpace also does not have a way to "reuse" an identifier by default (except
when you are restoring from a DSpace AIP backup).  However, if you recreate
the deleted Item, you could always just (manually) change the new Item's
identifier in the "handle" database table.  All Items in DSpace store their
identifiers in the "handle" column of the "handle" database table.  So, if
you are comfortable with manually modifying your database data, you can
recreate the deleted item, and then change it's "handle" column to be
"10469/8086".  However, before making any database level changes, PLEASE
BACKUP YOUR SYSTEM FIRST.  We cannot help if you accidentally delete or
change the wrong data in your database.

Depending on the version of DSpace you are using, we do have some SQL
"helper functions" that help with direct database access.
*
https://wiki.duraspace.org/display/DSPACE/Helper+SQL+functions+for+DSpace+6
*
https://wiki.duraspace.org/display/DSPACE/Helper+SQL+functions+for+DSpace+5

- Tim

On Fri, Sep 28, 2018 at 11:44 AM Freddy Guerrero 
wrote:

> Please can you help me with this query? We deleted a record by mistake and
> I have some questions:
>
> 1.- Can I recover a deleted record?
> 2.- The message that I have is of invalid Identifier (
> http://repositorio.flacsoandes.edu.ec/handle/10469/8086)
> 3.- If the record can not be recovered, how can I use the identifier again
> (10469/8086)?
>
> I ask you to help me with these questions.
>
> Regards
>
>
>
>
> El miércoles, 26 de septiembre de 2018, 21:35:08 (UTC-5), Freddy Guerrero
> escribió:
>
>> Hello with everyone
>>
>> Please can you help me with this query: How do I export an item but
>> without losing its statistics? This is because it has many downloads and
>> the author requires us to keep the statistics.
>>
>> http://67.192.84.248:8080/handle/10469/8680/statistics
>>
>> Then I need to import it to my repository
>>
>> Fred
>>
> --
> All messages to this mailing list should adhere to the DuraSpace Code of
> Conduct: https://duraspace.org/about/policies/code-of-conduct/
> ---
> You received this message because you are subscribed to the Google Groups
> "DSpace Technical Support" group.
> To unsubscribe from this group and stop receiving emails from it, send an
> email to dspace-tech+unsubscr...@googlegroups.com.
> To post to this group, send email to dspace-tech@googlegroups.com.
> Visit this group at https://groups.google.com/group/dspace-tech.
> For more options, visit https://groups.google.com/d/optout.
>
-- 
Tim Donohue
Technical Lead for DSpace & DSpaceDirect
DuraSpace.org | DSpace.org | DSpaceDirect.org

-- 
All messages to this mailing list should adhere to the DuraSpace Code of 
Conduct: https://duraspace.org/about/policies/code-of-conduct/
--- 
You received this message because you are subscribed to the Google Groups 
"DSpace Technical Support" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to dspace-tech+unsubscr...@googlegroups.com.
To post to this group, send email to dspace-tech@googlegroups.com.
Visit this group at https://groups.google.com/group/dspace-tech.
For more options, visit https://groups.google.com/d/optout.


[dspace-tech] Re: Export an item without losing its statistics

2018-09-28 Thread Freddy Guerrero
Please can you help me with this query? We deleted a record by mistake and 
I have some questions:

1.- Can I recover a deleted record?
2.- The message that I have is of invalid Identifier (
http://repositorio.flacsoandes.edu.ec/handle/10469/8086)
3.- If the record can not be recovered, how can I use the identifier again 
(10469/8086)?

I ask you to help me with these questions.

Regards




El miércoles, 26 de septiembre de 2018, 21:35:08 (UTC-5), Freddy Guerrero 
escribió:
>
> Hello with everyone
>
> Please can you help me with this query: How do I export an item but 
> without losing its statistics? This is because it has many downloads and 
> the author requires us to keep the statistics.
>
> http://67.192.84.248:8080/handle/10469/8680/statistics
>
> Then I need to import it to my repository
>
> Fred
>

-- 
All messages to this mailing list should adhere to the DuraSpace Code of 
Conduct: https://duraspace.org/about/policies/code-of-conduct/
--- 
You received this message because you are subscribed to the Google Groups 
"DSpace Technical Support" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to dspace-tech+unsubscr...@googlegroups.com.
To post to this group, send email to dspace-tech@googlegroups.com.
Visit this group at https://groups.google.com/group/dspace-tech.
For more options, visit https://groups.google.com/d/optout.


[dspace-tech] Re: Export an item without losing its statistics

2018-09-28 Thread Freddy Guerrero


El miércoles, 26 de septiembre de 2018, 21:35:08 (UTC-5), Freddy Guerrero 
escribió:
>
> Hello with everyone
>
> Please can you help me with this query: How do I export an item but 
> without losing its statistics? This is because it has many downloads and 
> the author requires us to keep the statistics.
>
> http://67.192.84.248:8080/handle/10469/8680/statistics
>
> Then I need to import it to my repository
>
> Fred
>

-- 
All messages to this mailing list should adhere to the DuraSpace Code of 
Conduct: https://duraspace.org/about/policies/code-of-conduct/
--- 
You received this message because you are subscribed to the Google Groups 
"DSpace Technical Support" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to dspace-tech+unsubscr...@googlegroups.com.
To post to this group, send email to dspace-tech@googlegroups.com.
Visit this group at https://groups.google.com/group/dspace-tech.
For more options, visit https://groups.google.com/d/optout.


Re: [dspace-tech] Re: AWS S3 Connection Pool Error

2018-09-28 Thread Nicholas Woodward
Hi Alan,
Thanks for the response! I tried with the following config, and DSpace 6.3 
was able to last about an hour before throwing pool connection errors.



It's running on Tomcat 8.5, and I'm guessing that's the source of my 
problems. I think I have the right attribute names for 8.5 
(https://tomcat.apache.org/tomcat-8.5-doc/jdbc-pool.html). Otherwise, I 
added the ResourceLink to each of the Contexts 
in /usr/share/tomcat8/conf/Catalina/localhost/oai.xml, rdf.xml, ROOT.xml, 
etc.

I haven't found in the tomcat docs yet if there are more setup changes I 
need to make to get it to work.


Thanks,
Nick


On Friday, September 28, 2018 at 9:18:27 AM UTC-5, Alan Orth wrote:
>
> Hey, Nick.
>
> We ended up doing quite a bit more tuning in our connection pooling setup 
> (some of it with input from Tom that original pooling thread). These are 
> the settings we're using on our DSpace 5.x instance on Tomcat 7 (a few 
> settings change on Tomcat 8.5, beware):
>
>type="javax.sql.DataSource"
>   driverClassName="org.postgresql.Driver"
>   
> url="jdbc:postgresql://localhost:5432/dspace?ApplicationName=dspaceWeb"
>   username="dspace"
>   password="dspace"
>   initialSize='5'
>   maxActive='250'
>   maxIdle='15'
>   minIdle='5'
>   maxWait='5000'
>   validationQuery='SELECT 1'
>   removeAbandoned='true'
>   removeAbandonedTimeout='180'
>   abandonWhenPercentageFull='50'
>   jdbcInterceptors='ResetAbandonedTimer'
>   logAbandoned='true'
>   testOnBorrow='true'
>   testOnReturn='true' />
>
> Our server gets a few million hits per month and we have not had any 
> connection pooling errors since we implemented these in early 2018. The 
> most important would probably be the ones for removing abandoned 
> connections.
>
> Regards,
>
> On Wed, Sep 26, 2018 at 10:22 PM Nicholas Woodward <
> woodward.n...@gmail.com > wrote:
>
>> Just out of curiosity, is this still an issue for folks on this thread? 
>> Were you able to resolve your issues by setting up a connection pool in 
>> Tomcat 
>> using Alan Orth's instructions? The reason I ask is that when we upgraded 
>> from 5.4 to 6.3 we also moved the assetstore into S3. And since then 
>> there's been an almost constant stream of errors like this in the logs.
>>
>>
>> com.amazonaws.http.AmazonHttpClient @ Unable to execute HTTP request: 
>> Timeout waiting for connection from pool
>> org.apache.http.conn.ConnectionPoolTimeoutException: Timeout waiting for 
>> connection from pool
>>
>>
>> When that happened I set up a connection pool using the instructions in 
>> the DSpace 6 installation docs - 
>> https://wiki.duraspace.org/display/DSDOC6x/Installing+DSpace#InstallingDSpace-Externaldatabaseconnectionpool.
>>  
>> And I set it up with what I thought were sufficiently high values for the 
>> maximum total connections (200) and maximum idle connections (50).
>>
>>
>> But the new setup has been in place for a few days now, and we're still 
>> seeing connection pool timeouts on a daily basis. Even though the maximum 
>> total connections is set to 200, we never see near that many postgres 
>> processes at any given time.
>>
>>
>> Is there some additional configuration to the JNDI Datasource that would 
>> help our situation? Or were there other things people did to improve the 
>> performance? 
>>
>>
>>
>> Thanks,
>>
>> Nick
>>
>>
>>
>>
>> On Wednesday, January 3, 2018 at 3:29:12 PM UTC-6, Mark H. Wood wrote:
>>>
>>> You might want to consider moving the pool out of DSpace's control into 
>>> the Servlet container -- see "Notes on PostgreSQL connection pooling with a 
>>> Tomcat JNDI resource" by Alan Orth elsewhere in this group.  It would give 
>>> you access to more of the pool's parameters (for testing connections before 
>>> use, and the like) and also make it easy to use a newer driver.  I've had 
>>> better luck with this arrangement.
>>>
>>> I believe that db.statementpool affects pooling of prepared statements 
>>> only.  Unless you've adjusted PostgreSQL, the default on its end is to do 
>>> no statement pooling regardless of what the client requests.  Like most 
>>> DBMS-centric webapp.s, DSpace can't operate without a connection pool.
>>>
>> -- 
>> All messages to this mailing list should adhere to the DuraSpace Code of 
>> Conduct: https://duraspace.org/about/policies/code-of-conduct/
>> --- 
>> You received this message because you are subscribed to the Google Groups 
>> "DSpace Technical Support" group.
>> To unsubscribe from this group and stop receiving emails from it, send an 
>> email to dspace-tech...@googlegroups.com .
>> To post to this group, send email to dspac...@googlegroups.com 
>> .
>> Visit this group at https://groups.google.com/group/dspace-tech.
>> For more options, visit https://groups.google.com/d/optout.
>>
>
>
> -- 
> Alan Orth
> alan...@gmail.com 
> https://picturingjordan.com
> https://engli

Re: [dspace-tech] REPOST: Re: Harvesting Error when running automatic harvesting scheduler

2018-09-28 Thread Tim Donohue
Hi Euler,

This sounds like a bug in the OAI Harvester to me (likely accidentally
caused by the Java API refactor in 6.x).  The reason I think that is
because of the error you are seeing from the Start Harvester:

failed to lazily initialize a collection of role:
org.dspace.content.DSpaceObject.metadata, could not initialize proxy - no
Session

This error is one that we ran into a lot during the development of DSpace 6
(and in later bug fix releases).  It's generally caused by Hibernate
attempting to use an object that has been "decached" from memory.  So, it
sounds to me like the code here has a bug somewhere that is causing this.

Here's other tickets that describe essentially this same behavior in other
areas of DSpace:
https://jira.duraspace.org/browse/DS-3660
https://jira.duraspace.org/browse/DS-3648
https://jira.duraspace.org/browse/DS-3775
https://jira.duraspace.org/browse/DS-3293

Could you create a new JIRA ticket to for this ticket (and essentially
provide the same details you sent here via email)?   I can then link it up
to all these old tickets and see if we can find a volunteer to investigate
& resolve it via a PR.

Thanks

Tim


On Thu, Sep 27, 2018 at 1:48 AM euler  wrote:

> Dear All,
>
> I am reposting this since I received no responses. It turned out that the
> Automatic Harvesting (Scheduler) from the Control Panel Screen in the demo
> server is also experiencing the same error that I stated below. Since I
> don't have access to the log files of the demo server, I can only assume
> that it is likely that what I am describing below is also happening in the
> demo server. I tried this on a fresh install of DSpace version 6.3 and I
> reproduced the errors mentioned. Right now, the only way I can successfully
> harvest (not on schedule or automatic) is via the command line by issuing 
> dspace
> harvest -r -e my@email -c collection_handle.
>
> Also, the error occuring in the demo server when enabling automatic
> harvesting in the control panel screen was posted in this mailing-list but
> unfortunately it has no responses: OAI Harvesting Error: failed to lazily
> initialize a collection of role
> 
>
> Hoping for your positive response since the repository that I'm working on
> will have the majority of its contents from external dspace sources.
>
> Thanks in advance!
> euler
>
> On Wednesday, September 12, 2018 at 2:42:34 PM UTC+8, euler wrote:
>>
>> Dear All,
>>
>> I'm having trouble using the automatic harvest scheduler both in the
>> XMLUI and in the command line. The version of DSpace the server is running
>> on is 6.3. When I use the command line (dspace harvest -S), the command
>> line returned the following error:
>>
>> Starting harvest loop... running.
>> org.dspace.core.exception.DatabaseSchemaValidationException: The schema
>> validator returned: null
>> at org.dspace.core.Context.init(Context.java:170)
>> at org.dspace.core.Context.(Context.java:126)
>> at
>> org.dspace.harvest.HarvestScheduler.scheduleLoop(HarvestScheduler.java:149)
>> at
>> org.dspace.harvest.HarvestScheduler.run(HarvestScheduler.java:140)
>> at java.lang.Thread.run(Unknown Source)
>> Exception in thread "Thread-4"
>> org.dspace.core.exception.DatabaseSchemaValidationException: The schema
>> validator returned: null
>> at org.dspace.core.Context.init(Context.java:170)
>> at org.dspace.core.Context.(Context.java:126)
>> at
>> org.dspace.harvest.HarvestScheduler.scheduleLoop(HarvestScheduler.java:234)
>> at
>> org.dspace.harvest.HarvestScheduler.run(HarvestScheduler.java:140)
>> at java.lang.Thread.run(Unknown Source)
>>
>>
>> The log showed the message below after running the command dspace harvest
>> -S:
>>
>> 2018-09-12 13:14:57,708 FATAL org.dspace.core.Context @ Cannot obtain the
>> bean which provides a database connection. Check previous entries in the
>> dspace.log to find why the db failed to initialize. The schema validator
>> returned: null
>> 2018-09-12 13:14:57,709 ERROR org.dspace.harvest.HarvestScheduler @
>> Exception on iteration: 0
>> 2018-09-12 13:14:57,713 FATAL org.dspace.core.Context @ Cannot obtain the
>> bean which provides a database connection. Check previous entries in the
>> dspace.log to find why the db failed to initialize. The schema validator
>> returned: null
>>
>> When using the Harvesting tab in the XMLUI control panel, after clicking
>> Start Harvester, the page returned this message:
>>
>> failed to lazily initialize a collection of role:
>> org.dspace.content.DSpaceObject.metadata, could not initialize proxy - no
>> Session
>>
>> Although when I press the back button of the browser, the status says
>> that the scheduler is waiting for collections to harvest. It seems that the
>> automatic scheduler from the UI is now running although it didn't harvest
>> any new items from the collections that I've set up for harvesting because
>>

Re: [dspace-tech] Re: DSpace 6.2 with collection home page too slow to load if items have lots of bitsteams

2018-09-28 Thread Tim Donohue
Hi Bill,

The issue you are seeing doesn't sound to be the same as the original issue
in this thread.  The behavior that was fixed in 6.3 was a behavior where
the *Collection homepage* loaded extremely slowly if you had Items that had
large number of bitstreams/thumbnails.  The fix was to be much smarter
about when to load Thumbnails/bitstreams into memory (and it was a fix to
the Java code under the XMLUI, so it applied to all themes):
https://github.com/DSpace/DSpace/pull/2016

The behavior you seem to be describing sounds different... you are talking
about the /community-list page with a large number of
collections/communities, and a Community page with a large number of
sub-communities/collections.  So, I'm not surprised that this specific 6.3
optimization had no effect -- as it was only for Collection homepages.

I cannot say for certain what is behind the behavior you are seeing -- it's
very possible that it's semi-related in that DSpace may be loading too many
objects into memory at once (which slows down the application, especially
with the addition of Hibernate in 6.x).  But, in your situation, it sounds
like maybe DSpace is loading too many Communities/Collections at once
(whereas the bug fixed was about ensuring DSpace didn't load too many
bitstreams into memory at once)

All in all, I think we may need to create a new ticket & begin a new
investigation into why this other performance behavior is occurring.
Hopefully it's something we can track down and fix in a 6.4 release.

- Tim

On Fri, Sep 28, 2018 at 10:11 AM Bill Tantzen  wrote:

> I'm very tardy jumping back into this party, but here's an update:  I just
> upgraded my dev site to version 6.3, and the speed problems persist.  I
> have made sure to optimize the mets requests in my theme, but that's
> actually a moot point, because the slowness is equally apparent even in the
> Default Reference Theme and the Atmire Mirage2 Theme (which I assume has
> been optimized, in v6.3, correct?).
>
> For /community-list with ~1500 collections + communities and 62K items,
> the page load time is minutes.  For our main community page, which contains
> the bulk of those sub-communities and collections (maybe 90%), the page
> load time is about 15 seconds.  That's still too slow to put into
> production, but makes me wonder why the difference in speed is so vast
> compared with the number of children in each case.
>
> Also, in one respect, the performance is even worse now.  If you dig up an
> earlier thread that I started, you will remember that the speed is just
> fine when logged in as an admin.  This is no longer the case, as there is
> no difference in speed between admin and anonymous users.
>
> Naturally, this is causing us to sit on v5.x for now, but since the rest
> half of v7 is based on v6, we need to figure this out!
>
> Cheers,
> Bill
>
> On Thu, Apr 12, 2018 at 1:02 AM Ying Jin  wrote:
>
>> Hi Tim,
>>
>> I have the fileSec updated so it only retrieve THUMBNAILs and it
>> significantly improved the page loading. Though some of our static
>> thumbnails broken, I am sure I can find another way to fix that.
>>
>> Cheers,
>> Ying
>>
>> On Wednesday, April 11, 2018 at 10:19:10 AM UTC-5, Tim Donohue wrote:
>>>
>>> Hi Ying,
>>>
>>> Looking forward to hearing what you find out.
>>>
>>> In the meantime, I'd like to better understand this statement:
>>>
>>> "For the thumbnail part, it is still a problem for us as I mentioned
>>> earlier, we have special theme needs to load all the thumbnails for the
>>> Gallery theme and TEI theme."
>>>
>>> Could you describe how you are using/displaying thumbnails in the
>>> Gallery theme and TEI theme? Are you displaying multiple thumbnails *per
>>> item* on the Community/Collection homepages (e.g. in Recent Submissions) in
>>> these themes?  If so, is there a limit to the number of thumbnails you
>>> display per Item (or a limit to the number of thumbnails that tend to exist
>>> per item)? Or is each item still represented by a single thumbnail on the
>>> Community/Collection homepage?  Do you have links you could share with us
>>> regarding these themes, so that we can better understand the use case
>>> here?
>>>
>>> Obviously, we don't want to include changes in DSpace 6.3 that would
>>> improve performance but also break specific theme use cases.
>>>
>>> Thanks
>>>
>>> - Tim
>>>
>>> On Wed, Apr 11, 2018 at 10:06 AM Ying Jin  wrote:
>>>
 Hi Tim,

 Thanks very much for the detailed information and great suggestion! It
 makes sense to not load original bundles or any other bundles that are not
 related to the page view.

 Now I remembered I customized the "sections=
 dmdSec,fileSec&fileGrpTypes=THUMBNAIL" part long time ago for some
 customizations as we need more info from mets.xml than what it is provided
 by default. I need to go and check what I have changed and report back!

 For the thumbnail part, it is still a problem for us as I mentioned
 earlier, we hav

Re: [dspace-tech] Re: Track the last eperson who edited an item

2018-09-28 Thread Tim Donohue
Hello,

Unfortunately, this is currently not provided out-of-the-box.  DSpace
captures a "last_modified" date on Items (in the "item" database table),
and it does capture basic provenance of who submitted/approved an item (in
dc.description.provenance).  But, individual metadata edits after the item
has been created are not captured in DSpace itself.

However, if you have the DSpace *log files* from that date, the log files
should note exactly who was logged in and edited that item at that time.
So, this information is logged, but not preserved within DSpace internally.

Tim

On Thu, Sep 27, 2018 at 10:10 AM 'Tran Huu Trung (TTTV.ICT)' via DSpace
Technical Support  wrote:

> Any help?
>
>
> Vào 20:23:05 UTC+7 Thứ Ba, ngày 22 tháng 12 năm 2015, euler đã viết:
>
>> Dear All,
>>
>> Is there a way to determine who is the last person that edited a certain
>> item? I can see in the item status tab the last modified date and in the
>> item metadata tab in the dc.description.provenance who is the submitter and
>> who approved the item. I was asked by a repository manager because some
>> metadata went missing (I suspected that it was deleted accidentally) in
>> some items. These could be problematic if there were numerous persons who
>> have the permission to edit items.
>>
>> Any advice would be greatly appreciated on this matter.
>>
>> Thanks in advance and best regards,
>> euler
>>
> --
> All messages to this mailing list should adhere to the DuraSpace Code of
> Conduct: https://duraspace.org/about/policies/code-of-conduct/
> ---
> You received this message because you are subscribed to the Google Groups
> "DSpace Technical Support" group.
> To unsubscribe from this group and stop receiving emails from it, send an
> email to dspace-tech+unsubscr...@googlegroups.com.
> To post to this group, send email to dspace-tech@googlegroups.com.
> Visit this group at https://groups.google.com/group/dspace-tech.
> For more options, visit https://groups.google.com/d/optout.
>
-- 
Tim Donohue
Technical Lead for DSpace & DSpaceDirect
DuraSpace.org | DSpace.org | DSpaceDirect.org

-- 
All messages to this mailing list should adhere to the DuraSpace Code of 
Conduct: https://duraspace.org/about/policies/code-of-conduct/
--- 
You received this message because you are subscribed to the Google Groups 
"DSpace Technical Support" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to dspace-tech+unsubscr...@googlegroups.com.
To post to this group, send email to dspace-tech@googlegroups.com.
Visit this group at https://groups.google.com/group/dspace-tech.
For more options, visit https://groups.google.com/d/optout.


Re: [dspace-tech] Re: DSpace 6.2 with collection home page too slow to load if items have lots of bitsteams

2018-09-28 Thread Bill Tantzen
I'm very tardy jumping back into this party, but here's an update:  I just
upgraded my dev site to version 6.3, and the speed problems persist.  I
have made sure to optimize the mets requests in my theme, but that's
actually a moot point, because the slowness is equally apparent even in the
Default Reference Theme and the Atmire Mirage2 Theme (which I assume has
been optimized, in v6.3, correct?).

For /community-list with ~1500 collections + communities and 62K items, the
page load time is minutes.  For our main community page, which contains the
bulk of those sub-communities and collections (maybe 90%), the page load
time is about 15 seconds.  That's still too slow to put into production,
but makes me wonder why the difference in speed is so vast compared with
the number of children in each case.

Also, in one respect, the performance is even worse now.  If you dig up an
earlier thread that I started, you will remember that the speed is just
fine when logged in as an admin.  This is no longer the case, as there is
no difference in speed between admin and anonymous users.

Naturally, this is causing us to sit on v5.x for now, but since the rest
half of v7 is based on v6, we need to figure this out!

Cheers,
Bill

On Thu, Apr 12, 2018 at 1:02 AM Ying Jin  wrote:

> Hi Tim,
>
> I have the fileSec updated so it only retrieve THUMBNAILs and it
> significantly improved the page loading. Though some of our static
> thumbnails broken, I am sure I can find another way to fix that.
>
> Cheers,
> Ying
>
> On Wednesday, April 11, 2018 at 10:19:10 AM UTC-5, Tim Donohue wrote:
>>
>> Hi Ying,
>>
>> Looking forward to hearing what you find out.
>>
>> In the meantime, I'd like to better understand this statement:
>>
>> "For the thumbnail part, it is still a problem for us as I mentioned
>> earlier, we have special theme needs to load all the thumbnails for the
>> Gallery theme and TEI theme."
>>
>> Could you describe how you are using/displaying thumbnails in the Gallery
>> theme and TEI theme? Are you displaying multiple thumbnails *per item* on
>> the Community/Collection homepages (e.g. in Recent Submissions) in these
>> themes?  If so, is there a limit to the number of thumbnails you display
>> per Item (or a limit to the number of thumbnails that tend to exist per
>> item)? Or is each item still represented by a single thumbnail on the
>> Community/Collection homepage?  Do you have links you could share with us
>> regarding these themes, so that we can better understand the use case
>> here?
>>
>> Obviously, we don't want to include changes in DSpace 6.3 that would
>> improve performance but also break specific theme use cases.
>>
>> Thanks
>>
>> - Tim
>>
>> On Wed, Apr 11, 2018 at 10:06 AM Ying Jin  wrote:
>>
>>> Hi Tim,
>>>
>>> Thanks very much for the detailed information and great suggestion! It
>>> makes sense to not load original bundles or any other bundles that are not
>>> related to the page view.
>>>
>>> Now I remembered I customized the "sections=dmdSec,fileSec&fileGrpTypes=
>>> THUMBNAIL" part long time ago for some customizations as we need more
>>> info from mets.xml than what it is provided by default. I need to go and
>>> check what I have changed and report back!
>>>
>>> For the thumbnail part, it is still a problem for us as I mentioned
>>> earlier, we have special theme needs to load all the thumbnails for the
>>> Gallery theme and TEI theme.
>>>
>>> I posted a code update on ticket about the READ_ONLY mode. For read-only
>>> transactions, we should set Hibernate flush mode to MANUAL. However, DSpace
>>> missed several places to change the default AUTO to MANUAL, that's why we
>>> got lots of partial-flushing in the log. I will post more findings on the
>>> tickets.
>>>
>>> Best,
>>> Ying
>>>
>>>
>>>
>>> On Wednesday, April 11, 2018 at 9:13:10 AM UTC-5, Tim Donohue wrote:
>>>
 Hi Ying (I'm copying back in DSpace-Tech, as I'd like this discussion
 to stay on-list),

 Looking back at this thread, I see you mentioned the custom MASTER
 bundle earlier as well. I had forgotten that.

 The core issue (that I resolved in
 https://github.com/DSpace/DSpace/pull/2016) is actually not directly
 related to Hibernate. The issue we discovered is the XMLUI themes/aspects
 are loading and parsing bundles that *are unnecessary to display the
 Collection homepage*.   So, in PR#2016, I resolved this by ensuring that,
 on the Collection/Community homepages, the XMLUI themes/aspects never load
 the ORIGINAL bundle content (and only load up the first bitstream in the
 THUMBNAIL bundle).

 Since this didn't improve your performance, I'd venture to guess that
 the XMLUI theme you are using is either purposefully or accidentally
 loading up you custom MASTER bundle (and looping through all the objects in
 that bundle).  Assuming you don't need any information about the MASTER
 bitstreams on the Collection homepage, the fix would be to ensure y

RE: [dspace-tech] Re: Problems with Orcid in dspace 6.3

2018-09-28 Thread Sean Kalynuk
Just following up that my tests also confirmed that PR-2195 fixes a bunch of 
issues and I added a comment to https://jira.duraspace.org/browse/DS-3999 with 
some details.
--
Sean

From: dspace-tech@googlegroups.com  On Behalf Of 
Darryl Friesen
Sent: September 20, 2018 4:36 PM
To: DSpace Technical Support 
Subject: Re: [dspace-tech] Re: Problems with Orcid in dspace 6.3


Great.  I've left a comment in DS-3999 stating that it appears to correct the 
issue.

- Darryl



On Thursday, September 20, 2018 at 3:26:06 PM UTC-6, Tim Donohue wrote:
Hi Darryl,

We welcome *either* code reviewers or testers.  So, simply adding your feedback 
that the PR "worked for you" and resolved  issues is good feedback.  If you 
don't have a GitHub account, you can also just add your testing feedback to the 
original JIRA ticket (https://jira.duraspace.org/browse/DS-3999).

Definitely don't worry if you cannot provide a code review.  We have plenty of 
volunteers that can provide quick code reviews.  Often we are most lacking in 
good *testers* (especially folks who've seen the issue & know how to trigger 
it, and can therefore easily tell if the code "fixes it").

Thanks for your testing!

Tim




On Thu, Sep 20, 2018 at 4:21 PM Darryl Friesen 
> wrote:

I implemented the change to Orcidv2AuthorityValue.java as per PR 2195 and 
rolled that out to our test server.  This seems to have fixed most (all?) of 
the issues mentioned in this thread, specifically:


  *   adding an additional author no longer seems to remove orcid_id from the 
Solr database
  *   Running index-authority also no longer removes orcid_id from Solr
  *   orcid is now displayed when using the author Lookup feature.  This is an 
important issue for us (and Sean as well i assume since he also mentioned it) 
we prefer ORCID whenever possible.  This will help eliminate dups in authority 
control now that people can see the ORCID ID again
I did not try UpdateAuthorities to see if the issues mentioned by Sean were 
still an issue.

Tim, I'm not a Java programmer -- I can help out if you want to migrate DSpace 
to one of the PHP frameworks though :)  -- so I don't feel comfortable making 
an approving review of the code in the PR;  I'm not sure if the code in that PR 
is "good" or not, nor how it might affect the rest of the DSpace codebase, but 
I could leave a comment in the PR if that helps.  It seems to have fixed a lot 
of issues for me.

- Darryl





On Thursday, September 20, 2018 at 12:42:54 PM UTC-6, Tim Donohue wrote:
All,

For anyone affected by the index-authority bug described in 
https://jira.duraspace.org/browse/DS-3999, we could use more testers for the 
proposed fix at: https://github.com/DSpace/DSpace/pull/2195 .  The quicker bug 
fixes get tested or reviewed, the quicker we are able to move them along into 
the actual codebase.  While we do have some volunteers that help us with 
testing/reviewing, finding additional community users can always speed up the 
process.

- Tim

On Thu, Sep 20, 2018 at 1:12 PM Sean Kalynuk 
mailto:sean.k...@umanitoba.ca>> wrote:
Hi Darryl,

I’m currently experimenting with DSpace 6.3 and have the same or similar issues.


• index-authority is removing orcid_id but leaving the authority_type 
as “orcid” (see https://jira.duraspace.org/browse/DS-3999)

• The orcid_id is not displaying in the Author Lookup for authors added 
from ORCID, so, when there are duplicate author entries, you cannot 
differentiate authority_type=”orcid_id” from authority_type=”person” for the 
same person

• UpdateAuthorities has multiple issues (-i option results in NPE and a 
full update only runs on 10 records) (see 
https://jira.duraspace.org/browse/DS-3302)

--
Sean

From: dspac...@googlegroups.com 
mailto:dspac...@googlegroups.com>> On Behalf Of 
Darryl Friesen

Sent: September 20, 2018 11:18 AM
To: DSpace Technical Support 
mailto:dspac...@googlegroups.com>>

Subject: [dspace-tech] Re: Problems with Orcid in dspace 6.3

While I haven't experimented with what happens when adding additional authors, 
I've noticed that the "orcid_id" field also seems to get removed by the 
"index-authority" job that runs as part of cron.  Perhaps there's a common task 
that is executed during both processes that is messing up the Solr database.

I've also noticed issues with the authority control/ORCID Lookup features 
during submission (and when editing).  The OCRID seems to be lost there too, 
and the authority control will happily create duplicates. I posted about it a 
couple weeks ago:

 https://groups.google.com/d/msg/dspace-tech/4nJRVyn8Hk8/M0TnMAIBCgAJ

I'm happy the ORCID lookup works again, but there seems to be some issues with 
it.

- Darryl


On Sunday, September 16, 2018 at 3:37:20 AM UTC-6, Stefanie Behnke wrote:
Dear all,
we use Dspace 6.3, XMLUI Interface and ORCID enabled.
Submitting a new item with 2 authors works. The result in the authority shows: 
(example for one author

Re: [dspace-tech] Re: AWS S3 Connection Pool Error

2018-09-28 Thread Alan Orth
Hey, Nick.

We ended up doing quite a bit more tuning in our connection pooling setup
(some of it with input from Tom that original pooling thread). These are
the settings we're using on our DSpace 5.x instance on Tomcat 7 (a few
settings change on Tomcat 8.5, beware):



Our server gets a few million hits per month and we have not had any
connection pooling errors since we implemented these in early 2018. The
most important would probably be the ones for removing abandoned
connections.

Regards,

On Wed, Sep 26, 2018 at 10:22 PM Nicholas Woodward <
woodward.nicholas@gmail.com> wrote:

> Just out of curiosity, is this still an issue for folks on this thread?
> Were you able to resolve your issues by setting up a connection pool in Tomcat
> using Alan Orth's instructions? The reason I ask is that when we upgraded
> from 5.4 to 6.3 we also moved the assetstore into S3. And since then
> there's been an almost constant stream of errors like this in the logs.
>
>
> com.amazonaws.http.AmazonHttpClient @ Unable to execute HTTP request:
> Timeout waiting for connection from pool
> org.apache.http.conn.ConnectionPoolTimeoutException: Timeout waiting for
> connection from pool
>
>
> When that happened I set up a connection pool using the instructions in
> the DSpace 6 installation docs -
> https://wiki.duraspace.org/display/DSDOC6x/Installing+DSpace#InstallingDSpace-Externaldatabaseconnectionpool.
> And I set it up with what I thought were sufficiently high values for the
> maximum total connections (200) and maximum idle connections (50).
>
>
> But the new setup has been in place for a few days now, and we're still
> seeing connection pool timeouts on a daily basis. Even though the maximum
> total connections is set to 200, we never see near that many postgres
> processes at any given time.
>
>
> Is there some additional configuration to the JNDI Datasource that would
> help our situation? Or were there other things people did to improve the
> performance?
>
>
>
> Thanks,
>
> Nick
>
>
>
>
> On Wednesday, January 3, 2018 at 3:29:12 PM UTC-6, Mark H. Wood wrote:
>>
>> You might want to consider moving the pool out of DSpace's control into
>> the Servlet container -- see "Notes on PostgreSQL connection pooling with a
>> Tomcat JNDI resource" by Alan Orth elsewhere in this group.  It would give
>> you access to more of the pool's parameters (for testing connections before
>> use, and the like) and also make it easy to use a newer driver.  I've had
>> better luck with this arrangement.
>>
>> I believe that db.statementpool affects pooling of prepared statements
>> only.  Unless you've adjusted PostgreSQL, the default on its end is to do
>> no statement pooling regardless of what the client requests.  Like most
>> DBMS-centric webapp.s, DSpace can't operate without a connection pool.
>>
> --
> All messages to this mailing list should adhere to the DuraSpace Code of
> Conduct: https://duraspace.org/about/policies/code-of-conduct/
> ---
> You received this message because you are subscribed to the Google Groups
> "DSpace Technical Support" group.
> To unsubscribe from this group and stop receiving emails from it, send an
> email to dspace-tech+unsubscr...@googlegroups.com.
> To post to this group, send email to dspace-tech@googlegroups.com.
> Visit this group at https://groups.google.com/group/dspace-tech.
> For more options, visit https://groups.google.com/d/optout.
>


-- 
Alan Orth
alan.o...@gmail.com
https://picturingjordan.com
https://englishbulgaria.net
https://mjanja.ch
"In heaven all the interesting people are missing." ―Friedrich Nietzsche

-- 
All messages to this mailing list should adhere to the DuraSpace Code of 
Conduct: https://duraspace.org/about/policies/code-of-conduct/
--- 
You received this message because you are subscribed to the Google Groups 
"DSpace Technical Support" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to dspace-tech+unsubscr...@googlegroups.com.
To post to this group, send email to dspace-tech@googlegroups.com.
Visit this group at https://groups.google.com/group/dspace-tech.
For more options, visit https://groups.google.com/d/optout.


[dspace-tech] Re: DOI registration only for specific collections

2018-09-28 Thread Mark H. Wood
On Tuesday, September 13, 2016 at 10:29:11 AM UTC-4, Anthony Petryk wrote:
>
> Is it possible to turn on DOI registration, but only for specific 
> collections?  For pre-existing publications/content, do you worry about 
> multiple DOI assignment for the same work?  
>
>

Not out-of-the-box, but there is a patch associated with  
https://jira.duraspace.org/browse/DS-3749.

-- 
All messages to this mailing list should adhere to the DuraSpace Code of 
Conduct: https://duraspace.org/about/policies/code-of-conduct/
--- 
You received this message because you are subscribed to the Google Groups 
"DSpace Technical Support" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to dspace-tech+unsubscr...@googlegroups.com.
To post to this group, send email to dspace-tech@googlegroups.com.
Visit this group at https://groups.google.com/group/dspace-tech.
For more options, visit https://groups.google.com/d/optout.


[dspace-tech] Communities and Collections order in JSPUI search results

2018-09-28 Thread Periklis Ntanasis
Hi,

I am using DSpace 5.8 with JSPUI.

In the simple-search results page there is a section of "Community hits"
and one of "Collection hits" before the Items. The results in those 2
sections (if there is any) do not populate the first pages first. For
example the first page may contain 3 communities, the second 2 and the
third 4.

This question has been mentioned before here: http://dspace.2283337.n4.
nabble.com/Re-Communities-and-Collections-in-search-results-td4672768.html

However, the person who asked the question was more interested in hiding
the community and collection hits.

I was wondering if there is a configuration option or an easy way to make
the community and collection hits populate the first pages first.

Thanks in advance,
Periklis

-- 
All messages to this mailing list should adhere to the DuraSpace Code of 
Conduct: https://duraspace.org/about/policies/code-of-conduct/
--- 
You received this message because you are subscribed to the Google Groups 
"DSpace Technical Support" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to dspace-tech+unsubscr...@googlegroups.com.
To post to this group, send email to dspace-tech@googlegroups.com.
Visit this group at https://groups.google.com/group/dspace-tech.
For more options, visit https://groups.google.com/d/optout.