Re: [Dspace-tech] IP Authentication in dspace 3.1
What is strange is that even after I did the configurations, when I check the logs, the access comes as anonymous. Is it something usual when we use IP authentication? - Ribin - Original Message - From: ribin jones ribin.jo...@niist.res.in To: heli...@centrum.sk Cc: dspace-tech dspace-tech@lists.sourceforge.net Sent: Wednesday, 7 August, 2013 9:50:13 AM Subject: Re: [Dspace-tech] IP Authentication in dspace 3.1 Pls see my answers below: - Original Message - From: helix84 heli...@centrum.sk To: ribin jones ribin.jo...@niist.res.in Cc: dspace-tech dspace-tech@lists.sourceforge.net Sent: Wednesday, 7 August, 2013 3:27:49 AM Subject: Re: [Dspace-tech] IP Authentication in dspace 3.1 On Tue, Aug 6, 2013 at 10:50 AM, ribin.jo...@niist.res.in wrote: I even tried with a single IP...still I see in the dspace log as access coming from anonymous. I had created a group by name SplGrp from dspace web interface and it is mentioned as ip.SplGrp = 10.10.50.201, \ in authentication-ip.cfg It looks correct. 1) Does the specific _item_ you're trying to access the READ right for the SplGrp group? I gave READ access permission for group SplGrp for one particular item I was trying to access and now it asks for a username/pwd when I try to access it from any network. 2) Is there any address translation (NAT) between the client (10.10.50.201) and DSpace? NO 2a) Check dspace.log to see what DSpace sees as your address. Please see the dspace logs below when I try to access an item. There is no NAT happenening in-between and access comes from 10.10.50.201 which is a local PC in the LAN: 2013-08-07 15:12:50,616 INFO org.dspace.app.webui.servlet.AbstractBrowserServlet @ anonymous:session_id=8EA1C12719F4C5C76F7715D4FF217706:ip_addr=10.10.50.201:browse:type=title,order=ASC,value=null,month=null,year=null,starts_with=null,vfocus=null,focus=-1,rpp=20,sort_by=1,community=123456789/632,collection=n/a,level=0,etal=-1 2013-08-07 15:12:50,617 INFO org.dspace.browse.BrowseEngine @ anonymous:session_id=8EA1C12719F4C5C76F7715D4FF217706:ip_addr=10.10.50.201:browse_by_item: 2013-08-07 15:12:51,750 WARN org.dspace.core.PluginManager @ No Configuration entry found for Sequence Plugin interface=org.dspace.plugin.ItemHomeProcessor 2b) Also look for any errors and messages there. If there are no messages, raise the log level to DEBUG and try again: https://wiki.duraspace.org/display/DSPACE/Troubleshoot+an+error Regards, ~~helix84 Compulsory reading: DSpace Mailing List Etiquette https://wiki.duraspace.org/display/DSPACE/Mailing+List+Etiquette -- Get 100% visibility into Java/.NET code with AppDynamics Lite! It's a free troubleshooting tool designed for production. Get down to code-level detail for bottlenecks, with 2% overhead. Download for free and get started troubleshooting in minutes. http://pubads.g.doubleclick.net/gampad/clk?id=48897031iu=/4140/ostg.clktrk ___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech List Etiquette: https://wiki.duraspace.org/display/DSPACE/Mailing+List+Etiquette
Re: [Dspace-tech] Missing dc.type field in mets.xml, but present in database
As it looks as not asked before... have you reindex your content after have changed the discovery configuration? as you have noted the filter are index under a different SOLR field, in your case type bean id=searchFilterType class=org.dspace.discovery.configuration.DiscoverySearchFilter property name=indexFieldName value=type/ it is derived from your indexFieldName configuration. The metadata are automatically indexed in discovery in the form schema.element.qualifier so it is right that you already have dc.type in your index but if have added the type searchFilter only recently it only affect items added or changed after this change. Hope this help, Andrea Il 07/08/2013 02:29, Andrea Schweer ha scritto: Hi, On 07/08/13 08:45, Alcides Carlos de Moraes Neto wrote: Looking at the solr logs, i see that the discovery filter is passed to SOLR as a parameter fq=type http://www22.senado.leg.br/solr/search/select?indent=truerows=0q=dc.type:[*+TO+*]fq=type:(text) http://www22.senado.leg.br/solr/search/select?indent=truerows=0q=dc.type:[*+TO+*]fq=type:%28text%29 Hm. Discovery has changed between 1.8.2 (which I'm still using) and 3.x and this is getting into areas that I'm not familiar with. That filter query looks for a field with the name type, not dc.type. So I assume only 2189 of your items have that field. curl --globoff http://127.0.0.1:8080/solr/search/select?indent=truerows=0q=type:[*+TO+*]; should verify that (by having numFound of 2189). That fields is created by Discovery based on the search filter settings, so I think you're right in that this has something to do with your custom search filter. However, your filter looks exactly like in the Discovery documentation, so I don't know what's going wrong. Could you try curl --globoff http://127.0.0.1:8080/solr/search/select?indent=truerows=1q=-type:[*+TO+*]+AND+dc.type:[*+TO+*]; This should give you 1 result that has no type field but a dc.type field in the discovery solr index. Then perhaps curl --globoff http://127.0.0.1:8080/solr/search/select?indent=truerows=1q=type:[*+TO+*]+AND+dc.type:[*+TO+*]; to give you an item that has both type and dc.type in the discovery solr index. Then compare these two items and see if there is a pattern. Just a stab in the dark, perhaps there is a bug with discovery indexing for items with more than one value for dc.type? I suspect Kevin would be a good person to help troubleshoot this, but I don't know if he's following the mailing list at the moment. I'm cc'ing him in to increase the chances that he'll see this. cheers, Andrea -- Andrea Bollini Dipartimento Servizi e Soluzioni per l'Amministrazione Universitaria Divisione Ricerca Via dei Tizii, 6 00185 Roma, Italy tel. +39 06 44 486 087 - mob. +39 348 82 77 525 http://www.cineca.it -- Get 100% visibility into Java/.NET code with AppDynamics Lite! It's a free troubleshooting tool designed for production. Get down to code-level detail for bottlenecks, with 2% overhead. Download for free and get started troubleshooting in minutes. http://pubads.g.doubleclick.net/gampad/clk?id=48897031iu=/4140/ostg.clktrk ___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech List Etiquette: https://wiki.duraspace.org/display/DSPACE/Mailing+List+Etiquette
Re: [Dspace-tech] One handle server for two DSpace instances?
Hi, Il 03/06/2013 21:16, Peter Dietz ha scritto: Hi Jessica / Nikolai, I've been looking into a possibly related problem. We are planning on consolidating/moving DSpace instances. We want a single handle daemon that supports multiple handle prefixes, and supports multiple DSpace (and possibly non-DSpace) instances. I have started to think about this too. Our need is very similar to the previous statement from Peter: one single handle daemon - multiple handle prefix we have a semplification here, 1 dspace = 1 unique handle prefix. Handle prefix are not shared between different dspace so there are not issues related to collisions. My idea (we have not yet write any code) is to build a custom connector for the Handle daemon that replace the current out-of-box DSpace HandlePlugin storage_type = CUSTOM storage_class = org.dspace.handle.HandlePlugin This connector should read a configuration file (or better a spring bean) that map handle prefix to different resolver. For the dspace instances I plan to write a simple servlet able to answer in JSON with the URL corresponding to the asked handle or N/A if the handle is not valid. So in first instance a single resolver able to query this JSON servlet is needed. Helix: is your code able to manage my use case? Any other considerations? Andrea My understanding is that the Global Handle Service (GHS) (i.e. hdl.handle.net http://hdl.handle.net) resolves requests to your Handle prefix by querying your Local Handle Service (LHS). Your LHS has to respond with a YES or a NO (that you have a specific handle or not), and if YES, then you also include an HTTP URL to redirect the handle to. The handle daemon packaged with DSpace connects to your instances DSpace Database, and basically just queries the handle table for the existence of a handle. I think you could look at the Handle system architecture,and you build a custom daemon, that knows how to query multiple local repositories to see which one has the asset. For your problem of wanting to register a single handle prefix, and have multiple services use those handles, you run into a problem of needing to ensure that you don't have collisions with your services trying to assign the same number to different resources. You could either adjust the code for each service (DSpace) to have each one assign different ranges of handles. i.e. DSpace1 = 1..5, DSpace 2 = 50001..9 Or, since the right hand side of a handle is text, you could stuff another symbol in there. 1811/data- for your repository that stores research data sets, 1811/video- for video repository, and so on. Then you'll end up with 1811/data-1 to 1811/data-9, and 1811/video-1 to 1811/video-9. You prevent collisions, since each domain-specific repository would only use a specified middle-prefix. You still need to solve the problem of your handle daemon knowing how to speak for multiple DSpace instances. I don't have any prototype solutions, but I hope this helps to guide your thinking. Peter Dietz On Mon, Jun 3, 2013 at 12:12 PM, nraanes nraa...@gmail.com mailto:nraa...@gmail.com wrote: Hi I'm also trying to figure out how to accomplish what Jessica asked (using one handle server for multiple DSpace instances). Would it be possible for you to share the unofficial solution once again? As this is my first post I would like to thank everyone on here. It's been a great resource while learning DSpace! Regards, Nikolai -- View this message in context: http://dspace.2283337.n4.nabble.com/One-handle-server-for-two-DSpace-instances-tp4662743p4664577.html Sent from the DSpace - Tech mailing list archive at Nabble.com. -- Get 100% visibility into Java/.NET code with AppDynamics Lite It's a free troubleshooting tool designed for production Get down to code-level detail for bottlenecks, with 2% overhead. Download for free and get started troubleshooting in minutes. http://p.sf.net/sfu/appdyn_d2d_ap2 ___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net mailto:DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech List Etiquette: https://wiki.duraspace.org/display/DSPACE/Mailing+List+Etiquette -- How ServiceNow helps IT people transform IT departments: 1. A cloud service to automate IT design, transition and operations 2. Dashboards that offer high-level views of enterprise services 3. A single system of record for all IT processes http://p.sf.net/sfu/servicenow-d2d-j ___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech List
Re: [Dspace-tech] Missing dc.type field in mets.xml, but present in database
On Wed, Aug 7, 2013 at 8:36 AM, Andrea Bollini a.boll...@cineca.it wrote: The metadata are automatically indexed in discovery in the form schema.element.qualifier so it is right that you already have dc.type in your index but if have added the type searchFilter only recently it only affect items added or changed after this change. So update-discovery-index -f should fix it? Regards, ~~helix84 Compulsory reading: DSpace Mailing List Etiquette https://wiki.duraspace.org/display/DSPACE/Mailing+List+Etiquette -- Get 100% visibility into Java/.NET code with AppDynamics Lite! It's a free troubleshooting tool designed for production. Get down to code-level detail for bottlenecks, with 2% overhead. Download for free and get started troubleshooting in minutes. http://pubads.g.doubleclick.net/gampad/clk?id=48897031iu=/4140/ostg.clktrk ___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech List Etiquette: https://wiki.duraspace.org/display/DSPACE/Mailing+List+Etiquette
Re: [Dspace-tech] Missing dc.type field in mets.xml, but present in database
yes, this was my guess Il 07/08/2013 08:56, helix84 ha scritto: On Wed, Aug 7, 2013 at 8:36 AM, Andrea Bollini a.boll...@cineca.it wrote: The metadata are automatically indexed in discovery in the form schema.element.qualifier so it is right that you already have dc.type in your index but if have added the type searchFilter only recently it only affect items added or changed after this change. So update-discovery-index -f should fix it? Regards, ~~helix84 Compulsory reading: DSpace Mailing List Etiquette https://wiki.duraspace.org/display/DSPACE/Mailing+List+Etiquette -- Andrea Bollini Dipartimento Servizi e Soluzioni per l'Amministrazione Universitaria Divisione Ricerca Via dei Tizii, 6 00185 Roma, Italy tel. +39 06 44 486 087 - mob. +39 348 82 77 525 http://www.cineca.it -- Get 100% visibility into Java/.NET code with AppDynamics Lite! It's a free troubleshooting tool designed for production. Get down to code-level detail for bottlenecks, with 2% overhead. Download for free and get started troubleshooting in minutes. http://pubads.g.doubleclick.net/gampad/clk?id=48897031iu=/4140/ostg.clktrk ___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech List Etiquette: https://wiki.duraspace.org/display/DSPACE/Mailing+List+Etiquette
Re: [Dspace-tech] How to replace the word dspace with repository
NOT WORKING YET.
When I reset the password as you previously suggested, both the digest_algorith
and salt fields get cleared. Then they are repopulated after attempting to
login just as you said. This does not however solve the login problem. Am not
actually getting an error when i attempt to login. The login just doesnt happen
and i am redirected to the home page. Still pondering on the next possible
solution.
Thanks in advance.
From: helix84 heli...@centrum.sk
To: otuoma peter otuomathegr...@yahoo.com
Cc: dspace-tech@lists.sourceforge.net dspace-tech@lists.sourceforge.net
Sent: Tuesday, August 6, 2013 1:44 PM
Subject: Re: [Dspace-tech] How to replace the word dspace with repository
On Tue, Aug 6, 2013 at 10:33 PM, otuoma peter otuomathegr...@yahoo.com wrote:
Well, I have both salt and digest_algorithm columns. However when i
remove LIMIT 1 I can see that the password field is abnomally longer for
the administrator account that am trying to login with. Previously i had
replaced this password using UPDATE eperson SET password =
md5('somepassword') WHERE email = 'some-email';
This was to enable me to recover the password used by the previous system
admin. It was also before doing the upgrade.
Am thinking replacing this password again might work though am not sure how
this will work with the salt combination.
That is normal. The default hash function changed from MD5 to SHA-512
in DSpace 3.
There is a migration mechanism in DSpace 3, so the MD5 hash will still
work (if salt=NULL and digest_algorithm=NULL, which tells DSpace this
is the legacy MD5 password) and on your next login will be replaced
with the SHA-512 hash. Therefore you can still do this to recover your
password:
UPDATE eperson SET password=md5('yourpassword'), salt=NULL,
digest_algorithm=NULL where email='ad...@example.com';
even if Postgres doesn't have a built-in function for SHA-512. DSpace
will re-hash it the next time you log in.
Regards,
~~helix84
Compulsory reading: DSpace Mailing List Etiquette
https://wiki.duraspace.org/display/DSPACE/Mailing+List+Etiquette--
Get 100% visibility into Java/.NET code with AppDynamics Lite!
It's a free troubleshooting tool designed for production.
Get down to code-level detail for bottlenecks, with 2% overhead.
Download for free and get started troubleshooting in minutes.
http://pubads.g.doubleclick.net/gampad/clk?id=48897031iu=/4140/ostg.clktrk___
DSpace-tech mailing list
DSpace-tech@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/dspace-tech
List Etiquette: https://wiki.duraspace.org/display/DSPACE/Mailing+List+Etiquette
[Dspace-tech] Lightbox in Item
Hi everyone, I am currently working on putting lightbox feature in item by following the tutorial from this site: http://developer.edina.ac.uk/projects/jorumdspace/wiki/Licence_lightbox_viewer. However, instead of lightbox from the CC license in which the patch is originally intended, I want the lightbox to show in files with thumbnails. I am trying to add this codes to call the lightbox xsl:attribute name=rel xsl:textprettyPhoto/xsl:text /xsl:attribute in theme/lib/xsl/aspect/artifactbrowser/item-view.xsl. I also put a javascript listener in theme/lib/xsl/core/page-structural.xsl but I cannot get any result. An error for missing variable $ appears during inspection. Any input will be helpful. Thanks! - Librarian In-Charge of Non-Print Educational Media Center Ateneo de Manila High School Philippines -- View this message in context: http://dspace.2283337.n4.nabble.com/Lightbox-in-Item-tp4666341.html Sent from the DSpace - Tech mailing list archive at Nabble.com. -- Get 100% visibility into Java/.NET code with AppDynamics Lite! It's a free troubleshooting tool designed for production. Get down to code-level detail for bottlenecks, with 2% overhead. Download for free and get started troubleshooting in minutes. http://pubads.g.doubleclick.net/gampad/clk?id=48897031iu=/4140/ostg.clktrk ___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech List Etiquette: https://wiki.duraspace.org/display/DSPACE/Mailing+List+Etiquette
Re: [Dspace-tech] LDAP and Special Groups Code
Hi everyone I'm beginning to suspect the LDAP Special Groups code in DSpace 3.0 is broken Please see the scenarios below, which are excerpts from /home/dspace/config/modules/authentication-ldap.cfg Scenario 1 login.groupmap.1 = OU=StaffUsers:all-staff login.groupmap.2 = OU=StudentUsers:all-students In practice newly authenticated new staff are added to the all-staff, all-authenticated and anonymous groups. Newly authenticated students only belong to the anonymous group Scenario 2 # Added By Clive Gould on 31/07/13 to allow for special groups # login.groupmap.1 = OU=StaffUsers:all-staff # login.groupmap.2 = OU=StudentUsers:all-students login.groupmap.1 = OU=StudentUsers:all-students In practice newly authenticated students are added to the all-students, all-authenticated and anonymous groups. Newly authenticated staff only belong to the anonymous group Scenario 3 # login.groupmap.1 = OU=StaffUsers:all-staff # login.groupmap.2 = OU=StudentUsers:all-students login.groupmap.1 = OU=StudentUsers:all-students login.groupmap.2 = OU=StaffUsers:all-staff Newly authenticated students are added to the all-students, all-authenticated and anonymous groups. Newly authenticated staff only belong to the anonymous group Conclusion It looks horribly as if only the first line login.groupmap.1 is being processed. login.groupmap.2 seems to be ignored Note: If a member of staff or student has logged in and registered once their membership of the special groups appears to be persistent through multiple logins I'm not a Java programmer and haven't time try to understand and debug the code myself. Has anyone actually got this special groups code to work properly or is this a bug that needs fixing? Any ideas anyone? Clive On Tue, Aug 6, 2013 at 10:11 AM, helix84 heli...@centrum.sk wrote: Neither login.specialgroup nor login.groupmap are applied to student, but it is to staff? I'm as baffled as you are. Are you modifying the right config file, i.e. [dspace]/config/modules/authentication-ldap.cfg (maybe you accidentally edited the one in [dspace-source])? Other than that, try sprinkling more log.debug calls around to see which branches of code are executed. Basically you want to check the values that drive the decisions in any relevant if statements. Regards, ~~helix84 Compulsory reading: DSpace Mailing List Etiquette https://wiki.duraspace.org/display/DSPACE/Mailing+List+Etiquette -- Get 100% visibility into Java/.NET code with AppDynamics Lite! It's a free troubleshooting tool designed for production. Get down to code-level detail for bottlenecks, with 2% overhead. Download for free and get started troubleshooting in minutes. http://pubads.g.doubleclick.net/gampad/clk?id=48897031iu=/4140/ostg.clktrk___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech List Etiquette: https://wiki.duraspace.org/display/DSPACE/Mailing+List+Etiquette
Re: [Dspace-tech] LDAP and Special Groups Code
Hi everyone
I'm not a programmer as I said before but have just been scanning over the
source code in LDAPAuthentication.java
My concern is with the following lines
Before we go into the while loop
int i = 1;
String groupMap = ConfigurationManager.getProperty(authentication-ldap,
login.groupmap. + i);
By my understanding this should read the first line login.groupmap.1
Before the end of the while loop to move onto any login.groupmap.2 and
login.groupmap.3 etc
groupMap = ConfigurationManager.getProperty(ldap.login.groupmap. + ++i);
It looks to me as if the last line should read
groupMap = ConfigurationManager.getProperty(login.groupmap. + ++i);
Have I found a bug or is this just down to the fact I don't understand the
code??
Any thoughts most welcome
Clive
The complete excerpt from
/home/dspace/dspace-3.0-src-release/dspace-api/src/main/java/org/dspace/authenticate/LDAPAuthentication.java
is shown below:
System.out.println(dn: + dn);
int i = 1;
String groupMap =
ConfigurationManager.getProperty(authentication-ldap, login.groupmap. +
i);
while (groupMap != null)
{
String t[] = groupMap.split(:);
String ldapSearchString = t[0];
String dspaceGroupName = t[1];
if (StringUtils.containsIgnoreCase(dn, ldapSearchString))
{
// assign user to this group
try
{
Group ldapGroup = Group.findByName(context,
dspaceGroupName);
if (ldapGroup != null)
{
ldapGroup.addMember(context.getCurrentUser());
ldapGroup.update();
context.commit();
}
else
{
// The group does not exist
log.warn(LogManager.getHeader(context,
ldap_assignGroupsBasedOnLdapDn,
Group defined in ldap.login.groupmap.
+ i + does not exist :: + dspaceGroupName));
}
}
catch (AuthorizeException ae)
{
log.debug(LogManager.getHeader(context,
assignGroupsBasedOnLdapDn could not authorize addition to group,
dspaceGroupName));
}
catch (SQLException e)
{
log.debug(LogManager.getHeader(context,
assignGroupsBasedOnLdapDn could not find group, dspaceGroupName));
}
}
groupMap =
ConfigurationManager.getProperty(ldap.login.groupmap. + ++i);
}
On Wed, Aug 7, 2013 at 10:35 AM, Clive Gould cli...@gmail.com wrote:
Hi everyone
I'm beginning to suspect the LDAP Special Groups code in DSpace 3.0 is
broken
Please see the scenarios below, which are excerpts from
/home/dspace/config/modules/authentication-ldap.cfg
Scenario 1
login.groupmap.1 = OU=StaffUsers:all-staff
login.groupmap.2 = OU=StudentUsers:all-students
In practice newly authenticated new staff are added to the all-staff,
all-authenticated and anonymous groups. Newly authenticated students only
belong to the anonymous group
Scenario 2
# Added By Clive Gould on 31/07/13 to allow for special groups
# login.groupmap.1 = OU=StaffUsers:all-staff
# login.groupmap.2 = OU=StudentUsers:all-students
login.groupmap.1 = OU=StudentUsers:all-students
In practice newly authenticated students are added to the all-students,
all-authenticated and anonymous groups. Newly authenticated staff only
belong to the anonymous group
Scenario 3
# login.groupmap.1 = OU=StaffUsers:all-staff
# login.groupmap.2 = OU=StudentUsers:all-students
login.groupmap.1 = OU=StudentUsers:all-students
login.groupmap.2 = OU=StaffUsers:all-staff
Newly authenticated students are added to the all-students,
all-authenticated and anonymous groups. Newly authenticated staff only
belong to the anonymous group
Conclusion
It looks horribly as if only the first line login.groupmap.1 is being
processed. login.groupmap.2 seems to be ignored
Note: If a member of staff or student has logged in and registered once
their membership of the special groups appears to be persistent through
multiple logins
I'm not a Java programmer and haven't time try to understand and debug the
code myself. Has anyone actually got this special groups code to work
properly or is this a bug that needs fixing?
Any ideas anyone?
Clive
On Tue, Aug 6, 2013 at 10:11 AM, helix84 heli...@centrum.sk wrote:
Neither login.specialgroup nor login.groupmap are applied to student,
but it is to staff? I'm as baffled as you are.
Are you modifying the right config file, i.e.
[dspace]/config/modules/authentication-ldap.cfg (maybe you
Re: [Dspace-tech] java.lang.NullPointerException when exporting metadata
Hi Helix, Thanks for your help so far. Just picked up this in the dspsace.log. Is it of use in pinpointing the issue? 2013-08-06 13:58:18,767 INFO com.atmire.statistics.export.ExportUsageEventListener @ Robot (Mozilla/5.0 (compatible; Baiduspider/2.0; +http://www.baidu.com/search/spider.html)) accessed Ferromagnetic Microswimmers.pdf/null 2013-08-06 13:58:20,441 ERROR org.dspace.app.xmlui.cocoon.DSpaceCocoonServletFilter @ Serious Error Occurred Processing Request! ClientAbortException: java.net.SocketException: Broken pipe at org.apache.catalina.connector.OutputBuffer.realWriteBytes(OutputBuffer.java:358) at org.apache.tomcat.util.buf.ByteChunk.flushBuffer(ByteChunk.java:432) at org.apache.catalina.connector.OutputBuffer.doFlush(OutputBuffer.java:309) at org.apache.catalina.connector.OutputBuffer.flush(OutputBuffer.java:288) at org.apache.catalina.connector.Response.flushBuffer(Response.java:549) at org.apache.catalina.connector.ResponseFacade.flushBuffer(ResponseFacade.java:279) at javax.servlet.ServletResponseWrapper.flushBuffer(ServletResponseWrapper.java:166) at org.apache.cocoon.servletservice.HttpServletResponseBufferingWrapper.flushBufferedResponse(HttpServletResponseBufferingWrapper.java:240) at org.apache.cocoon.servletservice.ServletServiceContext$PathDispatcher.forward(ServletServiceContext.java:481) at org.apache.cocoon.servletservice.ServletServiceContext$PathDispatcher.forward(ServletServiceContext.java:443) at org.apache.cocoon.servletservice.spring.ServletFactoryBean$ServiceInterceptor.invoke(ServletFactoryBean.java:264) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:172) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:202) at $Proxy20.service(Unknown Source) at org.apache.cocoon.servletservice.DispatcherServlet.service(DispatcherServlet.java:106) at javax.servlet.http.HttpServlet.service(HttpServlet.java:717) at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:290) at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:206) at org.dspace.app.xmlui.cocoon.SetCharacterEncodingFilter.doFilter(SetCharacterEncodingFilter.java:111) at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:235) at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:206) at org.dspace.app.xmlui.cocoon.DSpaceCocoonServletFilter.doFilter(DSpaceCocoonServletFilter.java:269) at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:235) at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:206) at org.apache.cocoon.servlet.multipart.MultipartFilter.doFilter(MultipartFilter.java:131) at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:235) at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:206) at org.dspace.utils.servlet.DSpaceWebappServletFilter.doFilter(DSpaceWebappServletFilter.java:78) at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:235) at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:206) at org.apache.catalina.core.StandardWrapperValve.invoke(StandardWrapperValve.java:233) at org.apache.catalina.core.StandardContextValve.invoke(StandardContextValve.java:191) at org.apache.catalina.core.StandardHostValve.invoke(StandardHostValve.java:127) at org.apache.catalina.valves.ErrorReportValve.invoke(ErrorReportValve.java:102) at org.apache.catalina.core.StandardEngineValve.invoke(StandardEngineValve.java:109) at org.apache.catalina.connector.CoyoteAdapter.service(CoyoteAdapter.java:298) at org.apache.jk.server.JkCoyoteHandler.invoke(JkCoyoteHandler.java:190) at org.apache.jk.common.HandlerRequest.invoke(HandlerRequest.java:291) at org.apache.jk.common.ChannelSocket.invoke(ChannelSocket.java:776) at org.apache.jk.common.ChannelSocket.processConnection(ChannelSocket.java:705) at org.apache.jk.common.ChannelSocket$SocketConnection.runIt(ChannelSocket.java:898) at org.apache.tomcat.util.threads.ThreadPool$ControlRunnable.run(ThreadPool.java:690) at java.lang.Thread.run(Thread.java:662) Caused by: java.net.SocketException: Broken pipe at java.net.SocketOutputStream.socketWrite0(Native Method) at java.net.SocketOutputStream.socketWrite(SocketOutputStream.java:92) at java.net.SocketOutputStream.write(SocketOutputStream.java:136) at
Re: [Dspace-tech] java.lang.NullPointerException when exporting metadata
No, that's completely harmless. Details are here: https://jira.duraspace.org/browse/DS-1448 Regards, ~~helix84 Compulsory reading: DSpace Mailing List Etiquette https://wiki.duraspace.org/display/DSPACE/Mailing+List+Etiquette -- Get 100% visibility into Java/.NET code with AppDynamics Lite! It's a free troubleshooting tool designed for production. Get down to code-level detail for bottlenecks, with 2% overhead. Download for free and get started troubleshooting in minutes. http://pubads.g.doubleclick.net/gampad/clk?id=48897031iu=/4140/ostg.clktrk ___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech List Etiquette: https://wiki.duraspace.org/display/DSPACE/Mailing+List+Etiquette
[Dspace-tech] User Login page
Dear All Please let me know how can the User Login Page fields can be increased. i.e. apart from FirstName , LastName , Contact No. ,Password fields new fields like Department , Designation etc. to be added. Regards Parul Dubey ITSL Limited From: Parul dubey [mailto:parul.du...@itsl.in] Sent: Tuesday, August 06, 2013 10:28 AM To: 'DSpace-tech@lists.sourceforge.net' Subject: RE: Dspace backup and restore Hi All Please let me know the steps for restoring the complete Dspace site(database + all customization ) from one system to another system . Regards Parul dubey -- Get 100% visibility into Java/.NET code with AppDynamics Lite! It's a free troubleshooting tool designed for production. Get down to code-level detail for bottlenecks, with 2% overhead. Download for free and get started troubleshooting in minutes. http://pubads.g.doubleclick.net/gampad/clk?id=48897031iu=/4140/ostg.clktrk___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech List Etiquette: https://wiki.duraspace.org/display/DSPACE/Mailing+List+Etiquette
Re: [Dspace-tech] LDAP and Special Groups Code
Hi everyone
It looks as if this was fixed in DSpace 3.2
[dspace@standbyvle ~]$ diff
/home/dspace/dspace-3.2-src-release/dspace-api/src/main/java/org/dspace/authenticate/LDAPAuthentication.java
/home/dspace/dspace-3.0-src-release/dspace-api/src/main/java/org/dspace/authenticate/LDAPAuthentication.java
615c615
* the authentication-ldap.login.groupmap.* key.
---
* the ldap.login.groupmap.* key.
647c647
Group defined in
authentication-ldap.login.groupmap. + i + does not exist :: +
dspaceGroupName));
---
Group defined in
ldap.login.groupmap. + i + does not exist :: + dspaceGroupName));
660c660
groupMap =
ConfigurationManager.getProperty(authentication-ldap, login.groupmap. +
++i);
---
groupMap =
ConfigurationManager.getProperty(ldap.login.groupmap. + ++i);
Thanks
Clive
On Wed, Aug 7, 2013 at 11:10 AM, Clive Gould cli...@gmail.com wrote:
Hi everyone
I'm not a programmer as I said before but have just been scanning over the
source code in LDAPAuthentication.java
My concern is with the following lines
Before we go into the while loop
int i = 1;
String groupMap = ConfigurationManager.getProperty(authentication-ldap,
login.groupmap. + i);
By my understanding this should read the first line login.groupmap.1
Before the end of the while loop to move onto any login.groupmap.2 and
login.groupmap.3 etc
groupMap = ConfigurationManager.getProperty(ldap.login.groupmap. + ++i);
It looks to me as if the last line should read
groupMap = ConfigurationManager.getProperty(login.groupmap. + ++i);
Have I found a bug or is this just down to the fact I don't understand the
code??
Any thoughts most welcome
Clive
The complete excerpt from
/home/dspace/dspace-3.0-src-release/dspace-api/src/main/java/org/dspace/authenticate/LDAPAuthentication.java
is shown below:
System.out.println(dn: + dn);
int i = 1;
String groupMap =
ConfigurationManager.getProperty(authentication-ldap, login.groupmap. +
i);
while (groupMap != null)
{
String t[] = groupMap.split(:);
String ldapSearchString = t[0];
String dspaceGroupName = t[1];
if (StringUtils.containsIgnoreCase(dn, ldapSearchString))
{
// assign user to this group
try
{
Group ldapGroup = Group.findByName(context,
dspaceGroupName);
if (ldapGroup != null)
{
ldapGroup.addMember(context.getCurrentUser());
ldapGroup.update();
context.commit();
}
else
{
// The group does not exist
log.warn(LogManager.getHeader(context,
ldap_assignGroupsBasedOnLdapDn,
Group defined in
ldap.login.groupmap. + i + does not exist :: + dspaceGroupName));
}
}
catch (AuthorizeException ae)
{
log.debug(LogManager.getHeader(context,
assignGroupsBasedOnLdapDn could not authorize addition to group,
dspaceGroupName));
}
catch (SQLException e)
{
log.debug(LogManager.getHeader(context,
assignGroupsBasedOnLdapDn could not find group, dspaceGroupName));
}
}
groupMap =
ConfigurationManager.getProperty(ldap.login.groupmap. + ++i);
}
On Wed, Aug 7, 2013 at 10:35 AM, Clive Gould cli...@gmail.com wrote:
Hi everyone
I'm beginning to suspect the LDAP Special Groups code in DSpace 3.0 is
broken
Please see the scenarios below, which are excerpts from
/home/dspace/config/modules/authentication-ldap.cfg
Scenario 1
login.groupmap.1 = OU=StaffUsers:all-staff
login.groupmap.2 = OU=StudentUsers:all-students
In practice newly authenticated new staff are added to the all-staff,
all-authenticated and anonymous groups. Newly authenticated students only
belong to the anonymous group
Scenario 2
# Added By Clive Gould on 31/07/13 to allow for special groups
# login.groupmap.1 = OU=StaffUsers:all-staff
# login.groupmap.2 = OU=StudentUsers:all-students
login.groupmap.1 = OU=StudentUsers:all-students
In practice newly authenticated students are added to the all-students,
all-authenticated and anonymous groups. Newly authenticated staff only
belong to the anonymous group
Scenario 3
# login.groupmap.1 = OU=StaffUsers:all-staff
# login.groupmap.2 = OU=StudentUsers:all-students
login.groupmap.1 =
Re: [Dspace-tech] LDAP and Special Groups Code
On Wed, Aug 7, 2013 at 1:20 PM, Clive Gould cli...@gmail.com wrote: It looks as if this was fixed in DSpace 3.2 Right. Sorry about that. You can simply use that newer LDAPAuthentication.java file (beware of OAI being broken in 3.2). Does it work for you now? https://jira.duraspace.org/browse/DS-1576 Regards, ~~helix84 Compulsory reading: DSpace Mailing List Etiquette https://wiki.duraspace.org/display/DSPACE/Mailing+List+Etiquette -- Get 100% visibility into Java/.NET code with AppDynamics Lite! It's a free troubleshooting tool designed for production. Get down to code-level detail for bottlenecks, with 2% overhead. Download for free and get started troubleshooting in minutes. http://pubads.g.doubleclick.net/gampad/clk?id=48897031iu=/4140/ostg.clktrk ___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech List Etiquette: https://wiki.duraspace.org/display/DSPACE/Mailing+List+Etiquette
Re: [Dspace-tech] LDAP and Special Groups Code
I've just copied over the config file from 3.2 run maven and ant On restarting Tomcat the problem still seems to be there :(( 1026 cp /home/dspace/dspace-3.2-src-release/dspace-api/src/main/java/org/dspace/authenticate/LDAPAuthentication.java /home/dspace/dspace-3.0-src-release/dspace-api/src/main/java/org/dspace/authenticate/LDAPAuthentication.java 1034 cd /home/dspace/dspace-3.0-src-release/dspace 1035 mvn -U clean package 1037 cd /home/dspace/dspace-3.0-src-release/dspace/target/dspace-3.0-build 1038 ant -Dconfig=/home/dspace/config/dspace.cfg update On Wed, Aug 7, 2013 at 12:26 PM, helix84 heli...@centrum.sk wrote: On Wed, Aug 7, 2013 at 1:20 PM, Clive Gould cli...@gmail.com wrote: It looks as if this was fixed in DSpace 3.2 Right. Sorry about that. You can simply use that newer LDAPAuthentication.java file (beware of OAI being broken in 3.2). Does it work for you now? https://jira.duraspace.org/browse/DS-1576 Regards, ~~helix84 Compulsory reading: DSpace Mailing List Etiquette https://wiki.duraspace.org/display/DSPACE/Mailing+List+Etiquette -- Get 100% visibility into Java/.NET code with AppDynamics Lite! It's a free troubleshooting tool designed for production. Get down to code-level detail for bottlenecks, with 2% overhead. Download for free and get started troubleshooting in minutes. http://pubads.g.doubleclick.net/gampad/clk?id=48897031iu=/4140/ostg.clktrk___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech List Etiquette: https://wiki.duraspace.org/display/DSPACE/Mailing+List+Etiquette
Re: [Dspace-tech] ConfigurationManager apparently returning 'xmlworkflow' instead of 'originalworkflow'
Hi, The news on this seems to be that this can be fixed by building dspace-xmlui and deploying that separately. This is obviously quite weird, but it may be that there is some problem with the products in maven repositories differing from the source in the 3.1 tag. Anyway, hope this is helpful for anyone else encountering the same problem with 3.1 and deleting roles. gilleain (University of Cambridge Library) On 2013-08-06 14:01, G.M. Torrance wrote: Hi, We're getting a NPE when trying to delete a role from a collection workflow. This seems like a re-appearance of https://jira.duraspace.org/browse/DS-1416 except that I can see the code that fixed that problem. Specifically, the stacktrace says : java.lang.NullPointerException at org.dspace.xmlworkflow.WorkflowUtils.deleteRoleGroup(WorkflowUtils.java:215) at org.dspace.app.xmlui.aspect.administrative.FlowContainerUtils.processDeleteCollectionRole( FlowContainerUtils.java:538) where the code at line 538 in FlowContainerUtils.java is: if(ConfigurationManager.getProperty(workflow, workflow.framework).equals(xmlworkflow)) so this test is passing, yet in the config file (config/modules/workflow.cfg) workflow.framework is indeed set to 'originalworkflow'. Since there are no set methods in ConfigurationManager I don't see how it can get the wrong value. Is there some way to test this? Perhaps by calling cocoon.log.error in the flowscript? ta gilleain -- Get your SQL database under version control now! Version control is standard for application code, but databases havent caught up. So what steps can you take to put your SQL databases under version control? Why should you start doing it? Read more to find out. http://pubads.g.doubleclick.net/gampad/clk?id=48897031iu=/4140/ostg.clktrk ___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech List Etiquette: https://wiki.duraspace.org/display/DSPACE/Mailing+List+Etiquette -- Get 100% visibility into Java/.NET code with AppDynamics Lite! It's a free troubleshooting tool designed for production. Get down to code-level detail for bottlenecks, with 2% overhead. Download for free and get started troubleshooting in minutes. http://pubads.g.doubleclick.net/gampad/clk?id=48897031iu=/4140/ostg.clktrk ___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech List Etiquette: https://wiki.duraspace.org/display/DSPACE/Mailing+List+Etiquette
Re: [Dspace-tech] Missing dc.type field in mets.xml, but present in database
Hello everyone, First of all thanks for helping me out. I did an update-discovery-index -b when I created the new filter, this should work as well as -f, correct? Last night I scheduled a new update-discovery-index -b. I think the problem is that it did not run completely. It ran for only about 4 minutes. I noticed the items it did log as written do work with the filter. I made a pastebin with the section of the log when it starts to index, at 22:00 http://pastebin.com/17PQHLN6 it stops at 22:04 and does not continue. I do not see any exceptions, just a cocoon broken pipe. Should the index rebuild command be run with tomcat disabled? Again thank you everyone for your time. =) Ats, Alcides Carlos de Moraes Neto 2013/8/7 Andrea Bollini a.boll...@cineca.it yes, this was my guess Il 07/08/2013 08:56, helix84 ha scritto: On Wed, Aug 7, 2013 at 8:36 AM, Andrea Bollini a.boll...@cineca.it wrote: The metadata are automatically indexed in discovery in the form schema.element.qualifier so it is right that you already have dc.type in your index but if have added the type searchFilter only recently it only affect items added or changed after this change. So update-discovery-index -f should fix it? Regards, ~~helix84 Compulsory reading: DSpace Mailing List Etiquette https://wiki.duraspace.org/**display/DSPACE/Mailing+List+**Etiquettehttps://wiki.duraspace.org/display/DSPACE/Mailing+List+Etiquette -- Andrea Bollini Dipartimento Servizi e Soluzioni per l'Amministrazione Universitaria Divisione Ricerca Via dei Tizii, 6 00185 Roma, Italy tel. +39 06 44 486 087 - mob. +39 348 82 77 525 http://www.cineca.it -- Get 100% visibility into Java/.NET code with AppDynamics Lite! It's a free troubleshooting tool designed for production. Get down to code-level detail for bottlenecks, with 2% overhead. Download for free and get started troubleshooting in minutes. http://pubads.g.doubleclick.net/gampad/clk?id=48897031iu=/4140/ostg.clktrk___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech List Etiquette: https://wiki.duraspace.org/display/DSPACE/Mailing+List+Etiquette
Re: [Dspace-tech] DSpace 3.2 needs JDK 1.7 for OAI functionality?
Hi, i've managed it in order to use JDK 6 instead of JDK 7. XOAI 3.0.0 release is now building on jdk 6. On 29 July 2013 19:45, Sam Ottenhoff ottenh...@longsight.com wrote: DSpace 3.x documentation seems JDK-agnostic, it points to using Oracle or OpenJDK, version 6 or 7: https://wiki.duraspace.org/display/DSDOC3x/Installation But the new OAI module seems to depend on running Tomcat using JDK 7. Here is the commit I see that targeted JDK 1.7 and effectively dropped support for JDK 6: https://github.com/lyncode/xoai/commit/a25cf93b1861608d8ed2d52b224b243fb0aca511 Am I mis-reading this? Is JDK 7 a requirement to run DSpace 3.2+? Here is the stack trace I observed: Caused by: java.lang.UnsupportedClassVersionError: com/lyncode/xoai/dataprovider/exceptions/ConfigurationException : Unsupported major.minor version 51.0 (unable to load class com.lyncode.xoai.dataprovider.exceptions.ConfigurationException) at org.apache.catalina.loader.WebappClassLoader.findClassInternal(WebappClassLoader.java:2892) Thanks, Sam -- Get your SQL database under version control now! Version control is standard for application code, but databases havent caught up. So what steps can you take to put your SQL databases under version control? Why should you start doing it? Read more to find out. http://pubads.g.doubleclick.net/gampad/clk?id=49501711iu=/4140/ostg.clktrk ___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech List Etiquette: https://wiki.duraspace.org/display/DSPACE/Mailing+List+Etiquette -- Thanks, João Melo (My Portfolio http://www.lyncode.com/m/jmelo/) DSpace Department *Lyncode*: Official websitehttp://www.google.com/url?q=http%3A%2F%2Fwww.lyncode.com%2Fsa=Dsntz=1usg=AFrqEzdV8iS6rMxflxnn138XReuRfUG3OQ [image: Follow us on Facebook]http://www.google.com/url?q=http%3A%2F%2Ftwitter.com%2Flyncodesa=Dsntz=1usg=AFrqEzeDuT3ZqMW5uVIA8AoxtTtAeiCX3Q http://www.google.com/url?q=http%3A%2F%2Fwww.facebook.com%2Flyncodesa=Dsntz=1usg=AFrqEzcWXjHa3gKBGLsNVxktapxkiWDnww -- Get 100% visibility into Java/.NET code with AppDynamics Lite! It's a free troubleshooting tool designed for production. Get down to code-level detail for bottlenecks, with 2% overhead. Download for free and get started troubleshooting in minutes. http://pubads.g.doubleclick.net/gampad/clk?id=48897031iu=/4140/ostg.clktrk___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech List Etiquette: https://wiki.duraspace.org/display/DSPACE/Mailing+List+Etiquette
Re: [Dspace-tech] Missing dc.type field in mets.xml, but present in database
Hi, On 08/08/13 06:46, Alcides Carlos de Moraes Neto wrote: I think the problem is that it did not run completely. It ran for only about 4 minutes. I noticed the items it did log as written do work with the filter. ...and at least one of them has a repeated dc.type, so that's not the problem either. I made a pastebin with the section of the log when it starts to index, at 22:00 http://pastebin.com/17PQHLN6 it stops at 22:04 and does not continue. I do not see any exceptions, just a cocoon broken pipe. The cocoon broken pipe usually means that a client aborted the download of a file, so this should have nothing to do with the indexing problem. Is there anything useful in your tomcat log file around 22:04? Solr logs to that one, not to the DSpace log file. Should the index rebuild command be run with tomcat disabled? No, tomcat must be running for the discovery reindexing. That's because the reindexer talks to solr, which is a webapp running inside tomcat. cheers, Andrea -- Dr Andrea Schweer IRR Technical Specialist, ITS Information Systems The University of Waikato, Hamilton, New Zealand -- Get 100% visibility into Java/.NET code with AppDynamics Lite! It's a free troubleshooting tool designed for production. Get down to code-level detail for bottlenecks, with 2% overhead. Download for free and get started troubleshooting in minutes. http://pubads.g.doubleclick.net/gampad/clk?id=48897031iu=/4140/ostg.clktrk ___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech List Etiquette: https://wiki.duraspace.org/display/DSPACE/Mailing+List+Etiquette
[Dspace-tech] Handling error 404 on XMLUI
Hi everyone,
After search all over the documentation I couldn't find a way to handle the 404
error in my XMLUI interface. I was trying to handle it with sitemap.xmap
(\dspace\webapps\xmlui\), I found this line:
map:when test=not-foundmap:generate type=exception/map:transform
src=exception2html.xsltmap:parameter name=contextPath
value={request:contextPath}/map:parameter name=pageTitle value=Resource
not found //map:transformmap:act type=localemap:transform
type=i18nmap:parameter name=locale
value={locale}//map:transform/map:actmap:serialize type=xhtml
status-code=404//map:when
I tried to change sth inside, and put this, in order to just redirect to the
main page when error 404 appears:
map:redirect-to uri={request:contextPath}/
But the page doesn't works at all. Is there another way to handle this error??
Gracias y saludos!!:D --
Get 100% visibility into Java/.NET code with AppDynamics Lite!
It's a free troubleshooting tool designed for production.
Get down to code-level detail for bottlenecks, with 2% overhead.
Download for free and get started troubleshooting in minutes.
http://pubads.g.doubleclick.net/gampad/clk?id=48897031iu=/4140/ostg.clktrk___
DSpace-tech mailing list
DSpace-tech@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/dspace-tech
List Etiquette: https://wiki.duraspace.org/display/DSPACE/Mailing+List+Etiquette
Re: [Dspace-tech] Missing dc.type field in mets.xml, but present in database
I checked the catalina.out for errors but could not find anything. I trimmed it, beginning at 22:00 and uploaded it. (SOLR log is really verbose, too big for pastebin) https://dl.dropboxusercontent.com/u/4193365/catalina.out.22h I'll try an update-discovery-index -f tomorrow... Ats, Alcides Carlos de Moraes Neto 2013/8/7 Andrea Schweer schw...@waikato.ac.nz Hi, On 08/08/13 06:46, Alcides Carlos de Moraes Neto wrote: I think the problem is that it did not run completely. It ran for only about 4 minutes. I noticed the items it did log as written do work with the filter. ...and at least one of them has a repeated dc.type, so that's not the problem either. I made a pastebin with the section of the log when it starts to index, at 22:00 http://pastebin.com/17PQHLN6 it stops at 22:04 and does not continue. I do not see any exceptions, just a cocoon broken pipe. The cocoon broken pipe usually means that a client aborted the download of a file, so this should have nothing to do with the indexing problem. Is there anything useful in your tomcat log file around 22:04? Solr logs to that one, not to the DSpace log file. Should the index rebuild command be run with tomcat disabled? No, tomcat must be running for the discovery reindexing. That's because the reindexer talks to solr, which is a webapp running inside tomcat. cheers, Andrea -- Dr Andrea Schweer IRR Technical Specialist, ITS Information Systems The University of Waikato, Hamilton, New Zealand -- Get 100% visibility into Java/.NET code with AppDynamics Lite! It's a free troubleshooting tool designed for production. Get down to code-level detail for bottlenecks, with 2% overhead. Download for free and get started troubleshooting in minutes. http://pubads.g.doubleclick.net/gampad/clk?id=48897031iu=/4140/ostg.clktrk___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech List Etiquette: https://wiki.duraspace.org/display/DSPACE/Mailing+List+Etiquette
Re: [Dspace-tech] IP Authentication in dspace 3.1
Any help on this? Ribin - Original Message - From: ribin jones ribin.jo...@niist.res.in To: heli...@centrum.sk Cc: dspace-tech dspace-tech@lists.sourceforge.net Sent: Wednesday, 7 August, 2013 11:46:43 AM Subject: Re: [Dspace-tech] IP Authentication in dspace 3.1 What is strange is that even after I did the configurations, when I check the logs, the access comes as anonymous. Is it something usual when we use IP authentication? - Ribin - Original Message - From: ribin jones ribin.jo...@niist.res.in To: heli...@centrum.sk Cc: dspace-tech dspace-tech@lists.sourceforge.net Sent: Wednesday, 7 August, 2013 9:50:13 AM Subject: Re: [Dspace-tech] IP Authentication in dspace 3.1 Pls see my answers below: - Original Message - From: helix84 heli...@centrum.sk To: ribin jones ribin.jo...@niist.res.in Cc: dspace-tech dspace-tech@lists.sourceforge.net Sent: Wednesday, 7 August, 2013 3:27:49 AM Subject: Re: [Dspace-tech] IP Authentication in dspace 3.1 On Tue, Aug 6, 2013 at 10:50 AM, ribin.jo...@niist.res.in wrote: I even tried with a single IP...still I see in the dspace log as access coming from anonymous. I had created a group by name SplGrp from dspace web interface and it is mentioned as ip.SplGrp = 10.10.50.201, \ in authentication-ip.cfg It looks correct. 1) Does the specific _item_ you're trying to access the READ right for the SplGrp group? I gave READ access permission for group SplGrp for one particular item I was trying to access and now it asks for a username/pwd when I try to access it from any network. 2) Is there any address translation (NAT) between the client (10.10.50.201) and DSpace? NO 2a) Check dspace.log to see what DSpace sees as your address. Please see the dspace logs below when I try to access an item. There is no NAT happenening in-between and access comes from 10.10.50.201 which is a local PC in the LAN: 2013-08-07 15:12:50,616 INFO org.dspace.app.webui.servlet.AbstractBrowserServlet @ anonymous:session_id=8EA1C12719F4C5C76F7715D4FF217706:ip_addr=10.10.50.201:browse:type=title,order=ASC,value=null,month=null,year=null,starts_with=null,vfocus=null,focus=-1,rpp=20,sort_by=1,community=123456789/632,collection=n/a,level=0,etal=-1 2013-08-07 15:12:50,617 INFO org.dspace.browse.BrowseEngine @ anonymous:session_id=8EA1C12719F4C5C76F7715D4FF217706:ip_addr=10.10.50.201:browse_by_item: 2013-08-07 15:12:51,750 WARN org.dspace.core.PluginManager @ No Configuration entry found for Sequence Plugin interface=org.dspace.plugin.ItemHomeProcessor 2b) Also look for any errors and messages there. If there are no messages, raise the log level to DEBUG and try again: https://wiki.duraspace.org/display/DSPACE/Troubleshoot+an+error Regards, ~~helix84 Compulsory reading: DSpace Mailing List Etiquette https://wiki.duraspace.org/display/DSPACE/Mailing+List+Etiquette -- Get 100% visibility into Java/.NET code with AppDynamics Lite! It's a free troubleshooting tool designed for production. Get down to code-level detail for bottlenecks, with 2% overhead. Download for free and get started troubleshooting in minutes. http://pubads.g.doubleclick.net/gampad/clk?id=48897031iu=/4140/ostg.clktrk ___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech List Etiquette: https://wiki.duraspace.org/display/DSPACE/Mailing+List+Etiquette -- Get 100% visibility into Java/.NET code with AppDynamics Lite! It's a free troubleshooting tool designed for production. Get down to code-level detail for bottlenecks, with 2% overhead. Download for free and get started troubleshooting in minutes. http://pubads.g.doubleclick.net/gampad/clk?id=48897031iu=/4140/ostg.clktrk ___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech List Etiquette: https://wiki.duraspace.org/display/DSPACE/Mailing+List+Etiquette
Re: [Dspace-tech] Uploading Bibliographic information from RefWorks
Hi Claire, We are working on this in order to include it in the 4.0 release of DSpace. Apart from other changes like the improvement of the library and the support for other bibliographic formats, we want to fix issues that are mentioned by the users, like the one you reported, the ability to support multiple mappings without the need to change the configuration. Moreover, we would like to support the ability, these transformations to happen via a UI. If you have already a JSPUI front end for this functionality, we would be glad if you could share it with the community via a JIRA issue and probably a github pull request. Best regards, Kostas Stamatis -Original Message- From: KNOWLES Claire [mailto:claire.know...@ed.ac.uk] Sent: Tuesday, August 06, 2013 10:21 AM To: Konstantinos Stamatis; 'Thomas Misilo'; dspace-tech@lists.sourceforge.net Subject: Re: [Dspace-tech] Uploading Bibliographic information from RefWorks Hi Tom Sorry to re-open a topic from January, but I was wondering if you had managed to make the changes so you can have more than one import type loading without changing the configuration files? If so, are you happy to share them? We have written a jspui front end for this functionality and want users to be able to select the import type from a drop down. Thanks Claire Claire Knowles Library and University Collections University of Edinburgh From: Konstantinos Stamatis kstama...@ekt.grmailto:kstama...@ekt.gr To: 'Thomas Misilo' misi...@fit.edumailto:misi...@fit.edu, dspace-tech dspace-tech@lists.sourceforge.netmailto:dspace-tech@lists.sourceforge.net Subject: Re: [Dspace-tech] Uploading Bibliographic information from RefWorks Dear Tom, Regarding your first question, the fact is that you cannot have different configurations based on the import type. However, there are two solutions/tricks that you can try and help you in this point. 1) Since bte.xml file is a Spring Configuration file for Dependency Injection, you can isolate some of the beans in different files. Then, In the main file (bte.xml) you can import the file you like with the specific configuration for the specific import type using the following code snippet import resource=classpath:spring-config.xml / It is not perfect because you will have to change the xml when you change the import type. However, it's easier than changing all the beans. 2) As you can see from here: https://code.google.com/p/biblio-transformation-engine/ BTE has a transformation workflow that can consist of Modifiers. Modifiers are there to change your records. We have shipped a specific modifier with BTE called FileKeyRenameModifier (http://bit.ly/Wh5GoP). This modifier is responsible of reading a map file to transform from one schema to another. BTE has such files by default (for example http://bit.ly/YkJf0q which is a bibtex to dc mapping). If you use a modifier like this, you can have many mapping files with the key_after value be the same for all cases, and finally, in your bte.xml file use only the values for dc. So instead of having mapping from A to DSpace, B to DSpace, C to DSpace and so on in your bte.xml, you can have mappings A to DC, B to DC, C to DC in different files and another one mapping DC to DSpace in your bte.xml. So, what you need to do is summarized here: a. Copy/Create mapping files from your input format to dc b. Enable modifiers in the bte.xml by adding a step in the TransformationWorkflow bean property name=steps list ref bean=fileKeyRenameModifier/ /list /property c. Create the modifier bean: bean id=fileKeyRenameModifier class=gr.ekt.transformationengine.modifiers.FileKeyRenameModifier property name=filename value=/input/bibtex2dc_keymapping.xml/ /bean d. Change the mapping xml file according to your import type e. Configure output generator to use the new values Regarding the second question, again you can use a modifier to change the values of a field. But in this case, you will need to write the modifier class by your own. All you need to do, is to write a class (by extending our abstract Modifier) and implement a method. In this modifier, you can have access to the record, and by using the Record class methods you can add/remove/change the values. For instance, you can keep author in a local variable, delete this field and create a new one with the same name, but now do not forget to split the author value. Each field within a record can have a list of values. For more information, please check the google code site https://code.google.com/p/biblio-transformation-engine/ and in the downloads section you can find sample projects and documentation. If you have any other specific question, please contact me either through this list or directly via email. Best regards, kostas From: Thomas Misilo
[Dspace-tech] Login does not work after upgrading from 1.7 to 3.2
I have almost succeeded upgrading our dspace repository from version 1.7 to
3.2. I followed the upgrade procedures for both versions. However, the login
including the administrator's account can not be logged-in. It does not give an
error message. The login does not just happen and one is redirected to the home
page.
I have tried to clear the password, digest_algorithm and salt fields in the
eperson table using:
UPDATE eperson SET password=md5('mypassword'), salt=NULL,digest_algorithm=NULL
WHERE email='example@example.email;
This clears the salt and digest algorithm fields and populates password field
with the md5 hash as expected. However when I attempt to login again, the
password field is filled with SHA-512 hash string, the salt field with a salt
string and the digest_algorithm field with SHA-512. The login does not still
happen and the person is redirected to the home page.
Its like am stuck, any help will be much appreciated.
--
Get 100% visibility into Java/.NET code with AppDynamics Lite!
It's a free troubleshooting tool designed for production.
Get down to code-level detail for bottlenecks, with 2% overhead.
Download for free and get started troubleshooting in minutes.
http://pubads.g.doubleclick.net/gampad/clk?id=48897031iu=/4140/ostg.clktrk___
DSpace-tech mailing list
DSpace-tech@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/dspace-tech
List Etiquette: https://wiki.duraspace.org/display/DSPACE/Mailing+List+Etiquette
Re: [Dspace-tech] Missing dc.type field in mets.xml, but present in database
Hi, On 08/08/13 11:55, Alcides Carlos de Moraes Neto wrote: I checked the catalina.out for errors but could not find anything. No, nothing looks suspicious. Very strange. I'll try an update-discovery-index -f tomorrow... Good luck and let us know what happens. It might be interesting to see whether it stops after the same item as last time, assuming it will process the items in the same order as last time (I don't know whether that's the case). cheers, Andrea -- Dr Andrea Schweer IRR Technical Specialist, ITS Information Systems The University of Waikato, Hamilton, New Zealand -- Get 100% visibility into Java/.NET code with AppDynamics Lite! It's a free troubleshooting tool designed for production. Get down to code-level detail for bottlenecks, with 2% overhead. Download for free and get started troubleshooting in minutes. http://pubads.g.doubleclick.net/gampad/clk?id=48897031iu=/4140/ostg.clktrk ___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech List Etiquette: https://wiki.duraspace.org/display/DSPACE/Mailing+List+Etiquette
