Re: [Dspace-tech] Bad date problem in DSpace 1.7.1
For what it's worth, this sounds related to this discussion here: https://jira.duraspace.org/browse/DS-815 If you have additional information I think it would be valuable if you could log it there as well. with kindest regards, Bram Luyten @mire Esperantolaan 4 - 3001 Heverlee - Belgium 2888 Loker Avenue East, Suite 305 - Carlsbad, CA 92010 - USA atmire.com - Institutional Repository Solutions On Thu, Aug 18, 2011 at 10:39 PM, Thornton, Susan M. (LARC-B702)[LITES] susan.m.thorn...@nasa.gov wrote: Thanks a bunch George. I heard from someone else who said they also had the same problem. Sue Sue Walker-Thornton Software Developer/Database Administrator NASA Langley Research Center|LITES Contract (757) 224-4074 -Original Message- From: George S Kozak [mailto:g...@cornell.edu] Sent: Thursday, August 18, 2011 2:48 PM To: Thornton, Susan M. (LARC-B702)[LITES]; dspace-tech@lists.sourceforge.net Subject: RE: Bad date problem in DSpace 1.7.1 Hi, Susan: I reported the same problem back in May. I was told to exported the metadata for the problem records and then reimport them after fixing them. That worked, but I never heard anyone saying that the problem was going to be fixed. George Kozak Digital Library Specialist Cornell University Library Information Technologies (CULIT) 501 Olin Library Cornell University Ithaca, NY 14853 607-255-8924 From: Thornton, Susan M. (LARC-B702)[LITES] [susan.m.thorn...@nasa.gov] Sent: Thursday, August 18, 2011 12:13 PM To: dspace-tech@lists.sourceforge.net Subject: [Dspace-tech] Bad date problem in DSpace 1.7.1 Hi, I am in the process of upgrading from DSpace 1.5.1 to 1.7.1. I am almost done and am running index-init, but I’ve just noticed a problem. With previous versions of DSpace, if a “bad” date was encountered in one of the date fields (issue date, accession date, publication date), DSpace just ignored it. Now, it seems it is unable to either display the Item page or the Browse screen if encounters one of these records. Here’s an example: One of our items has the following invalid issue and publication date that our Users have never gotten around to correcting: Washington, D.C. :1955. If I try to display the Item, the screen is blank and the following message displays in the dspace.log file: 2011-08-18 12:07:14,232 WARN org.dspace.content.DCDate @ Mangled date: Washington, D.C. :1955. ..failed all attempts to parse as date. The same message displays if I try to browse by issue date. I know the “right” thing to do is to clean up our data, but I also know we have quite a few of these old bad dates and am wondering why DSpace is now having a problem with it. Thanks, Sue Sue Walker-Thornton Software Developer/Database Administrator NASA Langley Research Center|LITES Contract SGT, Inc.|130 Research Drive Hampton, Va. 23666 Office: (757) 224-4074 Mobile: (757) 506-9903 Fax: (757) 224-4001 susan.m.thorn...@nasa.gov -- Get a FREE DOWNLOAD! and learn more about uberSVN rich system, user administration capabilities and model configuration. Take the hassle out of deploying and managing Subversion and the tools developers use with it. http://p.sf.net/sfu/wandisco-d2d-2 ___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech -- Get a FREE DOWNLOAD! and learn more about uberSVN rich system, user administration capabilities and model configuration. Take the hassle out of deploying and managing Subversion and the tools developers use with it. http://p.sf.net/sfu/wandisco-d2d-2___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech
[Dspace-tech] Dspace content uploading without digital file
Hi, I have installed Dspace 1.7.1 . I have also started uploading the digital content and it is working fine. I also want to upload some contents for which I do not have any digital file, I just want to upload citation details of those contents. But Dspace is not allowing the submission without uploading the file. Can you please give me any solution to upload the contents with uploading the file. Regards, Vinod -- Get a FREE DOWNLOAD! and learn more about uberSVN rich system, user administration capabilities and model configuration. Take the hassle out of deploying and managing Subversion and the tools developers use with it. http://p.sf.net/sfu/wandisco-d2d-2 ___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech
Re: [Dspace-tech] Dspace content uploading without digital file
Hi Vinod change the default value (in dspace.cfg) for webui.submit.upload.required = false That should work Regards Emilio El 19/08/2011 10:21, Vinod K. Sharma escribió: Hi, I have installed Dspace 1.7.1 . I have also started uploading the digital content and it is working fine. I also want to upload some contents for which I do not have any digital file, I just want to upload citation details of those contents. But Dspace is not allowing the submission without uploading the file. Can you please give me any solution to upload the contents with uploading the file. Regards, Vinod -- Get a FREE DOWNLOAD! and learn more about uberSVN rich system, user administration capabilities and model configuration. Take the hassle out of deploying and managing Subversion and the tools developers use with it. http://p.sf.net/sfu/wandisco-d2d-2 ___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech smime.p7s Description: S/MIME Cryptographic Signature -- Get a FREE DOWNLOAD! and learn more about uberSVN rich system, user administration capabilities and model configuration. Take the hassle out of deploying and managing Subversion and the tools developers use with it. http://p.sf.net/sfu/wandisco-d2d-2___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech
[Dspace-tech] Managment of Historical Archival
Hello everyone, I need to implement DSpace for archiving valuable documents in the environment of government. I know there are standards such as ISO 15489 records management or the G-ISAD for archival description, but wanted to know if anyone has done anything like this or suggest any idea. I also wanted to know if is possible combine with the Dublin Core metadata with ISAD-G or EAD or is it preferable to adopt a single metadata schema. Regards, -- Ing. Miguel A. Robledo Dirección Provincial de Gobierno Digital Tucuman 2657 1º Piso - Santa Fe Teléfono: 0342-4508704 -- Get a FREE DOWNLOAD! and learn more about uberSVN rich system, user administration capabilities and model configuration. Take the hassle out of deploying and managing Subversion and the tools developers use with it. http://p.sf.net/sfu/wandisco-d2d-2___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech
[Dspace-tech] DSpace / Kaltura integration
This is posted on behalf of David Ruddy, who coordinates activities related to our institutional repository at Cornell. - Cornell's central campus IT has recently begun working with Kaltura to provide video services across campus. In the Library, we'd like to see some degree of integration between our DSpace IR and Kaltura, such as streaming capabilities for video content in our IR. We're just beginning to explore such integration and wondering if others in the DSpace community have already done so, or are interested in collaborating. If you operate both DSpace and Kaltura and have attempted integration, or are interested in integration, please let me know. Thanks, David Ruddy d...@cornell.edu 607.255.6803 George Kozak Digital Library Specialist Cornell University Library Information Technologies (CULIT) 501 Olin Library Cornell University Ithaca, NY 14853 607-255-8924 -- Get a FREE DOWNLOAD! and learn more about uberSVN rich system, user administration capabilities and model configuration. Take the hassle out of deploying and managing Subversion and the tools developers use with it. http://p.sf.net/sfu/wandisco-d2d-2 ___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech
Re: [Dspace-tech] DSpace / Kaltura integration
Hi, George, David, since you inquired about interest, I thought I'd say that, while we don't currently run Kaltura, we're definitely interested in seeing a streaming integration for DSpace made available to the community. It's been at the top of the list for a while, here in Missouri. I do know that Stuart Lewis and Kim Shepherd have been working with integrating Red5, they presented on this work at OR11, and Kim may be able to offer tips for other similar kinds of integration. We're also willing to collaborate on a solution which can be given to the community. -- HARDY POTTINGER pottinge...@umsystem.edu University of Missouri Library Systems http://lso.umsystem.edu/~pottingerhj/ https://MOspace.umsystem.edu/ No matter how far down the wrong road you've gone, turn back. --Turkish proverb On 8/19/11 9:01 AM, George S Kozak g...@cornell.edu wrote: This is posted on behalf of David Ruddy, who coordinates activities related to our institutional repository at Cornell. - Cornell's central campus IT has recently begun working with Kaltura to provide video services across campus. In the Library, we'd like to see some degree of integration between our DSpace IR and Kaltura, such as streaming capabilities for video content in our IR. We're just beginning to explore such integration and wondering if others in the DSpace community have already done so, or are interested in collaborating. If you operate both DSpace and Kaltura and have attempted integration, or are interested in integration, please let me know. Thanks, David Ruddy d...@cornell.edu 607.255.6803 George Kozak Digital Library Specialist Cornell University Library Information Technologies (CULIT) 501 Olin Library Cornell University Ithaca, NY 14853 607-255-8924 -- Get a FREE DOWNLOAD! and learn more about uberSVN rich system, user administration capabilities and model configuration. Take the hassle out of deploying and managing Subversion and the tools developers use with it. http://p.sf.net/sfu/wandisco-d2d-2 ___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech -- Get a FREE DOWNLOAD! and learn more about uberSVN rich system, user administration capabilities and model configuration. Take the hassle out of deploying and managing Subversion and the tools developers use with it. http://p.sf.net/sfu/wandisco-d2d-2 ___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech
Re: [Dspace-tech] Managment of Historical Archival
On Fri, Aug 19, 2011 at 10:22:30AM -0500, Tim Donohue wrote:
[snip]
To answer your second question about metadata. DSpace does support
custom metadata schemas (you can create your own), but internally it
does not currently support XML-based metadata (like EAD). Out-of-the-box
DSpace only supports qualified Dublin Core. You can import/export
metadata in some XML-based formats, but when the metadata is stored in
DSpace itself it is always translated into a qualified Dublin Core
structure (so depending on the metadata schema, some specificity may be
lost).
Well, strictly speaking, it's not *all* QDC specifically. You can
define as many additional schemae as you want. But they all have to
be one- or two-level hierarchies (like QDC) so some models would be
quite difficult to represent. Shallow hierarchial models are what
DSpace can use to support basic searching and browsing. If you can
express it as a tuple {schema, term[, qualifier]} then it is
manipulable in DSpace.
IIRC other types of metadata representations can be stored as
bitstreams, though they can't be directly used by DSpace. They would
be bound to their Items and available for use by other tools.
I guess it would be fair to say that DSpace concentrates on doing IR
well, but tries not to get in the way of people who are willing to
extend it to do other things well.
--
Mark H. Wood, Lead System Programmer mw...@iupui.edu
Asking whether markets are efficient is like asking whether people are smart.
pgpy4wfLNepOq.pgp
Description: PGP signature
--
Get a FREE DOWNLOAD! and learn more about uberSVN rich system,
user administration capabilities and model configuration. Take
the hassle out of deploying and managing Subversion and the
tools developers use with it. http://p.sf.net/sfu/wandisco-d2d-2___
DSpace-tech mailing list
DSpace-tech@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/dspace-tech
[Dspace-tech] Authority control not found (and Mirage theme)
Hi, I recently implemented authority control on dc.contributor.author and generally it seems to work well. However, there is one issue which may or may not be a bug in the implementation or in the Mirage theme choice-support.js script. When a value is *not found* in the authority and the user selects to use the value anyway, the system sets the confidence value to the constant for accepted rather than not found. I can read some ambiguity in the documentation (https://wiki.duraspace.org/display/DSPACE/Authority+Control+of+Metadata+Values) and source code regarding the correct answer -- I.e., in a sense the value is accepted as is by an authoritative interactive user, but it's also not found in the authority data source. In any case, we would like in this instance for the confidence level to be set to not found in order to distinguish it from values that are found in the authority data source. So, I guess the question to the list is: Is the behavior we are observing correct by design? Thanks, David DSpace 1.7.1 -- Get a FREE DOWNLOAD! and learn more about uberSVN rich system, user administration capabilities and model configuration. Take the hassle out of deploying and managing Subversion and the tools developers use with it. http://p.sf.net/sfu/wandisco-d2d-2___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech
Re: [Dspace-tech] How to share a collection among many communities?
Alexandre, Yes, what you are reading is old documentation. The core codebase supports placing a collection in more than one community. But the user interfaces do not and the behavior may be unexpected. This is an area of DSpace that was never completely implemented. I would avoid attempting to add a a collection to more than one community. Mapping items into multiple collections is probably a bit more stable, although personally, I'm not sure I've ever seen a valid reason to want to do it. Its always been my opinion that the urge to start mapping items across collections means that your overloading the meaning of the Community/Collection hierarchy for your organization and treating it as a classification scheme rather than a tool to manage submitter and review workflow. Note, The introduction of Discovery/Solr to DSpace as a search solution had the intent of providing the repo developers with a tool to create views over DSpace content that are not Community/Collection centric. Though this is still in its adolescence, eventually navigation over DSpace content by a means other than a community/collection hierarchy will lead to a better separation of management and presentation features and less need to attempt multiple item mapping in the first place. Mark On Thu, Aug 18, 2011 at 3:09 PM, helix84 heli...@centrum.sk wrote: On Thu, Aug 18, 2011 at 22:52, Stuart Lewis s.le...@auckland.ac.nz wrote: Using the batch CSV editor won't work, as this just allows items to be added to collections, not to communities. Oh, I misread, thanks for catching that. Regards, ~~helix84 -- Get a FREE DOWNLOAD! and learn more about uberSVN rich system, user administration capabilities and model configuration. Take the hassle out of deploying and managing Subversion and the tools developers use with it. http://p.sf.net/sfu/wandisco-d2d-2 ___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech -- Mark R. Diggory @mire - www.atmire.com 2888 Loker Avenue East - Suite 305 - Carlsbad - CA - 92010 Esperantolaan 4 - Heverlee 3001 - Belgium -- Get a FREE DOWNLOAD! and learn more about uberSVN rich system, user administration capabilities and model configuration. Take the hassle out of deploying and managing Subversion and the tools developers use with it. http://p.sf.net/sfu/wandisco-d2d-2 ___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech
Re: [Dspace-tech] Requesting Troubleshooting Suggestions - AIP Export Errors
Tim - Many thanks for your help! I'm going to try to provide some additional information to see about teasing out the cause of this particular problem. To start, I should toss out a little system information: DSpace v. 1.7.2 Java version 1.6.0_26 PostgresSQL 8.4.7 All on the same RedHat box. The next important detail is that I should have removed the manifestOnly option from the command as I've experienced the error with manifestOnly set to true as well as left out (defaulted to false). As a side note, this use of manifestOnly was more of an afterthought (I'd noted it's experimental nature), and I'm not certain that it actually does quite what I was looking for. My purpose is setting up instances with data so that I can fully test themes I'm building for various institutions, but I'm not really needing content files (bitstreams), just the communities, sub-communities, collections, item-pages, and *references* to content files (having files or not doesn't really matter as much, but it'd be preferable to leave out the asset store). From the description in your email, it does sound indeed as though setting the manifestOnly option to true would be good for my use-case *as long as* the feature was stable (which, as it has been said, it's not as of yet). But again, the manifestOnly option is not a priority (for me) at this point. It sounds as though the next piece of the puzzle might be the database connection. The postgres service that I'm using for the instance(s) is on the same machine as the dspace instance(s). I think that eliminates network troubles as a potential cause (not that there couldn't be something else going on with the postgres service). Next up would be a little more detail concerning the behavior of the attempted command. The error does not happen immediately, it does run for a while before erroring out. I'm not sure about how to get exact statistics for how much of the process is being completed, but I can give some info. The instance I'm attempting to pull from has 28 communities and 82 sub-communities (all but a few have items). I'm not sure how many collections but it should have between 6,000 to 8,000 items. I've run the command numerous times and seem to semi-randomly get between 55mb and 125mb's worth of data. That ranges between 2, 6, or more communities depending on the run (with collection and item numbers varying widely). In attempting to do some more detailed troubleshooting I delved into a DEBUG level of dspace logs. Unfortunately the DEBUG level only gave me one additional line from which to investigate the issue: 2011-08-19 14:05:51,512 DEBUG net.sf.ehcache.CacheManager @ CacheManager already shutdown The rest of the log file didn't show anything relevant. From there I was going to try to take a look at the postgres logs but 1) I don't have read access to them, 2) They don't have query level information (not sure how necessary that would be), and 3) My sysadmin seemed to think that it wouldn't worth checking at this point. He did, however, suggest some other things to check on which I have. We have several (around 10) tomcat instances serving dspace installations on this server. Half have no data and are never used. The other half have descent stores of info (communities, collections, items, bitstreams) but are very infrequently accessed. One instance is large and has more regular (but hard for me to define in volume) usage. I ended up changing all the instances to have a db.maxidle value of 5 (rather than the default -1 [unlimited]). This seemed to enable the AIP export process to run longer before it errored out. After this I ended up shutting down all the tomcat instances save for the large one and also increased the db.maxconnections to 400 (just to give it a whirl). This seemed to allow the AIP export to go even longer before erroring out. Another interesting (to me at least) thing is that I also tried changing the db.maxidle down to a value of 1. The trial here lasted a long time, got a lot of data, but ended due to exceeding the db.maxwait interval (I'd set it to 1 milliseconds) for the idle thread. I'm not sure what all exactly this would tell us, but at least some of it will be relevant/helpful info. One other thing that I discovered while tweaking with the database settings was that running the AIP export while tailing the log file showed that the org.postgresql.util.PSQLException popped up at least a few times for each AIP export I'd attempted to do. Is it a specific object in DSpace that causes the error? This is a great question. I'm not sure how to answer it though (would probably need a query level of postgres logs?). I can say that for certain this was the case for an earlier error (not one that related to postgres issues) that we'd encountered with the AIP tool. The cause of the earlier error was that we'd somehow managed to have a couple items in the instance that did not have titles. After making sure that the items were removed or given dc.title
