This is an automated notification sent by LCG Savannah.
It relates to:
task #3234, project CDS Invenio
==============================================================================
LATEST MODIFICATIONS of task #3234:
==============================================================================
Update of task #3234 (project cdsware):
Percent Complete: 90% => 100%
Assigned to: None => skaplun
Open/Closed: Open => Closed
==============================================================================
OVERVIEW of task #3234:
==============================================================================
URL:
<http://savannah.cern.ch/task/?3234>
Summary: BibUpload should take care of uploading fulltext
files too
Project: CDS Invenio
Submitted by: simko
Submitted on: 2006-03-30 08:26
Should Start On: 2006-03-30 00:00
Should be Finished on: 2006-03-30 00:00
Category: BibUpload
Priority: 5 - Normal
Status: Done
Privacy: Public
Percent Complete: 100%
Assigned to: skaplun
Open/Closed: Closed
Discussion Lock: Any
Effort: 0.00
_______________________________________________________
Here's that MARCXML format with embedded-file-path-to-be-uploaded that
I mentioned you earlier today. The idea is that elmsubmit would
produce such a file and bibupload would then upload it, metadata
together with the fulltext. No websumbit calls would be required
anymore then.
Tibor
* Tue, 31 Aug 2004 17:47:03 +0200
| Another idea that is being discussed elsewhere (EPrints, DSpace) is
| to allow for importing many fulltext files easily, together with the
| metadata.
|
| * Usage scenario:
|
| RERO plans to upload 100,000 photos in the near future.
|
| * Problem:
|
| Even when fulltext files are located on the document server, each
| file has to be integrated into our
|
| ``<prefix>/var/data/files/g1/213123/file.jpg;2''
|
| structure, so that much post-upload treatment is necessary.
| Firstly one has to upload the metadata, then get back recIDs, then
| for each fulltext file create new docID, then put the file where it
| belongs in our ``var/data/files/g0/'' tree with the appropriate
| version number, then to make a link between recID and docID, and
| finally enrich existing metadata with 856.
|
| * Proposed solution:
|
| BibUpload can do the job more easily during the upload time,
| similarly to what it's already doing for formats, when the special
| tag FMT is encountered. For the fulltext file transfer we could
| invent a new special tag called FFT, say, so that the input file
| would look like this:
|
| <record>
| <datafield tag="100" ind1="" ind2="">
| <subfield code="a">Wang, B</subfield>
| </datafield>
| <datafield tag="245" ind1="" ind2="">
| <subfield code="a">
| Quasinormal modes of Reissner-Nordstrom Anti-de Sitter Black
Holes
| </subfield>
| </datafield>
| <datafield tag="FFT" ind1="" ind2="">
| <subfield code="a">
| file:///tmp/file1.jpg
| </subfield>
| <subfield code="a">
| file:///tmp/file1.tiff
| </subfield>
| </datafield>
| </record>
|
| and bibupload, when it sees the FFT tag, would integrate the files
| into our ``var/data/files/g0/'' structure where they belongs, and
| link the files to the metadata record. It can do so since it knows
| the newly attributed recID and stuff.
|
| We could also later on extend the FFT protocol to allow for various
| file input channels like:
|
| file:///tmp/file1.jpg
|
| http://site.com/file1.jpg
|
| sftp://site.com/file1.jpg
|
| etc.
_______________________________________________________
Follow-up Comments:
-------------------------------------------------------
Date: 2007-04-26 09:16 By: Tibor Simko <simko>
FFT insert mode done, correct and replace to be tested. FFT rights
and comments may be introduced too.
(The implementation currently does not use file.py library, this could/shoud
be improved.)
-------------------------------------------------------
Date: 2006-07-21 09:26 By: Tibor Simko <simko>
New BibUpload could create many 8564 fields (for every input file)
that look like this (respecting our new URL schema):
http://pcuds17.cern.ch/record/73/files/file1.jpg
http://pcuds17.cern.ch/record/73/files/file1.tiff
This will help with the BibFormat task of providing direct links
to every file in HB format, so that users do not have to go through an
intermediate page. (See the other BibFormat task and
also doc.rero.ch site.)
_______________________________________________________
Carbon-Copy List:
CC Address | Comment
------------------------------------+-----------------------------
2195 | -UPD-
1576 | -SUB-
==============================================================================
This item URL is:
<http://savannah.cern.ch/task/?3234>
_______________________________________________
Message sent via/by LCG Savannah
http://savannah.cern.ch/
