Re: [Fedora-commons-developers] OAI-PMH Harvester

2009-03-12 Thread Mischael Schill
The work is now well underway, there will be a release in the next  
couple of weeks. Now is the right time to ask me questions if anybody  
is interested how the harvester will work.

Cheers,
Mischael Schill

--
Apps built with the Adobe(R) Flex(R) framework and Flex Builder(TM) are
powering Web 2.0 with engaging, cross-platform capabilities. Quickly and
easily build your RIAs with Flex Builder, the Eclipse(TM)based development
software that enables intelligent coding and step-through debugging.
Download the free 60 day trial. http://p.sf.net/sfu/www-adobe-com
___
Fedora-commons-developers mailing list
Fedora-commons-developers@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/fedora-commons-developers


Re: [Fedora-commons-developers] OAI-PMH Harvester

2009-03-12 Thread Filipe Correia
Hello Mischael,

On Thu, Mar 12, 2009 at 8:55 AM, Mischael Schill
mischael.sch...@switch.ch wrote:
 The work is now well underway, there will be a release in the next
 couple of weeks. Now is the right time to ask me questions if anybody
 is interested how the harvester will work.

Is this an harvester meant to harvest external meta-data and
automatically ingest/update it in fedora? (hence, replicating the
meta-data on another repository)
Or is it the other way around, and what it does is to harvest
meta-data provided by fedora's OAI-PMH service?

I would find both scenarios useful, although I see the second one more
as a software library than a standalone module.

Regards,
Filipe Correia

--
Apps built with the Adobe(R) Flex(R) framework and Flex Builder(TM) are
powering Web 2.0 with engaging, cross-platform capabilities. Quickly and
easily build your RIAs with Flex Builder, the Eclipse(TM)based development
software that enables intelligent coding and step-through debugging.
Download the free 60 day trial. http://p.sf.net/sfu/www-adobe-com
___
Fedora-commons-developers mailing list
Fedora-commons-developers@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/fedora-commons-developers


Re: [Fedora-commons-developers] OAI-PMH Harvester

2009-03-12 Thread Mischael Schill
Hello Filipe,

On 12.03.2009, at 12:19, Filipe Correia wrote:
 Is this an harvester meant to harvest external meta-data and
 automatically ingest/update it in fedora? (hence, replicating the
 meta-data on another repository)
Thats right.
It consists of the following parts:
- An OAI-PMH client implementation library (finished)
- The Harvester as a library (60% complete)
- A WebService which uses the library
- Possibly a Web UI

The harvester itself will have the following features:
- It is Protocol-Agnostic: You can easily add more harvesting and  
more storing protocols, so it isn't tied to Fedora or OAI-PMH but  
these are the protocols I'll implement.
- Converting different metadata formats into others using xslt or  
custom java code.
- Translation-tables: Translates the content of metadata fields. For  
example if the source uses another naming schema for the discipline- 
field.
- One or more Metadata-Streams.

Possible future features:
- Non-XML data streams
- Support for OAI-ORE

I'm using standard Java 1.5 with JAX-WS, JAXB and Joda-Time (because  
java.util.Date and DateFormat is just evil).
It needs at least Fedora 2 to work (Using the Fedora2Repository class  
which uses the SOAP-API). I'm implementing a Fedora3Repository using  
the REST API afterwards.

 Or is it the other way around, and what it does is to harvest
 meta-data provided by fedora's OAI-PMH service?

By creating another storing protocol (called Repository inside the  
harvester, as opposed to Archive which is the harvesting protocol)  
this is easily done.

Cheers,
Mischael Schill

--
Apps built with the Adobe(R) Flex(R) framework and Flex Builder(TM) are
powering Web 2.0 with engaging, cross-platform capabilities. Quickly and
easily build your RIAs with Flex Builder, the Eclipse(TM)based development
software that enables intelligent coding and step-through debugging.
Download the free 60 day trial. http://p.sf.net/sfu/www-adobe-com
___
Fedora-commons-developers mailing list
Fedora-commons-developers@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/fedora-commons-developers


Re: [Fedora-commons-developers] OAI-PMH Harvester

2009-03-12 Thread Filipe Correia
Great! Support for OAI-ORE sounds like a particularly nice addition :)
Would love to hear back from you when you release it.

Cheers,
Filipe Correia

On Thu, Mar 12, 2009 at 3:36 PM, Mischael Schill
mischael.sch...@switch.ch wrote:
 On 12.03.2009, at 12:19, Filipe Correia wrote:
 Is this an harvester meant to harvest external meta-data and
 automatically ingest/update it in fedora? (hence, replicating the
 meta-data on another repository)

 Thats right.
 It consists of the following parts:
 - An OAI-PMH client implementation library (finished)
 - The Harvester as a library (60% complete)
 - A WebService which uses the library
 - Possibly a Web UI

 The harvester itself will have the following features:
 - It is Protocol-Agnostic: You can easily add more harvesting and more
 storing protocols, so it isn't tied to Fedora or OAI-PMH but these are the
 protocols I'll implement.
 - Converting different metadata formats into others using xslt or custom
 java code.
 - Translation-tables: Translates the content of metadata fields. For example
 if the source uses another naming schema for the discipline-field.
 - One or more Metadata-Streams.

 Possible future features:
 - Non-XML data streams
 - Support for OAI-ORE

 I'm using standard Java 1.5 with JAX-WS, JAXB and Joda-Time (because
 java.util.Date and DateFormat is just evil).
 It needs at least Fedora 2 to work (Using the Fedora2Repository class which
 uses the SOAP-API). I'm implementing a Fedora3Repository using the REST API
 afterwards.

 Or is it the other way around, and what it does is to harvest
 meta-data provided by fedora's OAI-PMH service?

 By creating another storing protocol (called Repository inside the
 harvester, as opposed to Archive which is the harvesting protocol) this is
 easily done.

 Cheers,
 Mischael Schill


--
Apps built with the Adobe(R) Flex(R) framework and Flex Builder(TM) are
powering Web 2.0 with engaging, cross-platform capabilities. Quickly and
easily build your RIAs with Flex Builder, the Eclipse(TM)based development
software that enables intelligent coding and step-through debugging.
Download the free 60 day trial. http://p.sf.net/sfu/www-adobe-com
___
Fedora-commons-developers mailing list
Fedora-commons-developers@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/fedora-commons-developers