That looks very powerful. I currently use a mix of OpenRefine and Python scripts[0] for various batch editing and cleanup tasks I have. The fact that GLAMpipe connects straight to DSpace via the REST API makes it very appealing, as I usually work on CSVs from the database or DSpace metadata export. On that note, you should add some information to the README about DSpace versions supported/tested, as we know the REST API has changed quite a bit from DSpace 4.x to 6.x.
One thing that is fantastic with OpenRefine is that you can view data in facets, making it easy to find outliers, for example in authors or subjects. Regarding the project requirements, NodeJS is simple to install and manage as a non-root user with NVM[1] on any platform, but I have an aversion to MongoDB because of the frequent bad press it has gotten over the years (security, data consistency, fanboys talking about it being "web scale"[2], etc). Wouldn't it have been possible to use a modern PostgreSQL (>9.4 I think?) with their document storage capabilities? Keep up the good work! [0] https://github.com/ilri/DSpace/wiki/Scripts [1] https://github.com/creationix/nvm [2] https://www.youtube.com/watch?v=b2F-DItXtZs On Tue, Dec 20, 2016 at 12:00 PM Ari <[email protected]> wrote: > > Hi, > I previously started a project called GLAMpipe, which aims to be a generic > data mangling tool for GLAM data (Galleries, Libraries, Archives and > Museums). The project is quite new, so things haven't settled yet. > > Currently i'm extending GLAMpipe so that one could use to manipulata data > in DSpace. > DSpace nodes: > - DSpace collection import > - DSpace query import > - DSpace download bitstream > - DSpace create items > - DSpace edit metadata > - DSpace add bitsreams > > I made a short screencast of correcting author name in demo.dspace.org: > https://www.youtube.com/watch?v=Ll_nKfB2otM > > In case you are interested and would like to test it out: > https://github.com/artturimatias/GLAMpipe > > It is a nodejs application with MongoDB. GLAMpipe can be run via Docker or > as a regular nodejs app in Linux. > Testing is almost non-existent at the moment, so things can (and will) > blow up occasionally. > > Any comments or suggestion are welcome! > > Best, > Ari Häyrinen > Information system expert > Jyväskylä University Library > > -- > You received this message because you are subscribed to the Google Groups > "DSpace Technical Support" group. > To unsubscribe from this group and stop receiving emails from it, send an > email to [email protected]. > To post to this group, send email to [email protected]. > Visit this group at https://groups.google.com/group/dspace-tech. > For more options, visit https://groups.google.com/d/optout. > -- Alan Orth [email protected] https://englishbulgaria.net https://alaninkenya.org https://mjanja.ch -- You received this message because you are subscribed to the Google Groups "DSpace Technical Support" group. To unsubscribe from this group and stop receiving emails from it, send an email to [email protected]. To post to this group, send email to [email protected]. Visit this group at https://groups.google.com/group/dspace-tech. For more options, visit https://groups.google.com/d/optout.
