This is in regard to a question I asked to the AMIA member list. I thought there are probably a few video librarians who are starting to get interested in this stuff as well so I'm forwarding it. Nothing too in depth but some useful info.
---------- Forwarded message ---------- From: Chris Lewis <[email protected]> Date: Fri, Aug 8, 2014 at 1:15 PM Subject: A quick summary of answers to my question about the uploading of large video files to AWS/Glacier To: [email protected] First thanks to those who replied to my query. Your comments were very useful. My original question: Are any of you using Amazon Glacier for archiving uncompressed video files? Amazon Web Services (AWS) options for large video file storage are Simple Storage Services (S3) and Glacier. S3 is the more expensive of the two as it’s intended for frequent access and can be used to host websites. Glacier is for long-term storage of files that are infrequently accessed. The uploading question would seem to apply to both. For transferring large uncompressed files to either, using FTP is a little iffy. One respondent said that she couldn’t complete a 59.5GB file upload using FTP because the connection was resetting itself every 24 hours. Her organization also experienced repeated failures for files larger than that. Another respondent described success transferring much larger files so testing would be warranted before ruling out FTP as an option. Options besides FTP that were recommended were RSYNC, a Unix tool for mirroring files that can resume interrupted transactions. Transmit, and Filezilla were also recommended. In all cases the target server must recognize the given protocol for it to work. Amazon also has an option called AWS DirectConnect where a fixed connection between datacenters can be set up. One respondent mentioned that her organization was setting up such a connection and offered to report on the experience when it was up and running. Finally Amazon has an option called AWS Import where a hard disc can be mailed to them though they charge a handling fee (~$70) every time they touch a drive. Thanks again for the feedback. -- Chris Lewis American University Library 202.885.3257 -- Chris Lewis American University Library 202.885.3257
VIDEOLIB is intended to encourage the broad and lively discussion of issues relating to the selection, evaluation, acquisition,bibliographic control, preservation, and use of current and evolving video formats in libraries and related institutions. It is hoped that the list will serve as an effective working tool for video librarians, as well as a channel of communication between libraries,educational institutions, and video producers and distributors.
