Hi David, > I'm taking over looking after the UCT Matterhorn installation now that > Lovemore has moved on - so apologies for the newbie questions ;-)
never mind. Welcome to the Opencast Matterhorn community! > I'm trying to get my head around Mattehorn's storage requirements as part of > investigating why we have long processing times on our production cluster > (running 1.1). > > 1) Should org.opencastproject.storage.dir be unique per node? The > documentation at > http://opencast.jira.com/wiki/display/MH/SAMPLE+Customization suggests it > should be but neither the comments in the file or our installation do this. It should be. "o.o.storage.dir" indicates the temporary storage that every node needs on its own. If you start using the same directory on a shared filesystem, you will run into troubles. You could however have all the work directories on the same shared network drive (we do this at ETH), preferably on the same drive as the workspace. > 2) does org.opencastproject.workspace.rootdir need to be shared between nodes > (i.e. could this be a local directory on the worker node) Ideally, yes! This is where you can gain a lot of performance. When any of the Matterhorn services need to work on a certain piece of media, the service will first download the file to the workspace and then start processing. Now as a media package travels through the system to be processed, each media track and metadata file will be touched multiple times by different services. If the workspace is shared, download occurs only once. And you missed the third question (or you got that already, and I am including it here for completeness' sake): The biggest performance gain can be achieved by putting both the working file repository's storage directory and the shared workspace on one single network volume. This means that there will be no downloading from the working file repository to the workspace but hard linking, which can be done in a blink of an eye. For future reference, I've added the answers above to the page you mentioned. Tobias _______________________________________________ Matterhorn mailing list [email protected] http://lists.opencastproject.org/mailman/listinfo/matterhorn To unsubscribe please email [email protected] _______________________________________________
