Hey all, I've been out of the office for quite some days, so I'm sorry if this email has already got stale.
The fact is, we were trying to find a simple path for migrating the audiovisual material from 1.0 to 1.1, but in the meantime we had one sort of a catastrophe with our servers and we lost ALL the data in our pilots. Therefore, as we did not have material to pass from 1.0 to 1.1, the work was stopped. Our idea was to keep the process as simple as possible. We did not even want to make a standard procedure, but a sort of a workaround for our specific situation. The way to go was, if I remember correctly, hit the search service endpoint of the 1.0, process the xml obtained and use the media URLs to move them from the 1.0 to the 1.1 repository, and then include those newly copied videos in the new search index. That solves having all our videos in the "search" index. If we also want to migrate the workflows, in case the awaited "re-ingest workflow" feature comes in a future release, we thought that we would create a dummy workflow that does not process the videos (and perhaps includes them in the search index, so that you have not to do it by hand). We started with bash but its capabilities to process .xml files are limited, to say the least, so we began to do something in python. We didn't actually have anything working before the servers crashed, so I'm sorry I cannot even offer a draft work. Perhaps Rüdiger's solution is the most advanced (how surprising ;) ), and I guess his approach may be similar than the one Adam and I described. Best regards, Rubén 2011/8/30 Adam Hochman <[email protected]> > ** > There is a rumor that the folks at University of Vigo had created a > migration strategy from 1.1 to 1.2. Ruben, did this ever come to fruition? > > The search service will provide all distributed instances of the > recordings. From this xml, you parse out the media packages and post them > in bulk (I think) to the workflow service. > You may want to have a custom workflow for the migration so that the files > are not re-encoded and distributed. The last operation's status description > could be named "migrated from 1.1. Distributed" so that the admin user > understands the recording's final status via the UI. I'm not sure though > whether you can simply keep the existing directory structure from 1.1. If > you can't I imagine you'll be required to resubmit the media packages using > the default workflow. > > On 8/30/11 4:08 AM, David Horwitz wrote: > > Thanks - Ruediger, Stephen had mentioned the need to re-ingest but had not > been able to point me to a discussion/documentation so I wanted to be sure > his information was up to date. > > I may well get in touch about the script when I'm closer in our upgrade. > > Regards > > David > > On 08/30/2011 12:24 PM, Ruediger Rolf wrote: > > Hi David, > > I'm sorry that I must say that there is currently no upgrade path. I guess > that there was a discussion on the mailing list some month ago about this > issue. We know that this is a problem and hard to communicate, but we have > limited development resources. > > As far as I know we are hoping to provide upgrade paths from 1.2 on. > > Currently the only way to upgrade is to reingest the old mediapackages into > 1.2. > If you still have all ZIP-Packages you can use the inbox. > > For the 1.0 to 1.1 upgrade I wrote myself a shell script that probably only > needs moderate changes to work for 1.1 to 1.2. This works on the files in > the matterhorn Working File Repository directory and does not need the zip > files or a running matterhorn. > I can share it, but it is not intensivly tested and unsupported. So you > should only use it if you know how shell scripts work. > > Regards > Rüdiger > > > > Am 30.08.2011 11:01, schrieb David Horwitz: > > Hi Ruediger, > > I asked a question about upgrade paths yesterday - its not mentioned > anywhere in the release notes at all. Some indication of how one goes about > updating a 1.1 installation to 1.2 would be very useful. If its in raw form > in the list archives/jira or where ever I'm happy to help beat it into some > useful form if pointed in the right direction. > > Regards > > David > > On 08/30/2011 10:40 AM, Ruediger Rolf wrote: > > Hi Eric, > > there is no upgrading from 1.1 to 1.2 you will have to setup a new database > for 1.2. It seems to me that you are still using the 1.1 database. > > Regards > Rüdiger > > Am 30.08.2011 10:02, schrieb Eric Shek: > > Hi all, > > I have installed the latest 1.2 release but I found that the ingest service > is not functioning properly. It seems that 1.2 has lots of new service and > bundle. Attached the logs which shows the error. > > Best Regards, > Eric Shek > > The following are the logs: > 2011-08-30 16:01:00 WARN (ServiceRegistryJpaImpl$JobDispatcher:1468) - > Error dispatching jobs > org.opencastproject.serviceregistry.api.ServiceRegistryException: Exception > [EclipseLink-4002] (Eclipse Persistence Services - 2.0.2.v20100323-r6872): > org.eclipse.persistence.exceptions.DatabaseException > Internal Exception: org.h2.jdbc.JdbcSQLException: Column "CREATOR" not > found; SQL statement: > SELECT ID, STATUS, PAYLOAD, DATESTARTED, RUNTIME, creator, > instance_version, DATECOMPLETED, operation, DISPATCHABLE, organization, > DATECREATED, QUEUETIME, processor_svc, PARENTJOB_ID, ROOTJOB_ID, creator_svc > FROM JOB WHERE ((DISPATCHABLE = ?) AND (STATUS = ?)) ORDER BY DATECREATED > ASC [42122-149] > Error Code: 42122 > Call: SELECT ID, STATUS, PAYLOAD, DATESTARTED, RUNTIME, creator, > instance_version, DATECOMPLETED, operation, DISPATCHABLE, organization, > DATECREATED, QUEUETIME, processor_svc, PARENTJOB_ID, ROOTJOB_ID, creator_svc > FROM JOB WHERE ((DISPATCHABLE = ?) AND (STATUS = ?)) ORDER BY DATECREATED > ASC > bind => [true, 0] > Query: ReadAllQuery(name="Job.dispatchable.status" > referenceClass=JobJpaImpl sql="SELECT ID, STATUS, PAYLOAD, DATESTARTED, > RUNTIME, creator, instance_version, DATECOMPLETED, operation, DISPATCHABLE, > organization, DATECREATED, QUEUETIME, processor_svc, PARENTJOB_ID, > ROOTJOB_ID, creator_svc FROM JOB WHERE ((DISPATCHABLE = ?) AND (STATUS = ?)) > ORDER BY DATECREATED ASC") > at > org.opencastproject.serviceregistry.impl.ServiceRegistryJpaImpl.getDispatchableJobs(ServiceRegistryJpaImpl.java:873) > at > org.opencastproject.serviceregistry.impl.ServiceRegistryJpaImpl$JobDispatcher.run(ServiceRegistryJpaImpl.java:1428) > at > java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:441) > at > java.util.concurrent.FutureTask$Sync.innerRunAndReset(FutureTask.java:317) > at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:150) > at > java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$101(ScheduledThreadPoolExecutor.java:98) > at > java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.runPeriodic(ScheduledThreadPoolExecutor.java:181) > at > java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:205) > at > java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:886) > at > java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:908) > at java.lang.Thread.run(Thread.java:619) > Caused by: Exception [EclipseLink-4002] (Eclipse Persistence Services - > 2.0.2.v20100323-r6872): org.eclipse.persistence.exceptions.DatabaseException > Internal Exception: org.h2.jdbc.JdbcSQLException: Column "CREATOR" not > found; SQL statement: > SELECT ID, STATUS, PAYLOAD, DATESTARTED, RUNTIME, creator, > instance_version, DATECOMPLETED, operation, DISPATCHABLE, organization, > DATECREATED, QUEUETIME, processor_svc, PARENTJOB_ID, ROOTJOB_ID, creator_svc > FROM JOB WHERE ((DISPATCHABLE = ?) AND (STATUS = ?)) ORDER BY DATECREATED > ASC [42122-149] > Error Code: 42122 > Call: SELECT ID, STATUS, PAYLOAD, DATESTARTED, RUNTIME, creator, > instance_version, DATECOMPLETED, operation, DISPATCHABLE, organization, > DATECREATED, QUEUETIME, processor_svc, PARENTJOB_ID, ROOTJOB_ID, creator_svc > FROM JOB WHERE ((DISPATCHABLE = ?) AND (STATUS = ?)) ORDER BY DATECREATED > ASC > bind => [true, 0] > Query: ReadAllQuery(name="Job.dispatchable.status" > referenceClass=JobJpaImpl sql="SELECT ID, STATUS, PAYLOAD, DATESTARTED, > RUNTIME, creator, instance_version, DATECOMPLETED, operation, DISPATCHABLE, > organization, DATECREATED, QUEUETIME, processor_svc, PARENTJOB_ID, > ROOTJOB_ID, creator_svc FROM JOB WHERE ((DISPATCHABLE = ?) AND (STATUS = ?)) > ORDER BY DATECREATED ASC") > at > org.eclipse.persistence.exceptions.DatabaseException.sqlException(DatabaseException.java:333) > at > org.eclipse.persistence.internal.databaseaccess.DatabaseAccessor.basicExecuteCall(DatabaseAccessor.java:687) > at > org.eclipse.persistence.internal.databaseaccess.DatabaseAccessor.executeCall(DatabaseAccessor.java:530) > at > org.eclipse.persistence.sessions.server.ServerSession.executeCall(ServerSession.java:529) > at > org.eclipse.persistence.internal.sessions.IsolatedClientSession.executeCall(IsolatedClientSession.java:133) > at > org.eclipse.persistence.internal.queries.DatasourceCallQueryMechanism.executeCall(DatasourceCallQueryMechanism.java:206) > at > org.eclipse.persistence.internal.queries.DatasourceCallQueryMechanism.executeCall(DatasourceCallQueryMechanism.java:192) > at > org.eclipse.persistence.internal.queries.DatasourceCallQueryMechanism.executeSelectCall(DatasourceCallQueryMechanism.java:263) > at > org.eclipse.persistence.internal.queries.DatasourceCallQueryMechanism.selectAllRows(DatasourceCallQueryMechanism.java:619) > at > org.eclipse.persistence.internal.queries.ExpressionQueryMechanism.selectAllRowsFromTable(ExpressionQueryMechanism.java:2537) > at > org.eclipse.persistence.internal.queries.ExpressionQueryMechanism.selectAllRows(ExpressionQueryMechanism.java:2496) > at > org.eclipse.persistence.queries.ReadAllQuery.executeObjectLevelReadQuery(ReadAllQuery.java:455) > at > org.eclipse.persistence.queries.ObjectLevelReadQuery.executeDatabaseQuery(ObjectLevelReadQuery.java:997) > at > org.eclipse.persistence.queries.DatabaseQuery.execute(DatabaseQuery.java:675) > at > org.eclipse.persistence.queries.ObjectLevelReadQuery.execute(ObjectLevelReadQuery.java:958) > at > org.eclipse.persistence.queries.ReadAllQuery.execute(ReadAllQuery.java:432) > at > org.eclipse.persistence.queries.ObjectLevelReadQuery.executeInUnitOfWork(ObjectLevelReadQuery.java:1021) > at > org.eclipse.persistence.internal.sessions.UnitOfWorkImpl.internalExecuteQuery(UnitOfWorkImpl.java:2898) > at > org.eclipse.persistence.internal.sessions.AbstractSession.executeQuery(AbstractSession.java:1225) > at > org.eclipse.persistence.internal.sessions.AbstractSession.executeQuery(AbstractSession.java:1207) > at > org.eclipse.persistence.internal.sessions.AbstractSession.executeQuery(AbstractSession.java:1181) > at > org.eclipse.persistence.internal.jpa.EJBQueryImpl.executeReadQuery(EJBQueryImpl.java:453) > at > org.eclipse.persistence.internal.jpa.EJBQueryImpl.getResultList(EJBQueryImpl.java:681) > at > org.opencastproject.serviceregistry.impl.ServiceRegistryJpaImpl.getDispatchableJobs(ServiceRegistryJpaImpl.java:871) > ... 10 more > Caused by: org.h2.jdbc.JdbcSQLException: Column "CREATOR" not found; SQL > statement: > SELECT ID, STATUS, PAYLOAD, DATESTARTED, RUNTIME, creator, > instance_version, DATECOMPLETED, operation, DISPATCHABLE, organization, > DATECREATED, QUEUETIME, processor_svc, PARENTJOB_ID, ROOTJOB_ID, creator_svc > FROM JOB WHERE ((DISPATCHABLE = ?) AND (STATUS = ?)) ORDER BY DATECREATED > ASC [42122-149] > at org.h2.message.DbException.getJdbcSQLException(DbException.java:327) > at org.h2.message.DbException.get(DbException.java:167) > at org.h2.message.DbException.get(DbException.java:144) > at > org.h2.expression.ExpressionColumn.optimize(ExpressionColumn.java:126) > at org.h2.command.dml.Select.prepare(Select.java:773) > at org.h2.command.Parser.prepare(Parser.java:202) > at org.h2.command.Parser.prepareCommand(Parser.java:214) > at org.h2.engine.Session.prepareLocal(Session.java:425) > at org.h2.engine.Session.prepareCommand(Session.java:374) > at org.h2.jdbc.JdbcConnection.prepareCommand(JdbcConnection.java:1056) > at > org.h2.jdbc.JdbcPreparedStatement.<init>(JdbcPreparedStatement.java:71) > at org.h2.jdbc.JdbcConnection.prepareStatement(JdbcConnection.java:233) > at > com.mchange.v2.c3p0.impl.NewProxyConnection.prepareStatement(NewProxyConnection.java:213) > at > org.eclipse.persistence.internal.databaseaccess.DatabaseAccessor.prepareStatement(DatabaseAccessor.java:1404) > at > org.eclipse.persistence.internal.databaseaccess.DatabaseAccessor.prepareStatement(DatabaseAccessor.java:1353) > at > org.eclipse.persistence.internal.databaseaccess.DatabaseCall.prepareStatement(DatabaseCall.java:645) > at > org.eclipse.persistence.internal.databaseaccess.DatabaseAccessor.basicExecuteCall(DatabaseAccessor.java:580) > ... 32 more > > > > _______________________________________________ > Matterhorn-users mailing > [email protected]http://lists.opencastproject.org/mailman/listinfo/matterhorn-users > > > > -- > > ________________________________________________ > Rüdiger Rolf, M.A. > Universität Osnabrück - Zentrum virtUOS > Heger-Tor-Wall 12, 49069 Osnabrück > Telefon: (0541) 969-6511 - Fax: (0541) 969-16511 > E-Mail: [email protected] > Internet: www.virtuos.uni-osnabrueck.de > > > _______________________________________________ > Matterhorn-users mailing > [email protected]http://lists.opencastproject.org/mailman/listinfo/matterhorn-users > > > > _______________________________________________ > Matterhorn-users mailing > [email protected]http://lists.opencastproject.org/mailman/listinfo/matterhorn-users > > > > -- > > ________________________________________________ > Rüdiger Rolf, M.A. > Universität Osnabrück - Zentrum virtUOS > Heger-Tor-Wall 12, 49069 Osnabrück > Telefon: (0541) 969-6511 - Fax: (0541) 969-16511 > E-Mail: [email protected] > Internet: www.virtuos.uni-osnabrueck.de > > > _______________________________________________ > Matterhorn-users mailing > [email protected]http://lists.opencastproject.org/mailman/listinfo/matterhorn-users > > > _______________________________________________ > Matterhorn-users mailing list > [email protected] > http://lists.opencastproject.org/mailman/listinfo/matterhorn-users > >
_______________________________________________ Matterhorn-users mailing list [email protected] http://lists.opencastproject.org/mailman/listinfo/matterhorn-users
