On 13-01-07 12:44 PM, Paul Pettit wrote: > hi greg, > > thanks for the reply! > > On 07/01/13 17:24, Greg Logan wrote: >>> [snip] >> Which firmware version are you using on the ECD? > > 2.3.1e1 (the latest i could find) > > i've added an ad-hoc api to it but my code shouldn't interfere with > scheduled recordings at all (i haven't done anything to your existing > code including the ingest stuff, just added the ability to start and > stop recordings manually and query the device status).
That's a recent version, so you should be ok. It's highly unlikely that your code affects ingest unless you've managed to alter one of my scripts! >>> [snip] >>> >>> so i am guessing that the huge number of segments caused by the auto >>> powerpoint is not helping? (i'm guessing that's also why it took 5.5 >>> hours to get that far!) it complains about the size of the POST to >>> http://matterhorn-worker.uscs.susx.ac.uk/distribution/streaming but I >>> can find no corresponding entry in the worker log - is that normal? >> >> No, it's not normal. It might help to post the logs, but if there's a >> lot of noise from other things then they might not be terribly clear. >> There is a bug related to excessive numbers of segments (which I can't >> find in JIRA at the moment), but it looks very different in the log >> files. > > logs from the admin and worker nodes attached for the time in question > (18:00 on 4th jan to 10:00 on 5th jan). I see a fair number of these: matterhorn-admin | 2013-01-04 22:49:11 WARN (RemoteBase:155) - {GET http://matterhorn-presentation.uscs.susx.ac.uk/search/episode?admin=true&limit=-1&offset=-1=HTTP/1.1 405 Method Not Allowed} matterhorn-admin | 2013-01-04 22:49:11 WARN (SeriesUpdatedEventHandler$1:275) - Unable to find mediapackages in search: which says to me there's something wrong with the presentation node (different version maybe?), although this should not present you with the problems you are seeing. matterhorn-admin | 2013-01-04 22:49:49 INFO (WorkflowServiceImpl:772) - Workflow state for Workflow {185939} was changed to 'PAUSED' from the outside That might account for the paused workflows, and is actually a bug reported at https://opencast.jira.com/browse/MH-9350. Other than that I don't really see anything wrong in the logs, aside from all the premature end of file issues. >>> [snip] >>> >>> i'd appreciate any light anyone can shed on any of this! >>> >>> if more logs would be helpful let me know and i'll upload them >>> somewhere. >> >> While I don't know what's going on with the errors above, the error >> below says to me that the ingested mediapackages you are receiving from >> your CAs are damaged. Any chance we could get the manifest.xml file the >> core is receiving? > > not sure where to find a manifest.xml - can't see anything obvious - let > me know where to look and i'll grab one. also included in the attached > is a dublincore.xml i grabbed from the device before it got ingested in > case that is of use (ignore the silly length - my colleague was trying > to schedule a 5 min recording but slipped and made it 5 hours by mistake!)? The manifest file is generated before/during ingest, depending on which version of the core the ECD is talking to. If you're dealing with a 1.3 or newer core then the file is only ever written to RAM, which presents a problem recovering it from outside the device! I'm unsure if the ingest REST endpoints print out the mediapackage at TRACE level debugging, but that might work? If not that should be easy to add (or just attach a debugger if you are comfortable with that ;)). G > many thanks for taking a look at this, > > paul. > > > > >> G >> >>> just noticed there also appear to be some of these entries in the admin >>> log normally just after starting an encoding job: >>> >>> matterhorn-admin | 2013-01-04 20:04:01 WARN (IngestRestService:584) - >>> Premature end of file. >>> org.opencastproject.mediapackage.MediaPackageException: Premature end of >>> file. >>> at >>> org.opencastproject.mediapackage.MediaPackageImpl.valueOf(MediaPackageImpl.java:1431) >>> >>> >>> at >>> org.opencastproject.mediapackage.MediaPackageBuilderImpl.loadFromXml(MediaPackageBuilderImpl.java:120) >>> >>> >>> at >>> org.opencastproject.mediapackage.MediaPackageBuilderImpl.loadFromXml(MediaPackageBuilderImpl.java:148) >>> >>> >>> at >>> org.opencastproject.ingest.endpoint.IngestRestService.ingest(IngestRestService.java:578) >>> >>> >>> at sun.reflect.GeneratedMethodAccessor175.invoke(Unknown >>> Source) >>> at >>> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) >>> >>> >>> at java.lang.reflect.Method.invoke(Method.java:616) >>> at >>> org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:173) >>> >>> >>> at >>> org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:89) >>> >>> >>> at >>> org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:133) >>> at >>> org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:82) >>> at >>> org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:58) >>> >>> >>> at >>> java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) >>> at >>> java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334) >>> at java.util.concurrent.FutureTask.run(FutureTask.java:166) >>> at >>> org.apache.cxf.workqueue.SynchronousExecutor.execute(SynchronousExecutor.java:37) >>> >>> >>> at >>> org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:106) >>> >>> >>> at >>> org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:243) >>> >>> >>> at >>> org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:110) >>> >>> >>> at >>> org.apache.cxf.transport.servlet.ServletDestination.invoke(ServletDestination.java:98) >>> >>> >>> at >>> org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:423) >>> >>> >>> at >>> org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:139) >>> >>> >>> at >>> org.apache.cxf.transport.servlet.AbstractCXFServlet.invoke(AbstractCXFServlet.java:142) >>> >>> >>> at >>> org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:179) >>> >>> >>> at >>> org.apache.cxf.transport.servlet.AbstractHTTPServlet.doPost(AbstractHTTPServlet.java:103) >>> >>> >>> at javax.servlet.http.HttpServlet.service(HttpServlet.java:727) >>> at >>> org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:159) >>> >>> >>> at >>> org.apache.felix.http.base.internal.handler.ServletHandler.doHandle(ServletHandler.java:91) >>> >>> >>> at >>> org.apache.felix.http.base.internal.handler.ServletHandler.handle(ServletHandler.java:77) >>> >>> >>> at >>> org.apache.felix.http.base.internal.dispatch.ServletPipeline.handle(ServletPipeline.java:42) >>> >>> >>> at >>> org.apache.felix.http.base.internal.dispatch.InvocationFilterChain.doFilter(InvocationFilterChain.java:49) >>> >>> >>> at >>> org.apache.felix.http.base.internal.dispatch.HttpFilterChain.doFilter(HttpFilterChain.java:33) >>> >>> >>> at >>> org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:343) >>> >>> >>> at >>> org.springframework.security.web.access.intercept.FilterSecurityInterceptor.invoke(FilterSecurityInterceptor.java:109) >>> >>> >>> at >>> org.springframework.security.web.access.intercept.FilterSecurityInterceptor.doFilter(FilterSecurityInterceptor.java:83) >>> >>> >>> at >>> org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:355) >>> >>> >>> at >>> org.springframework.security.web.access.ExceptionTranslationFilter.doFilter(ExceptionTranslationFilter.java:97) >>> >>> >>> at >>> org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:355) >>> >>> >>> at >>> org.springframework.security.web.session.SessionManagementFilter.doFilter(SessionManagementFilter.java:100) >>> >>> >>> at >>> org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:355) >>> >>> >>> at >>> org.springframework.security.web.authentication.AnonymousAuthenticationFilter.doFilter(AnonymousAuthenticationFilter.java:78) >>> >>> >>> at >>> org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:355) >>> >>> >>> at >>> org.springframework.security.web.authentication.rememberme.RememberMeAuthenticationFilter.doFilter(RememberMeAuthenticationFilter >>> >>> >>> .java:119) >>> at >>> org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:355) >>> >>> >>> at >>> org.springframework.security.web.servletapi.SecurityContextHolderAwareRequestFilter.doFilter(SecurityContextHolderAwareRequestFil >>> >>> >>> ter.java:54) >>> at >>> org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:355) >>> >>> >>> at >>> org.springframework.security.web.savedrequest.RequestCacheAwareFilter.doFilter(RequestCacheAwareFilter.java:35) >>> >>> >>> at >>> org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:355) >>> >>> >>> at >>> org.springframework.security.oauth.provider.OAuthProviderProcessingFilter.doFilter(OAuthProviderProcessingFilter.java:173) >>> >>> >>> at >>> org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:355) >>> >>> >>> at >>> org.springframework.security.web.authentication.www.DigestAuthenticationFilter.doFilter(DigestAuthenticationFilter.java:319) >>> >>> >>> at >>> org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:355) >>> >>> >>> at >>> org.springframework.security.web.authentication.ui.DefaultLoginPageGeneratingFilter.doFilter(DefaultLoginPageGeneratingFilter.java:90) >>> >>> >>> at >>> org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:355) >>> >>> >>> at >>> org.springframework.security.web.authentication.AbstractAuthenticationProcessingFilter.doFilter(AbstractAuthenticationProcessingFilter.java:188) >>> >>> >>> at >>> org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:355) >>> >>> >>> at >>> org.springframework.security.web.authentication.AbstractAuthenticationProcessingFilter.doFilter(AbstractAuthenticationProcessingFilter.java:188) >>> >>> >>> at >>> org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:355) >>> >>> >>> at >>> org.springframework.security.web.authentication.logout.LogoutFilter.doFilter(LogoutFilter.java:105) >>> >>> >>> at >>> org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:355) >>> >>> >>> at >>> org.springframework.security.web.context.SecurityContextPersistenceFilter.doFilter(SecurityContextPersistenceFilter.java:79) >>> >>> >>> at >>> org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:355) >>> >>> >>> at >>> org.springframework.security.web.FilterChainProxy.doFilter(FilterChainProxy.java:149) >>> >>> >>> at >>> org.opencastproject.kernel.security.SecurityFilter.doFilter(SecurityFilter.java:115) >>> >>> >>> at >>> org.apache.felix.http.base.internal.handler.FilterHandler.doHandle(FilterHandler.java:80) >>> >>> >>> at >>> org.apache.felix.http.base.internal.handler.FilterHandler.handle(FilterHandler.java:68) >>> >>> >>> at >>> org.apache.felix.http.base.internal.dispatch.InvocationFilterChain.doFilter(InvocationFilterChain.java:47) >>> >>> >>> at >>> org.apache.felix.http.base.internal.dispatch.HttpFilterChain.doFilter(HttpFilterChain.java:33) >>> >>> >>> at >>> org.opencastproject.kernel.security.OrganizationFilter.doFilter(OrganizationFilter.java:111) >>> >>> >>> at >>> org.apache.felix.http.base.internal.handler.FilterHandler.doHandle(FilterHandler.java:80) >>> >>> >>> at >>> org.apache.felix.http.base.internal.handler.FilterHandler.handle(FilterHandler.java:68) >>> >>> >>> at >>> org.apache.felix.http.base.internal.dispatch.InvocationFilterChain.doFilter(InvocationFilterChain.java:47) >>> >>> >>> at >>> org.apache.felix.http.base.internal.dispatch.HttpFilterChain.doFilter(HttpFilterChain.java:33) >>> >>> >>> at >>> org.opencastproject.kernel.rest.JsonpFilter.doFilter(JsonpFilter.java:106) >>> >>> at >>> org.apache.felix.http.base.internal.handler.FilterHandler.doHandle(FilterHandler.java:80) >>> >>> >>> at >>> org.apache.felix.http.base.internal.handler.FilterHandler.handle(FilterHandler.java:68) >>> >>> >>> at >>> org.apache.felix.http.base.internal.dispatch.InvocationFilterChain.doFilter(InvocationFilterChain.java:47) >>> >>> >>> at >>> org.apache.felix.http.base.internal.dispatch.HttpFilterChain.doFilter(HttpFilterChain.java:33) >>> >>> >>> at >>> org.opencastproject.kernel.rest.CleanSessionsFilter.doFilter(CleanSessionsFilter.java:82) >>> >>> >>> at >>> org.apache.felix.http.base.internal.handler.FilterHandler.doHandle(FilterHandler.java:80) >>> >>> >>> at >>> org.apache.felix.http.base.internal.handler.FilterHandler.handle(FilterHandler.java:68) >>> >>> >>> at >>> org.apache.felix.http.base.internal.dispatch.InvocationFilterChain.doFilter(InvocationFilterChain.java:47) >>> >>> >>> at >>> org.apache.felix.http.base.internal.dispatch.HttpFilterChain.doFilter(HttpFilterChain.java:33) >>> >>> >>> at >>> org.apache.felix.http.base.internal.dispatch.FilterPipeline.dispatch(FilterPipeline.java:48) >>> >>> >>> at >>> org.apache.felix.http.base.internal.dispatch.Dispatcher.dispatch(Dispatcher.java:39) >>> >>> >>> at >>> org.apache.felix.http.base.internal.DispatcherServlet.service(DispatcherServlet.java:55) >>> >>> >>> at javax.servlet.http.HttpServlet.service(HttpServlet.java:820) >>> at >>> org.mortbay.jetty.servlet.ServletHolder.handle(ServletHolder.java:511) >>> at >>> org.mortbay.jetty.servlet.ServletHandler.handle(ServletHandler.java:390) >>> at >>> org.mortbay.jetty.servlet.SessionHandler.handle(SessionHandler.java:182) >>> at >>> org.mortbay.jetty.handler.ContextHandler.handle(ContextHandler.java:765) >>> at >>> org.mortbay.jetty.handler.HandlerWrapper.handle(HandlerWrapper.java:152) >>> at org.mortbay.jetty.Server.handle(Server.java:326) >>> at >>> org.mortbay.jetty.HttpConnection.handleRequest(HttpConnection.java:536) >>> at >>> org.mortbay.jetty.HttpConnection$RequestHandler.content(HttpConnection.java:930) >>> >>> >>> at org.mortbay.jetty.HttpParser.parseNext(HttpParser.java:747) >>> at >>> org.mortbay.jetty.HttpParser.parseAvailable(HttpParser.java:218) >>> at >>> org.mortbay.jetty.HttpConnection.handle(HttpConnection.java:405) >>> at >>> org.mortbay.io.nio.SelectChannelEndPoint.run(SelectChannelEndPoint.java:409) >>> >>> >>> at >>> org.mortbay.thread.QueuedThreadPool$PoolThread.run(QueuedThreadPool.java:582) >>> >>> >>> Caused by: org.xml.sax.SAXParseException; lineNumber: 1; columnNumber: >>> 1; Premature end of file. >>> at >>> com.sun.org.apache.xerces.internal.util.ErrorHandlerWrapper.createSAXParseException(ErrorHandlerWrapper.java:198) >>> >>> >>> at >>> com.sun.org.apache.xerces.internal.util.ErrorHandlerWrapper.fatalError(ErrorHandlerWrapper.java:177) >>> >>> >>> at >>> com.sun.org.apache.xerces.internal.impl.XMLErrorReporter.reportError(XMLErrorReporter.java:391) >>> >>> >>> at >>> com.sun.org.apache.xerces.internal.impl.XMLScanner.reportFatalError(XMLScanner.java:1404) >>> >>> >>> at >>> com.sun.org.apache.xerces.internal.impl.XMLDocumentScannerImpl$PrologDriver.next(XMLDocumentScannerImpl.java:1034) >>> >>> >>> at >>> com.sun.org.apache.xerces.internal.impl.XMLDocumentScannerImpl.next(XMLDocumentScannerImpl.java:625) >>> >>> >>> at >>> com.sun.org.apache.xerces.internal.impl.XMLNSDocumentScannerImpl.next(XMLNSDocumentScannerImpl.java:116) >>> >>> >>> at >>> com.sun.org.apache.xerces.internal.impl.XMLDocumentFragmentScannerImpl.scanDocument(XMLDocumentFragmentScannerImpl.java:488) >>> >>> >>> at >>> com.sun.org.apache.xerces.internal.parsers.XML11Configuration.parse(XML11Configuration.java:819) >>> >>> >>> at >>> com.sun.org.apache.xerces.internal.parsers.XML11Configuration.parse(XML11Configuration.java:748) >>> >>> >>> at >>> com.sun.org.apache.xerces.internal.parsers.XMLParser.parse(XMLParser.java:123) >>> >>> >>> at >>> com.sun.org.apache.xerces.internal.parsers.AbstractSAXParser.parse(AbstractSAXParser.java:1208) >>> >>> >>> at >>> com.sun.org.apache.xerces.internal.jaxp.SAXParserImpl$JAXPSAXParser.parse(SAXParserImpl.java:525) >>> >>> >>> at >>> com.sun.xml.bind.v2.runtime.unmarshaller.UnmarshallerImpl.unmarshal0(UnmarshallerImpl.java:211) >>> >>> >>> at >>> com.sun.xml.bind.v2.runtime.unmarshaller.UnmarshallerImpl.unmarshal(UnmarshallerImpl.java:190) >>> >>> >>> at >>> com.sun.xml.bind.v2.runtime.unmarshaller.UnmarshallerImpl.unmarshal(UnmarshallerImpl.java:241) >>> >>> >>> at >>> org.opencastproject.mediapackage.MediaPackageImpl.valueOf(MediaPackageImpl.java:1429) >>> >>> >>> ... 99 more >>> >>> >>> thanks, >>> >>> paul. >>> >> >> >> >> >> _______________________________________________ >> Matterhorn-users mailing list >> [email protected] >> http://lists.opencastproject.org/mailman/listinfo/matterhorn-users >> > > > > > _______________________________________________ > Matterhorn-users mailing list > [email protected] > http://lists.opencastproject.org/mailman/listinfo/matterhorn-users >
signature.asc
Description: OpenPGP digital signature
_______________________________________________ Matterhorn-users mailing list [email protected] http://lists.opencastproject.org/mailman/listinfo/matterhorn-users
