I get many different "error 503" deploy errors every day. This is causing me no end of headaches, and I'm finding it extremely difficult to debug the cause of these errors. (sometimes they are "error 500", sometimes 503, but they're unpredictable and random)
Here is an example from today. The build was running fine (for several hours) and then maven errored out, reporting that the deploy failed with a 503 error. The artifact (I've changed the name to "artifact-version.jar" below) seemed to deploy fine in thread 1272, but the garbage collector thread (1267) is having all kinds of issues, and I think that was causing the problem. Does anyone have any suggestions? This has been an issue for months and I've had many attempts at fixing it, and right now my main suggestion to solve the problem has been "nexus". Thanks, Dana Lacoste 2010-01-04 16:15:05,998 [TP-Processor44] [INFO ] (o.a.r.HttpRepo :164) - external-repo1: Retrieving 'http://repo1.maven.org/maven2/maven-plugins/maven-jaxb-plugin/1.1.0/maven-jaxb-plugin-1.1.0.pom.sha1'... 2010-01-04 16:15:06,033 [TP-Processor44] [INFO ] (o.a.r.HttpRepo :164) - external-repo1: Retrieving 'http://repo1.maven.org/maven2/maven-plugins/maven-jaxb-plugin/1.1.0/maven-jaxb-plugin-1.1.0.pom.md5'... 2010-01-04 16:15:06,035 [TP-Processor44] [WARN ] (o.a.j.f.JcrFsItem :355) - Could not brute force delete node: javax.jcr.PathNotFoundException: /repositories/external-repo1-cache/maven-plugins/maven-jaxb-plugin/1.1.0/maven-jaxb-plugin-1.1.0.pom 2010-01-04 16:28:52,136 [pool-1-thread-1267] [INFO ] (o.a.j.j.ArtifactoryDbDataStoreImpl:112) - The cache folder contains 2422 files for a total of 2925322338 bytes which is above the maximum 1073741824 allowed. Deleting cached files. 2010-01-04 16:28:54,413 [pool-1-thread-1269] [INFO ] (o.a.s.a.ArchiveIndexer:91) - The content of the archive: 'maven-dependency-plugin-2.0-ALPHA-1-SNAPSHOT.jar' was indexed successfully 2010-01-04 16:28:57,536 [pool-1-thread-1272] [INFO ] (o.a.s.a.ArchiveIndexer:91) - The content of the archive: 'artifact-version.jar' was indexed successfully 2010-01-04 16:29:24,113 [pool-1-thread-1267] [INFO ] (o.a.j.j.ArtifactoryDbDataStoreImpl:127) - GC deleted 1400 cached files to save 1851601654 bytes 2010-01-04 16:29:52,447 [pool-1-thread-1267] [WARN ] (o.a.j.j.ArtifactoryDbGarbageCollector:423) - Repository access error during read of garbage collection javax.jcr.ItemNotFoundException: failed to build path of 392ff491-fa4f-4bd8-b104-f074e6670f83: 2c1769b8-8685-476a-bebb-3e9737c46b12 at org.apache.jackrabbit.core.HierarchyManagerImpl.getPath(HierarchyManagerImpl.java:398) [jackrabbit-core-jfrog-1.5.7b.jar:na] at org.apache.jackrabbit.core.CachingHierarchyManager.getPath(CachingHierarchyManager.java:229) [jackrabbit-core-jfrog-1.5.7b.jar:na] at org.apache.jackrabbit.core.ItemImpl.getPrimaryPath(ItemImpl.java:213) [jackrabbit-core-jfrog-1.5.7b.jar:na] at org.apache.jackrabbit.core.NodeImpl.getPrimaryPath(NodeImpl.java:3240) [jackrabbit-core-jfrog-1.5.7b.jar:na] at org.apache.jackrabbit.core.ItemImpl.getPath(ItemImpl.java:1271) [jackrabbit-core-jfrog-1.5.7b.jar:na] at org.artifactory.jcr.jackrabbit.ArtifactoryDbGarbageCollector.binarySize(ArtifactoryDbGarbageCollector.java:387) [artifactory-core-2.1.2.jar:na] at org.artifactory.jcr.jackrabbit.ArtifactoryDbGarbageCollector.access$300(ArtifactoryDbGarbageCollector.java:72) [artifactory-core-2.1.2.jar:na] at org.artifactory.jcr.jackrabbit.ArtifactoryDbGarbageCollector$SessionWrapper.markActiveJcrDataNodes(ArtifactoryDbGarbageCollector.java:269) [artifactory-core-2.1.2.jar:na] at org.artifactory.jcr.jackrabbit.ArtifactoryDbGarbageCollector.scanningSessionList(ArtifactoryDbGarbageCollector.java:176) [artifactory-core-2.1.2.jar:na] at org.artifactory.jcr.jackrabbit.ArtifactoryDbGarbageCollector.scan(ArtifactoryDbGarbageCollector.java:158) [artifactory-core-2.1.2.jar:na] at org.artifactory.jcr.JcrServiceImpl.garbageCollect(JcrServiceImpl.java:851) [artifactory-core-2.1.2.jar:na] at sun.reflect.GeneratedMethodAccessor332.invoke(Unknown Source) [na:na] at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25) [na:1.6.0_16] at java.lang.reflect.Method.invoke(Method.java:597) [na:1.6.0_16] at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:307) [spring-aop-2.5.6.jar:2.5.6] at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:198) [spring-aop-2.5.6.jar:2.5.6] at $Proxy16.garbageCollect(Unknown Source) [na:na] at org.artifactory.jcr.schedule.JcrGarbageCollectorJob.onExecute(JcrGarbageCollectorJob.java:33) [artifactory-core-2.1.2.jar:na] at org.artifactory.jcr.schedule.JcrGarbageCollectorJob.onExecute(JcrGarbageCollectorJob.java:29) [artifactory-core-2.1.2.jar:na] at org.artifactory.schedule.quartz.QuartzCommand.execute(QuartzCommand.java:43) [artifactory-core-2.1.2.jar:na] at org.quartz.core.JobRunShell.run(JobRunShell.java:202) [quartz-1.6.3.jar:1.6.3] at org.artifactory.schedule.CachedThreadPoolTaskExecutor$RunnableWrapper.run(CachedThreadPoolTaskExecutor.java:65) [artifactory-core-2.1.2.jar:na] at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:886) [na:1.6.0_16] at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:908) [na:1.6.0_16] at java.lang.Thread.run(Thread.java:619) [na:1.6.0_16] Caused by: org.apache.jackrabbit.core.state.NoSuchItemStateException: 2c1769b8-8685-476a-bebb-3e9737c46b12 at org.apache.jackrabbit.core.state.SessionItemStateManager.getItemState(SessionItemStateManager.java:202) [jackrabbit-core-jfrog-1.5.7b.jar:na] at org.apache.jackrabbit.core.HierarchyManagerImpl.getItemState(HierarchyManagerImpl.java:150) [jackrabbit-core-jfrog-1.5.7b.jar:na] at org.apache.jackrabbit.core.HierarchyManagerImpl.buildPath(HierarchyManagerImpl.java:276) [jackrabbit-core-jfrog-1.5.7b.jar:na] at org.apache.jackrabbit.core.CachingHierarchyManager.buildPath(CachingHierarchyManager.java:195) [jackrabbit-core-jfrog-1.5.7b.jar:na] at org.apache.jackrabbit.core.HierarchyManagerImpl.buildPath(HierarchyManagerImpl.java:278) [jackrabbit-core-jfrog-1.5.7b.jar:na] at org.apache.jackrabbit.core.CachingHierarchyManager.buildPath(CachingHierarchyManager.java:195) [jackrabbit-core-jfrog-1.5.7b.jar:na] at org.apache.jackrabbit.core.HierarchyManagerImpl.getPath(HierarchyManagerImpl.java:393) [jackrabbit-core-jfrog-1.5.7b.jar:na] ... 24 common frames omitted 2010-01-04 16:29:52,461 [pool-1-thread-1267] [ERROR] (o.a.j.JcrServiceImpl:866) - Datastore garbage collector execution failed. javax.jcr.ItemNotFoundException: failed to build path of 392ff491-fa4f-4bd8-b104-f074e6670f83: 2c1769b8-8685-476a-bebb-3e9737c46b12 at org.apache.jackrabbit.core.HierarchyManagerImpl.getPath(HierarchyManagerImpl.java:398) [jackrabbit-core-jfrog-1.5.7b.jar:na] at org.apache.jackrabbit.core.CachingHierarchyManager.getPath(CachingHierarchyManager.java:229) [jackrabbit-core-jfrog-1.5.7b.jar:na] at org.apache.jackrabbit.core.ItemImpl.getPrimaryPath(ItemImpl.java:213) [jackrabbit-core-jfrog-1.5.7b.jar:na] at org.apache.jackrabbit.core.NodeImpl.getPrimaryPath(NodeImpl.java:3240) [jackrabbit-core-jfrog-1.5.7b.jar:na] at org.apache.jackrabbit.core.ItemImpl.getPath(ItemImpl.java:1271) [jackrabbit-core-jfrog-1.5.7b.jar:na] at org.artifactory.jcr.jackrabbit.ArtifactoryDbGarbageCollector.binarySize(ArtifactoryDbGarbageCollector.java:387) [artifactory-core-2.1.2.jar:na] at org.artifactory.jcr.jackrabbit.ArtifactoryDbGarbageCollector.access$300(ArtifactoryDbGarbageCollector.java:72) [artifactory-core-2.1.2.jar:na] at org.artifactory.jcr.jackrabbit.ArtifactoryDbGarbageCollector$SessionWrapper.markActiveJcrDataNodes(ArtifactoryDbGarbageCollector.java:269) [artifactory-core-2.1.2.jar:na] at org.artifactory.jcr.jackrabbit.ArtifactoryDbGarbageCollector.scanningSessionList(ArtifactoryDbGarbageCollector.java:176) [artifactory-core-2.1.2.jar:na] at org.artifactory.jcr.jackrabbit.ArtifactoryDbGarbageCollector.scan(ArtifactoryDbGarbageCollector.java:158) [artifactory-core-2.1.2.jar:na] at org.artifactory.jcr.JcrServiceImpl.garbageCollect(JcrServiceImpl.java:851) [artifactory-core-2.1.2.jar:na] at sun.reflect.GeneratedMethodAccessor332.invoke(Unknown Source) [na:na] at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25) [na:1.6.0_16] at java.lang.reflect.Method.invoke(Method.java:597) [na:1.6.0_16] at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:307) [spring-aop-2.5.6.jar:2.5.6] at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:198) [spring-aop-2.5.6.jar:2.5.6] at $Proxy16.garbageCollect(Unknown Source) [na:na] at org.artifactory.jcr.schedule.JcrGarbageCollectorJob.onExecute(JcrGarbageCollectorJob.java:33) [artifactory-core-2.1.2.jar:na] at org.artifactory.jcr.schedule.JcrGarbageCollectorJob.onExecute(JcrGarbageCollectorJob.java:29) [artifactory-core-2.1.2.jar:na] at org.artifactory.schedule.quartz.QuartzCommand.execute(QuartzCommand.java:43) [artifactory-core-2.1.2.jar:na] at org.quartz.core.JobRunShell.run(JobRunShell.java:202) [quartz-1.6.3.jar:1.6.3] at org.artifactory.schedule.CachedThreadPoolTaskExecutor$RunnableWrapper.run(CachedThreadPoolTaskExecutor.java:65) [artifactory-core-2.1.2.jar:na] at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:886) [na:1.6.0_16] at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:908) [na:1.6.0_16] at java.lang.Thread.run(Thread.java:619) [na:1.6.0_16] Caused by: org.apache.jackrabbit.core.state.NoSuchItemStateException: 2c1769b8-8685-476a-bebb-3e9737c46b12 at org.apache.jackrabbit.core.state.SessionItemStateManager.getItemState(SessionItemStateManager.java:202) [jackrabbit-core-jfrog-1.5.7b.jar:na] at org.apache.jackrabbit.core.HierarchyManagerImpl.getItemState(HierarchyManagerImpl.java:150) [jackrabbit-core-jfrog-1.5.7b.jar:na] at org.apache.jackrabbit.core.HierarchyManagerImpl.buildPath(HierarchyManagerImpl.java:276) [jackrabbit-core-jfrog-1.5.7b.jar:na] at org.apache.jackrabbit.core.CachingHierarchyManager.buildPath(CachingHierarchyManager.java:195) [jackrabbit-core-jfrog-1.5.7b.jar:na] at org.apache.jackrabbit.core.HierarchyManagerImpl.buildPath(HierarchyManagerImpl.java:278) [jackrabbit-core-jfrog-1.5.7b.jar:na] at org.apache.jackrabbit.core.CachingHierarchyManager.buildPath(CachingHierarchyManager.java:195) [jackrabbit-core-jfrog-1.5.7b.jar:na] at org.apache.jackrabbit.core.HierarchyManagerImpl.getPath(HierarchyManagerImpl.java:393) [jackrabbit-core-jfrog-1.5.7b.jar:na] ... 24 common frames omitted
------------------------------------------------------------------------------ This SF.Net email is sponsored by the Verizon Developer Community Take advantage of Verizon's best-in-class app development support A streamlined, 14 day to market process makes app distribution fast and easy Join now and get one step closer to millions of Verizon customers http://p.sf.net/sfu/verizon-dev2dev
_______________________________________________ Artifactory-users mailing list [email protected] https://lists.sourceforge.net/lists/listinfo/artifactory-users
