I have attached the archiva.xml configuration as well.
-----Original Message-----
From: Jason Chaffee [mailto:[EMAIL PROTECTED]
Sent: Sunday, February 24, 2008 9:31 PM
To: archiva-users@maven.apache.org
Subject: RE: Archiva crashes after a couple of days
I forgot to mention that I get the NPE error with database scanning as
well. So, I have a lot of issues with the current release of Archiva
and I am really not do anything special with it...very basic
configuration.
-----Original Message-----
From: Jason Chaffee [mailto:[EMAIL PROTECTED]
Sent: Sunday, February 24, 2008 9:27 PM
To: archiva-users@maven.apache.org
Subject: RE: Archiva crashes after a couple of days
Again, this is using the default setup for the database and consumers
except that I added some extra file extensions to be indexed. They are
as follows:
* **/*.nar
* **/*.rpm
* **/*.bin
* **/*.xml (not sure if this was a default or not)
Yes, I am having the massive logs and errors from the invalid path bug
at the same time. They may be related. That is one of the main reasons
I would like to get a 1.0.2 release is to get the repo scanning fix for
invalid paths when there was nothing wrong with the paths in the first
place. We had a few thousand artifacts that would cause this error
though.
-----Original Message-----
From: Brett Porter [mailto:[EMAIL PROTECTED]
Sent: Sunday, February 24, 2008 7:55 PM
To: archiva-users@maven.apache.org
Subject: Re: Archiva crashes after a couple of days
also - is this in conjunction with exceptions in the logs? Maybe
something happens when those start to occur.
I ran some local profiling on an initial scan and sieging the WebDAV
URLs and wasn't able to generate any memory leaks on my current
dataset.
- Brett
On 25/02/2008, James William Dumay <[EMAIL PROTECTED]> wrote:
> We have a similar amount of data in our Archiva instance.
>
> Are you running Archiva on the internal derby database or another
dbms?
>
> Also, try turning off a few of the consumers and see if that helps -
> some of the consumers seem not to be handling large datasets
gracefully.
>
>
> James
>
>
>
> On Fri, 2008-02-22 at 16:39 -0800, Jason Chaffee wrote:
>
> > They are pretty big, both in number of artifacts and in size. Our
> > largest repo has around 75,000 artifacts in right now and the size
is
> > over 200 GB. This is a snapshot repo and we have many teams that
are
> > creating large installer artifacts that are basically uber
artifacts,
> > thus the size of these artifacts can be quite large.
> >
> > -----Original Message-----
> > From: Eric Miles [mailto:[EMAIL PROTECTED]
> > Sent: Friday, February 22, 2008 1:38 PM
> > To: archiva-users@maven.apache.org
> > Subject: RE: Archiva crashes after a couple of days
> >
> > We use:
> >
> > 0 30 2 * * ? - daily at 2:30 am
> > 0 30 * * * ? - every 30 mins
> >
> > The default out of the box shouldn't be an issue I wouldn't think.
How
> > large are your repos?
> >
> > Ours:
> > 344M jasper
> > 332K plugins
> > 203M proxied
> > 107M releases
> > 239M snapshots
> >
> >
> > On Fri, 2008-02-22 at 13:28 -0800, Jason Chaffee wrote:
> > > I am using the defaults, out of box expressions. So, it seems
those
> > too
> > > could be fine tuned.
> > >
> > > -----Original Message-----
> > > From: Brown, Carlton [mailto:[EMAIL PROTECTED]
> > > Sent: Friday, February 22, 2008 1:14 PM
> > > To: archiva-users@maven.apache.org
> > > Subject: RE: Archiva crashes after a couple of days
> > >
> > > > -----Original Message-----
> > > > From: Eric Miles [mailto:[EMAIL PROTECTED]
> > > > Sent: Friday, February 22, 2008 4:07 PM
> > > > To: archiva-users@maven.apache.org
> > > > Subject: RE: Archiva crashes after a couple of days
> > > >
> > > > I too had this same issue. Make sure your cron syntax is
correct as
> > > it
> > > > is not standard unix cron syntax. The first entry is a second
> > number,
> > > > not minutes. I initially (and accidentally) setup our cron
jobs to
> > > run
> > > > at a crazy pace, I think every second.
> > >
> > > Me three. I didn't see any reason not to scan every minute, but
in
> > fact
> > > it was every second. Result - massive log files, Archiva hung.
Did
> > not
> > > have to reinstall it, though.
> > >
> > > The cron setup would be a good candidate for improved input forms
> > and/or
> > > validation.
> > >
> > > -----------------------------------------
> > > ====================================================
> > > This message contains PRIVILEGED and CONFIDENTIAL
> > > information that is intended only for use by the
> > > named recipient. If you are not the named recipient,
> > > any disclosure, dissemination, or action based on
> > > the contents of this message is prohibited. In such
> > > case please notify us and destroy and delete all
> > > copies of this transmission. Thank you.
> > > ====================================================
>
>
--
Brett Porter
Blog: http://blogs.exist.com/bporter/
<?xml version="1.0" encoding="UTF-8"?>
<configuration>
<version>2</version>
<repositoryScanning>
<fileTypes>
<fileType>
<id>artifacts</id>
<patterns>
<pattern>**/*.bin</pattern>
<pattern>**/*.car</pattern>
<pattern>**/*.dtd</pattern>
<pattern>**/*.ear</pattern>
<pattern>**/*.jar</pattern>
<pattern>**/*.mar</pattern>
<pattern>**/*.nar</pattern>
<pattern>**/*.pom</pattern>
<pattern>**/*.rar</pattern>
<pattern>**/*.rpm</pattern>
<pattern>**/*.sar</pattern>
<pattern>**/*.tar.bz2</pattern>
<pattern>**/*.tar.gz</pattern>
<pattern>**/*.tld</pattern>
<pattern>**/*.war</pattern>
<pattern>**/*.xml</pattern>
<pattern>**/*.zip</pattern>
</patterns>
</fileType>
<fileType>
<id>auto-remove</id>
<patterns>
<pattern>**/*-</pattern>
<pattern>**/*.bak</pattern>
<pattern>**/*~</pattern>
</patterns>
</fileType>
<fileType>
<id>ignored</id>
<patterns>
<pattern>**/*.rb</pattern>
<pattern>**/*.sh</pattern>
<pattern>**/.DAV/**</pattern>
<pattern>**/.htaccess</pattern>
<pattern>**/.svn/**</pattern>
<pattern>**/KEYS</pattern>
</patterns>
</fileType>
<fileType>
<id>indexable-content</id>
<patterns>
<pattern>**/*.block</pattern>
<pattern>**/*.config</pattern>
<pattern>**/*.dtd</pattern>
<pattern>**/*.pom</pattern>
<pattern>**/*.tld</pattern>
<pattern>**/*.txt</pattern>
<pattern>**/*.TXT</pattern>
<pattern>**/*.xml</pattern>
<pattern>**/*.xsd</pattern>
</patterns>
</fileType>
</fileTypes>
<knownContentConsumers>
<knownContentConsumer>auto-remove</knownContentConsumer>
<knownContentConsumer>auto-rename</knownContentConsumer>
<knownContentConsumer>create-missing-checksums</knownContentConsumer>
<knownContentConsumer>index-content</knownContentConsumer>
<knownContentConsumer>metadata-updater</knownContentConsumer>
<knownContentConsumer>repository-purge</knownContentConsumer>
<knownContentConsumer>update-db-artifact</knownContentConsumer>
<knownContentConsumer>validate-checksums</knownContentConsumer>
</knownContentConsumers>
<invalidContentConsumers>
<invalidContentConsumer>update-db-bad-content</invalidContentConsumer>
</invalidContentConsumers>
</repositoryScanning>
<databaseScanning>
<cronExpression>0 15 * * * ?</cronExpression>
<unprocessedConsumers>
<unprocessedConsumer>index-archive-toc</unprocessedConsumer>
<unprocessedConsumer>index-artifact</unprocessedConsumer>
<unprocessedConsumer>index-public-methods</unprocessedConsumer>
<unprocessedConsumer>update-db-bytecode-stats</unprocessedConsumer>
<unprocessedConsumer>update-db-project</unprocessedConsumer>
<unprocessedConsumer>validate-repository-metadata</unprocessedConsumer>
</unprocessedConsumers>
<cleanupConsumers>
<cleanupConsumer>not-present-remove-db-artifact</cleanupConsumer>
<cleanupConsumer>not-present-remove-db-project</cleanupConsumer>
<cleanupConsumer>not-present-remove-indexed</cleanupConsumer>
</cleanupConsumers>
</databaseScanning>
<managedRepositories>
<managedRepository>
<location>/disk1/html/maven2-client</location>
<snapshots>true</snapshots>
<refreshCronExpression>0 0 4 * * ?</refreshCronExpression>
<daysOlder>0</daysOlder>
<deleteReleasedSnapshots>true</deleteReleasedSnapshots>
<id>tva.client</id>
<name>TVA Client Repository</name>
</managedRepository>
<managedRepository>
<location>/disk1/html/maven2</location>
<refreshCronExpression>0 0 3 * * ?</refreshCronExpression>
<retentionCount>20</retentionCount>
<id>tva.release</id>
<name>TVA Release Repository</name>
</managedRepository>
<managedRepository>
<location>/disk1/html/maven2-snapshot</location>
<snapshots>true</snapshots>
<refreshCronExpression>0 30 * * * ?</refreshCronExpression>
<retentionCount>10</retentionCount>
<daysOlder>0</daysOlder>
<deleteReleasedSnapshots>true</deleteReleasedSnapshots>
<id>tva.snapshot</id>
<name>TVA Snapshot Repository</name>
</managedRepository>
<managedRepository>
<location>/proxy/maven2</location>
<snapshots>true</snapshots>
<refreshCronExpression>0 10 * * * ?</refreshCronExpression>
<daysOlder>0</daysOlder>
<deleteReleasedSnapshots>true</deleteReleasedSnapshots>
<id>tva.proxy</id>
<name>TVA Proxy Repository</name>
</managedRepository>
</managedRepositories>
<remoteRepositories>
<remoteRepository>
<url>http://repo1.maven.org/maven2</url>
<id>central</id>
<name>Central Repository</name>
</remoteRepository>
<remoteRepository>
<url>http://download.java.net/maven/2/</url>
<id>maven2-repository.dev.java.net</id>
<name>Java.net Repository for Maven 2</name>
</remoteRepository>
<remoteRepository>
<url>http://people.apache.org/repo/m2-incubating-repository/</url>
<id>apache.incubating</id>
<name>Apache Incubating Repository</name>
</remoteRepository>
<remoteRepository>
<url>http://people.apache.org/repo/m2-snapshot-repository/</url>
<id>apache.snapshot</id>
<name>Apache Snapshot Repository</name>
</remoteRepository>
<remoteRepository>
<url>http://repository.codehaus.org/</url>
<id>codehaus</id>
<name>Codehaus Repository</name>
</remoteRepository>
<remoteRepository>
<url>http://snapshots.repository.codehaus.org/</url>
<id>codehaus.snapshot</id>
<name>Codehaus Snapshot Repository</name>
</remoteRepository>
<remoteRepository>
<url>http://java.freehep.org/maven2/</url>
<id>freehep</id>
<name>FreeHEP Maven Repository</name>
</remoteRepository>
<remoteRepository>
<url>http://download.java.net/maven/1/</url>
<id>maven1-repository.dev.java.net</id>
<name>Java.net Maven 1 Repository</name>
<layout>legacy</layout>
</remoteRepository>
<remoteRepository>
<url>http://repository.jboss.com/maven2/</url>
<username/>
<password/>
<id>jboss</id>
<name>JBoss Repository</name>
</remoteRepository>
</remoteRepositories>
<proxyConnectors>
<proxyConnector>
<order>1</order>
<sourceRepoId>tva.proxy</sourceRepoId>
<targetRepoId>central</targetRepoId>
<proxyId>(direct connection)</proxyId>
<policies>
<releases>always</releases>
<snapshots>never</snapshots>
<checksum>fix</checksum>
<cache-failures>no</cache-failures>
</policies>
</proxyConnector>
<proxyConnector>
<order>2</order>
<sourceRepoId>tva.proxy</sourceRepoId>
<targetRepoId>maven1-repository.dev.java.net</targetRepoId>
<proxyId>(direct connection)</proxyId>
<policies>
<releases>always</releases>
<checksum>fix</checksum>
<snapshots>never</snapshots>
<cache-failures>no</cache-failures>
</policies>
</proxyConnector>
<proxyConnector>
<order>3</order>
<sourceRepoId>tva.proxy</sourceRepoId>
<targetRepoId>maven2-repository.dev.java.net</targetRepoId>
<proxyId>(direct connection)</proxyId>
<policies>
<releases>always</releases>
<snapshots>never</snapshots>
<checksum>fix</checksum>
<cache-failures>no</cache-failures>
</policies>
</proxyConnector>
<proxyConnector>
<order>4</order>
<sourceRepoId>tva.proxy</sourceRepoId>
<targetRepoId>codehaus</targetRepoId>
<proxyId>(direct connection)</proxyId>
<policies>
<releases>always</releases>
<snapshots>never</snapshots>
<checksum>fix</checksum>
<cache-failures>no</cache-failures>
</policies>
</proxyConnector>
<proxyConnector>
<order>5</order>
<sourceRepoId>tva.proxy</sourceRepoId>
<targetRepoId>apache.incubating</targetRepoId>
<proxyId>(direct connection)</proxyId>
<policies>
<releases>always</releases>
<snapshots>never</snapshots>
<checksum>fix</checksum>
<cache-failures>no</cache-failures>
</policies>
</proxyConnector>
<proxyConnector>
<order>6</order>
<sourceRepoId>tva.proxy</sourceRepoId>
<targetRepoId>jboss</targetRepoId>
<proxyId>(direct connection)</proxyId>
<policies>
<releases>always</releases>
<snapshots>never</snapshots>
<checksum>fix</checksum>
<cache-failures>no</cache-failures>
</policies>
</proxyConnector>
<proxyConnector>
<order>7</order>
<sourceRepoId>tva.proxy</sourceRepoId>
<targetRepoId>freehep</targetRepoId>
<proxyId>(direct connection)</proxyId>
<policies>
<releases>always</releases>
<snapshots>never</snapshots>
<checksum>fix</checksum>
<cache-failures>no</cache-failures>
</policies>
</proxyConnector>
</proxyConnectors>
<legacyArtifactPaths>
<legacyArtifactPath>
<path>jaxen/jars/jaxen-1.0-FCS-full.jar</path>
<artifact>jaxen:jaxen:1.0-FCS:full:jar</artifact>
</legacyArtifactPath>
</legacyArtifactPaths>
</configuration>
