Is the "merged index" virtual path/location for repository groups configurable somehow to use ".index" instead? I don't see it in the UI, but maybe there is a nifty setting in archiva.xml I could set.
On Wed, Feb 6, 2013 at 11:03 AM, Jeff <[email protected]> wrote: > Yay! I like configurable! > > I noticed that in my remote repository folders that the index directory is > ".index" which differs from the default of .indexer for local repos. Are > the index folders in the "remotes" directory provided as part of the > "merged" index? > > I am using a repository group as well and thus assume the "merged index" > is supported, but when I go to the repo group url such as > http://archiva/repository/myrepogroup/.indexer, it seems to just hang. > > (I'm getting a brain cramp trying to resolve all of the index stuff in my > head.) > > Thanks for your efforts and help and I anxiously await 1.4-M4 :-). > > > On Wed, Feb 6, 2013 at 10:40 AM, Olivier Lamy <[email protected]> wrote: > >> 2013/2/6 Olivier Lamy <[email protected]>: >> > The issue I have is that will break backward compat. >> > Create an issue in jira to see others reactions. >> > Note: >> http://archiva.apache.org/docs/1.4-M4-SNAPSHOT/userguide/virtual-repositories.html >> > section "Merged index". >> > I know people using that (including my current company). >> > BTW I agree that will be more following a "de facto" standard. >> NOTE we can that make configurable :-) >> > >> > 2013/2/6 Jeff <[email protected]>: >> >> Also, would there be value in Archiva changing the default to .index >> >> instead of .indexer since .index seems to be the standard used for >> index >> >> downloads by clients? >> >> >> >> >> >> On Wed, Feb 6, 2013 at 8:54 AM, Jeff <[email protected]> wrote: >> >> >> >>> Thanks Olivier! I will set an absolute directory. >> >>> >> >>> On a side note as per previous discussion, I have an NFS mount for the >> >>> archiva data folder that is symlinked. >> >>> >> >>> NFS: /mnt/archiva-remote >> >>> >> >>> ARCHIVA: /archiva/data --> /mnt/archiva-remote >> >>> >> >>> When I set my repository folder via the Archiva UI to something like: >> >>> >> >>> /archiva/data/repositories/cms-releases >> >>> >> >>> After I save and then refresh the UI, the value for the repository >> gets >> >>> changed to: >> >>> >> >>> /mnt/archiva-remote/repositories/cms-releases >> >>> >> >>> While this still works, it makes it difficult to move or relocate the >> >>> share. Recently we had to create a bigger share (we now have 4TB) on >> >>> another system to which we mounted at a different mount point, to >> which we >> >>> copied the data files from the old share and then switched the >> symlink, but >> >>> it broke the repositories because the directories were pointing to >> the old >> >>> NFS mount. Something to look at anyway. >> >>> >> >>> When is 1.4-M4 scheduled? >> >>> >> >>> >> >>> On Wed, Feb 6, 2013 at 4:15 AM, Olivier Lamy <[email protected]> >> wrote: >> >>> >> >>>> in trunk. >> >>>> if blank .indexer directory is created in the repository directory. >> >>>> I agree "Index Directory" is a bit confusing option. >> >>>> As this doesn't work really if you configure something outside of the >> >>>> top of your repository directory. >> >>>> Furthermore I have noticed changing the value it's not dynamic (need >> a >> >>>> restart). >> >>>> So I will try to fix that. >> >>>> Currently what you can do is adding a value with a directory inside >> >>>> your repository directory. >> >>>> If repository use /home/archiva/repo/mygreat-repo >> >>>> use /home/archiva/repo/mygreat-repo/.indexer >> >>>> I will try to fix that in trunk (or at least improve documentation ! >> ) >> >>>> 2013/2/6 Olivier Lamy <[email protected]>: >> >>>> > Hi, >> >>>> > Apologize for delay. >> >>>> > >> >>>> > 2013/2/4 Jeff <[email protected]>: >> >>>> >> I'm now trying to switch up the index directories on my >> repositories >> >>>> and am >> >>>> >> banging my head. I've simply removed the "Index Directory" >> setting on >> >>>> my >> >>>> >> repos and I see the .indexer folder getting created. Which is >> good. >> >>>> >> >> >>>> >> However, according to >> >>>> >> >> http://archiva.apache.org/docs/1.4-M3/adminguide/repositories.html, it >> >>>> >> states: >> >>>> >> >> >>>> >> *Another directory named .index is also created at the root of the >> >>>> >> repository directory. This is not configurable though as it >> contains >> >>>> the >> >>>> >> packaged/bundled index which is consumed by different consumers >> of the >> >>>> >> index such as M2Eclipse. * >> >>>> > doh documentation is wrong (we use .indexer) >> >>>> >> >> >>>> >> >> >>>> >> However, it is NOT getting created. I've restarted tomcat, I've >> >>>> forced a >> >>>> >> full index scan on every repository as well as a Directory scan. >> >>>> >> >> >>>> >> The above statement also lead me to believe that regardless of the >> >>>> location >> >>>> >> of ".indexer" that ".index" would still get created at the root >> but it >> >>>> >> isn't. >> >>>> >> >> >>>> >> On one repository I tried setting "Index Directory" to ".index", >> but I >> >>>> get >> >>>> >> an error that it can't create "/usr/share/tomcat6/.index". >> >>>> > A bit weird. >> >>>> > What is -Dappserver.base value ? >> >>>> > BTW I agree there are some possible with relative path (I fixed >> some in >> >>>> trunk). >> >>>> > But while studying your case, I think this need more >> >>>> attention/debugging. >> >>>> > I'm on it. I will keep you informed as soon I have fixed (or at >> least >> >>>> > understood the issue :-)) that in source code. >> >>>> >> >> >>>> >> Thanks for any additional direction... >> >>>> >> >> >>>> >> >> >>>> >> On Mon, Feb 4, 2013 at 8:47 AM, Jeff <[email protected]> >> wrote: >> >>>> >> >> >>>> >>> I don't *yet* have a need, but our user base is growing and so >> is our >> >>>> >>> CI/CD pipeline (number of GO and Jenkins build agents/slaves) >> and I >> >>>> wanted >> >>>> >>> to plan ahead. I am trying to find the document that talked >> about >> >>>> keeping >> >>>> >>> indexes local while allowing a shared repo, but I have been >> >>>> unsuccessful >> >>>> >>> thus far. Maybe I dreamed it up. :-) >> >>>> >>> >> >>>> >>> Thanks for your help. >> >>>> >>> >> >>>> >>> >> >>>> >>> On Mon, Feb 4, 2013 at 2:56 AM, Olivier Lamy <[email protected]> >> >>>> wrote: >> >>>> >>> >> >>>> >>>> complicated to have scabality when serving files :-( >> >>>> >>>> we don't (yet) any sync possible (that's something we start >> >>>> discussing >> >>>> >>>> on dev@ with maybe using new Apache project called helix). >> >>>> >>>> With your setup each repository will be independent. >> >>>> >>>> Do you have so many users to need that ? >> >>>> >>>> >> >>>> >>>> 2013/2/2 Jeff <[email protected]>: >> >>>> >>>> > I will do that. >> >>>> >>>> > >> >>>> >>>> > However, how do I configure the repository to support the >> >>>> previously >> >>>> >>>> > mentioned horizontal scaling with a shared repository? >> >>>> >>>> > >> >>>> >>>> > >> >>>> >>>> > On Sat, Feb 2, 2013 at 10:26 AM, Olivier Lamy < >> [email protected]> >> >>>> wrote: >> >>>> >>>> > >> >>>> >>>> >> our default is .indexer. >> >>>> >>>> >> Oh I believe using an absolute path for the index location >> doesn't >> >>>> >>>> >> work and it's not available via http(s). >> >>>> >>>> >> Can you simply change the index path to .index or leave it >> blank >> >>>> >>>> >> (default is .indexer) ? >> >>>> >>>> >> As it that will be available as this one >> >>>> >>>> >> >> >>>> >>>> >> >>>> >> https://archiva-repository.apache.org/archiva/repository/snapshots/.indexer >> >>>> >>>> >> >> >>>> >>>> >> >> >>>> >>>> >> >> >>>> >>>> >> 2013/2/2 Jeff <[email protected]>: >> >>>> >>>> >> > Also, isn't the default index directory supposed to be >> .index? >> >>>> >>>> That's >> >>>> >>>> >> what >> >>>> >>>> >> > it seems to be on Maven Central. >> >>>> >>>> >> > >> >>>> >>>> >> > http://repo.maven.apache.org/maven2/.index/ >> >>>> >>>> >> > >> >>>> >>>> >> > Thanks. >> >>>> >>>> >> > >> >>>> >>>> >> > >> >>>> >>>> >> > On Fri, Feb 1, 2013 at 3:28 PM, Jeff <[email protected] >> > >> >>>> wrote: >> >>>> >>>> >> > >> >>>> >>>> >> >> If I attempt to go to a similar URL for any of our >> repositories >> >>>> >>>> there is >> >>>> >>>> >> >> no .indexer or .index path such as: >> >>>> >>>> >> >> >> >>>> >>>> >> >> http://archiva/repository/dna-releases/.indexer >> >>>> >>>> >> >> http://archiva/repository/dna-snapshots/.index >> >>>> >>>> >> >> http://archiva/repository/dnabackend-releases/.indexer >> >>>> >>>> >> >> http://archiva/repository/dnabackend-snapshots/.index >> >>>> >>>> >> >> >> >>>> >>>> >> >> Is this because I moved them? If so, I am happy to put >> them >> >>>> back >> >>>> >>>> to the >> >>>> >>>> >> >> normal location, but then what would change to allow >> multiple >> >>>> >>>> archiva >> >>>> >>>> >> >> tomcat servers to use the same 'data' repositories? >> >>>> >>>> >> >> >> >>>> >>>> >> >> >> >>>> >>>> >> >> >> >>>> >>>> >> >> On Fri, Feb 1, 2013 at 2:10 PM, Olivier Lamy < >> [email protected] >> >>>> > >> >>>> >>>> wrote: >> >>>> >>>> >> >> >> >>>> >>>> >> >>> 2013/2/1 Jeff <[email protected]>: >> >>>> >>>> >> >>> > I'm not sure what you mean by "why you don't access to >> >>>> indexes >> >>>> >>>> via >> >>>> >>>> >> >>> http"... >> >>>> >>>> >> >>> Something like >> >>>> >>>> >> >>> >> >>>> >>>> >> >> >>>> >>>> >> >>>> >> https://archiva-repository.apache.org/archiva/repository/snapshots/.indexer/ >> >>>> >>>> >> >>> >> >>>> >>>> >> >>> it's available for all repositories (and for group too >> since >> >>>> >>>> 1.4-M2 in >> >>>> >>>> >> >>> path lie >> archiva/repository/${grouprepositoryId}/.indexer/ >> >>>> >>>> >> >>> >> >>>> >>>> >> >>> Don't know exactly how it works in IDE. But they use >> remote >> >>>> indexes >> >>>> >>>> >> >>> available via http(s) and not file system directories. >> >>>> >>>> >> >>> ? >> >>>> >>>> >> >>> >> >>>> >>>> >> >>> > >> >>>> >>>> >> >>> > When I setup Archiva running in Tomcat 6 under CentOS >> 6.2 >> >>>> Linux, >> >>>> >>>> I >> >>>> >>>> >> have >> >>>> >>>> >> >>> the >> >>>> >>>> >> >>> > folder structure below: >> >>>> >>>> >> >>> > >> >>>> >>>> >> >>> > /archiva >> >>>> >>>> >> >>> > /conf >> >>>> >>>> >> >>> > /data >> >>>> >>>> >> >>> > /derbydb >> >>>> >>>> >> >>> > /indexes >> >>>> >>>> >> >>> > /logs >> >>>> >>>> >> >>> > >> >>>> >>>> >> >>> > I think the only thing that is not standard is the >> 'indexes' >> >>>> >>>> >> directory. >> >>>> >>>> >> >>> I >> >>>> >>>> >> >>> > was trying to setup Archiva and anticipate possibly >> needing >> >>>> to >> >>>> >>>> scale >> >>>> >>>> >> >>> > horizontally by adding multiple front end servers >> behind >> >>>> our load >> >>>> >>>> >> >>> balancer. >> >>>> >>>> >> >>> > I read somewhere (I thought) that the indexes are >> >>>> specific to >> >>>> >>>> each >> >>>> >>>> >> >>> front >> >>>> >>>> >> >>> > end server, but that the repository data could be >> shared, >> >>>> so I >> >>>> >>>> >> mounted >> >>>> >>>> >> >>> the >> >>>> >>>> >> >>> > /archiva/data folder as a remote NFS mount. The rest >> of the >> >>>> >>>> folders >> >>>> >>>> >> >>> above >> >>>> >>>> >> >>> > are located physically on the archiva server. >> >>>> >>>> >> >>> > >> >>>> >>>> >> >>> > For each repository, the index folder is set to >> something >> >>>> like: >> >>>> >>>> >> >>> > >> >>>> >>>> >> >>> > /archiva/indexes/team1-releases >> >>>> >>>> >> >>> > /archiva/indexes/team1-snapshots >> >>>> >>>> >> >>> > >> >>>> >>>> >> >>> > But my understanding is that these indexes are the >> internal >> >>>> >>>> Archiva >> >>>> >>>> >> >>> > indexes, not the publicly consumable indexes. Nowhere >> in >> >>>> the >> >>>> >>>> >> >>> > /archiva/data/repositories/team1-releases or other >> >>>> repositories >> >>>> >>>> are >> >>>> >>>> >> >>> there >> >>>> >>>> >> >>> > any .index folders. >> >>>> >>>> >> >>> > >> >>>> >>>> >> >>> > I also have a single repository group that proxies all >> >>>> internal >> >>>> >>>> and >> >>>> >>>> >> >>> > externally proxied repositories under a single virtual >> >>>> >>>> repository and >> >>>> >>>> >> >>> there >> >>>> >>>> >> >>> > are no indexes consolidated under that repository group >> >>>> either >> >>>> >>>> which >> >>>> >>>> >> is >> >>>> >>>> >> >>> > what I thought was added in 1.4-M2 (the ability to >> >>>> consolidate >> >>>> >>>> >> indexes). >> >>>> >>>> >> >>> > >> >>>> >>>> >> >>> > Inside of /archiva/indexes, each repository index does >> have >> >>>> a >> >>>> >>>> bunch >> >>>> >>>> >> of >> >>>> >>>> >> >>> > files that look like: >> >>>> >>>> >> >>> > >> >>>> >>>> >> >>> > _7.fdt >> >>>> >>>> >> >>> > _7.fdx >> >>>> >>>> >> >>> > ... >> >>>> >>>> >> >>> > nexux-maven-reposotory-index.6948.gz >> >>>> >>>> >> >>> > nexux-maven-reposotory-index.6949.gz >> >>>> >>>> >> >>> > nexux-maven-reposotory-index.6950.gz >> >>>> >>>> >> >>> > nexux-maven-reposotory-index.6951.gz >> >>>> >>>> >> >>> > ... >> >>>> >>>> >> >>> > >> >>>> >>>> >> >>> > So something is generating these (I assume correctly). >> >>>> >>>> >> >>> > >> >>>> >>>> >> >>> > Also in each repository, the setting named "Skip Packed >> >>>> Index >> >>>> >>>> >> creation" >> >>>> >>>> >> >>> is >> >>>> >>>> >> >>> > NOT checked. >> >>>> >>>> >> >>> >> >>>> >>>> >> >>> Those nexux-maven-reposotory-index.xxx.gz files is >> incremental >> >>>> >>>> >> >>> generation. see a file called >> >>>> >>>> >> >>> nexus-maven-repository-index-packer.properties which >> contains >> >>>> some >> >>>> >>>> >> >>> metadatas on incremental generation. >> >>>> >>>> >> >>> > >> >>>> >>>> >> >>> > Hopefully that clarifies things and we can work this >> out >> >>>> and get >> >>>> >>>> it >> >>>> >>>> >> >>> > addressed as needed for 1.4-M4 :-). >> >>>> >>>> >> >>> > >> >>>> >>>> >> >>> > >> >>>> >>>> >> >>> > On Fri, Feb 1, 2013 at 9:51 AM, Olivier Lamy < >> >>>> [email protected]> >> >>>> >>>> >> wrote: >> >>>> >>>> >> >>> > >> >>>> >>>> >> >>> >> maybe there is an issue and setup indexes to a >> dedicated >> >>>> >>>> location >> >>>> >>>> >> >>> doesn't >> >>>> >>>> >> >>> >> work. >> >>>> >>>> >> >>> >> Is there any indexes files in archiva installation ? >> >>>> >>>> >> >>> >> >> >>>> >>>> >> >>> >> BTW why you don't access to indexes via http ? >> >>>> >>>> >> >>> >> >> >>>> >>>> >> >>> >> 2013/2/1 Jeff <[email protected]>: >> >>>> >>>> >> >>> >> > Yep, multiple times. The server has been up and >> running >> >>>> for a >> >>>> >>>> >> >>> number of >> >>>> >>>> >> >>> >> > months. >> >>>> >>>> >> >>> >> > On Feb 1, 2013 2:33 AM, "Olivier Lamy" < >> [email protected] >> >>>> > >> >>>> >>>> wrote: >> >>>> >>>> >> >>> >> > >> >>>> >>>> >> >>> >> >> Did you try a full scan ? >> >>>> >>>> >> >>> >> >> >> >>>> >>>> >> >>> >> >> >> >>>> >>>> >> >>> >> >> 2013/1/31 Jeff <[email protected]>: >> >>>> >>>> >> >>> >> >> > I'm currently using 1.4-M3 and have configured my >> >>>> Archiva >> >>>> >>>> >> indexes >> >>>> >>>> >> >>> to >> >>>> >>>> >> >>> >> >> point >> >>>> >>>> >> >>> >> >> > to a dedicated index folder located on the local >> host >> >>>> and >> >>>> >>>> put >> >>>> >>>> >> the >> >>>> >>>> >> >>> data >> >>>> >>>> >> >>> >> >> > folder on a shared NFS mount. >> >>>> >>>> >> >>> >> >> > >> >>>> >>>> >> >>> >> >> > However, the .index folder for local repos is not >> >>>> getting >> >>>> >>>> >> created >> >>>> >>>> >> >>> and >> >>>> >>>> >> >>> >> >> thus >> >>>> >>>> >> >>> >> >> > my IDE's can only see versions of what I have in >> my >> >>>> local >> >>>> >>>> .m2 >> >>>> >>>> >> >>> >> repository. >> >>>> >>>> >> >>> >> >> > >> >>>> >>>> >> >>> >> >> > I don't see anything in the logs suggesting that >> it is >> >>>> >>>> failing. >> >>>> >>>> >> >>> >> >> > >> >>>> >>>> >> >>> >> >> > Thoughts? >> >>>> >>>> >> >>> >> >> > >> >>>> >>>> >> >>> >> >> > -- >> >>>> >>>> >> >>> >> >> > Jeff Vincent >> >>>> >>>> >> >>> >> >> > [email protected] >> >>>> >>>> >> >>> >> >> > See my LinkedIn profile at: >> >>>> >>>> >> >>> >> >> > http://www.linkedin.com/in/rjeffreyvincent >> >>>> >>>> >> >>> >> >> > I ♥ DropBox <http://db.tt/9O6LfBX> !! >> >>>> >>>> >> >>> >> >> >> >>>> >>>> >> >>> >> >> >> >>>> >>>> >> >>> >> >> >> >>>> >>>> >> >>> >> >> -- >> >>>> >>>> >> >>> >> >> Olivier Lamy >> >>>> >>>> >> >>> >> >> Talend: http://coders.talend.com >> >>>> >>>> >> >>> >> >> http://twitter.com/olamy | >> http://linkedin.com/in/olamy >> >>>> >>>> >> >>> >> >> >> >>>> >>>> >> >>> >> >> >>>> >>>> >> >>> >> >> >>>> >>>> >> >>> >> >> >>>> >>>> >> >>> >> -- >> >>>> >>>> >> >>> >> Olivier Lamy >> >>>> >>>> >> >>> >> Talend: http://coders.talend.com >> >>>> >>>> >> >>> >> http://twitter.com/olamy | >> http://linkedin.com/in/olamy >> >>>> >>>> >> >>> >> >> >>>> >>>> >> >>> > >> >>>> >>>> >> >>> > >> >>>> >>>> >> >>> > >> >>>> >>>> >> >>> > -- >> >>>> >>>> >> >>> > Jeff Vincent >> >>>> >>>> >> >>> > [email protected] >> >>>> >>>> >> >>> > See my LinkedIn profile at: >> >>>> >>>> >> >>> > http://www.linkedin.com/in/rjeffreyvincent >> >>>> >>>> >> >>> > I ♥ DropBox <http://db.tt/9O6LfBX> !! >> >>>> >>>> >> >>> >> >>>> >>>> >> >>> >> >>>> >>>> >> >>> >> >>>> >>>> >> >>> -- >> >>>> >>>> >> >>> Olivier Lamy >> >>>> >>>> >> >>> Talend: http://coders.talend.com >> >>>> >>>> >> >>> http://twitter.com/olamy | http://linkedin.com/in/olamy >> >>>> >>>> >> >>> >> >>>> >>>> >> >> >> >>>> >>>> >> >> >> >>>> >>>> >> >> >> >>>> >>>> >> >> -- >> >>>> >>>> >> >> Jeff Vincent >> >>>> >>>> >> >> [email protected] >> >>>> >>>> >> >> See my LinkedIn profile at: >> >>>> >>>> >> >> http://www.linkedin.com/in/rjeffreyvincent >> >>>> >>>> >> >> I ♥ DropBox <http://db.tt/9O6LfBX> !! >> >>>> >>>> >> >> >> >>>> >>>> >> > >> >>>> >>>> >> > >> >>>> >>>> >> > >> >>>> >>>> >> > -- >> >>>> >>>> >> > Jeff Vincent >> >>>> >>>> >> > [email protected] >> >>>> >>>> >> > See my LinkedIn profile at: >> >>>> >>>> >> > http://www.linkedin.com/in/rjeffreyvincent >> >>>> >>>> >> > I ♥ DropBox <http://db.tt/9O6LfBX> !! >> >>>> >>>> >> >> >>>> >>>> >> >> >>>> >>>> >> >> >>>> >>>> >> -- >> >>>> >>>> >> Olivier Lamy >> >>>> >>>> >> Talend: http://coders.talend.com >> >>>> >>>> >> http://twitter.com/olamy | http://linkedin.com/in/olamy >> >>>> >>>> >> >> >>>> >>>> > >> >>>> >>>> > >> >>>> >>>> > >> >>>> >>>> > -- >> >>>> >>>> > Jeff Vincent >> >>>> >>>> > [email protected] >> >>>> >>>> > See my LinkedIn profile at: >> >>>> >>>> > http://www.linkedin.com/in/rjeffreyvincent >> >>>> >>>> > I ♥ DropBox <http://db.tt/9O6LfBX> !! >> >>>> >>>> >> >>>> >>>> >> >>>> >>>> >> >>>> >>>> -- >> >>>> >>>> Olivier Lamy >> >>>> >>>> Talend: http://coders.talend.com >> >>>> >>>> http://twitter.com/olamy | http://linkedin.com/in/olamy >> >>>> >>>> >> >>>> >>> >> >>>> >>> >> >>>> >>> >> >>>> >>> -- >> >>>> >>> Jeff Vincent >> >>>> >>> [email protected] >> >>>> >>> See my LinkedIn profile at: >> >>>> >>> http://www.linkedin.com/in/rjeffreyvincent >> >>>> >>> I ♥ DropBox <http://db.tt/9O6LfBX> !! >> >>>> >>> >> >>>> >> >> >>>> >> >> >>>> >> >> >>>> >> -- >> >>>> >> Jeff Vincent >> >>>> >> [email protected] >> >>>> >> See my LinkedIn profile at: >> >>>> >> http://www.linkedin.com/in/rjeffreyvincent >> >>>> >> I ♥ DropBox <http://db.tt/9O6LfBX> !! >> >>>> > >> >>>> > >> >>>> > >> >>>> > -- >> >>>> > Olivier Lamy >> >>>> > Talend: http://coders.talend.com >> >>>> > http://twitter.com/olamy | http://linkedin.com/in/olamy >> >>>> >> >>>> >> >>>> >> >>>> -- >> >>>> Olivier Lamy >> >>>> Talend: http://coders.talend.com >> >>>> http://twitter.com/olamy | http://linkedin.com/in/olamy >> >>>> >> >>>> 2013/2/6 Olivier Lamy <[email protected]>: >> >>>> > Hi, >> >>>> > Apologize for delay. >> >>>> > >> >>>> > 2013/2/4 Jeff <[email protected]>: >> >>>> >> I'm now trying to switch up the index directories on my >> repositories >> >>>> and am >> >>>> >> banging my head. I've simply removed the "Index Directory" >> setting on >> >>>> my >> >>>> >> repos and I see the .indexer folder getting created. Which is >> good. >> >>>> >> >> >>>> >> However, according to >> >>>> >> >> http://archiva.apache.org/docs/1.4-M3/adminguide/repositories.html, it >> >>>> >> states: >> >>>> >> >> >>>> >> *Another directory named .index is also created at the root of the >> >>>> >> repository directory. This is not configurable though as it >> contains >> >>>> the >> >>>> >> packaged/bundled index which is consumed by different consumers >> of the >> >>>> >> index such as M2Eclipse. * >> >>>> > doh documentation is wrong (we use .indexer) >> >>>> >> >> >>>> >> >> >>>> >> However, it is NOT getting created. I've restarted tomcat, I've >> >>>> forced a >> >>>> >> full index scan on every repository as well as a Directory scan. >> >>>> >> >> >>>> >> The above statement also lead me to believe that regardless of the >> >>>> location >> >>>> >> of ".indexer" that ".index" would still get created at the root >> but it >> >>>> >> isn't. >> >>>> >> >> >>>> >> On one repository I tried setting "Index Directory" to ".index", >> but I >> >>>> get >> >>>> >> an error that it can't create "/usr/share/tomcat6/.index". >> >>>> > A bit weird. >> >>>> > What is -Dappserver.base value ? >> >>>> > BTW I agree there are some possible with relative path (I fixed >> some in >> >>>> trunk). >> >>>> > But while studying your case, I think this need more >> >>>> attention/debugging. >> >>>> > I'm on it. I will keep you informed as soon I have fixed (or at >> least >> >>>> > understood the issue :-)) that in source code. >> >>>> >> >> >>>> >> Thanks for any additional direction... >> >>>> >> >> >>>> >> >> >>>> >> On Mon, Feb 4, 2013 at 8:47 AM, Jeff <[email protected]> >> wrote: >> >>>> >> >> >>>> >>> I don't *yet* have a need, but our user base is growing and so >> is our >> >>>> >>> CI/CD pipeline (number of GO and Jenkins build agents/slaves) >> and I >> >>>> wanted >> >>>> >>> to plan ahead. I am trying to find the document that talked >> about >> >>>> keeping >> >>>> >>> indexes local while allowing a shared repo, but I have been >> >>>> unsuccessful >> >>>> >>> thus far. Maybe I dreamed it up. :-) >> >>>> >>> >> >>>> >>> Thanks for your help. >> >>>> >>> >> >>>> >>> >> >>>> >>> On Mon, Feb 4, 2013 at 2:56 AM, Olivier Lamy <[email protected]> >> >>>> wrote: >> >>>> >>> >> >>>> >>>> complicated to have scabality when serving files :-( >> >>>> >>>> we don't (yet) any sync possible (that's something we start >> >>>> discussing >> >>>> >>>> on dev@ with maybe using new Apache project called helix). >> >>>> >>>> With your setup each repository will be independent. >> >>>> >>>> Do you have so many users to need that ? >> >>>> >>>> >> >>>> >>>> 2013/2/2 Jeff <[email protected]>: >> >>>> >>>> > I will do that. >> >>>> >>>> > >> >>>> >>>> > However, how do I configure the repository to support the >> >>>> previously >> >>>> >>>> > mentioned horizontal scaling with a shared repository? >> >>>> >>>> > >> >>>> >>>> > >> >>>> >>>> > On Sat, Feb 2, 2013 at 10:26 AM, Olivier Lamy < >> [email protected]> >> >>>> wrote: >> >>>> >>>> > >> >>>> >>>> >> our default is .indexer. >> >>>> >>>> >> Oh I believe using an absolute path for the index location >> doesn't >> >>>> >>>> >> work and it's not available via http(s). >> >>>> >>>> >> Can you simply change the index path to .index or leave it >> blank >> >>>> >>>> >> (default is .indexer) ? >> >>>> >>>> >> As it that will be available as this one >> >>>> >>>> >> >> >>>> >>>> >> >>>> >> https://archiva-repository.apache.org/archiva/repository/snapshots/.indexer >> >>>> >>>> >> >> >>>> >>>> >> >> >>>> >>>> >> >> >>>> >>>> >> 2013/2/2 Jeff <[email protected]>: >> >>>> >>>> >> > Also, isn't the default index directory supposed to be >> .index? >> >>>> >>>> That's >> >>>> >>>> >> what >> >>>> >>>> >> > it seems to be on Maven Central. >> >>>> >>>> >> > >> >>>> >>>> >> > http://repo.maven.apache.org/maven2/.index/ >> >>>> >>>> >> > >> >>>> >>>> >> > Thanks. >> >>>> >>>> >> > >> >>>> >>>> >> > >> >>>> >>>> >> > On Fri, Feb 1, 2013 at 3:28 PM, Jeff <[email protected] >> > >> >>>> wrote: >> >>>> >>>> >> > >> >>>> >>>> >> >> If I attempt to go to a similar URL for any of our >> repositories >> >>>> >>>> there is >> >>>> >>>> >> >> no .indexer or .index path such as: >> >>>> >>>> >> >> >> >>>> >>>> >> >> http://archiva/repository/dna-releases/.indexer >> >>>> >>>> >> >> http://archiva/repository/dna-snapshots/.index >> >>>> >>>> >> >> http://archiva/repository/dnabackend-releases/.indexer >> >>>> >>>> >> >> http://archiva/repository/dnabackend-snapshots/.index >> >>>> >>>> >> >> >> >>>> >>>> >> >> Is this because I moved them? If so, I am happy to put >> them >> >>>> back >> >>>> >>>> to the >> >>>> >>>> >> >> normal location, but then what would change to allow >> multiple >> >>>> >>>> archiva >> >>>> >>>> >> >> tomcat servers to use the same 'data' repositories? >> >>>> >>>> >> >> >> >>>> >>>> >> >> >> >>>> >>>> >> >> >> >>>> >>>> >> >> On Fri, Feb 1, 2013 at 2:10 PM, Olivier Lamy < >> [email protected] >> >>>> > >> >>>> >>>> wrote: >> >>>> >>>> >> >> >> >>>> >>>> >> >>> 2013/2/1 Jeff <[email protected]>: >> >>>> >>>> >> >>> > I'm not sure what you mean by "why you don't access to >> >>>> indexes >> >>>> >>>> via >> >>>> >>>> >> >>> http"... >> >>>> >>>> >> >>> Something like >> >>>> >>>> >> >>> >> >>>> >>>> >> >> >>>> >>>> >> >>>> >> https://archiva-repository.apache.org/archiva/repository/snapshots/.indexer/ >> >>>> >>>> >> >>> >> >>>> >>>> >> >>> it's available for all repositories (and for group too >> since >> >>>> >>>> 1.4-M2 in >> >>>> >>>> >> >>> path lie >> archiva/repository/${grouprepositoryId}/.indexer/ >> >>>> >>>> >> >>> >> >>>> >>>> >> >>> Don't know exactly how it works in IDE. But they use >> remote >> >>>> indexes >> >>>> >>>> >> >>> available via http(s) and not file system directories. >> >>>> >>>> >> >>> ? >> >>>> >>>> >> >>> >> >>>> >>>> >> >>> > >> >>>> >>>> >> >>> > When I setup Archiva running in Tomcat 6 under CentOS >> 6.2 >> >>>> Linux, >> >>>> >>>> I >> >>>> >>>> >> have >> >>>> >>>> >> >>> the >> >>>> >>>> >> >>> > folder structure below: >> >>>> >>>> >> >>> > >> >>>> >>>> >> >>> > /archiva >> >>>> >>>> >> >>> > /conf >> >>>> >>>> >> >>> > /data >> >>>> >>>> >> >>> > /derbydb >> >>>> >>>> >> >>> > /indexes >> >>>> >>>> >> >>> > /logs >> >>>> >>>> >> >>> > >> >>>> >>>> >> >>> > I think the only thing that is not standard is the >> 'indexes' >> >>>> >>>> >> directory. >> >>>> >>>> >> >>> I >> >>>> >>>> >> >>> > was trying to setup Archiva and anticipate possibly >> needing >> >>>> to >> >>>> >>>> scale >> >>>> >>>> >> >>> > horizontally by adding multiple front end servers >> behind >> >>>> our load >> >>>> >>>> >> >>> balancer. >> >>>> >>>> >> >>> > I read somewhere (I thought) that the indexes are >> >>>> specific to >> >>>> >>>> each >> >>>> >>>> >> >>> front >> >>>> >>>> >> >>> > end server, but that the repository data could be >> shared, >> >>>> so I >> >>>> >>>> >> mounted >> >>>> >>>> >> >>> the >> >>>> >>>> >> >>> > /archiva/data folder as a remote NFS mount. The rest >> of the >> >>>> >>>> folders >> >>>> >>>> >> >>> above >> >>>> >>>> >> >>> > are located physically on the archiva server. >> >>>> >>>> >> >>> > >> >>>> >>>> >> >>> > For each repository, the index folder is set to >> something >> >>>> like: >> >>>> >>>> >> >>> > >> >>>> >>>> >> >>> > /archiva/indexes/team1-releases >> >>>> >>>> >> >>> > /archiva/indexes/team1-snapshots >> >>>> >>>> >> >>> > >> >>>> >>>> >> >>> > But my understanding is that these indexes are the >> internal >> >>>> >>>> Archiva >> >>>> >>>> >> >>> > indexes, not the publicly consumable indexes. Nowhere >> in >> >>>> the >> >>>> >>>> >> >>> > /archiva/data/repositories/team1-releases or other >> >>>> repositories >> >>>> >>>> are >> >>>> >>>> >> >>> there >> >>>> >>>> >> >>> > any .index folders. >> >>>> >>>> >> >>> > >> >>>> >>>> >> >>> > I also have a single repository group that proxies all >> >>>> internal >> >>>> >>>> and >> >>>> >>>> >> >>> > externally proxied repositories under a single virtual >> >>>> >>>> repository and >> >>>> >>>> >> >>> there >> >>>> >>>> >> >>> > are no indexes consolidated under that repository group >> >>>> either >> >>>> >>>> which >> >>>> >>>> >> is >> >>>> >>>> >> >>> > what I thought was added in 1.4-M2 (the ability to >> >>>> consolidate >> >>>> >>>> >> indexes). >> >>>> >>>> >> >>> > >> >>>> >>>> >> >>> > Inside of /archiva/indexes, each repository index does >> have >> >>>> a >> >>>> >>>> bunch >> >>>> >>>> >> of >> >>>> >>>> >> >>> > files that look like: >> >>>> >>>> >> >>> > >> >>>> >>>> >> >>> > _7.fdt >> >>>> >>>> >> >>> > _7.fdx >> >>>> >>>> >> >>> > ... >> >>>> >>>> >> >>> > nexux-maven-reposotory-index.6948.gz >> >>>> >>>> >> >>> > nexux-maven-reposotory-index.6949.gz >> >>>> >>>> >> >>> > nexux-maven-reposotory-index.6950.gz >> >>>> >>>> >> >>> > nexux-maven-reposotory-index.6951.gz >> >>>> >>>> >> >>> > ... >> >>>> >>>> >> >>> > >> >>>> >>>> >> >>> > So something is generating these (I assume correctly). >> >>>> >>>> >> >>> > >> >>>> >>>> >> >>> > Also in each repository, the setting named "Skip Packed >> >>>> Index >> >>>> >>>> >> creation" >> >>>> >>>> >> >>> is >> >>>> >>>> >> >>> > NOT checked. >> >>>> >>>> >> >>> >> >>>> >>>> >> >>> Those nexux-maven-reposotory-index.xxx.gz files is >> incremental >> >>>> >>>> >> >>> generation. see a file called >> >>>> >>>> >> >>> nexus-maven-repository-index-packer.properties which >> contains >> >>>> some >> >>>> >>>> >> >>> metadatas on incremental generation. >> >>>> >>>> >> >>> > >> >>>> >>>> >> >>> > Hopefully that clarifies things and we can work this >> out >> >>>> and get >> >>>> >>>> it >> >>>> >>>> >> >>> > addressed as needed for 1.4-M4 :-). >> >>>> >>>> >> >>> > >> >>>> >>>> >> >>> > >> >>>> >>>> >> >>> > On Fri, Feb 1, 2013 at 9:51 AM, Olivier Lamy < >> >>>> [email protected]> >> >>>> >>>> >> wrote: >> >>>> >>>> >> >>> > >> >>>> >>>> >> >>> >> maybe there is an issue and setup indexes to a >> dedicated >> >>>> >>>> location >> >>>> >>>> >> >>> doesn't >> >>>> >>>> >> >>> >> work. >> >>>> >>>> >> >>> >> Is there any indexes files in archiva installation ? >> >>>> >>>> >> >>> >> >> >>>> >>>> >> >>> >> BTW why you don't access to indexes via http ? >> >>>> >>>> >> >>> >> >> >>>> >>>> >> >>> >> 2013/2/1 Jeff <[email protected]>: >> >>>> >>>> >> >>> >> > Yep, multiple times. The server has been up and >> running >> >>>> for a >> >>>> >>>> >> >>> number of >> >>>> >>>> >> >>> >> > months. >> >>>> >>>> >> >>> >> > On Feb 1, 2013 2:33 AM, "Olivier Lamy" < >> [email protected] >> >>>> > >> >>>> >>>> wrote: >> >>>> >>>> >> >>> >> > >> >>>> >>>> >> >>> >> >> Did you try a full scan ? >> >>>> >>>> >> >>> >> >> >> >>>> >>>> >> >>> >> >> >> >>>> >>>> >> >>> >> >> 2013/1/31 Jeff <[email protected]>: >> >>>> >>>> >> >>> >> >> > I'm currently using 1.4-M3 and have configured my >> >>>> Archiva >> >>>> >>>> >> indexes >> >>>> >>>> >> >>> to >> >>>> >>>> >> >>> >> >> point >> >>>> >>>> >> >>> >> >> > to a dedicated index folder located on the local >> host >> >>>> and >> >>>> >>>> put >> >>>> >>>> >> the >> >>>> >>>> >> >>> data >> >>>> >>>> >> >>> >> >> > folder on a shared NFS mount. >> >>>> >>>> >> >>> >> >> > >> >>>> >>>> >> >>> >> >> > However, the .index folder for local repos is not >> >>>> getting >> >>>> >>>> >> created >> >>>> >>>> >> >>> and >> >>>> >>>> >> >>> >> >> thus >> >>>> >>>> >> >>> >> >> > my IDE's can only see versions of what I have in >> my >> >>>> local >> >>>> >>>> .m2 >> >>>> >>>> >> >>> >> repository. >> >>>> >>>> >> >>> >> >> > >> >>>> >>>> >> >>> >> >> > I don't see anything in the logs suggesting that >> it is >> >>>> >>>> failing. >> >>>> >>>> >> >>> >> >> > >> >>>> >>>> >> >>> >> >> > Thoughts? >> >>>> >>>> >> >>> >> >> > >> >>>> >>>> >> >>> >> >> > -- >> >>>> >>>> >> >>> >> >> > Jeff Vincent >> >>>> >>>> >> >>> >> >> > [email protected] >> >>>> >>>> >> >>> >> >> > See my LinkedIn profile at: >> >>>> >>>> >> >>> >> >> > http://www.linkedin.com/in/rjeffreyvincent >> >>>> >>>> >> >>> >> >> > I ♥ DropBox <http://db.tt/9O6LfBX> !! >> >>>> >>>> >> >>> >> >> >> >>>> >>>> >> >>> >> >> >> >>>> >>>> >> >>> >> >> >> >>>> >>>> >> >>> >> >> -- >> >>>> >>>> >> >>> >> >> Olivier Lamy >> >>>> >>>> >> >>> >> >> Talend: http://coders.talend.com >> >>>> >>>> >> >>> >> >> http://twitter.com/olamy | >> http://linkedin.com/in/olamy >> >>>> >>>> >> >>> >> >> >> >>>> >>>> >> >>> >> >> >>>> >>>> >> >>> >> >> >>>> >>>> >> >>> >> >> >>>> >>>> >> >>> >> -- >> >>>> >>>> >> >>> >> Olivier Lamy >> >>>> >>>> >> >>> >> Talend: http://coders.talend.com >> >>>> >>>> >> >>> >> http://twitter.com/olamy | >> http://linkedin.com/in/olamy >> >>>> >>>> >> >>> >> >> >>>> >>>> >> >>> > >> >>>> >>>> >> >>> > >> >>>> >>>> >> >>> > >> >>>> >>>> >> >>> > -- >> >>>> >>>> >> >>> > Jeff Vincent >> >>>> >>>> >> >>> > [email protected] >> >>>> >>>> >> >>> > See my LinkedIn profile at: >> >>>> >>>> >> >>> > http://www.linkedin.com/in/rjeffreyvincent >> >>>> >>>> >> >>> > I ♥ DropBox <http://db.tt/9O6LfBX> !! >> >>>> >>>> >> >>> >> >>>> >>>> >> >>> >> >>>> >>>> >> >>> >> >>>> >>>> >> >>> -- >> >>>> >>>> >> >>> Olivier Lamy >> >>>> >>>> >> >>> Talend: http://coders.talend.com >> >>>> >>>> >> >>> http://twitter.com/olamy | http://linkedin.com/in/olamy >> >>>> >>>> >> >>> >> >>>> >>>> >> >> >> >>>> >>>> >> >> >> >>>> >>>> >> >> >> >>>> >>>> >> >> -- >> >>>> >>>> >> >> Jeff Vincent >> >>>> >>>> >> >> [email protected] >> >>>> >>>> >> >> See my LinkedIn profile at: >> >>>> >>>> >> >> http://www.linkedin.com/in/rjeffreyvincent >> >>>> >>>> >> >> I ♥ DropBox <http://db.tt/9O6LfBX> !! >> >>>> >>>> >> >> >> >>>> >>>> >> > >> >>>> >>>> >> > >> >>>> >>>> >> > >> >>>> >>>> >> > -- >> >>>> >>>> >> > Jeff Vincent >> >>>> >>>> >> > [email protected] >> >>>> >>>> >> > See my LinkedIn profile at: >> >>>> >>>> >> > http://www.linkedin.com/in/rjeffreyvincent >> >>>> >>>> >> > I ♥ DropBox <http://db.tt/9O6LfBX> !! >> >>>> >>>> >> >> >>>> >>>> >> >> >>>> >>>> >> >> >>>> >>>> >> -- >> >>>> >>>> >> Olivier Lamy >> >>>> >>>> >> Talend: http://coders.talend.com >> >>>> >>>> >> http://twitter.com/olamy | http://linkedin.com/in/olamy >> >>>> >>>> >> >> >>>> >>>> > >> >>>> >>>> > >> >>>> >>>> > >> >>>> >>>> > -- >> >>>> >>>> > Jeff Vincent >> >>>> >>>> > [email protected] >> >>>> >>>> > See my LinkedIn profile at: >> >>>> >>>> > http://www.linkedin.com/in/rjeffreyvincent >> >>>> >>>> > I ♥ DropBox <http://db.tt/9O6LfBX> !! >> >>>> >>>> >> >>>> >>>> >> >>>> >>>> >> >>>> >>>> -- >> >>>> >>>> Olivier Lamy >> >>>> >>>> Talend: http://coders.talend.com >> >>>> >>>> http://twitter.com/olamy | http://linkedin.com/in/olamy >> >>>> >>>> >> >>>> >>> >> >>>> >>> >> >>>> >>> >> >>>> >>> -- >> >>>> >>> Jeff Vincent >> >>>> >>> [email protected] >> >>>> >>> See my LinkedIn profile at: >> >>>> >>> http://www.linkedin.com/in/rjeffreyvincent >> >>>> >>> I ♥ DropBox <http://db.tt/9O6LfBX> !! >> >>>> >>> >> >>>> >> >> >>>> >> >> >>>> >> >> >>>> >> -- >> >>>> >> Jeff Vincent >> >>>> >> [email protected] >> >>>> >> See my LinkedIn profile at: >> >>>> >> http://www.linkedin.com/in/rjeffreyvincent >> >>>> >> I ♥ DropBox <http://db.tt/9O6LfBX> !! >> >>>> > >> >>>> > >> >>>> > >> >>>> > -- >> >>>> > Olivier Lamy >> >>>> > Talend: http://coders.talend.com >> >>>> > http://twitter.com/olamy | http://linkedin.com/in/olamy >> >>>> >> >>>> >> >>>> >> >>>> -- >> >>>> Olivier Lamy >> >>>> Talend: http://coders.talend.com >> >>>> http://twitter.com/olamy | http://linkedin.com/in/olamy >> >>>> >> >>> >> >>> >> >>> >> >>> -- >> >>> Jeff Vincent >> >>> [email protected] >> >>> See my LinkedIn profile at: >> >>> http://www.linkedin.com/in/rjeffreyvincent >> >>> I ♥ DropBox <http://db.tt/9O6LfBX> !! >> >>> >> >> >> >> >> >> >> >> -- >> >> Jeff Vincent >> >> [email protected] >> >> See my LinkedIn profile at: >> >> http://www.linkedin.com/in/rjeffreyvincent >> >> I ♥ DropBox <http://db.tt/9O6LfBX> !! >> > >> > >> > >> > -- >> > Olivier Lamy >> > Talend: http://coders.talend.com >> > http://twitter.com/olamy | http://linkedin.com/in/olamy >> >> >> >> -- >> Olivier Lamy >> Talend: http://coders.talend.com >> http://twitter.com/olamy | http://linkedin.com/in/olamy >> > > > > -- > Jeff Vincent > [email protected] > See my LinkedIn profile at: > http://www.linkedin.com/in/rjeffreyvincent > I ♥ DropBox <http://db.tt/9O6LfBX> !! > -- Jeff Vincent [email protected] See my LinkedIn profile at: http://www.linkedin.com/in/rjeffreyvincent I ♥ DropBox <http://db.tt/9O6LfBX> !!
