2013/2/6 Jeff <[email protected]>: > Is the "merged index" virtual path/location for repository groups > configurable somehow to use ".index" instead? I don't see it in the UI, > but maybe there is a nifty setting in archiva.xml I could set. nope. I created: https://jira.codehaus.org/browse/MRM-1745.
> > > On Wed, Feb 6, 2013 at 11:03 AM, Jeff <[email protected]> wrote: > >> Yay! I like configurable! >> >> I noticed that in my remote repository folders that the index directory is >> ".index" which differs from the default of .indexer for local repos. Are >> the index folders in the "remotes" directory provided as part of the >> "merged" index? >> >> I am using a repository group as well and thus assume the "merged index" >> is supported, but when I go to the repo group url such as >> http://archiva/repository/myrepogroup/.indexer, it seems to just hang. >> >> (I'm getting a brain cramp trying to resolve all of the index stuff in my >> head.) >> >> Thanks for your efforts and help and I anxiously await 1.4-M4 :-). >> >> >> On Wed, Feb 6, 2013 at 10:40 AM, Olivier Lamy <[email protected]> wrote: >> >>> 2013/2/6 Olivier Lamy <[email protected]>: >>> > The issue I have is that will break backward compat. >>> > Create an issue in jira to see others reactions. >>> > Note: >>> http://archiva.apache.org/docs/1.4-M4-SNAPSHOT/userguide/virtual-repositories.html >>> > section "Merged index". >>> > I know people using that (including my current company). >>> > BTW I agree that will be more following a "de facto" standard. >>> NOTE we can that make configurable :-) >>> > >>> > 2013/2/6 Jeff <[email protected]>: >>> >> Also, would there be value in Archiva changing the default to .index >>> >> instead of .indexer since .index seems to be the standard used for >>> index >>> >> downloads by clients? >>> >> >>> >> >>> >> On Wed, Feb 6, 2013 at 8:54 AM, Jeff <[email protected]> wrote: >>> >> >>> >>> Thanks Olivier! I will set an absolute directory. >>> >>> >>> >>> On a side note as per previous discussion, I have an NFS mount for the >>> >>> archiva data folder that is symlinked. >>> >>> >>> >>> NFS: /mnt/archiva-remote >>> >>> >>> >>> ARCHIVA: /archiva/data --> /mnt/archiva-remote >>> >>> >>> >>> When I set my repository folder via the Archiva UI to something like: >>> >>> >>> >>> /archiva/data/repositories/cms-releases >>> >>> >>> >>> After I save and then refresh the UI, the value for the repository >>> gets >>> >>> changed to: >>> >>> >>> >>> /mnt/archiva-remote/repositories/cms-releases >>> >>> >>> >>> While this still works, it makes it difficult to move or relocate the >>> >>> share. Recently we had to create a bigger share (we now have 4TB) on >>> >>> another system to which we mounted at a different mount point, to >>> which we >>> >>> copied the data files from the old share and then switched the >>> symlink, but >>> >>> it broke the repositories because the directories were pointing to >>> the old >>> >>> NFS mount. Something to look at anyway. >>> >>> >>> >>> When is 1.4-M4 scheduled? >>> >>> >>> >>> >>> >>> On Wed, Feb 6, 2013 at 4:15 AM, Olivier Lamy <[email protected]> >>> wrote: >>> >>> >>> >>>> in trunk. >>> >>>> if blank .indexer directory is created in the repository directory. >>> >>>> I agree "Index Directory" is a bit confusing option. >>> >>>> As this doesn't work really if you configure something outside of the >>> >>>> top of your repository directory. >>> >>>> Furthermore I have noticed changing the value it's not dynamic (need >>> a >>> >>>> restart). >>> >>>> So I will try to fix that. >>> >>>> Currently what you can do is adding a value with a directory inside >>> >>>> your repository directory. >>> >>>> If repository use /home/archiva/repo/mygreat-repo >>> >>>> use /home/archiva/repo/mygreat-repo/.indexer >>> >>>> I will try to fix that in trunk (or at least improve documentation ! >>> ) >>> >>>> 2013/2/6 Olivier Lamy <[email protected]>: >>> >>>> > Hi, >>> >>>> > Apologize for delay. >>> >>>> > >>> >>>> > 2013/2/4 Jeff <[email protected]>: >>> >>>> >> I'm now trying to switch up the index directories on my >>> repositories >>> >>>> and am >>> >>>> >> banging my head. I've simply removed the "Index Directory" >>> setting on >>> >>>> my >>> >>>> >> repos and I see the .indexer folder getting created. Which is >>> good. >>> >>>> >> >>> >>>> >> However, according to >>> >>>> >> >>> http://archiva.apache.org/docs/1.4-M3/adminguide/repositories.html, it >>> >>>> >> states: >>> >>>> >> >>> >>>> >> *Another directory named .index is also created at the root of the >>> >>>> >> repository directory. This is not configurable though as it >>> contains >>> >>>> the >>> >>>> >> packaged/bundled index which is consumed by different consumers >>> of the >>> >>>> >> index such as M2Eclipse. * >>> >>>> > doh documentation is wrong (we use .indexer) >>> >>>> >> >>> >>>> >> >>> >>>> >> However, it is NOT getting created. I've restarted tomcat, I've >>> >>>> forced a >>> >>>> >> full index scan on every repository as well as a Directory scan. >>> >>>> >> >>> >>>> >> The above statement also lead me to believe that regardless of the >>> >>>> location >>> >>>> >> of ".indexer" that ".index" would still get created at the root >>> but it >>> >>>> >> isn't. >>> >>>> >> >>> >>>> >> On one repository I tried setting "Index Directory" to ".index", >>> but I >>> >>>> get >>> >>>> >> an error that it can't create "/usr/share/tomcat6/.index". >>> >>>> > A bit weird. >>> >>>> > What is -Dappserver.base value ? >>> >>>> > BTW I agree there are some possible with relative path (I fixed >>> some in >>> >>>> trunk). >>> >>>> > But while studying your case, I think this need more >>> >>>> attention/debugging. >>> >>>> > I'm on it. I will keep you informed as soon I have fixed (or at >>> least >>> >>>> > understood the issue :-)) that in source code. >>> >>>> >> >>> >>>> >> Thanks for any additional direction... >>> >>>> >> >>> >>>> >> >>> >>>> >> On Mon, Feb 4, 2013 at 8:47 AM, Jeff <[email protected]> >>> wrote: >>> >>>> >> >>> >>>> >>> I don't *yet* have a need, but our user base is growing and so >>> is our >>> >>>> >>> CI/CD pipeline (number of GO and Jenkins build agents/slaves) >>> and I >>> >>>> wanted >>> >>>> >>> to plan ahead. I am trying to find the document that talked >>> about >>> >>>> keeping >>> >>>> >>> indexes local while allowing a shared repo, but I have been >>> >>>> unsuccessful >>> >>>> >>> thus far. Maybe I dreamed it up. :-) >>> >>>> >>> >>> >>>> >>> Thanks for your help. >>> >>>> >>> >>> >>>> >>> >>> >>>> >>> On Mon, Feb 4, 2013 at 2:56 AM, Olivier Lamy <[email protected]> >>> >>>> wrote: >>> >>>> >>> >>> >>>> >>>> complicated to have scabality when serving files :-( >>> >>>> >>>> we don't (yet) any sync possible (that's something we start >>> >>>> discussing >>> >>>> >>>> on dev@ with maybe using new Apache project called helix). >>> >>>> >>>> With your setup each repository will be independent. >>> >>>> >>>> Do you have so many users to need that ? >>> >>>> >>>> >>> >>>> >>>> 2013/2/2 Jeff <[email protected]>: >>> >>>> >>>> > I will do that. >>> >>>> >>>> > >>> >>>> >>>> > However, how do I configure the repository to support the >>> >>>> previously >>> >>>> >>>> > mentioned horizontal scaling with a shared repository? >>> >>>> >>>> > >>> >>>> >>>> > >>> >>>> >>>> > On Sat, Feb 2, 2013 at 10:26 AM, Olivier Lamy < >>> [email protected]> >>> >>>> wrote: >>> >>>> >>>> > >>> >>>> >>>> >> our default is .indexer. >>> >>>> >>>> >> Oh I believe using an absolute path for the index location >>> doesn't >>> >>>> >>>> >> work and it's not available via http(s). >>> >>>> >>>> >> Can you simply change the index path to .index or leave it >>> blank >>> >>>> >>>> >> (default is .indexer) ? >>> >>>> >>>> >> As it that will be available as this one >>> >>>> >>>> >> >>> >>>> >>>> >>> >>>> >>> https://archiva-repository.apache.org/archiva/repository/snapshots/.indexer >>> >>>> >>>> >> >>> >>>> >>>> >> >>> >>>> >>>> >> >>> >>>> >>>> >> 2013/2/2 Jeff <[email protected]>: >>> >>>> >>>> >> > Also, isn't the default index directory supposed to be >>> .index? >>> >>>> >>>> That's >>> >>>> >>>> >> what >>> >>>> >>>> >> > it seems to be on Maven Central. >>> >>>> >>>> >> > >>> >>>> >>>> >> > http://repo.maven.apache.org/maven2/.index/ >>> >>>> >>>> >> > >>> >>>> >>>> >> > Thanks. >>> >>>> >>>> >> > >>> >>>> >>>> >> > >>> >>>> >>>> >> > On Fri, Feb 1, 2013 at 3:28 PM, Jeff <[email protected] >>> > >>> >>>> wrote: >>> >>>> >>>> >> > >>> >>>> >>>> >> >> If I attempt to go to a similar URL for any of our >>> repositories >>> >>>> >>>> there is >>> >>>> >>>> >> >> no .indexer or .index path such as: >>> >>>> >>>> >> >> >>> >>>> >>>> >> >> http://archiva/repository/dna-releases/.indexer >>> >>>> >>>> >> >> http://archiva/repository/dna-snapshots/.index >>> >>>> >>>> >> >> http://archiva/repository/dnabackend-releases/.indexer >>> >>>> >>>> >> >> http://archiva/repository/dnabackend-snapshots/.index >>> >>>> >>>> >> >> >>> >>>> >>>> >> >> Is this because I moved them? If so, I am happy to put >>> them >>> >>>> back >>> >>>> >>>> to the >>> >>>> >>>> >> >> normal location, but then what would change to allow >>> multiple >>> >>>> >>>> archiva >>> >>>> >>>> >> >> tomcat servers to use the same 'data' repositories? >>> >>>> >>>> >> >> >>> >>>> >>>> >> >> >>> >>>> >>>> >> >> >>> >>>> >>>> >> >> On Fri, Feb 1, 2013 at 2:10 PM, Olivier Lamy < >>> [email protected] >>> >>>> > >>> >>>> >>>> wrote: >>> >>>> >>>> >> >> >>> >>>> >>>> >> >>> 2013/2/1 Jeff <[email protected]>: >>> >>>> >>>> >> >>> > I'm not sure what you mean by "why you don't access to >>> >>>> indexes >>> >>>> >>>> via >>> >>>> >>>> >> >>> http"... >>> >>>> >>>> >> >>> Something like >>> >>>> >>>> >> >>> >>> >>>> >>>> >> >>> >>>> >>>> >>> >>>> >>> https://archiva-repository.apache.org/archiva/repository/snapshots/.indexer/ >>> >>>> >>>> >> >>> >>> >>>> >>>> >> >>> it's available for all repositories (and for group too >>> since >>> >>>> >>>> 1.4-M2 in >>> >>>> >>>> >> >>> path lie >>> archiva/repository/${grouprepositoryId}/.indexer/ >>> >>>> >>>> >> >>> >>> >>>> >>>> >> >>> Don't know exactly how it works in IDE. But they use >>> remote >>> >>>> indexes >>> >>>> >>>> >> >>> available via http(s) and not file system directories. >>> >>>> >>>> >> >>> ? >>> >>>> >>>> >> >>> >>> >>>> >>>> >> >>> > >>> >>>> >>>> >> >>> > When I setup Archiva running in Tomcat 6 under CentOS >>> 6.2 >>> >>>> Linux, >>> >>>> >>>> I >>> >>>> >>>> >> have >>> >>>> >>>> >> >>> the >>> >>>> >>>> >> >>> > folder structure below: >>> >>>> >>>> >> >>> > >>> >>>> >>>> >> >>> > /archiva >>> >>>> >>>> >> >>> > /conf >>> >>>> >>>> >> >>> > /data >>> >>>> >>>> >> >>> > /derbydb >>> >>>> >>>> >> >>> > /indexes >>> >>>> >>>> >> >>> > /logs >>> >>>> >>>> >> >>> > >>> >>>> >>>> >> >>> > I think the only thing that is not standard is the >>> 'indexes' >>> >>>> >>>> >> directory. >>> >>>> >>>> >> >>> I >>> >>>> >>>> >> >>> > was trying to setup Archiva and anticipate possibly >>> needing >>> >>>> to >>> >>>> >>>> scale >>> >>>> >>>> >> >>> > horizontally by adding multiple front end servers >>> behind >>> >>>> our load >>> >>>> >>>> >> >>> balancer. >>> >>>> >>>> >> >>> > I read somewhere (I thought) that the indexes are >>> >>>> specific to >>> >>>> >>>> each >>> >>>> >>>> >> >>> front >>> >>>> >>>> >> >>> > end server, but that the repository data could be >>> shared, >>> >>>> so I >>> >>>> >>>> >> mounted >>> >>>> >>>> >> >>> the >>> >>>> >>>> >> >>> > /archiva/data folder as a remote NFS mount. The rest >>> of the >>> >>>> >>>> folders >>> >>>> >>>> >> >>> above >>> >>>> >>>> >> >>> > are located physically on the archiva server. >>> >>>> >>>> >> >>> > >>> >>>> >>>> >> >>> > For each repository, the index folder is set to >>> something >>> >>>> like: >>> >>>> >>>> >> >>> > >>> >>>> >>>> >> >>> > /archiva/indexes/team1-releases >>> >>>> >>>> >> >>> > /archiva/indexes/team1-snapshots >>> >>>> >>>> >> >>> > >>> >>>> >>>> >> >>> > But my understanding is that these indexes are the >>> internal >>> >>>> >>>> Archiva >>> >>>> >>>> >> >>> > indexes, not the publicly consumable indexes. Nowhere >>> in >>> >>>> the >>> >>>> >>>> >> >>> > /archiva/data/repositories/team1-releases or other >>> >>>> repositories >>> >>>> >>>> are >>> >>>> >>>> >> >>> there >>> >>>> >>>> >> >>> > any .index folders. >>> >>>> >>>> >> >>> > >>> >>>> >>>> >> >>> > I also have a single repository group that proxies all >>> >>>> internal >>> >>>> >>>> and >>> >>>> >>>> >> >>> > externally proxied repositories under a single virtual >>> >>>> >>>> repository and >>> >>>> >>>> >> >>> there >>> >>>> >>>> >> >>> > are no indexes consolidated under that repository group >>> >>>> either >>> >>>> >>>> which >>> >>>> >>>> >> is >>> >>>> >>>> >> >>> > what I thought was added in 1.4-M2 (the ability to >>> >>>> consolidate >>> >>>> >>>> >> indexes). >>> >>>> >>>> >> >>> > >>> >>>> >>>> >> >>> > Inside of /archiva/indexes, each repository index does >>> have >>> >>>> a >>> >>>> >>>> bunch >>> >>>> >>>> >> of >>> >>>> >>>> >> >>> > files that look like: >>> >>>> >>>> >> >>> > >>> >>>> >>>> >> >>> > _7.fdt >>> >>>> >>>> >> >>> > _7.fdx >>> >>>> >>>> >> >>> > ... >>> >>>> >>>> >> >>> > nexux-maven-reposotory-index.6948.gz >>> >>>> >>>> >> >>> > nexux-maven-reposotory-index.6949.gz >>> >>>> >>>> >> >>> > nexux-maven-reposotory-index.6950.gz >>> >>>> >>>> >> >>> > nexux-maven-reposotory-index.6951.gz >>> >>>> >>>> >> >>> > ... >>> >>>> >>>> >> >>> > >>> >>>> >>>> >> >>> > So something is generating these (I assume correctly). >>> >>>> >>>> >> >>> > >>> >>>> >>>> >> >>> > Also in each repository, the setting named "Skip Packed >>> >>>> Index >>> >>>> >>>> >> creation" >>> >>>> >>>> >> >>> is >>> >>>> >>>> >> >>> > NOT checked. >>> >>>> >>>> >> >>> >>> >>>> >>>> >> >>> Those nexux-maven-reposotory-index.xxx.gz files is >>> incremental >>> >>>> >>>> >> >>> generation. see a file called >>> >>>> >>>> >> >>> nexus-maven-repository-index-packer.properties which >>> contains >>> >>>> some >>> >>>> >>>> >> >>> metadatas on incremental generation. >>> >>>> >>>> >> >>> > >>> >>>> >>>> >> >>> > Hopefully that clarifies things and we can work this >>> out >>> >>>> and get >>> >>>> >>>> it >>> >>>> >>>> >> >>> > addressed as needed for 1.4-M4 :-). >>> >>>> >>>> >> >>> > >>> >>>> >>>> >> >>> > >>> >>>> >>>> >> >>> > On Fri, Feb 1, 2013 at 9:51 AM, Olivier Lamy < >>> >>>> [email protected]> >>> >>>> >>>> >> wrote: >>> >>>> >>>> >> >>> > >>> >>>> >>>> >> >>> >> maybe there is an issue and setup indexes to a >>> dedicated >>> >>>> >>>> location >>> >>>> >>>> >> >>> doesn't >>> >>>> >>>> >> >>> >> work. >>> >>>> >>>> >> >>> >> Is there any indexes files in archiva installation ? >>> >>>> >>>> >> >>> >> >>> >>>> >>>> >> >>> >> BTW why you don't access to indexes via http ? >>> >>>> >>>> >> >>> >> >>> >>>> >>>> >> >>> >> 2013/2/1 Jeff <[email protected]>: >>> >>>> >>>> >> >>> >> > Yep, multiple times. The server has been up and >>> running >>> >>>> for a >>> >>>> >>>> >> >>> number of >>> >>>> >>>> >> >>> >> > months. >>> >>>> >>>> >> >>> >> > On Feb 1, 2013 2:33 AM, "Olivier Lamy" < >>> [email protected] >>> >>>> > >>> >>>> >>>> wrote: >>> >>>> >>>> >> >>> >> > >>> >>>> >>>> >> >>> >> >> Did you try a full scan ? >>> >>>> >>>> >> >>> >> >> >>> >>>> >>>> >> >>> >> >> >>> >>>> >>>> >> >>> >> >> 2013/1/31 Jeff <[email protected]>: >>> >>>> >>>> >> >>> >> >> > I'm currently using 1.4-M3 and have configured my >>> >>>> Archiva >>> >>>> >>>> >> indexes >>> >>>> >>>> >> >>> to >>> >>>> >>>> >> >>> >> >> point >>> >>>> >>>> >> >>> >> >> > to a dedicated index folder located on the local >>> host >>> >>>> and >>> >>>> >>>> put >>> >>>> >>>> >> the >>> >>>> >>>> >> >>> data >>> >>>> >>>> >> >>> >> >> > folder on a shared NFS mount. >>> >>>> >>>> >> >>> >> >> > >>> >>>> >>>> >> >>> >> >> > However, the .index folder for local repos is not >>> >>>> getting >>> >>>> >>>> >> created >>> >>>> >>>> >> >>> and >>> >>>> >>>> >> >>> >> >> thus >>> >>>> >>>> >> >>> >> >> > my IDE's can only see versions of what I have in >>> my >>> >>>> local >>> >>>> >>>> .m2 >>> >>>> >>>> >> >>> >> repository. >>> >>>> >>>> >> >>> >> >> > >>> >>>> >>>> >> >>> >> >> > I don't see anything in the logs suggesting that >>> it is >>> >>>> >>>> failing. >>> >>>> >>>> >> >>> >> >> > >>> >>>> >>>> >> >>> >> >> > Thoughts? >>> >>>> >>>> >> >>> >> >> > >>> >>>> >>>> >> >>> >> >> > -- >>> >>>> >>>> >> >>> >> >> > Jeff Vincent >>> >>>> >>>> >> >>> >> >> > [email protected] >>> >>>> >>>> >> >>> >> >> > See my LinkedIn profile at: >>> >>>> >>>> >> >>> >> >> > http://www.linkedin.com/in/rjeffreyvincent >>> >>>> >>>> >> >>> >> >> > I ♥ DropBox <http://db.tt/9O6LfBX> !! >>> >>>> >>>> >> >>> >> >> >>> >>>> >>>> >> >>> >> >> >>> >>>> >>>> >> >>> >> >> >>> >>>> >>>> >> >>> >> >> -- >>> >>>> >>>> >> >>> >> >> Olivier Lamy >>> >>>> >>>> >> >>> >> >> Talend: http://coders.talend.com >>> >>>> >>>> >> >>> >> >> http://twitter.com/olamy | >>> http://linkedin.com/in/olamy >>> >>>> >>>> >> >>> >> >> >>> >>>> >>>> >> >>> >> >>> >>>> >>>> >> >>> >> >>> >>>> >>>> >> >>> >> >>> >>>> >>>> >> >>> >> -- >>> >>>> >>>> >> >>> >> Olivier Lamy >>> >>>> >>>> >> >>> >> Talend: http://coders.talend.com >>> >>>> >>>> >> >>> >> http://twitter.com/olamy | >>> http://linkedin.com/in/olamy >>> >>>> >>>> >> >>> >> >>> >>>> >>>> >> >>> > >>> >>>> >>>> >> >>> > >>> >>>> >>>> >> >>> > >>> >>>> >>>> >> >>> > -- >>> >>>> >>>> >> >>> > Jeff Vincent >>> >>>> >>>> >> >>> > [email protected] >>> >>>> >>>> >> >>> > See my LinkedIn profile at: >>> >>>> >>>> >> >>> > http://www.linkedin.com/in/rjeffreyvincent >>> >>>> >>>> >> >>> > I ♥ DropBox <http://db.tt/9O6LfBX> !! >>> >>>> >>>> >> >>> >>> >>>> >>>> >> >>> >>> >>>> >>>> >> >>> >>> >>>> >>>> >> >>> -- >>> >>>> >>>> >> >>> Olivier Lamy >>> >>>> >>>> >> >>> Talend: http://coders.talend.com >>> >>>> >>>> >> >>> http://twitter.com/olamy | http://linkedin.com/in/olamy >>> >>>> >>>> >> >>> >>> >>>> >>>> >> >> >>> >>>> >>>> >> >> >>> >>>> >>>> >> >> >>> >>>> >>>> >> >> -- >>> >>>> >>>> >> >> Jeff Vincent >>> >>>> >>>> >> >> [email protected] >>> >>>> >>>> >> >> See my LinkedIn profile at: >>> >>>> >>>> >> >> http://www.linkedin.com/in/rjeffreyvincent >>> >>>> >>>> >> >> I ♥ DropBox <http://db.tt/9O6LfBX> !! >>> >>>> >>>> >> >> >>> >>>> >>>> >> > >>> >>>> >>>> >> > >>> >>>> >>>> >> > >>> >>>> >>>> >> > -- >>> >>>> >>>> >> > Jeff Vincent >>> >>>> >>>> >> > [email protected] >>> >>>> >>>> >> > See my LinkedIn profile at: >>> >>>> >>>> >> > http://www.linkedin.com/in/rjeffreyvincent >>> >>>> >>>> >> > I ♥ DropBox <http://db.tt/9O6LfBX> !! >>> >>>> >>>> >> >>> >>>> >>>> >> >>> >>>> >>>> >> >>> >>>> >>>> >> -- >>> >>>> >>>> >> Olivier Lamy >>> >>>> >>>> >> Talend: http://coders.talend.com >>> >>>> >>>> >> http://twitter.com/olamy | http://linkedin.com/in/olamy >>> >>>> >>>> >> >>> >>>> >>>> > >>> >>>> >>>> > >>> >>>> >>>> > >>> >>>> >>>> > -- >>> >>>> >>>> > Jeff Vincent >>> >>>> >>>> > [email protected] >>> >>>> >>>> > See my LinkedIn profile at: >>> >>>> >>>> > http://www.linkedin.com/in/rjeffreyvincent >>> >>>> >>>> > I ♥ DropBox <http://db.tt/9O6LfBX> !! >>> >>>> >>>> >>> >>>> >>>> >>> >>>> >>>> >>> >>>> >>>> -- >>> >>>> >>>> Olivier Lamy >>> >>>> >>>> Talend: http://coders.talend.com >>> >>>> >>>> http://twitter.com/olamy | http://linkedin.com/in/olamy >>> >>>> >>>> >>> >>>> >>> >>> >>>> >>> >>> >>>> >>> >>> >>>> >>> -- >>> >>>> >>> Jeff Vincent >>> >>>> >>> [email protected] >>> >>>> >>> See my LinkedIn profile at: >>> >>>> >>> http://www.linkedin.com/in/rjeffreyvincent >>> >>>> >>> I ♥ DropBox <http://db.tt/9O6LfBX> !! >>> >>>> >>> >>> >>>> >> >>> >>>> >> >>> >>>> >> >>> >>>> >> -- >>> >>>> >> Jeff Vincent >>> >>>> >> [email protected] >>> >>>> >> See my LinkedIn profile at: >>> >>>> >> http://www.linkedin.com/in/rjeffreyvincent >>> >>>> >> I ♥ DropBox <http://db.tt/9O6LfBX> !! >>> >>>> > >>> >>>> > >>> >>>> > >>> >>>> > -- >>> >>>> > Olivier Lamy >>> >>>> > Talend: http://coders.talend.com >>> >>>> > http://twitter.com/olamy | http://linkedin.com/in/olamy >>> >>>> >>> >>>> >>> >>>> >>> >>>> -- >>> >>>> Olivier Lamy >>> >>>> Talend: http://coders.talend.com >>> >>>> http://twitter.com/olamy | http://linkedin.com/in/olamy >>> >>>> >>> >>>> 2013/2/6 Olivier Lamy <[email protected]>: >>> >>>> > Hi, >>> >>>> > Apologize for delay. >>> >>>> > >>> >>>> > 2013/2/4 Jeff <[email protected]>: >>> >>>> >> I'm now trying to switch up the index directories on my >>> repositories >>> >>>> and am >>> >>>> >> banging my head. I've simply removed the "Index Directory" >>> setting on >>> >>>> my >>> >>>> >> repos and I see the .indexer folder getting created. Which is >>> good. >>> >>>> >> >>> >>>> >> However, according to >>> >>>> >> >>> http://archiva.apache.org/docs/1.4-M3/adminguide/repositories.html, it >>> >>>> >> states: >>> >>>> >> >>> >>>> >> *Another directory named .index is also created at the root of the >>> >>>> >> repository directory. This is not configurable though as it >>> contains >>> >>>> the >>> >>>> >> packaged/bundled index which is consumed by different consumers >>> of the >>> >>>> >> index such as M2Eclipse. * >>> >>>> > doh documentation is wrong (we use .indexer) >>> >>>> >> >>> >>>> >> >>> >>>> >> However, it is NOT getting created. I've restarted tomcat, I've >>> >>>> forced a >>> >>>> >> full index scan on every repository as well as a Directory scan. >>> >>>> >> >>> >>>> >> The above statement also lead me to believe that regardless of the >>> >>>> location >>> >>>> >> of ".indexer" that ".index" would still get created at the root >>> but it >>> >>>> >> isn't. >>> >>>> >> >>> >>>> >> On one repository I tried setting "Index Directory" to ".index", >>> but I >>> >>>> get >>> >>>> >> an error that it can't create "/usr/share/tomcat6/.index". >>> >>>> > A bit weird. >>> >>>> > What is -Dappserver.base value ? >>> >>>> > BTW I agree there are some possible with relative path (I fixed >>> some in >>> >>>> trunk). >>> >>>> > But while studying your case, I think this need more >>> >>>> attention/debugging. >>> >>>> > I'm on it. I will keep you informed as soon I have fixed (or at >>> least >>> >>>> > understood the issue :-)) that in source code. >>> >>>> >> >>> >>>> >> Thanks for any additional direction... >>> >>>> >> >>> >>>> >> >>> >>>> >> On Mon, Feb 4, 2013 at 8:47 AM, Jeff <[email protected]> >>> wrote: >>> >>>> >> >>> >>>> >>> I don't *yet* have a need, but our user base is growing and so >>> is our >>> >>>> >>> CI/CD pipeline (number of GO and Jenkins build agents/slaves) >>> and I >>> >>>> wanted >>> >>>> >>> to plan ahead. I am trying to find the document that talked >>> about >>> >>>> keeping >>> >>>> >>> indexes local while allowing a shared repo, but I have been >>> >>>> unsuccessful >>> >>>> >>> thus far. Maybe I dreamed it up. :-) >>> >>>> >>> >>> >>>> >>> Thanks for your help. >>> >>>> >>> >>> >>>> >>> >>> >>>> >>> On Mon, Feb 4, 2013 at 2:56 AM, Olivier Lamy <[email protected]> >>> >>>> wrote: >>> >>>> >>> >>> >>>> >>>> complicated to have scabality when serving files :-( >>> >>>> >>>> we don't (yet) any sync possible (that's something we start >>> >>>> discussing >>> >>>> >>>> on dev@ with maybe using new Apache project called helix). >>> >>>> >>>> With your setup each repository will be independent. >>> >>>> >>>> Do you have so many users to need that ? >>> >>>> >>>> >>> >>>> >>>> 2013/2/2 Jeff <[email protected]>: >>> >>>> >>>> > I will do that. >>> >>>> >>>> > >>> >>>> >>>> > However, how do I configure the repository to support the >>> >>>> previously >>> >>>> >>>> > mentioned horizontal scaling with a shared repository? >>> >>>> >>>> > >>> >>>> >>>> > >>> >>>> >>>> > On Sat, Feb 2, 2013 at 10:26 AM, Olivier Lamy < >>> [email protected]> >>> >>>> wrote: >>> >>>> >>>> > >>> >>>> >>>> >> our default is .indexer. >>> >>>> >>>> >> Oh I believe using an absolute path for the index location >>> doesn't >>> >>>> >>>> >> work and it's not available via http(s). >>> >>>> >>>> >> Can you simply change the index path to .index or leave it >>> blank >>> >>>> >>>> >> (default is .indexer) ? >>> >>>> >>>> >> As it that will be available as this one >>> >>>> >>>> >> >>> >>>> >>>> >>> >>>> >>> https://archiva-repository.apache.org/archiva/repository/snapshots/.indexer >>> >>>> >>>> >> >>> >>>> >>>> >> >>> >>>> >>>> >> >>> >>>> >>>> >> 2013/2/2 Jeff <[email protected]>: >>> >>>> >>>> >> > Also, isn't the default index directory supposed to be >>> .index? >>> >>>> >>>> That's >>> >>>> >>>> >> what >>> >>>> >>>> >> > it seems to be on Maven Central. >>> >>>> >>>> >> > >>> >>>> >>>> >> > http://repo.maven.apache.org/maven2/.index/ >>> >>>> >>>> >> > >>> >>>> >>>> >> > Thanks. >>> >>>> >>>> >> > >>> >>>> >>>> >> > >>> >>>> >>>> >> > On Fri, Feb 1, 2013 at 3:28 PM, Jeff <[email protected] >>> > >>> >>>> wrote: >>> >>>> >>>> >> > >>> >>>> >>>> >> >> If I attempt to go to a similar URL for any of our >>> repositories >>> >>>> >>>> there is >>> >>>> >>>> >> >> no .indexer or .index path such as: >>> >>>> >>>> >> >> >>> >>>> >>>> >> >> http://archiva/repository/dna-releases/.indexer >>> >>>> >>>> >> >> http://archiva/repository/dna-snapshots/.index >>> >>>> >>>> >> >> http://archiva/repository/dnabackend-releases/.indexer >>> >>>> >>>> >> >> http://archiva/repository/dnabackend-snapshots/.index >>> >>>> >>>> >> >> >>> >>>> >>>> >> >> Is this because I moved them? If so, I am happy to put >>> them >>> >>>> back >>> >>>> >>>> to the >>> >>>> >>>> >> >> normal location, but then what would change to allow >>> multiple >>> >>>> >>>> archiva >>> >>>> >>>> >> >> tomcat servers to use the same 'data' repositories? >>> >>>> >>>> >> >> >>> >>>> >>>> >> >> >>> >>>> >>>> >> >> >>> >>>> >>>> >> >> On Fri, Feb 1, 2013 at 2:10 PM, Olivier Lamy < >>> [email protected] >>> >>>> > >>> >>>> >>>> wrote: >>> >>>> >>>> >> >> >>> >>>> >>>> >> >>> 2013/2/1 Jeff <[email protected]>: >>> >>>> >>>> >> >>> > I'm not sure what you mean by "why you don't access to >>> >>>> indexes >>> >>>> >>>> via >>> >>>> >>>> >> >>> http"... >>> >>>> >>>> >> >>> Something like >>> >>>> >>>> >> >>> >>> >>>> >>>> >> >>> >>>> >>>> >>> >>>> >>> https://archiva-repository.apache.org/archiva/repository/snapshots/.indexer/ >>> >>>> >>>> >> >>> >>> >>>> >>>> >> >>> it's available for all repositories (and for group too >>> since >>> >>>> >>>> 1.4-M2 in >>> >>>> >>>> >> >>> path lie >>> archiva/repository/${grouprepositoryId}/.indexer/ >>> >>>> >>>> >> >>> >>> >>>> >>>> >> >>> Don't know exactly how it works in IDE. But they use >>> remote >>> >>>> indexes >>> >>>> >>>> >> >>> available via http(s) and not file system directories. >>> >>>> >>>> >> >>> ? >>> >>>> >>>> >> >>> >>> >>>> >>>> >> >>> > >>> >>>> >>>> >> >>> > When I setup Archiva running in Tomcat 6 under CentOS >>> 6.2 >>> >>>> Linux, >>> >>>> >>>> I >>> >>>> >>>> >> have >>> >>>> >>>> >> >>> the >>> >>>> >>>> >> >>> > folder structure below: >>> >>>> >>>> >> >>> > >>> >>>> >>>> >> >>> > /archiva >>> >>>> >>>> >> >>> > /conf >>> >>>> >>>> >> >>> > /data >>> >>>> >>>> >> >>> > /derbydb >>> >>>> >>>> >> >>> > /indexes >>> >>>> >>>> >> >>> > /logs >>> >>>> >>>> >> >>> > >>> >>>> >>>> >> >>> > I think the only thing that is not standard is the >>> 'indexes' >>> >>>> >>>> >> directory. >>> >>>> >>>> >> >>> I >>> >>>> >>>> >> >>> > was trying to setup Archiva and anticipate possibly >>> needing >>> >>>> to >>> >>>> >>>> scale >>> >>>> >>>> >> >>> > horizontally by adding multiple front end servers >>> behind >>> >>>> our load >>> >>>> >>>> >> >>> balancer. >>> >>>> >>>> >> >>> > I read somewhere (I thought) that the indexes are >>> >>>> specific to >>> >>>> >>>> each >>> >>>> >>>> >> >>> front >>> >>>> >>>> >> >>> > end server, but that the repository data could be >>> shared, >>> >>>> so I >>> >>>> >>>> >> mounted >>> >>>> >>>> >> >>> the >>> >>>> >>>> >> >>> > /archiva/data folder as a remote NFS mount. The rest >>> of the >>> >>>> >>>> folders >>> >>>> >>>> >> >>> above >>> >>>> >>>> >> >>> > are located physically on the archiva server. >>> >>>> >>>> >> >>> > >>> >>>> >>>> >> >>> > For each repository, the index folder is set to >>> something >>> >>>> like: >>> >>>> >>>> >> >>> > >>> >>>> >>>> >> >>> > /archiva/indexes/team1-releases >>> >>>> >>>> >> >>> > /archiva/indexes/team1-snapshots >>> >>>> >>>> >> >>> > >>> >>>> >>>> >> >>> > But my understanding is that these indexes are the >>> internal >>> >>>> >>>> Archiva >>> >>>> >>>> >> >>> > indexes, not the publicly consumable indexes. Nowhere >>> in >>> >>>> the >>> >>>> >>>> >> >>> > /archiva/data/repositories/team1-releases or other >>> >>>> repositories >>> >>>> >>>> are >>> >>>> >>>> >> >>> there >>> >>>> >>>> >> >>> > any .index folders. >>> >>>> >>>> >> >>> > >>> >>>> >>>> >> >>> > I also have a single repository group that proxies all >>> >>>> internal >>> >>>> >>>> and >>> >>>> >>>> >> >>> > externally proxied repositories under a single virtual >>> >>>> >>>> repository and >>> >>>> >>>> >> >>> there >>> >>>> >>>> >> >>> > are no indexes consolidated under that repository group >>> >>>> either >>> >>>> >>>> which >>> >>>> >>>> >> is >>> >>>> >>>> >> >>> > what I thought was added in 1.4-M2 (the ability to >>> >>>> consolidate >>> >>>> >>>> >> indexes). >>> >>>> >>>> >> >>> > >>> >>>> >>>> >> >>> > Inside of /archiva/indexes, each repository index does >>> have >>> >>>> a >>> >>>> >>>> bunch >>> >>>> >>>> >> of >>> >>>> >>>> >> >>> > files that look like: >>> >>>> >>>> >> >>> > >>> >>>> >>>> >> >>> > _7.fdt >>> >>>> >>>> >> >>> > _7.fdx >>> >>>> >>>> >> >>> > ... >>> >>>> >>>> >> >>> > nexux-maven-reposotory-index.6948.gz >>> >>>> >>>> >> >>> > nexux-maven-reposotory-index.6949.gz >>> >>>> >>>> >> >>> > nexux-maven-reposotory-index.6950.gz >>> >>>> >>>> >> >>> > nexux-maven-reposotory-index.6951.gz >>> >>>> >>>> >> >>> > ... >>> >>>> >>>> >> >>> > >>> >>>> >>>> >> >>> > So something is generating these (I assume correctly). >>> >>>> >>>> >> >>> > >>> >>>> >>>> >> >>> > Also in each repository, the setting named "Skip Packed >>> >>>> Index >>> >>>> >>>> >> creation" >>> >>>> >>>> >> >>> is >>> >>>> >>>> >> >>> > NOT checked. >>> >>>> >>>> >> >>> >>> >>>> >>>> >> >>> Those nexux-maven-reposotory-index.xxx.gz files is >>> incremental >>> >>>> >>>> >> >>> generation. see a file called >>> >>>> >>>> >> >>> nexus-maven-repository-index-packer.properties which >>> contains >>> >>>> some >>> >>>> >>>> >> >>> metadatas on incremental generation. >>> >>>> >>>> >> >>> > >>> >>>> >>>> >> >>> > Hopefully that clarifies things and we can work this >>> out >>> >>>> and get >>> >>>> >>>> it >>> >>>> >>>> >> >>> > addressed as needed for 1.4-M4 :-). >>> >>>> >>>> >> >>> > >>> >>>> >>>> >> >>> > >>> >>>> >>>> >> >>> > On Fri, Feb 1, 2013 at 9:51 AM, Olivier Lamy < >>> >>>> [email protected]> >>> >>>> >>>> >> wrote: >>> >>>> >>>> >> >>> > >>> >>>> >>>> >> >>> >> maybe there is an issue and setup indexes to a >>> dedicated >>> >>>> >>>> location >>> >>>> >>>> >> >>> doesn't >>> >>>> >>>> >> >>> >> work. >>> >>>> >>>> >> >>> >> Is there any indexes files in archiva installation ? >>> >>>> >>>> >> >>> >> >>> >>>> >>>> >> >>> >> BTW why you don't access to indexes via http ? >>> >>>> >>>> >> >>> >> >>> >>>> >>>> >> >>> >> 2013/2/1 Jeff <[email protected]>: >>> >>>> >>>> >> >>> >> > Yep, multiple times. The server has been up and >>> running >>> >>>> for a >>> >>>> >>>> >> >>> number of >>> >>>> >>>> >> >>> >> > months. >>> >>>> >>>> >> >>> >> > On Feb 1, 2013 2:33 AM, "Olivier Lamy" < >>> [email protected] >>> >>>> > >>> >>>> >>>> wrote: >>> >>>> >>>> >> >>> >> > >>> >>>> >>>> >> >>> >> >> Did you try a full scan ? >>> >>>> >>>> >> >>> >> >> >>> >>>> >>>> >> >>> >> >> >>> >>>> >>>> >> >>> >> >> 2013/1/31 Jeff <[email protected]>: >>> >>>> >>>> >> >>> >> >> > I'm currently using 1.4-M3 and have configured my >>> >>>> Archiva >>> >>>> >>>> >> indexes >>> >>>> >>>> >> >>> to >>> >>>> >>>> >> >>> >> >> point >>> >>>> >>>> >> >>> >> >> > to a dedicated index folder located on the local >>> host >>> >>>> and >>> >>>> >>>> put >>> >>>> >>>> >> the >>> >>>> >>>> >> >>> data >>> >>>> >>>> >> >>> >> >> > folder on a shared NFS mount. >>> >>>> >>>> >> >>> >> >> > >>> >>>> >>>> >> >>> >> >> > However, the .index folder for local repos is not >>> >>>> getting >>> >>>> >>>> >> created >>> >>>> >>>> >> >>> and >>> >>>> >>>> >> >>> >> >> thus >>> >>>> >>>> >> >>> >> >> > my IDE's can only see versions of what I have in >>> my >>> >>>> local >>> >>>> >>>> .m2 >>> >>>> >>>> >> >>> >> repository. >>> >>>> >>>> >> >>> >> >> > >>> >>>> >>>> >> >>> >> >> > I don't see anything in the logs suggesting that >>> it is >>> >>>> >>>> failing. >>> >>>> >>>> >> >>> >> >> > >>> >>>> >>>> >> >>> >> >> > Thoughts? >>> >>>> >>>> >> >>> >> >> > >>> >>>> >>>> >> >>> >> >> > -- >>> >>>> >>>> >> >>> >> >> > Jeff Vincent >>> >>>> >>>> >> >>> >> >> > [email protected] >>> >>>> >>>> >> >>> >> >> > See my LinkedIn profile at: >>> >>>> >>>> >> >>> >> >> > http://www.linkedin.com/in/rjeffreyvincent >>> >>>> >>>> >> >>> >> >> > I ♥ DropBox <http://db.tt/9O6LfBX> !! >>> >>>> >>>> >> >>> >> >> >>> >>>> >>>> >> >>> >> >> >>> >>>> >>>> >> >>> >> >> >>> >>>> >>>> >> >>> >> >> -- >>> >>>> >>>> >> >>> >> >> Olivier Lamy >>> >>>> >>>> >> >>> >> >> Talend: http://coders.talend.com >>> >>>> >>>> >> >>> >> >> http://twitter.com/olamy | >>> http://linkedin.com/in/olamy >>> >>>> >>>> >> >>> >> >> >>> >>>> >>>> >> >>> >> >>> >>>> >>>> >> >>> >> >>> >>>> >>>> >> >>> >> >>> >>>> >>>> >> >>> >> -- >>> >>>> >>>> >> >>> >> Olivier Lamy >>> >>>> >>>> >> >>> >> Talend: http://coders.talend.com >>> >>>> >>>> >> >>> >> http://twitter.com/olamy | >>> http://linkedin.com/in/olamy >>> >>>> >>>> >> >>> >> >>> >>>> >>>> >> >>> > >>> >>>> >>>> >> >>> > >>> >>>> >>>> >> >>> > >>> >>>> >>>> >> >>> > -- >>> >>>> >>>> >> >>> > Jeff Vincent >>> >>>> >>>> >> >>> > [email protected] >>> >>>> >>>> >> >>> > See my LinkedIn profile at: >>> >>>> >>>> >> >>> > http://www.linkedin.com/in/rjeffreyvincent >>> >>>> >>>> >> >>> > I ♥ DropBox <http://db.tt/9O6LfBX> !! >>> >>>> >>>> >> >>> >>> >>>> >>>> >> >>> >>> >>>> >>>> >> >>> >>> >>>> >>>> >> >>> -- >>> >>>> >>>> >> >>> Olivier Lamy >>> >>>> >>>> >> >>> Talend: http://coders.talend.com >>> >>>> >>>> >> >>> http://twitter.com/olamy | http://linkedin.com/in/olamy >>> >>>> >>>> >> >>> >>> >>>> >>>> >> >> >>> >>>> >>>> >> >> >>> >>>> >>>> >> >> >>> >>>> >>>> >> >> -- >>> >>>> >>>> >> >> Jeff Vincent >>> >>>> >>>> >> >> [email protected] >>> >>>> >>>> >> >> See my LinkedIn profile at: >>> >>>> >>>> >> >> http://www.linkedin.com/in/rjeffreyvincent >>> >>>> >>>> >> >> I ♥ DropBox <http://db.tt/9O6LfBX> !! >>> >>>> >>>> >> >> >>> >>>> >>>> >> > >>> >>>> >>>> >> > >>> >>>> >>>> >> > >>> >>>> >>>> >> > -- >>> >>>> >>>> >> > Jeff Vincent >>> >>>> >>>> >> > [email protected] >>> >>>> >>>> >> > See my LinkedIn profile at: >>> >>>> >>>> >> > http://www.linkedin.com/in/rjeffreyvincent >>> >>>> >>>> >> > I ♥ DropBox <http://db.tt/9O6LfBX> !! >>> >>>> >>>> >> >>> >>>> >>>> >> >>> >>>> >>>> >> >>> >>>> >>>> >> -- >>> >>>> >>>> >> Olivier Lamy >>> >>>> >>>> >> Talend: http://coders.talend.com >>> >>>> >>>> >> http://twitter.com/olamy | http://linkedin.com/in/olamy >>> >>>> >>>> >> >>> >>>> >>>> > >>> >>>> >>>> > >>> >>>> >>>> > >>> >>>> >>>> > -- >>> >>>> >>>> > Jeff Vincent >>> >>>> >>>> > [email protected] >>> >>>> >>>> > See my LinkedIn profile at: >>> >>>> >>>> > http://www.linkedin.com/in/rjeffreyvincent >>> >>>> >>>> > I ♥ DropBox <http://db.tt/9O6LfBX> !! >>> >>>> >>>> >>> >>>> >>>> >>> >>>> >>>> >>> >>>> >>>> -- >>> >>>> >>>> Olivier Lamy >>> >>>> >>>> Talend: http://coders.talend.com >>> >>>> >>>> http://twitter.com/olamy | http://linkedin.com/in/olamy >>> >>>> >>>> >>> >>>> >>> >>> >>>> >>> >>> >>>> >>> >>> >>>> >>> -- >>> >>>> >>> Jeff Vincent >>> >>>> >>> [email protected] >>> >>>> >>> See my LinkedIn profile at: >>> >>>> >>> http://www.linkedin.com/in/rjeffreyvincent >>> >>>> >>> I ♥ DropBox <http://db.tt/9O6LfBX> !! >>> >>>> >>> >>> >>>> >> >>> >>>> >> >>> >>>> >> >>> >>>> >> -- >>> >>>> >> Jeff Vincent >>> >>>> >> [email protected] >>> >>>> >> See my LinkedIn profile at: >>> >>>> >> http://www.linkedin.com/in/rjeffreyvincent >>> >>>> >> I ♥ DropBox <http://db.tt/9O6LfBX> !! >>> >>>> > >>> >>>> > >>> >>>> > >>> >>>> > -- >>> >>>> > Olivier Lamy >>> >>>> > Talend: http://coders.talend.com >>> >>>> > http://twitter.com/olamy | http://linkedin.com/in/olamy >>> >>>> >>> >>>> >>> >>>> >>> >>>> -- >>> >>>> Olivier Lamy >>> >>>> Talend: http://coders.talend.com >>> >>>> http://twitter.com/olamy | http://linkedin.com/in/olamy >>> >>>> >>> >>> >>> >>> >>> >>> >>> >>> -- >>> >>> Jeff Vincent >>> >>> [email protected] >>> >>> See my LinkedIn profile at: >>> >>> http://www.linkedin.com/in/rjeffreyvincent >>> >>> I ♥ DropBox <http://db.tt/9O6LfBX> !! >>> >>> >>> >> >>> >> >>> >> >>> >> -- >>> >> Jeff Vincent >>> >> [email protected] >>> >> See my LinkedIn profile at: >>> >> http://www.linkedin.com/in/rjeffreyvincent >>> >> I ♥ DropBox <http://db.tt/9O6LfBX> !! >>> > >>> > >>> > >>> > -- >>> > Olivier Lamy >>> > Talend: http://coders.talend.com >>> > http://twitter.com/olamy | http://linkedin.com/in/olamy >>> >>> >>> >>> -- >>> Olivier Lamy >>> Talend: http://coders.talend.com >>> http://twitter.com/olamy | http://linkedin.com/in/olamy >>> >> >> >> >> -- >> Jeff Vincent >> [email protected] >> See my LinkedIn profile at: >> http://www.linkedin.com/in/rjeffreyvincent >> I ♥ DropBox <http://db.tt/9O6LfBX> !! >> > > > > -- > Jeff Vincent > [email protected] > See my LinkedIn profile at: > http://www.linkedin.com/in/rjeffreyvincent > I ♥ DropBox <http://db.tt/9O6LfBX> !! -- Olivier Lamy Talend: http://coders.talend.com http://twitter.com/olamy | http://linkedin.com/in/olamy
