RE: maven indexing tweaks

2023-03-23 Thread Eirik Bakke
ential problem I was imagining is not too relevant. -- Eirik -Original Message- From: Michael Bien Sent: Saturday, March 18, 2023 10:37 PM To: dev@netbeans.apache.org; Eirik Bakke Subject: Re: maven indexing tweaks On 18.03.23 14:41, Eirik Bakke wrote: > - "sliding window" tim

Re: maven indexing tweaks

2023-03-18 Thread Michael Bien
inal Message- From: Michael Bien Sent: Friday, March 17, 2023 8:26 PM To: dev@netbeans.apache.org; Antonio Subject: Re: maven indexing tweaks On 17.03.23 22:38, Antonio wrote: Hi, These are impressive savings! yeah I am pretty happy about the results too. Esp the removal of the sha1 fi

RE: maven indexing tweaks

2023-03-18 Thread Eirik Bakke
s artifact in the cache". -- Eirik -Original Message- From: Michael Bien Sent: Friday, March 17, 2023 8:26 PM To: dev@netbeans.apache.org; Antonio Subject: Re: maven indexing tweaks On 17.03.23 22:38, Antonio wrote: > Hi, > > These are impressive savings! yeah I am pr

Re: maven indexing tweaks

2023-03-17 Thread Michael Bien
On 17.03.23 22:38, Antonio wrote: Hi, These are impressive savings! yeah I am pretty happy about the results too. Esp the removal of the sha1 field had a great effect. Technically we do actually offer this as query through the public API, however, it doesn't appear as anything is using it

Re: maven indexing tweaks

2023-03-17 Thread Antonio
Hi, These are impressive savings! Out of curiosity, we don't build the index incrementally using Maven's IndexReader, do we? That's why we download the whole index, right? Thanks, Antonio [1]

maven indexing tweaks

2023-03-17 Thread Michael Bien
Hello everyone, I experimented a bit with the maven index extraction process and got some pretty good results (I think). There might be a way to filter the index during extraction without noteworthy overhead, which allows the following:  - "sliding window" time filters, e.g drop all