Re: Packages webapp status

2020-02-08 Thread Clement Verna
On Fri, 7 Feb 2020 at 21:50, Richard Fearn  wrote:

> On Mon, 3 Feb 2020 at 17:03, Kevin Fenzi  wrote:
> >
> > Thats... much more harsh than I would agree with. I still use it and
> > find some of its information helpfull.
>
> Sadly it does seem to have got a lot worse recently... I noticed last
> weekend that a few of the packages I maintain (e.g. clide, colordiff,
> perl-App-ccdiff, whowatch) can no longer found.
>
> I remember some tickets being created about this - I'll see if I can
> find them and comment there...
>

Hi all,

The indexing of the packages app full text search database relies almost
only on mdapi [0] to populate the informations. The indexing sends a lot of
requests to mdapi (at least 80 000, 1 for each package and subpackages)
that causes a lot of load on mdapi which in returns makes some of the
requests timeout and fail. I have improved mdapi performance last year [1]
but unfortunately since we have moved it to OpenShift, mdapi is using an
NFS volume mount which is rather slow making the performance improvement
not as significant.

So the current situation is that every time the indexing process run, it is
a little bit of a lottery. Depending on how many requests to mdapi are
failing it will get different results, so a package might suddenly
disappear. There is also a bug that I did not investigate but sometimes a
package has another package description.

All that to say that I think, the indexing process needs to be rewritten or
fix to be less aggressive towards mdapi or to be able to handle failure. I
think it would be nice to have full text search of packages as a different
service providing a simple API so anyone interested can build something
cool using this. I personally don't have the time to look at this, but if
anyone is interested I am happy to answer questions or provide pointers
about the current process.

Hope this was an useful explanation :-)

[0] - https://mdapi.fedoraproject.org/
[1] - https://communityblog.fedoraproject.org/speeding-up-mdapi/

>
> Rich
>
> --
> Richard Fearn
> richardfe...@gmail.com
> ___
> devel mailing list -- devel@lists.fedoraproject.org
> To unsubscribe send an email to devel-le...@lists.fedoraproject.org
> Fedora Code of Conduct:
> https://docs.fedoraproject.org/en-US/project/code-of-conduct/
> List Guidelines: https://fedoraproject.org/wiki/Mailing_list_guidelines
> List Archives:
> https://lists.fedoraproject.org/archives/list/devel@lists.fedoraproject.org
>
___
devel mailing list -- devel@lists.fedoraproject.org
To unsubscribe send an email to devel-le...@lists.fedoraproject.org
Fedora Code of Conduct: 
https://docs.fedoraproject.org/en-US/project/code-of-conduct/
List Guidelines: https://fedoraproject.org/wiki/Mailing_list_guidelines
List Archives: 
https://lists.fedoraproject.org/archives/list/devel@lists.fedoraproject.org


Re: Packages webapp status

2020-02-07 Thread Richard Fearn
On Mon, 3 Feb 2020 at 17:03, Kevin Fenzi  wrote:
>
> Thats... much more harsh than I would agree with. I still use it and
> find some of its information helpfull.

Sadly it does seem to have got a lot worse recently... I noticed last
weekend that a few of the packages I maintain (e.g. clide, colordiff,
perl-App-ccdiff, whowatch) can no longer found.

I remember some tickets being created about this - I'll see if I can
find them and comment there...

Rich

-- 
Richard Fearn
richardfe...@gmail.com
___
devel mailing list -- devel@lists.fedoraproject.org
To unsubscribe send an email to devel-le...@lists.fedoraproject.org
Fedora Code of Conduct: 
https://docs.fedoraproject.org/en-US/project/code-of-conduct/
List Guidelines: https://fedoraproject.org/wiki/Mailing_list_guidelines
List Archives: 
https://lists.fedoraproject.org/archives/list/devel@lists.fedoraproject.org


Re: Packages webapp status

2020-02-03 Thread Kevin Fenzi
On Fri, Jan 31, 2020 at 01:37:36AM -0500, Elliott Sales de Andrade wrote:
> On Thu, 30 Jan 2020 at 08:03, Neal Gompa  wrote:
> >
> > On Thu, Jan 30, 2020 at 6:40 AM IƱaki Ucar  wrote:
> > >
> > > On Wed, 29 Jan 2020 at 23:23, Leigh Griffin  wrote:
> > > >
> > > > I suspect that a bulk of our users are similar to you. Given that you 
> > > > are engaged on the thread (thank you!) what is your day to day needs? 
> > > > What features are part of your usage and interaction? What's missing or 
> > > > what would you like to see added? Your voice here can help represent 
> > > > that group and is most welcome.
> > >
> > > I'd say that if you manage to accommodate the more complicated
> > > workflows, the basic one is covered. Beyond that, I really like the
> > > table that is displayed in src.fp.o for every package, because in a
> > > single glance you can tell which one is the stable version and the
> > > version in testing for every release. I really like the links to Koji,
> > > Bodhi... integrated just above the table. And I really really like the
> > > Fedora Packages app, but it seems to be dead.
> > >
> > > In summary, package maintainance has many pieces (dist-git, builders,
> > > update system, bugzilla, QA, CI...), and a "control panel" like Fedora
> > > Packages is very useful, I think.
> > >
> >
> > The Packages app was being rewritten by Miroslav Suchy:
> > https://github.com/xsuchy/fedora-packages-ng
> >
> > I don't know if it's ready yet to replace the existing one, though.
> >
> 
> I don't know what the status of the replacement is, but when I go to

Hopefully Miroslav can fill us in on that.

> Packages, 50% of what I look for is missing and 50% is just wrong.
> This is less than useless. Any prospective Fedora user won't even
> bother installing it if they can't find out whether their favourite
> application is available. We might as well just turn Packages off.

Thats... much more harsh than I would agree with. I still use it and
find some of its information helpfull. 

kevin


signature.asc
Description: PGP signature
___
devel mailing list -- devel@lists.fedoraproject.org
To unsubscribe send an email to devel-le...@lists.fedoraproject.org
Fedora Code of Conduct: 
https://docs.fedoraproject.org/en-US/project/code-of-conduct/
List Guidelines: https://fedoraproject.org/wiki/Mailing_list_guidelines
List Archives: 
https://lists.fedoraproject.org/archives/list/devel@lists.fedoraproject.org