Re: Local system program analytics

2018-07-12 Thread Cindy-Sue Causey
On 7/12/18, to...@tuxteam.de  wrote:
> -BEGIN PGP SIGNED MESSAGE-
> Hash: SHA1
>
> On Wed, Jul 11, 2018 at 03:45:18PM +0200, Mirko Parthey wrote:
>> On Wed, Jul 11, 2018 at 07:18:55AM -0400, David Maulik wrote:
>> > Is there any program that can show me the programs on my system I use
>> > the most?
>> > I'm looking for something that can help me trim unneeded/unused packages
>> > as
>> > well as show me which programs I use the most to help inform
>> > support/donation
>> > decisions.
>>
>> You could try BSD process accounting. The Debian kernels have it built
>> in,
>> and the userspace tools such as "sa" can be found in the "acct" package.
>
> So the programs which burn most CPU will get most sponsoring ;-)
>
> Don't get me wrong -- I think your answer ist a good data point.
> I just wanted to illustrate how difficult a "good" answer to the
> OP's seemingly simple question is...


Agreed on a seemingly simple so is not when one takes into account all
that is going on under the hood.

For some reason, your response then made me think... a close second
might be something that monitors activity on...

/usr/bin; /usr/sbin; etc...

?

OR NOT. :)

That would take into account the various ways various users choose to
access packages throughout every day, e.g. via Applications menu and
terminal command line...

Also while playing with my own new 6 (?) button mouse, I encountered
wmbutton which turned out to be another way to open programs

Cindy :)
-- 
Cindy-Sue Causey
Talking Rock, Pickens County, Georgia, USA

* runs with duct tape *



Re: Local system program analytics

2018-07-12 Thread Mirko Parthey
On Thu, Jul 12, 2018 at 10:09:10AM +0200, to...@tuxteam.de wrote:
> So the programs which burn most CPU will get most sponsoring ;-)

Maybe wall-clock time spent is a suitable measure?
sa --sort-real-time | head

> I just wanted to illustrate how difficult a "good" answer to the
> OP's seemingly simple question is...

I agree.

Mirko



Re: Local system program analytics

2018-07-12 Thread tomas
-BEGIN PGP SIGNED MESSAGE-
Hash: SHA1

On Wed, Jul 11, 2018 at 08:52:54AM -0400, David Maulik wrote:
> On 7/11/2018 5:55 AM, to...@tuxteam.de wrote:
> 
> > On Wed, Jul 11, 2018 at 09:41:39PM +1000, Zenaan Harkness wrote:
> >
> > [...]
> >
> >> IDK, except there is a distro-wide popcon:
> >> https://popcon.debian.org/
> >
> > Yeah, only that popcon gathers analytics on what packages people
> > install (to guide decisions on, for example, what should go in
> > the first "CD").
> >
> > Cheers
> > -- tomás
> 
> So I looked at the popcon README https://popcon.debian.org/README and much to 
> my surprise popcon has the functionality to generate a rudimentary list of 
> recently used programs.

[I assume you intended to CC the list -- there's much more
knowledge "out there" than would fit in my humble skull]

> For example,
>   popularity-contest | grep ''
> will show you a list of packages you haven't used in a while.  Note that
> this output isn't totally accurate: some packages appear "old" but you can't
> remove them because other (non-old) packages depend on them.  Shared library
> packages are particularly bad this way because it's impossible to tell when
> a library was last used.

See? I learnt something new: popcon gathers statistics on when something
was "used"... thanks for that insight.

> It looks like I still have a little bit of research to do to get the fine 
> granular information I was looking for but I think I can start to work with 
> this information. With the help suggestions by Tomas about SystemTap I will 
> see if I can get what I am looking for, and maybe next time I will RTFM.

Yes. Definitely an interesting research topic. Obviously "usage"
or "relevance" in this context is at least a multi-dimensional
property.

I'd be interested in the conclusions you reach!

Cheers
- -- tomás
-BEGIN PGP SIGNATURE-
Version: GnuPG v1.4.12 (GNU/Linux)

iEYEARECAAYFAltHDpkACgkQBcgs9XrR2kYucwCfZ0k0GVsSmUCD/O8zCzsWISyS
gkIAn0lF4YTh16l8sc81ixR0EY4kNLl1
=E0Gj
-END PGP SIGNATURE-



Re: Local system program analytics

2018-07-12 Thread tomas
-BEGIN PGP SIGNED MESSAGE-
Hash: SHA1

On Wed, Jul 11, 2018 at 03:45:18PM +0200, Mirko Parthey wrote:
> On Wed, Jul 11, 2018 at 07:18:55AM -0400, David Maulik wrote:
> > Is there any program that can show me the programs on my system I use the 
> > most?
> > I'm looking for something that can help me trim unneeded/unused packages as
> > well as show me which programs I use the most to help inform 
> > support/donation
> > decisions.
> 
> You could try BSD process accounting. The Debian kernels have it built in,
> and the userspace tools such as "sa" can be found in the "acct" package.

So the programs which burn most CPU will get most sponsoring ;-)

Don't get me wrong -- I think your answer ist a good data point.
I just wanted to illustrate how difficult a "good" answer to the
OP's seemingly simple question is...

Cheers
- -- tomás
-BEGIN PGP SIGNATURE-
Version: GnuPG v1.4.12 (GNU/Linux)

iEYEARECAAYFAltHDKYACgkQBcgs9XrR2kY7+QCeMM5CZAIfx/ezmYx/LrcaOAcx
0XwAn0PjY9QTFghMWG9HoawUrafXrPeY
=Nq+q
-END PGP SIGNATURE-



Re: Local system program analytics

2018-07-11 Thread Mirko Parthey
On Wed, Jul 11, 2018 at 07:18:55AM -0400, David Maulik wrote:
> Is there any program that can show me the programs on my system I use the 
> most?
> I'm looking for something that can help me trim unneeded/unused packages as
> well as show me which programs I use the most to help inform support/donation
> decisions.

You could try BSD process accounting. The Debian kernels have it built in,
and the userspace tools such as "sa" can be found in the "acct" package.



Re: Local system program analytics

2018-07-11 Thread tomas
-BEGIN PGP SIGNED MESSAGE-
Hash: SHA1

On Wed, Jul 11, 2018 at 09:41:39PM +1000, Zenaan Harkness wrote:

[...]

> IDK, except there is a distro-wide popcon:
> https://popcon.debian.org/

Yeah, only that popcon gathers analytics on what packages people
install (to guide decisions on, for example, what should go in
the first "CD").

Cheers
- -- tomás
-BEGIN PGP SIGNATURE-
Version: GnuPG v1.4.12 (GNU/Linux)

iEYEARECAAYFAltF8EEACgkQBcgs9XrR2kZ//QCfYUQGDcndYhU8PIbvQLVAyMAF
02IAn0zG5y3dirT7KGaUB+BFSljSN+S3
=azT7
-END PGP SIGNATURE-



Re: Local system program analytics

2018-07-11 Thread tomas
-BEGIN PGP SIGNED MESSAGE-
Hash: SHA1

On Wed, Jul 11, 2018 at 07:18:55AM -0400, David Maulik wrote:
> Is there any program that can show me the programs on my system
> I use the most?
[...]

Define "use most".

OK, OK. This was a snotty answer, but there's something behind
it :-)

The system has a very different view of "using" than you have:
it can count how often a binary is invoked. It can measure
for how long a binary runs (init is started just once every
time you start your computer, but runs all the time while your
computer is up, to name one extreme example. Likewise a database
server or a web server. If you're a command line user, "ls"
will be a binary you are invoking lots of times during one session;
a shell, or Perl, or Python will be used innumerable times by
other programs. On the other extreme, there will be libraries
you might never have heard of (libc, libssl, watever) without
which many or most of your programs won't run).

To give a more specific answer -- if you are a heavy shell user,
your shell history might give you a hint; otherwise, you'll have
to ask the kernel. I don't think you'll find a ready-made solution,
but there are many kernel instrumentation approaches which might
be a building block in your quest's solution. To get a more
concrete idea, you might look into System Tap [1]; you would
select, e.g. the exec family of system calls (which start a
binary) and then run some statistics on them (note: not that
I'm proposing to *do* this -- rather to look into it to gain
insights which might help you to understand the problem space
you are trying to cover. As a collateral, and as so often, you
will learn a lot of other things :)

Cheers

[1] https://en.wikipedia.org/wiki/SystemTap
- -- tomás
-BEGIN PGP SIGNATURE-
Version: GnuPG v1.4.12 (GNU/Linux)

iEYEARECAAYFAltF7TUACgkQBcgs9XrR2ka2qwCdEwukHJ9dzqwgK0O1PMF5RCj1
DqsAn2FJCzEVq/ILh2Gf0Cnm4seWbmXV
=SkR/
-END PGP SIGNATURE-



Re: Local system program analytics

2018-07-11 Thread Zenaan Harkness
On Wed, Jul 11, 2018 at 07:18:55AM -0400, David Maulik wrote:
> Is there any program that can show me the programs on my system I use the 
> most? I'm looking for something that can help me trim unneeded/unused 
> packages as well as show me which programs I use the most to help inform 
> support/donation decisions.

IDK, except there is a distro-wide popcon:
https://popcon.debian.org/

Good luck,



Local system program analytics

2018-07-11 Thread David Maulik
Is there any program that can show me the programs on my system I use the most? 
I'm looking for something that can help me trim unneeded/unused packages as 
well as show me which programs I use the most to help inform support/donation 
decisions.