[gentoo-user] Ktorrent using a lot of memory recently

2021-12-20 Thread Dale
Howdy all,

I been using Ktorrent for several months now.  When I started using it,
it used only a few hundred megabytes of ram and was running for a week
or so without a restart.  It rarely even showed up in top when sorted by
memory usage.  Certainly true when several Firefox browser profiles are
open and running.  Recently tho, it is using a lot more memory.  Once it
was several GBs and I had to close and restart Ktorrent to clear it up. 
It runs with a more normal memory usage for a while but then starts
building up again.  Once I get something downloaded, I copy it from the
folder it downloads to over to other directories where I rename and
organize things.  Only active downloads remain listed within Ktorrent. 
This is from top. This is after less than a day of run time, likely
around 12 hours or so. 


  PID USER  PR  NI    VIRT    RES    SHR S  %CPU  %MEM TIME+
COMMAND 

 5604 dale  20   0 3262804   1.0g  81648 S   0.0   3.3  45:40.05
/usr/bin/ktorrent


This is my version and USE flags.


[ebuild   R    ] net-p2p/ktorrent-21.08.3:5::gentoo  USE="bwscheduler
downloadorder handbook infowidget ipfilter logviewer magnetgenerator
mediaplayer scanfolder stats upnp webengine zeroconf -debug -rss
-shutdown -test" 0 KiB


Entries in /etc/portage for ktorrent:


root@fireball / # grep -r ktorrent /etc/portage/
/etc/portage/package.use/package.use:net-p2p/ktorrent -search -shutdown -rss
root@fireball / #


I checked and I'm on the same version as I have been using since I
installed Ktorrent.  I suspect the problem may be a dependency of
Ktorrent and not Ktorrent itself, even tho it shows Ktorrent using the
memory.  I'm not quite sure how that could be but since Ktorrent itself
hasn't changed, well, makes me wonder.

Anyone else having this problem or have a idea of the cause?  Could it
be a USE flag that I can disable?  I can disable things I don't use if
needed.  Is it something Ktorrent depends on that is causing this?

Ideas? Thoughts?

Thanks.

Dale

:-)  :-) 



Re: [gentoo-user] Re: X11 crashes anyone?

2021-12-20 Thread Ionen Wolkens
On Tue, Dec 21, 2021 at 08:31:55AM +0200, Nikos Chantziaras wrote:
> Seems to be a different issue then. I'm on an nvidia card using the 
> binary driver, and there's no problems like the ones you're having. It's 
> a straight disappearance of the desktop here when it happens due to the 
> X11 process segfault.

If using xorg-21, I assume using nvidia-drivers-495.xx as well?

I was never able to reproduce these, but did run into users running
into segfault-at-start issues with 495.

With 495.44-r2 and 495.46-r10, Xorg log may have a backtrace
mentioning libnvidia-glcore.so, if so try 495.46-r0.

Alternatively, 495.46* may mention failed in libpthread (or libc if
glibc-2.34), in that case try 495.44-r2 instead.

The more failsafe approach however is to just use stable drivers though.

echo "x11-drivers/nvidia-drivers -~amd64" >> 
/etc/portage/package.accept_keywords

Or 470.94 is fine too (due to be next stable soon).

If still happening, then I don't know what might be wrong just from
this.

-- 
ionen


signature.asc
Description: PGP signature


[gentoo-user] Re: X11 crashes anyone?

2021-12-20 Thread Nikos Chantziaras

On 20/12/2021 13:21, Michael wrote:

On Monday, 20 December 2021 07:10:59 GMT Nikos Chantziaras wrote:

Has anyone here noticed that x.org likes to crash sometimes as of late?
[...]


I have been suffering similar symptoms[1] on a AMD Kaveri APU powered box,
running plasma with two monitors, which worsened[2] in the last couple of
weeks.  All other boxen work fine, so I assumed some Radeon driver issue
specific to this machine.

[1]  For some months now the RH monitor would not acquire the correct
resolution. [...]

[2] Last week's update broke both xorg and wayland.  Plasma crashes when
launched and partially recovers. [...]


Seems to be a different issue then. I'm on an nvidia card using the 
binary driver, and there's no problems like the ones you're having. It's 
a straight disappearance of the desktop here when it happens due to the 
X11 process segfault.





[gentoo-user] Re: Movie editing softeware

2021-12-20 Thread Grant Edwards
On 2021-12-20, William Kenworthy  wrote:

> Hi, what is a usable piece of software in portage to do a quick edit of 
> a movie? (cut start/end and maybe splice a bit in/out of the middle?)

I do stuff like that using a shell script to invoke the MLT "melt"
command line video editor.

https://www.mltframework.org/docs/melt/

https://www.linux-magazine.com/Issues/2018/206/Command-Line-Melt

It takes some trial-and-error to get the hang of some of the
options...





Re: [gentoo-user] ERROR: dev-python/dbus-python-1.2.18::gentoo failed (configure phase)

2021-12-20 Thread thelma
On 12/19/21 3:10 PM, the...@sys-concept.com wrote:
> I got stuck on dbus-python,  any suggestions? 
> 
> configure: error: 
>   Could not link test program to Python. Maybe the main Python library has 
> been
>   installed in some non-standard library path. If so, pass it to configure,
>   via the LIBS environment variable.
>   Example: ./configure LIBS="-L/usr/non-standard-path/python/lib"
>   
>ERROR!
>You probably have to install the development version of the Python package
>for your distribution.  The exact name of this package varies among them.
>   
> 
> See `config.log' for more details
> 
> !!! Please attach the following file when seeking support:
> !!! 
> /var/tmp/portage/dev-python/dbus-python-1.2.18/work/dbus-python-1.2.18-python3_9/config.log
>  * ERROR: dev-python/dbus-python-1.2.18::gentoo failed (configure phase):
>  *   econf failed
>  * 
>  * Call stack:
>  *   ebuild.sh, line  127:  Called src_configure
>  * environment, line 2766:  Called python_foreach_impl 
> 'run_in_build_dir' 'configuring'
>  * environment, line 2437:  Called multibuild_foreach_variant 
> '_python_multibuild_wrapper' 'run_in_build_dir' 'configuring'
>  * environment, line 1958:  Called _multibuild_run 
> '_python_multibuild_wrapper' 'run_in_build_dir' 'configuring'
>  * environment, line 1956:  Called _python_multibuild_wrapper 
> 'run_in_build_dir' 'configuring'
>  * environment, line  724:  Called run_in_build_dir 'configuring'
>  * environment, line 2747:  Called configuring
>  * environment, line 2764:  Called econf 
> '--disable-documentation' 'PYTHON_EXTRA_LIBS= '
>  *phase-helpers.sh, line  711:  Called __helpers_die 'econf failed'
>  *   isolated-functions.sh, line  112:  Called die
>  * The specific snippet of code:
>  *die "$@"
>  * 
>  * If you need support, post the output of `emerge --info 
> '=dev-python/dbus-python-1.2.18::gentoo'`,
>  * the complete build log and the output of `emerge -pqv 
> '=dev-python/dbus-python-1.2.18::gentoo'`.
>  * The complete build log is located at 
> '/var/tmp/portage/dev-python/dbus-python-1.2.18/temp/build.log'.
>  * The ebuild environment file is located at 
> '/var/tmp/portage/dev-python/dbus-python-1.2.18/temp/environment'.
>  * Working directory: 
> '/var/tmp/portage/dev-python/dbus-python-1.2.18/work/dbus-python-1.2.18-python3_9'
>  * S: '/var/tmp/portage/dev-python/dbus-python-1.2.18/work/dbus-python-1.2.18'
> 
> !!! existing preserved libs found

Solution:
emerge -v1 libxcrypt



Re: [gentoo-user] Local mail delivery agent (MDA) wanted

2021-12-20 Thread Grant Taylor

On 12/20/21 3:37 PM, Wol wrote:

You mean the body sans envelope?


Kinda, sorta, yes, no, maybe.

I'd have to compare the two formats to be able to say more definitively, 
or with any certainty.  But, ya, that's the /type/ of difference that 
I'm thinking of.


Aside:  What /actually/ is the body vs envelope?  In SMTP it's simple, 
it, everything between the DATA and the trailing . is 
the body the MAIL FROM: and RCPT TO(s) are envelope.  But RFC 822 
messages on disk, that's a bit of a horse of a different color.  It's 
easy to differentiate body from headers, but envelope???




--
Grant. . . .
unix || die



Re: [gentoo-user] Local mail delivery agent (MDA) wanted

2021-12-20 Thread Wol

On 20/12/2021 22:28, Grant Taylor wrote:
But the latter mails were missing vital headers and thus mail had a 
problem displaying them properly.


That sounds like raw, unprocessed email to me.


You mean the body sans envelope?

Cheers,
Wol



Re: [gentoo-user] Local mail delivery agent (MDA) wanted

2021-12-20 Thread Grant Taylor

On 12/20/21 3:09 PM, Frank Steinmetzger wrote:

Delivery works on both systems


:-)


(with a little caveat, see second-last paragraph).


;-)

At first I believed that both systems used mail from GNU mailutils. 
But I erred:


Ya.  Determining /which/ implementation of a command is being used can 
be ... difficult at times.


My Gentoo NAS only has mailutils installed. But while I have that also 
installed on Arch, I was in fact using s-nail’s mail program there. 
Mailutils installs its mail as /usr/bin/gnu-mail instead, which allows 
both packages to co-exist (which Gentoo does not).


Yep.  That could be an issue.  It's not bad if you are aware of it and 
can account for it.


So I tried gnu-mail on Arch, but this does not move read mail away 
upon exit like its Gentoo cousin.


That might be a default configuration / rc file in somewhere in /etc.

I did more trials, wrote a lengthy description of it into this message 
and threw them away again, so I wouldn’t bore you.


/me chuckles mildly.

I doubt that you would bore me.  I might also learn something about Arch 
and possibly even Gentoo.  But those bits have already gone through the 
circuit.  (Portmanteau of "water under the bridge"?)


In the end I gave up, removed Gentoo’s mailutils and went with 
s-nail. And now it works. ¯\_(ツ)_/¯


It sounds like you've achieved your goal /and/ that we (at least you and 
I) learned some things along the way.  :-D


Maybe building dma from source broke some stuff, because it installed 
into /usr/local. `echo foo | mail root` (mail from mailutils) produces 
mail that remains in dma’s queue, whereas `echo bar | sendmail root` 
(/usr/local/sbin/ sendmail from dma) gets the mail delivered to the 
spool file.


I would expect the `mail` and `sendmail` commands (binaries / scripts) 
to do slightly different things.  Both should accept messages on STDIN. 
But what they do with them might be different.


Leaving the message in the spool makes me think that there is 
expectation that something else, maybe even another part of DMA, will do 
something with the spooled message(s).  Maybe DMA is expecting some sort 
of cron job to work the mail queue.


But the latter mails were missing vital headers and thus mail had a 
problem displaying them properly.


That sounds like raw, unprocessed email to me.

It’s all a bit voodoo-esque to my simple-minded user’s point of 
view; confusion over many implementations of the same standard;


The wonderful thing about standards is that we have so many to choose 
from.  }:-)



they should interoperate,


Ideally.


but maybe don’t, or maybe I did not configure them properly.


See above comment about cron et al.

plus the overly complex configs and info documentation on GNU’s 
side which keeps me away. It must have been great days back in the 
80s. I wish I had experienced those times and machines.


Email is ... non-trivial, to put it mildly.  There are many different 
things that interact and each behaves slightly differently while doing a 
different part of the job.




--
Grant. . . .
unix || die



Re: [gentoo-user] Local mail delivery agent (MDA) wanted

2021-12-20 Thread Frank Steinmetzger
Am Mon, Dec 20, 2021 at 01:00:13PM -0700 schrieb Grant Taylor:
> On 12/20/21 12:08 PM, Frank Steinmetzger wrote:
> > There is one last niggle: after I read a message with the mail tool, it
> > saves those messages in /root/mbox. It does not do this on Arch, but
> > keeps them in /var/spool/mail/root instead.
> 
> This sounds like the doing of your mail user agent.
> 
> The MTA+LDA receive and deliver the mail (respectively) to the user's
> mailbox.

Delivery works on both systems (with a little caveat, see second-last
paragraph).

> The MUA is what reads / modifies the mailbox.
> So ... compare the email client that you're using between the two systems.

At first I believed that both systems used mail from GNU mailutils.
But I erred:

My Gentoo NAS only has mailutils installed. But while I have that also
installed on Arch, I was in fact using s-nail’s mail program there.
Mailutils installs its mail as /usr/bin/gnu-mail instead, which allows both
packages to co-exist (which Gentoo does not). So I tried gnu-mail on Arch,
but this does not move read mail away upon exit like its Gentoo cousin.

I did more trials, wrote a lengthy description of it into this message and
threw them away again, so I wouldn’t bore you. In the end I gave up, removed
Gentoo’s mailutils and went with s-nail. And now it works. ¯\_(ツ)_/¯


Maybe building dma from source broke some stuff, because it installed into
/usr/local. `echo foo | mail root` (mail from mailutils) produces mail that
remains in dma’s queue, whereas `echo bar | sendmail root` (/usr/local/sbin/
sendmail from dma) gets the mail delivered to the spool file. But the latter
mails were missing vital headers and thus mail had a problem displaying
them properly.

It’s all a bit voodoo-esque to my simple-minded user’s point of view;
confusion over many implementations of the same standard; they should
interoperate, but maybe don’t, or maybe I did not configure them properly.
plus the overly complex configs and info documentation on GNU’s side which
keeps me away. It must have been great days back in the 80s. I wish I had
experienced those times and machines.

-- 
Grüße | Greetings | Qapla’
Please do not share anything from, with or about me on any social network.

What lies on the bottom of the ocean and shivers? - A nervours wreck.


signature.asc
Description: PGP signature


Re: [gentoo-user] Re: failed to compile seamonkey

2021-12-20 Thread pat

On 2021-12-17 13:22, nunojsi...@ist.utl.pt wrote:

On 2021-12-16, p...@xvalheru.org wrote:


Hi all,

I've failed to compile seamonkey-2.53.9.1-r1. I don't know what's
wrong. Please point me to the solution.


Possibly an incompatible rust version, see
https://bugs.gentoo.org/show_bug.cgi?id=824066


emerge --info '=www-client/seamonkey-2.53.9.1-r1::gentoo'

[...]

dev-lang/rust: 1.56.1::gentoo
dev-lang/rust-bin: 1.53.0::gentoo

[...]

Of these two versions, it's trying to use 1.56.1, if I'm reading your
build log correctly.


Thanks, it helped.

Pat


Freehosting PIPNI - http://www.pipni.cz/




Re: [gentoo-user] Synchronous writes over the network.

2021-12-20 Thread Rich Freeman
On Mon, Dec 20, 2021 at 2:52 PM Wols Lists  wrote:
>
> And it might also mean blocking writes, which is why you don't want it
> on spinning rust. But it also means that it is (almost) guaranteed to
> get to permanent storage, which is why you do want it for mail,
> databases, etc.
>

The reason that mail/databases/etc use synchronous behavior isn't
because it is "almost" guaranteed to make it to storage.  The reason
they use it is because you have multiple hosts, and each host can
guarantee non-loss of data internally, but synchronous behavior is
necessary to ensure that data is not lost on a handoff.

Take a mail server.  If your SMTP connection goes down for any reason
before the server communicates that the mail was accepted then the
sender will assume the mail was not delivered, and will try again.  So
if the network goes down, or the SMTP server crashes, then the client
will cache the mail and try again.  Most mail servers will have the
data already on-disk before even attempting to deliver mail, so even
if all the computers involved go down during this handoff nothing is
lost as it is still in the client cache on-disk.

On the other hand, once the server confirms delivery then
responsibility is handed off and the client can forget about the mail.
It is important that the mail server not communicate that the mail was
received until it can guarantee that it won't lose the mail.  That is
usually accomplished by the server syncing the mail file to the
on-disk spool and blocking until that is successful before
communicating back to the client that the mail was delivered.

Database transactions behave similarly.

If the userspace application either does a write on a file opened with
O_SYNC or does an fsync system call on the file, and the system call
returns, then the data is present on-disk and will be persistent even
if the power is lost at the very next moment.  It is acceptable for a
filesystem to return the call if the data is in a persistent journal,
which is what the ZIL is, as long as it is flushed to disk.

Of course, you can still accept mail or implement a database
asynchronously, but you lose a number of data protections that are
otherwise designed into the software (well, assuming you're not
storing your data in MyISAM...).  :)

-- 
Rich



Re: [gentoo-user] Local mail delivery agent (MDA) wanted

2021-12-20 Thread Grant Taylor

On 12/20/21 12:08 PM, Frank Steinmetzger wrote:
There is one last niggle: after I read a message with the mail tool, 
it saves those messages in /root/mbox. It does not do this on Arch, 
but keeps them in /var/spool/mail/root instead.


This sounds like the doing of your mail user agent.

The MTA+LDA receive and deliver the mail (respectively) to the user's 
mailbox.


The MUA is what reads / modifies the mailbox.

So ... compare the email client that you're using between the two systems.



--
Grant. . . .
unix || die



Re: [gentoo-user] Synchronous writes over the network.

2021-12-20 Thread Wols Lists

On 20/12/2021 18:52, Mark Knecht wrote:

The thing is that the ZIL is only used for synchronous writes and I
don't know whether anything I'm doing to back up my user machines,
which currently is just rsync commands, is synchronous or could be
made synchronous, and I do not know if the NFS writes from the R_Pi
are synchronous or could be made so.


"Synchronous writes" basically means "in the order they were written".

And it might also mean blocking writes, which is why you don't want it 
on spinning rust. But it also means that it is (almost) guaranteed to 
get to permanent storage, which is why you do want it for mail, 
databases, etc.


Your typical (asynchronous) app calls "write", chucks it at the kernel, 
and forgets about it. Hence "asynchronous" - "without regard to time".


Your app which has switched on synchronicity will lock until the write 
has completed.


Your understanding about the ZIL sounds about right - whatever you throw 
at the NAS will be saved to the ZIL before it gets written properly 
later. Your apps (rsync etc) don't need to worry, the kernel will cache 
stuff, flood it through to the ZIL, and the NAS will take it from there.


The only thing I'd worry about is how "bursty" is the data being chucked 
at the NAS. A backup is likely to be a stream that could easily 
overwhelm the buffers, and that's not good. Do you have an rsync daemon 
on the NAS? The more you can make the writes smaller and bursty the 
better, and running an rsync daemon is one of the ways.


Cheers,
Wol



Re: [gentoo-user] Synchronous writes over the network.

2021-12-20 Thread Rich Freeman
On Mon, Dec 20, 2021 at 1:52 PM Mark Knecht  wrote:
>
> I've recently built 2 TrueNAS file servers. The first (and main) unit
> runs all the time and serves to backup my home user machines.
> Generally speaking I (currently) put data onto it using rsync but it
> also has an NFS mount that serves as a location for my Raspberry Pi to
> store duplicate copies of astrophotography pictures live as they come
> off the DSLR in the middle of the night.
>
> ...
>
> The thing is that the ZIL is only used for synchronous writes and I
> don't know whether anything I'm doing to back up my user machines,
> which currently is just rsync commands, is synchronous or could be
> made synchronous, and I do not know if the NFS writes from the R_Pi
> are synchronous or could be made so.
>

Disclaimer: some of this stuff is a bit arcane and the documentation
isn't very great, so I could be missing a nuance somewhere.

First, one of your options is to set sync=always on the zfs dataset,
if synchronous behavior is strongly desired.  That will force ALL
writes at the filesystem level to be synchronous.  It will of course
also normally kill performance but the ZIL may very well save you if
your SSD performs adequately.  This still only applies at the
filesystem level, which may be an issue with NFS (read on).

I'm not sure how exactly you're using rsync from the description above
(rsyncd, directly client access, etc).  In any case I don't think
rsync has any kind of option to force synchronous behavior.  I'm not
sure if manually running a sync on the server after using rsync will
use the ZIL or not.  If you're using sync=always then that should
cover rsync no matter how you're doing it.

Nfs is a little different as both the server-side and client-side have
possible asynchronous behavior.  By default the nfs client is
asynchronous, so caching can happen on the client before the file is
even sent to the server.  This can be disabled with the mount option
sync on the client side.  That will force all data to be sent to the
server immediately.  Any nfs server or filesystem settings on the
server side will not have any impact if the client doesn't transmit
the data to the server.  The server also has a sync setting which
defaults to on, and it additionally has another layer of caching on
top of that which can be disabled with no_wdelay on the export.  Those
server-side settings probably delay anything getting to the filesystem
and so they would have precedence over any filesystem-level settings.

As you can see you need to use a bit of a kill-it-with-fire approach
to get synchronous behavior, as it traditionally performs so poorly
that everybody takes steps to try to prevent it from happening.

I'll also note that the main thing synchronous behavior protects you
from is unclean shutdown of the server.  It has no bearing on what
happens if a client goes down uncleanly.  If you don't expect server
crashes it may not provide much benefit.

If you're using ZIL you should consider having the ZIL mirrored, as
any loss of the ZIL devices will otherwise cause data loss.  Use of
the ZIL is also going to create wear on your SSD so consider that and
your overall disk load before setting sync=always on the dataset.
Since the setting is at the dataset level you could have multiple
mountpoints and have a different sync policy for each.  The default is
normal POSIX behavior which only syncs when requested (sync, fsync,
O_SYNC, etc).

-- 
Rich



Re: [gentoo-user] Local mail delivery agent (MDA) wanted

2021-12-20 Thread Frank Steinmetzger
Am Mon, Dec 20, 2021 at 08:08:21PM +0100 schrieb Frank Steinmetzger:

> There is one last niggle: after I read a message with the mail tool, it
> saves those messages in /root/mbox.

Which is actually a maildir directory. :D

-- 
Grüße | Greetings | Qapla’
Please do not share anything from, with or about me on any social network.

What was that disease called again that makes you forget everything?


signature.asc
Description: PGP signature


Re: [gentoo-user] Local mail delivery agent (MDA) wanted

2021-12-20 Thread Frank Steinmetzger
Am Sat, Dec 18, 2021 at 07:19:19PM -0700 schrieb Grant Taylor:
> On 12/18/21 4:00 PM, Frank Steinmetzger wrote:
> > Just for the record and completeness’ sake: ... I found out that the
> > program was actually called dma -- the DragonFly BSD mail transport
> > agent, not mda.
> 
> Thank you for sharing your find Frank.
> 
> The DragonFly BSD MTA looks interesting.  I'll have to check it out.
> Especially if it's small and intended for local delivery and / or getting
> messages off of box all the while without exposing an SMTP port.

A little update report. After the setup of dma went so smoothly on my Arch
installations, I wanted to recreate it on my Gentoo-based NAS over the
weekend:

- cloned the dma repo¹ and installed everything
- removed everything from /var/spool/mail and any leftover queues for a
  clean start
- changed the sendmail path in fcron.conf from usr/bin to usr/local/bin
- had to amend /etc/mailutils.conf, because it sets up the root mailbox as
  a maildir called .maildir (according to the comment, that is Gentoo-
  specific). So I just commented out that block to (hopefully) get GNU
  maildir default behavior

Now I finally get mails from cron et al on my NAS and can read them with
mail or mutt. I can sleep better now, knowing that it will monitor its four
6 TB disks and notify me at the first sign of trouble, including “there is
new mail” on the console. \o/

There is one last niggle: after I read a message with the mail tool, it
saves those messages in /root/mbox. It does not do this on Arch, but keeps
them in /var/spool/mail/root instead. So far I haven’t found out why it does
that and where that might be configured. Perhaps some leftover config from
previous experiments with different mail packages.


¹ https://github.com/corecode/dma

-- 
Grüße | Greetings | Qapla’
Please do not share anything from, with or about me on any social network.

The circle is the parallel to the dot.


signature.asc
Description: PGP signature


[gentoo-user] Synchronous writes over the network.

2021-12-20 Thread Mark Knecht
I wonder if someone can help me get educated about synchronous writes
to a file server over the network? Is this something that's designed
into specific apps or is this something that I have control of at the
sys admin level?

I've recently built 2 TrueNAS file servers. The first (and main) unit
runs all the time and serves to backup my home user machines.
Generally speaking I (currently) put data onto it using rsync but it
also has an NFS mount that serves as a location for my Raspberry Pi to
store duplicate copies of astrophotography pictures live as they come
off the DSLR in the middle of the night.

The second TrueNAS machine serves to back up this first machine but
resides at the other end of the house to protect data in case of fire.
Eventually I'll probably backup all of this offsite but for now it's
two old computers and a bunch of disks.

The question about synchronous writes comes in the configuration of
TrueNAS. TrueNAS supports what it calls a ZIL (ZFS Intent Log) which
is a smaller SSD at the front end of the write data flow. The idea (as
I understand it) is that the ZIL allows writes to the server to be
cached quickly onto, in my case, an SSD, and then eventually written
to spinning drives when the system gets around to it. Once new data
arrives at the ZIL it remains until it's written and verified at which
time the entries in the ZIL are removed. The ZIL does not do anything
to speed up reads from the file server.

The thing is that the ZIL is only used for synchronous writes and I
don't know whether anything I'm doing to back up my user machines,
which currently is just rsync commands, is synchronous or could be
made synchronous, and I do not know if the NFS writes from the R_Pi
are synchronous or could be made so.

If someone can point me in the right direction in terms of reading and
study I'd appreciate it.

Thanks,
Mark



Re: [gentoo-user] Movie editing softeware

2021-12-20 Thread Jigme Datse
On Mon, 20 Dec 2021 14:11:50 +0800
William Kenworthy  wrote:

> On 20/12/21 13:40, Andrew Lowe wrote:
> > On 20/12/21 11:17 am, William Kenworthy wrote:  
> >> Hi, what is a usable piece of software in portage to do a quick
> >> edit of a movie? (cut start/end and maybe splice a bit in/out of
> >> the middle?)
> >>
> >> BillK
> >>
> >>
> >>  
> >
> > How easy should it be? Won't ffmpeg allow you to do this type of
> > thing but you need to do a bit of work to get what you need - no
> > nice GUI?
> >
> > Andrew
> >  
> I am using ffmeg now to reduce the video size.  Its a Christmas
> message taken on a lumix camera that needs to be sent a few thousand
> km over what may be a flakey mobile link.  I just wanted something I
> can play a video, click on a point and delete everything before that.
>  Same at the end.  Looking at kdelive its a stupidly complex program
> that has a steep learning curve to do the above.
> 
> BillK
> 
> 
> 

The one thing if you are wanting to reduce video size, after getting
something that is the "just the right bits" video, send it as a HEVC
encoded video.  Generally it's h.264 once you have a "web" video, but I
have found I can reduce to 1/20 to 1/50 often taking that to HEVC for a
1080p video.  And...  You may not need/want it at that high a
resolution.



Re: [gentoo-user] Movie editing softeware

2021-12-20 Thread Michael
On Monday, 20 December 2021 11:16:14 GMT Wols Lists wrote:
> On 20/12/2021 08:25, Neil Bothwick wrote:
> > On Mon, 20 Dec 2021 07:55:15 +, Wols Lists wrote:
> >> With pretty much every bit of linux software I've found, I have to
> >> import my source into a project, make a meal of deleting the sections I
> >> don't want, and then I can't just "save a file", I have to tell the
> >> program loads of crap that I don't have a clue about, I just want my
> >> new file to be EXACTLY THE SAME as the original, just missing the bits
> >> I've deleted.
> > 
> > Avidemux works just like that, select the bits you don't want, delete
> > them, save using the copy codec, which does no transcoding.
> > 
> > Or you can use a different codec/bitrate/whatever if you also want to
> > reduce the size.
> 
> Ummm.
> 
> I don't know what the problem was, but I know I tried Avidemux, and it
> really didn't work for me. afair, it just got slower and slower, and was
> taking hours to save a file. Maybe a couple of days to save a 2hr video,
> that sort of thing ...
> 
> Cheers,
> Wol

kdenlive would be the same, IF you are transcoding the streams.  If you are 
just clipping sections, but copying over the same codecs and remuxing, it will 
be much faster.

I've tried various GUIs and found I was wasting more time learning how each 
application worked, than actually doing work.  So I reverted back to using 
ffmpeg on CLI.

ffmpeg -ss 00:03:00 -i input.mp4 -codec: copy -t 00:43:00 output.mp4

The above works a treat to clip start and end on a video and is fast.  If I 
need to clip many bits along the length of the video, e.g. removing adverts 
from a TV transmission, then I clip them separately and concatenate them as 
shown here:

https://trac.ffmpeg.org/wiki/Concatenate

When I want to transcode streams I use hardware acceleration which is faster 
and cooler than burning CPU cycles, e.g.:

ffmpeg -hwaccel vaapi -vaapi_device /dev/dri/renderD128 -ss 00:04:12 -i
input.ts -vf format='nv12|vaapi,hwupload' -codec:v h264_vaapi -codec:a ac3 -t 
00:59:08 output.ts


signature.asc
Description: This is a digitally signed message part.


Re: [gentoo-user] X11 crashes anyone?

2021-12-20 Thread Michael
On Monday, 20 December 2021 07:10:59 GMT Nikos Chantziaras wrote:
> Has anyone here noticed that x.org likes to crash sometimes as of late?
> Never happened before, going years and years back. The last month or so,
> I've got three x.org crashes:
> 
> systemd-coredump[204553]: [] Process 453 (X) of user 0 dumped core.
> 
> This is x11-base/xorg-server-21.1.2-r2.
> 
> qlop -v x11-base/xorg-server says:
> 
>2021-08-04T17:58:15 >>> x11-base/xorg-server-1.20.13-r1: 52s
>2021-11-30T16:15:54 >>> x11-base/xorg-server-21.1.1: 28s
>2021-12-03T18:49:22 >>> x11-base/xorg-server-21.1.1-r2: 27s
>2021-12-16T17:08:40 >>> x11-base/xorg-server-21.1.2: 24s
>2021-12-19T21:57:08 >>> x11-base/xorg-server-21.1.2-r2: 25s
> 
> So it seems this coincides with the upgrade from 1.20.13 to 21.1.1 about
> a month ago.
> 
> Anyone else seeing this?

I have been suffering similar symptoms[1] on a AMD Kaveri APU powered box, 
running plasma with two monitors, which worsened[2] in the last couple of 
weeks.  All other boxen work fine, so I assumed some Radeon driver issue 
specific to this machine.

[1]  For some months now the RH monitor would not acquire the correct 
resolution.  The workaround I came up with, until I have some time to 
troubleshoot it, was to go into SystemSettings/Display, disable the RH monitor 
and then re-enable it.  This process is more painful than it sounds, because 
clicking on Plasma desktop GUI menus does not update the screen.  I have to 
drop into a console and back to Alt+F7 before I can see the output of whatever 
I had clicked on.  Interestingly, Plasma-Wayland worked fine, both monitors 
came up with the correct resolution.

[2] Last week's update broke both xorg and wayland.  Plasma crashes when 
launched and partially recovers.  I glanced at the errors and it seems to be 
related to some Qt library.  Again, I haven't troubleshooted it further.

Not sure if this helps, but would be interested to try in whatever fix you may 
come up with.

signature.asc
Description: This is a digitally signed message part.


Re: [gentoo-user] Movie editing softeware

2021-12-20 Thread Wols Lists

On 20/12/2021 08:25, Neil Bothwick wrote:

On Mon, 20 Dec 2021 07:55:15 +, Wols Lists wrote:


With pretty much every bit of linux software I've found, I have to
import my source into a project, make a meal of deleting the sections I
don't want, and then I can't just "save a file", I have to tell the
program loads of crap that I don't have a clue about, I just want my
new file to be EXACTLY THE SAME as the original, just missing the bits
I've deleted.


Avidemux works just like that, select the bits you don't want, delete
them, save using the copy codec, which does no transcoding.

Or you can use a different codec/bitrate/whatever if you also want to
reduce the size.



Ummm.

I don't know what the problem was, but I know I tried Avidemux, and it 
really didn't work for me. afair, it just got slower and slower, and was 
taking hours to save a file. Maybe a couple of days to save a 2hr video, 
that sort of thing ...


Cheers,
Wol



[gentoo-user] Re: Movie editing softeware

2021-12-20 Thread Nikos Chantziaras

On 20/12/2021 05:17, William Kenworthy wrote:
Hi, what is a usable piece of software in portage to do a quick edit of 
a movie? (cut start/end and maybe splice a bit in/out of the middle?)


I use LosslessCut for this:

  https://github.com/mifi/lossless-cut

It's not in Portage, but the provided AppImage download "just runs". If 
you've never used an AppImage before, it behaves just like a normal 
executable. So "chmod +x LosslessCut-linux.AppImage" and then just run it.





Re: [gentoo-user] Movie editing softeware

2021-12-20 Thread eric

On 12/20/21 1:13 AM, eric wrote:

On 12/20/21 12:55 AM, Wols Lists wrote:

On 20/12/2021 06:11, William Kenworthy wrote:


On 20/12/21 13:40, Andrew Lowe wrote:

On 20/12/21 11:17 am, William Kenworthy wrote:
Hi, what is a usable piece of software in portage to do a quick 
edit of a movie? (cut start/end and maybe splice a bit in/out of 
the middle?)


BillK





How easy should it be? Won't ffmpeg allow you to do this type of 
thing but you need to do a bit of work to get what you need - no 
nice GUI?


Andrew

I am using ffmeg now to reduce the video size.  Its a Christmas 
message taken on a lumix camera that needs to be sent a few thousand 
km over what may be a flakey mobile link.  I just wanted something I 
can play a video, click on a point and delete everything before that. 
Same at the end.  Looking at kdelive its a stupidly complex program 
that has a steep learning curve to do the above.


I'm looking for the same. On my PVR I just create two chapter marks, 
and delete the section between the chapter marks.


With pretty much every bit of linux software I've found, I have to 
import my source into a project, make a meal of deleting the sections 
I don't want, and then I can't just "save a file", I have to tell the 
program loads of crap that I don't have a clue about, I just want my 
new file to be EXACTLY THE SAME as the original, just missing the bits 
I've deleted.


Most software works like that, why doesn't video editing software?

Cheers,
Wol



I have not tried this myself but has anyone tried "easycrop". It is a 
script that uses mpv to do the hard work.


https://github.com/aidanholm/mpv-easycrop



I spoke to soon. This script does not do what you are looking for. It 
just allows you to select a rectangular section of the screen and crops 
the rest. It does not allow you to remove sections of the video like the 
beginning few minutes.


Regards,

Eric



Re: [gentoo-user] Movie editing softeware

2021-12-20 Thread Neil Bothwick
On Mon, 20 Dec 2021 07:55:15 +, Wols Lists wrote:

> With pretty much every bit of linux software I've found, I have to 
> import my source into a project, make a meal of deleting the sections I 
> don't want, and then I can't just "save a file", I have to tell the 
> program loads of crap that I don't have a clue about, I just want my
> new file to be EXACTLY THE SAME as the original, just missing the bits
> I've deleted.

Avidemux works just like that, select the bits you don't want, delete
them, save using the copy codec, which does no transcoding.

Or you can use a different codec/bitrate/whatever if you also want to
reduce the size.


-- 
Neil Bothwick

Power corrupts - absolute power is even more fun.


pgpqGVHkLE5mJ.pgp
Description: OpenPGP digital signature


Re: [gentoo-user] Movie editing softeware

2021-12-20 Thread eric

On 12/20/21 12:55 AM, Wols Lists wrote:

On 20/12/2021 06:11, William Kenworthy wrote:


On 20/12/21 13:40, Andrew Lowe wrote:

On 20/12/21 11:17 am, William Kenworthy wrote:
Hi, what is a usable piece of software in portage to do a quick edit 
of a movie? (cut start/end and maybe splice a bit in/out of the 
middle?)


BillK





How easy should it be? Won't ffmpeg allow you to do this type of 
thing but you need to do a bit of work to get what you need - no nice 
GUI?


Andrew

I am using ffmeg now to reduce the video size.  Its a Christmas 
message taken on a lumix camera that needs to be sent a few thousand 
km over what may be a flakey mobile link.  I just wanted something I 
can play a video, click on a point and delete everything before that.  
Same at the end.  Looking at kdelive its a stupidly complex program 
that has a steep learning curve to do the above.


I'm looking for the same. On my PVR I just create two chapter marks, and 
delete the section between the chapter marks.


With pretty much every bit of linux software I've found, I have to 
import my source into a project, make a meal of deleting the sections I 
don't want, and then I can't just "save a file", I have to tell the 
program loads of crap that I don't have a clue about, I just want my new 
file to be EXACTLY THE SAME as the original, just missing the bits I've 
deleted.


Most software works like that, why doesn't video editing software?

Cheers,
Wol



I have not tried this myself but has anyone tried "easycrop". It is a 
script that uses mpv to do the hard work.


https://github.com/aidanholm/mpv-easycrop

Regards,

Eric