Re: [FFmpeg-user] h264_vaapi missing frames

[Kai Hendry]

Actually I spoke too soon. It's definitely dropping frames still. For example.

https://s.natalian.org/2018-03-28/1522205981.mp4.log
https://s.natalian.org/2018-03-28/1522205981.mp4
___
ffmpeg-user mailing list
ffmpeg-user@ffmpeg.org
http://ffmpeg.org/mailman/listinfo/ffmpeg-user

To unsubscribe, visit link above, or email
ffmpeg-user-requ...@ffmpeg.org with subject "unsubscribe".

Re: [FFmpeg-user] h264_vaapi missing frames

[Kai Hendry]

On 23 March 2018 at 21:12, Mark Thompson  wrote:
> This is still duplicating a very large number of frames for video sync.  As 
> suggested previously, please try with video sync disabled ("-vsync 0") or 
> without audio.

https://s.natalian.org/2018-03-25/vsync.mp4.log
https://s.natalian.org/2018-03-25/vsync.mp4

Hi Mark, I think vsync 0 is working well!
https://github.com/kaihendry/recordmydesktop2.0/commit/e76c69c1847aa7b859397f31326bfc539efd1599


Thank you!
___
ffmpeg-user mailing list
ffmpeg-user@ffmpeg.org
http://ffmpeg.org/mailman/listinfo/ffmpeg-user

To unsubscribe, visit link above, or email
ffmpeg-user-requ...@ffmpeg.org with subject "unsubscribe".

Re: [FFmpeg-user] h264_vaapi missing frames

[Carl Eugen Hoyos]

2018-03-23 14:31 GMT+01:00, Gyan Doshi :
>
>
> On 3/23/2018 6:45 PM, Carl Eugen Hoyos wrote:
>> 2018-03-23 14:12 GMT+01:00, Mark Thompson :
>
>>>
>>> This is still duplicating a very large number of frames for video sync.
>>> As suggested previously, please try with video sync disabled
>>> ("-vsync 0") or without audio.
>>
>> To the best of my knowledge, this would produce an invalid output file:
>> The input is not cfr, FFmpeg's mov output does not support vfr.
>
> How are you assessing validity

The author of the mov muxer has repeatedly confirmed this,
there is a old commit that clarifies it.

> or what would be needed to make the output valid?
> Is there a particular conformance tool or some part of the
> QT or MPEG-4 specs that you have in mind?

I don't know, sorry.

Carl Eugen
___
ffmpeg-user mailing list
ffmpeg-user@ffmpeg.org
http://ffmpeg.org/mailman/listinfo/ffmpeg-user

To unsubscribe, visit link above, or email
ffmpeg-user-requ...@ffmpeg.org with subject "unsubscribe".

Re: [FFmpeg-user] h264_vaapi missing frames

[Mark Thompson]

On 23/03/18 13:15, Carl Eugen Hoyos wrote:
> 2018-03-23 14:12 GMT+01:00, Mark Thompson :
>> On 23/03/18 01:28, Kai Hendry wrote:
>>> Thank you Moritz! Damn, I feel like a fool. ;)
>>>
>>> Unfortunately Mark's suggestion doesn't seem to have an impact.
>>>
>>> As you hopefully can see here:
>>> https://s.natalian.org/2018-03-23/1521768226.mp4
>>>
>>> The mouse still doesn't move smoothy across the screen. Hence I feel
>>> it's dropping frames!
>>>
>>> https://s.natalian.org/2018-03-23/1521768226.mp4.log
>>> ...
>>> *** 38 dup!
>>> ...
>>> *** 33 dup!
>>> ...
>>> *** 40 dup!
>>> ...
>>> *** 39 dup!
>>> ...
>>> *** 40 dup!
>>> ...
>>> *** 38 dup!
>>> ...
>>> *** 40 dup!
>>> ...
>>> *** 39 dup!
>>> ...
>>> *** 39 dup!
>>> ...
>>> *** 39 dup!
>>> frame=  439 fps= 30 q=-0.0 Lsize=1870kB time=00:00:14.58
>>> bitrate=1050.4kbits/s dup=381 drop=34 speed=0.985x
>>
>> This is still duplicating a very large number of frames for video sync.  As
>> suggested previously, please try with video sync disabled ("-vsync 0") or
>> without audio.
> 
> To the best of my knowledge, this would produce an invalid output file:
> The input is not cfr, FFmpeg's mov output does not support vfr.

Indeed, hence "try".  It may produce an output with bad properties, but if it 
contains all of the desired frames then it's clear that the problem lies 
somewhere in timestamps and video sync, and therefore that efforts should be 
focussed there to get a correct and complete output.

- Mark
___
ffmpeg-user mailing list
ffmpeg-user@ffmpeg.org
http://ffmpeg.org/mailman/listinfo/ffmpeg-user

To unsubscribe, visit link above, or email
ffmpeg-user-requ...@ffmpeg.org with subject "unsubscribe".

Re: [FFmpeg-user] h264_vaapi missing frames

[Gyan Doshi]

On 3/23/2018 6:45 PM, Carl Eugen Hoyos wrote:

2018-03-23 14:12 GMT+01:00, Mark Thompson :




This is still duplicating a very large number of frames for video sync.  As
suggested previously, please try with video sync disabled ("-vsync 0") or
without audio.


To the best of my knowledge, this would produce an invalid output file:
The input is not cfr, FFmpeg's mov output does not support vfr.


How are you assessing validity, or what would be needed to make the 
output valid? Is there a particular conformance tool or some part of the 
QT or MPEG-4 specs that you have in mind?



Regards,
Gyan
___
ffmpeg-user mailing list
ffmpeg-user@ffmpeg.org
http://ffmpeg.org/mailman/listinfo/ffmpeg-user

To unsubscribe, visit link above, or email
ffmpeg-user-requ...@ffmpeg.org with subject "unsubscribe".

Re: [FFmpeg-user] h264_vaapi missing frames

[Carl Eugen Hoyos]

2018-03-23 14:12 GMT+01:00, Mark Thompson :
> On 23/03/18 01:28, Kai Hendry wrote:
>> Thank you Moritz! Damn, I feel like a fool. ;)
>>
>> Unfortunately Mark's suggestion doesn't seem to have an impact.
>>
>> As you hopefully can see here:
>> https://s.natalian.org/2018-03-23/1521768226.mp4
>>
>> The mouse still doesn't move smoothy across the screen. Hence I feel
>> it's dropping frames!
>>
>> https://s.natalian.org/2018-03-23/1521768226.mp4.log
>> ...
>> *** 38 dup!
>> ...
>> *** 33 dup!
>> ...
>> *** 40 dup!
>> ...
>> *** 39 dup!
>> ...
>> *** 40 dup!
>> ...
>> *** 38 dup!
>> ...
>> *** 40 dup!
>> ...
>> *** 39 dup!
>> ...
>> *** 39 dup!
>> ...
>> *** 39 dup!
>> frame=  439 fps= 30 q=-0.0 Lsize=1870kB time=00:00:14.58
>> bitrate=1050.4kbits/s dup=381 drop=34 speed=0.985x
>
> This is still duplicating a very large number of frames for video sync.  As
> suggested previously, please try with video sync disabled ("-vsync 0") or
> without audio.

To the best of my knowledge, this would produce an invalid output file:
The input is not cfr, FFmpeg's mov output does not support vfr.

Carl Eugen

>
> - Mark
> ___
> ffmpeg-user mailing list
> ffmpeg-user@ffmpeg.org
> http://ffmpeg.org/mailman/listinfo/ffmpeg-user
>
> To unsubscribe, visit link above, or email
> ffmpeg-user-requ...@ffmpeg.org with subject "unsubscribe".
___
ffmpeg-user mailing list
ffmpeg-user@ffmpeg.org
http://ffmpeg.org/mailman/listinfo/ffmpeg-user

To unsubscribe, visit link above, or email
ffmpeg-user-requ...@ffmpeg.org with subject "unsubscribe".

Re: [FFmpeg-user] h264_vaapi missing frames

[Mark Thompson]

On 23/03/18 01:28, Kai Hendry wrote:
> Thank you Moritz! Damn, I feel like a fool. ;)
> 
> Unfortunately Mark's suggestion doesn't seem to have an impact.
> 
> As you hopefully can see here:
> https://s.natalian.org/2018-03-23/1521768226.mp4
> 
> The mouse still doesn't move smoothy across the screen. Hence I feel
> it's dropping frames!
> 
> https://s.natalian.org/2018-03-23/1521768226.mp4.log
> ...
> *** 38 dup!
> ...
> *** 33 dup!
> ...
> *** 40 dup!
> ...
> *** 39 dup!
> ...
> *** 40 dup!
> ...
> *** 38 dup!
> ...
> *** 40 dup!
> ...
> *** 39 dup!
> ...
> *** 39 dup!
> ...
> *** 39 dup!
> frame=  439 fps= 30 q=-0.0 Lsize=1870kB time=00:00:14.58 
> bitrate=1050.4kbits/s dup=381 drop=34 speed=0.985x

This is still duplicating a very large number of frames for video sync.  As 
suggested previously, please try with video sync disabled ("-vsync 0") or 
without audio.

- Mark
___
ffmpeg-user mailing list
ffmpeg-user@ffmpeg.org
http://ffmpeg.org/mailman/listinfo/ffmpeg-user

To unsubscribe, visit link above, or email
ffmpeg-user-requ...@ffmpeg.org with subject "unsubscribe".

Re: [FFmpeg-user] h264_vaapi missing frames

[Erik Dobberkau]

>
>
> Are you saying I'm doing something wrong with capturing?
>
>
I was merely suspecting your output device could be set to 60Hz, but you're
only capturing every other frame when setting your ffmpeg input to 30Hz. I
might be wrong.
___
ffmpeg-user mailing list
ffmpeg-user@ffmpeg.org
http://ffmpeg.org/mailman/listinfo/ffmpeg-user

To unsubscribe, visit link above, or email
ffmpeg-user-requ...@ffmpeg.org with subject "unsubscribe".

Re: [FFmpeg-user] h264_vaapi missing frames

[Kai Hendry]

On 23 March 2018 at 14:06, Erik Dobberkau  wrote:
> If you only capture a fraction of the frames your device is actually
> producing without motion blending, isn't that to be expected?

A fraction of the frames? I should iiuc be capturing at 30 fps. I am
not quite sure how to tell how much is being dropped (which I don't
want!)

it's just over 14.65s. So there should be at least 14*30 420 frames encoded.
  Input stream #0:0 (video): 92 packets read (1356595200 bytes); 92
frames decoded;

Are you saying I'm doing something wrong with capturing?
___
ffmpeg-user mailing list
ffmpeg-user@ffmpeg.org
http://ffmpeg.org/mailman/listinfo/ffmpeg-user

To unsubscribe, visit link above, or email
ffmpeg-user-requ...@ffmpeg.org with subject "unsubscribe".

Re: [FFmpeg-user] h264_vaapi missing frames

[Erik Dobberkau]

> Unfortunately Mark's suggestion doesn't seem to have an impact.
>
> As you hopefully can see here:
> https://s.natalian.org/2018-03-23/1521768226.mp4
>
> The mouse still doesn't move smoothy across the screen. Hence I feel
> it's dropping frames!
>
>
Simple question:
If you only capture a fraction of the frames your device is actually
producing without motion blending, isn't that to be expected?
___
ffmpeg-user mailing list
ffmpeg-user@ffmpeg.org
http://ffmpeg.org/mailman/listinfo/ffmpeg-user

To unsubscribe, visit link above, or email
ffmpeg-user-requ...@ffmpeg.org with subject "unsubscribe".

Re: [FFmpeg-user] h264_vaapi missing frames

[Kai Hendry]

Thank you Moritz! Damn, I feel like a fool. ;)

Unfortunately Mark's suggestion doesn't seem to have an impact.

As you hopefully can see here:
https://s.natalian.org/2018-03-23/1521768226.mp4

The mouse still doesn't move smoothy across the screen. Hence I feel
it's dropping frames!

https://s.natalian.org/2018-03-23/1521768226.mp4.log


Kind regards,
___
ffmpeg-user mailing list
ffmpeg-user@ffmpeg.org
http://ffmpeg.org/mailman/listinfo/ffmpeg-user

To unsubscribe, visit link above, or email
ffmpeg-user-requ...@ffmpeg.org with subject "unsubscribe".

Re: [FFmpeg-user] h264_vaapi missing frames

[Moritz Barsnick]

On Thu, Mar 22, 2018 at 09:22:24 +0800, Kai Hendry wrote:
> https://s.natalian.org/2018-03-22/1521681432.mp4.log
> I'm getting hwupload,scale_vaapi=format=nv12: Invalid argument
> 
> Did I miss something?

Yes, the lines before that one. This hints that your command line is
misinterpreted:
> Opening an output file: hwupload,scale_vaapi=format=nv12.
This is where it goes wrong:
> Applying option vf (set video filters) with argument -vf.

Which points to the obvious:
> [...] -movflags +faststart -vf -vf "hwupload,scale_vaapi=format=nv12" [...]
 ^^^

One "-vf" too many. :-)

Moritz

P.S.: That log was definitely short enough (by far) to post/attach it
  here directly.
___
ffmpeg-user mailing list
ffmpeg-user@ffmpeg.org
http://ffmpeg.org/mailman/listinfo/ffmpeg-user

To unsubscribe, visit link above, or email
ffmpeg-user-requ...@ffmpeg.org with subject "unsubscribe".

Re: [FFmpeg-user] h264_vaapi missing frames

[Kai Hendry]

On 21 March 2018 at 19:17, Mark Thompson  wrote:
> If that doesn't work then I suggest reducing the test case to find which 
> parts are causing the problem - e.g. try without audio, using libx264 instead 
> of VAAPI, without extra video sync ("-vsync 0").

Thanks! Will give it a shot.

> Aside:  the command you have there does colour-conversion on the CPU (x11grab 
> makes bgr0, the format filter there makes it convert to nv12 before upload).  
> It is possible to do the conversion on the GPU instead by putting a 
> conversion after hwupload, which is often faster: "-vf 
> 'hwupload,scale_vaapi=format=nv12'" (though note that this has less control 
> over colourspaces, so the colours can be a bit wrong in some cases).

https://s.natalian.org/2018-03-22/1521681432.mp4.log
I'm getting hwupload,scale_vaapi=format=nv12: Invalid argument

Did I miss something?

My native resolution is 2560x1440, but I don't mind it being scaled
down to 1080p. Would that help things I wonder? Will have to try as
soon as figure out the CLI.
___
ffmpeg-user mailing list
ffmpeg-user@ffmpeg.org
http://ffmpeg.org/mailman/listinfo/ffmpeg-user

To unsubscribe, visit link above, or email
ffmpeg-user-requ...@ffmpeg.org with subject "unsubscribe".

Re: [FFmpeg-user] h264_vaapi missing frames

[Mark Thompson]

On 20/03/18 10:24, Kai Hendry wrote:
> Hi Mark,
> 
> On 20 March 2018 at 17:58, Mark Thompson  wrote:
>> Show your command line?  The pts values in that file are quite uniform, 
>> suggesting that you've forced the output to be treated as if it is 30/1001 
>> fps even if it isn't.  The status line also says "frame=  529 ... dup=430", 
>> which I think means it has captured 100 frames and made 430 duplicates to 
>> keep the framerate.
> 
> Sorry, I've just discovered -report.
> 
> https://s.natalian.org/2018-03-20/1521541273.mp4.log
> https://s.natalian.org/2018-03-20/1521541273.mp4
> 
> https://github.com/kaihendry/recordmydesktop2.0/blob/vaapi/x11capture
> is the script in question.
> 
> Does that better tell you what I'm doing wrong?

The -re option might be causing problems there - it is meant to be used for 
pretending that a file is a real-time source, not for actual real-time sources 
(see the documentation at , 
which warns against doing exactly this).  With that option removed I would 
expect it to use the real timestamps from x11grab which hopefully gives better 
results.

If that doesn't work then I suggest reducing the test case to find which parts 
are causing the problem - e.g. try without audio, using libx264 instead of 
VAAPI, without extra video sync ("-vsync 0").

- Mark


Aside:  the command you have there does colour-conversion on the CPU (x11grab 
makes bgr0, the format filter there makes it convert to nv12 before upload).  
It is possible to do the conversion on the GPU instead by putting a conversion 
after hwupload, which is often faster: "-vf 'hwupload,scale_vaapi=format=nv12'" 
(though note that this has less control over colourspaces, so the colours can 
be a bit wrong in some cases).
___
ffmpeg-user mailing list
ffmpeg-user@ffmpeg.org
http://ffmpeg.org/mailman/listinfo/ffmpeg-user

To unsubscribe, visit link above, or email
ffmpeg-user-requ...@ffmpeg.org with subject "unsubscribe".

Re: [FFmpeg-user] h264_vaapi missing frames

[Kai Hendry]

Hi Mark,

On 20 March 2018 at 17:58, Mark Thompson  wrote:
> Show your command line?  The pts values in that file are quite uniform, 
> suggesting that you've forced the output to be treated as if it is 30/1001 
> fps even if it isn't.  The status line also says "frame=  529 ... dup=430", 
> which I think means it has captured 100 frames and made 430 duplicates to 
> keep the framerate.

Sorry, I've just discovered -report.

https://s.natalian.org/2018-03-20/1521541273.mp4.log
https://s.natalian.org/2018-03-20/1521541273.mp4

https://github.com/kaihendry/recordmydesktop2.0/blob/vaapi/x11capture
is the script in question.

Does that better tell you what I'm doing wrong?
___
ffmpeg-user mailing list
ffmpeg-user@ffmpeg.org
http://ffmpeg.org/mailman/listinfo/ffmpeg-user

To unsubscribe, visit link above, or email
ffmpeg-user-requ...@ffmpeg.org with subject "unsubscribe".

Re: [FFmpeg-user] h264_vaapi missing frames

[Mark Thompson]

On 20/03/18 02:30, Kai Hendry wrote:
> Hi there,
> 
> With my brand new Intel 8th gen laptop (Intel Corporation UHD Graphics
> 620 (rev 07) with 8 core Intel(R) Core(TM) i7-8550U CPU @ 1.80GHz on
> Archlinux, I thought I'd experiment with hardware accelerated capture
> as opposed to my normal 2-step approach of
> 1) recording to mkv
> https://github.com/kaihendry/recordmydesktop2.0/blob/master/x11capture
> 2) converting mkv to mp4
> https://github.com/kaihendry/recordmydesktop2.0/blob/master/htmlvideo
> 
> 
> However with -vaapi_device /dev/dri/renderD128 -movflags +faststart
> -vf 'format=nv12|vaapi,hwupload' -c:v h264_vaapi it seems to skip
> frames.
> 
> https://s.natalian.org/2018-03-20/1521512464.mp4.log
> https://s.natalian.org/2018-03-20/1521512464.mp4
> 
> 
> Ffprobe seems to say it's 30fps:
>  Stream #0:0(und): Video: h264 (High) (avc1 / 0x31637661), yuv420p,
> 2560x1440, 722 kb/s, 29.97 fps, 29.97 tbr, 30k tbn, 59.94 tbc
> (default)
> 
> But during playback, it would appear not!
> 
> Is there a good way to test or know I've dropped frames in my screen capture?
> 
> How can I prevent frame dropping?

Show your command line?  The pts values in that file are quite uniform, 
suggesting that you've forced the output to be treated as if it is 30/1001 fps 
even if it isn't.  The status line also says "frame=  529 ... dup=430", which I 
think means it has captured 100 frames and made 430 duplicates to keep the 
framerate.

- Mark
___
ffmpeg-user mailing list
ffmpeg-user@ffmpeg.org
http://ffmpeg.org/mailman/listinfo/ffmpeg-user

To unsubscribe, visit link above, or email
ffmpeg-user-requ...@ffmpeg.org with subject "unsubscribe".

Re: [FFmpeg-user] h264_vaapi missing frames

[Kai Hendry]

Thanks Dennis for the suggestion!

On 20 March 2018 at 10:54, Dennis Mungai  wrote:
> Have you tried using the restream option?
> ffmpeg -re -i capture_device -vaapi_device /dev/dri/renderD128
> -movflags +faststart
> -vf 'format=nv12|vaapi,hwupload' -c:v h264_vaapi {$encoder_opts} outputfile.

I don't think it made a difference judging how it captured my mouse pointer.

https://s.natalian.org/2018-03-20/1521525601.mp4.log
https://s.natalian.org/2018-03-20/1521525601.mp4

Sidenote: the log doesn't seem to log my cmdline, am I missing a debug switch?
___
ffmpeg-user mailing list
ffmpeg-user@ffmpeg.org
http://ffmpeg.org/mailman/listinfo/ffmpeg-user

To unsubscribe, visit link above, or email
ffmpeg-user-requ...@ffmpeg.org with subject "unsubscribe".

Re: [FFmpeg-user] h264_vaapi missing frames

[Dennis Mungai]

Hello there,

Have you tried using the restream option?

ffmpeg -re -i capture_device -vaapi_device /dev/dri/renderD128
-movflags +faststart
-vf 'format=nv12|vaapi,hwupload' -c:v h264_vaapi {$encoder_opts} outputfile.

Try and report back.

On 20 March 2018 at 05:30, Kai Hendry  wrote:
> Hi there,
>
> With my brand new Intel 8th gen laptop (Intel Corporation UHD Graphics
> 620 (rev 07) with 8 core Intel(R) Core(TM) i7-8550U CPU @ 1.80GHz on
> Archlinux, I thought I'd experiment with hardware accelerated capture
> as opposed to my normal 2-step approach of
> 1) recording to mkv
> https://github.com/kaihendry/recordmydesktop2.0/blob/master/x11capture
> 2) converting mkv to mp4
> https://github.com/kaihendry/recordmydesktop2.0/blob/master/htmlvideo
>
>
> However with -vaapi_device /dev/dri/renderD128 -movflags +faststart
> -vf 'format=nv12|vaapi,hwupload' -c:v h264_vaapi it seems to skip
> frames.
>
> https://s.natalian.org/2018-03-20/1521512464.mp4.log
> https://s.natalian.org/2018-03-20/1521512464.mp4
>
>
> Ffprobe seems to say it's 30fps:
>  Stream #0:0(und): Video: h264 (High) (avc1 / 0x31637661), yuv420p,
> 2560x1440, 722 kb/s, 29.97 fps, 29.97 tbr, 30k tbn, 59.94 tbc
> (default)
>
> But during playback, it would appear not!
>
> Is there a good way to test or know I've dropped frames in my screen capture?
>
> How can I prevent frame dropping?
>
> Kind regards,
> ___
> ffmpeg-user mailing list
> ffmpeg-user@ffmpeg.org
> http://ffmpeg.org/mailman/listinfo/ffmpeg-user
>
> To unsubscribe, visit link above, or email
> ffmpeg-user-requ...@ffmpeg.org with subject "unsubscribe".
___
ffmpeg-user mailing list
ffmpeg-user@ffmpeg.org
http://ffmpeg.org/mailman/listinfo/ffmpeg-user

To unsubscribe, visit link above, or email
ffmpeg-user-requ...@ffmpeg.org with subject "unsubscribe".

[FFmpeg-user] h264_vaapi missing frames

[Kai Hendry]

Hi there,

With my brand new Intel 8th gen laptop (Intel Corporation UHD Graphics
620 (rev 07) with 8 core Intel(R) Core(TM) i7-8550U CPU @ 1.80GHz on
Archlinux, I thought I'd experiment with hardware accelerated capture
as opposed to my normal 2-step approach of
1) recording to mkv
https://github.com/kaihendry/recordmydesktop2.0/blob/master/x11capture
2) converting mkv to mp4
https://github.com/kaihendry/recordmydesktop2.0/blob/master/htmlvideo


However with -vaapi_device /dev/dri/renderD128 -movflags +faststart
-vf 'format=nv12|vaapi,hwupload' -c:v h264_vaapi it seems to skip
frames.

https://s.natalian.org/2018-03-20/1521512464.mp4.log
https://s.natalian.org/2018-03-20/1521512464.mp4


Ffprobe seems to say it's 30fps:
 Stream #0:0(und): Video: h264 (High) (avc1 / 0x31637661), yuv420p,
2560x1440, 722 kb/s, 29.97 fps, 29.97 tbr, 30k tbn, 59.94 tbc
(default)

But during playback, it would appear not!

Is there a good way to test or know I've dropped frames in my screen capture?

How can I prevent frame dropping?

Kind regards,
___
ffmpeg-user mailing list
ffmpeg-user@ffmpeg.org
http://ffmpeg.org/mailman/listinfo/ffmpeg-user

To unsubscribe, visit link above, or email
ffmpeg-user-requ...@ffmpeg.org with subject "unsubscribe".