Re: [FFmpeg-user] why are my streams not aligned?
On Mon, Nov 18, 2019 at 1:08 PM Ted Park wrote: > > > I am not sure what you mean? I thought I was doing a simple encoding: > > > > - One input video only, one output for video. > > - One audio input plus a finalized video input for the audio output. > Yes, but you have separate (raw) input sources. > > I think by alignment you are referring to the segment durations varying > from each variant to another which could be a simple fix (at least I think?) > > Map is used to end up with a video only stream and an audio only stream. > by using the variant map for the hls muxer. > > But then when you play the result, are the video and audio going to be in > sync is what I’m wondering, since they come from separate sources, and > processed on separate tasks. > > > I am only including the copied video because I was under the impression > > that it was required to properly segment the audio file. > > The audio stream doesn’t even have to be ts, you could have separate aac > files for each segment. If you mean properly wrt synchronization, that’s > what I’m wondering, since you have separate audio and video sources, is > that even going to make any difference? > > i.e. if you simply multiplex the input and output, are the video and audio > in sync? If so, using that file and variant map would make things a lot > simpler. > ___ > ffmpeg-user mailing list > ffmpeg-user@ffmpeg.org > https://ffmpeg.org/mailman/listinfo/ffmpeg-user > > To unsubscribe, visit link above, or email > ffmpeg-user-requ...@ffmpeg.org with subject "unsubscribe". Your questions made me check the source in more detail =) I picked a random test video from FFMPEG test cases to run through processing. The audio duration is longer than the video duration. I think that is my issue here, but I will report back if it turns out not to be the problem! ___ ffmpeg-user mailing list ffmpeg-user@ffmpeg.org https://ffmpeg.org/mailman/listinfo/ffmpeg-user To unsubscribe, visit link above, or email ffmpeg-user-requ...@ffmpeg.org with subject "unsubscribe".
Re: [FFmpeg-user] why are my streams not aligned?
On Mon, Nov 18, 2019 at 12:37 PM Ted Park wrote: > The target duration randomly being changed to 7 is weird, but why are you > doing this at all? Can’t you just do a simple encoding to a ts file for the > video first with the right gop settings then have that be the reference for > creating the hls playlist? Or even just create the ts file from both video > and audio and prepare it for hls? Because how do you know they were synched > to a common clock in the first place... > ___ > ffmpeg-user mailing list > ffmpeg-user@ffmpeg.org > https://ffmpeg.org/mailman/listinfo/ffmpeg-user > > To unsubscribe, visit link above, or email > ffmpeg-user-requ...@ffmpeg.org with subject "unsubscribe". I am not sure what you mean? I thought I was doing a simple encoding: - One input video only, one output for video. - One audio input plus a finalized video input for the audio output. Map is used to end up with a video only stream and an audio only stream. I am only including the copied video because I was under the impression that it was required to properly segment the audio file. It is omitted from the final output on the audio only stream. ___ ffmpeg-user mailing list ffmpeg-user@ffmpeg.org https://ffmpeg.org/mailman/listinfo/ffmpeg-user To unsubscribe, visit link above, or email ffmpeg-user-requ...@ffmpeg.org with subject "unsubscribe".
Re: [FFmpeg-user] why are my streams not aligned?
On Mon, Nov 18, 2019 at 10:54 AM Dennis Mungai wrote: > On Mon, 18 Nov 2019, 18:44 Dennis Mungai, wrote: > > > > > > > On Mon, 18 Nov 2019, 18:38 gordon, wrote: > > > >> Okay, thank you. I will give that a go. > >> > >> -- aside -- > >> > >> I thought that the "-force_key_frames expr:gte(t,n_forced*2)" was > placing > >> the key frames for segment boundaries and still allowing the encoder to > >> place other keyframes where they wanted? I am trying to use h264, h265, > >> and vp9 so I figured the keyframes not at boundaries would need to be > >> different for efficiency. > >> > >> How do I determine the best (or good) value for "-g" given a particular > >> source file and target duration for segments? > >> > >> On Mon, Nov 18, 2019 at 10:19 AM Dennis Mungai > wrote: > >> > >> > On Mon, 18 Nov 2019 at 17:31, gordon wrote: > >> > > >> > > Why are the segments for my stream not aligned? The first command > >> > outputs > >> > > video segment. The second command outputs an audio segment with the > >> > > previous video output copied in. > >> > > > >> > > Ffmpeg commands are pasted below with the m3u8 outputs. The same > >> results > >> > > were observed on ffmpeg 4.2.1 and snapshot > >> > > > >> > > /usr/local/bin/ffmpeg -y -loglevel error -f rawvideo -vcodec > rawvideo > >> -s > >> > > 160x120 -pix_fmt rgb24 -r 12.00 -i - -an -vcodec libx264 -preset > >> medium > >> > -f > >> > > hls -an -hls_flags single_file -hls_time 6 -hls_list_size 0 > >> > > -hls_segment_type mpegts -hls_segment_filename > >> > > > >> > > > >> > > >> > /tmp/973b7b02b6e6486f90d3064527a69701/output/21b79578a1d04533932e32d28f46eb94.ts > >> > > -hls_playlist_type vod -master_pl_name > >> > > 21b79578a1d04533932e32d28f46eb94-master.m3u8 -force_key_frames > >> > > 'expr:gte(t,n_forced*2)' -profile:v baseline -level 3.0 -pix_fmt > >> yuv420p > >> > > -vsync cfr -b 145k -pix_fmt yuv420p > >> > > > >> > > > >> > > >> > /tmp/973b7b02b6e6486f90d3064527a69701/output/21b79578a1d04533932e32d28f46eb94-variant.m3u8 > >> > > > >> > > #EXTM3U > >> > > #EXT-X-VERSION:4 > >> > > #EXT-X-TARGETDURATION:6 > >> > > #EXT-X-MEDIA-SEQUENCE:0 > >> > > #EXT-X-PLAYLIST-TYPE:VOD > >> > > #EXTINF:6.00, > >> > > #EXT-X-BYTERANGE:116748@0 > >> > > 21b79578a1d04533932e32d28f46eb94.ts > >> > > #EXTINF:6.00, > >> > > #EXT-X-BYTERANGE:96256@116748 > >> > > 21b79578a1d04533932e32d28f46eb94.ts > >> > > #EXTINF:6.00, > >> > > #EXT-X-BYTERANGE:143256@213004 > >> > > 21b79578a1d04533932e32d28f46eb94.ts > >> > > #EXTINF:6.00, > >> > > #EXT-X-BYTERANGE:97760@356260 > >> > > 21b79578a1d04533932e32d28f46eb94.ts > >> > > #EXTINF:5.75, > >> > > #EXT-X-BYTERANGE:75764@454020 > >> > > 21b79578a1d04533932e32d28f46eb94.ts > >> > > #EXT-X-ENDLIST > >> > > > >> > > > >> > > /usr/local/bin/ffmpeg -y -loglevel error -f s16le -acodec pcm_s16le > >> -ar > >> > > 44100 -ac 2 -i - -i > >> > > > >> > > > >> > > >> > /tmp/973b7b02b6e6486f90d3064527a69701/output/21b79578a1d04533932e32d28f46eb94.ts > >> > > -vcodec copy -acodec libfdk_aac -ar 44100 -strict -2 -profile:a > >> aac_he_v2 > >> > > -vbr 1 -f hls -hls_flags single_file -hls_time 6 -hls_list_size 0 > >> > > -hls_segment_type mpegts -hls_segment_filename > >> > > > >> > > > >> > > >> > /tmp/973b7b02b6e6486f90d3064527a69701/output/e3658a88388c4d4da25681956bccb00f.ts > >> > > -hls_playlist_type vod -master_pl_name > >> > > e3658a88388c4d4da25681956bccb00f-master.m3u8 -force_key_frames > >> > > 'expr:gte(t,n_forced*2)' -pix_fmt yuv420p -vsync cfr > >> > > > >> > > > >> > > >> > /tmp/973b7b02b6e6486f90d3064527a69701/output/e3658a88388c4d4da25681956bccb00f-variant.m3u8 > >> > > > >> > > #EXTM3U > >> > > #EXT-X-VERSION:4
Re: [FFmpeg-user] why are my streams not aligned?
On Mon, Nov 18, 2019 at 10:37 AM gordon wrote: > Okay, thank you. I will give that a go. > > -- aside -- > > I thought that the "-force_key_frames expr:gte(t,n_forced*2)" was placing > the key frames for segment boundaries and still allowing the encoder to > place other keyframes where they wanted? I am trying to use h264, h265, > and vp9 so I figured the keyframes not at boundaries would need to be > different for efficiency. > > How do I determine the best (or good) value for "-g" given a particular > source file and target duration for segments? > > On Mon, Nov 18, 2019 at 10:19 AM Dennis Mungai wrote: > >> On Mon, 18 Nov 2019 at 17:31, gordon wrote: >> >> > Why are the segments for my stream not aligned? The first command >> outputs >> > video segment. The second command outputs an audio segment with the >> > previous video output copied in. >> > >> > Ffmpeg commands are pasted below with the m3u8 outputs. The same >> results >> > were observed on ffmpeg 4.2.1 and snapshot >> > >> > /usr/local/bin/ffmpeg -y -loglevel error -f rawvideo -vcodec rawvideo -s >> > 160x120 -pix_fmt rgb24 -r 12.00 -i - -an -vcodec libx264 -preset medium >> -f >> > hls -an -hls_flags single_file -hls_time 6 -hls_list_size 0 >> > -hls_segment_type mpegts -hls_segment_filename >> > >> > >> /tmp/973b7b02b6e6486f90d3064527a69701/output/21b79578a1d04533932e32d28f46eb94.ts >> > -hls_playlist_type vod -master_pl_name >> > 21b79578a1d04533932e32d28f46eb94-master.m3u8 -force_key_frames >> > 'expr:gte(t,n_forced*2)' -profile:v baseline -level 3.0 -pix_fmt yuv420p >> > -vsync cfr -b 145k -pix_fmt yuv420p >> > >> > >> /tmp/973b7b02b6e6486f90d3064527a69701/output/21b79578a1d04533932e32d28f46eb94-variant.m3u8 >> > >> > #EXTM3U >> > #EXT-X-VERSION:4 >> > #EXT-X-TARGETDURATION:6 >> > #EXT-X-MEDIA-SEQUENCE:0 >> > #EXT-X-PLAYLIST-TYPE:VOD >> > #EXTINF:6.00, >> > #EXT-X-BYTERANGE:116748@0 >> > 21b79578a1d04533932e32d28f46eb94.ts >> > #EXTINF:6.00, >> > #EXT-X-BYTERANGE:96256@116748 >> > 21b79578a1d04533932e32d28f46eb94.ts >> > #EXTINF:6.00, >> > #EXT-X-BYTERANGE:143256@213004 >> > 21b79578a1d04533932e32d28f46eb94.ts >> > #EXTINF:6.00, >> > #EXT-X-BYTERANGE:97760@356260 >> > 21b79578a1d04533932e32d28f46eb94.ts >> > #EXTINF:5.75, >> > #EXT-X-BYTERANGE:75764@454020 >> > 21b79578a1d04533932e32d28f46eb94.ts >> > #EXT-X-ENDLIST >> > >> > >> > /usr/local/bin/ffmpeg -y -loglevel error -f s16le -acodec pcm_s16le -ar >> > 44100 -ac 2 -i - -i >> > >> > >> /tmp/973b7b02b6e6486f90d3064527a69701/output/21b79578a1d04533932e32d28f46eb94.ts >> > -vcodec copy -acodec libfdk_aac -ar 44100 -strict -2 -profile:a >> aac_he_v2 >> > -vbr 1 -f hls -hls_flags single_file -hls_time 6 -hls_list_size 0 >> > -hls_segment_type mpegts -hls_segment_filename >> > >> > >> /tmp/973b7b02b6e6486f90d3064527a69701/output/e3658a88388c4d4da25681956bccb00f.ts >> > -hls_playlist_type vod -master_pl_name >> > e3658a88388c4d4da25681956bccb00f-master.m3u8 -force_key_frames >> > 'expr:gte(t,n_forced*2)' -pix_fmt yuv420p -vsync cfr >> > >> > >> /tmp/973b7b02b6e6486f90d3064527a69701/output/e3658a88388c4d4da25681956bccb00f-variant.m3u8 >> > >> > #EXTM3U >> > #EXT-X-VERSION:4 >> > #EXT-X-TARGETDURATION:6 >> > #EXT-X-MEDIA-SEQUENCE:0 >> > #EXT-X-PLAYLIST-TYPE:VOD >> > #EXTINF:6.00, >> > #EXT-X-BYTERANGE:146452@0 >> > e3658a88388c4d4da25681956bccb00f.ts >> > #EXTINF:6.00, >> > #EXT-X-BYTERANGE:125020@146452 >> > e3658a88388c4d4da25681956bccb00f.ts >> > #EXTINF:5.916667, >> > #EXT-X-BYTERANGE:167320@271472 >> > e3658a88388c4d4da25681956bccb00f.ts >> > #EXTINF:6.08, >> > #EXT-X-BYTERANGE:133856@438792 >> > e3658a88388c4d4da25681956bccb00f.ts >> > #EXTINF:5.75, >> > #EXT-X-BYTERANGE:103776@572648 >> > e3658a88388c4d4da25681956bccb00f.ts >> > #EXT-X-ENDLIST >> >> >> >> To ensure alignment, you must use a closed GOP (set via -flags +cgop) and >> specify a GOP size via the -g option passed to your video encoder. >> >> > >> > >> ___ >> ffmpeg-user mailing list >> ffmpeg-user@ffmpeg.org >> https://ffmpeg.org/mai
Re: [FFmpeg-user] why are my streams not aligned?
Okay, thank you. I will give that a go. -- aside -- I thought that the "-force_key_frames expr:gte(t,n_forced*2)" was placing the key frames for segment boundaries and still allowing the encoder to place other keyframes where they wanted? I am trying to use h264, h265, and vp9 so I figured the keyframes not at boundaries would need to be different for efficiency. How do I determine the best (or good) value for "-g" given a particular source file and target duration for segments? On Mon, Nov 18, 2019 at 10:19 AM Dennis Mungai wrote: > On Mon, 18 Nov 2019 at 17:31, gordon wrote: > > > Why are the segments for my stream not aligned? The first command > outputs > > video segment. The second command outputs an audio segment with the > > previous video output copied in. > > > > Ffmpeg commands are pasted below with the m3u8 outputs. The same results > > were observed on ffmpeg 4.2.1 and snapshot > > > > /usr/local/bin/ffmpeg -y -loglevel error -f rawvideo -vcodec rawvideo -s > > 160x120 -pix_fmt rgb24 -r 12.00 -i - -an -vcodec libx264 -preset medium > -f > > hls -an -hls_flags single_file -hls_time 6 -hls_list_size 0 > > -hls_segment_type mpegts -hls_segment_filename > > > > > /tmp/973b7b02b6e6486f90d3064527a69701/output/21b79578a1d04533932e32d28f46eb94.ts > > -hls_playlist_type vod -master_pl_name > > 21b79578a1d04533932e32d28f46eb94-master.m3u8 -force_key_frames > > 'expr:gte(t,n_forced*2)' -profile:v baseline -level 3.0 -pix_fmt yuv420p > > -vsync cfr -b 145k -pix_fmt yuv420p > > > > > /tmp/973b7b02b6e6486f90d3064527a69701/output/21b79578a1d04533932e32d28f46eb94-variant.m3u8 > > > > #EXTM3U > > #EXT-X-VERSION:4 > > #EXT-X-TARGETDURATION:6 > > #EXT-X-MEDIA-SEQUENCE:0 > > #EXT-X-PLAYLIST-TYPE:VOD > > #EXTINF:6.00, > > #EXT-X-BYTERANGE:116748@0 > > 21b79578a1d04533932e32d28f46eb94.ts > > #EXTINF:6.00, > > #EXT-X-BYTERANGE:96256@116748 > > 21b79578a1d04533932e32d28f46eb94.ts > > #EXTINF:6.00, > > #EXT-X-BYTERANGE:143256@213004 > > 21b79578a1d04533932e32d28f46eb94.ts > > #EXTINF:6.00, > > #EXT-X-BYTERANGE:97760@356260 > > 21b79578a1d04533932e32d28f46eb94.ts > > #EXTINF:5.75, > > #EXT-X-BYTERANGE:75764@454020 > > 21b79578a1d04533932e32d28f46eb94.ts > > #EXT-X-ENDLIST > > > > > > /usr/local/bin/ffmpeg -y -loglevel error -f s16le -acodec pcm_s16le -ar > > 44100 -ac 2 -i - -i > > > > > /tmp/973b7b02b6e6486f90d3064527a69701/output/21b79578a1d04533932e32d28f46eb94.ts > > -vcodec copy -acodec libfdk_aac -ar 44100 -strict -2 -profile:a aac_he_v2 > > -vbr 1 -f hls -hls_flags single_file -hls_time 6 -hls_list_size 0 > > -hls_segment_type mpegts -hls_segment_filename > > > > > /tmp/973b7b02b6e6486f90d3064527a69701/output/e3658a88388c4d4da25681956bccb00f.ts > > -hls_playlist_type vod -master_pl_name > > e3658a88388c4d4da25681956bccb00f-master.m3u8 -force_key_frames > > 'expr:gte(t,n_forced*2)' -pix_fmt yuv420p -vsync cfr > > > > > /tmp/973b7b02b6e6486f90d3064527a69701/output/e3658a88388c4d4da25681956bccb00f-variant.m3u8 > > > > #EXTM3U > > #EXT-X-VERSION:4 > > #EXT-X-TARGETDURATION:6 > > #EXT-X-MEDIA-SEQUENCE:0 > > #EXT-X-PLAYLIST-TYPE:VOD > > #EXTINF:6.00, > > #EXT-X-BYTERANGE:146452@0 > > e3658a88388c4d4da25681956bccb00f.ts > > #EXTINF:6.00, > > #EXT-X-BYTERANGE:125020@146452 > > e3658a88388c4d4da25681956bccb00f.ts > > #EXTINF:5.916667, > > #EXT-X-BYTERANGE:167320@271472 > > e3658a88388c4d4da25681956bccb00f.ts > > #EXTINF:6.08, > > #EXT-X-BYTERANGE:133856@438792 > > e3658a88388c4d4da25681956bccb00f.ts > > #EXTINF:5.75, > > #EXT-X-BYTERANGE:103776@572648 > > e3658a88388c4d4da25681956bccb00f.ts > > #EXT-X-ENDLIST > > > > To ensure alignment, you must use a closed GOP (set via -flags +cgop) and > specify a GOP size via the -g option passed to your video encoder. > > > > > > ___ > ffmpeg-user mailing list > ffmpeg-user@ffmpeg.org > https://ffmpeg.org/mailman/listinfo/ffmpeg-user > > To unsubscribe, visit link above, or email > ffmpeg-user-requ...@ffmpeg.org with subject "unsubscribe". ___ ffmpeg-user mailing list ffmpeg-user@ffmpeg.org https://ffmpeg.org/mailman/listinfo/ffmpeg-user To unsubscribe, visit link above, or email ffmpeg-user-requ...@ffmpeg.org with subject "unsubscribe".
[FFmpeg-user] why are my streams not aligned?
Why are the segments for my stream not aligned? The first command outputs video segment. The second command outputs an audio segment with the previous video output copied in. Ffmpeg commands are pasted below with the m3u8 outputs. The same results were observed on ffmpeg 4.2.1 and snapshot /usr/local/bin/ffmpeg -y -loglevel error -f rawvideo -vcodec rawvideo -s 160x120 -pix_fmt rgb24 -r 12.00 -i - -an -vcodec libx264 -preset medium -f hls -an -hls_flags single_file -hls_time 6 -hls_list_size 0 -hls_segment_type mpegts -hls_segment_filename /tmp/973b7b02b6e6486f90d3064527a69701/output/21b79578a1d04533932e32d28f46eb94.ts -hls_playlist_type vod -master_pl_name 21b79578a1d04533932e32d28f46eb94-master.m3u8 -force_key_frames 'expr:gte(t,n_forced*2)' -profile:v baseline -level 3.0 -pix_fmt yuv420p -vsync cfr -b 145k -pix_fmt yuv420p /tmp/973b7b02b6e6486f90d3064527a69701/output/21b79578a1d04533932e32d28f46eb94-variant.m3u8 #EXTM3U #EXT-X-VERSION:4 #EXT-X-TARGETDURATION:6 #EXT-X-MEDIA-SEQUENCE:0 #EXT-X-PLAYLIST-TYPE:VOD #EXTINF:6.00, #EXT-X-BYTERANGE:116748@0 21b79578a1d04533932e32d28f46eb94.ts #EXTINF:6.00, #EXT-X-BYTERANGE:96256@116748 21b79578a1d04533932e32d28f46eb94.ts #EXTINF:6.00, #EXT-X-BYTERANGE:143256@213004 21b79578a1d04533932e32d28f46eb94.ts #EXTINF:6.00, #EXT-X-BYTERANGE:97760@356260 21b79578a1d04533932e32d28f46eb94.ts #EXTINF:5.75, #EXT-X-BYTERANGE:75764@454020 21b79578a1d04533932e32d28f46eb94.ts #EXT-X-ENDLIST /usr/local/bin/ffmpeg -y -loglevel error -f s16le -acodec pcm_s16le -ar 44100 -ac 2 -i - -i /tmp/973b7b02b6e6486f90d3064527a69701/output/21b79578a1d04533932e32d28f46eb94.ts -vcodec copy -acodec libfdk_aac -ar 44100 -strict -2 -profile:a aac_he_v2 -vbr 1 -f hls -hls_flags single_file -hls_time 6 -hls_list_size 0 -hls_segment_type mpegts -hls_segment_filename /tmp/973b7b02b6e6486f90d3064527a69701/output/e3658a88388c4d4da25681956bccb00f.ts -hls_playlist_type vod -master_pl_name e3658a88388c4d4da25681956bccb00f-master.m3u8 -force_key_frames 'expr:gte(t,n_forced*2)' -pix_fmt yuv420p -vsync cfr /tmp/973b7b02b6e6486f90d3064527a69701/output/e3658a88388c4d4da25681956bccb00f-variant.m3u8 #EXTM3U #EXT-X-VERSION:4 #EXT-X-TARGETDURATION:6 #EXT-X-MEDIA-SEQUENCE:0 #EXT-X-PLAYLIST-TYPE:VOD #EXTINF:6.00, #EXT-X-BYTERANGE:146452@0 e3658a88388c4d4da25681956bccb00f.ts #EXTINF:6.00, #EXT-X-BYTERANGE:125020@146452 e3658a88388c4d4da25681956bccb00f.ts #EXTINF:5.916667, #EXT-X-BYTERANGE:167320@271472 e3658a88388c4d4da25681956bccb00f.ts #EXTINF:6.08, #EXT-X-BYTERANGE:133856@438792 e3658a88388c4d4da25681956bccb00f.ts #EXTINF:5.75, #EXT-X-BYTERANGE:103776@572648 e3658a88388c4d4da25681956bccb00f.ts #EXT-X-ENDLIST ___ ffmpeg-user mailing list ffmpeg-user@ffmpeg.org https://ffmpeg.org/mailman/listinfo/ffmpeg-user To unsubscribe, visit link above, or email ffmpeg-user-requ...@ffmpeg.org with subject "unsubscribe".
[FFmpeg-user] Syncing multiple MKV streams
I have a multi stream MKV container with 4 synced mp4 videos (multi-angle video). I need to be able to switch between the streams while maintaining the timecode, i.e. frame by frame switch from one angle to the other one. When I switch streams using v in ffplay, the switch occurs in real time; however, the video jumps to the next i-frame (at least that is what it looks like it is doing). Is there a way to switch streams while maintaining the original stream's clock? If there isn't a CLI solution to this problem can you point me to the correct location to inquire about modifying the code for this purpose? Thank you ___ ffmpeg-user mailing list ffmpeg-user@ffmpeg.org http://ffmpeg.org/mailman/listinfo/ffmpeg-user
