Re: youtube-dl → yt-dlp, was Re: OT: Detecting ISP throttling (was: Re: Potentially OT. Videos lagging & buffering in any browser but Google Chrome.)
30 mars 2023, 23:56 de debianl...@potentially-spam.de-bruyn.de: I was successful at downloading the video with: yt-dlp --verbose -k --ignore-config -c https://manifest.prod.boltdns.net/manifest/v1/hls/v4/clear/1241706627001/83ddeca4-2e3a-4149-840f-0ca907c2cb59/10s/master.m3u8?fastly_token=NjQyNjYyOWZfOTIzNjUyM2MwN2JlZTI3NjdhNDcwMjM4ZjhmNmY1MmRiZTQxMzM5ZTllOTYyM2E3YTkxZWNhOGQxYmY1YTU0OA%3D%3D after finishing download, i found the file master-master.mp4 If you (the poster who managed to download the video, using the above command and URL) happen to remember how you got to the URL, please either post the steps to the list, or, send to me direct, as I have two more videos from Rootstech 2023, that I want to download, that they have not yet (and are therefore, unlikely to be) uploaded to youtube for viewing/downloading, and, I have problems with the streaming of videos, in that the streams get blocked/broken, causing continuity problems in the videos. And, whilst I have tried applying the Rootstech web site videos' URL's, in vlc, to view/capture streaming videos in vlc, that does not work. vlc is the only Linux application of which I am aware, that would be likely to download/capture the videos direct from the Rootstech web site, and, as I cannot get that to work, the only means that I believe that is available, for downloading the videos, if the process can be determined, for achieving the downloadable videos as above, is similarly through using yt-dlp, through the web site at manifest.prod.boltdns.net . But, I have no idea as to how to get to the path, for each of the videos that I want, within or through that web site. Thank you in anticipation. .. Bret Busby Armadale West Australia (UTC+0800) ..
Re: youtube-dl → yt-dlp, was Re: OT: Detecting ISP throttling (was: Re: Potentially OT. Videos lagging & buffering in any browser but Google Chrome.)
Am 31.03.2023 um 00:28 schrieb l0f...@tuta.io: > How do you get that URL? Via your browser resource/code inspector? Hi, i had been asking not having to answer that question, because i myself do not really understand, how it works. I stumbled across an explanation while skimming through open issues of yt-dlp on github. But unfortunately i did not save the link. => Happy searching ;-)
Re: youtube-dl → yt-dlp, was Re: OT: Detecting ISP throttling (was: Re: Potentially OT. Videos lagging & buffering in any browser but Google Chrome.)
Hi, 30 mars 2023, 23:56 de debianl...@potentially-spam.de-bruyn.de: > I was successful at downloading the video with: > >> yt-dlp --verbose -k --ignore-config -c >> https://manifest.prod.boltdns.net/manifest/v1/hls/v4/clear/1241706627001/83ddeca4-2e3a-4149-840f-0ca907c2cb59/10s/master.m3u8?fastly_token=NjQyNjYyOWZfOTIzNjUyM2MwN2JlZTI3NjdhNDcwMjM4ZjhmNmY1MmRiZTQxMzM5ZTllOTYyM2E3YTkxZWNhOGQxYmY1YTU0OA%3D%3D >> > > after finishing download, i found the file > >> master-master.mp4 >> Indeed, well done. Actually, it works as well without any yt-dlp option/switch. How do you get that URL? Via your browser resource/code inspector? l0f4r0
Re: youtube-dl → yt-dlp, was Re: OT: Detecting ISP throttling (was: Re: Potentially OT. Videos lagging & buffering in any browser but Google Chrome.)
On Thu, 30 Mar 2023 23:28:23 +0200 (CEST)
l0f...@tuta.io wrote:
Hello l0f...@tuta.io,
>Interesting theory but I can play that specific video in my browser
>without being logged in ;)
Weird; I had to log in first. No idea why your experience differs.
Still, as this doesn't forward the core issue, I'll leave it there.
--
Regards _ "Valid sig separator is {dash}{dash}{space}"
/ ) "The blindingly obvious is never immediately apparent"
/ _)rad "Is it only me that has a working delete key?"
Sign away your life
Tin Soldiers - Stiff Little Fingers
pgp6zu6CjrXEk.pgp
Description: OpenPGP digital signature
Re: youtube-dl → yt-dlp, was Re: OT: Detecting ISP throttling (was: Re: Potentially OT. Videos lagging & buffering in any browser but Google Chrome.)
Am 30.03.2023 um 20:20 schrieb Bret Busby: > On 31/3/23 02:08, David Wright wrote: >> On Fri 31 Mar 2023 at 01:41:04 (+0800), Bret Busby wrote: >>> On 31/3/23 00:40, David Wright wrote: On Thu 30 Mar 2023 at 19:31:21 (+0800), Bret Busby wrote: > I had previously been able to use youtube-dl, to download videos from > youtube, but, it no longer works with youtube. AIUI youtube-dl is now obsolete, and its new spelling is yt-dlp. You can download it from bullseye-backports. If you're a backports user, just install it and check out the CLI options you normally use, in case they've been tweaked, with: $ yt-dlp -help | less > And, I had been able to download videos from some streaming hosts, > but, find that I cannot download videos from other streaming hosts. > > By download, I mean saving to my computer - so that I can get > continuity, and, replay the streamed videos at slower speeds, and, > manipulate the sound, so that I (having a hearing disability that > affects my ability to hear what is spoken) can better hear what is > being said, which is important for educational videos, such as at > Rootstech 2023, where I cannot download significant videos. The yt-dlp dependencies are all unversioned, so rather than put backports into my sources.list, I just checked that I had them all, downloaded yt-dlp….deb from the Packages page, and installed it with the apt-get install /full-path-to/yt-dlp….deb syntax. (The backports youtube-dl package used to get very long in the tooth at times, so I've done this frequently in the past.) Whenever downloading fails, I check out whether there's a more up-to-date version with the yt-dlp -U option. Apparently there's a bug in yt-dlp at the moment, but I don't think either of us uses mpv /with/ the downloader, but only /after/ downloading has completed. >>> I had downloaded and installed yt-dlp, but, that did not work, either. >> >> Writing "did not work" just doesn't cut it on this list: >> we need some specifics. Here's an example I ran this >> morning on a reference given by David Christensen: >> >> $ gy bKzonnwoR2I >> /usr/bin/yt-dlp http://www.youtube.com/watch?v=bKzonnwoR2I >> [youtube] Extracting URL: http://www.youtube.com/watch?v=bKzonnwoR2I >> [youtube] bKzonnwoR2I: Downloading webpage >> [youtube] bKzonnwoR2I: Downloading android player API JSON >> [info] bKzonnwoR2I: Downloading 1 format(s): 248+251 >> [download] Destination: Unix Pipeline (Brian Kernighan) - >> Computerphile [bKzonnwoR2I].f248.webm >> [download] 100% of 50.64MiB in 00:00:05 at 8.45MiB/s >> [download] Destination: Unix Pipeline (Brian Kernighan) - >> Computerphile [bKzonnwoR2I].f251.webm >> [download] 100% of 3.85MiB in 00:00:00 at 6.28MiB/s >> [Merger] Merging formats into "Unix Pipeline (Brian Kernighan) - >> Computerphile [bKzonnwoR2I].webm" >> Remember to remove any unmerged files as appropriate. >> $ >> >> Whether you can download that would determine where you go from here. >> >> Cheers, >> David. >> > Fri Mar 31 02:18:31 bret@bret-Precision-Tower-5810:~$yt-dlp > https://www.familysearch.org/rootstech/session/expanding-your-family-tree-with-sideview-and-more-innovations-from-ancestrydna?lang=eng > > [generic] > expanding-your-family-tree-with-sideview-and-more-innovations-from-ancestrydna?lang=eng: > Requesting header > WARNING: [generic] Falling back on generic information extractor. > [generic] > expanding-your-family-tree-with-sideview-and-more-innovations-from-ancestrydna?lang=eng: > Downloading webpage > [generic] > expanding-your-family-tree-with-sideview-and-more-innovations-from-ancestrydna?lang=eng: > Extracting information > ERROR: Unsupported URL: > https://www.familysearch.org/rootstech/session/expanding-your-family-tree-with-sideview-and-more-innovations-from-ancestrydna?lang=eng > > Fri Mar 31 02:19:05 bret@bret-Precision-Tower-5810:~$ > > > .. > Bret Busby > Armadale > West Australia > (UTC+0800) > .. > > I was successful at downloading the video with: > yt-dlp --verbose -k --ignore-config -c > https://manifest.prod.boltdns.net/manifest/v1/hls/v4/clear/1241706627001/83ddeca4-2e3a-4149-840f-0ca907c2cb59/10s/master.m3u8?fastly_token=NjQyNjYyOWZfOTIzNjUyM2MwN2JlZTI3NjdhNDcwMjM4ZjhmNmY1MmRiZTQxMzM5ZTllOTYyM2E3YTkxZWNhOGQxYmY1YTU0OA%3D%3D after finishing download, i found the file > master-master.mp4 Dont ask me, how i did this, because i dont know, just happened to work.
Re: youtube-dl → yt-dlp, was Re: OT: Detecting ISP throttling (was: Re: Potentially OT. Videos lagging & buffering in any browser but Google Chrome.)
Hello Brad, 30 mars 2023, 23:20 de b...@fineby.me.uk: > >In your case, yt-dlp falls back on its generic extractor (documentation > >says "Generic downloader that works on some sites") but it doesn't work > >for familysearch.org visibly... > > Largely, I suspect, it's because to access video on that FamilySearch > page, one is required to be logged in. IDK whether yt-dlp can handle > that. > Interesting theory but I can play that specific video in my browser without being logged in ;) l0f4r0
Re: youtube-dl → yt-dlp, was Re: OT: Detecting ISP throttling (was: Re: Potentially OT. Videos lagging & buffering in any browser but Google Chrome.)
On Thu, 30 Mar 2023 22:55:05 +0200 (CEST)
l0f...@tuta.io wrote:
Hello l0f...@tuta.io,
>In your case, yt-dlp falls back on its generic extractor (documentation
>says "Generic downloader that works on some sites") but it doesn't work
>for familysearch.org visibly...
Largely, I suspect, it's because to access video on that FamilySearch
page, one is required to be logged in. IDK whether yt-dlp can handle
that.
--
Regards _ "Valid sig separator is {dash}{dash}{space}"
/ ) "The blindingly obvious is never immediately apparent"
/ _)rad "Is it only me that has a working delete key?"
Success defined by acquisition stinks
Money is Not Our God - Killing Joke
pgpKN1faLi1Xv.pgp
Description: OpenPGP digital signature
Re: youtube-dl → yt-dlp, was Re: OT: Detecting ISP throttling (was: Re: Potentially OT. Videos lagging & buffering in any browser but Google Chrome.)
Hello, 30 mars 2023, 20:46 de b...@busby.net: > Fri Mar 31 02:18:31 bret@bret-Precision-Tower-5810:~$yt-dlp > https://www.familysearch.org/rootstech/session/expanding-your-family-tree-with-sideview-and-more-innovations-from-ancestrydna?lang=eng > [generic] > expanding-your-family-tree-with-sideview-and-more-innovations-from-ancestrydna?lang=eng: > Requesting header > WARNING: [generic] Falling back on generic information extractor. > [generic] > expanding-your-family-tree-with-sideview-and-more-innovations-from-ancestrydna?lang=eng: > Downloading webpage > [generic] > expanding-your-family-tree-with-sideview-and-more-innovations-from-ancestrydna?lang=eng: > Extracting information > ERROR: Unsupported URL: > https://www.familysearch.org/rootstech/session/expanding-your-family-tree-with-sideview-and-more-innovations-from-ancestrydna?lang=eng > Fri Mar 31 02:19:05 bret@bret-Precision-Tower-5810:~$ > yt-dlp cannot download videos from every and each websites on the internet. You can find the compatible websites here: https://github.com/yt-dlp/yt-dlp/blob/master/supportedsites.md In your case, yt-dlp falls back on its generic extractor (documentation says "Generic downloader that works on some sites") but it doesn't work for familysearch.org visibly... As mentioned by David, you should try the following command to see (hopefully) that your yt-dlp works just fine: yt-dlp http://www.youtube.com/watch?v=bKzonnwoR2I l0f4r0
Re: youtube-dl → yt-dlp, was Re: OT: Detecting ISP throttling (was: Re: Potentially OT. Videos lagging & buffering in any browser but Google Chrome.)
On 31/3/23 02:08, David Wright wrote: On Fri 31 Mar 2023 at 01:41:04 (+0800), Bret Busby wrote: On 31/3/23 00:40, David Wright wrote: On Thu 30 Mar 2023 at 19:31:21 (+0800), Bret Busby wrote: I had previously been able to use youtube-dl, to download videos from youtube, but, it no longer works with youtube. AIUI youtube-dl is now obsolete, and its new spelling is yt-dlp. You can download it from bullseye-backports. If you're a backports user, just install it and check out the CLI options you normally use, in case they've been tweaked, with: $ yt-dlp -help | less And, I had been able to download videos from some streaming hosts, but, find that I cannot download videos from other streaming hosts. By download, I mean saving to my computer - so that I can get continuity, and, replay the streamed videos at slower speeds, and, manipulate the sound, so that I (having a hearing disability that affects my ability to hear what is spoken) can better hear what is being said, which is important for educational videos, such as at Rootstech 2023, where I cannot download significant videos. The yt-dlp dependencies are all unversioned, so rather than put backports into my sources.list, I just checked that I had them all, downloaded yt-dlp….deb from the Packages page, and installed it with theapt-get install /full-path-to/yt-dlp….debsyntax. (The backports youtube-dl package used to get very long in the tooth at times, so I've done this frequently in the past.) Whenever downloading fails, I check out whether there's a more up-to-date version with the yt-dlp -U option. Apparently there's a bug in yt-dlp at the moment, but I don't think either of us uses mpv /with/ the downloader, but only /after/ downloading has completed. I had downloaded and installed yt-dlp, but, that did not work, either. Writing "did not work" just doesn't cut it on this list: we need some specifics. Here's an example I ran this morning on a reference given by David Christensen: $ gy bKzonnwoR2I /usr/bin/yt-dlp http://www.youtube.com/watch?v=bKzonnwoR2I [youtube] Extracting URL: http://www.youtube.com/watch?v=bKzonnwoR2I [youtube] bKzonnwoR2I: Downloading webpage [youtube] bKzonnwoR2I: Downloading android player API JSON [info] bKzonnwoR2I: Downloading 1 format(s): 248+251 [download] Destination: Unix Pipeline (Brian Kernighan) - Computerphile [bKzonnwoR2I].f248.webm [download] 100% of 50.64MiB in 00:00:05 at 8.45MiB/s [download] Destination: Unix Pipeline (Brian Kernighan) - Computerphile [bKzonnwoR2I].f251.webm [download] 100% of3.85MiB in 00:00:00 at 6.28MiB/s [Merger] Merging formats into "Unix Pipeline (Brian Kernighan) - Computerphile [bKzonnwoR2I].webm" Remember to remove any unmerged files as appropriate. $ Whether you can download that would determine where you go from here. Cheers, David. Fri Mar 31 02:18:31 bret@bret-Precision-Tower-5810:~$yt-dlp https://www.familysearch.org/rootstech/session/expanding-your-family-tree-with-sideview-and-more-innovations-from-ancestrydna?lang=eng [generic] expanding-your-family-tree-with-sideview-and-more-innovations-from-ancestrydna?lang=eng: Requesting header WARNING: [generic] Falling back on generic information extractor. [generic] expanding-your-family-tree-with-sideview-and-more-innovations-from-ancestrydna?lang=eng: Downloading webpage [generic] expanding-your-family-tree-with-sideview-and-more-innovations-from-ancestrydna?lang=eng: Extracting information ERROR: Unsupported URL: https://www.familysearch.org/rootstech/session/expanding-your-family-tree-with-sideview-and-more-innovations-from-ancestrydna?lang=eng Fri Mar 31 02:19:05 bret@bret-Precision-Tower-5810:~$ .. Bret Busby Armadale West Australia (UTC+0800) ..
Re: youtube-dl → yt-dlp, was Re: OT: Detecting ISP throttling (was: Re: Potentially OT. Videos lagging & buffering in any browser but Google Chrome.)
On Thu, Mar 30, 2023 at 01:08:19PM -0500, David Wright wrote: > On Fri 31 Mar 2023 at 01:41:04 (+0800), Bret Busby wrote: [...] > Writing "did not work" just doesn't cut it on this list: > we need some specifics. Here's an example I ran this > morning on a reference given by David Christensen: This is more or less I thought at the first post: "not work" doesn't work here. For me, youtube-dl works most of the time. But this will almost certainly be a complex function of the downloader's location and the video in question, so... One thing I found out is that youtube-dl's cache seems to suffer poisoning from time to time (no wonder, with all that toxic javascript out there). A timely youtube-dl --rm-cache-dir got it unstuck for me once (meaning that a video which threw a 403 before downloaded nicely after). YMMV and things. Cheers -- t signature.asc Description: PGP signature
Re: youtube-dl → yt-dlp, was Re: OT: Detecting ISP throttling (was: Re: Potentially OT. Videos lagging & buffering in any browser but Google Chrome.)
On Fri 31 Mar 2023 at 01:41:04 (+0800), Bret Busby wrote: > On 31/3/23 00:40, David Wright wrote: > > On Thu 30 Mar 2023 at 19:31:21 (+0800), Bret Busby wrote: > > > > > I had previously been able to use youtube-dl, to download videos from > > > youtube, but, it no longer works with youtube. > > > > AIUI youtube-dl is now obsolete, and its new spelling is yt-dlp. > > > > You can download it from bullseye-backports. If you're a backports > > user, just install it and check out the CLI options you normally > > use, in case they've been tweaked, with: > > > >$ yt-dlp -help | less > > > > > And, I had been able to download videos from some streaming hosts, > > > but, find that I cannot download videos from other streaming hosts. > > > > > > By download, I mean saving to my computer - so that I can get > > > continuity, and, replay the streamed videos at slower speeds, and, > > > manipulate the sound, so that I (having a hearing disability that > > > affects my ability to hear what is spoken) can better hear what is > > > being said, which is important for educational videos, such as at > > > Rootstech 2023, where I cannot download significant videos. > > > > The yt-dlp dependencies are all unversioned, so rather than put > > backports into my sources.list, I just checked that I had them all, > > downloaded yt-dlp….deb from the Packages page, and installed it with > > theapt-get install /full-path-to/yt-dlp….debsyntax. > > (The backports youtube-dl package used to get very long in the tooth > > at times, so I've done this frequently in the past.) Whenever > > downloading fails, I check out whether there's a more up-to-date > > version with the yt-dlp -U option. > > > > Apparently there's a bug in yt-dlp at the moment, but I don't think > > either of us uses mpv /with/ the downloader, but only /after/ > > downloading has completed. > > > I had downloaded and installed yt-dlp, but, that did not work, either. Writing "did not work" just doesn't cut it on this list: we need some specifics. Here's an example I ran this morning on a reference given by David Christensen: $ gy bKzonnwoR2I /usr/bin/yt-dlp http://www.youtube.com/watch?v=bKzonnwoR2I [youtube] Extracting URL: http://www.youtube.com/watch?v=bKzonnwoR2I [youtube] bKzonnwoR2I: Downloading webpage [youtube] bKzonnwoR2I: Downloading android player API JSON [info] bKzonnwoR2I: Downloading 1 format(s): 248+251 [download] Destination: Unix Pipeline (Brian Kernighan) - Computerphile [bKzonnwoR2I].f248.webm [download] 100% of 50.64MiB in 00:00:05 at 8.45MiB/s [download] Destination: Unix Pipeline (Brian Kernighan) - Computerphile [bKzonnwoR2I].f251.webm [download] 100% of3.85MiB in 00:00:00 at 6.28MiB/s [Merger] Merging formats into "Unix Pipeline (Brian Kernighan) - Computerphile [bKzonnwoR2I].webm" Remember to remove any unmerged files as appropriate. $ Whether you can download that would determine where you go from here. Cheers, David.
Re: youtube-dl → yt-dlp, was Re: OT: Detecting ISP throttling (was: Re: Potentially OT. Videos lagging & buffering in any browser but Google Chrome.)
On 31/3/23 00:40, David Wright wrote: On Thu 30 Mar 2023 at 19:31:21 (+0800), Bret Busby wrote: I had previously been able to use youtube-dl, to download videos from youtube, but, it no longer works with youtube. AIUI youtube-dl is now obsolete, and its new spelling is yt-dlp. You can download it from bullseye-backports. If you're a backports user, just install it and check out the CLI options you normally use, in case they've been tweaked, with: $ yt-dlp -help | less And, I had been able to download videos from some streaming hosts, but, find that I cannot download videos from other streaming hosts. By download, I mean saving to my computer - so that I can get continuity, and, replay the streamed videos at slower speeds, and, manipulate the sound, so that I (having a hearing disability that affects my ability to hear what is spoken) can better hear what is being said, which is important for educational videos, such as at Rootstech 2023, where I cannot download significant videos. The yt-dlp dependencies are all unversioned, so rather than put backports into my sources.list, I just checked that I had them all, downloaded yt-dlp….deb from the Packages page, and installed it with theapt-get install /full-path-to/yt-dlp….debsyntax. (The backports youtube-dl package used to get very long in the tooth at times, so I've done this frequently in the past.) Whenever downloading fails, I check out whether there's a more up-to-date version with the yt-dlp -U option. Apparently there's a bug in yt-dlp at the moment, but I don't think either of us uses mpv /with/ the downloader, but only /after/ downloading has completed. Cheers, David. I had downloaded and installed yt-dlp, but, that did not work, either. .. Bret Busby Armadale West Australia (UTC+0800) ..
