Re: [gentoo-user] network transfer speed
在 2021/1/15 下午2:56, the...@sys-concept.com 写道: On both of my systems the network card speed is showing 1000 cat /sys/class/net/enp4s0/speed 1000 but when I do rsync larage file I only see about: 20 to 22MB/s On my home network I get about 110MB/s between PC's Both PC's have SSD and the swith is Gigabit (I think). How to find a the bottleneck? 1000Mbps network card's maximum theoretical speed is about 125MiB/s. It only works in short distances. The real speed is depending on where the files are and all devices on the link. So where are the files?
Re: [gentoo-user] network transfer speed
On 15/01/2021 07:56, the...@sys-concept.com wrote: Hello On both of my systems the network card speed is showing 1000 cat /sys/class/net/enp4s0/speed 1000 but when I do rsync larage file I only see about: 20 to 22MB/s On my home network I get about 110MB/s between PC's Both PC's have SSD and the swith is Gigabit (I think). How to find a the bottleneck? 20MB = 80Mb so it sounds like your network is a 100Mb network. What is the perfs of your switch(s) between your systems ? Regards, Hogren
Re: [gentoo-user] [OT] Differences between wget and browser file retrieval?
210114 David Haller wrote: > On Thu, 14 Jan 2021, Walter Dnes wrote: >> I download daily a PDF. Today, the command ... >> wget https://files.ontario.ca/moh-covid-19-report-en-2021-01-14.pdf >> returns a zero-byte file. *BUT*, sticking the URL into the URL bar > >of Pale Moon and Google Chrome brings up the PDF file just fine. >> Is "wget" being blocked ? > I could download that file just fine just now[1]. > Try running 'wget' with the '-S' option. > Oh and : >> WARNING: cannot verify files.ontario.ca's certificate, issued by > So, try: > wget -S --no-check-certificate -U 'Mozilla/5.0 ...' \ >https://files.ontario.ca/moh-covid-19-report-en-2021-01-14.pdf > BTW: you know that you can let date format that URL? e.g.: > wget -S --no-check-certificate -U 'Mozilla/5.0 ...' \ >"$(date '+https://files.ontario.ca/moh-covid-19-report-en-%Y-%m-%d.pdf')" Here in Toronto, I get the same result as Walter via his URL & similar results from the 2 longer versions above, except that the escaped version give "ERROR 403: Forbidden". When I drop Walter's URL into the address bar of Firefox, no problem : a 1,75 MB PDF which appears to have all the info. It looks as if the site is refusing 'wget' requests from Ontario, but allowing them from eg Germany (!). What Walter is doing is well worthwhile. Press reports are very shallow & the Ontario government doesn't appear to have any clear idea just where & how the virus is being spread between humans. HTH. -- ,, SUPPORT ___//___, Philip Webb ELECTRIC /] [] [] [] [] []| Cities Centre, University of Toronto TRANSIT`-O--O---' purslowatcadotinterdotnet
[gentoo-user] network transfer speed
On both of my systems the network card speed is showing 1000 cat /sys/class/net/enp4s0/speed 1000 but when I do rsync larage file I only see about: 20 to 22MB/s On my home network I get about 110MB/s between PC's Both PC's have SSD and the swith is Gigabit (I think). How to find a the bottleneck?
Re: [gentoo-user] [OT] Differences between wget and browser file retrieval?
Hello, On Thu, 14 Jan 2021, Walter Dnes wrote: > I'm bored, so I do a regular daily report at the DSL Reports "CanChat" >sub-forum, on the Covid-19 case counts for Ontario, using provincial >data. I download 2 files daily as source data. One of them is a PDF >file, which is run through "pdftotext" and then parsed by a bash script >(don't ask). Today, the command... > > wget https://files.ontario.ca/moh-covid-19-report-en-2021-01-14.pdf > >...returns a zero-byte file. *BUT*, sticking the URL into the URL bar >of Pale Moon and Google Chrome (and I assume Firefox/etc) brings up the >PDF file just fine. Is "wget" being blocked? [..] > I've tried setting --user-agent= with my browser's string as shown by >https://www.whatismybrowser.com/detect/what-is-my-user-agent but no >luck. Is there some way to get around this? I have not updated this >past week, so I don't think the problem is at my end. I could download that file just fine just now[1]. Try running 'wget' with the '-S' option. Oh and: [..] WARNING: cannot verify files.ontario.ca's certificate, issued by [..] If you sent stderr to /dev/null ... So, try: wget -S --no-check-certificate -U 'Mozilla/5.0 ...' \ https://files.ontario.ca/moh-covid-19-report-en-2021-01-14.pdf BTW: you know that you can let date format that URL? e.g.: wget -S --no-check-certificate -U 'Mozilla/5.0 ...' \ "$(date '+https://files.ontario.ca/moh-covid-19-report-en-%Y-%m-%d.pdf')" There just are no unescaped '%' allowed besides the format strings for the date/time. So if an URL contains one, you need to escape those with another '%', as in e.g. $(date '+foo%%20bar-%Y-%m-%d.pdf') ^^ this fella In your case, the URL is clean ;) HTH, -dnh [1] $ TZ=America/Toronto date Thu Jan 14 16:50:15 EST 2021 -- "Airplane travel is nature's way of making you look like your passport photo." -- Al Gore
Re: [gentoo-user] [OT] Differences between wget and browser file retrieval?
On Thu, 14 Jan 2021 16:10:09 -0500 Jack wrote: > On 2021.01.14 15:49, Walter Dnes wrote: > > I'm bored, so I do a regular daily report at the DSL Reports > > "CanChat" > > sub-forum, on the Covid-19 case counts for Ontario, using provincial > > data. I download 2 files daily as source data. One of them is a PDF > > file, which is run through "pdftotext" and then parsed by a bash > > script > > (don't ask). Today, the command... > > > > wget https://files.ontario.ca/moh-covid-19-report-en-2021-01-14.pdf > > > > ...returns a zero-byte file. *BUT*, sticking the URL into the URL bar > > of Pale Moon and Google Chrome (and I assume Firefox/etc) brings up > > the > > PDF file just fine. Is "wget" being blocked? I have to do extra > > steps > > to get from the browser-invoked PDF to get the PDF file saved to the > > standard work area where my script expects it to be, so it can work > > its > > magic and parse out the daily breakdown by PHU (Public Health Unit). > > BTW, today's posts requiring the PDF file are... > > https://www.dslreports.com/forum/r33002718- > > https://www.dslreports.com/forum/r33002752- > > > > I've tried setting --user-agent= with my browser's string as shown > > by > > https://www.whatismybrowser.com/detect/what-is-my-user-agent but no > > luck. Is there some way to get around this? I have not updated this > > past week, so I don't think the problem is at my end. > > I just copy/pasted that wget command into my terminal, and it got me a > 1.7M PDF doc. I'm in the US, but I have no idea if location/IP is an > issue or not. > > Jack > I could download the file too with the wget command that you posted. If you still have trouble, you could try using curl and pretend that you're a firefox: curl 'https://files.ontario.ca/moh-covid-19-report-en-2021-01-14.pdf' -H 'User-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:84.0) Gecko/20100101 Firefox/84.0' -H 'Accept: text/html,application/xhtml+xml,application/xml;q=0.9,image/webp,*/*;q=0.8' -H 'Accept-Language: en,de;q=0.7,en-US;q=0.3' --compressed -H 'DNT: 1' -H 'Connection: keep-alive' -H 'Upgrade-Insecure-Requests: 1' -H 'Pragma: no-cache' -H 'Cache-Control: no-cache' > moh-covid-19-report-en-2021-01-14.pdf Andreas
Re: [gentoo-user] [OT] Differences between wget and browser file retrieval?
On 2021.01.14 15:49, Walter Dnes wrote: I'm bored, so I do a regular daily report at the DSL Reports "CanChat" sub-forum, on the Covid-19 case counts for Ontario, using provincial data. I download 2 files daily as source data. One of them is a PDF file, which is run through "pdftotext" and then parsed by a bash script (don't ask). Today, the command... wget https://files.ontario.ca/moh-covid-19-report-en-2021-01-14.pdf ...returns a zero-byte file. *BUT*, sticking the URL into the URL bar of Pale Moon and Google Chrome (and I assume Firefox/etc) brings up the PDF file just fine. Is "wget" being blocked? I have to do extra steps to get from the browser-invoked PDF to get the PDF file saved to the standard work area where my script expects it to be, so it can work its magic and parse out the daily breakdown by PHU (Public Health Unit). BTW, today's posts requiring the PDF file are... https://www.dslreports.com/forum/r33002718- https://www.dslreports.com/forum/r33002752- I've tried setting --user-agent= with my browser's string as shown by https://www.whatismybrowser.com/detect/what-is-my-user-agent but no luck. Is there some way to get around this? I have not updated this past week, so I don't think the problem is at my end. I just copy/pasted that wget command into my terminal, and it got me a 1.7M PDF doc. I'm in the US, but I have no idea if location/IP is an issue or not. Jack
[gentoo-user] [OT] Differences between wget and browser file retrieval?
I'm bored, so I do a regular daily report at the DSL Reports "CanChat" sub-forum, on the Covid-19 case counts for Ontario, using provincial data. I download 2 files daily as source data. One of them is a PDF file, which is run through "pdftotext" and then parsed by a bash script (don't ask). Today, the command... wget https://files.ontario.ca/moh-covid-19-report-en-2021-01-14.pdf ...returns a zero-byte file. *BUT*, sticking the URL into the URL bar of Pale Moon and Google Chrome (and I assume Firefox/etc) brings up the PDF file just fine. Is "wget" being blocked? I have to do extra steps to get from the browser-invoked PDF to get the PDF file saved to the standard work area where my script expects it to be, so it can work its magic and parse out the daily breakdown by PHU (Public Health Unit). BTW, today's posts requiring the PDF file are... https://www.dslreports.com/forum/r33002718- https://www.dslreports.com/forum/r33002752- I've tried setting --user-agent= with my browser's string as shown by https://www.whatismybrowser.com/detect/what-is-my-user-agent but no luck. Is there some way to get around this? I have not updated this past week, so I don't think the problem is at my end. -- Walter Dnes I don't run "desktop environments"; I run useful applications
Re: [gentoo-user] Re: Console scrollback
On 1/13/21 6:25 PM, Grant Edwards wrote: Some of the above are shadowed by readline or by bash in emacs mode, but the tty driver uses more than a few control keys. Thank you for the clarification / additional information. -- Grant. . . . unix || die
Re: [gentoo-user] Console scrollback
Grant: > On 1/13/21 2:56 PM, Alan Mackenzie wrote: ... > > Doing text work in X is s l u g g i s h. Changing from one > > application to another, which would be achieved by, say Alt-F4 on a > > console takes more key sequences in X, and is less than instantaneous. I'm using fvwm set up with 9 virtual screens and so I can swith between them with ctr-arrow, fast enought for me. ... > > On an Emacs session, in three columns on a console, I can display > > 195 consecutive lines of a source file simultaneously. ... I get 260x97 chars in emacs on a 1600x1280 display. With three columns, w82,82,83chars, I get 3x95=285 lines of text. /// Alan, how do you set up your console (I'd like to try) ? Regards, /Karl Hammar
Re: [gentoo-user] Re: Console scrollback
Hello, Grant. On Wed, Jan 13, 2021 at 22:15:25 -, Grant Edwards wrote: > On 2021-01-13, Alan Mackenzie wrote: > > I think bringing up a new Gentoo system absolutely requires working in > > the console, certainly up to the point where X11 and a Window Manager > > have been installed and debugged. > I usually install Gentoo via ssh. > The article I read about the removal of Linux console's backscrolling > feature said it was mostly due to lack of a maintainer for that code, > and that if somebody stepped forward to maintain it, it could be revived. I'm doing my best to step forward, but I suspect that will be almost as difficult as fixing the bugs in it. ;-) I'm disappointed that the decision to cut out this important feature was taken without any serious attempt to find a maintainer. I have the impression (though I may be wrong), that the problem was talked about on the linux kernel mailing list, but nobody there took it upon himself to post on any of the more hard-core distributions' mailing lists, such as gentoo's. > FWOW, if you really want backscrolling on the console, you can get > that with screen, but doing so would drive me nuts, since I'd have to > break all my fingers to stop them from typeing ctrl-A to move the > start of a line. I've switched screen's meta-character a few times, > but everytime I try that I find my fingers already have something else > assigned to that control character (which I had forgotten about). It > would be nice if I could print out my fingers' assignment table to > find an unused control character, but that doesn't seem to be how it > works. Can one set up a "basic" screen which doesn't use a meta-character? > -- > Grant -- Alan Mackenzie (Nuremberg, Germany).
Re: [gentoo-user] Console scrollback
Hello, Neil. On Wed, Jan 13, 2021 at 18:44:15 +, Neil Bothwick wrote: > On Wed, 13 Jan 2021 18:14:39 +, Alan Mackenzie wrote: > > > I see that the kernel code to scroll the console has been stripped out > > > [1]. > > This is appalling. I do all my work on the console (apart from web > > browsing), and with this development, Linux effectively becomes unusable > > to me. I will NOT be bullied into using second rate alternatives like > > X-Windows terminals. > What about screen/tmux? I suppose they'd do at a pinch, but they're both things which get between Linux and my applications, and like X-Windows, they offer "features" which I don't need and don't want, and hijack key sequences. But I will look into it if I have to. For the moment, I can get by by not updating my kernel. > -- > Neil Bothwick > WinErr 00D: Window closed - Do not look outside -- Alan Mackenzie (Nuremberg, Germany).