Re: HOWTO donate CPU to the fight against the Corona-virus
On Sunday, March 22, 2020 11:38:31 AM CEST Stefan Ehmann wrote: > On Saturday, March 21, 2020 12:07:55 PM CET Alexander Leidinger wrote: > > Quoting Stefan Ehmann (from Sat, 21 Mar 2020 > > > > 11:38:26 +0100): > > > On Thursday, March 19, 2020 8:57:45 AM CET Alexander Leidinger via > > > freebsd- > > > > > > stable wrote: > > >> Hi, > > >> > > >> if someone wants to donate some FreeBSD based CPU resources to the > > >> fight against the Corona-virus, here is a quick HOWTO in terms of > > >> installing the Folding@Home client on FreeBSD: > > >> > > >> https://www.leidinger.net/blog/2020/03/19/fighting-the-coronavirus-with > > >> -f > > >> ree bsd-foldinghome/ > > > > > > Unfortunately, (using a CPU slot for the same work unit) TPF is 2-3 > > > times > > > slower than on Ubuntu for me. Much of the speed difference seems to > > > be related > > > to libOpenCL. If remove libOpenCL on Ubuntu, it's still 20-30% faster > > > than > > > on FreeBSD. > > > > The pure CPU based code should be the same. Someone would have to > > trace / reverse engineer what is going on. > > I'm pretty sure now that libOpenCL is only relevant for GPU slots. > > I couldn't reproduce that the presence of libOpenCL.so has any effect on CPU > slots. Didn't make much sense anyway, something else must have been going > on. So there's probably no point in getting OpenCL to run on FreeBSD until > we have GPU rendering. > > The numbers displayed by FAHControl are rather strange: > * There is no discernible difference in speed if 1 or all CPU cores are used > (but top shows that 600% CPU cycles are burned) - happens on both Ubuntu > and Linuxolator > * According to the progress bar, Ubuntu completes 1% per minute, but > Linuxolator only 0.1% (for the same work unit) > > Don't know if the numbers displayed are bogus or there is really that much > of a difference. Maybe the issue is only related to a specific WU or to > AMD-CPUs. Just a short update: I've tested the port with a different WU and everything seems normal. Speed is comparable to Linux and multi-core also works as expected. My previous problems can probably be ignored, not sure what the problem actually was. ___ freebsd-current@freebsd.org mailing list https://lists.freebsd.org/mailman/listinfo/freebsd-current To unsubscribe, send any mail to "freebsd-current-unsubscr...@freebsd.org"
Re: HOWTO donate CPU to the fight against the Corona-virus
Quoting Alex S (from Sun, 22 Mar 2020 17:53:47 +0300): Alexander Leidinger wrote: First step would be to get CUDA support in FreeBSD. Ahem, I have a little patch, consisting of several functions copy-pasted from the Linux driver, which is supposed to enable core CUDA functionality: https://github.com/shkhln/nvshim/issues/1#issuecomment-600358438. This won't work for applications depending on unified memory support, but otherwise should be good enough. Could you plesae describe a little bit more detailed what your shim does? I have the impression it maps some linux glibc symbols which are used in a NVidia library for CUDA which only exists as a linux lib to FreeBSD symbols and when some FreeBSD binary then tries to load the NVidia CUDA lib it is then using the FreeBSD libc/m/pthread. If this is correct, what would be in your opinion the correct way to get official CUDA support? Something like the following or is more needed? - implement nvida-uvm - implement os_lock_user_pages - submit the above to NVidia and ask for the CUDA lob to be compiled for FreeBSD Bye, Alexander. -- http://www.Leidinger.net alexan...@leidinger.net: PGP 0x8F31830F9F2772BF http://www.FreeBSD.orgnetch...@freebsd.org : PGP 0x8F31830F9F2772BF pgpiPy9_HIm84.pgp Description: Digitale PGP-Signatur
Re: HOWTO donate CPU to the fight against the Corona-virus
Quoting Alexander Leidinger via freebsd-stable (from Mon, 23 Mar 2020 08:05:24 +0100): Quoting tech-lists (from Mon, 23 Mar 2020 01:35:52 +): Is it possible to use this with a cuda-compatible nvidia card and if so how would one go about it? First step would be to convince NVidia to provide a driver package for FreeBSD with CUDA support. Hmmm... seems we could help NVidia... https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=224358 - see specially comment #6 + #7 + #13 - implement nvidia-uvm Anyone? Bye, Alexander. -- http://www.Leidinger.net alexan...@leidinger.net: PGP 0x8F31830F9F2772BF http://www.FreeBSD.orgnetch...@freebsd.org : PGP 0x8F31830F9F2772BF pgpKgpRsNkX7k.pgp Description: Digitale PGP-Signatur
Re: HOWTO donate CPU to the fight against the Corona-virus
Quoting Alexander Leidinger via freebsd-stable (from Thu, 19 Mar 2020 08:57:45 +0100): Hi, if someone wants to donate some FreeBSD based CPU resources to the fight against the Corona-virus, here is a quick HOWTO in terms of installing the Folding@Home client on FreeBSD: https://www.leidinger.net/blog/2020/03/19/fighting-the-coronavirus-with-freebsd-foldinghome/ This is now available as a port: biology/linux-foldingathome (thanks 0mp@). Bye, Alexander. -- http://www.Leidinger.net alexan...@leidinger.net: PGP 0x8F31830F9F2772BF http://www.FreeBSD.orgnetch...@freebsd.org : PGP 0x8F31830F9F2772BF pgpeG1W621XEN.pgp Description: Digitale PGP-Signatur
Re: HOWTO donate CPU to the fight against the Corona-virus
Alexander Leidinger wrote: > First step would be to get CUDA support in FreeBSD. Ahem, I have a little patch, consisting of several functions copy-pasted from the Linux driver, which is supposed to enable core CUDA functionality: https://github.com/shkhln/nvshim/issues/1#issuecomment-600358438. This won't work for applications depending on unified memory support, but otherwise should be good enough. ___ freebsd-current@freebsd.org mailing list https://lists.freebsd.org/mailman/listinfo/freebsd-current To unsubscribe, send any mail to "freebsd-current-unsubscr...@freebsd.org"
Re: HOWTO donate CPU to the fight against the Corona-virus
On Saturday, March 21, 2020 12:07:55 PM CET Alexander Leidinger wrote: > Quoting Stefan Ehmann (from Sat, 21 Mar 2020 > > 11:38:26 +0100): > > On Thursday, March 19, 2020 8:57:45 AM CET Alexander Leidinger via > > freebsd- > > > > stable wrote: > >> Hi, > >> > >> if someone wants to donate some FreeBSD based CPU resources to the > >> fight against the Corona-virus, here is a quick HOWTO in terms of > >> installing the Folding@Home client on FreeBSD: > >> > >> https://www.leidinger.net/blog/2020/03/19/fighting-the-coronavirus-with-f > >> ree bsd-foldinghome/ > > > > Unfortunately, (using a CPU slot for the same work unit) TPF is 2-3 times > > slower than on Ubuntu for me. Much of the speed difference seems to > > be related > > to libOpenCL. If remove libOpenCL on Ubuntu, it's still 20-30% faster than > > on FreeBSD. > > The pure CPU based code should be the same. Someone would have to > trace / reverse engineer what is going on. I'm pretty sure now that libOpenCL is only relevant for GPU slots. I couldn't reproduce that the presence of libOpenCL.so has any effect on CPU slots. Didn't make much sense anyway, something else must have been going on. So there's probably no point in getting OpenCL to run on FreeBSD until we have GPU rendering. The numbers displayed by FAHControl are rather strange: * There is no discernible difference in speed if 1 or all CPU cores are used (but top shows that 600% CPU cycles are burned) - happens on both Ubuntu and Linuxolator * According to the progress bar, Ubuntu completes 1% per minute, but Linuxolator only 0.1% (for the same work unit) Don't know if the numbers displayed are bogus or there is really that much of a difference. Maybe the issue is only related to a specific WU or to AMD-CPUs. I've also tried https://fahbench.github.io/ but it's mainly targeted at GPUs and uses a different Core. ___ freebsd-current@freebsd.org mailing list https://lists.freebsd.org/mailman/listinfo/freebsd-current To unsubscribe, send any mail to "freebsd-current-unsubscr...@freebsd.org"
Re: HOWTO donate CPU to the fight against the Corona-virus
Quoting Stefan Ehmann (from Sat, 21 Mar 2020 11:38:26 +0100): On Thursday, March 19, 2020 8:57:45 AM CET Alexander Leidinger via freebsd- stable wrote: Hi, if someone wants to donate some FreeBSD based CPU resources to the fight against the Corona-virus, here is a quick HOWTO in terms of installing the Folding@Home client on FreeBSD: https://www.leidinger.net/blog/2020/03/19/fighting-the-coronavirus-with-free bsd-foldinghome/ Unfortunately, (using a CPU slot for the same work unit) TPF is 2-3 times slower than on Ubuntu for me. Much of the speed difference seems to be related to libOpenCL. If remove libOpenCL on Ubuntu, it's still 20-30% faster than on FreeBSD. The pure CPU based code should be the same. Someone would have to trace / reverse engineer what is going on. Don't know how stable the TPF numbers are, so numbers may be bogus. Will a CPU slot also use the GPU with libOpenCL or is it just using better optimized code? I tried to install libOpenCL but all I get is: No idea. Just an assumption: either full CPU or full GPU. OpenCL: Not detected: clGetPlatformIDs() returned -1001 Depending on what clGetPlatformIDs is doing and if it is not using/requesting some GPU support, it may be worth to check the code of it so see if we can improve something. Since there's no CUDA support for FreeBSD, I guess there is no point in trying getting GPU slots to work. I assume the same. First step would be to get CUDA support in FreeBSD. I think I remember somewhere on the X11 mailinglist someone told that he got some NVidia GPU compute part working... not really sure about that part. It would help to get a big player to request it from NVidia. As Netflix seems to go the "encode videos on CPU" (assumption based upon their Intel av1 codec support/benchmarks) way, and other players in the video / graphics business more oriented towards linux, I do not have much hope in this regard ATM. Bye, Alexander. -- http://www.Leidinger.net alexan...@leidinger.net: PGP 0x8F31830F9F2772BF http://www.FreeBSD.orgnetch...@freebsd.org : PGP 0x8F31830F9F2772BF pgpzxtM_vv03y.pgp Description: Digitale PGP-Signatur
Re: HOWTO donate CPU to the fight against the Corona-virus
On Thursday, March 19, 2020 8:57:45 AM CET Alexander Leidinger via freebsd- stable wrote: > Hi, > > if someone wants to donate some FreeBSD based CPU resources to the > fight against the Corona-virus, here is a quick HOWTO in terms of > installing the Folding@Home client on FreeBSD: > > https://www.leidinger.net/blog/2020/03/19/fighting-the-coronavirus-with-free > bsd-foldinghome/ > Unfortunately, (using a CPU slot for the same work unit) TPF is 2-3 times slower than on Ubuntu for me. Much of the speed difference seems to be related to libOpenCL. If remove libOpenCL on Ubuntu, it's still 20-30% faster than on FreeBSD. Don't know how stable the TPF numbers are, so numbers may be bogus. Will a CPU slot also use the GPU with libOpenCL or is it just using better optimized code? I tried to install libOpenCL but all I get is: OpenCL: Not detected: clGetPlatformIDs() returned -1001 Since there's no CUDA support for FreeBSD, I guess there is no point in trying getting GPU slots to work. ___ freebsd-current@freebsd.org mailing list https://lists.freebsd.org/mailman/listinfo/freebsd-current To unsubscribe, send any mail to "freebsd-current-unsubscr...@freebsd.org"
Re: HOWTO donate CPU to the fight against the Corona-virus
Quoting Jonathan Anderson (from Fri, 20 Mar 2020 10:21:11 -0230): Hi all, Running this on a 12.1-STABLE system, I see a whole lot of this in /var/log/messages: fahclient[53019]: ^[[91m12:15:25:ERROR:WU00:FS00:Exception: Could not get an assignment^[[0m Is this because there temporarily isn't enough work to go around, or because more FreeBSD support is required on the work distribution end as well? This means he was not able to download a work unit. This can either be a network problem, or that the pool of WUs is depleted. At the WE when I tried to get this working even my Windows Laptop didn't receive WUs. Yesterday to today I got WUs non-stop (but it takes some hours to process a WU... my dual-socket Xeon system processes a WU since yesterday 11pm and is currently at 50% of the WU). Be patient, they are adding WUs as fast as they can. You can check in the forum for more info about this: https://foldingforum.org/viewforum.php?f=18=64ecf0e5c256f1bdbb767fcc8a2661c2 Bye, Alexander. -- http://www.Leidinger.net alexan...@leidinger.net: PGP 0x8F31830F9F2772BF http://www.FreeBSD.orgnetch...@freebsd.org : PGP 0x8F31830F9F2772BF pgptMNutdAxTd.pgp Description: Digitale PGP-Signatur
Re: HOWTO donate CPU to the fight against the Corona-virus
On 3/20/20 1:51 PM, Jonathan Anderson wrote: Hi all, Running this on a 12.1-STABLE system, I see a whole lot of this in /var/log/messages: fahclient[53019]: ^[[91m12:15:25:ERROR:WU00:FS00:Exception: Could not get an assignment^[[0m Is this because there temporarily isn't enough work to go around, or because more FreeBSD support is required on the work distribution end as well? Either there is no work or you have to change the user name in the config file. I am not sure however if the username change is really a solution. Cheers, Mateusz ___ freebsd-current@freebsd.org mailing list https://lists.freebsd.org/mailman/listinfo/freebsd-current To unsubscribe, send any mail to "freebsd-current-unsubscr...@freebsd.org"
Re: HOWTO donate CPU to the fight against the Corona-virus
Hi all, Running this on a 12.1-STABLE system, I see a whole lot of this in /var/log/messages: fahclient[53019]: ^[[91m12:15:25:ERROR:WU00:FS00:Exception: Could not get an assignment^[[0m Is this because there temporarily isn't enough work to go around, or because more FreeBSD support is required on the work distribution end as well? Jon On Fri, 20 Mar 2020 at 08:37, Bob Bishop wrote: > Hi, > > Just a note that the client can grow its logfile at the rate of ~1GB a > day. You’ll probably want to take avoiding action. > > > On 19 Mar 2020, at 07:57, Alexander Leidinger via freebsd-stable < > freebsd-sta...@freebsd.org> wrote: > > > > Hi, > > > > if someone wants to donate some FreeBSD based CPU resources to the fight > against the Corona-virus, here is a quick HOWTO in terms of installing the > Folding@Home client on FreeBSD: > > > > > https://www.leidinger.net/blog/2020/03/19/fighting-the-coronavirus-with-freebsd-foldinghome/ > > > > I tested this on a recent -current. > > > > If you are interested in how this helps in the fight against the virus, > please refer to the https://foldingathome.org/ website. In short and > over-simplified: they search for vaccines. > > > > Bye, > > Alexander. > > > > -- > > http://www.Leidinger.net alexan...@leidinger.net: PGP 0x8F31830F9F2772BF > > http://www.FreeBSD.orgnetch...@freebsd.org : PGP 0x8F31830F9F2772BF > > -- > Bob Bishop > r...@gid.co.uk > > > > > -- jonat...@freebsd.org http://freebsd.org/~jonathan/ ___ freebsd-current@freebsd.org mailing list https://lists.freebsd.org/mailman/listinfo/freebsd-current To unsubscribe, send any mail to "freebsd-current-unsubscr...@freebsd.org"
Re: HOWTO donate CPU to the fight against the Corona-virus
Hi, Just a note that the client can grow its logfile at the rate of ~1GB a day. You’ll probably want to take avoiding action. > On 19 Mar 2020, at 07:57, Alexander Leidinger via freebsd-stable > wrote: > > Hi, > > if someone wants to donate some FreeBSD based CPU resources to the fight > against the Corona-virus, here is a quick HOWTO in terms of installing the > Folding@Home client on FreeBSD: > > https://www.leidinger.net/blog/2020/03/19/fighting-the-coronavirus-with-freebsd-foldinghome/ > > I tested this on a recent -current. > > If you are interested in how this helps in the fight against the virus, > please refer to the https://foldingathome.org/ website. In short and > over-simplified: they search for vaccines. > > Bye, > Alexander. > > -- > http://www.Leidinger.net alexan...@leidinger.net: PGP 0x8F31830F9F2772BF > http://www.FreeBSD.orgnetch...@freebsd.org : PGP 0x8F31830F9F2772BF -- Bob Bishop r...@gid.co.uk signature.asc Description: Message signed with OpenPGP
Re: HOWTO donate CPU to the fight against the Corona-virus
Quoting Matthias Apitz (from Fri, 20 Mar 2020 08:01:12 +0100): El día jueves, marzo 19, 2020 a las 08:57:45a. m. +0100, Alexander Leidinger escribió: Hi, if someone wants to donate some FreeBSD based CPU resources to the fight against the Corona-virus, here is a quick HOWTO in terms of installing the Folding@Home client on FreeBSD: https://www.leidinger.net/blog/2020/03/19/fighting-the-coronavirus-with-freebsd-foldinghome/ I tested this on a recent -current. Alexander, As far as I understand, the binary(!) tool pulls tasks from the net and communicates the results back over net, correct? What about the security aspect of this? This is correct. And a malicious person may distribute malware to you. If e.g. the group behind emotet would be able to infiltrate the servers of the project and inject their malicious payload somehow, it would be a big disaster (as there are even science organisations / universities / ... participating as far as I understand it). Personally I have this binary running on FreeBSD in a jail, but also on a Windows laptop. This is something were everyone needs to do their risk-management on their own. Currently with the Corona-virus I consider for myself the benefit of participating with a lot resources more important than the risk (on the laptop). When the current situation normalizes, I probably stop the client on the laptop, but will let it run in the jail (with less resources donated to it). YMMV. Bye, Alexander. -- http://www.Leidinger.net alexan...@leidinger.net: PGP 0x8F31830F9F2772BF http://www.FreeBSD.orgnetch...@freebsd.org : PGP 0x8F31830F9F2772BF pgpwioTYlKMnF.pgp Description: Digitale PGP-Signatur
Re: HOWTO donate CPU to the fight against the Corona-virus
Quoting "Kevin P. Neal" (from Thu, 19 Mar 2020 20:51:28 -0400): On Fri, Mar 20, 2020 at 12:13:37AM +0100, Mateusz Piotrowski wrote: The patch is now on Phabricator open to reviews & ready to be tested: https://reviews.freebsd.org/D24127 No source is available? They must not be serious, then. It's answered on the website. As they have stats for each user, cheaters may modify the code to get better stats while the result may then not be useable for the project (false positives could be resolved by a verification step, but false negatives not, and giving the same WU to multiple people to have a statistical confidence would slow down the progress a lot). A lot of the code is actually open source, but not all. They refer to projects which they use. Also think about the fact that this project comes from a medical background where you have a lot of closedness, intelectual property, regulation and liabilities. Personally I consider the fact that this project (started in the year 2000) is producing open source code at all already as a start of an evolition in the medical business (yes, there are other more open source projects in this field too). Bye, Alexander. -- http://www.Leidinger.net alexan...@leidinger.net: PGP 0x8F31830F9F2772BF http://www.FreeBSD.orgnetch...@freebsd.org : PGP 0x8F31830F9F2772BF pgpp1ax0q4FB5.pgp Description: Digitale PGP-Signatur
Re: HOWTO donate CPU to the fight against the Corona-virus
El día jueves, marzo 19, 2020 a las 08:57:45a. m. +0100, Alexander Leidinger escribió: > Hi, > > if someone wants to donate some FreeBSD based CPU resources to the > fight against the Corona-virus, here is a quick HOWTO in terms of > installing the Folding@Home client on FreeBSD: > > https://www.leidinger.net/blog/2020/03/19/fighting-the-coronavirus-with-freebsd-foldinghome/ > > I tested this on a recent -current. Alexander, As far as I understand, the binary(!) tool pulls tasks from the net and communicates the results back over net, correct? What about the security aspect of this? Thanks matthias -- Matthias Apitz, ✉ g...@unixarea.de, http://www.unixarea.de/ +49-176-38902045 Public GnuPG key: http://www.unixarea.de/key.pub ___ freebsd-current@freebsd.org mailing list https://lists.freebsd.org/mailman/listinfo/freebsd-current To unsubscribe, send any mail to "freebsd-current-unsubscr...@freebsd.org"
Re: HOWTO donate CPU to the fight against the Corona-virus
Hi! On 3/19/20 11:04 PM, Mateusz Piotrowski wrote: On 3/19/20 8:57 AM, Alexander Leidinger via freebsd-stable wrote: if someone wants to donate some FreeBSD based CPU resources to the fight against the Corona-virus, here is a quick HOWTO in terms of installing the Folding@Home client on FreeBSD: https://www.leidinger.net/blog/2020/03/19/fighting-the-coronavirus-with-freebsd-foldinghome/ I tested this on a recent -current. If you are interested in how this helps in the fight against the virus, please refer to the https://foldingathome.org/ website. In short and over-simplified: they search for vaccines. I've got an almost finished port of this software. I'll post a patch soonish. The patch is now on Phabricator open to reviews & ready to be tested: https://reviews.freebsd.org/D24127 Cheers, Mateusz ___ freebsd-current@freebsd.org mailing list https://lists.freebsd.org/mailman/listinfo/freebsd-current To unsubscribe, send any mail to "freebsd-current-unsubscr...@freebsd.org"
Re: HOWTO donate CPU to the fight against the Corona-virus
Hi, On 3/19/20 8:57 AM, Alexander Leidinger via freebsd-stable wrote: Hi, if someone wants to donate some FreeBSD based CPU resources to the fight against the Corona-virus, here is a quick HOWTO in terms of installing the Folding@Home client on FreeBSD: https://www.leidinger.net/blog/2020/03/19/fighting-the-coronavirus-with-freebsd-foldinghome/ I tested this on a recent -current. If you are interested in how this helps in the fight against the virus, please refer to the https://foldingathome.org/ website. In short and over-simplified: they search for vaccines. Bye, Alexander. I've got an almost finished port of this software. I'll post a patch soonish. Thanks so much for your blog post! Cheers! Mateusz ___ freebsd-current@freebsd.org mailing list https://lists.freebsd.org/mailman/listinfo/freebsd-current To unsubscribe, send any mail to "freebsd-current-unsubscr...@freebsd.org"
HOWTO donate CPU to the fight against the Corona-virus
Hi, if someone wants to donate some FreeBSD based CPU resources to the fight against the Corona-virus, here is a quick HOWTO in terms of installing the Folding@Home client on FreeBSD: https://www.leidinger.net/blog/2020/03/19/fighting-the-coronavirus-with-freebsd-foldinghome/ I tested this on a recent -current. If you are interested in how this helps in the fight against the virus, please refer to the https://foldingathome.org/ website. In short and over-simplified: they search for vaccines. Bye, Alexander. -- http://www.Leidinger.net alexan...@leidinger.net: PGP 0x8F31830F9F2772BF http://www.FreeBSD.orgnetch...@freebsd.org : PGP 0x8F31830F9F2772BF pgpegpTcV7V9M.pgp Description: Digitale PGP-Signatur
