Re: swap space issues

2020-06-28 Thread Donald Wilde
On 6/28/20, Donald Wilde  wrote:
> Okay, the post with the attachments was too big, so I canceled it. The
> direct copies went out with the archives.
>
> Here's the one pertinent log file. I'm still examining it.
> [snip]

Even the log file is too big. Sent the whole thing to the LLVM80
maintainer and the Synth maintainer.

>> I'll keep examining the entire /var/log/synth archive, which I
>> attached to my last post in this thread. :D
>
> This one will again be bounced by -stable, but hopefully Eric, the
> Synth maintainer will see it.
>
> ... and Brooks (Jason?), the llvm80 maintainer. Will repost to -stable
> without attachments, and with more  analysis.
[snip]

 From the log file for devel/llvm80:

[4911/4933] : && /usr/local/bin/cmake -E rm -f lib/libgtest_main.a &&
/usr/local/bin/ar qc lib/libgtest_main.a
utils/unittest/UnitTestMain/CMakeFiles/gtest_main.dir/TestMain.cpp.o
&& /usr/local/bin/ranlib lib/libgtest_main.a && :
[4912/4933] cd /construction/xports/devel/llvm80/work/.build/docs &&
/usr/local/bin/cmake -E make_directory
/construction/xports/devel/llvm80/work/.build/docs/man &&
/usr/local/bin/sphinx-build-3.7 -b man -d
/construction/xports/devel/llvm80/work/.build/docs/_doctrees-dsymutil-man
-q /construction/xports/devel/llvm80/work/llvm-8.0.1.src/docs
/construction/xports/devel/llvm80/work/.build/docs/man
/construction/xports/devel/llvm80/work/llvm-8.0.1.src/docs/MarkdownQuickstartTemplate.md:96:
WARNING: Unexpected indentation.
/construction/xports/devel/llvm80/work/llvm-8.0.1.src/docs/MarkdownQuickstartTemplate.md:94:
WARNING: Inline literal start-string without end-string.
/construction/xports/devel/llvm80/work/llvm-8.0.1.src/docs/MarkdownQuickstartTemplate.md:97:
WARNING: Block quote ends without a blank line; unexpected unindent.
/construction/xports/devel/llvm80/work/llvm-8.0.1.src/docs/MarkdownQuickstartTemplate.md:104:
WARNING: Unexpected indentation.
/construction/xports/devel/llvm80/work/llvm-8.0.1.src/docs/MarkdownQuickstartTemplate.md:102:
WARNING: Inline literal start-string without end-string.
/construction/xports/devel/llvm80/work/llvm-8.0.1.src/docs/MarkdownQuickstartTemplate.md:105:
WARNING: Block quote ends without a blank line; unexpected unindent.

[snip]
/construction/xports/devel/llvm80/work/llvm-8.0.1.src/docs/MarkdownQuickstartTemplate.md:141:
WARNING: Block quote ends without a blank line; unexpected unindent.
/construction/xports/devel/llvm80/work/llvm-8.0.1.src/docs/MarkdownQuickstartTemplate.md:145:
WARNING: Unexpected indentation.
/construction/xports/devel/llvm80/work/llvm-8.0.1.src/docs/SpeculativeLoadHardening.md:32:
WARNING: Unexpected indentation.
/construction/xports/devel/llvm80/work/llvm-8.0.1.src/docs/SpeculativeLoadHardening.md:21:
WARNING: Inline literal start-string without end-string.
/construction/xports/devel/llvm80/work/llvm-8.0.1.src/docs/SpeculativeLoadHardening.md:34:
WARNING: Block quote ends without a blank line; unexpected unindent.
/construction/xports/devel/llvm80/work/llvm-8.0.1.src/docs/SpeculativeLoadHardening.md:39:
WARNING: Unexpected indentation.

These go on and on. I'll have to go back and examine the config.

These reference tests of something by Google. IIRC, I enabled BROTLI
and another Google package, something like 'Google Performance Tools.'


-- 
Don Wilde

* What is the Internet of Things but a system *
* of systems including humans? *

___
freebsd-stable@freebsd.org mailing list
https://lists.freebsd.org/mailman/listinfo/freebsd-stable
To unsubscribe, send any mail to "freebsd-stable-unsubscr...@freebsd.org"


Re: swap space issues

2020-06-28 Thread Donald Wilde
[trimming the direct cc:s]

On 6/28/20, Donald Wilde  wrote:
> On 6/28/20, Donald Wilde  wrote:
>> On 6/27/20, Donald Wilde  wrote:
>>> On 6/26/20, Ronald Klop  wrote:

> [snip]
[snip]

I should have said that this run was done with 3 and 3 in synth.

> The first attached tarball was an earlier run that failed (not
> crashed) on cmake. I resolved that one through a direct build, but I
> did do a graceful stoppage of synth while llvm80 was in process. It
> did finally crash anyway, which led me to throttle back to 1 and 1.
>
> The second one, hopefully, contains every log up to the one that
> crashed and hopefully also the beginning of that task. As I say, ONE
> builder and ONE task, after a reboot. LLVM80 was the only builder
> input.

Okay, here's the summary, updated just before the crash. Attached is
the full JSON, but I'll give the highlights here:
{
[snip]
  ,"elapsed":"04:43:47"
... almost five hours

[snip]
  ,"swapinfo":" 1.6%"
... no warning!

  ,"load":" 1.12"
... 1 builder and 1 task
 }
 ,"builders":[
  {
[snip]
   ,"origin":"devel/llvm80"
   ,"lines":"15326"

FWIW, that's a lot of "lines," compared to other ports. What does
"lines" count?
Will look it up.
  }
 ]
}
I'll keep examining the entire /var/log/synth archive, which I
attached to my last post in this thread. :D
-- 
Don Wilde

* What is the Internet of Things but a system *
* of systems including humans? *

___
freebsd-stable@freebsd.org mailing list
https://lists.freebsd.org/mailman/listinfo/freebsd-stable
To unsubscribe, send any mail to "freebsd-stable-unsubscr...@freebsd.org"


Re: `efivar -l` fails on UEFI booted 11.4-RELEASE

2020-06-28 Thread Warner Losh
On Sun, Jun 28, 2020, 1:52 AM Dimitry Andric  wrote:

> On 28 Jun 2020, at 04:21, Kyle Evans  wrote:
> >
> > On Sat, Jun 27, 2020 at 8:04 PM Yasuhiro KIMURA 
> wrote:
> >>
> >> On UEFI booted 11.4-RELEASE system `efivar -l` fails as following.
> >>
> >> root@rolling-vm-freebsd3[160]# uname -a
> >> FreeBSD rolling-vm-freebsd3.home.utahime.org 11.4-RELEASE FreeBSD
> 11.4-RELEASE #0 r362094: Fri Jun 12 18:27:15 UTC 2020
>  r...@releng2.nyi.freebsd.org:/usr/obj/usr/src/sys/GENERIC  amd64
> >> root@rolling-vm-freebsd3[161]# efivar -l
> >> efivar: Error listing names: No such file or directory
>
> Perhaps the efivar utility could suggest loading the module in this case?
>

The trouble I'd that this error also means other things too. It's a lot
more than changing the printf here.

Warner

>
___
freebsd-stable@freebsd.org mailing list
https://lists.freebsd.org/mailman/listinfo/freebsd-stable
To unsubscribe, send any mail to "freebsd-stable-unsubscr...@freebsd.org"


Re: `efivar -l` fails on UEFI booted 11.4-RELEASE

2020-06-28 Thread Dimitry Andric
On 28 Jun 2020, at 04:21, Kyle Evans  wrote:
> 
> On Sat, Jun 27, 2020 at 8:04 PM Yasuhiro KIMURA  wrote:
>> 
>> On UEFI booted 11.4-RELEASE system `efivar -l` fails as following.
>> 
>> root@rolling-vm-freebsd3[160]# uname -a
>> FreeBSD rolling-vm-freebsd3.home.utahime.org 11.4-RELEASE FreeBSD 
>> 11.4-RELEASE #0 r362094: Fri Jun 12 18:27:15 UTC 2020 
>> r...@releng2.nyi.freebsd.org:/usr/obj/usr/src/sys/GENERIC  amd64
>> root@rolling-vm-freebsd3[161]# efivar -l
>> efivar: Error listing names: No such file or directory

Perhaps the efivar utility could suggest loading the module in this case?

-Dimitry



signature.asc
Description: Message signed with OpenPGP


Re: swap space issues

2020-06-28 Thread Donald Wilde
On 6/27/20, Donald Wilde  wrote:
> On 6/26/20, Ronald Klop  wrote:
>>
>> Van: Bob Bishop 
>> Datum: vrijdag, 26 juni 2020 17:18
>> Aan: Peter Jeremy 
>> CC: Donald Wilde , freebsd-stable
>> 
>> Onderwerp: Re: swap space issues
>>>
>>>
>>>
>>> > On 26 Jun 2020, at 11:23, Peter Jeremy  wrote:
>>> >
>>> > On 2020-Jun-25 11:30:31 -0700, Donald Wilde  wrote:
>>> >> Here's 'pstat -s' on the i3 (which registers as cpu HAMMER):
>>> >>
>>> >> Device  1K-blocks UsedAvail Capacity
>>> >> /dev/ada0s1b 335544320 33554432 0%
>>> >> /dev/ada0s1d 335544320 33554432 0%
>>> >> Total671088640 67108864 0%
>>> >
>>> > I strongly suggest you don't have more than one swap device on
>>> > spinning
>>> > rust - the VM system will stripe I/O across the available devices and
>>> > that will give particularly poor results when it has to seek between
>>> > the
>>> > partitions.
>>>
> Based on all recommendations on this thread (thanks, guys!), I've
> rebuilt my i3 mule with exactly one 16G partition, as it has only
> 'spinning rust'  for a disk. My loader.conf has
> kern.maxswzone=420 and ccache is fully active and working for both
> root on tcsh and users on sh.

That appears to be successful. this is still a MBR-based system, not
GPT, due to BIOS issues, but it's a 'choose my battles' situation.

>
> I have yet to try synth again. I'm doing buildworld/buildkernel for
> 12-STABLE, but evidence so far is good. 'top -t' is actually happy,
> showing 16G (grog?), so I'll try firing up synth after another hour or
> so on the latest fetch of the ports tree.

Top appears to have gone south again. I give up, Greg! 'pstat -s' _is_ happy.

Synth is still crashing hard, same issue. As I said in freebsd-ports
on my thread about 'stable postgresql11', pg11 didn't like synth's
request that I create a different directory because
/usr/ports/distfiles didn't exist. Doing so and adding the DISTFILES
to make.conf caused all kinds of problems.

I am currently (I hope) building a successful pg11-server, but I've
restored /usr/ports/distfiles and before I go to bed tonight I hope to
kick off another synth run.

This failure happened with three builders and three tasks per builder.
The symptom, multiple times, has been that llvm80 takes forever and
then causes the swap failure even though pstat -s is happy AND loader
conf kern.maxswzone (=420) is sufficient for my 16G partition.
I've tried installing llvm80 as a pkg, but that didn't help. The swap
stays at zero usage, and then goes almost instantaneously to OOM.

The only bit of advice I'm not completely compliant with is the use of
a 16G swap partition where I was advised to set max to 8G.
-- 
Don Wilde

* What is the Internet of Things but a system *
* of systems including humans? *

___
freebsd-stable@freebsd.org mailing list
https://lists.freebsd.org/mailman/listinfo/freebsd-stable
To unsubscribe, send any mail to "freebsd-stable-unsubscr...@freebsd.org"