CVS commit: src/external/apache2/llvm/librt

2023-07-15 Thread Robert Swindells
Module Name:src
Committed By:   rjs
Date:   Sat Jul 15 21:14:01 UTC 2023

Modified Files:
src/external/apache2/llvm/librt: Makefile
Added Files:
src/external/apache2/llvm/librt/libLLVMAMDGPUDisassembler: Makefile

Log Message:
Add AMDGPUDisassembler to LLVM runtime.


To generate a diff of this commit:
cvs rdiff -u -r1.4 -r1.5 src/external/apache2/llvm/librt/Makefile
cvs rdiff -u -r0 -r1.1 \
src/external/apache2/llvm/librt/libLLVMAMDGPUDisassembler/Makefile

Please note that diffs are not public domain; they are subject to the
copyright notices on the relevant files.

Modified files:

Index: src/external/apache2/llvm/librt/Makefile
diff -u src/external/apache2/llvm/librt/Makefile:1.4 src/external/apache2/llvm/librt/Makefile:1.5
--- src/external/apache2/llvm/librt/Makefile:1.4	Sun May 30 01:56:58 2021
+++ src/external/apache2/llvm/librt/Makefile	Sat Jul 15 21:14:01 2023
@@ -1,4 +1,4 @@
-#	$NetBSD: Makefile,v 1.4 2021/05/30 01:56:58 joerg Exp $
+#	$NetBSD: Makefile,v 1.5 2023/07/15 21:14:01 rjs Exp $
 
 .include 
 
@@ -92,6 +92,7 @@ SUBDIR+= \
 	libLLVMAMDGPUMCTargetDesc \
 	libLLVMAMDGPUTargetInfo \
 	libLLVMAMDGPUAsmParser \
+	libLLVMAMDGPUDisassembler \
 	libLLVMAMDGPUUtils
 .endif
 

Added files:

Index: src/external/apache2/llvm/librt/libLLVMAMDGPUDisassembler/Makefile
diff -u /dev/null src/external/apache2/llvm/librt/libLLVMAMDGPUDisassembler/Makefile:1.1
--- /dev/null	Sat Jul 15 21:14:01 2023
+++ src/external/apache2/llvm/librt/libLLVMAMDGPUDisassembler/Makefile	Sat Jul 15 21:14:01 2023
@@ -0,0 +1,3 @@
+#	$NetBSD: Makefile,v 1.1 2023/07/15 21:14:01 rjs Exp $
+
+.include 



CVS commit: src/external/apache2/llvm/librt

2023-07-15 Thread Robert Swindells
Module Name:src
Committed By:   rjs
Date:   Sat Jul 15 21:14:01 UTC 2023

Modified Files:
src/external/apache2/llvm/librt: Makefile
Added Files:
src/external/apache2/llvm/librt/libLLVMAMDGPUDisassembler: Makefile

Log Message:
Add AMDGPUDisassembler to LLVM runtime.


To generate a diff of this commit:
cvs rdiff -u -r1.4 -r1.5 src/external/apache2/llvm/librt/Makefile
cvs rdiff -u -r0 -r1.1 \
src/external/apache2/llvm/librt/libLLVMAMDGPUDisassembler/Makefile

Please note that diffs are not public domain; they are subject to the
copyright notices on the relevant files.



CVS commit: src/external/apache2/llvm

2023-06-04 Thread Luke Mewburn
Module Name:src
Committed By:   lukem
Date:   Sun Jun  4 17:48:05 UTC 2023

Modified Files:
src/external/apache2/llvm: Makefile.inc

Log Message:
llvm tool build: fix warning

-std=c++14 is for HOST_CXXFLAGS not HOST_CPPFLAGS.

Fixes: cc1: warning: command-line option '-std=c++14' is valid for C++/ObjC++ 
but not for C


To generate a diff of this commit:
cvs rdiff -u -r1.7 -r1.8 src/external/apache2/llvm/Makefile.inc

Please note that diffs are not public domain; they are subject to the
copyright notices on the relevant files.

Modified files:

Index: src/external/apache2/llvm/Makefile.inc
diff -u src/external/apache2/llvm/Makefile.inc:1.7 src/external/apache2/llvm/Makefile.inc:1.8
--- src/external/apache2/llvm/Makefile.inc:1.7	Sat Jun  3 21:33:01 2023
+++ src/external/apache2/llvm/Makefile.inc	Sun Jun  4 17:48:05 2023
@@ -1,4 +1,4 @@
-#	$NetBSD: Makefile.inc,v 1.7 2023/06/03 21:33:01 lukem Exp $
+#	$NetBSD: Makefile.inc,v 1.8 2023/06/04 17:48:05 lukem Exp $
 
 .if !defined(LLVM_TOPLEVEL_MK)
 LLVM_TOPLEVEL_MK=
@@ -36,7 +36,7 @@ HOST_CXXFLAGS+=	-O2 -fno-rtti -fno-excep
 .if ${HOST_SUPPORTS_MODULES:Uno} == "yes"
 HOST_CXXFLAGS+=	${MODULES_CXXFLAGS}
 .endif
-HOST_CPPFLAGS+=	-std=c++14
+HOST_CXXFLAGS+=	-std=c++14
 LLVM_TARGETS=	x86,powerpc,sparc,aarch64,arm,mips
 .else
 LLVM_INCLUDE_CONFIG=	${LLVM_TOPLEVEL}/config



CVS commit: src/external/apache2/llvm

2023-06-04 Thread Luke Mewburn
Module Name:src
Committed By:   lukem
Date:   Sun Jun  4 17:48:05 UTC 2023

Modified Files:
src/external/apache2/llvm: Makefile.inc

Log Message:
llvm tool build: fix warning

-std=c++14 is for HOST_CXXFLAGS not HOST_CPPFLAGS.

Fixes: cc1: warning: command-line option '-std=c++14' is valid for C++/ObjC++ 
but not for C


To generate a diff of this commit:
cvs rdiff -u -r1.7 -r1.8 src/external/apache2/llvm/Makefile.inc

Please note that diffs are not public domain; they are subject to the
copyright notices on the relevant files.



Re: CVS commit: src/external/apache2/llvm

2022-02-28 Thread Joerg Sonnenberger
Am Tue, Mar 01, 2022 at 10:17:18AM +1100 schrieb matthew green:
> "Joerg Sonnenberger" writes:
> > Module Name:src
> > Committed By:   joerg
> > Date:   Mon Feb 28 16:30:10 UTC 2022
> >
> > Modified Files:
> > src/external/apache2/llvm: Makefile.inc
> >
> > Log Message:
> > When MKDEBUG is use, build LLVM with -g1 to significantly reduce debug
> > information. This still includes types and line tables, but skips e.g.
> > local variables and inline tracking.
> 
> tempted to do this for GCC as well.  i'll see what happens to the
> size of eg gallium.so.0.debug (currently larger than the full
> base install itself.)  it's kind of insane:
> 
> -r--r--r--  1 root  wheel  1828732744 Nov 14 00:15 
> /usr/libdata/debug/usr/X11R7/lib/modules/dri/gallium_dri.so.0.debug
> 
> yesterday-when-i-was-mad /usr/src> readelf --debug-dump 
> /usr/libdata/debug/usr/X11R7/lib/modules/dri/gallium_dri.so.0.debug >& 
> /dev/null
> 320.988u 1.149s 5:22.15 99.9%   0+0k 1+0io 0pf+0w
> 
> ... and that's a zen3 cpu.

This is applied to both GCC and Clang as base compiler.

Joerg


re: CVS commit: src/external/apache2/llvm

2022-02-28 Thread matthew green
"Joerg Sonnenberger" writes:
> Module Name:  src
> Committed By: joerg
> Date: Mon Feb 28 16:30:10 UTC 2022
>
> Modified Files:
>   src/external/apache2/llvm: Makefile.inc
>
> Log Message:
> When MKDEBUG is use, build LLVM with -g1 to significantly reduce debug
> information. This still includes types and line tables, but skips e.g.
> local variables and inline tracking.

tempted to do this for GCC as well.  i'll see what happens to the
size of eg gallium.so.0.debug (currently larger than the full
base install itself.)  it's kind of insane:

-r--r--r--  1 root  wheel  1828732744 Nov 14 00:15 
/usr/libdata/debug/usr/X11R7/lib/modules/dri/gallium_dri.so.0.debug

yesterday-when-i-was-mad /usr/src> readelf --debug-dump 
/usr/libdata/debug/usr/X11R7/lib/modules/dri/gallium_dri.so.0.debug >& /dev/null
320.988u 1.149s 5:22.15 99.9%   0+0k 1+0io 0pf+0w

... and that's a zen3 cpu.


.mrg.


CVS commit: src/external/apache2/llvm

2022-02-28 Thread Joerg Sonnenberger
Module Name:src
Committed By:   joerg
Date:   Mon Feb 28 16:30:10 UTC 2022

Modified Files:
src/external/apache2/llvm: Makefile.inc

Log Message:
When MKDEBUG is use, build LLVM with -g1 to significantly reduce debug
information. This still includes types and line tables, but skips e.g.
local variables and inline tracking.


To generate a diff of this commit:
cvs rdiff -u -r1.5 -r1.6 src/external/apache2/llvm/Makefile.inc

Please note that diffs are not public domain; they are subject to the
copyright notices on the relevant files.

Modified files:

Index: src/external/apache2/llvm/Makefile.inc
diff -u src/external/apache2/llvm/Makefile.inc:1.5 src/external/apache2/llvm/Makefile.inc:1.6
--- src/external/apache2/llvm/Makefile.inc:1.5	Sun May 30 01:56:45 2021
+++ src/external/apache2/llvm/Makefile.inc	Mon Feb 28 16:30:10 2022
@@ -1,4 +1,4 @@
-#	$NetBSD: Makefile.inc,v 1.5 2021/05/30 01:56:45 joerg Exp $
+#	$NetBSD: Makefile.inc,v 1.6 2022/02/28 16:30:10 joerg Exp $
 
 .if !defined(LLVM_TOPLEVEL_MK)
 LLVM_TOPLEVEL_MK=
@@ -50,6 +50,9 @@ LLVM_TARGETS=	x86,powerpc,sparc,aarch64,
 CXXFLAGS+=		${${ACTIVE_CC} == "clang":? ${MODULES_CXXFLAGS} :}
 
 CXXFLAGS+=	-std=c++14
+.if ${MKDEBUG:Uno} != "no"
+CXXFLAGS+=	-g1
+.endif
 CXXFLAGS+=	-fno-rtti -fno-exceptions ${${ACTIVE_CC} == "gcc" :? -fno-strict-aliasing :}
 CXXFLAGS+=	-ffunction-sections -fdata-sections
 LDFLAGS+=	-Wl,--gc-sections



CVS commit: src/external/apache2/llvm

2022-02-28 Thread Joerg Sonnenberger
Module Name:src
Committed By:   joerg
Date:   Mon Feb 28 16:30:10 UTC 2022

Modified Files:
src/external/apache2/llvm: Makefile.inc

Log Message:
When MKDEBUG is use, build LLVM with -g1 to significantly reduce debug
information. This still includes types and line tables, but skips e.g.
local variables and inline tracking.


To generate a diff of this commit:
cvs rdiff -u -r1.5 -r1.6 src/external/apache2/llvm/Makefile.inc

Please note that diffs are not public domain; they are subject to the
copyright notices on the relevant files.



Re: CVS commit: src/external/apache2/llvm/config/llvm/Config

2020-02-21 Thread Joerg Sonnenberger
On Fri, Feb 21, 2020 at 11:13:24AM +0100, Kamil Rytarowski wrote:
> On 21.02.2020 07:20, Martin Husemann wrote:
> > On Fri, Feb 21, 2020 at 03:01:45AM +0100, Kamil Rytarowski wrote:
> >> I consider calling ncurses-dev essential as a bug.
> > 
> > My knee jerk reaction was: if a unix compiler needs terminfo (especially
> > when it only does that to create coloured unreadable messages) it needs
> > to be moved to pkgsrc. Same goes for a command line debugger.
> > 
> > But if I understood Joerg's (extremely terse) objection:
> > there should be logic in the tools build dealing with missing terminfo
> > libs and this case needs more analyzis to understand why it fails.
> > 
> > Martin
> > 
> 
> This patch changes cryptic failure in linking to a verbose message:
> 
> http://netbsd.org/~kamil/patch-00231-llvm-terminfo-tools.txt
> 
> Does it look to commit?

No, absolutely not. This is just making the problem a 100 times worse.

Joerg


Re: CVS commit: src/external/apache2/llvm/config/llvm/Config

2020-02-21 Thread Valery Ushakov
On Fri, Feb 21, 2020 at 11:13:24 +0100, Kamil Rytarowski wrote:

> This patch changes cryptic failure in linking to a verbose message:
> 
> http://netbsd.org/~kamil/patch-00231-llvm-terminfo-tools.txt
> 
> Does it look to commit?

The "devel library" is linux-specific terminology.
There's no need for ALL CAPS.

-uwe


Re: CVS commit: src/external/apache2/llvm/config/llvm/Config

2020-02-21 Thread Kamil Rytarowski
On 21.02.2020 07:20, Martin Husemann wrote:
> On Fri, Feb 21, 2020 at 03:01:45AM +0100, Kamil Rytarowski wrote:
>> I consider calling ncurses-dev essential as a bug.
> 
> My knee jerk reaction was: if a unix compiler needs terminfo (especially
> when it only does that to create coloured unreadable messages) it needs
> to be moved to pkgsrc. Same goes for a command line debugger.
> 
> But if I understood Joerg's (extremely terse) objection:
> there should be logic in the tools build dealing with missing terminfo
> libs and this case needs more analyzis to understand why it fails.
> 
> Martin
> 

This patch changes cryptic failure in linking to a verbose message:

http://netbsd.org/~kamil/patch-00231-llvm-terminfo-tools.txt

Does it look to commit?

A real fix (assuming we want terminfo in tools) is to build terminfo
together with tools. I defer this to someone else.



signature.asc
Description: OpenPGP digital signature


Re: CVS commit: src/external/apache2/llvm/config/llvm/Config

2020-02-21 Thread Kamil Rytarowski
On 21.02.2020 09:17, Leonardo Taccari wrote:
> Kamil Rytarowski writes:
>> [...]
>> ./build.sh tools for LLVM is broken when host ships with no terminfo
>> devel libraries. I tried to disable this superfluous feature for tools
>> (for colors in a terminal), but it got reverted (breaking TNF rules) here.
>> [...]
> 
> Apart possible technical arguments, AFAICS the revert probably haven't
> broken the rules: you have asked for feedback on #NetBSD@Freenode IRC
> channel and then  replied with a no but you have committed them
> anyway.
> 

This message was not reached/noted on my end (as it was not prefixed
with my login over there) and later (next day) it was out of IRC log
scroll buffer.

I don't object formally.



signature.asc
Description: OpenPGP digital signature


Re: CVS commit: src/external/apache2/llvm/config/llvm/Config

2020-02-21 Thread Leonardo Taccari
Kamil Rytarowski writes:
> [...]
> ./build.sh tools for LLVM is broken when host ships with no terminfo
> devel libraries. I tried to disable this superfluous feature for tools
> (for colors in a terminal), but it got reverted (breaking TNF rules) here.
> [...]

Apart possible technical arguments, AFAICS the revert probably haven't
broken the rules: you have asked for feedback on #NetBSD@Freenode IRC
channel and then  replied with a no but you have committed them
anyway.


Re: CVS commit: src/external/apache2/llvm/config/llvm/Config

2020-02-20 Thread Martin Husemann
On Fri, Feb 21, 2020 at 03:01:45AM +0100, Kamil Rytarowski wrote:
> I consider calling ncurses-dev essential as a bug.

My knee jerk reaction was: if a unix compiler needs terminfo (especially
when it only does that to create coloured unreadable messages) it needs
to be moved to pkgsrc. Same goes for a command line debugger.

But if I understood Joerg's (extremely terse) objection:
there should be logic in the tools build dealing with missing terminfo
libs and this case needs more analyzis to understand why it fails.

Martin


Re: CVS commit: src/external/apache2/llvm/config/llvm/Config

2020-02-20 Thread Kamil Rytarowski
On 21.02.2020 02:47, Christos Zoulas wrote:
> So host needs to install terminfo-dev. How is that different from the host 
> environment needing to provide other pieces of the development environment? 
> For example if another tool needed openssl-dev, would we disable crypto? Or 
> if it needed yacc/bison or autoconf/automake wouldn't we rather install 
> those? Isn't simple to type one command to install the appropriate packages?
> 
> christos
> 
> christos
> 


Maybe it is simpler to require terminfo, but it shall be verbose and
fail in the 'configure' phase (the need-terminfo: target in
tools/llvm/Makefile). It was breaking the public bot for cryptic reasons
for a number of days.

As far as I am aware the contract for ./build.sh tools was to bootstrap
on a very minimal system with a functional essential development packages.

I consider calling ncurses-dev essential as a bug. Requiring OpenSSL-dev
would be worse as it is API incompatibile between versions and we
promised to bootstrap from "anything".

yacc, m4, make, gmake etc are tools generated on the top of essential
packages. If we insist on terminfo-dev from host, it is better to build
it as a tool.



signature.asc
Description: OpenPGP digital signature


Re: CVS commit: src/external/apache2/llvm/config/llvm/Config

2020-02-20 Thread Christos Zoulas
So host needs to install terminfo-dev. How is that different from the host 
environment needing to provide other pieces of the development environment? For 
example if another tool needed openssl-dev, would we disable crypto? Or if it 
needed yacc/bison or autoconf/automake wouldn't we rather install those? Isn't 
simple to type one command to install the appropriate packages?

christos

christos



> On Feb 20, 2020, at 7:32 PM, Kamil Rytarowski  wrote:
> 
> On 21.02.2020 01:17, Christos Zoulas wrote:
>> In article <5f8df6c1-bb25-f24a-27fc-b3a752a6d...@gmx.com>,
>> Kamil Rytarowski   wrote:
>> 
>>> We don't have any direct reproducer (we tried) and we must figure it out
>>> from syzkaller bot. We don't have access to the machine and a limited
>>> access to an admin over there (who has no expertise on BSDs). This
>>> failure breaks kMSan build for long time now. There is full build log.
>> 
>> If we don't undestand the problem we don't just disable code to make the
>> tool happy. This is: hand hurts, amputate. Let's try to figure out what's
>> wrong first.
>> 
>>> Calling syzbot report useless does not help. Lack of support in the
>>> build phase will result in removal of the bot instance and turn our work
>>> into futile effort.
>> 
>> We need to have more details in order to fix the problem.
>> 
>> christos
>> 
> 
> ./build.sh tools for LLVM is broken when host ships with no terminfo
> devel libraries. I tried to disable this superfluous feature for tools
> (for colors in a terminal), but it got reverted (breaking TNF rules) here.
> 
> The broken tools logic was workarounded in the syzbot setup and we
> installed there ncurses-dev package and the build passed.
> 
> PR toolchain/54993
> 
> 



Re: CVS commit: src/external/apache2/llvm/config/llvm/Config

2020-02-20 Thread Kamil Rytarowski
On 21.02.2020 01:17, Christos Zoulas wrote:
> In article <5f8df6c1-bb25-f24a-27fc-b3a752a6d...@gmx.com>,
> Kamil Rytarowski   wrote:
> 
>> We don't have any direct reproducer (we tried) and we must figure it out
>>from syzkaller bot. We don't have access to the machine and a limited
>> access to an admin over there (who has no expertise on BSDs). This
>> failure breaks kMSan build for long time now. There is full build log.
> 
> If we don't undestand the problem we don't just disable code to make the
> tool happy. This is: hand hurts, amputate. Let's try to figure out what's
> wrong first.
> 
>> Calling syzbot report useless does not help. Lack of support in the
>> build phase will result in removal of the bot instance and turn our work
>> into futile effort.
> 
> We need to have more details in order to fix the problem.
> 
> christos
> 

./build.sh tools for LLVM is broken when host ships with no terminfo
devel libraries. I tried to disable this superfluous feature for tools
(for colors in a terminal), but it got reverted (breaking TNF rules) here.

The broken tools logic was workarounded in the syzbot setup and we
installed there ncurses-dev package and the build passed.

PR toolchain/54993



signature.asc
Description: OpenPGP digital signature


Re: CVS commit: src/external/apache2/llvm/config/llvm/Config

2020-02-20 Thread Christos Zoulas
In article <5f8df6c1-bb25-f24a-27fc-b3a752a6d...@gmx.com>,
Kamil Rytarowski   wrote:

>We don't have any direct reproducer (we tried) and we must figure it out
>from syzkaller bot. We don't have access to the machine and a limited
>access to an admin over there (who has no expertise on BSDs). This
>failure breaks kMSan build for long time now. There is full build log.

If we don't undestand the problem we don't just disable code to make the
tool happy. This is: hand hurts, amputate. Let's try to figure out what's
wrong first.

>Calling syzbot report useless does not help. Lack of support in the
>build phase will result in removal of the bot instance and turn our work
>into futile effort.

We need to have more details in order to fix the problem.

christos



Re: CVS commit: src/external/apache2/llvm/config/llvm/Config

2020-02-20 Thread Valery Ushakov
On Thu, Feb 20, 2020 at 00:09:28 +, Roy Marples wrote:

> On 19/02/2020 22:29, Kamil Rytarowski wrote:
> > Why do you need terminfo/termios in ./build.sh tools?
> 
> We build the nbtic tool so we can build the terminfo database.

The database is not a problem.  If we want to keep this code turned on
in llvm we are better providing a small do-nothing libterminfo stub as
a fallback that would claim that the current TERM doesn't support
colors.

-uwe


Re: CVS commit: src/external/apache2/llvm/config/llvm/Config

2020-02-20 Thread Valery Ushakov
On Thu, Feb 20, 2020 at 10:54:50 +0100, Kamil Rytarowski wrote:

> >> https://syzkaller.appspot.com/text?tag=CrashLog=11aafc09e0
> > 
> > Yes and that is completely useless for figuring out the why.
> 
> We don't have any direct reproducer (we tried) and we must figure it
> out from syzkaller bot. We don't have access to the machine and a
> limited access to an admin over there (who has no expertise on
> BSDs). This failure breaks kMSan build for long time now. There is
> full build log.

We can start by dropping "> /dev/null 2>&1" in tools/llvm/Makefile (may be 
temporarily).

-uwe


Re: CVS commit: src/external/apache2/llvm/config/llvm/Config

2020-02-20 Thread Kamil Rytarowski
On 20.02.2020 01:09, Roy Marples wrote:
> On 19/02/2020 22:29, Kamil Rytarowski wrote:
>> Why do you need terminfo/termios in ./build.sh tools?
> 
> We build the nbtic tool so we can build the terminfo database.
> 
> Roy

I will try to have a look and switch to our internal terminfo.



signature.asc
Description: OpenPGP digital signature


Re: CVS commit: src/external/apache2/llvm/config/llvm/Config

2020-02-20 Thread Kamil Rytarowski
On 19.02.2020 23:50, Joerg Sonnenberger wrote:
> On Wed, Feb 19, 2020 at 11:29:09PM +0100, Kamil Rytarowski wrote:
>> On 19.02.2020 23:03, Joerg Sonnenberger wrote:
>>> On Wed, Feb 19, 2020 at 04:10:17PM +0100, Kamil Rytarowski wrote:
 On 19.02.2020 14:32, Joerg Sonnenberger wrote:
> Module Name:  src
> Committed By: joerg
> Date: Wed Feb 19 13:32:40 UTC 2020
>
> Modified Files:
>   src/external/apache2/llvm/config/llvm/Config: config.h.in
>
> Log Message:
> Revert last. It was objected to pre-commit, there is no actual error
> analysis or report and there is existing logic supposed to handle this.
>
>
> To generate a diff of this commit:
> cvs rdiff -u -r1.2 -r1.3 \
> src/external/apache2/llvm/config/llvm/Config/config.h.in
>
> Please note that diffs are not public domain; they are subject to the
> copyright notices on the relevant files.
>

 Objected pre-commit? Nothing reached me and I see nothing in logs.

 No report? It was discussed in public syzkaller ML and semipublic IRC
 channel with 5 people involved.

 https://syzkaller.appspot.com/text?tag=CrashLog=11aafc09e0

 No analysis? There is analysis in the commit message that we remove
 optional features.

 I request either to reintroduce it now or land another fix.
>>>
>>> While I am on many mailing lists, I'm certainly not on all lists. I
>>> answered in the only forum where I saw the message. I am strongly
>>> objecting here because you make the tools compiler a lot less usable.
>>> You haven't acutally shown *why* the existing logic doesn't work.
>>>
>>
>> The existing logic does not work as it is breaking bootstrap on
>> Linux/Ubuntu as presented here:
>>
>> https://syzkaller.appspot.com/text?tag=CrashLog=11aafc09e0
> 
> Yes and that is completely useless for figuring out the why.
> 
> Joerg
> 

We don't have any direct reproducer (we tried) and we must figure it out
from syzkaller bot. We don't have access to the machine and a limited
access to an admin over there (who has no expertise on BSDs). This
failure breaks kMSan build for long time now. There is full build log.

Calling syzbot report useless does not help. Lack of support in the
build phase will result in removal of the bot instance and turn our work
into futile effort.



signature.asc
Description: OpenPGP digital signature


Re: CVS commit: src/external/apache2/llvm/config/llvm/Config

2020-02-19 Thread Roy Marples

On 19/02/2020 22:29, Kamil Rytarowski wrote:

Why do you need terminfo/termios in ./build.sh tools?


We build the nbtic tool so we can build the terminfo database.

Roy


Re: CVS commit: src/external/apache2/llvm/config/llvm/Config

2020-02-19 Thread Joerg Sonnenberger
On Wed, Feb 19, 2020 at 11:29:09PM +0100, Kamil Rytarowski wrote:
> On 19.02.2020 23:03, Joerg Sonnenberger wrote:
> > On Wed, Feb 19, 2020 at 04:10:17PM +0100, Kamil Rytarowski wrote:
> >> On 19.02.2020 14:32, Joerg Sonnenberger wrote:
> >>> Module Name:  src
> >>> Committed By: joerg
> >>> Date: Wed Feb 19 13:32:40 UTC 2020
> >>>
> >>> Modified Files:
> >>>   src/external/apache2/llvm/config/llvm/Config: config.h.in
> >>>
> >>> Log Message:
> >>> Revert last. It was objected to pre-commit, there is no actual error
> >>> analysis or report and there is existing logic supposed to handle this.
> >>>
> >>>
> >>> To generate a diff of this commit:
> >>> cvs rdiff -u -r1.2 -r1.3 \
> >>> src/external/apache2/llvm/config/llvm/Config/config.h.in
> >>>
> >>> Please note that diffs are not public domain; they are subject to the
> >>> copyright notices on the relevant files.
> >>>
> >>
> >> Objected pre-commit? Nothing reached me and I see nothing in logs.
> >>
> >> No report? It was discussed in public syzkaller ML and semipublic IRC
> >> channel with 5 people involved.
> >>
> >> https://syzkaller.appspot.com/text?tag=CrashLog=11aafc09e0
> >>
> >> No analysis? There is analysis in the commit message that we remove
> >> optional features.
> >>
> >> I request either to reintroduce it now or land another fix.
> > 
> > While I am on many mailing lists, I'm certainly not on all lists. I
> > answered in the only forum where I saw the message. I am strongly
> > objecting here because you make the tools compiler a lot less usable.
> > You haven't acutally shown *why* the existing logic doesn't work.
> > 
> 
> The existing logic does not work as it is breaking bootstrap on
> Linux/Ubuntu as presented here:
> 
> https://syzkaller.appspot.com/text?tag=CrashLog=11aafc09e0

Yes and that is completely useless for figuring out the why.

Joerg


Re: CVS commit: src/external/apache2/llvm/config/llvm/Config

2020-02-19 Thread Kamil Rytarowski
On 19.02.2020 23:03, Joerg Sonnenberger wrote:
> On Wed, Feb 19, 2020 at 04:10:17PM +0100, Kamil Rytarowski wrote:
>> On 19.02.2020 14:32, Joerg Sonnenberger wrote:
>>> Module Name:src
>>> Committed By:   joerg
>>> Date:   Wed Feb 19 13:32:40 UTC 2020
>>>
>>> Modified Files:
>>> src/external/apache2/llvm/config/llvm/Config: config.h.in
>>>
>>> Log Message:
>>> Revert last. It was objected to pre-commit, there is no actual error
>>> analysis or report and there is existing logic supposed to handle this.
>>>
>>>
>>> To generate a diff of this commit:
>>> cvs rdiff -u -r1.2 -r1.3 \
>>> src/external/apache2/llvm/config/llvm/Config/config.h.in
>>>
>>> Please note that diffs are not public domain; they are subject to the
>>> copyright notices on the relevant files.
>>>
>>
>> Objected pre-commit? Nothing reached me and I see nothing in logs.
>>
>> No report? It was discussed in public syzkaller ML and semipublic IRC
>> channel with 5 people involved.
>>
>> https://syzkaller.appspot.com/text?tag=CrashLog=11aafc09e0
>>
>> No analysis? There is analysis in the commit message that we remove
>> optional features.
>>
>> I request either to reintroduce it now or land another fix.
> 
> While I am on many mailing lists, I'm certainly not on all lists. I
> answered in the only forum where I saw the message. I am strongly
> objecting here because you make the tools compiler a lot less usable.
> You haven't acutally shown *why* the existing logic doesn't work.
> 

The existing logic does not work as it is breaking bootstrap on
Linux/Ubuntu as presented here:

https://syzkaller.appspot.com/text?tag=CrashLog=11aafc09e0

> Joerg
> 

Why do you need terminfo/termios in ./build.sh tools?

We need to fix bootstrap on Linux and it is easier to remove terminfo
features and termios ones. We don't need to handle terminal resizing
detection or colors for tools.

Instead of supporting these features dynamically it is easier to disable
them unconditionally. But if you insist to detect them dynamically and
maintain it, please land a patch that will resurrect the bot.



signature.asc
Description: OpenPGP digital signature


Re: CVS commit: src/external/apache2/llvm/config/llvm/Config

2020-02-19 Thread Joerg Sonnenberger
On Wed, Feb 19, 2020 at 04:10:17PM +0100, Kamil Rytarowski wrote:
> On 19.02.2020 14:32, Joerg Sonnenberger wrote:
> > Module Name:src
> > Committed By:   joerg
> > Date:   Wed Feb 19 13:32:40 UTC 2020
> > 
> > Modified Files:
> > src/external/apache2/llvm/config/llvm/Config: config.h.in
> > 
> > Log Message:
> > Revert last. It was objected to pre-commit, there is no actual error
> > analysis or report and there is existing logic supposed to handle this.
> > 
> > 
> > To generate a diff of this commit:
> > cvs rdiff -u -r1.2 -r1.3 \
> > src/external/apache2/llvm/config/llvm/Config/config.h.in
> > 
> > Please note that diffs are not public domain; they are subject to the
> > copyright notices on the relevant files.
> > 
> 
> Objected pre-commit? Nothing reached me and I see nothing in logs.
> 
> No report? It was discussed in public syzkaller ML and semipublic IRC
> channel with 5 people involved.
> 
> https://syzkaller.appspot.com/text?tag=CrashLog=11aafc09e0
> 
> No analysis? There is analysis in the commit message that we remove
> optional features.
> 
> I request either to reintroduce it now or land another fix.

While I am on many mailing lists, I'm certainly not on all lists. I
answered in the only forum where I saw the message. I am strongly
objecting here because you make the tools compiler a lot less usable.
You haven't acutally shown *why* the existing logic doesn't work.

Joerg


Re: CVS commit: src/external/apache2/llvm/config/llvm/Config

2020-02-19 Thread Kamil Rytarowski
On 19.02.2020 14:32, Joerg Sonnenberger wrote:
> Module Name:  src
> Committed By: joerg
> Date: Wed Feb 19 13:32:40 UTC 2020
> 
> Modified Files:
>   src/external/apache2/llvm/config/llvm/Config: config.h.in
> 
> Log Message:
> Revert last. It was objected to pre-commit, there is no actual error
> analysis or report and there is existing logic supposed to handle this.
> 
> 
> To generate a diff of this commit:
> cvs rdiff -u -r1.2 -r1.3 \
> src/external/apache2/llvm/config/llvm/Config/config.h.in
> 
> Please note that diffs are not public domain; they are subject to the
> copyright notices on the relevant files.
> 

Objected pre-commit? Nothing reached me and I see nothing in logs.

No report? It was discussed in public syzkaller ML and semipublic IRC
channel with 5 people involved.

https://syzkaller.appspot.com/text?tag=CrashLog=11aafc09e0

No analysis? There is analysis in the commit message that we remove
optional features.

I request either to reintroduce it now or land another fix.



signature.asc
Description: OpenPGP digital signature


Re: CVS commit: src/external/apache2/llvm

2019-11-29 Thread Joerg Sonnenberger
On Fri, Nov 29, 2019 at 11:28:31AM +, m...@netbsd.org wrote:
> On Thu, Nov 28, 2019 at 11:01:22PM +, Joerg Sonnenberger wrote:
> > Log Message:
> > Use -fno-strict-aliasing unconditionally for the cross compiler.
> 
> What's the context for that?

This was meant to be part of the earlier change to build clang and
associated things with it when using GCC. The same problem applies for
the cross-compiler when the host compiler is a new enough GCC.

Joerg


Re: CVS commit: src/external/apache2/llvm

2019-11-29 Thread maya
On Thu, Nov 28, 2019 at 11:01:22PM +, Joerg Sonnenberger wrote:
> Log Message:
> Use -fno-strict-aliasing unconditionally for the cross compiler.

What's the context for that?

Thanks!


CVS commit: src/external/apache2/llvm

2019-11-28 Thread Joerg Sonnenberger
Module Name:src
Committed By:   joerg
Date:   Thu Nov 28 23:01:22 UTC 2019

Modified Files:
src/external/apache2/llvm: Makefile.inc

Log Message:
Use -fno-strict-aliasing unconditionally for the cross compiler.


To generate a diff of this commit:
cvs rdiff -u -r1.3 -r1.4 src/external/apache2/llvm/Makefile.inc

Please note that diffs are not public domain; they are subject to the
copyright notices on the relevant files.



CVS commit: src/external/apache2/llvm

2019-11-28 Thread Joerg Sonnenberger
Module Name:src
Committed By:   joerg
Date:   Thu Nov 28 23:01:22 UTC 2019

Modified Files:
src/external/apache2/llvm: Makefile.inc

Log Message:
Use -fno-strict-aliasing unconditionally for the cross compiler.


To generate a diff of this commit:
cvs rdiff -u -r1.3 -r1.4 src/external/apache2/llvm/Makefile.inc

Please note that diffs are not public domain; they are subject to the
copyright notices on the relevant files.

Modified files:

Index: src/external/apache2/llvm/Makefile.inc
diff -u src/external/apache2/llvm/Makefile.inc:1.3 src/external/apache2/llvm/Makefile.inc:1.4
--- src/external/apache2/llvm/Makefile.inc:1.3	Mon Nov 18 19:54:23 2019
+++ src/external/apache2/llvm/Makefile.inc	Thu Nov 28 23:01:22 2019
@@ -1,4 +1,4 @@
-#	$NetBSD: Makefile.inc,v 1.3 2019/11/18 19:54:23 joerg Exp $
+#	$NetBSD: Makefile.inc,v 1.4 2019/11/28 23:01:22 joerg Exp $
 
 .if !defined(LLVM_TOPLEVEL_MK)
 LLVM_TOPLEVEL_MK=
@@ -28,7 +28,7 @@ CLANG_INCLUDE_CONFIG=	${LLVM_TOOLCONF_OB
 LLVM_INCLUDE_OBJDIR!=	cd ${NETBSDSRCDIR}/tools/llvm-include && ${PRINTOBJDIR}
 LLVM_TOOLCONF_OBJDIR!=	cd ${NETBSDSRCDIR}/tools/llvm && ${PRINTOBJDIR}
 HOST_CPPFLAGS+=	${CPPFLAGS}
-HOST_CXXFLAGS+=	-O2 -fno-rtti -fno-exceptions 
+HOST_CXXFLAGS+=	-O2 -fno-rtti -fno-exceptions -fno-strict-aliasing
 HOST_CPPFLAGS+=	-std=c++14
 LLVM_TARGETS=	x86,powerpc,sparc,aarch64,arm,mips
 .else



CVS commit: src/external/apache2/llvm

2019-11-18 Thread Joerg Sonnenberger
Module Name:src
Committed By:   joerg
Date:   Mon Nov 18 19:54:24 UTC 2019

Modified Files:
src/external/apache2/llvm: Makefile.inc
src/external/apache2/llvm/lib/libclangAST: Makefile

Log Message:
Use a big hammer and disabling strict aliasing for the tools build or
when using GCC.


To generate a diff of this commit:
cvs rdiff -u -r1.2 -r1.3 src/external/apache2/llvm/Makefile.inc
cvs rdiff -u -r1.2 -r1.3 src/external/apache2/llvm/lib/libclangAST/Makefile

Please note that diffs are not public domain; they are subject to the
copyright notices on the relevant files.

Modified files:

Index: src/external/apache2/llvm/Makefile.inc
diff -u src/external/apache2/llvm/Makefile.inc:1.2 src/external/apache2/llvm/Makefile.inc:1.3
--- src/external/apache2/llvm/Makefile.inc:1.2	Thu Nov 14 13:16:35 2019
+++ src/external/apache2/llvm/Makefile.inc	Mon Nov 18 19:54:23 2019
@@ -1,4 +1,4 @@
-#	$NetBSD: Makefile.inc,v 1.2 2019/11/14 13:16:35 martin Exp $
+#	$NetBSD: Makefile.inc,v 1.3 2019/11/18 19:54:23 joerg Exp $
 
 .if !defined(LLVM_TOPLEVEL_MK)
 LLVM_TOPLEVEL_MK=
@@ -28,7 +28,7 @@ CLANG_INCLUDE_CONFIG=	${LLVM_TOOLCONF_OB
 LLVM_INCLUDE_OBJDIR!=	cd ${NETBSDSRCDIR}/tools/llvm-include && ${PRINTOBJDIR}
 LLVM_TOOLCONF_OBJDIR!=	cd ${NETBSDSRCDIR}/tools/llvm && ${PRINTOBJDIR}
 HOST_CPPFLAGS+=	${CPPFLAGS}
-HOST_CXXFLAGS+=	-O2 -fno-rtti -fno-exceptions
+HOST_CXXFLAGS+=	-O2 -fno-rtti -fno-exceptions 
 HOST_CPPFLAGS+=	-std=c++14
 LLVM_TARGETS=	x86,powerpc,sparc,aarch64,arm,mips
 .else
@@ -38,7 +38,7 @@ LLVM_INCLUDE_OBJDIR!=	cd ${LLVM_TOPLEVEL
 LLVM_TARGETS=	x86,powerpc,sparc,aarch64,arm,mips,amdgpu
 
 CXXFLAGS+=	-std=c++14
-CXXFLAGS+=	-fno-rtti -fno-exceptions
+CXXFLAGS+=	-fno-rtti -fno-exceptions ${${ACTIVE_CC} == "gcc" :? -fno-strict-aliasing :}
 CXXFLAGS+=	-ffunction-sections -fdata-sections
 LDFLAGS+=	-Wl,--gc-sections
 DPADD+=		${LIBEXECINFO}

Index: src/external/apache2/llvm/lib/libclangAST/Makefile
diff -u src/external/apache2/llvm/lib/libclangAST/Makefile:1.2 src/external/apache2/llvm/lib/libclangAST/Makefile:1.3
--- src/external/apache2/llvm/lib/libclangAST/Makefile:1.2	Sat Nov 16 15:51:26 2019
+++ src/external/apache2/llvm/lib/libclangAST/Makefile	Mon Nov 18 19:54:23 2019
@@ -1,4 +1,4 @@
-#	$NetBSD: Makefile,v 1.2 2019/11/16 15:51:26 joerg Exp $
+#	$NetBSD: Makefile,v 1.3 2019/11/18 19:54:23 joerg Exp $
 
 LIB=	clangAST
 
@@ -112,10 +112,6 @@ CLANG_TABLEGEN_OUTPUT= \
 
 .if defined(HOSTLIB)
 .include 
-BAD_GCC_VERSION!=	case `${HOST_CXX} --version 2> /dev/null` in [cg]++*7.4*) echo yes ;; *) echo no ;; esac
-.  if ${BAD_GCC_VERSION} == "yes"
-HOST_CXXFLAGS+=	-O0
-.  endif
 .else
 .include 
 .endif



CVS commit: src/external/apache2/llvm

2019-11-18 Thread Joerg Sonnenberger
Module Name:src
Committed By:   joerg
Date:   Mon Nov 18 19:54:24 UTC 2019

Modified Files:
src/external/apache2/llvm: Makefile.inc
src/external/apache2/llvm/lib/libclangAST: Makefile

Log Message:
Use a big hammer and disabling strict aliasing for the tools build or
when using GCC.


To generate a diff of this commit:
cvs rdiff -u -r1.2 -r1.3 src/external/apache2/llvm/Makefile.inc
cvs rdiff -u -r1.2 -r1.3 src/external/apache2/llvm/lib/libclangAST/Makefile

Please note that diffs are not public domain; they are subject to the
copyright notices on the relevant files.



CVS commit: src/external/apache2/llvm/lib/libclangAST

2019-11-16 Thread Joerg Sonnenberger
Module Name:src
Committed By:   joerg
Date:   Sat Nov 16 15:51:26 UTC 2019

Modified Files:
src/external/apache2/llvm/lib/libclangAST: Makefile

Log Message:
Build libclangAST with -O1 when the host compiler is GCC 7 to avoid
miscompiles.


To generate a diff of this commit:
cvs rdiff -u -r1.1 -r1.2 src/external/apache2/llvm/lib/libclangAST/Makefile

Please note that diffs are not public domain; they are subject to the
copyright notices on the relevant files.



CVS commit: src/external/apache2/llvm/lib/libclangAST

2019-11-16 Thread Joerg Sonnenberger
Module Name:src
Committed By:   joerg
Date:   Sat Nov 16 15:51:26 UTC 2019

Modified Files:
src/external/apache2/llvm/lib/libclangAST: Makefile

Log Message:
Build libclangAST with -O1 when the host compiler is GCC 7 to avoid
miscompiles.


To generate a diff of this commit:
cvs rdiff -u -r1.1 -r1.2 src/external/apache2/llvm/lib/libclangAST/Makefile

Please note that diffs are not public domain; they are subject to the
copyright notices on the relevant files.

Modified files:

Index: src/external/apache2/llvm/lib/libclangAST/Makefile
diff -u src/external/apache2/llvm/lib/libclangAST/Makefile:1.1 src/external/apache2/llvm/lib/libclangAST/Makefile:1.2
--- src/external/apache2/llvm/lib/libclangAST/Makefile:1.1	Mon Nov 11 22:45:14 2019
+++ src/external/apache2/llvm/lib/libclangAST/Makefile	Sat Nov 16 15:51:26 2019
@@ -1,4 +1,4 @@
-#	$NetBSD: Makefile,v 1.1 2019/11/11 22:45:14 joerg Exp $
+#	$NetBSD: Makefile,v 1.2 2019/11/16 15:51:26 joerg Exp $
 
 LIB=	clangAST
 
@@ -112,6 +112,10 @@ CLANG_TABLEGEN_OUTPUT= \
 
 .if defined(HOSTLIB)
 .include 
+BAD_GCC_VERSION!=	case `${HOST_CXX} --version 2> /dev/null` in [cg]++*7.4*) echo yes ;; *) echo no ;; esac
+.  if ${BAD_GCC_VERSION} == "yes"
+HOST_CXXFLAGS+=	-O0
+.  endif
 .else
 .include 
 .endif



CVS commit: src/external/apache2/llvm

2019-11-14 Thread Martin Husemann
Module Name:src
Committed By:   martin
Date:   Thu Nov 14 13:16:35 UTC 2019

Modified Files:
src/external/apache2/llvm: Makefile.inc

Log Message:
For gcc < 9 disable stringop-overflow warnings - they are broken.


To generate a diff of this commit:
cvs rdiff -u -r1.1 -r1.2 src/external/apache2/llvm/Makefile.inc

Please note that diffs are not public domain; they are subject to the
copyright notices on the relevant files.



CVS commit: src/external/apache2/llvm

2019-11-14 Thread Martin Husemann
Module Name:src
Committed By:   martin
Date:   Thu Nov 14 13:16:35 UTC 2019

Modified Files:
src/external/apache2/llvm: Makefile.inc

Log Message:
For gcc < 9 disable stringop-overflow warnings - they are broken.


To generate a diff of this commit:
cvs rdiff -u -r1.1 -r1.2 src/external/apache2/llvm/Makefile.inc

Please note that diffs are not public domain; they are subject to the
copyright notices on the relevant files.

Modified files:

Index: src/external/apache2/llvm/Makefile.inc
diff -u src/external/apache2/llvm/Makefile.inc:1.1 src/external/apache2/llvm/Makefile.inc:1.2
--- src/external/apache2/llvm/Makefile.inc:1.1	Mon Nov 11 22:44:57 2019
+++ src/external/apache2/llvm/Makefile.inc	Thu Nov 14 13:16:35 2019
@@ -1,4 +1,4 @@
-#	$NetBSD: Makefile.inc,v 1.1 2019/11/11 22:44:57 joerg Exp $
+#	$NetBSD: Makefile.inc,v 1.2 2019/11/14 13:16:35 martin Exp $
 
 .if !defined(LLVM_TOPLEVEL_MK)
 LLVM_TOPLEVEL_MK=
@@ -19,6 +19,9 @@ CONFIG_DIR:=	${.PARSEDIR}/autoconf
 
 CPPFLAGS+=	-I. -I${CLANG_SRCDIR}/include -I${LLVM_SRCDIR}/include
 
+# Bogus warning with -O2 in GCC 7 and 8.
+CWARNFLAGS.gcc+=	${${ACTIVE_CC} == "gcc" && ${HAVE_GCC:U0} < 9:? -Wno-stringop-overflow :}
+
 .if defined(HOSTLIB) || defined(HOSTPROG) || defined(_BSD_HOSTINIT_MK_)
 LLVM_INCLUDE_CONFIG=	${LLVM_TOOLCONF_OBJDIR}/config/include
 CLANG_INCLUDE_CONFIG=	${LLVM_TOOLCONF_OBJDIR}/config/tools/clang/include