Re: lang/go failes to build with poudriere, since 2018-04-05

Wed, 25 Apr 2018 16:33:15 -0700

That happens very rarely, so rarely its been really hard to make any progress debugging it.
If you believe you have reliable reproduction case I'd be very interested in it. 


One thing I noticed when re-reading your original post is that you say 
you tested on 11.1 but then your output mentions HEAD, are you running 
11.1-RELEASE or 11-STABLE, if so what revision?


Also of interest is the hardware and related configuration?

    Regards
    Steve

On 25/04/2018 22:09, Derek (freebsd lists) wrote:

Ah, you'll note: fork/exec implicated here.

Looks like this guy strikes again:
https://github.com/golang/go/issues/15658


It pains me to say but Go on FreeBSD is (and has always been) broken.  
Should be fine if you don't exec.  Something that might help, is 
setting GOMAXPROCS=1.


Derek

On 18-04-25 07:45 AM, Steven Hartland wrote:

Builds fine on 11.1-RELEASE-p6 here:

[00:04:02] Committing packages to repository
[00:04:02] Removing old packages
[00:04:02] Built ports: lang/go

[ports11-1-multiplay] [2018-04-25_11h37m16s] [committing:] Queued: 1 
Built: 1  Failed: 0  Skipped: 0  Ignored: 0  Tobuild: 0   Time: 00:04:01
[00:04:02] Logs: 
/usr/local/poudriere/data/logs/bulk/ports11-1-multiplay/2018-04-25_11h37m16s 


[00:04:02] Cleaning up

svn info
Path: .
Working Copy Root Path: /usr/local/poudriere/ports/multiplay
URL: https://svn.freebsd.org/ports/head
Relative URL: ^/head
Repository Root: https://svn.freebsd.org/ports
Repository UUID: 35697150-7ecd-e111-bb59-0022644237b5
Revision: 468275
Node Kind: directory
Schedule: normal
Last Changed Author: tobik
Last Changed Rev: 468275
Last Changed Date: 2018-04-25 11:08:41 +0000 (Wed, 25 Apr 2018)


     Regards
     Steve

On 25/04/2018 12:07, Bjarne wrote:

I got a job to rebuild all packages every night, but since 
2018-04-05 building  /usr/ports/lang/go is failing.



Apparently 2018-04-05  some major changed was introduced, since 331 
pakackes was rebuilt. Not sure what it was, I saw nothing in UPATING.


Top of logfile:


Building lang/go

build started at Thu Apr  5 03:04:07 UTC 2018
port directory: /usr/ports/lang/go
package name: go-1.10.1,1

building for: FreeBSD freebsd_11-1-HEAD-job-03 11.1-RELEASE-p9 
FreeBSD 11.1-RELEASE-p9 amd64

maintained by: jlaff...@freebsd.org

Makefile ident:      $FreeBSD: head/lang/go/Makefile 466249 
2018-04-02 18:58:11Z jlaffaye $

Poudriere version: 3.2.6
Host OSVERSION: 1101001
Jail OSVERSION: 1101001

actually  build fails both on freebsd 10.3 and 11.1

Running poudriere testport -j freebsd_11-1 -p HEAD -i -o lang/go :



=======================<phase: lib-depends 
>============================
=========================================================================== 


=>> Recording filesystem state for prebuild... done
=======================<phase: configure >============================
===>   go-1.10.1,1 depends on package: go14>=1.4 - found
===>  Configuring for go-1.10.1,1

=========================================================================== 


=======================<phase: build >============================
===>  Building for go-1.10.1,1

cd /wrkdirs/usr/ports/lang/go/work/go/src && 
GOROOT=/wrkdirs/usr/ports/lang/go/work/go GOROOT_FINAL=/usr/local/go 
GOROOT_BOOTSTRAP=/usr/local/go14 GOBIN= GOARCH=amd64 GOOS=freebsd 
GO386=  /bin/sh make.bash

-ap: not found
go: not found
Building Go cmd/dist using /usr/local/go14.
Building Go toolchain1 using /usr/local/go14.
Building Go bootstrap cmd/go (go_bootstrap) using Go toolchain1.
Building Go toolchain2 using go_bootstrap and Go toolchain1.
runtime: gp: gp=0xc420499380, goid=38, gp->atomicstatus=2
runtime:  g:  g=0xc420000c00, goid=0,  g->atomicstatus=0
fatal error: bad g->status in ready

runtime stack:
runtime.throw(0x6f776b, 0x16)
        /usr/local/go/src/runtime/panic.go:616 +0x81
runtime.ready(0xc420499380, 0x5, 0xc420499201)
        /usr/local/go/src/runtime/proc.go:601 +0x27b
runtime.goready.func1()
        /usr/local/go/src/runtime/proc.go:302 +0x38
runtime.systemstack(0x0)
        /usr/local/go/src/runtime/asm_amd64.s:409 +0x79
runtime.mstart()
        /usr/local/go/src/runtime/proc.go:1175

goroutine 37 [running]:
runtime.systemstack_switch()

        /usr/local/go/src/runtime/asm_amd64.s:363 fp=0xc4204a06c0 
sp=0xc4204a06b8 pc=0x450c00

runtime.goready(0xc420499380, 0x5)

        /usr/local/go/src/runtime/proc.go:301 +0x4b fp=0xc4204a06f0 
sp=0xc4204a06c0 pc=0x42a74b

runtime.readyWithTime(0xc4201a4c00, 0x5)

        /usr/local/go/src/runtime/sema.go:83 +0x41 fp=0xc4204a0710 
sp=0xc4204a06f0 pc=0x43a071

runtime.semrelease1(0x8885e4, 0x0)

        /usr/local/go/src/runtime/sema.go:194 +0x12d fp=0xc4204a0768 
sp=0xc4204a0710 pc=0x43a54d

sync.runtime_Semrelease(0x8885e4, 0xc4204a0700)

        /usr/local/go/src/runtime/sema.go:66 +0x34 fp=0xc4204a0788 
sp=0xc4204a0768 pc=0x439f84

sync.(*Mutex).Unlock(0x8885e0)

        /usr/local/go/src/sync/mutex.go:201 +0x75 fp=0xc4204a07b0 
sp=0xc4204a0788 pc=0x4674d5

sync.(*RWMutex).Unlock(0x8885e0)

        /usr/local/go/src/sync/rwmutex.go:132 +0x7e fp=0xc4204a07e0 
sp=0xc4204a07b0 pc=0x46824e
syscall.forkExec(0xc4202f0440, 0x3d, 0xc4202aa1e0, 0x2, 0x2, 
0xc4204a09d8, 0x20, 0x0, 0xc4200aa5a0)
        /usr/local/go/src/syscall/exec_unix.go:199 +0x3e1 
fp=0xc4204a0900 sp=0xc4204a07e0 pc=0x46c031
syscall.StartProcess(0xc4202f0440, 0x3d, 0xc4202aa1e0, 0x2, 0x2, 
0xc4204a09d8, 0x2, 0x4, 0x0, 0x0)
        /usr/local/go/src/syscall/exec_unix.go:241 +0x64 
fp=0xc4204a0958 sp=0xc4204a0900 pc=0x46c484
os.startProcess(0xc4202f0440, 0x3d, 0xc4202aa1e0, 0x2, 0x2, 
0xc4204a0b80, 0xc420403400, 0x3e, 0x3e)
        /usr/local/go/src/os/exec_posix.go:46 +0x1f1 fp=0xc4204a0a30 
sp=0xc4204a0958 pc=0x48ce21
os.StartProcess(0xc4202f0440, 0x3d, 0xc4202aa1e0, 0x2, 0x2, 
0xc4204a0b80, 0x0, 0x0, 0x1)
        /usr/local/go/src/os/exec.go:102 +0x7c fp=0xc4204a0a88 
sp=0xc4204a0a30 pc=0x48c93c

os/exec.(*Cmd).Start(0xc4201809a0, 0x6f0801, 0xc4200f21c0)

        /usr/local/go/src/os/exec/exec.go:379 +0x4e6 fp=0xc4204a0bd8 
sp=0xc4204a0a88 pc=0x4e2466

os/exec.(*Cmd).Run(0xc4201809a0, 0xc4200f21c0, 0xc420402c00)

        /usr/local/go/src/os/exec/exec.go:302 +0x2b fp=0xc4204a0c00 
sp=0xc4204a0bd8 pc=0x4e1f1b
cmd/go/internal/work.(*Builder).toolID(0xc420120e60, 0x6f04de, 0x3, 
0x11, 0xc4204a12f0)
        /usr/local/go/src/cmd/go/internal/work/buildid.go:183 +0x321 
fp=0xc4204a0db0 sp=0xc4204a0c00 pc=0x5de0a1
cmd/go/internal/work.(*Builder).buildActionID(0xc420120e60, 
0xc4201f63c0, 0x0, 0x0, 0x0, 0x0)
        /usr/local/go/src/cmd/go/internal/work/exec.go:221 +0x16e5 
fp=0xc4204a14c0 sp=0xc4204a0db0 pc=0x5e3d95
cmd/go/internal/work.(*Builder).build(0xc420120e60, 0xc4201f63c0, 
0x0, 0x0)
        /usr/local/go/src/cmd/go/internal/work/exec.go:304 +0xb0 
fp=0xc4204a1e70 sp=0xc4204a14c0 pc=0x5e4790

cmd/go/internal/work.(*Builder).Do.func1(0xc4201f63c0)

        /usr/local/go/src/cmd/go/internal/work/exec.go:106 +0x72 
fp=0xc4204a1ef8 sp=0xc4204a1e70 pc=0x611ef2
cmd/go/internal/work.(*Builder).Do.func2(0xc420172090, 0xc420120e60, 
0xc420188ea0)
        /usr/local/go/src/cmd/go/internal/work/exec.go:164 +0xbb 
fp=0xc4204a1fc8 sp=0xc4204a1ef8 pc=0x6121db

runtime.goexit()

        /usr/local/go/src/runtime/asm_amd64.s:2361 +0x1 
fp=0xc4204a1fd0 sp=0xc4204a1fc8 pc=0x4535f1

created by cmd/go/internal/work.(*Builder).Do
        /usr/local/go/src/cmd/go/internal/work/exec.go:151 +0x38c

goroutine 1 [semacquire]:
sync.runtime_Semacquire(0xc42017209c)
        /usr/local/go/src/runtime/sema.go:56 +0x39
sync.(*WaitGroup).Wait(0xc420172090)
        /usr/local/go/src/sync/waitgroup.go:129 +0x72
cmd/go/internal/work.(*Builder).Do(0xc420120e60, 0xc420296f00)
        /usr/local/go/src/cmd/go/internal/work/exec.go:173 +0x3b0
cmd/go/internal/work.InstallPackages(0xc42008c050, 0x4, 0x4, 0x0)
        /usr/local/go/src/cmd/go/internal/work/build.go:482 +0xb25
cmd/go/internal/work.runInstall(0x864dc0, 0xc42008c050, 0x4, 0x4)
        /usr/local/go/src/cmd/go/internal/work/build.go:413 +0x49
main.main()
        /usr/local/go/src/cmd/go/main.go:140 +0x7e1

goroutine 19 [syscall]:
os/signal.signal_recv(0x0)
        /usr/local/go/src/runtime/sigqueue.go:139 +0xa6
os/signal.loop()
        /usr/local/go/src/os/signal/signal_unix.go:22 +0x22
created by os/signal.init.0
        /usr/local/go/src/os/signal/signal_unix.go:28 +0x41

goroutine 35 [syscall]:

syscall.Syscall6(0x214, 0x0, 0x4350, 0x0, 0x18, 0x0, 0x0, 
0xc4202aebc8, 0x4e255f, 0x10)

        /usr/local/go/src/syscall/asm_unix_amd64.s:42 +0x5
os.(*Process).blockUntilWaitable(0xc4202a8120, 0x0, 0x0, 0x2)
        /usr/local/go/src/os/wait_wait6.go:29 +0x5e

os.(*Process).wait(0xc4202a8120, 0xc420266020, 0xc4204b80d8, 
0xc4204b80d8)

        /usr/local/go/src/os/exec_unix.go:22 +0x3c
os.(*Process).Wait(0xc4202a8120, 0x713e38, 0x713e40, 0x713e30)
        /usr/local/go/src/os/exec.go:123 +0x2b
os/exec.(*Cmd).Wait(0xc4204b8000, 0x0, 0x0)
        /usr/local/go/src/os/exec/exec.go:461 +0x5c
os/exec.(*Cmd).Run(0xc4204b8000, 0xc4200fa0e0, 0xc4204ec000)
        /usr/local/go/src/os/exec/exec.go:305 +0x5c

cmd/go/internal/work.(*Builder).toolID(0xc420120e60, 0x6f19bc, 0x7, 
0x2c, 0xc4202af380)

        /usr/local/go/src/cmd/go/internal/work/buildid.go:183 +0x321

cmd/go/internal/work.(*Builder).buildActionID(0xc420120e60, 
0xc420111cc0, 0x0, 0x0, 0x0, 0x0)

        /usr/local/go/src/cmd/go/internal/work/exec.go:219 +0xf69

cmd/go/internal/work.(*Builder).build(0xc420120e60, 0xc420111cc0, 
0x0, 0x0)

        /usr/local/go/src/cmd/go/internal/work/exec.go:304 +0xb0
cmd/go/internal/work.(*Builder).Do.func1(0xc420111cc0)
        /usr/local/go/src/cmd/go/internal/work/exec.go:106 +0x72

cmd/go/internal/work.(*Builder).Do.func2(0xc420172090, 0xc420120e60, 
0xc420188ea0)

        /usr/local/go/src/cmd/go/internal/work/exec.go:164 +0xbb
created by cmd/go/internal/work.(*Builder).Do
        /usr/local/go/src/cmd/go/internal/work/exec.go:151 +0x38c

goroutine 36 [semacquire]:
sync.runtime_SemacquireMutex(0x8885e4, 0x0)
        /usr/local/go/src/runtime/sema.go:71 +0x3d
sync.(*Mutex).Lock(0x8885e0)
        /usr/local/go/src/sync/mutex.go:134 +0x108
sync.(*RWMutex).Lock(0x8885e0)
        /usr/local/go/src/sync/rwmutex.go:93 +0x2d

syscall.forkExec(0xc4202ea680, 0x3d, 0xc4202661c0, 0x2, 0x2, 
0xc4202b29d8, 0x20, 0x0, 0xc4202b6540)

        /usr/local/go/src/syscall/exec_unix.go:186 +0x253

syscall.StartProcess(0xc4202ea680, 0x3d, 0xc4202661c0, 0x2, 0x2, 
0xc4202b29d8, 0x2, 0x4, 0x0, 0x0)

        /usr/local/go/src/syscall/exec_unix.go:241 +0x64

os.startProcess(0xc4202ea680, 0x3d, 0xc4202661c0, 0x2, 0x2, 
0xc4202b2b80, 0xc4204ed400, 0x3e, 0x3e)

        /usr/local/go/src/os/exec_posix.go:46 +0x1f1

os.StartProcess(0xc4202ea680, 0x3d, 0xc4202661c0, 0x2, 0x2, 
0xc4202b2b80, 0x0, 0x0, 0x1)

        /usr/local/go/src/os/exec.go:102 +0x7c
os/exec.(*Cmd).Start(0xc4204b8160, 0x6f0801, 0xc4200fa1c0)
        /usr/local/go/src/os/exec/exec.go:379 +0x4e6
os/exec.(*Cmd).Run(0xc4204b8160, 0xc4200fa1c0, 0xc4204ecc00)
        /usr/local/go/src/os/exec/exec.go:302 +0x2b

cmd/go/internal/work.(*Builder).toolID(0xc420120e60, 0x6f04de, 0x3, 
0x11, 0xc4202b32f0)

        /usr/local/go/src/cmd/go/internal/work/buildid.go:183 +0x321

cmd/go/internal/work.(*Builder).buildActionID(0xc420120e60, 
0xc420110f00, 0x0, 0x0, 0x0, 0x0)

        /usr/local/go/src/cmd/go/internal/work/exec.go:221 +0x16e5

cmd/go/internal/work.(*Builder).build(0xc420120e60, 0xc420110f00, 
0x0, 0x0)

        /usr/local/go/src/cmd/go/internal/work/exec.go:304 +0xb0
cmd/go/internal/work.(*Builder).Do.func1(0xc420110f00)
        /usr/local/go/src/cmd/go/internal/work/exec.go:106 +0x72

cmd/go/internal/work.(*Builder).Do.func2(0xc420172090, 0xc420120e60, 
0xc420188ea0)

        /usr/local/go/src/cmd/go/internal/work/exec.go:164 +0xbb
created by cmd/go/internal/work.(*Builder).Do
        /usr/local/go/src/cmd/go/internal/work/exec.go:151 +0x38c

goroutine 38 [running]:
        goroutine running on other thread; stack unavailable
created by cmd/go/internal/work.(*Builder).Do
        /usr/local/go/src/cmd/go/internal/work/exec.go:151 +0x38c

goroutine 21 [IO wait]:
internal/poll.runtime_pollWait(0x800a60650, 0x72, 0xc420468ce8)
        /usr/local/go/src/runtime/netpoll.go:173 +0x57

internal/poll.(*pollDesc).wait(0xc4202921a8, 0x72, 
0xffffffffffffff01, 0x7395e0, 0x84d2a8)

        /usr/local/go/src/internal/poll/fd_poll_runtime.go:85 +0x9b

internal/poll.(*pollDesc).waitRead(0xc4202921a8, 0xc4203b9201, 
0x200, 0x200)

        /usr/local/go/src/internal/poll/fd_poll_runtime.go:90 +0x3d

internal/poll.(*FD).Read(0xc420292190, 0xc4203b9200, 0x200, 0x200, 
0x0, 0x0, 0x0)

        /usr/local/go/src/internal/poll/fd_unix.go:157 +0x17d

os.(*File).read(0xc42000c028, 0xc4203b9200, 0x200, 0x200, 
0xc4203b9200, 0x0, 0x0)

        /usr/local/go/src/os/file_unix.go:226 +0x4e

os.(*File).Read(0xc42000c028, 0xc4203b9200, 0x200, 0x200, 0x0, 
0xc420468e78, 0xc420468e60)

        /usr/local/go/src/os/file.go:107 +0x6a

bytes.(*Buffer).ReadFrom(0xc4200fa000, 0x7391c0, 0xc42000c028, 
0x800aad458, 0xc4200fa000, 0xc420110f01)

        /usr/local/go/src/bytes/buffer.go:205 +0xa0

io.copyBuffer(0x738ce0, 0xc4200fa000, 0x7391c0, 0xc42000c028, 0x0, 
0x0, 0x0, 0x100000000000000, 0xc420110f00, 0xc4200e2580)

        /usr/local/go/src/io/io.go:386 +0x31a

io.Copy(0x738ce0, 0xc4200fa000, 0x7391c0, 0xc42000c028, 0x612251, 
0x1, 0xc420468f1f)

        /usr/local/go/src/io/io.go:362 +0x5a
os/exec.(*Cmd).writerDescriptor.func1(0x0, 0x0)
        /usr/local/go/src/os/exec/exec.go:275 +0x4d
os/exec.(*Cmd).Start.func1(0xc4204b8000, 0xc420266080)
        /usr/local/go/src/os/exec/exec.go:396 +0x27
created by os/exec.(*Cmd).Start
        /usr/local/go/src/os/exec/exec.go:395 +0x5df

goroutine 22 [IO wait]:
internal/poll.runtime_pollWait(0x800a60240, 0x72, 0xc4204da4e8)
        /usr/local/go/src/runtime/netpoll.go:173 +0x57

internal/poll.(*pollDesc).wait(0xc420292248, 0x72, 
0xffffffffffffff01, 0x7395e0, 0x84d2a8)

        /usr/local/go/src/internal/poll/fd_poll_runtime.go:85 +0x9b

internal/poll.(*pollDesc).waitRead(0xc420292248, 0xc4203b9401, 
0x200, 0x200)

        /usr/local/go/src/internal/poll/fd_poll_runtime.go:90 +0x3d

internal/poll.(*FD).Read(0xc420292230, 0xc4203b9400, 0x200, 0x200, 
0x0, 0x0, 0x0)

        /usr/local/go/src/internal/poll/fd_unix.go:157 +0x17d

os.(*File).read(0xc42000c070, 0xc4203b9400, 0x200, 0x200, 
0xc4203b9400, 0x0, 0x0)

        /usr/local/go/src/os/file_unix.go:226 +0x4e

os.(*File).Read(0xc42000c070, 0xc4203b9400, 0x200, 0x200, 
0x6f66206465696669, 0x6f66202f2f0a6d72, 0xc4204da660)

        /usr/local/go/src/os/file.go:107 +0x6a

bytes.(*Buffer).ReadFrom(0xc4200fa0e0, 0x7391c0, 0xc42000c070, 
0x800aad458, 0xc4200fa0e0, 0x726f206874697701)

        /usr/local/go/src/bytes/buffer.go:205 +0xa0

io.copyBuffer(0x738ce0, 0xc4200fa0e0, 0x7391c0, 0xc42000c070, 0x0, 
0x0, 0x0, 0x0, 0x0, 0x0)

        /usr/local/go/src/io/io.go:386 +0x31a
io.Copy(0x738ce0, 0xc4200fa0e0, 0x7391c0, 0xc42000c070, 0x0, 0x0, 0x0)
        /usr/local/go/src/io/io.go:362 +0x5a
os/exec.(*Cmd).writerDescriptor.func1(0x0, 0x0)
        /usr/local/go/src/os/exec/exec.go:275 +0x4d
os/exec.(*Cmd).Start.func1(0xc4204b8000, 0xc4202660c0)
        /usr/local/go/src/os/exec/exec.go:396 +0x27
created by os/exec.(*Cmd).Start
        /usr/local/go/src/os/exec/exec.go:395 +0x5df

go tool dist: FAILED: 
/wrkdirs/usr/ports/lang/go/work/go/pkg/tool/freebsd_amd64/go_bootstrap 
install -gcflags=all= -ldflags=all= -i cmd/asm cmd/cgo cmd/compile 
cmd/link: exit status 2

*** Error code 2

Stop.
make: stopped in /usr/ports/lang/go

=======================<phase: Interactive 
>============================

[00:00:26] Installing packages
[00:00:26] Installing run-depends for lang/go | go-1.10.1,1
[00:00:26] Installing lang/go | go-1.10.1,1
pkg-static: /tmp/pkgs/go-1.10.1,1.txz: No such file or directory
pkg-static: Was 'pkg install /tmp/pkgs/go-1.10.1,1.txz' meant?

Failed to install the following 1 package(s): /tmp/pkgs/go-1.10.1,1.txz
*** Error code 70

Stop.
make: stopped in /usr/ports/lang/go
[00:00:26] Warning: Failed to install lang/go | go-1.10.1,1
[00:00:26] Installing local Pkg repository to /usr/local/etc/pkg/repos
[00:00:26] Entering interactive test mode. Type 'exit' when done.
FreeBSD ?.?.?  (UNKNOWN)







_______________________________________________
freebsd-ports@freebsd.org mailing list
https://lists.freebsd.org/mailman/listinfo/freebsd-ports
To unsubscribe, send any mail to "freebsd-ports-unsubscr...@freebsd.org"





_______________________________________________
freebsd-ports@freebsd.org mailing list
https://lists.freebsd.org/mailman/listinfo/freebsd-ports
To unsubscribe, send any mail to "freebsd-ports-unsubscr...@freebsd.org"






















					Reply via email to