Thanks, I'm monitoring build pods until someone goes stuck. Will back with trace ASAP.
-- Mateus Caruccio / Master of Puppets GetupCloud.com - Eliminamos a Gravidade On Thu, Feb 9, 2017 at 12:50 PM, Clayton Coleman <ccole...@redhat.com> wrote: > In order to get an accurate dump you'll want to sigquit the process from a > privileged user (cluster admin can rsh into the stick pod and kill -SIGQUIT > 1, or find the process from the node and do similar on the right pid). > That should dump the full stack to the main container logs, which will have > more context. Gdb doesn't do a great job of showing the full stack. > > On Feb 9, 2017, at 7:57 AM, Mateus Caruccio <mateus.caruccio@getupcloud. > com> wrote: > > Sorry, forgot that: > > openshift/origin-sti-builder:v1.3.1 > > -- > Mateus Caruccio / Master of Puppets > GetupCloud.com - Eliminamos a Gravidade > > On Thu, Feb 9, 2017 at 10:44 AM, Cesar Wong <cew...@redhat.com> wrote: > >> Hi Mateus, >> >> What is the version of the builder image? >> >> On Feb 9, 2017, at 6:32 AM, Mateus Caruccio < >> mateus.caruc...@getupcloud.com> wrote: >> >> Hi. I'm seen from time to time (more than once in a week) builder images >> stuck, doing nothing and lasting forever. >> >> Entering the container I can see /usr/bin/openshift-sti-build is up, but >> not running. >> >> >> Here are some clues: >> >> *$ oc logs pods/web-22-build -n ********** >> >> Pulling image "getupcloud/sti-php-extra:melissa" ... >> Pulling image "getupcloud/sti-php-extra:melissa" ... >> Cloning "https://github.com/transainc/grendene-melissa-site.git"; ... >> Commit: f97792dbf727b254e55edbedfd530d4fea674f30 (Merge branch 'dev') >> Author: Renan <re...@transainc.com> >> Date: Wed Feb 8 18:01:40 2017 -0200 >> Pulling image "172.30.34.145:5000/melissaprod/web:latest" ... >> WARNING: Clean build will be performed because of error saving previous >> build artifacts >> >> >> *$ sudo docker exec -it >> k8s_sti-build.22823935_web-22-build_********_a4904f03-ee39-11e6-8bca-000d3ac04b9b_d337fdb8 >> ps fax* >> >> PID TTY STAT TIME COMMAND >> 121 ? Rs+ 0:00 ps fax >> 1 ? Ssl 0:10 /usr/bin/openshift-sti-build --loglevel=0 >> >> >> *$ sudo strace -p 14154* >> >> Process 14154 attached >> futex(0x855aac8, FUTEX_WAIT, 0, NULL^CProcess 14154 detached >> <detached ...> >> >> *$ sudo gdb -p 14154* >> >> GNU gdb (GDB) Red Hat Enterprise Linux 7.6.1-80.el7 >> Copyright (C) 2013 Free Software Foundation, Inc. >> License GPLv3+: GNU GPL version 3 or later <http://gnu.org/licenses/gpl.h >> tml> >> This is free software: you are free to change and redistribute it. >> There is NO WARRANTY, to the extent permitted by law. Type "show copying" >> and "show warranty" for details. >> This GDB was configured as "x86_64-redhat-linux-gnu". >> For bug reporting instructions, please see: >> <http://www.gnu.org/software/gdb/bugs/>. >> Attaching to process 14154 >> Reading symbols from /usr/bin/openshift...done. >> Reading symbols from /lib64/ld-linux-x86-64.so.2...Reading symbols from >> /usr/lib/debug/usr/lib64/ld-2.17.so.debug...done. >> done. >> Loaded symbols for /lib64/ld-linux-x86-64.so.2 >> runtime.futex () at /usr/lib/golang/src/runtime/sys_linux_amd64.s:307 >> 307 /usr/lib/golang/src/runtime/sys_linux_amd64.s: Arquivo ou diretório >> não encontrado. >> warning: Missing auto-load scripts referenced in section >> .debug_gdb_scripts >> of file /usr/bin/openshift >> Use `info auto-load python [REGEXP]' to list them. >> (gdb) bt >> #0 runtime.futex () at /usr/lib/golang/src/runtime/sys_linux_amd64.s:307 >> #1 0x000000000042d603 in runtime.futexsleep (addr=0x855aac8 >> <runtime.mheap_+2312>, val=0, ns=-1) at /usr/lib/golang/src/runtime/os >> 1_linux.go:40 >> #2 0x0000000000411de4 in runtime.notesleep (n=0x855aac8 >> <runtime.mheap_+2312>) at /usr/lib/golang/src/runtime/lock_futex.go:145 >> #3 0x0000000000435bbb in runtime.stopm () at >> /usr/lib/golang/src/runtime/proc.go:1538 >> #4 0x0000000000436f49 in runtime.findrunnable (gp=0x41ccb6 >> <runtime.gcMarkWorkAvailable+118>, inheritTime=false) at >> /usr/lib/golang/src/runtime/proc.go:1976 >> #5 0x00000000004375cf in runtime.schedule () at >> /usr/lib/golang/src/runtime/proc.go:2075 >> #6 0x000000000043786b in runtime.park_m (gp=0xc820001380) at >> /usr/lib/golang/src/runtime/proc.go:2140 >> #7 0x0000000000460a3b in runtime.mcall () at >> /usr/lib/golang/src/runtime/asm_amd64.s:233 >> #8 0x000000000855a000 in github.com/openshift/origin/ve >> ndor/github.com/ugorji/go/codec.fastpathAV () >> #9 0x00007fffbf823e00 in ?? () >> #10 0x000000000855a080 in github.com/openshift/origin/ve >> ndor/github.com/ugorji/go/codec.fastpathAV () >> #11 0x0000000000434aa2 in runtime.mstart () at >> /usr/lib/golang/src/runtime/proc.go:1068 >> #12 0x00000000004608d8 in runtime.rt0_go () at >> /usr/lib/golang/src/runtime/asm_amd64.s:149 >> #13 0x0000000000000002 in ?? () >> #14 0x00007fffbf823f18 in ?? () >> #15 0x0000000000000002 in ?? () >> #16 0x00007fffbf823f18 in ?? () >> #17 0x0000000000000000 in ?? () >> (gdb) >> >> >> >> -- >> Mateus Caruccio / Master of Puppets >> GetupCloud.com - Eliminamos a Gravidade >> _______________________________________________ >> dev mailing list >> dev@lists.openshift.redhat.com >> http://lists.openshift.redhat.com/openshiftmm/listinfo/dev >> >> >> > _______________________________________________ > dev mailing list > dev@lists.openshift.redhat.com > http://lists.openshift.redhat.com/openshiftmm/listinfo/dev > >
_______________________________________________ dev mailing list dev@lists.openshift.redhat.com http://lists.openshift.redhat.com/openshiftmm/listinfo/dev
