Thanks, I'm monitoring build pods until someone goes stuck.
Will back with trace ASAP.

--
Mateus Caruccio / Master of Puppets
GetupCloud.com - Eliminamos a Gravidade

On Thu, Feb 9, 2017 at 12:50 PM, Clayton Coleman <ccole...@redhat.com>
wrote:

> In order to get an accurate dump you'll want to sigquit the process from a
> privileged user (cluster admin can rsh into the stick pod and kill -SIGQUIT
> 1, or find the process from the node and do similar on the right pid).
> That should dump the full stack to the main container logs, which will have
> more context.  Gdb doesn't do a great job of showing the full stack.
>
> On Feb 9, 2017, at 7:57 AM, Mateus Caruccio <mateus.caruccio@getupcloud.
> com> wrote:
>
> Sorry, forgot that:
>
> openshift/origin-sti-builder:v1.3.1
>
> --
> Mateus Caruccio / Master of Puppets
> GetupCloud.com - Eliminamos a Gravidade
>
> On Thu, Feb 9, 2017 at 10:44 AM, Cesar Wong <cew...@redhat.com> wrote:
>
>> Hi Mateus,
>>
>> What is the version of the builder image?
>>
>> On Feb 9, 2017, at 6:32 AM, Mateus Caruccio <
>> mateus.caruc...@getupcloud.com> wrote:
>>
>> Hi. I'm seen from time to time (more than once in a week) builder images
>> stuck, doing nothing and lasting forever.
>>
>> Entering the container I can see /usr/bin/openshift-sti-build is up, but
>> not running.
>>
>>
>> Here are some clues:
>>
>> *$ oc logs pods/web-22-build -n **********
>>
>> Pulling image "getupcloud/sti-php-extra:melissa" ...
>> Pulling image "getupcloud/sti-php-extra:melissa" ...
>> Cloning "https://github.com/transainc/grendene-melissa-site.git"; ...
>> Commit: f97792dbf727b254e55edbedfd530d4fea674f30 (Merge branch 'dev')
>> Author: Renan <re...@transainc.com>
>> Date: Wed Feb 8 18:01:40 2017 -0200
>> Pulling image "172.30.34.145:5000/melissaprod/web:latest" ...
>> WARNING: Clean build will be performed because of error saving previous
>> build artifacts
>>
>>
>> *$ sudo docker exec -it
>> k8s_sti-build.22823935_web-22-build_********_a4904f03-ee39-11e6-8bca-000d3ac04b9b_d337fdb8
>> ps fax*
>>
>>    PID TTY      STAT   TIME COMMAND
>>    121 ?        Rs+    0:00 ps fax
>>      1 ?        Ssl    0:10 /usr/bin/openshift-sti-build --loglevel=0
>>
>>
>> *$ sudo strace -p 14154*
>>
>> Process 14154 attached
>> futex(0x855aac8, FUTEX_WAIT, 0, NULL^CProcess 14154 detached
>>  <detached ...>
>>
>> *$ sudo gdb -p 14154*
>>
>> GNU gdb (GDB) Red Hat Enterprise Linux 7.6.1-80.el7
>> Copyright (C) 2013 Free Software Foundation, Inc.
>> License GPLv3+: GNU GPL version 3 or later <http://gnu.org/licenses/gpl.h
>> tml>
>> This is free software: you are free to change and redistribute it.
>> There is NO WARRANTY, to the extent permitted by law.  Type "show copying"
>> and "show warranty" for details.
>> This GDB was configured as "x86_64-redhat-linux-gnu".
>> For bug reporting instructions, please see:
>> <http://www.gnu.org/software/gdb/bugs/>.
>> Attaching to process 14154
>> Reading symbols from /usr/bin/openshift...done.
>> Reading symbols from /lib64/ld-linux-x86-64.so.2...Reading symbols from
>> /usr/lib/debug/usr/lib64/ld-2.17.so.debug...done.
>> done.
>> Loaded symbols for /lib64/ld-linux-x86-64.so.2
>> runtime.futex () at /usr/lib/golang/src/runtime/sys_linux_amd64.s:307
>> 307 /usr/lib/golang/src/runtime/sys_linux_amd64.s: Arquivo ou diretório
>> não encontrado.
>> warning: Missing auto-load scripts referenced in section
>> .debug_gdb_scripts
>> of file /usr/bin/openshift
>> Use `info auto-load python [REGEXP]' to list them.
>> (gdb) bt
>> #0  runtime.futex () at /usr/lib/golang/src/runtime/sys_linux_amd64.s:307
>> #1  0x000000000042d603 in runtime.futexsleep (addr=0x855aac8
>> <runtime.mheap_+2312>, val=0, ns=-1) at /usr/lib/golang/src/runtime/os
>> 1_linux.go:40
>> #2  0x0000000000411de4 in runtime.notesleep (n=0x855aac8
>> <runtime.mheap_+2312>) at /usr/lib/golang/src/runtime/lock_futex.go:145
>> #3  0x0000000000435bbb in runtime.stopm () at
>> /usr/lib/golang/src/runtime/proc.go:1538
>> #4  0x0000000000436f49 in runtime.findrunnable (gp=0x41ccb6
>> <runtime.gcMarkWorkAvailable+118>, inheritTime=false) at
>> /usr/lib/golang/src/runtime/proc.go:1976
>> #5  0x00000000004375cf in runtime.schedule () at
>> /usr/lib/golang/src/runtime/proc.go:2075
>> #6  0x000000000043786b in runtime.park_m (gp=0xc820001380) at
>> /usr/lib/golang/src/runtime/proc.go:2140
>> #7  0x0000000000460a3b in runtime.mcall () at
>> /usr/lib/golang/src/runtime/asm_amd64.s:233
>> #8  0x000000000855a000 in github.com/openshift/origin/ve
>> ndor/github.com/ugorji/go/codec.fastpathAV ()
>> #9  0x00007fffbf823e00 in ?? ()
>> #10 0x000000000855a080 in github.com/openshift/origin/ve
>> ndor/github.com/ugorji/go/codec.fastpathAV ()
>> #11 0x0000000000434aa2 in runtime.mstart () at
>> /usr/lib/golang/src/runtime/proc.go:1068
>> #12 0x00000000004608d8 in runtime.rt0_go () at
>> /usr/lib/golang/src/runtime/asm_amd64.s:149
>> #13 0x0000000000000002 in ?? ()
>> #14 0x00007fffbf823f18 in ?? ()
>> #15 0x0000000000000002 in ?? ()
>> #16 0x00007fffbf823f18 in ?? ()
>> #17 0x0000000000000000 in ?? ()
>> (gdb)
>>
>>
>>
>> --
>> Mateus Caruccio / Master of Puppets
>> GetupCloud.com - Eliminamos a Gravidade
>> _______________________________________________
>> dev mailing list
>> dev@lists.openshift.redhat.com
>> http://lists.openshift.redhat.com/openshiftmm/listinfo/dev
>>
>>
>>
> _______________________________________________
> dev mailing list
> dev@lists.openshift.redhat.com
> http://lists.openshift.redhat.com/openshiftmm/listinfo/dev
>
>
_______________________________________________
dev mailing list
dev@lists.openshift.redhat.com
http://lists.openshift.redhat.com/openshiftmm/listinfo/dev

Reply via email to