[Bug 1318366] Re: provisioning large environments with complex relations caused jujud on bootstrap node to fail

I just hit this on a much smaller deploy: bootstrap with 9 LXC containers and a hulk smashed unit on machine 0 with 4 other physical machines. Note that there have been many, many such deployments with the exact same configuration, but this time it failed with a panic: rescanned document misses

[Bug 1318366] Re: provisioning large environments with complex relations caused jujud on bootstrap node to fail

I just hit this on a much smaller deploy: bootstrap with 9 LXC containers and a hulk smashed unit on machine 0 with 4 other physical machines. Note that there have been many, many such deployments with the exact same configuration, but this time it failed with a panic: rescanned document misses

[Bug 1318366] Re: provisioning large environments with complex relations caused jujud on bootstrap node to fail

** Changed in: juju-core (Ubuntu) Importance: Undecided = High ** Changed in: juju-core (Ubuntu) Status: New = Triaged -- You received this bug notification because you are a member of Ubuntu Server Team, which is subscribed to juju-core in Ubuntu.

[Bug 1318366] Re: provisioning large environments with complex relations caused jujud on bootstrap node to fail

I wonder if this is just saturating the transaction log. The txn log is a capped collection, so it only allows N entries before it starts overwriting earlier ones. I can imagine there are other issues going on, but we might want a knob that lets you say I'm going to be running 1000s things, make

[Bug 1318366] Re: provisioning large environments with complex relations caused jujud on bootstrap node to fail

** Changed in: juju-core (Ubuntu) Importance: Undecided = High ** Changed in: juju-core (Ubuntu) Status: New = Triaged -- You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. https://bugs.launchpad.net/bugs/1318366 Title:

[Bug 1318366] Re: provisioning large environments with complex relations caused jujud on bootstrap node to fail

I wonder if this is just saturating the transaction log. The txn log is a capped collection, so it only allows N entries before it starts overwriting earlier ones. I can imagine there are other issues going on, but we might want a knob that lets you say I'm going to be running 1000s things, make

[Bug 1318366] Re: provisioning large environments with complex relations caused jujud on bootstrap node to fail

** Changed in: juju-core Status: New = Triaged ** Changed in: juju-core Importance: Undecided = High ** Changed in: juju-core Milestone: None = next-stable ** Tags added: panic performance -- You received this bug notification because you are a member of Ubuntu Server Team,

[Bug 1318366] Re: provisioning large environments with complex relations caused jujud on bootstrap node to fail

** Changed in: juju-core Status: New = Triaged ** Changed in: juju-core Importance: Undecided = High ** Changed in: juju-core Milestone: None = next-stable ** Tags added: panic performance -- You received this bug notification because you are a member of Ubuntu Bugs, which is

[Bug 1318366] Re: provisioning large environments with complex relations caused jujud on bootstrap node to fail

** Also affects: juju-core (Ubuntu) Importance: Undecided Status: New ** Attachment added: exploder.yaml https://bugs.launchpad.net/ubuntu/+source/juju-core/+bug/1318366/+attachment/4109911/+files/exploder.yaml -- You received this bug notification because you are a member of

[Bug 1318366] Re: provisioning large environments with complex relations caused jujud on bootstrap node to fail

I had to work round this by bringing up 128 servers to start with and then adding in 64 server chunks; see bug 1317909 for details on how this degrades as environments get large. -- You received this bug notification because you are a member of Ubuntu Server Team, which is subscribed to

[Bug 1318366] Re: provisioning large environments with complex relations caused jujud on bootstrap node to fail

Logfile: http://people.canonical.com/~jamespage/badstuff.log -- You received this bug notification because you are a member of Ubuntu Server Team, which is subscribed to juju-core in Ubuntu. https://bugs.launchpad.net/bugs/1318366 Title: provisioning large environments with complex relations

[Bug 1318366] Re: provisioning large environments with complex relations caused jujud on bootstrap node to fail

** Attachment added: mongod.log https://bugs.launchpad.net/ubuntu/+source/juju-core/+bug/1318366/+attachment/4109916/+files/mongod.log -- You received this bug notification because you are a member of Ubuntu Server Team, which is subscribed to juju-core in Ubuntu.

[Bug 1318366] Re: provisioning large environments with complex relations caused jujud on bootstrap node to fail

Logfile: http://people.canonical.com/~jamespage/badstuff.log -- You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. https://bugs.launchpad.net/bugs/1318366 Title: provisioning large environments with complex relations caused jujud on

[Bug 1318366] Re: provisioning large environments with complex relations caused jujud on bootstrap node to fail

I had to work round this by bringing up 128 servers to start with and then adding in 64 server chunks; see bug 1317909 for details on how this degrades as environments get large. -- You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu.

[Bug 1318366] Re: provisioning large environments with complex relations caused jujud on bootstrap node to fail

** Also affects: juju-core (Ubuntu) Importance: Undecided Status: New ** Attachment added: exploder.yaml https://bugs.launchpad.net/ubuntu/+source/juju-core/+bug/1318366/+attachment/4109911/+files/exploder.yaml -- You received this bug notification because you are a member of

[Bug 1318366] Re: provisioning large environments with complex relations caused jujud on bootstrap node to fail

** Attachment added: mongod.log https://bugs.launchpad.net/ubuntu/+source/juju-core/+bug/1318366/+attachment/4109916/+files/mongod.log -- You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. https://bugs.launchpad.net/bugs/1318366 Title: