Jira (PUP-723) Due to prefetching, Yumrepo clobbers any definition that it does not create
Title: Message Title Eric Delaney updated an issue Puppet / PUP-723 Due to prefetching, Yumrepo clobbers any definition that it does not create Change By: Eric Delaney QA Risk Assessment: Needs Assessment Manual Add Comment This message was sent by Atlassian JIRA (v7.7.1#77002-sha1:e75ca93) -- You received this message because you are subscribed to the Google Groups "Puppet Bugs" group. To unsubscribe from this group and stop receiving emails from it, send an email to puppet-bugs+unsubscr...@googlegroups.com. To post to this group, send email to puppet-bugs@googlegroups.com. Visit this group at https://groups.google.com/group/puppet-bugs. For more options, visit https://groups.google.com/d/optout.
Jira (PUP-723) Due to prefetching, Yumrepo clobbers any definition that it does not create
Title: Message Title
Eric Delaney commented on PUP-723
Re: Due to prefetching, Yumrepo clobbers any definition that it does not create
Tested on SHA=285774ff536eff6031053bdd5ddd74fbdf8b5bf0
[root@in2afewlmeym5o6 ~]# cat t.pp
yumrepo {'puppetlabs-products':
enabled => 1
}
package {'epel-release':
ensure => present,
provider => rpm,
source => 'http://dl.fedoraproject.org/pub/epel/6/x86_64/epel-release-6-8.noarch.rpm',
require => Yumrepo['puppetlabs-products'],
}
# When this synchs, it will nuke /etc/yum.repos.d/epel.repo
yumrepo {'epel':
Jira (PUP-723) Due to prefetching, Yumrepo clobbers any definition that it does not create
Title: Message Title Jennifer Solman updated an issue Puppet / PUP-723 Due to prefetching, Yumrepo clobbers any definition that it does not create Change By: Jennifer Solman Release Notes Summary: Yumrepo was clobbering repo configurations that weren't being managed by a yumrepo resource. Puppet Yumrepo now checks for any yumrepos repo configs it isn't managing before writing out to yumrepo config file. Add Comment This message was sent by Atlassian JIRA (v7.7.1#77002-sha1:e75ca93) -- You received this message because you are subscribed to the Google Groups "Puppet Bugs" group. To unsubscribe from this group and stop receiving emails from it, send an email to puppet-bugs+unsubscr...@googlegroups.com. To post to this group, send email to puppet-bugs@googlegroups.com. Visit this group at https://groups.google.com/group/puppet-bugs. For more options, visit https://groups.google.com/d/optout.
Jira (PUP-723) Due to prefetching, Yumrepo clobbers any definition that it does not create
Title: Message Title Eric Delaney assigned an issue to Eric Delaney Puppet / PUP-723 Due to prefetching, Yumrepo clobbers any definition that it does not create Change By: Eric Delaney Assignee: Jennifer Solman Eric Delaney Add Comment This message was sent by Atlassian JIRA (v7.7.1#77002-sha1:e75ca93) -- You received this message because you are subscribed to the Google Groups "Puppet Bugs" group. To unsubscribe from this group and stop receiving emails from it, send an email to puppet-bugs+unsubscr...@googlegroups.com. To post to this group, send email to puppet-bugs@googlegroups.com. Visit this group at https://groups.google.com/group/puppet-bugs. For more options, visit https://groups.google.com/d/optout.
Jira (PUP-723) Due to prefetching, Yumrepo clobbers any definition that it does not create
Title: Message Title Jennifer Solman updated an issue Puppet / PUP-723 Due to prefetching, Yumrepo clobbers any definition that it does not create Change By: Jennifer Solman QA Risk Assessment Reason: manual verification QA Risk Assessment: Needs Assessment Add Comment This message was sent by Atlassian JIRA (v7.7.1#77002-sha1:e75ca93) -- You received this message because you are subscribed to the Google Groups "Puppet Bugs" group. To unsubscribe from this group and stop receiving emails from it, send an email to puppet-bugs+unsubscr...@googlegroups.com. To post to this group, send email to puppet-bugs@googlegroups.com. Visit this group at https://groups.google.com/group/puppet-bugs. For more options, visit https://groups.google.com/d/optout.
Jira (PUP-723) Due to prefetching, Yumrepo clobbers any definition that it does not create
Title: Message Title Jennifer Solman updated an issue Puppet / PUP-723 Due to prefetching, Yumrepo clobbers any definition that it does not create Change By: Jennifer Solman Release Notes Summary: Yumrepo was clobbering repo configurations that weren't being managed by a yumrepo resource. Puppet now checks for any yumrepos it isn't managing before writing out to yumrepo config file. Release Notes: Bug Fix Add Comment This message was sent by Atlassian JIRA (v7.7.1#77002-sha1:e75ca93) -- You received this message because you are subscribed to the Google Groups "Puppet Bugs" group. To unsubscribe from this group and stop receiving emails from it, send an email to puppet-bugs+unsubscr...@googlegroups.com. To post to this group, send email to puppet-bugs@googlegroups.com. Visit this group at https://groups.google.com/group/puppet-bugs. For more options, visit https://groups.google.com/d/optout.
Jira (PUP-723) Due to prefetching, Yumrepo clobbers any definition that it does not create
Title: Message Title Melissa Stone commented on PUP-723 Re: Due to prefetching, Yumrepo clobbers any definition that it does not create Jennifer Solman can you add release notes, and if this needs manual QA validation or not? Add Comment This message was sent by Atlassian JIRA (v7.7.1#77002-sha1:e75ca93) -- You received this message because you are subscribed to the Google Groups "Puppet Bugs" group. To unsubscribe from this group and stop receiving emails from it, send an email to puppet-bugs+unsubscr...@googlegroups.com. To post to this group, send email to puppet-bugs@googlegroups.com. Visit this group at https://groups.google.com/group/puppet-bugs. For more options, visit https://groups.google.com/d/optout.
Jira (PUP-723) Due to prefetching, Yumrepo clobbers any definition that it does not create
Title: Message Title Melissa Stone commented on PUP-723 Re: Due to prefetching, Yumrepo clobbers any definition that it does not create This has passed ci in puppet-agent 5.4.0.512.g285774f Add Comment This message was sent by Atlassian JIRA (v7.7.1#77002-sha1:e75ca93) -- You received this message because you are subscribed to the Google Groups "Puppet Bugs" group. To unsubscribe from this group and stop receiving emails from it, send an email to puppet-bugs+unsubscr...@googlegroups.com. To post to this group, send email to puppet-bugs@googlegroups.com. Visit this group at https://groups.google.com/group/puppet-bugs. For more options, visit https://groups.google.com/d/optout.
Jira (PUP-723) Due to prefetching, Yumrepo clobbers any definition that it does not create
Title: Message Title Kris Bosland commented on PUP-723 Re: Due to prefetching, Yumrepo clobbers any definition that it does not create Jennifer Solman can you add release notes if needed? Add Comment This message was sent by Atlassian JIRA (v7.7.1#77002-sha1:e75ca93) -- You received this message because you are subscribed to the Google Groups "Puppet Bugs" group. To unsubscribe from this group and stop receiving emails from it, send an email to puppet-bugs+unsubscr...@googlegroups.com. To post to this group, send email to puppet-bugs@googlegroups.com. Visit this group at https://groups.google.com/group/puppet-bugs. For more options, visit https://groups.google.com/d/optout.
Jira (PUP-723) Due to prefetching, Yumrepo clobbers any definition that it does not create
Title: Message Title Kris Bosland commented on PUP-723 Re: Due to prefetching, Yumrepo clobbers any definition that it does not create Merged into 5.5.x at https://github.com/puppetlabs/puppet/commit/672c0caf2966a2acdee96dd15806fc554f2d1c0d Add Comment This message was sent by Atlassian JIRA (v7.7.1#77002-sha1:e75ca93) -- You received this message because you are subscribed to the Google Groups "Puppet Bugs" group. To unsubscribe from this group and stop receiving emails from it, send an email to puppet-bugs+unsubscr...@googlegroups.com. To post to this group, send email to puppet-bugs@googlegroups.com. Visit this group at https://groups.google.com/group/puppet-bugs. For more options, visit https://groups.google.com/d/optout.
Jira (PUP-723) Due to prefetching, Yumrepo clobbers any definition that it does not create
Title: Message Title Jennifer Solman updated an issue Puppet / PUP-723 Due to prefetching, Yumrepo clobbers any definition that it does not create Change By: Jennifer Solman Sprint: Platform Core Hopper KANBAN Add Comment This message was sent by Atlassian JIRA (v7.7.1#77002-sha1:e75ca93) -- You received this message because you are subscribed to the Google Groups "Puppet Bugs" group. To unsubscribe from this group and stop receiving emails from it, send an email to puppet-bugs+unsubscr...@googlegroups.com. To post to this group, send email to puppet-bugs@googlegroups.com. Visit this group at https://groups.google.com/group/puppet-bugs. For more options, visit https://groups.google.com/d/optout.
Jira (PUP-723) Due to prefetching, Yumrepo clobbers any definition that it does not create
Title: Message Title Jennifer Solman assigned an issue to Jennifer Solman Puppet / PUP-723 Due to prefetching, Yumrepo clobbers any definition that it does not create Change By: Jennifer Solman Assignee: Jennifer Solman Add Comment This message was sent by Atlassian JIRA (v7.7.1#77002-sha1:e75ca93) -- You received this message because you are subscribed to the Google Groups "Puppet Bugs" group. To unsubscribe from this group and stop receiving emails from it, send an email to puppet-bugs+unsubscr...@googlegroups.com. To post to this group, send email to puppet-bugs@googlegroups.com. Visit this group at https://groups.google.com/group/puppet-bugs. For more options, visit https://groups.google.com/d/optout.
Jira (PUP-723) Due to prefetching, Yumrepo clobbers any definition that it does not create
Title: Message Title Jacob Helwig updated an issue Puppet / PUP-723 Due to prefetching, Yumrepo clobbers any definition that it does not create Change By: Jacob Helwig Sprint: Platform Core Hopper Add Comment This message was sent by Atlassian JIRA (v7.5.1#75006-sha1:7df2574) -- You received this message because you are subscribed to the Google Groups "Puppet Bugs" group. To unsubscribe from this group and stop receiving emails from it, send an email to puppet-bugs+unsubscr...@googlegroups.com. To post to this group, send email to puppet-bugs@googlegroups.com. Visit this group at https://groups.google.com/group/puppet-bugs. For more options, visit https://groups.google.com/d/optout.
Jira (PUP-723) Due to prefetching, Yumrepo clobbers any definition that it does not create
Title: Message Title Jacob Helwig updated an issue Puppet / PUP-723 Due to prefetching, Yumrepo clobbers any definition that it does not create Change By: Jacob Helwig Fix Version/s: PUP 5.5.0 Add Comment This message was sent by Atlassian JIRA (v7.5.1#75006-sha1:7df2574) -- You received this message because you are subscribed to the Google Groups "Puppet Bugs" group. To unsubscribe from this group and stop receiving emails from it, send an email to puppet-bugs+unsubscr...@googlegroups.com. To post to this group, send email to puppet-bugs@googlegroups.com. Visit this group at https://groups.google.com/group/puppet-bugs. For more options, visit https://groups.google.com/d/optout.
Jira (PUP-723) Due to prefetching, Yumrepo clobbers any definition that it does not create
Title: Message Title Josh Cooper assigned an issue to Unassigned Puppet / PUP-723 Due to prefetching, Yumrepo clobbers any definition that it does not create Change By: Josh Cooper Assignee: Eric Sorenson Add Comment This message was sent by Atlassian JIRA (v7.5.1#75006-sha1:7df2574) -- You received this message because you are subscribed to the Google Groups "Puppet Bugs" group. To unsubscribe from this group and stop receiving emails from it, send an email to puppet-bugs+unsubscr...@googlegroups.com. To post to this group, send email to puppet-bugs@googlegroups.com. Visit this group at https://groups.google.com/group/puppet-bugs. For more options, visit https://groups.google.com/d/optout.
Jira (PUP-723) Due to prefetching, Yumrepo clobbers any definition that it does not create
Title: Message Title Jacob Helwig commented on PUP-723 Re: Due to prefetching, Yumrepo clobbers any definition that it does not create It looks like we need to stat to see if the file already exists on disk at the beginning of create in the provider, and re-fetch from disk to populate self.virtual_inifile if that is the case. Add Comment This message was sent by Atlassian JIRA (v7.5.1#75006-sha1:7df2574) -- You received this message because you are subscribed to the Google Groups "Puppet Bugs" group. To unsubscribe from this group and stop receiving emails from it, send an email to puppet-bugs+unsubscr...@googlegroups.com. To post to this group, send email to puppet-bugs@googlegroups.com. Visit this group at https://groups.google.com/group/puppet-bugs. For more options, visit https://groups.google.com/d/optout.
Jira (PUP-723) Due to prefetching, Yumrepo clobbers any definition that it does not create
Title: Message Title Moses Mendoza updated an issue Puppet / PUP-723 Due to prefetching, Yumrepo clobbers any definition that it does not create Change By: Moses Mendoza Labels: redmine triaged Add Comment This message was sent by Atlassian JIRA (v6.4.14#64029-sha1:ae256fe) -- You received this message because you are subscribed to the Google Groups "Puppet Bugs" group. To unsubscribe from this group and stop receiving emails from it, send an email to puppet-bugs+unsubscr...@googlegroups.com. To post to this group, send email to puppet-bugs@googlegroups.com. Visit this group at https://groups.google.com/group/puppet-bugs. For more options, visit https://groups.google.com/d/optout.
Jira (PUP-723) Due to prefetching, Yumrepo clobbers any definition that it does not create
Title: Message Title Sean McDonald updated an issue Puppet / PUP-723 Due to prefetching, Yumrepo clobbers any definition that it does not create Change By: Sean McDonald Labels: redmine triaged Add Comment This message was sent by Atlassian JIRA (v6.4.14#64029-sha1:ae256fe) -- You received this message because you are subscribed to the Google Groups "Puppet Bugs" group. To unsubscribe from this group and stop receiving emails from it, send an email to puppet-bugs+unsubscr...@googlegroups.com. To post to this group, send email to puppet-bugs@googlegroups.com. Visit this group at https://groups.google.com/group/puppet-bugs. For more options, visit https://groups.google.com/d/optout.
Jira (PUP-723) Due to prefetching, Yumrepo clobbers any definition that it does not create
Title: Message Title Sean McDonald updated an issue Puppet / PUP-723 Due to prefetching, Yumrepo clobbers any definition that it does not create Change By: Sean McDonald Team: Agent Add Comment This message was sent by Atlassian JIRA (v6.4.14#64029-sha1:ae256fe) -- You received this message because you are subscribed to the Google Groups "Puppet Bugs" group. To unsubscribe from this group and stop receiving emails from it, send an email to puppet-bugs+unsubscr...@googlegroups.com. To post to this group, send email to puppet-bugs@googlegroups.com. Visit this group at https://groups.google.com/group/puppet-bugs. For more options, visit https://groups.google.com/d/optout.
Jira (PUP-723) Due to prefetching, Yumrepo clobbers any definition that it does not create
Title: Message Title Josh Cooper commented on PUP-723 Re: Due to prefetching, Yumrepo clobbers any definition that it does not create Still an issue in 4.10.1: [root@wrldi7rk9e5lxja ~]# /opt/puppetlabs/bin/puppet apply manifest.pp Notice: Compiled catalog for wrldi7rk9e5lxja.delivery.puppetlabs.net in environment production in 0.56 seconds Notice: /Stage[main]/Main/Yumrepo[puppetlabs-products]/ensure: created Notice: /Stage[main]/Main/Package[epel-release]/ensure: created Notice: /Stage[main]/Main/Yumrepo[epel]/ensure: created Notice: Applied catalog in 0.62 seconds [root@wrldi7rk9e5lxja ~]# cat /etc/yum.repos.d/epel.repo [epel] enabled=1 failovermethod=priority
Jira (PUP-723) Due to prefetching, Yumrepo clobbers any definition that it does not create
Title: Message Title Eric Sorenson assigned an issue to Eric Sorenson Puppet / PUP-723 Due to prefetching, Yumrepo clobbers any definition that it does not create Change By: Eric Sorenson Assignee: Eric Sorenson Add Comment This message was sent by Atlassian JIRA (v6.4.13#64028-sha1:b7939e9) -- You received this message because you are subscribed to the Google Groups "Puppet Bugs" group. To unsubscribe from this group and stop receiving emails from it, send an email to puppet-bugs+unsubscr...@googlegroups.com. To post to this group, send email to puppet-bugs@googlegroups.com. Visit this group at https://groups.google.com/group/puppet-bugs. For more options, visit https://groups.google.com/d/optout.
Jira (PUP-723) Due to prefetching, Yumrepo clobbers any definition that it does not create
Title: Message Title Jonathan Lynch updated an issue Puppet / PUP-723 Due to prefetching, Yumrepo clobbers any definition that it does not create Change By: Jonathan Lynch Comment: I'm not sure why [https://projects.puppetlabs.com/issues/1843] is marked as a duplicate of this, but augeas doesn't fix that issue. I'm writing this here because it was marked as a duplicate, but if you all think I should put it in a separate issue I will.Puppet seems to cache/prefetch the repository details at the beginning of the puppet run, meaning that I can't install a repository using yumrepo and install a package from that same repository during the same puppet run. The first puppet run, it adds the repository but seems to be working off its prefetched data so the package install fails. The second puppet run updates the yum cache so now the package install succeeds.https://groups.google.com/forum/#!topic/puppet-users/MossJ_4ngQ8I've found a few threads that suggest using a "yum clean metadata" exec to work around this problem, but shouldn't yumrepo just do this on its own?EDIT: After more searching it looks like https://tickets.puppetlabs.com/browse/PUP-4039 more directly addresses my issue... Add Comment This message was sent by Atlassian JIRA (v6.4.13#64028-sha1:b7939e9) -- You received this message because you are subscribed to the Google Groups "Puppet Bugs" group. To unsubscribe from this group and stop receiving emails from it, send an email to puppet-bugs+unsubscr...@googlegroups.com. To post to this group, send email to puppet-bugs@googlegroups.com. Visit this group at https://groups.google.com/group/puppet-bugs. For more options, v
Jira (PUP-723) Due to prefetching, Yumrepo clobbers any definition that it does not create
Title: Message Title Jonathan Lynch commented on PUP-723 Re: Due to prefetching, Yumrepo clobbers any definition that it does not create I'm not sure why 1843(https://projects.puppetlabs.com/issues/1843) is marked as a duplicate of this, but augeas certainly doesn't fix that issue. I'm writing this here because it was marked as a duplicate, but if you all think I should put it in a separate issue I will. Puppet seems to cache/prefetch the repository details at the beginning of the puppet run, meaning that I can't install a repository using yumrepo and install a package from that same repository during the same puppet run. The first puppet run, it adds the repository but seems to be working off its prefetched data so the package install fails. The second puppet run updates the yum cache so now the package install succeeds. Even using the requires or before directives this problem still happens, so it seems to be related to some sort of prefetching that puppet is doing. Whether that's a part of puppet itself or part of the yumrepo type I do not know. So this is counterintuitive and not idempotent and all that. Maybe the yumrepo type could refresh the cache after it installs a repository? Add Comment This message was sent by Atlassian JIRA (v6.4.13#64028-sha1:b7939e9) -- You received this message because you are subscribed to the Google Groups "Puppet Bugs" group. To unsubscribe from this group and stop receiving emails from it, send an email to puppet-bugs+unsubscr...@googlegroups.com. To post to this group, send email to puppet-bugs@googlegroups.com. Visit this group at https://groups.google.com/group/puppet-bugs. For more options, visit https://groups.google.com/d/optout.
Jira (PUP-723) Due to prefetching, Yumrepo clobbers any definition that it does not create
Title: Message Title
Stefan Lasiewski commented on PUP-723
Re: Due to prefetching, Yumrepo clobbers any definition that it does not create
For those of you who find this bug, try Augeas as a workaround:
class stefanl::remi (
$ensure = 'latest',
$enabled = true,
$priority = '80',
) {
package { 'remi-release':
ensure => $ensure,
Jira (PUP-723) Due to prefetching, Yumrepo clobbers any definition that it does not create
Title: Message Title Stefan Lasiewski commented on PUP-723 Re: Due to prefetching, Yumrepo clobbers any definition that it does not create This still happens in Puppet 3.8.4. This is actually a pretty serious bug. On my systems, this bug can lead to a cascade of failures and effectively neuters huge parts of my manifest which are not yum related at all. Using code similar to the Epel example above, this bug triggered failures on over 100+ of my systems. Cleanup required that I remove the truncated .repo file from all of these systems. Yuck. Using the Package and Yumrepo types together seems pretty natural, so I imagine a number of people have run into this. Is there a workaround besides "Don't use yumrepo and package together"? Can I tell Yumrepo to NOT prefetch? ``` puppet agent --test 2>&1 | egrep -c "Warning|Error" 94 puppet agent --test 2>&1 | egrep -c "Skipping because of failed dependencies" 61 ``` Add Comment This message was sent by Atlassian JIRA (v6.4.12#64027-sha1:e3691cc) -- You received this message because you are subscribed to the Google Groups "Puppet Bugs" group. To unsubscribe from this group and stop receiving emails from it, send an email to puppet-bugs+unsubscr...@googlegroups.com. To post to this group, send email to puppet-bugs@googlegroups.com. Visit this group at http://groups.google.com/group/puppet-bugs. For more options, visit https://groups.google.com/d/optout.
Jira (PUP-723) Due to prefetching, Yumrepo clobbers any definition that it does not create
Title: Message Title
Fabrice Bacchella commented on PUP-723
Re: Due to prefetching, Yumrepo clobbers any definition that it does not create
Does it needs 6 years to decide to add a stat("repofile") and rescan a prefetched file if it's newer than the cached version ? That would be much easer than refactor yumrepo to use a provider.
Add Comment
This message was sent by Atlassian JIRA (v6.3.10#6340-sha1:7ea293a)
--
You received this message because you are subscribed to the Google Groups "Puppet Bugs" group.
To unsubscribe from this group and stop receiving emails from it, send an email to puppet-bugs+unsubscr...@googlegroups.com.
To post to this group, send email to puppet-bugs@googlegroups.com.
Visit this group at http://groups.google.com/group/puppet-bugs.
For more options, visit https://groups.google.com/d/optout.
Jira (PUP-723) Due to prefetching, Yumrepo clobbers any definition that it does not create
Title: Message Title
Charlie Sharpsteen commented on an issue
Re: Due to prefetching, Yumrepo clobbers any definition that it does not create
This is still an issue under Puppet 3.7.1. Reproduction steps for CentOS 6.5:
1. Add the Puppetlabs yum repos and install Puppet:
# yum install -y http://yum.puppetlabs.com/puppetlabs-release-el-6.noarch.rpm
# yum install -y puppet
2. Run the following manifest:
# This is required by the 'epel-release' package and thus triggers a prefetch
# of Yumrepo resources before the package lays down the EPEL definitions.
yumrepo {'puppetlabs-products':
enabled => 1m
}
package {'epel-release':
Jira (PUP-723) Due to prefetching, Yumrepo clobbers any definition that it does not create
Title: Message Title Charlie Sharpsteen updated an issue Puppet / PUP-723 Due to prefetching, Yumrepo clobbers any definition that it does not create Change By: Charlie Sharpsteen Affects Version/s: PUP 3.7.1 Add Comment This message was sent by Atlassian JIRA (v6.1.4#6159-sha1:44eaede) -- You received this message because you are subscribed to the Google Groups "Puppet Bugs" group. To unsubscribe from this group and stop receiving emails from it, send an email to puppet-bugs+unsubscr...@googlegroups.com. To post to this group, send email to puppet-bugs@googlegroups.com. Visit this group at http://groups.google.com/group/puppet-bugs. For more options, visit https://groups.google.com/d/optout.
