Jira (PDB-5135) PuppetDB should warn about resource titles that exceed Postgres index sizes
Title: Message Title Sebastian Miclea updated an issue PuppetDB / PDB-5135 PuppetDB should warn about resource titles that exceed Postgres index sizes Change By: Sebastian Miclea Fix Version/s: PDB 6.19.0 Add Comment This message was sent by Atlassian Jira (v8.13.2#813002-sha1:c495a97) -- You received this message because you are subscribed to the Google Groups "Puppet Bugs" group. To unsubscribe from this group and stop receiving emails from it, send an email to puppet-bugs+unsubscr...@googlegroups.com. To view this discussion on the web visit https://groups.google.com/d/msgid/puppet-bugs/JIRA.399989.162152585.147093.1633440720200%40Atlassian.JIRA.
Jira (PDB-5135) PuppetDB should warn about resource titles that exceed Postgres index sizes
Title: Message Title Austin Blatt updated an issue PuppetDB / PDB-5135 PuppetDB should warn about resource titles that exceed Postgres index sizes Change By: Austin Blatt Fix Version/s: PDB 7.6.0 Add Comment This message was sent by Atlassian Jira (v8.13.2#813002-sha1:c495a97) -- You received this message because you are subscribed to the Google Groups "Puppet Bugs" group. To unsubscribe from this group and stop receiving emails from it, send an email to puppet-bugs+unsubscr...@googlegroups.com. To view this discussion on the web visit https://groups.google.com/d/msgid/puppet-bugs/JIRA.399989.162152585.126648.1631199600192%40Atlassian.JIRA.
Jira (PDB-5135) PuppetDB should warn about resource titles that exceed Postgres index sizes
Title: Message Title Sebastian Miclea updated an issue PuppetDB / PDB-5135 PuppetDB should warn about resource titles that exceed Postgres index sizes Change By: Sebastian Miclea Release Notes: Not Needed Enhancement Release Notes Summary: On the resource_events_resource_*z partial has the multicolumn resource_events_resource_timestamp_xz index (timestamp, title and type) that is limited to 2712 bytes for postgres versions up to 11. Starting with postgres 12, the index size was reduced with 8 bytes. Having resource events that exceed this limit will cause PDB to fail to insert the row without to many info about what and where is the resource that caused the error. This pr adds extra logs with details to allow easier debugging. There are two messages printed, when the index is close to the limit (between 2500 and 2704) and when the limit is exceeded (over 2704). Add Comment This message was sent by Atlassian Jira (v8.13.2#813002-sha1:c495a97) -- You received this message because you are subscribed to the Google Groups "Puppet
Jira (PDB-5135) PuppetDB should warn about resource titles that exceed Postgres index sizes
Title: Message Title Bogdan Irimie updated an issue PuppetDB / PDB-5135 PuppetDB should warn about resource titles that exceed Postgres index sizes Change By: Bogdan Irimie Sprint: ghost-28.07.2021 , ghost-11.08.2021 Add Comment This message was sent by Atlassian Jira (v8.13.2#813002-sha1:c495a97) -- You received this message because you are subscribed to the Google Groups "Puppet Bugs" group. To unsubscribe from this group and stop receiving emails from it, send an email to puppet-bugs+unsubscr...@googlegroups.com. To view this discussion on the web visit https://groups.google.com/d/msgid/puppet-bugs/JIRA.399989.162152585.92342.1627457520046%40Atlassian.JIRA.
Jira (PDB-5135) PuppetDB should warn about resource titles that exceed Postgres index sizes
Title: Message Title Sebastian Miclea commented on PDB-5135 Re: PuppetDB should warn about resource titles that exceed Postgres index sizes Charlie Sharpsteen I've set up a PR fir the PupetDB termini that logs a message when the index limit is reached. With Rob Browning suggestion I've added a second log to warn that the size is near the limit. Currently I'm looking if it's possible to add the message from PDB, because for me, it's a bit confusing to have one error in pdb and one in puppetserver. Add Comment This message was sent by Atlassian Jira (v8.13.2#813002-sha1:c495a97) -- You received this message because you are subscribed to the Google Groups "Puppet Bugs" group. To unsubscribe from this group and stop receiving emails from it, send an email to puppet-bugs+unsubscr...@googlegroups.com. To view this discussion on the web visit https://groups.google.com/d/msgid/puppet-bugs/JIRA.399989.162152585.91198.1627393920185%40Atlassian.JIRA.
Jira (PDB-5135) PuppetDB should warn about resource titles that exceed Postgres index sizes
Title: Message Title Sebastian Miclea assigned an issue to Sebastian Miclea PuppetDB / PDB-5135 PuppetDB should warn about resource titles that exceed Postgres index sizes Change By: Sebastian Miclea Assignee: Sebastian Miclea Add Comment This message was sent by Atlassian Jira (v8.13.2#813002-sha1:c495a97) -- You received this message because you are subscribed to the Google Groups "Puppet Bugs" group. To unsubscribe from this group and stop receiving emails from it, send an email to puppet-bugs+unsubscr...@googlegroups.com. To view this discussion on the web visit https://groups.google.com/d/msgid/puppet-bugs/JIRA.399989.162152585.84960.1626780240030%40Atlassian.JIRA.
Jira (PDB-5135) PuppetDB should warn about resource titles that exceed Postgres index sizes
Title: Message Title Oana Tanasoiu updated an issue PuppetDB / PDB-5135 PuppetDB should warn about resource titles that exceed Postgres index sizes Change By: Oana Tanasoiu Sprint: ready for triage 2 ghost-28.07.2021 Add Comment This message was sent by Atlassian Jira (v8.13.2#813002-sha1:c495a97) -- You received this message because you are subscribed to the Google Groups "Puppet Bugs" group. To unsubscribe from this group and stop receiving emails from it, send an email to puppet-bugs+unsubscr...@googlegroups.com. To view this discussion on the web visit https://groups.google.com/d/msgid/puppet-bugs/JIRA.399989.162152585.80888.1626248700196%40Atlassian.JIRA.
Jira (PDB-5135) PuppetDB should warn about resource titles that exceed Postgres index sizes
Title: Message Title Oana Tanasoiu updated an issue PuppetDB / PDB-5135 PuppetDB should warn about resource titles that exceed Postgres index sizes Change By: Oana Tanasoiu Sprint: ready for triage 2 Add Comment This message was sent by Atlassian Jira (v8.13.2#813002-sha1:c495a97) -- You received this message because you are subscribed to the Google Groups "Puppet Bugs" group. To unsubscribe from this group and stop receiving emails from it, send an email to puppet-bugs+unsubscr...@googlegroups.com. To view this discussion on the web visit https://groups.google.com/d/msgid/puppet-bugs/JIRA.399989.162152585.80878.1626247080192%40Atlassian.JIRA.
Jira (PDB-5135) PuppetDB should warn about resource titles that exceed Postgres index sizes
Title: Message Title Bogdan Irimie updated an issue PuppetDB / PDB-5135 PuppetDB should warn about resource titles that exceed Postgres index sizes Change By: Bogdan Irimie Story Points: 5 Add Comment This message was sent by Atlassian Jira (v8.13.2#813002-sha1:c495a97) -- You received this message because you are subscribed to the Google Groups "Puppet Bugs" group. To unsubscribe from this group and stop receiving emails from it, send an email to puppet-bugs+unsubscr...@googlegroups.com. To view this discussion on the web visit https://groups.google.com/d/msgid/puppet-bugs/JIRA.399989.162152585.71159.1625124060030%40Atlassian.JIRA.
Jira (PDB-5135) PuppetDB should warn about resource titles that exceed Postgres index sizes
Title: Message Title Austin Blatt updated an issue PuppetDB / PDB-5135 PuppetDB should warn about resource titles that exceed Postgres index sizes Change By: Austin Blatt Team: PuppetDB Ghost Add Comment This message was sent by Atlassian Jira (v8.13.2#813002-sha1:c495a97) -- You received this message because you are subscribed to the Google Groups "Puppet Bugs" group. To unsubscribe from this group and stop receiving emails from it, send an email to puppet-bugs+unsubscr...@googlegroups.com. To view this discussion on the web visit https://groups.google.com/d/msgid/puppet-bugs/JIRA.399989.162152585.70370.1625071500095%40Atlassian.JIRA.
Jira (PDB-5135) PuppetDB should warn about resource titles that exceed Postgres index sizes
Title: Message Title Charlie Sharpsteen commented on PDB-5135 Re: PuppetDB should warn about resource titles that exceed Postgres index sizes The PuppetDB terminii that run inside of Puppet Server might be a good spot for this check as they already iterate over catalog resources and report resource events when prepping the data for sybmission to PuppetDB. Add Comment This message was sent by Atlassian Jira (v8.13.2#813002-sha1:c495a97) -- You received this message because you are subscribed to the Google Groups "Puppet Bugs" group. To unsubscribe from this group and stop receiving emails from it, send an email to puppet-bugs+unsubscr...@googlegroups.com. To view this discussion on the web visit https://groups.google.com/d/msgid/puppet-bugs/JIRA.399989.162152585.37542.1621525980249%40Atlassian.JIRA.
Jira (PDB-5135) PuppetDB should warn about resource titles that exceed Postgres index sizes
Title: Message Title Charlie Sharpsteen updated an issue PuppetDB / PDB-5135 PuppetDB should warn about resource titles that exceed Postgres index sizes Change By: Charlie Sharpsteen Team: PuppetDB Add Comment This message was sent by Atlassian Jira (v8.13.2#813002-sha1:c495a97) -- You received this message because you are subscribed to the Google Groups "Puppet Bugs" group. To unsubscribe from this group and stop receiving emails from it, send an email to puppet-bugs+unsubscr...@googlegroups.com. To view this discussion on the web visit https://groups.google.com/d/msgid/puppet-bugs/JIRA.399989.162152585.37543.1621525980256%40Atlassian.JIRA.
Jira (PDB-5135) PuppetDB should warn about resource titles that exceed Postgres index sizes
Title: Message Title Charlie Sharpsteen created an issue PuppetDB / PDB-5135 PuppetDB should warn about resource titles that exceed Postgres index sizes Issue Type: Improvement Assignee: Unassigned Created: 2021/05/20 8:50 AM Priority: Normal Reporter: Charlie Sharpsteen When PuppetDB inserts data into Postgres, the constraints of the database can cause errors to be raised. A typical example is that Postgres disallows the use of the null byte, "\0", in strings while UTF-8 generally tolerates it. Another constraint comes into play when large data values are inserted into columns that have database indexes: Any data type that can be sorted into a well-defined linear order can be indexed by a btree index. The only limitation is that an index entry cannot exceed approximately one-third of a page (after TOAST compression, if applicable). https://www.postgresql.org/docs/11/btree-intro.html This constraint is typically encountered with resource title values in catalogs or reports and results in an error similar to the following being raised from the storage attempt: 2021-05-11T23:59:47.225Z ERROR [p.p.command] [14,654,263] [store report] Retrying after attempt 0 for node.hostname.example, due to: org.postgresql.util.PSQLException: ERROR: index row size 2720 exceeds maximum 2712 for index "resource_events_resource_timestamp_20210511z" This error is somewhat useful in that it indicates which node tripped the condition. But the
