Jira (PDB-4871) Investigate queries using two Hikari connections per request

2021-05-28 Thread Austin Blatt (Jira)
Title: Message Title


 
 
 
 

 
 
 

 
   
 Austin Blatt updated an issue  
 

  
 
 
 
 

 
 
  
 
 
 
 

 
 PuppetDB /  PDB-4871  
 
 
  Investigate queries using two Hikari connections per request   
 

  
 
 
 
 

 
Change By: 
 Austin Blatt  
 
 
Fix Version/s: 
 PDB 6.14.0  
 

  
 
 
 
 

 
 
 

 
 
 Add Comment  
 

  
 

  
 
 
 
  
 

  
 
 
 
 

 
 This message was sent by Atlassian Jira (v8.13.2#813002-sha1:c495a97)  
 
 

 
   
 

  
 

  
 

   





-- 
You received this message because you are subscribed to the Google Groups "Puppet Bugs" group.
To unsubscribe from this group and stop receiving emails from it, send an email to puppet-bugs+unsubscr...@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/puppet-bugs/JIRA.370205.1598390523000.42666.1622058060031%40Atlassian.JIRA.


Jira (PDB-4871) Investigate queries using two Hikari connections per request

2020-11-18 Thread Zachary Kent (Jira)
Title: Message Title


 
 
 
 

 
 
 

 
   
 Zachary Kent commented on  PDB-4871  
 

  
 
 
 
 

 
 
  
 
 
 
 

 
  Re: Investigate queries using two Hikari connections per request   
 

  
 
 
 
 

 
 Investigating this issue we realized that the 2nd connection was only being held open until the first row from the query was ready to be streamed to the client. This isn't as bad as holding the connection open for the entire query but could still cause the outer setup query to appear idle in transaction for a short time before rows we returned.  
 

  
 
 
 
 

 
 
 

 
 
 Add Comment  
 

  
 

  
 
 
 
  
 

  
 
 
 
 

 
 This message was sent by Atlassian Jira (v8.5.2#805002-sha1:a66f935)  
 
 

 
   
 

  
 

  
 

   





-- 
You received this message because you are subscribed to the Google Groups "Puppet Bugs" group.
To unsubscribe from this group and stop receiving emails from it, send an email to puppet-bugs+unsubscr...@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/puppet-bugs/JIRA.370205.1598390523000.82109.1605720540028%40Atlassian.JIRA.


Jira (PDB-4871) Investigate queries using two Hikari connections per request

2020-11-12 Thread Rob Browning (Jira)
Title: Message Title


 
 
 
 

 
 
 

 
   
 Rob Browning updated an issue  
 

  
 
 
 
 

 
 
  
 
 
 
 

 
 PuppetDB /  PDB-4871  
 
 
  Investigate queries using two Hikari connections per request   
 

  
 
 
 
 

 
Change By: 
 Rob Browning  
 
 
Release Notes: 
 Bug Fix  
 
 
Release Notes Summary: 
 PuppetDB won't hold an extra database connection open while generating query responses.  Previously it would create and hold an extra connection open during the initial phase of the response.  For the moment, the previous behavior can be restored by setting the PDB_USE_DEPRECATED_QUERY_STREAMING_METHOD environment variable.  See the [configuration information](https://puppet.com/docs/puppetdb/latest/configure.html#experimental-environment-variables) for further details.  
 

  
 
 
 
 

 
 
 

 
 
 Add Comment  
 

  
 

  
 
 
 
  
 

  
 
 
 
 

 
 This message was sent by Atlassian Jira (v8.5.2#805002-sha1:a66f935)  
 
 

 
   
 

  
 

  
 

   





-- 
You received this message because you are subscribed to the Google Groups "Puppet Bugs" group.
To unsubscribe from this group and stop receiving emails from it, send an email to puppet-bugs+unsubscr...@googlegroups.com.
To view this discussion on the web visit 

Jira (PDB-4871) Investigate queries using two Hikari connections per request

2020-11-10 Thread Austin Blatt (Jira)
Title: Message Title


 
 
 
 

 
 
 

 
   
 Austin Blatt updated an issue  
 

  
 
 
 
 

 
 
  
 
 
 
 

 
 PuppetDB /  PDB-4871  
 
 
  Investigate queries using two Hikari connections per request   
 

  
 
 
 
 

 
Change By: 
 Austin Blatt  
 
 
Labels: 
 platform_7  
 

  
 
 
 
 

 
 
 

 
 
 Add Comment  
 

  
 

  
 
 
 
  
 

  
 
 
 
 

 
 This message was sent by Atlassian Jira (v8.5.2#805002-sha1:a66f935)  
 
 

 
   
 

  
 

  
 

   





-- 
You received this message because you are subscribed to the Google Groups "Puppet Bugs" group.
To unsubscribe from this group and stop receiving emails from it, send an email to puppet-bugs+unsubscr...@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/puppet-bugs/JIRA.370205.1598390523000.75859.1605026340139%40Atlassian.JIRA.


Jira (PDB-4871) Investigate queries using two Hikari connections per request

2020-11-10 Thread Austin Blatt (Jira)
Title: Message Title


 
 
 
 

 
 
 

 
   
 Austin Blatt updated an issue  
 

  
 
 
 
 

 
 
  
 
 
 
 

 
 PuppetDB /  PDB-4871  
 
 
  Investigate queries using two Hikari connections per request   
 

  
 
 
 
 

 
Change By: 
 Austin Blatt  
 
 
Team: 
 HA PuppetDB  
 

  
 
 
 
 

 
 
 

 
 
 Add Comment  
 

  
 

  
 
 
 
  
 

  
 
 
 
 

 
 This message was sent by Atlassian Jira (v8.5.2#805002-sha1:a66f935)  
 
 

 
   
 

  
 

  
 

   





-- 
You received this message because you are subscribed to the Google Groups "Puppet Bugs" group.
To unsubscribe from this group and stop receiving emails from it, send an email to puppet-bugs+unsubscr...@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/puppet-bugs/JIRA.370205.1598390523000.75857.1605026340050%40Atlassian.JIRA.


Jira (PDB-4871) Investigate queries using two Hikari connections per request

2020-11-05 Thread Jarret Lavallee (Jira)
Title: Message Title


 
 
 
 

 
 
 

 
   
 Jarret Lavallee updated an issue  
 

  
 
 
 
 

 
 
  
 
 
 
 

 
 PuppetDB /  PDB-4871  
 
 
  Investigate queries using two Hikari connections per request   
 

  
 
 
 
 

 
Change By: 
 Jarret Lavallee  
 
 
CS Priority: 
 Major  
 

  
 
 
 
 

 
 
 

 
 
 Add Comment  
 

  
 

  
 
 
 
  
 

  
 
 
 
 

 
 This message was sent by Atlassian Jira (v8.5.2#805002-sha1:a66f935)  
 
 

 
   
 

  
 

  
 

   





-- 
You received this message because you are subscribed to the Google Groups "Puppet Bugs" group.
To unsubscribe from this group and stop receiving emails from it, send an email to puppet-bugs+unsubscr...@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/puppet-bugs/JIRA.370205.1598390523000.73466.1604617920033%40Atlassian.JIRA.


Jira (PDB-4871) Investigate queries using two Hikari connections per request

2020-11-05 Thread Jarret Lavallee (Jira)
Title: Message Title


 
 
 
 

 
 
 

 
   
 Jarret Lavallee updated an issue  
 

  
 
 
 
 

 
 
  
 
 
 
 

 
 PuppetDB /  PDB-4871  
 
 
  Investigate queries using two Hikari connections per request   
 

  
 
 
 
 

 
Change By: 
 Jarret Lavallee  
 
 
CS Priority: 
 Needs Priority  
 

  
 
 
 
 

 
 
 

 
 
 Add Comment  
 

  
 

  
 
 
 
  
 

  
 
 
 
 

 
 This message was sent by Atlassian Jira (v8.5.2#805002-sha1:a66f935)  
 
 

 
   
 

  
 

  
 

   





-- 
You received this message because you are subscribed to the Google Groups "Puppet Bugs" group.
To unsubscribe from this group and stop receiving emails from it, send an email to puppet-bugs+unsubscr...@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/puppet-bugs/JIRA.370205.1598390523000.73424.1604616720041%40Atlassian.JIRA.


Jira (PDB-4871) Investigate queries using two Hikari connections per request

2020-11-05 Thread Rob Browning (Jira)
Title: Message Title


 
 
 
 

 
 
 

 
   
 Rob Browning assigned an issue to Rob Browning  
 

  
 
 
 
 

 
 
  
 
 
 
 

 
 PuppetDB /  PDB-4871  
 
 
  Investigate queries using two Hikari connections per request   
 

  
 
 
 
 

 
Change By: 
 Rob Browning  
 
 
Assignee: 
 Zachary Kent Rob Browning  
 

  
 
 
 
 

 
 
 

 
 
 Add Comment  
 

  
 

  
 
 
 
  
 

  
 
 
 
 

 
 This message was sent by Atlassian Jira (v8.5.2#805002-sha1:a66f935)  
 
 

 
   
 

  
 

  
 

   





-- 
You received this message because you are subscribed to the Google Groups "Puppet Bugs" group.
To unsubscribe from this group and stop receiving emails from it, send an email to puppet-bugs+unsubscr...@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/puppet-bugs/JIRA.370205.1598390523000.73171.1604601960027%40Atlassian.JIRA.


Jira (PDB-4871) Investigate queries using two Hikari connections per request

2020-11-04 Thread Jarret Lavallee (Jira)
Title: Message Title


 
 
 
 

 
 
 

 
   
 Jarret Lavallee updated an issue  
 

  
 
 
 
 

 
 
  
 
 
 
 

 
 PuppetDB /  PDB-4871  
 
 
  Investigate queries using two Hikari connections per request   
 

  
 
 
 
 

 
Change By: 
 Jarret Lavallee  
 
 
CS Priority: 
 Needs Priority  
 

  
 
 
 
 

 
 
 

 
 
 Add Comment  
 

  
 

  
 
 
 
  
 

  
 
 
 
 

 
 This message was sent by Atlassian Jira (v8.5.2#805002-sha1:a66f935)  
 
 

 
   
 

  
 

  
 

   





-- 
You received this message because you are subscribed to the Google Groups "Puppet Bugs" group.
To unsubscribe from this group and stop receiving emails from it, send an email to puppet-bugs+unsubscr...@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/puppet-bugs/JIRA.370205.1598390523000.72273.1604545260035%40Atlassian.JIRA.


Jira (PDB-4871) Investigate queries using two Hikari connections per request

2020-11-04 Thread Josh Cooper (Jira)
Title: Message Title


 
 
 
 

 
 
 

 
   
 Josh Cooper updated an issue  
 

  
 
 
 
 

 
 
  
 
 
 
 

 
 PuppetDB /  PDB-4871  
 
 
  Investigate queries using two Hikari connections per request   
 

  
 
 
 
 

 
Change By: 
 Josh Cooper  
 
 
Fix Version/s: 
 PDB 7.0.0  
 

  
 
 
 
 

 
 
 

 
 
 Add Comment  
 

  
 

  
 
 
 
  
 

  
 
 
 
 

 
 This message was sent by Atlassian Jira (v8.5.2#805002-sha1:a66f935)  
 
 

 
   
 

  
 

  
 

   





-- 
You received this message because you are subscribed to the Google Groups "Puppet Bugs" group.
To unsubscribe from this group and stop receiving emails from it, send an email to puppet-bugs+unsubscr...@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/puppet-bugs/JIRA.370205.1598390523000.72159.1604536020037%40Atlassian.JIRA.


Jira (PDB-4871) Investigate queries using two Hikari connections per request

2020-11-04 Thread Zachary Kent (Jira)
Title: Message Title


 
 
 
 

 
 
 

 
   
 Zachary Kent updated an issue  
 

  
 
 
 
 

 
 
  
 
 
 
 

 
 PuppetDB /  PDB-4871  
 
 
  Investigate queries using two Hikari connections per request   
 

  
 
 
 
 

 
Change By: 
 Zachary Kent  
 
 
Fix Version/s: 
 PDB 7.0.0  
 

  
 
 
 
 

 
 
 

 
 
 Add Comment  
 

  
 

  
 
 
 
  
 

  
 
 
 
 

 
 This message was sent by Atlassian Jira (v8.5.2#805002-sha1:a66f935)  
 
 

 
   
 

  
 

  
 

   





-- 
You received this message because you are subscribed to the Google Groups "Puppet Bugs" group.
To unsubscribe from this group and stop receiving emails from it, send an email to puppet-bugs+unsubscr...@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/puppet-bugs/JIRA.370205.1598390523000.72112.1604532720103%40Atlassian.JIRA.


Jira (PDB-4871) Investigate queries using two Hikari connections per request

2020-10-29 Thread Zachary Kent (Jira)
Title: Message Title


 
 
 
 

 
 
 

 
   
 Zachary Kent assigned an issue to Zachary Kent  
 

  
 
 
 
 

 
 
  
 
 
 
 

 
 PuppetDB /  PDB-4871  
 
 
  Investigate queries using two Hikari connections per request   
 

  
 
 
 
 

 
Change By: 
 Zachary Kent  
 
 
Assignee: 
 Zachary Kent  
 

  
 
 
 
 

 
 
 

 
 
 Add Comment  
 

  
 

  
 
 
 
  
 

  
 
 
 
 

 
 This message was sent by Atlassian Jira (v8.5.2#805002-sha1:a66f935)  
 
 

 
   
 

  
 

  
 

   





-- 
You received this message because you are subscribed to the Google Groups "Puppet Bugs" group.
To unsubscribe from this group and stop receiving emails from it, send an email to puppet-bugs+unsubscr...@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/puppet-bugs/JIRA.370205.1598390523000.67175.1603989780034%40Atlassian.JIRA.


Jira (PDB-4871) Investigate queries using two Hikari connections per request

2020-10-22 Thread Rob Browning (Jira)
Title: Message Title


 
 
 
 

 
 
 

 
   
 Rob Browning updated an issue  
 

  
 
 
 
 

 
 
  
 
 
 
 

 
 PuppetDB /  PDB-4871  
 
 
  Investigate queries using two Hikari connections per request   
 

  
 
 
 
 

 
Change By: 
 Rob Browning  
 
 
Story Points: 
 3  
 

  
 
 
 
 

 
 
 

 
 
 Add Comment  
 

  
 

  
 
 
 
  
 

  
 
 
 
 

 
 This message was sent by Atlassian Jira (v8.5.2#805002-sha1:a66f935)  
 
 

 
   
 

  
 

  
 

   





-- 
You received this message because you are subscribed to the Google Groups "Puppet Bugs" group.
To unsubscribe from this group and stop receiving emails from it, send an email to puppet-bugs+unsubscr...@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/puppet-bugs/JIRA.370205.1598390523000.61702.1603394760040%40Atlassian.JIRA.


Jira (PDB-4871) Investigate queries using two Hikari connections per request

2020-10-22 Thread Rob Browning (Jira)
Title: Message Title


 
 
 
 

 
 
 

 
   
 Rob Browning updated an issue  
 

  
 
 
 
 

 
 
  
 
 
 
 

 
 PuppetDB /  PDB-4871  
 
 
  Investigate queries using two Hikari connections per request   
 

  
 
 
 
 

 
Change By: 
 Rob Browning  
 
 
Fix Version/s: 
 PDB 7.0.0  
 

  
 
 
 
 

 
 
 

 
 
 Add Comment  
 

  
 

  
 
 
 
  
 

  
 
 
 
 

 
 This message was sent by Atlassian Jira (v8.5.2#805002-sha1:a66f935)  
 
 

 
   
 

  
 

  
 

   





-- 
You received this message because you are subscribed to the Google Groups "Puppet Bugs" group.
To unsubscribe from this group and stop receiving emails from it, send an email to puppet-bugs+unsubscr...@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/puppet-bugs/JIRA.370205.1598390523000.61700.1603394700093%40Atlassian.JIRA.


Jira (PDB-4871) Investigate queries using two Hikari connections per request

2020-08-25 Thread Zachary Kent (Jira)
Title: Message Title


 
 
 
 

 
 
 

 
   
 Zachary Kent created an issue  
 

  
 
 
 
 

 
 
  
 
 
 
 

 
 PuppetDB /  PDB-4871  
 
 
  Investigate queries using two Hikari connections per request   
 

  
 
 
 
 

 
Issue Type: 
  Bug  
 
 
Assignee: 
 Unassigned  
 
 
Created: 
 2020/08/25 2:22 PM  
 
 
Priority: 
  Normal  
 
 
Reporter: 
 Zachary Kent  
 

  
 
 
 
 

 
 It looks like PDB queries are grabbing two connections from the Hikari PDBReadPool for each request. You can see this behavior by fetching this branch. The commit on the tip of that branch uses the Hikari AcviveConnections metric to get the number of active connections being used from the pool at any given time (refreshed every second). Once you have the branch, start PDB up locally with `lein run services -c ...` and then run any query against the `/pdb/query/v4` endpoint. This should result in the following output:  
 
 
 
 
 "inside the outer with-transacted-connection form:"  
 
 
 "pg_backend_pid: [{:pg_backend_pid 91592}]"  
 
 
 "number of active connections:"  
 
 
 {:request  
 
 
  {:mbean