Hi Douglas,
normally, there should be only one DB connection open if no jobs are running.
As you are using FreeBSD, may it be that the Bareos binaries are built with
the experimental database pooling functionality? Could you please post your
catalog config (Catalog { ... }), and check if you are using any of the
parameters, look for "experimental database pooling functionality" in
http://doc.bareos.org/master/html/bareos-manual-main-reference.html#CatalogResource
Regards,
Stephan
On 09/07/2017 07:16 PM, Douglas K. Rand wrote:
> Hey Stephan. I have Maximum Concurrent Jobs set to 10 for the director
> and also set to 10 in my common Job Defs. And also set to 10 in my
> on-disk storage daemon; and set to 1 in my LTO-6 SD.
>
> I have 86 jobs that start at 21:00 each night: 84 always incremental
> jobs at priority 10, one consolidation job at priority 20, and one
> catalog job at priority 50.
>
> Yesterday we consumed all of the Postgres connections yet again, so I
> re-started the Bareos director. After that re-start the established
> Postgres connections were two (one for the query to get the status):
>
> usename | pid | state | query
> ---------+-------+--------+----------------------------------------------------------------------
> bareos | 72370 | idle | SET client_encoding TO 'SQL_ASCII'
> bareos | 90620 | active | SELECT usename, pid, state, query FROM
> pg_stat_activity ORDER BY pid
> (2 rows)
>
> But just after 21:00 there were 98 Postgres connections:
>
> usename | pid | state | query
> ---------+-------+--------+----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
>
> bareos | 72370 | idle | SET client_encoding TO 'SQL_ASCII'
> bareos | 90698 | idle | UPDATE Media SET
> VolJobs=10,VolFiles=1,VolBlocks=130413,VolBytes=8412907724,VolMounts=10,VolErrors=0,VolWrites=130414,MaxVolBytes=16000000000,VolStatus='Append',Slot=0,InChanger=0,VolReadTime=0,VolWriteTime=7065975,LabelType=0,StorageId=1,PoolId=6,VolRetention=31536000,VolUseDuration=0,MaxVolJobs=0,MaxVolFiles=0,Enabled=1,LocationId=0,ScratchPoolId=0,RecyclePoolId=0,RecycleCount=0,Recycle=1,ActionOnPurge=0,MinBlocksize=0,MaxBlocksize=0
>
> WHERE VolumeName='incr-0686'
> bareos | 90699 | idle | UPDATE Media SET
> VolJobs=7,VolFiles=2,VolBlocks=164480,VolBytes=10610777273,VolMounts=7,VolErrors=0,VolWrites=164481,MaxVolBytes=16000000000,VolStatus='Append',Slot=0,InChanger=0,VolReadTime=0,VolWriteTime=8158808,LabelType=0,StorageId=1,PoolId=6,VolRetention=31536000,VolUseDuration=0,MaxVolJobs=0,MaxVolFiles=0,Enabled=1,LocationId=0,ScratchPoolId=0,RecyclePoolId=0,RecycleCount=0,Recycle=1,ActionOnPurge=0,MinBlocksize=0,MaxBlocksize=0
>
> WHERE VolumeName='incr-0683'
> bareos | 90700 | idle | UPDATE Media SET
> VolJobs=2,VolFiles=0,VolBlocks=19062,VolBytes=1229720082,VolMounts=2,VolErrors=0,VolWrites=19063,MaxVolBytes=16000000000,VolStatus='Append',Slot=0,InChanger=0,VolReadTime=0,VolWriteTime=1101701,LabelType=0,StorageId=1,PoolId=6,VolRetention=31536000,VolUseDuration=0,MaxVolJobs=0,MaxVolFiles=0,Enabled=1,LocationId=0,ScratchPoolId=0,RecyclePoolId=0,RecycleCount=0,Recycle=1,ActionOnPurge=0,MinBlocksize=0,MaxBlocksize=0
>
> WHERE VolumeName='incr-0687'
> bareos | 90701 | idle | UPDATE Media SET
> VolJobs=30,VolFiles=3,VolBlocks=242410,VolBytes=15637398352,VolMounts=30,VolErrors=0,VolWrites=242411,MaxVolBytes=16000000000,VolStatus='Append',Slot=0,InChanger=0,VolReadTime=0,VolWriteTime=11139499,LabelType=0,StorageId=1,PoolId=6,VolRetention=31536000,VolUseDuration=0,MaxVolJobs=0,MaxVolFiles=0,Enabled=1,LocationId=0,ScratchPoolId=0,RecyclePoolId=0,RecycleCount=0,Recycle=1,ActionOnPurge=0,MinBlocksize=0,MaxBlocksize=0
>
> WHERE VolumeName='incr-0670'
> bareos | 90702 | idle | UPDATE Media SET
> VolJobs=5,VolFiles=1,VolBlocks=90985,VolBytes=5869432460,VolMounts=5,VolErrors=0,VolWrites=90986,MaxVolBytes=16000000000,VolStatus='Append',Slot=0,InChanger=0,VolReadTime=0,VolWriteTime=4620587,LabelType=0,StorageId=1,PoolId=6,VolRetention=31536000,VolUseDuration=0,MaxVolJobs=0,MaxVolFiles=0,Enabled=1,LocationId=0,ScratchPoolId=0,RecyclePoolId=0,RecycleCount=0,Recycle=1,ActionOnPurge=0,MinBlocksize=0,MaxBlocksize=0
>
> WHERE VolumeName='incr-0684'
> bareos | 90703 | idle | UPDATE Media SET
> VolJobs=1,VolFiles=0,VolBlocks=0,VolBytes=218,VolMounts=1,VolErrors=0,VolWrites=1,MaxVolBytes=16000000000,VolStatus='Append',Slot=0,InChanger=0,VolReadTime=0,VolWriteTime=22,LabelType=0,StorageId=1,PoolId=6,VolRetention=31536000,VolUseDuration=0,MaxVolJobs=0,MaxVolFiles=0,Enabled=1,LocationId=0,ScratchPoolId=0,RecyclePoolId=0,RecycleCount=0,Recycle=1,ActionOnPurge=0,MinBlocksize=0,MaxBlocksize=0
>
> WHERE VolumeName='incr-0689'
> bareos | 90704 | idle | UPDATE Media SET
> VolJobs=1,VolFiles=0,VolBlocks=0,VolBytes=218,VolMounts=1,VolErrors=0,VolWrites=1,MaxVolBytes=16000000000,VolStatus='Append',Slot=0,InChanger=0,VolReadTime=0,VolWriteTime=21,LabelType=0,StorageId=1,PoolId=6,VolRetention=31536000,VolUseDuration=0,MaxVolJobs=0,MaxVolFiles=0,Enabled=1,LocationId=0,ScratchPoolId=0,RecyclePoolId=0,RecycleCount=0,Recycle=1,ActionOnPurge=0,MinBlocksize=0,MaxBlocksize=0
>
> WHERE VolumeName='incr-0690'
> bareos | 90705 | idle | SELECT sum(JobFiles) FROM Job WHERE JobId
> IN
> (30121,30972,31148,31234,31320,31410,31498,31588,31677,31849,31937,32023,32110,32197,32285,32372,32543,32659,32745,32858,32957,33045,33155,33327,33413,33499,33612)
>
> bareos | 90706 | idle | UPDATE Media SET
> VolJobs=1,VolFiles=0,VolBlocks=0,VolBytes=218,VolMounts=1,VolErrors=0,VolWrites=1,MaxVolBytes=16000000000,VolStatus='Append',Slot=0,InChanger=0,VolReadTime=0,VolWriteTime=17,LabelType=0,StorageId=1,PoolId=6,VolRetention=31536000,VolUseDuration=0,MaxVolJobs=0,MaxVolFiles=0,Enabled=1,LocationId=0,ScratchPoolId=0,RecyclePoolId=0,RecycleCount=0,Recycle=1,ActionOnPurge=0,MinBlocksize=0,MaxBlocksize=0
>
> WHERE VolumeName='incr-0692'
> bareos | 90707 | idle | UPDATE Media SET
> VolJobs=1,VolFiles=0,VolBlocks=0,VolBytes=218,VolMounts=1,VolErrors=0,VolWrites=1,MaxVolBytes=16000000000,VolStatus='Append',Slot=0,InChanger=0,VolReadTime=0,VolWriteTime=16,LabelType=0,StorageId=1,PoolId=6,VolRetention=31536000,VolUseDuration=0,MaxVolJobs=0,MaxVolFiles=0,Enabled=1,LocationId=0,ScratchPoolId=0,RecyclePoolId=0,RecycleCount=0,Recycle=1,ActionOnPurge=0,MinBlocksize=0,MaxBlocksize=0
>
> WHERE VolumeName='incr-0693'
> bareos | 90708 | idle | SELECT count(*) from Media WHERE PoolId=6
> bareos | 90709 | idle | SELECT count(*) from Media WHERE PoolId=6
> bareos | 90710 | idle | SELECT count(*) from Media WHERE PoolId=6
> bareos | 90711 | idle | SELECT count(*) from Media WHERE PoolId=6
> bareos | 90712 | idle | SELECT count(*) from Media WHERE PoolId=6
> bareos | 90713 | idle | SELECT count(*) from Media WHERE PoolId=6
> bareos | 90714 | idle | SELECT count(*) from Media WHERE PoolId=6
> bareos | 90715 | idle | UPDATE Pool SET
> NumVols=143,MaxVols=1024,UseOnce=0,UseCatalog=1,AcceptAnyVolume=0,VolRetention='31536000',VolUseDuration='0',MaxVolJobs=0,MaxVolFiles=0,MaxVolBytes=16000000000,Recycle=1,AutoPrune=0,LabelType=0,LabelFormat='incr-',RecyclePoolId=0,ScratchPoolId=0,ActionOnPurge=0,MinBlockSize=0,MaxBlockSize=0
>
> WHERE PoolId=6
> bareos | 90716 | idle | SELECT count(*) from Media WHERE PoolId=6
> bareos | 90717 | idle | SELECT count(*) from Media WHERE PoolId=6
> bareos | 90718 | idle | SELECT count(*) from Media WHERE PoolId=6
> bareos | 90719 | idle | SELECT count(*) from Media WHERE PoolId=6
> bareos | 90720 | idle | SELECT count(*) from Media WHERE PoolId=6
> bareos | 90721 | idle | SELECT count(*) from Media WHERE PoolId=6
> bareos | 90722 | idle | SELECT count(*) from Media WHERE PoolId=6
> bareos | 90723 | idle | SELECT count(*) from Media WHERE PoolId=6
> bareos | 90724 | idle | SELECT count(*) from Media WHERE PoolId=6
> bareos | 90725 | idle | SELECT count(*) from Media WHERE PoolId=6
> bareos | 90726 | idle | COMMIT
> bareos | 90727 | idle | COMMIT
> bareos | 90728 | idle | COMMIT
> bareos | 90729 | idle | SELECT count(*) from Media WHERE PoolId=6
> bareos | 90730 | idle | SELECT count(*) from Media WHERE PoolId=6
> bareos | 90731 | idle | SELECT count(*) from Media WHERE PoolId=6
> bareos | 90732 | idle | COMMIT
> bareos | 90733 | idle | SELECT count(*) from Media WHERE PoolId=6
> bareos | 90734 | idle | SELECT count(*) from Media WHERE PoolId=6
> bareos | 90735 | idle | SELECT count(*) from Media WHERE PoolId=6
> bareos | 90736 | idle | SELECT count(*) from Media WHERE PoolId=6
> bareos | 90737 | idle | SELECT count(*) from Media WHERE PoolId=6
> bareos | 90738 | idle | COMMIT
> bareos | 90739 | idle | SELECT count(*) from Media WHERE PoolId=6
> bareos | 90740 | idle | SELECT count(*) from Media WHERE PoolId=6
> bareos | 90741 | idle | COMMIT
> bareos | 90742 | idle | SELECT count(*) from Media WHERE PoolId=6
> bareos | 90743 | idle | SELECT count(*) from Media WHERE PoolId=6
> bareos | 90744 | idle | SELECT count(*) from Media WHERE PoolId=6
> bareos | 90745 | idle | SELECT count(*) from Media WHERE PoolId=6
> bareos | 90746 | idle | SELECT count(*) from Media WHERE PoolId=6
> bareos | 90747 | idle | SELECT count(*) from Media WHERE PoolId=6
> bareos | 90748 | idle | SELECT count(*) from Media WHERE PoolId=6
> bareos | 90749 | idle | SELECT count(*) from Media WHERE PoolId=6
> bareos | 90750 | idle | SELECT count(*) from Media WHERE PoolId=6
> bareos | 90751 | idle | SELECT count(*) from Media WHERE PoolId=6
> bareos | 90752 | idle | SELECT count(*) from Media WHERE PoolId=6
> bareos | 90753 | idle | SELECT count(*) from Media WHERE PoolId=6
> bareos | 90754 | idle | SELECT count(*) from Media WHERE PoolId=6
> bareos | 90755 | idle | SELECT count(*) from Media WHERE PoolId=6
> bareos | 90756 | idle | SELECT count(*) from Media WHERE PoolId=6
> bareos | 90757 | idle | SELECT count(*) from Media WHERE PoolId=6
> bareos | 90758 | idle | SELECT count(*) from Media WHERE PoolId=6
> bareos | 90759 | idle | SELECT count(*) from Media WHERE PoolId=6
> bareos | 90760 | idle | UPDATE Pool SET
> NumVols=144,MaxVols=1024,UseOnce=0,UseCatalog=1,AcceptAnyVolume=0,VolRetention='31536000',VolUseDuration='0',MaxVolJobs=0,MaxVolFiles=0,MaxVolBytes=16000000000,Recycle=1,AutoPrune=0,LabelType=0,LabelFormat='incr-',RecyclePoolId=0,ScratchPoolId=0,ActionOnPurge=0,MinBlockSize=0,MaxBlockSize=0
>
> WHERE PoolId=6
> bareos | 90761 | idle | SELECT count(*) from Media WHERE PoolId=6
> bareos | 90762 | idle | UPDATE Pool SET
> NumVols=145,MaxVols=1024,UseOnce=0,UseCatalog=1,AcceptAnyVolume=0,VolRetention='31536000',VolUseDuration='0',MaxVolJobs=0,MaxVolFiles=0,MaxVolBytes=16000000000,Recycle=1,AutoPrune=0,LabelType=0,LabelFormat='incr-',RecyclePoolId=0,ScratchPoolId=0,ActionOnPurge=0,MinBlockSize=0,MaxBlockSize=0
>
> WHERE PoolId=6
> bareos | 90763 | idle | UPDATE Pool SET
> NumVols=146,MaxVols=1024,UseOnce=0,UseCatalog=1,AcceptAnyVolume=0,VolRetention='31536000',VolUseDuration='0',MaxVolJobs=0,MaxVolFiles=0,MaxVolBytes=16000000000,Recycle=1,AutoPrune=0,LabelType=0,LabelFormat='incr-',RecyclePoolId=0,ScratchPoolId=0,ActionOnPurge=0,MinBlockSize=0,MaxBlockSize=0
>
> WHERE PoolId=6
> bareos | 90764 | idle | SELECT count(*) from Media WHERE PoolId=6
> bareos | 90765 | idle | SELECT count(*) from Media WHERE PoolId=6
> bareos | 90766 | idle | SELECT count(*) from Media WHERE PoolId=6
> bareos | 90767 | idle | SELECT count(*) from Media WHERE PoolId=6
> bareos | 90768 | idle | SELECT count(*) from Media WHERE PoolId=6
> bareos | 90769 | idle | SELECT count(*) from Media WHERE PoolId=6
> bareos | 90770 | idle | SELECT count(*) from Media WHERE PoolId=6
> bareos | 90771 | idle | COMMIT
> bareos | 90772 | idle | SELECT count(*) from Media WHERE PoolId=6
> bareos | 90773 | idle | SELECT count(*) from Media WHERE PoolId=6
> bareos | 90774 | idle | SELECT count(*) from Media WHERE PoolId=6
> bareos | 90775 | active | FETCH 100 FROM _bac_cursor
> bareos | 90776 | idle | COMMIT
> bareos | 90777 | idle | SELECT count(*) from Media WHERE PoolId=6
> bareos | 90782 | idle | SELECT count(*) from Media WHERE PoolId=6
> bareos | 90783 | idle | SELECT count(*) from Media WHERE PoolId=6
> bareos | 90784 | idle | SELECT count(*) from Media WHERE PoolId=6
> bareos | 90785 | idle | SELECT count(*) from Media WHERE PoolId=6
> bareos | 90786 | idle | SELECT count(*) from Media WHERE PoolId=6
> bareos | 90787 | idle | SELECT count(*) from Media WHERE PoolId=6
> bareos | 90788 | idle | UPDATE Pool SET
> NumVols=147,MaxVols=1024,UseOnce=0,UseCatalog=1,AcceptAnyVolume=0,VolRetention='31536000',VolUseDuration='0',MaxVolJobs=0,MaxVolFiles=0,MaxVolBytes=16000000000,Recycle=1,AutoPrune=0,LabelType=0,LabelFormat='incr-',RecyclePoolId=0,ScratchPoolId=0,ActionOnPurge=0,MinBlockSize=0,MaxBlockSize=0
>
> WHERE PoolId=6
> bareos | 90789 | idle | SELECT count(*) from Media WHERE PoolId=6
> bareos | 90790 | idle | SELECT count(*) from Media WHERE PoolId=6
> bareos | 90791 | idle | SELECT count(*) from Media WHERE PoolId=6
> bareos | 90792 | idle | SELECT count(*) from Media WHERE PoolId=6
> bareos | 90793 | idle | SELECT count(*) from Media WHERE PoolId=6
> bareos | 90794 | idle | SELECT count(*) from Media WHERE PoolId=6
> bareos | 90795 | idle | SELECT currval('Job_Jobid_seq')
> bareos | 90796 | idle | SELECT count(*) from Media WHERE PoolId=1
> bareos | 90799 | idle | COMMIT
> bareos | 90864 | active | SELECT usename, pid, state, query FROM
> pg_stat_activity ORDER BY pid
> (98 rows)
>
> What is interesting is that after all of the backups are done and the
> director is quiet with no running jobs that I still have 28 Postgres
> database connections:
>
> usename | pid | state | query
> ---------+-------+--------+-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
>
> bareos | 50283 | active | SELECT usename, pid, state, query FROM
> pg_stat_activity ORDER BY pid
> bareos | 72370 | idle | SET client_encoding TO 'SQL_ASCII'
> bareos | 90795 | idle | SELECT
> VolSessionId,VolSessionTime,PoolId,StartTime,EndTime,JobFiles,JobBytes,JobTDate,Job,JobStatus,Type,Level,ClientId,Name,PriorJobId,RealEndTime,JobId,FileSetId,SchedTime,RealEndTime,ReadBytes,HasBase,PurgedFiles
> FROM Job WHERE JobId=30114
> bareos | 98119 | idle | SELECT
> VolSessionId,VolSessionTime,PoolId,StartTime,EndTime,JobFiles,JobBytes,JobTDate,Job,JobStatus,Type,Level,ClientId,Name,PriorJobId,RealEndTime,JobId,FileSetId,SchedTime,RealEndTime,ReadBytes,HasBase,PurgedFiles
> FROM Job WHERE JobId=30115
> bareos | 98121 | idle | SELECT
> VolSessionId,VolSessionTime,PoolId,StartTime,EndTime,JobFiles,JobBytes,JobTDate,Job,JobStatus,Type,Level,ClientId,Name,PriorJobId,RealEndTime,JobId,FileSetId,SchedTime,RealEndTime,ReadBytes,HasBase,PurgedFiles
> FROM Job WHERE JobId=30117
> bareos | 98123 | idle | SELECT
> VolSessionId,VolSessionTime,PoolId,StartTime,EndTime,JobFiles,JobBytes,JobTDate,Job,JobStatus,Type,Level,ClientId,Name,PriorJobId,RealEndTime,JobId,FileSetId,SchedTime,RealEndTime,ReadBytes,HasBase,PurgedFiles
> FROM Job WHERE JobId=30121
> bareos | 98128 | idle | SELECT
> VolSessionId,VolSessionTime,PoolId,StartTime,EndTime,JobFiles,JobBytes,JobTDate,Job,JobStatus,Type,Level,ClientId,Name,PriorJobId,RealEndTime,JobId,FileSetId,SchedTime,RealEndTime,ReadBytes,HasBase,PurgedFiles
> FROM Job WHERE JobId=30122
> bareos | 98130 | idle | SELECT
> VolSessionId,VolSessionTime,PoolId,StartTime,EndTime,JobFiles,JobBytes,JobTDate,Job,JobStatus,Type,Level,ClientId,Name,PriorJobId,RealEndTime,JobId,FileSetId,SchedTime,RealEndTime,ReadBytes,HasBase,PurgedFiles
> FROM Job WHERE JobId=30125
> bareos | 98132 | idle | SELECT
> VolSessionId,VolSessionTime,PoolId,StartTime,EndTime,JobFiles,JobBytes,JobTDate,Job,JobStatus,Type,Level,ClientId,Name,PriorJobId,RealEndTime,JobId,FileSetId,SchedTime,RealEndTime,ReadBytes,HasBase,PurgedFiles
> FROM Job WHERE JobId=30126
> bareos | 98134 | idle | SELECT
> VolSessionId,VolSessionTime,PoolId,StartTime,EndTime,JobFiles,JobBytes,JobTDate,Job,JobStatus,Type,Level,ClientId,Name,PriorJobId,RealEndTime,JobId,FileSetId,SchedTime,RealEndTime,ReadBytes,HasBase,PurgedFiles
> FROM Job WHERE JobId=30127
> bareos | 98136 | idle | SELECT
> VolSessionId,VolSessionTime,PoolId,StartTime,EndTime,JobFiles,JobBytes,JobTDate,Job,JobStatus,Type,Level,ClientId,Name,PriorJobId,RealEndTime,JobId,FileSetId,SchedTime,RealEndTime,ReadBytes,HasBase,PurgedFiles
> FROM Job WHERE JobId=30128
> bareos | 98140 | idle | SELECT
> VolSessionId,VolSessionTime,PoolId,StartTime,EndTime,JobFiles,JobBytes,JobTDate,Job,JobStatus,Type,Level,ClientId,Name,PriorJobId,RealEndTime,JobId,FileSetId,SchedTime,RealEndTime,ReadBytes,HasBase,PurgedFiles
> FROM Job WHERE JobId=30129
> bareos | 98142 | idle | SELECT
> VolSessionId,VolSessionTime,PoolId,StartTime,EndTime,JobFiles,JobBytes,JobTDate,Job,JobStatus,Type,Level,ClientId,Name,PriorJobId,RealEndTime,JobId,FileSetId,SchedTime,RealEndTime,ReadBytes,HasBase,PurgedFiles
> FROM Job WHERE JobId=30130
> bareos | 98144 | idle | SELECT
> VolSessionId,VolSessionTime,PoolId,StartTime,EndTime,JobFiles,JobBytes,JobTDate,Job,JobStatus,Type,Level,ClientId,Name,PriorJobId,RealEndTime,JobId,FileSetId,SchedTime,RealEndTime,ReadBytes,HasBase,PurgedFiles
> FROM Job WHERE JobId=30132
> bareos | 98146 | idle | SELECT
> VolSessionId,VolSessionTime,PoolId,StartTime,EndTime,JobFiles,JobBytes,JobTDate,Job,JobStatus,Type,Level,ClientId,Name,PriorJobId,RealEndTime,JobId,FileSetId,SchedTime,RealEndTime,ReadBytes,HasBase,PurgedFiles
> FROM Job WHERE JobId=30222
> bareos | 98150 | idle | SELECT
> VolSessionId,VolSessionTime,PoolId,StartTime,EndTime,JobFiles,JobBytes,JobTDate,Job,JobStatus,Type,Level,ClientId,Name,PriorJobId,RealEndTime,JobId,FileSetId,SchedTime,RealEndTime,ReadBytes,HasBase,PurgedFiles
> FROM Job WHERE JobId=30139
> bareos | 98152 | idle | SELECT
> VolSessionId,VolSessionTime,PoolId,StartTime,EndTime,JobFiles,JobBytes,JobTDate,Job,JobStatus,Type,Level,ClientId,Name,PriorJobId,RealEndTime,JobId,FileSetId,SchedTime,RealEndTime,ReadBytes,HasBase,PurgedFiles
> FROM Job WHERE JobId=30142
> bareos | 98154 | idle | SELECT
> VolSessionId,VolSessionTime,PoolId,StartTime,EndTime,JobFiles,JobBytes,JobTDate,Job,JobStatus,Type,Level,ClientId,Name,PriorJobId,RealEndTime,JobId,FileSetId,SchedTime,RealEndTime,ReadBytes,HasBase,PurgedFiles
> FROM Job WHERE JobId=30144
> bareos | 98156 | idle | SELECT
> VolSessionId,VolSessionTime,PoolId,StartTime,EndTime,JobFiles,JobBytes,JobTDate,Job,JobStatus,Type,Level,ClientId,Name,PriorJobId,RealEndTime,JobId,FileSetId,SchedTime,RealEndTime,ReadBytes,HasBase,PurgedFiles
> FROM Job WHERE JobId=30146
> bareos | 98158 | idle | SELECT
> VolSessionId,VolSessionTime,PoolId,StartTime,EndTime,JobFiles,JobBytes,JobTDate,Job,JobStatus,Type,Level,ClientId,Name,PriorJobId,RealEndTime,JobId,FileSetId,SchedTime,RealEndTime,ReadBytes,HasBase,PurgedFiles
> FROM Job WHERE JobId=30147
> bareos | 98161 | idle | SELECT
> VolSessionId,VolSessionTime,PoolId,StartTime,EndTime,JobFiles,JobBytes,JobTDate,Job,JobStatus,Type,Level,ClientId,Name,PriorJobId,RealEndTime,JobId,FileSetId,SchedTime,RealEndTime,ReadBytes,HasBase,PurgedFiles
> FROM Job WHERE JobId=30151
> bareos | 98163 | idle | SELECT
> VolSessionId,VolSessionTime,PoolId,StartTime,EndTime,JobFiles,JobBytes,JobTDate,Job,JobStatus,Type,Level,ClientId,Name,PriorJobId,RealEndTime,JobId,FileSetId,SchedTime,RealEndTime,ReadBytes,HasBase,PurgedFiles
> FROM Job WHERE JobId=30163
> bareos | 98167 | idle | SELECT
> VolSessionId,VolSessionTime,PoolId,StartTime,EndTime,JobFiles,JobBytes,JobTDate,Job,JobStatus,Type,Level,ClientId,Name,PriorJobId,RealEndTime,JobId,FileSetId,SchedTime,RealEndTime,ReadBytes,HasBase,PurgedFiles
> FROM Job WHERE JobId=30164
> bareos | 98169 | idle | SELECT
> VolSessionId,VolSessionTime,PoolId,StartTime,EndTime,JobFiles,JobBytes,JobTDate,Job,JobStatus,Type,Level,ClientId,Name,PriorJobId,RealEndTime,JobId,FileSetId,SchedTime,RealEndTime,ReadBytes,HasBase,PurgedFiles
> FROM Job WHERE JobId=30171
> bareos | 98173 | idle | SELECT
> VolSessionId,VolSessionTime,PoolId,StartTime,EndTime,JobFiles,JobBytes,JobTDate,Job,JobStatus,Type,Level,ClientId,Name,PriorJobId,RealEndTime,JobId,FileSetId,SchedTime,RealEndTime,ReadBytes,HasBase,PurgedFiles
> FROM Job WHERE JobId=30173
> bareos | 98175 | idle | SELECT
> VolSessionId,VolSessionTime,PoolId,StartTime,EndTime,JobFiles,JobBytes,JobTDate,Job,JobStatus,Type,Level,ClientId,Name,PriorJobId,RealEndTime,JobId,FileSetId,SchedTime,RealEndTime,ReadBytes,HasBase,PurgedFiles
> FROM Job WHERE JobId=30174
> bareos | 98177 | idle | SELECT
> VolSessionId,VolSessionTime,PoolId,StartTime,EndTime,JobFiles,JobBytes,JobTDate,Job,JobStatus,Type,Level,ClientId,Name,PriorJobId,RealEndTime,JobId,FileSetId,SchedTime,RealEndTime,ReadBytes,HasBase,PurgedFiles
> FROM Job WHERE JobId=30175
> bareos | 98179 | idle | SELECT
> VolSessionId,VolSessionTime,PoolId,StartTime,EndTime,JobFiles,JobBytes,JobTDate,Job,JobStatus,Type,Level,ClientId,Name,PriorJobId,RealEndTime,JobId,FileSetId,SchedTime,RealEndTime,ReadBytes,HasBase,PurgedFiles
> FROM Job WHERE JobId=30176
> (28 rows)
>
>
> On 09/07/17 06:07, Stephan Duehr wrote:
>> Hi Douglas,
>>
>> I would expect one DB connection per running job as normal.
>> How do you have Maximum Concurrent Jobs configured?
>> I'm currently not sure if or why the DB Connection is already opened at
>> scheduled time, when
>> Maximum Concurrent Jobs is less then the number of scheduled jobs.
>>
>> Regards,
>>
>> Stephan
>>
>> On 08/09/2017 05:20 PM, Douglas K. Rand wrote:
>>> I'm having a problem where Bareos consumes all 150 of my Postgres
>>> connections and then backup jobs start to fail with
>>> the error:
>>>
>>> 06-Aug 21:00 bareos JobId 0: Fatal error: sql_pooling.c:83 Could not open
>>> database "bareos": ERR=postgresql.c:246 Unable
>>> to connect to PostgreSQL server. Database=bareos User=bareos
>>> Possible causes: SQL server not running; password incorrect;
>>> max_connections exceeded.
>>>
>>> I can keep bumping max_connections in Postgres, but there seems to be a
>>> problem here. I'm using Bareos 16.2.4 on FreeBSD
>>> 10.2 with Postgres 9.5.2.
>>>
>>> At a minute before the backups start there are two connections to Postgres:
>>>
>>> usename | pid | state | query
>>> ---------+-------+--------+---------------------------------------------------------
>>> bareos | 6542 | idle | SET client_encoding TO 'SQL_ASCII'
>>> bareos | 43277 | active | SELECT usename, pid, state, query FROM
>>> pg_stat_activity
>>>
>>> But a minute after backups start there are 96 connections to Postgres, I've
>>> attached the status to the email, which is a
>>> result of:
>>>
>>> psql --pset=pager=off --user=bareos --dbname=bareos --command="SELECT
>>> usename, pid, state, query FROM pg_stat_activity"
>>>
>>> lsof -i :postgresql
>>>
>>> ps -axlwwH -U bareos
>>>
>>> As you can see there are 9 UPDATE Media statements running, all via
>>> different connections each from a different Bareos
>>> thread; and 74 SELECT count(*) from Media statements also each from
>>> different threads; and then a handful of other
>>> statements. Each connection is from the Bareos director process, but from
>>> what seems to be different threads.
>>>
>>> It almost seems that each scheduled spawns a thread for when that job is
>>> scheduled to run (21:00 in my case) and then as
>>> the backups finish the threads go away, along with the Postgres connection.
>>> Here are the number of Postgres connections
>>> over time:
>>>
>>> 2017-08-08/21:00:00:(2 rows)
>>> 2017-08-08/21:01:00:(96 rows)
>>> 2017-08-08/21:02:00:(92 rows)
>>> 2017-08-08/21:03:00:(94 rows)
>>> 2017-08-08/21:05:00:(93 rows)
>>> 2017-08-08/21:06:00:(91 rows)
>>> 2017-08-08/21:07:00:(89 rows)
>>> 2017-08-08/21:08:00:(87 rows)
>>> 2017-08-08/21:09:00:(84 rows)
>>> 2017-08-08/21:10:00:(78 rows)
>>> 2017-08-08/21:11:00:(77 rows)
>>> 2017-08-08/21:12:00:(75 rows)
>>> 2017-08-08/21:13:00:(72 rows)
>>> 2017-08-08/21:14:00:(71 rows)
>>> 2017-08-08/21:15:00:(64 rows)
>>> 2017-08-08/21:16:00:(63 rows)
>>> 2017-08-08/21:17:00:(60 rows)
>>> 2017-08-08/21:18:00:(58 rows)
>>> 2017-08-08/21:19:00:(56 rows)
>>> 2017-08-08/21:20:00:(53 rows)
>>> 2017-08-08/21:21:00:(51 rows)
>>> 2017-08-08/21:23:00:(48 rows)
>>> 2017-08-08/21:24:00:(46 rows)
>>> 2017-08-08/21:25:00:(44 rows)
>>> 2017-08-08/21:26:00:(43 rows)
>>> 2017-08-08/21:27:00:(42 rows)
>>> 2017-08-08/21:28:00:(41 rows)
>>> 2017-08-08/21:31:00:(40 rows)
>>> 2017-08-08/21:32:00:(34 rows)
>>> 2017-08-08/21:33:00:(28 rows)
>>> 2017-08-08/21:34:00:(24 rows)
>>> 2017-08-08/21:35:00:(21 rows)
>>> 2017-08-08/21:36:00:(19 rows)
>>> 2017-08-08/21:37:00:(13 rows)
>>> 2017-08-08/21:44:00:(11 rows)
>>> 2017-08-08/21:51:00:(9 rows)
>>> 2017-08-08/21:53:00:(7 rows)
>>> 2017-08-08/21:56:00:(6 rows)
>>> 2017-08-08/22:47:00:(5 rows)
>>> 2017-08-09/02:13:00:(4 rows)
>>> 2017-08-09/02:16:00:(3 rows)
>>>
>>> Backup completes at 02:15
>>>
>>
>
--
Stephan Dühr [email protected]
Bareos GmbH & Co. KG Phone: +49 221-630693-90
http://www.bareos.com
Sitz der Gesellschaft: Köln | Amtsgericht Köln: HRA 29646
Komplementär: Bareos Verwaltungs-GmbH
Geschäftsführer: S. Dühr, M. Außendorf, J. Steffens, Philipp Storz
--
You received this message because you are subscribed to the Google Groups
"bareos-users" group.
To unsubscribe from this group and stop receiving emails from it, send an email
to [email protected].
To post to this group, send email to [email protected].
For more options, visit https://groups.google.com/d/optout.
