>>>>> On Fri, 10 Feb 2006 10:19:16 -0500, "Dan Langille" <[EMAIL PROTECTED]> 
>>>>> said:
> Priority: normal
> Content-description: Mail message body
> 
> On 10 Feb 2006 at 15:12, Martin Simmons wrote:
> 
> > >>>>> On Fri, 10 Feb 2006 06:58:56 -0800, Karl Hakimian <[EMAIL PROTECTED]> 
> > >>>>> said:
> > > 
> > > > I don't think COPY will be useful.
> > > 
> > > I don't think I'm ready to give up on the copy command yet. The amount
> > > of data in the filename and path tables is small compared to the file
> > > table. If we created a copy command while updating the file and path
> > > tables and then dumped the file updates via copy, that should be a
> > > significant speed improvement.
> > > 
> > > >    http://www.postgresql.org/docs/8.1/static/sql-copy.html
> > > > 
> > > > The data we are adding to the database does not already exist.  
> > > > There's nothing to COPY.
> > > 
> > > We should be able to created it from the spooled attributes.
> > > 
> > > > I think transactions are more important here.  We need to look more 
> > > > closely at that.
> > > 
> > > I believe transactions would help quite a bit. Seems to me I saw some
> > > transaction code in bacula commented out. Does anyone know why it was
> > > removed?
> > 
> > Because it was tied to multiple connections and this made it fatally broken
> > because of how the filename and path tables are updated.
> 
> Is there any way around it?

Lots.  We keep discussing them ad nauseam :-)

> Using two transactions, one for the vital components, the other for 
> non-vital portions.
> 
> Or do we need to revisit how these tables are updated?

Yes, it would be possible to commit the filename/path inserts immediately
(i.e. 1 insert per transaction) but still do the file inserts within a larger
transaction.  I'm not sure if postgresql would need two connections to do this
or if it can handle multiple simultaneous transactions on one connection.

Another much simpler way for spooling users would be to add a pthread lock
around the catalog despooling code so it could be done within a transaction.

__Martin


-------------------------------------------------------
This SF.net email is sponsored by: Splunk Inc. Do you grep through log files
for problems?  Stop!  Download the new AJAX search engine that makes
searching your log files as easy as surfing the  web.  DOWNLOAD SPLUNK!
http://sel.as-us.falkag.net/sel?cmd=lnk&kid=103432&bid=230486&dat=121642
_______________________________________________
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users

Reply via email to