>>>>> On Fri, 10 Feb 2006 10:19:16 -0500, "Dan Langille" <[EMAIL PROTECTED]> >>>>> said: > Priority: normal > Content-description: Mail message body > > On 10 Feb 2006 at 15:12, Martin Simmons wrote: > > > >>>>> On Fri, 10 Feb 2006 06:58:56 -0800, Karl Hakimian <[EMAIL PROTECTED]> > > >>>>> said: > > > > > > > I don't think COPY will be useful. > > > > > > I don't think I'm ready to give up on the copy command yet. The amount > > > of data in the filename and path tables is small compared to the file > > > table. If we created a copy command while updating the file and path > > > tables and then dumped the file updates via copy, that should be a > > > significant speed improvement. > > > > > > > http://www.postgresql.org/docs/8.1/static/sql-copy.html > > > > > > > > The data we are adding to the database does not already exist. > > > > There's nothing to COPY. > > > > > > We should be able to created it from the spooled attributes. > > > > > > > I think transactions are more important here. We need to look more > > > > closely at that. > > > > > > I believe transactions would help quite a bit. Seems to me I saw some > > > transaction code in bacula commented out. Does anyone know why it was > > > removed? > > > > Because it was tied to multiple connections and this made it fatally broken > > because of how the filename and path tables are updated. > > Is there any way around it?
Lots. We keep discussing them ad nauseam :-) > Using two transactions, one for the vital components, the other for > non-vital portions. > > Or do we need to revisit how these tables are updated? Yes, it would be possible to commit the filename/path inserts immediately (i.e. 1 insert per transaction) but still do the file inserts within a larger transaction. I'm not sure if postgresql would need two connections to do this or if it can handle multiple simultaneous transactions on one connection. Another much simpler way for spooling users would be to add a pthread lock around the catalog despooling code so it could be done within a transaction. __Martin ------------------------------------------------------- This SF.net email is sponsored by: Splunk Inc. Do you grep through log files for problems? Stop! Download the new AJAX search engine that makes searching your log files as easy as surfing the web. DOWNLOAD SPLUNK! http://sel.as-us.falkag.net/sel?cmd=lnk&kid=103432&bid=230486&dat=121642 _______________________________________________ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users