On Tue, May 16, 2017 at 6:15 PM, Martin Vahi <martin.v...@softf1.com> wrote:
> > > ---console--session--excerpt--start---- > SQLITE_NOMEM: failed to allocate 651456745 bytes of memory > SQLITE_NOMEM: statement aborts at 22: [INSERT INTO > blob(rcvid,size,uuid,content)VALUES(6,662828201,' > 9b81ec309fc0c2f2278f386c8b1917359fe24bd8',:data)] > Even if committing in chunks were feasible (it's currently not, unless i'm sorely mistaken), that wouldn't solve the problem of trying to commit a 650MB file, because chunks would/could presumably not span across individual files. Checking in a new version of that file (of a similar size) will take more than twice that amount of memory (see below). > fossil: SQL error: out of memory > SQLITE_ERROR: statement aborts at 1: [ROLLBACK] cannot rollback - no > transaction is active > ---console--session--excerpt--end------ > > The obvious line of thought might be that > I should just upgrade my hardware, but if there's > no fundamental reason, why files can not be > committed in chunks For one, fossil's delta implementation requires that the whole file contents be in memory (plus memory for storing the delta from the previous version, if any). Applying a delta requires both the original version, the delta, and the new copy (with the delta applied) to be in memory at once. Thus it cannot be used to manage huge files on systems with really limited memory. > The idea is that some embedded systems have only > 64MiB of RAM, which is actually pretty much, > given that in the 90'ties my desktop computer > had about 40MiB. That was in the 90's. Nowadays web browsers regularly allocate that amount of memory (or more) just for the JavaScript engine. i'm not saying "go buy more hardware," but several parts of fossil's internals require amounts of memory directly related to (but notably larger than) the size of the biggest file being operated on. -- ----- stephan beal http://wanderinghorse.net/home/stephan/ "Freedom is sloppy. But since tyranny's the only guaranteed byproduct of those who insist on a perfect world, freedom will have to do." -- Bigby Wolf
_______________________________________________ fossil-users mailing list fossil-users@lists.fossil-scm.org http://lists.fossil-scm.org:8080/cgi-bin/mailman/listinfo/fossil-users
