My db definitely did go up in size with fts - which I think is ok just because that's what needs to be when using fts. So I'm not concerned so much about the stop words and things, although I agree that adjusting that list would definitely help.
Since I'm on a mobile device, space is key. I think if I wasn't using fts, I'd still want to compress the db. But the fact that I need both has led me to try to figure this out. I was just wondering if by some chance someone had done the hard work already of wrapping in some compression functions into the amalgamation src - saves me some work. But if they haven't then this might be something I will have to do over the next few months. While there would probably be some sort of speed hit, I think compression, especially for mobile devices, would definitely be useful. In the case for the app I'm working on, our writes can afford to be slowest and therefore use the max compression, which could possibly give us a nice small db size. Alexey's code provided a good starting point, so I'll probably start there. Thanks for the reply. - jason On Tue, Mar 2, 2010 at 4:25 AM, Max Vlasov <[email protected]> wrote: > On Tue, Mar 2, 2010 at 2:41 AM, Jason Lee <[email protected]> wrote: > >> Hi all, >> >> I've been playing around with the FTS3 (via the amalgamation src) on a >> mobile device and it's working well. But my db file size is getting >> pretty big and I was looking for a way to compress it. >> > > > Jason, can you calculate the ratio between your text data and fts3 data? > From my tests it showed that fts eats not so much. For example, once I tried > en wikipedia abstracts as a test file (downloadable xml, I took title and > abstract from it), it's 3M records, 500M file without fts, after indexing > the size has changed to 1,5G. And I even didn't use stop-words. So with > proper stop-words usage the ratio can even be better. > > Max > _______________________________________________ > sqlite-users mailing list > [email protected] > http://sqlite.org:8080/cgi-bin/mailman/listinfo/sqlite-users > _______________________________________________ sqlite-users mailing list [email protected] http://sqlite.org:8080/cgi-bin/mailman/listinfo/sqlite-users
