Re: [sqlite] FTS & Doc Compression

2010-03-25 Thread Alexey Pechnikov
Hello! On Tuesday 02 March 2010 02:41:46 Jason Lee wrote: > I've been playing around with the FTS3 (via the amalgamation src) on a > mobile device and it's working well. But my db file size is getting > pretty big and I was looking for a way to compress it. I've seen some > earlier posts from

Re: [sqlite] FTS & Doc Compression

2010-03-25 Thread Alexey Pechnikov
Hello! On Tuesday 02 March 2010 15:25:35 Max Vlasov wrote: > can you calculate the ratio between your text data and fts3 data? In my databases with unicode texts compressed data is about 25% of original. Best regards, Alexey Pechnikov. http://pechnikov.tel/

Re: [sqlite] FTS & Doc Compression

2010-03-03 Thread Alexandre Courbot
While I am not directly concerned by the problem, a possibility to transparently compress the text of FTS3 tables (not the indexes, just the contents of the virtual column) using zlib would be great. I cut a database size in half by doing this on non-fts3 text tables. DEFLATE being very efficient

Re: [sqlite] FTS & Doc Compression

2010-03-02 Thread Jason Lee
My db definitely did go up in size with fts - which I think is ok just because that's what needs to be when using fts. So I'm not concerned so much about the stop words and things, although I agree that adjusting that list would definitely help. Since I'm on a mobile device, space is key. I

Re: [sqlite] FTS & Doc Compression

2010-03-02 Thread Max Vlasov
On Tue, Mar 2, 2010 at 2:41 AM, Jason Lee wrote: > Hi all, > > I've been playing around with the FTS3 (via the amalgamation src) on a > mobile device and it's working well. But my db file size is getting > pretty big and I was looking for a way to compress it. > Jason, can

[sqlite] FTS & Doc Compression

2010-03-01 Thread Jason Lee
Hi all, I've been playing around with the FTS3 (via the amalgamation src) on a mobile device and it's working well. But my db file size is getting pretty big and I was looking for a way to compress it. I've seen some earlier posts from Alexey for his compression modifications to the FTS3