Sean, Have you considered simply not storing most of the differences that you have?
In particular, can you use something like LLR to find the 5% (or even 1%) of the differences that really matter and just tossing the rest? That will compress your data better than anything I could do with bit twiddles. -- Ted Dunning, CTO DeepDyve
