-----BEGIN PGP SIGNED MESSAGE----- Hash: SHA256 For deduplication, one needs a cheap, rolling hash [1]. Reliability, cryptographic security are not needed. Au contrarie, it is a good thing that some inputs "clash" on zero - you choose your block boundaries there.
This way a single byte's change in the file results only the containing block's change and maybe the next block - but not more! --- [1]: https://en.wikipedia.org/wiki/Rolling_hash#Content-based_slicing_using_moving_sum ‐‐‐‐‐‐‐ Original Message ‐‐‐‐‐‐‐ On 2019. February 11., Monday 18:06, Simon B. <[email protected]> wrote: > Tamas, thank you, and sorry for my misinformation. Reading this > https://stackoverflow.com/questions/6043708/how-reliable-is-the-adler32-checksum > it seem important to not use Adler32 for large chunks. Probably perkeep still > needs a short + a technical onboarding video or "slides". > > I'm interested in any links or people up to putting together at least the > bullet points for something like that. > > thanks again > > -- > You received this message because you are subscribed to the Google Groups > "Perkeep" group. > To unsubscribe from this group and stop receiving emails from it, send an > email to [email protected]. > For more options, visit https://groups.google.com/d/optout. -----BEGIN PGP SIGNATURE----- Version: ProtonMail Comment: https://protonmail.com wsBcBAEBCAAGBQJcYa1tAAoJELj70Bsqr19tsx0H/RgtSv6CATiUvMVrBgVs TGbaLFMcKV2Rmd3TvKjY2xV+SZChlsq5o7ijlUEs8YXWWW3bZ4YA2O+l2QHx lK0cdeCi/VXLzCu0GQ0jNqDUTpV/XLA+0Yp+VrbOVz0yIwSEEpR4AMTiUaB+ So78O8F5pxm5NOdXXV+uruncfTI6G5A+uSm/vPCmKD+EDQ+lKzykMy7PODI0 C9jONHZ8U9WXAuwSHHbv9HnalpFUpqhT1vSz73YsYV9aB6/4HrIZn54KOlz+ z1EHmUnU9ggX4eyCMSAFktAgGida18c0NCmxRUaZ3o15QbGMFK7PnvjyzZsO UYbyKeHAfwrQd2gqUxr+T40= =sPiT -----END PGP SIGNATURE----- -- You received this message because you are subscribed to the Google Groups "Perkeep" group. To unsubscribe from this group and stop receiving emails from it, send an email to [email protected]. For more options, visit https://groups.google.com/d/optout.
publickey - [email protected] - 0x78A4747D.asc
Description: application/pgp-keys
publickey - [email protected] - 0x78A4747D.asc.sig
Description: PGP signature
