I On Sunday 12 January 2003 17:03, you wrote: > > Hey people > > Just thought I'd forward this on to the dev list just in case it's > something that should be looked at. The remark was made by Sandworm who > is currently working on Frost about why there are duplicate files with > the new FEC version. > > ----- Sandworm ----- 2003.1.12 - 18:47:34 ----- > I've checked the issue with the keys and the explanation may be simple. > What I found is that both files are identical and the splitfile metadata > has a different key for the last block of the file. Do mean you insert the exact same file and you get SplitFile metadata with different check and data CHKs? If this is true it is a bug and I would like any info you can provide on reproducing it.
>This may reasonably > be caused by a change of the data beyond EOF sent for generation of the > key and put into the chunk file in one of the versions since first > upload if the file. What does this mean? What data beyond EOF? > > However I still wonder whether we should rely on the sequence of lines > in the metadata returned by freenet. A change of the sort order over the > versions would result in different keys for the files - not a good idea. > We depend on the FEC implementation anyhow, but we probably should not > depend on the sort order. I have prepared a version where the splitfile > entries are sorted and will test it. > > What do you guys suggest? I think we need to add a field containing a hash of the entire file to the SplitFile metadata so you can tell when two lexical different SplitFiles reconstruct files that are bit for bit identical. It could either be a CHK or maybe an MD5. Suggested fieldname: CheckSum e.g. SplitFile.CheckSum=something_that_looks_like_line_noise --gj > ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ > Sandworm - Digging the grounds for a free world > PGP key fingerprint: DD5B 782C 37FF 1DF7 2CF3 A944 26CE A571 B8B2 2B82 > ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ ---------------------------------------- Content-Type: text/html; charset="us-ascii"; name="Attachment: 1" Content-Transfer-Encoding: quoted-printable Content-Description: ---------------------------------------- _______________________________________________ devl mailing list [EMAIL PROTECTED] http://hawk.freenetproject.org/cgi-bin/mailman/listinfo/devl
