Thanks for the reply Matt... Just as an FYI...
I updated my code to track duplicates and then did a sample run over a 5 minute period that once a minute paged in new results for the query "http filter:links" This resulted in about 11 pages of results each minute and over the 11 pages I saw anywhere from 60 - 150 duplicates so it's not just 3 or 4. My concern isn't really around the extra updates it's the fact that sometimes updates are missing. Anyway... It sounds like you guys are working on it and I just thought I'd share that data point with you. -steve
