Another option, using standard unix tools: sort both lists and use comm: $ sort smalllist > sorted.smalllist $ sort biglist > sorted.biglist $ comm -12 sorted.smalllist sorted.biglist
-- Edward From: [email protected] [mailto:[email protected]] On Behalf Of Richard Stovall Sent: Tuesday, June 28, 2016 11:03 AM To: [email protected] Subject: [NTSysADM] Compare two large lists Not necessarily Windows-related. I need to compare a list of about 300,000 file hashes against a larger list of ~30,000,000 and find ones that are represented in both data sets. I'm not a database guy, nor have I ever played one on TeeVee. Any ideas about how to go about this with standard/free tools in Windows or Linux? TIA, RS
