Re: grep pattern to find special combinations of fields in a large csv file

2020-07-29 Thread David G Wagner
You will have in history and you can use the script editor to record your actions, save that output and execute. Personally a Perl individual, but you should be able to follow the shooting... A thought... Wags ;) WagsWorld Hebrews 4:15 Ph(primary) : 408-914-1341 Ph(secondary): 408-761-7391 On

Re: grep pattern to find special combinations of fields in a large csv file

2020-07-29 Thread Lewis Downey
Neil, face, No doubt you are right. By now i should be perfectly comfortable building and querying MySQL tables. However so far I have punted on learning SQL. Same for Perl. It could still happen, maybe... Thanks for the replies. (still curious if grep could find the correct results.) --

Re: grep pattern to find special combinations of fields in a large csv file

2020-07-29 Thread Lewis Downey
Robin, Your text filter works like a charm! The results are in some kind of funky order but accurate. The filter barely took moments to runs - a gigantic improvement. I have not yet found a way to script the application of the filter, but if that never happens spending 60 seconds to run the

Re: grep pattern to find special combinations of fields in a large csv file

2020-07-29 Thread face
These things are so much easier in a database...with a simple MySQL table of cv19(recDate, county, state, FIPS, cases, deaths) bulk load the data and execute the query 'select recDate, county, state , count(deaths), min(deaths) from cv19 where deaths > 0 group by county, state order by

Re: grep pattern to find special combinations of fields in a large csv file

2020-07-29 Thread Robin Beech
I often write scripts to process text that I put in the text filters folder so they are accessible from the Text menu, maybe this is what you plan for your grep script. If find awk is very good for processing large volumes of data organized by column. Here is an awk text filter that seems to

Re: grep pattern to find special combinations of fields in a large csv file

2020-07-29 Thread Neil Faiman
AppleScript is wonderful as a glue language. As a data processing language, not so much. BBEdit is happy running any sort of scripts, not just AppleScript.This looks like it should be trivial in Perl. Regards, Neil Faiman > On Jul 29, 2020, at 9:54 AM, Lewis Downey wrote: > >

grep pattern to find special combinations of fields in a large csv file

2020-07-29 Thread Lewis Downey
Hello! I do not know where to start to put together a grep pattern that will parse a 375,000+ line csv file in a specific way for a personal project. The file is publicly available from the NY Times and contains data related to tracking Covid-19