The size of the log files is why there are specialty programs to summarize and analyze them. However, I usually use a combination of CLI tools and BBEdit to pull out the information that I want. Some of the CLI tools seem more efficient than loading the file into BBEdit and using its tools to accomplish these same things.
For example, I wanted to pull 404 errors out of a folder of tab-delimited log files so I used grep to filter out lines which contained a 404 field and piped that to cut which pulled out just the 8th field (which was the file name in this log), sorted the results, filtered to unique, and piped to BBEdit for display and further processing. grep "\t404\t" * | cut -f 8 | sort | uniq | bbedit The actual command I ended up with did two passes to make sure I didn't have any records which contained a length field of 404 or the like. The cut could be first, but the two passes seemed faster since the grep filtered out most of the 200 and 30x entries. grep "\t404\t" * | cut -f 8,9 | grep "\t404" | cut -f 1 | sort | uniq | bbedit Hope this helps, [fletcher] > On Nov 17, 2016, at 7:40 AM, Jonathan Duke <[email protected]> wrote: > > I love BBEdit (since the classic days), but when I'm trying to open and > search some immense log files from our server it just isn't doing the job. > > I know it isn't the best tool for something like this, but when all you have > is a hammer… > > What would people suggest for files of this size (I'm downloading a log file > right now that is already 14 GB of an unknown total). > > Thanks. > > Cheers, > Jon > > -- > This is the BBEdit Talk public discussion group. If you have a > feature request or would like to report a problem, please email > "[email protected]" rather than posting to the group. > Follow @bbedit on Twitter: <http://www.twitter.com/bbedit> > --- > You received this message because you are subscribed to the Google Groups > "BBEdit Talk" group. > To unsubscribe from this group and stop receiving emails from it, send an > email to [email protected]. > To post to this group, send email to [email protected]. > Visit this group at https://groups.google.com/group/bbedit. -- This is the BBEdit Talk public discussion group. If you have a feature request or would like to report a problem, please email "[email protected]" rather than posting to the group. Follow @bbedit on Twitter: <http://www.twitter.com/bbedit> --- You received this message because you are subscribed to the Google Groups "BBEdit Talk" group. To unsubscribe from this group and stop receiving emails from it, send an email to [email protected]. To post to this group, send email to [email protected]. Visit this group at https://groups.google.com/group/bbedit.
