Another way staying in BBEdit would be to do some neutralizing conversions before parsing into columns.

For example, when I need to embed newlines in a file of text records whose records are separated by newlines, I replace the internal newlines with another character that isn’t already in the records somewhere - such as a backslash (‘\’). It looks like your records all start with ‘200' and end with two consecutive semi-colons (‘;;’). If so, then you could search for newlines NOT surrounded by those.

When I do this I take a step and then save a copy of the file before moving to the next cleanup step. Always want to be able to back up a step or two if I goof.

[Sorry about the stupid smart quotes my new email client insists on converting from straight quotes.]

HTH

------ Original Message ------
From "Marshall Clow" <mtc...@gmail.com>
To bbedit@googlegroups.com
Date 3/26/2025 7:41:47 AM
Subject Re: How to filter / sort CSV-files by certain columns?

On Mar 26, 2025, at 7:25 AM, Vlad Ghitulescu <v...@ghitulescu.de> wrote:

You’re probably right re BBEdit vs other special tools - even Rich suggested this in the beginning of our conversation.

The question is: Which other tool exactly?

Excel would not import 3 million+ records 😔 and yes, I encountered the „helpful“ changes and some more too 😶

The Perl-CSV family of modules sounds like heaven 😉 - unfortunately I didn’t learn Perl yet 😶

I have done stuff with the ’csv’ module in python 3, but nothing this extensive.
        https://docs.python.org/3/library/csv.html

— Marshall




Thanks,

    - Bruce

_bruce__van_allen__santa_cruz__ca_


--
This is the BBEdit Talk public discussion group. If you have a feature request or believe that 
the application isn't working correctly, please email "supp...@barebones.com" rather 
than posting here. Follow @bbedit on Mastodon: <https://mastodon.social/@bbedit>
--- You received this message because you are subscribed to the Google Groups "BBEdit Talk" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to bbedit+unsubscr...@googlegroups.com.
To view this discussion visit 
https://groups.google.com/d/msgid/bbedit/em3a519c56-ef50-4ccb-bcfb-de55aeab4fd2%40181c06df.com.

Reply via email to