Matt - I have a similar issue. When I work with a new voter file report I may have 900,000 lines of data. Since I'm converting the data to a .csv file I have to first find all commas and get rid of them. There aren't supposed to be any but there always are some so I use EM Editor to search and replace the commas with blank spaces. I can't think of an easier way to do it. BTW, EM Editor rips through those 900,000 records really quickly. I also replace a couple of million tabs with commas and then delete all quote marks. My imports are clean.
Years ago I used to break that big file into ten pieces, bring each into WP Editor and do about the same. This is so, so much easier. Don *Don FriedmanProfessionalRecords.Com LLCPRS Data Systems* *205 S Main StreetPittsburgh, PA 15215412-784-1600 - 1-800-PRS-FILE 412-784-1615 Fax* On Wed, Feb 4, 2015 at 11:47 AM, Matt Dwyer, PE <[email protected]> wrote: > To import long DP text fields (e.g, A80A10) into SQL, preferably using an > INSERT query, what is best practice to get around the combination of single > quotes in text fields and the 78 character subfield issue? > > I can print longer text fields of course using A0A0 format, but I would > like to turn fix the single quotes ( ' into '' ) where they occur in the > middle of a text field, and subfield function truncates to 78 characters > (drat). > > At the moment, I use | as my delimiter in the report from DP instead of > single quote and then do a search and replace with a text editor (' become > '' and then | becomes '). I guess I could write an app to do that but have > not done that yet... > > Anyone have a favorite/best practice? > > _______________________________________________ > Dataperf mailing list > [email protected] > http://lists.dataperfect.nl/cgi-bin/mailman/listinfo/dataperf > >
_______________________________________________ Dataperf mailing list [email protected] http://lists.dataperfect.nl/cgi-bin/mailman/listinfo/dataperf
