If this is a one-time thing, you could keep it simple by using some standard unix tools.
If the file has fixed width fields, you could remove columns pretty easily with block edit mode in vim. Then you may be able to grep out the lines you want and save them to a different file. If this is something you will need to do more than once, or your querying needs cannot be easily handled by grep, then definitely take the time to get your data loaded into a database. I'd also recommend PostgreSQL, but MySQL would also work (and may have more user-friendly tools to help). SQLite could be useful too, and it's now included with Python 2.5, so you get a great little database and an awesome scripting language all in one! So there's many choices...good luck. Grant On 1/24/07, Mike McKay <[EMAIL PROTECTED]> wrote:
Dennis Bagley wrote: > The database is a TEXT file, tab delimited - yes a flat file > I have tried importing it into > > Paradox, HSQLDB, Open Office Base and Calc, Excel - > > I was playing with the spreadsheets thinking at the very least I could > eliminate the fields > I do not want, but the same record/row limit appears to be built into > all of these. > (When I said 65K it's 65,536 records or 1024 x 64 so I guess technically > it's really 64K.) > > Joshua has suggested POSTGRESQL, which I am not familiar with at all or > MySQL. > I know a little about MySQL but must admit that when it comes to databases > I hate working on the command line and have not installed MySQL on my > machine yet. Sqlite might be a good option. Looks like there is a GUI for it: http://sourceforge.net/projects/sqlitebrowser/ Mysql has a limited but nice GUI interface - mysql query browser might be able to hand hold you through the import. There is also Kexi - http://www.kexi-project.org/ which is more MS Access like. _______________________________________________ RLUG mailing list RLUG@rlug.org http://lists.rlug.org/mailman/listinfo/rlug
_______________________________________________ RLUG mailing list RLUG@rlug.org http://lists.rlug.org/mailman/listinfo/rlug
