There is definitely a way to do this by mapping the files, but if you don't know what mmap is you're going to have a hard time doing it. I think you might also have a hard time writing a better parser than is in the csv addon (which is pretty slow last I checked).
Jd is really the right way to go with this; the csv reader and writers for it are both world class for ingesting and exporting large data sets in csv format. Personally I'd just keep the data in Jd and be happy if you want to use the data. An ordinary laptop or desktop PC with Jd would be fine with this data, and you wouldn't have to shuffle DVDs. -SL On Tue, Mar 31, 2020 at 10:50 PM HH PackRat <[email protected]> wrote: > On 3/31/20, 'Jim Russell' via Programming <[email protected]> > wrote: > > If I may, and having heard no reply to my defense of component files, I'd > > suggest jfiles as a potential solution. Each record can take whatever > size > > you are comfortable with: a month, year, or decade. Or am I missing > > something (as usual)? > > I'm not trying to create a database. What I eventually want from this > project #4 is a DVD-ROM with 3,000 sets of historical (not current) > stock data between 1962 and 2017 that I can choose from to pull into > my PC for whatever analysis (cycles, Gann studies, etc.) that I may > wish to do. I have no need to have all this data constantly at my > fingertips and take up disk space. > > Thanks for your input! > > Harvey > ---------------------------------------------------------------------- > For information about J forums see http://www.jsoftware.com/forums.htm > ---------------------------------------------------------------------- For information about J forums see http://www.jsoftware.com/forums.htm
