Tony and Albert:
Thanks for the insights. Cannot see a structural issue (yet), as both
halves imported without burping; but an antivirus delay is an intriguing
idea. If one assumes that antivirus was also interested in, and active
on, all the shorter files which imported without incident, then file
size seems implicated; suggesting the crossing of an internal delay
threshold within R:BASE ("uh, I've waited long enough") due to AV dwell
time. May be worth an experiment or two.
Thanks!
Bruce
------ Original Message ------
Sent: 12/9/2018 10:42:57 PM
Subject: RE: [RBASE-L] - GATEWAY IMPORT CSV - Practical Record Count /
File Size Limit?
From: "Tony IJntema" <[email protected]>
To: [email protected]
Bruce,
I have an application which imports several files of more than a million
rows (size > 100 MB) and encounter no problems.
My suggestion is to have a look into the file if there is a structure
problem, like a missing quote or something else.
You can start reading 600.000 rows and look what happens and so on
Tony
Van:[email protected] [mailto:[email protected]] Namens
Bruce A. Chitiea
Verzonden: maandag 10 december 2018 2:07
Aan:[email protected]
Onderwerp: [RBASE-L] - GATEWAY IMPORT CSV - Practical Record Count /
File Size Limit?
Win10Pro / RGBX5E
GATEWAY IMPORT CSV
Wondering if there's a practical limit to the record count or file size
of a source CSV file, or if there's a "choke" setting to be tweaked.
I had successfully imported several CSV files, the largest of which
contained 634,500 records (101mb. )
RBASE started and then dropped efforts (without error message) to import
a file containing 800,000 records (128mb. )
Without additional modification to internal data or structure, once this
file was cut into halves (400,000 records, @64mb each), RBASE happily
imported the halves.
Thoughts?
Best wishes for the season, all!
Bruce Chitiea
SafeSectors, Inc.
909.238.9012 m
--
For group guidelines, visit
http://www.rbase.com/support/usersgroup_guidelines.php
---
You received this message because you are subscribed to the Google
Groups "RBASE-L" group.
To unsubscribe from this group and stop receiving emails from it, send
an email to [email protected].
For more options, visit https://groups.google.com/d/optout.
--
For group guidelines, visit
http://www.rbase.com/support/usersgroup_guidelines.php
---
You received this message because you are subscribed to the Google
Groups "RBASE-L" group.
To unsubscribe from this group and stop receiving emails from it, send
an email to [email protected].
For more options, visit https://groups.google.com/d/optout.
--
For group guidelines, visit
http://www.rbase.com/support/usersgroup_guidelines.php
---
You received this message because you are subscribed to the Google Groups "RBASE-L" group.
To unsubscribe from this group and stop receiving emails from it, send an email
to [email protected].
For more options, visit https://groups.google.com/d/optout.
