Javier,
When loading records of such magnitude, fwiw, you
will see a huge different if you DROP INDEX
colname IN tablename (or DROP INDEX tablename.columnname) first.
After loading the data, you can BUILD the INDEX as you see fit.
Very Best R:egards,
Razzak
At 12:08 AM 7/1/2021, [email protected] wrote:
I just finished loading 170,000+ records from a
CSV file. I was loading only 4 of the 8 columns
in the *.CSV file and it did take a long time.
The receiving table had 1 Index and that might
have slowed down the loading process. I need to
test loading into a table with no indices and build the index afterwards.
Javier,
Javier Valencia, PE
913-915-3137
-----Original Message-----
From: [email protected] <[email protected]> On Behalf Of daved
Sent: Wednesday, June 30, 2021 6:34 AM
To: [email protected]
Subject: Re: [RBASE-L] - Importing Data
Has anyone had a problem importing excel files
(and using excel format) where the sheet
contains greater than 50,000 rows? For some
reason, the gateway utility does not show the
individual worksheets on the file to select
from, but when I eliminated rows from the
worksheet I need to import to get it down to <50,000 rows, it works fine.
Dave Dickey, President & Senior Consultant, HTM Insource, LLC
---- Original Message ----
From: "Randyp" <[email protected]>
Sent: 6/29/2021 9:28:19 PM
To: [email protected]
Subject: Re: [RBASE-L] - Importing Data
I import a CVS file then rename columns which
makes data compatible with existing tables. This
could be done with an update table command. Your
additional procedures could follow in order.
You might append to an empty existing table to
have the benefit of pre-defined indexes and
computed columns. The newly populated table
could be the source for a view or views automating the averaging of values.
Randy Peterson
Sent from my iPhone
> On Jun 29, 2021, at 7:03 PM, [email protected] wrote:
>
> Thanks R:azzak,
>
> Yes, it helps. I was using the option to
create a new table from the import file and the
"Specifications" button is not available; It is
only available when importing data into an
existing table. I have used this approach
before and I knew there was a way of generating a specification file.
> I can create the receiving table ahead of
time as a workaround. I am trying to create a
utility that automates the entire process, from
importing the data, adding an index adding
calculated columns and then running a procedure
to populate another table with the averaged values.
> I should have enough now to get me going. 😊
>
> Javier,
>
> Javier Valencia, PE
> 913-915-3137
>
>
> -----Original Message-----
> From: [email protected] <[email protected]> On Behalf Of
> A. Razzak Memon
> Sent: Tuesday, June 29, 2021 5:03 PM
> To: [email protected]
> Subject: Re: [RBASE-L] - Importing Data
>
> Javier,
>
> It is the [Specifications ...] button during
the whole process of setting up the Import process.
>
> See attached.
>
> Hope it helps!
>
> Very Best R:egards,
>
> Razzak
>
> At 05:47 PM 6/29/2021, [email protected] wrote:
>
>> I need to import 170,000 rows of data from either a CSV or an Excel
>> file and I would like to create a specification file  (*.RGW) with
>> all the parameters so I can run t from command line. I remember
>> having the  option to create the import using the Gateway Utility
>> and then storing the parameters in a RGW type file but I do not seem
>> to find where the option is or how to do it.
>>
>> When importing using the Excel import it gives me the option of using
>> row 1 to read the column names; I do not seem to get this option when
>> using CSV; is this not available?
>>
>> Also, when changing the columns names on the import file to match
>> current columns, it tells me the columns already exist even when
>> the type and length are identical so I have
to change the name to something else.
>>
>> Obviously I have not used this feature in a while and my skills are
>> rusty and the newer version are probably different than the last one
>> when I use Gateway. Any light you can shed would be appreciated.
>>
>> Javier,
>>
>> Javier Valencia, PE
>
> --
> For group guidelines, visit
> http://www.rbase.com/support/usersgroup_guidelines.php
> ---
> You received this message because you are
subscribed to the Google Groups "RBASE-L" group.
> To unsubscribe from this group and stop
receiving emails from it, send an email to
[email protected].
> To view this discussion on the web visit
https://groups.google.com/d/msgid/rbase-l/0LptxZ-1lKsfD37El-00fi3C%40mrelay.perfora.net.
>
> --
> For group guidelines, visit
> http://www.rbase.com/support/usersgroup_guidelines.php
> ---
> You received this message because you are
subscribed to the Google Groups "RBASE-L" group.
> To unsubscribe from this group and stop
receiving emails from it, send an email to
[email protected].
> To view this discussion on the web visit
https://groups.google.com/d/msgid/rbase-l/!%26!AAAAAAAAAAAYAAAAAAAAAG1gU%2BA71stIig71BAFnx9iihQAAEAAAAA66%2Bbnmq3pGoOuGF2JPWzkBAAAAAA%3D%3D%40vtgonline.com.
--
For group guidelines, visit
http://www.rbase.com/support/usersgroup_guidelines.php
---
You received this message because you are
subscribed to the Google Groups "RBASE-L" group.
To unsubscribe from this group and stop
receiving emails from it, send an email to
[email protected].
To view this discussion on the web visit
https://groups.google.com/d/msgid/rbase-l/EFDF36BD-5282-4BCD-BA43-0C131974FCE1%40ctags.com.
--
For group guidelines, visit
http://www.rbase.com/support/usersgroup_guidelines.php
---
You received this message because you are
subscribed to the Google Groups "RBASE-L" group.
To unsubscribe from this group and stop
receiving emails from it, send an email to
[email protected].
To view this discussion on the web visit
https://groups.google.com/d/msgid/rbase-l/202106300733447.SM6792722%40MAIL1.
--
For group guidelines, visit
http://www.rbase.com/support/usersgroup_guidelines.php
---
You received this message because you are
subscribed to the Google Groups "RBASE-L" group.
To unsubscribe from this group and stop
receiving emails from it, send an email to
[email protected].
To view this discussion on the web visit
https://groups.google.com/d/msgid/rbase-l/!%26!AAAAAAAAAAAYAAAAAAAAAG1gU%2BA71stIig71BAFnx9iihQAAEAAAALhCgJCstN1Fmafe5duE2BEBAAAAAA%3D%3D%40vtgonline.com.
--
For group guidelines, visit
http://www.rbase.com/support/usersgroup_guidelines.php
---
You received this message because you are subscribed to the Google Groups "RBASE-L" group.
To unsubscribe from this group and stop receiving emails from it, send an email
to [email protected].
To view this discussion on the web visit
https://groups.google.com/d/msgid/rbase-l/0LgJSE-1lT5xp1VTw-00ndYY%40mrelay.perfora.net.
