You can save your large excel file as a txt file and import it that way. I am importing files 500k+ using this method with no problems.
Lance Sent from my Verizon, Samsung Galaxy smartphone -------- Original message -------- From: "Richardson, Jeff" <[email protected]> Date: 6/30/21 10:35 AM (GMT-05:00) To: [email protected] Subject: RE: [RBASE-L] - Importing Data CAUTION: This Email is sent from outside our organization. Please DO NOT Click on any links or open any attachments unless you recognize the sender. Please forward any Suspicious Email "as an attachment" to [email protected]<mailto:[email protected]> Yes. I’ve also found that 50,000 seems to be the limit. I never determined a remedy to import more than 50,000 other than to break it up. Wish I had an answer. From: [email protected] <[email protected]> On Behalf Of daved Sent: Wednesday, June 30, 2021 7:34 AM To: [email protected] Subject: Re: [RBASE-L] - Importing Data Has anyone had a problem importing excel files (and using excel format) where the sheet contains greater than 50,000 rows? For some reason, the gateway utility does not show the individual worksheets on the file to select from, but when I eliminated rows from the worksheet I need to import to get it down to <50,000 rows, it works fine. Dave Dickey, President & Senior Consultant, HTM Insource, LLC ---- Original Message ---- From: "Randyp" <[email protected]<mailto:[email protected]>> Sent: 6/29/2021 9:28:19 PM To: [email protected]<mailto:[email protected]> Subject: Re: [RBASE-L] - Importing Data I import a CVS file then rename columns which makes data compatible with existing tables. This could be done with an update table command. Your additional procedures could follow in order. You might append to an empty existing table to have the benefit of pre-defined indexes and computed columns. The newly populated table could be the source for a view or views automating the averaging of values. Randy Peterson Sent from my iPhone > On Jun 29, 2021, at 7:03 PM, > [email protected]<mailto:[email protected]> wrote: > > Thanks R:azzak, > > Yes, it helps. I was using the option to create a new table from the import > file and the "Specifications" button is not available; It is only available > when importing data into an existing table. I have used this approach before > and I knew there was a way of generating a specification file. > I can create the receiving table ahead of time as a workaround. I am trying > to create a utility that automates the entire process, from importing the > data, adding an index adding calculated columns and then running a procedure > to populate another table with the averaged values. > I should have enough now to get me going. 😊 > > Javier, > > Javier Valencia, PE > 913-915-3137 > > > -----Original Message----- > From: [email protected]<mailto:[email protected]> > <[email protected]<mailto:[email protected]>> On Behalf Of A. > Razzak Memon > Sent: Tuesday, June 29, 2021 5:03 PM > To: [email protected]<mailto:[email protected]> > Subject: Re: [RBASE-L] - Importing Data > > Javier, > > It is the [Specifications ...] button during the whole process of setting up > the Import process. > > See attached. > > Hope it helps! > > Very Best R:egards, > > Razzak > > At 05:47 PM 6/29/2021, > [email protected]<mailto:[email protected]> wrote: > >> I need to import 170,000 rows of data from either a CSV or an Excel >> file and I would like to create a specification file  (*.RGW) with all >> the parameters so I can run t from command line. I remember having the >>  option to create the import using the Gateway Utility and then >> storing the parameters in a RGW type file but I do not seem to find >> where the option is or how to do it. >> >> When importing using the Excel import it gives me the option of using >> row 1 to read the column names; I do not seem to get this option when >> using CSV; is this not available? >> >> Also, when changing the columns names on the import file to match >> current columns, it tells me the columns already exist even when the >> type and length are identical so I have to change the name to something else. >> >> Obviously I have not used this feature in a while and my skills are >> rusty and the newer version are probably different than the last one >> when I use Gateway. Any light you can shed would be appreciated. >> >> Javier, >> >> Javier Valencia, PE > > -- > For group guidelines, visit > http://www.rbase.com/support/usersgroup_guidelines.php<https://nam04.safelinks.protection.outlook.com/?url=http%3A%2F%2Fwww.rbase.com%2Fsupport%2Fusersgroup_guidelines.php&data=04%7C01%7Clhannaw%40bronxleb.org%7Cf312946ad840407d4a1c08d93bd41f8b%7C4298a6c031114e0cb60c030ea7ab66ee%7C0%7C0%7C637606605451376781%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000&sdata=0rdMvlcTlxo%2FvZ9dbEmFvyXQpyQVTmO%2Bg4h4M7U82TU%3D&reserved=0> > --- > You received this message because you are subscribed to the Google Groups > "RBASE-L" group. > To unsubscribe from this group and stop receiving emails from it, send an > email to > [email protected]<mailto:[email protected]>. > To view this discussion on the web visit > https://groups.google.com/d/msgid/rbase-l/[email protected]<https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Fgroups.google.com%2Fd%2Fmsgid%2Frbase-l%2F0LptxZ-1lKsfD37El-00fi3C%40mrelay.perfora.net&data=04%7C01%7Clhannaw%40bronxleb.org%7Cf312946ad840407d4a1c08d93bd41f8b%7C4298a6c031114e0cb60c030ea7ab66ee%7C0%7C0%7C637606605451376781%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000&sdata=ik6CY%2B0G5o7OvIZL%2BT6%2FmX5%2FfJYuqv3WPjM90zWZesE%3D&reserved=0>. > > -- > For group guidelines, visit > http://www.rbase.com/support/usersgroup_guidelines.php<https://nam04.safelinks.protection.outlook.com/?url=http%3A%2F%2Fwww.rbase.com%2Fsupport%2Fusersgroup_guidelines.php&data=04%7C01%7Clhannaw%40bronxleb.org%7Cf312946ad840407d4a1c08d93bd41f8b%7C4298a6c031114e0cb60c030ea7ab66ee%7C0%7C0%7C637606605451386725%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000&sdata=P0q%2BnBWu0ghFE0iVlaOo%2FjgVEToXRgrXvyqV6rG6YZ8%3D&reserved=0> > --- > You received this message because you are subscribed to the Google Groups > "RBASE-L" group. > To unsubscribe from this group and stop receiving emails from it, send an > email to > [email protected]<mailto:[email protected]>. > To view this discussion on the web visit > https://groups.google.com/d/msgid/rbase-l/!&!AAAAAAAAAAAYAAAAAAAAAG1gU+A71stIig71BAFnx9iihQAAEAAAAA66+bnmq3pGoOuGF2JPWzkBAAAAAA==@vtgonline.com<https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Fgroups.google.com%2Fd%2Fmsgid%2Frbase-l%2F!%26!AAAAAAAAAAAYAAAAAAAAAG1gU%2BA71stIig71BAFnx9iihQAAEAAAAA66%2Bbnmq3pGoOuGF2JPWzkBAAAAAA%3D%3D%40vtgonline.com&data=04%7C01%7Clhannaw%40bronxleb.org%7Cf312946ad840407d4a1c08d93bd41f8b%7C4298a6c031114e0cb60c030ea7ab66ee%7C0%7C0%7C637606605451386725%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000&sdata=L8MKaIMaPE2ltJE7iTmH0CMMJBamcnbPHxPfvCPv3N4%3D&reserved=0>. -- For group guidelines, visit http://www.rbase.com/support/usersgroup_guidelines.php<https://nam04.safelinks.protection.outlook.com/?url=http%3A%2F%2Fwww.rbase.com%2Fsupport%2Fusersgroup_guidelines.php&data=04%7C01%7Clhannaw%40bronxleb.org%7Cf312946ad840407d4a1c08d93bd41f8b%7C4298a6c031114e0cb60c030ea7ab66ee%7C0%7C0%7C637606605451396689%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000&sdata=2sFKkiSLyMg8AqEmeNJ5HZqy1Sntq4gKGiGJNZCBAV4%3D&reserved=0> --- You received this message because you are subscribed to the Google Groups "RBASE-L" group. To unsubscribe from this group and stop receiving emails from it, send an email to [email protected]<mailto:[email protected]>. To view this discussion on the web visit https://groups.google.com/d/msgid/rbase-l/[email protected]<https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Fgroups.google.com%2Fd%2Fmsgid%2Frbase-l%2FEFDF36BD-5282-4BCD-BA43-0C131974FCE1%40ctags.com&data=04%7C01%7Clhannaw%40bronxleb.org%7Cf312946ad840407d4a1c08d93bd41f8b%7C4298a6c031114e0cb60c030ea7ab66ee%7C0%7C0%7C637606605451396689%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000&sdata=swFooMDcitodiAhYX1u06E5FK0HM3OXxoHKVKQ%2BYsk0%3D&reserved=0>. -- For group guidelines, visit http://www.rbase.com/support/usersgroup_guidelines.php<https://nam04.safelinks.protection.outlook.com/?url=http%3A%2F%2Fwww.rbase.com%2Fsupport%2Fusersgroup_guidelines.php&data=04%7C01%7Clhannaw%40bronxleb.org%7Cf312946ad840407d4a1c08d93bd41f8b%7C4298a6c031114e0cb60c030ea7ab66ee%7C0%7C0%7C637606605451406645%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000&sdata=yohj9K0uGh0ZwZhzPUn3gW6jKptm124%2B2myCO9Ob8q4%3D&reserved=0> --- You received this message because you are subscribed to the Google Groups "RBASE-L" group. To unsubscribe from this group and stop receiving emails from it, send an email to [email protected]<mailto:[email protected]>. To view this discussion on the web visit https://groups.google.com/d/msgid/rbase-l/202106300733447.SM6792722@MAIL1<https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Fgroups.google.com%2Fd%2Fmsgid%2Frbase-l%2F202106300733447.SM6792722%40MAIL1&data=04%7C01%7Clhannaw%40bronxleb.org%7Cf312946ad840407d4a1c08d93bd41f8b%7C4298a6c031114e0cb60c030ea7ab66ee%7C0%7C0%7C637606605451406645%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000&sdata=ahv0pQ5of1IrQpO0IhEIRooobpbMiDfTV6fOqhJL8mI%3D&reserved=0>. ATTENTION: This message and all attachments are PRIVATE, and may contain information that is CONFIDENTIAL and PRIVILEGED. If you have received this message in error, please notify the sender by reply e-mail and delete the message immediately. If you no longer wish to receive communication from DMA, please click here.<https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Ftax.dmainc.com%2Fsubscribe&data=04%7C01%7Clhannaw%40bronxleb.org%7Cf312946ad840407d4a1c08d93bd41f8b%7C4298a6c031114e0cb60c030ea7ab66ee%7C0%7C0%7C637606605451416602%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000&sdata=%2BHljUMdYa4Y03u4EbOH2IqCVue%2BGqSgzonoGQV64I70%3D&reserved=0> -- For group guidelines, visit http://www.rbase.com/support/usersgroup_guidelines.php<https://nam04.safelinks.protection.outlook.com/?url=http%3A%2F%2Fwww.rbase.com%2Fsupport%2Fusersgroup_guidelines.php&data=04%7C01%7Clhannaw%40bronxleb.org%7Cf312946ad840407d4a1c08d93bd41f8b%7C4298a6c031114e0cb60c030ea7ab66ee%7C0%7C0%7C637606605451416602%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000&sdata=b7VuUcjDFOSSsgj1ObLSp6El7rFbtqKebog6Kxtue3Q%3D&reserved=0> --- You received this message because you are subscribed to the Google Groups "RBASE-L" group. To unsubscribe from this group and stop receiving emails from it, send an email to [email protected]<mailto:[email protected]>. To view this discussion on the web visit https://groups.google.com/d/msgid/rbase-l/BL3PR07MB87551E6F36943DC4D7E9CF74B4019%40BL3PR07MB8755.namprd07.prod.outlook.com<https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Fgroups.google.com%2Fd%2Fmsgid%2Frbase-l%2FBL3PR07MB87551E6F36943DC4D7E9CF74B4019%2540BL3PR07MB8755.namprd07.prod.outlook.com%3Futm_medium%3Demail%26utm_source%3Dfooter&data=04%7C01%7Clhannaw%40bronxleb.org%7Cf312946ad840407d4a1c08d93bd41f8b%7C4298a6c031114e0cb60c030ea7ab66ee%7C0%7C0%7C637606605451426560%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000&sdata=UnofE%2FMDwwGKJ22H%2B9IyscqZygGSJVP5S67GJTPWIZs%3D&reserved=0>. CONFIDENTIALITY NOTICE: This communication and any attachments may contain confidential and/or privileged information for the use of the designated recipients named above. If you are not the intended recipient, you are hereby notified that you have received this communication in error and that any review, disclosure, dissemination, distribution or copying of it or its contents is prohibited. If you have received this communication in error, please notify the sender immediately by email or telephone and destroy all copies of this communication and any attachments. -- For group guidelines, visit http://www.rbase.com/support/usersgroup_guidelines.php --- You received this message because you are subscribed to the Google Groups "RBASE-L" group. To unsubscribe from this group and stop receiving emails from it, send an email to [email protected]. To view this discussion on the web visit https://groups.google.com/d/msgid/rbase-l/MN2PR11MB47129750C64E9F956F33A934DF019%40MN2PR11MB4712.namprd11.prod.outlook.com.
