[R] Fetch large sized file from SQL
Hi List, Does any one know what package I need to use in order to fetch/get a large sized dataframe from SQL? I have already used sqldf package which is good for fetching large sized csv files. Thanks Alireza [[alternative HTML version deleted]] __ R-help@r-project.org mailing list https://stat.ethz.ch/mailman/listinfo/r-help PLEASE do read the posting guide http://www.R-project.org/posting-guide.html and provide commented, minimal, self-contained, reproducible code.
Re: [R] Fetch large sized file from SQL
You can try using RODBC, it allows you to connect to databases using the ODBC driver. I had some difficulties using it with the postgresSQL driver in the past, because of some apparent incompatibility with the native postrgesSQL ODBC driver. I think the problem where solved by the new ODBC driver for postgresSQL and the new revision for RODBC. On Friday 02 October 2009 13:56:02 Dr. Alireza Zolfaghari wrote: Hi List, Does any one know what package I need to use in order to fetch/get a large sized dataframe from SQL? I have already used sqldf package which is good for fetching large sized csv files. Thanks Alireza [[alternative HTML version deleted]] __ R-help@r-project.org mailing list https://stat.ethz.ch/mailman/listinfo/r-help PLEASE do read the posting guide http://www.R-project.org/posting-guide.html and provide commented, minimal, self-contained, reproducible code. -- Corrado Topi Global Climate Change Biodiversity Indicators Area 18,Department of Biology University of York, York, YO10 5YW, UK Phone: + 44 (0) 1904 328645, E-mail: ct...@york.ac.uk __ R-help@r-project.org mailing list https://stat.ethz.ch/mailman/listinfo/r-help PLEASE do read the posting guide http://www.R-project.org/posting-guide.html and provide commented, minimal, self-contained, reproducible code.
Re: [R] Fetch large sized file from SQL
But the problem is that the dataframe size in sql is large, therefore odbc can sqlQuery() can not handel it. On Fri, Oct 2, 2009 at 2:14 PM, Corrado ct...@york.ac.uk wrote: You can try using RODBC, it allows you to connect to databases using the ODBC driver. I had some difficulties using it with the postgresSQL driver in the past, because of some apparent incompatibility with the native postrgesSQL ODBC driver. I think the problem where solved by the new ODBC driver for postgresSQL and the new revision for RODBC. On Friday 02 October 2009 13:56:02 Dr. Alireza Zolfaghari wrote: Hi List, Does any one know what package I need to use in order to fetch/get a large sized dataframe from SQL? I have already used sqldf package which is good for fetching large sized csv files. Thanks Alireza [[alternative HTML version deleted]] __ R-help@r-project.org mailing list https://stat.ethz.ch/mailman/listinfo/r-help PLEASE do read the posting guide http://www.R-project.org/posting-guide.htmlhttp://www.r-project.org/posting-guide.htmland provide commented, minimal, self-contained, reproducible code. -- Corrado Topi Global Climate Change Biodiversity Indicators Area 18,Department of Biology University of York, York, YO10 5YW, UK Phone: + 44 (0) 1904 328645, E-mail: ct...@york.ac.uk [[alternative HTML version deleted]] __ R-help@r-project.org mailing list https://stat.ethz.ch/mailman/listinfo/r-help PLEASE do read the posting guide http://www.R-project.org/posting-guide.html and provide commented, minimal, self-contained, reproducible code.
Re: [R] Fetch large sized file from SQL
I think you can specify the number of rows to be loaded at a time. It was quite a while ago. Try reading ?sqlQuery ?odbcConnect I have loaded quite large tables. On Friday 02 October 2009 14:59:59 Dr. Alireza Zolfaghari wrote: But the problem is that the dataframe size in sql is large, therefore odbc can sqlQuery() can not handel it. On Fri, Oct 2, 2009 at 2:14 PM, Corrado ct...@york.ac.uk wrote: You can try using RODBC, it allows you to connect to databases using the ODBC driver. I had some difficulties using it with the postgresSQL driver in the past, because of some apparent incompatibility with the native postrgesSQL ODBC driver. I think the problem where solved by the new ODBC driver for postgresSQL and the new revision for RODBC. On Friday 02 October 2009 13:56:02 Dr. Alireza Zolfaghari wrote: Hi List, Does any one know what package I need to use in order to fetch/get a large sized dataframe from SQL? I have already used sqldf package which is good for fetching large sized csv files. Thanks Alireza [[alternative HTML version deleted]] __ R-help@r-project.org mailing list https://stat.ethz.ch/mailman/listinfo/r-help PLEASE do read the posting guide http://www.R-project.org/posting-guide.htmlhttp://www.r-project.org/po sting-guide.htmland provide commented, minimal, self-contained, reproducible code. -- Corrado Topi Global Climate Change Biodiversity Indicators Area 18,Department of Biology University of York, York, YO10 5YW, UK Phone: + 44 (0) 1904 328645, E-mail: ct...@york.ac.uk -- Corrado Topi Global Climate Change Biodiversity Indicators Area 18,Department of Biology University of York, York, YO10 5YW, UK Phone: + 44 (0) 1904 328645, E-mail: ct...@york.ac.uk __ R-help@r-project.org mailing list https://stat.ethz.ch/mailman/listinfo/r-help PLEASE do read the posting guide http://www.R-project.org/posting-guide.html and provide commented, minimal, self-contained, reproducible code.