Re: [sqlite] .import error: cannot open large file

2013-11-15 Thread Simon Slavin
On 15 Nov 2013, at 9:23am, Luís Simão wrote: > Not sure if it helps, but you could try > >sqlite3 somedb '.import /dev/stdin hugetable' < huge.file > > making OS handle file reading instead of another process (cat). If the source really is a file then the right way to do it is sqlite3 so

Re: [sqlite] .import error: cannot open large file

2013-11-15 Thread Luís Simão
Not sure if it helps, but you could try sqlite3 somedb '.import /dev/stdin hugetable' < huge.file making OS handle file reading instead of another process (cat). LS 2013/11/14 lpryszcz > Hi, Often I pipe tables (from .gz or multiple files). I found it also work > for large files that othe

Re: [sqlite] .import error: cannot open large file

2013-11-14 Thread lpryszcz
Hi, Often I pipe tables (from .gz or multiple files). I found it also work for large files that otherwise fail with `Error: cannot open :huge.file"`: cat huge.file | sqlite3 somedb '.import /dev/stdin hugetable' But it could be slower that using `real` file import. Anyone have an idea? L. --

Re: [sqlite] .import error: cannot open large file

2011-06-06 Thread Roger Binns
-BEGIN PGP SIGNED MESSAGE- Hash: SHA1 On 06/06/2011 04:47 PM, Rense Corten wrote: > Just to report back on this issue: recompiling as per Nuno's > instructions indeed solved the problem. Still, if anyone can explain > to me why the original executable would work without problems on a > dif

Re: [sqlite] .import error: cannot open large file

2011-06-06 Thread Rense Corten
Just to report back on this issue: recompiling as per Nuno's instructions indeed solved the problem. Still, if anyone can explain to me why the original executable would work without problems on a different machine, I would be grateful. > > On Fri, Jun 3, 2011 at 10:28 AM, Rense Corten wrote: >>

Re: [sqlite] .import error: cannot open large file

2011-06-03 Thread Nuno Lucas
On Fri, Jun 3, 2011 at 18:28, Rense Corten wrote: > Thanks for your answer, Nuno. > However, the system I am using is already 64-bit (I should have > mentioned that) , and the same binary can do the job on another Ubuntu > 64-bit  system. I'll try your suggestion nevertheless, but can there > be o

Re: [sqlite] .import error: cannot open large file

2011-06-03 Thread Rense Corten
Thanks for your answer, Nuno. However, the system I am using is already 64-bit (I should have mentioned that) , and the same binary can do the job on another Ubuntu 64-bit system. I'll try your suggestion nevertheless, but can there be other causes? Rense > It's what the thread says. The SQLite s

Re: [sqlite] .import error: cannot open large file

2011-06-02 Thread Nuno Lucas
Hello, On Fri, Jun 3, 2011 at 00:08, Rense Corten wrote: [...] > So I searched the archives of this list and found two threads on this: > > http://www.mail-archive.com/sqlite-users@sqlite.org/msg51574.html > http://www.mail-archive.com/sqlite-users@sqlite.org/msg48649.html > > The first thread go

[sqlite] .import error: cannot open large file

2011-06-02 Thread Rense Corten
Hi all, I'm trying to import a large file of about 13GB using SQLite 3.7.6.3 on Ubuntu. I use the precompiled Linux binary. The commands are: = .separator ";" .import largefile.csv mytable = but then I get: "Error: cannot open "largefile.csv" " I