Re: [sqlite] 64-bit precompiled command-line shell binary

[RSmith]

On 2014/07/03 16:52, Gert Van Assche wrote:


I cannot test what RSmith wants to test, but I trust his expertise on this 
(SQLitespeed is a nice tool!)



I don't mean to sound so official, but sometimes forget to add - the name is 
just Ryan :)

I am not even sure if the tests are attainable - but I am very much planning to find out.  Very glad you like the SQLitespeed tool 
and if the intended 64bit testing actually produces markedly improved (or even just different) results this weekend, we'll release 
an official 64bit version. (some other updates are due out too - will keep it posted).




Thanks for your work on this, both of you.



It's honestly all Jan's work in this case, I merely added musings, but it 
always is a great pleasure!

___
sqlite-users mailing list
sqlite-users@sqlite.org
http://sqlite.org:8080/cgi-bin/mailman/listinfo/sqlite-users

Re: [sqlite] 64-bit precompiled command-line shell binary

[Gert Van Assche]

Jan,

for what I want to do, this exe is a perfect solution. It is working fine.

I cannot test what RSmith wants to test, but I trust his expertise on this
(SQLitespeed is a nice tool!)

Thanks for your work on this, both of you.


gert



2014-07-03 15:54 GMT+02:00 RSmith :

>
> On 2014/07/03 13:55, Jan Nijtmans wrote:
>
>> 2014-07-01 21:12 GMT+02:00 RSmith :
>>
>>> I seem to remember a similar question having surfaced some time ago but
>>> cannot find the reference now - so let me ask the great forum devs again:
>>> WIll the 64-bit version of sqlite3.exe be able to use >2GB of memory for
>>> itself
>>>
>> Really don't know, but I guess the answer should be: Yes.
>> Just try it, I'm interested in your feed-back.
>>
>
> Thanks for these Jan!
>
> Also - if the OP does not come back with results I will set up a testing
> scenario this weekend, since I am now quite interested. I will try to set
> the Page sizes and limits so that 4GB or more is used theoretically, and
> then try to make DB's of appropriate size and devise queries that would
> require (or at least allow) that much to be used, and then track the memory
> usage.
>
> Do you see any problem with this approach or have any advice before I
> start?
>
>
>
>
> ___
> sqlite-users mailing list
> sqlite-users@sqlite.org
> http://sqlite.org:8080/cgi-bin/mailman/listinfo/sqlite-users
>
___
sqlite-users mailing list
sqlite-users@sqlite.org
http://sqlite.org:8080/cgi-bin/mailman/listinfo/sqlite-users

Re: [sqlite] 64-bit precompiled command-line shell binary

[RSmith]

On 2014/07/03 13:55, Jan Nijtmans wrote:

2014-07-01 21:12 GMT+02:00 RSmith :

I seem to remember a similar question having surfaced some time ago but
cannot find the reference now - so let me ask the great forum devs again:
WIll the 64-bit version of sqlite3.exe be able to use >2GB of memory for
itself

Really don't know, but I guess the answer should be: Yes.
Just try it, I'm interested in your feed-back.


Thanks for these Jan!

Also - if the OP does not come back with results I will set up a testing scenario this weekend, since I am now quite interested. I 
will try to set the Page sizes and limits so that 4GB or more is used theoretically, and then try to make DB's of appropriate size 
and devise queries that would require (or at least allow) that much to be used, and then track the memory usage.


Do you see any problem with this approach or have any advice before I start?



___
sqlite-users mailing list
sqlite-users@sqlite.org
http://sqlite.org:8080/cgi-bin/mailman/listinfo/sqlite-users

Re: [sqlite] 64-bit precompiled command-line shell binary

[Gert Van Assche]

Thanks Jan. I'll test it this afternoon.

gert


2014-07-03 13:55 GMT+02:00 Jan Nijtmans :

> 2014-07-01 21:12 GMT+02:00 RSmith :
> > I seem to remember a similar question having surfaced some time ago but
> > cannot find the reference now - so let me ask the great forum devs again:
> > WIll the 64-bit version of sqlite3.exe be able to use >2GB of memory for
> > itself
>
> Really don't know, but I guess the answer should be: Yes.
> Just try it, I'm interested in your feed-back.
>
> > is this different to the 32bit version, and if so, does anyone have
> > a pre-compiled 64bit sqlite3.exe version please?
>
> There is now, you can download it here:
> <
> http://sourceforge.net/projects/cyqlite/files/3.8.5/sqlite-shell-win64-x64-3080500.zip/download
> >
>
> sqlite3.exe is (cross-)compiled using the MinGW-w64 compiler as follows:
> x86_64-w64-mingw32-gcc -o sqlite3.exe -DUSE_SYSTEM_SQLITE=1
> shell.c sqlite3.dll
> x86_64-w64-mingw32-strip -o sqlite3.exe
>
> This means that it's only a small .exe (64 kB) which uses a (64-bit, 547
> kB)
> "sqlite3.dll" residing in the same directory to do the real work.
> You can replace sqlite3.dll with any other (64-bit) version, if it works
> then the dll is compatible with the SQLite 3.8.5 shell, if it doesn't work
> then there is some incompatibility (no guarantees, but it works
> with the 64-bit sqlite3.dll download provided by
>  as well).
>
> Regards,
>   Jan Nijtmans
> ___
> sqlite-users mailing list
> sqlite-users@sqlite.org
> http://sqlite.org:8080/cgi-bin/mailman/listinfo/sqlite-users
>
___
sqlite-users mailing list
sqlite-users@sqlite.org
http://sqlite.org:8080/cgi-bin/mailman/listinfo/sqlite-users

Re: [sqlite] 64-bit precompiled command-line shell binary

[Jan Nijtmans]

2014-07-01 21:12 GMT+02:00 RSmith :
> I seem to remember a similar question having surfaced some time ago but
> cannot find the reference now - so let me ask the great forum devs again:
> WIll the 64-bit version of sqlite3.exe be able to use >2GB of memory for
> itself

Really don't know, but I guess the answer should be: Yes.
Just try it, I'm interested in your feed-back.

> is this different to the 32bit version, and if so, does anyone have
> a pre-compiled 64bit sqlite3.exe version please?

There is now, you can download it here:


sqlite3.exe is (cross-)compiled using the MinGW-w64 compiler as follows:
x86_64-w64-mingw32-gcc -o sqlite3.exe -DUSE_SYSTEM_SQLITE=1
shell.c sqlite3.dll
x86_64-w64-mingw32-strip -o sqlite3.exe

This means that it's only a small .exe (64 kB) which uses a (64-bit, 547 kB)
"sqlite3.dll" residing in the same directory to do the real work.
You can replace sqlite3.dll with any other (64-bit) version, if it works
then the dll is compatible with the SQLite 3.8.5 shell, if it doesn't work
then there is some incompatibility (no guarantees, but it works
with the 64-bit sqlite3.dll download provided by
 as well).

Regards,
  Jan Nijtmans
___
sqlite-users mailing list
sqlite-users@sqlite.org
http://sqlite.org:8080/cgi-bin/mailman/listinfo/sqlite-users

Re: [sqlite] 64-bit precompiled command-line shell binary

[RSmith]

Apologies this reply went to the wrong mailbox - rectified here.

On 2014/07/01 20:19, Gert Van Assche wrote:

Thanks for your replay.

I'm not a developer, and I don't know how to compile the source code.
The reason why I think I will need a 64-bit exe is that the 32-bit one is 
limited to 2GB RAM in memory.
As I'll have to read/wrtite a lot to a huge db, I think a 64-bit might help me.

gert



By "help me" I assume you mean setting a cache-size that is sufficiently big to 
speed up database processes of very large size DBs?

The RAM usage is an OS limitation, not one of the program. SQLite (or any other program) can only ask for a memory allocation, which 
may or may not fail. Allocating more than 2GB of memory by just one application (such as sqlite3.exe) is plausible, however I don't 
know if sqlite3.exe or the sqlite code in general is able to manage more than 2GB of memory or more than 32bit addressing (even when 
compiled in 64 bit guise). This is a separate issue to the OS's ability to address more than 2GB memory (It might be able to read 
16GB of memory and still only supply <2GB chunks of it to 32bit apps).


Even then, I think there is a hard upper limit to the cache size that can be 
specified, but cannot find it now - For information see:
http://www.sqlite.org/pragma.html#pragma_cache_size
http://www.sqlite.org/malloc.html


I seem to remember a similar question having surfaced some time ago but cannot find the reference now - so let me ask the great 
forum devs again: WIll the 64-bit version of sqlite3.exe be able to use >2GB of memory for itself, is this different to the 32bit 
version, and if so, does anyone have a pre-compiled 64bit sqlite3.exe version please?



Thanks!
___
sqlite-users mailing list
sqlite-users@sqlite.org
http://sqlite.org:8080/cgi-bin/mailman/listinfo/sqlite-users

Re: [sqlite] 64-bit precompiled command-line shell binary

[RSmith]

On 2014/07/01 18:52, Gert Van Assche wrote:

Maybe a stupid question: how should I use this DLL? just put in the same folder 
as the sqlite3.exe?



Not a stupid question at all - in fact my mistake, the previous request was for the 64-bit DLL and of course any time you compile 
SQLite into your code or compile the existing amalgamation for sqlite3.exe, it will compile whatever your compiler wishes.
The DLL is for linking to applications in a 64-bit Windows OS, but that is NOT sqlite3.exe specifically, which in turn has to be 
compiled to 64bit bit by itself.


Windows 8 and 8.1 should (and does) run the 32bit sqlite3.exe as is and will have negligible effects when changing to 64 bit... is 
there a reason you need it to be 64-bit? That usually doesn't matter at all - which is why it isn't generally available.  Are you 
perhaps meaning windows RT? In which case there is a whole other level of things to be considered apart from just compiling it to 64 
bit.


Still, if you absolutely need a 64 bit version, you can compile it so (the same site has the amalgamation and recently even added 
the detailed steps to take in compiling your own version).


It isn't common though, but I am sure someone on here has done a 64 bit version - generally they only do it to allow/disable 
different compiler switches to the standard version, so they might be able to send you a version, but I doubt there is a standard 
place to get one from - especially not one that is updated in step with the sqlite.org distribution. (I might be wrong though!)






2014-07-01 16:39 GMT+02:00 RSmith >:


On 2014/07/01 14:29, Gert Van Assche wrote:

All,

where could I download a 64-bit sqlite3.exe for running on Windows 8?


From an earlier reply by Richard Hipp:

A 64-bit Windows DLL is now available athttp://www.sqlite.org/download.html 




___
sqlite-users mailing list
sqlite-users@sqlite.org
http://sqlite.org:8080/cgi-bin/mailman/listinfo/sqlite-users

Re: [sqlite] 64-bit precompiled command-line shell binary

[Gert Van Assche]

Maybe a stupid question: how should I use this DLL? just put in the same
folder as the sqlite3.exe?




2014-07-01 16:39 GMT+02:00 RSmith :

>
> On 2014/07/01 14:29, Gert Van Assche wrote:
>
>> All,
>>
>> where could I download a 64-bit sqlite3.exe for running on Windows 8?
>>
>
> From an earlier reply by Richard Hipp:
>
> A 64-bit Windows DLL is now available athttp://www.sqlite.org/
> download.html
>
>
>
>
>
>
>
> ___
> sqlite-users mailing list
> sqlite-users@sqlite.org
> http://sqlite.org:8080/cgi-bin/mailman/listinfo/sqlite-users
>
___
sqlite-users mailing list
sqlite-users@sqlite.org
http://sqlite.org:8080/cgi-bin/mailman/listinfo/sqlite-users

Re: [sqlite] 64-bit precompiled command-line shell binary

[RSmith]

On 2014/07/01 14:29, Gert Van Assche wrote:

All,

where could I download a 64-bit sqlite3.exe for running on Windows 8?


From an earlier reply by Richard Hipp:

A 64-bit Windows DLL is now available athttp://www.sqlite.org/download.html







___
sqlite-users mailing list
sqlite-users@sqlite.org
http://sqlite.org:8080/cgi-bin/mailman/listinfo/sqlite-users

Re: [sqlite] 64-bit precompiled command-line shell binary for Windows 7

[Udi Karni]

Thank you Mr. Burstein. This is great !!!

Run times using memory for DB and Temp are much improved over SSD - let
alone conventional disk, "out of memory" messages are gone, count (*) is
sub-second.

Time to go shopping for more RAM.

Thanks again.

On Mon, Apr 30, 2012 at 9:23 AM, Baruch Burstein wrote:

> I haven't tested it (I only have a 32-bit system), but here you go. Just
> change the extension to .exe
>
> On Mon, Apr 30, 2012 at 4:28 PM, Udi Karni  wrote:
>
> > Dear Sqlite development team,
> >
> > I'd like to add a vote for requesting a 64-bit precompiled command-line
> > shell binary (sqlite3.exe) for Windows 7 - to be added to the list of
> files
> > downloadable from the page  .
> >
> > It would be very helpful for those of us who are not versed with
> compiling
> > C++ code.
> >
> > I have seen a tremendous performance boost from the use of "memory
> > temp_store" and "memory database". The 64-bit version would allow them to
> > go beyond 2GB.
> >
> > Is that simple? Not so simple? If you could elaborate - it would be much
> > appreciated.
> >
> > Thank you !
> >
> > Udi
> > ___
> > sqlite-users mailing list
> > sqlite-users@sqlite.org
> > http://sqlite.org:8080/cgi-bin/mailman/listinfo/sqlite-users
> >
>
>
>
> --
> Programming today is a race between software engineers striving to build
> bigger and better idiot-proof programs, and the Universe trying to produce
> bigger and better idiots. So far, the Universe is winning.  - Rich Cook
>
> ___
> sqlite-users mailing list
> sqlite-users@sqlite.org
> http://sqlite.org:8080/cgi-bin/mailman/listinfo/sqlite-users
>
>
___
sqlite-users mailing list
sqlite-users@sqlite.org
http://sqlite.org:8080/cgi-bin/mailman/listinfo/sqlite-users

Re: [sqlite] 64-bit precompiled command-line shell binary for Windows 7

[Ryan Johnson]

The list strips all attachments... you might want to PM it.

On 30/04/2012 12:23 PM, Baruch Burstein wrote:

I haven't tested it (I only have a 32-bit system), but here you go. Just
change the extension to .exe

On Mon, Apr 30, 2012 at 4:28 PM, Udi Karni  wrote:


Dear Sqlite development team,

I'd like to add a vote for requesting a 64-bit precompiled command-line
shell binary (sqlite3.exe) for Windows 7 - to be added to the list of files
downloadable from the page  .

It would be very helpful for those of us who are not versed with compiling
C++ code.

I have seen a tremendous performance boost from the use of "memory
temp_store" and "memory database". The 64-bit version would allow them to
go beyond 2GB.

Is that simple? Not so simple? If you could elaborate - it would be much
appreciated.

Thank you !

Udi
___
sqlite-users mailing list
sqlite-users@sqlite.org
http://sqlite.org:8080/cgi-bin/mailman/listinfo/sqlite-users






___
sqlite-users mailing list
sqlite-users@sqlite.org
http://sqlite.org:8080/cgi-bin/mailman/listinfo/sqlite-users


___
sqlite-users mailing list
sqlite-users@sqlite.org
http://sqlite.org:8080/cgi-bin/mailman/listinfo/sqlite-users

Re: [sqlite] 64-bit precompiled command-line shell binary for Windows 7

[Baruch Burstein]

I haven't tested it (I only have a 32-bit system), but here you go. Just
change the extension to .exe

On Mon, Apr 30, 2012 at 4:28 PM, Udi Karni  wrote:

> Dear Sqlite development team,
>
> I'd like to add a vote for requesting a 64-bit precompiled command-line
> shell binary (sqlite3.exe) for Windows 7 - to be added to the list of files
> downloadable from the page  .
>
> It would be very helpful for those of us who are not versed with compiling
> C++ code.
>
> I have seen a tremendous performance boost from the use of "memory
> temp_store" and "memory database". The 64-bit version would allow them to
> go beyond 2GB.
>
> Is that simple? Not so simple? If you could elaborate - it would be much
> appreciated.
>
> Thank you !
>
> Udi
> ___
> sqlite-users mailing list
> sqlite-users@sqlite.org
> http://sqlite.org:8080/cgi-bin/mailman/listinfo/sqlite-users
>



-- 
Programming today is a race between software engineers striving to build
bigger and better idiot-proof programs, and the Universe trying to produce
bigger and better idiots. So far, the Universe is winning.  - Rich Cook
___
sqlite-users mailing list
sqlite-users@sqlite.org
http://sqlite.org:8080/cgi-bin/mailman/listinfo/sqlite-users