Re: [sqlite] Any operation to trigger osMunmap?

2018-04-18 Thread Nick
So the PSS will not decrease even if the db becomes smaller after some
DELETE/vacuum operations? 

I think it is a better way to free the mmap memory after every query
automatically inside sqlite. Why not?



--
Sent from: http://sqlite.1065341.n5.nabble.com/
___
sqlite-users mailing list
sqlite-users@mailinglists.sqlite.org
http://mailinglists.sqlite.org/cgi-bin/mailman/listinfo/sqlite-users


Re: [sqlite] Are you getting spam when you post to sqlite-users ?

2018-04-18 Thread Shevek
It has to be a subscriber. I just got spam in the form of an 
almost-immediate reply to my last message to the list, including 
message-ids. Web wouldn't bother including that metadata, and is 
unlikely to be quite so real-time.


On 04/18/2018 11:35 PM, Simon Slavin wrote:

On 18 Apr 2018, at 11:19pm, dave  wrote:


Wouldn't it be as simple as subscribing to the mailing list and harvesting
the emails directly from the inbound content?


No need to subscribe.  This mailing list is gated to web fora.  Just scrape 
some web pages.

I don't think there's a solution short of each one of us tuning our junkmail 
filters by telling them to reject all of those spam messages.

Simon.
___
sqlite-users mailing list
sqlite-users@mailinglists.sqlite.org
http://mailinglists.sqlite.org/cgi-bin/mailman/listinfo/sqlite-users


___
sqlite-users mailing list
sqlite-users@mailinglists.sqlite.org
http://mailinglists.sqlite.org/cgi-bin/mailman/listinfo/sqlite-users


Re: [sqlite] JDBC driver experience

2018-04-18 Thread Shevek

1. Xerial
2. A year or so, relatively heavily.

3.
 * MAX_MMAP_SIZE is too small by a few hundred megabytes. It's safe to 
set to around a terabyte.
 * No way to effectively use multiple threads, even on a read-only 
mmap'd database.
 * Planner sometimes misses plans - does it need better STAT features 
enabled?


4. What immediately comes to mind:

For writing:
 * JournalMode MEMORY
 * SynchronousMode OFF
 * A couple of hundred meg of page cache
 * Use quite big transactions, but it doesn't really matter where the 
boundaries are. You can do 50K+ writes per transaction.

 * Use Java-side locks.
 * Any data which doesn't need to be accessible to the relational 
engine should be serialized into a BLOB with Kryo and Snappy. Even 
simple text fields.



For reading:
 * mmap EVERYTHING
 * JournalMode OFF
 * It's MUCH faster to join in Java than in sqlite. If you're loading 
data into memory, do an application-side hash-join.

 * Wrap all your queries in a performance rig and log slow queries.
 * Force the planner using the CROSS keyword for any query which is 
ever slow.
 * Sometimes the planner changes the query plan based on e.g. the size 
of an IN-list.
 * Use covering indexes, and use sqlite_analyzer to figure out which 
ones are winning a space-time trade-off.
 * The partial covering index optimizer doesn't always account for 
constants, and we lose a bunch of space because we have to include the 
constant values in the index.



Overall:
 * Does anyone respond to issues?


We actually use nondeterministic transaction boundaries for writing 
because it really doesn't matter where they are, it only matters that 
you have one.


S.

On 04/18/2018 08:34 PM, Richard Hipp wrote:

Are you using SQLite with JDBC?  If so, can you please answer a few
questions below?

You can post on this mailing list or send your reply directly to me.

1. Which JDBC are you using?
2. For how long have you been using it?
3. What issues you had with this driver?
4. What advise do you have for avoiding problems in this driver?


___
sqlite-users mailing list
sqlite-users@mailinglists.sqlite.org
http://mailinglists.sqlite.org/cgi-bin/mailman/listinfo/sqlite-users


Re: [sqlite] Are you getting spam when you post to sqlite-users ?

2018-04-18 Thread Keith Medcalf

I block by domain as in

*.dognuts
*.spammers
*.dating
*.evildoers

for basically every johhny-cum-lately domain (ie, that has not existed since 
before 1995) -- one strike and the whole TLD is fileterd (as in packet routed 
to the null0 interface).  Then tere is the checks on SPF, protocol conformance 
(as in you do not speak until spoken to, you dirty spammer you), a number of 
RBL checks and of course null0 routing all "nasty" addresses (that is, if you 
send SSH attacks to someone, you likely have no good reason to be talking to me 
at all).

Very effective.  99.9% of all spam eliminated.

---
The fact that there's a Highway to Hell but only a Stairway to Heaven says a 
lot about anticipated traffic volume.

>-Original Message-
>From: sqlite-users [mailto:sqlite-users-
>boun...@mailinglists.sqlite.org] On Behalf Of Dennis Clarke
>Sent: Wednesday, 18 April, 2018 10:36
>To: sqlite-users@mailinglists.sqlite.org
>Subject: Re: [sqlite] Are you getting spam when you post to sqlite-
>users ?
>
>
>> "Banishing" means configuring IP filters on the server to silently
>> discard any and all IP packets that originate from the targeted
>range
>> of IP addresses.
>
>This is the best method that I have ever used and I can tell you that
>your ipfilter rules can get quite long using this approach.  In truth
>I banish ALL registered subnets from certain areas of the world
>and then life goes on.  Entire continents blocked.
>
>Dennis
>
>
>
>___
>sqlite-users mailing list
>sqlite-users@mailinglists.sqlite.org
>http://mailinglists.sqlite.org/cgi-bin/mailman/listinfo/sqlite-users



___
sqlite-users mailing list
sqlite-users@mailinglists.sqlite.org
http://mailinglists.sqlite.org/cgi-bin/mailman/listinfo/sqlite-users


Re: [sqlite] JDBC driver experience

2018-04-18 Thread Don V Nielsen
1. Xerial
2. Couple years?
3. None. But I am just a dumb user. I use JetBrains IDE's (RubyMine, Rider,
Datagrip). The IDE's provide direct access to the datasource for looking at
the db, manipulating data, manipulating tables. That sort of stuff. Never
once have I had an issue with the driver crashing, or munging data, or
being a general kludge. It has been effective.
4.
5. I use the driver's through other products. I don't program with them
directly. I'm not at that level of smart.

dvn - wish I could be greater help

On Wed, Apr 18, 2018 at 2:34 PM, Richard Hipp  wrote:

> Are you using SQLite with JDBC?  If so, can you please answer a few
> questions below?
>
> You can post on this mailing list or send your reply directly to me.
>
> 1. Which JDBC are you using?
> 2. For how long have you been using it?
> 3. What issues you had with this driver?
> 4. What advise do you have for avoiding problems in this driver?
>
> --
> D. Richard Hipp
> d...@sqlite.org
> ___
> sqlite-users mailing list
> sqlite-users@mailinglists.sqlite.org
> http://mailinglists.sqlite.org/cgi-bin/mailman/listinfo/sqlite-users
>
___
sqlite-users mailing list
sqlite-users@mailinglists.sqlite.org
http://mailinglists.sqlite.org/cgi-bin/mailman/listinfo/sqlite-users


Re: [sqlite] Are you getting spam when you post to sqlite-users ?

2018-04-18 Thread Simon Slavin
On 18 Apr 2018, at 11:19pm, dave  wrote:

> Wouldn't it be as simple as subscribing to the mailing list and harvesting
> the emails directly from the inbound content?

No need to subscribe.  This mailing list is gated to web fora.  Just scrape 
some web pages.

I don't think there's a solution short of each one of us tuning our junkmail 
filters by telling them to reject all of those spam messages.

Simon.
___
sqlite-users mailing list
sqlite-users@mailinglists.sqlite.org
http://mailinglists.sqlite.org/cgi-bin/mailman/listinfo/sqlite-users


Re: [sqlite] Are you getting spam when you post to sqlite-users ?

2018-04-18 Thread dave
Wouldn't it be as simple as subscribing to the mailing list and harvesting
the emails directly from the inbound content?  Because as it is, everyone's
real email already comes to me in the list messages I receive (as
'sqlite-users on behalf of x...@yyy.com')

The spam message I just received used the subject line that I had posted
onto the list a day or so ago (so I know how they got it), but was addressed
to my email directly (so I don't think there's any banning that sqlite can
do).  Perhaps it's a pity I'm otherwise too busy, because Samantha invites
me to 'come and treat us in real, plz'.  Lol!  Oh well, this account is so
inundated with spam already, I suppose a little more won't hurt

> -Original Message-
> From: sqlite-users 
> [mailto:sqlite-users-boun...@mailinglists.sqlite.org] On 
> Behalf Of José María Mateos
> Sent: Wednesday, April 18, 2018 8:55 AM
> To: sqlite-users@mailinglists.sqlite.org
> Subject: Re: [sqlite] Are you getting spam when you post to 
> sqlite-users ?
> 
> 
> On Tue, Apr 17, 2018, at 17:39, Simon Slavin wrote:
> > Dear list-posters,
> > 
> > Are you getting a new dating-spam each time you post to 
> this list ?  If 
> > you are, please post a brief follow-up to this message.  
> Please do /not/ 
> > include any details about the spam, its headers, or the person it's 
> > apparently from.  Just a "me too" until I say I have seen enough 
> > responses.
> 
> For what I understand, this exact behavior is happening right 
> now on the r-help mailing list too. People were wondering if 
> addresses were being scrapped from nabble.com or something similar.
> 
> Cheers,
> 
> -- 
> José María (Chema) Mateos
> https://rinzewind.org/blog-es || https://rinzewind.org/blog-en
> ___
> sqlite-users mailing list
> sqlite-users@mailinglists.sqlite.org
> http://mailinglists.sqlite.org/cgi-bin/mailman/listinfo/sqlite-users
> 


___
sqlite-users mailing list
sqlite-users@mailinglists.sqlite.org
http://mailinglists.sqlite.org/cgi-bin/mailman/listinfo/sqlite-users


[sqlite] JDBC driver experience

2018-04-18 Thread Richard Hipp
Are you using SQLite with JDBC?  If so, can you please answer a few
questions below?

You can post on this mailing list or send your reply directly to me.

1. Which JDBC are you using?
2. For how long have you been using it?
3. What issues you had with this driver?
4. What advise do you have for avoiding problems in this driver?

-- 
D. Richard Hipp
d...@sqlite.org
___
sqlite-users mailing list
sqlite-users@mailinglists.sqlite.org
http://mailinglists.sqlite.org/cgi-bin/mailman/listinfo/sqlite-users


Re: [sqlite] Are you getting spam when you post to sqlite-users ?

2018-04-18 Thread Richard Hipp
On 4/18/18, Dennis Clarke  wrote:
>
>> "Banishing" means configuring IP filters on the server to silently
>> discard any and all IP packets that originate from the targeted range
>> of IP addresses.
>
> This is the best method that I have ever used and I can tell you that
> your ipfilter rules can get quite long using this approach.  In truth
> I banish ALL registered subnets from certain areas of the world
> and then life goes on.  Entire continents blocked.
>

This technique works to prevent me from getting the spam, because all
my email goes through the machine doing the blocking - sqlite.org.
Unfortunately, the email for the other 2000+ people on this mail list
goes through different servers which are not blocking the misbehaving
IP address, and so they are still seeing the spam.
-- 
D. Richard Hipp
d...@sqlite.org
___
sqlite-users mailing list
sqlite-users@mailinglists.sqlite.org
http://mailinglists.sqlite.org/cgi-bin/mailman/listinfo/sqlite-users


Re: [sqlite] crash dropping table

2018-04-18 Thread Simon Slavin


On 18 Apr 2018, at 5:59pm, Mark Wagner  wrote:

> I will try to produce a repro case that I can share out (the database I was
> testing on has lots of personal data that I will first try to delete).

Before you do anything else to it, make a copy and use the SQLite shell to do

PRAGMA integrity_check();

on it.  Just in case the reason for the crash is that the database is corrupt.

Simon.
___
sqlite-users mailing list
sqlite-users@mailinglists.sqlite.org
http://mailinglists.sqlite.org/cgi-bin/mailman/listinfo/sqlite-users


Re: [sqlite] crash dropping table

2018-04-18 Thread Mark Wagner
I will try to produce a repro case that I can share out (the database I was
testing on has lots of personal data that I will first try to delete).
Thanks for the responses.

@David Note that those weren't the precise commands (i.e. drop command was
"drop table x;").



On Wed, Apr 18, 2018 at 9:56 AM Simon Slavin  wrote:

> On 18 Apr 2018, at 4:47pm, Mark Wagner  wrote:
>
> > I have a simple test case wherein I delete from a number of tables and
> then
> > drop one of those tables.  This crashes sqlite3.
> >
> > So something like this:
> >
> > begin;
> > delete from x;
> > delete from y;
> > delete from z;
> > drop x;  << crashes here
> >
> > Sorry for my ignorance but is there a procedure for submitting bugs for
> > things like this?
>
> Can you make the same problem happen in the SQLite CLI tool ?  If so,
> please post a full script here.  If not, there's a possibility that the
> problem is somewhere in your own software.
>
> If it's in your software, are you checking the return values from the
> first four commands in your list ?
>
> Simon.
> ___
> sqlite-users mailing list
> sqlite-users@mailinglists.sqlite.org
> http://mailinglists.sqlite.org/cgi-bin/mailman/listinfo/sqlite-users
>
___
sqlite-users mailing list
sqlite-users@mailinglists.sqlite.org
http://mailinglists.sqlite.org/cgi-bin/mailman/listinfo/sqlite-users


Re: [sqlite] crash dropping table

2018-04-18 Thread Simon Slavin
On 18 Apr 2018, at 4:47pm, Mark Wagner  wrote:

> I have a simple test case wherein I delete from a number of tables and then
> drop one of those tables.  This crashes sqlite3.
> 
> So something like this:
> 
> begin;
> delete from x;
> delete from y;
> delete from z;
> drop x;  << crashes here
> 
> Sorry for my ignorance but is there a procedure for submitting bugs for
> things like this?

Can you make the same problem happen in the SQLite CLI tool ?  If so, please 
post a full script here.  If not, there's a possibility that the problem is 
somewhere in your own software.

If it's in your software, are you checking the return values from the first 
four commands in your list ?

Simon.
___
sqlite-users mailing list
sqlite-users@mailinglists.sqlite.org
http://mailinglists.sqlite.org/cgi-bin/mailman/listinfo/sqlite-users


Re: [sqlite] Are you getting spam when you post to sqlite-users ?

2018-04-18 Thread Dennis Clarke



"Banishing" means configuring IP filters on the server to silently
discard any and all IP packets that originate from the targeted range
of IP addresses.


This is the best method that I have ever used and I can tell you that
your ipfilter rules can get quite long using this approach.  In truth
I banish ALL registered subnets from certain areas of the world
and then life goes on.  Entire continents blocked.

Dennis



___
sqlite-users mailing list
sqlite-users@mailinglists.sqlite.org
http://mailinglists.sqlite.org/cgi-bin/mailman/listinfo/sqlite-users


Re: [sqlite] Are you getting spam when you post to sqlite-users ?

2018-04-18 Thread Richard Hipp
Can you forward at least the header to me, please?

On 4/18/18, David Raymond  wrote:
> Just got my first one after my last post.
>
>
> -Original Message-
> From: sqlite-users [mailto:sqlite-users-boun...@mailinglists.sqlite.org] On
> Behalf Of Richard Hipp
> Sent: Wednesday, April 18, 2018 8:41 AM
> To: SQLite mailing list
> Subject: Re: [sqlite] Are you getting spam when you post to sqlite-users ?
>
> I have banished a block of 256 IP addresses around the specific IP
> address from which the spam was originating.  (The ISP is
> Mellowhost.com.)  I did not expect that this would help, as I assumed
> that the email addresses were being harvested from a separate gmail or
> yahoo email account.  And yet, since banishing that block of IPs, I
> have not heard any further reports of spam.
>
> Please let me know if you get any more spam after sending messages to this
> list.
>
> "Banishing" means configuring IP filters on the server to silently
> discard any and all IP packets that originate from the targeted range
> of IP addresses.
> --
> D. Richard Hipp
> d...@sqlite.org
> ___
> sqlite-users mailing list
> sqlite-users@mailinglists.sqlite.org
> http://mailinglists.sqlite.org/cgi-bin/mailman/listinfo/sqlite-users
> ___
> sqlite-users mailing list
> sqlite-users@mailinglists.sqlite.org
> http://mailinglists.sqlite.org/cgi-bin/mailman/listinfo/sqlite-users
>


-- 
D. Richard Hipp
d...@sqlite.org
___
sqlite-users mailing list
sqlite-users@mailinglists.sqlite.org
http://mailinglists.sqlite.org/cgi-bin/mailman/listinfo/sqlite-users


Re: [sqlite] Are you getting spam when you post to sqlite-users ?

2018-04-18 Thread David Raymond
Just got my first one after my last post.


-Original Message-
From: sqlite-users [mailto:sqlite-users-boun...@mailinglists.sqlite.org] On 
Behalf Of Richard Hipp
Sent: Wednesday, April 18, 2018 8:41 AM
To: SQLite mailing list
Subject: Re: [sqlite] Are you getting spam when you post to sqlite-users ?

I have banished a block of 256 IP addresses around the specific IP
address from which the spam was originating.  (The ISP is
Mellowhost.com.)  I did not expect that this would help, as I assumed
that the email addresses were being harvested from a separate gmail or
yahoo email account.  And yet, since banishing that block of IPs, I
have not heard any further reports of spam.

Please let me know if you get any more spam after sending messages to this list.

"Banishing" means configuring IP filters on the server to silently
discard any and all IP packets that originate from the targeted range
of IP addresses.
-- 
D. Richard Hipp
d...@sqlite.org
___
sqlite-users mailing list
sqlite-users@mailinglists.sqlite.org
http://mailinglists.sqlite.org/cgi-bin/mailman/listinfo/sqlite-users
___
sqlite-users mailing list
sqlite-users@mailinglists.sqlite.org
http://mailinglists.sqlite.org/cgi-bin/mailman/listinfo/sqlite-users


Re: [sqlite] crash dropping table

2018-04-18 Thread David Raymond
The more specific info the better.

Can you reproduce it with a new database or does it only happen on one specific 
database?

What're the schemas of x, y and z?

Are those the exact commands you're giving it?
(For example: "drop x;" should give you a syntax error, but not crash)

What journal mode is the database using?

Etc...


-Original Message-
From: sqlite-users [mailto:sqlite-users-boun...@mailinglists.sqlite.org] On 
Behalf Of Mark Wagner
Sent: Wednesday, April 18, 2018 11:48 AM
To: SQLite mailing list
Subject: [sqlite] crash dropping table

I have a simple test case wherein I delete from a number of tables and then
drop one of those tables.  This crashes sqlite3.

So something like this:

begin;
delete from x;
delete from y;
delete from z;
drop x;  << crashes here

Sorry for my ignorance but is there a procedure for submitting bugs for
things like this?

SQLite 3.22.0 2018-01-22 18:45:57
0c55d179733b46d8d0ba4d88e01a25e10677046ee3da1d5b1581e86726f2alt1
zlib version 1.2.8
gcc-7.3.0
___
sqlite-users mailing list
sqlite-users@mailinglists.sqlite.org
http://mailinglists.sqlite.org/cgi-bin/mailman/listinfo/sqlite-users
___
sqlite-users mailing list
sqlite-users@mailinglists.sqlite.org
http://mailinglists.sqlite.org/cgi-bin/mailman/listinfo/sqlite-users


Re: [sqlite] crash dropping table

2018-04-18 Thread Richard Hipp
On 4/18/18, Mark Wagner  wrote:
> I have a simple test case wherein I delete from a number of tables and then
> drop one of those tables.  This crashes sqlite3.
>
> So something like this:
>
> begin;
> delete from x;
> delete from y;
> delete from z;
> drop x;  << crashes here

Can you send in a reproducible test case?

-- 
D. Richard Hipp
d...@sqlite.org
___
sqlite-users mailing list
sqlite-users@mailinglists.sqlite.org
http://mailinglists.sqlite.org/cgi-bin/mailman/listinfo/sqlite-users


Re: [sqlite] crash dropping table

2018-04-18 Thread Kees Nuyt
On Wed, 18 Apr 2018 15:47:47 +, Mark Wagner 
wrote:

> Sorry for my ignorance but is there a procedure for
> submitting bugs for things like this?

The procedure is to mail bugs to this mailing list, including
version info, so you did exactly the right thing.

-- 
Regards,
Kees Nuyt
___
sqlite-users mailing list
sqlite-users@mailinglists.sqlite.org
http://mailinglists.sqlite.org/cgi-bin/mailman/listinfo/sqlite-users


[sqlite] crash dropping table

2018-04-18 Thread Mark Wagner
I have a simple test case wherein I delete from a number of tables and then
drop one of those tables.  This crashes sqlite3.

So something like this:

begin;
delete from x;
delete from y;
delete from z;
drop x;  << crashes here

Sorry for my ignorance but is there a procedure for submitting bugs for
things like this?

SQLite 3.22.0 2018-01-22 18:45:57
0c55d179733b46d8d0ba4d88e01a25e10677046ee3da1d5b1581e86726f2alt1
zlib version 1.2.8
gcc-7.3.0
___
sqlite-users mailing list
sqlite-users@mailinglists.sqlite.org
http://mailinglists.sqlite.org/cgi-bin/mailman/listinfo/sqlite-users


Re: [sqlite] Are you getting spam when you post to sqlite-users ?

2018-04-18 Thread Don V Nielsen
And my dating success rate has dropped dramatically

On Wed, Apr 18, 2018 at 8:54 AM, José María Mateos 
wrote:

> On Tue, Apr 17, 2018, at 17:39, Simon Slavin wrote:
> > Dear list-posters,
> >
> > Are you getting a new dating-spam each time you post to this list ?  If
> > you are, please post a brief follow-up to this message.  Please do /not/
> > include any details about the spam, its headers, or the person it's
> > apparently from.  Just a "me too" until I say I have seen enough
> > responses.
>
> For what I understand, this exact behavior is happening right now on the
> r-help mailing list too. People were wondering if addresses were being
> scrapped from nabble.com or something similar.
>
> Cheers,
>
> --
> José María (Chema) Mateos
> https://rinzewind.org/blog-es || https://rinzewind.org/blog-en
> ___
> sqlite-users mailing list
> sqlite-users@mailinglists.sqlite.org
> http://mailinglists.sqlite.org/cgi-bin/mailman/listinfo/sqlite-users
>
___
sqlite-users mailing list
sqlite-users@mailinglists.sqlite.org
http://mailinglists.sqlite.org/cgi-bin/mailman/listinfo/sqlite-users


Re: [sqlite] [EXTERNAL] kooky thought: a vm-only build (for embedded). feasible?

2018-04-18 Thread dave
Thanks for the feedback.  The schema would indeed be fixed.  It sounds like
I have an 'interesting' side project in my future!

> -Original Message-
> From: sqlite-users 
> [mailto:sqlite-users-boun...@mailinglists.sqlite.org] On 
> Behalf Of Hick Gunter
> Sent: Monday, April 16, 2018 1:50 AM
> To: 'SQLite mailing list'
> Subject: Re: [sqlite] [EXTERNAL] kooky thought: a vm-only 
> build (for embedded). feasible?
> 
> 
> There have been some inquries on the list into executing 
> pre-generated bytecode. If you have a fixed schema you may be 
> able to create a valid sqlite3_stmt pointer from bytecode 
> stored somewhere.
> 
> -Ursprüngliche Nachricht-
> Von: sqlite-users 
> [mailto:sqlite-users-boun...@mailinglists.sqlite.org] Im 
> Auftrag von dave
> Gesendet: Sonntag, 15. April 2018 20:55
> An: sqlite-users@mailinglists.sqlite.org
> Betreff: [EXTERNAL] [sqlite] kooky thought: a vm-only build 
> (for embedded). feasible?
> 
> I had a stray thought, and wanted to ask if it's been thunk 
> before,and if so what is the thinking?  Or just for commentary.
> 
> I have been building a system, part of which uses sqlite and 
> virtual tables.
> This is working great in a desktop/mobile environment.  
> However, eventually one day, I will want to migrate aspects 
> of the product to deeply embedded systems (e.g. something 
> like an STM32F4 class chip), and am thinking about size -- 
> both code and RAM.  I know about the various compile switches 
> that can turn off various features, but I wonder if I can 
> really strip it down further by eliminating parsing, query 
> planning, etc, altogether, and only support the virtual 
> machine.  I do need virtual tables, though.  In my particular 
> use-case, I only need read access -- no create or update.  
> The thinking being that I can build queries offline and 
> compile them into the p-code (or whatever it's called), and 
> either burn those well know queries into flash, or perhaps 
> send them down the wire as needed.  Then of course (maybe 
> even more critically), can I control ram usage in a 
> deterministic way such that it will still work on 
> memory-constrained devices (e.g. having a total of 128 KiB 
> max for the whole system).
> 
> Anway, has this been discussed before?  Or is it a fool's errand?
> 
> Cheers!
> 
> -dave
> ___
> sqlite-users mailing list
> sqlite-users@mailinglists.sqlite.org
> http://mailinglists.sqlite.org/cgi-bin/mailman/listinfo/sqlite-users
> 
> 
> ___
>  Gunter Hick | Software Engineer | Scientific Games 
> International GmbH | Klitschgasse 2-4, A-1130 Vienna | FN 
> 157284 a, HG Wien, DVR: 0430013 | (O) +43 1 80100 - 0
> 
> May be privileged. May be confidential. Please delete if not 
> the addressee.
> ___
> sqlite-users mailing list
> sqlite-users@mailinglists.sqlite.org
> http://mailinglists.sqlite.org/cgi-bin/mailman/listinfo/sqlite-users
> 


___
sqlite-users mailing list
sqlite-users@mailinglists.sqlite.org
http://mailinglists.sqlite.org/cgi-bin/mailman/listinfo/sqlite-users


Re: [sqlite] kooky thought: a vm-only build (for embedded).feasible?

2018-04-18 Thread dave
...
> > size -- both code and RAM.  I know about the various 
> compile switches that
> > can turn off various features, but I wonder if I can really 
> strip it down
> > further by eliminating parsing, query planning, etc, 
> altogether, and only
> > support the virtual machine.  I do need virtual tables, 
> though.  In my
> > particular use-case, I only need read access -- no create 
> or update.  The
...
> > such that it will still work on memory-constrained devices 
> (e.g. having a
> > total of 128 KiB max for the whole system).
> >
> > Anway, has this been discussed before?  Or is it a fool's errand?
> 
> We did this once, back in 2005, for a startup company in Boston.  It
> was called "SSE".  Unfortunately, we didn't continue to support it.  I
> went looking for the source code and could not find it.
> 
> The database was to run on a smart-card with limited RAM.  All of the
> prepared statements were generated on a workstation, then serialized
> and stored in a special table in the database file.  The application
> would then use a special API that would deserialize a prepared
> statement (identified by a well-known integer) then bind parameters
> and run it.
> 
> So much has changed in the SQLite bytecode engine since then that
> there is basically zero chance that SSE would still run today, even if
> I could find the source code.
> 
> -- 
> D. Richard Hipp
> d...@sqlite.org

Ah, groovy.  Well, at least that is validation of the concept.  So it sounds
like I have a side project for my copious free time!

-dave


___
sqlite-users mailing list
sqlite-users@mailinglists.sqlite.org
http://mailinglists.sqlite.org/cgi-bin/mailman/listinfo/sqlite-users


Re: [sqlite] Are you getting spam when you post to sqlite-users ?

2018-04-18 Thread José María Mateos
On Tue, Apr 17, 2018, at 17:39, Simon Slavin wrote:
> Dear list-posters,
> 
> Are you getting a new dating-spam each time you post to this list ?  If 
> you are, please post a brief follow-up to this message.  Please do /not/ 
> include any details about the spam, its headers, or the person it's 
> apparently from.  Just a "me too" until I say I have seen enough 
> responses.

For what I understand, this exact behavior is happening right now on the r-help 
mailing list too. People were wondering if addresses were being scrapped from 
nabble.com or something similar.

Cheers,

-- 
José María (Chema) Mateos
https://rinzewind.org/blog-es || https://rinzewind.org/blog-en
___
sqlite-users mailing list
sqlite-users@mailinglists.sqlite.org
http://mailinglists.sqlite.org/cgi-bin/mailman/listinfo/sqlite-users


Re: [sqlite] Any operation to trigger osMunmap?

2018-04-18 Thread Richard Hipp
On 4/18/18, Nick  wrote:
> Hi,
> I have one process using sqlite with “pragma mmap_size=30M”. The operations
> of my process is insert-select-insert-select. So the PSS(private clean) will
> increase along with the growing of the db which is treated as memory leak by
> Mem-Analysor tool.
>
> I guess calling sqlite3_close() or pragma mmap_size=0 after querys may free
> the PSS but that is not a good way for my process.
>
> So I am wondering is there any other way to free the PSS? As I find
> unixUnmapfile() will be called when nFetchOut back to 0 but I do not know
> what operation may trigger that.

I think sqlite3_close() or pragma mmap_size are the only ways to do that.

Note that the PSS increase is not actually a memory leak.  That it is
reported as a leak is a issue in Mem-Analyzor.

-- 
D. Richard Hipp
d...@sqlite.org
___
sqlite-users mailing list
sqlite-users@mailinglists.sqlite.org
http://mailinglists.sqlite.org/cgi-bin/mailman/listinfo/sqlite-users


Re: [sqlite] Are you getting spam when you post to sqlite-users ?

2018-04-18 Thread Richard Hipp
I have banished a block of 256 IP addresses around the specific IP
address from which the spam was originating.  (The ISP is
Mellowhost.com.)  I did not expect that this would help, as I assumed
that the email addresses were being harvested from a separate gmail or
yahoo email account.  And yet, since banishing that block of IPs, I
have not heard any further reports of spam.

Please let me know if you get any more spam after sending messages to this list.

"Banishing" means configuring IP filters on the server to silently
discard any and all IP packets that originate from the targeted range
of IP addresses.
-- 
D. Richard Hipp
d...@sqlite.org
___
sqlite-users mailing list
sqlite-users@mailinglists.sqlite.org
http://mailinglists.sqlite.org/cgi-bin/mailman/listinfo/sqlite-users


Re: [sqlite] Changes on sqlite3 parser and why not ?

2018-04-18 Thread Richard Hipp
On 4/17/18, petern  wrote:
> 3. In tables with serially related data it can be cumbersome to reference
> columns in the working table when columns must be computed from existing
> rows in the same table.

I don't understand this point.  Can you provide an example?

-- 
D. Richard Hipp
d...@sqlite.org
___
sqlite-users mailing list
sqlite-users@mailinglists.sqlite.org
http://mailinglists.sqlite.org/cgi-bin/mailman/listinfo/sqlite-users


[sqlite] [PATCH] Feature request: support cli variables

2018-04-18 Thread Juan Picca
Hi all.

After read  i
wanted to try to do the same with my sqlite queries.

Sadly, the sqlite command line shell don't support variables.
For that i want to suggest to add the support of variables
in the command line shell.

For start thinking about it, i attached a proof of concept of the
feature. The license for the POC is the same as sqlite: public domain.

Comments about the POC:

1.  I use another database (in memory) to persist variables between
changes of databases (.open command).
2.  A missing part is add a command line argument similar to `-var
name value` for assign variables from the command line.

Greetings,
JMPC.
___
sqlite-users mailing list
sqlite-users@mailinglists.sqlite.org
http://mailinglists.sqlite.org/cgi-bin/mailman/listinfo/sqlite-users


Re: [sqlite] Changes on sqlite3 parser and why not ?

2018-04-18 Thread petern
Some points on working table alias:

1. If upsert goes to trunk, there is already a INSERT table alias test case
(do_execsql_test upsert3-210)  that must succeed:

https://www.sqlite.org/src/info/907b5a37c539ea67

2. Obviously PostgreSQL already supports a working table alias universally:

https://www.postgresql.org/docs/9.5/static/sql-insert.html
INSERT INTO table_name [ AS alias ] [ ( column_name [, ...] ) ]

https://www.postgresql.org/docs/9.5/static/sql-update.html
UPDATE [ ONLY ] table_name [ * ] [ [ AS ] alias ]

https://www.postgresql.org/docs/9.5/static/sql-delete.html
DELETE FROM [ ONLY ] table_name [ * ] [ [ AS ] alias ]

3. In tables with serially related data it can be cumbersome to reference
columns in the working table when columns must be computed from existing
rows in the same table.  The INSERT/UPDATE/DELETE working table alias would
be very helpful and informative for readability in these situations.

Peter



On Tue, Apr 17, 2018 at 9:58 AM, Domingo Alvarez Duarte 
wrote:

> Hello Richard !
>
> Now that you are making changes on sqlite3 parser could you please add the
> table alias to delete/insert/update ?
>
>
___
sqlite-users mailing list
sqlite-users@mailinglists.sqlite.org
http://mailinglists.sqlite.org/cgi-bin/mailman/listinfo/sqlite-users


[sqlite] Any operation to trigger osMunmap?

2018-04-18 Thread Nick
Hi,
I have one process using sqlite with “pragma mmap_size=30M”. The operations
of my process is insert-select-insert-select. So the PSS(private clean) will
increase along with the growing of the db which is treated as memory leak by
Mem-Analysor tool. 

I guess calling sqlite3_close() or pragma mmap_size=0 after querys may free
the PSS but that is not a good way for my process.

So I am wondering is there any other way to free the PSS? As I find
unixUnmapfile() will be called when nFetchOut back to 0 but I do not know
what operation may trigger that.

Thanks for any light you can shed.



--
Sent from: http://sqlite.1065341.n5.nabble.com/
___
sqlite-users mailing list
sqlite-users@mailinglists.sqlite.org
http://mailinglists.sqlite.org/cgi-bin/mailman/listinfo/sqlite-users