Re: [sqlite] group_concat query performance

2014-10-19 Thread Kraijenbrink - FixHet - Systeembeheer
>Have you tested using a transaction over your combined queries? >Even for simple read operations this may give a huge performance difference. Yes, we did. Not only for performance reasons but for "automatic cleanup" in case of an error as well. -- Peter

Re: [sqlite] group_concat query performance

2014-10-17 Thread Bert Huijben
> -Original Message- > From: sqlite-users-boun...@sqlite.org [mailto:sqlite-users- > boun...@sqlite.org] On Behalf Of Kraijenbrink - FixHet - Systeembeheer > Sent: vrijdag 17 oktober 2014 16:46 > To: General Discussion of SQLite Database > Subject: Re: [sqlite]

Re: [sqlite] group_concat query performance

2014-10-17 Thread Kraijenbrink - FixHet - Systeembeheer
Thanks Bert, You are right. Now the C++ example runs equaly fast. Looks like I have to redesign the Db schema. With regards, Peter >Where do you perform the query in the C++ code? > >Your C++ program shows how you prepare the statement 5000 times, but not how >you execute it. > >The VB.Net

Re: [sqlite] group_concat query performance

2014-10-17 Thread Bert Huijben
> -Original Message- > From: sqlite-users-boun...@sqlite.org [mailto:sqlite-users- > boun...@sqlite.org] On Behalf Of Kraijenbrink - FixHet - Systeembeheer > Sent: vrijdag 17 oktober 2014 12:01 > To: General Discussion of SQLite Database > Subject: Re: [sqlite]

Re: [sqlite] group_concat query performance

2014-10-17 Thread Kraijenbrink - FixHet - Systeembeheer
Joe Mistachkin wrote: > >Thanks for the query. It's difficult to track down performance issues with >System.Data.SQLite without seeing the C# (or VB.NET) example code as there are >a variety of ways to query and process data using it. > >Is there any chance we could see the code that is using

Re: [sqlite] group_concat query performance

2014-10-16 Thread Joe Mistachkin
Kraijenbrink - FixHet - Systeembeheer wrote: > > Sorry for the delay, I had to solve an server problem first. This is the > sql query I've been testing with > Thanks for the query. It's difficult to track down performance issues with System.Data.SQLite without seeing the C# (or VB.NET) example

Re: [sqlite] group_concat query performance

2014-10-16 Thread Kraijenbrink - FixHet - Systeembeheer
. With regards, Peter >-Original Message- >From: sqlite-users-boun...@sqlite.org [mailto:sqlite-users-boun...@sqlite.org] >On Behalf Of Joe Mistachkin >Sent: maandag 13 oktober 2014 20:31 >To: 'General Discussion of SQLite Database' >Subject: Re: [sqlite] group_concat

Re: [sqlite] group_concat query performance

2014-10-13 Thread Joe Mistachkin
Kraijenbrink - FixHet - Systeembeheer wrote: > > 1. "SQLitePerfTest - C++ " runs very fast. 50.000 queries in 8 or 9 seconds; > > 2. "SQLitePerfTest - VB.net runs very fast. 50.000 queries in 7 or 8 seconds. >(Without the GROUP_CONCAT function that is;) > > 3. "SQLitePerfTest - VB.net

Re: [sqlite] group_concat query performance

2014-10-13 Thread Kraijenbrink - FixHet - Systeembeheer
Hi, I've created 3 test samples. A C++ (sqlite-amalgamation-3080600 .lib) and two VB.NET variants (sqlite-netFx40-binary-x64-2010-1.0.94.0). 1. "SQLitePerfTest - C++ " runs very fast. 50.000 queries in 8 or 9 seconds; 2. "SQLitePerfTest - VB.net runs very fast. 50.000 queries in 7 or 8

Re: [sqlite] group_concat query performance

2014-09-30 Thread Kraijenbrink - FixHet - Systeembeheer
Kaspersky Antivirus. = -Original Message- From: sqlite-users-boun...@sqlite.org [mailto:sqlite-users-boun...@sqlite.org] On Behalf Of Richard Hipp Sent: donderdag 25 september 2014 17:46 To: General Discussion of SQLite Database Subject: Re: [sqlite] group_concat query performance On Th

Re: [sqlite] group_concat query performance

2014-09-25 Thread Richard Hipp
On Thu, Sep 25, 2014 at 9:34 AM, Richard Hipp wrote: > Thanks for the schema. Unfortunately, that was insufficient to reproduce > the problem. Are you able to send me the actual database file, via private > email? > Thanks for sending the data. But I'm still not able to

Re: [sqlite] group_concat query performance

2014-09-25 Thread Clemens Ladisch
Richard Hipp wrote: > Note that the use of AUTOINCREMENT has nothing to do with your > problem - I just see people using it a lot and I'm wondering why > it is so popular MySQL needs it. Every search for "autoincrement" will find it. This keyword's name appears to imply that you do _not_ get

Re: [sqlite] group_concat query performance

2014-09-25 Thread Richard Hipp
Thanks for the schema. Unfortunately, that was insufficient to reproduce the problem. Are you able to send me the actual database file, via private email? Aside: Why are you using AUTOINCREMENT? Do you really need it? Are you aware that there are space and time penalties for using

Re: [sqlite] group_concat query performance

2014-09-25 Thread Kraijenbrink - FixHet - Systeembeheer
Hi, Thank you for the fast response. Below this line you'll find sqlite3.exe's output: CREATE TABLE tblFolderNames ( pkintFolderNameID integer PRIMARY KEY AUTOINCREMENT NOT NULL, txtNametext NOT NULL UNIQUE COLLATE nocase ); CREATE TABLE tblFolders ( pkintFolderID

Re: [sqlite] group_concat query performance

2014-09-25 Thread Richard Hipp
Please run the ".fullschema" command on your database and send us the output. I mean by this: (1) Download the latest version of sqlite3.exe from the website. (2) Run "sqlite3 YOURDATABASE .fullschema >out.txt" (3) Include the text of out.txt in the body of a follow-up email. That information

Re: [sqlite] group_concat query performance

2014-09-25 Thread Dominique Devienne
On Thu, Sep 25, 2014 at 12:54 PM, Kraijenbrink - FixHet - Systeembeheer < kraijenbr...@fixhet.nl> wrote: > > SELECT GROUP_CONCAT(Parent.fkintFolderID,'\') FilePath > FROM tblFolderNestedSets Node > , tblFolderNestedSets Parent > WHERE Node.intLeft BETWEEN Parent.intLeft AND Parent.intRight > AND

[sqlite] group_concat query performance

2014-09-25 Thread Kraijenbrink - FixHet - Systeembeheer
Hi all, I've searched through this forum but couldn't find any related topic regarding my question. I'm having serious performance problems (queries up to 20/sec) while running a SQLite query since i added a group_concat clause. The query looks like: SELECT