Your SQL pass, so it is somewhere in the library. The problem is how to
find in the big data where exactly. I am now going one character by each
other, because it is probably only one specific record kind doing that.
I was able to compile the library under linux and running strace looks
like this:
lseek(3, 9742336, SEEK_SET) = 9742336
read(3,
"\r\0\0\0.\0x\0\3\357\3\333\3\313\3\273\3\250\3\223\3~\3k\3Y\3G\0033\3\31"...,
1024) = 1024
lseek(3, 9743360, SEEK_SET) = 9743360
read(3,
"\r\0\0\0)\0~\0\3\354\3\330\3\304\3\260\3\234\3\210\3t\3`\3L\0038\3$\3\20"...,
1024) = 1024
open("/dev/tty", O_RDWR|O_NOCTTY|O_NONBLOCK) = 4
writev(4, [{"*** Error in `", 14},
{"/home/milan/sqlite/sqlite-autoco"..., 56}, {"': ", 3}, {"free():
invalid next size (fast)", 32}, {": 0x", 4}, {"0000000001eadc20", 16},
{" ***\n", 5}], 7*** Error in
`/home/milan/sqlite/sqlite-autoconf-3080803/.libs/sqlite3': free():
invalid next size (fast): 0x0000000001eadc20 ***
) = 130
mmap(NULL, 4096, PROT_READ|PROT_WRITE, MAP_PRIVATE|MAP_ANONYMOUS, -1, 0)
= 0x7fe78ca59000
any hint how to fast find which record is doing that crash or even fix
for such crash is welcome :)
Milan
On 2015-03-11 19:30, Simon Slavin wrote:
>> On 11 Mar 2015, at 4:56pm, Milan Roubal <roubal at keyserver.cz> wrote:
>>
>> I am also facing problem with sqlite closed by windows because of
>> crash. On same data this query crash:
>>
>> select load_extension("libstringmetrics.dll");
>> select a.vorname, b.vorname, a.nachname, b.nachname,
>> stringmetrics("qgrams_distance","similarity",a.nachname, b.nachname,
>> "") nach_dist
>> from r2 a, allUsers b
>> where
>> a.vorname like 'r%' and b.vorname like 'r%' and
>> round(nach_dist) between 50 and 100
>> ;
>>
>> The first query is able to pass on some small sample, but not on all
>> my data. I am trying to find what concrete string comparison is
>> crashing it, but it is slow with crashes. Is there any way how to
>> start logging the calls of the library to find the exact data that are
>> causing the crash?
>
> Try this command
>
> select a.vorname, b.vorname, a.nachname, b.nachname,
> 55 nach_dist
> from r2 a, allUsers b
> where
> a.vorname like 'r%' and b.vorname like 'r%' and
> round(nach_dist) between 50 and 100
>
> If it does not crash then the problem is in your stringmetrics library.
>
> Simon.
> _______________________________________________
> sqlite-users mailing list
> sqlite-users at mailinglists.sqlite.org
> http://mailinglists.sqlite.org/cgi-bin/mailman/listinfo/sqlite-users
