[Touch-packages] [Bug 1546911] Re: Please recompile sqlite 3.11 with -DSQLITE_ENABLE_FTS3_TOKENIZER

2016-03-20 Thread Michi Henning
** Changed in: mediascanner2 (Ubuntu) Status: Confirmed => Invalid -- You received this bug notification because you are a member of Ubuntu Touch seeded packages, which is subscribed to mediascanner2 in Ubuntu. https://bugs.launchpad.net/bugs/1546911 Title: Please recompile sqlite 3.11

[Touch-packages] [Bug 1546911] Re: Please recompile sqlite 3.11 with -DSQLITE_ENABLE_FTS3_TOKENIZER

2016-02-23 Thread Launchpad Bug Tracker
This bug was fixed in the package sqlite3 - 3.11.0-1ubuntu1 --- sqlite3 (3.11.0-1ubuntu1) xenial; urgency=medium * debian/rules: compile SQLite with SQLITE_ENABLE_FTS3_TOKENIZER to re-enable the two-argument version of fts3_tokenizer() used by mediascanner2 (LP: #1546911)

[Touch-packages] [Bug 1546911] Re: Please recompile sqlite 3.11 with -DSQLITE_ENABLE_FTS3_TOKENIZER

2016-02-23 Thread Łukasz Zemczak
I uploaded the modified sqlite3 to xenial-proposed. -- You received this bug notification because you are a member of Ubuntu Touch seeded packages, which is subscribed to mediascanner2 in Ubuntu. https://bugs.launchpad.net/bugs/1546911 Title: Please recompile sqlite 3.11 with

[Touch-packages] [Bug 1546911] Re: Please recompile sqlite 3.11 with -DSQLITE_ENABLE_FTS3_TOKENIZER

2016-02-22 Thread James Henstridge
Well, one other major user of this API is Thunderbird. In fact, the tokenizer we use in mediascanner is based on the one they developed. It looks like a number of other people had also extracted the Mozilla tokenizer too, since none of the built-in options give the same multi- language

[Touch-packages] [Bug 1546911] Re: Please recompile sqlite 3.11 with -DSQLITE_ENABLE_FTS3_TOKENIZER

2016-02-22 Thread Tyler Hicks
I agree that applications shouldn't be running untrusted SQL/PHP. We can enable the flag in our sqlite3 package for now but, as Łukasz mentioned, I think it would be best if James could work with upstream to get a proper tokenizer in place in the future. -- You received this bug notification

[Touch-packages] [Bug 1546911] Re: Please recompile sqlite 3.11 with -DSQLITE_ENABLE_FTS3_TOKENIZER

2016-02-22 Thread Łukasz Zemczak
I think we're all leaning a bit towards actually enabling this flag in our sqlite3 packages. In case the security team gives a +1 on it, I have already prepared the modified package for upload. That being said, I guess mediascanner2 needs to slowly think about the future. Since the documentation

[Touch-packages] [Bug 1546911] Re: Please recompile sqlite 3.11 with -DSQLITE_ENABLE_FTS3_TOKENIZER

2016-02-18 Thread James Henstridge
Tyler: no it isn't. The one argument version allows you to query for the existence of a particular named tokenizer. The two argument version is needed to register a new named tokenizer. When they disabled this they didn't offer an alternative for fts3/fts4 users, so the documentation just says

[Touch-packages] [Bug 1546911] Re: Please recompile sqlite 3.11 with -DSQLITE_ENABLE_FTS3_TOKENIZER

2016-02-18 Thread Tyler Hicks
Hi James - Is it possible to use the 1-argument variant of fts3_tokenizer()? See the second example in https://sqlite.org/fts3.html#f3tknzr -- You received this bug notification because you are a member of Ubuntu Touch seeded packages, which is subscribed to mediascanner2 in Ubuntu.

[Touch-packages] [Bug 1546911] Re: Please recompile sqlite 3.11 with -DSQLITE_ENABLE_FTS3_TOKENIZER

2016-02-18 Thread Łukasz Zemczak
** Changed in: sqlite3 (Ubuntu) Assignee: (unassigned) => Łukasz Zemczak (sil2100) ** Changed in: sqlite3 (Ubuntu) Status: New => Confirmed -- You received this bug notification because you are a member of Ubuntu Touch seeded packages, which is subscribed to mediascanner2 in Ubuntu.

[Touch-packages] [Bug 1546911] Re: Please recompile sqlite 3.11 with -DSQLITE_ENABLE_FTS3_TOKENIZER

2016-02-18 Thread James Henstridge
And as a simple test case for the problem, run the following: $ sqlite3 :memory: SQLite version ... Enter ".help" for usage hints. sqlite> select fts3_tokenizer('foo', fts3_tokenizer('porter')); On older versions this would register the tokenizer "foo". With 3.11.0, it spits out