LucaCappelletti94 opened a new pull request, #3021: URL: https://github.com/apache/datafusion-sqlparser-rs/pull/3021
`CREATE VIRTUAL TABLE ft USING fts5(body, tokenize = 'porter')` fails with `Expected: ), found: =`, and `fts5(a, b UNINDEXED)` fails the same way, because the module arguments are parsed as a list of identifiers. SQLite defines each argument as [any token sequence with balanced parentheses](https://www.sqlite.org/lang_createvtab.html) and keeps the statement verbatim in `sqlite_schema`, so stored DDL for an FTS5 table with options cannot be parsed back. Each argument is kept as the text written between top-level commas, together with its span, in a new `VirtualTableModuleArgument`. The meaning of an argument belongs to the module, so the whitespace inside it is kept (for example `filename=data.csv` must not come back as `data . csv`), quoted strings are re-escaped, and empty arguments are dropped as SQLite drops them. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
