GitHub user collimarco closed a discussion: Fast full-text search or LIKE query on Parquet file on S3
I am trying to filter some logs that are stored in Parquet format on S3. I use a query like this: ``` SELECT status, message FROM sample WHERE status = 200 AND message LIKE '%foo%' ``` **Is this the right approach to search some keywords in a text field? Or is there a better/faster function to use instead of SQL LIKE?** In particular I would like to optimize the speed of the query and reduce the data downloaded (e.g. leveraging the condition pushdown). GitHub link: https://github.com/apache/datafusion/discussions/6545 ---- This is an automatically sent email for [email protected]. To unsubscribe, please send an email to: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
