LorrensP-2158466 commented on issue #1588: URL: https://github.com/apache/datafusion-sqlparser-rs/issues/1588#issuecomment-2585725385
I don't know if this is useful, but I remember watching a video from Strager: [Perfect Hash Tables](https://youtu.be/DMQ_HcNSOAI?si=pTcWhy_D2-wBIkHb). He had the same kind of problem and created a "custom" hash table by using the information he already has, the known keywords In short, because he knew which words are keywords, he built his hash table around that by combining the first 2 and last 2 bytes and hashing that. And after that still compare. (This is of the top of my head) I did notice there are about ~800 keywords, so I don't know if it's feasible, but maybe it's worth looking into it? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
