GitHub user geserdugarov added a comment to the discussion: [DISCUSS] New Agentic lakehouse module & built-in AI agent gateway
Great proposal to move towards an Agentic Lakehouse. It should be done, but I want to share a thought: I do not think it would be enough. I believe that the real breakthrough could come from making hudi-ai-gateway a harness. It should provide an agent loop that discovers the data interactively and is able to provide everything requested by an LLM during a session. This is where we start to face some really hard subtasks. For instance, we need to provide some kind of Table Viewer tool, and I am pessimistic about its current state. I think it should be similar to the File Viewer tools used in agent harnesses. A useful precedent is the [SWE-agent paper](https://arxiv.org/abs/2405.15793): an open-file window of at most 100 numbered lines, together with the file path, total line count, omitted-line counts, visible line numbers, scrolling, and goto. It is really tricky to provide something similar for a table. Perhaps it should be done differently. GitHub link: https://github.com/apache/hudi/discussions/19264#discussioncomment-17710931 ---- This is an automatically sent email for [email protected]. To unsubscribe, please send an email to: [email protected]
