Lee-W commented on code in PR #76799:
URL: https://github.com/apache/airflow/pull/76799#discussion_r4597459965


##########
providers/common/ai/docs/toolsets/sql.rst:
##########
@@ -337,9 +344,114 @@ Parameters
   Must be a valid Python identifier. Set it when one agent has another toolset 
with the
   same tool names, since duplicate tool names are rejected. A function passed 
to
   ``.approval_required()`` sees these prefixed names; see ``allow_writes`` 
above.
+- ``include_table_comments``: When ``True``, ``list_tables`` returns
+  ``{"name": ..., "comment": ...}`` objects instead of bare names; ``comment`` 
is
+  present only for tables that have one. Default ``False``. ``get_schema`` 
returns
+  comments regardless. See :ref:`sql-toolset-comments`.
+- ``search_backend``: Registers the ``search_tables`` tool. Default ``None``, 
no search
+  tool. See :ref:`sql-toolset-table-search`.
+- ``max_listed_tables``: With a ``search_backend``, the number of tables above 
which
+  ``list_tables`` stops listing and points at ``search_tables``. Default 
``100``. No
+  effect without a ``search_backend``.
 - ``max_retries``: How many times the model may correct a failed call to these
   tools. Default ``None``, the agent's ``retries``. See 
:ref:`toolset-retry-budget`.
 
+.. _sql-toolset-comments:
+
+Table and column comments
+-------------------------
+
+A column named ``amt_adj_2`` tells an agent little; the comment the database 
holds for
+it often does. ``get_schema`` returns ``table_comment`` and a ``comment`` on 
each column
+where the database reports one:
+
+.. code-block:: json
+
+    {"columns": [{"name": "amt_adj_2", "type": "NUMERIC", "comment": "Net of 
refunds"}],
+     "column_count": 1, "table_comment": "Customer orders"}
+
+Comments are read through ``DbApiHook.get_table_comment`` and
+``DbApiHook.get_table_columns_with_comments``, which ``common.sql`` provides 
from the
+release that added them. With an older ``common.sql``, or on a dialect that 
cannot report
+comments (SQLite, for one), ``get_schema`` works as before and returns none. A 
failure reading
+the *table* comment is ignored for the same reason; a failure reading the 
columns is not.
+
+Each comment is cut to 200 characters. Comments share ``max_result_bytes`` 
with the
+columns, so a wide table with long comments can cross the budget where the 
same table
+without them would not. When the result is summarized (see 
:ref:`bounded-schema-results`),
+the column comments are left out, the summary says so with 
``comments_omitted``, and the
+agent gets them back by asking for the columns it needs with ``name_contains``.
+
+``include_table_comments=True`` adds the table comments to ``list_tables``, 
and the default
+search backend reads the same comments to build its catalog. Both call the 
Inspector's
+``get_multi_table_comment`` once per schema. What that costs depends on the 
dialect. Where the
+dialect does not implement ``get_multi_table_comment`` itself, SQLAlchemy's 
default reads the
+comments one table at a time. Based on the dialects' reflection 
implementations (read, not run
+against a live database), Snowflake (``snowflake-sqlalchemy`` 2.1.0) and 
BigQuery
+(``sqlalchemy-bigquery`` 1.17.3) do not implement it, so there each table 
costs one query, or one
+API call on BigQuery, and a schema with many tables makes this slow. On 
PostgreSQL it was a single
+query when tried. On such databases leave ``include_table_comments`` off for 
large schemas, or pass
+a custom ``search_backend`` that builds its catalog with one dialect-specific 
query, for example
+against ``INFORMATION_SCHEMA``.
+
+SQLAlchemy 1.4 has no ``get_multi_table_comment``, so there ``list_tables`` 
returns tables without
+comments rather than reading them table by table. The default search backend 
then has no comments
+to match, and a query whose words appear only in comments returns nothing; 
matching on table
+names still works.
+
+.. _sql-toolset-table-search:
+
+Finding tables in a large warehouse
+-----------------------------------
+
+Listing every table stops working once there are hundreds. Pass a 
``search_backend`` and the
+agent gets a ``search_tables`` tool that takes a free-text ``query`` and an 
optional
+``limit`` (default 10, at most 50) and returns matching tables with their 
comments. Once
+there are more than ``max_listed_tables`` tables, ``list_tables`` returns only 
their number

Review Comment:
   Added both from a real run: the `table_count`/`hint` result and a 
`search_tables` result, plus the empty case.



-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: [email protected]

For queries about this service, please contact Infrastructure at:
[email protected]

Reply via email to