mobuchowski commented on code in PR #45798:
URL: https://github.com/apache/airflow/pull/45798#discussion_r1922624860
##########
airflow/lineage/hook.py:
##########
@@ -159,6 +160,9 @@ def add_input_asset(
asset_extra: dict | None = None,
):
"""Add the input asset and its corresponding hook execution context to
the collector."""
+ if len(self._inputs) >= 100:
+ self.log.debug("Maximum number of asset inputs exceeded.
Skipping.")
Review Comment:
I wanted to avoid flood of log messages when someone causes it to add 100s
of thousands of inputs.
Changed it to have additional log for the first time output is exceeded,
with log level warning - this way there will be an indication of that happening.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
