jens-scheffler-bosch commented on issue #33827: URL: https://github.com/apache/airflow/issues/33827#issuecomment-1703183055
That sounds like a nice feature, I was also sometimes tempted / demanded to find specific runs in the grid view and missed as "simple" option to find a run older than the last 25/100. The current alternative is only using the "Browse" -> "DAG Runs" menu item but also there a search based on parameters is not working. Maybe the idea must be split up into two parts getting it in manageable size: * Have a search option in grid view in general * Have a search option for params in there (as I assume you would also filter for other criterias like run_id etc...) The main challenge I see in making a search for specific params is: The params are stored as serialized object in the database as blob. If you want to search within the params dict, you need to de-serialize all items into Python back again - which would be possible for a few but if you think of thousands of runs this can get really a big effort and is more than a full table scan. It needs to read all data into the web server. Also as the dict is not stored as a DB accessible object, a query can not be pushed to the DB engine. Effectively this means searching for params would need an extension of the database model such that the values are stored in a searchable table as index in the database to effectively find records. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
