There is not a bigquery api exposed to set the description when you want to run a query and save the results to a table - which is the main reason I wanted this. My flow is load data into staging tables -> aggregate data using sql and save the results to new table -> set table description on new table with metadata such as timestamp when aggregate was performed, source systems etc.
The other use case I want it for is to include metadata such as latest extract date or load date in history tables. This obviously changes each time new data is added to the table so can not be set at table creation time, and again there does not seem an api exposed to set description when adding data to an existing table. I could change the existing operators to include a description parameters, and then call the hook to set the description after it has run, but it seemed simpler and more useful to add a new operator to set the description [ Full content available at: https://github.com/apache/incubator-airflow/pull/4003 ] This message was relayed via gitbox.apache.org for devnull@infra.apache.org
