Hi all, I have a pipeline reading CSV files, performing some transforms, and writing to BigQuery. At the moment I'm reading the BigQuery schema from a separate JSON file. If the CSV files had a new column added (and I wanted to include this column in the resultant BigQuery table), I'd have to change the JSON schema or the pipeline itself. Is there any way to autodetect the schema using BigQueryIO? How do people normally deal with potential changes to input CSVs?
Thanks, Joe
