[ https://issues.apache.org/jira/browse/AIRFLOW-2551?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Joy Gao resolved AIRFLOW-2551. ------------------------------ Resolution: Fixed Fix Version/s: 2.0.0 Issue resolved by pull request #3449 [https://github.com/apache/incubator-airflow/pull/3449] > Encode binary data with base64 standard rather than base64 url > -------------------------------------------------------------- > > Key: AIRFLOW-2551 > URL: https://issues.apache.org/jira/browse/AIRFLOW-2551 > Project: Apache Airflow > Issue Type: Bug > Reporter: Hongyi Wang > Assignee: Hongyi Wang > Priority: Major > Fix For: 2.0.0 > > > When we try to load mysql data into Google BigQuery (mysql -> gcs -> bq), > there is a binary filed (uuid), which will cause BigQuery job failed, with > message "_Could not decode base64 string to bytes. Field: uuid; Value: > _gJbkmC1QTiS-zZ46uiHWg==_" > This was caused by "_col_val = base64.urlsafe_b64encode(col_val)_" in > mysql_to_gcs_operator. > We should use "_standard_b64encode()_" instead. > {quote}{{Base64url encoding is basically base64 encoding except they use > non-reserved URL characters (e.g. – is used instead of + and _ is used > instead of /) __ }} > {quote} > Related to [AIRFLOW-2169] -- This message was sent by Atlassian JIRA (v7.6.3#76005)