[
https://issues.apache.org/jira/browse/AIRFLOW-2551?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16498452#comment-16498452
]
ASF subversion and git services commented on AIRFLOW-2551:
----------------------------------------------------------
Commit 975a45b0246eb836d653c7210651ecc9590c6db4 in incubator-airflow's branch
refs/heads/master from [~whynick1]
[ https://git-wip-us.apache.org/repos/asf?p=incubator-airflow.git;h=975a45b ]
[AIRFLOW-2551] Encode binary data with base64 standard rather than base64 url
> Encode binary data with base64 standard rather than base64 url
> --------------------------------------------------------------
>
> Key: AIRFLOW-2551
> URL: https://issues.apache.org/jira/browse/AIRFLOW-2551
> Project: Apache Airflow
> Issue Type: Bug
> Reporter: Hongyi Wang
> Assignee: Hongyi Wang
> Priority: Major
> Fix For: 2.0.0
>
>
> When we try to load mysql data into Google BigQuery (mysql -> gcs -> bq),
> there is a binary filed (uuid), which will cause BigQuery job failed, with
> message "_Could not decode base64 string to bytes. Field: uuid; Value:
> _gJbkmC1QTiS-zZ46uiHWg==_"
> This was caused by "_col_val = base64.urlsafe_b64encode(col_val)_" in
> mysql_to_gcs_operator.
> We should use "_standard_b64encode()_" instead.
> {quote}{{Base64url encoding is basically base64 encoding except they use
> non-reserved URL characters (e.g. – is used instead of + and _ is used
> instead of /) __ }}
> {quote}
> Related to [AIRFLOW-2169]
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
