[
https://issues.apache.org/jira/browse/AIRFLOW-5553?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Felix Uellendall resolved AIRFLOW-5553.
---------------------------------------
Fix Version/s: 1.10.6
Resolution: Fixed
> mysql_to_gcs.MySqlToGoogleCloudStorageOperator binary values cannot be
> encoded whenever a BQ schema is not explicitly specified
> -------------------------------------------------------------------------------------------------------------------------------
>
> Key: AIRFLOW-5553
> URL: https://issues.apache.org/jira/browse/AIRFLOW-5553
> Project: Apache Airflow
> Issue Type: Bug
> Components: operators
> Affects Versions: 1.10.3, 1.10.4, 1.10.5
> Reporter: Nikolay Stoynov
> Assignee: Nikolay Stoynov
> Priority: Minor
> Labels: easyfix
> Fix For: 1.10.6
>
>
>
> The MySqlGoogleCloudStorageOperator currently deals with `bytes` values.
> However, the way it detects when a value is of type `bytes` is dependent on
> the column type in the BQ schema provided.
> Therefore, whenever a BQ schema is not provided, the value is not dealt with
> and a serialization issue occurs:
> {noformat}
> [2018-10-11 17:59:36,056] INFO
> airflow.task.task_runner.bash_task_runner.BashTaskRunner _read_task_logs -
> Job 11906: Subtask my_subtask TypeError: Object of type 'bytes' is not JSON
> serializable{noformat}
> This should be a trivial fix but needs to be addressed so that the check for
> a bytes value is based on the type of the variable too.
>
--
This message was sent by Atlassian Jira
(v8.3.4#803005)