[
https://issues.apache.org/jira/browse/AIRFLOW-1613?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16204371#comment-16204371
]
ASF subversion and git services commented on AIRFLOW-1613:
----------------------------------------------------------
Commit 85127769dc4e69abd26b0f9aa8cca0decb266daa in incubator-airflow's branch
refs/heads/master from [~criccomini]
[ https://git-wip-us.apache.org/repos/asf?p=incubator-airflow.git;h=8512776 ]
Revert "[AIRFLOW-1613] Handle binary field in MySqlToGoogleCloudStorageOperator"
Reverting due to improper handling of binary description_flag.
This reverts commit d578b292e96d5fdd87b5168508005cd73edc4f96.
> Make MySqlToGoogleCloudStorageOperator compaitible with python3
> ---------------------------------------------------------------
>
> Key: AIRFLOW-1613
> URL: https://issues.apache.org/jira/browse/AIRFLOW-1613
> Project: Apache Airflow
> Issue Type: Bug
> Components: contrib
> Reporter: Joy Gao
> Assignee: Joy Gao
> Fix For: 1.9.0
>
>
> 1.
> In Python 3, map(...) returns an iterator, which can only be iterated over
> once.
> Therefore the current implementation will return an empty list after the
> first iteration of schema:
> {code}
> schema = map(lambda schema_tuple: schema_tuple[0], cursor.description)
> file_no = 0
> tmp_file_handle = NamedTemporaryFile(delete=True)
> tmp_file_handles = {self.filename.format(file_no): tmp_file_handle}
> for row in cursor:
> # Convert datetime objects to utc seconds, and decimals to floats
> row = map(self.convert_types, row)
> row_dict = dict(zip(schema, row))
> {code}
> 2.
> File opened as binary, but string are written to it. Get error `a bytes-like
> object is required, not 'str'`. Use mode='w' instead.
> 3.
> Operator currently does not support binary columns in mysql. We should
> support uploading binary columns from mysql to cloud storage as it's a pretty
> common use-case.
--
This message was sent by Atlassian JIRA
(v6.4.14#64029)
