[ 
https://issues.apache.org/jira/browse/AIRFLOW-259?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16882492#comment-16882492
 ] 

John Bodley commented on AIRFLOW-259:
-------------------------------------

[~jackjack10] I'm unsure as we're currently not using either of these 
operators. 

> MySqlToHiveOperator incorrectly requotes strings due to csv.writer 
> configuration
> --------------------------------------------------------------------------------
>
>                 Key: AIRFLOW-259
>                 URL: https://issues.apache.org/jira/browse/AIRFLOW-259
>             Project: Apache Airflow
>          Issue Type: Bug
>          Components: operators
>            Reporter: John Bodley
>            Priority: Minor
>
> The MySqlToHiveOperator has the same issue as the HiveToMySqlOperator when 
> bulk_load=True, i.e. the both use a csv.writer as an intermediate step, which 
> mangles strings containing quotes due to the quoting logic. 
> For example a JSON blob in MySQL of the form 
>     {"dashboard_id": "85"}
> becomes
>    "{""dashboard_id"": 85}"   
> in Hive.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

Reply via email to