trikker opened a new issue, #231: URL: https://github.com/apache/doris-flink-connector/issues/231
### Search before asking - [X] I had searched in the [issues](https://github.com/apache/incubator-doris/issues?q=is%3Aissue) and found no similar issues. ### Version 1.4.0 ### What's Wrong? After syncing mysql data to doris, the blob type is converted to doris text type because doris doesn't support blob type. But the data should not be converted to base64 encoded. ### What You Expected? The data should be hex encoded in doris text type or a config should be added to specify the encoder of blob/binary data from source database(e.g. MySQL). ### How to Reproduce? suppose there is a table tt in MySQL which contains blob data type: ``` CREATE TABLE `tt` ( `id` int NOT NULL AUTO_INCREMENT, `name` varchar(20) COLLATE utf8mb4_general_ci DEFAULT NULL, `bb` blob, `tt` text); ``` After run the following job, the blob type in MySQL is converted to text type in doris and the data is base64-encoded. ``` bin/flink run -d \ -Dexecution.checkpointing.interval=10s \ -Dparallelism.default=1 \ -c org.apache.doris.flink.tools.cdc.CdcTools \ lib/flink-doris-connector-1.17-1.4.0.jar \ mysql-sync-database \ --database testdb \ --job-name flink_sync_mysql_to_doris_testdb \ --mysql-conf hostname=xxxx \ --mysql-conf port=3360 \ --mysql-conf username=flink \ --mysql-conf password=flink \ --mysql-conf database-name=testdb \ --including-tables ".*" \ --sink-conf fenodes=xxxx:8030 \ --sink-conf username=flink \ --sink-conf password=flink \ --sink-conf jdbc-url=jdbc:mysql://xxxx:9030 \ --sink-conf sink.label-prefix=labeltest1898 \ --table-conf replication_num=1 ``` ### Anything Else? It is strange and I haven't found the problem in the code. I searched "base64" in the code and don't find anything suspicious. Maybe the code is in its dependency? ### Are you willing to submit PR? - [X] Yes I am willing to submit a PR! ### Code of Conduct - [X] I agree to follow this project's [Code of Conduct](https://www.apache.org/foundation/policies/conduct) -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
