jacktengg opened a new pull request, #11728:
URL: https://github.com/apache/doris/pull/11728
# Proposed changes
Issue Number: close #xxx
## Problem summary
When inserting into external ODBC table, if data contains unicode chars
whose code point value is bigger than max int16, `utf8_ucs2_cvt.from_bytes`
throws exception `std::range_error` and causes BE coredump.
This is a temporary solution only to avoid BE coredump. A final solution to
support UNICODE chars bigger than max int16 should be provided later.
How to reproduce:
```
-- mysql table
CREATE TABLE t1 (
room_id bigint,
space_name varchar(300)
);
-- doris table
CREATE EXTERNAL RESOURCE `mysql_resource`
PROPERTIES (
"host" = "127.0.0.1",
"port" = "3306",
"user" = "root",
"password" = "",
"database" = "test",
"driver" = "MySQL ODBC 5.3",
"odbc_type" = "mysql",
"type" = "odbc_catalog");
CREATE EXTERNAL TABLE `t1` (
`room_id` bigint(20) NULL COMMENT "ID",
`space_name` text NULL COMMENT "name"
) ENGINE=ODBC
COMMENT "ODBC"
PROPERTIES (
"odbc_catalog_resource" = "mysql_resource",
"database" = "test",
"table" = "t1"
);
CREATE TABLE `t2` (
`room_id` bigint(20) NULL COMMENT "ID",
`space_name` text NULL COMMENT "name"
) ENGINE=OLAP
UNIQUE KEY(`room_id`)
COMMENT "OLAP"
DISTRIBUTED BY HASH(`room_id`) BUCKETS 2
PROPERTIES (
"replication_allocation" = "tag.location.default: 1",
"in_memory" = "false",
"storage_format" = "V2"
);
insert into `t2`(`room_id`,`space_name`) values (1, "a🐷b");
insert into t1 select * from t2;
```
## Checklist(Required)
1. Does it affect the original behavior:
- [ ] Yes
- [ ] No
- [ ] I don't know
2. Has unit tests been added:
- [ ] Yes
- [ ] No
- [ ] No Need
3. Has document been added or modified:
- [ ] Yes
- [ ] No
- [ ] No Need
4. Does it need to update dependencies:
- [ ] Yes
- [ ] No
5. Are there any changes that cannot be rolled back:
- [ ] Yes (If Yes, please explain WHY)
- [ ] No
## Further comments
If this is a relatively large or complex change, kick off the discussion at
[[email protected]](mailto:[email protected]) by explaining why you
chose the solution you did and what alternatives you considered, etc...
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
