wang-zhiang commented on issue #4776:
URL:
https://github.com/apache/incubator-seatunnel/issues/4776#issuecomment-1552683631
There's something at the bottom
1.This is the ddl of the source table at synchronization:
CREATE TABLE `ods.mj_temp`(
`itemid` string,
`itemname` string,
`city` string,
`shopcity` string,
`leaf_classid` string,
`leaf_class` string,
`bid` string,
`brandname` string,
`shopid` string,
`shopname` string,
`catid1` string,
`catid2` string,
`catid3` string,
`catid4` string,
`class_1_category` string,
`class_2_category` string,
`class_3_category` string,
`class_4_category` string,
`shoptype_1` string,
`background_level_1_category` string,
`background_level_2_category` string,
`background_level_3_category` string,
`background_level_4_category` string,
`background_leaf_category` string,
`brand` string,
`model` string,
`modelid` string,
`subtitle` string,
`stock` string,
`marked_price` string,
`sales_volume` string,
`sales_volume2` string,
`qty` double,
`sales__price` string,
`price` double,
`comments` string,
`isjd_logistics` string,
`isoverseas_purchase` string,
`product_properties` string,
`skuname` string,
`time_` string,
`priceall` string,
`prices` string,
`sales_data_crawl_date` string,
`attribute` string,
`buyyernum` string,
`column_23` string,
`salesdatasource` string,
`comcount` string,
`ttype` string,
`categoryid` string,
`brandid` string,
`sellerid` string,
`shop` string,
`id` string,
`shopuserid` string,
`isglobal_purchase` string,
`adddate` string,
`grand` string,
`ttypeold` string,
`categoryidold` string,
`brandidold` string,
`gtype` string,
`from_table_name` string,
`pt_channel` string,
`pt_ym` string)
ROW FORMAT SERDE
'org.apache.hadoop.hive.serde2.lazy.LazySimpleSerDe'
STORED AS INPUTFORMAT
'org.apache.hadoop.mapred.TextInputFormat'
OUTPUTFORMAT
'org.apache.hadoop.hive.ql.io.HiveIgnoreKeyTextOutputFormat'
LOCATION
'hdfs://mycluster/user/hive/warehouse/ods.db/mj_temp'
TBLPROPERTIES (
'bucketing_version'='2',
'last_modified_by'='smartpath',
'last_modified_time'='1663656042',
'transient_lastDdlTime'='1663656042')
2. The following is the ddl of the synchronized result table :(Note: The ddl
of the result table is derived from the source table create table as)
CREATE TABLE `tmp.mj_temp`(
`itemid` string,
`itemname` string,
`city` string,
`shopcity` string,
`leaf_classid` string,
`leaf_class` string,
`bid` string,
`brandname` string,
`shopid` string,
`shopname` string,
`catid1` string,
`catid2` string,
`catid3` string,
`catid4` string,
`class_1_category` string,
`class_2_category` string,
`class_3_category` string,
`class_4_category` string,
`shoptype_1` string,
`background_level_1_category` string,
`background_level_2_category` string,
`background_level_3_category` string,
`background_level_4_category` string,
`background_leaf_category` string,
`brand` string,
`model` string,
`modelid` string,
`subtitle` string,
`stock` string,
`marked_price` string,
`sales_volume` string,
`sales_volume2` string,
`qty` double,
`sales__price` string,
`price` double,
`comments` string,
`isjd_logistics` string,
`isoverseas_purchase` string,
`product_properties` string,
`skuname` string,
`time_` string,
`priceall` string,
`prices` string,
`sales_data_crawl_date` string,
`attribute` string,
`buyyernum` string,
`column_23` string,
`salesdatasource` string,
`comcount` string,
`ttype` string,
`categoryid` string,
`brandid` string,
`sellerid` string,
`shop` string,
`id` string,
`shopuserid` string,
`isglobal_purchase` string,
`adddate` string,
`grand` string,
`ttypeold` string,
`categoryidold` string,
`brandidold` string,
`gtype` string,
`from_table_name` string,
`pt_channel` string,
`pt_ym` string)
ROW FORMAT SERDE
'org.apache.hadoop.hive.serde2.lazy.LazySimpleSerDe'
STORED AS INPUTFORMAT
'org.apache.hadoop.mapred.TextInputFormat'
OUTPUTFORMAT
'org.apache.hadoop.hive.ql.io.HiveIgnoreKeyTextOutputFormat'
LOCATION
'hdfs://mycluster/user/hive/warehouse/tmp.db/mj_temp'
TBLPROPERTIES (
'transient_lastDdlTime'='1684315313')
Hello, thank you for your reply, do I need to provide it? Besides DDL, you
said there are data, I sent you the data in the form of csv in my last email,
is there anything wrong with it? Is there anything else I need to provide?
------------------ 原始邮件 ------------------
发件人:
"apache/incubator-seatunnel"
***@***.***>;
发送时间: 2023年5月18日(星期四) 下午3:40
***@***.***>;
***@***.******@***.***>;
主题: Re: [apache/incubator-seatunnel] Synchronizing data to hive
contains garbled characters (Issue #4776)
you Can put hive sql ddl and data into this problem
—
Reply to this email directly, view it on GitHub, or unsubscribe.
You are receiving this because you authored the thread.Message ID:
***@***.***>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
