?????? sql ????josn?????????? ????????????

claylin Fri, 17 Jul 2020 06:27:24 -0700

????????????????




------------------&nbsp;????????&nbsp;------------------
??????:                                                                         
                                               "user-zh"                        
                                                            
<[email protected]&gt;;
????????:&nbsp;2020??7??17??(??????) ????8:51
??????:&nbsp;"user-zh"<[email protected]&gt;;

????:&nbsp;Re: sql ????josn?????????? ????????????



??????????????????????????????????????????issue[1] ??????????????????

[1] https://issues.apache.org/jira/browse/FLINK-18590

Benchao Li <[email protected]&gt; ??2020??7??17?????? ????8:41??????

&gt; 
????????????????json??????array????????????????watermark????????????????????????????????
&gt;
&gt; claylin <[email protected]&gt; ??2020??7??17?????? ????8:37??????
&gt;
&gt;&gt; 
????????????????????????????????sql????????????????????????????????????????watermark????????????????????????????????flink????????
&gt;&gt;
&gt;&gt;
&gt;&gt;
&gt;&gt;
&gt;&gt; ------------------&amp;nbsp;????????&amp;nbsp;------------------
&gt;&gt; ??????:
&gt;&gt;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;
 "user-zh"
&gt;&gt;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;
 <
&gt;&gt; [email protected]&amp;gt;;
&gt;&gt; ????????:&amp;nbsp;2020??7??17??(??????) ????8:33
&gt;&gt; ??????:&amp;nbsp;"user-zh"<[email protected]&amp;gt;;
&gt;&gt;
&gt;&gt; ????:&amp;nbsp;Re: sql ????josn?????????? ????????????
&gt;&gt;
&gt;&gt;
&gt;&gt;
&gt;&gt; ??????????????????????????????????????????????????
&gt;&gt;
&gt;&gt; claylin <[email protected]&amp;gt; ??2020??7??17?????? ????8:28??????
&gt;&gt;
&gt;&gt; &amp;gt; hi all????????????????json????????????????????(ts AS 
CAST(FROM_UNIXTIME(hiido_time) AS
&gt;&gt; &amp;gt; TIMESTAMP(3)),????????)??????????????????
&gt;&gt; &amp;gt; create table hiido_push_sdk_mq (
&gt;&gt; &amp;gt; datas&amp;amp;nbsp; &amp;amp;nbsp;ARRAY<ROW<`from` 
string,hdid string,event
&gt;&gt; &amp;gt; string,hiido_time bigint,ts AS CAST(FROM_UNIXTIME(hiido_time) 
AS
&gt;&gt; &amp;gt; TIMESTAMP(3)),WATERMARK FOR ts AS ts - INTERVAL '5'
&gt;&gt; MINUTE&amp;amp;gt;&amp;amp;gt;
&gt;&gt; &amp;gt; ) with (
&gt;&gt; &amp;gt; 'connector' = 'kafka',
&gt;&gt; &amp;gt; 'topic' = 'hiido_pushsdk_event',
&gt;&gt; &amp;gt; 'properties.bootstrap.servers' = 
'kafkafs002-core001.yy.com:8103,
&gt;&gt; &amp;gt; 
kafkafs002-core002.yy.com:8103,kafkafs002-core003.yy.com:8103',
&gt;&gt; &amp;gt; 'properties.group.id' = 'push_click_sql_version_consumer',
&gt;&gt; &amp;gt; 'scan.startup.mode' = 'latest-offset',
&gt;&gt; &amp;gt; 'format.type' = 'json');
&gt;&gt; &amp;gt;
&gt;&gt; &amp;gt;
&gt;&gt; &amp;gt;
&gt;&gt; &amp;gt;
&gt;&gt; &amp;gt; ??????????
&gt;&gt; &amp;gt; [ERROR] 2020-07-17 20:17:50,640(562284338) --&amp;amp;gt;
&gt;&gt; [http-nio-8080-exec-10]
&gt;&gt; &amp;gt;
&gt;&gt; 
com.yy.push.flink.sql.gateway.sql.parse.SqlCommandParser.parseBySqlParser(SqlCommandParser.java:77):
&gt;&gt; &amp;gt; parseBySqlParser, parse:
&gt;&gt; &amp;gt; com.yy.push.flink.sql.gateway.context.JobContext$1@5d5f32d1, 
stmt:
&gt;&gt; create
&gt;&gt; &amp;gt; table hiido_push_sdk_mq (&amp;amp;nbsp; &amp;amp;nbsp; 
datas&amp;amp;nbsp;
&gt;&gt; &amp;amp;nbsp;ARRAY<ROW<`from`
&gt;&gt; &amp;gt; string,hdid string,event string,hiido_time bigint,ts AS
&gt;&gt; &amp;gt; CAST(FROM_UNIXTIME(hiido_time) AS TIMESTAMP(3)),WATERMARK FOR 
ts AS
&gt;&gt; ts -
&gt;&gt; &amp;gt; INTERVAL '5' MINUTE&amp;amp;gt;&amp;amp;gt;) with 
('connector' =
&gt;&gt; 'kafka','topic' =
&gt;&gt; &amp;gt; 'hiido_pushsdk_event','properties.bootstrap.servers' = '
&gt;&gt; &amp;gt; kafkafs002-core001.yy.com:8103,kafkafs002-core002.yy.com:8103,
&gt;&gt; &amp;gt; kafkafs002-core003.yy.com:8103','properties.group.id' =
&gt;&gt; &amp;gt; 'push_click_sql_version_consumer','scan.startup.mode' =
&gt;&gt; &amp;gt; 'latest-offset','format.type' = 'json'), error info: SQL parse
&gt;&gt; failed.
&gt;&gt; &amp;gt; Encountered "AS" at line 1, column 115.
&gt;&gt; &amp;gt; Was expecting one of:
&gt;&gt; &amp;gt; &amp;amp;nbsp; &amp;amp;nbsp; "ROW" ...
&gt;&gt; &amp;gt; &amp;amp;nbsp; &amp;amp;nbsp; 
<BRACKET_QUOTED_IDENTIFIER&amp;amp;gt; ...
&gt;&gt; &amp;gt; &amp;amp;nbsp; &amp;amp;nbsp; <QUOTED_IDENTIFIER&amp;amp;gt; 
...
&gt;&gt; &amp;gt; &amp;amp;nbsp; &amp;amp;nbsp; 
<BACK_QUOTED_IDENTIFIER&amp;amp;gt; ...
&gt;&gt; &amp;gt; &amp;amp;nbsp; &amp;amp;nbsp; <IDENTIFIER&amp;amp;gt; ...
&gt;&gt; &amp;gt; &amp;amp;nbsp; &amp;amp;nbsp; 
<UNICODE_QUOTED_IDENTIFIER&amp;amp;gt; ...
&gt;&gt; &amp;gt; &amp;amp;nbsp; &amp;amp;nbsp; "STRING" ...
&gt;&gt; &amp;gt; &amp;amp;nbsp; &amp;amp;nbsp; "BYTES" ...
&gt;&gt; &amp;gt; &amp;amp;nbsp; &amp;amp;nbsp; "ARRAY" ...
&gt;&gt; &amp;gt; &amp;amp;nbsp; &amp;amp;nbsp; "MULTISET" ...
&gt;&gt; &amp;gt; &amp;amp;nbsp; &amp;amp;nbsp; "RAW" ...
&gt;&gt; &amp;gt; &amp;amp;nbsp; &amp;amp;nbsp; "BOOLEAN" ...
&gt;&gt; &amp;gt; &amp;amp;nbsp; &amp;amp;nbsp; "INTEGER" ...
&gt;&gt; &amp;gt; &amp;amp;nbsp; &amp;amp;nbsp; "INT" ...
&gt;&gt; &amp;gt; &amp;amp;nbsp; &amp;amp;nbsp; "TINYINT" ...
&gt;&gt; &amp;gt; &amp;amp;nbsp; &amp;amp;nbsp; "SMALLINT" ...
&gt;&gt; &amp;gt; &amp;amp;nbsp; &amp;amp;nbsp; "BIGINT" ...
&gt;&gt; &amp;gt; &amp;amp;nbsp; &amp;amp;nbsp; "REAL" ...
&gt;&gt; &amp;gt; &amp;amp;nbsp; &amp;amp;nbsp; "DOUBLE" ...
&gt;&gt; &amp;gt; &amp;amp;nbsp; &amp;amp;nbsp; "FLOAT" ...
&gt;&gt; &amp;gt; &amp;amp;nbsp; &amp;amp;nbsp; "BINARY" ...
&gt;&gt; &amp;gt; &amp;amp;nbsp; &amp;amp;nbsp; "VARBINARY" ...
&gt;&gt; &amp;gt; &amp;amp;nbsp; &amp;amp;nbsp; "DECIMAL" ...
&gt;&gt; &amp;gt; &amp;amp;nbsp; &amp;amp;nbsp; "DEC" ...
&gt;&gt; &amp;gt; &amp;amp;nbsp; &amp;amp;nbsp; "NUMERIC" ...
&gt;&gt; &amp;gt; &amp;amp;nbsp; &amp;amp;nbsp; "ANY" ...
&gt;&gt; &amp;gt; &amp;amp;nbsp; &amp;amp;nbsp; "CHARACTER" ...
&gt;&gt; &amp;gt; &amp;amp;nbsp; &amp;amp;nbsp; "CHAR" ...
&gt;&gt; &amp;gt; &amp;amp;nbsp; &amp;amp;nbsp; "VARCHAR" ...
&gt;&gt; &amp;gt; &amp;amp;nbsp; &amp;amp;nbsp; "DATE" ...
&gt;&gt; &amp;gt; &amp;amp;nbsp; &amp;amp;nbsp; "TIME" ...
&gt;&gt; &amp;gt; &amp;amp;nbsp; &amp;amp;nbsp; "TIMESTAMP" ...
&gt;&gt;
&gt;&gt;
&gt;&gt;
&gt;&gt; --
&gt;&gt;
&gt;&gt; Best,
&gt;&gt; Benchao Li
&gt;
&gt;
&gt;
&gt; --
&gt;
&gt; Best,
&gt; Benchao Li
&gt;


-- 

Best,
Benchao Li

?????? sql ????josn?????????? ????????????

回复