[
https://issues.apache.org/jira/browse/FLINK-6966?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16633442#comment-16633442
]
Fan weiwen edited comment on FLINK-6966 at 9/30/18 5:02 PM:
------------------------------------------------------------
this is my test sql
{code:java}
//代码占位符
i use redis sink but can test in kafka or other sink
Asql
select
reqIp as factorContenta,
count(*) as eCount,
60 * 60 as expire
from
kafkasource
where
uri in not null
group by
hop(
rowtime,
interval '2' second,
interval '60' minute
),
reqIp
having
count(*) >= 1
Bsql
select
uid as factorContentb,
count(*) as eCount,
60 * 60 as expire
from
kafkasource
where
uri is not null
group by
hop(
rowtime,
interval '2' second,
interval '60' minute
),
uid
having
count(*) >= 1
{code}
this is my test data
{code:java}
//代码占位符
{
"code" : "200",
"reqIp" : "656.19.173.34",
"t" : 1537950912546,
"uid" : 6630519,
"uri" : "/test"
}
{code}
first the job only Asql , start A sql redis has a key 656.19.173.34
then stop Asql and savepoint del redis key 656.19.173.34
now start Bsql from savepoint you can find it key 656.19.173.34 is create
redis has Asql create key and Bsql create key
this is wrong
was (Author: fanweiwen):
this is my test sql
{code:java}
//代码占位符
i use redis sink but can test in kafka or other sink
Asql
select
reqIp as factorContenta,
count(*) as eCount,
60 * 60 as expire
from
xp_sso_biz_source
where
uri in not null
group by
hop(
rowtime,
interval '2' second,
interval '60' minute
),
reqIp
having
count(*) >= 1
Bsql
select
uid as factorContentb,
count(*) as eCount,
60 * 60 as expire
from
xp_sso_biz_source
where
uri is not null
group by
hop(
rowtime,
interval '2' second,
interval '60' minute
),
uid
having
count(*) >= 1
{code}
this is my test data
{code:java}
//代码占位符
{
"code" : "200",
"reqIp" : "656.19.173.34",
"t" : 1537950912546,
"uid" : 6630519,
"uri" : "/test"
}
{code}
first the job only Asql , start A sql redis has a key 656.19.173.34
then stop Asql and savepoint del redis key 656.19.173.34
now start Bsql from savepoint you can find it key 656.19.173.34 is create
redis has Asql create key and Bsql create key
this is wrong
> Add maxParallelism and UIDs to all operators generated by the Table API / SQL
> -----------------------------------------------------------------------------
>
> Key: FLINK-6966
> URL: https://issues.apache.org/jira/browse/FLINK-6966
> Project: Flink
> Issue Type: Improvement
> Components: Table API & SQL
> Affects Versions: 1.4.0
> Reporter: Fabian Hueske
> Priority: Major
>
> At the moment, the Table API does not assign UIDs and the max parallelism to
> operators (except for operators with parallelism 1).
> We should do that to avoid problems when rescaling or restarting jobs from
> savepoints.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
