[
https://issues.apache.org/jira/browse/FLINK-6204?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15948717#comment-15948717
]
sunjincheng edited comment on FLINK-6204 at 3/30/17 9:46 AM:
-------------------------------------------------------------
Yes, That's My meaning. This JIRA. will do the second task `#2).Update all OVER
window ProcessFunction implementations to use the SortedQueueState` And have
created a JIRA.[FLINK-6219|https://issues.apache.org/jira/browse/FLINK-6219]
for `#1).Add SortedQueueState, which allows for efficient insertion, traversal
in order, and removal from the head`.
Best,
SunJincheng
was (Author: sunjincheng121):
Yes, That's My meaning. This JIRA. will do the second task `#2).Update all OVER
window ProcessFunction implementations to use the SortedQueueState` And I'll
add a JIRA.[FLINK-6219|https://issues.apache.org/jira/browse/FLINK-6219] for
`#1).Add SortedQueueState, which allows for efficient insertion, traversal in
order, and removal from the head`.
Best,
SunJincheng
> Update all OVER window ProcessFunction implementations to use the
> SortedQueueState
> -----------------------------------------------------------------------------------
>
> Key: FLINK-6204
> URL: https://issues.apache.org/jira/browse/FLINK-6204
> Project: Flink
> Issue Type: Bug
> Components: Table API & SQL
> Reporter: sunjincheng
> Assignee: sunjincheng
>
> Currently `event time OVER ROWS BETWEEN UNBOUNDED PRECEDING aggregation to
> SQL` implementation class: ` UnboundedEventTimeOverProcessFunction` use
> data size uncontrollable memory data structures`sortedTimestamps:
> util.LinkedList [Long] cache data timestamps and sort timestamps. IMO,It's
> not a good way, because in the production environment there are millions of
> window data pre millisecond in our application scenario.So, I want to remove
> `util.LinkedList [Long] `. Welcome anyone to give me feedback.
> What do you think? [~fhueske] and [~Yuhong_kyo]
> When a SortedQueueState is available，we will Update all OVER window
> ProcessFunction implementations to use the SortedQueueState.
--
This message was sent by Atlassian JIRA
(v6.3.15#6346)
