This is an automated email from the ASF dual-hosted git repository.
duhengforever pushed a change to branch main
in repository https://gitbox.apache.org/repos/asf/rocketmq-streams.git.
from dea200e Merge pull request #14 from ShannonDing/infra
new c613245 1. support max event time wait for all splits ready 2. add
flatMap function for user 3. support AbstractMutilSplitMessageCache open
autoflush flag 4. remove method(removeSplit,addNewSplit) from ISource interface
5. fix bug for window fire and add window debug filewriter
new fab8054 1.support max event time wait for all splits ready 2.add
flatMap function for user 3.support AbstractMutilSplitMessageCache open
autoflush flag 4.remove method(removeSplit,addNewSplit) from ISource interface
5.fix bug for window fire and add window debug filewriter
new b5bfa0b Merge pull request #15 from yuanxiaodong/window_test
The 59 revisions listed above as "new" are entirely new to this
repository and will be described in separate emails. The revisions
listed as "add" were already present in the repository and have only
been added to this reference.
Summary of changes:
rocketmq-streams-channel-rocketmq/pom.xml | 4 +
.../rocketmq/streams/source/RocketMQSource.java | 115 ++++++++++++--
.../rocketmq/streams/client/StreamBuilder.java | 4 +-
.../client/strategy/ConfiguableConnector.java | 16 ++
.../streams/client/transform/DataStream.java | 67 +++++---
.../rocketmq/streams/client/DataStreamTest.java | 44 +++++-
.../apache/rocketmq/streams/client/JoinTest.java | 1 -
.../apache/rocketmq/streams/client/SinkTest.java | 24 +++
.../apache/rocketmq/streams/client/SourceTest.java | 24 +++
.../apache/rocketmq/streams/client/SplitTest.java | 41 +++--
.../streams/common/calssscaner/AbstractScan.java | 19 +++
.../impl/AbstractMutilSplitMessageCache.java | 8 +-
.../common/channel/source/AbstractSource.java | 13 +-
.../streams/common/channel/source/ISource.java | 11 --
.../streams/common/functions/FlatMapFunction.java | 9 ++
.../topology/stages/AbstractWindowStage.java | 13 +-
.../common/topology/stages/OutputChainStage.java | 2 +-
.../rocketmq/streams/common/utils/ReflectUtil.java | 4 +-
.../rocketmq/streams/window/debug/DebugWriter.java | 128 ++++++++++++++++
.../streams/window/fire/EventTimeManager.java | 56 +++++++
.../streams/window/fire/SplitEventTimeManager.java | 170 +++++++++++++++++++++
.../streams/window/fire/WindowFireManager.java | 14 ++
.../rocketmq/streams/window/model/WindowCache.java | 36 ++++-
.../streams/window/model/WindowInstance.java | 23 ++-
.../window/offset/IWindowMaxValueManager.java | 10 --
.../window/offset/WindowMaxValueManager.java | 32 ++--
.../streams/window/operator/AbstractWindow.java | 126 +++++++--------
.../window/operator/impl/SessionWindow.java | 34 +----
.../streams/window/shuffle/ShuffleChannel.java | 55 +++----
.../streams/window/source/WindowRireSource.java | 78 +++++++---
30 files changed, 918 insertions(+), 263 deletions(-)
create mode 100644
rocketmq-streams-clients/src/main/java/org/apache/rocketmq/streams/client/strategy/ConfiguableConnector.java
create mode 100644
rocketmq-streams-clients/src/test/java/org/apache/rocketmq/streams/client/SinkTest.java
create mode 100644
rocketmq-streams-clients/src/test/java/org/apache/rocketmq/streams/client/SourceTest.java
create mode 100644
rocketmq-streams-commons/src/main/java/org/apache/rocketmq/streams/common/functions/FlatMapFunction.java
create mode 100644
rocketmq-streams-window/src/main/java/org/apache/rocketmq/streams/window/debug/DebugWriter.java
create mode 100644
rocketmq-streams-window/src/main/java/org/apache/rocketmq/streams/window/fire/EventTimeManager.java
create mode 100644
rocketmq-streams-window/src/main/java/org/apache/rocketmq/streams/window/fire/SplitEventTimeManager.java
create mode 100644
rocketmq-streams-window/src/main/java/org/apache/rocketmq/streams/window/fire/WindowFireManager.java