Jungtaek Lim created STORM-2146:
-----------------------------------
Summary: Storm SQL - Support JOIN between Streaming data source
and State data source in Trident mode
Key: STORM-2146
URL: https://issues.apache.org/jira/browse/STORM-2146
Project: Apache Storm
Issue Type: New Feature
Components: storm-sql
Reporter: Jungtaek Lim
Assignee: Jungtaek Lim
This issue is only targeted to Trident mode.
This issue also handles drop supporting join between Streaming data source and
Streaming data source since the join is based on micro-batch so result is
non-deterministic which doesn't make sense.
This issue tracks supporting join between Streaming data source and State data
source.
Following works should be done:
- create interface for State Table which is able to query value based on key
- define DDL for State data source
- modify visitJoin in TridentLogicalPlanCompiler
- check join condition: first one is Streaming and next one is State
- table order can be reversible
- only simple equi-join is supported (support compose key?)
- query to State via join key and join Streaming row and the value
- address unit tests
- update document
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
