[
https://issues.apache.org/jira/browse/SAMZA-1938?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16652315#comment-16652315
]
ASF GitHub Bot commented on SAMZA-1938:
---------------------------------------
GitHub user weiqingy opened a pull request:
https://github.com/apache/samza/pull/732
SAMZA-1938: Support use cases to run multiple sql statements in one Samza
job
## What changes were proposed in this pull request?
This PR is to support the following user scenarios:
1. support users to run multiple Sql statements in the same job.
- sql1 = "Insert into testavro.simpleOutputTopic select * from
testavro.SIMPLE1";
- sql2 = "Insert into testavro.SIMPLE3 select * from testavro.SIMPLE2";
2. Support fan-out use case. For example,
- sql1 = "Insert into testavro.SIMPLE2 select * from testavro.SIMPLE1";
- sql2 = "Insert into testavro.SIMPLE3 select * from testavro.SIMPLE1";
3. Support fan-in use case. For example,
- sql1 = "Insert into testavro.simpleOutputTopic select * from
testavro.SIMPLE2";
- sql2 = "Insert into testavro.simpleOutputTopic select * from
testavro.SIMPLE1";
This PR makes the information about `SystemDescriptors`, `MessageStream of
input sources` and `OutputStream` stored in `QueryTranslator`. The reason is
that those information belongs to the job and each job has only one
`QueryTranslator` object.
## How was this patch tested?
1. Add unit tests
2. Testing in Samza SQL shell.
You can merge this pull request into a Git repository by running:
$ git pull https://github.com/weiqingy/samza SAMZA-1938
Alternatively you can review and apply these changes as the patch at:
https://github.com/apache/samza/pull/732.patch
To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:
This closes #732
----
commit aa12c43a828cdf3343307ac11655807a78a950d5
Author: Weiqing Yang <yangweiqing001@...>
Date: 2018-10-16T18:46:59Z
SAMZA-1938: Support use cases to run multiple sql statements in one Samza
job
----
> Support use cases to run multiple sql statements in one Samza job
> ------------------------------------------------------------------
>
> Key: SAMZA-1938
> URL: https://issues.apache.org/jira/browse/SAMZA-1938
> Project: Samza
> Issue Type: Bug
> Components: sql
> Reporter: Weiqing Yang
> Priority: Major
> Fix For: 0.15.0
>
>
> This Jira is to track the following tasks:
> * Support users to run multiple Sql statements in the same job.
> ** sql1 = "Insert into testavro.simpleOutputTopic select * from
> testavro.SIMPLE1";
> sql2 = "Insert into testavro.SIMPLE3 select * from testavro.SIMPLE2";
> * Support fan-out use case. For example,
> ** sql1 = "Insert into testavro.SIMPLE2 select * from testavro.SIMPLE1";
> sql2 = "Insert into testavro.SIMPLE3 select * from testavro.SIMPLE1";
> * Support fan-in use case. For example,
> ** sql1 = "Insert into testavro.simpleOutputTopic select * from
> testavro.SIMPLE2";
> sql2 = "Insert into testavro.simpleOutputTopic select * from
> testavro.SIMPLE1";
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
