[
https://issues.apache.org/jira/browse/BEAM-7758?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16889468#comment-16889468
]
Rahul Patwari edited comment on BEAM-7758 at 7/20/19 4:16 PM:
--------------------------------------------------------------
[~amaliujia]
Is this the expected flow:
{code:java}
PCollection<Row> unboundedPcollection = ...;
org.apache.beam.sdk.extensions.sql.meta.Table table = Table.builder(). ...
.build();//Schema, Properties ... are given
org.apache.beam.sdk.extensions.sql.meta.provider.SlowChangingCacheTableProvider
provider = SlowChangingCacheTableProvider.builder().withTable(table).build();
unboundedPcollection.apply(SqlTransform.query("JOIN
query").withTableProvider("SlowChangingCacheTableName", provider).build());
{code}
Can the existing Table Providers like 'KafkaTableProvider', 'TextTableProvider'
be used in a programmatic way(using SqlTransform.query().withTableProvider())?
was (Author: rahul8383):
[~amaliujia]
When Should the Table for PCollectionView get created?
What are the changes needed in BeamSqlTable?
Does the existing TableProviders like "KafkaTableProvider" (or)
"TextTableProvider" can be used in the Java Program
[https://github.com/apache/beam/blob/master/sdks/java/extensions/sql/src/main/java/org/apache/beam/sdk/extensions/sql/SqlTransform.java#L186]
{{Is this the expected flow:}}
{{PCollection<Row> unboundedPcollection = ...;}}
{{slowChangingTableProvider.createTable(table);}}
{{unboundedPcollection.apply(SqlTransform.query("JOIN
query").withTableProvider("SlowChangingTableName",
slowChangingTableProvider).build());}}
> Table returns PCollectionView in BeamSQL
> ----------------------------------------
>
> Key: BEAM-7758
> URL: https://issues.apache.org/jira/browse/BEAM-7758
> Project: Beam
> Issue Type: New Feature
> Components: dsl-sql
> Reporter: Rui Wang
> Assignee: Rahul Patwari
> Priority: Major
>
> We might be able to define a table with properties that says this table
> return a PCollectionView. By doing so we will have a trigger based
> PCollectionView available in SQL rel nodes.
> Relevant thread:
> https://lists.apache.org/thread.html/602121ee49886590ce4975f66aa0d270b4a5d64575337fca8bef1232@%3Cdev.beam.apache.org%3E
--
This message was sent by Atlassian JIRA
(v7.6.14#76016)
