[
https://issues.apache.org/jira/browse/BEAM-7758?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16889468#comment-16889468
]
Rahul Patwari edited comment on BEAM-7758 at 7/20/19 4:17 PM:
--------------------------------------------------------------
[~amaliujia]
Is this the expected flow:
{code:java}
PCollection<Row> unboundedPcollection = ...;
org.apache.beam.sdk.extensions.sql.meta.Table table = Table.builder(). ...
.build();//Schema, Properties ... are given
org.apache.beam.sdk.extensions.sql.meta.provider.SlowChangingCacheTableProvider
provider = SlowChangingCacheTableProvider.builder().withTable(table).build();
unboundedPcollection.apply(SqlTransform.query("JOIN
query").withTableProvider("SlowChangingCacheTableName", provider).build());
{code}
Can the existing Table Providers like 'KafkaTableProvider', 'TextTableProvider'
be used in a programmatic way(using SqlTransform.query().withTableProvider())?
was (Author: rahul8383):
[~amaliujia]
Is this the expected flow:
{code:java}
PCollection<Row> unboundedPcollection = ...;
org.apache.beam.sdk.extensions.sql.meta.Table table = Table.builder(). ...
.build();//Schema, Properties ... are given
org.apache.beam.sdk.extensions.sql.meta.provider.SlowChangingCacheTableProvider
provider = SlowChangingCacheTableProvider.builder().withTable(table).build();
unboundedPcollection.apply(SqlTransform.query("JOIN
query").withTableProvider("SlowChangingCacheTableName", provider).build());
{code}
Can the existing Table Providers like 'KafkaTableProvider', 'TextTableProvider'
be used in a programmatic way(using SqlTransform.query().withTableProvider())?
> Table returns PCollectionView in BeamSQL
> ----------------------------------------
>
> Key: BEAM-7758
> URL: https://issues.apache.org/jira/browse/BEAM-7758
> Project: Beam
> Issue Type: New Feature
> Components: dsl-sql
> Reporter: Rui Wang
> Assignee: Rahul Patwari
> Priority: Major
>
> We might be able to define a table with properties that says this table
> return a PCollectionView. By doing so we will have a trigger based
> PCollectionView available in SQL rel nodes.
> Relevant thread:
> https://lists.apache.org/thread.html/602121ee49886590ce4975f66aa0d270b4a5d64575337fca8bef1232@%3Cdev.beam.apache.org%3E
--
This message was sent by Atlassian JIRA
(v7.6.14#76016)
