[
https://issues.apache.org/jira/browse/BEAM-8365?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Kirill Kozlov updated BEAM-8365:
--------------------------------
Description:
* InMemoryTable should implement a following method:
{code:java}
public PCollection<Row> buildIOReader(
PBegin begin, BeamSqlTableFilter filters, List<String> fieldNames);{code}
Which should return a `PCollection` with fields specified in `fieldNames` list.
* Add a property "push_down" to TestTableProvider, which should allow user to
select version of InMemoryProvider to use: with project push-down, with
predicate push-down (will be implemented later), both (will be implemented
later), or without (default).
* Create a rule to push fields used by a Calc (in projects and in a condition)
down into TestTable IO.
* Updating that same Calc (from previous step) to have a proper input and
output schemes, remove unused fields.
was:
* InMemoryTable should implement implement a following method:
{code:java}
public PCollection<Row> buildIOReader(
PBegin begin, BeamSqlTableFilter filters, List<String> fieldNames);{code}
Which should return a `PCollection` with fields specified in `fieldNames` list.
* Add a property "push_down" to TestTableProvider, which should allow user to
select version of InMemoryProvider to use: with project push-down, with
predicate push-down (will be implemented later), both (will be implemented
later), or without (default).
* Create a rule to push fields used by a Calc (in projects and in a condition)
down into TestTable IO.
* Updating that same Calc (from previous step) to have a proper input and
output schemes, remove unused fields.
> Add project push-down capability to IO APIs
> -------------------------------------------
>
> Key: BEAM-8365
> URL: https://issues.apache.org/jira/browse/BEAM-8365
> Project: Beam
> Issue Type: New Feature
> Components: dsl-sql
> Reporter: Kirill Kozlov
> Assignee: Kirill Kozlov
> Priority: Minor
> Time Spent: 50m
> Remaining Estimate: 0h
>
> * InMemoryTable should implement a following method:
> {code:java}
> public PCollection<Row> buildIOReader(
> PBegin begin, BeamSqlTableFilter filters, List<String> fieldNames);{code}
> Which should return a `PCollection` with fields specified in `fieldNames`
> list.
> * Add a property "push_down" to TestTableProvider, which should allow user
> to select version of InMemoryProvider to use: with project push-down, with
> predicate push-down (will be implemented later), both (will be implemented
> later), or without (default).
> * Create a rule to push fields used by a Calc (in projects and in a
> condition) down into TestTable IO.
> * Updating that same Calc (from previous step) to have a proper input and
> output schemes, remove unused fields.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
