[jira] [Updated] (BEAM-8365) Add project push-down capability to IO APIs

[Kenneth Knowles (Jira)]

 [ 
https://issues.apache.org/jira/browse/BEAM-8365?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Kenneth Knowles updated BEAM-8365:
--
Status: Open  (was: Triage Needed)

> Add project push-down capability to IO APIs
> ---
>
> Key: BEAM-8365
> URL: https://issues.apache.org/jira/browse/BEAM-8365
> Project: Beam
>  Issue Type: New Feature
>  Components: dsl-sql
>Reporter: Kirill Kozlov
>Assignee: Kirill Kozlov
>Priority: Minor
>  Time Spent: 1h 10m
>  Remaining Estimate: 0h
>
> * InMemoryTable should implement a following method:
> {code:java}
> public PCollection buildIOReader(
> PBegin begin, BeamSqlTableFilter filters, List fieldNames);{code}
> Which should return a `PCollection` with fields specified in `fieldNames` 
> list.
>  * Create a rule to push fields used by a Calc (in projects and in a 
> condition) down into TestTable IO.
>  * Updating that same Calc  (from previous step) to have a proper input and 
> output schemes, remove unused fields.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

[jira] [Updated] (BEAM-8365) Add project push-down capability to IO APIs

[Kenneth Knowles (Jira)]

 [ 
https://issues.apache.org/jira/browse/BEAM-8365?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Kenneth Knowles updated BEAM-8365:
--
Priority: Major  (was: Minor)

> Add project push-down capability to IO APIs
> ---
>
> Key: BEAM-8365
> URL: https://issues.apache.org/jira/browse/BEAM-8365
> Project: Beam
>  Issue Type: New Feature
>  Components: dsl-sql
>Reporter: Kirill Kozlov
>Assignee: Kirill Kozlov
>Priority: Major
>  Time Spent: 1h 10m
>  Remaining Estimate: 0h
>
> * InMemoryTable should implement a following method:
> {code:java}
> public PCollection buildIOReader(
> PBegin begin, BeamSqlTableFilter filters, List fieldNames);{code}
> Which should return a `PCollection` with fields specified in `fieldNames` 
> list.
>  * Create a rule to push fields used by a Calc (in projects and in a 
> condition) down into TestTable IO.
>  * Updating that same Calc  (from previous step) to have a proper input and 
> output schemes, remove unused fields.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

[jira] [Updated] (BEAM-8365) Add project push-down capability to IO APIs

[Kirill Kozlov (Jira)]

 [ 
https://issues.apache.org/jira/browse/BEAM-8365?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Kirill Kozlov updated BEAM-8365:

Description: 
* InMemoryTable should implement a following method:
{code:java}
public PCollection buildIOReader(
PBegin begin, BeamSqlTableFilter filters, List fieldNames);{code}
Which should return a `PCollection` with fields specified in `fieldNames` list.

 * Create a rule to push fields used by a Calc (in projects and in a condition) 
down into TestTable IO.
 * Updating that same Calc  (from previous step) to have a proper input and 
output schemes, remove unused fields.

  was:
* InMemoryTable should implement a following method:
{code:java}
public PCollection buildIOReader(
PBegin begin, BeamSqlTableFilter filters, List fieldNames);{code}
Which should return a `PCollection` with fields specified in `fieldNames` list.

 * Add a property "push_down" to TestTableProvider, which should allow user to 
select version of InMemoryProvider to use: with project push-down, with 
predicate push-down (will be implemented later), both (will be implemented 
later), or without (default).
 * Create a rule to push fields used by a Calc (in projects and in a condition) 
down into TestTable IO.
 * Updating that same Calc  (from previous step) to have a proper input and 
output schemes, remove unused fields.


> Add project push-down capability to IO APIs
> ---
>
> Key: BEAM-8365
> URL: https://issues.apache.org/jira/browse/BEAM-8365
> Project: Beam
>  Issue Type: New Feature
>  Components: dsl-sql
>Reporter: Kirill Kozlov
>Assignee: Kirill Kozlov
>Priority: Minor
>  Time Spent: 1h
>  Remaining Estimate: 0h
>
> * InMemoryTable should implement a following method:
> {code:java}
> public PCollection buildIOReader(
> PBegin begin, BeamSqlTableFilter filters, List fieldNames);{code}
> Which should return a `PCollection` with fields specified in `fieldNames` 
> list.
>  * Create a rule to push fields used by a Calc (in projects and in a 
> condition) down into TestTable IO.
>  * Updating that same Calc  (from previous step) to have a proper input and 
> output schemes, remove unused fields.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

[jira] [Updated] (BEAM-8365) Add project push-down capability to IO APIs

[Kirill Kozlov (Jira)]

 [ 
https://issues.apache.org/jira/browse/BEAM-8365?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Kirill Kozlov updated BEAM-8365:

Description: 
* InMemoryTable should implement a following method:
{code:java}
public PCollection buildIOReader(
PBegin begin, BeamSqlTableFilter filters, List fieldNames);{code}
Which should return a `PCollection` with fields specified in `fieldNames` list.

 * Add a property "push_down" to TestTableProvider, which should allow user to 
select version of InMemoryProvider to use: with project push-down, with 
predicate push-down (will be implemented later), both (will be implemented 
later), or without (default).
 * Create a rule to push fields used by a Calc (in projects and in a condition) 
down into TestTable IO.
 * Updating that same Calc  (from previous step) to have a proper input and 
output schemes, remove unused fields.

  was:
* InMemoryTable should implement implement a following method:
{code:java}
public PCollection buildIOReader(
PBegin begin, BeamSqlTableFilter filters, List fieldNames);{code}
Which should return a `PCollection` with fields specified in `fieldNames` list.

 * Add a property "push_down" to TestTableProvider, which should allow user to 
select version of InMemoryProvider to use: with project push-down, with 
predicate push-down (will be implemented later), both (will be implemented 
later), or without (default).
 * Create a rule to push fields used by a Calc (in projects and in a condition) 
down into TestTable IO.
 * Updating that same Calc  (from previous step) to have a proper input and 
output schemes, remove unused fields.


> Add project push-down capability to IO APIs
> ---
>
> Key: BEAM-8365
> URL: https://issues.apache.org/jira/browse/BEAM-8365
> Project: Beam
>  Issue Type: New Feature
>  Components: dsl-sql
>Reporter: Kirill Kozlov
>Assignee: Kirill Kozlov
>Priority: Minor
>  Time Spent: 50m
>  Remaining Estimate: 0h
>
> * InMemoryTable should implement a following method:
> {code:java}
> public PCollection buildIOReader(
> PBegin begin, BeamSqlTableFilter filters, List fieldNames);{code}
> Which should return a `PCollection` with fields specified in `fieldNames` 
> list.
>  * Add a property "push_down" to TestTableProvider, which should allow user 
> to select version of InMemoryProvider to use: with project push-down, with 
> predicate push-down (will be implemented later), both (will be implemented 
> later), or without (default).
>  * Create a rule to push fields used by a Calc (in projects and in a 
> condition) down into TestTable IO.
>  * Updating that same Calc  (from previous step) to have a proper input and 
> output schemes, remove unused fields.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

[jira] [Updated] (BEAM-8365) Add project push-down capability to IO APIs

[Kirill Kozlov (Jira)]

 [ 
https://issues.apache.org/jira/browse/BEAM-8365?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Kirill Kozlov updated BEAM-8365:

Description: 
* InMemoryTable should implement implement a following method:
{code:java}
public PCollection buildIOReader(
PBegin begin, BeamSqlTableFilter filters, List fieldNames);{code}
Which should return a `PCollection` with fields specified in `fieldNames` list.

 * Add a property "push_down" to TestTableProvider, which should allow user to 
select version of InMemoryProvider to use: with project push-down, with 
predicate push-down (will be implemented later), both (will be implemented 
later), or without (default).
 * Create a rule to push fields used by a Calc (in projects and in a condition) 
down into TestTable IO.
 * Updating that same Calc  (from previous step) to have a proper input and 
output schemes, remove unused fields.

  was:
* Create a class extending InMemoryTable and implement a following method:
{code:java}
public PCollection buildIOReader(
PBegin begin, BeamSqlTableFilter filters, List fieldNames);{code}
Which should return a `PCollection` with fields specified in `fieldNames` list.

 * Add a property "push_down" to TestTableProvider, which should allow user to 
select version of InMemoryProvider to use: with project push-down, with 
predicate push-down (will be implemented later), both (will be implemented 
later), or without (default).
 * Create a rule to push fields used by a Calc (in projects and in a condition) 
down into TestTable IO.
 * Updating that same Calc  (from previous step) to have a proper input and 
output schemes, remove unused fields.


> Add project push-down capability to IO APIs
> ---
>
> Key: BEAM-8365
> URL: https://issues.apache.org/jira/browse/BEAM-8365
> Project: Beam
>  Issue Type: New Feature
>  Components: dsl-sql
>Reporter: Kirill Kozlov
>Assignee: Kirill Kozlov
>Priority: Minor
>  Time Spent: 40m
>  Remaining Estimate: 0h
>
> * InMemoryTable should implement implement a following method:
> {code:java}
> public PCollection buildIOReader(
> PBegin begin, BeamSqlTableFilter filters, List fieldNames);{code}
> Which should return a `PCollection` with fields specified in `fieldNames` 
> list.
>  * Add a property "push_down" to TestTableProvider, which should allow user 
> to select version of InMemoryProvider to use: with project push-down, with 
> predicate push-down (will be implemented later), both (will be implemented 
> later), or without (default).
>  * Create a rule to push fields used by a Calc (in projects and in a 
> condition) down into TestTable IO.
>  * Updating that same Calc  (from previous step) to have a proper input and 
> output schemes, remove unused fields.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

[jira] [Updated] (BEAM-8365) Add project push-down capability to IO APIs

[Kirill Kozlov (Jira)]

 [ 
https://issues.apache.org/jira/browse/BEAM-8365?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Kirill Kozlov updated BEAM-8365:

Description: 
* Create a class extending InMemoryTable and implement a following method:
{code:java}
public PCollection buildIOReader(
PBegin begin, BeamSqlTableFilter filters, List fieldNames);{code}
Which should return a `PCollection` with fields specified in `fieldNames` list.

 * Add a property "push_down" to TestTableProvider, which should allow user to 
select version of InMemoryProvider to use: with project push-down, with 
predicate push-down (will be implemented later), both (will be implemented 
later), or without (default).
 * Create a rule to push fields used by a Calc (in projects and in a condition) 
down into TestTable IO.
 * Updating that same Calc  (from previous step) to have a proper input and 
output schemes, remove unused fields.

  was:
* Create a class extending InMemoryTable and implement a following method:
{code:java}
public PCollection buildIOReader(
PBegin begin, BeamSqlTableFilter filters, List fieldNames);{code}
Which should return a `PCollection` with fields specified in `fieldNames` list.

 * Add a property "push_down" to TestTableProvider, which should allow user to 
select version of InMemoryProvider to use: with project push-down, with 
predicate push-down (will be implemented later), both (will be implemented 
later), or without (default).


> Add project push-down capability to IO APIs
> ---
>
> Key: BEAM-8365
> URL: https://issues.apache.org/jira/browse/BEAM-8365
> Project: Beam
>  Issue Type: New Feature
>  Components: dsl-sql
>Reporter: Kirill Kozlov
>Assignee: Kirill Kozlov
>Priority: Minor
>
> * Create a class extending InMemoryTable and implement a following method:
> {code:java}
> public PCollection buildIOReader(
> PBegin begin, BeamSqlTableFilter filters, List fieldNames);{code}
> Which should return a `PCollection` with fields specified in `fieldNames` 
> list.
>  * Add a property "push_down" to TestTableProvider, which should allow user 
> to select version of InMemoryProvider to use: with project push-down, with 
> predicate push-down (will be implemented later), both (will be implemented 
> later), or without (default).
>  * Create a rule to push fields used by a Calc (in projects and in a 
> condition) down into TestTable IO.
>  * Updating that same Calc  (from previous step) to have a proper input and 
> output schemes, remove unused fields.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

[jira] [Updated] (BEAM-8365) Add project push-down capability to IO APIs

[Kirill Kozlov (Jira)]

 [ 
https://issues.apache.org/jira/browse/BEAM-8365?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Kirill Kozlov updated BEAM-8365:

Summary: Add project push-down capability to IO APIs  (was: Add project 
push-down capability to TestTableProvider)

> Add project push-down capability to IO APIs
> ---
>
> Key: BEAM-8365
> URL: https://issues.apache.org/jira/browse/BEAM-8365
> Project: Beam
>  Issue Type: New Feature
>  Components: dsl-sql
>Reporter: Kirill Kozlov
>Assignee: Kirill Kozlov
>Priority: Minor
>
> * Create a class extending InMemoryTable and implement a following method:
> {code:java}
> public PCollection buildIOReader(
> PBegin begin, BeamSqlTableFilter filters, List fieldNames);{code}
> Which should return a `PCollection` with fields specified in `fieldNames` 
> list.
>  * Add a property "push_down" to TestTableProvider, which should allow user 
> to select version of InMemoryProvider to use: with project push-down, with 
> predicate push-down (will be implemented later), both (will be implemented 
> later), or without (default).



--
This message was sent by Atlassian Jira
(v8.3.4#803005)