Re: [PR] Support Substrait's VirtualTables [datafusion]

2024-05-28 Thread via GitHub
alamb merged PR #10531: URL: https://github.com/apache/datafusion/pull/10531 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

Re: [PR] Support Substrait's VirtualTables [datafusion]

2024-05-27 Thread via GitHub
jonahgao commented on code in PR #10531: URL: https://github.com/apache/datafusion/pull/10531#discussion_r1616109221 ## datafusion/substrait/src/logical_plan/producer.rs: ## @@ -512,6 +572,62 @@ pub fn to_substrait_rel( } } +fn to_substrait_named_struct(schema: ) ->

Re: [PR] Support Substrait's VirtualTables [datafusion]

2024-05-27 Thread via GitHub
Blizzara commented on code in PR #10531: URL: https://github.com/apache/datafusion/pull/10531#discussion_r1616085373 ## datafusion/substrait/src/logical_plan/producer.rs: ## @@ -512,6 +572,62 @@ pub fn to_substrait_rel( } } +fn to_substrait_named_struct(schema: ) ->

Re: [PR] Support Substrait's VirtualTables [datafusion]

2024-05-27 Thread via GitHub
jonahgao commented on code in PR #10531: URL: https://github.com/apache/datafusion/pull/10531#discussion_r1616026851 ## datafusion/substrait/src/logical_plan/producer.rs: ## @@ -512,6 +572,62 @@ pub fn to_substrait_rel( } } +fn to_substrait_named_struct(schema: ) ->

Re: [PR] Support Substrait's VirtualTables [datafusion]

2024-05-27 Thread via GitHub
Blizzara commented on code in PR #10531: URL: https://github.com/apache/datafusion/pull/10531#discussion_r1615825150 ## datafusion/substrait/src/logical_plan/producer.rs: ## @@ -512,6 +572,62 @@ pub fn to_substrait_rel( } } +fn to_substrait_named_struct(schema: ) ->

Re: [PR] Support Substrait's VirtualTables [datafusion]

2024-05-27 Thread via GitHub
Blizzara commented on code in PR #10531: URL: https://github.com/apache/datafusion/pull/10531#discussion_r1615824249 ## datafusion/substrait/src/logical_plan/producer.rs: ## @@ -512,6 +572,62 @@ pub fn to_substrait_rel( } } +fn to_substrait_named_struct(schema: ) ->

Re: [PR] Support Substrait's VirtualTables [datafusion]

2024-05-27 Thread via GitHub
Blizzara commented on code in PR #10531: URL: https://github.com/apache/datafusion/pull/10531#discussion_r1615803887 ## datafusion/substrait/tests/cases/roundtrip_logical_plan.rs: ## @@ -685,6 +685,19 @@ async fn roundtrip_literal_struct() -> Result<()> { .await }

Re: [PR] Support Substrait's VirtualTables [datafusion]

2024-05-25 Thread via GitHub
jonahgao commented on code in PR #10531: URL: https://github.com/apache/datafusion/pull/10531#discussion_r1614673020 ## datafusion/substrait/tests/cases/roundtrip_logical_plan.rs: ## @@ -685,6 +685,19 @@ async fn roundtrip_literal_struct() -> Result<()> { .await }

Re: [PR] Support Substrait's VirtualTables [datafusion]

2024-05-25 Thread via GitHub
jonahgao commented on code in PR #10531: URL: https://github.com/apache/datafusion/pull/10531#discussion_r1614671030 ## datafusion/substrait/tests/cases/roundtrip_logical_plan.rs: ## @@ -685,6 +685,19 @@ async fn roundtrip_literal_struct() -> Result<()> { .await }

Re: [PR] Support Substrait's VirtualTables [datafusion]

2024-05-25 Thread via GitHub
jonahgao commented on code in PR #10531: URL: https://github.com/apache/datafusion/pull/10531#discussion_r1614666495 ## datafusion/substrait/src/logical_plan/producer.rs: ## @@ -512,6 +572,62 @@ pub fn to_substrait_rel( } } +fn to_substrait_named_struct(schema: ) ->

Re: [PR] Support Substrait's VirtualTables [datafusion]

2024-05-24 Thread via GitHub
Blizzara commented on PR #10531: URL: https://github.com/apache/datafusion/pull/10531#issuecomment-2129741689 @jonahgao @alamb this last one is ready now too :) -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL

Re: [PR] Support Substrait's VirtualTables [datafusion]

2024-05-23 Thread via GitHub
Blizzara commented on code in PR #10531: URL: https://github.com/apache/datafusion/pull/10531#discussion_r1612010377 ## datafusion/substrait/src/logical_plan/consumer.rs: ## @@ -1277,6 +1407,56 @@ pub(crate) fn from_substrait_literal(lit: ) -> Result { s,

Re: [PR] Support Substrait's VirtualTables [datafusion]

2024-05-23 Thread via GitHub
Blizzara commented on PR #10531: URL: https://github.com/apache/datafusion/pull/10531#issuecomment-2127582955 @jonahgao Thanks for the review - I pushed a new version but it builds on top of https://github.com/apache/datafusion/pull/10622 and https://github.com/apache/datafusion/pull/10640

Re: [PR] Support Substrait's VirtualTables [datafusion]

2024-05-23 Thread via GitHub
Blizzara commented on code in PR #10531: URL: https://github.com/apache/datafusion/pull/10531#discussion_r1611984584 ## datafusion/substrait/src/logical_plan/consumer.rs: ## @@ -1277,7 +1404,84 @@ pub(crate) fn from_substrait_literal(lit: ) -> Result { s,

Re: [PR] Support Substrait's VirtualTables [datafusion]

2024-05-21 Thread via GitHub
jonahgao commented on code in PR #10531: URL: https://github.com/apache/datafusion/pull/10531#discussion_r1609182533 ## datafusion/substrait/src/logical_plan/consumer.rs: ## @@ -505,7 +507,35 @@ pub async fn from_substrait_rel( _ => Ok(t),

Re: [PR] Support Substrait's VirtualTables [datafusion]

2024-05-21 Thread via GitHub
jonahgao commented on code in PR #10531: URL: https://github.com/apache/datafusion/pull/10531#discussion_r1609180143 ## datafusion/substrait/src/logical_plan/consumer.rs: ## @@ -1277,7 +1404,84 @@ pub(crate) fn from_substrait_literal(lit: ) -> Result { s,

Re: [PR] Support Substrait's VirtualTables [datafusion]

2024-05-21 Thread via GitHub
Blizzara commented on code in PR #10531: URL: https://github.com/apache/datafusion/pull/10531#discussion_r1608623644 ## datafusion/substrait/src/logical_plan/consumer.rs: ## @@ -1277,7 +1404,84 @@ pub(crate) fn from_substrait_literal(lit: ) -> Result { s,

Re: [PR] Support Substrait's VirtualTables [datafusion]

2024-05-21 Thread via GitHub
Blizzara commented on code in PR #10531: URL: https://github.com/apache/datafusion/pull/10531#discussion_r1608622303 ## datafusion/substrait/src/logical_plan/consumer.rs: ## @@ -505,7 +507,35 @@ pub async fn from_substrait_rel( _ => Ok(t),

Re: [PR] Support Substrait's VirtualTables [datafusion]

2024-05-21 Thread via GitHub
Blizzara commented on code in PR #10531: URL: https://github.com/apache/datafusion/pull/10531#discussion_r1608610498 ## datafusion/substrait/src/logical_plan/consumer.rs: ## @@ -1277,6 +1407,56 @@ pub(crate) fn from_substrait_literal(lit: ) -> Result { s,

Re: [PR] Support Substrait's VirtualTables [datafusion]

2024-05-21 Thread via GitHub
jonahgao commented on code in PR #10531: URL: https://github.com/apache/datafusion/pull/10531#discussion_r1608431571 ## datafusion/substrait/src/logical_plan/consumer.rs: ## @@ -505,7 +507,35 @@ pub async fn from_substrait_rel( _ => Ok(t),

Re: [PR] Support Substrait's VirtualTables [datafusion]

2024-05-21 Thread via GitHub
jonahgao commented on code in PR #10531: URL: https://github.com/apache/datafusion/pull/10531#discussion_r1608413505 ## datafusion/substrait/src/logical_plan/consumer.rs: ## @@ -1277,6 +1407,56 @@ pub(crate) fn from_substrait_literal(lit: ) -> Result { s,

Re: [PR] Support Substrait's VirtualTables [datafusion]

2024-05-21 Thread via GitHub
jonahgao commented on code in PR #10531: URL: https://github.com/apache/datafusion/pull/10531#discussion_r1608408244 ## datafusion/substrait/src/logical_plan/consumer.rs: ## @@ -1277,7 +1404,84 @@ pub(crate) fn from_substrait_literal(lit: ) -> Result { s,

Re: [PR] Support Substrait's VirtualTables [datafusion]

2024-05-21 Thread via GitHub
Blizzara commented on code in PR #10531: URL: https://github.com/apache/datafusion/pull/10531#discussion_r1608039288 ## datafusion/substrait/tests/cases/roundtrip_logical_plan.rs: ## @@ -607,6 +608,15 @@ async fn qualified_catalog_schema_table_reference() -> Result<()> {

Re: [PR] Support Substrait's VirtualTables [datafusion]

2024-05-21 Thread via GitHub
Blizzara commented on PR #10531: URL: https://github.com/apache/datafusion/pull/10531#issuecomment-2122279768 @jonahgao @alamb I think this is ready by me :) -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL

Re: [PR] Support Substrait's VirtualTables [datafusion]

2024-05-20 Thread via GitHub
jonahgao commented on code in PR #10531: URL: https://github.com/apache/datafusion/pull/10531#discussion_r1607637374 ## datafusion/substrait/tests/cases/roundtrip_logical_plan.rs: ## @@ -607,6 +608,15 @@ async fn qualified_catalog_schema_table_reference() -> Result<()> {

Re: [PR] Support Substrait's VirtualTables [datafusion]

2024-05-20 Thread via GitHub
jonahgao commented on code in PR #10531: URL: https://github.com/apache/datafusion/pull/10531#discussion_r1607637374 ## datafusion/substrait/tests/cases/roundtrip_logical_plan.rs: ## @@ -607,6 +608,15 @@ async fn qualified_catalog_schema_table_reference() -> Result<()> {

Re: [PR] Support Substrait's VirtualTables [datafusion]

2024-05-20 Thread via GitHub
Blizzara commented on code in PR #10531: URL: https://github.com/apache/datafusion/pull/10531#discussion_r1606981891 ## datafusion/substrait/tests/cases/roundtrip_logical_plan.rs: ## @@ -607,6 +608,15 @@ async fn qualified_catalog_schema_table_reference() -> Result<()> {

Re: [PR] Support Substrait's VirtualTables [datafusion]

2024-05-20 Thread via GitHub
Blizzara commented on code in PR #10531: URL: https://github.com/apache/datafusion/pull/10531#discussion_r1601980707 ## datafusion/substrait/src/logical_plan/producer.rs: ## @@ -165,6 +168,53 @@ pub fn to_substrait_rel( }))), })) } +

Re: [PR] Support Substrait's VirtualTables [datafusion]

2024-05-20 Thread via GitHub
jonahgao commented on code in PR #10531: URL: https://github.com/apache/datafusion/pull/10531#discussion_r1606501759 ## datafusion/substrait/tests/cases/roundtrip_logical_plan.rs: ## @@ -607,6 +608,15 @@ async fn qualified_catalog_schema_table_reference() -> Result<()> {

Re: [PR] Support Substrait's VirtualTables [datafusion]

2024-05-16 Thread via GitHub
alamb commented on PR #10531: URL: https://github.com/apache/datafusion/pull/10531#issuecomment-2116424197 Thanks @Blizzara -- I started the CI on this PR -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above

Re: [PR] Support Substrait's VirtualTables [datafusion]

2024-05-16 Thread via GitHub
Blizzara commented on code in PR #10531: URL: https://github.com/apache/datafusion/pull/10531#discussion_r1601979954 ## datafusion/substrait/src/logical_plan/consumer.rs: ## @@ -1277,6 +1407,56 @@ pub(crate) fn from_substrait_literal(lit: ) -> Result { s,

Re: [PR] Support Substrait's VirtualTables [datafusion]

2024-05-15 Thread via GitHub
Blizzara commented on code in PR #10531: URL: https://github.com/apache/datafusion/pull/10531#discussion_r1601981711 ## datafusion/substrait/tests/cases/roundtrip_logical_plan.rs: ## @@ -607,6 +608,15 @@ async fn qualified_catalog_schema_table_reference() -> Result<()> {

Re: [PR] Support Substrait's VirtualTables [datafusion]

2024-05-15 Thread via GitHub
Blizzara commented on code in PR #10531: URL: https://github.com/apache/datafusion/pull/10531#discussion_r1601980707 ## datafusion/substrait/src/logical_plan/producer.rs: ## @@ -165,6 +168,53 @@ pub fn to_substrait_rel( }))), })) } +

Re: [PR] Support Substrait's VirtualTables [datafusion]

2024-05-15 Thread via GitHub
Blizzara commented on code in PR #10531: URL: https://github.com/apache/datafusion/pull/10531#discussion_r1601980361 ## datafusion/substrait/src/logical_plan/producer.rs: ## @@ -165,6 +168,53 @@ pub fn to_substrait_rel( }))), })) } +

Re: [PR] Support Substrait's VirtualTables [datafusion]

2024-05-15 Thread via GitHub
Blizzara commented on code in PR #10531: URL: https://github.com/apache/datafusion/pull/10531#discussion_r1601979954 ## datafusion/substrait/src/logical_plan/consumer.rs: ## @@ -1277,6 +1407,56 @@ pub(crate) fn from_substrait_literal(lit: ) -> Result { s,

Re: [PR] Support Substrait's VirtualTables [datafusion]

2024-05-15 Thread via GitHub
Blizzara commented on code in PR #10531: URL: https://github.com/apache/datafusion/pull/10531#discussion_r1601978505 ## datafusion/substrait/src/logical_plan/consumer.rs: ## @@ -1137,7 +1220,8 @@ fn from_substrait_type(dt: ::proto::Type) -> Result {

[PR] Support Substrait's VirtualTables [datafusion]

2024-05-15 Thread via GitHub
Blizzara opened a new pull request, #10531: URL: https://github.com/apache/datafusion/pull/10531 ## Which issue does this PR close? Closes #10530 ## Rationale for this change ## What changes are included in this PR? Adds support for Substrait's