I was thinking to use LogicalType or Row need to figure out how LogicalType works, it looks like we can have nested row and it can be a good feet
Byron Ellis can you attach a link to your branch for inspiration On Mon, Dec 4, 2023 at 7:18 PM Alexey Romanenko <aromanenko....@gmail.com> wrote: > Did you take a look by chance > on org.apache.beam.sdk.schemas.Schema.LogicalType? Can it be helpful for > your case? > > On 4 Dec 2023, at 12:02, Mark Zitnik <m...@clickhouse.com> wrote: > > Yes I know it is done in org.apache.beam.sdk.io.clickhouse.TableSchema > (Did it for several other types), but since Tuple is a nested type that can > hold any number of other ClickHouse types I was wondering what is the best > type from the Apache Beam side in order to implement it. > > Mark > > On Mon, Dec 4, 2023 at 12:24 PM Alexey Romanenko <aromanenko....@gmail.com> > wrote: > >> Hi Mark, >> >> What do you mean by “support” in this case? To map this ClickHouse data >> type to a Beam Schema data type as it’s done in >> org.apache.beam.sdk.io.clickhouse.TableSchema for other types or >> something else? >> >> — >> Alexey >> >> On 3 Dec 2023, at 10:35, Mark Zitnik <m...@clickhouse.com> wrote: >> >> Hi Team, >> >> I am one of the committers of the ClickHouse integration team. >> I need to add support for Tuple in the ClickHouse connector for >> Apache Beam. What is the best approval for implementing that? Tuple( >> https://clickhouse.com/docs/en/sql-reference/data-types/tuple) in a >> nested data type( >> https://clickhouse.com/docs/en/sql-reference/data-types#data_types). >> If you can point me to a reference on other connectors >> >> Thanks >> -MZ >> >> >> >> >> >