Yes, we do have the plan to add more examples to https://cloud.google.com/dataflow/docs/guides/managed-io-iceberg.
You are also welcome to contribute your example to https://github.com/apache/beam/tree/master/examples/java if you want. On Sun, Mar 16, 2025 at 1:29 AM LEE SOMANG <h...@chosunbiz.com> wrote: > Hello XQ Hu, > > Thank you for your response and for sharing the example. > > I was able to successfully complete our PoC by referring to the example > you provided. However, as mentioned earlier, the lack of detailed > documentation made certain aspects, such as managing dependencies, a bit > challenging. > > Do you know if there are any plans to update the Google Cloud > documentation to include more comprehensive guidance on this topic? It > would be incredibly helpful for others working on similar implementations. > > Thank you again for your assistance. > > Best regards > > 2025년 3월 14일 (금) 오후 10:48, XQ Hu via dev <dev@beam.apache.org>님이 작성: > >> >> https://github.com/apache/beam/blob/master/sdks/java/io/iceberg/src/test/java/org/apache/beam/sdk/io/iceberg/catalog/BigQueryMetastoreCatalogIT.java#L92C30-L92C50 >> >> Is the IT example good? >> >> On Fri, Mar 14, 2025 at 9:28 AM LEE SOMANG <h...@chosunbiz.com> wrote: >> >>> Hi XQ Hu, >>> >>> Thanks for confirming that managed Iceberg IO supports BigQuery >>> Metastore. >>> >>> I was looking through the documentation and noticed there aren't any >>> examples showing how to use BigQuery Metastore. This makes it a bit tricky >>> to run our PoC effectively. Are there plans to add such examples soon, or >>> do you know of any other resources that might help us? >>> >>> Thanks for your help! >>> >>> >>> 2025년 3월 14일 (금) 오후 10:04, XQ Hu via dev <dev@beam.apache.org>님이 작성: >>> >>>> https://cloud.google.com/dataflow/docs/guides/managed-io-iceberg >>>> Yes, the managed Iceberg IO indeed supports BigQuery metastore >>>> <https://cloud.google.com/bigquery/docs/about-bqms> >>>> >>>> On Fri, Mar 14, 2025 at 1:42 AM LEE SOMANG <h...@chosunbiz.com> wrote: >>>> >>>>> Hello Beam developers, >>>>> >>>>> I recently came across the existence of BigQuery Metastore. [1] >>>>> >>>>> Is it possible to use BigQuery Metastore with Apache Beam's IcebergIO? >>>>> >>>>> Or are there any plans to support it in the future? >>>>> >>>>> The examples in the official documentation for BigQuery Metastore only >>>>> mention Apache Spark, which is a bit confusing. [2] >>>>> >>>>> If this becomes possible with Apache Beam, I believe it could open up >>>>> many use cases. >>>>> >>>>> Thank you. >>>>> >>>>> [1]: https://cloud.google.com/bigquery/docs/about-bqms >>>>> [2]: https://cloud.google.com/bigquery/docs/bqms-use-dataproc >>>>> >>>>> -- >>>>> >>>>> LEE SOMANG >>>>> R&D Department Backend Development Team >>>>> >>>>> The Chosunilbo, 30, Sejong-daero 21-gil, Jung-gu, Seoul, Korea (zip >>>>> code: 04519) >>>>> M : +82 10-8940-5081 <+82%2010-8940-5081> >>>>> E : h...@chosunbiz.com >>>>> >>>> >>> >>> -- >>> >>> LEE SOMANG >>> R&D Department Backend Development Team >>> >>> The Chosunilbo, 30, Sejong-daero 21-gil, Jung-gu, Seoul, Korea (zip >>> code: 04519) >>> M : +82 10-8940-5081 <+82%2010-8940-5081> >>> E : h...@chosunbiz.com >>> >> > > -- > > LEE SOMANG > R&D Department Backend Development Team > > The Chosunilbo, 30, Sejong-daero 21-gil, Jung-gu, Seoul, Korea (zip code: > 04519) > M : +82 10-8940-5081 <+82%2010-8940-5081> > E : h...@chosunbiz.com >
