Hello XQ Hu, Thank you for your response and for sharing the example.
I was able to successfully complete our PoC by referring to the example you provided. However, as mentioned earlier, the lack of detailed documentation made certain aspects, such as managing dependencies, a bit challenging. Do you know if there are any plans to update the Google Cloud documentation to include more comprehensive guidance on this topic? It would be incredibly helpful for others working on similar implementations. Thank you again for your assistance. Best regards 2025년 3월 14일 (금) 오후 10:48, XQ Hu via dev <dev@beam.apache.org>님이 작성: > > https://github.com/apache/beam/blob/master/sdks/java/io/iceberg/src/test/java/org/apache/beam/sdk/io/iceberg/catalog/BigQueryMetastoreCatalogIT.java#L92C30-L92C50 > > Is the IT example good? > > On Fri, Mar 14, 2025 at 9:28 AM LEE SOMANG <h...@chosunbiz.com> wrote: > >> Hi XQ Hu, >> >> Thanks for confirming that managed Iceberg IO supports BigQuery Metastore. >> >> I was looking through the documentation and noticed there aren't any >> examples showing how to use BigQuery Metastore. This makes it a bit tricky >> to run our PoC effectively. Are there plans to add such examples soon, or >> do you know of any other resources that might help us? >> >> Thanks for your help! >> >> >> 2025년 3월 14일 (금) 오후 10:04, XQ Hu via dev <dev@beam.apache.org>님이 작성: >> >>> https://cloud.google.com/dataflow/docs/guides/managed-io-iceberg >>> Yes, the managed Iceberg IO indeed supports BigQuery metastore >>> <https://cloud.google.com/bigquery/docs/about-bqms> >>> >>> On Fri, Mar 14, 2025 at 1:42 AM LEE SOMANG <h...@chosunbiz.com> wrote: >>> >>>> Hello Beam developers, >>>> >>>> I recently came across the existence of BigQuery Metastore. [1] >>>> >>>> Is it possible to use BigQuery Metastore with Apache Beam's IcebergIO? >>>> >>>> Or are there any plans to support it in the future? >>>> >>>> The examples in the official documentation for BigQuery Metastore only >>>> mention Apache Spark, which is a bit confusing. [2] >>>> >>>> If this becomes possible with Apache Beam, I believe it could open up >>>> many use cases. >>>> >>>> Thank you. >>>> >>>> [1]: https://cloud.google.com/bigquery/docs/about-bqms >>>> [2]: https://cloud.google.com/bigquery/docs/bqms-use-dataproc >>>> >>>> -- >>>> >>>> LEE SOMANG >>>> R&D Department Backend Development Team >>>> >>>> The Chosunilbo, 30, Sejong-daero 21-gil, Jung-gu, Seoul, Korea (zip >>>> code: 04519) >>>> M : +82 10-8940-5081 <+82%2010-8940-5081> >>>> E : h...@chosunbiz.com >>>> >>> >> >> -- >> >> LEE SOMANG >> R&D Department Backend Development Team >> >> The Chosunilbo, 30, Sejong-daero 21-gil, Jung-gu, Seoul, Korea (zip code: >> 04519) >> M : +82 10-8940-5081 <+82%2010-8940-5081> >> E : h...@chosunbiz.com >> > -- LEE SOMANG R&D Department Backend Development Team The Chosunilbo, 30, Sejong-daero 21-gil, Jung-gu, Seoul, Korea (zip code: 04519) M : +82 10-8940-5081 E : h...@chosunbiz.com
