Hey Siyuan, Can you open a GitHub issue with a reproducible code snippet? We can try and take a look but will need more info (for example, which write method are you using).
Best, Ahmed On Thu, Aug 29, 2024 at 6:21 PM hsy...@gmail.com <hsy...@gmail.com> wrote: > I have a question regarding the performance of BigQueryIO > DynamicDestinations. > In my use case, I need write the data to hundreds of different tables in > different projects(same region). And the data volume for each table is > quite different which means the data is highly skewed. I observe that the > write performance is very very bad(10x slower) compare if I write all the > data into just one table. All the tables are in same schema > > Any recommended solutions? Thanks! > > Regards, > Siyuan >
