Hi, I got the following message on dataflow :
(3ab7c60e46263340): Workflow failed. Causes: (8218eb08eddcd37d): S105:get_num_lines_integrated_billing_92bab7e1/CombineGlobally(CountCombineFn)/DoOnce/Read+get_num_lines_integrated_billing_92bab7e1/CombineGlobally(CountCombineFn)/InjectDefault/Do+get_static_integrated_billing_92bab7e1+write_static_integrated_billing_92bab7e1/NativeWrite failed., (7acad398ba00c12b): BigQuery import job "dataflow_job_9235157842787578025-B" failed., (7acad398ba00c220): BigQuery job "dataflow_job_9235157842787578025-B" in project "gbl-imt-ve-datalake-prod" finished with error(s): errorResult: Exceeded rate limits: too many table update operations for this table. For more information, see https://cloud.google.com/bigquery/troubleshooting-errors, error: Exceeded rate limits: too many table update operations for this table. For more information, see https://cloud.google.com/bigquery/troubleshooting-errors But we don't configure the pipeline to update the data in bigquery but use the classical BigQuerySink to write data, what's going on? Thanks by advance for your help. Dataflowid : 2017-09-19_07_16_08-10277898752286222869 *Sébastien MORAND* Team Lead Solution Architect Technology & Operations / Digital Factory Veolia - Group Information Systems & Technology (IS&T) Cell.: +33 7 52 66 20 81 / Direct: +33 1 85 57 71 08 Bureau 0144C (Ouest) 30, rue Madeleine-Vionnet - 93300 Aubervilliers, France *www.veolia.com <http://www.veolia.com>* <http://www.veolia.com> <https://www.facebook.com/veoliaenvironment/> <https://www.youtube.com/user/veoliaenvironnement> <https://www.linkedin.com/company/veolia-environnement> <https://twitter.com/veolia> -- -------------------------------------------------------------------------------------------- This e-mail transmission (message and any attached files) may contain information that is proprietary, privileged and/or confidential to Veolia Environnement and/or its affiliates and is intended exclusively for the person(s) to whom it is addressed. If you are not the intended recipient, please notify the sender by return e-mail and delete all copies of this e-mail, including all attachments. Unless expressly authorized, any use, disclosure, publication, retransmission or dissemination of this e-mail and/or of its attachments is strictly prohibited. Ce message electronique et ses fichiers attaches sont strictement confidentiels et peuvent contenir des elements dont Veolia Environnement et/ou l'une de ses entites affiliees sont proprietaires. Ils sont donc destines a l'usage de leurs seuls destinataires. Si vous avez recu ce message par erreur, merci de le retourner a son emetteur et de le detruire ainsi que toutes les pieces attachees. L'utilisation, la divulgation, la publication, la distribution, ou la reproduction non expressement autorisees de ce message et de ses pieces attachees sont interdites. --------------------------------------------------------------------------------------------
