marianobrc commented on issue #36340:
URL: https://github.com/apache/beam/issues/36340#issuecomment-3357734198

   > Thanks for filing this.
   > 
   > Can you check if the the Dataflow Log Explorer logs 
`managed-transforms-worker` and `managed-transforms-worker-startup` mentioned 
in [1] has additional information regarding the error ?
   > 
   > Also, can you mention your Iceberg config ?
   > 
   > If you can file a Google Cloud support ticket, the support team take a 
look at your exact job.
   > 
   > [1] 
https://cloud.google.com/dataflow/docs/guides/common-errors#managed-transforms-upgrade
   
   Thanks for looking into this @chamikaramj 
   The iceberg config is:
   ```python
   iceberg_config = {
       "table": "earthranger_catalog.warehouse.observations",
       "catalog_name": "earthranger_catalog",
       "catalog_properties": {
           "warehouse": "gs://dwh_dev/iceberg-warehouse/",
           "catalog-impl": "org.apache.iceberg.hadoop.HadoopCatalog",
       },
       "triggering_frequency_seconds": 60
   }
   ```
   There aren't any logs from the `worker` or `worker-startup` in the logs 
explorer, nor from `harness` or `harness-startup`, only the ones I shared from 
`job-message`.
   Unfortunately, we cannot file a Google Cloud support ticket since we don't 
have a GCP Support plan.
   
   
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: [email protected]

For queries about this service, please contact Infrastructure at:
[email protected]

Reply via email to