Re: [I] [Bug]: Iceberg managed connector upgrade failed in GCP Dataflow [beam]

Wed, 01 Oct 2025 15:31:27 -0700 


marianobrc commented on issue #36340:
URL: https://github.com/apache/beam/issues/36340#issuecomment-3358044910

   > Lemme try to run a job using a similar config.
   > 
   > BTW the logs you have to check are `managed-transforms-worker` and 
`managed-transforms-worker-startup` not the `worker` etc. you mentioned. These 
have to be explicitly selected in the Log Explorer UI with the correct time 
range. It might also help to unselect other logs. See the attached screenshot 
below.
   > <img alt="Image" width="1662" height="560" 
src="https://private-user-images.githubusercontent.com/10819857/496338408-4f787a92-0043-4d5e-bd16-1c9417b3c301.png?jwt=eyJ0eXAiOiJKV1QiLCJhbGciOiJIUzI1NiJ9.eyJpc3MiOiJnaXRodWIuY29tIiwiYXVkIjoicmF3LmdpdGh1YnVzZXJjb250ZW50LmNvbSIsImtleSI6ImtleTUiLCJleHAiOjE3NTkzNTA2MDgsIm5iZiI6MTc1OTM1MDMwOCwicGF0aCI6Ii8xMDgxOTg1Ny80OTYzMzg0MDgtNGY3ODdhOTItMDA0My00ZDVlLWJkMTYtMWM5NDE3YjNjMzAxLnBuZz9YLUFtei1BbGdvcml0aG09QVdTNC1ITUFDLVNIQTI1NiZYLUFtei1DcmVkZW50aWFsPUFLSUFWQ09EWUxTQTUzUFFLNFpBJTJGMjAyNTEwMDElMkZ1cy1lYXN0LTElMkZzMyUyRmF3czRfcmVxdWVzdCZYLUFtei1EYXRlPTIwMjUxMDAxVDIwMjUwOFomWC1BbXotRXhwaXJlcz0zMDAmWC1BbXotU2lnbmF0dXJlPTVmNjA5N2YwMDEzMjljMWVkMTQ3OTExMTdhZTFkOWFjMmI3MzFjNTM2ZmY2ZjM5YmFmNWUzYzk5OGQ5ZGVkN2YmWC1BbXotU2lnbmVkSGVhZGVycz1ob3N0In0.3QfsX9K1Mp5CKBhx4U0hZUX_3bYUhF4JlT46ZeIYeFU";>
   
   Thank you for your quick response. For some reason, the `managed-` ones 
don't show up as an option for me:
   
   <img width="1778" height="648" alt="Image" 
src="https://github.com/user-attachments/assets/74c268f3-364d-49e5-aa7a-b4c41b83bbf1";
 />
   
   If I clear all the filters (All log names), then those job logs are all I 
can see:
   
   <img width="1773" height="722" alt="Image" 
src="https://github.com/user-attachments/assets/43c2a0b0-81d3-4a2b-b15f-2c62fb0fac8b";
 />
   
   @liferoad here is the job id and other details in case are useful:
   ```
   Job name
   beamapp-dev-0929124506-405713-ih4cgl5j
   
   Job ID
   2025-09-29_05_47_09-6071847335088109426
   
   Job type
   Streaming
   
   Job status
    Failed
   
   SDK version
   Apache Beam Python 3.12 SDK 2.67.0
    A newer version of the SDK family exists and updating is recommended. 
[Learn more 
](https://cloud.google.com/dataflow/docs/support/sdk-version-support-status)
   
   Job region
   us-west1
   
   Service zones
   us-west1-b
   
   Worker location 
   us-west1
   ```
   
   Thank you


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: [email protected]

For queries about this service, please contact Infrastructure at:
[email protected]

Reply via email to