[GitHub] [beam] Abacn commented on issue #26673: [Failing Test]: beam_PreCommit_Python_Cron failing TestWriteBigTable.test_write_metrics

Thu, 11 May 2023 12:28:53 -0700 


Abacn commented on issue #26673:
URL: https://github.com/apache/beam/issues/26673#issuecomment-1544561302

   With google-cloud-bigtable=2.18.0, query runner api monitoring infos returns 
an empty dict here:
   
   
https://github.com/apache/beam/blob/2209da6c084c224462bea947c428942c2f6efcce/sdks/python/apache_beam/io/gcp/bigtableio_test.py#LL116C54-L116C54
   
   WIth google-cloud-bigtable=2.17.0, 
`MetricsEnvironment.process_wide_container().to_runner_api_monitoring_infos(None)`
 returns a dict like this:
   
   ```
   {frozenset({('SERVICE', 'BigTable'), 'beam:metric:io:api_request_count:v1', 
('INSTANCE_ID', 'python-test-6aa8fa26'), ('STATUS', 'already_exists'), 
('TABLE_ID', 'python-test-d77bc18a'), ('METHOD', 
'google.bigtable.v2.MutateRows'), ('RESOURCE', 
'//bigtable.googleapis.com/projects/python-test-8b2a433b/instances/python-test-6aa8fa26/tables/python-test-d77bc18a'),
 ('BIGTABLE_PROJECT_ID', 'python-test-8b2a433b')}): urn: 
"beam:metric:io:api_request_count:v1"
   type: "beam:metrics:sum_int64:v1"
   payload: "\002"
   labels {
     key: "BIGTABLE_PROJECT_ID"
     value: "python-test-8b2a433b"
   }
   labels {
     key: "INSTANCE_ID"
     value: "python-test-6aa8fa26"
   }
   labels {
     key: "METHOD"
     value: "google.bigtable.v2.MutateRows"
   }
   labels {
     key: "RESOURCE"
     value: 
"//bigtable.googleapis.com/projects/python-test-8b2a433b/instances/python-test-6aa8fa26/tables/python-test-d77bc18a"
   }
   labels {
     key: "SERVICE"
     value: "BigTable"
   }
   labels {
     key: "STATUS"
     value: "already_exists"
   }
   labels {
     key: "TABLE_ID"
     value: "python-test-d77bc18a"
   }
   start_time {
     seconds: 1683832726
     nanos: 768536000
   }
   , frozenset({('SERVICE', 'BigTable'), ('STATUS', 'ok'), 
'beam:metric:io:api_request_count:v1', ('INSTANCE_ID', 'python-test-6aa8fa26'), 
('TABLE_ID', 'python-test-d77bc18a'), ('METHOD', 
'google.bigtable.v2.MutateRows'), ('RESOURCE', 
'//bigtable.googleapis.com/projects/python-test-8b2a433b/instances/python-test-6aa8fa26/tables/python-test-d77bc18a'),
 ('BIGTABLE_PROJECT_ID', 'python-test-8b2a433b')}): urn: 
"beam:metric:io:api_request_count:v1"
   type: "beam:metrics:sum_int64:v1"
   payload: "\002"
   labels {
     key: "BIGTABLE_PROJECT_ID"
     value: "python-test-8b2a433b"
   }
   labels {
     key: "INSTANCE_ID"
     value: "python-test-6aa8fa26"
   }
   labels {
     key: "METHOD"
     value: "google.bigtable.v2.MutateRows"
   }
   labels {
     key: "RESOURCE"
     value: 
"//bigtable.googleapis.com/projects/python-test-8b2a433b/instances/python-test-6aa8fa26/tables/python-test-d77bc18a"
   }
   labels {
     key: "SERVICE"
     value: "BigTable"
   }
   labels {
     key: "STATUS"
     value: "ok"
   }
   labels {
     key: "TABLE_ID"
     value: "python-test-d77bc18a"
   }
   start_time {
     seconds: 1683832726
     nanos: 768579000
   }
   }
   ```


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: [email protected]

For queries about this service, please contact Infrastructure at:
[email protected]

Reply via email to