See <https://ci-beam.apache.org/job/beam_PostCommit_Python39/2464/display/redirect>
Changes: ------------------------------------------ [...truncated 12.14 MB...] [gw4] [32mPASSED[0m apache_beam/io/gcp/bigquery_read_it_test.py::ReadUsingStorageApiTests::test_iobase_source_with_column_selection_and_row_restriction_rows apache_beam/io/gcp/bigquery_read_it_test.py::ReadUsingStorageApiTests::test_iobase_source_with_native_datetime [gw4] [32mPASSED[0m apache_beam/io/gcp/bigquery_read_it_test.py::ReadUsingStorageApiTests::test_iobase_source_with_native_datetime apache_beam/io/gcp/bigquery_read_it_test.py::ReadUsingStorageApiTests::test_iobase_source_with_query [gw4] [32mPASSED[0m apache_beam/io/gcp/bigquery_read_it_test.py::ReadUsingStorageApiTests::test_iobase_source_with_query apache_beam/io/gcp/bigquery_read_it_test.py::ReadUsingStorageApiTests::test_iobase_source_with_query_and_filters [gw4] [32mPASSED[0m apache_beam/io/gcp/bigquery_read_it_test.py::ReadUsingStorageApiTests::test_iobase_source_with_query_and_filters apache_beam/io/gcp/bigquery_read_it_test.py::ReadUsingStorageApiTests::test_iobase_source_with_row_restriction [gw4] [32mPASSED[0m apache_beam/io/gcp/bigquery_read_it_test.py::ReadUsingStorageApiTests::test_iobase_source_with_row_restriction apache_beam/io/gcp/bigquery_read_it_test.py::ReadUsingStorageApiTests::test_iobase_source_with_very_selective_filters [gw4] [32mPASSED[0m apache_beam/io/gcp/bigquery_read_it_test.py::ReadUsingStorageApiTests::test_iobase_source_with_very_selective_filters apache_beam/io/gcp/bigquery_read_it_test.py::ReadNewTypesTests::test_iobase_source [gw4] [32mPASSED[0m apache_beam/io/gcp/bigquery_read_it_test.py::ReadNewTypesTests::test_iobase_source apache_beam/io/gcp/bigquery_read_it_test.py::ReadNewTypesTests::test_native_source [gw4] [32mPASSED[0m apache_beam/io/gcp/bigquery_read_it_test.py::ReadNewTypesTests::test_native_source apache_beam/io/gcp/bigquery_read_it_test.py::ReadAllBQTests::test_read_queries [gw4] [32mPASSED[0m apache_beam/io/gcp/bigquery_read_it_test.py::ReadAllBQTests::test_read_queries apache_beam/io/gcp/bigquery_read_it_test.py::ReadInteractiveRunnerTests::test_read_in_interactive_runner [gw4] [32mPASSED[0m apache_beam/io/gcp/bigquery_read_it_test.py::ReadInteractiveRunnerTests::test_read_in_interactive_runner =================================== FAILURES =================================== [31m[1m___________________ BigtableIOWriteTest.test_bigtable_write ____________________[0m [gw5] linux -- Python 3.9.10 <https://ci-beam.apache.org/job/beam_PostCommit_Python39/ws/src/build/gradleenv/-1734967050/bin/python3.9> args = (parent: "projects/apache-beam-testing" instance_id: "python-test-934ac50d" instance { display_name: "python-test-93...d10" value { location: "projects/apache-beam-testing/locations/us-east1-b" default_storage_type: HDD } } ,) kwargs = {'metadata': [('x-goog-request-params', 'parent=projects/apache-beam-testing'), ('x-goog-api-client', 'gl-python/3.9.10 grpc/1.59.0 gax/2.12.0 gapic/2.21.0')], 'timeout': 300.0} @functools.wraps(callable_) def error_remapped_callable(*args, **kwargs): try: > return callable_(*args, **kwargs) [1m[31m../../build/gradleenv/-1734967050/lib/python3.9/site-packages/google/api_core/grpc_helpers.py[0m:75: _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ [1m[31m../../build/gradleenv/-1734967050/lib/python3.9/site-packages/grpc/_channel.py[0m:1161: in __call__ return _end_unary_response_blocking(state, call, False, None) _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ state = <grpc._channel._RPCState object at 0x7f555c0f2d30> call = <grpc._cython.cygrpc.SegregatedCall object at 0x7f555c0ad7c0> with_call = False, deadline = None def _end_unary_response_blocking( state: _RPCState, call: cygrpc.SegregatedCall, with_call: bool, deadline: Optional[float], ) -> Union[ResponseType, Tuple[ResponseType, grpc.Call]]: if state.code is grpc.StatusCode.OK: if with_call: rendezvous = _MultiThreadedRendezvous(state, call, None, deadline) return state.response, rendezvous else: return state.response else: > raise _InactiveRpcError(state) # pytype: disable=not-instantiable [1m[31mE grpc._channel._InactiveRpcError: <_InactiveRpcError of RPC that terminated with:[0m [1m[31mE status = StatusCode.RESOURCE_EXHAUSTED[0m [1m[31mE details = "Quota exceeded for quota metric 'Instance and cluster metadata write requests' and limit 'Instance and cluster metadata write requests per day' of service 'bigtableadmin.googleapis.com' for consumer 'project_number:844138762903'."[0m [1m[31mE debug_error_string = "UNKNOWN:Error received from peer ipv4:142.251.6.95:443 {grpc_message:"Quota exceeded for quota metric \'Instance and cluster metadata write requests\' and limit \'Instance and cluster metadata write requests per day\' of service \'bigtableadmin.googleapis.com\' for consumer \'project_number:844138762903\'.", grpc_status:8, created_time:"2023-10-23T06:23:51.173674961+00:00"}"[0m [1m[31mE >[0m [1m[31m../../build/gradleenv/-1734967050/lib/python3.9/site-packages/grpc/_channel.py[0m:1004: _InactiveRpcError [33mThe above exception was the direct cause of the following exception:[0m self = <apache_beam.examples.cookbook.bigtableio_it_test.BigtableIOWriteTest testMethod=test_bigtable_write> def setUp(self): try: from google.cloud.bigtable import enums self.STORAGE_TYPE = enums.StorageType.HDD self.INSTANCE_TYPE = enums.Instance.Type.DEVELOPMENT except ImportError: self.STORAGE_TYPE = 2 self.INSTANCE_TYPE = 2 self.test_pipeline = TestPipeline(is_integration_test=True) self.runner_name = type(self.test_pipeline.runner).__name__ self.project = self.test_pipeline.get_option('project') self.client = Client(project=self.project, admin=True) self._delete_old_instances() self.instance = self.client.instance( self.instance_id, instance_type=self.INSTANCE_TYPE, labels=LABELS) if not self.instance.exists(): cluster = self.instance.cluster( self.cluster_id, self.LOCATION_ID, default_storage_type=self.STORAGE_TYPE) > operation = self.instance.create(clusters=[cluster]) [1m[31mapache_beam/examples/cookbook/bigtableio_it_test.py[0m:143: _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ [1m[31m../../build/gradleenv/-1734967050/lib/python3.9/site-packages/google/cloud/bigtable/instance.py[0m:334: in create return self._client.instance_admin_client.create_instance( [1m[31m../../build/gradleenv/-1734967050/lib/python3.9/site-packages/google/cloud/bigtable_admin_v2/services/bigtable_instance_admin/client.py[0m:684: in create_instance response = rpc( [1m[31m../../build/gradleenv/-1734967050/lib/python3.9/site-packages/google/api_core/gapic_v1/method.py[0m:131: in __call__ return wrapped_func(*args, **kwargs) [1m[31m../../build/gradleenv/-1734967050/lib/python3.9/site-packages/google/api_core/timeout.py[0m:120: in func_with_timeout return func(*args, **kwargs) _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ args = (parent: "projects/apache-beam-testing" instance_id: "python-test-934ac50d" instance { display_name: "python-test-93...d10" value { location: "projects/apache-beam-testing/locations/us-east1-b" default_storage_type: HDD } } ,) kwargs = {'metadata': [('x-goog-request-params', 'parent=projects/apache-beam-testing'), ('x-goog-api-client', 'gl-python/3.9.10 grpc/1.59.0 gax/2.12.0 gapic/2.21.0')], 'timeout': 300.0} @functools.wraps(callable_) def error_remapped_callable(*args, **kwargs): try: return callable_(*args, **kwargs) except grpc.RpcError as exc: > raise exceptions.from_grpc_error(exc) from exc [1m[31mE google.api_core.exceptions.ResourceExhausted: 429 Quota exceeded for quota metric 'Instance and cluster metadata write requests' and limit 'Instance and cluster metadata write requests per day' of service 'bigtableadmin.googleapis.com' for consumer 'project_number:844138762903'. [reason: "RATE_LIMIT_EXCEEDED"[0m [1m[31mE domain: "googleapis.com"[0m [1m[31mE metadata {[0m [1m[31mE key: "service"[0m [1m[31mE value: "bigtableadmin.googleapis.com"[0m [1m[31mE }[0m [1m[31mE metadata {[0m [1m[31mE key: "quota_metric"[0m [1m[31mE value: "bigtableadmin.googleapis.com/instances_write_requests"[0m [1m[31mE }[0m [1m[31mE metadata {[0m [1m[31mE key: "quota_location"[0m [1m[31mE value: "global"[0m [1m[31mE }[0m [1m[31mE metadata {[0m [1m[31mE key: "quota_limit"[0m [1m[31mE value: "InstancesWriteRequestsPerDayPerProject"[0m [1m[31mE }[0m [1m[31mE metadata {[0m [1m[31mE key: "quota_limit_value"[0m [1m[31mE value: "500"[0m [1m[31mE }[0m [1m[31mE metadata {[0m [1m[31mE key: "consumer"[0m [1m[31mE value: "projects/844138762903"[0m [1m[31mE }[0m [1m[31mE ][0m [1m[31m../../build/gradleenv/-1734967050/lib/python3.9/site-packages/google/api_core/grpc_helpers.py[0m:77: ResourceExhausted [33m=============================== warnings summary ===============================[0m apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_it apache_beam/examples/complete/game/game_stats_it_test.py::GameStatsIT::test_game_stats_it apache_beam/examples/complete/game/leader_board_it_test.py::LeaderBoardIT::test_leader_board_it apache_beam/io/gcp/bigquery_test.py::PubSubBigQueryIT::test_file_loads apache_beam/io/gcp/bigquery_test.py::PubSubBigQueryIT::test_streaming_inserts <https://ci-beam.apache.org/job/beam_PostCommit_Python39/ws/src/sdks/python/apache_beam/io/gcp/tests/utils.py>:63: PendingDeprecationWarning: Client.dataset is deprecated and will be removed in a future version. Use a string like 'my_project.my_dataset' or a cloud.google.bigquery.DatasetReference object, instead. dataset_ref = client.dataset(unique_dataset_name, project=project) apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it <https://ci-beam.apache.org/job/beam_PostCommit_Python39/ws/src/sdks/python/apache_beam/io/gcp/tests/utils.py>:100: PendingDeprecationWarning: Client.dataset is deprecated and will be removed in a future version. Use a string like 'my_project.my_dataset' or a cloud.google.bigquery.DatasetReference object, instead. table_ref = client.dataset(dataset_id).table(table_id) apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays <https://ci-beam.apache.org/job/beam_PostCommit_Python39/ws/src/sdks/python/apache_beam/examples/dataframe/flight_delays.py>:47: FutureWarning: The default value of numeric_only in DataFrame.mean is deprecated. In a future version, it will default to False. In addition, specifying 'numeric_only=None' is deprecated. Select only valid columns or specify the value of numeric_only to silence this warning. return airline_df[at_top_airports].mean() apache_beam/io/gcp/bigquery_read_it_test.py::ReadTests::test_native_source <https://ci-beam.apache.org/job/beam_PostCommit_Python39/ws/src/sdks/python/apache_beam/io/gcp/bigquery_read_it_test.py>:170: BeamDeprecationWarning: BigQuerySource is deprecated since 2.25.0. Use ReadFromBigQuery instead. beam.io.BigQuerySource(query=self.query, use_standard_sql=True))) apache_beam/io/gcp/bigquery_read_it_test.py::ReadNewTypesTests::test_native_source <https://ci-beam.apache.org/job/beam_PostCommit_Python39/ws/src/sdks/python/apache_beam/io/gcp/bigquery_read_it_test.py>:706: BeamDeprecationWarning: BigQuerySource is deprecated since 2.25.0. Use ReadFromBigQuery instead. beam.io.BigQuerySource(query=self.query, use_standard_sql=True))) -- Docs: https://docs.pytest.org/en/stable/how-to/capture-warnings.html - generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_Python39/ws/src/sdks/python/pytest_postCommitIT-df-py39.xml> - [36m[1m=========================== short test summary info ============================[0m [31mFAILED[0m apache_beam/examples/cookbook/bigtableio_it_test.py::[1mBigtableIOWriteTest::test_bigtable_write[0m - google.api_core.exceptions.ResourceExhausted: 429 Quota exceeded for quota metric 'Instance and cluster metadata write requests' and limit 'Instance and cluster metadata write requests per day' of service 'bigtableadmin.googleapis.com' for consumer 'project_number:844138762903'. [reason: "RATE_LIMIT_EXCEEDED" domain: "googleapis.com" metadata { key: "service" value: "bigtableadmin.googleapis.com" } metadata { key: "quota_metric" value: "bigtableadmin.googleapis.com/instances_write_requests" } metadata { key: "quota_location" value: "global" } metadata { key: "quota_limit" value: "InstancesWriteRequestsPerDayPerProject" } metadata { key: "quota_limit_value" value: "500" } metadata { key: "consumer" value: "projects/844138762903" } ] [31m====== [31m[1m1 failed[0m, [32m87 passed[0m, [33m50 skipped[0m, [33m9 warnings[0m[31m in 8113.97s (2:15:13)[0m[31m =======[0m > Task :sdks:python:test-suites:dataflow:py39:postCommitIT FAILED FAILURE: Build failed with an exception. * Where: Script '<https://ci-beam.apache.org/job/beam_PostCommit_Python39/ws/src/sdks/python/test-suites/dataflow/common.gradle'> line: 139 * What went wrong: Execution failed for task ':sdks:python:test-suites:dataflow:py39:postCommitIT'. > Process 'command 'sh'' finished with non-zero exit value 1 * Try: > Run with --stacktrace option to get the stack trace. > Run with --info or --debug option to get more log output. > Get more help at https://help.gradle.org. Deprecated Gradle features were used in this build, making it incompatible with Gradle 9.0. You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins. For more on this, please refer to https://docs.gradle.org/8.3/userguide/command_line_interface.html#sec:command_line_warnings in the Gradle documentation. BUILD FAILED in 2h 21m 40s 219 actionable tasks: 155 executed, 60 from cache, 4 up-to-date Publishing build scan... https://ge.apache.org/s/26yb7pvkx33sy Build step 'Invoke Gradle script' changed build result to FAILURE Build step 'Invoke Gradle script' marked build as failure --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
