See <https://builds.apache.org/job/beam_sonarqube_report/526/display/redirect?page=changes>
Changes: [ttanay100] unskip ReifyTest.test_window [ttanay100] [BEAM-7437] Add streaming flag to BQ streaming inserts IT test [ttanay100] Change default timeout to 5 mins [iemejia] [BEAM-6740] Add PTransformTranslator for Combine.Globally [iemejia] [BEAM-6740] Add extractAcummulatorCoder for Combine.Globally and fix [iemejia] [BEAM-7640] Change tests to use PayloadTranslator instead of unused [iemejia] [BEAM-6740] Refactor to remove duplicated code in CombineTranslation [kcweaver] [BEAM-7708] don't expect SQL shell bundled dependencies to be shadowed [33895511+aromanenko-dev] [BEAM-6480] Adds AvroIO sink for generic records. (#9005) [github] [SQL][Doc] fix broken gradle command. [lcwik] Added new example on how to create a custom unbounded streaming source ------------------------------------------ [...truncated 1.12 MB...] test_with_jar_packages (apache_beam.runners.portability.stager_test.StagerTest) ... ok test_with_jar_packages_invalid_file_name (apache_beam.runners.portability.stager_test.StagerTest) ... ok test_with_jar_packages_missing_files (apache_beam.runners.portability.stager_test.StagerTest) ... ok test_with_main_session (apache_beam.runners.portability.stager_test.StagerTest) ... ok test_with_requirements_file (apache_beam.runners.portability.stager_test.StagerTest) ... ok test_with_requirements_file_and_cache (apache_beam.runners.portability.stager_test.StagerTest) ... ok test_with_setup_file (apache_beam.runners.portability.stager_test.StagerTest) ... ok test_in_memory_data_channel (apache_beam.runners.worker.data_plane_test.DataChannelTest) ... ok test_basic_record (apache_beam.runners.worker.logger_test.JsonLogFormatterTest) ... ok test_exception_record (apache_beam.runners.worker.logger_test.JsonLogFormatterTest) ... ok test_nested_with_per_thread_info (apache_beam.runners.worker.logger_test.JsonLogFormatterTest) ... ok test_record_with_arbitrary_messages (apache_beam.runners.worker.logger_test.JsonLogFormatterTest) ... ok test_record_with_format_character (apache_beam.runners.worker.logger_test.JsonLogFormatterTest) ... ok test_record_with_per_thread_info (apache_beam.runners.worker.logger_test.JsonLogFormatterTest) ... ok test_per_thread_attribute (apache_beam.runners.worker.logger_test.PerThreadLoggingContextTest) ... ok test_set_when_already_defined (apache_beam.runners.worker.logger_test.PerThreadLoggingContextTest) ... ok test_set_when_undefined (apache_beam.runners.worker.logger_test.PerThreadLoggingContextTest) ... ok test_should_sample (apache_beam.runners.worker.opcounters_test.OperationCountersTest) ... ok test_update_int (apache_beam.runners.worker.opcounters_test.OperationCountersTest) ... ok test_update_multiple (apache_beam.runners.worker.opcounters_test.OperationCountersTest) ... ok test_update_new_object (apache_beam.runners.worker.opcounters_test.OperationCountersTest) ... ok test_update_old_object (apache_beam.runners.worker.opcounters_test.OperationCountersTest) ... ok test_update_str (apache_beam.runners.worker.opcounters_test.OperationCountersTest) ... ok test_basic_counters (apache_beam.runners.worker.opcounters_test.TransformIoCounterTest) ... ok test_parse_pipeline_options (apache_beam.runners.worker.sdk_worker_main_test.SdkWorkerMainTest) ... ok test_status_server (apache_beam.runners.worker.sdk_worker_main_test.SdkWorkerMainTest) ... ok test_work_count_custom_value (apache_beam.runners.worker.sdk_worker_main_test.SdkWorkerMainTest) ... ok test_work_count_default_value (apache_beam.runners.worker.sdk_worker_main_test.SdkWorkerMainTest) ... ok test_work_count_wrong_format (apache_beam.runners.worker.sdk_worker_main_test.SdkWorkerMainTest) ... ok test_fn_registration (apache_beam.runners.worker.sdk_worker_test.SdkWorkerTest) ... ok test_emulated_iterable (apache_beam.runners.worker.sideinputs_test.EmulatedCollectionsTest) ... ok test_large_iterable_values (apache_beam.runners.worker.sideinputs_test.EmulatedCollectionsTest) ... ok test_bytes_read_are_reported (apache_beam.runners.worker.sideinputs_test.PrefetchingSourceIteratorTest) ... ok test_multiple_sources_iterator_fn (apache_beam.runners.worker.sideinputs_test.PrefetchingSourceIteratorTest) ... ok test_multiple_sources_single_reader_iterator_fn (apache_beam.runners.worker.sideinputs_test.PrefetchingSourceIteratorTest) ... ok test_single_source_iterator_fn (apache_beam.runners.worker.sideinputs_test.PrefetchingSourceIteratorTest) ... ok test_source_iterator_fn_exception (apache_beam.runners.worker.sideinputs_test.PrefetchingSourceIteratorTest) ... ok test_source_iterator_single_source_exception (apache_beam.runners.worker.sideinputs_test.PrefetchingSourceIteratorTest) ... ok test_basic_sampler (apache_beam.runners.worker.statesampler_test.StateSamplerTest) ... ok test_sampler_transition_overhead (apache_beam.runners.worker.statesampler_test.StateSamplerTest) ... ok test_failure_when_worker_id_exists (apache_beam.runners.worker.worker_id_interceptor_test.WorkerIdInterceptorTest) ... ok test_worker_id_insertion (apache_beam.runners.worker.worker_id_interceptor_test.WorkerIdInterceptorTest) ... ok test_dofn_process_keyparam (apache_beam.runners.common_test.DoFnProcessTest) ... ok test_dofn_process_keyparam_error_no_key (apache_beam.runners.common_test.DoFnProcessTest) ... ok test_dofn_validate_finish_bundle_error (apache_beam.runners.common_test.DoFnSignatureTest) ... ok test_dofn_validate_process_error (apache_beam.runners.common_test.DoFnSignatureTest) ... ok test_dofn_validate_start_bundle_error (apache_beam.runners.common_test.DoFnSignatureTest) ... ok test_deduplication (apache_beam.runners.pipeline_context_test.PipelineContextTest) ... ok test_deduplication_by_proto (apache_beam.runners.pipeline_context_test.PipelineContextTest) ... ok test_serialization (apache_beam.runners.pipeline_context_test.PipelineContextTest) ... ok test_create_runner (apache_beam.runners.runner_test.RunnerTest) ... ok test_create_runner_shorthand (apache_beam.runners.runner_test.RunnerTest) ... ok test_run_api (apache_beam.runners.runner_test.RunnerTest) ... ok test_run_api_with_callable (apache_beam.runners.runner_test.RunnerTest) ... ok test_coders_microbenchmark (apache_beam.tools.microbenchmarks_test.MicrobenchmarksTest) ... ok test_basic_combiners_display_data (apache_beam.transforms.combiners_test.CombineTest) ... ok test_builtin_combines (apache_beam.transforms.combiners_test.CombineTest) ... ok test_combine_globally_display_data (apache_beam.transforms.combiners_test.CombineTest) ... ok test_combine_globally_with_default (apache_beam.transforms.combiners_test.CombineTest) ... ok test_combine_globally_with_default_side_input (apache_beam.transforms.combiners_test.CombineTest) ... ok test_combine_globally_without_default (apache_beam.transforms.combiners_test.CombineTest) ... ok test_combine_per_key_top_display_data (apache_beam.transforms.combiners_test.CombineTest) ... ok test_combine_sample_display_data (apache_beam.transforms.combiners_test.CombineTest) ... ok test_empty_global_top (apache_beam.transforms.combiners_test.CombineTest) ... ok test_global_fanout (apache_beam.transforms.combiners_test.CombineTest) ... ok test_global_sample (apache_beam.transforms.combiners_test.CombineTest) ... ok test_hot_key_fanout (apache_beam.transforms.combiners_test.CombineTest) ... ok test_hot_key_fanout_sharded (apache_beam.transforms.combiners_test.CombineTest) ... ok test_per_key_sample (apache_beam.transforms.combiners_test.CombineTest) ... ok test_sharded_top (apache_beam.transforms.combiners_test.CombineTest) ... ok test_sharded_top_combine_fn (apache_beam.transforms.combiners_test.CombineTest) ... ok test_to_list_and_to_dict (apache_beam.transforms.combiners_test.CombineTest) ... ok test_top (apache_beam.transforms.combiners_test.CombineTest) ... ok test_top_key (apache_beam.transforms.combiners_test.CombineTest) ... ok test_top_key_py2 (apache_beam.transforms.combiners_test.CombineTest) ... ok test_top_no_compact (apache_beam.transforms.combiners_test.CombineTest) ... ok test_top_py2 (apache_beam.transforms.combiners_test.CombineTest) ... ok test_top_shorthands (apache_beam.transforms.combiners_test.CombineTest) ... ok test_tuple_combine_fn (apache_beam.transforms.combiners_test.CombineTest) ... ok test_tuple_combine_fn_without_defaults (apache_beam.transforms.combiners_test.CombineTest) ... ok test_add_input (apache_beam.transforms.combiners_test.LatestCombineFnTest) ... ok test_create_accumulator (apache_beam.transforms.combiners_test.LatestCombineFnTest) ... ok test_extract_output (apache_beam.transforms.combiners_test.LatestCombineFnTest) ... ok test_merge_accumulators (apache_beam.transforms.combiners_test.LatestCombineFnTest) ... ok test_with_input_types_decorator_violation (apache_beam.transforms.combiners_test.LatestCombineFnTest) ... ok test_globally (apache_beam.transforms.combiners_test.LatestTest) ... ok test_globally_empty (apache_beam.transforms.combiners_test.LatestTest) ... ok test_per_key (apache_beam.transforms.combiners_test.LatestTest) ... ok test_per_key_empty (apache_beam.transforms.combiners_test.LatestTest) ... ok test_create_source_dynamic_splitting (apache_beam.transforms.create_test.CreateTest) ... ok test_create_source_progress (apache_beam.transforms.create_test.CreateTest) ... ok test_create_source_read (apache_beam.transforms.create_test.CreateTest) ... ok test_create_source_read_reentrant (apache_beam.transforms.create_test.CreateTest) ... ok test_create_source_read_reentrant_with_initial_splits (apache_beam.transforms.create_test.CreateTest) ... ok test_create_source_read_with_initial_splits (apache_beam.transforms.create_test.CreateTest) ... ok test_create_transform (apache_beam.transforms.create_test.CreateTest) ... ok test_add_input (apache_beam.transforms.dataflow_distribution_counter_test.DataflowDistributionAccumulatorTest) ... ok test_calculate_bucket_index_with_input_0 (apache_beam.transforms.dataflow_distribution_counter_test.DataflowDistributionAccumulatorTest) ... ok test_calculate_bucket_index_within_max_long (apache_beam.transforms.dataflow_distribution_counter_test.DataflowDistributionAccumulatorTest) ... ok test_translate_to_histogram_with_input_0 (apache_beam.transforms.dataflow_distribution_counter_test.DataflowDistributionAccumulatorTest) ... ok test_translate_to_histogram_with_max_input (apache_beam.transforms.dataflow_distribution_counter_test.DataflowDistributionAccumulatorTest) ... ok Tests basic display data cases (key:value, key:dict) ... ok test_create_list_display_data (apache_beam.transforms.display_test.DisplayDataTest) ... ok test_display_data_item_matcher (apache_beam.transforms.display_test.DisplayDataTest) ... ok test_drop_if_none (apache_beam.transforms.display_test.DisplayDataTest) ... ok test_inheritance_dofn (apache_beam.transforms.display_test.DisplayDataTest) ... ok test_inheritance_ptransform (apache_beam.transforms.display_test.DisplayDataTest) ... ok test_subcomponent (apache_beam.transforms.display_test.DisplayDataTest) ... ok test_unicode_type_display_data (apache_beam.transforms.display_test.DisplayDataTest) ... ok test_unsupported_type_display_data (apache_beam.transforms.display_test.DisplayDataTest) ... ok test_value_provider_display_data (apache_beam.transforms.display_test.DisplayDataTest) ... ok test_dofn_lifecycle (apache_beam.transforms.dofn_lifecycle_test.DoFnLifecycleTest) ... ok test_java_expansion_dataflow (apache_beam.transforms.external_test.ExternalTransformTest) ... SKIP: GCP dependencies are not installed test_java_expansion_portable_runner (apache_beam.transforms.external_test.ExternalTransformTest) ... SKIP: No expansion service jar provided. test_multi (apache_beam.transforms.external_test.ExternalTransformTest) ... ok test_nested (apache_beam.transforms.external_test.ExternalTransformTest) ... ok test_payload (apache_beam.transforms.external_test.ExternalTransformTest) ... ok test_pipeline_generation (apache_beam.transforms.external_test.ExternalTransformTest) ... ok test_simple (apache_beam.transforms.external_test.ExternalTransformTest) ... ok test_job_python_from_python_it (apache_beam.transforms.external_test_it.ExternalTransformIT) ... SKIP: IT is skipped because --test-pipeline-options is not specified test_apply_custom_transform_with_label (apache_beam.transforms.ptransform_test.PTransformLabelsTest) ... ok test_apply_custom_transform_without_label (apache_beam.transforms.ptransform_test.PTransformLabelsTest) ... ok test_apply_ptransform_using_decorator (apache_beam.transforms.ptransform_test.PTransformLabelsTest) ... ok Tests that chaining gets proper nesting. ... ok test_combine_with_label (apache_beam.transforms.ptransform_test.PTransformLabelsTest) ... ok test_combine_without_label (apache_beam.transforms.ptransform_test.PTransformLabelsTest) ... ok test_default_labels (apache_beam.transforms.ptransform_test.PTransformLabelsTest) ... ok test_label_propogation (apache_beam.transforms.ptransform_test.PTransformLabelsTest) ... ok test_apply_to_crazy_pvaluish (apache_beam.transforms.ptransform_test.PTransformTest) ... ok test_apply_to_list (apache_beam.transforms.ptransform_test.PTransformTest) ... ok test_chained_ptransforms (apache_beam.transforms.ptransform_test.PTransformTest) ... ok test_co_group_by_key_on_dict (apache_beam.transforms.ptransform_test.PTransformTest) ... ok test_co_group_by_key_on_iterable (apache_beam.transforms.ptransform_test.PTransformTest) ... ok test_co_group_by_key_on_list (apache_beam.transforms.ptransform_test.PTransformTest) ... ok test_combine_per_key_with_callable (apache_beam.transforms.ptransform_test.PTransformTest) ... ok test_combine_per_key_with_combine_fn (apache_beam.transforms.ptransform_test.PTransformTest) ... ok test_combine_per_key_with_side_input_as_arg (apache_beam.transforms.ptransform_test.PTransformTest) ... ok test_combine_with_callable (apache_beam.transforms.ptransform_test.PTransformTest) ... ok test_combine_with_combine_fn (apache_beam.transforms.ptransform_test.PTransformTest) ... ok test_combine_with_side_input_as_arg (apache_beam.transforms.ptransform_test.PTransformTest) ... ok test_distinct (apache_beam.transforms.ptransform_test.PTransformTest) ... ok test_do_fn_with_finish (apache_beam.transforms.ptransform_test.PTransformTest) ... ok test_do_fn_with_start (apache_beam.transforms.ptransform_test.PTransformTest) ... ok test_do_fn_with_start_error (apache_beam.transforms.ptransform_test.PTransformTest) ... ok test_do_requires_do_fn_returning_iterable (apache_beam.transforms.ptransform_test.PTransformTest) ... ok test_do_with_callable (apache_beam.transforms.ptransform_test.PTransformTest) ... ok test_do_with_do_fn (apache_beam.transforms.ptransform_test.PTransformTest) ... ok test_do_with_do_fn_returning_dict_raises_warning (apache_beam.transforms.ptransform_test.PTransformTest) ... ok test_do_with_do_fn_returning_string_raises_warning (apache_beam.transforms.ptransform_test.PTransformTest) ... ok test_do_with_multiple_outputs_maintains_unique_name (apache_beam.transforms.ptransform_test.PTransformTest) ... ok test_do_with_side_input_as_arg (apache_beam.transforms.ptransform_test.PTransformTest) ... ok test_do_with_side_input_as_keyword_arg (apache_beam.transforms.ptransform_test.PTransformTest) ... ok test_do_with_unconstructed_do_fn (apache_beam.transforms.ptransform_test.PTransformTest) ... ok test_filter (apache_beam.transforms.ptransform_test.PTransformTest) ... ok test_flatten_input_type_must_be_iterable (apache_beam.transforms.ptransform_test.PTransformTest) ... ok test_flatten_input_type_must_be_iterable_of_pcolls (apache_beam.transforms.ptransform_test.PTransformTest) ... ok test_flatten_multiple_pcollections_having_multiple_consumers (apache_beam.transforms.ptransform_test.PTransformTest) ... ok test_flatten_no_pcollections (apache_beam.transforms.ptransform_test.PTransformTest) ... ok test_flatten_pcollections (apache_beam.transforms.ptransform_test.PTransformTest) ... ok test_flatten_pcollections_in_iterable (apache_beam.transforms.ptransform_test.PTransformTest) ... ok test_flatten_same_pcollections (apache_beam.transforms.ptransform_test.PTransformTest) ... ok test_group_by_key (apache_beam.transforms.ptransform_test.PTransformTest) ... ok test_group_by_key_input_must_be_kv_pairs (apache_beam.transforms.ptransform_test.PTransformTest) ... ok test_group_by_key_only_input_must_be_kv_pairs (apache_beam.transforms.ptransform_test.PTransformTest) ... ok test_keys_and_values (apache_beam.transforms.ptransform_test.PTransformTest) ... ok test_kv_swap (apache_beam.transforms.ptransform_test.PTransformTest) ... ok test_multi_input_ptransform (apache_beam.transforms.ptransform_test.PTransformTest) ... ok test_multiple_empty_outputs (apache_beam.transforms.ptransform_test.PTransformTest) ... ok test_named_tuple (apache_beam.transforms.ptransform_test.PTransformTest) ... ok test_par_do_with_multiple_outputs_and_using_return (apache_beam.transforms.ptransform_test.PTransformTest) ... ok test_par_do_with_multiple_outputs_and_using_yield (apache_beam.transforms.ptransform_test.PTransformTest) ... ok Regression test for an issue with how partitions are handled. ... ok test_partition_with_callable (apache_beam.transforms.ptransform_test.PTransformTest) ... ok test_partition_with_partition_fn (apache_beam.transforms.ptransform_test.PTransformTest) ... ok test_read_metrics (apache_beam.transforms.ptransform_test.PTransformTest) ... ok test_remove_duplicates (apache_beam.transforms.ptransform_test.PTransformTest) ... <https://builds.apache.org/job/beam_sonarqube_report/ws/src/sdks/python/build/srcs/sdks/python/apache_beam/transforms/ptransform_test.py>:664: BeamDeprecationWarning: RemoveDuplicates is deprecated since 2.12. Use Distinct instead. result = pcoll.apply(beam.RemoveDuplicates()) ok test_str (apache_beam.transforms.ptransform_test.PTransformTest) ... scripts/run_tox.sh: line 52: 10516 Terminated tox -c tox.ini --recreate -e $1 --installpkg $2 ok > Task :sdks:python:testPy2Cython FAILED > Task :vendor:bytebuddy-1_9_3:compileJava NO-SOURCE > Task :vendor:bytebuddy-1_9_3:processResources NO-SOURCE > Task :vendor:bytebuddy-1_9_3:classes UP-TO-DATE > Task :vendor:bytebuddy-1_9_3:compileTestJava NO-SOURCE > Task :vendor:bytebuddy-1_9_3:processTestResources NO-SOURCE > Task :vendor:bytebuddy-1_9_3:testClasses UP-TO-DATE > Task :vendor:bytebuddy-1_9_3:test NO-SOURCE > Task :vendor:grpc-1_21_0:compileJava NO-SOURCE > Task :vendor:grpc-1_21_0:processResources NO-SOURCE > Task :vendor:grpc-1_21_0:classes UP-TO-DATE > Task :vendor:grpc-1_21_0:compileTestJava NO-SOURCE > Task :vendor:grpc-1_21_0:processTestResources NO-SOURCE > Task :vendor:grpc-1_21_0:testClasses UP-TO-DATE > Task :vendor:grpc-1_21_0:test NO-SOURCE > Task :vendor:guava-26_0-jre:compileJava NO-SOURCE > Task :vendor:guava-26_0-jre:processResources NO-SOURCE > Task :vendor:guava-26_0-jre:classes UP-TO-DATE > Task :vendor:guava-26_0-jre:compileTestJava NO-SOURCE > Task :vendor:guava-26_0-jre:processTestResources NO-SOURCE > Task :vendor:guava-26_0-jre:testClasses UP-TO-DATE > Task :vendor:guava-26_0-jre:test NO-SOURCE > Task :vendor:sdks-java-extensions-protobuf:compileTestJava NO-SOURCE > Task :vendor:sdks-java-extensions-protobuf:processTestResources NO-SOURCE > Task :vendor:sdks-java-extensions-protobuf:testClasses UP-TO-DATE > Task :vendor:sdks-java-extensions-protobuf:test NO-SOURCE The message received from the daemon indicates that the daemon has disappeared. Build request sent: Build{id=664b3fdc-d1d4-41a9-b3ff-4744c1474067, currentDir=<https://builds.apache.org/job/beam_sonarqube_report/ws/src}> Attempting to read last messages from the daemon log... Daemon pid: 1766 log file: /home/jenkins/.gradle/daemon/5.2.1/daemon-1766.out.log ----- Last 20 lines from daemon log file - daemon-1766.out.log ----- at org.gradle.process.internal.DefaultExecHandle.execExceptionFor(DefaultExecHandle.java:232) at org.gradle.process.internal.DefaultExecHandle.setEndStateInfo(DefaultExecHandle.java:209) at org.gradle.process.internal.DefaultExecHandle.failed(DefaultExecHandle.java:356) at org.gradle.process.internal.ExecHandleRunner.run(ExecHandleRunner.java:86) at org.gradle.internal.operations.CurrentBuildOperationPreservingRunnable.run(CurrentBuildOperationPreservingRunnable.java:42) at org.gradle.internal.concurrent.ExecutorPolicy$CatchAndRecordFailures.onExecute(ExecutorPolicy.java:63) at org.gradle.internal.concurrent.ManagedExecutorImpl$1.run(ManagedExecutorImpl.java:46) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at org.gradle.internal.concurrent.ThreadFactoryImpl$ManagedThreadRunnable.run(ThreadFactoryImpl.java:55) at java.lang.Thread.run(Thread.java:748) Caused by: java.lang.IllegalStateException: Shutdown in progress at java.lang.ApplicationShutdownHooks.remove(ApplicationShutdownHooks.java:82) at java.lang.Runtime.removeShutdownHook(Runtime.java:239) at org.gradle.process.internal.shutdown.ShutdownHooks.removeShutdownHook(ShutdownHooks.java:33) at org.gradle.process.internal.DefaultExecHandle.setEndStateInfo(DefaultExecHandle.java:199) at org.gradle.process.internal.DefaultExecHandle.aborted(DefaultExecHandle.java:352) at org.gradle.process.internal.ExecHandleRunner.completed(ExecHandleRunner.java:107) at org.gradle.process.internal.ExecHandleRunner.run(ExecHandleRunner.java:83) ... 7 more ----- End of the daemon log ----- FAILURE: Build failed with an exception. * What went wrong: Gradle build daemon disappeared unexpectedly (it may have been killed or may have crashed) * Try: Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights. * Get more help at https://help.gradle.org > Task :runners:extensions-java:metrics:compileJava Build step 'Invoke Gradle script' changed build result to FAILURE Build step 'Invoke Gradle script' marked build as failure WARN: Unable to locate 'report-task.txt' in the workspace. Did the SonarScanner succeeded? --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
