See <https://builds.apache.org/job/beam_PostCommit_XVR_Spark/598/display/redirect?page=changes>
Changes: [github] add missing bracket [boyuanz] [BEAM-9562, BEAM-6274] Fix-up timers to use Elements.Timer proto in data [robertwb] Allow unset write threshold for state backed iterable coder. [github] [BEAM-9727] Automatically set required experiment flags for dataflow [github] Update environments.py to add a method to specify container image ------------------------------------------ [...truncated 574.74 KB...] File "<https://builds.apache.org/job/beam_PostCommit_XVR_Spark/ws/src/sdks/python/apache_beam/transforms/validate_runner_xlang_test.py";,> line 104, in run_combine_globally TEST_COMGL_URN, None, self.expansion_service)) File "<https://builds.apache.org/job/beam_PostCommit_XVR_Spark/ws/src/sdks/python/apache_beam/pvalue.py";,> line 140, in __or__ return self.pipeline.apply(ptransform, self) File "<https://builds.apache.org/job/beam_PostCommit_XVR_Spark/ws/src/sdks/python/apache_beam/pipeline.py";,> line 634, in apply pvalueish_result = self.runner.apply(transform, pvalueish, self._options) File "<https://builds.apache.org/job/beam_PostCommit_XVR_Spark/ws/src/sdks/python/apache_beam/runners/runner.py";,> line 198, in apply return m(transform, input, options) File "<https://builds.apache.org/job/beam_PostCommit_XVR_Spark/ws/src/sdks/python/apache_beam/runners/runner.py";,> line 228, in apply_PTransform return transform.expand(input) File "<https://builds.apache.org/job/beam_PostCommit_XVR_Spark/ws/src/sdks/python/apache_beam/transforms/external.py";,> line 330, in expand raise RuntimeError(response.error) RuntimeError: Traceback (most recent call last): File "<https://builds.apache.org/job/beam_PostCommit_XVR_Spark/ws/src/build/gradleenv/1922375555/local/lib/python2.7/site-packages/apache_beam/runners/portability/expansion_service.py";,> line 58, in Expand _create_environment(self._options), File "<https://builds.apache.org/job/beam_PostCommit_XVR_Spark/ws/src/build/gradleenv/1922375555/local/lib/python2.7/site-packages/apache_beam/runners/portability/portable_runner.py";,> line 282, in _create_environment return env_class.from_options(portable_options) File "<https://builds.apache.org/job/beam_PostCommit_XVR_Spark/ws/src/build/gradleenv/1922375555/local/lib/python2.7/site-packages/apache_beam/transforms/environments.py";,> line 255, in from_options return from_container_image( NameError: global name 'from_container_image' is not defined ====================================================================== ERROR: test_combine_per_key (apache_beam.transforms.validate_runner_xlang_test.ValidateRunnerXlangTest) ---------------------------------------------------------------------- Traceback (most recent call last): File "<https://builds.apache.org/job/beam_PostCommit_XVR_Spark/ws/src/sdks/python/apache_beam/transforms/validate_runner_xlang_test.py";,> line 200, in test_combine_per_key CrossLanguageTestPipelines().run_combine_per_key(test_pipeline) File "<https://builds.apache.org/job/beam_PostCommit_XVR_Spark/ws/src/sdks/python/apache_beam/transforms/validate_runner_xlang_test.py";,> line 114, in run_combine_per_key TEST_COMPK_URN, None, self.expansion_service)) File "<https://builds.apache.org/job/beam_PostCommit_XVR_Spark/ws/src/sdks/python/apache_beam/pvalue.py";,> line 140, in __or__ return self.pipeline.apply(ptransform, self) File "<https://builds.apache.org/job/beam_PostCommit_XVR_Spark/ws/src/sdks/python/apache_beam/pipeline.py";,> line 634, in apply pvalueish_result = self.runner.apply(transform, pvalueish, self._options) File "<https://builds.apache.org/job/beam_PostCommit_XVR_Spark/ws/src/sdks/python/apache_beam/runners/runner.py";,> line 198, in apply return m(transform, input, options) File "<https://builds.apache.org/job/beam_PostCommit_XVR_Spark/ws/src/sdks/python/apache_beam/runners/runner.py";,> line 228, in apply_PTransform return transform.expand(input) File "<https://builds.apache.org/job/beam_PostCommit_XVR_Spark/ws/src/sdks/python/apache_beam/transforms/external.py";,> line 330, in expand raise RuntimeError(response.error) RuntimeError: Traceback (most recent call last): File "<https://builds.apache.org/job/beam_PostCommit_XVR_Spark/ws/src/build/gradleenv/1922375555/local/lib/python2.7/site-packages/apache_beam/runners/portability/expansion_service.py";,> line 58, in Expand _create_environment(self._options), File "<https://builds.apache.org/job/beam_PostCommit_XVR_Spark/ws/src/build/gradleenv/1922375555/local/lib/python2.7/site-packages/apache_beam/runners/portability/portable_runner.py";,> line 282, in _create_environment return env_class.from_options(portable_options) File "<https://builds.apache.org/job/beam_PostCommit_XVR_Spark/ws/src/build/gradleenv/1922375555/local/lib/python2.7/site-packages/apache_beam/transforms/environments.py";,> line 255, in from_options return from_container_image( NameError: global name 'from_container_image' is not defined ====================================================================== ERROR: test_flatten (apache_beam.transforms.validate_runner_xlang_test.ValidateRunnerXlangTest) ---------------------------------------------------------------------- Traceback (most recent call last): File "<https://builds.apache.org/job/beam_PostCommit_XVR_Spark/ws/src/sdks/python/apache_beam/transforms/validate_runner_xlang_test.py";,> line 209, in test_flatten CrossLanguageTestPipelines().run_flatten(test_pipeline) File "<https://builds.apache.org/job/beam_PostCommit_XVR_Spark/ws/src/sdks/python/apache_beam/transforms/validate_runner_xlang_test.py";,> line 123, in run_flatten TEST_FLATTEN_URN, None, self.expansion_service)) File "<https://builds.apache.org/job/beam_PostCommit_XVR_Spark/ws/src/sdks/python/apache_beam/transforms/ptransform.py";,> line 562, in __ror__ result = p.apply(self, pvalueish, label) File "<https://builds.apache.org/job/beam_PostCommit_XVR_Spark/ws/src/sdks/python/apache_beam/pipeline.py";,> line 634, in apply pvalueish_result = self.runner.apply(transform, pvalueish, self._options) File "<https://builds.apache.org/job/beam_PostCommit_XVR_Spark/ws/src/sdks/python/apache_beam/runners/runner.py";,> line 198, in apply return m(transform, input, options) File "<https://builds.apache.org/job/beam_PostCommit_XVR_Spark/ws/src/sdks/python/apache_beam/runners/runner.py";,> line 228, in apply_PTransform return transform.expand(input) File "<https://builds.apache.org/job/beam_PostCommit_XVR_Spark/ws/src/sdks/python/apache_beam/transforms/external.py";,> line 330, in expand raise RuntimeError(response.error) RuntimeError: Traceback (most recent call last): File "<https://builds.apache.org/job/beam_PostCommit_XVR_Spark/ws/src/build/gradleenv/1922375555/local/lib/python2.7/site-packages/apache_beam/runners/portability/expansion_service.py";,> line 58, in Expand _create_environment(self._options), File "<https://builds.apache.org/job/beam_PostCommit_XVR_Spark/ws/src/build/gradleenv/1922375555/local/lib/python2.7/site-packages/apache_beam/runners/portability/portable_runner.py";,> line 282, in _create_environment return env_class.from_options(portable_options) File "<https://builds.apache.org/job/beam_PostCommit_XVR_Spark/ws/src/build/gradleenv/1922375555/local/lib/python2.7/site-packages/apache_beam/transforms/environments.py";,> line 255, in from_options return from_container_image( NameError: global name 'from_container_image' is not defined ====================================================================== ERROR: test_group_by_key (apache_beam.transforms.validate_runner_xlang_test.ValidateRunnerXlangTest) ---------------------------------------------------------------------- Traceback (most recent call last): File "<https://builds.apache.org/job/beam_PostCommit_XVR_Spark/ws/src/sdks/python/apache_beam/transforms/validate_runner_xlang_test.py";,> line 173, in test_group_by_key CrossLanguageTestPipelines().run_group_by_key(test_pipeline) File "<https://builds.apache.org/job/beam_PostCommit_XVR_Spark/ws/src/sdks/python/apache_beam/transforms/validate_runner_xlang_test.py";,> line 81, in run_group_by_key | beam.Map(lambda x: "{}:{}".format(x[0], ','.join(sorted(x[1]))))) File "<https://builds.apache.org/job/beam_PostCommit_XVR_Spark/ws/src/sdks/python/apache_beam/pvalue.py";,> line 140, in __or__ return self.pipeline.apply(ptransform, self) File "<https://builds.apache.org/job/beam_PostCommit_XVR_Spark/ws/src/sdks/python/apache_beam/pipeline.py";,> line 634, in apply pvalueish_result = self.runner.apply(transform, pvalueish, self._options) File "<https://builds.apache.org/job/beam_PostCommit_XVR_Spark/ws/src/sdks/python/apache_beam/runners/runner.py";,> line 198, in apply return m(transform, input, options) File "<https://builds.apache.org/job/beam_PostCommit_XVR_Spark/ws/src/sdks/python/apache_beam/runners/runner.py";,> line 228, in apply_PTransform return transform.expand(input) File "<https://builds.apache.org/job/beam_PostCommit_XVR_Spark/ws/src/sdks/python/apache_beam/transforms/external.py";,> line 330, in expand raise RuntimeError(response.error) RuntimeError: Traceback (most recent call last): File "<https://builds.apache.org/job/beam_PostCommit_XVR_Spark/ws/src/build/gradleenv/1922375555/local/lib/python2.7/site-packages/apache_beam/runners/portability/expansion_service.py";,> line 58, in Expand _create_environment(self._options), File "<https://builds.apache.org/job/beam_PostCommit_XVR_Spark/ws/src/build/gradleenv/1922375555/local/lib/python2.7/site-packages/apache_beam/runners/portability/portable_runner.py";,> line 282, in _create_environment return env_class.from_options(portable_options) File "<https://builds.apache.org/job/beam_PostCommit_XVR_Spark/ws/src/build/gradleenv/1922375555/local/lib/python2.7/site-packages/apache_beam/transforms/environments.py";,> line 255, in from_options return from_container_image( NameError: global name 'from_container_image' is not defined ====================================================================== ERROR: test_multi_input_output_with_sideinput (apache_beam.transforms.validate_runner_xlang_test.ValidateRunnerXlangTest) ---------------------------------------------------------------------- Traceback (most recent call last): File "<https://builds.apache.org/job/beam_PostCommit_XVR_Spark/ws/src/sdks/python/apache_beam/transforms/validate_runner_xlang_test.py";,> line 164, in test_multi_input_output_with_sideinput test_pipeline) File "<https://builds.apache.org/job/beam_PostCommit_XVR_Spark/ws/src/sdks/python/apache_beam/transforms/validate_runner_xlang_test.py";,> line 69, in run_multi_input_output_with_sideinput TEST_MULTI_URN, None, self.expansion_service) File "<https://builds.apache.org/job/beam_PostCommit_XVR_Spark/ws/src/sdks/python/apache_beam/transforms/ptransform.py";,> line 562, in __ror__ result = p.apply(self, pvalueish, label) File "<https://builds.apache.org/job/beam_PostCommit_XVR_Spark/ws/src/sdks/python/apache_beam/pipeline.py";,> line 634, in apply pvalueish_result = self.runner.apply(transform, pvalueish, self._options) File "<https://builds.apache.org/job/beam_PostCommit_XVR_Spark/ws/src/sdks/python/apache_beam/runners/runner.py";,> line 198, in apply return m(transform, input, options) File "<https://builds.apache.org/job/beam_PostCommit_XVR_Spark/ws/src/sdks/python/apache_beam/runners/runner.py";,> line 228, in apply_PTransform return transform.expand(input) File "<https://builds.apache.org/job/beam_PostCommit_XVR_Spark/ws/src/sdks/python/apache_beam/transforms/external.py";,> line 330, in expand raise RuntimeError(response.error) RuntimeError: Traceback (most recent call last): File "<https://builds.apache.org/job/beam_PostCommit_XVR_Spark/ws/src/build/gradleenv/1922375555/local/lib/python2.7/site-packages/apache_beam/runners/portability/expansion_service.py";,> line 58, in Expand _create_environment(self._options), File "<https://builds.apache.org/job/beam_PostCommit_XVR_Spark/ws/src/build/gradleenv/1922375555/local/lib/python2.7/site-packages/apache_beam/runners/portability/portable_runner.py";,> line 282, in _create_environment return env_class.from_options(portable_options) File "<https://builds.apache.org/job/beam_PostCommit_XVR_Spark/ws/src/build/gradleenv/1922375555/local/lib/python2.7/site-packages/apache_beam/transforms/environments.py";,> line 255, in from_options return from_container_image( NameError: global name 'from_container_image' is not defined ====================================================================== ERROR: test_partition (apache_beam.transforms.validate_runner_xlang_test.ValidateRunnerXlangTest) ---------------------------------------------------------------------- Traceback (most recent call last): File "<https://builds.apache.org/job/beam_PostCommit_XVR_Spark/ws/src/sdks/python/apache_beam/transforms/validate_runner_xlang_test.py";,> line 218, in test_partition CrossLanguageTestPipelines().run_partition(test_pipeline) File "<https://builds.apache.org/job/beam_PostCommit_XVR_Spark/ws/src/sdks/python/apache_beam/transforms/validate_runner_xlang_test.py";,> line 132, in run_partition TEST_PARTITION_URN, None, self.expansion_service)) File "<https://builds.apache.org/job/beam_PostCommit_XVR_Spark/ws/src/sdks/python/apache_beam/pvalue.py";,> line 140, in __or__ return self.pipeline.apply(ptransform, self) File "<https://builds.apache.org/job/beam_PostCommit_XVR_Spark/ws/src/sdks/python/apache_beam/pipeline.py";,> line 634, in apply pvalueish_result = self.runner.apply(transform, pvalueish, self._options) File "<https://builds.apache.org/job/beam_PostCommit_XVR_Spark/ws/src/sdks/python/apache_beam/runners/runner.py";,> line 198, in apply return m(transform, input, options) File "<https://builds.apache.org/job/beam_PostCommit_XVR_Spark/ws/src/sdks/python/apache_beam/runners/runner.py";,> line 228, in apply_PTransform return transform.expand(input) File "<https://builds.apache.org/job/beam_PostCommit_XVR_Spark/ws/src/sdks/python/apache_beam/transforms/external.py";,> line 330, in expand raise RuntimeError(response.error) RuntimeError: Traceback (most recent call last): File "<https://builds.apache.org/job/beam_PostCommit_XVR_Spark/ws/src/build/gradleenv/1922375555/local/lib/python2.7/site-packages/apache_beam/runners/portability/expansion_service.py";,> line 58, in Expand _create_environment(self._options), File "<https://builds.apache.org/job/beam_PostCommit_XVR_Spark/ws/src/build/gradleenv/1922375555/local/lib/python2.7/site-packages/apache_beam/runners/portability/portable_runner.py";,> line 282, in _create_environment return env_class.from_options(portable_options) File "<https://builds.apache.org/job/beam_PostCommit_XVR_Spark/ws/src/build/gradleenv/1922375555/local/lib/python2.7/site-packages/apache_beam/transforms/environments.py";,> line 255, in from_options return from_container_image( NameError: global name 'from_container_image' is not defined ====================================================================== ERROR: test_prefix (apache_beam.transforms.validate_runner_xlang_test.ValidateRunnerXlangTest) ---------------------------------------------------------------------- Traceback (most recent call last): File "<https://builds.apache.org/job/beam_PostCommit_XVR_Spark/ws/src/sdks/python/apache_beam/transforms/validate_runner_xlang_test.py";,> line 154, in test_prefix CrossLanguageTestPipelines().run_prefix(test_pipeline) File "<https://builds.apache.org/job/beam_PostCommit_XVR_Spark/ws/src/sdks/python/apache_beam/transforms/validate_runner_xlang_test.py";,> line 57, in run_prefix self.expansion_service)) File "<https://builds.apache.org/job/beam_PostCommit_XVR_Spark/ws/src/sdks/python/apache_beam/pvalue.py";,> line 140, in __or__ return self.pipeline.apply(ptransform, self) File "<https://builds.apache.org/job/beam_PostCommit_XVR_Spark/ws/src/sdks/python/apache_beam/pipeline.py";,> line 634, in apply pvalueish_result = self.runner.apply(transform, pvalueish, self._options) File "<https://builds.apache.org/job/beam_PostCommit_XVR_Spark/ws/src/sdks/python/apache_beam/runners/runner.py";,> line 198, in apply return m(transform, input, options) File "<https://builds.apache.org/job/beam_PostCommit_XVR_Spark/ws/src/sdks/python/apache_beam/runners/runner.py";,> line 228, in apply_PTransform return transform.expand(input) File "<https://builds.apache.org/job/beam_PostCommit_XVR_Spark/ws/src/sdks/python/apache_beam/transforms/external.py";,> line 330, in expand raise RuntimeError(response.error) RuntimeError: Traceback (most recent call last): File "<https://builds.apache.org/job/beam_PostCommit_XVR_Spark/ws/src/build/gradleenv/1922375555/local/lib/python2.7/site-packages/apache_beam/runners/portability/expansion_service.py";,> line 58, in Expand _create_environment(self._options), File "<https://builds.apache.org/job/beam_PostCommit_XVR_Spark/ws/src/build/gradleenv/1922375555/local/lib/python2.7/site-packages/apache_beam/runners/portability/portable_runner.py";,> line 282, in _create_environment return env_class.from_options(portable_options) File "<https://builds.apache.org/job/beam_PostCommit_XVR_Spark/ws/src/build/gradleenv/1922375555/local/lib/python2.7/site-packages/apache_beam/transforms/environments.py";,> line 255, in from_options return from_container_image( NameError: global name 'from_container_image' is not defined ---------------------------------------------------------------------- XML: nosetests-xlangValidateRunner.xml ---------------------------------------------------------------------- XML: <https://builds.apache.org/job/beam_PostCommit_XVR_Spark/ws/src/sdks/python/nosetests.xml> ---------------------------------------------------------------------- Ran 10 tests in 5.166s FAILED (errors=10) > Task :runners:spark:job-server:validatesCrossLanguageRunnerPythonUsingPython > FAILED > Task :runners:spark:job-server:validatesCrossLanguageRunnerCleanup > Task :runners:spark:job-server:sparkJobServerCleanup FAILURE: Build completed with 3 failures. 1: Task failed with an exception. ----------- * What went wrong: Execution failed for task ':runners:spark:job-server:validatesCrossLanguageRunnerJavaUsingPython'. > There were failing tests. See the report at: > file://<https://builds.apache.org/job/beam_PostCommit_XVR_Spark/ws/src/runners/spark/job-server/build/reports/tests/validatesCrossLanguageRunnerJavaUsingPython/index.html> * Try: Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights. ============================================================================== 2: Task failed with an exception. ----------- * What went wrong: Execution failed for task ':runners:spark:job-server:validatesCrossLanguageRunnerPythonUsingJava'. > Process 'command 'sh'' finished with non-zero exit value 1 * Try: Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights. ============================================================================== 3: Task failed with an exception. ----------- * What went wrong: Execution failed for task ':runners:spark:job-server:validatesCrossLanguageRunnerPythonUsingPython'. > Process 'command 'sh'' finished with non-zero exit value 1 * Try: Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights. ============================================================================== * Get more help at https://help.gradle.org Deprecated Gradle features were used in this build, making it incompatible with Gradle 6.0. Use '--warning-mode all' to show the individual deprecation warnings. See https://docs.gradle.org/5.2.1/userguide/command_line_interface.html#sec:command_line_warnings BUILD FAILED in 23m 55s 105 actionable tasks: 80 executed, 23 from cache, 2 up-to-date Publishing build scan... https://gradle.com/s/5laubu52nomz6 Build step 'Invoke Gradle script' changed build result to FAILURE Build step 'Invoke Gradle script' marked build as failure --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
