See <https://builds.apache.org/job/beam_PostCommit_Py_VR_Dataflow/1734/display/redirect>
------------------------------------------ [...truncated 297.85 KB...] ], "type": "JOB_TYPE_BATCH" } root: INFO: Create job: <Job createTime: u'2018-11-15T06:01:14.444501Z' currentStateTime: u'1970-01-01T00:00:00Z' id: u'2018-11-14_22_01_13-4155478926902841098' location: u'us-central1' name: u'beamapp-jenkins-1115060100-814783' projectId: u'apache-beam-testing' stageStates: [] steps: [] tempFiles: [] type: TypeValueValuesEnum(JOB_TYPE_BATCH, 1)> root: INFO: Created job with id: [2018-11-14_22_01_13-4155478926902841098] root: INFO: To access the Dataflow monitoring console, please navigate to https://console.cloud.google.com/dataflow/jobsDetail/locations/us-central1/jobs/2018-11-14_22_01_13-4155478926902841098?project=apache-beam-testing root: INFO: Job 2018-11-14_22_01_13-4155478926902841098 is in state JOB_STATE_RUNNING root: INFO: 2018-11-15T06:01:13.642Z: JOB_MESSAGE_DETAILED: Autoscaling is enabled for job 2018-11-14_22_01_13-4155478926902841098. The number of workers will be between 1 and 1000. root: INFO: 2018-11-15T06:01:13.689Z: JOB_MESSAGE_DETAILED: Autoscaling was automatically enabled for job 2018-11-14_22_01_13-4155478926902841098. root: INFO: 2018-11-15T06:01:18.138Z: JOB_MESSAGE_DETAILED: Checking permissions granted to controller Service Account. root: INFO: 2018-11-15T06:01:19.733Z: JOB_MESSAGE_BASIC: Worker configuration: n1-standard-1 in us-central1-b. root: INFO: 2018-11-15T06:01:20.384Z: JOB_MESSAGE_DETAILED: Expanding CoGroupByKey operations into optimizable parts. root: INFO: 2018-11-15T06:01:20.434Z: JOB_MESSAGE_DETAILED: Expanding GroupByKey operations into optimizable parts. root: INFO: 2018-11-15T06:01:20.484Z: JOB_MESSAGE_DETAILED: Lifting ValueCombiningMappingFns into MergeBucketsMappingFns root: INFO: 2018-11-15T06:01:20.526Z: JOB_MESSAGE_DEBUG: Annotating graph with Autotuner information. root: INFO: 2018-11-15T06:01:20.595Z: JOB_MESSAGE_DETAILED: Fusing adjacent ParDo, Read, Write, and Flatten operations root: INFO: 2018-11-15T06:01:20.644Z: JOB_MESSAGE_DETAILED: Fusing consumer ParDo(CounterDoFn) into Read root: INFO: 2018-11-15T06:01:20.694Z: JOB_MESSAGE_DEBUG: Workflow config is missing a default resource spec. root: INFO: 2018-11-15T06:01:20.750Z: JOB_MESSAGE_DEBUG: Adding StepResource setup and teardown to workflow graph. root: INFO: 2018-11-15T06:01:20.791Z: JOB_MESSAGE_DEBUG: Adding workflow start and stop steps. root: INFO: 2018-11-15T06:01:20.838Z: JOB_MESSAGE_DEBUG: Assigning stage ids. root: INFO: 2018-11-15T06:01:21.090Z: JOB_MESSAGE_DEBUG: Executing wait step start3 root: INFO: 2018-11-15T06:01:21.233Z: JOB_MESSAGE_BASIC: Executing operation Read+ParDo(CounterDoFn) root: INFO: 2018-11-15T06:01:21.295Z: JOB_MESSAGE_DEBUG: Starting worker pool setup. root: INFO: 2018-11-15T06:01:21.345Z: JOB_MESSAGE_BASIC: Starting 1 workers in us-central1-b... root: INFO: 2018-11-15T06:01:43.064Z: JOB_MESSAGE_DETAILED: Autoscaling: Raised the number of workers to 0 based on the rate of progress in the currently running step(s). root: INFO: 2018-11-15T06:02:29.357Z: JOB_MESSAGE_DETAILED: Autoscaling: Raised the number of workers to 1 based on the rate of progress in the currently running step(s). root: INFO: 2018-11-15T06:04:17.224Z: JOB_MESSAGE_DETAILED: Workers have started successfully. root: INFO: 2018-11-15T06:04:17.279Z: JOB_MESSAGE_DETAILED: Workers have started successfully. oauth2client.transport: INFO: Refreshing due to a 401 (attempt 1/2) root: INFO: 2018-11-15T07:01:21.156Z: JOB_MESSAGE_ERROR: Workflow failed. Causes: The Dataflow job appears to be stuck because no worker activity has been seen in the last 1h. You can get help with Cloud Dataflow at https://cloud.google.com/dataflow/support. root: INFO: 2018-11-15T07:01:21.307Z: JOB_MESSAGE_BASIC: Cancel request is committed for workflow job: 2018-11-14_22_01_13-4155478926902841098. root: INFO: 2018-11-15T07:01:21.398Z: JOB_MESSAGE_DETAILED: Cleaning up. root: INFO: 2018-11-15T07:01:21.475Z: JOB_MESSAGE_DEBUG: Starting worker pool teardown. root: INFO: 2018-11-15T07:01:21.509Z: JOB_MESSAGE_BASIC: Stopping worker pool... root: INFO: 2018-11-15T07:03:43.389Z: JOB_MESSAGE_DETAILED: Autoscaling: Reduced the number of workers to 0 based on the rate of progress in the currently running step(s). root: INFO: 2018-11-15T07:03:43.640Z: JOB_MESSAGE_BASIC: Worker pool stopped. root: INFO: 2018-11-15T07:03:43.767Z: JOB_MESSAGE_DEBUG: Tearing down pending resources... root: INFO: Job 2018-11-14_22_01_13-4155478926902841098 is in state JOB_STATE_FAILED --------------------- >> end captured logging << --------------------- ---------------------------------------------------------------------- XML: <https://builds.apache.org/job/beam_PostCommit_Py_VR_Dataflow/ws/src/sdks/python/nosetests.xml> ---------------------------------------------------------------------- Ran 16 tests in 3775.961s FAILED (errors=1) Found: https://console.cloud.google.com/dataflow/jobsDetail/locations/us-central1/jobs/2018-11-14_22_01_13-4155478926902841098?project=apache-beam-testing. Found: https://console.cloud.google.com/dataflow/jobsDetail/locations/us-central1/jobs/2018-11-14_22_01_14-5683236171450396203?project=apache-beam-testing. Found: https://console.cloud.google.com/dataflow/jobsDetail/locations/us-central1/jobs/2018-11-14_22_08_46-18249184356952962429?project=apache-beam-testing. Found: https://console.cloud.google.com/dataflow/jobsDetail/locations/us-central1/jobs/2018-11-14_22_01_14-13684210300919421152?project=apache-beam-testing. Found: https://console.cloud.google.com/dataflow/jobsDetail/locations/us-central1/jobs/2018-11-14_22_09_15-2224819298770804589?project=apache-beam-testing. Found: https://console.cloud.google.com/dataflow/jobsDetail/locations/us-central1/jobs/2018-11-14_22_01_14-17550803002788947334?project=apache-beam-testing. Found: https://console.cloud.google.com/dataflow/jobsDetail/locations/us-central1/jobs/2018-11-14_22_08_11-10165183477606178799?project=apache-beam-testing. Found: https://console.cloud.google.com/dataflow/jobsDetail/locations/us-central1/jobs/2018-11-14_22_14_12-16341028848112643520?project=apache-beam-testing. Found: https://console.cloud.google.com/dataflow/jobsDetail/locations/us-central1/jobs/2018-11-14_22_01_14-11835839705717330925?project=apache-beam-testing. Found: https://console.cloud.google.com/dataflow/jobsDetail/locations/us-central1/jobs/2018-11-14_22_08_11-17327067436279067380?project=apache-beam-testing. Found: https://console.cloud.google.com/dataflow/jobsDetail/locations/us-central1/jobs/2018-11-14_22_01_15-6160145572903101072?project=apache-beam-testing. Found: https://console.cloud.google.com/dataflow/jobsDetail/locations/us-central1/jobs/2018-11-14_22_09_06-231176696586666610?project=apache-beam-testing. Found: https://console.cloud.google.com/dataflow/jobsDetail/locations/us-central1/jobs/2018-11-14_22_01_13-5238589497165744469?project=apache-beam-testing. Found: https://console.cloud.google.com/dataflow/jobsDetail/locations/us-central1/jobs/2018-11-14_22_08_06-10364595717804825766?project=apache-beam-testing. Found: https://console.cloud.google.com/dataflow/jobsDetail/locations/us-central1/jobs/2018-11-14_22_01_14-10450245352772976909?project=apache-beam-testing. Found: https://console.cloud.google.com/dataflow/jobsDetail/locations/us-central1/jobs/2018-11-14_22_08_06-18445827882425992210?project=apache-beam-testing. > Task :beam-sdks-python:validatesRunnerBatchTests FAILED :beam-sdks-python:validatesRunnerBatchTests (Thread[Task worker for ':',5,main]) completed. Took 1 hrs 2 mins 57.054 secs. :beam-sdks-python:validatesRunnerStreamingTests (Thread[Task worker for ':',5,main]) started. > Task :beam-sdks-python:validatesRunnerStreamingTests Caching disabled for task ':beam-sdks-python:validatesRunnerStreamingTests': Caching has not been enabled for the task Task ':beam-sdks-python:validatesRunnerStreamingTests' is not up-to-date because: Task has not declared any outputs despite executing actions. Starting process 'command 'sh''. Working directory: <https://builds.apache.org/job/beam_PostCommit_Py_VR_Dataflow/ws/src/sdks/python> Command: sh -c . <https://builds.apache.org/job/beam_PostCommit_Py_VR_Dataflow/ws/src/sdks/python/build/gradleenv/bin/activate> && ./scripts/run_integration_test.sh --test_opts "--nocapture --processes=8 --process-timeout=4500 --attr=ValidatesRunner,!sickbay-streaming" --streaming true --worker_jar <https://builds.apache.org/job/beam_PostCommit_Py_VR_Dataflow/ws/src/runners/google-cloud-dataflow-java/worker/build/libs/beam-runners-google-cloud-dataflow-java-fn-api-worker-2.9.0-SNAPSHOT.jar> Successfully started process 'command 'sh'' ########################################################################### # Build pipeline options if not provided in --pipeline_opts from commandline if [[ -z $PIPELINE_OPTS ]]; then # Check that the script is running in a known directory. if [[ $PWD != *sdks/python* ]]; then echo 'Unable to locate Apache Beam Python SDK root directory' exit 1 fi # Go to the Apache Beam Python SDK root if [[ "*sdks/python" != $PWD ]]; then cd $(pwd | sed 's/sdks\/python.*/sdks\/python/') fi # Create a tarball if not exists if [[ $(find ${SDK_LOCATION}) ]]; then SDK_LOCATION=$(find ${SDK_LOCATION}) else python setup.py -q sdist SDK_LOCATION=$(find dist/apache-beam-*.tar.gz) fi # Install test dependencies for ValidatesRunner tests. echo "pyhamcrest" > postcommit_requirements.txt echo "mock" >> postcommit_requirements.txt # Options used to run testing pipeline on Cloud Dataflow Service. Also used for # running on DirectRunner (some options ignored). opts=( "--runner=$RUNNER" "--project=$PROJECT" "--staging_location=$GCS_LOCATION/staging-it" "--temp_location=$GCS_LOCATION/temp-it" "--output=$GCS_LOCATION/py-it-cloud/output" "--sdk_location=$SDK_LOCATION" "--requirements_file=postcommit_requirements.txt" "--num_workers=$NUM_WORKERS" "--sleep_secs=$SLEEP_SECS" ) # Add --streaming if provided if [[ "$STREAMING" = true ]]; then opts+=("--streaming") fi # Add --dataflow_worker_jar if provided if [[ ! -z "$WORKER_JAR" ]]; then opts+=("--dataflow_worker_jar=$WORKER_JAR") fi PIPELINE_OPTS=$(IFS=" " ; echo "${opts[*]}") fi pwd | sed 's/sdks\/python.*/sdks\/python/' find ${SDK_LOCATION} find ${SDK_LOCATION} IFS=" " ; echo "${opts[*]}" ########################################################################### # Run tests and validate that jobs finish successfully. echo ">>> RUNNING integration tests with pipeline options: $PIPELINE_OPTS" python setup.py nosetests \ --test-pipeline-options="$PIPELINE_OPTS" \ $TEST_OPTS >>> RUNNING integration tests with pipeline options: >>> --runner=TestDataflowRunner --project=apache-beam-testing >>> --staging_location=gs://temp-storage-for-end-to-end-tests/staging-it >>> --temp_location=gs://temp-storage-for-end-to-end-tests/temp-it >>> --output=gs://temp-storage-for-end-to-end-tests/py-it-cloud/output >>> --sdk_location=build/apache-beam.tar.gz >>> --requirements_file=postcommit_requirements.txt --num_workers=1 >>> --sleep_secs=20 --streaming >>> --dataflow_worker_jar=<https://builds.apache.org/job/beam_PostCommit_Py_VR_Dataflow/ws/src/runners/google-cloud-dataflow-java/worker/build/libs/beam-runners-google-cloud-dataflow-java-fn-api-worker-2.9.0-SNAPSHOT.jar> <https://builds.apache.org/job/beam_PostCommit_Py_VR_Dataflow/ws/src/sdks/python/build/gradleenv/local/lib/python2.7/site-packages/setuptools/dist.py>:470: UserWarning: Normalizing '2.9.0.dev' to '2.9.0.dev0' normalized_version, running nosetests running egg_info writing requirements to apache_beam.egg-info/requires.txt writing apache_beam.egg-info/PKG-INFO writing top-level names to apache_beam.egg-info/top_level.txt writing dependency_links to apache_beam.egg-info/dependency_links.txt writing entry points to apache_beam.egg-info/entry_points.txt reading manifest file 'apache_beam.egg-info/SOURCES.txt' reading manifest template 'MANIFEST.in' warning: no files found matching 'README.md' warning: no files found matching 'NOTICE' warning: no files found matching 'LICENSE' writing manifest file 'apache_beam.egg-info/SOURCES.txt' <https://builds.apache.org/job/beam_PostCommit_Py_VR_Dataflow/ws/src/sdks/python/apache_beam/runners/dataflow/dataflow_runner.py>:800: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported options = pbegin.pipeline.options.view_as(DebugOptions) <https://builds.apache.org/job/beam_PostCommit_Py_VR_Dataflow/ws/src/sdks/python/apache_beam/runners/dataflow/dataflow_runner.py>:800: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported options = pbegin.pipeline.options.view_as(DebugOptions) <https://builds.apache.org/job/beam_PostCommit_Py_VR_Dataflow/ws/src/sdks/python/apache_beam/runners/dataflow/dataflow_runner.py>:800: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported options = pbegin.pipeline.options.view_as(DebugOptions) <https://builds.apache.org/job/beam_PostCommit_Py_VR_Dataflow/ws/src/sdks/python/apache_beam/runners/dataflow/dataflow_runner.py>:800: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported options = pbegin.pipeline.options.view_as(DebugOptions) <https://builds.apache.org/job/beam_PostCommit_Py_VR_Dataflow/ws/src/sdks/python/apache_beam/runners/dataflow/dataflow_runner.py>:800: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported options = pbegin.pipeline.options.view_as(DebugOptions) <https://builds.apache.org/job/beam_PostCommit_Py_VR_Dataflow/ws/src/sdks/python/apache_beam/runners/dataflow/dataflow_runner.py>:800: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported options = pbegin.pipeline.options.view_as(DebugOptions) <https://builds.apache.org/job/beam_PostCommit_Py_VR_Dataflow/ws/src/sdks/python/apache_beam/runners/dataflow/dataflow_runner.py>:800: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported options = pbegin.pipeline.options.view_as(DebugOptions) <https://builds.apache.org/job/beam_PostCommit_Py_VR_Dataflow/ws/src/sdks/python/apache_beam/runners/dataflow/dataflow_runner.py>:800: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported options = pbegin.pipeline.options.view_as(DebugOptions) test_as_list_twice (apache_beam.transforms.sideinputs_test.SideInputsTest) ... ok test_par_do_with_multiple_outputs_and_using_yield (apache_beam.transforms.ptransform_test.PTransformTest) ... ok test_flatten_multiple_pcollections_having_multiple_consumers (apache_beam.transforms.ptransform_test.PTransformTest) ... ok test_undeclared_outputs (apache_beam.transforms.ptransform_test.PTransformTest) ... ok test_multiple_empty_outputs (apache_beam.transforms.ptransform_test.PTransformTest) ... ok test_par_do_with_multiple_outputs_and_using_return (apache_beam.transforms.ptransform_test.PTransformTest) ... ok test_as_list_and_as_dict_side_inputs (apache_beam.transforms.sideinputs_test.SideInputsTest) ... ok test_as_dict_twice (apache_beam.transforms.sideinputs_test.SideInputsTest) ... ok test_as_singleton_with_different_defaults (apache_beam.transforms.sideinputs_test.SideInputsTest) ... ok test_as_singleton_without_unique_labels (apache_beam.transforms.sideinputs_test.SideInputsTest) ... ok test_default_value_singleton_side_input (apache_beam.transforms.sideinputs_test.SideInputsTest) ... ok test_empty_singleton_side_input (apache_beam.transforms.sideinputs_test.SideInputsTest) ... ok test_flattened_side_input (apache_beam.transforms.sideinputs_test.SideInputsTest) ... ok test_iterable_side_input (apache_beam.transforms.sideinputs_test.SideInputsTest) ... ok ---------------------------------------------------------------------- XML: <https://builds.apache.org/job/beam_PostCommit_Py_VR_Dataflow/ws/src/sdks/python/nosetests.xml> ---------------------------------------------------------------------- Ran 14 tests in 877.974s OK Found: https://console.cloud.google.com/dataflow/jobsDetail/locations/us-central1/jobs/2018-11-14_23_04_10-479792338729869958?project=apache-beam-testing. Found: https://console.cloud.google.com/dataflow/jobsDetail/locations/us-central1/jobs/2018-11-14_23_11_15-571042253120413437?project=apache-beam-testing. Found: https://console.cloud.google.com/dataflow/jobsDetail/locations/us-central1/jobs/2018-11-14_23_04_10-12558083176052425298?project=apache-beam-testing. Found: https://console.cloud.google.com/dataflow/jobsDetail/locations/us-central1/jobs/2018-11-14_23_11_15-15092275047392847568?project=apache-beam-testing. Found: https://console.cloud.google.com/dataflow/jobsDetail/locations/us-central1/jobs/2018-11-14_23_04_11-1026212171350918614?project=apache-beam-testing. Found: https://console.cloud.google.com/dataflow/jobsDetail/locations/us-central1/jobs/2018-11-14_23_11_10-3153051596077838798?project=apache-beam-testing. Found: https://console.cloud.google.com/dataflow/jobsDetail/locations/us-central1/jobs/2018-11-14_23_04_11-6147696809948068800?project=apache-beam-testing. Found: https://console.cloud.google.com/dataflow/jobsDetail/locations/us-central1/jobs/2018-11-14_23_10_46-6554358858266795662?project=apache-beam-testing. Found: https://console.cloud.google.com/dataflow/jobsDetail/locations/us-central1/jobs/2018-11-14_23_04_10-5263264961323426253?project=apache-beam-testing. Found: https://console.cloud.google.com/dataflow/jobsDetail/locations/us-central1/jobs/2018-11-14_23_04_10-14715788434264587015?project=apache-beam-testing. Found: https://console.cloud.google.com/dataflow/jobsDetail/locations/us-central1/jobs/2018-11-14_23_04_10-7887285586018446829?project=apache-beam-testing. Found: https://console.cloud.google.com/dataflow/jobsDetail/locations/us-central1/jobs/2018-11-14_23_10_40-4464986862996237?project=apache-beam-testing. Found: https://console.cloud.google.com/dataflow/jobsDetail/locations/us-central1/jobs/2018-11-14_23_04_10-4270548178496288311?project=apache-beam-testing. Found: https://console.cloud.google.com/dataflow/jobsDetail/locations/us-central1/jobs/2018-11-14_23_10_34-13494339516098382996?project=apache-beam-testing. :beam-sdks-python:validatesRunnerStreamingTests (Thread[Task worker for ':',5,main]) completed. Took 14 mins 38.808 secs. FAILURE: Build failed with an exception. * Where: Build file '<https://builds.apache.org/job/beam_PostCommit_Py_VR_Dataflow/ws/src/sdks/python/build.gradle'> line: 331 * What went wrong: Execution failed for task ':beam-sdks-python:validatesRunnerBatchTests'. > Process 'command 'sh'' finished with non-zero exit value 1 * Try: Run with --stacktrace option to get the stack trace. Run with --debug option to get more log output. Run with --scan to get full insights. * Get more help at https://help.gradle.org Deprecated Gradle features were used in this build, making it incompatible with Gradle 5.0. Use '--warning-mode all' to show the individual deprecation warnings. See https://docs.gradle.org/4.10.2/userguide/command_line_interface.html#sec:command_line_warnings BUILD FAILED in 1h 18m 23s 61 actionable tasks: 56 executed, 5 from cache Publishing build scan... https://gradle.com/s/ybdu6xwifdd74 Build step 'Invoke Gradle script' changed build result to FAILURE Build step 'Invoke Gradle script' marked build as failure --------------------------------------------------------------------- To unsubscribe, e-mail: builds-unsubscr...@beam.apache.org For additional commands, e-mail: builds-h...@beam.apache.org
