See <https://builds.apache.org/job/beam_PostCommit_Python_Verify/6779/display/redirect>
------------------------------------------ [...truncated 147.10 KB...] Starting process 'command 'sh''. Working directory: <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python> Command: sh -c . <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/build/gradleenv/1327086738/bin/activate> && ./apache_beam/io/hdfs_integration_test/hdfs_integration_test.sh Successfully started process 'command 'sh'' ++ dirname ./apache_beam/io/hdfs_integration_test/hdfs_integration_test.sh + TEST_DIR=./apache_beam/io/hdfs_integration_test + ROOT_DIR=./apache_beam/io/hdfs_integration_test/../../../../.. + CONTEXT_DIR=./apache_beam/io/hdfs_integration_test/../../../../../build/hdfs_integration + rm -r ./apache_beam/io/hdfs_integration_test/../../../../../build/hdfs_integration rm: cannot remove './apache_beam/io/hdfs_integration_test/../../../../../build/hdfs_integration': No such file or directory + true + mkdir -p ./apache_beam/io/hdfs_integration_test/../../../../../build/hdfs_integration/sdks + cp ./apache_beam/io/hdfs_integration_test/docker-compose.yml ./apache_beam/io/hdfs_integration_test/Dockerfile ./apache_beam/io/hdfs_integration_test/hdfscli.cfg ./apache_beam/io/hdfs_integration_test/hdfs_integration_test.sh ./apache_beam/io/hdfs_integration_test/../../../../../build/hdfs_integration/ + cp -r ./apache_beam/io/hdfs_integration_test/../../../../../sdks/python ./apache_beam/io/hdfs_integration_test/../../../../../build/hdfs_integration/sdks/ + cp -r ./apache_beam/io/hdfs_integration_test/../../../../../model ./apache_beam/io/hdfs_integration_test/../../../../../build/hdfs_integration/ ++ echo hdfs_IT-jenkins-beam_PostCommit_Python_Verify-6779 + PROJECT_NAME=hdfs_IT-jenkins-beam_PostCommit_Python_Verify-6779 + '[' -z jenkins-beam_PostCommit_Python_Verify-6779 ']' + COLOR_OPT=--no-ansi + COMPOSE_OPT='-p hdfs_IT-jenkins-beam_PostCommit_Python_Verify-6779 --no-ansi' + cd ./apache_beam/io/hdfs_integration_test/../../../../../build/hdfs_integration + docker network prune --force runtime/cgo: pthread_create failed: Resource temporarily unavailable SIGABRT: abort PC=0x7faa0f586428 m=3 goroutine 0 [idle]: goroutine 1 [runnable, locked to thread]: time.init() /usr/local/go/src/time/zoneinfo_unix.go:91 os.init() /usr/local/go/src/os/wait_waitid.go:41 +0x53 fmt.init() /usr/local/go/src/fmt/scan.go:1198 +0x53 main.init() /usr/src/docker/.gopath/src/github.com/docker/docker/cmd/docker/docker.go:311 +0x32 goroutine 17 [syscall, locked to thread]: runtime.goexit() /usr/local/go/src/runtime/asm_amd64.s:2086 +0x1 rax 0x0 rbx 0x7faa0f916700 rcx 0x7faa0f586428 rdx 0x6 rdi 0x4dec rsi 0x4dc1 rbp 0xf1d11e rsp 0x7faa0eb4a9b8 r8 0x7faa0f917770 r9 0x7faa0eb4b700 r10 0x8 r11 0x202 r12 0x7faa080008c0 r13 0xf3 r14 0x30 r15 0x3 rip 0x7faa0f586428 rflags 0x202 cs 0x33 fs 0x0 gs 0x0 :beam-sdks-python:hdfsIntegrationTest (Thread[Task worker for ':',5,main]) completed. Took 0.077 secs. :beam-sdks-python:postCommitIT (Thread[Task worker for ':',5,main]) started. > Task :beam-sdks-python:postCommitIT FAILED Caching disabled for task ':beam-sdks-python:postCommitIT': Caching has not been enabled for the task Task ':beam-sdks-python:postCommitIT' is not up-to-date because: Task has not declared any outputs despite executing actions. Starting process 'command 'sh''. Working directory: <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python> Command: sh -c . <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/build/gradleenv/1327086738/bin/activate> && ./scripts/run_integration_test.sh --test_opts "--nocapture --processes=8 --process-timeout=4500 --attr=IT" Successfully started process 'command 'sh'' ########################################################################### # Build pipeline options if not provided in --pipeline_opts from commandline if [[ -z $PIPELINE_OPTS ]]; then # Check that the script is running in a known directory. if [[ $PWD != *sdks/python* ]]; then echo 'Unable to locate Apache Beam Python SDK root directory' exit 1 fi # Go to the Apache Beam Python SDK root if [[ "*sdks/python" != $PWD ]]; then cd $(pwd | sed 's/sdks\/python.*/sdks\/python/') fi # Create a tarball if not exists if [[ $(find ${SDK_LOCATION}) ]]; then SDK_LOCATION=$(find ${SDK_LOCATION}) else python setup.py -q sdist SDK_LOCATION=$(find dist/apache-beam-*.tar.gz) fi # Install test dependencies for ValidatesRunner tests. echo "pyhamcrest" > postcommit_requirements.txt echo "mock" >> postcommit_requirements.txt # Options used to run testing pipeline on Cloud Dataflow Service. Also used for # running on DirectRunner (some options ignored). opts=( "--runner=$RUNNER" "--project=$PROJECT" "--staging_location=$GCS_LOCATION/staging-it" "--temp_location=$GCS_LOCATION/temp-it" "--output=$GCS_LOCATION/py-it-cloud/output" "--sdk_location=$SDK_LOCATION" "--requirements_file=postcommit_requirements.txt" "--num_workers=$NUM_WORKERS" "--sleep_secs=$SLEEP_SECS" ) # Add --streaming if provided if [[ "$STREAMING" = true ]]; then opts+=("--streaming") fi # Add --dataflow_worker_jar if provided if [[ ! -z "$WORKER_JAR" ]]; then opts+=("--dataflow_worker_jar=$WORKER_JAR") fi PIPELINE_OPTS=$(IFS=" " ; echo "${opts[*]}") fi pwd | sed 's/sdks\/python.*/sdks\/python/' find ${SDK_LOCATION} find ${SDK_LOCATION} IFS=" " ; echo "${opts[*]}" ########################################################################### # Run tests and validate that jobs finish successfully. echo ">>> RUNNING integration tests with pipeline options: $PIPELINE_OPTS" python setup.py nosetests \ --test-pipeline-options="$PIPELINE_OPTS" \ $TEST_OPTS >>> RUNNING integration tests with pipeline options: >>> --runner=TestDataflowRunner --project=apache-beam-testing >>> --staging_location=gs://temp-storage-for-end-to-end-tests/staging-it >>> --temp_location=gs://temp-storage-for-end-to-end-tests/temp-it >>> --output=gs://temp-storage-for-end-to-end-tests/py-it-cloud/output >>> --sdk_location=build/apache-beam.tar.gz >>> --requirements_file=postcommit_requirements.txt --num_workers=1 >>> --sleep_secs=20 <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/build/gradleenv/1327086738/local/lib/python2.7/site-packages/setuptools/dist.py>:470: UserWarning: Normalizing '2.10.0.dev' to '2.10.0.dev0' normalized_version, running nosetests running egg_info writing requirements to apache_beam.egg-info/requires.txt writing apache_beam.egg-info/PKG-INFO writing top-level names to apache_beam.egg-info/top_level.txt writing dependency_links to apache_beam.egg-info/dependency_links.txt writing entry points to apache_beam.egg-info/entry_points.txt reading manifest file 'apache_beam.egg-info/SOURCES.txt' reading manifest template 'MANIFEST.in' warning: no files found matching 'README.md' warning: no files found matching 'NOTICE' warning: no files found matching 'LICENSE' writing manifest file 'apache_beam.egg-info/SOURCES.txt' OpenBLAS blas_thread_init: pthread_create: Resource temporarily unavailable OpenBLAS blas_thread_init: RLIMIT_NPROC 10240 current, 10240 max OpenBLAS blas_thread_init: pthread_create: Resource temporarily unavailable OpenBLAS blas_thread_init: RLIMIT_NPROC 10240 current, 10240 max OpenBLAS blas_thread_init: pthread_create: Resource temporarily unavailable OpenBLAS blas_thread_init: RLIMIT_NPROC 10240 current, 10240 max OpenBLAS blas_thread_init: pthread_create: Resource temporarily unavailable OpenBLAS blas_thread_init: RLIMIT_NPROC 10240 current, 10240 max OpenBLAS blas_thread_init: pthread_create: Resource temporarily unavailable OpenBLAS blas_thread_init: RLIMIT_NPROC 10240 current, 10240 max OpenBLAS blas_thread_init: pthread_create: Resource temporarily unavailable OpenBLAS blas_thread_init: RLIMIT_NPROC 10240 current, 10240 max OpenBLAS blas_thread_init: pthread_create: Resource temporarily unavailable OpenBLAS blas_thread_init: RLIMIT_NPROC 10240 current, 10240 max OpenBLAS blas_thread_init: pthread_create: Resource temporarily unavailable OpenBLAS blas_thread_init: RLIMIT_NPROC 10240 current, 10240 max OpenBLAS blas_thread_init: pthread_create: Resource temporarily unavailable OpenBLAS blas_thread_init: RLIMIT_NPROC 10240 current, 10240 max OpenBLAS blas_thread_init: pthread_create: Resource temporarily unavailable OpenBLAS blas_thread_init: RLIMIT_NPROC 10240 current, 10240 max OpenBLAS blas_thread_init: pthread_create: Resource temporarily unavailable OpenBLAS blas_thread_init: RLIMIT_NPROC 10240 current, 10240 max OpenBLAS blas_thread_init: pthread_create: Resource temporarily unavailable OpenBLAS blas_thread_init: RLIMIT_NPROC 10240 current, 10240 max OpenBLAS blas_thread_init: pthread_create: Resource temporarily unavailable OpenBLAS blas_thread_init: RLIMIT_NPROC 10240 current, 10240 max Process SyncManager-1: Traceback (most recent call last): File "/usr/lib/python2.7/multiprocessing/process.py", line 258, in _bootstrap self.run() File "/usr/lib/python2.7/multiprocessing/process.py", line 114, in run self._target(*self._args, **self._kwargs) File "/usr/lib/python2.7/multiprocessing/managers.py", line 558, in _run_server server.serve_forever() File "/usr/lib/python2.7/multiprocessing/managers.py", line 184, in serve_forever t.start() File "/usr/lib/python2.7/threading.py", line 736, in start _start_new_thread(self.__bootstrap, ()) error: can't start new thread interrupted :beam-sdks-python:postCommitIT (Thread[Task worker for ':',5,main]) completed. Took 0.937 secs. FAILURE: Build completed with 3 failures. 1: Task failed with an exception. ----------- * Where: Build file '<https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/build.gradle'> line: 159 * What went wrong: Execution failed for task ':beam-sdks-python:directRunnerIT'. > Process 'command 'sh'' finished with non-zero exit value 1 * Try: Run with --stacktrace option to get the stack trace. Run with --debug option to get more log output. Run with --scan to get full insights. ============================================================================== 2: Task failed with an exception. ----------- * Where: Build file '<https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/build.gradle'> line: 313 * What went wrong: Execution failed for task ':beam-sdks-python:hdfsIntegrationTest'. > Process 'command 'sh'' finished with non-zero exit value 2 * Try: Run with --stacktrace option to get the stack trace. Run with --debug option to get more log output. Run with --scan to get full insights. ============================================================================== 3: Task failed with an exception. ----------- * Where: Build file '<https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/build.gradle'> line: 274 * What went wrong: Execution failed for task ':beam-sdks-python:postCommitIT'. > Process 'command 'sh'' finished with non-zero exit value 1 * Try: Run with --stacktrace option to get the stack trace. Run with --debug option to get more log output. Run with --scan to get full insights. ============================================================================== * Get more help at https://help.gradle.org BUILD FAILED in 36s 6 actionable tasks: 6 executed Publishing build scan... https://gradle.com/s/ucfv5vwf4wcgk Build step 'Invoke Gradle script' changed build result to FAILURE Build step 'Invoke Gradle script' marked build as failure --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
