See
<https://ci-beam.apache.org/job/beam_PostCommit_Python36/3966/display/redirect>
Changes:
------------------------------------------
[...truncated 46.79 MB...]
File "apache_beam/runners/worker/operations.py", line 706, in
apache_beam.runners.worker.operations.DoOperation.start
File "apache_beam/runners/worker/operations.py", line 707, in
apache_beam.runners.worker.operations.DoOperation.start
File "apache_beam/runners/worker/operations.py", line 305, in
apache_beam.runners.worker.operations.Operation.start
File "apache_beam/runners/worker/operations.py", line 311, in
apache_beam.runners.worker.operations.Operation.start
File "apache_beam/runners/worker/operations.py", line 653, in
apache_beam.runners.worker.operations.DoOperation.setup
File "apache_beam/runners/worker/operations.py", line 654, in
apache_beam.runners.worker.operations.DoOperation.setup
File "apache_beam/runners/worker/operations.py", line 286, in
apache_beam.runners.worker.operations.Operation.setup
File "apache_beam/runners/worker/operations.py", line 300, in
apache_beam.runners.worker.operations.Operation.setup
File "apache_beam/runners/worker/operations.py", line 793, in
apache_beam.runners.worker.operations.DoOperation._get_runtime_performance_hints
File
"/usr/local/lib/python3.6/site-packages/apache_beam/internal/pickler.py", line
287, in loads
return dill.loads(s)
File "/usr/local/lib/python3.6/site-packages/dill/_dill.py", line 275, in
loads
return load(file, ignore, **kwds)
File "/usr/local/lib/python3.6/site-packages/dill/_dill.py", line 270, in load
return Unpickler(file, ignore=ignore, **kwds).load()
File "/usr/local/lib/python3.6/site-packages/dill/_dill.py", line 472, in load
obj = StockUnpickler.load(self)
File "/usr/local/lib/python3.6/site-packages/dill/_dill.py", line 462, in
find_class
return StockUnpickler.find_class(self, module, name)
File "<frozen importlib._bootstrap>", line 971, in _find_and_load
File "<frozen importlib._bootstrap>", line 955, in _find_and_load_unlocked
File "<frozen importlib._bootstrap>", line 665, in _load_unlocked
File "<frozen importlib._bootstrap_external>", line 674, in exec_module
File "<frozen importlib._bootstrap_external>", line 779, in get_code
File "<frozen importlib._bootstrap_external>", line 487, in _compile_bytecode
EOFError: marshal data too short
apache_beam.runners.dataflow.dataflow_runner: INFO: 2021-06-03T12:48:27.623Z:
JOB_MESSAGE_ERROR: Traceback (most recent call last):
File
"/usr/local/lib/python3.6/site-packages/apache_beam/internal/pickler.py", line
283, in loads
return dill.loads(s)
File "/usr/local/lib/python3.6/site-packages/dill/_dill.py", line 275, in
loads
return load(file, ignore, **kwds)
File "/usr/local/lib/python3.6/site-packages/dill/_dill.py", line 270, in load
return Unpickler(file, ignore=ignore, **kwds).load()
File "/usr/local/lib/python3.6/site-packages/dill/_dill.py", line 472, in load
obj = StockUnpickler.load(self)
File "/usr/local/lib/python3.6/site-packages/dill/_dill.py", line 462, in
find_class
return StockUnpickler.find_class(self, module, name)
File "<frozen importlib._bootstrap>", line 971, in _find_and_load
File "<frozen importlib._bootstrap>", line 955, in _find_and_load_unlocked
File "<frozen importlib._bootstrap>", line 665, in _load_unlocked
File "<frozen importlib._bootstrap_external>", line 674, in exec_module
File "<frozen importlib._bootstrap_external>", line 779, in get_code
File "<frozen importlib._bootstrap_external>", line 487, in _compile_bytecode
EOFError: marshal data too short
During handling of the above exception, another exception occurred:
Traceback (most recent call last):
File "/usr/local/lib/python3.6/site-packages/dataflow_worker/batchworker.py",
line 651, in do_work
work_executor.execute()
File "/usr/local/lib/python3.6/site-packages/dataflow_worker/executor.py",
line 179, in execute
op.start()
File "apache_beam/runners/worker/operations.py", line 704, in
apache_beam.runners.worker.operations.DoOperation.start
File "apache_beam/runners/worker/operations.py", line 706, in
apache_beam.runners.worker.operations.DoOperation.start
File "apache_beam/runners/worker/operations.py", line 707, in
apache_beam.runners.worker.operations.DoOperation.start
File "apache_beam/runners/worker/operations.py", line 305, in
apache_beam.runners.worker.operations.Operation.start
File "apache_beam/runners/worker/operations.py", line 311, in
apache_beam.runners.worker.operations.Operation.start
File "apache_beam/runners/worker/operations.py", line 653, in
apache_beam.runners.worker.operations.DoOperation.setup
File "apache_beam/runners/worker/operations.py", line 654, in
apache_beam.runners.worker.operations.DoOperation.setup
File "apache_beam/runners/worker/operations.py", line 286, in
apache_beam.runners.worker.operations.Operation.setup
File "apache_beam/runners/worker/operations.py", line 300, in
apache_beam.runners.worker.operations.Operation.setup
File "apache_beam/runners/worker/operations.py", line 793, in
apache_beam.runners.worker.operations.DoOperation._get_runtime_performance_hints
File
"/usr/local/lib/python3.6/site-packages/apache_beam/internal/pickler.py", line
287, in loads
return dill.loads(s)
File "/usr/local/lib/python3.6/site-packages/dill/_dill.py", line 275, in
loads
return load(file, ignore, **kwds)
File "/usr/local/lib/python3.6/site-packages/dill/_dill.py", line 270, in load
return Unpickler(file, ignore=ignore, **kwds).load()
File "/usr/local/lib/python3.6/site-packages/dill/_dill.py", line 472, in load
obj = StockUnpickler.load(self)
File "/usr/local/lib/python3.6/site-packages/dill/_dill.py", line 462, in
find_class
return StockUnpickler.find_class(self, module, name)
File "<frozen importlib._bootstrap>", line 971, in _find_and_load
File "<frozen importlib._bootstrap>", line 955, in _find_and_load_unlocked
File "<frozen importlib._bootstrap>", line 665, in _load_unlocked
File "<frozen importlib._bootstrap_external>", line 674, in exec_module
File "<frozen importlib._bootstrap_external>", line 779, in get_code
File "<frozen importlib._bootstrap_external>", line 487, in _compile_bytecode
EOFError: marshal data too short
apache_beam.runners.dataflow.dataflow_runner: INFO: 2021-06-03T12:48:31.185Z:
JOB_MESSAGE_ERROR: Traceback (most recent call last):
File
"/usr/local/lib/python3.6/site-packages/apache_beam/internal/pickler.py", line
283, in loads
return dill.loads(s)
File "/usr/local/lib/python3.6/site-packages/dill/_dill.py", line 275, in
loads
return load(file, ignore, **kwds)
File "/usr/local/lib/python3.6/site-packages/dill/_dill.py", line 270, in load
return Unpickler(file, ignore=ignore, **kwds).load()
File "/usr/local/lib/python3.6/site-packages/dill/_dill.py", line 472, in load
obj = StockUnpickler.load(self)
File "/usr/local/lib/python3.6/site-packages/dill/_dill.py", line 462, in
find_class
return StockUnpickler.find_class(self, module, name)
File "<frozen importlib._bootstrap>", line 971, in _find_and_load
File "<frozen importlib._bootstrap>", line 955, in _find_and_load_unlocked
File "<frozen importlib._bootstrap>", line 665, in _load_unlocked
File "<frozen importlib._bootstrap_external>", line 674, in exec_module
File "<frozen importlib._bootstrap_external>", line 779, in get_code
File "<frozen importlib._bootstrap_external>", line 487, in _compile_bytecode
EOFError: marshal data too short
During handling of the above exception, another exception occurred:
Traceback (most recent call last):
File "/usr/local/lib/python3.6/site-packages/dataflow_worker/batchworker.py",
line 651, in do_work
work_executor.execute()
File "/usr/local/lib/python3.6/site-packages/dataflow_worker/executor.py",
line 179, in execute
op.start()
File "apache_beam/runners/worker/operations.py", line 704, in
apache_beam.runners.worker.operations.DoOperation.start
File "apache_beam/runners/worker/operations.py", line 706, in
apache_beam.runners.worker.operations.DoOperation.start
File "apache_beam/runners/worker/operations.py", line 707, in
apache_beam.runners.worker.operations.DoOperation.start
File "apache_beam/runners/worker/operations.py", line 305, in
apache_beam.runners.worker.operations.Operation.start
File "apache_beam/runners/worker/operations.py", line 311, in
apache_beam.runners.worker.operations.Operation.start
File "apache_beam/runners/worker/operations.py", line 653, in
apache_beam.runners.worker.operations.DoOperation.setup
File "apache_beam/runners/worker/operations.py", line 654, in
apache_beam.runners.worker.operations.DoOperation.setup
File "apache_beam/runners/worker/operations.py", line 286, in
apache_beam.runners.worker.operations.Operation.setup
File "apache_beam/runners/worker/operations.py", line 300, in
apache_beam.runners.worker.operations.Operation.setup
File "apache_beam/runners/worker/operations.py", line 793, in
apache_beam.runners.worker.operations.DoOperation._get_runtime_performance_hints
File
"/usr/local/lib/python3.6/site-packages/apache_beam/internal/pickler.py", line
287, in loads
return dill.loads(s)
File "/usr/local/lib/python3.6/site-packages/dill/_dill.py", line 275, in
loads
return load(file, ignore, **kwds)
File "/usr/local/lib/python3.6/site-packages/dill/_dill.py", line 270, in load
return Unpickler(file, ignore=ignore, **kwds).load()
File "/usr/local/lib/python3.6/site-packages/dill/_dill.py", line 472, in load
obj = StockUnpickler.load(self)
File "/usr/local/lib/python3.6/site-packages/dill/_dill.py", line 462, in
find_class
return StockUnpickler.find_class(self, module, name)
File "<frozen importlib._bootstrap>", line 971, in _find_and_load
File "<frozen importlib._bootstrap>", line 955, in _find_and_load_unlocked
File "<frozen importlib._bootstrap>", line 665, in _load_unlocked
File "<frozen importlib._bootstrap_external>", line 674, in exec_module
File "<frozen importlib._bootstrap_external>", line 779, in get_code
File "<frozen importlib._bootstrap_external>", line 487, in _compile_bytecode
EOFError: marshal data too short
apache_beam.runners.dataflow.dataflow_runner: INFO: 2021-06-03T12:48:34.685Z:
JOB_MESSAGE_ERROR: Traceback (most recent call last):
File
"/usr/local/lib/python3.6/site-packages/apache_beam/internal/pickler.py", line
283, in loads
return dill.loads(s)
File "/usr/local/lib/python3.6/site-packages/dill/_dill.py", line 275, in
loads
return load(file, ignore, **kwds)
File "/usr/local/lib/python3.6/site-packages/dill/_dill.py", line 270, in load
return Unpickler(file, ignore=ignore, **kwds).load()
File "/usr/local/lib/python3.6/site-packages/dill/_dill.py", line 472, in load
obj = StockUnpickler.load(self)
File "/usr/local/lib/python3.6/site-packages/dill/_dill.py", line 462, in
find_class
return StockUnpickler.find_class(self, module, name)
File "<frozen importlib._bootstrap>", line 971, in _find_and_load
File "<frozen importlib._bootstrap>", line 955, in _find_and_load_unlocked
File "<frozen importlib._bootstrap>", line 665, in _load_unlocked
File "<frozen importlib._bootstrap_external>", line 674, in exec_module
File "<frozen importlib._bootstrap_external>", line 779, in get_code
File "<frozen importlib._bootstrap_external>", line 487, in _compile_bytecode
EOFError: marshal data too short
During handling of the above exception, another exception occurred:
Traceback (most recent call last):
File "/usr/local/lib/python3.6/site-packages/dataflow_worker/batchworker.py",
line 651, in do_work
work_executor.execute()
File "/usr/local/lib/python3.6/site-packages/dataflow_worker/executor.py",
line 179, in execute
op.start()
File "apache_beam/runners/worker/operations.py", line 704, in
apache_beam.runners.worker.operations.DoOperation.start
File "apache_beam/runners/worker/operations.py", line 706, in
apache_beam.runners.worker.operations.DoOperation.start
File "apache_beam/runners/worker/operations.py", line 707, in
apache_beam.runners.worker.operations.DoOperation.start
File "apache_beam/runners/worker/operations.py", line 305, in
apache_beam.runners.worker.operations.Operation.start
File "apache_beam/runners/worker/operations.py", line 311, in
apache_beam.runners.worker.operations.Operation.start
File "apache_beam/runners/worker/operations.py", line 653, in
apache_beam.runners.worker.operations.DoOperation.setup
File "apache_beam/runners/worker/operations.py", line 654, in
apache_beam.runners.worker.operations.DoOperation.setup
File "apache_beam/runners/worker/operations.py", line 286, in
apache_beam.runners.worker.operations.Operation.setup
File "apache_beam/runners/worker/operations.py", line 300, in
apache_beam.runners.worker.operations.Operation.setup
File "apache_beam/runners/worker/operations.py", line 793, in
apache_beam.runners.worker.operations.DoOperation._get_runtime_performance_hints
File
"/usr/local/lib/python3.6/site-packages/apache_beam/internal/pickler.py", line
287, in loads
return dill.loads(s)
File "/usr/local/lib/python3.6/site-packages/dill/_dill.py", line 275, in
loads
return load(file, ignore, **kwds)
File "/usr/local/lib/python3.6/site-packages/dill/_dill.py", line 270, in load
return Unpickler(file, ignore=ignore, **kwds).load()
File "/usr/local/lib/python3.6/site-packages/dill/_dill.py", line 472, in load
obj = StockUnpickler.load(self)
File "/usr/local/lib/python3.6/site-packages/dill/_dill.py", line 462, in
find_class
return StockUnpickler.find_class(self, module, name)
File "<frozen importlib._bootstrap>", line 971, in _find_and_load
File "<frozen importlib._bootstrap>", line 955, in _find_and_load_unlocked
File "<frozen importlib._bootstrap>", line 665, in _load_unlocked
File "<frozen importlib._bootstrap_external>", line 674, in exec_module
File "<frozen importlib._bootstrap_external>", line 779, in get_code
File "<frozen importlib._bootstrap_external>", line 487, in _compile_bytecode
EOFError: marshal data too short
apache_beam.runners.dataflow.dataflow_runner: INFO: 2021-06-03T12:48:35.380Z:
JOB_MESSAGE_BASIC: Finished operation
read/Read+read/_PassThroughThenCleanup/ParDo(PassThrough)/ParDo(PassThrough)+Map(datetime_to_utc)+assert_that/WindowInto(WindowIntoFn)+assert_that/ToVoidKey+assert_that/Group/pair_with_1+assert_that/Group/GroupByKey/Reify+assert_that/Group/GroupByKey/Write
apache_beam.runners.dataflow.dataflow_runner: INFO: 2021-06-03T12:48:35.454Z:
JOB_MESSAGE_DEBUG: Executing failure step failure22
apache_beam.runners.dataflow.dataflow_runner: INFO: 2021-06-03T12:48:35.480Z:
JOB_MESSAGE_ERROR: Workflow failed. Causes:
S02:read/Read+read/_PassThroughThenCleanup/ParDo(PassThrough)/ParDo(PassThrough)+Map(datetime_to_utc)+assert_that/WindowInto(WindowIntoFn)+assert_that/ToVoidKey+assert_that/Group/pair_with_1+assert_that/Group/GroupByKey/Reify+assert_that/Group/GroupByKey/Write
failed., The job failed because a work item has failed 4 times. Look in
previous log entries for the cause of each one of the 4 failures. For more
information, see https://cloud.google.com/dataflow/docs/guides/common-errors.
The work item was attempted on these workers:
beamapp-jenkins-060312411-06030541-h918-harness-h29k
Root cause: Work item failed.,
beamapp-jenkins-060312411-06030541-h918-harness-h29k
Root cause: Work item failed.,
beamapp-jenkins-060312411-06030541-h918-harness-h29k
Root cause: Work item failed.,
beamapp-jenkins-060312411-06030541-h918-harness-h29k
Root cause: Work item failed.
apache_beam.runners.dataflow.dataflow_runner: INFO: 2021-06-03T12:48:35.578Z:
JOB_MESSAGE_BASIC: Finished operation
assert_that/Create/Read+assert_that/Group/pair_with_0+assert_that/Group/GroupByKey/Reify+assert_that/Group/GroupByKey/Write
apache_beam.runners.dataflow.dataflow_runner: INFO: 2021-06-03T12:48:35.945Z:
JOB_MESSAGE_WARNING: S04:read/FilesToRemoveImpulse/Read+read/MapFilesToRemove
failed.
apache_beam.runners.dataflow.dataflow_runner: INFO: 2021-06-03T12:48:36.017Z:
JOB_MESSAGE_BASIC: Finished operation
read/FilesToRemoveImpulse/Read+read/MapFilesToRemove
apache_beam.runners.dataflow.dataflow_runner: INFO: 2021-06-03T12:48:36.125Z:
JOB_MESSAGE_DETAILED: Cleaning up.
apache_beam.runners.dataflow.dataflow_runner: INFO: 2021-06-03T12:48:36.184Z:
JOB_MESSAGE_DEBUG: Starting worker pool teardown.
apache_beam.runners.dataflow.dataflow_runner: INFO: 2021-06-03T12:48:36.213Z:
JOB_MESSAGE_BASIC: Stopping worker pool...
apache_beam.runners.dataflow.dataflow_runner: INFO: 2021-06-03T12:49:26.334Z:
JOB_MESSAGE_DETAILED: Autoscaling: Resized worker pool from 1 to 0.
apache_beam.runners.dataflow.dataflow_runner: INFO: 2021-06-03T12:49:26.377Z:
JOB_MESSAGE_BASIC: Worker pool stopped.
apache_beam.runners.dataflow.dataflow_runner: INFO: 2021-06-03T12:49:26.411Z:
JOB_MESSAGE_DEBUG: Tearing down pending resources...
apache_beam.runners.dataflow.dataflow_runner: INFO: Job
2021-06-03_05_41_23-961357921000445671 is in state JOB_STATE_FAILED
--------------------- >> end captured logging << ---------------------
----------------------------------------------------------------------
XML: nosetests-postCommitIT-df-py36.xml
----------------------------------------------------------------------
XML:
<https://ci-beam.apache.org/job/beam_PostCommit_Python36/ws/src/sdks/python/nosetests.xml>
----------------------------------------------------------------------
Ran 70 tests in 5644.561s
FAILED (SKIP=8, errors=1)
> Task :sdks:python:test-suites:dataflow:py36:postCommitIT FAILED
FAILURE: Build failed with an exception.
* Where:
Script
'<https://ci-beam.apache.org/job/beam_PostCommit_Python36/ws/src/sdks/python/test-suites/dataflow/common.gradle'>
line: 126
* What went wrong:
Execution failed for task ':sdks:python:test-suites:dataflow:py36:postCommitIT'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug
option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with
Gradle 7.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See
https://docs.gradle.org/6.8.3/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 1h 37m 47s
213 actionable tasks: 151 executed, 58 from cache, 4 up-to-date
Publishing build scan...
https://gradle.com/s/sm3fqttg52i5w
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
