See
<https://builds.apache.org/job/beam_PostCommit_Py_VR_Dataflow/4053/display/redirect?page=changes>
Changes:
[lostluck] Fix documentation on iterable coder spec.
------------------------------------------
[...truncated 847.01 KB...]
}
],
"is_wrapper": true
},
"output_name": "out",
"user_name": "assert:odd/Match.out"
}
],
"parallel_input": {
"@type": "OutputReference",
"output_name": "out",
"step_name": "s36"
},
"serialized_fn": "ref_AppliedPTransform_assert:odd/Match_49",
"user_name": "assert:odd/Match"
}
}
],
"type": "JOB_TYPE_STREAMING"
}
root: INFO: Create job: <Job
createTime: u'2019-07-18T16:35:59.088503Z'
currentStateTime: u'1970-01-01T00:00:00Z'
id: u'2019-07-18_09_35_57-17849296837788960310'
location: u'us-central1'
name: u'beamapp-jenkins-0718163549-217223'
projectId: u'apache-beam-testing'
stageStates: []
startTime: u'2019-07-18T16:35:59.088503Z'
steps: []
tempFiles: []
type: TypeValueValuesEnum(JOB_TYPE_STREAMING, 2)>
root: INFO: Created job with id: [2019-07-18_09_35_57-17849296837788960310]
root: INFO: To access the Dataflow monitoring console, please navigate to
https://console.cloud.google.com/dataflow/jobsDetail/locations/us-central1/jobs/2019-07-18_09_35_57-17849296837788960310?project=apache-beam-testing
root: WARNING: Waiting indefinitely for streaming job.
root: INFO: Job 2019-07-18_09_35_57-17849296837788960310 is in state
JOB_STATE_RUNNING
root: INFO: 2019-07-18T16:36:01.636Z: JOB_MESSAGE_DETAILED: Checking
permissions granted to controller Service Account.
root: INFO: 2019-07-18T16:36:02.240Z: JOB_MESSAGE_BASIC: Worker configuration:
n1-standard-4 in us-central1-a.
root: INFO: 2019-07-18T16:36:02.910Z: JOB_MESSAGE_DETAILED: Expanding
SplittableParDo operations into optimizable parts.
root: INFO: 2019-07-18T16:36:02.913Z: JOB_MESSAGE_DETAILED: Expanding
CollectionToSingleton operations into optimizable parts.
root: INFO: 2019-07-18T16:36:02.920Z: JOB_MESSAGE_DETAILED: Expanding
CoGroupByKey operations into optimizable parts.
root: INFO: 2019-07-18T16:36:02.930Z: JOB_MESSAGE_DETAILED: Expanding
SplittableProcessKeyed operations into optimizable parts.
root: INFO: 2019-07-18T16:36:02.932Z: JOB_MESSAGE_DETAILED: Expanding
GroupByKey operations into streaming Read/Write steps
root: INFO: 2019-07-18T16:36:02.941Z: JOB_MESSAGE_DEBUG: Annotating graph with
Autotuner information.
root: INFO: 2019-07-18T16:36:02.961Z: JOB_MESSAGE_DETAILED: Fusing adjacent
ParDo, Read, Write, and Flatten operations
root: INFO: 2019-07-18T16:36:02.964Z: JOB_MESSAGE_DETAILED: Unzipping flatten
s11 for input s10.out
root: INFO: 2019-07-18T16:36:02.966Z: JOB_MESSAGE_DETAILED: Fusing unzipped
copy of assert_that/Group/GroupByKey/WriteStream, through flatten
assert_that/Group/Flatten, into producer assert_that/Group/pair_with_1
root: INFO: 2019-07-18T16:36:02.968Z: JOB_MESSAGE_DETAILED: Fusing consumer
Flatten into Map(split_even_odd)/Map(split_even_odd)
root: INFO: 2019-07-18T16:36:02.970Z: JOB_MESSAGE_DETAILED: Fusing consumer
assert_that/WindowInto(WindowIntoFn) into Flatten
root: INFO: 2019-07-18T16:36:02.972Z: JOB_MESSAGE_DETAILED: Fusing consumer
assert_that/Group/pair_with_1 into assert_that/ToVoidKey
root: INFO: 2019-07-18T16:36:02.974Z: JOB_MESSAGE_DETAILED: Fusing consumer
assert_that/ToVoidKey into assert_that/WindowInto(WindowIntoFn)
root: INFO: 2019-07-18T16:36:02.976Z: JOB_MESSAGE_DETAILED: Unzipping flatten
s22 for input s20.out
root: INFO: 2019-07-18T16:36:02.978Z: JOB_MESSAGE_DETAILED: Fusing unzipped
copy of assert:even/Group/GroupByKey/WriteStream, through flatten
assert:even/Group/Flatten, into producer assert:even/Group/pair_with_0
root: INFO: 2019-07-18T16:36:02.980Z: JOB_MESSAGE_DETAILED: Unzipping flatten
s33 for input s31.out
root: INFO: 2019-07-18T16:36:02.982Z: JOB_MESSAGE_DETAILED: Fusing unzipped
copy of assert:odd/Group/GroupByKey/WriteStream, through flatten
assert:odd/Group/Flatten, into producer assert:odd/Group/pair_with_0
root: INFO: 2019-07-18T16:36:02.984Z: JOB_MESSAGE_DETAILED: Fusing consumer
assert:odd/WindowInto(WindowIntoFn) into Map(split_even_odd)/Map(split_even_odd)
root: INFO: 2019-07-18T16:36:02.986Z: JOB_MESSAGE_DETAILED: Fusing consumer
assert_that/Group/GroupByKey/WriteStream into assert_that/Group/pair_with_0
root: INFO: 2019-07-18T16:36:02.988Z: JOB_MESSAGE_DETAILED: Fusing consumer
assert:even/WindowInto(WindowIntoFn) into
Map(split_even_odd)/Map(split_even_odd)
root: INFO: 2019-07-18T16:36:02.990Z: JOB_MESSAGE_DETAILED: Fusing consumer
assert:even/Group/GroupByKey/WriteStream into assert:even/Group/pair_with_1
root: INFO: 2019-07-18T16:36:02.992Z: JOB_MESSAGE_DETAILED: Fusing consumer
assert:odd/Group/GroupByKey/WriteStream into assert:odd/Group/pair_with_1
root: INFO: 2019-07-18T16:36:02.994Z: JOB_MESSAGE_DETAILED: Fusing consumer
assert_that/Unkey into assert_that/Group/Map(_merge_tagged_vals_under_key)
root: INFO: 2019-07-18T16:36:02.997Z: JOB_MESSAGE_DETAILED: Fusing consumer
assert:odd/Group/pair_with_0 into assert:odd/Create/Decode Values
root: INFO: 2019-07-18T16:36:02.998Z: JOB_MESSAGE_DETAILED: Fusing consumer
assert:odd/Create/Decode Values into assert:odd/Create/Impulse
root: INFO: 2019-07-18T16:36:03Z: JOB_MESSAGE_DETAILED: Fusing consumer
assert:odd/Unkey into assert:odd/Group/Map(_merge_tagged_vals_under_key)
root: INFO: 2019-07-18T16:36:03.002Z: JOB_MESSAGE_DETAILED: Fusing consumer
assert_that/Group/Map(_merge_tagged_vals_under_key) into
assert_that/Group/GroupByKey/MergeBuckets
root: INFO: 2019-07-18T16:36:03.004Z: JOB_MESSAGE_DETAILED: Fusing consumer
assert:even/Match into assert:even/Unkey
root: INFO: 2019-07-18T16:36:03.006Z: JOB_MESSAGE_DETAILED: Fusing consumer
assert:odd/ToVoidKey into assert:odd/WindowInto(WindowIntoFn)
root: INFO: 2019-07-18T16:36:03.008Z: JOB_MESSAGE_DETAILED: Fusing consumer
assert_that/Group/GroupByKey/MergeBuckets into
assert_that/Group/GroupByKey/ReadStream
root: INFO: 2019-07-18T16:36:03.009Z: JOB_MESSAGE_DETAILED: Fusing consumer
assert:even/Unkey into assert:even/Group/Map(_merge_tagged_vals_under_key)
root: INFO: 2019-07-18T16:36:03.011Z: JOB_MESSAGE_DETAILED: Fusing consumer
assert:odd/Match into assert:odd/Unkey
root: INFO: 2019-07-18T16:36:03.013Z: JOB_MESSAGE_DETAILED: Fusing consumer
assert:even/Group/Map(_merge_tagged_vals_under_key) into
assert:even/Group/GroupByKey/MergeBuckets
root: INFO: 2019-07-18T16:36:03.015Z: JOB_MESSAGE_DETAILED: Fusing consumer
assert:even/Group/GroupByKey/MergeBuckets into
assert:even/Group/GroupByKey/ReadStream
root: INFO: 2019-07-18T16:36:03.017Z: JOB_MESSAGE_DETAILED: Fusing consumer
Start/Decode Values into Start/Impulse
root: INFO: 2019-07-18T16:36:03.019Z: JOB_MESSAGE_DETAILED: Fusing consumer
assert:even/Group/pair_with_1 into assert:even/ToVoidKey
root: INFO: 2019-07-18T16:36:03.021Z: JOB_MESSAGE_DETAILED: Fusing consumer
assert:odd/Group/GroupByKey/MergeBuckets into
assert:odd/Group/GroupByKey/ReadStream
root: INFO: 2019-07-18T16:36:03.023Z: JOB_MESSAGE_DETAILED: Fusing consumer
assert:even/ToVoidKey into assert:even/WindowInto(WindowIntoFn)
root: INFO: 2019-07-18T16:36:03.025Z: JOB_MESSAGE_DETAILED: Fusing consumer
assert_that/Create/Decode Values into assert_that/Create/Impulse
root: INFO: 2019-07-18T16:36:03.026Z: JOB_MESSAGE_DETAILED: Fusing consumer
assert:odd/Group/pair_with_1 into assert:odd/ToVoidKey
root: INFO: 2019-07-18T16:36:03.028Z: JOB_MESSAGE_DETAILED: Fusing consumer
assert_that/Match into assert_that/Unkey
root: INFO: 2019-07-18T16:36:03.031Z: JOB_MESSAGE_DETAILED: Fusing consumer
assert:odd/Group/Map(_merge_tagged_vals_under_key) into
assert:odd/Group/GroupByKey/MergeBuckets
root: INFO: 2019-07-18T16:36:03.033Z: JOB_MESSAGE_DETAILED: Fusing consumer
assert_that/Group/pair_with_0 into assert_that/Create/Decode Values
root: INFO: 2019-07-18T16:36:03.034Z: JOB_MESSAGE_DETAILED: Fusing consumer
assert:even/Group/pair_with_0 into assert:even/Create/Decode Values
root: INFO: 2019-07-18T16:36:03.037Z: JOB_MESSAGE_DETAILED: Fusing consumer
Map(split_even_odd)/Map(split_even_odd) into Start/Decode Values
root: INFO: 2019-07-18T16:36:03.038Z: JOB_MESSAGE_DETAILED: Fusing consumer
assert:even/Create/Decode Values into assert:even/Create/Impulse
root: INFO: 2019-07-18T16:36:03.051Z: JOB_MESSAGE_DEBUG: Adding StepResource
setup and teardown to workflow graph.
root: INFO: 2019-07-18T16:36:03.065Z: JOB_MESSAGE_DEBUG: Adding workflow start
and stop steps.
root: INFO: 2019-07-18T16:36:03.110Z: JOB_MESSAGE_DEBUG: Assigning stage ids.
root: INFO: 2019-07-18T16:36:03.216Z: JOB_MESSAGE_DEBUG: Executing wait step
start2
root: INFO: 2019-07-18T16:36:03.227Z: JOB_MESSAGE_DEBUG: Starting worker pool
setup.
root: INFO: 2019-07-18T16:36:03.231Z: JOB_MESSAGE_BASIC: Starting 1 workers...
root: INFO: 2019-07-18T16:36:06.589Z: JOB_MESSAGE_BASIC: Executing operation
Start/Impulse+Start/Decode
Values+Map(split_even_odd)/Map(split_even_odd)+Flatten+assert_that/WindowInto(WindowIntoFn)+assert_that/ToVoidKey+assert_that/Group/pair_with_1+assert_that/Group/GroupByKey/WriteStream+assert:odd/WindowInto(WindowIntoFn)+assert:even/WindowInto(WindowIntoFn)+assert:odd/ToVoidKey+assert:even/ToVoidKey+assert:even/Group/pair_with_1+assert:even/Group/GroupByKey/WriteStream+assert:odd/Group/pair_with_1+assert:odd/Group/GroupByKey/WriteStream
root: INFO: 2019-07-18T16:36:06.589Z: JOB_MESSAGE_BASIC: Executing operation
assert_that/Group/GroupByKey/ReadStream+assert_that/Group/GroupByKey/MergeBuckets+assert_that/Group/Map(_merge_tagged_vals_under_key)+assert_that/Unkey+assert_that/Match
root: INFO: 2019-07-18T16:36:06.589Z: JOB_MESSAGE_BASIC: Executing operation
assert_that/Create/Impulse+assert_that/Create/Decode
Values+assert_that/Group/pair_with_0+assert_that/Group/GroupByKey/WriteStream
root: INFO: 2019-07-18T16:36:06.589Z: JOB_MESSAGE_BASIC: Executing operation
assert:even/Create/Impulse+assert:even/Create/Decode
Values+assert:even/Group/pair_with_0+assert:even/Group/GroupByKey/WriteStream
root: INFO: 2019-07-18T16:36:06.589Z: JOB_MESSAGE_BASIC: Executing operation
assert:even/Group/GroupByKey/ReadStream+assert:even/Group/GroupByKey/MergeBuckets+assert:even/Group/Map(_merge_tagged_vals_under_key)+assert:even/Unkey+assert:even/Match
root: INFO: 2019-07-18T16:36:06.589Z: JOB_MESSAGE_BASIC: Executing operation
assert:odd/Create/Impulse+assert:odd/Create/Decode
Values+assert:odd/Group/pair_with_0+assert:odd/Group/GroupByKey/WriteStream
root: INFO: 2019-07-18T16:36:06.589Z: JOB_MESSAGE_BASIC: Executing operation
assert:odd/Group/GroupByKey/ReadStream+assert:odd/Group/GroupByKey/MergeBuckets+assert:odd/Group/Map(_merge_tagged_vals_under_key)+assert:odd/Unkey+assert:odd/Match
root: INFO: 2019-07-18T16:37:01.722Z: JOB_MESSAGE_DETAILED: Workers have
started successfully.
root: INFO: 2019-07-18T16:37:33.544Z: JOB_MESSAGE_DEBUG: Executing input step
topology_init_attach_disk_input_step
root: INFO: 2019-07-18T16:37:33.743Z: JOB_MESSAGE_DETAILED: Checking
permissions granted to controller Service Account.
root: INFO: 2019-07-18T16:37:34.306Z: JOB_MESSAGE_BASIC: Worker configuration:
n1-standard-4 in us-central1-a.
--------------------- >> end captured logging << ---------------------
----------------------------------------------------------------------
XML: nosetests-validatesRunnerStreamingTests-df.xml
----------------------------------------------------------------------
XML:
<https://builds.apache.org/job/beam_PostCommit_Py_VR_Dataflow/ws/src/sdks/python/nosetests.xml>
----------------------------------------------------------------------
Ran 15 tests in 1092.427s
FAILED (failures=1)
Found:
https://console.cloud.google.com/dataflow/jobsDetail/locations/us-central1/jobs/2019-07-18_09_35_57-17849296837788960310?project=apache-beam-testing.
Found:
https://console.cloud.google.com/dataflow/jobsDetail/locations/us-central1/jobs/2019-07-18_09_42_44-18039182676302877800?project=apache-beam-testing.
Found:
https://console.cloud.google.com/dataflow/jobsDetail/locations/us-central1/jobs/2019-07-18_09_35_57-8326743264496824441?project=apache-beam-testing.
Found:
https://console.cloud.google.com/dataflow/jobsDetail/locations/us-central1/jobs/2019-07-18_09_44_32-13774199640925782017?project=apache-beam-testing.
Found:
https://console.cloud.google.com/dataflow/jobsDetail/locations/us-central1/jobs/2019-07-18_09_35_57-6805335255821409211?project=apache-beam-testing.
Found:
https://console.cloud.google.com/dataflow/jobsDetail/locations/us-central1/jobs/2019-07-18_09_44_03-11811808547851806909?project=apache-beam-testing.
Found:
https://console.cloud.google.com/dataflow/jobsDetail/locations/us-central1/jobs/2019-07-18_09_35_57-11183265229652083118?project=apache-beam-testing.
Found:
https://console.cloud.google.com/dataflow/jobsDetail/locations/us-central1/jobs/2019-07-18_09_45_22-11482126136157347645?project=apache-beam-testing.
Found:
https://console.cloud.google.com/dataflow/jobsDetail/locations/us-central1/jobs/2019-07-18_09_35_56-7675915049046293394?project=apache-beam-testing.
Found:
https://console.cloud.google.com/dataflow/jobsDetail/locations/us-central1/jobs/2019-07-18_09_44_40-14372011104617258871?project=apache-beam-testing.
Found:
https://console.cloud.google.com/dataflow/jobsDetail/locations/us-central1/jobs/2019-07-18_09_35_57-2300705120450180300?project=apache-beam-testing.
Found:
https://console.cloud.google.com/dataflow/jobsDetail/locations/us-central1/jobs/2019-07-18_09_44_02-15850162861509046558?project=apache-beam-testing.
Found:
https://console.cloud.google.com/dataflow/jobsDetail/locations/us-central1/jobs/2019-07-18_09_35_57-5278941483088730750?project=apache-beam-testing.
Found:
https://console.cloud.google.com/dataflow/jobsDetail/locations/us-central1/jobs/2019-07-18_09_45_19-15153987046553515429?project=apache-beam-testing.
Found:
https://console.cloud.google.com/dataflow/jobsDetail/locations/us-central1/jobs/2019-07-18_09_35_57-8300257888577841931?project=apache-beam-testing.
> Task :sdks:python:validatesRunnerStreamingTests FAILED
FAILURE: Build completed with 8 failures.
1: Task failed with an exception.
-----------
* Where:
Build file
'<https://builds.apache.org/job/beam_PostCommit_Py_VR_Dataflow/ws/src/sdks/python/test-suites/dataflow/py36/build.gradle'>
line: 69
* What went wrong:
Execution failed for task
':sdks:python:test-suites:dataflow:py36:validatesRunnerBatchTests'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug
option to get more log output. Run with --scan to get full insights.
==============================================================================
2: Task failed with an exception.
-----------
* Where:
Build file
'<https://builds.apache.org/job/beam_PostCommit_Py_VR_Dataflow/ws/src/sdks/python/test-suites/dataflow/py35/build.gradle'>
line: 69
* What went wrong:
Execution failed for task
':sdks:python:test-suites:dataflow:py35:validatesRunnerBatchTests'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug
option to get more log output. Run with --scan to get full insights.
==============================================================================
3: Task failed with an exception.
-----------
* Where:
Build file
'<https://builds.apache.org/job/beam_PostCommit_Py_VR_Dataflow/ws/src/sdks/python/test-suites/dataflow/py36/build.gradle'>
line: 90
* What went wrong:
Execution failed for task
':sdks:python:test-suites:dataflow:py36:validatesRunnerStreamingTests'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug
option to get more log output. Run with --scan to get full insights.
==============================================================================
4: Task failed with an exception.
-----------
* Where:
Build file
'<https://builds.apache.org/job/beam_PostCommit_Py_VR_Dataflow/ws/src/sdks/python/test-suites/dataflow/py35/build.gradle'>
line: 90
* What went wrong:
Execution failed for task
':sdks:python:test-suites:dataflow:py35:validatesRunnerStreamingTests'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug
option to get more log output. Run with --scan to get full insights.
==============================================================================
5: Task failed with an exception.
-----------
* Where:
Build file
'<https://builds.apache.org/job/beam_PostCommit_Py_VR_Dataflow/ws/src/sdks/python/test-suites/dataflow/py37/build.gradle'>
line: 100
* What went wrong:
Execution failed for task
':sdks:python:test-suites:dataflow:py37:validatesRunnerBatchTests'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug
option to get more log output. Run with --scan to get full insights.
==============================================================================
6: Task failed with an exception.
-----------
* Where:
Build file
'<https://builds.apache.org/job/beam_PostCommit_Py_VR_Dataflow/ws/src/sdks/python/build.gradle'>
line: 201
* What went wrong:
Execution failed for task ':sdks:python:validatesRunnerBatchTests'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug
option to get more log output. Run with --scan to get full insights.
==============================================================================
7: Task failed with an exception.
-----------
* Where:
Build file
'<https://builds.apache.org/job/beam_PostCommit_Py_VR_Dataflow/ws/src/sdks/python/test-suites/dataflow/py37/build.gradle'>
line: 121
* What went wrong:
Execution failed for task
':sdks:python:test-suites:dataflow:py37:validatesRunnerStreamingTests'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug
option to get more log output. Run with --scan to get full insights.
==============================================================================
8: Task failed with an exception.
-----------
* Where:
Build file
'<https://builds.apache.org/job/beam_PostCommit_Py_VR_Dataflow/ws/src/sdks/python/build.gradle'>
line: 221
* What went wrong:
Execution failed for task ':sdks:python:validatesRunnerStreamingTests'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug
option to get more log output. Run with --scan to get full insights.
==============================================================================
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with
Gradle 6.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See
https://docs.gradle.org/5.2.1/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 49m 27s
76 actionable tasks: 59 executed, 17 from cache
Publishing build scan...
https://gradle.com/s/g7qcosy7wrfec
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
