See
<https://ci-beam.apache.org/job/beam_PostCommit_Python35/2838/display/redirect?page=changes>
Changes:
[chamikaramj] Include coders embedded in CombinePayload when converting x-lang
[kevinsijo] [BEAM-9919] Refining xlang types and wrappers
[Luke Cwik] [BEAM-9979] Support a reset call that happens after the bundle is
done
[noreply] [BEAM-10200] Add optional experiment to enable heap dump through the …
[kevinsijo] [BEAM-9919] xlang transforms wrapped with namespaces
[kevinsijo] [BEAM-9919] cleaning namespace.go
------------------------------------------
[...truncated 22.10 MB...]
{
"@type":
"FastPrimitivesCoder$QlpoOTFBWSZTWYQR6NMAAEDXwH8QgCEJAEBAv279AmAAIABqEqnqGgaABpoyNAGVHpGgMgDQBk0oR6IeoECBiqqU5NY23ndshzT2UPUOGrg42YPi9VyA8lbwwPJgtghxs5Qq1aWwExCDeMa0RHC2QigTCdizz1nx+LuSKcKEhCCPRpg=",
"component_encodings": [],
"pipeline_proto_coder_id":
"ref_Coder_FastPrimitivesCoder_3"
}
],
"is_pair_like": true,
"pipeline_proto_coder_id": "ref_Coder_FastPrimitivesCoder_3"
},
{
"@type": "kind:global_window"
}
],
"is_wrapper": true
},
"output_name": "unbatchable",
"user_name": "WriteToSpanner/make batches/Filtering Batchable
Mutations/ParDo(_BatchableFilterFn).unbatchable"
}
],
"parallel_input": {
"@type": "OutputReference",
"output_name": "None",
"step_name": "s2"
},
"serialized_fn":
"QlpoOTFBWSZTWQ3AWGIAAXl/wP//////+RAAFfuUwr/n//JgwAQAQAG8l3LWxESeUGmg0AADIMgDI0NADQAGgADSE9U2SbTKnlPUxGTQNDEYgDQAAGQyAANIyCkyHqPUzFAZDQMAgANGINGg0DCMNNRDIFNpP1TTQDTQAA0AAADQMQ0PTKc5kkOK5y5lrsufqCCGs53A8gQe5jIAHEUIpeE5TDBBJJu3b9u9cvL+FfLYogCQQSCMJSgSUJRASAE5UtoBUqqt0oPDgfHskIYIYwGvD3TwhQDDHqKK1+VOQrabDCSfXWfEXXUsgdaxgqRTit+kZcmi86b4H/lwgISNMqTBY7ZkYliGgb2KwFSGMIuVbAjXg+xPoCAstkNsQE/YtJN+b1qoUR9L5MOh4K9PNvW2aAYJcEncf7OYxIFJAA1sOkI5AWNedGCbq9VPzVDIsxWjFCYHRCVvCBAlYmeGyZhUDYUoDgQXNEhgEgj9FJDR8B6ZWzj1W9g+mzTioFV6Tiygc/suBEKUGCeSxqHIwoWoICdOeGG4B6pamPWKAWSAycFrEuTTMSKEsKOeXkNKLawxhHTpoEVasmjRQ1ZR+lRwUqUtKwecpzzlNREPQh0ZjnZhmcpCCizYhCif6kMKKJkaJsxOjWFukJleERB8SYpY1EpjggxUBQUzotMlHWMA1lO6BA2aHRhgxIHaVkROYUVKpIUdXhAmr8P7PRJcQT2MFFP+LuSKcKEgG4CwxA==",
"user_name": "WriteToSpanner/make batches/Filtering Batchable
Mutations/ParDo(_BatchableFilterFn)"
}
},
{
"kind": "ParallelDo",
"name": "s4",
"properties": {
"display_data": [
{
"key": "fn",
"label": "Transform Function",
"namespace": "apache_beam.transforms.core.ParDo",
"shortValue": "_BatchFn",
"type": "STRING",
"value": "apache_beam.io.gcp.experimental.spannerio._BatchFn"
}
],
"non_parallel_inputs": {},
"output_info": [
{
"encoding": {
"@type": "kind:windowed_value",
"component_encodings": [
{
"@type":
"FastPrimitivesCoder$QlpoOTFBWSZTWYQR6NMAAEDXwH8QgCEJAEBAv279AmAAIABqEqnqGgaABpoyNAGVHpGgMgDQBk0oR6IeoECBiqqU5NY23ndshzT2UPUOGrg42YPi9VyA8lbwwPJgtghxs5Qq1aWwExCDeMa0RHC2QigTCdizz1nx+LuSKcKEhCCPRpg=",
"component_encodings": [
{
"@type":
"FastPrimitivesCoder$QlpoOTFBWSZTWYQR6NMAAEDXwH8QgCEJAEBAv279AmAAIABqEqnqGgaABpoyNAGVHpGgMgDQBk0oR6IeoECBiqqU5NY23ndshzT2UPUOGrg42YPi9VyA8lbwwPJgtghxs5Qq1aWwExCDeMa0RHC2QigTCdizz1nx+LuSKcKEhCCPRpg=",
"component_encodings": [],
"pipeline_proto_coder_id":
"ref_Coder_FastPrimitivesCoder_3"
},
{
"@type":
"FastPrimitivesCoder$QlpoOTFBWSZTWYQR6NMAAEDXwH8QgCEJAEBAv279AmAAIABqEqnqGgaABpoyNAGVHpGgMgDQBk0oR6IeoECBiqqU5NY23ndshzT2UPUOGrg42YPi9VyA8lbwwPJgtghxs5Qq1aWwExCDeMa0RHC2QigTCdizz1nx+LuSKcKEhCCPRpg=",
"component_encodings": [],
"pipeline_proto_coder_id":
"ref_Coder_FastPrimitivesCoder_3"
}
],
"is_pair_like": true,
"pipeline_proto_coder_id": "ref_Coder_FastPrimitivesCoder_3"
},
{
"@type": "kind:global_window"
}
],
"is_wrapper": true
},
"output_name": "None",
"user_name": "WriteToSpanner/make batches/ParDo(_BatchFn).out"
}
],
"parallel_input": {
"@type": "OutputReference",
"output_name": "None",
"step_name": "s3"
},
"serialized_fn":
"QlpoOTFBWSZTWfdulaQAAWF/wP//////4RAAFfuUwr/n//JgwAQAQAG8juus4ghJkE2kxoBGJgBpoDSYmRjUxojGgAGkTKbJPRpT2qHlNMAgABiYRiZDIAA0aBqYRpUaNPUxlNpABoAABoaAAYg0A9QaaRRPSeSY9KAwRk0yGQAyMjIYhoMgwTLJgGzDCxVoQtjhz2w53U1EA+C+QidhQjQ0ZikoEEk4cP96txfWJvyv3G1QHiQSCNZVBJQlEBIA4Z09gSpVrbKr4IPrvQgwkQFgit1A3FFVp3WcC1dj9arLuaVYmLEe4F37NYY/0eI35fzsrKfT/nLEbNNFFpKOq4Q3EPAeUUkwJ6Am9DpgKiASTFwAdFpUU9nRFwBcYHJhcRQJzSsrberi0msBwE0CRkPyme9ZCWcCEK0s9gO/Dpzh0MnqnvI1OLxlPqjBBNIGMGwdGGQ0SnJWUgEQAU6AywIhCcwYPoNPGxw91NWM7JJhXCZc0oWtfZSgHhzOMWErwdUgoxHNfiHsBEqRLExRCo0MSKFUP7ktggUR4yOayW8UY9qF8I7MnAQ6VBT//6ICE59Bl+0GZwKDJFlVUkqYtJmlREwFAJ2HjCqq0GQ8DFKmZCK0r8xwpsRLpqgUsHEcjHiStoMkawEyJ8KCefrpASotRqDD54HTw+NOTarCB04xHhOSidKsCOW5n/NDNYh17de/jyLuSKcKEh7t0rSA",
"user_name": "WriteToSpanner/make batches/ParDo(_BatchFn)"
}
},
{
"kind": "Flatten",
"name": "s5",
"properties": {
"display_data": [],
"inputs": [
{
"@type": "OutputReference",
"output_name": "unbatchable",
"step_name": "s3"
},
{
"@type": "OutputReference",
"output_name": "None",
"step_name": "s4"
}
],
"output_info": [
{
"encoding": {
"@type": "kind:windowed_value",
"component_encodings": [
{
"@type":
"FastPrimitivesCoder$QlpoOTFBWSZTWYQR6NMAAEDXwH8QgCEJAEBAv279AmAAIABqEqnqGgaABpoyNAGVHpGgMgDQBk0oR6IeoECBiqqU5NY23ndshzT2UPUOGrg42YPi9VyA8lbwwPJgtghxs5Qq1aWwExCDeMa0RHC2QigTCdizz1nx+LuSKcKEhCCPRpg=",
"component_encodings": [
{
"@type":
"FastPrimitivesCoder$QlpoOTFBWSZTWYQR6NMAAEDXwH8QgCEJAEBAv279AmAAIABqEqnqGgaABpoyNAGVHpGgMgDQBk0oR6IeoECBiqqU5NY23ndshzT2UPUOGrg42YPi9VyA8lbwwPJgtghxs5Qq1aWwExCDeMa0RHC2QigTCdizz1nx+LuSKcKEhCCPRpg=",
"component_encodings": [],
"pipeline_proto_coder_id":
"ref_Coder_FastPrimitivesCoder_3"
},
{
"@type":
"FastPrimitivesCoder$QlpoOTFBWSZTWYQR6NMAAEDXwH8QgCEJAEBAv279AmAAIABqEqnqGgaABpoyNAGVHpGgMgDQBk0oR6IeoECBiqqU5NY23ndshzT2UPUOGrg42YPi9VyA8lbwwPJgtghxs5Qq1aWwExCDeMa0RHC2QigTCdizz1nx+LuSKcKEhCCPRpg=",
"component_encodings": [],
"pipeline_proto_coder_id":
"ref_Coder_FastPrimitivesCoder_3"
}
],
"is_pair_like": true,
"pipeline_proto_coder_id": "ref_Coder_FastPrimitivesCoder_3"
},
{
"@type": "kind:global_window"
}
],
"is_wrapper": true
},
"output_name": "out",
"user_name": "WriteToSpanner/make batches/Merging batchable and
unbatchable.out"
}
],
"user_name": "WriteToSpanner/make batches/Merging batchable and
unbatchable"
}
},
{
"kind": "ParallelDo",
"name": "s6",
"properties": {
"display_data": [
{
"key": "fn",
"label": "Transform Function",
"namespace": "apache_beam.transforms.core.ParDo",
"shortValue": "_WriteToSpannerDoFn",
"type": "STRING",
"value":
"apache_beam.io.gcp.experimental.spannerio._WriteToSpannerDoFn"
}
],
"non_parallel_inputs": {},
"output_info": [
{
"encoding": {
"@type": "kind:windowed_value",
"component_encodings": [
{
"@type":
"FastPrimitivesCoder$QlpoOTFBWSZTWYQR6NMAAEDXwH8QgCEJAEBAv279AmAAIABqEqnqGgaABpoyNAGVHpGgMgDQBk0oR6IeoECBiqqU5NY23ndshzT2UPUOGrg42YPi9VyA8lbwwPJgtghxs5Qq1aWwExCDeMa0RHC2QigTCdizz1nx+LuSKcKEhCCPRpg=",
"component_encodings": [
{
"@type":
"FastPrimitivesCoder$QlpoOTFBWSZTWYQR6NMAAEDXwH8QgCEJAEBAv279AmAAIABqEqnqGgaABpoyNAGVHpGgMgDQBk0oR6IeoECBiqqU5NY23ndshzT2UPUOGrg42YPi9VyA8lbwwPJgtghxs5Qq1aWwExCDeMa0RHC2QigTCdizz1nx+LuSKcKEhCCPRpg=",
"component_encodings": [],
"pipeline_proto_coder_id":
"ref_Coder_FastPrimitivesCoder_3"
},
{
"@type":
"FastPrimitivesCoder$QlpoOTFBWSZTWYQR6NMAAEDXwH8QgCEJAEBAv279AmAAIABqEqnqGgaABpoyNAGVHpGgMgDQBk0oR6IeoECBiqqU5NY23ndshzT2UPUOGrg42YPi9VyA8lbwwPJgtghxs5Qq1aWwExCDeMa0RHC2QigTCdizz1nx+LuSKcKEhCCPRpg=",
"component_encodings": [],
"pipeline_proto_coder_id":
"ref_Coder_FastPrimitivesCoder_3"
}
],
"is_pair_like": true,
"pipeline_proto_coder_id": "ref_Coder_FastPrimitivesCoder_3"
},
{
"@type": "kind:global_window"
}
],
"is_wrapper": true
},
"output_name": "None",
"user_name": "WriteToSpanner/Writing to spanner.out"
}
],
"parallel_input": {
"@type": "OutputReference",
"output_name": "out",
"step_name": "s5"
},
"serialized_fn":
"QlpoOTFBWSZTWWzsztoAAs9/wH/////////////+wr/3/+JhwEAC7Id2sCUw0IElMwp+TSan6ifqnpom0aTQDQZHqeo9Rp6jTJ7KE9QwnqNPUaaNDQ21QaJlMKemlPVG1PTQIMmjJpkMIxMjIxMIwEAyGmTRiNNNGnoNT9UqeUaAAAAA0AAGE0AAGIAAZDQH6oAASRTJohNo1TxMp6RtTQaaAAAaAAAAAAAAHpAXzfn0oqSqpsp1LWjmQQwzjnrfWs4abkoqdWfjjyp2MwiID7GGJLbGSRNU0Fb9NajsGoGAkDBzne8x0xs56OT70Cda17yffen0yAIQhAIAGAAAwEgSVdck8dmxlueOpbuXtvd4HFCOQkGRkCECIlEwlAwFkiEZg/i0SdFBrmFH6+NJTXsJLepKAqmQrcSBB4c1SZSwihCDQ3mIN/BowLJxKQx5LtdVnA0C16PTe2r/Pr0xTH54aEHTiHy+/vZwybd/3e23rSeViSpJrXVCXefmlw2HZ8klDck2u66fuZ8evnWACud5jbkiUJPTPyexHazxaLumsiWpPBUNH8QAKrARRQBbTomDIjOYQET+1TBXywQy70/7H8qm/Do5ac4/7EAvFALWAr3fOmHi1d3jeovcGG1m1g0EUQgEbIyauDHBPOqmZovLbONkTA4QAhNcdXrW9lrQkgQAmMbdERXTOxzXnyWPsbKKXFCycBLBEuQdoYZ2vOwPZTqZozFZMTKBEfeDDMGDCGAkV121MQiqVKrNCdj09ytJUysFVpFtkQYNI1QR0YJ1bumUzngQrexNfOfSX1Oh/1J1n6tGQIVY78MQ7Dv3ZUNGMnZwCDGOCdMsy4yGswVpUUdFiJOYiRSiwA2YSHTQAdxqMJBTKIWBnTMjPMpVjqs50k2SExeaBdtrBPhKCOstMrVKa9WhZQcNTdLYJitF5vFelMPn57Zqm1BLpWjFr2Ny7XznJwEXMN3/YxJHb2FVER9NLURKhvtWio+LzWCTvVVS2s6JOdJESCmYAMqyrNC4RikZGjMLR0iZZuhRKRHFChsc7qExK7jLqskxGi8KHUnEwqnA1smB5koMONUOjpiSk8E1BQRkoxwbZUTthO1CBx/Mzm39NQqAQOZJyiK8mmPpCx/mVnimqJ7OYKontbRMlUkqG+Qdk4wGy3BzYpsfY/pgsU3NimmoW/+LuSKcKEg2dmdtAA==",
"user_name": "WriteToSpanner/Writing to spanner"
}
}
],
"type": "JOB_TYPE_BATCH"
}
apache_beam.runners.dataflow.internal.apiclient: INFO: Create job: <Job
createTime: '2020-08-20T00:14:32.315420Z'
currentStateTime: '1970-01-01T00:00:00Z'
id: '2020-08-19_17_14_31-5760546762468696125'
location: 'us-central1'
name: 'beamapp-jenkins-0820001420-652281'
projectId: 'apache-beam-testing'
stageStates: []
startTime: '2020-08-20T00:14:32.315420Z'
steps: []
tempFiles: []
type: TypeValueValuesEnum(JOB_TYPE_BATCH, 1)>
apache_beam.runners.dataflow.internal.apiclient: INFO: Created job with id:
[2020-08-19_17_14_31-5760546762468696125]
apache_beam.runners.dataflow.internal.apiclient: INFO: Submitted job:
2020-08-19_17_14_31-5760546762468696125
apache_beam.runners.dataflow.internal.apiclient: INFO: To access the Dataflow
monitoring console, please navigate to
https://console.cloud.google.com/dataflow/jobs/us-central1/2020-08-19_17_14_31-5760546762468696125?project=apache-beam-testing
--------------------- >> end captured logging << ---------------------
----------------------------------------------------------------------
XML: nosetests-postCommitIT-df-py35.xml
----------------------------------------------------------------------
XML:
<https://ci-beam.apache.org/job/beam_PostCommit_Python35/ws/src/sdks/python/nosetests.xml>
----------------------------------------------------------------------
Ran 66 tests in 3791.548s
FAILED (SKIP=7, errors=1, failures=2)
> Task :sdks:python:test-suites:dataflow:py35:postCommitIT FAILED
FAILURE: Build failed with an exception.
* Where:
Script
'<https://ci-beam.apache.org/job/beam_PostCommit_Python35/ws/src/sdks/python/test-suites/dataflow/common.gradle'>
line: 118
* What went wrong:
Execution failed for task ':sdks:python:test-suites:dataflow:py35:postCommitIT'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug
option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with
Gradle 6.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See
https://docs.gradle.org/5.2.1/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 1h 5m 49s
153 actionable tasks: 117 executed, 34 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/4yclqu5igislm
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
