See
<https://ci-beam.apache.org/job/beam_PostCommit_Python36/2825/display/redirect?page=changes>
Changes:
[chamikaramj] Include coders embedded in CombinePayload when converting x-lang
[kevinsijo] [BEAM-9919] Refining xlang types and wrappers
[Luke Cwik] [BEAM-9979] Support a reset call that happens after the bundle is
done
[noreply] [BEAM-10200] Add optional experiment to enable heap dump through the …
[kevinsijo] [BEAM-9919] xlang transforms wrapped with namespaces
[kevinsijo] [BEAM-9919] cleaning namespace.go
------------------------------------------
[...truncated 22.47 MB...]
"user_name": "assert_that/Group/GroupByKey"
}
},
{
"kind": "ParallelDo",
"name": "s10",
"properties": {
"display_data": [
{
"key": "fn",
"label": "Transform Function",
"namespace": "apache_beam.transforms.core.ParDo",
"shortValue": "CallableWrapperDoFn",
"type": "STRING",
"value": "apache_beam.transforms.core.CallableWrapperDoFn"
},
{
"key": "fn",
"label": "Transform Function",
"namespace": "apache_beam.transforms.core.CallableWrapperDoFn",
"type": "STRING",
"value": "_merge_tagged_vals_under_key"
}
],
"non_parallel_inputs": {},
"output_info": [
{
"encoding": {
"@type": "kind:windowed_value",
"component_encodings": [
{
"@type":
"FastPrimitivesCoder$QlpoOTFBWSZTWYQR6NMAAEDXwH8QgCEJAEBAv279AmAAIABqEqnqGgaABpoyNAGVHpGgMgDQBk0oR6IeoECBiqqU5NY23ndshzT2UPUOGrg42YPi9VyA8lbwwPJgtghxs5Qq1aWwExCDeMa0RHC2QigTCdizz1nx+LuSKcKEhCCPRpg=",
"component_encodings": [
{
"@type":
"FastPrimitivesCoder$QlpoOTFBWSZTWYQR6NMAAEDXwH8QgCEJAEBAv279AmAAIABqEqnqGgaABpoyNAGVHpGgMgDQBk0oR6IeoECBiqqU5NY23ndshzT2UPUOGrg42YPi9VyA8lbwwPJgtghxs5Qq1aWwExCDeMa0RHC2QigTCdizz1nx+LuSKcKEhCCPRpg=",
"component_encodings": [],
"pipeline_proto_coder_id":
"ref_Coder_FastPrimitivesCoder_4"
},
{
"@type":
"FastPrimitivesCoder$QlpoOTFBWSZTWYQR6NMAAEDXwH8QgCEJAEBAv279AmAAIABqEqnqGgaABpoyNAGVHpGgMgDQBk0oR6IeoECBiqqU5NY23ndshzT2UPUOGrg42YPi9VyA8lbwwPJgtghxs5Qq1aWwExCDeMa0RHC2QigTCdizz1nx+LuSKcKEhCCPRpg=",
"component_encodings": [],
"pipeline_proto_coder_id":
"ref_Coder_FastPrimitivesCoder_4"
}
],
"is_pair_like": true,
"pipeline_proto_coder_id": "ref_Coder_FastPrimitivesCoder_4"
},
{
"@type": "kind:global_window"
}
],
"is_wrapper": true
},
"output_name": "None",
"user_name":
"assert_that/Group/Map(_merge_tagged_vals_under_key).out"
}
],
"parallel_input": {
"@type": "OutputReference",
"output_name": "out",
"step_name": "s9"
},
"serialized_fn":
"QlpoOTFBWSZTWbG03PUABAt/7H//////////////////////wQABIAAEAFAEV6pMNpSC5huiJqaNETRpoAaDJoekBgnqAyNANNGRoMjQaDTRo0ANMjIZBoZBoQQaTKbTRMp5GhMRoaaAD1NNAZDIBoA0NADRoaNAeobUA2RDKf5I9UeU0TGpk00aAAxAGmhoAAAyGgyDIGhoyDIAAABBpiYBMATBGmmAATACaGhiYAAAABGEYBGmJkMASKJkCCekZFHqbaJ6ZTUPSekeoaZA09QANAD1NpAAAA0A0aAAOwatEnOFg4zOCRK7kFGjXGxlnupXUwhEbxRrlmu3mOfpzPC/isBC4db5oiPID2/e6Z40kB9Liw5DSt4ufCC06EWv9mRauf7HTsMNd/Eoi+VEBKiChat1aWlI/TNJBdrcGolzQD191L95hTRgkaKOkSnOalRFxB70aKE4URFkKSTpoFRnp2bOor6ArIRhqOp9ls03ACEyPQNJEQzM5ERUajMg1EG5MNaEREK1PRa0CAwV8BSliy2Y2JpmOtZsbig/kdAuv6n57W3SGwp+ytFGYUgqzRI8Am23v5lJRsTUE1pr01ZUqCSjwsqTXRTNp53x2N3qRjIVnTg9wcF1zZ0qSMByBmCwFCXGAhUgZaJQnnCcFcqMUESM8LbIajQOa06BUWyopVosklkKexK+F2RA+ZKIX2NZtGJge7zvySCcBBCBBfbuw1bwm0mVLmeuG5xVybIU9EGiAOJrcphiKZKB8KdnA8UjyN+Gu18+PE/pcbpcRX0XnX1Z9CWW3lP/M8DoPc8tUuKjIDtmppyJP0Ul/XnHAK8i16V+RsQw7KJEAWZuiUH+ViAnu6b72agfUuGwpVhjYVo1AsOUkYQsaHLnhEuhSYuCVx/SviVaw1Flwikqbbf2KEbiqPv2JTDNkHqCyuqGbLTJ8iE4kxWRvxFOgGJHb0bjr3OtfH5wtKhEhEEnYAmNFFbFZBV5lLbsu33HflOicjyETgVUlEHhONtQZeMQqXGWypZp6WZIykh87EJWqip5pQLfUlG+65nAKmmyHBEj3BcgaiP0ViJFCAmCmsZdwryPh1BWUdF1YgFCpeiJGR44WhNgr1wHkWtQF/9T2R6Gph/i1+dnn7b7ut0sLAIhWmDuSutFt6JaoUEQTNxlG0dQ3YdZl0Cp5J0HBb1mBcjHY7hQk84rliUZ5ELOZ4aE68l5PdyOusXVMVk3V/NpbMkphBwOFNIrxwFxweK2o0tRTVBMliQW9GYFrpopdIaTacYClHthtMVCB0MHv8y4L0L5e2rlQqyAnPXki7KsCCg1Z8Sanr4GsGnhhrrTSOZ3ARJhIjMwga0NENSPelXLH1sp55Yq5WcxHTxrz8xsL0kC3QXekxNivNTqCqRycAB3hGQYFU7oUUJxVBadZBOM2ogp2CKAOAL1xEoVENKdIiTFZJGM2ZNG5MTmQskuBCZEzERVaODNTGERPpRjKOTBq2lTewPHohOSDe2ZWJrWTmqTKir43JCtz1buUnOtmjGttS2YBFcpQInOs1L9F2dVoIcSsWEKLxhNXHF3WKRBNHhWyV6+tOcS23VI7ddZTdrBtiqDcprvTGOXPufLGOe/qWCmnZG4LDLRcpsw/7/323y/sWcq9kI5lRbAp43eAJhKGNFCEppmHeoHmo+R5LapMRLhx4RkZhUFASA4IZgMb5V4PiIPSw9TrXHq26JkjvRAt1SGqy1DBZDeEAQkjhiRaGInS/5LdzM3y7+C5qDDvNXWwdf25GK6geTSpyl/xdyRThQkLG03PUA=",
"user_name": "assert_that/Group/Map(_merge_tagged_vals_under_key)"
}
},
{
"kind": "ParallelDo",
"name": "s11",
"properties": {
"display_data": [
{
"key": "fn",
"label": "Transform Function",
"namespace": "apache_beam.transforms.core.ParDo",
"shortValue": "CallableWrapperDoFn",
"type": "STRING",
"value": "apache_beam.transforms.core.CallableWrapperDoFn"
},
{
"key": "fn",
"label": "Transform Function",
"namespace": "apache_beam.transforms.core.CallableWrapperDoFn",
"type": "STRING",
"value": "<lambda>"
}
],
"non_parallel_inputs": {},
"output_info": [
{
"encoding": {
"@type": "kind:windowed_value",
"component_encodings": [
{
"@type":
"FastPrimitivesCoder$QlpoOTFBWSZTWYQR6NMAAEDXwH8QgCEJAEBAv279AmAAIABqEqnqGgaABpoyNAGVHpGgMgDQBk0oR6IeoECBiqqU5NY23ndshzT2UPUOGrg42YPi9VyA8lbwwPJgtghxs5Qq1aWwExCDeMa0RHC2QigTCdizz1nx+LuSKcKEhCCPRpg=",
"component_encodings": [
{
"@type":
"FastPrimitivesCoder$QlpoOTFBWSZTWYQR6NMAAEDXwH8QgCEJAEBAv279AmAAIABqEqnqGgaABpoyNAGVHpGgMgDQBk0oR6IeoECBiqqU5NY23ndshzT2UPUOGrg42YPi9VyA8lbwwPJgtghxs5Qq1aWwExCDeMa0RHC2QigTCdizz1nx+LuSKcKEhCCPRpg=",
"component_encodings": [],
"pipeline_proto_coder_id":
"ref_Coder_FastPrimitivesCoder_4"
},
{
"@type":
"FastPrimitivesCoder$QlpoOTFBWSZTWYQR6NMAAEDXwH8QgCEJAEBAv279AmAAIABqEqnqGgaABpoyNAGVHpGgMgDQBk0oR6IeoECBiqqU5NY23ndshzT2UPUOGrg42YPi9VyA8lbwwPJgtghxs5Qq1aWwExCDeMa0RHC2QigTCdizz1nx+LuSKcKEhCCPRpg=",
"component_encodings": [],
"pipeline_proto_coder_id":
"ref_Coder_FastPrimitivesCoder_4"
}
],
"is_pair_like": true,
"pipeline_proto_coder_id": "ref_Coder_FastPrimitivesCoder_4"
},
{
"@type": "kind:global_window"
}
],
"is_wrapper": true
},
"output_name": "None",
"user_name": "assert_that/Unkey.out"
}
],
"parallel_input": {
"@type": "OutputReference",
"output_name": "None",
"step_name": "s10"
},
"serialized_fn":
"QlpoOTFBWSZTWTipuGkAAs//wH///////////////////+ZrwFADNm2yYKRNw1NFMptQD1DajT0jagAaAA0PUGg0aAZHqADGoAaA9TRpp6gCUSaGgQNNI2k9JoaQNAAAAAADQADQBkyA0AMgNNE0IqflNqnqGh6jRtQ0B6gAGgANGgAAAABoDR6jaQGiDACYAAAEwAJgAAATACaGAAAAAAAgwAmAAABMACYAAAEwAmhgAAAAAAdxc/RkKyq6uxLdu9fynXK88TZyRtfFognaAHwVDqGBiCHAqAdvJKuQM57nsDgZRH8x6miqhf2w+JYYyqCQhZVHwv381vsEvhXLHC/EH0VISkgqVOeTxlWJJNooDkisBHCCMcgcgA/DHPu3EIJvivMiFEYb6OvuUAfhaADIQFGM3btVBVqVnzhqIRtYUYKPmaQjnxyOFTrCkgIBpUZZQbbHvNpI5gXGgpoOYWNclGsGX0BAYXyyojWzJQwUbgMjqoDJIgTnkPtTDgBBlmNE15F21bc0pvJ7GV686otfCyQazvkVauNaOSpEGPHa26FTzknWkzJZNzUtWa0OleXvnMHxlCPnhgHsVJ1CIOtdTdXewElkGUSJq3aXIg83iIDBVA656wE4+fvQzagElXUOUEjYCQTdDWSmhYlpYBAaHhWsOQQUheS805KTYdp9ub946u1f6GdHAWp2CDJoSdWPJ+Smm2PuqjiiYqJCJikQRxQUF+kY4pKh/Hg6QhjjRbAJEj0C+CL6NbI70BBQ/FDmjy2sl4jecRkBaKJFrS0CPGyjRyPQ3AhPPe0NLQk0cGl8cHV0/rdEMScyy6FNTaAa8CKVKNxjxmQxpextsD2UWFYmXHWN7YCPICwWTWIJk65lKyUYRcu44TFUJQ5l2aHDkvYUCbBDacWWw4pEQ9gSjgRRIs6CsooNZuBVRQcIrVBcysR7mUx6R4cMBX2oV75KJeuQZxBTMqTF0siH7BgpEpbffdiS4So3mpqQPF3Vz42f02sEJwrlRbw/9CFUmxXV6WnGqmWjgsTalQUrzlL9NVpNBM5Ri8TiTDvBZGjQNQzKq2TZna5ZbrEyQQl65q5gpYhjcEvaYIBiXZQk4u2xqUfSqjC8PzTbxQ4TJERtQ00gpRO8teIfGCg8VpSw2KK2QjbYZUmAIEeswksjkg6JxB/Z2Y0JVkerhGXsKQKZmrpyy3nZkZaZNHfLFYu14inQZ4qdMEdSCRiIKAXQipY6zvf+/1KuYPZj34nT3YrOL9O1BOfffx5apfQu5IpwoSBxU3DS",
"user_name": "assert_that/Unkey"
}
},
{
"kind": "ParallelDo",
"name": "s12",
"properties": {
"display_data": [
{
"key": "fn",
"label": "Transform Function",
"namespace": "apache_beam.transforms.core.ParDo",
"shortValue": "CallableWrapperDoFn",
"type": "STRING",
"value": "apache_beam.transforms.core.CallableWrapperDoFn"
},
{
"key": "fn",
"label": "Transform Function",
"namespace": "apache_beam.transforms.core.CallableWrapperDoFn",
"type": "STRING",
"value": "_equal"
}
],
"non_parallel_inputs": {},
"output_info": [
{
"encoding": {
"@type": "kind:windowed_value",
"component_encodings": [
{
"@type":
"FastPrimitivesCoder$QlpoOTFBWSZTWYQR6NMAAEDXwH8QgCEJAEBAv279AmAAIABqEqnqGgaABpoyNAGVHpGgMgDQBk0oR6IeoECBiqqU5NY23ndshzT2UPUOGrg42YPi9VyA8lbwwPJgtghxs5Qq1aWwExCDeMa0RHC2QigTCdizz1nx+LuSKcKEhCCPRpg=",
"component_encodings": [
{
"@type":
"FastPrimitivesCoder$QlpoOTFBWSZTWYQR6NMAAEDXwH8QgCEJAEBAv279AmAAIABqEqnqGgaABpoyNAGVHpGgMgDQBk0oR6IeoECBiqqU5NY23ndshzT2UPUOGrg42YPi9VyA8lbwwPJgtghxs5Qq1aWwExCDeMa0RHC2QigTCdizz1nx+LuSKcKEhCCPRpg=",
"component_encodings": [],
"pipeline_proto_coder_id":
"ref_Coder_FastPrimitivesCoder_4"
},
{
"@type":
"FastPrimitivesCoder$QlpoOTFBWSZTWYQR6NMAAEDXwH8QgCEJAEBAv279AmAAIABqEqnqGgaABpoyNAGVHpGgMgDQBk0oR6IeoECBiqqU5NY23ndshzT2UPUOGrg42YPi9VyA8lbwwPJgtghxs5Qq1aWwExCDeMa0RHC2QigTCdizz1nx+LuSKcKEhCCPRpg=",
"component_encodings": [],
"pipeline_proto_coder_id":
"ref_Coder_FastPrimitivesCoder_4"
}
],
"is_pair_like": true,
"pipeline_proto_coder_id": "ref_Coder_FastPrimitivesCoder_4"
},
{
"@type": "kind:global_window"
}
],
"is_wrapper": true
},
"output_name": "None",
"user_name": "assert_that/Match.out"
}
],
"parallel_input": {
"@type": "OutputReference",
"output_name": "None",
"step_name": "s11"
},
"serialized_fn":
"QlpoOTFBWSZTWch/hJYABFH/9n///////////////////////QABgYAQABARUAT29sbrZ7c6aKInjcImiIPUQbUNNA9TQyaGRoaGjQNNGhoAGg0BkAAAGmgaNAAaZA1NEGlPEwTSntQHqnk1BhMAJk00GQwEBkBkYABNBhNGgMRjU0MmGgjRAhNGhlPSaGmhoepoA0ANAGgGgAAABoaGg0AAAAIBoyZNMEwjExMJpphGRgAEMAhppowQMEaGCaGRgAAAAShAjUm00SbBDSTPSe1T1I00NPUaGI0A9Q0HqAD1GgAGIGgeoPSeo0aAB4yhlRZ+lIiKigfQd5ySg0SkTVLNUghZ5jdCrVooloqFLqWWSfJ87V5rLXlK8mpnEAiIxqb0L3TIskxvibqheMu6CggTAxfqibe2wS5qlHnPtKmJROoWqTe+DMXokelWh5k6lXeMGHflGcTn6dYIJilVCCBEGIYCG5Rz4HC+0n2IoDRkoiVCdZZoD35D4rIol+/aWmdBe+YTxmaEBhZTPWxCTIjLhSyuYye97yKFc7TPoiJIlOisxvBRInzDOPgwD1VWJ2Rk5PpXJBRFgKxuO987n2aCjQCu6EFIkQdlyq4IhnbJuFVUclVUZJnMubtVZ2YZhUpZWCSs7b514vRwm+2t1XzVelopU56csAQYkw0oEGN2vK0Fd6/cmvst0kvZ1lsxVzYqQFMB1mvcYoEMgANjdPxXqgq8BW/ejOUD7QowpumyUFMChLKRk671xg2FKfnFawHUwfqBlSOGFicj8PvmoF9p1dbsh3EEfZ0TOgcGSoegOPxC+nxQVIjVC/uDIHgwCiMYg3XSRFZL+VPmaqiGdcPiACGBgwtWm2VfUk0WeV9kuXFOkyFPBmgRQ7GlAiRCKtNaNZVVnym696YhXzS15W5onDprfK9X/Z3sYi+H370ArT+9LfY41jddlJ0rFFxy0gV2/TsUzjydoOYqE7MS6mjiGgPGvyt8d3MGxCQTZomrIhi64sPa3BFCJu56RgYkRWCbZ8KeZGRA0O7HkIWwRZZeL5OivLiyVi1IJMuXD0RJSFUVdYZy25Nf5s0fEVY09+POppGC5o4ikQuDerCu2VUDfK+eSGdjn9UXvOoBJYtMBANKMgmBKYnEvExATUgm9ceo7VDJqAOaChPhF2utlRKhN+VhQqirdWOqWcEag4B+xAzx4ghmHi1iG0pNHyUSUUzqhPpxnKziFU0fT9gTCRF86tWQzmxg0UrXIcJVeJAwWMiJXMGLkTvcYqrOCc8XJQFKPfhCMgnxuHr/h/eWz7X7e91dLi1YhDUfvi71pjBjT1YUhDM8EY7JSGQtmVscDU1d0HZT6lYIWWq9cU2edtXwv5tyFgYDEVS0ETEoljnDvAFr08IufTp1UtScI5QpYG76zCZxMDJkOspEWCR20pPYTWrsRFAkDVQUKsicqgZQetEJBaZmYYGB7ccZWVFCYivBQU1ONkneCrlVnCiOJjAsFwwQu5S4JG3HGjrCEtSpUquLQXhDcQY5CDaCqpfnKRfdfx3ezOCbGzuRcS/nmTa7ePnq4rSwpyTSWOW51EFzD0sNMGhWhSnkpTkosJGutR9JEVTQ721oXWn1FoiqUzTc+BLdyV7q5Mql2htIiTnGRMssskYtE8zKHvrAPWJz2VlVURGiqvW2pXVAiZ4+CkrgWlXM30wMqpLRDWDSp91YoGTJcnC4kZ9ozChx7ZnkYCxG1mRxsDjrLfx1vxcMwFIk26pBLRrhG2XjSocujaMXvXKCAoMY7//vbJ6s5rrgJiUyJbcC0YSFHzLKgiIxwzBVgJMiQwGkpEfSOnuien9k7aK9sNXFI6YPk8hgGkB4VDxlyEyWZIKDxNqptGQ00iOkcbkyw++F3mg0whQppwsodcFOmL9GmMF+eo5UgjEQpgYQcLMB8Ypn/GtIZv+YDYab2o0tvMkJv7/pKjPI8OeNFR5Qh+vHcm3UAmIVJAVFPLLVpJkyKAlYR5BX0MtLPUTo4SPR+Jo0eSdtZLma9gfX/i3IknEV5xdkxP8XckU4UJDIf4SW",
"user_name": "assert_that/Match"
}
}
],
"type": "JOB_TYPE_BATCH"
}
apache_beam.runners.dataflow.internal.apiclient: INFO: Create job: <Job
createTime: '2020-08-20T00:46:15.178781Z'
currentStateTime: '1970-01-01T00:00:00Z'
id: '2020-08-19_17_46_13-17699990660033597932'
location: 'us-central1'
name: 'beamapp-jenkins-0820004605-677561'
projectId: 'apache-beam-testing'
stageStates: []
startTime: '2020-08-20T00:46:15.178781Z'
steps: []
tempFiles: []
type: TypeValueValuesEnum(JOB_TYPE_BATCH, 1)>
apache_beam.runners.dataflow.internal.apiclient: INFO: Created job with id:
[2020-08-19_17_46_13-17699990660033597932]
apache_beam.runners.dataflow.internal.apiclient: INFO: Submitted job:
2020-08-19_17_46_13-17699990660033597932
apache_beam.runners.dataflow.internal.apiclient: INFO: To access the Dataflow
monitoring console, please navigate to
https://console.cloud.google.com/dataflow/jobs/us-central1/2020-08-19_17_46_13-17699990660033597932?project=apache-beam-testing
--------------------- >> end captured logging << ---------------------
----------------------------------------------------------------------
XML: nosetests-postCommitIT-df-py36.xml
----------------------------------------------------------------------
XML:
<https://ci-beam.apache.org/job/beam_PostCommit_Python36/ws/src/sdks/python/nosetests.xml>
----------------------------------------------------------------------
Ran 66 tests in 3728.378s
FAILED (SKIP=7, errors=2, failures=5)
> Task :sdks:python:test-suites:dataflow:py36:postCommitIT FAILED
FAILURE: Build failed with an exception.
* Where:
Script
'<https://ci-beam.apache.org/job/beam_PostCommit_Python36/ws/src/sdks/python/test-suites/dataflow/common.gradle'>
line: 118
* What went wrong:
Execution failed for task ':sdks:python:test-suites:dataflow:py36:postCommitIT'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug
option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with
Gradle 6.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See
https://docs.gradle.org/5.2.1/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 1h 4m 26s
153 actionable tasks: 117 executed, 34 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/rxsxjcqd5gw3i
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
