See
<https://ci-beam.apache.org/job/beam_PostCommit_Python37/2738/display/redirect?page=changes>
Changes:
[chamikaramj] Include coders embedded in CombinePayload when converting x-lang
[kevinsijo] [BEAM-9919] Refining xlang types and wrappers
[Luke Cwik] [BEAM-9979] Support a reset call that happens after the bundle is
done
[noreply] [BEAM-10200] Add optional experiment to enable heap dump through the …
[kevinsijo] [BEAM-9919] xlang transforms wrapped with namespaces
[kevinsijo] [BEAM-9919] cleaning namespace.go
------------------------------------------
[...truncated 22.35 MB...]
"user_name": "assert_that/Group/GroupByKey"
}
},
{
"kind": "ParallelDo",
"name": "s23",
"properties": {
"display_data": [
{
"key": "fn",
"label": "Transform Function",
"namespace": "apache_beam.transforms.core.ParDo",
"shortValue": "CallableWrapperDoFn",
"type": "STRING",
"value": "apache_beam.transforms.core.CallableWrapperDoFn"
},
{
"key": "fn",
"label": "Transform Function",
"namespace": "apache_beam.transforms.core.CallableWrapperDoFn",
"type": "STRING",
"value": "_merge_tagged_vals_under_key"
}
],
"non_parallel_inputs": {},
"output_info": [
{
"encoding": {
"@type": "kind:windowed_value",
"component_encodings": [
{
"@type":
"FastPrimitivesCoder$QlpoOTFBWSZTWYQR6NMAAEDXwH8QgCEJAEBAv279AmAAIABqEqnqGgaABpoyNAGVHpGgMgDQBk0oR6IeoECBiqqU5NY23ndshzT2UPUOGrg42YPi9VyA8lbwwPJgtghxs5Qq1aWwExCDeMa0RHC2QigTCdizz1nx+LuSKcKEhCCPRpg=",
"component_encodings": [
{
"@type":
"FastPrimitivesCoder$QlpoOTFBWSZTWYQR6NMAAEDXwH8QgCEJAEBAv279AmAAIABqEqnqGgaABpoyNAGVHpGgMgDQBk0oR6IeoECBiqqU5NY23ndshzT2UPUOGrg42YPi9VyA8lbwwPJgtghxs5Qq1aWwExCDeMa0RHC2QigTCdizz1nx+LuSKcKEhCCPRpg=",
"component_encodings": [],
"pipeline_proto_coder_id":
"ref_Coder_FastPrimitivesCoder_3"
},
{
"@type":
"FastPrimitivesCoder$QlpoOTFBWSZTWYQR6NMAAEDXwH8QgCEJAEBAv279AmAAIABqEqnqGgaABpoyNAGVHpGgMgDQBk0oR6IeoECBiqqU5NY23ndshzT2UPUOGrg42YPi9VyA8lbwwPJgtghxs5Qq1aWwExCDeMa0RHC2QigTCdizz1nx+LuSKcKEhCCPRpg=",
"component_encodings": [],
"pipeline_proto_coder_id":
"ref_Coder_FastPrimitivesCoder_3"
}
],
"is_pair_like": true,
"pipeline_proto_coder_id": "ref_Coder_FastPrimitivesCoder_3"
},
{
"@type": "kind:global_window"
}
],
"is_wrapper": true
},
"output_name": "None",
"user_name":
"assert_that/Group/Map(_merge_tagged_vals_under_key).out"
}
],
"parallel_input": {
"@type": "OutputReference",
"output_name": "out",
"step_name": "s22"
},
"serialized_fn":
"QlpoOTFBWSZTWbcxGGkABAr//H//////////////////////wQABYAAgAAQAUARea92Q9g0GqDBoRNEaSep4k9TRkbETxRp6mwp6QGTTQ0PKPUNGnqZA0BoNqaB6h6aJ6T9U9QepsUIqm9U0xM0TTRpmo0NNNMjRpgEyGmmTEMjEyMmmjCNGjTEDBMTEGmmnkCJPRPSNI1NqaAAANAAA0ADIaA0AAAAAAAAAAKnpKaNMJoaZMCNAMjEMAIGQAMmCaYEZGCMABB6jQGjJoGJBAEZASn6TyGFNI9JtR6gekDTQANAD1NqaAADQGg00AAbU04E75DRQOWq0prjZqGGDBmGe2yjDdvicVyGt9t/FJCiXHfkFVs4BB4MfzuBHlAe78HUHkQIA6SciRPw85mNryJ1+6OF/SCDIylMBcYkR8Edw4AZAhBk/RCJB645gcoI6A5U0BYQifEC5spKf6iZH1wHHf0hCIjEwe5OAW657yme4HEJBBSPDqwrFFepPkIgoQywEgh9L4tWMiEIwBAdwDODGAABwYycIkAIFfognmGMCIiE9CRa0CAwUYCLDgU2puRXMVdnmTojnO7JZH4/bZ0SAZTH3DqfnBgBLncHd+Ckku1zmBdOUWKN4+uZ5S8QLvTQlKA6BWytK2kEqZAgg0w/BlthMevW31r7ehmBkaAKJY/Ga3YZBNQtoaCK+YoNlLytMmXriTcBpTbk5SoIxnIHe/MdVQ84ml7VglbbMTJjsFPxZv2cDwIxoVafh0ZutpTvrY2Nq1yMvlQpeMcqkMloUPvPUw/JRzWl6T2eOrR9vu1P1C7mfreW7Z9fvoavX1a2HEXcsqkbFTZWEq1+pwXPNe1x87UqVWsfxRTN6iA8MoNJVQpxMPRRHQAaFTmODEGeAyc9ZhOGIMHQp+c79clIEhBANHFsBNSDWRuAnnyC3mwsH+moEzG5KJ7ARIJUkl95Z1gld8U5dBKE3yh5u3vOtxmUkVFuTCuWk1TDkV9Xo8VGXofr0+pPE3qWJDVbQvpnHqjXYZPFw9jDFLQtk1U0NIxNAOQuIkFSjrDNxg0p4x2DDPG7nJGYQC5loJoL5Vngwo9aDqlNEc0GTHCfQLkm/QwizS4HilnCYwGN48biPGr7vWGu5YKNcgOGtlFKNbrmhaEx9i4oDaLWoCPaOUfsek1nrcvU4u27uReFIIhiYIdmFyAdGqGIB4cAUNtB+yP0G42vm1Ayckc9MeVPWePgFgNEFpBsNpdHCQdI0tqKmw0lbmFTTA6yBnipf8oFERAxAZMOAokTYGB2gFbRKLt8xLxEQtIFHqRAFCkfIpALqRTmBg7uAkUC8gJ6AW9v2AUtUKdmwvMwYFRyQIszGsgPGKPCUY5K0a71xshvEjf7oBwiGpWWWAQIgIFR7dUaVNYfsBKUBIwMxcWnA/nIRKTEMoaZjeFdDth21BqYzRxpTdhF07lS/ltPkmalXrlaN21lDps06mSlkjFcpIZZkCJAvQVBi23IwnbJ1PQSspBE8ERdORx4k5xEWXhzwdhrxUCVLKFg1NGBA5WxCco4yomQZiJeioEGjTLuZhGMyGrAdBhsMA47pYOHMnv1Ps0mYgNwmc3AH0i4MWBysnMAxRHiUQNNRvRcKKMQdommElmMDQDKBtyTUxCChzrF24QUd6/ODEqd1gE4zPsMULn/db7qhVln3acJV91PXGwb20L4tEIi9Ob9+CysJItKV4MchgzcSr0opCtwMhQJkY/Tbf8euYpK0+xrwlv57bHEstKk3zh51Fg358QgYwHzqKQw6/h3E3LtPKXHfXbQk8D+3se/8cyY7EPpRcLCkYJf8XckU4UJC3MRhpA==",
"user_name": "assert_that/Group/Map(_merge_tagged_vals_under_key)"
}
},
{
"kind": "ParallelDo",
"name": "s24",
"properties": {
"display_data": [
{
"key": "fn",
"label": "Transform Function",
"namespace": "apache_beam.transforms.core.ParDo",
"shortValue": "CallableWrapperDoFn",
"type": "STRING",
"value": "apache_beam.transforms.core.CallableWrapperDoFn"
},
{
"key": "fn",
"label": "Transform Function",
"namespace": "apache_beam.transforms.core.CallableWrapperDoFn",
"type": "STRING",
"value": "<lambda>"
}
],
"non_parallel_inputs": {},
"output_info": [
{
"encoding": {
"@type": "kind:windowed_value",
"component_encodings": [
{
"@type":
"FastPrimitivesCoder$QlpoOTFBWSZTWYQR6NMAAEDXwH8QgCEJAEBAv279AmAAIABqEqnqGgaABpoyNAGVHpGgMgDQBk0oR6IeoECBiqqU5NY23ndshzT2UPUOGrg42YPi9VyA8lbwwPJgtghxs5Qq1aWwExCDeMa0RHC2QigTCdizz1nx+LuSKcKEhCCPRpg=",
"component_encodings": [
{
"@type":
"FastPrimitivesCoder$QlpoOTFBWSZTWYQR6NMAAEDXwH8QgCEJAEBAv279AmAAIABqEqnqGgaABpoyNAGVHpGgMgDQBk0oR6IeoECBiqqU5NY23ndshzT2UPUOGrg42YPi9VyA8lbwwPJgtghxs5Qq1aWwExCDeMa0RHC2QigTCdizz1nx+LuSKcKEhCCPRpg=",
"component_encodings": [],
"pipeline_proto_coder_id":
"ref_Coder_FastPrimitivesCoder_3"
},
{
"@type":
"FastPrimitivesCoder$QlpoOTFBWSZTWYQR6NMAAEDXwH8QgCEJAEBAv279AmAAIABqEqnqGgaABpoyNAGVHpGgMgDQBk0oR6IeoECBiqqU5NY23ndshzT2UPUOGrg42YPi9VyA8lbwwPJgtghxs5Qq1aWwExCDeMa0RHC2QigTCdizz1nx+LuSKcKEhCCPRpg=",
"component_encodings": [],
"pipeline_proto_coder_id":
"ref_Coder_FastPrimitivesCoder_3"
}
],
"is_pair_like": true,
"pipeline_proto_coder_id": "ref_Coder_FastPrimitivesCoder_3"
},
{
"@type": "kind:global_window"
}
],
"is_wrapper": true
},
"output_name": "None",
"user_name": "assert_that/Unkey.out"
}
],
"parallel_input": {
"@type": "OutputReference",
"output_name": "None",
"step_name": "s23"
},
"serialized_fn":
"QlpoOTFBWSZTWfqe4EEAAs//wH///////////////////+ZrwFADNm0ZjWkTcNTRJo0ho0ME9EeoYgaGgGmmQA0DQaGgAwgMIZNNMhoAlEQaaBDTSmekyJmkDQAAAAAAAANAGgAABoDTRNEKn5U/Kn6oaHqNG9UAHqAA0AA0aAAAAAAGh6h6QGiDACYAAAEwAJgAAATACaGAAAAAAAgwAmAAABMACYAAAEwAmhgAAAAAAdddD1SlCq6liXbt/DmOvU1SQVEsFONXFVAAHuVDnGUxBDhVAOzklXIGY971BwPaR/N7S0VUL+2HwLDVKoJCFlUe/Bgy2+oTAFcsc394Pn6AlBBUqc0nhKsSSaygOSG4I4QRjkDkAHAW7OK+fBNoWFmPtFaX2+E1QBwGrkGQgK8iDYwKgq4FZ8Y8BGQUCjBSE6ZGOhHI4UOgLKCAJicUSMH8F8hunUB3iRyUKoSCsF5w7FGKEgy85qYesCLLBbDcyO9eZchWqlAmJikAQhQtfQixn3D09cmXC8YatudmHvldoM7fobM4DylJ37iNGj8DFShIO1kT5RS6a7apxx3KyuQ5g0MoR9MLA90pOlRB1Lk3F3WCSyDKJEyt2FyIPM8RAYaYHWPUAnFzl+GXSAkqqRyAkbASCbg1kpkLEtLCIDPcCvEkEFAXjvPUTE+LXfXj/Z+Dq4eVnviLlTBBk8ZUrGp+Cyy6QuwPkkYqJGJjEgPkirMNgxxYYCHJi5ghkkAtoEkRsS9uT5wQSu8YRVwyR9IatzLaPa4eRFwrlWiasRprHo5Gx3gjJasyfMrpy0+gtu0qbgGDa0DwOALZ0k0ASQAYg6IJOR1C5OkX8jYA3MLSsTNfQbe0D9KFotmmQTL1DLFlrxC5t5wmMoSdzLrzuHJewoE1yGtxZaHFAiHsCT76KJFnQVFFCBmyFVFBwiwKC51A/ZzGTYNHDAWGBCnCTCX70WeRWTqk5jlsQ/QMFJFLsMLtJNiMBtv5/ImmPo6D2f014YTQqlPbif6EKZNjOr0NNGmiWggsTXKcpVmKX6KrQZyZpRi8TizB3gsjPnWnZlVbJmZ2vWW1CYkEJfvaiYFLEMbwl6zBAMW6UJOLrRpkfRKjC+PzRbjBwmSIjZhp5RSupq0yEIwUGlExagkkukZBdDMlygiRtuMmlckXLN8Q6229CZZW0g8v4kiUztH5TTX3Zzy4yd+EtUGPTIWSDJMzpgjqXBGIgoBgCIugta079/mSpgwnsKlX5rRIeV9VrMqX338eWqX0LuSKcKEh9T3Agg==",
"user_name": "assert_that/Unkey"
}
},
{
"kind": "ParallelDo",
"name": "s25",
"properties": {
"display_data": [
{
"key": "fn",
"label": "Transform Function",
"namespace": "apache_beam.transforms.core.ParDo",
"shortValue": "CallableWrapperDoFn",
"type": "STRING",
"value": "apache_beam.transforms.core.CallableWrapperDoFn"
},
{
"key": "fn",
"label": "Transform Function",
"namespace": "apache_beam.transforms.core.CallableWrapperDoFn",
"type": "STRING",
"value": "_equal"
}
],
"non_parallel_inputs": {},
"output_info": [
{
"encoding": {
"@type": "kind:windowed_value",
"component_encodings": [
{
"@type":
"FastPrimitivesCoder$QlpoOTFBWSZTWYQR6NMAAEDXwH8QgCEJAEBAv279AmAAIABqEqnqGgaABpoyNAGVHpGgMgDQBk0oR6IeoECBiqqU5NY23ndshzT2UPUOGrg42YPi9VyA8lbwwPJgtghxs5Qq1aWwExCDeMa0RHC2QigTCdizz1nx+LuSKcKEhCCPRpg=",
"component_encodings": [
{
"@type":
"FastPrimitivesCoder$QlpoOTFBWSZTWYQR6NMAAEDXwH8QgCEJAEBAv279AmAAIABqEqnqGgaABpoyNAGVHpGgMgDQBk0oR6IeoECBiqqU5NY23ndshzT2UPUOGrg42YPi9VyA8lbwwPJgtghxs5Qq1aWwExCDeMa0RHC2QigTCdizz1nx+LuSKcKEhCCPRpg=",
"component_encodings": [],
"pipeline_proto_coder_id":
"ref_Coder_FastPrimitivesCoder_3"
},
{
"@type":
"FastPrimitivesCoder$QlpoOTFBWSZTWYQR6NMAAEDXwH8QgCEJAEBAv279AmAAIABqEqnqGgaABpoyNAGVHpGgMgDQBk0oR6IeoECBiqqU5NY23ndshzT2UPUOGrg42YPi9VyA8lbwwPJgtghxs5Qq1aWwExCDeMa0RHC2QigTCdizz1nx+LuSKcKEhCCPRpg=",
"component_encodings": [],
"pipeline_proto_coder_id":
"ref_Coder_FastPrimitivesCoder_3"
}
],
"is_pair_like": true,
"pipeline_proto_coder_id": "ref_Coder_FastPrimitivesCoder_3"
},
{
"@type": "kind:global_window"
}
],
"is_wrapper": true
},
"output_name": "None",
"user_name": "assert_that/Match.out"
}
],
"parallel_input": {
"@type": "OutputReference",
"output_name": "None",
"step_name": "s24"
},
"serialized_fn":
"QlpoOTFBWSZTWbxG3MkABEx/9n//////////////////////+QAB4YAQABARUAT+HJrYxQAxBaImiTU9NJo00yaB6mgBpkA0AAAAA0GjIAAZDQ0NBkxqAaeoaaEDJgjAEGmAjTBGgYmIyYCMI0xMIYCZDRiGjEwRhMAJgAgJpogTVMCPKGjyhpo9NQAAGgAAAAAAAA09QPUAADQBAyYIwBBpgI0wRoGJiMmAjCNMTCGAmQ0YhoxMEYTACYAEoRNNBMmSMTTTRMASeiGaJoaGhkDTTINGg00BiGhpoADRhNBpkA9Jb+Z73QuYVzbbHNdqvOTC/DTk0n25VF+5mSbTsUMOZG7GihbVtaGGjNhjqx0VrFEERTgZ50Xon2qcdIc4dyncUcgEioEBTTVE5fLYI8ZSblPmVMxROwUTHW6GsWwIfRdQ9GepV7Zgw6BjY1LdOA5Zskg5RVOvfylOvndnKrXqZfSdOm4V7sF9oQpAMW3A4sEn37SVCCcfhKE0JXswaatZxwhG3CTGkkc8gVVRRFsgVpnztEoDMiPeSgMBFZQownwYAeiIwu8dy560uAkTEOgr1z+m+THcSNwSu4xUjMfCzOGZVsZmZnNY5oTs5dXvFZ2qMwqTMrBKrO5ntWFkMBe9Dqq+dV+pWTwQEGZMyWdbSaF5WArwtCwNiObSdTovRuzVyoyQCkA8FRFMUCGOAGppPzHqgq6Ct2o65EfQKMKdU55EmkIpqzDJuV5oqb1Um6A5vBdUAvYBDQTaPb8nGWu+cK+hR128yvGNcjae5iZ50lZkHtjbqkYoKzxqtIrcxyzcdlEfIgsPAipZLezR1wn96K4ZMAEMXG3N+meK4K/x82tfQ5FTMy9GKWKxBodDRQVEtVUTRObWyCi3nv4MIuG0uO2sNCflea6np3w+OmfO4D2Ktx4WxtOHx7bzztEemJn+6aD1+6iFddwPuJu26rMxMhWPy0ks7Mid+cI8Iivxs3fIh0vAThcjLRJYq/iNGVSZnQG0HyTcKEpIVOFe+kEWHJ7jk3l4MGSsW4gk5VUcsSWUVRVzxnLclbpcidHwFWE3jDyOXcswERC4NxcuEaR1yY2lyikBYzd/EVNE8JfWWmAgGlKEGIlMRQCkBI8Er6tjC8ZyKcEQJNqF2utthkSoTRLoTKoq2LLkzzX0xpjTNkkIbMtQhrEgtghx1KEfKoksE1VQo60Ia+yVzI+PYCYJSElDoX2VZ+iQi1/APJ3SExAdGZmS9fKZHqWOpEe8g2SITJI/CEsQju9jU/P+9PX6b/V7E/8Yt067iEMOUZvcGaGOeS+E8mtICMbxSGQ4ZptjkM7JzAdrH2KwSbFFmqKcTKC9q/d67tcL5hLlCJhUTGw3DFrxYBc3FHGk8rhHKJPKr+1QUPSAqQZa8p6IMobtFsoSEpTtYCJUTELRJYrwZRlDNuNNCIUszMMDA9t6MrKihQIrwUFMfczWhVwbpp1jicYFkXDIhZpFYkLkMSO1iSXHUqVEpaIdRBjgINQqqW354xL7r+KzbNI33ycaDiXlc2drbx7d7kQnapGWNXwOdOyV1Oq+UHtetRNGiYUCqcKqUrQZohGWBZzjsNaUngh1CPFI7o8ffXpDUvzJoGcpQiZxwIwg+BWJAVXXgAkSmrJIiGZrBEVKaL6cIEXdtHI4Bz6WK8oEN0JQXJgR5yyIGdnVTSVJCbbZhQw+pcNiJgNZGyMjjbHGhvJ+jbJi2DCTiUN2SRKTUCFReMEXLlUGLn1xJBQYv/95O3d3ejXULlzmSm2TcEo+xISCqqMT27QRR1yYpjE3G6aPHO1Htrd38nEKdHHdQtWx0wlRYaOzakVKHpEVeTTpR31BTS7Qzq6L2EttJbpSUzP0pGIPaUV+po7GehLrV7kVFUrDfk41mC3A7PiSjB/mE92Im7fGmS7Rpf7/o0vUSxJoUUqLNPnrOH+XgkINSAgVYiRguOOECsvqOXCflpIrWoRjpuBMp+30hzbr6RlMop/xdcQVVvzhYrapZx3n/F3JFOFCQvEbcyQ=",
"user_name": "assert_that/Match"
}
}
],
"type": "JOB_TYPE_BATCH"
}
apache_beam.runners.dataflow.internal.apiclient: INFO: Create job: <Job
createTime: '2020-08-20T00:41:28.241345Z'
currentStateTime: '1970-01-01T00:00:00Z'
id: '2020-08-19_17_41_26-13864778263095951612'
location: 'us-central1'
name: 'beamapp-jenkins-0820001153-267928'
projectId: 'apache-beam-testing'
stageStates: []
startTime: '2020-08-20T00:41:28.241345Z'
steps: []
tempFiles: []
type: TypeValueValuesEnum(JOB_TYPE_BATCH, 1)>
apache_beam.runners.dataflow.internal.apiclient: INFO: Created job with id:
[2020-08-19_17_41_26-13864778263095951612]
apache_beam.runners.dataflow.internal.apiclient: INFO: Submitted job:
2020-08-19_17_41_26-13864778263095951612
apache_beam.runners.dataflow.internal.apiclient: INFO: To access the Dataflow
monitoring console, please navigate to
https://console.cloud.google.com/dataflow/jobs/us-central1/2020-08-19_17_41_26-13864778263095951612?project=apache-beam-testing
--------------------- >> end captured logging << ---------------------
----------------------------------------------------------------------
XML: nosetests-postCommitIT-df-py37.xml
----------------------------------------------------------------------
XML:
<https://ci-beam.apache.org/job/beam_PostCommit_Python37/ws/src/sdks/python/nosetests.xml>
----------------------------------------------------------------------
Ran 66 tests in 3848.701s
FAILED (SKIP=7, failures=3)
> Task :sdks:python:test-suites:dataflow:py37:postCommitIT FAILED
FAILURE: Build failed with an exception.
* Where:
Script
'<https://ci-beam.apache.org/job/beam_PostCommit_Python37/ws/src/sdks/python/test-suites/dataflow/common.gradle'>
line: 118
* What went wrong:
Execution failed for task ':sdks:python:test-suites:dataflow:py37:postCommitIT'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug
option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with
Gradle 6.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See
https://docs.gradle.org/5.2.1/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 1h 6m 34s
153 actionable tasks: 117 executed, 34 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/sgy6oaxxwxj5c
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
