See
<https://builds.apache.org/job/beam_PostCommit_Python36/31/display/redirect?page=changes>
Changes:
[robertwb] [BEAM-7801] Fix wordcount_xlang postcommit.
------------------------------------------
[...truncated 199.90 KB...]
{
"key": "mutation",
"namespace":
"apache_beam.io.gcp.datastore.v1new.datastoreio._DatastoreWriteFn",
"type": "STRING",
"value": "Write (upsert)"
},
{
"key": "project",
"namespace":
"apache_beam.io.gcp.datastore.v1new.datastoreio._DatastoreWriteFn",
"type": "STRING",
"value": "apache-beam-testing"
}
],
"non_parallel_inputs": {},
"output_info": [
{
"encoding": {
"@type": "kind:windowed_value",
"component_encodings": [
{
"@type":
"FastPrimitivesCoder$eNprYE5OLEhMzkiNT0pNzNVLzk9JLSqGUlxuicUlAUWZuZklmWWpxc4gQa5CBs3GQsbaQqYIfgYGhvi0xJycpMTk7HiwlkJ8pgVkJmfnpEJNYQGawlpbyJZUnKQHACYlLgM=",
"component_encodings": [
{
"@type":
"FastPrimitivesCoder$eNprYE5OLEhMzkiNT0pNzNVLzk9JLSqGUlxuicUlAUWZuZklmWWpxc4gQa5CBs3GQsbaQqYIfgYGhvi0xJycpMTk7HiwlkJ8pgVkJmfnpEJNYQGawlpbyJZUnKQHACYlLgM=",
"component_encodings": []
},
{
"@type":
"FastPrimitivesCoder$eNprYE5OLEhMzkiNT0pNzNVLzk9JLSqGUlxuicUlAUWZuZklmWWpxc4gQa5CBs3GQsbaQqYIfgYGhvi0xJycpMTk7HiwlkJ8pgVkJmfnpEJNYQGawlpbyJZUnKQHACYlLgM=",
"component_encodings": []
}
],
"is_pair_like": true
},
{
"@type": "kind:global_window"
}
],
"is_wrapper": true
},
"output_name": "out",
"user_name": "Write to Datastore/Write Batch to Datastore.out"
}
],
"parallel_input": {
"@type": "OutputReference",
"output_name": "out",
"step_name": "s3"
},
"serialized_fn":
"eNqtmXdYVMmywA/iEUURMaCCCCoKKCAoKCqoCIoUiwHYdcQwDsPAjE7gnJkhKIgR5ZjjmtO6uuZdRVFMmAUj5sWIrlnMaw63Gix33nvfd+/74/oH9Zs+PdXV1dVVdZwx1p7KRI1W6ytnf23lySqTXGEyibYCJ6vOcVyCWaM1afRGwUpmgx/xMXsqVMkRrGOEqkpFikKpVskTVAqdr8bgm6xM8U1UmBRGk0FU+ab661Vp/3zWGGwHiBqTKs4QTkO2Ai9zQLXy7yMVM3rphWo5gk2MUN1rrFAjS7D1rLBFniIahquUJqGmrB5+rFzbh63tY1IZ0cpkoVaFlXKlVqPSmwS7PrLa7KOYopQbzUqlymhUGYXa6v9pt05lEjVK4zdpG1350VawrzAtXKVVJSuY8jCDWW9SiUKdHMEhRqiLptXLEurLauKkyq/K9QqdSmjwb5QnKIyqbwv0wbm2giNqaZglNPKU1UA17PtG/LJKaCzr/n2H/1/v+n53YrQZT4l50UlW9ZtawVnWAPH79JgUZex3jzQxJxgTKjZS4SqVKBpEo+CiZntsmiW4qhuomaFuWUIzT/V/ybTmamdZ3f9lUc/KhVtUmGPPzDGpRYPJpFUlyo0qpVFwrzCpZZbQ6ptJHlmC53/NJC80yRkVKc06sxaPPFUVV7k8Hn6sSmnQJxqF1hW22VraJgpt/tM98FUkKlKYwn++ZBv6bSju+4jgjTvyyRJ8PWV2bAGFVisXVYIZY9sotP2Pa5hNGq1ttCGVWWvW2Qp+qM0/S2jnKavFtOnNOnmCWTlChcraR6VX7qFyQK4zCgHRD6wrb4vSLIp4e+QafaIqXQiM4mQNLYd1RrlRo1eq5KoUg1ItdIiqTBTfdXccIgR5DhE6eUZxUZxqiNCZoAtBMEEIQVeCbgTdCUIJehCEEYQT9CToRRBB0JsgkgAIogh+IIgm6EPQl6AfQX+CGIJYgjiCHwl+IhhAICMYSBBPMIhgMMEQgqEEcoJhBAqCBAIlQSKBiiCJIJlATaAhGE4wgkBLoCPQExgIUggEApHASGAiMBOkEqQRpBNkEIwkGEWQSZBFMJogm2AMwViCcQTjCSYQTCTIIZhEMJkgl0AimEIwlWAawXSCGQQzCWYRzCaYQzCXYB7BfIKfCRYQLCRYRLCYYAnBUoJlBMsJVhCsJFhF8AvBaoJfCdYQrCX4jWAdwXqCDQQbCTYRbCbYQvB7JajMCbL6LJt8K9dJZosU+IeapbStWcI2TzVmMDVLWWrMT2rMQWpMO3mYdraTwh0E+QQ7CXYRFBDsJthDsJdgH8F+gkKCAwQHCQ4RHCY4QnCU4BjBcYIigmKCEwQnCU4RnCY4Q3CWoITgHMF5ggsEFwkuEVwmuELwJ0EpwVWCawTXCW4Q3CS4RVBGcJvgDsFfBHcJ7hHcJ3hA8JDgEcFjgicE5QRPCZ4RPCd4QfCS4BXBa4K/Cd4QvCV4R/Ce4APBR4JPBJ8JvhB8/QYiZ8VxxFYWXMWCrS24qgXzFlzNgm0suLoF17BgWwuuacG1LNjOgmtbsL0F17FgBwuua8H1LLi+BTewYEcLbmjBjSy4sQU7WbCzBTexYBcLbmrBrhbsZsHNLLi5BbewYHcLbmnBrSzYw4I9LdjLgltbcBsL9v7OLPtVtL2GVJWoNSgS5SK2oQbRB2dEdHvNVfyrfMMRFfpEg070xSfKSraNqRRiWxzzihH9UERZe0o8Th/DgVNGhDNkac+1gWzJ2F/iH7a4u56T+BcjIs9xkJOb9wM4rPvLKPEfi9Zt52BFk5JWMGnw0RAIO10YK/GjhBe7cLbXjqbrUNReKJ/OgbxZta4Sn2n68hGH7jevOw3FutdOM1BYSavno+jVDc6jKOx7pxxF9Vo/PuVA0zU2XOIHnX78GwfuDu7xEj/xaMAMDg4WrtbAnEMLBkp8ypx3V9GElwsMEr8mxvZPDjI68Jkww8W7vcSnP9f8ykF7zbpWEu84MnIhB3bh84dJ/PwrqnwO9rfIcwX1g/ctIS2y6WCJL/Oyl3DpDpfv5HDQ902JP4wwvgiR+KutL97iQNVWX03ir3QL/AvnBEPBQQ4Sguo2APvODdIlvmtLh4s4XuNBjeMowtW/HONgwqk7/rivT3uW4VCqVeJfHHTt+66WxL+TUuZyMBOS0yR++KH3W/Hx0Afiaw6CrasGw13jhCiJz3OZfZO5PKsR7l2zOdYBrtv1TYF+hc3qSnx8nLAFHwphi++hWJ7hdISDz8U+ThJv3y95Ceq5p/CR+Et/RK3hoF/MnnjYMP9IKJwM8UnG7U0O3MFB4YYPQ0CpOuKMh/J+xVHU0vnnTrkcJD7LiwZPp0Z4uLsjHi7H8dK42GMoTt3s+xLF/qQ6SzlYcNpJhh71mHibAyu/NDOsPrR7JBy4MzgEHsdsGwFHm4y1g7yMJpmwZnD4UNB83eWCgXDK8QJq0MR32sbB5snumbD4Q98QqBV7JlXiJwV8QV0/WnezwoWbu+7jYP62W86Q2eBpGkwaddVG4iN69VvNwbJphk5Q/+h4dOxM1zXsuP4YVuUEB+1mBdWUeLtOw19ycCP+czuJd9+4kEVh+IW7V9ku8jW7OSh/kd5Y4pueMF7BoVqnQ65z4GOcU0Pit+z1K8AQm7CgFYTPG2+C25kde2Lg9Y4twYlJmfknUDTuX/UdijdrzrPgrX/bC5eNLNsdKPG/di1ga/SWco9zsHJJZnP86kubzzg0eU7gUxQeUwvu46lILc2wcv8+fyieXB4O4wdEZ0t8FOjQ7QVundGwA7Mv/omz57k6nGILLdz9M4ojM6ayANn0Z+xXDvbV/YIBua/4KzooaMIq3PL8YztWcRB7WdcFXGfVSYW5stFuMO5pHxFg8JmRGBw+/hM58J6Qh07O/tR/HqpyCey7mYMNDa/hjTx6RnMbh1aV1fvCQbfH65yhdEW4FVxPX4AXb6J9i0J82Hz2UOaGdtHG5Rw8WpRjDcN9SxJg2ftxmbAtZglOvPzoygGcwa1u9QzFn2Pzx3FwZlcDR1jgXuQPzaPvd4Hm1h4/wKzLOhncDohIh3E2jsOht2K9AZIcirvD/eAVeIl+qhPC4pkL74721e00ppnEi8t2bcYh95PrF7Cr6Vf+NwdX7kgREl/0LBEdklnu2xgG7krrK/EbpQfoybdtR3bG0PRrN4UDt7UjQyX+5jJMUujAxfFnUew+5/gQBV/e+jlO2LqhNqTFT9RB1lNHN4h8+NAf3g66Ywf6qMN6iR/ze8snOHekQ/gfHDR5mWuGzU+qo9Mefumyk4NF2w5iFG5Pv3oQ5zj32M7OOy9s9K8onk+1weDouH2uL4xa7oan7C3UP8VB0rJiDMz2G6dg0rSuvQU30WNq0GycP3Wly3oOTviXuku8WjEApxb8MqKTxNc1DViDj2e9+BvV/V2tTTXwSRnYDy/+p6c30YA97fGaLktyZHlzu03WFBY7QuND7IgD3MtQuEXGssi9Ut2Gxefi0+MxT6Q3S1FJfMzF6nfYZcwdeh6zktfbeCi2+b0hXtIPpYs4aJQ+Sg9O20sSQbk81Q9q7MzvBV9yVXjS5jjZJQ52SN5+uKlf4negjrjkQwtRZBd9KkKx5MrT+ygG+p9gduRefH0NxRzb8j2YmA/Wi4Vk1aWu8K5rdwzHfH4LqyqPYtuyAG/T7OlkDrLbr6kt8a9fbcFEvvDjcQ94dX6rGtYuzaoCfvYT7GCqY49kmM/dRufcXKRhGTL2vPY1irLBSftQ1JmRiiXqXv/56PRcU+pptFXTvB78mfUqEC5/jemCh3epTyEHjvfjfMEvO0cHNx6He2AZcTz/M2bFiBNYRjbm5LEcr6t26De2Pe1MzMzCiP46OJIWhrfUvVEJGucd3mI4xMKnqjBxX0Z/+GEc7wGgeBQt8ZB4bisHqT+Vq3FvU6zfo44pITGYxfv2eW0DkY+ftYFz2h8xSANck1jhOz2l8WEOhsXubguZ/Z9hpjvjnXcU78/Ca6Fw4FxUTegQVCMZYl53wfJs7V1RX3Kc17JbGzJ43TQOnlVd2xNWlNTCgL1YPomdaj+b6bNQ2GwvLOXAYZgafe3mdZH5OqFEuxRFWOeuLOxmH73AMui7rOK/UTyYOY5d85YnIlej2Fy1GybkORvNjeHIsSd4jZbBoYscHPWdjjG31zWDOXvozMMYDNtyFYlo9I40dkMPhs6azDb8xoCF99rjTT5wNiO3MaRuqmIHf5evxszoWOjBbO++0PU0iqPTq2JWd5m8Hk/d5NiZHWjWTt0ZFOdKw7ah6LmzbC+KUYuK2IoX63lj+V9Vkh0Pi2v5qiFrZ1ENmN80WC7xA86cQDf2HuBuK/EXXKNZhnexckT7yj7mDYeCMDv07NnLPVkR230H8AbK9G+GQfeT8cHweuQ8rMq3T9ybwNaNfDSJVfKzB1n3wt1eU8zB0Bud64Nx/+NBMHD4XzwmxvAFpfhwxMKdrCJs2r6Upe1xexuweIk5Wx1Pb+zZbQ3Qjg3P97MQdVmwtKLgdCznYP2YnB5wqdUmLXQM8ggGb98ALNX3j8SO5eBm8pLekJ5eqIH6aQ0yJb7VmP6XMSivpAyHKm28eqE1Wxaht3L1cgFqiCcHgtwmKRYacz2bYvzfSsA9hXyYZpb4vgE/Xsf12m4KfYPixOi4Lyjk9voNKHamfxzLmq4iM1qZ4JiHR/fq/nEWNdNCX7/n4PiKxRhn5Xu2vmIlLyFtJgrllA6fUHQrPsVOZGjvDOyPxBsDh8LdQ1exmyo/Nm0ltmAZgUE4595YdobvXE8x7118dRrr3qoyIyb3z/XSsBtpkbbHGXq2C8zCylQ2HQNq2CO1FzSdtFMGXZo38Zb41n712KWQPx/B0tkrjy7YrEzbfxMDJ3PBVZZubgQD3uqsn5r6gTU4RcGGRbNFiV8a7vIHPtzxQ31MjEqPxHC4E5aBG1mlL8JAPDyzhxJL7aLcORy0Xd0S81/chA9Y8DWDV2Pxn+Ccy3JV25MtWNy9HfIbW8btmAs71E9WW99geV13BKOn8HkKltK54Uv9ICzApIP4/KWNJH5uvQ7rOBhXq0UP+LoxxgeudS/GJPG+R/uvLL86P7/GQf+x1TG1/iwWMDdfuVOCDat10mK0v/UFDPtBa4Pmc2Cb79gOus/9PQOyL29kV/mhMzadP9X16oY1Pv3qOPym3eHO2DYaCodjWQ+tsQ+z0plW5qrAB97SSnyTP+azGGvQ+OgTDs6/cbCDzwWDAvBeup9jGbhNaSlWFV2gOwb60svROOeIqz320+unaw+z5nvXNmy3Z+tr9sFupixjJgceztMwqobsTWNtbcKNVqwpf7tYxjz02z3tYg7yZ/bDntm/34HPHCyf3AZ7T9/8x1g7wnNcnOHJhFxsU1P8S7EKh+a+DYKy4NmxsG5XXm1Y1jAvFN5mH8LOcxvHoyuaFM3DnmZg7qTHHCiCbthjCho97HcOhjzZgAfbzuoAO9gbxtaYjvRvrHFLo31GsRLu3fsavljc8nkbLPG/ZGixuf8ytT22DI/97PDbfpkRnaHPqJNhMFL4gFenjX4e602q2a5kN3K3dIRdhnnV05jyX69lsxKaue/lFlzWoVMyfHygbAh2OrkTFK043gFfR2KGMO8KZi80cmx8QHVI8h3VA2LdRsdhh3Zl1EYOfOemJkn8LdMylj1andyC7u75WwYGSHZMcS4ORe2pNp6DjeofE3DdgjKMyr2fvEdCabl3S4mXORnYi1HixOsSB9ejS7APOFarZCNLQBGjWFaGLoVsQgpvw07z4apgPKLsNoPx9ja/HPILDkUWDMUS0+P43jqY92TSJ8x7I91ag761dy1YuvcLvpbZ708swhbYpFNBjRmr7CE1KbM1nBO9cHvLXMy7WSILPMPKwntFwV0U6v66McxHrz6sRVGvQxG2W8OSJ3QEVR8OD69uvzfoi5Onb4zAkjjuCdZUHx8nrJ5fi9+yChAyy2k6M7hhKF7g/KAQ7Beu++9iNeiuYRBLwjva7niLoiCieh5butgbL4HiYT8ZjFlXLQCKN5Y2g8ZLBw8HKcOtBdj02R0Bqy7EYPs04kR79u7zIt/3IBedUsUk+uO7a59JYjsr9gPkt1+mTBkpKrlaozcZxfbsrdfy5xD2rOKRb6JKacCXZoNotI3sG4fDvdmwrRjAXorHioFMcZbYgb1yV6jV6FPMpgrdRrEje1jxY4nBbPpnOIgNm3PETpXWDBE7I2SJXfDvEDH4/5iCb+PGJIOoM/oq2S+cAzT4Vp6m0SfbiiGVNnSt+Hq3ChPYLydpFTOS9GL3f6OrcpJthNaQoNBW6sRdhVZq7IGi4gdEk6hJTlaJqCvs3+j6Nss2XJWkMGtNcd8+iuGV2noybeynT4WSfgkz6OU6Q6JK7MX+T8Gq4nc7k0anMpoUuhS50qBL0OhVohhR+bTitDRGeWKlerE3Dk82J5jESATffwG9sFw4",
"user_name": "Write to Datastore/Write Batch to Datastore"
}
}
],
"type": "JOB_TYPE_BATCH"
}
root: INFO: Create job: <Job
createTime: '2019-07-23T19:28:12.407838Z'
currentStateTime: '1970-01-01T00:00:00Z'
id: '2019-07-23_12_28_11-6757908712431842453'
location: 'us-central1'
name: 'beamapp-jenkins-0723192803-457978'
projectId: 'apache-beam-testing'
stageStates: []
startTime: '2019-07-23T19:28:12.407838Z'
steps: []
tempFiles: []
type: TypeValueValuesEnum(JOB_TYPE_BATCH, 1)>
root: INFO: Created job with id: [2019-07-23_12_28_11-6757908712431842453]
root: INFO: To access the Dataflow monitoring console, please navigate to
https://console.cloud.google.com/dataflow/jobsDetail/locations/us-central1/jobs/2019-07-23_12_28_11-6757908712431842453?project=apache-beam-testing
root: INFO: Job 2019-07-23_12_28_11-6757908712431842453 is in state
JOB_STATE_RUNNING
root: INFO: 2019-07-23T19:28:11.307Z: JOB_MESSAGE_DETAILED: Autoscaling is
enabled for job 2019-07-23_12_28_11-6757908712431842453. The number of workers
will be between 1 and 1000.
root: INFO: 2019-07-23T19:28:11.346Z: JOB_MESSAGE_DETAILED: Autoscaling was
automatically enabled for job 2019-07-23_12_28_11-6757908712431842453.
root: INFO: 2019-07-23T19:28:14.916Z: JOB_MESSAGE_DETAILED: Checking
permissions granted to controller Service Account.
root: INFO: 2019-07-23T19:28:15.644Z: JOB_MESSAGE_BASIC: Worker configuration:
n1-standard-1 in us-central1-a.
root: INFO: 2019-07-23T19:28:16.260Z: JOB_MESSAGE_DETAILED: Expanding
CoGroupByKey operations into optimizable parts.
root: INFO: 2019-07-23T19:28:16.300Z: JOB_MESSAGE_DETAILED: Expanding
GroupByKey operations into optimizable parts.
root: INFO: 2019-07-23T19:28:16.324Z: JOB_MESSAGE_DETAILED: Lifting
ValueCombiningMappingFns into MergeBucketsMappingFns
root: INFO: 2019-07-23T19:28:16.366Z: JOB_MESSAGE_DEBUG: Annotating graph with
Autotuner information.
root: INFO: 2019-07-23T19:28:16.437Z: JOB_MESSAGE_DETAILED: Fusing adjacent
ParDo, Read, Write, and Flatten operations
root: INFO: 2019-07-23T19:28:16.475Z: JOB_MESSAGE_DETAILED: Fusing consumer To
String into Input/Read
root: INFO: 2019-07-23T19:28:16.506Z: JOB_MESSAGE_DETAILED: Fusing consumer
Write to Datastore/Write Batch to Datastore into To Entity
root: INFO: 2019-07-23T19:28:16.542Z: JOB_MESSAGE_DETAILED: Fusing consumer To
Entity into To String
root: INFO: 2019-07-23T19:28:16.568Z: JOB_MESSAGE_DEBUG: Workflow config is
missing a default resource spec.
root: INFO: 2019-07-23T19:28:16.601Z: JOB_MESSAGE_DEBUG: Adding StepResource
setup and teardown to workflow graph.
root: INFO: 2019-07-23T19:28:16.650Z: JOB_MESSAGE_DEBUG: Adding workflow start
and stop steps.
root: INFO: 2019-07-23T19:28:16.683Z: JOB_MESSAGE_DEBUG: Assigning stage ids.
root: INFO: 2019-07-23T19:28:16.882Z: JOB_MESSAGE_DEBUG: Executing wait step
start3
root: INFO: 2019-07-23T19:28:16.989Z: JOB_MESSAGE_BASIC: Executing operation
Input/Read+To String+To Entity+Write to Datastore/Write Batch to Datastore
root: INFO: 2019-07-23T19:28:17.055Z: JOB_MESSAGE_DEBUG: Starting worker pool
setup.
root: INFO: 2019-07-23T19:28:17.099Z: JOB_MESSAGE_BASIC: Starting 1 workers in
us-central1-a...
root: INFO: 2019-07-23T19:28:17.503Z: JOB_MESSAGE_BASIC: Worker configuration:
n1-standard-1 in us-central1-a.
--------------------- >> end captured logging << ---------------------
<https://builds.apache.org/job/beam_PostCommit_Python36/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:1140:
BeamDeprecationWarning: options is deprecated since First stable release.
References to <pipeline>.options will not be supported
method_to_use = self._compute_method(p, p.options)
<https://builds.apache.org/job/beam_PostCommit_Python36/ws/src/sdks/python/apache_beam/runners/dataflow/dataflow_runner.py>:686:
BeamDeprecationWarning: BigQuerySink is deprecated since 2.11.0. Use
WriteToBigQuery instead.
kms_key=transform.kms_key))
Found:
https://console.cloud.google.com/dataflow/jobsDetail/locations/us-central1/jobs/2019-07-23_12_17_53-6941870018152544683?project=apache-beam-testing.
Found:
https://console.cloud.google.com/dataflow/jobsDetail/locations/us-central1/jobs/2019-07-23_12_34_50-5564262877971897864?project=apache-beam-testing.
Found:
https://console.cloud.google.com/dataflow/jobsDetail/locations/us-central1/jobs/2019-07-23_12_45_17-5283600660937548362?project=apache-beam-testing.
Found:
https://console.cloud.google.com/dataflow/jobsDetail/locations/us-central1/jobs/2019-07-23_12_55_25-1213062873870443565?project=apache-beam-testing.
Found:
https://console.cloud.google.com/dataflow/jobsDetail/locations/us-central1/jobs/2019-07-23_12_17_51-3309276437425046630?project=apache-beam-testing.
Found:
https://console.cloud.google.com/dataflow/jobsDetail/locations/us-central1/jobs/2019-07-23_12_41_39-12640000323126398987?project=apache-beam-testing.
<https://builds.apache.org/job/beam_PostCommit_Python36/ws/src/sdks/python/apache_beam/runners/dataflow/dataflow_runner.py>:686:
BeamDeprecationWarning: BigQuerySink is deprecated since 2.11.0. Use
WriteToBigQuery instead.
kms_key=transform.kms_key))
Found:
https://console.cloud.google.com/dataflow/jobsDetail/locations/us-central1/jobs/2019-07-23_12_17_53-2977499607119906607?project=apache-beam-testing.
<https://builds.apache.org/job/beam_PostCommit_Python36/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:1140:
BeamDeprecationWarning: options is deprecated since First stable release.
References to <pipeline>.options will not be supported
Found:
https://console.cloud.google.com/dataflow/jobsDetail/locations/us-central1/jobs/2019-07-23_12_31_03-5137205863418081022?project=apache-beam-testing.
method_to_use = self._compute_method(p, p.options)
Found:
https://console.cloud.google.com/dataflow/jobsDetail/locations/us-central1/jobs/2019-07-23_12_40_59-10812349847773608535?project=apache-beam-testing.
Found:
https://console.cloud.google.com/dataflow/jobsDetail/locations/us-central1/jobs/2019-07-23_12_49_21-16448938032031857151?project=apache-beam-testing.
Found:
https://console.cloud.google.com/dataflow/jobsDetail/locations/us-central1/jobs/2019-07-23_12_17_50-14039409661864038531?project=apache-beam-testing.
<https://builds.apache.org/job/beam_PostCommit_Python36/ws/src/sdks/python/apache_beam/io/fileio_test.py>:232:
FutureWarning: MatchAll is experimental.
| 'GetPath' >> beam.Map(lambda metadata: metadata.path))
Found:
https://console.cloud.google.com/dataflow/jobsDetail/locations/us-central1/jobs/2019-07-23_12_41_23-8668893629613760095?project=apache-beam-testing.
<https://builds.apache.org/job/beam_PostCommit_Python36/ws/src/sdks/python/apache_beam/io/fileio_test.py>:243:
FutureWarning: MatchAll is experimental.
Found:
https://console.cloud.google.com/dataflow/jobsDetail/locations/us-central1/jobs/2019-07-23_12_51_05-11538824585111933286?project=apache-beam-testing.
| 'Checksums' >> beam.Map(compute_hash))
Found:
https://console.cloud.google.com/dataflow/jobsDetail/locations/us-central1/jobs/2019-07-23_13_00_20-16996068435653418408?project=apache-beam-testing.
<https://builds.apache.org/job/beam_PostCommit_Python36/ws/src/sdks/python/apache_beam/io/fileio_test.py>:243:
FutureWarning: ReadMatches is experimental.
| 'Checksums' >> beam.Map(compute_hash))
Found:
https://console.cloud.google.com/dataflow/jobsDetail/locations/us-central1/jobs/2019-07-23_12_17_50-2671988468154458069?project=apache-beam-testing.
Exception in thread Thread-2:
Traceback (most recent call last):
Found:
https://console.cloud.google.com/dataflow/jobsDetail/locations/us-central1/jobs/2019-07-23_12_28_11-6757908712431842453?project=apache-beam-testing.
Found:
https://console.cloud.google.com/dataflow/jobsDetail/locations/us-central1/jobs/2019-07-23_12_33_34-955473263831069565?project=apache-beam-testing.
File "/usr/lib/python3.6/threading.py", line 916, in _bootstrap_inner
Found:
https://console.cloud.google.com/dataflow/jobsDetail/locations/us-central1/jobs/2019-07-23_12_43_58-8830717106383376330?project=apache-beam-testing.
self.run()
File "/usr/lib/python3.6/threading.py", line 864, in run
self._target(*self._args, **self._kwargs)
File
"<https://builds.apache.org/job/beam_PostCommit_Python36/ws/src/sdks/python/apache_beam/runners/dataflow/dataflow_runner.py";,>
line 157, in poll_for_job_completion
response = runner.dataflow_client.get_job(job_id)
File
"<https://builds.apache.org/job/beam_PostCommit_Python36/ws/src/sdks/python/apache_beam/utils/retry.py";,>
line 197, in wrapper
return fun(*args, **kwargs)
File
"<https://builds.apache.org/job/beam_PostCommit_Python36/ws/src/sdks/python/apache_beam/runners/dataflow/internal/apiclient.py";,>
line 670, in get_job
response = self._client.projects_locations_jobs.Get(request)
File
"<https://builds.apache.org/job/beam_PostCommit_Python36/ws/src/sdks/python/apache_beam/runners/dataflow/internal/clients/dataflow/dataflow_v1b3_client.py";,>
line 689, in Get
config, request, global_params=global_params)
File
"<https://builds.apache.org/job/beam_PostCommit_Python36/ws/src/build/gradleenv/-1734967053/lib/python3.6/site-packages/apitools/base/py/base_api.py";,>
line 731, in _RunMethod
return self.ProcessHttpResponse(method_config, http_response, request)
File
"<https://builds.apache.org/job/beam_PostCommit_Python36/ws/src/build/gradleenv/-1734967053/lib/python3.6/site-packages/apitools/base/py/base_api.py";,>
line 737, in ProcessHttpResponse
self.__ProcessHttpResponse(method_config, http_response, request))
File
"<https://builds.apache.org/job/beam_PostCommit_Python36/ws/src/build/gradleenv/-1734967053/lib/python3.6/site-packages/apitools/base/py/base_api.py";,>
line 604, in __ProcessHttpResponse
http_response, method_config=method_config, request=request)
apitools.base.py.exceptions.HttpNotFoundError: HttpError accessing
<https://dataflow.googleapis.com/v1b3/projects/apache-beam-testing/locations/us-central1/jobs/2019-07-23_12_28_11-6757908712431842453?alt=json>:
response: <{'vary': 'Origin, X-Origin, Referer', 'content-type':
'application/json; charset=UTF-8', 'date': 'Tue, 23 Jul 2019 19:29:07 GMT',
'server': 'ESF', 'cache-control': 'private', 'x-xss-protection': '0',
'x-frame-options': 'SAMEORIGIN', 'x-content-type-options': 'nosniff',
'transfer-encoding': 'chunked', 'status': '404', 'content-length': '279',
'-content-encoding': 'gzip'}>, content <{
"error": {
"code": 404,
"message": "(9791b2cd42cd67b6): Information about job
2019-07-23_12_28_11-6757908712431842453 could not be found in our system.
Please double check the id is correct. If it is please contact customer
support.",
"status": "NOT_FOUND"
}
}
>
<https://builds.apache.org/job/beam_PostCommit_Python36/ws/src/sdks/python/apache_beam/io/gcp/bigquery_test.py>:565:
BeamDeprecationWarning: options is deprecated since First stable release.
References to <pipeline>.options will not be supported
streaming = self.test_pipeline.options.view_as(StandardOptions).streaming
<https://builds.apache.org/job/beam_PostCommit_Python36/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:1140:
BeamDeprecationWarning: options is deprecated since First stable release.
References to <pipeline>.options will not be supported
method_to_use = self._compute_method(p, p.options)
<https://builds.apache.org/job/beam_PostCommit_Python36/ws/src/sdks/python/apache_beam/io/gcp/bigquery_file_loads.py>:557:
BeamDeprecationWarning: options is deprecated since First stable release.
References to <pipeline>.options will not be supported
temp_location = p.options.view_as(GoogleCloudOptions).temp_location
Found:
https://console.cloud.google.com/dataflow/jobsDetail/locations/us-central1/jobs/2019-07-23_12_17_50-17175147652638275708?project=apache-beam-testing.
<https://builds.apache.org/job/beam_PostCommit_Python36/ws/src/sdks/python/apache_beam/runners/dataflow/dataflow_runner.py>:686:
BeamDeprecationWarning: BigQuerySink is deprecated since 2.11.0. Use
WriteToBigQuery instead.
kms_key=transform.kms_key))
Found:
https://console.cloud.google.com/dataflow/jobsDetail/locations/us-central1/jobs/2019-07-23_12_26_52-9175709265896949280?project=apache-beam-testing.
Exception in thread Thread-2:
Found:
https://console.cloud.google.com/dataflow/jobsDetail/locations/us-central1/jobs/2019-07-23_12_31_45-588279746494080658?project=apache-beam-testing.
Traceback (most recent call last):
Found:
https://console.cloud.google.com/dataflow/jobsDetail/locations/us-central1/jobs/2019-07-23_12_41_12-9276142290237258886?project=apache-beam-testing.
File "/usr/lib/python3.6/threading.py", line 916, in _bootstrap_inner
self.run()
File "/usr/lib/python3.6/threading.py", line 864, in run
self._target(*self._args, **self._kwargs)
File
"<https://builds.apache.org/job/beam_PostCommit_Python36/ws/src/sdks/python/apache_beam/runners/dataflow/dataflow_runner.py";,>
line 157, in poll_for_job_completion
response = runner.dataflow_client.get_job(job_id)
File
"<https://builds.apache.org/job/beam_PostCommit_Python36/ws/src/sdks/python/apache_beam/utils/retry.py";,>
line 197, in wrapper
return fun(*args, **kwargs)
File
"<https://builds.apache.org/job/beam_PostCommit_Python36/ws/src/sdks/python/apache_beam/runners/dataflow/internal/apiclient.py";,>
line 670, in get_job
response = self._client.projects_locations_jobs.Get(request)
File
"<https://builds.apache.org/job/beam_PostCommit_Python36/ws/src/sdks/python/apache_beam/runners/dataflow/internal/clients/dataflow/dataflow_v1b3_client.py";,>
line 689, in Get
config, request, global_params=global_params)
File
"<https://builds.apache.org/job/beam_PostCommit_Python36/ws/src/build/gradleenv/-1734967053/lib/python3.6/site-packages/apitools/base/py/base_api.py";,>
line 731, in _RunMethod
return self.ProcessHttpResponse(method_config, http_response, request)
File
"<https://builds.apache.org/job/beam_PostCommit_Python36/ws/src/build/gradleenv/-1734967053/lib/python3.6/site-packages/apitools/base/py/base_api.py";,>
line 737, in ProcessHttpResponse
self.__ProcessHttpResponse(method_config, http_response, request))
File
"<https://builds.apache.org/job/beam_PostCommit_Python36/ws/src/build/gradleenv/-1734967053/lib/python3.6/site-packages/apitools/base/py/base_api.py";,>
line 604, in __ProcessHttpResponse
http_response, method_config=method_config, request=request)
apitools.base.py.exceptions.HttpNotFoundError: HttpError accessing
<https://dataflow.googleapis.com/v1b3/projects/apache-beam-testing/locations/us-central1/jobs/2019-07-23_12_26_52-9175709265896949280?alt=json>:
response: <{'vary': 'Origin, X-Origin, Referer', 'content-type':
'application/json; charset=UTF-8', 'date': 'Tue, 23 Jul 2019 19:28:06 GMT',
'server': 'ESF', 'cache-control': 'private', 'x-xss-protection': '0',
'x-frame-options': 'SAMEORIGIN', 'x-content-type-options': 'nosniff',
'transfer-encoding': 'chunked', 'status': '404', 'content-length': '279',
'-content-encoding': 'gzip'}>, content <{
"error": {
"code": 404,
"message": "(28a861c2d5dd48eb): Information about job
2019-07-23_12_26_52-9175709265896949280 could not be found in our system.
Please double check the id is correct. If it is please contact customer
support.",
"status": "NOT_FOUND"
}
}
>
<https://builds.apache.org/job/beam_PostCommit_Python36/ws/src/sdks/python/apache_beam/runners/dataflow/dataflow_runner.py>:686:
BeamDeprecationWarning: BigQuerySink is deprecated since 2.11.0. Use
WriteToBigQuery instead.
kms_key=transform.kms_key))
<https://builds.apache.org/job/beam_PostCommit_Python36/ws/src/sdks/python/apache_beam/io/gcp/big_query_query_to_table_pipeline.py>:73:
BeamDeprecationWarning: BigQuerySink is deprecated since 2.11.0. Use
WriteToBigQuery instead.
kms_key=kms_key))
Found:
https://console.cloud.google.com/dataflow/jobsDetail/locations/us-central1/jobs/2019-07-23_12_17_53-6389203069352709867?project=apache-beam-testing.
<https://builds.apache.org/job/beam_PostCommit_Python36/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:1140:
BeamDeprecationWarning: options is deprecated since First stable release.
References to <pipeline>.options will not be supported
Found:
https://console.cloud.google.com/dataflow/jobsDetail/locations/us-central1/jobs/2019-07-23_12_28_36-16293057498102649680?project=apache-beam-testing.
method_to_use = self._compute_method(p, p.options)
Found:
https://console.cloud.google.com/dataflow/jobsDetail/locations/us-central1/jobs/2019-07-23_12_37_43-6630060697901323263?project=apache-beam-testing.
<https://builds.apache.org/job/beam_PostCommit_Python36/ws/src/sdks/python/apache_beam/io/gcp/bigquery_file_loads.py>:557:
BeamDeprecationWarning: options is deprecated since First stable release.
References to <pipeline>.options will not be supported
Found:
https://console.cloud.google.com/dataflow/jobsDetail/locations/us-central1/jobs/2019-07-23_12_46_55-15050826236453847353?project=apache-beam-testing.
temp_location = p.options.view_as(GoogleCloudOptions).temp_location
Found:
https://console.cloud.google.com/dataflow/jobsDetail/locations/us-central1/jobs/2019-07-23_12_56_58-13993199515539258101?project=apache-beam-testing.
Found:
https://console.cloud.google.com/dataflow/jobsDetail/locations/us-central1/jobs/2019-07-23_12_17_51-17349981583331124121?project=apache-beam-testing.
Found:
https://console.cloud.google.com/dataflow/jobsDetail/locations/us-central1/jobs/2019-07-23_12_29_35-10676541449082568627?project=apache-beam-testing.
Found:
https://console.cloud.google.com/dataflow/jobsDetail/locations/us-central1/jobs/2019-07-23_12_40_38-10319187647776092241?project=apache-beam-testing.
Found:
https://console.cloud.google.com/dataflow/jobsDetail/locations/us-central1/jobs/2019-07-23_12_51_06-8598430577117379657?project=apache-beam-testing.
----------------------------------------------------------------------
XML: nosetests-postCommitIT-df-py36.xml
----------------------------------------------------------------------
XML:
<https://builds.apache.org/job/beam_PostCommit_Python36/ws/src/sdks/python/nosetests.xml>
----------------------------------------------------------------------
Ran 41 tests in 3124.296s
FAILED (SKIP=4, failures=2)
> Task :sdks:python:test-suites:dataflow:py36:postCommitIT FAILED
FAILURE: Build failed with an exception.
* Where:
Build file
'<https://builds.apache.org/job/beam_PostCommit_Python36/ws/src/sdks/python/test-suites/dataflow/py36/build.gradle'>
line: 49
* What went wrong:
Execution failed for task ':sdks:python:test-suites:dataflow:py36:postCommitIT'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug
option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with
Gradle 6.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See
https://docs.gradle.org/5.2.1/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 53m 0s
63 actionable tasks: 46 executed, 17 from cache
Publishing build scan...
https://gradle.com/s/qitb3ezv3idrw
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
