See <https://ci-beam.apache.org/job/beam_LoadTests_Python_ParDo_Dataflow_Batch/844/display/redirect?page=changes>
Changes: [samuelw] [BEAM-12818] Write windowed file output to a consistent subdirectory [samuelw] [BEAM-13268] Change autosharding big query inserts to happen in parallel [noreply] [BEAM-3293] Add check for error on NewIterable call (#16006) [Brian Hulette] remove pkg_resources in run_generate_requirements.sh [Brian Hulette] Run generatePythonRequirementsAll for pyarrow 6 [noreply] Update dev container tags used by Dataflow runner with unreleased SDKs. [noreply] [BEAM-13265] Add withDeterministicRecordIdFn which allows for [noreply] [BEAM-13183] [BEAM-8152] Use venv instead of virtualenv to create Python ------------------------------------------ [...truncated 89.85 KB...] INFO:apache_beam.runners.dataflow.dataflow_runner:2021-11-18T13:30:35.348Z: JOB_MESSAGE_DETAILED: Fusing consumer Step: 19 into Step: 18 INFO:apache_beam.runners.dataflow.dataflow_runner:2021-11-18T13:30:35.392Z: JOB_MESSAGE_DETAILED: Fusing consumer Step: 20 into Step: 19 INFO:apache_beam.runners.dataflow.dataflow_runner:2021-11-18T13:30:35.445Z: JOB_MESSAGE_DETAILED: Fusing consumer Step: 21 into Step: 20 INFO:apache_beam.runners.dataflow.dataflow_runner:2021-11-18T13:30:35.474Z: JOB_MESSAGE_DETAILED: Fusing consumer Step: 22 into Step: 21 INFO:apache_beam.runners.dataflow.dataflow_runner:2021-11-18T13:30:35.511Z: JOB_MESSAGE_DETAILED: Fusing consumer Step: 23 into Step: 22 INFO:apache_beam.runners.dataflow.dataflow_runner:2021-11-18T13:30:35.532Z: JOB_MESSAGE_DETAILED: Fusing consumer Step: 24 into Step: 23 INFO:apache_beam.runners.dataflow.dataflow_runner:2021-11-18T13:30:35.559Z: JOB_MESSAGE_DETAILED: Fusing consumer Step: 25 into Step: 24 INFO:apache_beam.runners.dataflow.dataflow_runner:2021-11-18T13:30:35.591Z: JOB_MESSAGE_DETAILED: Fusing consumer Step: 26 into Step: 25 INFO:apache_beam.runners.dataflow.dataflow_runner:2021-11-18T13:30:35.624Z: JOB_MESSAGE_DETAILED: Fusing consumer Step: 27 into Step: 26 INFO:apache_beam.runners.dataflow.dataflow_runner:2021-11-18T13:30:35.658Z: JOB_MESSAGE_DETAILED: Fusing consumer Step: 28 into Step: 27 INFO:apache_beam.runners.dataflow.dataflow_runner:2021-11-18T13:30:35.706Z: JOB_MESSAGE_DETAILED: Fusing consumer Step: 29 into Step: 28 INFO:apache_beam.runners.dataflow.dataflow_runner:2021-11-18T13:30:35.737Z: JOB_MESSAGE_DETAILED: Fusing consumer Step: 30 into Step: 29 INFO:apache_beam.runners.dataflow.dataflow_runner:2021-11-18T13:30:35.775Z: JOB_MESSAGE_DETAILED: Fusing consumer Step: 31 into Step: 30 INFO:apache_beam.runners.dataflow.dataflow_runner:2021-11-18T13:30:35.809Z: JOB_MESSAGE_DETAILED: Fusing consumer Step: 32 into Step: 31 INFO:apache_beam.runners.dataflow.dataflow_runner:2021-11-18T13:30:35.844Z: JOB_MESSAGE_DETAILED: Fusing consumer Step: 33 into Step: 32 INFO:apache_beam.runners.dataflow.dataflow_runner:2021-11-18T13:30:35.878Z: JOB_MESSAGE_DETAILED: Fusing consumer Step: 34 into Step: 33 INFO:apache_beam.runners.dataflow.dataflow_runner:2021-11-18T13:30:35.907Z: JOB_MESSAGE_DETAILED: Fusing consumer Step: 35 into Step: 34 INFO:apache_beam.runners.dataflow.dataflow_runner:2021-11-18T13:30:35.948Z: JOB_MESSAGE_DETAILED: Fusing consumer Step: 36 into Step: 35 INFO:apache_beam.runners.dataflow.dataflow_runner:2021-11-18T13:30:35.972Z: JOB_MESSAGE_DETAILED: Fusing consumer Step: 37 into Step: 36 INFO:apache_beam.runners.dataflow.dataflow_runner:2021-11-18T13:30:36.008Z: JOB_MESSAGE_DETAILED: Fusing consumer Step: 38 into Step: 37 INFO:apache_beam.runners.dataflow.dataflow_runner:2021-11-18T13:30:36.043Z: JOB_MESSAGE_DETAILED: Fusing consumer Step: 39 into Step: 38 INFO:apache_beam.runners.dataflow.dataflow_runner:2021-11-18T13:30:36.079Z: JOB_MESSAGE_DETAILED: Fusing consumer Step: 40 into Step: 39 INFO:apache_beam.runners.dataflow.dataflow_runner:2021-11-18T13:30:36.150Z: JOB_MESSAGE_DETAILED: Fusing consumer Step: 41 into Step: 40 INFO:apache_beam.runners.dataflow.dataflow_runner:2021-11-18T13:30:36.325Z: JOB_MESSAGE_DETAILED: Fusing consumer Step: 42 into Step: 41 INFO:apache_beam.runners.dataflow.dataflow_runner:2021-11-18T13:30:36.403Z: JOB_MESSAGE_DETAILED: Fusing consumer Step: 43 into Step: 42 INFO:apache_beam.runners.dataflow.dataflow_runner:2021-11-18T13:30:36.478Z: JOB_MESSAGE_DETAILED: Fusing consumer Step: 44 into Step: 43 INFO:apache_beam.runners.dataflow.dataflow_runner:2021-11-18T13:30:36.557Z: JOB_MESSAGE_DETAILED: Fusing consumer Step: 45 into Step: 44 INFO:apache_beam.runners.dataflow.dataflow_runner:2021-11-18T13:30:36.638Z: JOB_MESSAGE_DETAILED: Fusing consumer Step: 46 into Step: 45 INFO:apache_beam.runners.dataflow.dataflow_runner:2021-11-18T13:30:36.671Z: JOB_MESSAGE_DETAILED: Fusing consumer Step: 47 into Step: 46 INFO:apache_beam.runners.dataflow.dataflow_runner:2021-11-18T13:30:36.705Z: JOB_MESSAGE_DETAILED: Fusing consumer Step: 48 into Step: 47 INFO:apache_beam.runners.dataflow.dataflow_runner:2021-11-18T13:30:36.743Z: JOB_MESSAGE_DETAILED: Fusing consumer Step: 49 into Step: 48 INFO:apache_beam.runners.dataflow.dataflow_runner:2021-11-18T13:30:36.770Z: JOB_MESSAGE_DETAILED: Fusing consumer Step: 50 into Step: 49 INFO:apache_beam.runners.dataflow.dataflow_runner:2021-11-18T13:30:36.809Z: JOB_MESSAGE_DETAILED: Fusing consumer Step: 51 into Step: 50 INFO:apache_beam.runners.dataflow.dataflow_runner:2021-11-18T13:30:36.835Z: JOB_MESSAGE_DETAILED: Fusing consumer Step: 52 into Step: 51 INFO:apache_beam.runners.dataflow.dataflow_runner:2021-11-18T13:30:36.859Z: JOB_MESSAGE_DETAILED: Fusing consumer Step: 53 into Step: 52 INFO:apache_beam.runners.dataflow.dataflow_runner:2021-11-18T13:30:36.879Z: JOB_MESSAGE_DETAILED: Fusing consumer Step: 54 into Step: 53 INFO:apache_beam.runners.dataflow.dataflow_runner:2021-11-18T13:30:36.903Z: JOB_MESSAGE_DETAILED: Fusing consumer Step: 55 into Step: 54 INFO:apache_beam.runners.dataflow.dataflow_runner:2021-11-18T13:30:36.929Z: JOB_MESSAGE_DETAILED: Fusing consumer Step: 56 into Step: 55 INFO:apache_beam.runners.dataflow.dataflow_runner:2021-11-18T13:30:36.964Z: JOB_MESSAGE_DETAILED: Fusing consumer Step: 57 into Step: 56 INFO:apache_beam.runners.dataflow.dataflow_runner:2021-11-18T13:30:37.005Z: JOB_MESSAGE_DETAILED: Fusing consumer Step: 58 into Step: 57 INFO:apache_beam.runners.dataflow.dataflow_runner:2021-11-18T13:30:37.028Z: JOB_MESSAGE_DETAILED: Fusing consumer Step: 59 into Step: 58 INFO:apache_beam.runners.dataflow.dataflow_runner:2021-11-18T13:30:37.052Z: JOB_MESSAGE_DETAILED: Fusing consumer Step: 60 into Step: 59 INFO:apache_beam.runners.dataflow.dataflow_runner:2021-11-18T13:30:37.086Z: JOB_MESSAGE_DETAILED: Fusing consumer Step: 61 into Step: 60 INFO:apache_beam.runners.dataflow.dataflow_runner:2021-11-18T13:30:37.117Z: JOB_MESSAGE_DETAILED: Fusing consumer Step: 62 into Step: 61 INFO:apache_beam.runners.dataflow.dataflow_runner:2021-11-18T13:30:37.143Z: JOB_MESSAGE_DETAILED: Fusing consumer Step: 63 into Step: 62 INFO:apache_beam.runners.dataflow.dataflow_runner:2021-11-18T13:30:37.183Z: JOB_MESSAGE_DETAILED: Fusing consumer Step: 64 into Step: 63 INFO:apache_beam.runners.dataflow.dataflow_runner:2021-11-18T13:30:37.244Z: JOB_MESSAGE_DETAILED: Fusing consumer Step: 65 into Step: 64 INFO:apache_beam.runners.dataflow.dataflow_runner:2021-11-18T13:30:37.303Z: JOB_MESSAGE_DETAILED: Fusing consumer Step: 66 into Step: 65 INFO:apache_beam.runners.dataflow.dataflow_runner:2021-11-18T13:30:37.334Z: JOB_MESSAGE_DETAILED: Fusing consumer Step: 67 into Step: 66 INFO:apache_beam.runners.dataflow.dataflow_runner:2021-11-18T13:30:37.369Z: JOB_MESSAGE_DETAILED: Fusing consumer Step: 68 into Step: 67 INFO:apache_beam.runners.dataflow.dataflow_runner:2021-11-18T13:30:37.403Z: JOB_MESSAGE_DETAILED: Fusing consumer Step: 69 into Step: 68 INFO:apache_beam.runners.dataflow.dataflow_runner:2021-11-18T13:30:37.447Z: JOB_MESSAGE_DETAILED: Fusing consumer Step: 70 into Step: 69 INFO:apache_beam.runners.dataflow.dataflow_runner:2021-11-18T13:30:37.487Z: JOB_MESSAGE_DETAILED: Fusing consumer Step: 71 into Step: 70 INFO:apache_beam.runners.dataflow.dataflow_runner:2021-11-18T13:30:37.518Z: JOB_MESSAGE_DETAILED: Fusing consumer Step: 72 into Step: 71 INFO:apache_beam.runners.dataflow.dataflow_runner:2021-11-18T13:30:37.552Z: JOB_MESSAGE_DETAILED: Fusing consumer Step: 73 into Step: 72 INFO:apache_beam.runners.dataflow.dataflow_runner:2021-11-18T13:30:37.578Z: JOB_MESSAGE_DETAILED: Fusing consumer Step: 74 into Step: 73 INFO:apache_beam.runners.dataflow.dataflow_runner:2021-11-18T13:30:37.612Z: JOB_MESSAGE_DETAILED: Fusing consumer Step: 75 into Step: 74 INFO:apache_beam.runners.dataflow.dataflow_runner:2021-11-18T13:30:37.647Z: JOB_MESSAGE_DETAILED: Fusing consumer Step: 76 into Step: 75 INFO:apache_beam.runners.dataflow.dataflow_runner:2021-11-18T13:30:37.691Z: JOB_MESSAGE_DETAILED: Fusing consumer Step: 77 into Step: 76 INFO:apache_beam.runners.dataflow.dataflow_runner:2021-11-18T13:30:37.720Z: JOB_MESSAGE_DETAILED: Fusing consumer Step: 78 into Step: 77 INFO:apache_beam.runners.dataflow.dataflow_runner:2021-11-18T13:30:37.767Z: JOB_MESSAGE_DETAILED: Fusing consumer Step: 79 into Step: 78 INFO:apache_beam.runners.dataflow.dataflow_runner:2021-11-18T13:30:37.799Z: JOB_MESSAGE_DETAILED: Fusing consumer Step: 80 into Step: 79 INFO:apache_beam.runners.dataflow.dataflow_runner:2021-11-18T13:30:37.836Z: JOB_MESSAGE_DETAILED: Fusing consumer Step: 81 into Step: 80 INFO:apache_beam.runners.dataflow.dataflow_runner:2021-11-18T13:30:37.869Z: JOB_MESSAGE_DETAILED: Fusing consumer Step: 82 into Step: 81 INFO:apache_beam.runners.dataflow.dataflow_runner:2021-11-18T13:30:37.900Z: JOB_MESSAGE_DETAILED: Fusing consumer Step: 83 into Step: 82 INFO:apache_beam.runners.dataflow.dataflow_runner:2021-11-18T13:30:37.923Z: JOB_MESSAGE_DETAILED: Fusing consumer Step: 84 into Step: 83 INFO:apache_beam.runners.dataflow.dataflow_runner:2021-11-18T13:30:37.949Z: JOB_MESSAGE_DETAILED: Fusing consumer Step: 85 into Step: 84 INFO:apache_beam.runners.dataflow.dataflow_runner:2021-11-18T13:30:38.009Z: JOB_MESSAGE_DETAILED: Fusing consumer Step: 86 into Step: 85 INFO:apache_beam.runners.dataflow.dataflow_runner:2021-11-18T13:30:38.042Z: JOB_MESSAGE_DETAILED: Fusing consumer Step: 87 into Step: 86 INFO:apache_beam.runners.dataflow.dataflow_runner:2021-11-18T13:30:38.081Z: JOB_MESSAGE_DETAILED: Fusing consumer Step: 88 into Step: 87 INFO:apache_beam.runners.dataflow.dataflow_runner:2021-11-18T13:30:38.111Z: JOB_MESSAGE_DETAILED: Fusing consumer Step: 89 into Step: 88 INFO:apache_beam.runners.dataflow.dataflow_runner:2021-11-18T13:30:38.143Z: JOB_MESSAGE_DETAILED: Fusing consumer Step: 90 into Step: 89 INFO:apache_beam.runners.dataflow.dataflow_runner:2021-11-18T13:30:38.178Z: JOB_MESSAGE_DETAILED: Fusing consumer Step: 91 into Step: 90 INFO:apache_beam.runners.dataflow.dataflow_runner:2021-11-18T13:30:38.214Z: JOB_MESSAGE_DETAILED: Fusing consumer Step: 92 into Step: 91 INFO:apache_beam.runners.dataflow.dataflow_runner:2021-11-18T13:30:38.249Z: JOB_MESSAGE_DETAILED: Fusing consumer Step: 93 into Step: 92 INFO:apache_beam.runners.dataflow.dataflow_runner:2021-11-18T13:30:38.302Z: JOB_MESSAGE_DETAILED: Fusing consumer Step: 94 into Step: 93 INFO:apache_beam.runners.dataflow.dataflow_runner:2021-11-18T13:30:38.326Z: JOB_MESSAGE_DETAILED: Fusing consumer Step: 95 into Step: 94 INFO:apache_beam.runners.dataflow.dataflow_runner:2021-11-18T13:30:38.361Z: JOB_MESSAGE_DETAILED: Fusing consumer Step: 96 into Step: 95 INFO:apache_beam.runners.dataflow.dataflow_runner:2021-11-18T13:30:38.398Z: JOB_MESSAGE_DETAILED: Fusing consumer Step: 97 into Step: 96 INFO:apache_beam.runners.dataflow.dataflow_runner:2021-11-18T13:30:38.445Z: JOB_MESSAGE_DETAILED: Fusing consumer Step: 98 into Step: 97 INFO:apache_beam.runners.dataflow.dataflow_runner:2021-11-18T13:30:38.482Z: JOB_MESSAGE_DETAILED: Fusing consumer Step: 99 into Step: 98 INFO:apache_beam.runners.dataflow.dataflow_runner:2021-11-18T13:30:38.519Z: JOB_MESSAGE_DETAILED: Fusing consumer Step: 100 into Step: 99 INFO:apache_beam.runners.dataflow.dataflow_runner:2021-11-18T13:30:38.552Z: JOB_MESSAGE_DETAILED: Fusing consumer Step: 101 into Step: 100 INFO:apache_beam.runners.dataflow.dataflow_runner:2021-11-18T13:30:38.578Z: JOB_MESSAGE_DETAILED: Fusing consumer Step: 102 into Step: 101 INFO:apache_beam.runners.dataflow.dataflow_runner:2021-11-18T13:30:38.613Z: JOB_MESSAGE_DETAILED: Fusing consumer Step: 103 into Step: 102 INFO:apache_beam.runners.dataflow.dataflow_runner:2021-11-18T13:30:38.642Z: JOB_MESSAGE_DETAILED: Fusing consumer Step: 104 into Step: 103 INFO:apache_beam.runners.dataflow.dataflow_runner:2021-11-18T13:30:38.680Z: JOB_MESSAGE_DETAILED: Fusing consumer Step: 105 into Step: 104 INFO:apache_beam.runners.dataflow.dataflow_runner:2021-11-18T13:30:38.727Z: JOB_MESSAGE_DETAILED: Fusing consumer Step: 106 into Step: 105 INFO:apache_beam.runners.dataflow.dataflow_runner:2021-11-18T13:30:38.760Z: JOB_MESSAGE_DETAILED: Fusing consumer Step: 107 into Step: 106 INFO:apache_beam.runners.dataflow.dataflow_runner:2021-11-18T13:30:38.806Z: JOB_MESSAGE_DETAILED: Fusing consumer Step: 108 into Step: 107 INFO:apache_beam.runners.dataflow.dataflow_runner:2021-11-18T13:30:38.828Z: JOB_MESSAGE_DETAILED: Fusing consumer Step: 109 into Step: 108 INFO:apache_beam.runners.dataflow.dataflow_runner:2021-11-18T13:30:38.867Z: JOB_MESSAGE_DETAILED: Fusing consumer Step: 110 into Step: 109 INFO:apache_beam.runners.dataflow.dataflow_runner:2021-11-18T13:30:38.896Z: JOB_MESSAGE_DETAILED: Fusing consumer Step: 111 into Step: 110 INFO:apache_beam.runners.dataflow.dataflow_runner:2021-11-18T13:30:38.921Z: JOB_MESSAGE_DETAILED: Fusing consumer Step: 112 into Step: 111 INFO:apache_beam.runners.dataflow.dataflow_runner:2021-11-18T13:30:38.952Z: JOB_MESSAGE_DETAILED: Fusing consumer Step: 113 into Step: 112 INFO:apache_beam.runners.dataflow.dataflow_runner:2021-11-18T13:30:39.002Z: JOB_MESSAGE_DETAILED: Fusing consumer Step: 114 into Step: 113 INFO:apache_beam.runners.dataflow.dataflow_runner:2021-11-18T13:30:39.041Z: JOB_MESSAGE_DETAILED: Fusing consumer Step: 115 into Step: 114 INFO:apache_beam.runners.dataflow.dataflow_runner:2021-11-18T13:30:39.072Z: JOB_MESSAGE_DETAILED: Fusing consumer Step: 116 into Step: 115 INFO:apache_beam.runners.dataflow.dataflow_runner:2021-11-18T13:30:39.105Z: JOB_MESSAGE_DETAILED: Fusing consumer Step: 117 into Step: 116 INFO:apache_beam.runners.dataflow.dataflow_runner:2021-11-18T13:30:39.137Z: JOB_MESSAGE_DETAILED: Fusing consumer Step: 118 into Step: 117 INFO:apache_beam.runners.dataflow.dataflow_runner:2021-11-18T13:30:39.171Z: JOB_MESSAGE_DETAILED: Fusing consumer Step: 119 into Step: 118 INFO:apache_beam.runners.dataflow.dataflow_runner:2021-11-18T13:30:39.206Z: JOB_MESSAGE_DETAILED: Fusing consumer Step: 120 into Step: 119 INFO:apache_beam.runners.dataflow.dataflow_runner:2021-11-18T13:30:39.242Z: JOB_MESSAGE_DETAILED: Fusing consumer Step: 121 into Step: 120 INFO:apache_beam.runners.dataflow.dataflow_runner:2021-11-18T13:30:39.302Z: JOB_MESSAGE_DETAILED: Fusing consumer Step: 122 into Step: 121 INFO:apache_beam.runners.dataflow.dataflow_runner:2021-11-18T13:30:39.325Z: JOB_MESSAGE_DETAILED: Fusing consumer Step: 123 into Step: 122 INFO:apache_beam.runners.dataflow.dataflow_runner:2021-11-18T13:30:39.362Z: JOB_MESSAGE_DETAILED: Fusing consumer Step: 124 into Step: 123 INFO:apache_beam.runners.dataflow.dataflow_runner:2021-11-18T13:30:39.393Z: JOB_MESSAGE_DETAILED: Fusing consumer Step: 125 into Step: 124 INFO:apache_beam.runners.dataflow.dataflow_runner:2021-11-18T13:30:39.446Z: JOB_MESSAGE_DETAILED: Fusing consumer Step: 126 into Step: 125 INFO:apache_beam.runners.dataflow.dataflow_runner:2021-11-18T13:30:39.475Z: JOB_MESSAGE_DETAILED: Fusing consumer Step: 127 into Step: 126 INFO:apache_beam.runners.dataflow.dataflow_runner:2021-11-18T13:30:39.511Z: JOB_MESSAGE_DETAILED: Fusing consumer Step: 128 into Step: 127 INFO:apache_beam.runners.dataflow.dataflow_runner:2021-11-18T13:30:39.532Z: JOB_MESSAGE_DETAILED: Fusing consumer Step: 129 into Step: 128 INFO:apache_beam.runners.dataflow.dataflow_runner:2021-11-18T13:30:39.554Z: JOB_MESSAGE_DETAILED: Fusing consumer Step: 130 into Step: 129 INFO:apache_beam.runners.dataflow.dataflow_runner:2021-11-18T13:30:39.588Z: JOB_MESSAGE_DETAILED: Fusing consumer Step: 131 into Step: 130 INFO:apache_beam.runners.dataflow.dataflow_runner:2021-11-18T13:30:39.614Z: JOB_MESSAGE_DETAILED: Fusing consumer Step: 132 into Step: 131 INFO:apache_beam.runners.dataflow.dataflow_runner:2021-11-18T13:30:39.648Z: JOB_MESSAGE_DETAILED: Fusing consumer Step: 133 into Step: 132 INFO:apache_beam.runners.dataflow.dataflow_runner:2021-11-18T13:30:39.673Z: JOB_MESSAGE_DETAILED: Fusing consumer Step: 134 into Step: 133 INFO:apache_beam.runners.dataflow.dataflow_runner:2021-11-18T13:30:39.708Z: JOB_MESSAGE_DETAILED: Fusing consumer Step: 135 into Step: 134 INFO:apache_beam.runners.dataflow.dataflow_runner:2021-11-18T13:30:39.773Z: JOB_MESSAGE_DETAILED: Fusing consumer Step: 136 into Step: 135 INFO:apache_beam.runners.dataflow.dataflow_runner:2021-11-18T13:30:39.809Z: JOB_MESSAGE_DETAILED: Fusing consumer Step: 137 into Step: 136 INFO:apache_beam.runners.dataflow.dataflow_runner:2021-11-18T13:30:39.842Z: JOB_MESSAGE_DETAILED: Fusing consumer Step: 138 into Step: 137 INFO:apache_beam.runners.dataflow.dataflow_runner:2021-11-18T13:30:39.868Z: JOB_MESSAGE_DETAILED: Fusing consumer Step: 139 into Step: 138 INFO:apache_beam.runners.dataflow.dataflow_runner:2021-11-18T13:30:39.899Z: JOB_MESSAGE_DETAILED: Fusing consumer Step: 140 into Step: 139 INFO:apache_beam.runners.dataflow.dataflow_runner:2021-11-18T13:30:39.934Z: JOB_MESSAGE_DETAILED: Fusing consumer Step: 141 into Step: 140 INFO:apache_beam.runners.dataflow.dataflow_runner:2021-11-18T13:30:39.968Z: JOB_MESSAGE_DETAILED: Fusing consumer Step: 142 into Step: 141 INFO:apache_beam.runners.dataflow.dataflow_runner:2021-11-18T13:30:40.007Z: JOB_MESSAGE_DETAILED: Fusing consumer Step: 143 into Step: 142 INFO:apache_beam.runners.dataflow.dataflow_runner:2021-11-18T13:30:40.041Z: JOB_MESSAGE_DETAILED: Fusing consumer Step: 144 into Step: 143 INFO:apache_beam.runners.dataflow.dataflow_runner:2021-11-18T13:30:40.077Z: JOB_MESSAGE_DETAILED: Fusing consumer Step: 145 into Step: 144 INFO:apache_beam.runners.dataflow.dataflow_runner:2021-11-18T13:30:40.113Z: JOB_MESSAGE_DETAILED: Fusing consumer Step: 146 into Step: 145 INFO:apache_beam.runners.dataflow.dataflow_runner:2021-11-18T13:30:40.147Z: JOB_MESSAGE_DETAILED: Fusing consumer Step: 147 into Step: 146 INFO:apache_beam.runners.dataflow.dataflow_runner:2021-11-18T13:30:40.183Z: JOB_MESSAGE_DETAILED: Fusing consumer Step: 148 into Step: 147 INFO:apache_beam.runners.dataflow.dataflow_runner:2021-11-18T13:30:40.212Z: JOB_MESSAGE_DETAILED: Fusing consumer Step: 149 into Step: 148 INFO:apache_beam.runners.dataflow.dataflow_runner:2021-11-18T13:30:40.249Z: JOB_MESSAGE_DETAILED: Fusing consumer Step: 150 into Step: 149 INFO:apache_beam.runners.dataflow.dataflow_runner:2021-11-18T13:30:40.307Z: JOB_MESSAGE_DETAILED: Fusing consumer Step: 151 into Step: 150 INFO:apache_beam.runners.dataflow.dataflow_runner:2021-11-18T13:30:40.344Z: JOB_MESSAGE_DETAILED: Fusing consumer Step: 152 into Step: 151 INFO:apache_beam.runners.dataflow.dataflow_runner:2021-11-18T13:30:40.380Z: JOB_MESSAGE_DETAILED: Fusing consumer Step: 153 into Step: 152 INFO:apache_beam.runners.dataflow.dataflow_runner:2021-11-18T13:30:40.432Z: JOB_MESSAGE_DETAILED: Fusing consumer Step: 154 into Step: 153 INFO:apache_beam.runners.dataflow.dataflow_runner:2021-11-18T13:30:40.457Z: JOB_MESSAGE_DETAILED: Fusing consumer Step: 155 into Step: 154 INFO:apache_beam.runners.dataflow.dataflow_runner:2021-11-18T13:30:40.489Z: JOB_MESSAGE_DETAILED: Fusing consumer Step: 156 into Step: 155 INFO:apache_beam.runners.dataflow.dataflow_runner:2021-11-18T13:30:40.522Z: JOB_MESSAGE_DETAILED: Fusing consumer Step: 157 into Step: 156 INFO:apache_beam.runners.dataflow.dataflow_runner:2021-11-18T13:30:40.554Z: JOB_MESSAGE_DETAILED: Fusing consumer Step: 158 into Step: 157 INFO:apache_beam.runners.dataflow.dataflow_runner:2021-11-18T13:30:40.590Z: JOB_MESSAGE_DETAILED: Fusing consumer Step: 159 into Step: 158 INFO:apache_beam.runners.dataflow.dataflow_runner:2021-11-18T13:30:40.624Z: JOB_MESSAGE_DETAILED: Fusing consumer Step: 160 into Step: 159 INFO:apache_beam.runners.dataflow.dataflow_runner:2021-11-18T13:30:40.669Z: JOB_MESSAGE_DETAILED: Fusing consumer Step: 161 into Step: 160 INFO:apache_beam.runners.dataflow.dataflow_runner:2021-11-18T13:30:40.699Z: JOB_MESSAGE_DETAILED: Fusing consumer Step: 162 into Step: 161 INFO:apache_beam.runners.dataflow.dataflow_runner:2021-11-18T13:30:40.724Z: JOB_MESSAGE_DETAILED: Fusing consumer Step: 163 into Step: 162 INFO:apache_beam.runners.dataflow.dataflow_runner:2021-11-18T13:30:40.755Z: JOB_MESSAGE_DETAILED: Fusing consumer Step: 164 into Step: 163 INFO:apache_beam.runners.dataflow.dataflow_runner:2021-11-18T13:30:40.782Z: JOB_MESSAGE_DETAILED: Fusing consumer Step: 165 into Step: 164 INFO:apache_beam.runners.dataflow.dataflow_runner:2021-11-18T13:30:40.821Z: JOB_MESSAGE_DETAILED: Fusing consumer Step: 166 into Step: 165 INFO:apache_beam.runners.dataflow.dataflow_runner:2021-11-18T13:30:40.864Z: JOB_MESSAGE_DETAILED: Fusing consumer Step: 167 into Step: 166 INFO:apache_beam.runners.dataflow.dataflow_runner:2021-11-18T13:30:40.902Z: JOB_MESSAGE_DETAILED: Fusing consumer Step: 168 into Step: 167 INFO:apache_beam.runners.dataflow.dataflow_runner:2021-11-18T13:30:40.935Z: JOB_MESSAGE_DETAILED: Fusing consumer Step: 169 into Step: 168 INFO:apache_beam.runners.dataflow.dataflow_runner:2021-11-18T13:30:40.967Z: JOB_MESSAGE_DETAILED: Fusing consumer Step: 170 into Step: 169 INFO:apache_beam.runners.dataflow.dataflow_runner:2021-11-18T13:30:41.010Z: JOB_MESSAGE_DETAILED: Fusing consumer Step: 171 into Step: 170 INFO:apache_beam.runners.dataflow.dataflow_runner:2021-11-18T13:30:41.033Z: JOB_MESSAGE_DETAILED: Fusing consumer Step: 172 into Step: 171 INFO:apache_beam.runners.dataflow.dataflow_runner:2021-11-18T13:30:41.077Z: JOB_MESSAGE_DETAILED: Fusing consumer Step: 173 into Step: 172 INFO:apache_beam.runners.dataflow.dataflow_runner:2021-11-18T13:30:41.102Z: JOB_MESSAGE_DETAILED: Fusing consumer Step: 174 into Step: 173 INFO:apache_beam.runners.dataflow.dataflow_runner:2021-11-18T13:30:41.133Z: JOB_MESSAGE_DETAILED: Fusing consumer Step: 175 into Step: 174 INFO:apache_beam.runners.dataflow.dataflow_runner:2021-11-18T13:30:41.169Z: JOB_MESSAGE_DETAILED: Fusing consumer Step: 176 into Step: 175 INFO:apache_beam.runners.dataflow.dataflow_runner:2021-11-18T13:30:41.201Z: JOB_MESSAGE_DETAILED: Fusing consumer Step: 177 into Step: 176 INFO:apache_beam.runners.dataflow.dataflow_runner:2021-11-18T13:30:41.250Z: JOB_MESSAGE_DETAILED: Fusing consumer Step: 178 into Step: 177 INFO:apache_beam.runners.dataflow.dataflow_runner:2021-11-18T13:30:41.305Z: JOB_MESSAGE_DETAILED: Fusing consumer Step: 179 into Step: 178 INFO:apache_beam.runners.dataflow.dataflow_runner:2021-11-18T13:30:41.339Z: JOB_MESSAGE_DETAILED: Fusing consumer Step: 180 into Step: 179 INFO:apache_beam.runners.dataflow.dataflow_runner:2021-11-18T13:30:41.363Z: JOB_MESSAGE_DETAILED: Fusing consumer Step: 181 into Step: 180 INFO:apache_beam.runners.dataflow.dataflow_runner:2021-11-18T13:30:41.402Z: JOB_MESSAGE_DETAILED: Fusing consumer Step: 182 into Step: 181 INFO:apache_beam.runners.dataflow.dataflow_runner:2021-11-18T13:30:41.446Z: JOB_MESSAGE_DETAILED: Fusing consumer Step: 183 into Step: 182 INFO:apache_beam.runners.dataflow.dataflow_runner:2021-11-18T13:30:41.481Z: JOB_MESSAGE_DETAILED: Fusing consumer Step: 184 into Step: 183 INFO:apache_beam.runners.dataflow.dataflow_runner:2021-11-18T13:30:41.516Z: JOB_MESSAGE_DETAILED: Fusing consumer Step: 185 into Step: 184 INFO:apache_beam.runners.dataflow.dataflow_runner:2021-11-18T13:30:41.553Z: JOB_MESSAGE_DETAILED: Fusing consumer Step: 186 into Step: 185 INFO:apache_beam.runners.dataflow.dataflow_runner:2021-11-18T13:30:41.591Z: JOB_MESSAGE_DETAILED: Fusing consumer Step: 187 into Step: 186 INFO:apache_beam.runners.dataflow.dataflow_runner:2021-11-18T13:30:41.627Z: JOB_MESSAGE_DETAILED: Fusing consumer Step: 188 into Step: 187 INFO:apache_beam.runners.dataflow.dataflow_runner:2021-11-18T13:30:41.664Z: JOB_MESSAGE_DETAILED: Fusing consumer Step: 189 into Step: 188 INFO:apache_beam.runners.dataflow.dataflow_runner:2021-11-18T13:30:41.708Z: JOB_MESSAGE_DETAILED: Fusing consumer Step: 190 into Step: 189 INFO:apache_beam.runners.dataflow.dataflow_runner:2021-11-18T13:30:41.745Z: JOB_MESSAGE_DETAILED: Fusing consumer Step: 191 into Step: 190 INFO:apache_beam.runners.dataflow.dataflow_runner:2021-11-18T13:30:41.786Z: JOB_MESSAGE_DETAILED: Fusing consumer Step: 192 into Step: 191 INFO:apache_beam.runners.dataflow.dataflow_runner:2021-11-18T13:30:41.815Z: JOB_MESSAGE_DETAILED: Fusing consumer Step: 193 into Step: 192 INFO:apache_beam.runners.dataflow.dataflow_runner:2021-11-18T13:30:41.843Z: JOB_MESSAGE_DETAILED: Fusing consumer Step: 194 into Step: 193 INFO:apache_beam.runners.dataflow.dataflow_runner:2021-11-18T13:30:41.878Z: JOB_MESSAGE_DETAILED: Fusing consumer Step: 195 into Step: 194 INFO:apache_beam.runners.dataflow.dataflow_runner:2021-11-18T13:30:41.914Z: JOB_MESSAGE_DETAILED: Fusing consumer Step: 196 into Step: 195 INFO:apache_beam.runners.dataflow.dataflow_runner:2021-11-18T13:30:41.958Z: JOB_MESSAGE_DETAILED: Fusing consumer Step: 197 into Step: 196 INFO:apache_beam.runners.dataflow.dataflow_runner:2021-11-18T13:30:41.989Z: JOB_MESSAGE_DETAILED: Fusing consumer Step: 198 into Step: 197 INFO:apache_beam.runners.dataflow.dataflow_runner:2021-11-18T13:30:42.023Z: JOB_MESSAGE_DETAILED: Fusing consumer Step: 199 into Step: 198 INFO:apache_beam.runners.dataflow.dataflow_runner:2021-11-18T13:30:42.059Z: JOB_MESSAGE_DETAILED: Fusing consumer Measure time: End into Step: 199 INFO:apache_beam.runners.dataflow.dataflow_runner:2021-11-18T13:30:42.096Z: JOB_MESSAGE_DEBUG: Workflow config is missing a default resource spec. INFO:apache_beam.runners.dataflow.dataflow_runner:2021-11-18T13:30:42.136Z: JOB_MESSAGE_DEBUG: Adding StepResource setup and teardown to workflow graph. INFO:apache_beam.runners.dataflow.dataflow_runner:2021-11-18T13:30:42.169Z: JOB_MESSAGE_DEBUG: Adding workflow start and stop steps. INFO:apache_beam.runners.dataflow.dataflow_runner:2021-11-18T13:30:42.204Z: JOB_MESSAGE_DEBUG: Assigning stage ids. INFO:apache_beam.runners.dataflow.dataflow_runner:2021-11-18T13:30:42.400Z: JOB_MESSAGE_DEBUG: Executing wait step start3 INFO:apache_beam.runners.dataflow.dataflow_runner:2021-11-18T13:30:42.508Z: JOB_MESSAGE_BASIC: Executing operation Read synthetic+Measure time: Start+Step: 0+Step: 1+Step: 2+Step: 3+Step: 4+Step: 5+Step: 6+Step: 7+Step: 8+Step: 9+Step: 10+Step: 11+Step: 12+Step: 13+Step: 14+Step: 15+Step: 16+Step: 17+Step: 18+Step: 19+Step: 20+Step: 21+Step: 22+Step: 23+Step: 24+Step: 25+Step: 26+Step: 27+Step: 28+Step: 29+Step: 30+Step: 31+Step: 32+Step: 33+Step: 34+Step: 35+Step: 36+Step: 37+Step: 38+Step: 39+Step: 40+Step: 41+Step: 42+Step: 43+Step: 44+Step: 45+Step: 46+Step: 47+Step: 48+Step: 49+Step: 50+Step: 51+Step: 52+Step: 53+Step: 54+Step: 55+Step: 56+Step: 57+Step: 58+Step: 59+Step: 60+Step: 61+Step: 62+Step: 63+Step: 64+Step: 65+Step: 66+Step: 67+Step: 68+Step: 69+Step: 70+Step: 71+Step: 72+Step: 73+Step: 74+Step: 75+Step: 76+Step: 77+Step: 78+Step: 79+Step: 80+Step: 81+Step: 82+Step: 83+Step: 84+Step: 85+Step: 86+Step: 87+Step: 88+Step: 89+Step: 90+Step: 91+Step: 92+Step: 93+Step: 94+Step: 95+Step: 96+Step: 97+Step: 98+Step: 99+Step: 100+Step: 101+Step: 102+Step: 103+Step: 104+Step: 105+Step: 106+Step: 107+Step: 108+Step: 109+Step: 110+Step: 111+Step: 112+Step: 113+Step: 114+Step: 115+Step: 116+Step: 117+Step: 118+Step: 119+Step: 120+Step: 121+Step: 122+Step: 123+Step: 124+Step: 125+Step: 126+Step: 127+Step: 128+Step: 129+Step: 130+Step: 131+Step: 132+Step: 133+Step: 134+Step: 135+Step: 136+Step: 137+Step: 138+Step: 139+Step: 140+Step: 141+Step: 142+Step: 143+Step: 144+Step: 145+Step: 146+Step: 147+Step: 148+Step: 149+Step: 150+Step: 151+Step: 152+Step: 153+Step: 154+Step: 155+Step: 156+Step: 157+Step: 158+Step: 159+Step: 160+Step: 161+Step: 162+Step: 163+Step: 164+Step: 165+Step: 166+Step: 167+Step: 168+Step: 169+Step: 170+Step: 171+Step: 172+Step: 173+Step: 174+Step: 175+Step: 176+Step: 177+Step: 178+Step: 179+Step: 180+Step: 181+Step: 182+Step: 183+Step: 184+Step: 185+Step: 186+Step: 187+Step: 188+Step: 189+Step: 190+Step: 191+Step: 192+Step: 193+Step: 194+Step: 195+Step: 196+Step: 197+Step: 198+Step: 199+Measure time: End INFO:apache_beam.runners.dataflow.dataflow_runner:2021-11-18T13:30:42.559Z: JOB_MESSAGE_DEBUG: Starting **** pool setup. INFO:apache_beam.runners.dataflow.dataflow_runner:2021-11-18T13:30:42.597Z: JOB_MESSAGE_BASIC: Starting 5 ****s in us-central1-c... INFO:apache_beam.runners.dataflow.dataflow_runner:Job 2021-11-18_05_30_26-8948190712658704363 is in state JOB_STATE_RUNNING INFO:apache_beam.runners.dataflow.dataflow_runner:2021-11-18T13:30:57.854Z: JOB_MESSAGE_BASIC: Your project already contains 100 Dataflow-created metric descriptors, so new user metrics of the form custom.googleapis.com/* will not be created. However, all user metrics are also available in the metric dataflow.googleapis.com/job/user_counter. If you rely on the custom metrics, you can delete old / unused metric descriptors. See https://developers.google.com/apis-explorer/#p/monitoring/v3/monitoring.projects.metricDescriptors.list and https://developers.google.com/apis-explorer/#p/monitoring/v3/monitoring.projects.metricDescriptors.delete INFO:apache_beam.runners.dataflow.dataflow_runner:2021-11-18T13:31:33.443Z: JOB_MESSAGE_DETAILED: Autoscaling: Raised the number of ****s to 5 based on the rate of progress in the currently running stage(s). INFO:apache_beam.runners.dataflow.dataflow_runner:2021-11-18T13:31:56.364Z: JOB_MESSAGE_DETAILED: Workers have started successfully. INFO:apache_beam.runners.dataflow.dataflow_runner:2021-11-18T13:31:56.404Z: JOB_MESSAGE_DETAILED: Workers have started successfully. Terminated > Task :sdks:python:apache_beam:testing:load_tests:run FAILED FAILURE: Build failed with an exception. * Where: Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Python_ParDo_Dataflow_Batch/ws/src/sdks/python/apache_beam/testing/load_tests/build.gradle'> line: 58 * What went wrong: Execution failed for task ':sdks:python:apache_beam:testing:load_tests:run'. > error occurred * Try: The message received from the daemon indicates that the daemon has disappeared. Build request sent: Build{id=ff807f0d-cf65-4b57-9b1e-5f3cd4c1f630, currentDir=<https://ci-beam.apache.org/job/beam_LoadTests_Python_ParDo_Dataflow_Batch/ws/src}> Attempting to read last messages from the daemon log... Daemon pid: 17751 log file: /home/jenkins/.gradle/daemon/6.9.1/daemon-17751.out.log ----- Last 20 lines from daemon log file - daemon-17751.out.log ----- FAILURE: Build failed with an exception. * Where: Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Python_ParDo_Dataflow_Batch/ws/src/sdks/python/apache_beam/testing/load_tests/build.gradle'> line: 58 * What went wrong: Execution failed for task ':sdks:python:apache_beam:testing:load_tests:run'. > error occurred * Try: Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights. * Get more help at https://help.gradle.org Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0. Use '--warning-mode all' to show the individual deprecation warnings. See https://docs.gradle.org/6.9.1/userguide/command_line_interface.html#sec:command_line_warnings BUILD FAILED ----- End of the daemon log ----- FAILURE: Build failed with an exception. * What went wrong: Gradle build daemon disappeared unexpectedly (it may have been killed or may have crashed) * Try: Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights. * Get more help at https://help.gradle.org Build step 'Invoke Gradle script' changed build result to FAILURE Build step 'Invoke Gradle script' marked build as failure --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
