[
https://issues.apache.org/jira/browse/FLINK-35437?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dawid Wysakowicz resolved FLINK-35437.
--------------------------------------
Resolution: Fixed
Fixed in 3d40bd7dd197b12b7b156bd758b4129148e885d1
> BlockStatementGrouper uses lots of memory
> -----------------------------------------
>
> Key: FLINK-35437
> URL: https://issues.apache.org/jira/browse/FLINK-35437
> Project: Flink
> Issue Type: Improvement
> Components: Table SQL / Runtime
> Affects Versions: 1.19.0
> Reporter: Dawid Wysakowicz
> Assignee: Dawid Wysakowicz
> Priority: Major
> Labels: pull-request-available
> Fix For: 1.20.0
>
>
> For deeply nested {{if else}} statements {{BlockStatementGrouper}} uses loads
> of memory and fails with OOM quickly.
> When running JMs with around 400mb a query like:
> {code}
> select case when orderid = 0 then 1 when orderid = 1 then 2 when orderid
> = 2 then 3 when orderid = 3 then 4 when orderid = 4 then 5 when orderid =
> 5 then
> 6 when orderid = 6 then 7 when orderid = 7 then 8 when orderid = 8 then 9
> when
> orderid = 9 then 10 when orderid = 10 then 11 when orderid = 11 then 12
> when orderid
> = 12 then 13 when orderid = 13 then 14 when orderid = 14 then 15 when
> orderid
> = 15 then 16 when orderid = 16 then 17 when orderid = 17 then 18 when
> orderid
> = 18 then 19 when orderid = 19 then 20 when orderid = 20 then 21 when
> orderid
> = 21 then 22 when orderid = 22 then 23 when orderid = 23 then 24 when
> orderid
> = 24 then 25 when orderid = 25 then 26 when orderid = 26 then 27 when
> orderid
> = 27 then 28 when orderid = 28 then 29 when orderid = 29 then 30 when
> orderid
> = 30 then 31 when orderid = 31 then 32 when orderid = 32 then 33 when
> orderid
> = 33 then 34 when orderid = 34 then 35 when orderid = 35 then 36 when
> orderid
> = 36 then 37 when orderid = 37 then 38 when orderid = 38 then 39 when
> orderid
> = 39 then 40 when orderid = 40 then 41 when orderid = 41 then 42 when
> orderid
> = 42 then 43 when orderid = 43 then 44 when orderid = 44 then 45 when
> orderid
> = 45 then 46 when orderid = 46 then 47 when orderid = 47 then 48 when
> orderid
> = 48 then 49 when orderid = 49 then 50 when orderid = 50 then 51 when
> orderid
> = 51 then 52 when orderid = 52 then 53 when orderid = 53 then 54 when
> orderid
> = 54 then 55 when orderid = 55 then 56 when orderid = 56 then 57 when
> orderid
> = 57 then 58 when orderid = 58 then 59 when orderid = 59 then 60 when
> orderid
> = 60 then 61 when orderid = 61 then 62 when orderid = 62 then 63 when
> orderid
> = 63 then 64 when orderid = 64 then 65 when orderid = 65 then 66 when
> orderid
> = 66 then 67 when orderid = 67 then 68 when orderid = 68 then 69 when
> orderid
> = 69 then 70 when orderid = 70 then 71 when orderid = 71 then 72 when
> orderid
> = 72 then 73 when orderid = 73 then 74 when orderid = 74 then 75 when
> orderid
> = 75 then 76 when orderid = 76 then 77 when orderid = 77 then 78 when
> orderid
> = 78 then 79 when orderid = 79 then 80 when orderid = 80 then 81 when
> orderid
> = 81 then 82 when orderid = 82 then 83 when orderid = 83 then 84 when
> orderid
> = 84 then 85 when orderid = 85 then 86 when orderid = 86 then 87 when
> orderid
> = 87 then 88 when orderid = 88 then 89 when orderid = 89 then 90 when
> orderid
> = 90 then 91 when orderid = 91 then 92 when orderid = 92 then 93 when
> orderid
> = 93 then 94 when orderid = 94 then 95 when orderid = 95 then 96 when
> orderid
> = 96 then 97 when orderid = 97 then 98 when orderid = 98 then 99 when
> orderid
> = 99 then 100 when orderid = 100 then 101 when orderid = 101 then 102
> when orderid
> = 102 then 103 when orderid = 103 then 104 when orderid = 104 then 105
> when orderid
> = 105 then 106 when orderid = 106 then 107 when orderid = 107 then 108
> when orderid
> = 108 then 109 when orderid = 109 then 110 when orderid = 110 then 111
> when orderid
> = 111 then 112 when orderid = 112 then 113 when orderid = 113 then 114
> when orderid
> = 114 then 115 when orderid = 115 then 116 when orderid = 116 then 117
> when orderid
> = 117 then 118 when orderid = 118 then 119 when orderid = 119 then 120
> when orderid
> = 120 then 121 when orderid = 121 then 122 when orderid = 122 then 123
> when orderid
> = 123 then 124 when orderid = 124 then 125 when orderid = 125 then 126
> when orderid
> = 126 then 127 when orderid = 127 then 128 when orderid = 128 then 129
> when orderid
> = 129 then 130 when orderid = 130 then 131 when orderid = 131 then 132
> when orderid
> = 132 then 133 when orderid = 133 then 134 when orderid = 134 then 135
> when orderid
> = 135 then 136 when orderid = 136 then 137 when orderid = 137 then 138
> when orderid
> = 138 then 139 when orderid = 139 then 140 when orderid = 140 then 141
> when orderid
> = 141 then 142 when orderid = 142 then 143 when orderid = 143 then 144
> when orderid
> = 144 then 145 when orderid = 145 then 146 when orderid = 146 then 147
> when orderid
> = 147 then 148 when orderid = 148 then 149 when orderid = 149 then 150
> when orderid
> = 150 then 151 when orderid = 151 then 152 when orderid = 152 then 153
> when orderid
> = 153 then 154 when orderid = 154 then 155 when orderid = 155 then 156
> when orderid
> = 156 then 157 when orderid = 157 then 158 when orderid = 158 then 159
> when orderid
> = 159 then 160 when orderid = 160 then 161 when orderid = 161 then 162
> when orderid
> = 162 then 163 when orderid = 163 then 164 when orderid = 164 then 165
> when orderid
> = 165 then 166 when orderid = 166 then 167 when orderid = 167 then 168
> when orderid
> = 168 then 169 when orderid = 169 then 170 when orderid = 170 then 171
> when orderid
> = 171 then 172 when orderid = 172 then 173 when orderid = 173 then 174
> when orderid
> = 174 then 175 when orderid = 175 then 176 when orderid = 176 then 177
> when orderid
> = 177 then 178 when orderid = 178 then 179 when orderid = 179 then 180
> when orderid
> = 180 then 181 when orderid = 181 then 182 when orderid = 182 then 183
> when orderid
> = 183 then 184 when orderid = 184 then 185 when orderid = 185 then 186
> when orderid
> = 186 then 187 when orderid = 187 then 188 when orderid = 188 then 189
> when orderid
> = 189 then 190 when orderid = 190 then 191 when orderid = 191 then 192
> when orderid
> = 192 then 193 when orderid = 193 then 194 when orderid = 194 then 195
> when orderid
> = 195 then 196 when orderid = 196 then 197 when orderid = 197 then 198
> when orderid
> = 198 then 199 when orderid = 199 then 200 when orderid = 200 then 201
> when orderid
> = 201 then 202 when orderid = 202 then 203 when orderid = 203 then 204
> when orderid
> = 204 then 205 when orderid = 205 then 206 when orderid = 206 then 207
> when orderid
> = 207 then 208 when orderid = 208 then 209 when orderid = 209 then 210
> when orderid
> = 210 then 211 when orderid = 211 then 212 when orderid = 212 then 213
> when orderid
> = 213 then 214 when orderid = 214 then 215 when orderid = 215 then 216
> when orderid
> = 216 then 217 when orderid = 217 then 218 when orderid = 218 then 219
> when orderid
> = 219 then 220 when orderid = 220 then 221 when orderid = 221 then 222
> when orderid
> = 222 then 223 when orderid = 223 then 224 when orderid = 224 then 225
> when orderid
> = 225 then 226 when orderid = 226 then 227 when orderid = 227 then 228
> when orderid
> = 228 then 229 when orderid = 229 then 230 when orderid = 230 then 231
> when orderid
> = 231 then 232 when orderid = 232 then 233 when orderid = 233 then 234
> when orderid
> = 234 then 235 when orderid = 235 then 236 when orderid = 236 then 237
> when orderid
> = 237 then 238 when orderid = 238 then 239 when orderid = 239 then 240
> when orderid
> = 240 then 241 when orderid = 241 then 242 when orderid = 242 then 243
> when orderid
> = 243 then 244 when orderid = 244 then 245 when orderid = 245 then 246
> when orderid
> = 246 then 247 when orderid = 247 then 248 when orderid = 248 then 249
> when orderid
> = 249 then 250 else 9999 end case_when_col from sample_data_1;
> {code}
> fails with an OOM. (Yes, I know the query can be simplified, but it shows the
> case).
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
