Peter Rozsa created IMPALA-12342:
------------------------------------
Summary: Erasure coding build fails on loading
iceberg_lineitem_multiblock
Key: IMPALA-12342
URL: https://issues.apache.org/jira/browse/IMPALA-12342
Project: IMPALA
Issue Type: Bug
Components: Infrastructure
Affects Versions: Impala 4.2.0
Environment: ERASURE_CODING=true
Reporter: Peter Rozsa
Assignee: Zoltán Borók-Nagy
Erasure coding build fails at statement generation:
```Traceback (most recent call last):
File "/home/impdev/impala/testdata/bin/generate-schema-statements.py", line
935, in <module>
convert_orc_to_full_acid)
File "/home/impdev/impala/testdata/bin/generate-schema-statements.py", line
678, in generate_statements
insert = eval_section(section['DEPENDENT_LOAD'])
File "/home/impdev/impala/testdata/bin/generate-schema-statements.py", line
612, in eval_section
assert p.returncode == 0
AssertionError
```
Error message: ```
put: Specified block size (524288) is less than the cell size (1048576) of the
erasure coding policy (ErasureCodingPolicy=[Name=RS-3-2-1024k,
Schema=[ECSchema=[Codec=rs, numDataUnits=3, numParityUnits=2]],
CellSize=1048576, Id=2]).
put: Specified block size (524288) is less than the cell size (1048576) of the
erasure coding policy (ErasureCodingPolicy=[Name=RS-3-2-1024k,
Schema=[ECSchema=[Codec=rs, numDataUnits=3, numParityUnits=2]],
CellSize=1048576, Id=2]).
put: Specified block size (524288) is less than the cell size (1048576) of the
erasure coding policy (ErasureCodingPolicy=[Name=RS-3-2-1024k,
Schema=[ECSchema=[Codec=rs, numDataUnits=3, numParityUnits=2]],
CellSize=1048576, Id=2]).
put: Specified block size (524288) is less than the cell size (1048576) of the
erasure coding policy (ErasureCodingPolicy=[Name=RS-3-2-1024k,
Schema=[ECSchema=[Codec=rs, numDataUnits=3, numParityUnits=2]],
CellSize=1048576, Id=2]).
put: Specified block size (524288) is less than the cell size (1048576) of the
erasure coding policy (ErasureCodingPolicy=[Name=RS-3-2-1024k,
Schema=[ECSchema=[Codec=rs, numDataUnits=3, numParityUnits=2]],
CellSize=1048576, Id=2]).
put: Specified block size (524288) is less than the cell size (1048576) of the
erasure coding policy (ErasureCodingPolicy=[Name=RS-3-2-1024k,
Schema=[ECSchema=[Codec=rs, numDataUnits=3, numParityUnits=2]],
CellSize=1048576, Id=2]).
put: Specified block size (524288) is less than the cell size (1048576) of the
erasure coding policy (ErasureCodingPolicy=[Name=RS-3-2-1024k,
Schema=[ECSchema=[Codec=rs, numDataUnits=3, numParityUnits=2]],
CellSize=1048576, Id=2]).
put: Specified block size (524288) is less than the cell size (1048576) of the
erasure coding policy (ErasureCodingPolicy=[Name=RS-3-2-1024k,
Schema=[ECSchema=[Codec=rs, numDataUnits=3, numParityUnits=2]],
CellSize=1048576, Id=2]).
put: Specified block size (524288) is less than the cell size (1048576) of the
erasure coding policy (ErasureCodingPolicy=[Name=RS-3-2-1024k,
Schema=[ECSchema=[Codec=rs, numDataUnits=3, numParityUnits=2]],
CellSize=1048576, Id=2]).
put: Specified block size (524288) is less than the cell size (1048576) of the
erasure coding policy (ErasureCodingPolicy=[Name=RS-3-2-1024k,
Schema=[ECSchema=[Codec=rs, numDataUnits=3, numParityUnits=2]],
CellSize=1048576, Id=2]).```
IMPALA-12327 added a specific block size setting for copying files from
iceberg_lineitem_multiblock. Without the blocksize setting, the put operation
succeeds.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
