vkhoroshko commented on issue #8651:
URL: https://github.com/apache/hudi/issues/8651#issuecomment-1904324751
Hello Guys,
I believe I face the similar issue.
I create the CoW table with append only mode and expect auto file sizing
feature to work (as depicted in the documentation):
```
CREATE TABLE hudi_table(
ts BIGINT,
uuid VARCHAR(40) PRIMARY KEY NOT ENFORCED,
rider VARCHAR(20),
driver VARCHAR(20),
fare DOUBLE,
city VARCHAR(20)
)
WITH (
'connector' = 'hudi',
'path' = 'file:///opt/flink/hudi',
'table.type' = 'COPY_ON_WRITE',
'write.operation'='insert',
'parquet.small.file.limit'='500000',
'parquet.max.file.size'='1000000'
);
```
But for every insert (and commit) - a separate parquet file is created and
they are never merged.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
