pengxianzi commented on issue #12589:
URL: https://github.com/apache/hudi/issues/12589#issuecomment-2576587299
@danny0405
We may have discovered a new issue. Previously, some large tables could be
written successfully. However, there is now an MOR table with over 100 million
records, and its table structure includes some composite primary keys. I
configured it as follows:
builder.pk(primaryKey)
.options(options);
primaryKey=id,age,name,address,phone,email
However, I am unsure if this configuration is effective. I couldn't find any
documentation regarding composite primary keys on the Hudi official website.
Additionally, when checking through the Hudi CLI, the total records written and
total updates written counts are the same, which makes me suspect that the
composite primary key configuration has not been applied correctly.
The Flink job is running normally, but no files are being written.
Looking forward to your response.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
