PrabhuJoseph commented on code in PR #8512:
URL: https://github.com/apache/hudi/pull/8512#discussion_r1175582627
##########
hudi-flink-datasource/hudi-flink/src/main/java/org/apache/hudi/sink/bulk/sort/SortOperator.java:
##########
@@ -89,7 +95,7 @@ public void open() throws Exception {
binarySerializer,
computer,
comparator,
- getContainingTask().getJobConfiguration());
+ conf);
Review Comment:
Yes right, the config needs to be set in flink-conf.yaml or SqlClient
session.
https://nightlies.apache.org/flink/flink-docs-master/docs/dev/table/config/
Both Context.getConfiguration and the configuration used above are the same
Flink Configuration (flink-conf.yaml) with the table options. The later needs
less code changes, at below classes to pass the configuration object
```
Pipelines#bulkInsert -> SortOperatorGen#createSortOperator ->
SortOperator#init
```
whereas former needs changes at below classes to pass the
Context.getConfiguration
```
HoodieTableSink#getSinkRuntimeProvider -> Pipelines#bulkInsert ->
SortOperatorGen#createSortOperator -> SortOperator#init
```
> should we use that configuration then?
I think not required.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
