ennox108 opened a new issue, #9070: URL: https://github.com/apache/hudi/issues/9070
I am trying to add the Hudi Sink Connector to AWS MSK using the below config connector.class=org.apache.hudi.connect.HoodieSinkConnector s3.region=us-east-1 hoodie.base.path=s3://data_bucket hoodie.table.type=MERGE_ON_READ flush.size=5 tasks.max=4 topics=****** hoodie.schemaprovider.class=org.apache.hudi.schema.SchemaRegistryProvider bootstrap.servers=******************** hoodie.datasource.write.partitionpath.field=**** value.converter.region=us-east-1 hoodie.kafka.commit.interval.secs=60 hoodie.table.name=hudi-test hoodie.datasource.write.recordkey.field=***** value.converter.schemas.enable=false value.converter=org.apache.kafka.connect.json.JsonConverter key.converter=org.apache.kafka.connect.storage.StringConverter The connector status shows running but there is no data that getting written to s3. . When i check the logs it shows the below error Bootstrap broker **************************** (id: -2 rack: null) disconnected I have verified if the brokers are in a healthy state. I have also tested other sink connectors using similar config and those connectors are correctly producing data to s3. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
