maheshguptags commented on issue #10609: URL: https://github.com/apache/hudi/issues/10609#issuecomment-2167548029
> @maheshguptags ConsumerConfig seems not Spark or Hudi classes, thats from Kafka, right? So these configurations doesn't work for Kafka. Is that configuration error, pass Spark configs into Kafka. I am not sure how it is execute/call. I am passing the keys using properties file like below ``` security.protocol=SASL_SSL sasl.jaas.config=software.amazon.msk.auth.iam.IAMLoginModule required; spark.driver.extraClassPath=/home/mahesh.gupta/hudi-utilities-bundle_2.12-0.14.1.jar spark.executor.extraClassPath=/home/mahesh.gupta/hudi-utilities-bundle_2.12-0.14.1.jar hoodie.index.type=RECORD_INDEX hoodie.metadata.record.index.enable=true hoodie.metadata.record.index.min.filegroup.count=20 hoodie.metadata.record.index.max.filegroup.count=5000 ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
