PavelPetukhov commented on issue #2959: URL: https://github.com/apache/hudi/issues/2959#issuecomment-848891756
There is no exceptions or errors in the logs, all warnings I found are the below 21/05/26 18:33:18 WARN util.NativeCodeLoader: Unable to load native-hadoop library for your platform... using builtin-java classes where applicable 21/05/26 18:33:19 WARN shortcircuit.DomainSocketFactory: The short-circuit local reads feature cannot be used because libhadoop cannot be loaded. 21/05/26 18:33:19 WARN deltastreamer.SchedulerConfGenerator: Job Scheduling Configs will not be in effect as spark.scheduler.mode is not set to FAIR at instantiation time. Continuing without scheduling configs 21/05/26 18:33:20 WARN util.Utils: spark.executor.instances less than spark.dynamicAllocation.minExecutors is invalid, ignoring its setting, please update your configs. 21/05/26 18:33:21 WARN util.Utils: spark.executor.instances less than spark.dynamicAllocation.minExecutors is invalid, ignoring its setting, please update your configs. 21/05/26 18:33:21 WARN cluster.YarnSchedulerBackend$YarnSchedulerEndpoint: Attempted to request executors before the AM has registered! 21/05/26 18:33:25 WARN spark.SparkContext: Using an existing SparkContext; some configuration may not take effect. 21/05/26 18:33:26 WARN consumer.ConsumerConfig: The configuration 'hoodie.deltastreamer.keygen.timebased.timestamp.type' was supplied but isn't a known config. 21/05/26 18:33:26 WARN consumer.ConsumerConfig: The configuration 'hoodie.deltastreamer.keygen.timebased.output.dateformat' was supplied but isn't a known config. 21/05/26 18:33:26 WARN consumer.ConsumerConfig: The configuration 'hoodie.deltastreamer.keygen.timebased.input.dateformat.list.delimiter.regex' was supplied but isn't a known config. 21/05/26 18:33:26 WARN consumer.ConsumerConfig: The configuration 'hoodie.deltastreamer.keygen.timebased.input.dateformat' was supplied but isn't a known config. 21/05/26 18:33:26 WARN consumer.ConsumerConfig: The configuration 'hoodie.datasource.write.partitionpath.field' was supplied but isn't a known config. 21/05/26 18:33:26 WARN consumer.ConsumerConfig: The configuration 'hoodie.delete.shuffle.parallelism' was supplied but isn't a known config. 21/05/26 18:33:26 WARN consumer.ConsumerConfig: The configuration 'hoodie.datasource.write.recordkey.field' was supplied but isn't a known config. 21/05/26 18:33:26 WARN consumer.ConsumerConfig: The configuration 'hoodie.upsert.shuffle.parallelism' was supplied but isn't a known config. 21/05/26 18:33:26 WARN consumer.ConsumerConfig: The configuration 'hoodie.datasource.write.keygenerator.class' was supplied but isn't a known config. 21/05/26 18:33:26 WARN consumer.ConsumerConfig: The configuration 'hoodie.deltastreamer.source.kafka.topic' was supplied but isn't a known config. 21/05/26 18:33:26 WARN consumer.ConsumerConfig: The configuration 'hoodie.deltastreamer.schemaprovider.registry.url' was supplied but isn't a known config. 21/05/26 18:33:26 WARN consumer.ConsumerConfig: The configuration 'hoodie.insert.shuffle.parallelism' was supplied but isn't a known config. 21/05/26 18:33:26 WARN consumer.ConsumerConfig: The configuration 'hoodie.embed.timeline.server' was supplied but isn't a known config. 21/05/26 18:33:26 WARN consumer.ConsumerConfig: The configuration 'hoodie.bulkinsert.shuffle.parallelism' was supplied but isn't a known config. 21/05/26 18:33:26 WARN consumer.ConsumerConfig: The configuration 'hoodie.deltastreamer.keygen.timebased.input.timezone' was supplied but isn't a known config. 21/05/26 18:33:26 WARN consumer.ConsumerConfig: The configuration 'hoodie.filesystem.view.type' was supplied but isn't a known config. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: [email protected]
