xushiyan commented on pull request #3416: URL: https://github.com/apache/hudi/pull/3416#issuecomment-972711756
> Tested scenarios: > > 1. w/o setting HUDI_CONF_DIR, having issues as reported above. Needs fixing. > 2. set proper HUDI_CONF_DIR env, but the dir does not contain the file (hudi-defaults.conf). Again a similar issue. attaching the stack trace below. Needs fixing. > 3. Set proper HUDI_CONF_DIR which has hudi-defaults.conf. I see writes picks up the config from this file. > 4. same as (3). tried overwriting the config with df.write.hudi for a property thats already in hudi-defaults.conf. The one given in spark-shel with df.write.hudi takes precedence. > 5. tried two spark-shells w/ proper env set in both. Both able to pick up the configs from hudi-defaults.conf. > > Stacktrace for (2) tested scenario 1 fixed. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
