Re: DMS - org.apache.hudi.exception.HoodieException: Please provide a valid schema provider class

2020-03-25 Thread Vinoth Chandar
Thanks! https://jira.apache.org/jira/browse/HUDI-735 filed to make that exception more user friendly. Please have at it, if anyone is interested in this :) On Wed, Mar 25, 2020 at 11:40 AM Joaquim S wrote: > Thank you Vinoth. I was able to find the issue. All my column names were in > high

Re: DMS - org.apache.hudi.exception.HoodieException: Please provide a valid schema provider class

2020-03-25 Thread Joaquim S
Thank you Vinoth. I was able to find the issue. All my column names were in high caps case. I switched column names and table names to lower case and it works perfectly. Vinoth Chandar escreveu no dia quarta, 25/03/2020 à(s) 11:04: > Hi, > > That's surprising..Do you have --source-class >

Re: DMS - org.apache.hudi.exception.HoodieException: Please provide a valid schema provider class

2020-03-25 Thread Vinoth Chandar
Hi, That's surprising..Do you have --source-class org.apache.hudi.utilities.sources.ParquetDFSSource? I ask sine for Row based sources, the schema provider is auto configured as show in the blog page.. Thanks VInoth On Tue, Mar 24, 2020 at 11:07 AM Joaquim S wrote: > Team, > > When following

DMS - org.apache.hudi.exception.HoodieException: Please provide a valid schema provider class

2020-03-24 Thread Joaquim S
Team, When following the blog "Change Capture Using AWS Database Migration Service and Hudi" with my own data set, the initial load works perfectly. When issuing the command with the DMS CDC files on S3, I get the following error: 20/03/24 17:56:28 ERROR HoodieDeltaStreamer: Got error running