Podling Report Reminder - July 2019

2019-06-25 Thread jmclean
Dear podling, This email was sent by an automated system on behalf of the Apache Incubator PMC. It is an initial reminder to give you plenty of time to prepare your quarterly board report. The board meeting is scheduled for Wed, 17 July 2019, 10:30 am PDT. The report for your podling will form a

Re: Schema compatibility

2019-06-25 Thread nishith agarwal
Hi Katie, Thanks for explaining the problem in detail. Could you give us some more information before I can help you with this ? 1. What table type are you using - COPY_ON_WRITE or MERGE_ON_READ ? 2. Could you paste the exception you see in Hudi ? 3. "Despite the schema having full

Schema compatibility

2019-06-25 Thread Katie Frost
Hi, I've been using the hudi delta streamer to create datasets in S3 and i've had issues with hudi acknowledging schema compatibility. I'm trying to run a spark job ingesting avro data to a hudi dataset in s3, with the raw avro source data also stored in s3. The raw avro data has two different

Re: Hoodie dataset write without partition

2019-06-25 Thread Netsanet Gebretsadkan
Amarnath, Few days ago, i was having the same problem. The hoodie modeled table was able to be created without any partition key but the hive sync was failing when you sync up without any partition. This was happening because the SlashEncodedDayPartionValueExtractor class was hard-coded to be