Mohit, Can you share the config for your ConvertAvroToORC processor? Also, by "CreateHiveTable", do you mean ReplaceText (to set the content to the hive.ddl attribute formed by ConvertAvroToORC) -> PutHiveQL (to execute the DDL)? If not, are you using a custom processor or ExecuteStreamCommand or something else?
If you are not using the generated DDL to create the table, can you share your CREATE TABLE statement for the target table? I'm guessing there's a mismatch somewhere between the data and the table definition. Regards, Matt On Tue, Apr 24, 2018 at 9:09 AM, Mohit <[email protected]> wrote: > Hi all, > > > > I’m using ValidateRecord processor to validate the csv and convert it into > Avro. Later, I convert this avro to orc using ConvertAvroToORC processor > and write it to hdfs and create a hive table on the top of it. > > When I query the table, it displays null, though the record count is > matching. > > > > Flow - ValidateRecord -> ConvertAvroToORC -> PutHDFS -> CreateHiveTable > > > > > > To debug, I also tried to write the avro data to hdfs and created the hive > table on the top of it. It is also displaying null results. > > > > Flow - ValidateRecord -> ConvertCSVToAvro -> PutHDFS I manually created > hive table with avro format. > > > > > > When I use ValidateRecord + ConvertCSVToAvro, it is working fine. > > Flow - ValidateRecord -> ConvertCSVToAvro -> ConvertAvroToORC -> PutHDFS > -> CreateHiveTable > > > > > > Is there anything I’m doing wrong? > > > > Thanks, > > Mohit > > > >
