Re: Hive ORC Malformed while loading into spark data frame

2015-09-29 Thread Hortonworks
o table also using hiveContext.sql. > Insert into partition table. When I try to load orc data into dataframe I am > loading particular partition data stored in path say > /user/xyz/Hive/xyz.db/sparktable/partition1=abc > > Regards, > Umesh > >> On Sep 30, 2015 02:21,

Re: Hive ORC Malformed while loading into spark data frame

2015-09-29 Thread Hortonworks
How was the table is generated, by hive or by spark? If you generate table using have but read it by data frame, it may have some comparability issue. Thanks Zhan Zhang Sent from my iPhone > On Sep 29, 2015, at 1:47 PM, unk1102 wrote: > > Hi I have a spark job