Re: Malformed orc file

2016-08-05 Thread Prasanth Jayachandran
, Prasanth Jayachandran <pjayachand...@hortonworks.com<mailto:pjayachand...@hortonworks.com>> wrote: Hi In case of streaming, when a transaction is open orc file is not closed and hence may not be flushed completely. Did the transaction commit successfully? Or was there any ex

Re: Malformed orc file

2016-08-05 Thread Owen O'Malley
from our > tester and he already droped table. > > On Thu, Aug 4, 2016 at 9:16 PM, Prasanth Jayachandran < > pjayachand...@hortonworks.com> wrote: > >> Hi >> >> In case of streaming, when a transaction is open orc file is not closed >> and hence may not b

Re: Malformed orc file

2016-08-05 Thread Igor Kuzmenko
sed > and hence may not be flushed completely. Did the transaction commit > successfully? Or was there any exception thrown during writes/commit? > > Thanks > Prasanth > > On Aug 3, 2016, at 6:09 AM, Igor Kuzmenko <f1she...@gmail.com> wrote: > > Hello, I've

Re: Malformed orc file

2016-08-04 Thread Prasanth Jayachandran
com<mailto:f1she...@gmail.com>> wrote: Hello, I've got a malformed ORC file in my Hive table. File was created by Hive Streaming API and I have no idea under what circumstances it became corrupted. File on google drive: link<https://drive.google.com/file/d/0ByB92PAoAkrKeFFZRUN4W

Malformed orc file

2016-08-03 Thread Igor Kuzmenko
Hello, I've got a malformed ORC file in my Hive table. File was created by Hive Streaming API and I have no idea under what circumstances it became corrupted. File on google drive: link <https://drive.google.com/file/d/0ByB92PAoAkrKeFFZRUN4WWVQY1U/view?usp=sharing> Exception message when

Re: Malformed Orc file Invalid postscript length 0

2015-05-26 Thread Grant Overby (groverby)
@hive.apache.org Cc: Bhavana Kamichetty (bkamiche) bkami...@cisco.commailto:bkami...@cisco.com Subject: Re: Malformed Orc file Invalid postscript length 0 I sent a link to you. File system is hdfs. Versions: hdp HDP-2.2.4.2-2 hdfs 2.6.0.2.2 MapReduce2 2.6.0.2.2 YARN 2.6.0.2.2 hive 0.14.0.2.2 tez

Re: Malformed Orc file Invalid postscript length 0

2015-05-22 Thread Owen O'Malley
Hive executes a query on an external table. It seems the postscript isn’t written even though .close() is called and returns normally. Any thoughts? java.io.IOException: Malformed ORC file hdfs://twig06.twigs:8020/warehouse/completed/events/connection_events/dt=1432229400/1432229419251-bb46892c

Malformed Orc file Invalid postscript length 0

2015-05-22 Thread Grant Overby (groverby)
I’m getting the following exception when Hive executes a query on an external table. It seems the postscript isn’t written even though .close() is called and returns normally. Any thoughts? java.io.IOException: Malformed ORC file hdfs://twig06.twigs:8020/warehouse/completed/events

Re: Malformed Orc file Invalid postscript length 0

2015-05-22 Thread Grant Overby (groverby)
Date: Friday, May 22, 2015 at 12:51 PM To: user@hive.apache.orgmailto:user@hive.apache.org user@hive.apache.orgmailto:user@hive.apache.org Cc: Bhavana Kamichetty (bkamiche) bkami...@cisco.commailto:bkami...@cisco.com Subject: Re: Malformed Orc file Invalid postscript length 0 Bhavana, Could