Re: Error with flush_length File in Orc, in hive 2.1.0 and mr execution engine.

Hi Eugene, One more observation, in namenode logs when i run select count(*) on individual tables i still see the same error as before, org.apache.hadoop.ipc.Server: IPC Server handler 1 on 9000, call org.apache.hadoop.hdfs.protocol.ClientProtocol.getBlockLocations from 192.168.120.133:47114

Re: Error with flush_length File in Orc, in hive 2.1.0 and mr execution engine.

Hi Eugene, select count(*) from mls_public_record_association_snapshot_orc pra left outer join mls_listing_snapshot_orc ml on pra.primary_listing_id = ml.id left outer join attribute a on a.id = ml.standard_status ran till end and threw the below exception. MapReduce Total cumulative CPU

Re: Error with flush_length File in Orc, in hive 2.1.0 and mr execution engine.

If you can run this, then it’s safe to ignore “00094_flush_length” messages and the issue is somewhere else select count(*) from mls_public_record_association_snapshot_orc pra left outer join mls_listing_snapshot_orc ml on pra.primary_listing_id = ml.id left outer join

Re: Error with flush_length File in Orc, in hive 2.1.0 and mr execution engine.

PFB EXPLAIN PLAN from hive, and query has issues at stage-14, i have also run another query which also fail in stage, *Map Reduce Local Work.* STAGE DEPENDENCIES: Stage-13 is a root stage , consists of Stage-1 Stage-1 Stage-10 depends on stages: Stage-1 , consists of Stage-15, Stage-2

Re: Error with flush_length File in Orc, in hive 2.1.0 and mr execution engine.

Hi Eugene, PFB Transaction table in green and parquet tables in yellow, INSERT INTO access_logs.crawlstats_dpp PARTITION(day="2016-10-23") select pra.url as prUrl,pra.url_type as urlType,CAST(pra.created_at AS timestamp) as prCreated, CAST(pra.updated_at AS timestamp) as prUpdated,

Re: Error with flush_length File in Orc, in hive 2.1.0 and mr execution engine.

Which of your tables are are transactional? Can you provide the DDL? I don’t think “File does not exist” error is causing your queries to fail. It’s an INFO level msg. There should be some other error. Eugene From: satyajit vegesna