Re: parquet decoding exceptions - hue sample data view works fine though

2016-08-05 Thread Sumit Khanna
Well anyways, even from Hue if I try loading partition wise data, it throws the same error. Am really really perplexed to what this bug really is.. Although, if I try viewing the data in general, it displays me column names / values / analysis etc but not partitionwise. Thanks, Sumit On Sat,

parquet decoding exceptions - hue sample data view works fine though

2016-08-05 Thread Sumit Khanna
Hey, I am having a parquet dir and a table mounted on it. the table is showing sample view , via hue fine but a simple query like select * from tablename gives this error : - Bad status for request TFetchResultsReq(fetchType=0, operationHandle=TOperationHandle(hasResultSet=True,

Re: hive concurrency not working

2016-08-05 Thread Gopal Vijayaraghavan
> Depends on how you configured scheduling in yarn ... ... >> you won't have this problem if you use Spark as the execution engine? >>That handles concurrency OK If I read this right, it is unlikely to be related to YARN configs. The Hue issue is directly related to how many Tez/Spark sessions

Re: Hive compaction didn't launch

2016-08-05 Thread Eugene Koifman
Support for transactions in Hive is not just for Storm. You can run transactional SQL statements. So the system must support cases where all actions with a transaction are not known at the start of the transaction. From: Igor Kuzmenko > Reply-To:

Re: Malformed orc file

2016-08-05 Thread Prasanth Jayachandran
If you are using one of the latest hive releases, then we orcfiledump have an option for recovering such files. It backtrack the files for intermediate footers. https://cwiki.apache.org/confluence/display/Hive/LanguageManual+ORC // Hive version 1.3.0 and later: hive --orcfiledump [-j] [-p] [-d]

Re: Malformed orc file

2016-08-05 Thread Owen O'Malley
The file has trailing data. If you want to recover the data, you can use: % strings -3 -t d ~/Downloads/bucket_0 | grep ORC will print the offsets where ORC occurs with in the file: 0 ORC 4559 ORC That means that there is one intermediate footer within the file. If you slice the file at

RE: Error running SQL query through Hive JDBC

2016-08-05 Thread Amit Bajpai
Below is the code snippet with the SQL query which I am running. The same query is running fine through Hive CLI. String sql = " SELECT TBL_CODE FROM DB.CODE_MAP WHERE SYSTEM_NAME='TDS' AND TABLE_NAME=TRIM('XYZ')";

RE: Error running SQL query through Hive JDBC

2016-08-05 Thread Markovitz, Dudu
Can you please share the query? From: Amit Bajpai [mailto:amit.baj...@flextronics.com] Sent: Friday, August 05, 2016 10:40 PM To: user@hive.apache.org Subject: Error running SQL query through Hive JDBC Hi, I am getting the below error when running the SQL query through Hive JDBC. Can

Error running SQL query through Hive JDBC

2016-08-05 Thread Amit Bajpai
Hi, I am getting the below error when running the SQL query through Hive JDBC. Can suggestion how to fix it. org.apache.hive.service.cli.HiveSQLException: Error while compiling statement: FAILED: SemanticException UDF = is not allowed at

Re: hive not showing up default database

2016-08-05 Thread Mich Talebzadeh
Most prob. a configuration issue. You don't create default database. It is there for you. How are you connecting to Hive, Hive CLI or Hive Thrift server? Can you log in to hive and do show databases; Also try to create another database create database mytest; and send the output. HTH Dr

hive not showing up default database

2016-08-05 Thread Sumit Khanna
Hello, hive is not showing default database. but when I try to create database default, it says default database already exists and throws an error. also, FYI, I have configured metastorage db as mysql. Please help. Thanks, Sumit

Re: Malformed orc file

2016-08-05 Thread Igor Kuzmenko
Unfortunately, I сan't provide more information, this file I got from our tester and he already droped table. On Thu, Aug 4, 2016 at 9:16 PM, Prasanth Jayachandran < pjayachand...@hortonworks.com> wrote: > Hi > > In case of streaming, when a transaction is open orc file is not closed > and hence

Re: Hive LIKE predicate. '_' wildcard decrease perfomance

2016-08-05 Thread Igor Kuzmenko
Thanks for reply, Gopal. Very helpful. On Thu, Aug 4, 2016 at 10:15 PM, Gopal Vijayaraghavan wrote: > > where res_url like '%mts.ru%' > ... > > where res_url like '%mts_ru%' > ... > > Why '_' wildcard decrease perfomance? > > Because it misses the fast path by just one "_". >

Re: hive concurrency not working

2016-08-05 Thread Mich Talebzadeh
great in that case they can try it and I am pretty sure if they are stuck they can come and ask you for expert advice since Hortonworks do not support Hive on Spark and I know that Dr Mich Talebzadeh LinkedIn * https://www.linkedin.com/profile/view?id=AAEWh2gBxianrbJd6zP6AcPCCdOABUrV8Pw

Re: hive concurrency not working

2016-08-05 Thread Jörn Franke
Depends on how you configured scheduling in yarn ... > On 05 Aug 2016, at 08:39, Mich Talebzadeh wrote: > > you won't have this problem if you use Spark as the execution engine? That > handles concurrency OK > > Dr Mich Talebzadeh > > LinkedIn >

Re: hive concurrency not working

2016-08-05 Thread Jörn Franke
That is not correct the option is there to install it. > On 05 Aug 2016, at 08:41, Mich Talebzadeh wrote: > > You won't have this problem if you use Spark as the execution engine! This > set up handles concurrency but Hive with Spark is not part of the HW distro. >

Re: hive concurrency not working

2016-08-05 Thread Mich Talebzadeh
You won't have this problem if you use Spark as the execution engine! This set up handles concurrency but Hive with Spark is not part of the HW distro. HTH Dr Mich Talebzadeh LinkedIn * https://www.linkedin.com/profile/view?id=AAEWh2gBxianrbJd6zP6AcPCCdOABUrV8Pw

Re: hive concurrency not working

2016-08-05 Thread Mich Talebzadeh
you won't have this problem if you use Spark as the execution engine? That handles concurrency OK Dr Mich Talebzadeh LinkedIn * https://www.linkedin.com/profile/view?id=AAEWh2gBxianrbJd6zP6AcPCCdOABUrV8Pw *