Re: Hive shell not using manually set tez container size

> set tez.task.resource.memory.mb to a different value than listed in > tez-site.xml, the query that's run doesn't seem to pick up the setting and > instead uses the one in the config file. Why not use the setting Hive uses in the submitted vertex? set hive.tez.container.size=? Cheers,

答复: Difference between MANAGED_TABLE and EXTERNAL_TABLE in org.apache.hadoop.hive.metastore.TableType

Thanks for your detailed explanations. I'm not asking what the concepts of INTERNAL TABLE and EXTERNAL TABLE in hive, I'm just confused what does the value "EXTERNAL_TABLE" in class org.apache.hadoop.hive.TableType mean? I create a table setting table type TableType.EXTERNAL_TABLE by calling

Hive shell not using manually set tez container size

Not really sure if this is an issue on the Hive or Tez side, but when we open a Hive shell and set tez.task.resource.memory.mb to a different value than listed in tez-site.xml, the query that's run doesn't seem to pick up the setting and instead uses the one in the config file. However, if we let

Re: Difference between MANAGED_TABLE and EXTERNAL_TABLE in org.apache.hadoop.hive.metastore.TableType

Adding to Alan's points external tables are used often as a staging area. For example, ingesting data from HDFS location on a daily basis and putting that data into Hive managed tables. That location of that external table can change pointing to a new HDFS directory created by say Flume etc

Re: Difference between MANAGED_TABLE and EXTERNAL_TABLE in org.apache.hadoop.hive.metastore.TableType

Hive does not assume that it owns the data for an external table. Thus when an external table is dropped, the data is not deleted. People often use this as a way to load data into a directory in HDFS and then “cast” a table structure over it by creating an external table with that directory

Difference between MANAGED_TABLE and EXTERNAL_TABLE in org.apache.hadoop.hive.metastore.TableType

Hi all, I found an enum TableType in package org.apache.hadoop.hive.metastore. What's the difference between MANAGED_TABLE and EXTERNAL_TABLE? Will the table be an EXTERNAL TABLE with setting table type EXTERNAL_TABLE when creating table? I found the code to determine whether a table is an

Re: Table not found in the definition of view

Hi, you should replace WITH table AS (subquery) SELECT ... FROM table with SELECT ... FROM( subquery ) table Regards. On Thu, Dec 1, 2016 at 12:32 PM, Priyanka Raghuvanshi wrote: > Hi All > > > Getting error 'Table not found in the definition of view ' if a view is

Table not found in the definition of view

Hi All Getting error 'Table not found in the definition of view ' if a view is created using 'WITH' clause to use the result of one query in another. This issue has been resolved for Hive 1.3.0 and 2.0.0 but mine is 0.13 Regards Priyanka Raghuvanshi

[ANN] Hivemall entered Apache Incubator

Hello all, I would like to announce that Hivemall project moved to Apache Incubator. Apache Hivemall is a scalable machine learning library that runs on Apache Hive, Apache Spark, and Apache Pig. http://hivemall.incubator.apache.org/ (project top page)