Hi,
I’m using 12.0 version and seems that ANALYZE command doesn’t update the table
level statistics while partitions level are just fine.
For example (after running the command ANALYZE TABLE T1 partition(date_prt)
COMPUTE STATISTICS):
I get:
.
.
.
Partition db1.t1{date_prt=2014-01-26} stats: [num_files: 16, num_rows: 9030050,
total_size: 51413507, raw_data_size: 477332702]
Table db1.t1 stats: [num_partitions: 0, num_files: 0, num_rows: 0, total_size:
0, raw_data_size: 0] <<<------ a problem
.
.
.
Is there any update on this issue?
Thanks Dsass
From: Navis류승우 [mailto:[email protected]]
Sent: Monday, February 03, 2014 2:44 AM
To: [email protected]
Subject: Re: DESCRIBE EXTENDED show numRows=0
Could you check the task log?
For stat gathering, hive uses derby by default. If the jdbc driver for derby is
not in auxlib, task cannot publish stats.
2014-01-30 Stephen Sprague <[email protected]<mailto:[email protected]>>:
the answer to this would seemingly be no. i just tried it in hive v0.12.
numRows=0 before and numRows=0 after my running of "analyze table <table>
compute statistics"
other values are populated though just not numRows. I wonder why that is.
Cheers,
Stephen
{noformat}
parameters:{numPartitions=0, numFiles=420, last_modified_by=dwr,
last_modified_time=1390986197, transient_lastDdlTime=1391060001,
totalSize=10748060517, numRows=0, rawDataSize=0}, viewOriginalText:null,
viewExpandedText:null, tableType:MANAGED_TABLE)
{noformat}
On Mon, Jan 27, 2014 at 3:52 AM, Lefty Leverenz
<[email protected]<mailto:[email protected]>> wrote:
Can the ANALYZE statement be used to gather statistics if hive.stats.autogather
was 'false' when the data was loaded? (See the wiki's Statistics in Hive doc:
Existing
Tables<https://cwiki.apache.org/confluence/display/Hive/StatsDev#StatsDev-ExistingTables>.)
-- Lefty
On Sun, Jan 26, 2014 at 8:01 PM, Navis류승우
<[email protected]<mailto:[email protected]>> wrote:
If the data is loaded into table with insert clause with
hive.stats.autogather=true, it will be updated. If it's not, it's zero (or -1
sometimes).
2014-01-23 Haroon Muhammad
<[email protected]<mailto:[email protected]>>
Hi,
I have observed that DESCRIBE EXTENDED always shows number of rows to be zero
despite the fact that the table has data. Is it a bug? Is it known ? Has anyone
else also come across the same ?
Thanks,