Ahmed!
> table/partition level statistics
>
>
> Key: HIVE-1361
> URL: https://issues.apache.org/jira/browse/HIVE-1361
> Project: Hadoop Hive
> Issue Type: Sub-task
> Com
[
https://issues.apache.org/jira/browse/HIVE-1361?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12914728#action_12914728
]
He Yongqiang commented on HIVE-1361:
+1 running tests.
> table/partitio
that resolves the conflicts with the latest
commits.
> table/partition level statistics
>
>
> Key: HIVE-1361
> URL: https://issues.apache.org/jira/browse/HIVE-1361
> Project: Hadoop Hive
>
refreshed to the latest trunk. Also added a negative
test case analyze.q and some trivial clean up in Java code (removing commented
out contents).
> table/partition level statistics
>
>
> Key: HIVE-1361
> URL: https://is
[
https://issues.apache.org/jira/browse/HIVE-1361?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Ning Zhang updated HIVE-1361:
-
Attachment: HIVE-1361.3.patch
Updated HIVE-1361.3.patch.
> table/partition level statist
[
https://issues.apache.org/jira/browse/HIVE-1361?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Ning Zhang updated HIVE-1361:
-
Attachment: (was: HIVE-1361.3.patch)
> table/partition level statist
stat
> table/partition level statistics
>
>
> Key: HIVE-1361
> URL: https://issues.apache.org/jira/browse/HIVE-1361
> Project: Hadoop Hive
> Issue Type: Sub-task
>
0.17. The
only difference from the last patch is the log change in stats2.q.out.
> table/partition level statistics
>
>
> Key: HIVE-1361
> URL: https://issues.apache.org/jira/browse/HIVE-1361
>
[
https://issues.apache.org/jira/browse/HIVE-1361?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Ning Zhang updated HIVE-1361:
-
Status: Patch Available (was: Open)
> table/partition level statist
l stats for non-partitioned table and
> partition-level stats for partitioned table. Future work could extend the
> table level stats to partitioned table as well.
> There are 3 major milestones in this subtask:
> 1) extend the insert statement to gather table/partition level st
any apps were dependent on
the old output format?
> describe extended table/partition output is cryptic
> ---
>
> Key: HIVE-558
> URL: https://issues.apache.org/jira/browse/HIVE-558
>
lot! Thanks.
> describe extended table/partition output is cryptic
> ---
>
> Key: HIVE-558
> URL: https://issues.apache.org/jira/browse/HIVE-558
> Project: Hadoop Hive
>
> describe extended table/partition output is cryptic
> ---
>
> Key: HIVE-558
> URL: https://issues.apache.org/jira/browse/HIVE-558
> Project: Hadoop Hive
> Is
sses
> describe extended table/partition output is cryptic
> ---
>
> Key: HIVE-558
> URL: https://issues.apache.org/jira/browse/HIVE-558
> Project: Hadoop Hive
> Issue Type: Improvem
and 17. All tests
pass, let me know if you see any problems.
> describe extended table/partition output is cryptic
> ---
>
> Key: HIVE-558
> URL: https://issues.apache.org/jira/browse/HIVE-558
>
Can you take a look ?
All other tests are passing
> describe extended table/partition output is cryptic
> ---
>
> Key: HIVE-558
> URL: https://issues.apache.org/jira/browse/HIVE-558
>
[
https://issues.apache.org/jira/browse/HIVE-1361?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Namit Jain updated HIVE-1361:
-
Status: Open (was: Patch Available)
> table/partition level statist
to lock the row ?
use a SELECT FOR UPDATE instead of
SELECT
- namit
> table/partition level statistics
>
>
> Key: HIVE-1361
> URL: https://issues.apache.org/jira/browse/HIVE-1361
> Proje
.
trunk/ql/src/java/org/apache/hadoop/hive/ql/stats/jdbc/JDBCStatsPublisher.java
<http://review.cloudera.org/r/862/#comment4286>
This is superfluous.
trunk/ql/src/java/org/apache/hadoop/hive/ql/stats/jdbc/JDBCStatsPublisher.java
<http://review.cloudera.org/r/862/#comment4292
pass
> describe extended table/partition output is cryptic
> ---
>
> Key: HIVE-558
> URL: https://issues.apache.org/jira/browse/HIVE-558
> Project: Hadoop Hive
> Issue Type: Improvem
[
https://issues.apache.org/jira/browse/HIVE-558?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12910775#action_12910775
]
Paul Yang commented on HIVE-558:
Looks good +1
> describe extended table/partition
null for views & added
copyright information
DDLSemanticAnalyzer: Use DescTableDesc.getSchema() as the method is static now.
QTestUtil: Additional tags added
Test case outputs updated (incl outputs for 0.17)
> describe extended table/partition output is
[
https://issues.apache.org/jira/browse/HIVE-1361?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12910470#action_12910470
]
Namit Jain commented on HIVE-1361:
--
Will take a look
> table/partition level sta
Processor
> table/partition level statistics
>
>
> Key: HIVE-1361
> URL: https://issues.apache.org/jira/browse/HIVE-1361
> Project: Hadoop Hive
> Issue Type: Sub-task
> Com
[
https://issues.apache.org/jira/browse/HIVE-1361?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Ning Zhang updated HIVE-1361:
-
Status: Patch Available (was: Open)
> table/partition level statist
/ql/stats/jdbc/JDBCStatsSetupConstants.java
PRE-CREATION
Diff: http://review.cloudera.org/r/862/diff
Testing
---
Thanks,
Carl
> table/partition level statistics
>
>
> Key: HIVE-1361
> URL: https://issues.apache.org/jira/browse/HI
---
This is an automatically generated e-mail. To reply, visit:
http://review.cloudera.org/r/862/
---
Review request for Hive Developers.
Summary
---
HIVE-1361
This addresses b
hen reading a table/partition
>
>
> Key: HIVE-1648
> URL: https://issues.apache.org/jira/browse/HIVE-1648
> Project: Hadoop Hive
> Issue Type: Sub-task
>
Automatically gathering stats when reading a table/partition
Key: HIVE-1648
URL: https://issues.apache.org/jira/browse/HIVE-1648
Project: Hadoop Hive
Issue Type: New Feature
[
https://issues.apache.org/jira/browse/HIVE-1361?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12910350#action_12910350
]
John Sichi commented on HIVE-1361:
--
Yay for Java-only patch :)
> table/partitio
e the metastore.
2) The stats of a table/partition can be exposed to the user by 'DESC
EXTENDED' to the table/partition. They are stored as the storage parameters
(numRows, nuFiles, numPartitions).
3) Introducing a new command 'ANALYZE TABLE [PARTITION (PARTITION SPEC)]
COMPUTE STA
some of which
which may vary from run to run, e.g. table create time. Those attributes will
need to be added to the ignore list in QTestUtil.java:checkCliDriverResults()
> describe extended table/partition output is cryptic
> ---
>
>
[
https://issues.apache.org/jira/browse/HIVE-558?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Work on HIVE-558 started by Thiruvel Thirumoolan.
> describe extended table/partition output is cryp
ibe extended table/partition output is cryptic
> ---
>
> Key: HIVE-558
> URL: https://issues.apache.org/jira/browse/HIVE-558
> Project: Hadoop Hive
> Issue Type: Improvement
>
rest? Also, could you move the width to a static constant?
> describe extended table/partition output is cryptic
> ---
>
> Key: HIVE-558
> URL: https://issues.apache.org/jira/browse/HIVE-558
>
[
https://issues.apache.org/jira/browse/HIVE-1591?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
John Sichi updated HIVE-1591:
-
Affects Version/s: 0.7.0
> Lock the database also as part of locking a table/partit
[
https://issues.apache.org/jira/browse/HIVE-1591?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
John Sichi updated HIVE-1591:
-
Status: Open (was: Patch Available)
> Lock the database also as part of locking a table/partit
ion(e.toString());
}
* we really need tests for actual concurrency
> Lock the database also as part of locking a table/partition
> ---
>
> Key: HIVE-1591
> URL: https://issues.apache.org/jira/browse/HI
[
https://issues.apache.org/jira/browse/HIVE-1591?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Namit Jain reassigned HIVE-1591:
Assignee: Namit Jain
> Lock the database also as part of locking a table/partit
[
https://issues.apache.org/jira/browse/HIVE-1591?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Namit Jain updated HIVE-1591:
-
Status: Patch Available (was: Open)
> Lock the database also as part of locking a table/partit
heck cleanups etc.
@Paul, can you also take a look at this ?
> describe extended table/partition output is cryptic
> ---
>
> Key: HIVE-558
> URL: https://issues.apache.org/jira/browse/HIVE-558
>
[
https://issues.apache.org/jira/browse/HIVE-558?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Namit Jain reassigned HIVE-558:
---
Assignee: Thiruvel Thirumoolan
> describe extended table/partition output is cryp
.
> describe extended table/partition output is cryptic
> ---
>
> Key: HIVE-558
> URL: https://issues.apache.org/jira/browse/HIVE-558
> Project: Hadoop Hive
> Issue Type: Improvement
ning data for those corresponding fields also,
which is when I think it would be truly independent. But I guess its safe to
assume the ordering of elements in DescTableDesc's schema wont change or more
elements added/removed.
> describe extended table/partition outpu
[
https://issues.apache.org/jira/browse/HIVE-1591?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Namit Jain updated HIVE-1591:
-
Attachment: hive.1591.1.patch
> Lock the database also as part of locking a table/partit
1590 is fixed, this will
automatically enable locking.
> Lock the database also as part of locking a table/partition
> ---
>
> Key: HIVE-1591
> URL: https://issues.apache.org/ji
[
https://issues.apache.org/jira/browse/HIVE-1591?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Namit Jain updated HIVE-1591:
-
Summary: Lock the database also as part of locking a table/partition (was:
ability to lock the database
columnInformation);
// If you want to show partitioned columns, have a seperate line: something
like:
PARTITIONED COLUMNS
after the initial columns
getPartitionInfoAsString(columnInformation, tbl);
}
return columnInformation.toString();
}
It is pretty close to wh
types.
But I am not sure how to obtain the comments of the fields through this way or
through the way you suggested (couldnt find a related usage), any pointers
would be appreciated.
> describe extended table/partition
xtended table/partition output is cryptic
> ---
>
> Key: HIVE-558
> URL: https://issues.apache.org/jira/browse/HIVE-558
> Project: Hadoop Hive
> Issue Type: Improvement
>
initial patch. Wrote a MetaDataFormatUtils class which formats table
information. This seemed better than the earlier approach I had. The output on
a describe & describe extended are attached.
Please let me know your thoughts on the approach and suggestions if any.
> describe extende
still
some minor changes to be done.
> table/partition level statistics
>
>
> Key: HIVE-1361
> URL: https://issues.apache.org/jira/browse/HIVE-1361
> Project: Hadoop Hive
> Issue Type: Sub-task
file sizes since they are
different in the raw size (serialized and compressed) with the sizes we saw
during stats gathering (deserialized and decompressed). And there are no strong
use cases for them currently, so we'll exclude them for this patch.
> table/partition leve
committed. Thanks Siying
> bring a table/partition offline
> ---
>
> Key: HIVE-1413
> URL: https://issues.apache.org/jira/browse/HIVE-1413
> Project: Hadoop Hive
> Issue Type: New Feature
>
Reporter: Namit Jain
>Assignee: Siying Dong
> Fix For: 0.7.0
>
> Attachments: HIVE-1413.1.patch, HIVE-1413.2.patch, HIVE-1413.3.patch,
> HIVE-1413.4.patch
>
>
> There should be a way to bring a table/partition offline.
> At that
cessor
>Reporter: Namit Jain
>Assignee: Siying Dong
> Fix For: 0.7.0
>
> Attachments: HIVE-1413.1.patch, HIVE-1413.2.patch, HIVE-1413.3.patch
>
>
> There should be a way to bring a table/partition offline.
> At that time, no read/w
[
https://issues.apache.org/jira/browse/HIVE-1413?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Siying Dong updated HIVE-1413:
--
Status: Patch Available (was: Open)
> bring a table/partition offl
of
everywhere.
change syntax a little bit.
Add some more unit test cases.
> bring a table/partition offline
> ---
>
> Key: HIVE-1413
> URL: https://issues.apache.org/jira/browse/HIVE-1413
> Pr
of no_drop mode. Make every mode like bitmap instead of levels
3. cover the case of dropping tables
> bring a table/partition offline
> ---
>
> Key: HIVE-1413
> URL: https://issues.apache.org/jira/browse/HIVE-1413
>
[
https://issues.apache.org/jira/browse/HIVE-1413?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Siying Dong updated HIVE-1413:
--
Attachment: (was: HIVE-1414.1.patch)
> bring a table/partition offl
eone else isnt working on it?
I would approach it by writing a Utils function to parse and display output of
metastore/src/gen-javabean/*Table.toString() in a proper format. Or is there a
Thrift helper that gets this done easier?
> describe extended table/partition output is
ing a table/partition offline
> ---
>
> Key: HIVE-1413
> URL: https://issues.apache.org/jira/browse/HIVE-1413
> Project: Hadoop Hive
> Issue Type: New Feature
> Components: Me
y DEFAULT on ADD COLUMN so existing
tables remain ONLINE by default.
> bring a table/partition offline
> ---
>
> Key: HIVE-1413
> URL: https://issues.apache.org/jira/browse/HIVE-1413
> Project: Hadoop Hive
d in HIVE-1427.
> bring a table/partition offline
> ---
>
> Key: HIVE-1413
> URL: https://issues.apache.org/jira/browse/HIVE-1413
> Project: Hadoop Hive
> Issue Type: New Feature
>
4.1.patch", but this is HIVE-1413.
> bring a table/partition offline
> ---
>
> Key: HIVE-1413
> URL: https://issues.apache.org/jira/browse/HIVE-1413
> Project: Hadoop Hive
> Issue Type: New Featu
[
https://issues.apache.org/jira/browse/HIVE-1413?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Siying Dong updated HIVE-1413:
--
Attachment: (was: HIVE-1414.1.patch)
> bring a table/partition offl
[
https://issues.apache.org/jira/browse/HIVE-1413?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Siying Dong updated HIVE-1413:
--
Attachment: HIVE-1414.1.patch
> bring a table/partition offl
[
https://issues.apache.org/jira/browse/HIVE-1413?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Siying Dong updated HIVE-1413:
--
Attachment: (was: HIVE-1414.1.patch)
> bring a table/partition offl
[
https://issues.apache.org/jira/browse/HIVE-1413?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Siying Dong updated HIVE-1413:
--
Attachment: HIVE-1414.1.patch
> bring a table/partition offl
case.
(5) unit tests for it.
> bring a table/partition offline
> ---
>
> Key: HIVE-1413
> URL: https://issues.apache.org/jira/browse/HIVE-1413
> Project: Hadoop Hive
> Issue Type:
)
(was: 0.5.1)
Component/s: Serializers/Deserializers
> Fix CombineHiveInputFormat to work with multi-level of directories in a
> single table/partition
> --
>
>
Component/s: Query Processor
> "show table extended like table partition(xxx) " will show the result of the
> whole table if the partitio
[
https://issues.apache.org/jira/browse/HIVE-1413?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
John Sichi updated HIVE-1413:
-
Fix Version/s: 0.7.0
(was: 0.6.0)
> bring a table/partition offl
this...
> fix inconsistent expectations from table/partition location value
> -
>
> Key: HIVE-897
> URL: https://issues.apache.org/jira/browse/HIVE-897
> Project: Hadoop Hive
>
7;location' parameter uniform throughout the
code (hive.metastore, hive.ql.metastore & load & move related classes).
Feel free to take over as appropriate.
> fix inconsistent expectations from tabl
The ANALYZE TABLE command should be integrated with the data replication
hook. When an existing table/partition is analyzed, a new WriteEntity should be
generated to make metadata replication work.
- Investigate JDO on top of HBase integration. If JDO works on HBase, we could
just use JDO to up
[
https://issues.apache.org/jira/browse/HIVE-1413?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Namit Jain reassigned HIVE-1413:
Assignee: Siying Dong (was: Paul Yang)
> bring a table/partition offl
bring a table/partition offline
---
Key: HIVE-1413
URL: https://issues.apache.org/jira/browse/HIVE-1413
Project: Hadoop Hive
Issue Type: New Feature
Components: Metastore, Query Processor
this issue, We were looking at fixing this
but the problem statement is very abstract.
> fix inconsistent expectations from table/partition location value
> -
>
> Key: HIVE-897
> URL: https:
There is no theoretical limit. Practically, the query planning phase
involves reading the partition from the metastore (derby, mysql). At some
point, when your query spans tons of partitions, the query planning phase
can take 2 minutes or more.
Edward
On Tue, Jun 8, 2010 at 3:00 AM, jaydeep vishw
Hi,
How many partitions at max we can create for a table? Suppose if I want
to use date as a partition, Is it limited or unlimited ?
Regards,
jaydeep
The information contained in this communication is intended solely for the use
of the individual or entity to whom it is addressed and others au
cted automatically at insert time. since
loading doesn't scan the data, we cannot gather stats from this command.
> table/partition level statistics
>
>
> Key: HIVE-1361
> URL: https://issues.apache.org/jira/browse/HIVE-13
will be collected
automatically at insert/load time vs. the stats which will be collected when
the user explicitly analyzes the table ?
> table/partition level statistics
>
>
> Key: HIVE-1361
> URL: https://issues.apa
table/partition level statistics
Key: HIVE-1361
URL: https://issues.apache.org/jira/browse/HIVE-1361
Project: Hadoop Hive
Issue Type: Sub-task
Affects Versions: 0.6.0
Reporter: Ning Zhang
just realized that when I
tested, I was using the stock hadoop 0.20 version which does not have
MAPREDUCE-1501 in it.
> allow sub-directories for an external table/partition
> -
>
> Key: HIVE-1083
>
into why)
(2) deal with HIVE-1133 to fix the corner cases
> allow sub-directories for an external table/partition
> -
>
> Key: HIVE-1083
> URL: https://issues.apache.org/jira/browse/HIVE-1083
>
]
Status: Resolved (was: Patch Available)
Committed to both trunk and 0.5. Thanks Zheng
> Fix CombineHiveInputFormat to work with multi-level of directories in a
> single table/par
gt; Fix CombineHiveInputFormat to work with multi-level of directories in a
> single table/partition
> --
>
> Key: HIVE-1200
> URL: https://issues.apache.org
ies in a
> single table/partition
> --
>
> Key: HIVE-1200
> URL: https://issues.apache.org/jira/browse/HIVE-1200
> Project: Hadoop Hive
>
mat to work with multi-level of directories in a
> single table/partition
> --
>
> Key: HIVE-1200
> URL: https://issues.apache.org/jira/browse/HIVE-1200
>
Fix CombineHiveInputFormat to work with multi-level of directories in a single
table/partition
--
Key: HIVE-1200
URL: https://issues.apache.org/jira/browse/HIVE-1200
apOperator, given the current input path, we need to find all the aliases
that the current input path corresponds to.
> allow sub-directories for an external table/partition
> -
>
> Key: HIVE-1083
>
[
https://issues.apache.org/jira/browse/HIVE-1083?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Zheng Shao updated HIVE-1083:
-
Description:
Sometimes users want to define an external table/partition based on all files
[
https://issues.apache.org/jira/browse/HIVE-1083?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Zheng Shao reassigned HIVE-1083:
Assignee: (was: Vikram Chandrasekhar)
> allow sub-directories for a table/partit
[
https://issues.apache.org/jira/browse/HIVE-1083?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Namit Jain reassigned HIVE-1083:
Assignee: Vikram Chandrasekhar
> allow sub-directories for a table/partit
anch-0.5 under HIVE-1059.
> "show table extended like table partition(xxx) " will show the result of the
> whole table if the partition does not exist
>
>
&
sing for the committed version
to branch 0.5.0: ql/src/test/results/clientnegative/invalide_t_alter1.q.out.
Can you double check and commit it?
> "show table extended like table partition(xxx) " will show the result of the
> whole table if the part
out when the
partition does not exist. (Yongqiang He via zshao)
Hadoop Flags: [Reviewed]
Status: Resolved (was: Patch Available)
Committed. Thanks Yongqiang.
> "show table extended like table partition(xxx) " will show the result of the
> whole table if the pa
low sub-directories for a table/partition
> ---
>
> Key: HIVE-1083
> URL: https://issues.apache.org/jira/browse/HIVE-1083
> Project: Hadoop Hive
> Issue Type: Improvement
>
allow sub-directories for a table/partition
---
Key: HIVE-1083
URL: https://issues.apache.org/jira/browse/HIVE-1083
Project: Hadoop Hive
Issue Type: Improvement
Components: Query Processor
1 - 100 of 167 matches
Mail list logo
