[jira] [Updated] (HIVE-22366) Multiple metastore calls for same table and constraints during planning
[ https://issues.apache.org/jira/browse/HIVE-22366?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vineet Garg updated HIVE-22366: --- Fix Version/s: 4.0.0 > Multiple metastore calls for same table and constraints during planning > --- > > Key: HIVE-22366 > URL: https://issues.apache.org/jira/browse/HIVE-22366 > Project: Hive > Issue Type: Improvement > Components: Query Planning >Reporter: Vineet Garg >Assignee: Vineet Garg >Priority: Major > Labels: pull-request-available > Fix For: 4.0.0 > > Attachments: HIVE-22366.1.patch, HIVE-22366.2.patch, > HIVE-22366.3.patch, HIVE-22366.4.patch, HIVE-22366.5.patch, > HIVE-22366.6.patch, HIVE-22366.7.patch, HIVE-22366.8.patch > > Time Spent: 0.5h > Remaining Estimate: 0h > > e.g. for a simple query like > {code:sql} > explain select count(i) from test2 group by j limit 3; > {code} > planner makes the following calls: > {code} > 2019-10-17T22:44:49,892 INFO [812910d4-bc6a-450c-aa8b-3487b4edceab main] > HiveMetaStore.audit: ugi=vgarg ip=unknown-ip-addr cmd=get_table : > tbl=hive.default.test2 > 2019-10-17T22:44:49,908 INFO [812910d4-bc6a-450c-aa8b-3487b4edceab main] > HiveMetaStore.audit: ugi=vgarg ip=unknown-ip-addr > cmd=get_primary_keys : tbl=hive.default.test2 > 2019-10-17T22:44:49,910 INFO [812910d4-bc6a-450c-aa8b-3487b4edceab main] > HiveMetaStore.audit: ugi=vgarg ip=unknown-ip-addr > cmd=get_foreign_keys : parentdb=null parenttbl=null foreigndb=default > foreigntbl=test2 > 2019-10-17T22:44:49,911 INFO [812910d4-bc6a-450c-aa8b-3487b4edceab main] > HiveMetaStore.audit: ugi=vgarg ip=unknown-ip-addr > cmd=get_unique_constraints : tbl=hive.default.test2 > 2019-10-17T22:44:49,913 INFO [812910d4-bc6a-450c-aa8b-3487b4edceab main] > HiveMetaStore.audit: ugi=vgarg ip=unknown-ip-addr > cmd=get_not_null_constraints : tbl=hive.default.test2 > 2019-10-17T22:44:49,979 INFO [812910d4-bc6a-450c-aa8b-3487b4edceab main] > HiveMetaStore.audit: ugi=vgarg ip=unknown-ip-addr > cmd=get_partitions : tbl=hive.default.test2 > 2019-10-17T22:44:49,997 INFO [812910d4-bc6a-450c-aa8b-3487b4edceab main] > HiveMetaStore.audit: ugi=vgarg ip=unknown-ip-addr > cmd=get_aggr_stats_for: table=hive.default.test2 > 2019-10-17T22:44:50,014 INFO [812910d4-bc6a-450c-aa8b-3487b4edceab main] > HiveMetaStore.audit: ugi=vgarg ip=unknown-ip-addr cmd=get_table : > tbl=hive.default.test2 > 2019-10-17T22:44:50,023 INFO [812910d4-bc6a-450c-aa8b-3487b4edceab main] > HiveMetaStore.audit: ugi=vgarg ip=unknown-ip-addr > cmd=get_primary_keys : tbl=hive.default.test2 > 2019-10-17T22:44:50,024 INFO [812910d4-bc6a-450c-aa8b-3487b4edceab main] > HiveMetaStore.audit: ugi=vgarg ip=unknown-ip-addr > cmd=get_foreign_keys : parentdb=null parenttbl=null foreigndb=default > foreigntbl=test2 > 2019-10-17T22:44:50,025 INFO [812910d4-bc6a-450c-aa8b-3487b4edceab main] > HiveMetaStore.audit: ugi=vgarg ip=unknown-ip-addr > cmd=get_unique_constraints : tbl=hive.default.test2 > 2019-10-17T22:44:50,026 INFO [812910d4-bc6a-450c-aa8b-3487b4edceab main] > HiveMetaStore.audit: ugi=vgarg ip=unknown-ip-addr > cmd=get_not_null_constraints : tbl=hive.default.test2 > {code} -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Updated] (HIVE-22366) Multiple metastore calls for same table and constraints during planning
[ https://issues.apache.org/jira/browse/HIVE-22366?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vineet Garg updated HIVE-22366: --- Resolution: Fixed Status: Resolved (was: Patch Available) Pushed to master, thanks [~jcamachorodriguez] > Multiple metastore calls for same table and constraints during planning > --- > > Key: HIVE-22366 > URL: https://issues.apache.org/jira/browse/HIVE-22366 > Project: Hive > Issue Type: Improvement > Components: Query Planning >Reporter: Vineet Garg >Assignee: Vineet Garg >Priority: Major > Labels: pull-request-available > Attachments: HIVE-22366.1.patch, HIVE-22366.2.patch, > HIVE-22366.3.patch, HIVE-22366.4.patch, HIVE-22366.5.patch, > HIVE-22366.6.patch, HIVE-22366.7.patch, HIVE-22366.8.patch > > Time Spent: 0.5h > Remaining Estimate: 0h > > e.g. for a simple query like > {code:sql} > explain select count(i) from test2 group by j limit 3; > {code} > planner makes the following calls: > {code} > 2019-10-17T22:44:49,892 INFO [812910d4-bc6a-450c-aa8b-3487b4edceab main] > HiveMetaStore.audit: ugi=vgarg ip=unknown-ip-addr cmd=get_table : > tbl=hive.default.test2 > 2019-10-17T22:44:49,908 INFO [812910d4-bc6a-450c-aa8b-3487b4edceab main] > HiveMetaStore.audit: ugi=vgarg ip=unknown-ip-addr > cmd=get_primary_keys : tbl=hive.default.test2 > 2019-10-17T22:44:49,910 INFO [812910d4-bc6a-450c-aa8b-3487b4edceab main] > HiveMetaStore.audit: ugi=vgarg ip=unknown-ip-addr > cmd=get_foreign_keys : parentdb=null parenttbl=null foreigndb=default > foreigntbl=test2 > 2019-10-17T22:44:49,911 INFO [812910d4-bc6a-450c-aa8b-3487b4edceab main] > HiveMetaStore.audit: ugi=vgarg ip=unknown-ip-addr > cmd=get_unique_constraints : tbl=hive.default.test2 > 2019-10-17T22:44:49,913 INFO [812910d4-bc6a-450c-aa8b-3487b4edceab main] > HiveMetaStore.audit: ugi=vgarg ip=unknown-ip-addr > cmd=get_not_null_constraints : tbl=hive.default.test2 > 2019-10-17T22:44:49,979 INFO [812910d4-bc6a-450c-aa8b-3487b4edceab main] > HiveMetaStore.audit: ugi=vgarg ip=unknown-ip-addr > cmd=get_partitions : tbl=hive.default.test2 > 2019-10-17T22:44:49,997 INFO [812910d4-bc6a-450c-aa8b-3487b4edceab main] > HiveMetaStore.audit: ugi=vgarg ip=unknown-ip-addr > cmd=get_aggr_stats_for: table=hive.default.test2 > 2019-10-17T22:44:50,014 INFO [812910d4-bc6a-450c-aa8b-3487b4edceab main] > HiveMetaStore.audit: ugi=vgarg ip=unknown-ip-addr cmd=get_table : > tbl=hive.default.test2 > 2019-10-17T22:44:50,023 INFO [812910d4-bc6a-450c-aa8b-3487b4edceab main] > HiveMetaStore.audit: ugi=vgarg ip=unknown-ip-addr > cmd=get_primary_keys : tbl=hive.default.test2 > 2019-10-17T22:44:50,024 INFO [812910d4-bc6a-450c-aa8b-3487b4edceab main] > HiveMetaStore.audit: ugi=vgarg ip=unknown-ip-addr > cmd=get_foreign_keys : parentdb=null parenttbl=null foreigndb=default > foreigntbl=test2 > 2019-10-17T22:44:50,025 INFO [812910d4-bc6a-450c-aa8b-3487b4edceab main] > HiveMetaStore.audit: ugi=vgarg ip=unknown-ip-addr > cmd=get_unique_constraints : tbl=hive.default.test2 > 2019-10-17T22:44:50,026 INFO [812910d4-bc6a-450c-aa8b-3487b4edceab main] > HiveMetaStore.audit: ugi=vgarg ip=unknown-ip-addr > cmd=get_not_null_constraints : tbl=hive.default.test2 > {code} -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Updated] (HIVE-22366) Multiple metastore calls for same table and constraints during planning
[ https://issues.apache.org/jira/browse/HIVE-22366?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vineet Garg updated HIVE-22366: --- Attachment: HIVE-22366.8.patch > Multiple metastore calls for same table and constraints during planning > --- > > Key: HIVE-22366 > URL: https://issues.apache.org/jira/browse/HIVE-22366 > Project: Hive > Issue Type: Improvement > Components: Query Planning >Reporter: Vineet Garg >Assignee: Vineet Garg >Priority: Major > Labels: pull-request-available > Attachments: HIVE-22366.1.patch, HIVE-22366.2.patch, > HIVE-22366.3.patch, HIVE-22366.4.patch, HIVE-22366.5.patch, > HIVE-22366.6.patch, HIVE-22366.7.patch, HIVE-22366.8.patch > > Time Spent: 0.5h > Remaining Estimate: 0h > > e.g. for a simple query like > {code:sql} > explain select count(i) from test2 group by j limit 3; > {code} > planner makes the following calls: > {code} > 2019-10-17T22:44:49,892 INFO [812910d4-bc6a-450c-aa8b-3487b4edceab main] > HiveMetaStore.audit: ugi=vgarg ip=unknown-ip-addr cmd=get_table : > tbl=hive.default.test2 > 2019-10-17T22:44:49,908 INFO [812910d4-bc6a-450c-aa8b-3487b4edceab main] > HiveMetaStore.audit: ugi=vgarg ip=unknown-ip-addr > cmd=get_primary_keys : tbl=hive.default.test2 > 2019-10-17T22:44:49,910 INFO [812910d4-bc6a-450c-aa8b-3487b4edceab main] > HiveMetaStore.audit: ugi=vgarg ip=unknown-ip-addr > cmd=get_foreign_keys : parentdb=null parenttbl=null foreigndb=default > foreigntbl=test2 > 2019-10-17T22:44:49,911 INFO [812910d4-bc6a-450c-aa8b-3487b4edceab main] > HiveMetaStore.audit: ugi=vgarg ip=unknown-ip-addr > cmd=get_unique_constraints : tbl=hive.default.test2 > 2019-10-17T22:44:49,913 INFO [812910d4-bc6a-450c-aa8b-3487b4edceab main] > HiveMetaStore.audit: ugi=vgarg ip=unknown-ip-addr > cmd=get_not_null_constraints : tbl=hive.default.test2 > 2019-10-17T22:44:49,979 INFO [812910d4-bc6a-450c-aa8b-3487b4edceab main] > HiveMetaStore.audit: ugi=vgarg ip=unknown-ip-addr > cmd=get_partitions : tbl=hive.default.test2 > 2019-10-17T22:44:49,997 INFO [812910d4-bc6a-450c-aa8b-3487b4edceab main] > HiveMetaStore.audit: ugi=vgarg ip=unknown-ip-addr > cmd=get_aggr_stats_for: table=hive.default.test2 > 2019-10-17T22:44:50,014 INFO [812910d4-bc6a-450c-aa8b-3487b4edceab main] > HiveMetaStore.audit: ugi=vgarg ip=unknown-ip-addr cmd=get_table : > tbl=hive.default.test2 > 2019-10-17T22:44:50,023 INFO [812910d4-bc6a-450c-aa8b-3487b4edceab main] > HiveMetaStore.audit: ugi=vgarg ip=unknown-ip-addr > cmd=get_primary_keys : tbl=hive.default.test2 > 2019-10-17T22:44:50,024 INFO [812910d4-bc6a-450c-aa8b-3487b4edceab main] > HiveMetaStore.audit: ugi=vgarg ip=unknown-ip-addr > cmd=get_foreign_keys : parentdb=null parenttbl=null foreigndb=default > foreigntbl=test2 > 2019-10-17T22:44:50,025 INFO [812910d4-bc6a-450c-aa8b-3487b4edceab main] > HiveMetaStore.audit: ugi=vgarg ip=unknown-ip-addr > cmd=get_unique_constraints : tbl=hive.default.test2 > 2019-10-17T22:44:50,026 INFO [812910d4-bc6a-450c-aa8b-3487b4edceab main] > HiveMetaStore.audit: ugi=vgarg ip=unknown-ip-addr > cmd=get_not_null_constraints : tbl=hive.default.test2 > {code} -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Updated] (HIVE-22366) Multiple metastore calls for same table and constraints during planning
[ https://issues.apache.org/jira/browse/HIVE-22366?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vineet Garg updated HIVE-22366: --- Status: Patch Available (was: Open) > Multiple metastore calls for same table and constraints during planning > --- > > Key: HIVE-22366 > URL: https://issues.apache.org/jira/browse/HIVE-22366 > Project: Hive > Issue Type: Improvement > Components: Query Planning >Reporter: Vineet Garg >Assignee: Vineet Garg >Priority: Major > Attachments: HIVE-22366.1.patch, HIVE-22366.2.patch, > HIVE-22366.3.patch, HIVE-22366.4.patch, HIVE-22366.5.patch, > HIVE-22366.6.patch, HIVE-22366.7.patch > > > e.g. for a simple query like > {code:sql} > explain select count(i) from test2 group by j limit 3; > {code} > planner makes the following calls: > {code} > 2019-10-17T22:44:49,892 INFO [812910d4-bc6a-450c-aa8b-3487b4edceab main] > HiveMetaStore.audit: ugi=vgarg ip=unknown-ip-addr cmd=get_table : > tbl=hive.default.test2 > 2019-10-17T22:44:49,908 INFO [812910d4-bc6a-450c-aa8b-3487b4edceab main] > HiveMetaStore.audit: ugi=vgarg ip=unknown-ip-addr > cmd=get_primary_keys : tbl=hive.default.test2 > 2019-10-17T22:44:49,910 INFO [812910d4-bc6a-450c-aa8b-3487b4edceab main] > HiveMetaStore.audit: ugi=vgarg ip=unknown-ip-addr > cmd=get_foreign_keys : parentdb=null parenttbl=null foreigndb=default > foreigntbl=test2 > 2019-10-17T22:44:49,911 INFO [812910d4-bc6a-450c-aa8b-3487b4edceab main] > HiveMetaStore.audit: ugi=vgarg ip=unknown-ip-addr > cmd=get_unique_constraints : tbl=hive.default.test2 > 2019-10-17T22:44:49,913 INFO [812910d4-bc6a-450c-aa8b-3487b4edceab main] > HiveMetaStore.audit: ugi=vgarg ip=unknown-ip-addr > cmd=get_not_null_constraints : tbl=hive.default.test2 > 2019-10-17T22:44:49,979 INFO [812910d4-bc6a-450c-aa8b-3487b4edceab main] > HiveMetaStore.audit: ugi=vgarg ip=unknown-ip-addr > cmd=get_partitions : tbl=hive.default.test2 > 2019-10-17T22:44:49,997 INFO [812910d4-bc6a-450c-aa8b-3487b4edceab main] > HiveMetaStore.audit: ugi=vgarg ip=unknown-ip-addr > cmd=get_aggr_stats_for: table=hive.default.test2 > 2019-10-17T22:44:50,014 INFO [812910d4-bc6a-450c-aa8b-3487b4edceab main] > HiveMetaStore.audit: ugi=vgarg ip=unknown-ip-addr cmd=get_table : > tbl=hive.default.test2 > 2019-10-17T22:44:50,023 INFO [812910d4-bc6a-450c-aa8b-3487b4edceab main] > HiveMetaStore.audit: ugi=vgarg ip=unknown-ip-addr > cmd=get_primary_keys : tbl=hive.default.test2 > 2019-10-17T22:44:50,024 INFO [812910d4-bc6a-450c-aa8b-3487b4edceab main] > HiveMetaStore.audit: ugi=vgarg ip=unknown-ip-addr > cmd=get_foreign_keys : parentdb=null parenttbl=null foreigndb=default > foreigntbl=test2 > 2019-10-17T22:44:50,025 INFO [812910d4-bc6a-450c-aa8b-3487b4edceab main] > HiveMetaStore.audit: ugi=vgarg ip=unknown-ip-addr > cmd=get_unique_constraints : tbl=hive.default.test2 > 2019-10-17T22:44:50,026 INFO [812910d4-bc6a-450c-aa8b-3487b4edceab main] > HiveMetaStore.audit: ugi=vgarg ip=unknown-ip-addr > cmd=get_not_null_constraints : tbl=hive.default.test2 > {code} -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Updated] (HIVE-22366) Multiple metastore calls for same table and constraints during planning
[ https://issues.apache.org/jira/browse/HIVE-22366?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vineet Garg updated HIVE-22366: --- Status: Open (was: Patch Available) > Multiple metastore calls for same table and constraints during planning > --- > > Key: HIVE-22366 > URL: https://issues.apache.org/jira/browse/HIVE-22366 > Project: Hive > Issue Type: Improvement > Components: Query Planning >Reporter: Vineet Garg >Assignee: Vineet Garg >Priority: Major > Attachments: HIVE-22366.1.patch, HIVE-22366.2.patch, > HIVE-22366.3.patch, HIVE-22366.4.patch, HIVE-22366.5.patch, > HIVE-22366.6.patch, HIVE-22366.7.patch > > > e.g. for a simple query like > {code:sql} > explain select count(i) from test2 group by j limit 3; > {code} > planner makes the following calls: > {code} > 2019-10-17T22:44:49,892 INFO [812910d4-bc6a-450c-aa8b-3487b4edceab main] > HiveMetaStore.audit: ugi=vgarg ip=unknown-ip-addr cmd=get_table : > tbl=hive.default.test2 > 2019-10-17T22:44:49,908 INFO [812910d4-bc6a-450c-aa8b-3487b4edceab main] > HiveMetaStore.audit: ugi=vgarg ip=unknown-ip-addr > cmd=get_primary_keys : tbl=hive.default.test2 > 2019-10-17T22:44:49,910 INFO [812910d4-bc6a-450c-aa8b-3487b4edceab main] > HiveMetaStore.audit: ugi=vgarg ip=unknown-ip-addr > cmd=get_foreign_keys : parentdb=null parenttbl=null foreigndb=default > foreigntbl=test2 > 2019-10-17T22:44:49,911 INFO [812910d4-bc6a-450c-aa8b-3487b4edceab main] > HiveMetaStore.audit: ugi=vgarg ip=unknown-ip-addr > cmd=get_unique_constraints : tbl=hive.default.test2 > 2019-10-17T22:44:49,913 INFO [812910d4-bc6a-450c-aa8b-3487b4edceab main] > HiveMetaStore.audit: ugi=vgarg ip=unknown-ip-addr > cmd=get_not_null_constraints : tbl=hive.default.test2 > 2019-10-17T22:44:49,979 INFO [812910d4-bc6a-450c-aa8b-3487b4edceab main] > HiveMetaStore.audit: ugi=vgarg ip=unknown-ip-addr > cmd=get_partitions : tbl=hive.default.test2 > 2019-10-17T22:44:49,997 INFO [812910d4-bc6a-450c-aa8b-3487b4edceab main] > HiveMetaStore.audit: ugi=vgarg ip=unknown-ip-addr > cmd=get_aggr_stats_for: table=hive.default.test2 > 2019-10-17T22:44:50,014 INFO [812910d4-bc6a-450c-aa8b-3487b4edceab main] > HiveMetaStore.audit: ugi=vgarg ip=unknown-ip-addr cmd=get_table : > tbl=hive.default.test2 > 2019-10-17T22:44:50,023 INFO [812910d4-bc6a-450c-aa8b-3487b4edceab main] > HiveMetaStore.audit: ugi=vgarg ip=unknown-ip-addr > cmd=get_primary_keys : tbl=hive.default.test2 > 2019-10-17T22:44:50,024 INFO [812910d4-bc6a-450c-aa8b-3487b4edceab main] > HiveMetaStore.audit: ugi=vgarg ip=unknown-ip-addr > cmd=get_foreign_keys : parentdb=null parenttbl=null foreigndb=default > foreigntbl=test2 > 2019-10-17T22:44:50,025 INFO [812910d4-bc6a-450c-aa8b-3487b4edceab main] > HiveMetaStore.audit: ugi=vgarg ip=unknown-ip-addr > cmd=get_unique_constraints : tbl=hive.default.test2 > 2019-10-17T22:44:50,026 INFO [812910d4-bc6a-450c-aa8b-3487b4edceab main] > HiveMetaStore.audit: ugi=vgarg ip=unknown-ip-addr > cmd=get_not_null_constraints : tbl=hive.default.test2 > {code} -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Updated] (HIVE-22366) Multiple metastore calls for same table and constraints during planning
[ https://issues.apache.org/jira/browse/HIVE-22366?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vineet Garg updated HIVE-22366: --- Attachment: HIVE-22366.7.patch > Multiple metastore calls for same table and constraints during planning > --- > > Key: HIVE-22366 > URL: https://issues.apache.org/jira/browse/HIVE-22366 > Project: Hive > Issue Type: Improvement > Components: Query Planning >Reporter: Vineet Garg >Assignee: Vineet Garg >Priority: Major > Attachments: HIVE-22366.1.patch, HIVE-22366.2.patch, > HIVE-22366.3.patch, HIVE-22366.4.patch, HIVE-22366.5.patch, > HIVE-22366.6.patch, HIVE-22366.7.patch > > > e.g. for a simple query like > {code:sql} > explain select count(i) from test2 group by j limit 3; > {code} > planner makes the following calls: > {code} > 2019-10-17T22:44:49,892 INFO [812910d4-bc6a-450c-aa8b-3487b4edceab main] > HiveMetaStore.audit: ugi=vgarg ip=unknown-ip-addr cmd=get_table : > tbl=hive.default.test2 > 2019-10-17T22:44:49,908 INFO [812910d4-bc6a-450c-aa8b-3487b4edceab main] > HiveMetaStore.audit: ugi=vgarg ip=unknown-ip-addr > cmd=get_primary_keys : tbl=hive.default.test2 > 2019-10-17T22:44:49,910 INFO [812910d4-bc6a-450c-aa8b-3487b4edceab main] > HiveMetaStore.audit: ugi=vgarg ip=unknown-ip-addr > cmd=get_foreign_keys : parentdb=null parenttbl=null foreigndb=default > foreigntbl=test2 > 2019-10-17T22:44:49,911 INFO [812910d4-bc6a-450c-aa8b-3487b4edceab main] > HiveMetaStore.audit: ugi=vgarg ip=unknown-ip-addr > cmd=get_unique_constraints : tbl=hive.default.test2 > 2019-10-17T22:44:49,913 INFO [812910d4-bc6a-450c-aa8b-3487b4edceab main] > HiveMetaStore.audit: ugi=vgarg ip=unknown-ip-addr > cmd=get_not_null_constraints : tbl=hive.default.test2 > 2019-10-17T22:44:49,979 INFO [812910d4-bc6a-450c-aa8b-3487b4edceab main] > HiveMetaStore.audit: ugi=vgarg ip=unknown-ip-addr > cmd=get_partitions : tbl=hive.default.test2 > 2019-10-17T22:44:49,997 INFO [812910d4-bc6a-450c-aa8b-3487b4edceab main] > HiveMetaStore.audit: ugi=vgarg ip=unknown-ip-addr > cmd=get_aggr_stats_for: table=hive.default.test2 > 2019-10-17T22:44:50,014 INFO [812910d4-bc6a-450c-aa8b-3487b4edceab main] > HiveMetaStore.audit: ugi=vgarg ip=unknown-ip-addr cmd=get_table : > tbl=hive.default.test2 > 2019-10-17T22:44:50,023 INFO [812910d4-bc6a-450c-aa8b-3487b4edceab main] > HiveMetaStore.audit: ugi=vgarg ip=unknown-ip-addr > cmd=get_primary_keys : tbl=hive.default.test2 > 2019-10-17T22:44:50,024 INFO [812910d4-bc6a-450c-aa8b-3487b4edceab main] > HiveMetaStore.audit: ugi=vgarg ip=unknown-ip-addr > cmd=get_foreign_keys : parentdb=null parenttbl=null foreigndb=default > foreigntbl=test2 > 2019-10-17T22:44:50,025 INFO [812910d4-bc6a-450c-aa8b-3487b4edceab main] > HiveMetaStore.audit: ugi=vgarg ip=unknown-ip-addr > cmd=get_unique_constraints : tbl=hive.default.test2 > 2019-10-17T22:44:50,026 INFO [812910d4-bc6a-450c-aa8b-3487b4edceab main] > HiveMetaStore.audit: ugi=vgarg ip=unknown-ip-addr > cmd=get_not_null_constraints : tbl=hive.default.test2 > {code} -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Updated] (HIVE-22366) Multiple metastore calls for same table and constraints during planning
[ https://issues.apache.org/jira/browse/HIVE-22366?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HIVE-22366: -- Labels: pull-request-available (was: ) > Multiple metastore calls for same table and constraints during planning > --- > > Key: HIVE-22366 > URL: https://issues.apache.org/jira/browse/HIVE-22366 > Project: Hive > Issue Type: Improvement > Components: Query Planning >Reporter: Vineet Garg >Assignee: Vineet Garg >Priority: Major > Labels: pull-request-available > Attachments: HIVE-22366.1.patch, HIVE-22366.2.patch, > HIVE-22366.3.patch, HIVE-22366.4.patch, HIVE-22366.5.patch, > HIVE-22366.6.patch, HIVE-22366.7.patch > > > e.g. for a simple query like > {code:sql} > explain select count(i) from test2 group by j limit 3; > {code} > planner makes the following calls: > {code} > 2019-10-17T22:44:49,892 INFO [812910d4-bc6a-450c-aa8b-3487b4edceab main] > HiveMetaStore.audit: ugi=vgarg ip=unknown-ip-addr cmd=get_table : > tbl=hive.default.test2 > 2019-10-17T22:44:49,908 INFO [812910d4-bc6a-450c-aa8b-3487b4edceab main] > HiveMetaStore.audit: ugi=vgarg ip=unknown-ip-addr > cmd=get_primary_keys : tbl=hive.default.test2 > 2019-10-17T22:44:49,910 INFO [812910d4-bc6a-450c-aa8b-3487b4edceab main] > HiveMetaStore.audit: ugi=vgarg ip=unknown-ip-addr > cmd=get_foreign_keys : parentdb=null parenttbl=null foreigndb=default > foreigntbl=test2 > 2019-10-17T22:44:49,911 INFO [812910d4-bc6a-450c-aa8b-3487b4edceab main] > HiveMetaStore.audit: ugi=vgarg ip=unknown-ip-addr > cmd=get_unique_constraints : tbl=hive.default.test2 > 2019-10-17T22:44:49,913 INFO [812910d4-bc6a-450c-aa8b-3487b4edceab main] > HiveMetaStore.audit: ugi=vgarg ip=unknown-ip-addr > cmd=get_not_null_constraints : tbl=hive.default.test2 > 2019-10-17T22:44:49,979 INFO [812910d4-bc6a-450c-aa8b-3487b4edceab main] > HiveMetaStore.audit: ugi=vgarg ip=unknown-ip-addr > cmd=get_partitions : tbl=hive.default.test2 > 2019-10-17T22:44:49,997 INFO [812910d4-bc6a-450c-aa8b-3487b4edceab main] > HiveMetaStore.audit: ugi=vgarg ip=unknown-ip-addr > cmd=get_aggr_stats_for: table=hive.default.test2 > 2019-10-17T22:44:50,014 INFO [812910d4-bc6a-450c-aa8b-3487b4edceab main] > HiveMetaStore.audit: ugi=vgarg ip=unknown-ip-addr cmd=get_table : > tbl=hive.default.test2 > 2019-10-17T22:44:50,023 INFO [812910d4-bc6a-450c-aa8b-3487b4edceab main] > HiveMetaStore.audit: ugi=vgarg ip=unknown-ip-addr > cmd=get_primary_keys : tbl=hive.default.test2 > 2019-10-17T22:44:50,024 INFO [812910d4-bc6a-450c-aa8b-3487b4edceab main] > HiveMetaStore.audit: ugi=vgarg ip=unknown-ip-addr > cmd=get_foreign_keys : parentdb=null parenttbl=null foreigndb=default > foreigntbl=test2 > 2019-10-17T22:44:50,025 INFO [812910d4-bc6a-450c-aa8b-3487b4edceab main] > HiveMetaStore.audit: ugi=vgarg ip=unknown-ip-addr > cmd=get_unique_constraints : tbl=hive.default.test2 > 2019-10-17T22:44:50,026 INFO [812910d4-bc6a-450c-aa8b-3487b4edceab main] > HiveMetaStore.audit: ugi=vgarg ip=unknown-ip-addr > cmd=get_not_null_constraints : tbl=hive.default.test2 > {code} -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Updated] (HIVE-22366) Multiple metastore calls for same table and constraints during planning
[ https://issues.apache.org/jira/browse/HIVE-22366?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vineet Garg updated HIVE-22366: --- Attachment: HIVE-22366.6.patch > Multiple metastore calls for same table and constraints during planning > --- > > Key: HIVE-22366 > URL: https://issues.apache.org/jira/browse/HIVE-22366 > Project: Hive > Issue Type: Improvement > Components: Query Planning >Reporter: Vineet Garg >Assignee: Vineet Garg >Priority: Major > Attachments: HIVE-22366.1.patch, HIVE-22366.2.patch, > HIVE-22366.3.patch, HIVE-22366.4.patch, HIVE-22366.5.patch, HIVE-22366.6.patch > > > e.g. for a simple query like > {code:sql} > explain select count(i) from test2 group by j limit 3; > {code} > planner makes the following calls: > {code} > 2019-10-17T22:44:49,892 INFO [812910d4-bc6a-450c-aa8b-3487b4edceab main] > HiveMetaStore.audit: ugi=vgarg ip=unknown-ip-addr cmd=get_table : > tbl=hive.default.test2 > 2019-10-17T22:44:49,908 INFO [812910d4-bc6a-450c-aa8b-3487b4edceab main] > HiveMetaStore.audit: ugi=vgarg ip=unknown-ip-addr > cmd=get_primary_keys : tbl=hive.default.test2 > 2019-10-17T22:44:49,910 INFO [812910d4-bc6a-450c-aa8b-3487b4edceab main] > HiveMetaStore.audit: ugi=vgarg ip=unknown-ip-addr > cmd=get_foreign_keys : parentdb=null parenttbl=null foreigndb=default > foreigntbl=test2 > 2019-10-17T22:44:49,911 INFO [812910d4-bc6a-450c-aa8b-3487b4edceab main] > HiveMetaStore.audit: ugi=vgarg ip=unknown-ip-addr > cmd=get_unique_constraints : tbl=hive.default.test2 > 2019-10-17T22:44:49,913 INFO [812910d4-bc6a-450c-aa8b-3487b4edceab main] > HiveMetaStore.audit: ugi=vgarg ip=unknown-ip-addr > cmd=get_not_null_constraints : tbl=hive.default.test2 > 2019-10-17T22:44:49,979 INFO [812910d4-bc6a-450c-aa8b-3487b4edceab main] > HiveMetaStore.audit: ugi=vgarg ip=unknown-ip-addr > cmd=get_partitions : tbl=hive.default.test2 > 2019-10-17T22:44:49,997 INFO [812910d4-bc6a-450c-aa8b-3487b4edceab main] > HiveMetaStore.audit: ugi=vgarg ip=unknown-ip-addr > cmd=get_aggr_stats_for: table=hive.default.test2 > 2019-10-17T22:44:50,014 INFO [812910d4-bc6a-450c-aa8b-3487b4edceab main] > HiveMetaStore.audit: ugi=vgarg ip=unknown-ip-addr cmd=get_table : > tbl=hive.default.test2 > 2019-10-17T22:44:50,023 INFO [812910d4-bc6a-450c-aa8b-3487b4edceab main] > HiveMetaStore.audit: ugi=vgarg ip=unknown-ip-addr > cmd=get_primary_keys : tbl=hive.default.test2 > 2019-10-17T22:44:50,024 INFO [812910d4-bc6a-450c-aa8b-3487b4edceab main] > HiveMetaStore.audit: ugi=vgarg ip=unknown-ip-addr > cmd=get_foreign_keys : parentdb=null parenttbl=null foreigndb=default > foreigntbl=test2 > 2019-10-17T22:44:50,025 INFO [812910d4-bc6a-450c-aa8b-3487b4edceab main] > HiveMetaStore.audit: ugi=vgarg ip=unknown-ip-addr > cmd=get_unique_constraints : tbl=hive.default.test2 > 2019-10-17T22:44:50,026 INFO [812910d4-bc6a-450c-aa8b-3487b4edceab main] > HiveMetaStore.audit: ugi=vgarg ip=unknown-ip-addr > cmd=get_not_null_constraints : tbl=hive.default.test2 > {code} -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Updated] (HIVE-22366) Multiple metastore calls for same table and constraints during planning
[ https://issues.apache.org/jira/browse/HIVE-22366?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vineet Garg updated HIVE-22366: --- Status: Patch Available (was: Open) > Multiple metastore calls for same table and constraints during planning > --- > > Key: HIVE-22366 > URL: https://issues.apache.org/jira/browse/HIVE-22366 > Project: Hive > Issue Type: Improvement > Components: Query Planning >Reporter: Vineet Garg >Assignee: Vineet Garg >Priority: Major > Attachments: HIVE-22366.1.patch, HIVE-22366.2.patch, > HIVE-22366.3.patch, HIVE-22366.4.patch, HIVE-22366.5.patch, HIVE-22366.6.patch > > > e.g. for a simple query like > {code:sql} > explain select count(i) from test2 group by j limit 3; > {code} > planner makes the following calls: > {code} > 2019-10-17T22:44:49,892 INFO [812910d4-bc6a-450c-aa8b-3487b4edceab main] > HiveMetaStore.audit: ugi=vgarg ip=unknown-ip-addr cmd=get_table : > tbl=hive.default.test2 > 2019-10-17T22:44:49,908 INFO [812910d4-bc6a-450c-aa8b-3487b4edceab main] > HiveMetaStore.audit: ugi=vgarg ip=unknown-ip-addr > cmd=get_primary_keys : tbl=hive.default.test2 > 2019-10-17T22:44:49,910 INFO [812910d4-bc6a-450c-aa8b-3487b4edceab main] > HiveMetaStore.audit: ugi=vgarg ip=unknown-ip-addr > cmd=get_foreign_keys : parentdb=null parenttbl=null foreigndb=default > foreigntbl=test2 > 2019-10-17T22:44:49,911 INFO [812910d4-bc6a-450c-aa8b-3487b4edceab main] > HiveMetaStore.audit: ugi=vgarg ip=unknown-ip-addr > cmd=get_unique_constraints : tbl=hive.default.test2 > 2019-10-17T22:44:49,913 INFO [812910d4-bc6a-450c-aa8b-3487b4edceab main] > HiveMetaStore.audit: ugi=vgarg ip=unknown-ip-addr > cmd=get_not_null_constraints : tbl=hive.default.test2 > 2019-10-17T22:44:49,979 INFO [812910d4-bc6a-450c-aa8b-3487b4edceab main] > HiveMetaStore.audit: ugi=vgarg ip=unknown-ip-addr > cmd=get_partitions : tbl=hive.default.test2 > 2019-10-17T22:44:49,997 INFO [812910d4-bc6a-450c-aa8b-3487b4edceab main] > HiveMetaStore.audit: ugi=vgarg ip=unknown-ip-addr > cmd=get_aggr_stats_for: table=hive.default.test2 > 2019-10-17T22:44:50,014 INFO [812910d4-bc6a-450c-aa8b-3487b4edceab main] > HiveMetaStore.audit: ugi=vgarg ip=unknown-ip-addr cmd=get_table : > tbl=hive.default.test2 > 2019-10-17T22:44:50,023 INFO [812910d4-bc6a-450c-aa8b-3487b4edceab main] > HiveMetaStore.audit: ugi=vgarg ip=unknown-ip-addr > cmd=get_primary_keys : tbl=hive.default.test2 > 2019-10-17T22:44:50,024 INFO [812910d4-bc6a-450c-aa8b-3487b4edceab main] > HiveMetaStore.audit: ugi=vgarg ip=unknown-ip-addr > cmd=get_foreign_keys : parentdb=null parenttbl=null foreigndb=default > foreigntbl=test2 > 2019-10-17T22:44:50,025 INFO [812910d4-bc6a-450c-aa8b-3487b4edceab main] > HiveMetaStore.audit: ugi=vgarg ip=unknown-ip-addr > cmd=get_unique_constraints : tbl=hive.default.test2 > 2019-10-17T22:44:50,026 INFO [812910d4-bc6a-450c-aa8b-3487b4edceab main] > HiveMetaStore.audit: ugi=vgarg ip=unknown-ip-addr > cmd=get_not_null_constraints : tbl=hive.default.test2 > {code} -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Updated] (HIVE-22366) Multiple metastore calls for same table and constraints during planning
[ https://issues.apache.org/jira/browse/HIVE-22366?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vineet Garg updated HIVE-22366: --- Status: Open (was: Patch Available) > Multiple metastore calls for same table and constraints during planning > --- > > Key: HIVE-22366 > URL: https://issues.apache.org/jira/browse/HIVE-22366 > Project: Hive > Issue Type: Improvement > Components: Query Planning >Reporter: Vineet Garg >Assignee: Vineet Garg >Priority: Major > Attachments: HIVE-22366.1.patch, HIVE-22366.2.patch, > HIVE-22366.3.patch, HIVE-22366.4.patch, HIVE-22366.5.patch, HIVE-22366.6.patch > > > e.g. for a simple query like > {code:sql} > explain select count(i) from test2 group by j limit 3; > {code} > planner makes the following calls: > {code} > 2019-10-17T22:44:49,892 INFO [812910d4-bc6a-450c-aa8b-3487b4edceab main] > HiveMetaStore.audit: ugi=vgarg ip=unknown-ip-addr cmd=get_table : > tbl=hive.default.test2 > 2019-10-17T22:44:49,908 INFO [812910d4-bc6a-450c-aa8b-3487b4edceab main] > HiveMetaStore.audit: ugi=vgarg ip=unknown-ip-addr > cmd=get_primary_keys : tbl=hive.default.test2 > 2019-10-17T22:44:49,910 INFO [812910d4-bc6a-450c-aa8b-3487b4edceab main] > HiveMetaStore.audit: ugi=vgarg ip=unknown-ip-addr > cmd=get_foreign_keys : parentdb=null parenttbl=null foreigndb=default > foreigntbl=test2 > 2019-10-17T22:44:49,911 INFO [812910d4-bc6a-450c-aa8b-3487b4edceab main] > HiveMetaStore.audit: ugi=vgarg ip=unknown-ip-addr > cmd=get_unique_constraints : tbl=hive.default.test2 > 2019-10-17T22:44:49,913 INFO [812910d4-bc6a-450c-aa8b-3487b4edceab main] > HiveMetaStore.audit: ugi=vgarg ip=unknown-ip-addr > cmd=get_not_null_constraints : tbl=hive.default.test2 > 2019-10-17T22:44:49,979 INFO [812910d4-bc6a-450c-aa8b-3487b4edceab main] > HiveMetaStore.audit: ugi=vgarg ip=unknown-ip-addr > cmd=get_partitions : tbl=hive.default.test2 > 2019-10-17T22:44:49,997 INFO [812910d4-bc6a-450c-aa8b-3487b4edceab main] > HiveMetaStore.audit: ugi=vgarg ip=unknown-ip-addr > cmd=get_aggr_stats_for: table=hive.default.test2 > 2019-10-17T22:44:50,014 INFO [812910d4-bc6a-450c-aa8b-3487b4edceab main] > HiveMetaStore.audit: ugi=vgarg ip=unknown-ip-addr cmd=get_table : > tbl=hive.default.test2 > 2019-10-17T22:44:50,023 INFO [812910d4-bc6a-450c-aa8b-3487b4edceab main] > HiveMetaStore.audit: ugi=vgarg ip=unknown-ip-addr > cmd=get_primary_keys : tbl=hive.default.test2 > 2019-10-17T22:44:50,024 INFO [812910d4-bc6a-450c-aa8b-3487b4edceab main] > HiveMetaStore.audit: ugi=vgarg ip=unknown-ip-addr > cmd=get_foreign_keys : parentdb=null parenttbl=null foreigndb=default > foreigntbl=test2 > 2019-10-17T22:44:50,025 INFO [812910d4-bc6a-450c-aa8b-3487b4edceab main] > HiveMetaStore.audit: ugi=vgarg ip=unknown-ip-addr > cmd=get_unique_constraints : tbl=hive.default.test2 > 2019-10-17T22:44:50,026 INFO [812910d4-bc6a-450c-aa8b-3487b4edceab main] > HiveMetaStore.audit: ugi=vgarg ip=unknown-ip-addr > cmd=get_not_null_constraints : tbl=hive.default.test2 > {code} -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Updated] (HIVE-22366) Multiple metastore calls for same table and constraints during planning
[ https://issues.apache.org/jira/browse/HIVE-22366?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vineet Garg updated HIVE-22366: --- Status: Patch Available (was: Open) > Multiple metastore calls for same table and constraints during planning > --- > > Key: HIVE-22366 > URL: https://issues.apache.org/jira/browse/HIVE-22366 > Project: Hive > Issue Type: Improvement > Components: Query Planning >Reporter: Vineet Garg >Assignee: Vineet Garg >Priority: Major > Attachments: HIVE-22366.1.patch, HIVE-22366.2.patch, > HIVE-22366.3.patch, HIVE-22366.4.patch, HIVE-22366.5.patch > > > e.g. for a simple query like > {code:sql} > explain select count(i) from test2 group by j limit 3; > {code} > planner makes the following calls: > {code} > 2019-10-17T22:44:49,892 INFO [812910d4-bc6a-450c-aa8b-3487b4edceab main] > HiveMetaStore.audit: ugi=vgarg ip=unknown-ip-addr cmd=get_table : > tbl=hive.default.test2 > 2019-10-17T22:44:49,908 INFO [812910d4-bc6a-450c-aa8b-3487b4edceab main] > HiveMetaStore.audit: ugi=vgarg ip=unknown-ip-addr > cmd=get_primary_keys : tbl=hive.default.test2 > 2019-10-17T22:44:49,910 INFO [812910d4-bc6a-450c-aa8b-3487b4edceab main] > HiveMetaStore.audit: ugi=vgarg ip=unknown-ip-addr > cmd=get_foreign_keys : parentdb=null parenttbl=null foreigndb=default > foreigntbl=test2 > 2019-10-17T22:44:49,911 INFO [812910d4-bc6a-450c-aa8b-3487b4edceab main] > HiveMetaStore.audit: ugi=vgarg ip=unknown-ip-addr > cmd=get_unique_constraints : tbl=hive.default.test2 > 2019-10-17T22:44:49,913 INFO [812910d4-bc6a-450c-aa8b-3487b4edceab main] > HiveMetaStore.audit: ugi=vgarg ip=unknown-ip-addr > cmd=get_not_null_constraints : tbl=hive.default.test2 > 2019-10-17T22:44:49,979 INFO [812910d4-bc6a-450c-aa8b-3487b4edceab main] > HiveMetaStore.audit: ugi=vgarg ip=unknown-ip-addr > cmd=get_partitions : tbl=hive.default.test2 > 2019-10-17T22:44:49,997 INFO [812910d4-bc6a-450c-aa8b-3487b4edceab main] > HiveMetaStore.audit: ugi=vgarg ip=unknown-ip-addr > cmd=get_aggr_stats_for: table=hive.default.test2 > 2019-10-17T22:44:50,014 INFO [812910d4-bc6a-450c-aa8b-3487b4edceab main] > HiveMetaStore.audit: ugi=vgarg ip=unknown-ip-addr cmd=get_table : > tbl=hive.default.test2 > 2019-10-17T22:44:50,023 INFO [812910d4-bc6a-450c-aa8b-3487b4edceab main] > HiveMetaStore.audit: ugi=vgarg ip=unknown-ip-addr > cmd=get_primary_keys : tbl=hive.default.test2 > 2019-10-17T22:44:50,024 INFO [812910d4-bc6a-450c-aa8b-3487b4edceab main] > HiveMetaStore.audit: ugi=vgarg ip=unknown-ip-addr > cmd=get_foreign_keys : parentdb=null parenttbl=null foreigndb=default > foreigntbl=test2 > 2019-10-17T22:44:50,025 INFO [812910d4-bc6a-450c-aa8b-3487b4edceab main] > HiveMetaStore.audit: ugi=vgarg ip=unknown-ip-addr > cmd=get_unique_constraints : tbl=hive.default.test2 > 2019-10-17T22:44:50,026 INFO [812910d4-bc6a-450c-aa8b-3487b4edceab main] > HiveMetaStore.audit: ugi=vgarg ip=unknown-ip-addr > cmd=get_not_null_constraints : tbl=hive.default.test2 > {code} -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Updated] (HIVE-22366) Multiple metastore calls for same table and constraints during planning
[ https://issues.apache.org/jira/browse/HIVE-22366?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vineet Garg updated HIVE-22366: --- Attachment: HIVE-22366.5.patch > Multiple metastore calls for same table and constraints during planning > --- > > Key: HIVE-22366 > URL: https://issues.apache.org/jira/browse/HIVE-22366 > Project: Hive > Issue Type: Improvement > Components: Query Planning >Reporter: Vineet Garg >Assignee: Vineet Garg >Priority: Major > Attachments: HIVE-22366.1.patch, HIVE-22366.2.patch, > HIVE-22366.3.patch, HIVE-22366.4.patch, HIVE-22366.5.patch > > > e.g. for a simple query like > {code:sql} > explain select count(i) from test2 group by j limit 3; > {code} > planner makes the following calls: > {code} > 2019-10-17T22:44:49,892 INFO [812910d4-bc6a-450c-aa8b-3487b4edceab main] > HiveMetaStore.audit: ugi=vgarg ip=unknown-ip-addr cmd=get_table : > tbl=hive.default.test2 > 2019-10-17T22:44:49,908 INFO [812910d4-bc6a-450c-aa8b-3487b4edceab main] > HiveMetaStore.audit: ugi=vgarg ip=unknown-ip-addr > cmd=get_primary_keys : tbl=hive.default.test2 > 2019-10-17T22:44:49,910 INFO [812910d4-bc6a-450c-aa8b-3487b4edceab main] > HiveMetaStore.audit: ugi=vgarg ip=unknown-ip-addr > cmd=get_foreign_keys : parentdb=null parenttbl=null foreigndb=default > foreigntbl=test2 > 2019-10-17T22:44:49,911 INFO [812910d4-bc6a-450c-aa8b-3487b4edceab main] > HiveMetaStore.audit: ugi=vgarg ip=unknown-ip-addr > cmd=get_unique_constraints : tbl=hive.default.test2 > 2019-10-17T22:44:49,913 INFO [812910d4-bc6a-450c-aa8b-3487b4edceab main] > HiveMetaStore.audit: ugi=vgarg ip=unknown-ip-addr > cmd=get_not_null_constraints : tbl=hive.default.test2 > 2019-10-17T22:44:49,979 INFO [812910d4-bc6a-450c-aa8b-3487b4edceab main] > HiveMetaStore.audit: ugi=vgarg ip=unknown-ip-addr > cmd=get_partitions : tbl=hive.default.test2 > 2019-10-17T22:44:49,997 INFO [812910d4-bc6a-450c-aa8b-3487b4edceab main] > HiveMetaStore.audit: ugi=vgarg ip=unknown-ip-addr > cmd=get_aggr_stats_for: table=hive.default.test2 > 2019-10-17T22:44:50,014 INFO [812910d4-bc6a-450c-aa8b-3487b4edceab main] > HiveMetaStore.audit: ugi=vgarg ip=unknown-ip-addr cmd=get_table : > tbl=hive.default.test2 > 2019-10-17T22:44:50,023 INFO [812910d4-bc6a-450c-aa8b-3487b4edceab main] > HiveMetaStore.audit: ugi=vgarg ip=unknown-ip-addr > cmd=get_primary_keys : tbl=hive.default.test2 > 2019-10-17T22:44:50,024 INFO [812910d4-bc6a-450c-aa8b-3487b4edceab main] > HiveMetaStore.audit: ugi=vgarg ip=unknown-ip-addr > cmd=get_foreign_keys : parentdb=null parenttbl=null foreigndb=default > foreigntbl=test2 > 2019-10-17T22:44:50,025 INFO [812910d4-bc6a-450c-aa8b-3487b4edceab main] > HiveMetaStore.audit: ugi=vgarg ip=unknown-ip-addr > cmd=get_unique_constraints : tbl=hive.default.test2 > 2019-10-17T22:44:50,026 INFO [812910d4-bc6a-450c-aa8b-3487b4edceab main] > HiveMetaStore.audit: ugi=vgarg ip=unknown-ip-addr > cmd=get_not_null_constraints : tbl=hive.default.test2 > {code} -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Updated] (HIVE-22366) Multiple metastore calls for same table and constraints during planning
[ https://issues.apache.org/jira/browse/HIVE-22366?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vineet Garg updated HIVE-22366: --- Status: Open (was: Patch Available) > Multiple metastore calls for same table and constraints during planning > --- > > Key: HIVE-22366 > URL: https://issues.apache.org/jira/browse/HIVE-22366 > Project: Hive > Issue Type: Improvement > Components: Query Planning >Reporter: Vineet Garg >Assignee: Vineet Garg >Priority: Major > Attachments: HIVE-22366.1.patch, HIVE-22366.2.patch, > HIVE-22366.3.patch, HIVE-22366.4.patch, HIVE-22366.5.patch > > > e.g. for a simple query like > {code:sql} > explain select count(i) from test2 group by j limit 3; > {code} > planner makes the following calls: > {code} > 2019-10-17T22:44:49,892 INFO [812910d4-bc6a-450c-aa8b-3487b4edceab main] > HiveMetaStore.audit: ugi=vgarg ip=unknown-ip-addr cmd=get_table : > tbl=hive.default.test2 > 2019-10-17T22:44:49,908 INFO [812910d4-bc6a-450c-aa8b-3487b4edceab main] > HiveMetaStore.audit: ugi=vgarg ip=unknown-ip-addr > cmd=get_primary_keys : tbl=hive.default.test2 > 2019-10-17T22:44:49,910 INFO [812910d4-bc6a-450c-aa8b-3487b4edceab main] > HiveMetaStore.audit: ugi=vgarg ip=unknown-ip-addr > cmd=get_foreign_keys : parentdb=null parenttbl=null foreigndb=default > foreigntbl=test2 > 2019-10-17T22:44:49,911 INFO [812910d4-bc6a-450c-aa8b-3487b4edceab main] > HiveMetaStore.audit: ugi=vgarg ip=unknown-ip-addr > cmd=get_unique_constraints : tbl=hive.default.test2 > 2019-10-17T22:44:49,913 INFO [812910d4-bc6a-450c-aa8b-3487b4edceab main] > HiveMetaStore.audit: ugi=vgarg ip=unknown-ip-addr > cmd=get_not_null_constraints : tbl=hive.default.test2 > 2019-10-17T22:44:49,979 INFO [812910d4-bc6a-450c-aa8b-3487b4edceab main] > HiveMetaStore.audit: ugi=vgarg ip=unknown-ip-addr > cmd=get_partitions : tbl=hive.default.test2 > 2019-10-17T22:44:49,997 INFO [812910d4-bc6a-450c-aa8b-3487b4edceab main] > HiveMetaStore.audit: ugi=vgarg ip=unknown-ip-addr > cmd=get_aggr_stats_for: table=hive.default.test2 > 2019-10-17T22:44:50,014 INFO [812910d4-bc6a-450c-aa8b-3487b4edceab main] > HiveMetaStore.audit: ugi=vgarg ip=unknown-ip-addr cmd=get_table : > tbl=hive.default.test2 > 2019-10-17T22:44:50,023 INFO [812910d4-bc6a-450c-aa8b-3487b4edceab main] > HiveMetaStore.audit: ugi=vgarg ip=unknown-ip-addr > cmd=get_primary_keys : tbl=hive.default.test2 > 2019-10-17T22:44:50,024 INFO [812910d4-bc6a-450c-aa8b-3487b4edceab main] > HiveMetaStore.audit: ugi=vgarg ip=unknown-ip-addr > cmd=get_foreign_keys : parentdb=null parenttbl=null foreigndb=default > foreigntbl=test2 > 2019-10-17T22:44:50,025 INFO [812910d4-bc6a-450c-aa8b-3487b4edceab main] > HiveMetaStore.audit: ugi=vgarg ip=unknown-ip-addr > cmd=get_unique_constraints : tbl=hive.default.test2 > 2019-10-17T22:44:50,026 INFO [812910d4-bc6a-450c-aa8b-3487b4edceab main] > HiveMetaStore.audit: ugi=vgarg ip=unknown-ip-addr > cmd=get_not_null_constraints : tbl=hive.default.test2 > {code} -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Updated] (HIVE-22366) Multiple metastore calls for same table and constraints during planning
[ https://issues.apache.org/jira/browse/HIVE-22366?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vineet Garg updated HIVE-22366: --- Status: Patch Available (was: Open) > Multiple metastore calls for same table and constraints during planning > --- > > Key: HIVE-22366 > URL: https://issues.apache.org/jira/browse/HIVE-22366 > Project: Hive > Issue Type: Improvement > Components: Query Planning >Reporter: Vineet Garg >Assignee: Vineet Garg >Priority: Major > Attachments: HIVE-22366.1.patch, HIVE-22366.2.patch, > HIVE-22366.3.patch, HIVE-22366.4.patch > > > e.g. for a simple query like > {code:sql} > explain select count(i) from test2 group by j limit 3; > {code} > planner makes the following calls: > {code} > 2019-10-17T22:44:49,892 INFO [812910d4-bc6a-450c-aa8b-3487b4edceab main] > HiveMetaStore.audit: ugi=vgarg ip=unknown-ip-addr cmd=get_table : > tbl=hive.default.test2 > 2019-10-17T22:44:49,908 INFO [812910d4-bc6a-450c-aa8b-3487b4edceab main] > HiveMetaStore.audit: ugi=vgarg ip=unknown-ip-addr > cmd=get_primary_keys : tbl=hive.default.test2 > 2019-10-17T22:44:49,910 INFO [812910d4-bc6a-450c-aa8b-3487b4edceab main] > HiveMetaStore.audit: ugi=vgarg ip=unknown-ip-addr > cmd=get_foreign_keys : parentdb=null parenttbl=null foreigndb=default > foreigntbl=test2 > 2019-10-17T22:44:49,911 INFO [812910d4-bc6a-450c-aa8b-3487b4edceab main] > HiveMetaStore.audit: ugi=vgarg ip=unknown-ip-addr > cmd=get_unique_constraints : tbl=hive.default.test2 > 2019-10-17T22:44:49,913 INFO [812910d4-bc6a-450c-aa8b-3487b4edceab main] > HiveMetaStore.audit: ugi=vgarg ip=unknown-ip-addr > cmd=get_not_null_constraints : tbl=hive.default.test2 > 2019-10-17T22:44:49,979 INFO [812910d4-bc6a-450c-aa8b-3487b4edceab main] > HiveMetaStore.audit: ugi=vgarg ip=unknown-ip-addr > cmd=get_partitions : tbl=hive.default.test2 > 2019-10-17T22:44:49,997 INFO [812910d4-bc6a-450c-aa8b-3487b4edceab main] > HiveMetaStore.audit: ugi=vgarg ip=unknown-ip-addr > cmd=get_aggr_stats_for: table=hive.default.test2 > 2019-10-17T22:44:50,014 INFO [812910d4-bc6a-450c-aa8b-3487b4edceab main] > HiveMetaStore.audit: ugi=vgarg ip=unknown-ip-addr cmd=get_table : > tbl=hive.default.test2 > 2019-10-17T22:44:50,023 INFO [812910d4-bc6a-450c-aa8b-3487b4edceab main] > HiveMetaStore.audit: ugi=vgarg ip=unknown-ip-addr > cmd=get_primary_keys : tbl=hive.default.test2 > 2019-10-17T22:44:50,024 INFO [812910d4-bc6a-450c-aa8b-3487b4edceab main] > HiveMetaStore.audit: ugi=vgarg ip=unknown-ip-addr > cmd=get_foreign_keys : parentdb=null parenttbl=null foreigndb=default > foreigntbl=test2 > 2019-10-17T22:44:50,025 INFO [812910d4-bc6a-450c-aa8b-3487b4edceab main] > HiveMetaStore.audit: ugi=vgarg ip=unknown-ip-addr > cmd=get_unique_constraints : tbl=hive.default.test2 > 2019-10-17T22:44:50,026 INFO [812910d4-bc6a-450c-aa8b-3487b4edceab main] > HiveMetaStore.audit: ugi=vgarg ip=unknown-ip-addr > cmd=get_not_null_constraints : tbl=hive.default.test2 > {code} -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Updated] (HIVE-22366) Multiple metastore calls for same table and constraints during planning
[ https://issues.apache.org/jira/browse/HIVE-22366?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vineet Garg updated HIVE-22366: --- Attachment: HIVE-22366.4.patch > Multiple metastore calls for same table and constraints during planning > --- > > Key: HIVE-22366 > URL: https://issues.apache.org/jira/browse/HIVE-22366 > Project: Hive > Issue Type: Improvement > Components: Query Planning >Reporter: Vineet Garg >Assignee: Vineet Garg >Priority: Major > Attachments: HIVE-22366.1.patch, HIVE-22366.2.patch, > HIVE-22366.3.patch, HIVE-22366.4.patch > > > e.g. for a simple query like > {code:sql} > explain select count(i) from test2 group by j limit 3; > {code} > planner makes the following calls: > {code} > 2019-10-17T22:44:49,892 INFO [812910d4-bc6a-450c-aa8b-3487b4edceab main] > HiveMetaStore.audit: ugi=vgarg ip=unknown-ip-addr cmd=get_table : > tbl=hive.default.test2 > 2019-10-17T22:44:49,908 INFO [812910d4-bc6a-450c-aa8b-3487b4edceab main] > HiveMetaStore.audit: ugi=vgarg ip=unknown-ip-addr > cmd=get_primary_keys : tbl=hive.default.test2 > 2019-10-17T22:44:49,910 INFO [812910d4-bc6a-450c-aa8b-3487b4edceab main] > HiveMetaStore.audit: ugi=vgarg ip=unknown-ip-addr > cmd=get_foreign_keys : parentdb=null parenttbl=null foreigndb=default > foreigntbl=test2 > 2019-10-17T22:44:49,911 INFO [812910d4-bc6a-450c-aa8b-3487b4edceab main] > HiveMetaStore.audit: ugi=vgarg ip=unknown-ip-addr > cmd=get_unique_constraints : tbl=hive.default.test2 > 2019-10-17T22:44:49,913 INFO [812910d4-bc6a-450c-aa8b-3487b4edceab main] > HiveMetaStore.audit: ugi=vgarg ip=unknown-ip-addr > cmd=get_not_null_constraints : tbl=hive.default.test2 > 2019-10-17T22:44:49,979 INFO [812910d4-bc6a-450c-aa8b-3487b4edceab main] > HiveMetaStore.audit: ugi=vgarg ip=unknown-ip-addr > cmd=get_partitions : tbl=hive.default.test2 > 2019-10-17T22:44:49,997 INFO [812910d4-bc6a-450c-aa8b-3487b4edceab main] > HiveMetaStore.audit: ugi=vgarg ip=unknown-ip-addr > cmd=get_aggr_stats_for: table=hive.default.test2 > 2019-10-17T22:44:50,014 INFO [812910d4-bc6a-450c-aa8b-3487b4edceab main] > HiveMetaStore.audit: ugi=vgarg ip=unknown-ip-addr cmd=get_table : > tbl=hive.default.test2 > 2019-10-17T22:44:50,023 INFO [812910d4-bc6a-450c-aa8b-3487b4edceab main] > HiveMetaStore.audit: ugi=vgarg ip=unknown-ip-addr > cmd=get_primary_keys : tbl=hive.default.test2 > 2019-10-17T22:44:50,024 INFO [812910d4-bc6a-450c-aa8b-3487b4edceab main] > HiveMetaStore.audit: ugi=vgarg ip=unknown-ip-addr > cmd=get_foreign_keys : parentdb=null parenttbl=null foreigndb=default > foreigntbl=test2 > 2019-10-17T22:44:50,025 INFO [812910d4-bc6a-450c-aa8b-3487b4edceab main] > HiveMetaStore.audit: ugi=vgarg ip=unknown-ip-addr > cmd=get_unique_constraints : tbl=hive.default.test2 > 2019-10-17T22:44:50,026 INFO [812910d4-bc6a-450c-aa8b-3487b4edceab main] > HiveMetaStore.audit: ugi=vgarg ip=unknown-ip-addr > cmd=get_not_null_constraints : tbl=hive.default.test2 > {code} -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Updated] (HIVE-22366) Multiple metastore calls for same table and constraints during planning
[ https://issues.apache.org/jira/browse/HIVE-22366?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vineet Garg updated HIVE-22366: --- Status: Open (was: Patch Available) > Multiple metastore calls for same table and constraints during planning > --- > > Key: HIVE-22366 > URL: https://issues.apache.org/jira/browse/HIVE-22366 > Project: Hive > Issue Type: Improvement > Components: Query Planning >Reporter: Vineet Garg >Assignee: Vineet Garg >Priority: Major > Attachments: HIVE-22366.1.patch, HIVE-22366.2.patch, > HIVE-22366.3.patch, HIVE-22366.4.patch > > > e.g. for a simple query like > {code:sql} > explain select count(i) from test2 group by j limit 3; > {code} > planner makes the following calls: > {code} > 2019-10-17T22:44:49,892 INFO [812910d4-bc6a-450c-aa8b-3487b4edceab main] > HiveMetaStore.audit: ugi=vgarg ip=unknown-ip-addr cmd=get_table : > tbl=hive.default.test2 > 2019-10-17T22:44:49,908 INFO [812910d4-bc6a-450c-aa8b-3487b4edceab main] > HiveMetaStore.audit: ugi=vgarg ip=unknown-ip-addr > cmd=get_primary_keys : tbl=hive.default.test2 > 2019-10-17T22:44:49,910 INFO [812910d4-bc6a-450c-aa8b-3487b4edceab main] > HiveMetaStore.audit: ugi=vgarg ip=unknown-ip-addr > cmd=get_foreign_keys : parentdb=null parenttbl=null foreigndb=default > foreigntbl=test2 > 2019-10-17T22:44:49,911 INFO [812910d4-bc6a-450c-aa8b-3487b4edceab main] > HiveMetaStore.audit: ugi=vgarg ip=unknown-ip-addr > cmd=get_unique_constraints : tbl=hive.default.test2 > 2019-10-17T22:44:49,913 INFO [812910d4-bc6a-450c-aa8b-3487b4edceab main] > HiveMetaStore.audit: ugi=vgarg ip=unknown-ip-addr > cmd=get_not_null_constraints : tbl=hive.default.test2 > 2019-10-17T22:44:49,979 INFO [812910d4-bc6a-450c-aa8b-3487b4edceab main] > HiveMetaStore.audit: ugi=vgarg ip=unknown-ip-addr > cmd=get_partitions : tbl=hive.default.test2 > 2019-10-17T22:44:49,997 INFO [812910d4-bc6a-450c-aa8b-3487b4edceab main] > HiveMetaStore.audit: ugi=vgarg ip=unknown-ip-addr > cmd=get_aggr_stats_for: table=hive.default.test2 > 2019-10-17T22:44:50,014 INFO [812910d4-bc6a-450c-aa8b-3487b4edceab main] > HiveMetaStore.audit: ugi=vgarg ip=unknown-ip-addr cmd=get_table : > tbl=hive.default.test2 > 2019-10-17T22:44:50,023 INFO [812910d4-bc6a-450c-aa8b-3487b4edceab main] > HiveMetaStore.audit: ugi=vgarg ip=unknown-ip-addr > cmd=get_primary_keys : tbl=hive.default.test2 > 2019-10-17T22:44:50,024 INFO [812910d4-bc6a-450c-aa8b-3487b4edceab main] > HiveMetaStore.audit: ugi=vgarg ip=unknown-ip-addr > cmd=get_foreign_keys : parentdb=null parenttbl=null foreigndb=default > foreigntbl=test2 > 2019-10-17T22:44:50,025 INFO [812910d4-bc6a-450c-aa8b-3487b4edceab main] > HiveMetaStore.audit: ugi=vgarg ip=unknown-ip-addr > cmd=get_unique_constraints : tbl=hive.default.test2 > 2019-10-17T22:44:50,026 INFO [812910d4-bc6a-450c-aa8b-3487b4edceab main] > HiveMetaStore.audit: ugi=vgarg ip=unknown-ip-addr > cmd=get_not_null_constraints : tbl=hive.default.test2 > {code} -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Updated] (HIVE-22366) Multiple metastore calls for same table and constraints during planning
[ https://issues.apache.org/jira/browse/HIVE-22366?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vineet Garg updated HIVE-22366: --- Status: Open (was: Patch Available) > Multiple metastore calls for same table and constraints during planning > --- > > Key: HIVE-22366 > URL: https://issues.apache.org/jira/browse/HIVE-22366 > Project: Hive > Issue Type: Improvement > Components: Query Planning >Reporter: Vineet Garg >Assignee: Vineet Garg >Priority: Major > Attachments: HIVE-22366.1.patch, HIVE-22366.2.patch, > HIVE-22366.3.patch > > > e.g. for a simple query like > {code:sql} > explain select count(i) from test2 group by j limit 3; > {code} > planner makes the following calls: > {code} > 2019-10-17T22:44:49,892 INFO [812910d4-bc6a-450c-aa8b-3487b4edceab main] > HiveMetaStore.audit: ugi=vgarg ip=unknown-ip-addr cmd=get_table : > tbl=hive.default.test2 > 2019-10-17T22:44:49,908 INFO [812910d4-bc6a-450c-aa8b-3487b4edceab main] > HiveMetaStore.audit: ugi=vgarg ip=unknown-ip-addr > cmd=get_primary_keys : tbl=hive.default.test2 > 2019-10-17T22:44:49,910 INFO [812910d4-bc6a-450c-aa8b-3487b4edceab main] > HiveMetaStore.audit: ugi=vgarg ip=unknown-ip-addr > cmd=get_foreign_keys : parentdb=null parenttbl=null foreigndb=default > foreigntbl=test2 > 2019-10-17T22:44:49,911 INFO [812910d4-bc6a-450c-aa8b-3487b4edceab main] > HiveMetaStore.audit: ugi=vgarg ip=unknown-ip-addr > cmd=get_unique_constraints : tbl=hive.default.test2 > 2019-10-17T22:44:49,913 INFO [812910d4-bc6a-450c-aa8b-3487b4edceab main] > HiveMetaStore.audit: ugi=vgarg ip=unknown-ip-addr > cmd=get_not_null_constraints : tbl=hive.default.test2 > 2019-10-17T22:44:49,979 INFO [812910d4-bc6a-450c-aa8b-3487b4edceab main] > HiveMetaStore.audit: ugi=vgarg ip=unknown-ip-addr > cmd=get_partitions : tbl=hive.default.test2 > 2019-10-17T22:44:49,997 INFO [812910d4-bc6a-450c-aa8b-3487b4edceab main] > HiveMetaStore.audit: ugi=vgarg ip=unknown-ip-addr > cmd=get_aggr_stats_for: table=hive.default.test2 > 2019-10-17T22:44:50,014 INFO [812910d4-bc6a-450c-aa8b-3487b4edceab main] > HiveMetaStore.audit: ugi=vgarg ip=unknown-ip-addr cmd=get_table : > tbl=hive.default.test2 > 2019-10-17T22:44:50,023 INFO [812910d4-bc6a-450c-aa8b-3487b4edceab main] > HiveMetaStore.audit: ugi=vgarg ip=unknown-ip-addr > cmd=get_primary_keys : tbl=hive.default.test2 > 2019-10-17T22:44:50,024 INFO [812910d4-bc6a-450c-aa8b-3487b4edceab main] > HiveMetaStore.audit: ugi=vgarg ip=unknown-ip-addr > cmd=get_foreign_keys : parentdb=null parenttbl=null foreigndb=default > foreigntbl=test2 > 2019-10-17T22:44:50,025 INFO [812910d4-bc6a-450c-aa8b-3487b4edceab main] > HiveMetaStore.audit: ugi=vgarg ip=unknown-ip-addr > cmd=get_unique_constraints : tbl=hive.default.test2 > 2019-10-17T22:44:50,026 INFO [812910d4-bc6a-450c-aa8b-3487b4edceab main] > HiveMetaStore.audit: ugi=vgarg ip=unknown-ip-addr > cmd=get_not_null_constraints : tbl=hive.default.test2 > {code} -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Updated] (HIVE-22366) Multiple metastore calls for same table and constraints during planning
[ https://issues.apache.org/jira/browse/HIVE-22366?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vineet Garg updated HIVE-22366: --- Status: Patch Available (was: Open) > Multiple metastore calls for same table and constraints during planning > --- > > Key: HIVE-22366 > URL: https://issues.apache.org/jira/browse/HIVE-22366 > Project: Hive > Issue Type: Improvement > Components: Query Planning >Reporter: Vineet Garg >Assignee: Vineet Garg >Priority: Major > Attachments: HIVE-22366.1.patch, HIVE-22366.2.patch, > HIVE-22366.3.patch > > > e.g. for a simple query like > {code:sql} > explain select count(i) from test2 group by j limit 3; > {code} > planner makes the following calls: > {code} > 2019-10-17T22:44:49,892 INFO [812910d4-bc6a-450c-aa8b-3487b4edceab main] > HiveMetaStore.audit: ugi=vgarg ip=unknown-ip-addr cmd=get_table : > tbl=hive.default.test2 > 2019-10-17T22:44:49,908 INFO [812910d4-bc6a-450c-aa8b-3487b4edceab main] > HiveMetaStore.audit: ugi=vgarg ip=unknown-ip-addr > cmd=get_primary_keys : tbl=hive.default.test2 > 2019-10-17T22:44:49,910 INFO [812910d4-bc6a-450c-aa8b-3487b4edceab main] > HiveMetaStore.audit: ugi=vgarg ip=unknown-ip-addr > cmd=get_foreign_keys : parentdb=null parenttbl=null foreigndb=default > foreigntbl=test2 > 2019-10-17T22:44:49,911 INFO [812910d4-bc6a-450c-aa8b-3487b4edceab main] > HiveMetaStore.audit: ugi=vgarg ip=unknown-ip-addr > cmd=get_unique_constraints : tbl=hive.default.test2 > 2019-10-17T22:44:49,913 INFO [812910d4-bc6a-450c-aa8b-3487b4edceab main] > HiveMetaStore.audit: ugi=vgarg ip=unknown-ip-addr > cmd=get_not_null_constraints : tbl=hive.default.test2 > 2019-10-17T22:44:49,979 INFO [812910d4-bc6a-450c-aa8b-3487b4edceab main] > HiveMetaStore.audit: ugi=vgarg ip=unknown-ip-addr > cmd=get_partitions : tbl=hive.default.test2 > 2019-10-17T22:44:49,997 INFO [812910d4-bc6a-450c-aa8b-3487b4edceab main] > HiveMetaStore.audit: ugi=vgarg ip=unknown-ip-addr > cmd=get_aggr_stats_for: table=hive.default.test2 > 2019-10-17T22:44:50,014 INFO [812910d4-bc6a-450c-aa8b-3487b4edceab main] > HiveMetaStore.audit: ugi=vgarg ip=unknown-ip-addr cmd=get_table : > tbl=hive.default.test2 > 2019-10-17T22:44:50,023 INFO [812910d4-bc6a-450c-aa8b-3487b4edceab main] > HiveMetaStore.audit: ugi=vgarg ip=unknown-ip-addr > cmd=get_primary_keys : tbl=hive.default.test2 > 2019-10-17T22:44:50,024 INFO [812910d4-bc6a-450c-aa8b-3487b4edceab main] > HiveMetaStore.audit: ugi=vgarg ip=unknown-ip-addr > cmd=get_foreign_keys : parentdb=null parenttbl=null foreigndb=default > foreigntbl=test2 > 2019-10-17T22:44:50,025 INFO [812910d4-bc6a-450c-aa8b-3487b4edceab main] > HiveMetaStore.audit: ugi=vgarg ip=unknown-ip-addr > cmd=get_unique_constraints : tbl=hive.default.test2 > 2019-10-17T22:44:50,026 INFO [812910d4-bc6a-450c-aa8b-3487b4edceab main] > HiveMetaStore.audit: ugi=vgarg ip=unknown-ip-addr > cmd=get_not_null_constraints : tbl=hive.default.test2 > {code} -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Updated] (HIVE-22366) Multiple metastore calls for same table and constraints during planning
[ https://issues.apache.org/jira/browse/HIVE-22366?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vineet Garg updated HIVE-22366: --- Attachment: HIVE-22366.3.patch > Multiple metastore calls for same table and constraints during planning > --- > > Key: HIVE-22366 > URL: https://issues.apache.org/jira/browse/HIVE-22366 > Project: Hive > Issue Type: Improvement > Components: Query Planning >Reporter: Vineet Garg >Assignee: Vineet Garg >Priority: Major > Attachments: HIVE-22366.1.patch, HIVE-22366.2.patch, > HIVE-22366.3.patch > > > e.g. for a simple query like > {code:sql} > explain select count(i) from test2 group by j limit 3; > {code} > planner makes the following calls: > {code} > 2019-10-17T22:44:49,892 INFO [812910d4-bc6a-450c-aa8b-3487b4edceab main] > HiveMetaStore.audit: ugi=vgarg ip=unknown-ip-addr cmd=get_table : > tbl=hive.default.test2 > 2019-10-17T22:44:49,908 INFO [812910d4-bc6a-450c-aa8b-3487b4edceab main] > HiveMetaStore.audit: ugi=vgarg ip=unknown-ip-addr > cmd=get_primary_keys : tbl=hive.default.test2 > 2019-10-17T22:44:49,910 INFO [812910d4-bc6a-450c-aa8b-3487b4edceab main] > HiveMetaStore.audit: ugi=vgarg ip=unknown-ip-addr > cmd=get_foreign_keys : parentdb=null parenttbl=null foreigndb=default > foreigntbl=test2 > 2019-10-17T22:44:49,911 INFO [812910d4-bc6a-450c-aa8b-3487b4edceab main] > HiveMetaStore.audit: ugi=vgarg ip=unknown-ip-addr > cmd=get_unique_constraints : tbl=hive.default.test2 > 2019-10-17T22:44:49,913 INFO [812910d4-bc6a-450c-aa8b-3487b4edceab main] > HiveMetaStore.audit: ugi=vgarg ip=unknown-ip-addr > cmd=get_not_null_constraints : tbl=hive.default.test2 > 2019-10-17T22:44:49,979 INFO [812910d4-bc6a-450c-aa8b-3487b4edceab main] > HiveMetaStore.audit: ugi=vgarg ip=unknown-ip-addr > cmd=get_partitions : tbl=hive.default.test2 > 2019-10-17T22:44:49,997 INFO [812910d4-bc6a-450c-aa8b-3487b4edceab main] > HiveMetaStore.audit: ugi=vgarg ip=unknown-ip-addr > cmd=get_aggr_stats_for: table=hive.default.test2 > 2019-10-17T22:44:50,014 INFO [812910d4-bc6a-450c-aa8b-3487b4edceab main] > HiveMetaStore.audit: ugi=vgarg ip=unknown-ip-addr cmd=get_table : > tbl=hive.default.test2 > 2019-10-17T22:44:50,023 INFO [812910d4-bc6a-450c-aa8b-3487b4edceab main] > HiveMetaStore.audit: ugi=vgarg ip=unknown-ip-addr > cmd=get_primary_keys : tbl=hive.default.test2 > 2019-10-17T22:44:50,024 INFO [812910d4-bc6a-450c-aa8b-3487b4edceab main] > HiveMetaStore.audit: ugi=vgarg ip=unknown-ip-addr > cmd=get_foreign_keys : parentdb=null parenttbl=null foreigndb=default > foreigntbl=test2 > 2019-10-17T22:44:50,025 INFO [812910d4-bc6a-450c-aa8b-3487b4edceab main] > HiveMetaStore.audit: ugi=vgarg ip=unknown-ip-addr > cmd=get_unique_constraints : tbl=hive.default.test2 > 2019-10-17T22:44:50,026 INFO [812910d4-bc6a-450c-aa8b-3487b4edceab main] > HiveMetaStore.audit: ugi=vgarg ip=unknown-ip-addr > cmd=get_not_null_constraints : tbl=hive.default.test2 > {code} -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Updated] (HIVE-22366) Multiple metastore calls for same table and constraints during planning
[ https://issues.apache.org/jira/browse/HIVE-22366?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vineet Garg updated HIVE-22366: --- Status: Patch Available (was: Open) > Multiple metastore calls for same table and constraints during planning > --- > > Key: HIVE-22366 > URL: https://issues.apache.org/jira/browse/HIVE-22366 > Project: Hive > Issue Type: Improvement > Components: Query Planning >Reporter: Vineet Garg >Assignee: Vineet Garg >Priority: Major > Attachments: HIVE-22366.1.patch, HIVE-22366.2.patch > > > e.g. for a simple query like > {code:sql} > explain select count(i) from test2 group by j limit 3; > {code} > planner makes the following calls: > {code} > 2019-10-17T22:44:49,892 INFO [812910d4-bc6a-450c-aa8b-3487b4edceab main] > HiveMetaStore.audit: ugi=vgarg ip=unknown-ip-addr cmd=get_table : > tbl=hive.default.test2 > 2019-10-17T22:44:49,908 INFO [812910d4-bc6a-450c-aa8b-3487b4edceab main] > HiveMetaStore.audit: ugi=vgarg ip=unknown-ip-addr > cmd=get_primary_keys : tbl=hive.default.test2 > 2019-10-17T22:44:49,910 INFO [812910d4-bc6a-450c-aa8b-3487b4edceab main] > HiveMetaStore.audit: ugi=vgarg ip=unknown-ip-addr > cmd=get_foreign_keys : parentdb=null parenttbl=null foreigndb=default > foreigntbl=test2 > 2019-10-17T22:44:49,911 INFO [812910d4-bc6a-450c-aa8b-3487b4edceab main] > HiveMetaStore.audit: ugi=vgarg ip=unknown-ip-addr > cmd=get_unique_constraints : tbl=hive.default.test2 > 2019-10-17T22:44:49,913 INFO [812910d4-bc6a-450c-aa8b-3487b4edceab main] > HiveMetaStore.audit: ugi=vgarg ip=unknown-ip-addr > cmd=get_not_null_constraints : tbl=hive.default.test2 > 2019-10-17T22:44:49,979 INFO [812910d4-bc6a-450c-aa8b-3487b4edceab main] > HiveMetaStore.audit: ugi=vgarg ip=unknown-ip-addr > cmd=get_partitions : tbl=hive.default.test2 > 2019-10-17T22:44:49,997 INFO [812910d4-bc6a-450c-aa8b-3487b4edceab main] > HiveMetaStore.audit: ugi=vgarg ip=unknown-ip-addr > cmd=get_aggr_stats_for: table=hive.default.test2 > 2019-10-17T22:44:50,014 INFO [812910d4-bc6a-450c-aa8b-3487b4edceab main] > HiveMetaStore.audit: ugi=vgarg ip=unknown-ip-addr cmd=get_table : > tbl=hive.default.test2 > 2019-10-17T22:44:50,023 INFO [812910d4-bc6a-450c-aa8b-3487b4edceab main] > HiveMetaStore.audit: ugi=vgarg ip=unknown-ip-addr > cmd=get_primary_keys : tbl=hive.default.test2 > 2019-10-17T22:44:50,024 INFO [812910d4-bc6a-450c-aa8b-3487b4edceab main] > HiveMetaStore.audit: ugi=vgarg ip=unknown-ip-addr > cmd=get_foreign_keys : parentdb=null parenttbl=null foreigndb=default > foreigntbl=test2 > 2019-10-17T22:44:50,025 INFO [812910d4-bc6a-450c-aa8b-3487b4edceab main] > HiveMetaStore.audit: ugi=vgarg ip=unknown-ip-addr > cmd=get_unique_constraints : tbl=hive.default.test2 > 2019-10-17T22:44:50,026 INFO [812910d4-bc6a-450c-aa8b-3487b4edceab main] > HiveMetaStore.audit: ugi=vgarg ip=unknown-ip-addr > cmd=get_not_null_constraints : tbl=hive.default.test2 > {code} -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Updated] (HIVE-22366) Multiple metastore calls for same table and constraints during planning
[ https://issues.apache.org/jira/browse/HIVE-22366?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vineet Garg updated HIVE-22366: --- Status: Open (was: Patch Available) > Multiple metastore calls for same table and constraints during planning > --- > > Key: HIVE-22366 > URL: https://issues.apache.org/jira/browse/HIVE-22366 > Project: Hive > Issue Type: Improvement > Components: Query Planning >Reporter: Vineet Garg >Assignee: Vineet Garg >Priority: Major > Attachments: HIVE-22366.1.patch, HIVE-22366.2.patch > > > e.g. for a simple query like > {code:sql} > explain select count(i) from test2 group by j limit 3; > {code} > planner makes the following calls: > {code} > 2019-10-17T22:44:49,892 INFO [812910d4-bc6a-450c-aa8b-3487b4edceab main] > HiveMetaStore.audit: ugi=vgarg ip=unknown-ip-addr cmd=get_table : > tbl=hive.default.test2 > 2019-10-17T22:44:49,908 INFO [812910d4-bc6a-450c-aa8b-3487b4edceab main] > HiveMetaStore.audit: ugi=vgarg ip=unknown-ip-addr > cmd=get_primary_keys : tbl=hive.default.test2 > 2019-10-17T22:44:49,910 INFO [812910d4-bc6a-450c-aa8b-3487b4edceab main] > HiveMetaStore.audit: ugi=vgarg ip=unknown-ip-addr > cmd=get_foreign_keys : parentdb=null parenttbl=null foreigndb=default > foreigntbl=test2 > 2019-10-17T22:44:49,911 INFO [812910d4-bc6a-450c-aa8b-3487b4edceab main] > HiveMetaStore.audit: ugi=vgarg ip=unknown-ip-addr > cmd=get_unique_constraints : tbl=hive.default.test2 > 2019-10-17T22:44:49,913 INFO [812910d4-bc6a-450c-aa8b-3487b4edceab main] > HiveMetaStore.audit: ugi=vgarg ip=unknown-ip-addr > cmd=get_not_null_constraints : tbl=hive.default.test2 > 2019-10-17T22:44:49,979 INFO [812910d4-bc6a-450c-aa8b-3487b4edceab main] > HiveMetaStore.audit: ugi=vgarg ip=unknown-ip-addr > cmd=get_partitions : tbl=hive.default.test2 > 2019-10-17T22:44:49,997 INFO [812910d4-bc6a-450c-aa8b-3487b4edceab main] > HiveMetaStore.audit: ugi=vgarg ip=unknown-ip-addr > cmd=get_aggr_stats_for: table=hive.default.test2 > 2019-10-17T22:44:50,014 INFO [812910d4-bc6a-450c-aa8b-3487b4edceab main] > HiveMetaStore.audit: ugi=vgarg ip=unknown-ip-addr cmd=get_table : > tbl=hive.default.test2 > 2019-10-17T22:44:50,023 INFO [812910d4-bc6a-450c-aa8b-3487b4edceab main] > HiveMetaStore.audit: ugi=vgarg ip=unknown-ip-addr > cmd=get_primary_keys : tbl=hive.default.test2 > 2019-10-17T22:44:50,024 INFO [812910d4-bc6a-450c-aa8b-3487b4edceab main] > HiveMetaStore.audit: ugi=vgarg ip=unknown-ip-addr > cmd=get_foreign_keys : parentdb=null parenttbl=null foreigndb=default > foreigntbl=test2 > 2019-10-17T22:44:50,025 INFO [812910d4-bc6a-450c-aa8b-3487b4edceab main] > HiveMetaStore.audit: ugi=vgarg ip=unknown-ip-addr > cmd=get_unique_constraints : tbl=hive.default.test2 > 2019-10-17T22:44:50,026 INFO [812910d4-bc6a-450c-aa8b-3487b4edceab main] > HiveMetaStore.audit: ugi=vgarg ip=unknown-ip-addr > cmd=get_not_null_constraints : tbl=hive.default.test2 > {code} -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Updated] (HIVE-22366) Multiple metastore calls for same table and constraints during planning
[ https://issues.apache.org/jira/browse/HIVE-22366?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vineet Garg updated HIVE-22366: --- Attachment: HIVE-22366.2.patch > Multiple metastore calls for same table and constraints during planning > --- > > Key: HIVE-22366 > URL: https://issues.apache.org/jira/browse/HIVE-22366 > Project: Hive > Issue Type: Improvement > Components: Query Planning >Reporter: Vineet Garg >Assignee: Vineet Garg >Priority: Major > Attachments: HIVE-22366.1.patch, HIVE-22366.2.patch > > > e.g. for a simple query like > {code:sql} > explain select count(i) from test2 group by j limit 3; > {code} > planner makes the following calls: > {code} > 2019-10-17T22:44:49,892 INFO [812910d4-bc6a-450c-aa8b-3487b4edceab main] > HiveMetaStore.audit: ugi=vgarg ip=unknown-ip-addr cmd=get_table : > tbl=hive.default.test2 > 2019-10-17T22:44:49,908 INFO [812910d4-bc6a-450c-aa8b-3487b4edceab main] > HiveMetaStore.audit: ugi=vgarg ip=unknown-ip-addr > cmd=get_primary_keys : tbl=hive.default.test2 > 2019-10-17T22:44:49,910 INFO [812910d4-bc6a-450c-aa8b-3487b4edceab main] > HiveMetaStore.audit: ugi=vgarg ip=unknown-ip-addr > cmd=get_foreign_keys : parentdb=null parenttbl=null foreigndb=default > foreigntbl=test2 > 2019-10-17T22:44:49,911 INFO [812910d4-bc6a-450c-aa8b-3487b4edceab main] > HiveMetaStore.audit: ugi=vgarg ip=unknown-ip-addr > cmd=get_unique_constraints : tbl=hive.default.test2 > 2019-10-17T22:44:49,913 INFO [812910d4-bc6a-450c-aa8b-3487b4edceab main] > HiveMetaStore.audit: ugi=vgarg ip=unknown-ip-addr > cmd=get_not_null_constraints : tbl=hive.default.test2 > 2019-10-17T22:44:49,979 INFO [812910d4-bc6a-450c-aa8b-3487b4edceab main] > HiveMetaStore.audit: ugi=vgarg ip=unknown-ip-addr > cmd=get_partitions : tbl=hive.default.test2 > 2019-10-17T22:44:49,997 INFO [812910d4-bc6a-450c-aa8b-3487b4edceab main] > HiveMetaStore.audit: ugi=vgarg ip=unknown-ip-addr > cmd=get_aggr_stats_for: table=hive.default.test2 > 2019-10-17T22:44:50,014 INFO [812910d4-bc6a-450c-aa8b-3487b4edceab main] > HiveMetaStore.audit: ugi=vgarg ip=unknown-ip-addr cmd=get_table : > tbl=hive.default.test2 > 2019-10-17T22:44:50,023 INFO [812910d4-bc6a-450c-aa8b-3487b4edceab main] > HiveMetaStore.audit: ugi=vgarg ip=unknown-ip-addr > cmd=get_primary_keys : tbl=hive.default.test2 > 2019-10-17T22:44:50,024 INFO [812910d4-bc6a-450c-aa8b-3487b4edceab main] > HiveMetaStore.audit: ugi=vgarg ip=unknown-ip-addr > cmd=get_foreign_keys : parentdb=null parenttbl=null foreigndb=default > foreigntbl=test2 > 2019-10-17T22:44:50,025 INFO [812910d4-bc6a-450c-aa8b-3487b4edceab main] > HiveMetaStore.audit: ugi=vgarg ip=unknown-ip-addr > cmd=get_unique_constraints : tbl=hive.default.test2 > 2019-10-17T22:44:50,026 INFO [812910d4-bc6a-450c-aa8b-3487b4edceab main] > HiveMetaStore.audit: ugi=vgarg ip=unknown-ip-addr > cmd=get_not_null_constraints : tbl=hive.default.test2 > {code} -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Updated] (HIVE-22366) Multiple metastore calls for same table and constraints during planning
[ https://issues.apache.org/jira/browse/HIVE-22366?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vineet Garg updated HIVE-22366: --- Attachment: HIVE-22366.1.patch > Multiple metastore calls for same table and constraints during planning > --- > > Key: HIVE-22366 > URL: https://issues.apache.org/jira/browse/HIVE-22366 > Project: Hive > Issue Type: Improvement > Components: Query Planning >Reporter: Vineet Garg >Assignee: Vineet Garg >Priority: Major > Attachments: HIVE-22366.1.patch > > > e.g. for a simple query like > {code:sql} > explain select count(i) from test2 group by j limit 3; > {code} > planner makes the following calls: > {code} > 2019-10-17T22:44:49,892 INFO [812910d4-bc6a-450c-aa8b-3487b4edceab main] > HiveMetaStore.audit: ugi=vgarg ip=unknown-ip-addr cmd=get_table : > tbl=hive.default.test2 > 2019-10-17T22:44:49,908 INFO [812910d4-bc6a-450c-aa8b-3487b4edceab main] > HiveMetaStore.audit: ugi=vgarg ip=unknown-ip-addr > cmd=get_primary_keys : tbl=hive.default.test2 > 2019-10-17T22:44:49,910 INFO [812910d4-bc6a-450c-aa8b-3487b4edceab main] > HiveMetaStore.audit: ugi=vgarg ip=unknown-ip-addr > cmd=get_foreign_keys : parentdb=null parenttbl=null foreigndb=default > foreigntbl=test2 > 2019-10-17T22:44:49,911 INFO [812910d4-bc6a-450c-aa8b-3487b4edceab main] > HiveMetaStore.audit: ugi=vgarg ip=unknown-ip-addr > cmd=get_unique_constraints : tbl=hive.default.test2 > 2019-10-17T22:44:49,913 INFO [812910d4-bc6a-450c-aa8b-3487b4edceab main] > HiveMetaStore.audit: ugi=vgarg ip=unknown-ip-addr > cmd=get_not_null_constraints : tbl=hive.default.test2 > 2019-10-17T22:44:49,979 INFO [812910d4-bc6a-450c-aa8b-3487b4edceab main] > HiveMetaStore.audit: ugi=vgarg ip=unknown-ip-addr > cmd=get_partitions : tbl=hive.default.test2 > 2019-10-17T22:44:49,997 INFO [812910d4-bc6a-450c-aa8b-3487b4edceab main] > HiveMetaStore.audit: ugi=vgarg ip=unknown-ip-addr > cmd=get_aggr_stats_for: table=hive.default.test2 > 2019-10-17T22:44:50,014 INFO [812910d4-bc6a-450c-aa8b-3487b4edceab main] > HiveMetaStore.audit: ugi=vgarg ip=unknown-ip-addr cmd=get_table : > tbl=hive.default.test2 > 2019-10-17T22:44:50,023 INFO [812910d4-bc6a-450c-aa8b-3487b4edceab main] > HiveMetaStore.audit: ugi=vgarg ip=unknown-ip-addr > cmd=get_primary_keys : tbl=hive.default.test2 > 2019-10-17T22:44:50,024 INFO [812910d4-bc6a-450c-aa8b-3487b4edceab main] > HiveMetaStore.audit: ugi=vgarg ip=unknown-ip-addr > cmd=get_foreign_keys : parentdb=null parenttbl=null foreigndb=default > foreigntbl=test2 > 2019-10-17T22:44:50,025 INFO [812910d4-bc6a-450c-aa8b-3487b4edceab main] > HiveMetaStore.audit: ugi=vgarg ip=unknown-ip-addr > cmd=get_unique_constraints : tbl=hive.default.test2 > 2019-10-17T22:44:50,026 INFO [812910d4-bc6a-450c-aa8b-3487b4edceab main] > HiveMetaStore.audit: ugi=vgarg ip=unknown-ip-addr > cmd=get_not_null_constraints : tbl=hive.default.test2 > {code} -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Updated] (HIVE-22366) Multiple metastore calls for same table and constraints during planning
[ https://issues.apache.org/jira/browse/HIVE-22366?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vineet Garg updated HIVE-22366: --- Status: Patch Available (was: Open) > Multiple metastore calls for same table and constraints during planning > --- > > Key: HIVE-22366 > URL: https://issues.apache.org/jira/browse/HIVE-22366 > Project: Hive > Issue Type: Improvement > Components: Query Planning >Reporter: Vineet Garg >Assignee: Vineet Garg >Priority: Major > Attachments: HIVE-22366.1.patch > > > e.g. for a simple query like > {code:sql} > explain select count(i) from test2 group by j limit 3; > {code} > planner makes the following calls: > {code} > 2019-10-17T22:44:49,892 INFO [812910d4-bc6a-450c-aa8b-3487b4edceab main] > HiveMetaStore.audit: ugi=vgarg ip=unknown-ip-addr cmd=get_table : > tbl=hive.default.test2 > 2019-10-17T22:44:49,908 INFO [812910d4-bc6a-450c-aa8b-3487b4edceab main] > HiveMetaStore.audit: ugi=vgarg ip=unknown-ip-addr > cmd=get_primary_keys : tbl=hive.default.test2 > 2019-10-17T22:44:49,910 INFO [812910d4-bc6a-450c-aa8b-3487b4edceab main] > HiveMetaStore.audit: ugi=vgarg ip=unknown-ip-addr > cmd=get_foreign_keys : parentdb=null parenttbl=null foreigndb=default > foreigntbl=test2 > 2019-10-17T22:44:49,911 INFO [812910d4-bc6a-450c-aa8b-3487b4edceab main] > HiveMetaStore.audit: ugi=vgarg ip=unknown-ip-addr > cmd=get_unique_constraints : tbl=hive.default.test2 > 2019-10-17T22:44:49,913 INFO [812910d4-bc6a-450c-aa8b-3487b4edceab main] > HiveMetaStore.audit: ugi=vgarg ip=unknown-ip-addr > cmd=get_not_null_constraints : tbl=hive.default.test2 > 2019-10-17T22:44:49,979 INFO [812910d4-bc6a-450c-aa8b-3487b4edceab main] > HiveMetaStore.audit: ugi=vgarg ip=unknown-ip-addr > cmd=get_partitions : tbl=hive.default.test2 > 2019-10-17T22:44:49,997 INFO [812910d4-bc6a-450c-aa8b-3487b4edceab main] > HiveMetaStore.audit: ugi=vgarg ip=unknown-ip-addr > cmd=get_aggr_stats_for: table=hive.default.test2 > 2019-10-17T22:44:50,014 INFO [812910d4-bc6a-450c-aa8b-3487b4edceab main] > HiveMetaStore.audit: ugi=vgarg ip=unknown-ip-addr cmd=get_table : > tbl=hive.default.test2 > 2019-10-17T22:44:50,023 INFO [812910d4-bc6a-450c-aa8b-3487b4edceab main] > HiveMetaStore.audit: ugi=vgarg ip=unknown-ip-addr > cmd=get_primary_keys : tbl=hive.default.test2 > 2019-10-17T22:44:50,024 INFO [812910d4-bc6a-450c-aa8b-3487b4edceab main] > HiveMetaStore.audit: ugi=vgarg ip=unknown-ip-addr > cmd=get_foreign_keys : parentdb=null parenttbl=null foreigndb=default > foreigntbl=test2 > 2019-10-17T22:44:50,025 INFO [812910d4-bc6a-450c-aa8b-3487b4edceab main] > HiveMetaStore.audit: ugi=vgarg ip=unknown-ip-addr > cmd=get_unique_constraints : tbl=hive.default.test2 > 2019-10-17T22:44:50,026 INFO [812910d4-bc6a-450c-aa8b-3487b4edceab main] > HiveMetaStore.audit: ugi=vgarg ip=unknown-ip-addr > cmd=get_not_null_constraints : tbl=hive.default.test2 > {code} -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Updated] (HIVE-22366) Multiple metastore calls for same table and constraints during planning
[ https://issues.apache.org/jira/browse/HIVE-22366?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vineet Garg updated HIVE-22366: --- Description: e.g. for a simple query like {code:sql} explain select count(i) from test2 group by j limit 3; {code} planner makes the following calls: {code} 2019-10-17T22:44:49,892 INFO [812910d4-bc6a-450c-aa8b-3487b4edceab main] HiveMetaStore.audit: ugi=vgargip=unknown-ip-addr cmd=get_table : tbl=hive.default.test2 2019-10-17T22:44:49,908 INFO [812910d4-bc6a-450c-aa8b-3487b4edceab main] HiveMetaStore.audit: ugi=vgargip=unknown-ip-addr cmd=get_primary_keys : tbl=hive.default.test2 2019-10-17T22:44:49,910 INFO [812910d4-bc6a-450c-aa8b-3487b4edceab main] HiveMetaStore.audit: ugi=vgargip=unknown-ip-addr cmd=get_foreign_keys : parentdb=null parenttbl=null foreigndb=default foreigntbl=test2 2019-10-17T22:44:49,911 INFO [812910d4-bc6a-450c-aa8b-3487b4edceab main] HiveMetaStore.audit: ugi=vgargip=unknown-ip-addr cmd=get_unique_constraints : tbl=hive.default.test2 2019-10-17T22:44:49,913 INFO [812910d4-bc6a-450c-aa8b-3487b4edceab main] HiveMetaStore.audit: ugi=vgargip=unknown-ip-addr cmd=get_not_null_constraints : tbl=hive.default.test2 2019-10-17T22:44:49,979 INFO [812910d4-bc6a-450c-aa8b-3487b4edceab main] HiveMetaStore.audit: ugi=vgargip=unknown-ip-addr cmd=get_partitions : tbl=hive.default.test2 2019-10-17T22:44:49,997 INFO [812910d4-bc6a-450c-aa8b-3487b4edceab main] HiveMetaStore.audit: ugi=vgargip=unknown-ip-addr cmd=get_aggr_stats_for: table=hive.default.test2 2019-10-17T22:44:50,014 INFO [812910d4-bc6a-450c-aa8b-3487b4edceab main] HiveMetaStore.audit: ugi=vgargip=unknown-ip-addr cmd=get_table : tbl=hive.default.test2 2019-10-17T22:44:50,023 INFO [812910d4-bc6a-450c-aa8b-3487b4edceab main] HiveMetaStore.audit: ugi=vgargip=unknown-ip-addr cmd=get_primary_keys : tbl=hive.default.test2 2019-10-17T22:44:50,024 INFO [812910d4-bc6a-450c-aa8b-3487b4edceab main] HiveMetaStore.audit: ugi=vgargip=unknown-ip-addr cmd=get_foreign_keys : parentdb=null parenttbl=null foreigndb=default foreigntbl=test2 2019-10-17T22:44:50,025 INFO [812910d4-bc6a-450c-aa8b-3487b4edceab main] HiveMetaStore.audit: ugi=vgargip=unknown-ip-addr cmd=get_unique_constraints : tbl=hive.default.test2 2019-10-17T22:44:50,026 INFO [812910d4-bc6a-450c-aa8b-3487b4edceab main] HiveMetaStore.audit: ugi=vgargip=unknown-ip-addr cmd=get_not_null_constraints : tbl=hive.default.test2 {code} > Multiple metastore calls for same table and constraints during planning > --- > > Key: HIVE-22366 > URL: https://issues.apache.org/jira/browse/HIVE-22366 > Project: Hive > Issue Type: Improvement > Components: Query Planning >Reporter: Vineet Garg >Assignee: Vineet Garg >Priority: Major > > e.g. for a simple query like > {code:sql} > explain select count(i) from test2 group by j limit 3; > {code} > planner makes the following calls: > {code} > 2019-10-17T22:44:49,892 INFO [812910d4-bc6a-450c-aa8b-3487b4edceab main] > HiveMetaStore.audit: ugi=vgarg ip=unknown-ip-addr cmd=get_table : > tbl=hive.default.test2 > 2019-10-17T22:44:49,908 INFO [812910d4-bc6a-450c-aa8b-3487b4edceab main] > HiveMetaStore.audit: ugi=vgarg ip=unknown-ip-addr > cmd=get_primary_keys : tbl=hive.default.test2 > 2019-10-17T22:44:49,910 INFO [812910d4-bc6a-450c-aa8b-3487b4edceab main] > HiveMetaStore.audit: ugi=vgarg ip=unknown-ip-addr > cmd=get_foreign_keys : parentdb=null parenttbl=null foreigndb=default > foreigntbl=test2 > 2019-10-17T22:44:49,911 INFO [812910d4-bc6a-450c-aa8b-3487b4edceab main] > HiveMetaStore.audit: ugi=vgarg ip=unknown-ip-addr > cmd=get_unique_constraints : tbl=hive.default.test2 > 2019-10-17T22:44:49,913 INFO [812910d4-bc6a-450c-aa8b-3487b4edceab main] > HiveMetaStore.audit: ugi=vgarg ip=unknown-ip-addr > cmd=get_not_null_constraints : tbl=hive.default.test2 > 2019-10-17T22:44:49,979 INFO [812910d4-bc6a-450c-aa8b-3487b4edceab main] > HiveMetaStore.audit: ugi=vgarg ip=unknown-ip-addr > cmd=get_partitions : tbl=hive.default.test2 > 2019-10-17T22:44:49,997 INFO [812910d4-bc6a-450c-aa8b-3487b4edceab main] > HiveMetaStore.audit: ugi=vgarg ip=unknown-ip-addr > cmd=get_aggr_stats_for: table=hive.default.test2 > 2019-10-17T22:44:50,014 INFO [812910d4-bc6a-450c-aa8b-3487b4edceab main] > HiveMetaStore.audit: ugi=vgarg ip=unknown-ip-addr cmd=get_table : > tbl=hive.default.test2 > 2019-10-17T22:44:50,023 INFO [812910d4-bc6a-450c-aa8b-3487b4edceab main] > HiveMetaStore.audit: ugi=vgarg ip=unknown-ip-addr > cmd=get_primary_keys :