[jira] [Updated] (HIVE-17824) msck repair table should drop the missing partitions from metastore
[ https://issues.apache.org/jira/browse/HIVE-17824?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Janaki Lahorani updated HIVE-17824: --- Attachment: (was: HIVE-17824.01-branch-2.patch) > msck repair table should drop the missing partitions from metastore > --- > > Key: HIVE-17824 > URL: https://issues.apache.org/jira/browse/HIVE-17824 > Project: Hive > Issue Type: Improvement >Reporter: Vihang Karajgaonkar >Assignee: Janaki Lahorani >Priority: Major > Fix For: 3.0.0, 2.4.0, 3.1.0 > > Attachments: HIVE-17824-branch-2.01.patch, > HIVE-17824.01-branch-2.patch, HIVE-17824.1.patch, HIVE-17824.2.patch, > HIVE-17824.3.patch, HIVE-17824.4.patch > > > {{msck repair table }} is often used in environments where the new > partitions are loaded as directories on HDFS or S3 and users want to create > the missing partitions in bulk. However, currently it only supports addition > of missing partitions. If there are any partitions which are present in > metastore but not on the FileSystem, it should also delete them so that it > truly repairs the table metadata. > We should be careful not to break backwards compatibility so we should either > introduce a new config or keyword to add support to delete unnecessary > partitions from the metastore. This way users who want the old behavior can > easily turn it off. -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Updated] (HIVE-17824) msck repair table should drop the missing partitions from metastore
[ https://issues.apache.org/jira/browse/HIVE-17824?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Janaki Lahorani updated HIVE-17824: --- Attachment: (was: HIVE-17824.01-branch-2.patch) > msck repair table should drop the missing partitions from metastore > --- > > Key: HIVE-17824 > URL: https://issues.apache.org/jira/browse/HIVE-17824 > Project: Hive > Issue Type: Improvement >Reporter: Vihang Karajgaonkar >Assignee: Janaki Lahorani >Priority: Major > Fix For: 3.0.0, 2.4.0, 3.1.0 > > Attachments: HIVE-17824-branch-2.01.patch, > HIVE-17824.01-branch-2.patch, HIVE-17824.1.patch, HIVE-17824.2.patch, > HIVE-17824.3.patch, HIVE-17824.4.patch > > > {{msck repair table }} is often used in environments where the new > partitions are loaded as directories on HDFS or S3 and users want to create > the missing partitions in bulk. However, currently it only supports addition > of missing partitions. If there are any partitions which are present in > metastore but not on the FileSystem, it should also delete them so that it > truly repairs the table metadata. > We should be careful not to break backwards compatibility so we should either > introduce a new config or keyword to add support to delete unnecessary > partitions from the metastore. This way users who want the old behavior can > easily turn it off. -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Updated] (HIVE-17824) msck repair table should drop the missing partitions from metastore
[ https://issues.apache.org/jira/browse/HIVE-17824?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vihang Karajgaonkar updated HIVE-17824: --- Resolution: Fixed Fix Version/s: 2.4.0 Status: Resolved (was: Patch Available) > msck repair table should drop the missing partitions from metastore > --- > > Key: HIVE-17824 > URL: https://issues.apache.org/jira/browse/HIVE-17824 > Project: Hive > Issue Type: Improvement >Reporter: Vihang Karajgaonkar >Assignee: Janaki Lahorani >Priority: Major > Fix For: 3.0.0, 2.4.0, 3.1.0 > > Attachments: HIVE-17824-branch-2.01.patch, > HIVE-17824.01-branch-2.patch, HIVE-17824.01-branch-2.patch, > HIVE-17824.01-branch-2.patch, HIVE-17824.1.patch, HIVE-17824.2.patch, > HIVE-17824.3.patch, HIVE-17824.4.patch > > > {{msck repair table }} is often used in environments where the new > partitions are loaded as directories on HDFS or S3 and users want to create > the missing partitions in bulk. However, currently it only supports addition > of missing partitions. If there are any partitions which are present in > metastore but not on the FileSystem, it should also delete them so that it > truly repairs the table metadata. > We should be careful not to break backwards compatibility so we should either > introduce a new config or keyword to add support to delete unnecessary > partitions from the metastore. This way users who want the old behavior can > easily turn it off. -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Updated] (HIVE-17824) msck repair table should drop the missing partitions from metastore
[ https://issues.apache.org/jira/browse/HIVE-17824?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Janaki Lahorani updated HIVE-17824: --- Attachment: HIVE-17824.01-branch-2.patch > msck repair table should drop the missing partitions from metastore > --- > > Key: HIVE-17824 > URL: https://issues.apache.org/jira/browse/HIVE-17824 > Project: Hive > Issue Type: Improvement >Reporter: Vihang Karajgaonkar >Assignee: Janaki Lahorani >Priority: Major > Fix For: 3.0.0, 3.1.0 > > Attachments: HIVE-17824-branch-2.01.patch, > HIVE-17824.01-branch-2.patch, HIVE-17824.01-branch-2.patch, > HIVE-17824.01-branch-2.patch, HIVE-17824.1.patch, HIVE-17824.2.patch, > HIVE-17824.3.patch, HIVE-17824.4.patch > > > {{msck repair table }} is often used in environments where the new > partitions are loaded as directories on HDFS or S3 and users want to create > the missing partitions in bulk. However, currently it only supports addition > of missing partitions. If there are any partitions which are present in > metastore but not on the FileSystem, it should also delete them so that it > truly repairs the table metadata. > We should be careful not to break backwards compatibility so we should either > introduce a new config or keyword to add support to delete unnecessary > partitions from the metastore. This way users who want the old behavior can > easily turn it off. -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Updated] (HIVE-17824) msck repair table should drop the missing partitions from metastore
[ https://issues.apache.org/jira/browse/HIVE-17824?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Janaki Lahorani updated HIVE-17824: --- Attachment: HIVE-17824.01-branch-2.patch > msck repair table should drop the missing partitions from metastore > --- > > Key: HIVE-17824 > URL: https://issues.apache.org/jira/browse/HIVE-17824 > Project: Hive > Issue Type: Improvement >Reporter: Vihang Karajgaonkar >Assignee: Janaki Lahorani >Priority: Major > Fix For: 3.0.0, 3.1.0 > > Attachments: HIVE-17824-branch-2.01.patch, > HIVE-17824.01-branch-2.patch, HIVE-17824.01-branch-2.patch, > HIVE-17824.1.patch, HIVE-17824.2.patch, HIVE-17824.3.patch, HIVE-17824.4.patch > > > {{msck repair table }} is often used in environments where the new > partitions are loaded as directories on HDFS or S3 and users want to create > the missing partitions in bulk. However, currently it only supports addition > of missing partitions. If there are any partitions which are present in > metastore but not on the FileSystem, it should also delete them so that it > truly repairs the table metadata. > We should be careful not to break backwards compatibility so we should either > introduce a new config or keyword to add support to delete unnecessary > partitions from the metastore. This way users who want the old behavior can > easily turn it off. -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Updated] (HIVE-17824) msck repair table should drop the missing partitions from metastore
[ https://issues.apache.org/jira/browse/HIVE-17824?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Janaki Lahorani updated HIVE-17824: --- Attachment: (was: HIVE-17824-branch-2.01.patch) > msck repair table should drop the missing partitions from metastore > --- > > Key: HIVE-17824 > URL: https://issues.apache.org/jira/browse/HIVE-17824 > Project: Hive > Issue Type: Improvement >Reporter: Vihang Karajgaonkar >Assignee: Janaki Lahorani >Priority: Major > Fix For: 3.0.0, 3.1.0 > > Attachments: HIVE-17824-branch-2.01.patch, > HIVE-17824.01-branch-2.patch, HIVE-17824.1.patch, HIVE-17824.2.patch, > HIVE-17824.3.patch, HIVE-17824.4.patch > > > {{msck repair table }} is often used in environments where the new > partitions are loaded as directories on HDFS or S3 and users want to create > the missing partitions in bulk. However, currently it only supports addition > of missing partitions. If there are any partitions which are present in > metastore but not on the FileSystem, it should also delete them so that it > truly repairs the table metadata. > We should be careful not to break backwards compatibility so we should either > introduce a new config or keyword to add support to delete unnecessary > partitions from the metastore. This way users who want the old behavior can > easily turn it off. -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Updated] (HIVE-17824) msck repair table should drop the missing partitions from metastore
[ https://issues.apache.org/jira/browse/HIVE-17824?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Janaki Lahorani updated HIVE-17824: --- Attachment: (was: HIVE-17824-branch-2.01.patch) > msck repair table should drop the missing partitions from metastore > --- > > Key: HIVE-17824 > URL: https://issues.apache.org/jira/browse/HIVE-17824 > Project: Hive > Issue Type: Improvement >Reporter: Vihang Karajgaonkar >Assignee: Janaki Lahorani >Priority: Major > Fix For: 3.0.0, 3.1.0 > > Attachments: HIVE-17824-branch-2.01.patch, > HIVE-17824.01-branch-2.patch, HIVE-17824.1.patch, HIVE-17824.2.patch, > HIVE-17824.3.patch, HIVE-17824.4.patch > > > {{msck repair table }} is often used in environments where the new > partitions are loaded as directories on HDFS or S3 and users want to create > the missing partitions in bulk. However, currently it only supports addition > of missing partitions. If there are any partitions which are present in > metastore but not on the FileSystem, it should also delete them so that it > truly repairs the table metadata. > We should be careful not to break backwards compatibility so we should either > introduce a new config or keyword to add support to delete unnecessary > partitions from the metastore. This way users who want the old behavior can > easily turn it off. -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Updated] (HIVE-17824) msck repair table should drop the missing partitions from metastore
[ https://issues.apache.org/jira/browse/HIVE-17824?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Janaki Lahorani updated HIVE-17824: --- Attachment: HIVE-17824.01-branch-2.patch > msck repair table should drop the missing partitions from metastore > --- > > Key: HIVE-17824 > URL: https://issues.apache.org/jira/browse/HIVE-17824 > Project: Hive > Issue Type: Improvement >Reporter: Vihang Karajgaonkar >Assignee: Janaki Lahorani >Priority: Major > Fix For: 3.0.0, 3.1.0 > > Attachments: HIVE-17824-branch-2.01.patch, > HIVE-17824.01-branch-2.patch, HIVE-17824.1.patch, HIVE-17824.2.patch, > HIVE-17824.3.patch, HIVE-17824.4.patch > > > {{msck repair table }} is often used in environments where the new > partitions are loaded as directories on HDFS or S3 and users want to create > the missing partitions in bulk. However, currently it only supports addition > of missing partitions. If there are any partitions which are present in > metastore but not on the FileSystem, it should also delete them so that it > truly repairs the table metadata. > We should be careful not to break backwards compatibility so we should either > introduce a new config or keyword to add support to delete unnecessary > partitions from the metastore. This way users who want the old behavior can > easily turn it off. -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Updated] (HIVE-17824) msck repair table should drop the missing partitions from metastore
[ https://issues.apache.org/jira/browse/HIVE-17824?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Janaki Lahorani updated HIVE-17824: --- Attachment: HIVE-17824-branch-2.01.patch > msck repair table should drop the missing partitions from metastore > --- > > Key: HIVE-17824 > URL: https://issues.apache.org/jira/browse/HIVE-17824 > Project: Hive > Issue Type: Improvement >Reporter: Vihang Karajgaonkar >Assignee: Janaki Lahorani >Priority: Major > Fix For: 3.0.0, 3.1.0 > > Attachments: HIVE-17824-branch-2.01.patch, > HIVE-17824-branch-2.01.patch, HIVE-17824-branch-2.01.patch, > HIVE-17824.1.patch, HIVE-17824.2.patch, HIVE-17824.3.patch, HIVE-17824.4.patch > > > {{msck repair table }} is often used in environments where the new > partitions are loaded as directories on HDFS or S3 and users want to create > the missing partitions in bulk. However, currently it only supports addition > of missing partitions. If there are any partitions which are present in > metastore but not on the FileSystem, it should also delete them so that it > truly repairs the table metadata. > We should be careful not to break backwards compatibility so we should either > introduce a new config or keyword to add support to delete unnecessary > partitions from the metastore. This way users who want the old behavior can > easily turn it off. -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Updated] (HIVE-17824) msck repair table should drop the missing partitions from metastore
[ https://issues.apache.org/jira/browse/HIVE-17824?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Janaki Lahorani updated HIVE-17824: --- Attachment: HIVE-17824-branch-2.01.patch > msck repair table should drop the missing partitions from metastore > --- > > Key: HIVE-17824 > URL: https://issues.apache.org/jira/browse/HIVE-17824 > Project: Hive > Issue Type: Improvement >Reporter: Vihang Karajgaonkar >Assignee: Janaki Lahorani >Priority: Major > Fix For: 3.0.0, 3.1.0 > > Attachments: HIVE-17824-branch-2.01.patch, > HIVE-17824-branch-2.01.patch, HIVE-17824.1.patch, HIVE-17824.2.patch, > HIVE-17824.3.patch, HIVE-17824.4.patch > > > {{msck repair table }} is often used in environments where the new > partitions are loaded as directories on HDFS or S3 and users want to create > the missing partitions in bulk. However, currently it only supports addition > of missing partitions. If there are any partitions which are present in > metastore but not on the FileSystem, it should also delete them so that it > truly repairs the table metadata. > We should be careful not to break backwards compatibility so we should either > introduce a new config or keyword to add support to delete unnecessary > partitions from the metastore. This way users who want the old behavior can > easily turn it off. -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Updated] (HIVE-17824) msck repair table should drop the missing partitions from metastore
[ https://issues.apache.org/jira/browse/HIVE-17824?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Janaki Lahorani updated HIVE-17824: --- Attachment: HIVE-17824-branch-2.01.patch > msck repair table should drop the missing partitions from metastore > --- > > Key: HIVE-17824 > URL: https://issues.apache.org/jira/browse/HIVE-17824 > Project: Hive > Issue Type: Improvement >Reporter: Vihang Karajgaonkar >Assignee: Janaki Lahorani >Priority: Major > Fix For: 3.0.0, 3.1.0 > > Attachments: HIVE-17824-branch-2.01.patch, HIVE-17824.1.patch, > HIVE-17824.2.patch, HIVE-17824.3.patch, HIVE-17824.4.patch > > > {{msck repair table }} is often used in environments where the new > partitions are loaded as directories on HDFS or S3 and users want to create > the missing partitions in bulk. However, currently it only supports addition > of missing partitions. If there are any partitions which are present in > metastore but not on the FileSystem, it should also delete them so that it > truly repairs the table metadata. > We should be careful not to break backwards compatibility so we should either > introduce a new config or keyword to add support to delete unnecessary > partitions from the metastore. This way users who want the old behavior can > easily turn it off. -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Updated] (HIVE-17824) msck repair table should drop the missing partitions from metastore
[ https://issues.apache.org/jira/browse/HIVE-17824?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vihang Karajgaonkar updated HIVE-17824: --- Fix Version/s: 3.1.0 3.0.0 > msck repair table should drop the missing partitions from metastore > --- > > Key: HIVE-17824 > URL: https://issues.apache.org/jira/browse/HIVE-17824 > Project: Hive > Issue Type: Improvement >Reporter: Vihang Karajgaonkar >Assignee: Janaki Lahorani >Priority: Major > Fix For: 3.0.0, 3.1.0 > > Attachments: HIVE-17824.1.patch, HIVE-17824.2.patch, > HIVE-17824.3.patch, HIVE-17824.4.patch > > > {{msck repair table }} is often used in environments where the new > partitions are loaded as directories on HDFS or S3 and users want to create > the missing partitions in bulk. However, currently it only supports addition > of missing partitions. If there are any partitions which are present in > metastore but not on the FileSystem, it should also delete them so that it > truly repairs the table metadata. > We should be careful not to break backwards compatibility so we should either > introduce a new config or keyword to add support to delete unnecessary > partitions from the metastore. This way users who want the old behavior can > easily turn it off. -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Updated] (HIVE-17824) msck repair table should drop the missing partitions from metastore
[ https://issues.apache.org/jira/browse/HIVE-17824?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Janaki Lahorani updated HIVE-17824: --- Attachment: HIVE-17824.4.patch > msck repair table should drop the missing partitions from metastore > --- > > Key: HIVE-17824 > URL: https://issues.apache.org/jira/browse/HIVE-17824 > Project: Hive > Issue Type: Improvement >Reporter: Vihang Karajgaonkar >Assignee: Janaki Lahorani >Priority: Major > Attachments: HIVE-17824.1.patch, HIVE-17824.2.patch, > HIVE-17824.3.patch, HIVE-17824.4.patch > > > {{msck repair table }} is often used in environments where the new > partitions are loaded as directories on HDFS or S3 and users want to create > the missing partitions in bulk. However, currently it only supports addition > of missing partitions. If there are any partitions which are present in > metastore but not on the FileSystem, it should also delete them so that it > truly repairs the table metadata. > We should be careful not to break backwards compatibility so we should either > introduce a new config or keyword to add support to delete unnecessary > partitions from the metastore. This way users who want the old behavior can > easily turn it off. -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Updated] (HIVE-17824) msck repair table should drop the missing partitions from metastore
[ https://issues.apache.org/jira/browse/HIVE-17824?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Janaki Lahorani updated HIVE-17824: --- Attachment: HIVE-17824.3.patch > msck repair table should drop the missing partitions from metastore > --- > > Key: HIVE-17824 > URL: https://issues.apache.org/jira/browse/HIVE-17824 > Project: Hive > Issue Type: Improvement >Reporter: Vihang Karajgaonkar >Assignee: Janaki Lahorani >Priority: Major > Attachments: HIVE-17824.1.patch, HIVE-17824.2.patch, > HIVE-17824.3.patch > > > {{msck repair table }} is often used in environments where the new > partitions are loaded as directories on HDFS or S3 and users want to create > the missing partitions in bulk. However, currently it only supports addition > of missing partitions. If there are any partitions which are present in > metastore but not on the FileSystem, it should also delete them so that it > truly repairs the table metadata. > We should be careful not to break backwards compatibility so we should either > introduce a new config or keyword to add support to delete unnecessary > partitions from the metastore. This way users who want the old behavior can > easily turn it off. -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Updated] (HIVE-17824) msck repair table should drop the missing partitions from metastore
[ https://issues.apache.org/jira/browse/HIVE-17824?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Janaki Lahorani updated HIVE-17824: --- Attachment: HIVE-17824.2.patch > msck repair table should drop the missing partitions from metastore > --- > > Key: HIVE-17824 > URL: https://issues.apache.org/jira/browse/HIVE-17824 > Project: Hive > Issue Type: Improvement >Reporter: Vihang Karajgaonkar >Assignee: Janaki Lahorani >Priority: Major > Attachments: HIVE-17824.1.patch, HIVE-17824.2.patch > > > {{msck repair table }} is often used in environments where the new > partitions are loaded as directories on HDFS or S3 and users want to create > the missing partitions in bulk. However, currently it only supports addition > of missing partitions. If there are any partitions which are present in > metastore but not on the FileSystem, it should also delete them so that it > truly repairs the table metadata. > We should be careful not to break backwards compatibility so we should either > introduce a new config or keyword to add support to delete unnecessary > partitions from the metastore. This way users who want the old behavior can > easily turn it off. -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Updated] (HIVE-17824) msck repair table should drop the missing partitions from metastore
[ https://issues.apache.org/jira/browse/HIVE-17824?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Janaki Lahorani updated HIVE-17824: --- Attachment: (was: HIVE-17824.1.patch) > msck repair table should drop the missing partitions from metastore > --- > > Key: HIVE-17824 > URL: https://issues.apache.org/jira/browse/HIVE-17824 > Project: Hive > Issue Type: Improvement >Reporter: Vihang Karajgaonkar >Assignee: Janaki Lahorani >Priority: Major > Attachments: HIVE-17824.1.patch, HIVE-17824.2.patch > > > {{msck repair table }} is often used in environments where the new > partitions are loaded as directories on HDFS or S3 and users want to create > the missing partitions in bulk. However, currently it only supports addition > of missing partitions. If there are any partitions which are present in > metastore but not on the FileSystem, it should also delete them so that it > truly repairs the table metadata. > We should be careful not to break backwards compatibility so we should either > introduce a new config or keyword to add support to delete unnecessary > partitions from the metastore. This way users who want the old behavior can > easily turn it off. -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Updated] (HIVE-17824) msck repair table should drop the missing partitions from metastore
[ https://issues.apache.org/jira/browse/HIVE-17824?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Janaki Lahorani updated HIVE-17824: --- Attachment: HIVE-17824.1.patch > msck repair table should drop the missing partitions from metastore > --- > > Key: HIVE-17824 > URL: https://issues.apache.org/jira/browse/HIVE-17824 > Project: Hive > Issue Type: Improvement >Reporter: Vihang Karajgaonkar >Assignee: Janaki Lahorani >Priority: Major > Attachments: HIVE-17824.1.patch, HIVE-17824.1.patch > > > {{msck repair table }} is often used in environments where the new > partitions are loaded as directories on HDFS or S3 and users want to create > the missing partitions in bulk. However, currently it only supports addition > of missing partitions. If there are any partitions which are present in > metastore but not on the FileSystem, it should also delete them so that it > truly repairs the table metadata. > We should be careful not to break backwards compatibility so we should either > introduce a new config or keyword to add support to delete unnecessary > partitions from the metastore. This way users who want the old behavior can > easily turn it off. -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Updated] (HIVE-17824) msck repair table should drop the missing partitions from metastore
[ https://issues.apache.org/jira/browse/HIVE-17824?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Janaki Lahorani updated HIVE-17824: --- Attachment: HIVE-17824.1.patch > msck repair table should drop the missing partitions from metastore > --- > > Key: HIVE-17824 > URL: https://issues.apache.org/jira/browse/HIVE-17824 > Project: Hive > Issue Type: Improvement >Reporter: Vihang Karajgaonkar >Assignee: Janaki Lahorani >Priority: Major > Attachments: HIVE-17824.1.patch > > > {{msck repair table }} is often used in environments where the new > partitions are loaded as directories on HDFS or S3 and users want to create > the missing partitions in bulk. However, currently it only supports addition > of missing partitions. If there are any partitions which are present in > metastore but not on the FileSystem, it should also delete them so that it > truly repairs the table metadata. > We should be careful not to break backwards compatibility so we should either > introduce a new config or keyword to add support to delete unnecessary > partitions from the metastore. This way users who want the old behavior can > easily turn it off. -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Updated] (HIVE-17824) msck repair table should drop the missing partitions from metastore
[ https://issues.apache.org/jira/browse/HIVE-17824?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Janaki Lahorani updated HIVE-17824: --- Status: Patch Available (was: Open) > msck repair table should drop the missing partitions from metastore > --- > > Key: HIVE-17824 > URL: https://issues.apache.org/jira/browse/HIVE-17824 > Project: Hive > Issue Type: Improvement >Reporter: Vihang Karajgaonkar >Assignee: Janaki Lahorani >Priority: Major > Attachments: HIVE-17824.1.patch > > > {{msck repair table }} is often used in environments where the new > partitions are loaded as directories on HDFS or S3 and users want to create > the missing partitions in bulk. However, currently it only supports addition > of missing partitions. If there are any partitions which are present in > metastore but not on the FileSystem, it should also delete them so that it > truly repairs the table metadata. > We should be careful not to break backwards compatibility so we should either > introduce a new config or keyword to add support to delete unnecessary > partitions from the metastore. This way users who want the old behavior can > easily turn it off. -- This message was sent by Atlassian JIRA (v7.6.3#76005)