[jira] [Updated] (HIVE-21948) Implement parallel processing in Pre Upgrade Tool
[ https://issues.apache.org/jira/browse/HIVE-21948?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jesus Camacho Rodriguez updated HIVE-21948: --- Resolution: Fixed Status: Resolved (was: Patch Available) Pushed to master, thanks [~kkasa]! > Implement parallel processing in Pre Upgrade Tool > - > > Key: HIVE-21948 > URL: https://issues.apache.org/jira/browse/HIVE-21948 > Project: Hive > Issue Type: Improvement > Components: Transactions >Affects Versions: 3.1.0 >Reporter: Krisztian Kasa >Assignee: Krisztian Kasa >Priority: Major > Fix For: 4.0.0 > > Attachments: HIVE-21948.1.patch, HIVE-21948.2.patch, > HIVE-21948.3.patch, HIVE-21948.4.patch, HIVE-21948.5.patch > > > Pre Upgrade Tool scans for all databases and tables in the warehouse > sequentially which can be very slow in case of lots of tables. > Example: It took the process 8-10 hours to complete on ~500k tables. -- This message was sent by Atlassian JIRA (v7.6.14#76016)
[jira] [Updated] (HIVE-21948) Implement parallel processing in Pre Upgrade Tool
[ https://issues.apache.org/jira/browse/HIVE-21948?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Krisztian Kasa updated HIVE-21948: -- Status: Open (was: Patch Available) > Implement parallel processing in Pre Upgrade Tool > - > > Key: HIVE-21948 > URL: https://issues.apache.org/jira/browse/HIVE-21948 > Project: Hive > Issue Type: Improvement > Components: Transactions >Affects Versions: 3.1.0 >Reporter: Krisztian Kasa >Assignee: Krisztian Kasa >Priority: Major > Fix For: 4.0.0 > > Attachments: HIVE-21948.1.patch, HIVE-21948.2.patch, > HIVE-21948.3.patch, HIVE-21948.4.patch, HIVE-21948.5.patch > > > Pre Upgrade Tool scans for all databases and tables in the warehouse > sequentially which can be very slow in case of lots of tables. > Example: It took the process 8-10 hours to complete on ~500k tables. -- This message was sent by Atlassian JIRA (v7.6.14#76016)
[jira] [Updated] (HIVE-21948) Implement parallel processing in Pre Upgrade Tool
[ https://issues.apache.org/jira/browse/HIVE-21948?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Krisztian Kasa updated HIVE-21948: -- Status: Patch Available (was: Open) > Implement parallel processing in Pre Upgrade Tool > - > > Key: HIVE-21948 > URL: https://issues.apache.org/jira/browse/HIVE-21948 > Project: Hive > Issue Type: Improvement > Components: Transactions >Affects Versions: 3.1.0 >Reporter: Krisztian Kasa >Assignee: Krisztian Kasa >Priority: Major > Fix For: 4.0.0 > > Attachments: HIVE-21948.1.patch, HIVE-21948.2.patch, > HIVE-21948.3.patch, HIVE-21948.4.patch, HIVE-21948.5.patch > > > Pre Upgrade Tool scans for all databases and tables in the warehouse > sequentially which can be very slow in case of lots of tables. > Example: It took the process 8-10 hours to complete on ~500k tables. -- This message was sent by Atlassian JIRA (v7.6.14#76016)
[jira] [Updated] (HIVE-21948) Implement parallel processing in Pre Upgrade Tool
[ https://issues.apache.org/jira/browse/HIVE-21948?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Krisztian Kasa updated HIVE-21948: -- Attachment: HIVE-21948.5.patch > Implement parallel processing in Pre Upgrade Tool > - > > Key: HIVE-21948 > URL: https://issues.apache.org/jira/browse/HIVE-21948 > Project: Hive > Issue Type: Improvement > Components: Transactions >Affects Versions: 3.1.0 >Reporter: Krisztian Kasa >Assignee: Krisztian Kasa >Priority: Major > Fix For: 4.0.0 > > Attachments: HIVE-21948.1.patch, HIVE-21948.2.patch, > HIVE-21948.3.patch, HIVE-21948.4.patch, HIVE-21948.5.patch > > > Pre Upgrade Tool scans for all databases and tables in the warehouse > sequentially which can be very slow in case of lots of tables. > Example: It took the process 8-10 hours to complete on ~500k tables. -- This message was sent by Atlassian JIRA (v7.6.14#76016)
[jira] [Updated] (HIVE-21948) Implement parallel processing in Pre Upgrade Tool
[ https://issues.apache.org/jira/browse/HIVE-21948?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Krisztian Kasa updated HIVE-21948: -- Status: Open (was: Patch Available) > Implement parallel processing in Pre Upgrade Tool > - > > Key: HIVE-21948 > URL: https://issues.apache.org/jira/browse/HIVE-21948 > Project: Hive > Issue Type: Improvement > Components: Transactions >Affects Versions: 3.1.0 >Reporter: Krisztian Kasa >Assignee: Krisztian Kasa >Priority: Major > Fix For: 4.0.0 > > Attachments: HIVE-21948.1.patch, HIVE-21948.2.patch, > HIVE-21948.3.patch, HIVE-21948.4.patch > > > Pre Upgrade Tool scans for all databases and tables in the warehouse > sequentially which can be very slow in case of lots of tables. > Example: It took the process 8-10 hours to complete on ~500k tables. -- This message was sent by Atlassian JIRA (v7.6.14#76016)
[jira] [Updated] (HIVE-21948) Implement parallel processing in Pre Upgrade Tool
[ https://issues.apache.org/jira/browse/HIVE-21948?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Krisztian Kasa updated HIVE-21948: -- Attachment: HIVE-21948.4.patch > Implement parallel processing in Pre Upgrade Tool > - > > Key: HIVE-21948 > URL: https://issues.apache.org/jira/browse/HIVE-21948 > Project: Hive > Issue Type: Improvement > Components: Transactions >Affects Versions: 3.1.0 >Reporter: Krisztian Kasa >Assignee: Krisztian Kasa >Priority: Major > Fix For: 4.0.0 > > Attachments: HIVE-21948.1.patch, HIVE-21948.2.patch, > HIVE-21948.3.patch, HIVE-21948.4.patch > > > Pre Upgrade Tool scans for all databases and tables in the warehouse > sequentially which can be very slow in case of lots of tables. > Example: It took the process 8-10 hours to complete on ~500k tables. -- This message was sent by Atlassian JIRA (v7.6.14#76016)
[jira] [Updated] (HIVE-21948) Implement parallel processing in Pre Upgrade Tool
[ https://issues.apache.org/jira/browse/HIVE-21948?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Krisztian Kasa updated HIVE-21948: -- Status: Patch Available (was: Open) > Implement parallel processing in Pre Upgrade Tool > - > > Key: HIVE-21948 > URL: https://issues.apache.org/jira/browse/HIVE-21948 > Project: Hive > Issue Type: Improvement > Components: Transactions >Affects Versions: 3.1.0 >Reporter: Krisztian Kasa >Assignee: Krisztian Kasa >Priority: Major > Fix For: 4.0.0 > > Attachments: HIVE-21948.1.patch, HIVE-21948.2.patch, > HIVE-21948.3.patch, HIVE-21948.4.patch > > > Pre Upgrade Tool scans for all databases and tables in the warehouse > sequentially which can be very slow in case of lots of tables. > Example: It took the process 8-10 hours to complete on ~500k tables. -- This message was sent by Atlassian JIRA (v7.6.14#76016)
[jira] [Updated] (HIVE-21948) Implement parallel processing in Pre Upgrade Tool
[ https://issues.apache.org/jira/browse/HIVE-21948?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Krisztian Kasa updated HIVE-21948: -- Attachment: HIVE-21948.3.patch > Implement parallel processing in Pre Upgrade Tool > - > > Key: HIVE-21948 > URL: https://issues.apache.org/jira/browse/HIVE-21948 > Project: Hive > Issue Type: Improvement > Components: Transactions >Affects Versions: 3.1.0 >Reporter: Krisztian Kasa >Assignee: Krisztian Kasa >Priority: Major > Fix For: 4.0.0 > > Attachments: HIVE-21948.1.patch, HIVE-21948.2.patch, > HIVE-21948.3.patch > > > Pre Upgrade Tool scans for all databases and tables in the warehouse > sequentially which can be very slow in case of lots of tables. > Example: It took the process 8-10 hours to complete on ~500k tables. -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Updated] (HIVE-21948) Implement parallel processing in Pre Upgrade Tool
[ https://issues.apache.org/jira/browse/HIVE-21948?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Krisztian Kasa updated HIVE-21948: -- Status: Patch Available (was: Open) > Implement parallel processing in Pre Upgrade Tool > - > > Key: HIVE-21948 > URL: https://issues.apache.org/jira/browse/HIVE-21948 > Project: Hive > Issue Type: Improvement > Components: Transactions >Affects Versions: 3.1.0 >Reporter: Krisztian Kasa >Assignee: Krisztian Kasa >Priority: Major > Fix For: 4.0.0 > > Attachments: HIVE-21948.1.patch, HIVE-21948.2.patch, > HIVE-21948.3.patch > > > Pre Upgrade Tool scans for all databases and tables in the warehouse > sequentially which can be very slow in case of lots of tables. > Example: It took the process 8-10 hours to complete on ~500k tables. -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Updated] (HIVE-21948) Implement parallel processing in Pre Upgrade Tool
[ https://issues.apache.org/jira/browse/HIVE-21948?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Krisztian Kasa updated HIVE-21948: -- Status: Open (was: Patch Available) > Implement parallel processing in Pre Upgrade Tool > - > > Key: HIVE-21948 > URL: https://issues.apache.org/jira/browse/HIVE-21948 > Project: Hive > Issue Type: Improvement > Components: Transactions >Affects Versions: 3.1.0 >Reporter: Krisztian Kasa >Assignee: Krisztian Kasa >Priority: Major > Fix For: 4.0.0 > > Attachments: HIVE-21948.1.patch, HIVE-21948.2.patch > > > Pre Upgrade Tool scans for all databases and tables in the warehouse > sequentially which can be very slow in case of lots of tables. > Example: It took the process 8-10 hours to complete on ~500k tables. -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Updated] (HIVE-21948) Implement parallel processing in Pre Upgrade Tool
[ https://issues.apache.org/jira/browse/HIVE-21948?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Krisztian Kasa updated HIVE-21948: -- Status: Patch Available (was: Open) > Implement parallel processing in Pre Upgrade Tool > - > > Key: HIVE-21948 > URL: https://issues.apache.org/jira/browse/HIVE-21948 > Project: Hive > Issue Type: Improvement > Components: Transactions >Affects Versions: 3.1.0 >Reporter: Krisztian Kasa >Assignee: Krisztian Kasa >Priority: Major > Fix For: 4.0.0 > > Attachments: HIVE-21948.1.patch, HIVE-21948.2.patch > > > Pre Upgrade Tool scans for all databases and tables in the warehouse > sequentially which can be very slow in case of lots of tables. > Example: It took the process 8-10 hours to complete on ~500k tables. -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Updated] (HIVE-21948) Implement parallel processing in Pre Upgrade Tool
[ https://issues.apache.org/jira/browse/HIVE-21948?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Krisztian Kasa updated HIVE-21948: -- Status: Open (was: Patch Available) > Implement parallel processing in Pre Upgrade Tool > - > > Key: HIVE-21948 > URL: https://issues.apache.org/jira/browse/HIVE-21948 > Project: Hive > Issue Type: Improvement > Components: Transactions >Affects Versions: 3.1.0 >Reporter: Krisztian Kasa >Assignee: Krisztian Kasa >Priority: Major > Fix For: 4.0.0 > > Attachments: HIVE-21948.1.patch, HIVE-21948.2.patch > > > Pre Upgrade Tool scans for all databases and tables in the warehouse > sequentially which can be very slow in case of lots of tables. > Example: It took the process 8-10 hours to complete on ~500k tables. -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Updated] (HIVE-21948) Implement parallel processing in Pre Upgrade Tool
[ https://issues.apache.org/jira/browse/HIVE-21948?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Krisztian Kasa updated HIVE-21948: -- Attachment: HIVE-21948.2.patch > Implement parallel processing in Pre Upgrade Tool > - > > Key: HIVE-21948 > URL: https://issues.apache.org/jira/browse/HIVE-21948 > Project: Hive > Issue Type: Improvement > Components: Transactions >Affects Versions: 3.1.0 >Reporter: Krisztian Kasa >Assignee: Krisztian Kasa >Priority: Major > Fix For: 4.0.0 > > Attachments: HIVE-21948.1.patch, HIVE-21948.2.patch > > > Pre Upgrade Tool scans for all databases and tables in the warehouse > sequentially which can be very slow in case of lots of tables. > Example: It took the process 8-10 hours to complete on ~500k tables. -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Updated] (HIVE-21948) Implement parallel processing in Pre Upgrade Tool
[ https://issues.apache.org/jira/browse/HIVE-21948?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Krisztian Kasa updated HIVE-21948: -- Summary: Implement parallel processing in Pre Upgrade Tool (was: Implement parallell processing in Pre Upgrade Tool) > Implement parallel processing in Pre Upgrade Tool > - > > Key: HIVE-21948 > URL: https://issues.apache.org/jira/browse/HIVE-21948 > Project: Hive > Issue Type: Improvement > Components: Transactions >Affects Versions: 3.1.0 >Reporter: Krisztian Kasa >Assignee: Krisztian Kasa >Priority: Major > Fix For: 4.0.0 > > Attachments: HIVE-21948.1.patch > > > Pre Upgrade Tool scans for all databases and tables in the warehouse > sequentially which can be very slow in case of lots of tables. > Example: It took the process 8-10 hours to complete on ~500k tables. -- This message was sent by Atlassian JIRA (v7.6.3#76005)