[jira] [Updated] (HIVE-21948) Implement parallel processing in Pre Upgrade Tool

2019-07-11 Thread Jesus Camacho Rodriguez (JIRA)


 [ 
https://issues.apache.org/jira/browse/HIVE-21948?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Jesus Camacho Rodriguez updated HIVE-21948:
---
Resolution: Fixed
Status: Resolved  (was: Patch Available)

Pushed to master, thanks [~kkasa]!

> Implement parallel processing in Pre Upgrade Tool
> -
>
> Key: HIVE-21948
> URL: https://issues.apache.org/jira/browse/HIVE-21948
> Project: Hive
>  Issue Type: Improvement
>  Components: Transactions
>Affects Versions: 3.1.0
>Reporter: Krisztian Kasa
>Assignee: Krisztian Kasa
>Priority: Major
> Fix For: 4.0.0
>
> Attachments: HIVE-21948.1.patch, HIVE-21948.2.patch, 
> HIVE-21948.3.patch, HIVE-21948.4.patch, HIVE-21948.5.patch
>
>
> Pre Upgrade Tool scans for all databases and tables in the warehouse 
> sequentially which can be very slow in case of lots of tables.
> Example: It took the process 8-10 hours to complete on ~500k tables.



--
This message was sent by Atlassian JIRA
(v7.6.14#76016)


[jira] [Updated] (HIVE-21948) Implement parallel processing in Pre Upgrade Tool

2019-07-11 Thread Krisztian Kasa (JIRA)


 [ 
https://issues.apache.org/jira/browse/HIVE-21948?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Krisztian Kasa updated HIVE-21948:
--
Status: Open  (was: Patch Available)

> Implement parallel processing in Pre Upgrade Tool
> -
>
> Key: HIVE-21948
> URL: https://issues.apache.org/jira/browse/HIVE-21948
> Project: Hive
>  Issue Type: Improvement
>  Components: Transactions
>Affects Versions: 3.1.0
>Reporter: Krisztian Kasa
>Assignee: Krisztian Kasa
>Priority: Major
> Fix For: 4.0.0
>
> Attachments: HIVE-21948.1.patch, HIVE-21948.2.patch, 
> HIVE-21948.3.patch, HIVE-21948.4.patch, HIVE-21948.5.patch
>
>
> Pre Upgrade Tool scans for all databases and tables in the warehouse 
> sequentially which can be very slow in case of lots of tables.
> Example: It took the process 8-10 hours to complete on ~500k tables.



--
This message was sent by Atlassian JIRA
(v7.6.14#76016)


[jira] [Updated] (HIVE-21948) Implement parallel processing in Pre Upgrade Tool

2019-07-11 Thread Krisztian Kasa (JIRA)


 [ 
https://issues.apache.org/jira/browse/HIVE-21948?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Krisztian Kasa updated HIVE-21948:
--
Status: Patch Available  (was: Open)

> Implement parallel processing in Pre Upgrade Tool
> -
>
> Key: HIVE-21948
> URL: https://issues.apache.org/jira/browse/HIVE-21948
> Project: Hive
>  Issue Type: Improvement
>  Components: Transactions
>Affects Versions: 3.1.0
>Reporter: Krisztian Kasa
>Assignee: Krisztian Kasa
>Priority: Major
> Fix For: 4.0.0
>
> Attachments: HIVE-21948.1.patch, HIVE-21948.2.patch, 
> HIVE-21948.3.patch, HIVE-21948.4.patch, HIVE-21948.5.patch
>
>
> Pre Upgrade Tool scans for all databases and tables in the warehouse 
> sequentially which can be very slow in case of lots of tables.
> Example: It took the process 8-10 hours to complete on ~500k tables.



--
This message was sent by Atlassian JIRA
(v7.6.14#76016)


[jira] [Updated] (HIVE-21948) Implement parallel processing in Pre Upgrade Tool

2019-07-11 Thread Krisztian Kasa (JIRA)


 [ 
https://issues.apache.org/jira/browse/HIVE-21948?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Krisztian Kasa updated HIVE-21948:
--
Attachment: HIVE-21948.5.patch

> Implement parallel processing in Pre Upgrade Tool
> -
>
> Key: HIVE-21948
> URL: https://issues.apache.org/jira/browse/HIVE-21948
> Project: Hive
>  Issue Type: Improvement
>  Components: Transactions
>Affects Versions: 3.1.0
>Reporter: Krisztian Kasa
>Assignee: Krisztian Kasa
>Priority: Major
> Fix For: 4.0.0
>
> Attachments: HIVE-21948.1.patch, HIVE-21948.2.patch, 
> HIVE-21948.3.patch, HIVE-21948.4.patch, HIVE-21948.5.patch
>
>
> Pre Upgrade Tool scans for all databases and tables in the warehouse 
> sequentially which can be very slow in case of lots of tables.
> Example: It took the process 8-10 hours to complete on ~500k tables.



--
This message was sent by Atlassian JIRA
(v7.6.14#76016)


[jira] [Updated] (HIVE-21948) Implement parallel processing in Pre Upgrade Tool

2019-07-11 Thread Krisztian Kasa (JIRA)


 [ 
https://issues.apache.org/jira/browse/HIVE-21948?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Krisztian Kasa updated HIVE-21948:
--
Status: Open  (was: Patch Available)

> Implement parallel processing in Pre Upgrade Tool
> -
>
> Key: HIVE-21948
> URL: https://issues.apache.org/jira/browse/HIVE-21948
> Project: Hive
>  Issue Type: Improvement
>  Components: Transactions
>Affects Versions: 3.1.0
>Reporter: Krisztian Kasa
>Assignee: Krisztian Kasa
>Priority: Major
> Fix For: 4.0.0
>
> Attachments: HIVE-21948.1.patch, HIVE-21948.2.patch, 
> HIVE-21948.3.patch, HIVE-21948.4.patch
>
>
> Pre Upgrade Tool scans for all databases and tables in the warehouse 
> sequentially which can be very slow in case of lots of tables.
> Example: It took the process 8-10 hours to complete on ~500k tables.



--
This message was sent by Atlassian JIRA
(v7.6.14#76016)


[jira] [Updated] (HIVE-21948) Implement parallel processing in Pre Upgrade Tool

2019-07-11 Thread Krisztian Kasa (JIRA)


 [ 
https://issues.apache.org/jira/browse/HIVE-21948?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Krisztian Kasa updated HIVE-21948:
--
Attachment: HIVE-21948.4.patch

> Implement parallel processing in Pre Upgrade Tool
> -
>
> Key: HIVE-21948
> URL: https://issues.apache.org/jira/browse/HIVE-21948
> Project: Hive
>  Issue Type: Improvement
>  Components: Transactions
>Affects Versions: 3.1.0
>Reporter: Krisztian Kasa
>Assignee: Krisztian Kasa
>Priority: Major
> Fix For: 4.0.0
>
> Attachments: HIVE-21948.1.patch, HIVE-21948.2.patch, 
> HIVE-21948.3.patch, HIVE-21948.4.patch
>
>
> Pre Upgrade Tool scans for all databases and tables in the warehouse 
> sequentially which can be very slow in case of lots of tables.
> Example: It took the process 8-10 hours to complete on ~500k tables.



--
This message was sent by Atlassian JIRA
(v7.6.14#76016)


[jira] [Updated] (HIVE-21948) Implement parallel processing in Pre Upgrade Tool

2019-07-11 Thread Krisztian Kasa (JIRA)


 [ 
https://issues.apache.org/jira/browse/HIVE-21948?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Krisztian Kasa updated HIVE-21948:
--
Status: Patch Available  (was: Open)

> Implement parallel processing in Pre Upgrade Tool
> -
>
> Key: HIVE-21948
> URL: https://issues.apache.org/jira/browse/HIVE-21948
> Project: Hive
>  Issue Type: Improvement
>  Components: Transactions
>Affects Versions: 3.1.0
>Reporter: Krisztian Kasa
>Assignee: Krisztian Kasa
>Priority: Major
> Fix For: 4.0.0
>
> Attachments: HIVE-21948.1.patch, HIVE-21948.2.patch, 
> HIVE-21948.3.patch, HIVE-21948.4.patch
>
>
> Pre Upgrade Tool scans for all databases and tables in the warehouse 
> sequentially which can be very slow in case of lots of tables.
> Example: It took the process 8-10 hours to complete on ~500k tables.



--
This message was sent by Atlassian JIRA
(v7.6.14#76016)


[jira] [Updated] (HIVE-21948) Implement parallel processing in Pre Upgrade Tool

2019-07-10 Thread Krisztian Kasa (JIRA)


 [ 
https://issues.apache.org/jira/browse/HIVE-21948?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Krisztian Kasa updated HIVE-21948:
--
Attachment: HIVE-21948.3.patch

> Implement parallel processing in Pre Upgrade Tool
> -
>
> Key: HIVE-21948
> URL: https://issues.apache.org/jira/browse/HIVE-21948
> Project: Hive
>  Issue Type: Improvement
>  Components: Transactions
>Affects Versions: 3.1.0
>Reporter: Krisztian Kasa
>Assignee: Krisztian Kasa
>Priority: Major
> Fix For: 4.0.0
>
> Attachments: HIVE-21948.1.patch, HIVE-21948.2.patch, 
> HIVE-21948.3.patch
>
>
> Pre Upgrade Tool scans for all databases and tables in the warehouse 
> sequentially which can be very slow in case of lots of tables.
> Example: It took the process 8-10 hours to complete on ~500k tables.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)


[jira] [Updated] (HIVE-21948) Implement parallel processing in Pre Upgrade Tool

2019-07-10 Thread Krisztian Kasa (JIRA)


 [ 
https://issues.apache.org/jira/browse/HIVE-21948?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Krisztian Kasa updated HIVE-21948:
--
Status: Patch Available  (was: Open)

> Implement parallel processing in Pre Upgrade Tool
> -
>
> Key: HIVE-21948
> URL: https://issues.apache.org/jira/browse/HIVE-21948
> Project: Hive
>  Issue Type: Improvement
>  Components: Transactions
>Affects Versions: 3.1.0
>Reporter: Krisztian Kasa
>Assignee: Krisztian Kasa
>Priority: Major
> Fix For: 4.0.0
>
> Attachments: HIVE-21948.1.patch, HIVE-21948.2.patch, 
> HIVE-21948.3.patch
>
>
> Pre Upgrade Tool scans for all databases and tables in the warehouse 
> sequentially which can be very slow in case of lots of tables.
> Example: It took the process 8-10 hours to complete on ~500k tables.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)


[jira] [Updated] (HIVE-21948) Implement parallel processing in Pre Upgrade Tool

2019-07-10 Thread Krisztian Kasa (JIRA)


 [ 
https://issues.apache.org/jira/browse/HIVE-21948?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Krisztian Kasa updated HIVE-21948:
--
Status: Open  (was: Patch Available)

> Implement parallel processing in Pre Upgrade Tool
> -
>
> Key: HIVE-21948
> URL: https://issues.apache.org/jira/browse/HIVE-21948
> Project: Hive
>  Issue Type: Improvement
>  Components: Transactions
>Affects Versions: 3.1.0
>Reporter: Krisztian Kasa
>Assignee: Krisztian Kasa
>Priority: Major
> Fix For: 4.0.0
>
> Attachments: HIVE-21948.1.patch, HIVE-21948.2.patch
>
>
> Pre Upgrade Tool scans for all databases and tables in the warehouse 
> sequentially which can be very slow in case of lots of tables.
> Example: It took the process 8-10 hours to complete on ~500k tables.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)


[jira] [Updated] (HIVE-21948) Implement parallel processing in Pre Upgrade Tool

2019-07-10 Thread Krisztian Kasa (JIRA)


 [ 
https://issues.apache.org/jira/browse/HIVE-21948?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Krisztian Kasa updated HIVE-21948:
--
Status: Patch Available  (was: Open)

> Implement parallel processing in Pre Upgrade Tool
> -
>
> Key: HIVE-21948
> URL: https://issues.apache.org/jira/browse/HIVE-21948
> Project: Hive
>  Issue Type: Improvement
>  Components: Transactions
>Affects Versions: 3.1.0
>Reporter: Krisztian Kasa
>Assignee: Krisztian Kasa
>Priority: Major
> Fix For: 4.0.0
>
> Attachments: HIVE-21948.1.patch, HIVE-21948.2.patch
>
>
> Pre Upgrade Tool scans for all databases and tables in the warehouse 
> sequentially which can be very slow in case of lots of tables.
> Example: It took the process 8-10 hours to complete on ~500k tables.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)


[jira] [Updated] (HIVE-21948) Implement parallel processing in Pre Upgrade Tool

2019-07-10 Thread Krisztian Kasa (JIRA)


 [ 
https://issues.apache.org/jira/browse/HIVE-21948?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Krisztian Kasa updated HIVE-21948:
--
Status: Open  (was: Patch Available)

> Implement parallel processing in Pre Upgrade Tool
> -
>
> Key: HIVE-21948
> URL: https://issues.apache.org/jira/browse/HIVE-21948
> Project: Hive
>  Issue Type: Improvement
>  Components: Transactions
>Affects Versions: 3.1.0
>Reporter: Krisztian Kasa
>Assignee: Krisztian Kasa
>Priority: Major
> Fix For: 4.0.0
>
> Attachments: HIVE-21948.1.patch, HIVE-21948.2.patch
>
>
> Pre Upgrade Tool scans for all databases and tables in the warehouse 
> sequentially which can be very slow in case of lots of tables.
> Example: It took the process 8-10 hours to complete on ~500k tables.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)


[jira] [Updated] (HIVE-21948) Implement parallel processing in Pre Upgrade Tool

2019-07-10 Thread Krisztian Kasa (JIRA)


 [ 
https://issues.apache.org/jira/browse/HIVE-21948?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Krisztian Kasa updated HIVE-21948:
--
Attachment: HIVE-21948.2.patch

> Implement parallel processing in Pre Upgrade Tool
> -
>
> Key: HIVE-21948
> URL: https://issues.apache.org/jira/browse/HIVE-21948
> Project: Hive
>  Issue Type: Improvement
>  Components: Transactions
>Affects Versions: 3.1.0
>Reporter: Krisztian Kasa
>Assignee: Krisztian Kasa
>Priority: Major
> Fix For: 4.0.0
>
> Attachments: HIVE-21948.1.patch, HIVE-21948.2.patch
>
>
> Pre Upgrade Tool scans for all databases and tables in the warehouse 
> sequentially which can be very slow in case of lots of tables.
> Example: It took the process 8-10 hours to complete on ~500k tables.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)


[jira] [Updated] (HIVE-21948) Implement parallel processing in Pre Upgrade Tool

2019-07-08 Thread Krisztian Kasa (JIRA)


 [ 
https://issues.apache.org/jira/browse/HIVE-21948?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Krisztian Kasa updated HIVE-21948:
--
Summary: Implement parallel processing in Pre Upgrade Tool  (was: Implement 
parallell processing in Pre Upgrade Tool)

> Implement parallel processing in Pre Upgrade Tool
> -
>
> Key: HIVE-21948
> URL: https://issues.apache.org/jira/browse/HIVE-21948
> Project: Hive
>  Issue Type: Improvement
>  Components: Transactions
>Affects Versions: 3.1.0
>Reporter: Krisztian Kasa
>Assignee: Krisztian Kasa
>Priority: Major
> Fix For: 4.0.0
>
> Attachments: HIVE-21948.1.patch
>
>
> Pre Upgrade Tool scans for all databases and tables in the warehouse 
> sequentially which can be very slow in case of lots of tables.
> Example: It took the process 8-10 hours to complete on ~500k tables.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)