[jira] [Updated] (HIVE-18907) Create utility to fix acid key index issue from HIVE-18817

2018-03-12 Thread Jason Dere (JIRA)

 [ 
https://issues.apache.org/jira/browse/HIVE-18907?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Jason Dere updated HIVE-18907:
--
Component/s: ORC

> Create utility to fix acid key index issue from HIVE-18817
> --
>
> Key: HIVE-18907
> URL: https://issues.apache.org/jira/browse/HIVE-18907
> Project: Hive
>  Issue Type: Bug
>  Components: ORC, Transactions
>Reporter: Jason Dere
>Assignee: Jason Dere
>Priority: Major
> Fix For: 3.0.0
>
> Attachments: HIVE-18907.1.patch, HIVE-18907.2.patch, 
> HIVE-18907.3.patch
>
>
> While HIVE-18817 will create new ORC Acid files from hitting the 
> ArrayIndexOutOfBounds issue, existing files created before HIVE-18817 will 
> still cause this issue. If there are delta directories then one way to 
> generate new files is to perform a major compaction. But this does not work 
> if there are no delta directories for the table/partition.
> Add a tool to fix the Acid ORC files directly in the case that a compaction 
> cannot be performed.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)


[jira] [Updated] (HIVE-18907) Create utility to fix acid key index issue from HIVE-18817

2018-03-12 Thread Eugene Koifman (JIRA)

 [ 
https://issues.apache.org/jira/browse/HIVE-18907?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Eugene Koifman updated HIVE-18907:
--
Component/s: Transactions

> Create utility to fix acid key index issue from HIVE-18817
> --
>
> Key: HIVE-18907
> URL: https://issues.apache.org/jira/browse/HIVE-18907
> Project: Hive
>  Issue Type: Bug
>  Components: Transactions
>Reporter: Jason Dere
>Assignee: Jason Dere
>Priority: Major
> Fix For: 3.0.0
>
> Attachments: HIVE-18907.1.patch, HIVE-18907.2.patch, 
> HIVE-18907.3.patch
>
>
> While HIVE-18817 will create new ORC Acid files from hitting the 
> ArrayIndexOutOfBounds issue, existing files created before HIVE-18817 will 
> still cause this issue. If there are delta directories then one way to 
> generate new files is to perform a major compaction. But this does not work 
> if there are no delta directories for the table/partition.
> Add a tool to fix the Acid ORC files directly in the case that a compaction 
> cannot be performed.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)


[jira] [Updated] (HIVE-18907) Create utility to fix acid key index issue from HIVE-18817

2018-03-12 Thread Jason Dere (JIRA)

 [ 
https://issues.apache.org/jira/browse/HIVE-18907?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Jason Dere updated HIVE-18907:
--
   Resolution: Fixed
Fix Version/s: 3.0.0
   Status: Resolved  (was: Patch Available)

> Create utility to fix acid key index issue from HIVE-18817
> --
>
> Key: HIVE-18907
> URL: https://issues.apache.org/jira/browse/HIVE-18907
> Project: Hive
>  Issue Type: Bug
>Reporter: Jason Dere
>Assignee: Jason Dere
>Priority: Major
> Fix For: 3.0.0
>
> Attachments: HIVE-18907.1.patch, HIVE-18907.2.patch, 
> HIVE-18907.3.patch
>
>
> While HIVE-18817 will create new ORC Acid files from hitting the 
> ArrayIndexOutOfBounds issue, existing files created before HIVE-18817 will 
> still cause this issue. If there are delta directories then one way to 
> generate new files is to perform a major compaction. But this does not work 
> if there are no delta directories for the table/partition.
> Add a tool to fix the Acid ORC files directly in the case that a compaction 
> cannot be performed.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)


[jira] [Updated] (HIVE-18907) Create utility to fix acid key index issue from HIVE-18817

2018-03-08 Thread Jason Dere (JIRA)

 [ 
https://issues.apache.org/jira/browse/HIVE-18907?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Jason Dere updated HIVE-18907:
--
Attachment: HIVE-18907.3.patch

> Create utility to fix acid key index issue from HIVE-18817
> --
>
> Key: HIVE-18907
> URL: https://issues.apache.org/jira/browse/HIVE-18907
> Project: Hive
>  Issue Type: Bug
>Reporter: Jason Dere
>Assignee: Jason Dere
>Priority: Major
> Attachments: HIVE-18907.1.patch, HIVE-18907.2.patch, 
> HIVE-18907.3.patch
>
>
> While HIVE-18817 will create new ORC Acid files from hitting the 
> ArrayIndexOutOfBounds issue, existing files created before HIVE-18817 will 
> still cause this issue. If there are delta directories then one way to 
> generate new files is to perform a major compaction. But this does not work 
> if there are no delta directories for the table/partition.
> Add a tool to fix the Acid ORC files directly in the case that a compaction 
> cannot be performed.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)


[jira] [Updated] (HIVE-18907) Create utility to fix acid key index issue from HIVE-18817

2018-03-08 Thread Jason Dere (JIRA)

 [ 
https://issues.apache.org/jira/browse/HIVE-18907?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Jason Dere updated HIVE-18907:
--
Attachment: HIVE-18907.2.patch

> Create utility to fix acid key index issue from HIVE-18817
> --
>
> Key: HIVE-18907
> URL: https://issues.apache.org/jira/browse/HIVE-18907
> Project: Hive
>  Issue Type: Bug
>Reporter: Jason Dere
>Assignee: Jason Dere
>Priority: Major
> Attachments: HIVE-18907.1.patch, HIVE-18907.2.patch
>
>
> While HIVE-18817 will create new ORC Acid files from hitting the 
> ArrayIndexOutOfBounds issue, existing files created before HIVE-18817 will 
> still cause this issue. If there are delta directories then one way to 
> generate new files is to perform a major compaction. But this does not work 
> if there are no delta directories for the table/partition.
> Add a tool to fix the Acid ORC files directly in the case that a compaction 
> cannot be performed.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)


[jira] [Updated] (HIVE-18907) Create utility to fix acid key index issue from HIVE-18817

2018-03-08 Thread Jason Dere (JIRA)

 [ 
https://issues.apache.org/jira/browse/HIVE-18907?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Jason Dere updated HIVE-18907:
--
Status: Patch Available  (was: Open)

> Create utility to fix acid key index issue from HIVE-18817
> --
>
> Key: HIVE-18907
> URL: https://issues.apache.org/jira/browse/HIVE-18907
> Project: Hive
>  Issue Type: Bug
>Reporter: Jason Dere
>Assignee: Jason Dere
>Priority: Major
> Attachments: HIVE-18907.1.patch
>
>
> While HIVE-18817 will create new ORC Acid files from hitting the 
> ArrayIndexOutOfBounds issue, existing files created before HIVE-18817 will 
> still cause this issue. If there are delta directories then one way to 
> generate new files is to perform a major compaction. But this does not work 
> if there are no delta directories for the table/partition.
> Add a tool to fix the Acid ORC files directly in the case that a compaction 
> cannot be performed.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)


[jira] [Updated] (HIVE-18907) Create utility to fix acid key index issue from HIVE-18817

2018-03-08 Thread Jason Dere (JIRA)

 [ 
https://issues.apache.org/jira/browse/HIVE-18907?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Jason Dere updated HIVE-18907:
--
Attachment: HIVE-18907.1.patch

> Create utility to fix acid key index issue from HIVE-18817
> --
>
> Key: HIVE-18907
> URL: https://issues.apache.org/jira/browse/HIVE-18907
> Project: Hive
>  Issue Type: Bug
>Reporter: Jason Dere
>Assignee: Jason Dere
>Priority: Major
> Attachments: HIVE-18907.1.patch
>
>
> While HIVE-18817 will create new ORC Acid files from hitting the 
> ArrayIndexOutOfBounds issue, existing files created before HIVE-18817 will 
> still cause this issue. If there are delta directories then one way to 
> generate new files is to perform a major compaction. But this does not work 
> if there are no delta directories for the table/partition.
> Add a tool to fix the Acid ORC files directly in the case that a compaction 
> cannot be performed.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)