[jira] [Assigned] (HIVE-18741) Add support for Import into Acid table

2018-02-16 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18741?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman reassigned HIVE-18741: - > Add support for Import into Acid table > -- > >

[jira] [Assigned] (HIVE-18740) Add support for Export from partitioned Acid table

2018-02-16 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18740?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman reassigned HIVE-18740: - > Add support for Export from partitioned Acid table >

[jira] [Assigned] (HIVE-18739) Add support for Export from unpartitioned Acid table

2018-02-16 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18739?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman reassigned HIVE-18739: - > Add support for Export from unpartitioned Acid table >

[jira] [Updated] (HIVE-18735) Create table like loses transactional attribute

2018-02-16 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18735?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman updated HIVE-18735: -- Description: {noformat} create table T1(a int, b int) clustered by (a) into 2 buckets stored as

[jira] [Updated] (HIVE-18735) Create table like loses transactional attribute

2018-02-16 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18735?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman updated HIVE-18735: -- Description: {noformat} create table T1(a int, b int) clustered by (a) into 2 buckets stored as

[jira] [Updated] (HIVE-18735) Create table like loses transactional attribute

2018-02-16 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18735?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman updated HIVE-18735: -- Description: {noformat} create table T1(a int, b int) clustered by (a) into 2 buckets stored as

[jira] [Commented] (HIVE-18712) Design HMS Api v2

2018-02-16 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18712?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16367679#comment-16367679 ] Eugene Koifman commented on HIVE-18712: --- +1 for consistent use of Request/Response objects Thirft

[jira] [Commented] (HIVE-18685) Add catalogs to metastore

2018-02-16 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18685?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16367665#comment-16367665 ] Eugene Koifman commented on HIVE-18685: --- {quote}9. It is not yet determined what types of cross

[jira] [Commented] (HIVE-18693) Snapshot Isolation does not work for Micromanaged table when a insert transaction is aborted

2018-02-15 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18693?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16366513#comment-16366513 ] Eugene Koifman commented on HIVE-18693: --- this won't enqueue any compaction requests so CompactorMR

[jira] [Commented] (HIVE-18693) Snapshot Isolation does not work for Micromanaged table when a insert transaction is aborted

2018-02-15 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18693?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16366352#comment-16366352 ] Eugene Koifman commented on HIVE-18693: --- Suppose you have 200 txns all of which committed (with this

[jira] [Commented] (HIVE-15077) Acid LockManager is unfair

2018-02-15 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-15077?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16366255#comment-16366255 ] Eugene Koifman commented on HIVE-15077: --- no related failures [~alangates] could you review please >

[jira] [Updated] (HIVE-18659) add acid version marker to acid files/directories

2018-02-15 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18659?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman updated HIVE-18659: -- Attachment: HIVE-18659.06.patch > add acid version marker to acid files/directories >

[jira] [Updated] (HIVE-18659) add acid version marker to acid files/directories

2018-02-14 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18659?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman updated HIVE-18659: -- Attachment: HIVE-18659.05.patch > add acid version marker to acid files/directories >

[jira] [Updated] (HIVE-15077) Acid LockManager is unfair

2018-02-14 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-15077?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman updated HIVE-15077: -- Affects Version/s: 2.3.0 Status: Patch Available (was: Open) > Acid LockManager

[jira] [Updated] (HIVE-15077) Acid LockManager is unfair

2018-02-14 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-15077?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman updated HIVE-15077: -- Attachment: HIVE-15077.02.patch > Acid LockManager is unfair > -- > >

[jira] [Updated] (HIVE-15077) Acid LockManager is unfair

2018-02-14 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-15077?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman updated HIVE-15077: -- Description: HIVE-10242 made the acid LM unfair. In TxnHandler.checkLock(), suppose we are

[jira] [Resolved] (HIVE-16964) _orc_acid_version file is missing

2018-02-14 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-16964?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman resolved HIVE-16964. --- Resolution: Fixed Fix Version/s: 3.0.0 included in HIVE-18659 > _orc_acid_version

[jira] [Updated] (HIVE-18659) add acid version marker to acid files/directories

2018-02-14 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18659?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman updated HIVE-18659: -- Summary: add acid version marker to acid files/directories (was: add acid version marker to

[jira] [Updated] (HIVE-18659) add acid version marker to acid files

2018-02-13 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18659?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman updated HIVE-18659: -- Attachment: HIVE-18659.04.patch > add acid version marker to acid files >

[jira] [Assigned] (HIVE-18709) Enable Compaction to work on more than one partition per job

2018-02-13 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18709?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman reassigned HIVE-18709: - > Enable Compaction to work on more than one partition per job >

[jira] [Updated] (HIVE-18689) restore inheritPerms functionality and extend it to ACID

2018-02-13 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18689?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman updated HIVE-18689: -- Component/s: Transactions > restore inheritPerms functionality and extend it to ACID >

[jira] [Commented] (HIVE-18700) qtests: authorization_update_own_table.q breaks row__id.q

2018-02-13 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18700?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16362691#comment-16362691 ] Eugene Koifman commented on HIVE-18700: --- [~kgyrtkirk] can you add details please? > qtests:

[jira] [Commented] (HIVE-18659) add acid version marker to acid files

2018-02-12 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18659?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16361500#comment-16361500 ] Eugene Koifman commented on HIVE-18659: --- it's already linked > add acid version marker to acid

[jira] [Comment Edited] (HIVE-16964) _orc_acid_version file is missing

2018-02-12 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-16964?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16361477#comment-16361477 ] Eugene Koifman edited comment on HIVE-16964 at 2/12/18 9:34 PM: This is

[jira] [Commented] (HIVE-16964) _orc_acid_version file is missing

2018-02-12 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-16964?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16361477#comment-16361477 ] Eugene Koifman commented on HIVE-16964: --- This is the layout that {{Hive.moveAcidFiles()}} sees. It

[jira] [Reopened] (HIVE-16964) _orc_acid_version file is missing

2018-02-12 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-16964?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman reopened HIVE-16964: --- Assignee: Eugene Koifman (was: Steve Yeom) > _orc_acid_version file is missing >

[jira] [Commented] (HIVE-18659) add acid version marker to acid files

2018-02-12 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18659?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16361463#comment-16361463 ] Eugene Koifman commented on HIVE-18659: --- _orc_acid_version is not written consistently. in fact is't

[jira] [Commented] (HIVE-18678) fix exim for MM tables and reinstante the test

2018-02-12 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18678?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16361212#comment-16361212 ] Eugene Koifman commented on HIVE-18678: --- +1 > fix exim for MM tables and reinstante the test >

[jira] [Commented] (HIVE-18575) ACID properties usage in jobconf is ambiguous for MM tables

2018-02-12 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18575?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16361182#comment-16361182 ] Eugene Koifman commented on HIVE-18575: --- +1 I left a couple nits on RB > ACID properties usage in

[jira] [Updated] (HIVE-15077) Acid LockManager is unfair

2018-02-09 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-15077?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman updated HIVE-15077: -- Description: HIVE-10242 made the acid LM unfair. In TxnHandler.checkLock(), suppose we are

[jira] [Commented] (HIVE-17284) remove OrcRecordUpdater.deleteEventIndexBuilder

2018-02-09 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17284?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16358915#comment-16358915 ] Eugene Koifman commented on HIVE-17284: --- this may not be the right thing to do.  ORC flattens

[jira] [Comment Edited] (HIVE-17284) remove OrcRecordUpdater.deleteEventIndexBuilder

2018-02-09 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17284?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16358915#comment-16358915 ] Eugene Koifman edited comment on HIVE-17284 at 2/9/18 8:31 PM: --- this may not

[jira] [Updated] (HIVE-18662) hive.acid.key.index is missing entries

2018-02-08 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18662?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman updated HIVE-18662: -- Description: OrcRecordUpdater.KeyIndexBuilder stores an index in ORC footer where each entry

[jira] [Commented] (HIVE-18659) add acid version marker to acid files

2018-02-08 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18659?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16357756#comment-16357756 ] Eugene Koifman commented on HIVE-18659: --- [~prasanth_j] could you review please > add acid version

[jira] [Updated] (HIVE-18659) add acid version marker to acid files

2018-02-08 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18659?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman updated HIVE-18659: -- Attachment: HIVE-18659.01.patch > add acid version marker to acid files >

[jira] [Updated] (HIVE-18659) add acid version marker to acid files

2018-02-08 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18659?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman updated HIVE-18659: -- Status: Patch Available (was: Open) > add acid version marker to acid files >

[jira] [Assigned] (HIVE-18659) add acid version marker to acid files

2018-02-08 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18659?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman reassigned HIVE-18659: - > add acid version marker to acid files > - > >

[jira] [Updated] (HIVE-17284) remove OrcRecordUpdater.deleteEventIndexBuilder

2018-02-08 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17284?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman updated HIVE-17284: -- Description: There is no point in it. We know how many rows a delete_delta file has from ORC

[jira] [Updated] (HIVE-18636) fix TestTxnNoBuckets.testCTAS - keeps failing on ptest

2018-02-07 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18636?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman updated HIVE-18636: -- Resolution: Fixed Status: Resolved (was: Patch Available) committed to master thanks

[jira] [Updated] (HIVE-18649) HiveInputFormat job conf object lifecycle is unclear or broken

2018-02-07 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18649?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman updated HIVE-18649: -- Component/s: Transactions > HiveInputFormat job conf object lifecycle is unclear or broken >

[jira] [Commented] (HIVE-18619) Verification of temporary Micromanaged table atomicity is needed

2018-02-07 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18619?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16355950#comment-16355950 ] Eugene Koifman commented on HIVE-18619: --- to test this in UT you can use

[jira] [Issue Comment Deleted] (HIVE-18575) ACID properties usage in jobconf is ambiguous for MM tables

2018-02-07 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18575?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman updated HIVE-18575: -- Comment: was deleted (was: what was the point of renaming isAcid to isFullAcid?  {{isAcid}} was

[jira] [Commented] (HIVE-18575) ACID properties usage in jobconf is ambiguous for MM tables

2018-02-07 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18575?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16355929#comment-16355929 ] Eugene Koifman commented on HIVE-18575: --- made some comments on RB > ACID properties usage in

[jira] [Updated] (HIVE-18636) fix TestTxnNoBuckets.testCTAS - keeps failing on ptest

2018-02-06 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18636?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman updated HIVE-18636: -- Status: Patch Available (was: Open) [~sershe] could you review please > fix

[jira] [Updated] (HIVE-18636) fix TestTxnNoBuckets.testCTAS - keeps failing on ptest

2018-02-06 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18636?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman updated HIVE-18636: -- Attachment: HIVE-18636.01.patch > fix TestTxnNoBuckets.testCTAS - keeps failing on ptest >

[jira] [Commented] (HIVE-18643) don't check for archived partitions for ACID ops

2018-02-06 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18643?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16354840#comment-16354840 ] Eugene Koifman commented on HIVE-18643: --- +1 > don't check for archived partitions for ACID ops >

[jira] [Updated] (HIVE-18636) fix TestTxnNoBuckets.testCTAS - keeps failing on ptest

2018-02-06 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18636?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman updated HIVE-18636: -- Priority: Blocker (was: Major) > fix TestTxnNoBuckets.testCTAS - keeps failing on ptest >

[jira] [Assigned] (HIVE-18636) fix TestTxnNoBuckets.testCTAS - keeps failing on ptest

2018-02-06 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18636?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman reassigned HIVE-18636: - Assignee: Eugene Koifman > fix TestTxnNoBuckets.testCTAS - keeps failing on ptest >

[jira] [Commented] (HIVE-18575) ACID properties usage in jobconf is ambiguous for MM tables

2018-02-06 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18575?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16354201#comment-16354201 ] Eugene Koifman commented on HIVE-18575: --- what was the point of renaming isAcid to isFullAcid? 

[jira] [Commented] (HIVE-16605) Enforce NOT NULL constraints

2018-02-05 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-16605?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16352863#comment-16352863 ] Eugene Koifman commented on HIVE-16605: --- merge_constraint_notnull.q sets 

[jira] [Commented] (HIVE-18575) ACID properties usage in jobconf is ambiguous for MM tables

2018-02-05 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18575?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16352769#comment-16352769 ] Eugene Koifman commented on HIVE-18575: --- I left some comments on RB.  Mostly, I think the change in 

[jira] [Commented] (HIVE-18128) Setting AcidUtils.setTransactionalTableScan in HiveInputFormat causes downstream errors

2018-02-05 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18128?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16352746#comment-16352746 ] Eugene Koifman commented on HIVE-18128: --- fixed in HIVE-18575? > Setting

[jira] [Updated] (HIVE-18575) ACID properties usage in jobconf is ambiguous for MM tables

2018-02-05 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18575?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman updated HIVE-18575: -- Component/s: Transactions > ACID properties usage in jobconf is ambiguous for MM tables >

[jira] [Updated] (HIVE-18589) java.io.IOException: Not enough history available

2018-02-02 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18589?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman updated HIVE-18589: -- Resolution: Fixed Fix Version/s: 3.0.0 Status: Resolved (was: Patch

[jira] [Resolved] (HIVE-18125) Support arbitrary file names in input to Load Data

2018-02-02 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18125?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman resolved HIVE-18125. --- Resolution: Fixed Fix Version/s: 3.0.0 fixed via HIVE-18516 > Support arbitrary file

[jira] [Updated] (HIVE-18221) test acid default

2018-02-02 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18221?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman updated HIVE-18221: -- Status: Open (was: Patch Available) > test acid default > - > >

[jira] [Updated] (HIVE-18606) CTAS on empty table throws NPE from org.apache.hadoop.hive.ql.exec.MoveTask

2018-02-02 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18606?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman updated HIVE-18606: -- Resolution: Fixed Fix Version/s: 3.0.0 Release Note: N/A Status: Resolved

[jira] [Commented] (HIVE-18516) load data should rename files consistent with insert statements for ACID Tables

2018-02-02 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18516?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16350945#comment-16350945 ] Eugene Koifman commented on HIVE-18516: --- +1 > load data should rename files consistent with insert

[jira] [Updated] (HIVE-18606) CTAS on empty table throws NPE from org.apache.hadoop.hive.ql.exec.MoveTask

2018-02-02 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18606?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman updated HIVE-18606: -- Attachment: HIVE-18606.03.patch > CTAS on empty table throws NPE from

[jira] [Commented] (HIVE-18606) CTAS on empty table throws NPE from org.apache.hadoop.hive.ql.exec.MoveTask

2018-02-01 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18606?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16349633#comment-16349633 ] Eugene Koifman commented on HIVE-18606: --- yes, you are right.  fixed in patch2 > CTAS on empty table

[jira] [Updated] (HIVE-18606) CTAS on empty table throws NPE from org.apache.hadoop.hive.ql.exec.MoveTask

2018-02-01 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18606?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman updated HIVE-18606: -- Attachment: HIVE-18606.02.patch > CTAS on empty table throws NPE from

[jira] [Commented] (HIVE-18606) CTAS on empty table throws NPE from org.apache.hadoop.hive.ql.exec.MoveTask

2018-02-01 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18606?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16349627#comment-16349627 ] Eugene Koifman commented on HIVE-18606: --- [~sershe] could you review please > CTAS on empty table

[jira] [Updated] (HIVE-18606) CTAS on empty table throws NPE from org.apache.hadoop.hive.ql.exec.MoveTask

2018-02-01 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18606?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman updated HIVE-18606: -- Status: Patch Available (was: Open) > CTAS on empty table throws NPE from

[jira] [Updated] (HIVE-18606) CTAS on empty table throws NPE from org.apache.hadoop.hive.ql.exec.MoveTask

2018-02-01 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18606?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman updated HIVE-18606: -- Attachment: HIVE-18606.01.patch > CTAS on empty table throws NPE from

[jira] [Updated] (HIVE-18606) CTAS on empty table throws NPE from org.apache.hadoop.hive.ql.exec.MoveTask

2018-02-01 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18606?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman updated HIVE-18606: -- Component/s: Transactions > CTAS on empty table throws NPE from

[jira] [Assigned] (HIVE-18606) CTAS on empty table throws NPE from org.apache.hadoop.hive.ql.exec.MoveTask

2018-02-01 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18606?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman reassigned HIVE-18606: - Assignee: Eugene Koifman > CTAS on empty table throws NPE from

[jira] [Commented] (HIVE-18589) java.io.IOException: Not enough history available

2018-02-01 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18589?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16348899#comment-16348899 ] Eugene Koifman commented on HIVE-18589: --- no related failures [~gopalv] could you review please >

[jira] [Updated] (HIVE-18589) java.io.IOException: Not enough history available

2018-01-31 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18589?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman updated HIVE-18589: -- Attachment: HIVE-18589.02.patch > java.io.IOException: Not enough history available >

[jira] [Updated] (HIVE-18589) java.io.IOException: Not enough history available

2018-01-31 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18589?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman updated HIVE-18589: -- Description: txnid:17 starts reading T2/P1 txnid:20 does insert overwrite T1/P1, creates

[jira] [Commented] (HIVE-18536) IOW + DP is broken for insert-only ACID

2018-01-31 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18536?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16347618#comment-16347618 ] Eugene Koifman commented on HIVE-18536: --- +1 > IOW + DP is broken for insert-only ACID >

[jira] [Comment Edited] (HIVE-18536) IOW + DP is broken for insert-only ACID

2018-01-31 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18536?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16347577#comment-16347577 ] Eugene Koifman edited comment on HIVE-18536 at 1/31/18 8:39 PM: I was

[jira] [Commented] (HIVE-18536) IOW + DP is broken for insert-only ACID

2018-01-31 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18536?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16347577#comment-16347577 ] Eugene Koifman commented on HIVE-18536: --- I was asking about "Boolean baseDir" param on RB.  why is

[jira] [Updated] (HIVE-18592) DP insert on insert only table causes StatTask to fail

2018-01-31 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18592?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman updated HIVE-18592: -- Component/s: Transactions > DP insert on insert only table causes StatTask to fail >

[jira] [Updated] (HIVE-18589) java.io.IOException: Not enough history available

2018-01-30 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18589?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman updated HIVE-18589: -- Attachment: HIVE-18589.01.patch > java.io.IOException: Not enough history available >

[jira] [Updated] (HIVE-18589) java.io.IOException: Not enough history available

2018-01-30 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18589?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman updated HIVE-18589: -- Status: Patch Available (was: Open) > java.io.IOException: Not enough history available >

[jira] [Assigned] (HIVE-18589) java.io.IOException: Not enough history available

2018-01-30 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18589?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman reassigned HIVE-18589: - > java.io.IOException: Not enough history available >

[jira] [Updated] (HIVE-18577) SemanticAnalyzer.validate has some pointless metastore calls

2018-01-30 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18577?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman updated HIVE-18577: -- Component/s: Transactions > SemanticAnalyzer.validate has some pointless metastore calls >

[jira] [Commented] (HIVE-18536) IOW + DP is broken for insert-only ACID

2018-01-29 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18536?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16344354#comment-16344354 ] Eugene Koifman commented on HIVE-18536: --- I imagine AcidUtils can just as well be in common > IOW +

[jira] [Comment Edited] (HIVE-18575) ACID properties usage in jobconf is ambiguous for MM tables

2018-01-29 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18575?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16344129#comment-16344129 ] Eugene Koifman edited comment on HIVE-18575 at 1/29/18 10:36 PM: -  

[jira] [Commented] (HIVE-18575) ACID properties usage in jobconf is ambiguous for MM tables

2018-01-29 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18575?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16344129#comment-16344129 ] Eugene Koifman commented on HIVE-18575: ---   hive.acid.table.scan and  TABLE_IS_TRANSACTIONAL =

[jira] [Commented] (HIVE-18536) IOW + DP is broken for insert-only ACID

2018-01-29 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18536?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16343649#comment-16343649 ] Eugene Koifman commented on HIVE-18536: --- I left 1 comment on RB. The code to create/parse

[jira] [Updated] (HIVE-18126) IOW Mechanics of multiple commands with OVERWRITE in a singe transactions

2018-01-26 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18126?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman updated HIVE-18126: -- Summary: IOW Mechanics of multiple commands with OVERWRITE in a singe transactions (was:

[jira] [Updated] (HIVE-17457) IOW Acid Insert Overwrite when the transaction fails

2018-01-26 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17457?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman updated HIVE-17457: -- Summary: IOW Acid Insert Overwrite when the transaction fails (was: Acid Insert Overwrite when

[jira] [Updated] (HIVE-18154) IOW Acid Load Data/Insert with Overwrite in multi statement transactions

2018-01-26 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18154?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman updated HIVE-18154: -- Summary: IOW Acid Load Data/Insert with Overwrite in multi statement transactions (was: Acid

[jira] [Updated] (HIVE-18157) Vectorization : Insert in bucketed table is broken with vectorization

2018-01-24 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18157?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman updated HIVE-18157: -- Component/s: Vectorization Transactions > Vectorization : Insert in bucketed

[jira] [Commented] (HIVE-18192) Introduce WriteID per table rather than using global transaction ID

2018-01-24 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18192?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16338208#comment-16338208 ] Eugene Koifman commented on HIVE-18192: --- Suppose A is the set of all ValidTxnList across all active

[jira] [Commented] (HIVE-18519) do not create materialized CTEs with ACID/MM

2018-01-23 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18519?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16336844#comment-16336844 ] Eugene Koifman commented on HIVE-18519: --- +1 pending tests > do not create materialized CTEs with

[jira] [Updated] (HIVE-18519) do not create materialized CTEs with ACID/MM

2018-01-23 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18519?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman updated HIVE-18519: -- Component/s: Transactions > do not create materialized CTEs with ACID/MM >

[jira] [Assigned] (HIVE-18520) add current txnid to ValidTxnList

2018-01-23 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18520?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman reassigned HIVE-18520: - > add current txnid to ValidTxnList > - > >

[jira] [Updated] (HIVE-15658) hive.ql.session.SessionState start() is not atomic, SessionState thread local variable can get into inconsistent state

2018-01-23 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-15658?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman updated HIVE-15658: -- Component/s: Transactions > hive.ql.session.SessionState start() is not atomic, SessionState

[jira] [Commented] (HIVE-18504) Hive is throwing InvalidObjectException(message:Invalid column type name is too long.

2018-01-22 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18504?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16334702#comment-16334702 ] Eugene Koifman commented on HIVE-18504: --- 2.6.3 looks like HDP version > Hive is throwing

[jira] [Commented] (HIVE-18503) MM/ACID tables: make tests that will never be compatible with acid use non-txn tables explicitly

2018-01-19 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18503?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16333133#comment-16333133 ] Eugene Koifman commented on HIVE-18503: --- linking HIVE-18315 for completeness - it did a bunch of

[jira] [Updated] (HIVE-18502) base_-9223372036854775808 is confusing

2018-01-19 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18502?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman updated HIVE-18502: -- Component/s: Transactions > base_-9223372036854775808 is confusing >

[jira] [Updated] (HIVE-18192) Introduce WriteID per table rather than using global transaction ID

2018-01-18 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18192?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman updated HIVE-18192: -- Description: To support ACID replication, we will be introducing a per table write Id which

[jira] [Updated] (HIVE-18460) Compactor doesn't pass Table properties to the Orc writer

2018-01-18 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18460?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman updated HIVE-18460: -- Resolution: Fixed Status: Resolved (was: Patch Available) > Compactor doesn't pass

[jira] [Commented] (HIVE-18460) Compactor doesn't pass Table properties to the Orc writer

2018-01-18 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18460?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16330801#comment-16330801 ] Eugene Koifman commented on HIVE-18460: --- no related failures committed to master thanks Prasanth

[jira] [Updated] (HIVE-18460) Compactor doesn't pass Table properties to the Orc writer

2018-01-17 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18460?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman updated HIVE-18460: -- Status: Patch Available (was: Open) > Compactor doesn't pass Table properties to the Orc

[jira] [Updated] (HIVE-18460) Compactor doesn't pass Table properties to the Orc writer

2018-01-17 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18460?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman updated HIVE-18460: -- Attachment: HIVE-18460.04.patch > Compactor doesn't pass Table properties to the Orc writer >

[jira] [Updated] (HIVE-18460) Compactor doesn't pass Table properties to the Orc writer

2018-01-17 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18460?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman updated HIVE-18460: -- Status: Open (was: Patch Available) > Compactor doesn't pass Table properties to the Orc

[jira] [Updated] (HIVE-18460) Compactor doesn't pass Table properties to the Orc writer

2018-01-17 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18460?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman updated HIVE-18460: -- Attachment: HIVE-18460.03.patch > Compactor doesn't pass Table properties to the Orc writer >

<    9   10   11   12   13   14   15   16   17   18   >