[jira] [Commented] (HIVE-17066) Query78 filter wrong estimatation is generating bad plan

2017-07-11 Thread Hive QA (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17066?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16083377#comment-16083377 ] Hive QA commented on HIVE-17066: Here are the results of testing the latest attachment:

[jira] [Commented] (HIVE-16907) "INSERT INTO" overwrite old data when destination table encapsulated by backquote

2017-07-11 Thread Rui Li (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-16907?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16083356#comment-16083356 ] Rui Li commented on HIVE-16907: --- I think we should firstly decide whether we allow "dot" in table names. I

[jira] [Commented] (HIVE-16922) Typo in serde.thrift: COLLECTION_DELIM = "colelction.delim"

2017-07-11 Thread Rui Li (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-16922?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16083365#comment-16083365 ] Rui Li commented on HIVE-16922: --- I'm +1 to fix the typo, though it needs to be marked as "breaking" change.

[jira] [Updated] (HIVE-16975) Vectorization: Fully vectorize CAST date as TIMESTAMP so VectorUDFAdaptor is now used

2017-07-11 Thread Teddy Choi (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-16975?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Teddy Choi updated HIVE-16975: -- Attachment: HIVE-16975.1.patch > Vectorization: Fully vectorize CAST date as TIMESTAMP so

[jira] [Assigned] (HIVE-16975) Vectorization: Fully vectorize CAST date as TIMESTAMP so VectorUDFAdaptor is now used

2017-07-11 Thread Teddy Choi (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-16975?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Teddy Choi reassigned HIVE-16975: - Assignee: Teddy Choi > Vectorization: Fully vectorize CAST date as TIMESTAMP so VectorUDFAdaptor

[jira] [Commented] (HIVE-17063) insert overwrite partition onto a external table fail when drop partition first

2017-07-11 Thread Wang Haihua (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17063?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16083357#comment-16083357 ] Wang Haihua commented on HIVE-17063: Fix some test error, now seems failed test result is not related

[jira] [Updated] (HIVE-17069) Refactor OrcRawRecrodMerger.ReaderPair

2017-07-11 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17069?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman updated HIVE-17069: -- Attachment: HIVE-17069.01.patch > Refactor OrcRawRecrodMerger.ReaderPair >

[jira] [Commented] (HIVE-16977) Vectorization: Vectorize expressions in THEN/ELSE branches of IF/CASE WHEN

2017-07-11 Thread Teddy Choi (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-16977?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16083403#comment-16083403 ] Teddy Choi commented on HIVE-16977: --- It looks like HIVE-16731 already solved this issue, too. It allows

[jira] [Commented] (HIVE-16177) non Acid to acid conversion doesn't handle _copy_N files

2017-07-11 Thread Hive QA (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-16177?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16083426#comment-16083426 ] Hive QA commented on HIVE-16177: Here are the results of testing the latest attachment:

[jira] [Assigned] (HIVE-16977) Vectorization: Vectorize expressions in THEN/ELSE branches of IF/CASE WHEN

2017-07-11 Thread Teddy Choi (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-16977?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Teddy Choi reassigned HIVE-16977: - Assignee: Teddy Choi > Vectorization: Vectorize expressions in THEN/ELSE branches of IF/CASE

[jira] [Commented] (HIVE-15767) Hive On Spark is not working on secure clusters from Oozie

2017-07-11 Thread Yibing Shi (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-15767?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16083374#comment-16083374 ] Yibing Shi commented on HIVE-15767: --- [~peterceluch], can the tokens in Oozie launcher application still

[jira] [Commented] (HIVE-17018) Small table is converted to map join even the total size of small tables exceeds the threshold(hive.auto.convert.join.noconditionaltask.size)

2017-07-11 Thread Chao Sun (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17018?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16083411#comment-16083411 ] Chao Sun commented on HIVE-17018: - What I'm thinking is that the new config (say A) will be a value

[jira] [Assigned] (HIVE-17072) Make the parallelized timeout configurable in BeeLine tests

2017-07-11 Thread Marta Kuczora (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17072?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marta Kuczora reassigned HIVE-17072: > Make the parallelized timeout configurable in BeeLine tests >

[jira] [Assigned] (HIVE-17073) Incorrect result with vectorization and SharedWorkOptimizer

2017-07-11 Thread Jesus Camacho Rodriguez (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17073?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jesus Camacho Rodriguez reassigned HIVE-17073: -- > Incorrect result with vectorization and SharedWorkOptimizer >

[jira] [Commented] (HIVE-17073) Incorrect result with vectorization and SharedWorkOptimizer

2017-07-11 Thread Jesus Camacho Rodriguez (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17073?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16082171#comment-16082171 ] Jesus Camacho Rodriguez commented on HIVE-17073: [~mmccline], could you review the patch?

[jira] [Updated] (HIVE-16989) Fix some issues identified by lgtm.com

2017-07-11 Thread Malcolm Taylor (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-16989?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Malcolm Taylor updated HIVE-16989: -- Status: Patch Available (was: In Progress) New patch addressing comments by @gopalv on review

[jira] [Updated] (HIVE-16989) Fix some issues identified by lgtm.com

2017-07-11 Thread Malcolm Taylor (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-16989?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Malcolm Taylor updated HIVE-16989: -- Status: In Progress (was: Patch Available) > Fix some issues identified by lgtm.com >

[jira] [Commented] (HIVE-16983) getFileStatus on accessible s3a://[bucket-name]/folder: throws com.amazonaws.services.s3.model.AmazonS3Exception: Forbidden (Service: Amazon S3; Status Code: 403; Error

2017-07-11 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-16983?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16082117#comment-16082117 ] Steve Loughran commented on HIVE-16983: --- * The joda time update will be mandatory for S3A to auth *

[jira] [Commented] (HIVE-16989) Fix some issues identified by lgtm.com

2017-07-11 Thread Hive QA (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-16989?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16082057#comment-16082057 ] Hive QA commented on HIVE-16989: Here are the results of testing the latest attachment:

[jira] [Updated] (HIVE-16989) Fix some issues identified by lgtm.com

2017-07-11 Thread Malcolm Taylor (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-16989?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Malcolm Taylor updated HIVE-16989: -- Attachment: HIVE-16989.3.patch > Fix some issues identified by lgtm.com >

[jira] [Updated] (HIVE-17073) Incorrect result with vectorization and SharedWorkOptimizer

2017-07-11 Thread Jesus Camacho Rodriguez (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17073?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jesus Camacho Rodriguez updated HIVE-17073: --- Attachment: HIVE-17073.patch > Incorrect result with vectorization and

[jira] [Updated] (HIVE-17073) Incorrect result with vectorization and SharedWorkOptimizer

2017-07-11 Thread Jesus Camacho Rodriguez (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17073?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jesus Camacho Rodriguez updated HIVE-17073: --- Status: Patch Available (was: In Progress) > Incorrect result with

[jira] [Commented] (HIVE-17073) Incorrect result with vectorization and SharedWorkOptimizer

2017-07-11 Thread Hive QA (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17073?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16082278#comment-16082278 ] Hive QA commented on HIVE-17073: Here are the results of testing the latest attachment:

[jira] [Work started] (HIVE-17073) Incorrect result with vectorization and SharedWorkOptimizer

2017-07-11 Thread Jesus Camacho Rodriguez (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17073?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Work on HIVE-17073 started by Jesus Camacho Rodriguez. -- > Incorrect result with vectorization and

[jira] [Commented] (HIVE-15767) Hive On Spark is not working on secure clusters from Oozie

2017-07-11 Thread Peter Vary (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-15767?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16082308#comment-16082308 ] Peter Vary commented on HIVE-15767: --- [~gezapeti]: There is a typo in the comment (missing 'n' from

[jira] [Updated] (HIVE-16907) "INSERT INTO" overwrite old data when destination table encapsulated by backquote

2017-07-11 Thread Bing Li (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-16907?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bing Li updated HIVE-16907: --- Attachment: HIVE-16907.1.patch The patch is created based on the latest master branch. > "INSERT INTO"

[jira] [Updated] (HIVE-16907) "INSERT INTO" overwrite old data when destination table encapsulated by backquote

2017-07-11 Thread Bing Li (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-16907?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bing Li updated HIVE-16907: --- Status: Patch Available (was: In Progress) > "INSERT INTO" overwrite old data when destination table

[jira] [Commented] (HIVE-15898) add Type2 SCD merge tests

2017-07-11 Thread Hive QA (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-15898?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16082387#comment-16082387 ] Hive QA commented on HIVE-15898: Here are the results of testing the latest attachment:

[jira] [Commented] (HIVE-16357) Failed folder creation when creating a new table is reported incorrectly

2017-07-11 Thread Peter Vary (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-16357?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16082334#comment-16082334 ] Peter Vary commented on HIVE-16357: --- Hi [~zsombor.klara], Thanks for the patch! One nit: boolean

[jira] [Updated] (HIVE-15898) add Type2 SCD merge tests

2017-07-11 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-15898?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman updated HIVE-15898: -- Attachment: HIVE-15898.07.patch > add Type2 SCD merge tests > - > >

[jira] [Updated] (HIVE-16732) Transactional tables should block LOAD DATA

2017-07-11 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-16732?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman updated HIVE-16732: -- Attachment: HIVE-16732.03.patch > Transactional tables should block LOAD DATA >

[jira] [Commented] (HIVE-16832) duplicate ROW__ID possible in multi insert into transactional table

2017-07-11 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-16832?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16082294#comment-16082294 ] Eugene Koifman commented on HIVE-16832: --- I agree that Compressed OTID is now bigger but I'm not

[jira] [Updated] (HIVE-15767) Hive On Spark is not working on secure clusters from Oozie

2017-07-11 Thread Peter Cseh (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-15767?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Peter Cseh updated HIVE-15767: -- Attachment: HIVE-15767-002.patch Addressing typo > Hive On Spark is not working on secure clusters

[jira] [Assigned] (HIVE-17075) unstable stats in q files

2017-07-11 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17075?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman reassigned HIVE-17075: - > unstable stats in q files > - > > Key: HIVE-17075

[jira] [Updated] (HIVE-16177) non Acid to acid conversion doesn't handle _copy_N files

2017-07-11 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-16177?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman updated HIVE-16177: -- Attachment: HIVE-16177.18-branch-2.patch > non Acid to acid conversion doesn't handle _copy_N

[jira] [Commented] (HIVE-16732) Transactional tables should block LOAD DATA

2017-07-11 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-16732?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16082519#comment-16082519 ] Eugene Koifman commented on HIVE-16732: --- patch 3 committed to master (3.0) > Transactional tables

[jira] [Commented] (HIVE-17070) remove .orig files from src

2017-07-11 Thread Jason Dere (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17070?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16082595#comment-16082595 ] Jason Dere commented on HIVE-17070: --- +1 > remove .orig files from src > --- > >

[jira] [Commented] (HIVE-17073) Incorrect result with vectorization and SharedWorkOptimizer

2017-07-11 Thread Matt McCline (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17073?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16082593#comment-16082593 ] Matt McCline commented on HIVE-17073: - [~jcamachorodriguez] Thank you for jumping in with a solution.

[jira] [Commented] (HIVE-16907) "INSERT INTO" overwrite old data when destination table encapsulated by backquote

2017-07-11 Thread Hive QA (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-16907?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16082608#comment-16082608 ] Hive QA commented on HIVE-16907: Here are the results of testing the latest attachment:

[jira] [Updated] (HIVE-17063) insert overwrite partition onto a external table fail when drop partition first

2017-07-11 Thread Wang Haihua (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17063?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wang Haihua updated HIVE-17063: --- Status: In Progress (was: Patch Available) > insert overwrite partition onto a external table fail

[jira] [Commented] (HIVE-16907) "INSERT INTO" overwrite old data when destination table encapsulated by backquote

2017-07-11 Thread Pengcheng Xiong (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-16907?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16082649#comment-16082649 ] Pengcheng Xiong commented on HIVE-16907: thanks [~nemon] for discovering this and thanks [~libing]

[jira] [Commented] (HIVE-8838) Support Parquet through HCatalog

2017-07-11 Thread Sushanth Sowmyan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8838?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16082672#comment-16082672 ] Sushanth Sowmyan commented on HIVE-8838: (also, note : I'm ignoring the reported test failures

[jira] [Updated] (HIVE-17063) insert overwrite partition onto a external table fail when drop partition first

2017-07-11 Thread Wang Haihua (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17063?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wang Haihua updated HIVE-17063: --- Status: Patch Available (was: In Progress) > insert overwrite partition onto a external table fail

[jira] [Updated] (HIVE-17063) insert overwrite partition onto a external table fail when drop partition first

2017-07-11 Thread Wang Haihua (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17063?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wang Haihua updated HIVE-17063: --- Attachment: HIVE-17063.3.patch > insert overwrite partition onto a external table fail when drop

[jira] [Commented] (HIVE-16732) Transactional tables should block LOAD DATA

2017-07-11 Thread Hive QA (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-16732?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16082479#comment-16082479 ] Hive QA commented on HIVE-16732: Here are the results of testing the latest attachment:

[jira] [Commented] (HIVE-16907) "INSERT INTO" overwrite old data when destination table encapsulated by backquote

2017-07-11 Thread Bing Li (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-16907?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16082427#comment-16082427 ] Bing Li commented on HIVE-16907: [~pxiong] and [~ashutoshc] Could I get your comments on the patch? Thank

[jira] [Commented] (HIVE-15767) Hive On Spark is not working on secure clusters from Oozie

2017-07-11 Thread Sahil Takiar (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-15767?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16082411#comment-16082411 ] Sahil Takiar commented on HIVE-15767: - Overall LGTM. Just a few questions: * Are these errors thrown

[jira] [Assigned] (HIVE-8838) Support Parquet through HCatalog

2017-07-11 Thread Sushanth Sowmyan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8838?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sushanth Sowmyan reassigned HIVE-8838: -- Assignee: Sushanth Sowmyan (was: Adam Szita) > Support Parquet through HCatalog >

[jira] [Updated] (HIVE-17073) Incorrect result with vectorization and SharedWorkOptimizer

2017-07-11 Thread Jesus Camacho Rodriguez (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17073?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jesus Camacho Rodriguez updated HIVE-17073: --- Attachment: HIVE-17073.01.patch > Incorrect result with vectorization and

[jira] [Commented] (HIVE-16177) non Acid to acid conversion doesn't handle _copy_N files

2017-07-11 Thread Hive QA (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-16177?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16082814#comment-16082814 ] Hive QA commented on HIVE-16177: Here are the results of testing the latest attachment:

[jira] [Assigned] (HIVE-8838) Support Parquet through HCatalog

2017-07-11 Thread Sushanth Sowmyan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8838?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sushanth Sowmyan reassigned HIVE-8838: -- Assignee: Adam Szita (was: Sushanth Sowmyan) > Support Parquet through HCatalog >

[jira] [Commented] (HIVE-4577) hive CLI can't handle hadoop dfs command with space and quotes.

2017-07-11 Thread Vaibhav Gumashta (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-4577?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16082711#comment-16082711 ] Vaibhav Gumashta commented on HIVE-4577: Thanks [~libing]. Looks like some test failures might need

[jira] [Commented] (HIVE-8838) Support Parquet through HCatalog

2017-07-11 Thread Adam Szita (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8838?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16082847#comment-16082847 ] Adam Szita commented on HIVE-8838: -- [~aihuaxu] those are unrelated, they are flaky/failing without this

[jira] [Commented] (HIVE-8838) Support Parquet through HCatalog

2017-07-11 Thread Aihua Xu (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8838?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16082858#comment-16082858 ] Aihua Xu commented on HIVE-8838: Thanks [~szita] The patch looks good to me. +1. > Support Parquet through

[jira] [Commented] (HIVE-8838) Support Parquet through HCatalog

2017-07-11 Thread Sushanth Sowmyan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8838?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16082668#comment-16082668 ] Sushanth Sowmyan commented on HIVE-8838: +1 Thanks for adding parquet support to HCat! This has

[jira] [Commented] (HIVE-8838) Support Parquet through HCatalog

2017-07-11 Thread Aihua Xu (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8838?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16082682#comment-16082682 ] Aihua Xu commented on HIVE-8838: [~szita] and [~sushanth] How about the tests related to TestHCatClient?

[jira] [Updated] (HIVE-8838) Support Parquet through HCatalog

2017-07-11 Thread Sushanth Sowmyan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8838?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sushanth Sowmyan updated HIVE-8838: --- Attachment: HIVE-8838.3.patch > Support Parquet through HCatalog >

[jira] [Commented] (HIVE-17063) insert overwrite partition onto a external table fail when drop partition first

2017-07-11 Thread Hive QA (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17063?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16082722#comment-16082722 ] Hive QA commented on HIVE-17063: Here are the results of testing the latest attachment:

[jira] [Updated] (HIVE-17073) Incorrect result with vectorization and SharedWorkOptimizer

2017-07-11 Thread Jesus Camacho Rodriguez (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17073?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jesus Camacho Rodriguez updated HIVE-17073: --- Attachment: HIVE-17073.01.patch > Incorrect result with vectorization and

[jira] [Updated] (HIVE-17073) Incorrect result with vectorization and SharedWorkOptimizer

2017-07-11 Thread Jesus Camacho Rodriguez (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17073?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jesus Camacho Rodriguez updated HIVE-17073: --- Attachment: (was: HIVE-17073.01.patch) > Incorrect result with

[jira] [Commented] (HIVE-17073) Incorrect result with vectorization and SharedWorkOptimizer

2017-07-11 Thread Matt McCline (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17073?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16082852#comment-16082852 ] Matt McCline commented on HIVE-17073: - Great work! I think you need to add some code to

[jira] [Commented] (HIVE-17018) Small table is converted to map join even the total size of small tables exceeds the threshold(hive.auto.convert.join.noconditionaltask.size)

2017-07-11 Thread liyunzhang_intel (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17018?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16083058#comment-16083058 ] liyunzhang_intel commented on HIVE-17018: - [~csun]: {quote}A better way might be to have a

[jira] [Updated] (HIVE-17066) Query78 filter wrong estimatation is generating bad plan

2017-07-11 Thread Vineet Garg (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17066?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vineet Garg updated HIVE-17066: --- Status: Open (was: Patch Available) > Query78 filter wrong estimatation is generating bad plan >

[jira] [Updated] (HIVE-15144) JSON.org license is now CatX

2017-07-11 Thread Pengcheng Xiong (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-15144?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Pengcheng Xiong updated HIVE-15144: --- Resolution: Fixed Status: Resolved (was: Patch Available) > JSON.org license is now

[jira] [Commented] (HIVE-17073) Incorrect result with vectorization and SharedWorkOptimizer

2017-07-11 Thread Hive QA (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17073?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16083089#comment-16083089 ] Hive QA commented on HIVE-17073: Here are the results of testing the latest attachment:

[jira] [Commented] (HIVE-15051) Test framework integration with findbugs, rat checks etc.

2017-07-11 Thread Lefty Leverenz (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-15051?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16083050#comment-16083050 ] Lefty Leverenz commented on HIVE-15051: --- Thanks for the explanations, [~pvary]. I used your own

[jira] [Updated] (HIVE-17066) Query78 filter wrong estimatation is generating bad plan

2017-07-11 Thread Vineet Garg (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17066?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vineet Garg updated HIVE-17066: --- Attachment: (was: HIVE-17066.3.patch) > Query78 filter wrong estimatation is generating bad plan

[jira] [Updated] (HIVE-17066) Query78 filter wrong estimatation is generating bad plan

2017-07-11 Thread Vineet Garg (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17066?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vineet Garg updated HIVE-17066: --- Status: Open (was: Patch Available) > Query78 filter wrong estimatation is generating bad plan >

[jira] [Updated] (HIVE-16832) duplicate ROW__ID possible in multi insert into transactional table

2017-07-11 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-16832?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman updated HIVE-16832: -- Attachment: HIVE-16832.21.patch patch 21 addresses Gopal's comments > duplicate ROW__ID

[jira] [Commented] (HIVE-4577) hive CLI can't handle hadoop dfs command with space and quotes.

2017-07-11 Thread Hive QA (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-4577?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16081884#comment-16081884 ] Hive QA commented on HIVE-4577: --- Here are the results of testing the latest attachment:

[jira] [Commented] (HIVE-17019) Add support to download debugging information as an archive.

2017-07-11 Thread Siddharth Seth (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17019?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16083111#comment-16083111 ] Siddharth Seth commented on HIVE-17019: --- Thanks for posting the patch. Will be useful to get

[jira] [Commented] (HIVE-16832) duplicate ROW__ID possible in multi insert into transactional table

2017-07-11 Thread Gopal V (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-16832?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16082885#comment-16082885 ] Gopal V commented on HIVE-16832: bq. Suppose you populate a partition via 100 inserts and 1M rows. So you

[jira] [Commented] (HIVE-15767) Hive On Spark is not working on secure clusters from Oozie

2017-07-11 Thread Peter Cseh (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-15767?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16082948#comment-16082948 ] Peter Cseh commented on HIVE-15767: --- This happens with HiveCLI, not with HS2. The exception is coming

[jira] [Comment Edited] (HIVE-17073) Incorrect result with vectorization and SharedWorkOptimizer

2017-07-11 Thread Matt McCline (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17073?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16082852#comment-16082852 ] Matt McCline edited comment on HIVE-17073 at 7/11/17 7:49 PM: -- Great work! I

[jira] [Commented] (HIVE-16926) LlapTaskUmbilicalExternalClient should not start new umbilical server for every fragment request

2017-07-11 Thread Siddharth Seth (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-16926?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16082995#comment-16082995 ] Siddharth Seth commented on HIVE-16926: --- Functionally, looks good to me. Minor comments. -

[jira] [Commented] (HIVE-17065) You can not successfully deploy hive clusters with Hive guidance documents

2017-07-11 Thread Lefty Leverenz (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17065?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16083012#comment-16083012 ] Lefty Leverenz commented on HIVE-17065: --- [~linzhangbing], it's easy to get edit privileges for the

[jira] [Updated] (HIVE-16177) non Acid to acid conversion doesn't handle _copy_N files

2017-07-11 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-16177?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman updated HIVE-16177: -- Attachment: HIVE-16177.19-branch-2.patch > non Acid to acid conversion doesn't handle _copy_N

[jira] [Commented] (HIVE-8838) Support Parquet through HCatalog

2017-07-11 Thread Hive QA (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8838?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16082904#comment-16082904 ] Hive QA commented on HIVE-8838: --- Here are the results of testing the latest attachment:

[jira] [Updated] (HIVE-17073) Incorrect result with vectorization and SharedWorkOptimizer

2017-07-11 Thread Jesus Camacho Rodriguez (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17073?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jesus Camacho Rodriguez updated HIVE-17073: --- Attachment: HIVE-17073.02.patch > Incorrect result with vectorization and

[jira] [Commented] (HIVE-15144) JSON.org license is now CatX

2017-07-11 Thread Lefty Leverenz (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-15144?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16082980#comment-16082980 ] Lefty Leverenz commented on HIVE-15144: --- [~pxiong], please update the fix versions to 2.3.0 and

[jira] [Commented] (HIVE-17073) Incorrect result with vectorization and SharedWorkOptimizer

2017-07-11 Thread Matt McCline (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17073?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16082920#comment-16082920 ] Matt McCline commented on HIVE-17073: - Ok, LGTM +1 tests pending. > Incorrect result with

[jira] [Commented] (HIVE-17073) Incorrect result with vectorization and SharedWorkOptimizer

2017-07-11 Thread Hive QA (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17073?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16083011#comment-16083011 ] Hive QA commented on HIVE-17073: Here are the results of testing the latest attachment:

[jira] [Updated] (HIVE-4577) hive CLI can't handle hadoop dfs command with space and quotes.

2017-07-11 Thread Bing Li (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-4577?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bing Li updated HIVE-4577: -- Attachment: HIVE-4577.5.patch > hive CLI can't handle hadoop dfs command with space and quotes. >

[jira] [Commented] (HIVE-4577) hive CLI can't handle hadoop dfs command with space and quotes.

2017-07-11 Thread Bing Li (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-4577?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16081730#comment-16081730 ] Bing Li commented on HIVE-4577: --- [~vgumashta] HIVE-4577.5.patch is generated based on the latest master

[jira] [Commented] (HIVE-17067) LLAP: Add http endpoint to provide system level configurations

2017-07-11 Thread Hive QA (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17067?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16081713#comment-16081713 ] Hive QA commented on HIVE-17067: Here are the results of testing the latest attachment:

[jira] [Commented] (HIVE-16996) Add HLL as an alternative to FM sketch to compute stats

2017-07-11 Thread Hive QA (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-16996?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16081827#comment-16081827 ] Hive QA commented on HIVE-16996: Here are the results of testing the latest attachment:

[jira] [Updated] (HIVE-17067) LLAP: Add http endpoint to provide system level configurations

2017-07-11 Thread Prasanth Jayachandran (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17067?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Prasanth Jayachandran updated HIVE-17067: - Resolution: Fixed Status: Resolved (was: Patch Available) Committed to

[jira] [Commented] (HIVE-17018) Small table is converted to map join even the total size of small tables exceeds the threshold(hive.auto.convert.join.noconditionaltask.size)

2017-07-11 Thread Chao Sun (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17018?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16081743#comment-16081743 ] Chao Sun commented on HIVE-17018: - [~kellyzly]: yes, this is to prevent a Spark task from using unbounded

[jira] [Commented] (HIVE-15898) add Type2 SCD merge tests

2017-07-11 Thread Hive QA (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-15898?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16081766#comment-16081766 ] Hive QA commented on HIVE-15898: Here are the results of testing the latest attachment:

[jira] [Commented] (HIVE-16983) getFileStatus on accessible s3a://[bucket-name]/folder: throws com.amazonaws.services.s3.model.AmazonS3Exception: Forbidden (Service: Amazon S3; Status Code: 403; Error

2017-07-11 Thread Vlad Gudikov (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-16983?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16081846#comment-16081846 ] Vlad Gudikov commented on HIVE-16983: - Well I've tested this one with s3a://, using Impala and Hive

[jira] [Commented] (HIVE-16832) duplicate ROW__ID possible in multi insert into transactional table

2017-07-11 Thread Gopal V (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-16832?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16081773#comment-16081773 ] Gopal V commented on HIVE-16832: LGTM - +1. Minor comments - the bits used for bucket and statement ids

[jira] [Commented] (HIVE-17073) Incorrect result with vectorization and SharedWorkOptimizer

2017-07-11 Thread Matt McCline (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17073?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16082605#comment-16082605 ] Matt McCline commented on HIVE-17073: - Also there is another forward at the top of the

[jira] [Updated] (HIVE-17070) remove .orig files from src

2017-07-11 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17070?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman updated HIVE-17070: -- Resolution: Fixed Fix Version/s: 3.0.0 Status: Resolved (was: Patch

[jira] [Commented] (HIVE-15705) Event replication for constraints

2017-07-11 Thread Hive QA (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-15705?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16083293#comment-16083293 ] Hive QA commented on HIVE-15705: Here are the results of testing the latest attachment:

[jira] [Commented] (HIVE-16370) Avro data type null not supported on partitioned tables

2017-07-11 Thread Andrew Sears (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-16370?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16083316#comment-16083316 ] Andrew Sears commented on HIVE-16370: - This is something that can be handled in Avro by unioning the

[jira] [Commented] (HIVE-17065) You can not successfully deploy hive clusters with Hive guidance documents

2017-07-11 Thread ZhangBing Lin (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17065?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16083322#comment-16083322 ] ZhangBing Lin commented on HIVE-17065: -- Hi,[~leftylev],thank you for your suggest! > You can not

[jira] [Commented] (HIVE-16832) duplicate ROW__ID possible in multi insert into transactional table

2017-07-11 Thread Hive QA (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-16832?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=1608#comment-1608 ] Hive QA commented on HIVE-16832: Here are the results of testing the latest attachment:

[jira] [Updated] (HIVE-16975) Vectorization: Fully vectorize CAST date as TIMESTAMP so VectorUDFAdaptor is now used

2017-07-11 Thread Teddy Choi (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-16975?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Teddy Choi updated HIVE-16975: -- Status: Patch Available (was: Open) > Vectorization: Fully vectorize CAST date as TIMESTAMP so

[jira] [Updated] (HIVE-16975) Vectorization: Fully vectorize CAST date as TIMESTAMP so VectorUDFAdaptor is now used

2017-07-11 Thread Teddy Choi (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-16975?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Teddy Choi updated HIVE-16975: -- Attachment: HIVE-16975.1.patch > Vectorization: Fully vectorize CAST date as TIMESTAMP so

[jira] [Updated] (HIVE-16975) Vectorization: Fully vectorize CAST date as TIMESTAMP so VectorUDFAdaptor is now used

2017-07-11 Thread Teddy Choi (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-16975?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Teddy Choi updated HIVE-16975: -- Attachment: (was: HIVE-16975.1.patch) > Vectorization: Fully vectorize CAST date as TIMESTAMP so

  1   2   >