[jira] [Updated] (HIVE-12017) Do not disable CBO by default when number of joins in a query is equal or less than 1

2015-11-18 Thread Jesus Camacho Rodriguez (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-12017?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jesus Camacho Rodriguez updated HIVE-12017: --- Attachment: HIVE-12017.12.patch > Do not disable CBO by default when number

[jira] [Commented] (HIVE-12417) Support for exclamation mark missing in regexp

2015-11-18 Thread Olaf Flebbe (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-12417?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15011395#comment-15011395 ] Olaf Flebbe commented on HIVE-12417: The four failures seem not related. Seems to be related to an

[jira] [Updated] (HIVE-11981) ORC Schema Evolution Issues (Vectorized, ACID, and Non-Vectorized)

2015-11-18 Thread Lefty Leverenz (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-11981?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lefty Leverenz updated HIVE-11981: -- Labels: TODOC2.0 (was: ) > ORC Schema Evolution Issues (Vectorized, ACID, and Non-Vectorized)

[jira] [Commented] (HIVE-11981) ORC Schema Evolution Issues (Vectorized, ACID, and Non-Vectorized)

2015-11-18 Thread Lefty Leverenz (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-11981?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15011483#comment-15011483 ] Lefty Leverenz commented on HIVE-11981: --- Doc note: This adds *hive.exec.schema.evolution* to

[jira] [Updated] (HIVE-12160) Hbase table query execution fails in secured cluster when hive.exec.mode.local.auto is set to true

2015-11-18 Thread Aihua Xu (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-12160?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aihua Xu updated HIVE-12160: Attachment: (was: HIVE-12160.patch) > Hbase table query execution fails in secured cluster when >

[jira] [Commented] (HIVE-12017) Do not disable CBO by default when number of joins in a query is equal or less than 1

2015-11-18 Thread Ashutosh Chauhan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-12017?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15011296#comment-15011296 ] Ashutosh Chauhan commented on HIVE-12017: - JOIN-GBY transpose rule is now cost based, so you may

[jira] [Updated] (HIVE-12160) Hbase table query execution fails in secured cluster when hive.exec.mode.local.auto is set to true

2015-11-18 Thread Aihua Xu (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-12160?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aihua Xu updated HIVE-12160: Attachment: HIVE-12160.patch > Hbase table query execution fails in secured cluster when >

[jira] [Commented] (HIVE-6113) Unable to instantiate org.apache.hadoop.hive.metastore.HiveMetaStoreClient

2015-11-18 Thread Oleksiy Sayankin (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-6113?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15011610#comment-15011610 ] Oleksiy Sayankin commented on HIVE-6113: va/org/apache/hadoop/hive/conf/HiveConf.java if

[jira] [Updated] (HIVE-12413) Default mode for hive.mapred.mode should be strict

2015-11-18 Thread Ashutosh Chauhan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-12413?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ashutosh Chauhan updated HIVE-12413: Attachment: HIVE-12413.2.patch > Default mode for hive.mapred.mode should be strict >

[jira] [Commented] (HIVE-12409) make sure SessionState.initTxnMgr() is thread safe

2015-11-18 Thread Hive QA (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-12409?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15011546#comment-15011546 ] Hive QA commented on HIVE-12409: Here are the results of testing the latest attachment:

[jira] [Resolved] (HIVE-12452) orc_merge9.q hangs when writing orc metadata section

2015-11-18 Thread Prasanth Jayachandran (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-12452?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Prasanth Jayachandran resolved HIVE-12452. -- Resolution: Implemented Fix for this is implemented in .2 patch of HIVE-12450

[jira] [Commented] (HIVE-11265) LLAP: investigate locality issues

2015-11-18 Thread Siddharth Seth (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-11265?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15011856#comment-15011856 ] Siddharth Seth commented on HIVE-11265: --- Should've updated this earlier. The 10 instances being run

[jira] [Commented] (HIVE-12417) Support for exclamation mark missing in regexp

2015-11-18 Thread Sergey Shelukhin (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-12417?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15011709#comment-15011709 ] Sergey Shelukhin commented on HIVE-12417: - +1 > Support for exclamation mark missing in regexp >

[jira] [Commented] (HIVE-9774) Print yarn application id to console [Spark Branch]

2015-11-18 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9774?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15011714#comment-15011714 ] Xuefu Zhang commented on HIVE-9774: --- While printing it, we may also want to print the ways to kill the

[jira] [Updated] (HIVE-12450) OrcFileMergeOperator does not use correct compression buffer size

2015-11-18 Thread Prasanth Jayachandran (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-12450?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Prasanth Jayachandran updated HIVE-12450: - Priority: Critical (was: Major) > OrcFileMergeOperator does not use correct

[jira] [Commented] (HIVE-11265) LLAP: investigate locality issues

2015-11-18 Thread Sergey Shelukhin (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-11265?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15011836#comment-15011836 ] Sergey Shelukhin commented on HIVE-11265: - Anything more to do here? There was some investigation,

[jira] [Resolved] (HIVE-11265) LLAP: investigate locality issues

2015-11-18 Thread Siddharth Seth (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-11265?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siddharth Seth resolved HIVE-11265. --- Resolution: Done > LLAP: investigate locality issues > - > >

[jira] [Updated] (HIVE-12450) OrcFileMergeOperator does not use correct compression buffer size

2015-11-18 Thread Prasanth Jayachandran (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-12450?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Prasanth Jayachandran updated HIVE-12450: - Description: OrcFileMergeOperator checks for compatibility before merging orc

[jira] [Updated] (HIVE-12450) OrcFileMergeOperator does not use correct compression buffer size

2015-11-18 Thread Prasanth Jayachandran (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-12450?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Prasanth Jayachandran updated HIVE-12450: - Attachment: HIVE-12450.2.patch Minor change. The compression buffer size should

[jira] [Commented] (HIVE-10004) yarn service registry should be an optional dependency

2015-11-18 Thread Sergey Shelukhin (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-10004?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15011819#comment-15011819 ] Sergey Shelukhin commented on HIVE-10004: - Needed? > yarn service registry should be an optional

[jira] [Resolved] (HIVE-10402) LLAP: scheduling occasionally schedules all the work on one machine

2015-11-18 Thread Sergey Shelukhin (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-10402?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sergey Shelukhin resolved HIVE-10402. - Resolution: Cannot Reproduce > LLAP: scheduling occasionally schedules all the work on

[jira] [Resolved] (HIVE-10772) LLAP: perf dips with IO elevator disabled

2015-11-18 Thread Sergey Shelukhin (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-10772?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sergey Shelukhin resolved HIVE-10772. - Resolution: Cannot Reproduce too unspecific > LLAP: perf dips with IO elevator disabled

[jira] [Resolved] (HIVE-7926) long-lived daemons for query fragment execution, I/O and caching

2015-11-18 Thread Sergey Shelukhin (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-7926?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sergey Shelukhin resolved HIVE-7926. Resolution: Fixed Fix Version/s: 2.0.0 Release Note: LLAP is the new hybrid

[jira] [Commented] (HIVE-10449) Make new fast hash table for Native Vector Map Join work with Hybrid Grace

2015-11-18 Thread Sergey Shelukhin (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-10449?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15011885#comment-15011885 ] Sergey Shelukhin commented on HIVE-10449: - Is there any planned work on this in the scope of 2.0

[jira] [Updated] (HIVE-10449) LLAP: Make new fast hash table for Native Vector Map Join work with Hybrid Grace

2015-11-18 Thread Sergey Shelukhin (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-10449?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sergey Shelukhin updated HIVE-10449: Issue Type: Bug (was: Sub-task) Parent: (was: HIVE-7926) > LLAP: Make new fast

[jira] [Updated] (HIVE-10449) Make new fast hash table for Native Vector Map Join work with Hybrid Grace

2015-11-18 Thread Sergey Shelukhin (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-10449?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sergey Shelukhin updated HIVE-10449: Summary: Make new fast hash table for Native Vector Map Join work with Hybrid Grace (was:

[jira] [Commented] (HIVE-10897) LLAP: ArrayIndexOOB exception in new mapjoin

2015-11-18 Thread Sergey Shelukhin (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-10897?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15011887#comment-15011887 ] Sergey Shelukhin commented on HIVE-10897: - Is this still relevant? > LLAP: ArrayIndexOOB

[jira] [Commented] (HIVE-11527) bypass HiveServer2 thrift interface for query results

2015-11-18 Thread Vaibhav Gumashta (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-11527?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15011942#comment-15011942 ] Vaibhav Gumashta commented on HIVE-11527: - [~sershe] I was aware of this jira, so didn't cover

[jira] [Commented] (HIVE-12417) Support for exclamation mark missing in regexp

2015-11-18 Thread Hive QA (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-12417?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15010834#comment-15010834 ] Hive QA commented on HIVE-12417: Here are the results of testing the latest attachment:

[jira] [Commented] (HIVE-11684) Implement limit pushdown through outer join in CBO

2015-11-18 Thread Jesus Camacho Rodriguez (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-11684?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15010729#comment-15010729 ] Jesus Camacho Rodriguez commented on HIVE-11684: New patch uploaded and RB updated.

[jira] [Updated] (HIVE-12017) Do not disable CBO by default when number of joins in a query is equal or less than 1

2015-11-18 Thread Jesus Camacho Rodriguez (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-12017?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jesus Camacho Rodriguez updated HIVE-12017: --- Attachment: HIVE-12017.11.patch Addressed [~ashutoshc] comment. > Do not

[jira] [Commented] (HIVE-12413) Default mode for hive.mapred.mode should be strict

2015-11-18 Thread Hive QA (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-12413?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15010491#comment-15010491 ] Hive QA commented on HIVE-12413: Here are the results of testing the latest attachment:

[jira] [Commented] (HIVE-6113) Unable to instantiate org.apache.hadoop.hive.metastore.HiveMetaStoreClient

2015-11-18 Thread Oleksiy Sayankin (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-6113?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15010696#comment-15010696 ] Oleksiy Sayankin commented on HIVE-6113: Hi team! Any updates regarding HIVE-6113-2.patch ? >

[jira] [Commented] (HIVE-12421) Streaming API add TransactionBatch.beginNextTransaction(long timeout)

2015-11-18 Thread Roshan Naik (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-12421?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15010502#comment-15010502 ] Roshan Naik commented on HIVE-12421: though.. not having a timeout option on blocking call is an issue

[jira] [Commented] (HIVE-12388) GetTables cannot get external tables when TABLE type argument is given

2015-11-18 Thread Aihua Xu (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-12388?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15010989#comment-15010989 ] Aihua Xu commented on HIVE-12388: - +1. Patch looks good to me. > GetTables cannot get external tables

[jira] [Updated] (HIVE-11981) ORC Schema Evolution Issues (Vectorized, ACID, and Non-Vectorized)

2015-11-18 Thread Matt McCline (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-11981?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matt McCline updated HIVE-11981: Fix Version/s: 2.0.0 > ORC Schema Evolution Issues (Vectorized, ACID, and Non-Vectorized) >

[jira] [Commented] (HIVE-11981) ORC Schema Evolution Issues (Vectorized, ACID, and Non-Vectorized)

2015-11-18 Thread Hive QA (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-11981?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=1507#comment-1507 ] Hive QA commented on HIVE-11981: Here are the results of testing the latest attachment:

[jira] [Commented] (HIVE-11981) ORC Schema Evolution Issues (Vectorized, ACID, and Non-Vectorized)

2015-11-18 Thread Matt McCline (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-11981?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15011121#comment-15011121 ] Matt McCline commented on HIVE-11981: - Committed to master. Thanks [~prasanth_j] for your review. >

[jira] [Comment Edited] (HIVE-12434) Merge spark into master 11/17/1015

2015-11-18 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-12434?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15012067#comment-15012067 ] Xuefu Zhang edited comment on HIVE-12434 at 11/18/15 9:49 PM: -- Committed to

[jira] [Updated] (HIVE-11180) Enable native vectorized map join for spark [Spark Branch]

2015-11-18 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-11180?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuefu Zhang updated HIVE-11180: --- Fix Version/s: 2.0.0 > Enable native vectorized map join for spark [Spark Branch] >

[jira] [Updated] (HIVE-12330) Fix precommit Spark test part2

2015-11-18 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-12330?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuefu Zhang updated HIVE-12330: --- Attachment: HIVE-12330.patch > Fix precommit Spark test part2 > -- > >

[jira] [Reopened] (HIVE-12330) Fix precommit Spark test part2

2015-11-18 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-12330?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuefu Zhang reopened HIVE-12330: Patch here is merged to master but reverted. Reopen this to master and see how test goes. > Fix

[jira] [Updated] (HIVE-10613) HCatSchemaUtils getHCatFieldSchema should include field comment

2015-11-18 Thread Thomas Friedrich (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-10613?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Thomas Friedrich updated HIVE-10613: Attachment: HIVE-10613.patch > HCatSchemaUtils getHCatFieldSchema should include field

[jira] [Commented] (HIVE-10613) HCatSchemaUtils getHCatFieldSchema should include field comment

2015-11-18 Thread Thomas Friedrich (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-10613?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15012543#comment-15012543 ] Thomas Friedrich commented on HIVE-10613: - Updated patch with test cases. > HCatSchemaUtils

[jira] [Updated] (HIVE-12229) Custom script in query cannot be executed in yarn-cluster mode [Spark Branch].

2015-11-18 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-12229?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuefu Zhang updated HIVE-12229: --- Fix Version/s: 1.3.0 > Custom script in query cannot be executed in yarn-cluster mode [Spark Branch].

[jira] [Updated] (HIVE-12283) Fix test failures after HIVE-11844 [Spark Branch]

2015-11-18 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-12283?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuefu Zhang updated HIVE-12283: --- Fix Version/s: 1.3.0 > Fix test failures after HIVE-11844 [Spark Branch] >

[jira] [Updated] (HIVE-11473) Upgrade Spark dependency to 1.5 [Spark Branch]

2015-11-18 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-11473?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuefu Zhang updated HIVE-11473: --- Fix Version/s: 1.3.0 > Upgrade Spark dependency to 1.5 [Spark Branch] >

[jira] [Updated] (HIVE-12450) OrcFileMergeOperator does not use correct compression buffer size

2015-11-18 Thread Prasanth Jayachandran (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-12450?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Prasanth Jayachandran updated HIVE-12450: - Description: OrcFileMergeOperator checks for compatibility before merging orc

[jira] [Updated] (HIVE-10613) HCatSchemaUtils getHCatFieldSchema should include field comment

2015-11-18 Thread Thomas Friedrich (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-10613?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Thomas Friedrich updated HIVE-10613: Attachment: (was: HIVE-10613.patch) > HCatSchemaUtils getHCatFieldSchema should include

[jira] [Updated] (HIVE-9600) add missing classes to hive-jdbc-standalone.jar

2015-11-18 Thread Chen Xin Yu (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9600?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Xin Yu updated HIVE-9600: -- Attachment: (was: HIVE-9600.1.patch) > add missing classes to hive-jdbc-standalone.jar >

[jira] [Commented] (HIVE-9599) remove derby, datanucleus and other not related to jdbc client classes from hive-jdbc-standalone.jar

2015-11-18 Thread Chen Xin Yu (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9599?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15012475#comment-15012475 ] Chen Xin Yu commented on HIVE-9599: --- Hi Ashutosh, I will look at HIVE-9600 and rebase the patch after

[jira] [Commented] (HIVE-9599) remove derby, datanucleus and other not related to jdbc client classes from hive-jdbc-standalone.jar

2015-11-18 Thread Chen Xin Yu (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9599?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15012474#comment-15012474 ] Chen Xin Yu commented on HIVE-9599: --- Hi Ashutosh, I will look at HIVE-9600 and rebase the patch after

[jira] [Commented] (HIVE-12436) Default hive.metastore.schema.verification to true

2015-11-18 Thread Ashutosh Chauhan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-12436?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15012506#comment-15012506 ] Ashutosh Chauhan commented on HIVE-12436: - Failures are unrelated. [~sushanth] would you like to

[jira] [Updated] (HIVE-12352) CompactionTxnHandler.markCleaned() may delete too much

2015-11-18 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-12352?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman updated HIVE-12352: -- Description: Worker will start with DB in state X (wrt this partition). while it's

[jira] [Updated] (HIVE-12091) Merge file doesn't work for ORC table when running on Spark. [Spark Branch]

2015-11-18 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-12091?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuefu Zhang updated HIVE-12091: --- Fix Version/s: 1.3.0 > Merge file doesn't work for ORC table when running on Spark. [Spark Branch] >

[jira] [Updated] (HIVE-9139) Clean up GenSparkProcContext.clonedReduceSinks and related code [Spark Branch]

2015-11-18 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9139?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuefu Zhang updated HIVE-9139: -- Fix Version/s: 1.3.0 > Clean up GenSparkProcContext.clonedReduceSinks and related code [Spark Branch] >

[jira] [Updated] (HIVE-11180) Enable native vectorized map join for spark [Spark Branch]

2015-11-18 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-11180?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuefu Zhang updated HIVE-11180: --- Fix Version/s: 1.3.0 > Enable native vectorized map join for spark [Spark Branch] >

[jira] [Commented] (HIVE-9600) add missing classes to hive-jdbc-standalone.jar

2015-11-18 Thread Chen Xin Yu (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9600?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15012681#comment-15012681 ] Chen Xin Yu commented on HIVE-9600: --- I tested hive-jdbc-standalone.jar with the patch, it works well with

[jira] [Updated] (HIVE-9600) add missing classes to hive-jdbc-standalone.jar

2015-11-18 Thread Chen Xin Yu (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9600?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Xin Yu updated HIVE-9600: -- Attachment: HIVE-9600.1..patch Exclude hive-mapreduce-* and hive-yarn-* instead of hadoop-* > add

[jira] [Updated] (HIVE-9600) add missing classes to hive-jdbc-standalone.jar

2015-11-18 Thread Chen Xin Yu (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9600?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Xin Yu updated HIVE-9600: -- Attachment: (was: HIVE-9600.1..patch) > add missing classes to hive-jdbc-standalone.jar >

[jira] [Updated] (HIVE-12352) CompactionTxnHandler.markCleaned() may delete too much

2015-11-18 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-12352?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman updated HIVE-12352: -- Description: Worker will start with DB in state X (wrt this partition). while it's

[jira] [Updated] (HIVE-12075) add analyze command to explictly cache file metadata in HBase metastore

2015-11-18 Thread Sergey Shelukhin (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-12075?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sergey Shelukhin updated HIVE-12075: Attachment: HIVE-12075.02.patch Fix some issues > add analyze command to explictly cache

[jira] [Updated] (HIVE-12075) add analyze command to explictly cache file metadata in HBase metastore

2015-11-18 Thread Sergey Shelukhin (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-12075?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sergey Shelukhin updated HIVE-12075: Description: ANALYZE TABLE (spec as usual) CACHE METADATA was: ANALYZE TABLE (spec as

[jira] [Comment Edited] (HIVE-12075) add analyze command to explictly cache file metadata in HBase metastore

2015-11-18 Thread Sergey Shelukhin (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-12075?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15012660#comment-15012660 ] Sergey Shelukhin edited comment on HIVE-12075 at 11/19/15 2:34 AM: ---

[jira] [Updated] (HIVE-12352) CompactionTxnHandler.markCleaned() may delete too much

2015-11-18 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-12352?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman updated HIVE-12352: -- Priority: Critical (was: Major) > CompactionTxnHandler.markCleaned() may delete too much >

[jira] [Updated] (HIVE-9600) add missing classes to hive-jdbc-standalone.jar

2015-11-18 Thread Chen Xin Yu (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9600?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Xin Yu updated HIVE-9600: -- Attachment: HIVE-9600.1.patch exclude hadoop-mapreduce and hadoop-yarn instead of hadoop-* > add

[jira] [Updated] (HIVE-12434) Merge spark into master 11/17/1015

2015-11-18 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-12434?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuefu Zhang updated HIVE-12434: --- Release Note: Merge introduced some configurations. > Merge spark into master 11/17/1015 >

[jira] [Updated] (HIVE-12283) Fix test failures after HIVE-11844 [Spark Branch]

2015-11-18 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-12283?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuefu Zhang updated HIVE-12283: --- Fix Version/s: 2.0.0 > Fix test failures after HIVE-11844 [Spark Branch] >

[jira] [Updated] (HIVE-11473) Upgrade Spark dependency to 1.5 [Spark Branch]

2015-11-18 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-11473?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuefu Zhang updated HIVE-11473: --- Fix Version/s: 2.0.0 > Upgrade Spark dependency to 1.5 [Spark Branch] >

[jira] [Updated] (HIVE-12284) Merge master to Spark branch 10/28/2015 [Spark Branch]

2015-11-18 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-12284?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuefu Zhang updated HIVE-12284: --- Fix Version/s: 2.0.0 > Merge master to Spark branch 10/28/2015 [Spark Branch] >

[jira] [Updated] (HIVE-12456) QueryId can't be stored in the configuration of the SessionState since multiple queries can run in a single session

2015-11-18 Thread Aihua Xu (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-12456?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aihua Xu updated HIVE-12456: Attachment: (was: HIVE-12456.patch) > QueryId can't be stored in the configuration of the SessionState

[jira] [Updated] (HIVE-12456) QueryId can't be stored in the configuration of the SessionState since multiple queries can run in a single session

2015-11-18 Thread Aihua Xu (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-12456?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aihua Xu updated HIVE-12456: Attachment: HIVE-12456.patch In the patch we will get the saved queryId from confOverlay which will be

[jira] [Commented] (HIVE-12434) Merge spark into master 11/17/1015

2015-11-18 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-12434?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15012087#comment-15012087 ] Xuefu Zhang commented on HIVE-12434: To clarify, all patches except that for HIVE-12330 was merged.

[jira] [Updated] (HIVE-11358) LLAP: move LlapConfiguration into HiveConf and document the settings

2015-11-18 Thread Sergey Shelukhin (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-11358?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sergey Shelukhin updated HIVE-11358: Attachment: HIVE-11358.02.patch Updated the time parameters and names to conform to Hive

[jira] [Updated] (HIVE-12459) Tez startup dislikes spaces in classpath on Windows

2015-11-18 Thread john lilley (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-12459?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] john lilley updated HIVE-12459: --- Affects Version/s: (was: 0.14.0) 1.2.1 > Tez startup dislikes spaces in

[jira] [Commented] (HIVE-11890) Create ORC module

2015-11-18 Thread Hive QA (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-11890?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15012453#comment-15012453 ] Hive QA commented on HIVE-11890: Here are the results of testing the latest attachment:

[jira] [Updated] (HIVE-12045) ClassNotFound for GenericUDF in "select distinct..." query (Hive on Spark)

2015-11-18 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-12045?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuefu Zhang updated HIVE-12045: --- Attachment: HIVE-12045.patch > ClassNotFound for GenericUDF in "select distinct..." query (Hive on

[jira] [Updated] (HIVE-12229) Custom script in query cannot be executed in yarn-cluster mode [Spark Branch].

2015-11-18 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-12229?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuefu Zhang updated HIVE-12229: --- Fix Version/s: 2.0.0 > Custom script in query cannot be executed in yarn-cluster mode [Spark Branch].

[jira] [Updated] (HIVE-12091) Merge file doesn't work for ORC table when running on Spark. [Spark Branch]

2015-11-18 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-12091?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuefu Zhang updated HIVE-12091: --- Fix Version/s: 2.0.0 > Merge file doesn't work for ORC table when running on Spark. [Spark Branch] >

[jira] [Resolved] (HIVE-10897) LLAP: ArrayIndexOOB exception in new mapjoin

2015-11-18 Thread Sergey Shelukhin (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-10897?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sergey Shelukhin resolved HIVE-10897. - Resolution: Cannot Reproduce > LLAP: ArrayIndexOOB exception in new mapjoin >

[jira] [Updated] (HIVE-12450) OrcFileMergeOperator does not use correct compression buffer size

2015-11-18 Thread Prasanth Jayachandran (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-12450?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Prasanth Jayachandran updated HIVE-12450: - Attachment: HIVE-12450.4.patch Added the test cases to tez as well. >

[jira] [Updated] (HIVE-9599) remove derby, datanucleus and other not related to jdbc client classes from hive-jdbc-standalone.jar

2015-11-18 Thread Ashutosh Chauhan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9599?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ashutosh Chauhan updated HIVE-9599: --- Attachment: HIVE-9599.3.patch Rebased the patch. Left hadoop jar changes for HIVE-9600

[jira] [Resolved] (HIVE-12453) Check SessionState status before performing cleanup

2015-11-18 Thread Wei Zheng (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-12453?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei Zheng resolved HIVE-12453. -- Resolution: Invalid > Check SessionState status before performing cleanup >

[jira] [Updated] (HIVE-12450) OrcFileMergeOperator does not use correct compression buffer size

2015-11-18 Thread Prasanth Jayachandran (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-12450?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Prasanth Jayachandran updated HIVE-12450: - Attachment: zlib-hang.png HIVE-12450.3.patch Added test case that

[jira] [Commented] (HIVE-9599) remove derby, datanucleus and other not related to jdbc client classes from hive-jdbc-standalone.jar

2015-11-18 Thread Thejas M Nair (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9599?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15012408#comment-15012408 ] Thejas M Nair commented on HIVE-9599: - +1 > remove derby, datanucleus and other not related to jdbc

[jira] [Commented] (HIVE-11499) Datanucleus leaks classloaders when used using embedded metastore with HiveServer2 with UDFs

2015-11-18 Thread Thejas M Nair (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-11499?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15012410#comment-15012410 ] Thejas M Nair commented on HIVE-11499: -- Created HIVE-12458 to remove the jar from source. >

[jira] [Commented] (HIVE-10897) LLAP: ArrayIndexOOB exception in new mapjoin

2015-11-18 Thread Matt McCline (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-10897?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15012383#comment-15012383 ] Matt McCline commented on HIVE-10897: - It is so old I don't think so > LLAP: ArrayIndexOOB

[jira] [Updated] (HIVE-12460) Fix branch-1 build

2015-11-18 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-12460?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuefu Zhang updated HIVE-12460: --- Attachment: HIVE-12460-branch-1.patch > Fix branch-1 build > -- > >

[jira] [Commented] (HIVE-12460) Fix branch-1 build

2015-11-18 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-12460?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15012700#comment-15012700 ] Xuefu Zhang commented on HIVE-12460: Attached the patch to fix hadoop-2 build. hadoop-1 build is

[jira] [Assigned] (HIVE-12461) Branch-1 -Phadoop-1 build is broken

2015-11-18 Thread Aleksei Statkevich (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-12461?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aleksei Statkevich reassigned HIVE-12461: - Assignee: Aleksei Statkevich > Branch-1 -Phadoop-1 build is broken >

[jira] [Commented] (HIVE-12434) Merge spark into master 11/17/1015

2015-11-18 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-12434?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15012067#comment-15012067 ] Xuefu Zhang commented on HIVE-12434: Committed to master to avoid staleness. Let me know if you have

[jira] [Updated] (HIVE-9139) Clean up GenSparkProcContext.clonedReduceSinks and related code [Spark Branch]

2015-11-18 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9139?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuefu Zhang updated HIVE-9139: -- Fix Version/s: 2.0.0 > Clean up GenSparkProcContext.clonedReduceSinks and related code [Spark Branch] >

[jira] [Commented] (HIVE-12017) Do not disable CBO by default when number of joins in a query is equal or less than 1

2015-11-18 Thread Ashutosh Chauhan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-12017?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15012167#comment-15012167 ] Ashutosh Chauhan commented on HIVE-12017: - Went through latest updates. [~jcamachorodriguez] can

[jira] [Commented] (HIVE-12300) deprecate MR in Hive 2.0

2015-11-18 Thread Sushanth Sowmyan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-12300?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15012310#comment-15012310 ] Sushanth Sowmyan commented on HIVE-12300: - Looks reasonable, +1. I was half surprised you didn't

[jira] [Commented] (HIVE-12436) Default hive.metastore.schema.verification to true

2015-11-18 Thread Hive QA (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-12436?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15012447#comment-15012447 ] Hive QA commented on HIVE-12436: Here are the results of testing the latest attachment:

[jira] [Commented] (HIVE-12175) Upgrade Kryo version to 3.0.x

2015-11-18 Thread Prasanth Jayachandran (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-12175?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15012696#comment-15012696 ] Prasanth Jayachandran commented on HIVE-12175: -- Fixes some more tests. > Upgrade Kryo

[jira] [Updated] (HIVE-12175) Upgrade Kryo version to 3.0.x

2015-11-18 Thread Prasanth Jayachandran (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-12175?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Prasanth Jayachandran updated HIVE-12175: - Attachment: HIVE-12175.5.patch > Upgrade Kryo version to 3.0.x >

[jira] [Assigned] (HIVE-12460) Fix branch-1 build

2015-11-18 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-12460?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuefu Zhang reassigned HIVE-12460: -- Assignee: Xuefu Zhang > Fix branch-1 build > -- > > Key:

[jira] [Updated] (HIVE-12461) Branch-1 -Phadoop-1 build is broken

2015-11-18 Thread Aleksei Statkevich (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-12461?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aleksei Statkevich updated HIVE-12461: -- Attachment: HIVE-12461-branch-1.patch There are 2 problems that cause build failure.

[jira] [Updated] (HIVE-11180) Enable native vectorized map join for spark [Spark Branch]

2015-11-18 Thread Lefty Leverenz (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-11180?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lefty Leverenz updated HIVE-11180: -- Labels: TODOC-SPARK TODOC1.3 (was: TODOC-SPARK) > Enable native vectorized map join for spark

  1   2   >