Re: --hiveconf vs -hiveconf

2014-08-10 Thread Lefty Leverenz
All occurrences of -hiveconf in the wiki have been changed to --hiveconf except for one new sentence in the CLI command line options https://cwiki.apache.org/confluence/display/Hive/LanguageManual+Cli#LanguageManualCli-HiveCommandLineOptions section, which says it's also supported. The list of

[jira] [Assigned] (HIVE-7606) Design SparkSession, SparkSessionManager

2014-08-10 Thread Venki Korukanti (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-7606?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Venki Korukanti reassigned HIVE-7606: - Assignee: Venki Korukanti Design SparkSession, SparkSessionManager

[jira] [Updated] (HIVE-7593) Instantiate SparkClient per user session

2014-08-10 Thread Chinna Rao Lalam (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-7593?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chinna Rao Lalam updated HIVE-7593: --- Attachment: HIVE-7593-spark.patch Instantiate SparkClient per user session

[jira] [Commented] (HIVE-6959) Enable Constant propagation optimizer for Hive Vectorization

2014-08-10 Thread Ashutosh Chauhan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-6959?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14092194#comment-14092194 ] Ashutosh Chauhan commented on HIVE-6959: +1 Enable Constant propagation optimizer

[jira] [Updated] (HIVE-7506) MetadataUpdater: provide a mechanism to edit the statistics of a column in a table (or a partition of a table)

2014-08-10 Thread pengcheng xiong (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-7506?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] pengcheng xiong updated HIVE-7506: -- Attachment: HIVE-7506.5.patch new patch after addressing all Lars and Ashutosh's comments.

[jira] [Commented] (HIVE-7647) Beeline does not honor --headerInterval and --color when executing with -e

2014-08-10 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-7647?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14092252#comment-14092252 ] Xuefu Zhang commented on HIVE-7647: --- [~ngangam] The change seems simple and reasonable.

[jira] [Commented] (HIVE-7452) Boolean comparison is done through reference equality rather than using equals

2014-08-10 Thread KangHS (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-7452?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14092283#comment-14092283 ] KangHS commented on HIVE-7452: -- Thanks, Ashutosh Chauhan :) Boolean comparison is done

[jira] [Commented] (HIVE-7600) ConstantPropagateProcFactory uses reference equality on Boolean

2014-08-10 Thread KangHS (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-7600?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14092284#comment-14092284 ] KangHS commented on HIVE-7600: -- Thanks, Ashutosh Chauhan :) ConstantPropagateProcFactory

Re: Review Request 23674: Handle db qualified names consistently across all HiveQL statements

2014-08-10 Thread Navis Ryu
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/23674/ --- (Updated Aug. 11, 2014, 12:53 a.m.) Review request for hive and Thejas Nair.

[jira] [Updated] (HIVE-4064) Handle db qualified names consistently across all HiveQL statements

2014-08-10 Thread Navis (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-4064?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Navis updated HIVE-4064: Attachment: HIVE-4064.7.patch.txt Handle db qualified names consistently across all HiveQL statements

[jira] [Commented] (HIVE-7205) Wrong results when union all of grouping followed by group by with correlation optimization

2014-08-10 Thread Navis (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-7205?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14092308#comment-14092308 ] Navis commented on HIVE-7205: - [~ashutoshc] IMO, [~yhuai] is original author of this optimizer

[jira] [Updated] (HIVE-6847) Improve / fix bugs in Hive scratch dir setup

2014-08-10 Thread Vaibhav Gumashta (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-6847?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vaibhav Gumashta updated HIVE-6847: --- Attachment: HIVE-6847.2.patch Updated patch for review. cc [~szehon] [~jdere] Improve /

[jira] [Commented] (HIVE-7638) Disallow CREATE VIEW when created with a temporary table

2014-08-10 Thread Navis (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-7638?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14092312#comment-14092312 ] Navis commented on HIVE-7638: - Couldn't we introduce temporary view? Disallow CREATE VIEW

[jira] [Updated] (HIVE-7592) List Jars or Files are not supported by Beeline

2014-08-10 Thread Navis (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-7592?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Navis updated HIVE-7592: Resolution: Fixed Fix Version/s: 0.14.0 Status: Resolved (was: Patch Available) Committed to

[jira] [Commented] (HIVE-5718) Support direct fetch for lateral views, sub queries, etc.

2014-08-10 Thread Navis (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-5718?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14092317#comment-14092317 ] Navis commented on HIVE-5718: - tez_join_hash.q looks suspicious but cannot reproduce. Others

[jira] [Updated] (HIVE-7390) Make quote character optional and configurable in BeeLine CSV/TSV output

2014-08-10 Thread Ferdinand Xu (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-7390?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ferdinand Xu updated HIVE-7390: --- Attachment: HIVE-7390.9.patch Latest version for Lars comments Make quote character optional and

[jira] [Commented] (HIVE-7647) Beeline does not honor --headerInterval and --color when executing with -e

2014-08-10 Thread Naveen Gangam (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-7647?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14092359#comment-14092359 ] Naveen Gangam commented on HIVE-7647: - [~xuefuz] I checked the history it was part of

[jira] [Updated] (HIVE-6959) Enable Constant propagation optimizer for Hive Vectorization

2014-08-10 Thread Ashutosh Chauhan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-6959?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ashutosh Chauhan updated HIVE-6959: --- Component/s: Vectorization Enable Constant propagation optimizer for Hive Vectorization

[jira] [Updated] (HIVE-6959) Enable Constant propagation optimizer for Hive Vectorization

2014-08-10 Thread Ashutosh Chauhan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-6959?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ashutosh Chauhan updated HIVE-6959: --- Affects Version/s: 0.14.0 Enable Constant propagation optimizer for Hive Vectorization

[jira] [Updated] (HIVE-6959) Enable Constant propagation optimizer for Hive Vectorization

2014-08-10 Thread Ashutosh Chauhan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-6959?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ashutosh Chauhan updated HIVE-6959: --- Resolution: Fixed Fix Version/s: 0.14.0 Status: Resolved (was: Patch

[jira] [Updated] (HIVE-7521) Reference equality is used on Boolean in NullScanOptimizer#WhereFalseProcessor#process()

2014-08-10 Thread Ashutosh Chauhan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-7521?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ashutosh Chauhan updated HIVE-7521: --- Resolution: Fixed Fix Version/s: 0.14.0 Status: Resolved (was: Patch

[jira] [Updated] (HIVE-7521) Reference equality is used on Boolean in NullScanOptimizer#WhereFalseProcessor#process()

2014-08-10 Thread Ashutosh Chauhan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-7521?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ashutosh Chauhan updated HIVE-7521: --- Component/s: Physical Optimizer Reference equality is used on Boolean in

[jira] [Updated] (HIVE-7521) Reference equality is used on Boolean in NullScanOptimizer#WhereFalseProcessor#process()

2014-08-10 Thread Ashutosh Chauhan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-7521?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ashutosh Chauhan updated HIVE-7521: --- Affects Version/s: 0.14.0 Reference equality is used on Boolean in

[jira] [Commented] (HIVE-7521) Reference equality is used on Boolean in NullScanOptimizer#WhereFalseProcessor#process()

2014-08-10 Thread Ashutosh Chauhan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-7521?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14092382#comment-14092382 ] Ashutosh Chauhan commented on HIVE-7521: Committed to trunk. Thanks, Kang HS!

[jira] [Updated] (HIVE-7419) Missing break in SemanticAnalyzer#getTableDescFromSerDe()

2014-08-10 Thread Ashutosh Chauhan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-7419?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ashutosh Chauhan updated HIVE-7419: --- Resolution: Fixed Fix Version/s: 0.14.0 Status: Resolved (was: Patch

[jira] [Updated] (HIVE-7419) Missing break in SemanticAnalyzer#getTableDescFromSerDe()

2014-08-10 Thread Ashutosh Chauhan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-7419?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ashutosh Chauhan updated HIVE-7419: --- Assignee: Navis Missing break in SemanticAnalyzer#getTableDescFromSerDe()

Re: Review Request 24467: HIVE-7373: Hive should not remove trailing zeros for decimal numbers

2014-08-10 Thread Sergio Pena
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/24467/ --- (Updated Aug. 11, 2014, 3:23 a.m.) Review request for hive. Changes ---

[jira] [Created] (HIVE-7672) Potential resource leak in EximUtil#createExportDump()

2014-08-10 Thread Ted Yu (JIRA)
Ted Yu created HIVE-7672: Summary: Potential resource leak in EximUtil#createExportDump() Key: HIVE-7672 URL: https://issues.apache.org/jira/browse/HIVE-7672 Project: Hive Issue Type: Bug

Re: Review Request 23674: Handle db qualified names consistently across all HiveQL statements

2014-08-10 Thread Lefty Leverenz
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/23674/#review50132 --- ql/src/java/org/apache/hadoop/hive/ql/exec/Utilities.java

[jira] [Commented] (HIVE-4064) Handle db qualified names consistently across all HiveQL statements

2014-08-10 Thread Hive QA (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-4064?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14092412#comment-14092412 ] Hive QA commented on HIVE-4064: --- {color:red}Overall{color}: -1 at least one tests failed

[jira] [Updated] (HIVE-7592) List Jars or Files are not supported by Beeline

2014-08-10 Thread Lefty Leverenz (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-7592?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lefty Leverenz updated HIVE-7592: - Labels: TODOC14 (was: ) List Jars or Files are not supported by Beeline

[jira] [Created] (HIVE-7673) database missing from output WriteEntity for create-table-as-select

2014-08-10 Thread Thejas M Nair (JIRA)
Thejas M Nair created HIVE-7673: --- Summary: database missing from output WriteEntity for create-table-as-select Key: HIVE-7673 URL: https://issues.apache.org/jira/browse/HIVE-7673 Project: Hive

Re: Review Request 23674: Handle db qualified names consistently across all HiveQL statements

2014-08-10 Thread Thejas Nair
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/23674/#review50141 --- Ship it! Ship It! - Thejas Nair On Aug. 11, 2014, 12:53 a.m.,

[jira] [Commented] (HIVE-4064) Handle db qualified names consistently across all HiveQL statements

2014-08-10 Thread Thejas M Nair (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-4064?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14092429#comment-14092429 ] Thejas M Nair commented on HIVE-4064: - +1 Handle db qualified names consistently

[jira] [Updated] (HIVE-7673) database missing from output WriteEntity for create-table-as-select

2014-08-10 Thread Thejas M Nair (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-7673?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Thejas M Nair updated HIVE-7673: Attachment: HIVE-7673.1.patch database missing from output WriteEntity for create-table-as-select

[jira] [Commented] (HIVE-7592) List Jars or Files are not supported by Beeline

2014-08-10 Thread Lefty Leverenz (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-7592?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14092432#comment-14092432 ] Lefty Leverenz commented on HIVE-7592: -- Doc note: This should be described in the

Re: Review Request 24445: HIVE-7642, Set hive input format by configuration.

2014-08-10 Thread Brock Noland
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/24445/#review50144 --- Hi, Thank you very much for taking this on! I have one question

Re: Review Request 24377: HIVE-7142 Hive multi serialization encoding support

2014-08-10 Thread Brock Noland
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/24377/#review50145 --- Ultimately it'd be nice to make Hive's internal codec configurable.

[jira] [Updated] (HIVE-7540) NotSerializableException encountered when using sortByKey transformation

2014-08-10 Thread Brock Noland (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-7540?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brock Noland updated HIVE-7540: --- Attachment: HIVE-7540.3-spark.patch The following patch adds a repository which I control. I can push

[jira] [Resolved] (HIVE-7540) NotSerializableException encountered when using sortByKey transformation

2014-08-10 Thread Brock Noland (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-7540?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brock Noland resolved HIVE-7540. Resolution: Fixed Fix Version/s: spark-branch Thank you very much for your contribution! I

[jira] [Updated] (HIVE-7674) Update to Spark 1.1

2014-08-10 Thread Brock Noland (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-7674?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brock Noland updated HIVE-7674: --- Issue Type: Sub-task (was: Task) Parent: HIVE-7292 Update to Spark 1.1 ---

[jira] [Created] (HIVE-7674) Update to Spark 1.1

2014-08-10 Thread Brock Noland (JIRA)
Brock Noland created HIVE-7674: -- Summary: Update to Spark 1.1 Key: HIVE-7674 URL: https://issues.apache.org/jira/browse/HIVE-7674 Project: Hive Issue Type: Task Components: Spark

[jira] [Updated] (HIVE-7674) Update to Spark 1.1

2014-08-10 Thread Brock Noland (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-7674?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brock Noland updated HIVE-7674: --- Priority: Blocker (was: Major) Update to Spark 1.1 --- Key:

[jira] [Updated] (HIVE-7653) Hive AvroSerDe does not support circular references in Schema

2014-08-10 Thread Sachin Goyal (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-7653?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sachin Goyal updated HIVE-7653: --- Attachment: HIVE-7653.2.patch Attaching patch file created using {code} git diff HIVE-7653.2.patch

[jira] [Commented] (HIVE-6847) Improve / fix bugs in Hive scratch dir setup

2014-08-10 Thread Hive QA (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-6847?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14092455#comment-14092455 ] Hive QA commented on HIVE-6847: --- {color:red}Overall{color}: -1 at least one tests failed

[jira] [Commented] (HIVE-7521) Reference equality is used on Boolean in NullScanOptimizer#WhereFalseProcessor#process()

2014-08-10 Thread KangHS (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-7521?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14092468#comment-14092468 ] KangHS commented on HIVE-7521: -- Thanks, Ashutosh Chauhan :) Reference equality is used on

[jira] [Resolved] (HIVE-7332) Create SparkClient, interface to Spark cluster

2014-08-10 Thread Chengxiang Li (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-7332?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chengxiang Li resolved HIVE-7332. - Resolution: Fixed Create SparkClient, interface to Spark cluster

[jira] [Commented] (HIVE-7332) Create SparkClient, interface to Spark cluster

2014-08-10 Thread Chengxiang Li (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-7332?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14092479#comment-14092479 ] Chengxiang Li commented on HIVE-7332: - Added HIVE-7438, HIVE-7439 to track job status