[jira] [Commented] (HIVE-14359) Hive on Spark might fail in HS2 with LDAP authentication in a kerberized cluster

2016-07-27 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-14359?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15395882#comment-15395882 ] Xuefu Zhang commented on HIVE-14359: +1. Just curious, the change in direct sql code i

[jira] [Commented] (HIVE-13688) Variable substitutions not working for shell commands in beeline

2016-07-26 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-13688?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15394588#comment-15394588 ] Xuefu Zhang commented on HIVE-13688: There are 4 kinds of variables, including system

[jira] [Commented] (HIVE-14346) Change the default value for hive.mapred.mode to null

2016-07-26 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-14346?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15394566#comment-15394566 ] Xuefu Zhang commented on HIVE-14346: +1 pending on test. > Change the default value f

[jira] [Commented] (HIVE-12727) refactor Hive strict checks to be more granular, allow order by no limit and no partition filter by default for now

2016-07-26 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-12727?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15394138#comment-15394138 ] Xuefu Zhang commented on HIVE-12727: It seems to be that the default value for hive.ma

[jira] [Commented] (HIVE-12727) refactor Hive strict checks to be more granular, allow order by no limit and no partition filter by default for now

2016-07-25 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-12727?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15392935#comment-15392935 ] Xuefu Zhang commented on HIVE-12727: My understanding is that hive.mapred.mode=strict

[jira] [Commented] (HIVE-14303) CommonJoinOperator.checkAndGenObject should return directly at CLOSE state to avoid NPE if ExecReducer.close is called twice.

2016-07-25 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-14303?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15392870#comment-15392870 ] Xuefu Zhang commented on HIVE-14303: Is it more logical if we check if reducer is null

[jira] [Commented] (HIVE-14305) To/From UTC timestamp may return incorrect result because of DST

2016-07-25 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-14305?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15392682#comment-15392682 ] Xuefu Zhang commented on HIVE-14305: Does SPARK-16078 offer any idea for Hive? > To/F

[jira] [Commented] (HIVE-14315) Implement StatsProvidingRecordReader for ParquetRecordReaderWrapper

2016-07-25 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-14315?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15392628#comment-15392628 ] Xuefu Zhang commented on HIVE-14315: +1 > Implement StatsProvidingRecordReader for Pa

[jira] [Commented] (HIVE-13688) Variable substitutions not working for shell commands in beeline

2016-07-25 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-13688?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15392431#comment-15392431 ] Xuefu Zhang commented on HIVE-13688: That's an alternative, but I think this is going

[jira] [Commented] (HIVE-14327) Make RPC server inside Hive on Spark port range configuration

2016-07-25 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-14327?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15392092#comment-15392092 ] Xuefu Zhang commented on HIVE-14327: Looks like a dupe of HIVE-1. Yes, I think it

[jira] [Comment Edited] (HIVE-14315) Implement StatsProvidingRecordReader for ParquetRecordReaderWrapper

2016-07-23 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-14315?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15390706#comment-15390706 ] Xuefu Zhang edited comment on HIVE-14315 at 7/23/16 5:04 PM: -

[jira] [Commented] (HIVE-14315) Implement StatsProvidingRecordReader for ParquetRecordReaderWrapper

2016-07-23 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-14315?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15390706#comment-15390706 ] Xuefu Zhang commented on HIVE-14315: +1 pending on tests. > Implement StatsProvidingR

[jira] [Commented] (HIVE-14281) Issue in decimal multiplication

2016-07-19 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-14281?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15384459#comment-15384459 ] Xuefu Zhang commented on HIVE-14281: Not sure this is a problem though. The next row m

[jira] [Commented] (HIVE-14259) FileUtils.isSubDir may return incorrect result

2016-07-16 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-14259?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15380755#comment-15380755 ] Xuefu Zhang commented on HIVE-14259: The original implementation seems more interestin

[jira] [Commented] (HIVE-13873) Column pruning for nested fields

2016-07-15 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-13873?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15380194#comment-15380194 ] Xuefu Zhang commented on HIVE-13873: Thanks, [~Ferd]. Regarding #3, for array, there i

[jira] [Commented] (HIVE-14001) beeline doesn't give out an error when takes either "-e" or "-f" in command instead of both

2016-07-15 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-14001?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15379619#comment-15379619 ] Xuefu Zhang commented on HIVE-14001: Awesome! Thanks for the information and the work.

[jira] [Commented] (HIVE-14077) revert or fix HIVE-13380

2016-07-13 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-14077?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15375902#comment-15375902 ] Xuefu Zhang commented on HIVE-14077: RE. Also I thought Hive does strive to be ANSI co

[jira] [Commented] (HIVE-14001) beeline doesn't give out an error when takes either "-e" or "-f" in command instead of both

2016-07-13 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-14001?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15375741#comment-15375741 ] Xuefu Zhang commented on HIVE-14001: Sorry for late reply. It would be great if we can

[jira] [Commented] (HIVE-14077) revert or fix HIVE-13380

2016-07-13 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-14077?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15375524#comment-15375524 ] Xuefu Zhang commented on HIVE-14077: Thanks for the clarification. Regarding ANSI, we

[jira] [Commented] (HIVE-14077) revert or fix HIVE-13380

2016-07-13 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-14077?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15375512#comment-15375512 ] Xuefu Zhang commented on HIVE-14077: Sorry for chiming in late, but I'm wonder what's

[jira] [Commented] (HIVE-13873) Column pruning for nested fields

2016-07-12 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-13873?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15374184#comment-15374184 ] Xuefu Zhang commented on HIVE-13873: [~Ferd], thanks for working on this. Patch looks

[jira] [Commented] (HIVE-14124) Spark app name should be in line with MapReduce app name when using Hive On Spark

2016-07-07 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-14124?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15366367#comment-15366367 ] Xuefu Zhang commented on HIVE-14124: Well, this is by design. Hive on Spark reuses the

[jira] [Comment Edited] (HIVE-13873) Column pruning for nested fields

2016-07-06 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-13873?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15364453#comment-15364453 ] Xuefu Zhang edited comment on HIVE-13873 at 7/6/16 3:24 PM: [~

[jira] [Commented] (HIVE-13873) Column pruning for nested fields

2016-07-06 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-13873?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15364453#comment-15364453 ] Xuefu Zhang commented on HIVE-13873: [~Ferd], thanks for working on this. I will be re

[jira] [Commented] (HIVE-14156) Problem with Chinese characters as partition value when using MySQL

2016-07-05 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-14156?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15362677#comment-15362677 ] Xuefu Zhang commented on HIVE-14156: Since the partition names are stored in underlyin

[jira] [Commented] (HIVE-13964) Add a parameter to beeline to allow a properties file to be passed in

2016-06-07 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-13964?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15319778#comment-15319778 ] Xuefu Zhang commented on HIVE-13964: Got it. Sounds good then. > Add a parameter to b

[jira] [Commented] (HIVE-13963) vectorization - string arguments may be converted to decimal null

2016-06-07 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-13963?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15319762#comment-15319762 ] Xuefu Zhang commented on HIVE-13963: Got it. Thanks for the explanation. Yeah, casting

[jira] [Commented] (HIVE-13968) CombineHiveInputFormat does not honor InputFormat that implements AvoidSplitCombination

2016-06-07 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-13968?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15319722#comment-15319722 ] Xuefu Zhang commented on HIVE-13968: [~lirui], it seemed you did the original work. Wo

[jira] [Commented] (HIVE-13964) Add a parameter to beeline to allow a properties file to be passed in

2016-06-07 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-13964?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15319720#comment-15319720 ] Xuefu Zhang commented on HIVE-13964: We cannot just bring what's removed from HIVE-665

[jira] [Commented] (HIVE-13963) vectorization - string arguments may be converted to decimal null

2016-06-07 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-13963?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15319715#comment-15319715 ] Xuefu Zhang commented on HIVE-13963: Re. The default precision and scale for the impli

[jira] [Commented] (HIVE-13760) Add a HIVE_QUERY_TIMEOUT configuration to kill a query if a query is running for more than the configured timeout value.

2016-06-06 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-13760?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15317878#comment-15317878 ] Xuefu Zhang commented on HIVE-13760: cool. sounds good then. > Add a HIVE_QUERY_TIMEO

[jira] [Comment Edited] (HIVE-13760) Add a HIVE_QUERY_TIMEOUT configuration to kill a query if a query is running for more than the configured timeout value.

2016-06-06 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-13760?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15317586#comment-15317586 ] Xuefu Zhang edited comment on HIVE-13760 at 6/7/16 1:04 AM: I'

[jira] [Commented] (HIVE-13760) Add a HIVE_QUERY_TIMEOUT configuration to kill a query if a query is running for more than the configured timeout value.

2016-06-06 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-13760?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15317586#comment-15317586 ] Xuefu Zhang commented on HIVE-13760: It seems to me that the patch doesn't work as exp

[jira] [Commented] (HIVE-13895) HoS start-up overhead in yarn-client mode

2016-05-30 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-13895?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15306579#comment-15306579 ] Xuefu Zhang commented on HIVE-13895: +1 > HoS start-up overhead in yarn-client mode >

[jira] [Commented] (HIVE-13873) Column pruning for nested fields

2016-05-26 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-13873?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15303487#comment-15303487 ] Xuefu Zhang commented on HIVE-13873: FYI, [~Ferd] > Column pruning for nested fields

[jira] [Commented] (HIVE-13376) HoS emits too many logs with application state

2016-05-26 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-13376?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15303395#comment-15303395 ] Xuefu Zhang commented on HIVE-13376: Sounds good to me, [~lirui]. Disabling spark.yarn

[jira] [Commented] (HIVE-13376) HoS emits too many logs with application state

2016-05-26 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-13376?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15302634#comment-15302634 ] Xuefu Zhang commented on HIVE-13376: [~lirui], There are some suggestions in HIVE-1256

[jira] [Commented] (HIVE-13376) HoS emits too many logs with application state

2016-05-25 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-13376?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15300301#comment-15300301 ] Xuefu Zhang commented on HIVE-13376: Yeah. I meant that maybe we don't need to change

[jira] [Commented] (HIVE-13376) HoS emits too many logs with application state

2016-05-25 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-13376?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15300039#comment-15300039 ] Xuefu Zhang commented on HIVE-13376: I think the issue is about logging, not about sta

[jira] [Commented] (HIVE-13813) Add Metrics for the number of Hive operations waiting for compile

2016-05-20 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-13813?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15294491#comment-15294491 ] Xuefu Zhang commented on HIVE-13813: Patch looks good to me, but it's good if [~jxiang

[jira] [Commented] (HIVE-13782) Compile async query asynchronously

2016-05-19 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-13782?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15291518#comment-15291518 ] Xuefu Zhang commented on HIVE-13782: +1 > Compile async query asynchronously > --

[jira] [Commented] (HIVE-13789) Repeatedly checking configuration in TextRecordWriter/Reader hurts performance

2016-05-19 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-13789?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15291332#comment-15291332 ] Xuefu Zhang commented on HIVE-13789: +1 > Repeatedly checking configuration in TextRe

[jira] [Commented] (HIVE-13293) Query occurs performance degradation after enabling parallel order by for Hive on Spark

2016-05-16 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-13293?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15286005#comment-15286005 ] Xuefu Zhang commented on HIVE-13293: Please commit. Thanks. > Query occurs performanc

[jira] [Updated] (HIVE-13760) Add a HIVE_QUERY_TIMEOUT configuration to kill a query if a query is running for more than the configured timeout value.

2016-05-16 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-13760?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuefu Zhang updated HIVE-13760: --- Assignee: zhihai xu > Add a HIVE_QUERY_TIMEOUT configuration to kill a query if a query is running >

[jira] [Commented] (HIVE-13688) Variable substitutions not working for shell commands in beeline

2016-05-13 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-13688?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15282871#comment-15282871 ] Xuefu Zhang commented on HIVE-13688: I think this is by design. The main question was

[jira] [Commented] (HIVE-13293) Query occurs performance degradation after enabling parallel order by for Hive on Spark

2016-05-13 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-13293?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15282841#comment-15282841 ] Xuefu Zhang commented on HIVE-13293: Hi [~lirui], Is checking num of partitions necess

[jira] [Commented] (HIVE-13293) Query occurs performance degradation after enabling parallel order by for Hive on Spark

2016-05-11 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-13293?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15280380#comment-15280380 ] Xuefu Zhang commented on HIVE-13293: Okay. Sounds good. +1 > Query occurs performance

[jira] [Commented] (HIVE-13293) Query occurs performance degradation after enabling parallel order by for Hive on Spark

2016-05-11 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-13293?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15280312#comment-15280312 ] Xuefu Zhang commented on HIVE-13293: [~lirui], thanks for working on this. The patch l

[jira] [Commented] (HIVE-13525) HoS hangs when job is empty

2016-05-07 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-13525?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15275468#comment-15275468 ] Xuefu Zhang commented on HIVE-13525: Thanks for the explanation, [~lirui]. +1. > HoS

[jira] [Commented] (HIVE-13525) HoS hangs when job is empty

2016-05-07 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-13525?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15275251#comment-15275251 ] Xuefu Zhang commented on HIVE-13525: Hi [~lirui], thanks for working on this. The patc

[jira] [Commented] (HIVE-13688) Variable substitutions not working for shell commands in beeline

2016-05-04 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-13688?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15271574#comment-15271574 ] Xuefu Zhang commented on HIVE-13688: Hi [~ngangam], I think the code you're referring

[jira] [Commented] (HIVE-13688) Variable substitutions not working for shell commands in beeline

2016-05-04 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-13688?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15271386#comment-15271386 ] Xuefu Zhang commented on HIVE-13688: I don't believe this is a bug. Hive variables are

[jira] [Updated] (HIVE-13611) add jar causes beeline not to output log messages

2016-04-26 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-13611?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuefu Zhang updated HIVE-13611: --- Description: After adding a jar in beeline warning messages and job log ouptut are no longer shown. T

[jira] [Updated] (HIVE-13534) ClassCastException when trying to access TIMESTAMP columns into parquet file using hive external table

2016-04-18 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-13534?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuefu Zhang updated HIVE-13534: --- Summary: ClassCastException when trying to access TIMESTAMP columns into parquet file using hive exter

[jira] [Updated] (HIVE-13534) Exception when trying to access TIMESTAMP columns into parquet file using hive external table

2016-04-18 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-13534?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuefu Zhang updated HIVE-13534: --- Summary: Exception when trying to access TIMESTAMP columns into parquet file using hive external table

[jira] [Commented] (HIVE-13525) HoS hangs when job is empty

2016-04-18 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-13525?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15245821#comment-15245821 ] Xuefu Zhang commented on HIVE-13525: Yes, I meant to suggest moving the increment outs

[jira] [Commented] (HIVE-13525) HoS hangs when job is empty

2016-04-17 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-13525?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15244806#comment-15244806 ] Xuefu Zhang commented on HIVE-13525: Thanks for working on this, [~lirui]. The explana

[jira] [Commented] (HIVE-13293) Query occurs performance degradation after enabling parallel order by for Hive on Spark

2016-04-12 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-13293?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15237434#comment-15237434 ] Xuefu Zhang commented on HIVE-13293: [~lirui], thanks for the investigation and the pa

[jira] [Updated] (HIVE-13422) Analyse command not working for column having datatype as decimal(38,0)

2016-04-08 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-13422?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuefu Zhang updated HIVE-13422: --- Description: For the repro {code} drop table sample_test; CREATE TABLE IF NOT EXISTS sample_test( key

[jira] [Updated] (HIVE-13422) Analyse command not working for column having datatype as decimal(38,0)

2016-04-08 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-13422?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuefu Zhang updated HIVE-13422: --- Description: For the repro {code} drop table sample_test; CREATE TABLE IF NOT EXISTS sample_test( key

[jira] [Issue Comment Deleted] (HIVE-13422) Analyse command not working for column having datatype as decimal(38,0)

2016-04-08 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-13422?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuefu Zhang updated HIVE-13422: --- Comment: was deleted (was: For the repro drop table sample_test; CREATE TABLE IF NOT EXISTS sample_tes

[jira] [Updated] (HIVE-13422) Analyse command not working for column having datatype as decimal(38,0)

2016-04-08 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-13422?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuefu Zhang updated HIVE-13422: --- Description: For the repro drop table sample_test; CREATE TABLE IF NOT EXISTS sample_test( key decimal

[jira] [Commented] (HIVE-13415) Decouple Sessions from thrift binary transport

2016-04-05 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-13415?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15227162#comment-15227162 ] Xuefu Zhang commented on HIVE-13415: Maybe we should consider closing any synchronous

[jira] [Commented] (HIVE-13415) Decouple Sessions from thrift binary transport

2016-04-05 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-13415?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15226238#comment-15226238 ] Xuefu Zhang commented on HIVE-13415: The patch seems merely reverting HIVE-9601. I'm w

[jira] [Commented] (HIVE-12650) Spark-submit is killed when Hive times out. Killing spark-submit doesn't cancel AM request. When AM is finally launched, it tries to connect back to Hive and gets refus

2016-03-31 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-12650?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15221149#comment-15221149 ] Xuefu Zhang commented on HIVE-12650: +1. Patch looks good to me. Thanks for working on

[jira] [Commented] (HIVE-13380) Decimal should have lower precedence than double in type hierachy

2016-03-31 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-13380?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15220329#comment-15220329 ] Xuefu Zhang commented on HIVE-13380: Yeah, but the concern is that 2.0 is already rele

[jira] [Commented] (HIVE-13380) Decimal should have lower precedence than double in type hierachy

2016-03-30 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-13380?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15219269#comment-15219269 ] Xuefu Zhang commented on HIVE-13380: I think this came to discussion in the past, and

[jira] [Resolved] (HIVE-12569) Excessive console message from SparkClientImpl [Spark Branch]

2016-03-30 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-12569?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuefu Zhang resolved HIVE-12569. Resolution: Duplicate > Excessive console message from SparkClientImpl [Spark Branch] >

[jira] [Commented] (HIVE-13376) HoS emits too many logs with application state

2016-03-30 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-13376?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15219230#comment-15219230 ] Xuefu Zhang commented on HIVE-13376: +1 on my side too. As a side note, this is a dupe

[jira] [Commented] (HIVE-12650) Spark-submit is killed when Hive times out. Killing spark-submit doesn't cancel AM request. When AM is finally launched, it tries to connect back to Hive and gets refus

2016-03-24 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-12650?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15211391#comment-15211391 ] Xuefu Zhang commented on HIVE-12650: Thanks, Rui. I think it's fine to list all possib

[jira] [Commented] (HIVE-12650) Spark-submit is killed when Hive times out. Killing spark-submit doesn't cancel AM request. When AM is finally launched, it tries to connect back to Hive and gets refus

2016-03-23 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-12650?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15208398#comment-15208398 ] Xuefu Zhang commented on HIVE-12650: I was thinking of just improving the current mess

[jira] [Commented] (HIVE-13308) HiveOnSpark sumbit query very slow when hundred of beeline exectue at same time

2016-03-23 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-13308?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15208405#comment-15208405 ] Xuefu Zhang commented on HIVE-13308: [~ruili], any thoughts on this? > HiveOnSpark su

[jira] [Commented] (HIVE-12984) spark tgz-s need to be deleted on mvn clean, as are other binary artifacts in the tree

2016-03-23 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-12984?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15208353#comment-15208353 ] Xuefu Zhang commented on HIVE-12984: The tarball contains not just jars, but also any

[jira] [Comment Edited] (HIVE-13300) Hive on spark throws exception for multi-insert with join

2016-03-22 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-13300?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15207176#comment-15207176 ] Xuefu Zhang edited comment on HIVE-13300 at 3/22/16 8:24 PM: -

[jira] [Commented] (HIVE-13300) Hive on spark throws exception for multi-insert with join

2016-03-22 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-13300?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15207176#comment-15207176 ] Xuefu Zhang commented on HIVE-13300: +1 > Hive on spark throws exception for multi-in

[jira] [Commented] (HIVE-13300) Hive on spark throws exception for multi-insert with join

2016-03-21 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-13300?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15205293#comment-15205293 ] Xuefu Zhang commented on HIVE-13300: We should be able to make a keywritable directly

[jira] [Commented] (HIVE-12650) Spark-submit is killed when Hive times out. Killing spark-submit doesn't cancel AM request. When AM is finally launched, it tries to connect back to Hive and gets refus

2016-03-21 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-12650?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15205200#comment-15205200 ] Xuefu Zhang commented on HIVE-12650: Since Hive cannot really differentiate the scenar

[jira] [Commented] (HIVE-13277) Exception "Unable to create serializer 'org.apache.hive.com.esotericsoftware.kryo.serializers.FieldSerializer' " occurred during query execution on spark engine when ve

2016-03-19 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-13277?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15200771#comment-15200771 ] Xuefu Zhang commented on HIVE-13277: [~lirui], thanks for for your investigation. Whil

[jira] [Commented] (HIVE-13293) Query occurs performance degradation after enabling parallel order by for Hive on sprak

2016-03-19 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-13293?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15197341#comment-15197341 ] Xuefu Zhang commented on HIVE-13293: Yes, the result can vary from query to query due

[jira] [Commented] (HIVE-13292) Different DOUBLE type precision issue between Spark and MR engine

2016-03-19 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-13292?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15197317#comment-15197317 ] Xuefu Zhang commented on HIVE-13292: Yeah. Doubles are implemented in many programming

[jira] [Commented] (HIVE-13293) Query occurs performance degradation after enabling parallel order by for Hive on sprak

2016-03-18 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-13293?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15198647#comment-15198647 ] Xuefu Zhang commented on HIVE-13293: [~lirui], that sounds like a viable optimization.

[jira] [Commented] (HIVE-12619) Switching the field order within an array of structs causes the query to fail

2016-03-15 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-12619?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15196198#comment-15196198 ] Xuefu Zhang commented on HIVE-12619: Patch #3 seems simpler and fixing the field order

[jira] [Commented] (HIVE-13278) Many redundant 'File not found' messages appeared in container log during query execution with Hive on Spark

2016-03-14 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-13278?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15194499#comment-15194499 ] Xuefu Zhang commented on HIVE-13278: [~xhao1], to clarify, this problem doesn't preven

[jira] [Updated] (HIVE-13276) Hive on Spark doesn't work when spark.master=local

2016-03-14 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-13276?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuefu Zhang updated HIVE-13276: --- Assignee: (was: Xuefu Zhang) > Hive on Spark doesn't work when spark.master=local > --

[jira] [Commented] (HIVE-13237) Select parquet struct field with upper case throws NPE

2016-03-08 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-13237?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15186362#comment-15186362 ] Xuefu Zhang commented on HIVE-13237: Patch looks good to me. [~jxiang], could you plea

[jira] [Commented] (HIVE-12045) ClassNotFoundException for GenericUDF [Spark Branch]

2016-03-04 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-12045?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15180316#comment-15180316 ] Xuefu Zhang commented on HIVE-12045: [~ztoth], yes, this is included in CDH5.7. > Cla

[jira] [Updated] (HIVE-13101) NullPointerException in HiveLexer.g

2016-02-24 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-13101?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuefu Zhang updated HIVE-13101: --- Resolution: Fixed Fix Version/s: 2.1.0 Status: Resolved (was: Patch Available) Comm

[jira] [Commented] (HIVE-11125) when i run a sql use hive on spark, it seem like the hive cli finished, but the application is always running

2016-02-24 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-11125?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15163069#comment-15163069 ] Xuefu Zhang commented on HIVE-11125: Yes, you can. However, a better way is to set a s

[jira] [Issue Comment Deleted] (HIVE-13123) Encountered unregistered class ID

2016-02-23 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-13123?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuefu Zhang updated HIVE-13123: --- Comment: was deleted (was: you can show me hive-exe-1.2.1.jar which solved the problem of Kryo by ema

[jira] [Commented] (HIVE-13066) Hive on Spark gives incorrect results when speculation is on

2016-02-22 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-13066?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15158323#comment-15158323 ] Xuefu Zhang commented on HIVE-13066: Hi [~lirui], thanks for working on this. The chan

[jira] [Updated] (HIVE-13045) move guava dependency back to 14 after HIVE-12952

2016-02-19 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-13045?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuefu Zhang updated HIVE-13045: --- Resolution: Fixed Fix Version/s: 2.1.0 Status: Resolved (was: Patch Available) Comm

[jira] [Updated] (HIVE-13057) Remove duplicate copies of TableDesc property values in PartitionDesc

2016-02-19 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-13057?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuefu Zhang updated HIVE-13057: --- Resolution: Fixed Fix Version/s: 2.1.0 Status: Resolved (was: Patch Available) Comm

[jira] [Commented] (HIVE-13057) Remove duplicate copies of TableDesc property values in PartitionDesc

2016-02-19 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-13057?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15154649#comment-15154649 ] Xuefu Zhang commented on HIVE-13057: +1 LGTM > Remove duplicate copies of TableDesc p

[jira] [Commented] (HIVE-13045) move guava dependency back to 14 after HIVE-12952

2016-02-18 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-13045?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15153222#comment-15153222 ] Xuefu Zhang commented on HIVE-13045: +1 > move guava dependency back to 14 after HIVE

[jira] [Updated] (HIVE-8073) Go thru all operator plan optimizations and disable those that are not suitable for Spark [Spark Branch]

2016-02-17 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8073?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuefu Zhang updated HIVE-8073: -- Fix Version/s: 2.0.0 > Go thru all operator plan optimizations and disable those that are not > suitable

[jira] [Updated] (HIVE-7831) Research commented out unset in Utiltities [Spark Branch]

2016-02-17 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-7831?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuefu Zhang updated HIVE-7831: -- Fix Version/s: (was: spark-branch) > Research commented out unset in Utiltities [Spark Branch] >

[jira] [Updated] (HIVE-8208) Multi-table insertion optimization #1: don't always break operator tree. [Spark Branch]

2016-02-17 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8208?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuefu Zhang updated HIVE-8208: -- Fix Version/s: (was: spark-branch) > Multi-table insertion optimization #1: don't always break operat

[jira] [Updated] (HIVE-9391) Spark doesn't obey setting hive.multigroupby.singlereducer

2016-02-17 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9391?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuefu Zhang updated HIVE-9391: -- Fix Version/s: (was: spark-branch) > Spark doesn't obey setting hive.multigroupby.singlereducer > ---

[jira] [Updated] (HIVE-8981) Not a directory error in mapjoin_hook.q [Spark Branch]

2016-02-17 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8981?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuefu Zhang updated HIVE-8981: -- Fix Version/s: (was: spark-branch) > Not a directory error in mapjoin_hook.q [Spark Branch] > ---

[jira] [Updated] (HIVE-7437) Check if servlet-api and jetty module in Spark library are an issue for hive-spark integration [Spark Branch]

2016-02-17 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-7437?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuefu Zhang updated HIVE-7437: -- Fix Version/s: (was: spark-branch) > Check if servlet-api and jetty module in Spark library are an is

<    2   3   4   5   6   7   8   9   10   11   >