[jira] [Updated] (HIVE-24280) Fix a potential NPE

2020-10-15 Thread Xuefu Zhang (Jira)
[ https://issues.apache.org/jira/browse/HIVE-24280?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuefu Zhang updated HIVE-24280: --- Status: Patch Available (was: Open) > Fix a potential NPE > --- > >

[jira] [Updated] (HIVE-24280) Fix a potential NPE

2020-10-15 Thread Xuefu Zhang (Jira)
[ https://issues.apache.org/jira/browse/HIVE-24280?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuefu Zhang updated HIVE-24280: --- Attachment: HIVE-24280.patch > Fix a potential NPE > --- > > Key: HIV

[jira] [Assigned] (HIVE-24280) Fix a potential NPE

2020-10-15 Thread Xuefu Zhang (Jira)
[ https://issues.apache.org/jira/browse/HIVE-24280?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuefu Zhang reassigned HIVE-24280: -- > Fix a potential NPE > --- > > Key: HIVE-24280 >

[jira] [Commented] (HIVE-19853) Arrow serializer needs to create a TimeStampMicroTZVector instead of TimeStampMicroVector

2020-07-21 Thread Xuefu Zhang (Jira)
[ https://issues.apache.org/jira/browse/HIVE-19853?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17162227#comment-17162227 ] Xuefu Zhang commented on HIVE-19853: Hi [~teddy.choi] and [~ewohlstadter], I unders

[jira] [Commented] (HIVE-23885) Remove Hive on Spark

2020-07-21 Thread Xuefu Zhang (Jira)
[ https://issues.apache.org/jira/browse/HIVE-23885?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17162113#comment-17162113 ] Xuefu Zhang commented on HIVE-23885: -1 I think this is a big decision that we need t

[jira] [Commented] (HIVE-22053) Function name is not normalized when creating function

2019-07-26 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-22053?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16893946#comment-16893946 ] Xuefu Zhang commented on HIVE-22053: It's surprising that the bug has been there for

[jira] [Commented] (HIVE-21524) Impala Engine

2019-03-27 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-21524?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16803073#comment-16803073 ] Xuefu Zhang commented on HIVE-21524: This sounds interesting. However, I'm trying to

[jira] [Commented] (HIVE-21035) Race condition in SparkUtilities#getSparkSession

2018-12-12 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-21035?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16719356#comment-16719356 ] Xuefu Zhang commented on HIVE-21035: [~asinkovits] Thanks for working on this. Maybe

[jira] [Commented] (HIVE-20721) Describe table sometimes shows "from deserializer" for column comments

2018-10-10 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-20721?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16645899#comment-16645899 ] Xuefu Zhang commented on HIVE-20721: Hi [~Ballesteros], have you tried "desc table" f

[jira] [Commented] (HIVE-20276) Hive UDF class getting Instantiated for each call of function

2018-07-31 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-20276?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16563838#comment-16563838 ] Xuefu Zhang commented on HIVE-20276: [~hardik1808] Could you give some code examples

[jira] [Commented] (HIVE-20261) Expose inputPartitionList in QueryPlan

2018-07-30 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-20261?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16562622#comment-16562622 ] Xuefu Zhang commented on HIVE-20261: +1 pending on test. [~zshao] thanks for working

[jira] [Commented] (HIVE-20141) Turn hive.spark.use.groupby.shuffle off by default

2018-07-11 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-20141?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16540335#comment-16540335 ] Xuefu Zhang commented on HIVE-20141: [~stakiar] Based on our benchmarking at Uber, gr

[jira] [Commented] (HIVE-20007) Hive should carry out timestamp computations in UTC

2018-06-27 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-20007?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16525488#comment-16525488 ] Xuefu Zhang commented on HIVE-20007: cc: [~lirui] > Hive should carry out timestamp

[jira] [Commented] (HIVE-19671) Distribute by rand() can lead to data inconsistency

2018-06-26 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-19671?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16523928#comment-16523928 ] Xuefu Zhang commented on HIVE-19671: Yeah. I think it makes sense. Thank. > Distribu

[jira] [Commented] (HIVE-19671) Distribute by rand() can lead to data inconsistency

2018-06-21 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-19671?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16519830#comment-16519830 ] Xuefu Zhang commented on HIVE-19671: Printing a warning is good, but we may not know

[jira] [Commented] (HIVE-19671) Distribute by rand() can lead to data inconsistency

2018-06-20 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-19671?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16518745#comment-16518745 ] Xuefu Zhang commented on HIVE-19671: Based on your analysis, it seems that random(see

[jira] [Commented] (HIVE-19937) Intern JobConf objects in Spark tasks

2018-06-19 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-19937?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16517674#comment-16517674 ] Xuefu Zhang commented on HIVE-19937: +1 > Intern JobConf objects in Spark tasks > --

[jira] [Commented] (HIVE-19671) Distribute by rand() can lead to data inconsistency

2018-05-29 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-19671?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16493796#comment-16493796 ] Xuefu Zhang commented on HIVE-19671: [~lirui] I think #1 is better. Nondeterministic

[jira] [Commented] (HIVE-19523) Decimal truncation for trailing zeros in Hive 1.2.1

2018-05-21 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-19523?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16483051#comment-16483051 ] Xuefu Zhang commented on HIVE-19523: {{HiveDecimal}} doesn't carry precision and scale

[jira] [Commented] (HIVE-18525) Add explain plan to Hive on Spark Web UI

2018-03-26 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18525?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16414268#comment-16414268 ] Xuefu Zhang commented on HIVE-18525: {quote} I haven't found a way to do that in the S

[jira] [Commented] (HIVE-18525) Add explain plan to Hive on Spark Web UI

2018-03-21 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18525?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16408965#comment-16408965 ] Xuefu Zhang commented on HIVE-18525: The feature looks good and useful to me. I don't

[jira] [Commented] (HIVE-18765) SparkClientImpl swallows exception messages from the RemoteDriver

2018-02-21 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18765?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16372363#comment-16372363 ] Xuefu Zhang commented on HIVE-18765: +1 pending on test. > SparkClientImpl swallows e

[jira] [Commented] (HIVE-18713) Optimize: Transform IN clauses to = when there's only one element

2018-02-14 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18713?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16364495#comment-16364495 ] Xuefu Zhang commented on HIVE-18713: Okay. Make sense. Thanks for the explanation. >

[jira] [Commented] (HIVE-18713) Optimize: Transform IN clauses to = when there's only one element

2018-02-14 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18713?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16364332#comment-16364332 ] Xuefu Zhang commented on HIVE-18713: I'm wondering if it's a good idea to extend this

[jira] [Commented] (HIVE-18442) HoS: No FileSystem for scheme: nullscan

2018-02-13 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18442?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16362690#comment-16362690 ] Xuefu Zhang commented on HIVE-18442: +1 to patch #1. > HoS: No FileSystem for scheme:

[jira] [Commented] (HIVE-18442) HoS: No FileSystem for scheme: nullscan

2018-02-12 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18442?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16361407#comment-16361407 ] Xuefu Zhang commented on HIVE-18442: Okay. It's fine to use {{fs.nullscan.impl}} to so

[jira] [Commented] (HIVE-18442) HoS: No FileSystem for scheme: nullscan

2018-02-09 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18442?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16359134#comment-16359134 ] Xuefu Zhang commented on HIVE-18442: [~lirui] Since it's a hack any way, is it okay ju

[jira] [Commented] (HIVE-18513) Query results caching

2018-02-02 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18513?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16350654#comment-16350654 ] Xuefu Zhang commented on HIVE-18513: That's good. As a minor comment, if we were only

[jira] [Commented] (HIVE-18442) HoS: No FileSystem for scheme: nullscan

2018-02-02 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18442?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16350627#comment-16350627 ] Xuefu Zhang commented on HIVE-18442: Regarding loading the jar twice, since we are loa

[jira] [Comment Edited] (HIVE-18513) Query results caching

2018-02-01 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18513?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16349716#comment-16349716 ] Xuefu Zhang edited comment on HIVE-18513 at 2/2/18 3:16 AM: Th

[jira] [Commented] (HIVE-18513) Query results caching

2018-02-01 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18513?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16349716#comment-16349716 ] Xuefu Zhang commented on HIVE-18513: Thanks, [~jcamachorodriguez] and [~jdere]. I went

[jira] [Commented] (HIVE-18513) Query results caching

2018-02-01 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18513?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16349703#comment-16349703 ] Xuefu Zhang commented on HIVE-18513: Could we have the high-level doc linked here so o

[jira] [Commented] (HIVE-18301) Investigate to enable MapInput cache in Hive on Spark

2018-01-31 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18301?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16347253#comment-16347253 ] Xuefu Zhang commented on HIVE-18301: It seems that IOContext is used in many places an

[jira] [Commented] (HIVE-18442) HoS: No FileSystem for scheme: nullscan

2018-01-31 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18442?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16347238#comment-16347238 ] Xuefu Zhang commented on HIVE-18442: Hi [~lirui], Thanks for the explanation. The patc

[jira] [Commented] (HIVE-18513) Query results caching

2018-01-26 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18513?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16341418#comment-16341418 ] Xuefu Zhang commented on HIVE-18513: [~jdere] Thanks for working on this useful featur

[jira] [Commented] (HIVE-18368) Improve Spark Debug RDD Graph

2018-01-24 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18368?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16338668#comment-16338668 ] Xuefu Zhang commented on HIVE-18368: [~stakiar] It may not be meaningful to all users,

[jira] [Commented] (HIVE-18368) Improve Spark Debug RDD Graph

2018-01-24 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18368?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16338395#comment-16338395 ] Xuefu Zhang commented on HIVE-18368: Thanks, [~stakiar].  As to the duplication, is i

[jira] [Commented] (HIVE-17257) Hive should merge empty files

2018-01-18 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17257?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16330994#comment-16330994 ] Xuefu Zhang commented on HIVE-17257: Thanks for the update, [~csun]. I also verified w

[jira] [Commented] (HIVE-14162) Allow disabling of long running job on Hive On Spark On YARN

2018-01-17 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-14162?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16329692#comment-16329692 ] Xuefu Zhang commented on HIVE-14162: Thanks, [~belugabehr]. I liked your thoughts and

[jira] [Commented] (HIVE-17257) Hive should merge empty files

2018-01-17 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17257?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16329018#comment-16329018 ] Xuefu Zhang commented on HIVE-17257: +1 for the patch. However, I'm not sure if those

[jira] [Commented] (HIVE-18442) HoS: No FileSystem for scheme: nullscan

2018-01-17 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18442?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16329014#comment-16329014 ] Xuefu Zhang commented on HIVE-18442: Hi [~lirui], thanks for working on this. Just cur

[jira] [Commented] (HIVE-14162) Allow disabling of long running job on Hive On Spark On YARN

2018-01-12 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-14162?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16324408#comment-16324408 ] Xuefu Zhang commented on HIVE-14162: The size of the driver is configurable. Minimum n

[jira] [Commented] (HIVE-14162) Allow disabling of long running job on Hive On Spark On YARN

2018-01-12 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-14162?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16324349#comment-16324349 ] Xuefu Zhang commented on HIVE-14162: [~belugabehr], Spark on Yarn is powered by a feat

[jira] [Commented] (HIVE-18434) Type is not determined correctly for comparison between decimal column and string constant

2018-01-11 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18434?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16323174#comment-16323174 ] Xuefu Zhang commented on HIVE-18434: Thanks for the explanation. While your patch may

[jira] [Commented] (HIVE-18434) Type is not determined correctly for comparison between decimal column and string constant

2018-01-11 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18434?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16322251#comment-16322251 ] Xuefu Zhang commented on HIVE-18434: Hi [~ashutoshc], thanks for working on this. Do y

[jira] [Commented] (HIVE-14162) Allow disabling of long running job on Hive On Spark On YARN

2018-01-10 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-14162?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16321254#comment-16321254 ] Xuefu Zhang commented on HIVE-14162: I don't quite follow why existing configurations

[jira] [Commented] (HIVE-18368) Improve Spark Debug RDD Graph

2018-01-09 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18368?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16319245#comment-16319245 ] Xuefu Zhang commented on HIVE-18368: Hi [~stakiar], thanks for working on this. I thin

[jira] [Commented] (HIVE-16484) Investigate SparkLauncher for HoS as alternative to bin/spark-submit

2018-01-09 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-16484?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16319187#comment-16319187 ] Xuefu Zhang commented on HIVE-16484: Cool. {quote} Once that gets started I'll work o

[jira] [Comment Edited] (HIVE-16484) Investigate SparkLauncher for HoS as alternative to bin/spark-submit

2018-01-08 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-16484?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16317336#comment-16317336 ] Xuefu Zhang edited comment on HIVE-16484 at 1/8/18 11:57 PM: -

[jira] [Commented] (HIVE-16484) Investigate SparkLauncher for HoS as alternative to bin/spark-submit

2018-01-08 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-16484?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16317336#comment-16317336 ] Xuefu Zhang commented on HIVE-16484: [~stakiar], I'm not denying the potential benefit

[jira] [Commented] (HIVE-16484) Investigate SparkLauncher for HoS as alternative to bin/spark-submit

2018-01-08 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-16484?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16317034#comment-16317034 ] Xuefu Zhang commented on HIVE-16484: I'd echo with [~lirui], wondering the benefits th

[jira] [Comment Edited] (HIVE-18304) datediff() UDF returns a wrong result when dealing with a (date, string) input

2017-12-19 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18304?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16297688#comment-16297688 ] Xuefu Zhang edited comment on HIVE-18304 at 12/20/17 12:20 AM: -

[jira] [Commented] (HIVE-18304) datediff() UDF returns a wrong result when dealing with a (date, string) input

2017-12-19 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18304?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16297688#comment-16297688 ] Xuefu Zhang commented on HIVE-18304: [~lirui] Can you comment on this issue? This migh

[jira] [Commented] (HIVE-18283) Better error message and error code for HoS exceptions

2017-12-19 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18283?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16297116#comment-16297116 ] Xuefu Zhang commented on HIVE-18283: +1 > Better error message and error code for HoS

[jira] [Commented] (HIVE-18291) An exception should be raised if the result is outside the range of decimal

2017-12-19 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18291?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16297106#comment-16297106 ] Xuefu Zhang commented on HIVE-18291: I think Hive current behavior is well-established

[jira] [Commented] (HIVE-18283) Better error message and error code for HoS exceptions

2017-12-18 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18283?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16295898#comment-16295898 ] Xuefu Zhang commented on HIVE-18283: Patch looks good to me except for a minor improve

[jira] [Commented] (HIVE-17486) Enable SharedWorkOptimizer in tez on HOS

2017-12-11 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17486?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16286811#comment-16286811 ] Xuefu Zhang commented on HIVE-17486: I meant, if FIL[52] and FIL[53] is the same in yo

[jira] [Commented] (HIVE-17486) Enable SharedWorkOptimizer in tez on HOS

2017-12-10 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17486?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16285550#comment-16285550 ] Xuefu Zhang commented on HIVE-17486: [~kellyzly], Thanks for working on this. I'm not

[jira] [Commented] (HIVE-17486) Enable SharedWorkOptimizer in tez on HOS

2017-12-07 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17486?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16282964#comment-16282964 ] Xuefu Zhang commented on HIVE-17486: Hi [~kellyzly], I think this thread is getting a

[jira] [Commented] (HIVE-17964) HoS: some spark configs doesn't require re-creating a session

2017-11-17 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17964?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16257222#comment-16257222 ] Xuefu Zhang commented on HIVE-17964: +1 > HoS: some spark configs doesn't require re-

[jira] [Commented] (HIVE-18030) HCatalog can't be used with Pig on Spark

2017-11-17 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18030?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16257212#comment-16257212 ] Xuefu Zhang commented on HIVE-18030: [~szita], as you noted, {quote} This feature was

[jira] [Commented] (HIVE-17964) HoS: some spark configs doesn't require re-creating a session

2017-11-14 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17964?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16252858#comment-16252858 ] Xuefu Zhang commented on HIVE-17964: That's good then. > HoS: some spark configs does

[jira] [Commented] (HIVE-17964) HoS: some spark configs doesn't require re-creating a session

2017-11-14 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17964?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16252653#comment-16252653 ] Xuefu Zhang commented on HIVE-17964: [~lirui] What's your thought on configurations su

[jira] [Commented] (HIVE-17964) HoS: some spark configs doesn't require re-creating a session

2017-11-13 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17964?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16250420#comment-16250420 ] Xuefu Zhang commented on HIVE-17964: +1 > HoS: some spark configs doesn't require re-

[jira] [Comment Edited] (HIVE-17964) HoS: some spark configs doesn't require re-creating a session

2017-11-13 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17964?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16250420#comment-16250420 ] Xuefu Zhang edited comment on HIVE-17964 at 11/13/17 10:43 PM: -

[jira] [Commented] (HIVE-17976) HoS: don't set output collector if there's no data to process

2017-11-13 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17976?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16249734#comment-16249734 ] Xuefu Zhang commented on HIVE-17976: Sounds good. Thanks for the explanation, [~lirui]

[jira] [Commented] (HIVE-17976) HoS: don't set output collector if there's no data to process

2017-11-12 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17976?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16249133#comment-16249133 ] Xuefu Zhang commented on HIVE-17976: Patch looks good to me. +1 [~lirui] Do you know

[jira] [Commented] (HIVE-17976) HoS: don't set output collector if there's no data to process

2017-11-09 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17976?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16247079#comment-16247079 ] Xuefu Zhang commented on HIVE-17976: [~lirui] Thanks for working on this. I will take

[jira] [Comment Edited] (HIVE-17964) HoS: some spark configs doesn't require re-creating a session

2017-11-09 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17964?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16246136#comment-16246136 ] Xuefu Zhang edited comment on HIVE-17964 at 11/9/17 5:47 PM: -

[jira] [Commented] (HIVE-17964) HoS: some spark configs doesn't require re-creating a session

2017-11-09 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17964?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16246136#comment-16246136 ] Xuefu Zhang commented on HIVE-17964: {quote} I think renaming a bunch of configs is no

[jira] [Commented] (HIVE-18030) HCatalog can't be used with Pig on Spark

2017-11-09 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18030?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16246089#comment-16246089 ] Xuefu Zhang commented on HIVE-18030: Patch looks fine. However, I'm wondering if it wo

[jira] [Commented] (HIVE-18009) Multiple lateral view query is slow on hive on spark

2017-11-08 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18009?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16244952#comment-16244952 ] Xuefu Zhang commented on HIVE-18009: [~aihuaxu] Thanks for working on this improvement

[jira] [Commented] (HIVE-17486) Enable SharedWorkOptimizer in tez on HOS

2017-11-02 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17486?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16236087#comment-16236087 ] Xuefu Zhang commented on HIVE-17486: [~lirui] The reason was briefly given at https:/

[jira] [Commented] (HIVE-17486) Enable SharedWorkOptimizer in tez on HOS

2017-11-01 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17486?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16235137#comment-16235137 ] Xuefu Zhang commented on HIVE-17486: [~kellyzly] I think M->M->R is possible. It's jus

[jira] [Commented] (HIVE-17486) Enable SharedWorkOptimizer in tez on HOS

2017-11-01 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17486?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16235085#comment-16235085 ] Xuefu Zhang commented on HIVE-17486: Hi [~kellyzly], I think your observation is corre

[jira] [Commented] (HIVE-15104) Hive on Spark generate more shuffle data than hive on mr

2017-10-24 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-15104?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16217431#comment-16217431 ] Xuefu Zhang commented on HIVE-15104: +1 > Hive on Spark generate more shuffle data th

[jira] [Commented] (HIVE-17684) HoS memory issues with MapJoinMemoryExhaustionHandler

2017-10-23 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17684?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16216000#comment-16216000 ] Xuefu Zhang commented on HIVE-17684: We don't see this issue often, possibly because o

[jira] [Comment Edited] (HIVE-17868) Make queries in spark_local_queries.q have deterministic output

2017-10-23 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17868?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16215443#comment-16215443 ] Xuefu Zhang edited comment on HIVE-17868 at 10/23/17 4:53 PM: --

[jira] [Commented] (HIVE-17868) Make queries in spark_local_queries.q have deterministic output

2017-10-23 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17868?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16215443#comment-16215443 ] Xuefu Zhang commented on HIVE-17868: Makes sense, [~asherman]. Thanks for the explanat

[jira] [Commented] (HIVE-16601) Display Session Id and Query Name / Id in Spark UI

2017-10-23 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-16601?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16215254#comment-16215254 ] Xuefu Zhang commented on HIVE-16601: The new screen shot looks great! +1 on that. I di

[jira] [Commented] (HIVE-17868) Make queries in spark_local_queries.q have deterministic output

2017-10-20 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17868?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16213178#comment-16213178 ] Xuefu Zhang commented on HIVE-17868: Adding order by might slow down the test. Prefera

[jira] [Commented] (HIVE-16601) Display Session Id and Query Name / Id in Spark UI

2017-10-19 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-16601?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16212089#comment-16212089 ] Xuefu Zhang commented on HIVE-16601: Thanks for the update. Personally I like the way

[jira] [Commented] (HIVE-16601) Display Session Id and Query Name / Id in Spark UI

2017-10-19 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-16601?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16211277#comment-16211277 ] Xuefu Zhang commented on HIVE-16601: Thanks for working on this. Could we have updated

[jira] [Commented] (HIVE-17756) Enable subquery related Qtests for Hive on Spark

2017-10-16 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17756?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16206076#comment-16206076 ] Xuefu Zhang commented on HIVE-17756: I think it might be better if we fix the problem

[jira] [Commented] (HIVE-15104) Hive on Spark generate more shuffle data than hive on mr

2017-10-13 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-15104?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16203867#comment-16203867 ] Xuefu Zhang commented on HIVE-15104: I think it's fairly safe to assume that hive-exec

[jira] [Updated] (HIVE-17756) Enable subquery related Qtests for Hive on Spark

2017-10-13 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17756?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuefu Zhang updated HIVE-17756: --- Resolution: Fixed Fix Version/s: 3.0.0 Status: Resolved (was: Patch Available) Patc

[jira] [Commented] (HIVE-15104) Hive on Spark generate more shuffle data than hive on mr

2017-10-12 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-15104?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16202897#comment-16202897 ] Xuefu Zhang commented on HIVE-15104: Hi [~lirui], to locate the jar, can we assume tha

[jira] [Commented] (HIVE-17786) JdbcConnectionParams set exact host and port in Utils.java

2017-10-12 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17786?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16201962#comment-16201962 ] Xuefu Zhang commented on HIVE-17786: +1 pending on test. > JdbcConnectionParams set e

[jira] [Commented] (HIVE-17756) Enable subquery related Qtests for Hive on Spark

2017-10-11 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17756?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16200622#comment-16200622 ] Xuefu Zhang commented on HIVE-17756: +1 > Enable subquery related Qtests for Hive on

[jira] [Commented] (HIVE-17111) Add TestLocalSparkCliDriver

2017-10-09 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17111?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16197213#comment-16197213 ] Xuefu Zhang commented on HIVE-17111: Thanks, guys! This is cool. +1 > Add TestLocalSp

[jira] [Commented] (HIVE-17111) Add TestLocalSparkCliDriver

2017-10-06 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17111?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16195239#comment-16195239 ] Xuefu Zhang commented on HIVE-17111: I think this is good. However, I have two questio

[jira] [Commented] (HIVE-17586) Make HS2 BackgroundOperationPool not fixed

2017-09-26 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17586?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16181938#comment-16181938 ] Xuefu Zhang commented on HIVE-17586: [~lirui] Thanks for sharing your findings. I thin

[jira] [Comment Edited] (HIVE-17586) Make HS2 BackgroundOperationPool not fixed

2017-09-26 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17586?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16181919#comment-16181919 ] Xuefu Zhang edited comment on HIVE-17586 at 9/27/17 3:06 AM: -

[jira] [Commented] (HIVE-17586) Make HS2 BackgroundOperationPool not fixed

2017-09-26 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17586?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16181919#comment-16181919 ] Xuefu Zhang commented on HIVE-17586: Actually no according java doc at https://docs.o

[jira] [Commented] (HIVE-17586) Make HS2 BackgroundOperationPool not fixed

2017-09-26 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17586?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16181857#comment-16181857 ] Xuefu Zhang commented on HIVE-17586: Above test failures don't seem related to patch.

[jira] [Updated] (HIVE-17586) Make HS2 BackgroundOperationPool not fixed

2017-09-25 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17586?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuefu Zhang updated HIVE-17586: --- Attachment: HIVE-17586.1.patch > Make HS2 BackgroundOperationPool not fixed >

[jira] [Updated] (HIVE-17586) Make HS2 BackgroundOperationPool not fixed

2017-09-25 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17586?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuefu Zhang updated HIVE-17586: --- Attachment: HIVE-17586.patch > Make HS2 BackgroundOperationPool not fixed > --

[jira] [Updated] (HIVE-17586) Make HS2 BackgroundOperationPool not fixed

2017-09-25 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17586?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuefu Zhang updated HIVE-17586: --- Status: Patch Available (was: Open) > Make HS2 BackgroundOperationPool not fixed > --

[jira] [Assigned] (HIVE-17586) Make HS2 BackgroundOperationPool not fixed

2017-09-22 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17586?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuefu Zhang reassigned HIVE-17586: -- > Make HS2 BackgroundOperationPool not fixed > -- > >

[jira] [Assigned] (HIVE-17548) ThriftCliService reports inaccurate the number of current sessions in the log message

2017-09-17 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17548?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuefu Zhang reassigned HIVE-17548: -- Assignee: Xuefu Zhang > ThriftCliService reports inaccurate the number of current sessions in t

  1   2   3   4   5   6   7   8   9   10   >