[jira] [Updated] (HIVE-24280) Fix a potential NPE

[ https://issues.apache.org/jira/browse/HIVE-24280?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuefu Zhang updated HIVE-24280: --- Status: Patch Available (was: Open) > Fix a potential NPE > --- > >

[jira] [Updated] (HIVE-24280) Fix a potential NPE

[ https://issues.apache.org/jira/browse/HIVE-24280?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuefu Zhang updated HIVE-24280: --- Attachment: HIVE-24280.patch > Fix a potential NPE > --- > > Key:

[jira] [Assigned] (HIVE-24280) Fix a potential NPE

[ https://issues.apache.org/jira/browse/HIVE-24280?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuefu Zhang reassigned HIVE-24280: -- > Fix a potential NPE > --- > > Key: HIVE-24280 >

[jira] [Commented] (HIVE-19853) Arrow serializer needs to create a TimeStampMicroTZVector instead of TimeStampMicroVector

[ https://issues.apache.org/jira/browse/HIVE-19853?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17162227#comment-17162227 ] Xuefu Zhang commented on HIVE-19853: Hi [~teddy.choi] and [~ewohlstadter], I understand this is an

[jira] [Commented] (HIVE-23885) Remove Hive on Spark

[ https://issues.apache.org/jira/browse/HIVE-23885?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17162113#comment-17162113 ] Xuefu Zhang commented on HIVE-23885: -1 I think this is a big decision that we need to go with our

[jira] [Commented] (HIVE-22053) Function name is not normalized when creating function

[ https://issues.apache.org/jira/browse/HIVE-22053?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16893946#comment-16893946 ] Xuefu Zhang commented on HIVE-22053: It's surprising that the bug has been there for so long... +1,

[jira] [Commented] (HIVE-21524) Impala Engine

[ https://issues.apache.org/jira/browse/HIVE-21524?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16803073#comment-16803073 ] Xuefu Zhang commented on HIVE-21524: This sounds interesting. However, I'm trying to figure out what

[jira] [Commented] (HIVE-21035) Race condition in SparkUtilities#getSparkSession

[ https://issues.apache.org/jira/browse/HIVE-21035?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16719356#comment-16719356 ] Xuefu Zhang commented on HIVE-21035: [~asinkovits] Thanks for working on this. Maybe I have missed

[jira] [Commented] (HIVE-20721) Describe table sometimes shows "from deserializer" for column comments

[ https://issues.apache.org/jira/browse/HIVE-20721?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16645899#comment-16645899 ] Xuefu Zhang commented on HIVE-20721: Hi [~Ballesteros], have you tried "desc table" for your table as

[jira] [Commented] (HIVE-20276) Hive UDF class getting Instantiated for each call of function

[ https://issues.apache.org/jira/browse/HIVE-20276?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16563838#comment-16563838 ] Xuefu Zhang commented on HIVE-20276: [~hardik1808] Could you give some code examples of the usage of

[jira] [Commented] (HIVE-20261) Expose inputPartitionList in QueryPlan

[ https://issues.apache.org/jira/browse/HIVE-20261?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16562622#comment-16562622 ] Xuefu Zhang commented on HIVE-20261: +1 pending on test. [~zshao] thanks for working on this. As a

[jira] [Commented] (HIVE-20141) Turn hive.spark.use.groupby.shuffle off by default

[ https://issues.apache.org/jira/browse/HIVE-20141?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16540335#comment-16540335 ] Xuefu Zhang commented on HIVE-20141: [~stakiar] Based on our benchmarking at Uber, groupByKey does

[jira] [Commented] (HIVE-20007) Hive should carry out timestamp computations in UTC

[ https://issues.apache.org/jira/browse/HIVE-20007?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16525488#comment-16525488 ] Xuefu Zhang commented on HIVE-20007: cc: [~lirui] > Hive should carry out timestamp computations in

[jira] [Commented] (HIVE-19671) Distribute by rand() can lead to data inconsistency

[ https://issues.apache.org/jira/browse/HIVE-19671?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16523928#comment-16523928 ] Xuefu Zhang commented on HIVE-19671: Yeah. I think it makes sense. Thank. > Distribute by rand() can

[jira] [Commented] (HIVE-19671) Distribute by rand() can lead to data inconsistency

[ https://issues.apache.org/jira/browse/HIVE-19671?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16519830#comment-16519830 ] Xuefu Zhang commented on HIVE-19671: Printing a warning is good, but we may not know if a

[jira] [Commented] (HIVE-19671) Distribute by rand() can lead to data inconsistency

[ https://issues.apache.org/jira/browse/HIVE-19671?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16518745#comment-16518745 ] Xuefu Zhang commented on HIVE-19671: Based on your analysis, it seems that random(see) depends on a

[jira] [Commented] (HIVE-19937) Intern JobConf objects in Spark tasks

[ https://issues.apache.org/jira/browse/HIVE-19937?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16517674#comment-16517674 ] Xuefu Zhang commented on HIVE-19937: +1 > Intern JobConf objects in Spark tasks >

[jira] [Commented] (HIVE-19671) Distribute by rand() can lead to data inconsistency

[ https://issues.apache.org/jira/browse/HIVE-19671?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16493796#comment-16493796 ] Xuefu Zhang commented on HIVE-19671: [~lirui] I think #1 is better. Nondeterministic partitioning

[jira] [Commented] (HIVE-19523) Decimal truncation for trailing zeros in Hive 1.2.1

[ https://issues.apache.org/jira/browse/HIVE-19523?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16483051#comment-16483051 ] Xuefu Zhang commented on HIVE-19523: {{HiveDecimal}} doesn't carry precision and scale info even

[jira] [Commented] (HIVE-18525) Add explain plan to Hive on Spark Web UI

[ https://issues.apache.org/jira/browse/HIVE-18525?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16414268#comment-16414268 ] Xuefu Zhang commented on HIVE-18525: {quote} I haven't found a way to do that in the Spark Web UI yet.

[jira] [Commented] (HIVE-18525) Add explain plan to Hive on Spark Web UI

[ https://issues.apache.org/jira/browse/HIVE-18525?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16408965#comment-16408965 ] Xuefu Zhang commented on HIVE-18525: The feature looks good and useful to me. I don't think generating

[jira] [Commented] (HIVE-18765) SparkClientImpl swallows exception messages from the RemoteDriver

[ https://issues.apache.org/jira/browse/HIVE-18765?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16372363#comment-16372363 ] Xuefu Zhang commented on HIVE-18765: +1 pending on test. > SparkClientImpl swallows exception

[jira] [Commented] (HIVE-18713) Optimize: Transform IN clauses to = when there's only one element

[ https://issues.apache.org/jira/browse/HIVE-18713?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16364495#comment-16364495 ] Xuefu Zhang commented on HIVE-18713: Okay. Make sense. Thanks for the explanation. > Optimize:

[jira] [Commented] (HIVE-18713) Optimize: Transform IN clauses to = when there's only one element

[ https://issues.apache.org/jira/browse/HIVE-18713?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16364332#comment-16364332 ] Xuefu Zhang commented on HIVE-18713: I'm wondering if it's a good idea to extend this such that if the

[jira] [Commented] (HIVE-18442) HoS: No FileSystem for scheme: nullscan

[ https://issues.apache.org/jira/browse/HIVE-18442?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16362690#comment-16362690 ] Xuefu Zhang commented on HIVE-18442: +1 to patch #1. > HoS: No FileSystem for scheme: nullscan >

[jira] [Commented] (HIVE-18442) HoS: No FileSystem for scheme: nullscan

[ https://issues.apache.org/jira/browse/HIVE-18442?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16361407#comment-16361407 ] Xuefu Zhang commented on HIVE-18442: Okay. It's fine to use {{fs.nullscan.impl}} to solve the problem.

[jira] [Commented] (HIVE-18442) HoS: No FileSystem for scheme: nullscan

[ https://issues.apache.org/jira/browse/HIVE-18442?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16359134#comment-16359134 ] Xuefu Zhang commented on HIVE-18442: [~lirui] Since it's a hack any way, is it okay just to use

[jira] [Commented] (HIVE-18513) Query results caching

[ https://issues.apache.org/jira/browse/HIVE-18513?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16350654#comment-16350654 ] Xuefu Zhang commented on HIVE-18513: That's good. As a minor comment, if we were only doing time-based

[jira] [Comment Edited] (HIVE-18513) Query results caching

[ https://issues.apache.org/jira/browse/HIVE-18513?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16349716#comment-16349716 ] Xuefu Zhang edited comment on HIVE-18513 at 2/2/18 3:16 AM: Thanks,

[jira] [Commented] (HIVE-18513) Query results caching

[ https://issues.apache.org/jira/browse/HIVE-18513?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16349716#comment-16349716 ] Xuefu Zhang commented on HIVE-18513: Thanks, [~jcamachorodriguez] and [~jdere]. I went thru the doc

[jira] [Commented] (HIVE-18513) Query results caching

[ https://issues.apache.org/jira/browse/HIVE-18513?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16349703#comment-16349703 ] Xuefu Zhang commented on HIVE-18513: Could we have the high-level doc linked here so others interested

[jira] [Commented] (HIVE-18301) Investigate to enable MapInput cache in Hive on Spark

[ https://issues.apache.org/jira/browse/HIVE-18301?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16347253#comment-16347253 ] Xuefu Zhang commented on HIVE-18301: It seems that IOContext is used in many places and the logics

[jira] [Commented] (HIVE-18442) HoS: No FileSystem for scheme: nullscan

[ https://issues.apache.org/jira/browse/HIVE-18442?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16347238#comment-16347238 ] Xuefu Zhang commented on HIVE-18442: Hi [~lirui], Thanks for the explanation. The patch looks fine.

[jira] [Commented] (HIVE-18513) Query results caching

[ https://issues.apache.org/jira/browse/HIVE-18513?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16341418#comment-16341418 ] Xuefu Zhang commented on HIVE-18513: [~jdere] Thanks for working on this useful feature! The patch

[jira] [Commented] (HIVE-18368) Improve Spark Debug RDD Graph

[ https://issues.apache.org/jira/browse/HIVE-18368?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16338668#comment-16338668 ] Xuefu Zhang commented on HIVE-18368: [~stakiar] It may not be meaningful to all users, but could be

[jira] [Commented] (HIVE-18368) Improve Spark Debug RDD Graph

[ https://issues.apache.org/jira/browse/HIVE-18368?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16338395#comment-16338395 ] Xuefu Zhang commented on HIVE-18368: Thanks, [~stakiar].  As to the duplication, is it possible that

[jira] [Commented] (HIVE-17257) Hive should merge empty files

[ https://issues.apache.org/jira/browse/HIVE-17257?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16330994#comment-16330994 ] Xuefu Zhang commented on HIVE-17257: Thanks for the update, [~csun]. I also verified with the patch

[jira] [Commented] (HIVE-14162) Allow disabling of long running job on Hive On Spark On YARN

[ https://issues.apache.org/jira/browse/HIVE-14162?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16329692#comment-16329692 ] Xuefu Zhang commented on HIVE-14162: Thanks, [~belugabehr]. I liked your thoughts and agreed that live

[jira] [Commented] (HIVE-17257) Hive should merge empty files

[ https://issues.apache.org/jira/browse/HIVE-17257?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16329018#comment-16329018 ] Xuefu Zhang commented on HIVE-17257: +1 for the patch. However, I'm not sure if those test failures

[jira] [Commented] (HIVE-18442) HoS: No FileSystem for scheme: nullscan

[ https://issues.apache.org/jira/browse/HIVE-18442?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16329014#comment-16329014 ] Xuefu Zhang commented on HIVE-18442: Hi [~lirui], thanks for working on this. Just curious, the

[jira] [Commented] (HIVE-14162) Allow disabling of long running job on Hive On Spark On YARN

[ https://issues.apache.org/jira/browse/HIVE-14162?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16324408#comment-16324408 ] Xuefu Zhang commented on HIVE-14162: The size of the driver is configurable. Minimum number of

[jira] [Commented] (HIVE-14162) Allow disabling of long running job on Hive On Spark On YARN

[ https://issues.apache.org/jira/browse/HIVE-14162?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16324349#comment-16324349 ] Xuefu Zhang commented on HIVE-14162: [~belugabehr], Spark on Yarn is powered by a feature call dynamic

[jira] [Commented] (HIVE-18434) Type is not determined correctly for comparison between decimal column and string constant

[ https://issues.apache.org/jira/browse/HIVE-18434?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16323174#comment-16323174 ] Xuefu Zhang commented on HIVE-18434: Thanks for the explanation. While your patch may fix the

[jira] [Commented] (HIVE-18434) Type is not determined correctly for comparison between decimal column and string constant

[ https://issues.apache.org/jira/browse/HIVE-18434?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16322251#comment-16322251 ] Xuefu Zhang commented on HIVE-18434: Hi [~ashutoshc], thanks for working on this. Do you mind

[jira] [Commented] (HIVE-14162) Allow disabling of long running job on Hive On Spark On YARN

[ https://issues.apache.org/jira/browse/HIVE-14162?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16321254#comment-16321254 ] Xuefu Zhang commented on HIVE-14162: I don't quite follow why existing configurations cannot meet what

[jira] [Commented] (HIVE-18368) Improve Spark Debug RDD Graph

[ https://issues.apache.org/jira/browse/HIVE-18368?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16319245#comment-16319245 ] Xuefu Zhang commented on HIVE-18368: Hi [~stakiar], thanks for working on this. I think this is very

[jira] [Commented] (HIVE-16484) Investigate SparkLauncher for HoS as alternative to bin/spark-submit

[ https://issues.apache.org/jira/browse/HIVE-16484?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16319187#comment-16319187 ] Xuefu Zhang commented on HIVE-16484: Cool. {quote} Once that gets started I'll work on using

[jira] [Comment Edited] (HIVE-16484) Investigate SparkLauncher for HoS as alternative to bin/spark-submit

[ https://issues.apache.org/jira/browse/HIVE-16484?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16317336#comment-16317336 ] Xuefu Zhang edited comment on HIVE-16484 at 1/8/18 11:57 PM: - [~stakiar], I'm

[jira] [Commented] (HIVE-16484) Investigate SparkLauncher for HoS as alternative to bin/spark-submit

[ https://issues.apache.org/jira/browse/HIVE-16484?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16317336#comment-16317336 ] Xuefu Zhang commented on HIVE-16484: [~stakiar], I'm not denying the potential benefits we might get,

[jira] [Commented] (HIVE-16484) Investigate SparkLauncher for HoS as alternative to bin/spark-submit

[ https://issues.apache.org/jira/browse/HIVE-16484?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16317034#comment-16317034 ] Xuefu Zhang commented on HIVE-16484: I'd echo with [~lirui], wondering the benefits the proposal

[jira] [Comment Edited] (HIVE-18304) datediff() UDF returns a wrong result when dealing with a (date, string) input

[ https://issues.apache.org/jira/browse/HIVE-18304?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16297688#comment-16297688 ] Xuefu Zhang edited comment on HIVE-18304 at 12/20/17 12:20 AM: --- [~lirui] Can

[jira] [Commented] (HIVE-18304) datediff() UDF returns a wrong result when dealing with a (date, string) input

[ https://issues.apache.org/jira/browse/HIVE-18304?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16297688#comment-16297688 ] Xuefu Zhang commented on HIVE-18304: [~lirui] Can you comment on this issue? This might be related to

[jira] [Commented] (HIVE-18283) Better error message and error code for HoS exceptions

[ https://issues.apache.org/jira/browse/HIVE-18283?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16297116#comment-16297116 ] Xuefu Zhang commented on HIVE-18283: +1 > Better error message and error code for HoS exceptions >

[jira] [Commented] (HIVE-18291) An exception should be raised if the result is outside the range of decimal

[ https://issues.apache.org/jira/browse/HIVE-18291?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16297106#comment-16297106 ] Xuefu Zhang commented on HIVE-18291: I think Hive current behavior is well-established, understood,

[jira] [Commented] (HIVE-18283) Better error message and error code for HoS exceptions

[ https://issues.apache.org/jira/browse/HIVE-18283?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16295898#comment-16295898 ] Xuefu Zhang commented on HIVE-18283: Patch looks good to me except for a minor improvement on a faster

[jira] [Commented] (HIVE-17486) Enable SharedWorkOptimizer in tez on HOS

[ https://issues.apache.org/jira/browse/HIVE-17486?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16286811#comment-16286811 ] Xuefu Zhang commented on HIVE-17486: I meant, if FIL[52] and FIL[53] is the same in your example, then

[jira] [Commented] (HIVE-17486) Enable SharedWorkOptimizer in tez on HOS

[ https://issues.apache.org/jira/browse/HIVE-17486?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16285550#comment-16285550 ] Xuefu Zhang commented on HIVE-17486: [~kellyzly], Thanks for working on this. I'm not sure if we

[jira] [Commented] (HIVE-17486) Enable SharedWorkOptimizer in tez on HOS

[ https://issues.apache.org/jira/browse/HIVE-17486?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16282964#comment-16282964 ] Xuefu Zhang commented on HIVE-17486: Hi [~kellyzly], I think this thread is getting a little bit long

[jira] [Commented] (HIVE-17964) HoS: some spark configs doesn't require re-creating a session

[ https://issues.apache.org/jira/browse/HIVE-17964?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16257222#comment-16257222 ] Xuefu Zhang commented on HIVE-17964: +1 > HoS: some spark configs doesn't require re-creating a

[jira] [Commented] (HIVE-18030) HCatalog can't be used with Pig on Spark

[ https://issues.apache.org/jira/browse/HIVE-18030?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16257212#comment-16257212 ] Xuefu Zhang commented on HIVE-18030: [~szita], as you noted, {quote} This feature was working

[jira] [Commented] (HIVE-17964) HoS: some spark configs doesn't require re-creating a session

[ https://issues.apache.org/jira/browse/HIVE-17964?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16252858#comment-16252858 ] Xuefu Zhang commented on HIVE-17964: That's good then. > HoS: some spark configs doesn't require

[jira] [Commented] (HIVE-17964) HoS: some spark configs doesn't require re-creating a session

[ https://issues.apache.org/jira/browse/HIVE-17964?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16252653#comment-16252653 ] Xuefu Zhang commented on HIVE-17964: [~lirui] What's your thought on configurations such as

[jira] [Commented] (HIVE-17964) HoS: some spark configs doesn't require re-creating a session

[ https://issues.apache.org/jira/browse/HIVE-17964?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16250420#comment-16250420 ] Xuefu Zhang commented on HIVE-17964: +1 > HoS: some spark configs doesn't require re-creating a

[jira] [Comment Edited] (HIVE-17964) HoS: some spark configs doesn't require re-creating a session

[ https://issues.apache.org/jira/browse/HIVE-17964?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16250420#comment-16250420 ] Xuefu Zhang edited comment on HIVE-17964 at 11/13/17 10:43 PM: --- +1 pending

[jira] [Commented] (HIVE-17976) HoS: don't set output collector if there's no data to process

[ https://issues.apache.org/jira/browse/HIVE-17976?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16249734#comment-16249734 ] Xuefu Zhang commented on HIVE-17976: Sounds good. Thanks for the explanation, [~lirui]. > HoS: don't

[jira] [Commented] (HIVE-17976) HoS: don't set output collector if there's no data to process

[ https://issues.apache.org/jira/browse/HIVE-17976?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16249133#comment-16249133 ] Xuefu Zhang commented on HIVE-17976: Patch looks good to me. +1 [~lirui] Do you know why setting

[jira] [Commented] (HIVE-17976) HoS: don't set output collector if there's no data to process

[ https://issues.apache.org/jira/browse/HIVE-17976?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16247079#comment-16247079 ] Xuefu Zhang commented on HIVE-17976: [~lirui] Thanks for working on this. I will take a look. > HoS:

[jira] [Comment Edited] (HIVE-17964) HoS: some spark configs doesn't require re-creating a session

[ https://issues.apache.org/jira/browse/HIVE-17964?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16246136#comment-16246136 ] Xuefu Zhang edited comment on HIVE-17964 at 11/9/17 5:47 PM: - {quote} I think

[jira] [Commented] (HIVE-17964) HoS: some spark configs doesn't require re-creating a session

[ https://issues.apache.org/jira/browse/HIVE-17964?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16246136#comment-16246136 ] Xuefu Zhang commented on HIVE-17964: {quote} I think renaming a bunch of configs is not very user

[jira] [Commented] (HIVE-18030) HCatalog can't be used with Pig on Spark

[ https://issues.apache.org/jira/browse/HIVE-18030?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16246089#comment-16246089 ] Xuefu Zhang commented on HIVE-18030: Patch looks fine. However, I'm wondering if it would be better to

[jira] [Commented] (HIVE-18009) Multiple lateral view query is slow on hive on spark

[ https://issues.apache.org/jira/browse/HIVE-18009?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16244952#comment-16244952 ] Xuefu Zhang commented on HIVE-18009: [~aihuaxu] Thanks for working on this improvement. Patch looks

[jira] [Commented] (HIVE-17486) Enable SharedWorkOptimizer in tez on HOS

[ https://issues.apache.org/jira/browse/HIVE-17486?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16236087#comment-16236087 ] Xuefu Zhang commented on HIVE-17486: [~lirui] The reason was briefly given at

[jira] [Commented] (HIVE-17486) Enable SharedWorkOptimizer in tez on HOS

[ https://issues.apache.org/jira/browse/HIVE-17486?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16235137#comment-16235137 ] Xuefu Zhang commented on HIVE-17486: [~kellyzly] I think M->M->R is possible. It's just that the

[jira] [Commented] (HIVE-17486) Enable SharedWorkOptimizer in tez on HOS

[ https://issues.apache.org/jira/browse/HIVE-17486?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16235085#comment-16235085 ] Xuefu Zhang commented on HIVE-17486: Hi [~kellyzly], I think your observation is correct. Spark has

[jira] [Commented] (HIVE-15104) Hive on Spark generate more shuffle data than hive on mr

[ https://issues.apache.org/jira/browse/HIVE-15104?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16217431#comment-16217431 ] Xuefu Zhang commented on HIVE-15104: +1 > Hive on Spark generate more shuffle data than hive on mr >

[jira] [Commented] (HIVE-17684) HoS memory issues with MapJoinMemoryExhaustionHandler

[ https://issues.apache.org/jira/browse/HIVE-17684?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16216000#comment-16216000 ] Xuefu Zhang commented on HIVE-17684: We don't see this issue often, possibly because our settings are

[jira] [Comment Edited] (HIVE-17868) Make queries in spark_local_queries.q have deterministic output

[ https://issues.apache.org/jira/browse/HIVE-17868?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16215443#comment-16215443 ] Xuefu Zhang edited comment on HIVE-17868 at 10/23/17 4:53 PM: -- Makes sense,

[jira] [Commented] (HIVE-17868) Make queries in spark_local_queries.q have deterministic output

[ https://issues.apache.org/jira/browse/HIVE-17868?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16215443#comment-16215443 ] Xuefu Zhang commented on HIVE-17868: Makes sense, [~asherman]. Thanks for the explanation. > Make

[jira] [Commented] (HIVE-16601) Display Session Id and Query Name / Id in Spark UI

[ https://issues.apache.org/jira/browse/HIVE-16601?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16215254#comment-16215254 ] Xuefu Zhang commented on HIVE-16601: The new screen shot looks great! +1 on that. I didn't review the

[jira] [Commented] (HIVE-17868) Make queries in spark_local_queries.q have deterministic output

[ https://issues.apache.org/jira/browse/HIVE-17868?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16213178#comment-16213178 ] Xuefu Zhang commented on HIVE-17868: Adding order by might slow down the test. Preferable way is to

[jira] [Commented] (HIVE-16601) Display Session Id and Query Name / Id in Spark UI

[ https://issues.apache.org/jira/browse/HIVE-16601?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16212089#comment-16212089 ] Xuefu Zhang commented on HIVE-16601: Thanks for the update. Personally I like the way that app name is

[jira] [Commented] (HIVE-16601) Display Session Id and Query Name / Id in Spark UI

[ https://issues.apache.org/jira/browse/HIVE-16601?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16211277#comment-16211277 ] Xuefu Zhang commented on HIVE-16601: Thanks for working on this. Could we have updated screenshots for

[jira] [Commented] (HIVE-17756) Enable subquery related Qtests for Hive on Spark

[ https://issues.apache.org/jira/browse/HIVE-17756?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16206076#comment-16206076 ] Xuefu Zhang commented on HIVE-17756: I think it might be better if we fix the problem in a separate

[jira] [Commented] (HIVE-15104) Hive on Spark generate more shuffle data than hive on mr

[ https://issues.apache.org/jira/browse/HIVE-15104?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16203867#comment-16203867 ] Xuefu Zhang commented on HIVE-15104: I think it's fairly safe to assume that hive-exec.jar and the new

[jira] [Updated] (HIVE-17756) Enable subquery related Qtests for Hive on Spark

[ https://issues.apache.org/jira/browse/HIVE-17756?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuefu Zhang updated HIVE-17756: --- Resolution: Fixed Fix Version/s: 3.0.0 Status: Resolved (was: Patch Available)

[jira] [Commented] (HIVE-15104) Hive on Spark generate more shuffle data than hive on mr

[ https://issues.apache.org/jira/browse/HIVE-15104?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16202897#comment-16202897 ] Xuefu Zhang commented on HIVE-15104: Hi [~lirui], to locate the jar, can we assume that the jar is

[jira] [Commented] (HIVE-17786) JdbcConnectionParams set exact host and port in Utils.java

[ https://issues.apache.org/jira/browse/HIVE-17786?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16201962#comment-16201962 ] Xuefu Zhang commented on HIVE-17786: +1 pending on test. > JdbcConnectionParams set exact host and

[jira] [Commented] (HIVE-17756) Enable subquery related Qtests for Hive on Spark

[ https://issues.apache.org/jira/browse/HIVE-17756?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16200622#comment-16200622 ] Xuefu Zhang commented on HIVE-17756: +1 > Enable subquery related Qtests for Hive on Spark >

[jira] [Commented] (HIVE-17111) Add TestLocalSparkCliDriver

[ https://issues.apache.org/jira/browse/HIVE-17111?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16197213#comment-16197213 ] Xuefu Zhang commented on HIVE-17111: Thanks, guys! This is cool. +1 > Add TestLocalSparkCliDriver >

[jira] [Commented] (HIVE-17111) Add TestLocalSparkCliDriver

[ https://issues.apache.org/jira/browse/HIVE-17111?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16195239#comment-16195239 ] Xuefu Zhang commented on HIVE-17111: I think this is good. However, I have two questions: 1. Other

[jira] [Commented] (HIVE-17586) Make HS2 BackgroundOperationPool not fixed

[ https://issues.apache.org/jira/browse/HIVE-17586?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16181938#comment-16181938 ] Xuefu Zhang commented on HIVE-17586: [~lirui] Thanks for sharing your findings. I think variable pool

[jira] [Comment Edited] (HIVE-17586) Make HS2 BackgroundOperationPool not fixed

[ https://issues.apache.org/jira/browse/HIVE-17586?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16181919#comment-16181919 ] Xuefu Zhang edited comment on HIVE-17586 at 9/27/17 3:06 AM: - Actually no

[jira] [Commented] (HIVE-17586) Make HS2 BackgroundOperationPool not fixed

[ https://issues.apache.org/jira/browse/HIVE-17586?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16181919#comment-16181919 ] Xuefu Zhang commented on HIVE-17586: Actually no according java doc at

[jira] [Commented] (HIVE-17586) Make HS2 BackgroundOperationPool not fixed

[ https://issues.apache.org/jira/browse/HIVE-17586?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16181857#comment-16181857 ] Xuefu Zhang commented on HIVE-17586: Above test failures don't seem related to patch. > Make HS2

[jira] [Updated] (HIVE-17586) Make HS2 BackgroundOperationPool not fixed

[ https://issues.apache.org/jira/browse/HIVE-17586?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuefu Zhang updated HIVE-17586: --- Attachment: HIVE-17586.1.patch > Make HS2 BackgroundOperationPool not fixed >

[jira] [Updated] (HIVE-17586) Make HS2 BackgroundOperationPool not fixed

[ https://issues.apache.org/jira/browse/HIVE-17586?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuefu Zhang updated HIVE-17586: --- Attachment: HIVE-17586.patch > Make HS2 BackgroundOperationPool not fixed >

[jira] [Updated] (HIVE-17586) Make HS2 BackgroundOperationPool not fixed

[ https://issues.apache.org/jira/browse/HIVE-17586?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuefu Zhang updated HIVE-17586: --- Status: Patch Available (was: Open) > Make HS2 BackgroundOperationPool not fixed >

[jira] [Assigned] (HIVE-17586) Make HS2 BackgroundOperationPool not fixed

[ https://issues.apache.org/jira/browse/HIVE-17586?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuefu Zhang reassigned HIVE-17586: -- > Make HS2 BackgroundOperationPool not fixed > -- > >

[jira] [Assigned] (HIVE-17548) ThriftCliService reports inaccurate the number of current sessions in the log message

[ https://issues.apache.org/jira/browse/HIVE-17548?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuefu Zhang reassigned HIVE-17548: -- Assignee: Xuefu Zhang > ThriftCliService reports inaccurate the number of current sessions in

[jira] [Commented] (HIVE-14836) Test the predicate pushing down support for Parquet vectorization read path

[ https://issues.apache.org/jira/browse/HIVE-14836?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16168207#comment-16168207 ] Xuefu Zhang commented on HIVE-14836: Hi [~Ferd], thanks for your patch. I'm a little confused. The

  1   2   3   4   5   6   7   8   9   10   >