[jira] [Commented] (HIVE-14836) Test the predicate pushing down support for Parquet vectorization read path

[ https://issues.apache.org/jira/browse/HIVE-14836?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16168207#comment-16168207 ] Xuefu Zhang commented on HIVE-14836: Hi [~Ferd], thanks for your patch. I'm a little c

[jira] [Resolved] (HIVE-7292) Hive on Spark

[ https://issues.apache.org/jira/browse/HIVE-7292?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuefu Zhang resolved HIVE-7292. --- Resolution: Done Fix Version/s: 1.1.0 As the feature is already released in Hive and remaining i

[jira] [Commented] (HIVE-7292) Hive on Spark

[ https://issues.apache.org/jira/browse/HIVE-7292?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16162071#comment-16162071 ] Xuefu Zhang commented on HIVE-7292: --- [~bastrich], thanks for your explanation. In fact, a

[jira] [Commented] (HIVE-7292) Hive on Spark

[ https://issues.apache.org/jira/browse/HIVE-7292?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16160444#comment-16160444 ] Xuefu Zhang commented on HIVE-7292: --- [~bastrich], the answer is no. However, if there is

[jira] [Updated] (HIVE-17401) Hive session idle timeout doesn't function properly

[ https://issues.apache.org/jira/browse/HIVE-17401?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuefu Zhang updated HIVE-17401: --- Resolution: Fixed Fix Version/s: 3.0.0 Status: Resolved (was: Patch Available) > Hi

[jira] [Commented] (HIVE-17401) Hive session idle timeout doesn't function properly

[ https://issues.apache.org/jira/browse/HIVE-17401?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16155703#comment-16155703 ] Xuefu Zhang commented on HIVE-17401: Above test failures don't seem related to the pat

[jira] [Updated] (HIVE-17401) Hive session idle timeout doesn't function properly

[ https://issues.apache.org/jira/browse/HIVE-17401?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuefu Zhang updated HIVE-17401: --- Attachment: HIVE-17401.2.patch > Hive session idle timeout doesn't function properly > ---

[jira] [Commented] (HIVE-17401) Hive session idle timeout doesn't function properly

[ https://issues.apache.org/jira/browse/HIVE-17401?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16153947#comment-16153947 ] Xuefu Zhang commented on HIVE-17401: Hi [~pvary], Thanks for the review. I think your

[jira] [Commented] (HIVE-17362) The MAX_PREWARM_TIME should be configurable on HoS

[ https://issues.apache.org/jira/browse/HIVE-17362?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16153843#comment-16153843 ] Xuefu Zhang commented on HIVE-17362: I think it's probably better to document those p

[jira] [Commented] (HIVE-15104) Hive on Spark generate more shuffle data than hive on mr

[ https://issues.apache.org/jira/browse/HIVE-15104?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16149777#comment-16149777 ] Xuefu Zhang commented on HIVE-15104: Hi [~lirui], I think creating a trivial package i

[jira] [Commented] (HIVE-15104) Hive on Spark generate more shuffle data than hive on mr

[ https://issues.apache.org/jira/browse/HIVE-15104?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16148351#comment-16148351 ] Xuefu Zhang commented on HIVE-15104: I see. It might be possible to put this class in

[jira] [Commented] (HIVE-15104) Hive on Spark generate more shuffle data than hive on mr

[ https://issues.apache.org/jira/browse/HIVE-15104?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16148174#comment-16148174 ] Xuefu Zhang commented on HIVE-15104: The patch looks good to me. My only concern is ab

[jira] [Commented] (HIVE-17412) Add "-- SORT_QUERY_RESULTS" for spark_vectorized_dynamic_partition_pruning.q

[ https://issues.apache.org/jira/browse/HIVE-17412?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16147276#comment-16147276 ] Xuefu Zhang commented on HIVE-17412: +1 > Add "-- SORT_QUERY_RESULTS" for spark_vecto

[jira] [Updated] (HIVE-17401) Hive session idle timeout doesn't function properly

[ https://issues.apache.org/jira/browse/HIVE-17401?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuefu Zhang updated HIVE-17401: --- Attachment: HIVE-17401.1.patch With the change in patch, I found activeCalls variable is no longer use

[jira] [Updated] (HIVE-17401) Hive session idle timeout doesn't function properly

[ https://issues.apache.org/jira/browse/HIVE-17401?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuefu Zhang updated HIVE-17401: --- Attachment: HIVE-17401.patch > Hive session idle timeout doesn't function properly > -

[jira] [Updated] (HIVE-17401) Hive session idle timeout doesn't function properly

[ https://issues.apache.org/jira/browse/HIVE-17401?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuefu Zhang updated HIVE-17401: --- Status: Patch Available (was: Open) > Hive session idle timeout doesn't function properly > -

[jira] [Commented] (HIVE-17401) Hive session idle timeout doesn't function properly

[ https://issues.apache.org/jira/browse/HIVE-17401?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16144383#comment-16144383 ] Xuefu Zhang commented on HIVE-17401: {code} private void startTimeoutChecker() { .

[jira] [Assigned] (HIVE-17401) Hive session idle timeout doesn't function properly

[ https://issues.apache.org/jira/browse/HIVE-17401?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuefu Zhang reassigned HIVE-17401: -- > Hive session idle timeout doesn't function properly > ---

[jira] [Commented] (HIVE-16811) Estimate statistics in absence of stats

[ https://issues.apache.org/jira/browse/HIVE-16811?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16144331#comment-16144331 ] Xuefu Zhang commented on HIVE-16811: Could we have some high-level description on how

[jira] [Commented] (HIVE-17388) Spark Stats for the WebUI Query Plan

[ https://issues.apache.org/jira/browse/HIVE-17388?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16143953#comment-16143953 ] Xuefu Zhang commented on HIVE-17388: Sorry that I am behind reviewing this patch and t

[jira] [Commented] (HIVE-17381) When we enable Parquet Writer Version V2, hive throws an exception: Unsupported encoding: DELTA_BYTE_ARRAY.

[ https://issues.apache.org/jira/browse/HIVE-17381?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16140051#comment-16140051 ] Xuefu Zhang commented on HIVE-17381: fyi: [~Ferd], [~pgolash] > When we enable Parque

[jira] [Commented] (HIVE-17362) The MAX_PREWARM_TIME should be configurable on HoS

[ https://issues.apache.org/jira/browse/HIVE-17362?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16137179#comment-16137179 ] Xuefu Zhang commented on HIVE-17362: +1 > The MAX_PREWARM_TIME should be configurable

[jira] [Commented] (HIVE-17362) The MAX_PREWARM_TIME should be configurable on HoS

[ https://issues.apache.org/jira/browse/HIVE-17362?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16135519#comment-16135519 ] Xuefu Zhang commented on HIVE-17362: I like the idea of replacing the code trick with

[jira] [Commented] (HIVE-17300) WebUI query plan graphs

[ https://issues.apache.org/jira/browse/HIVE-17300?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16133368#comment-16133368 ] Xuefu Zhang commented on HIVE-17300: I'd like to review it, but haven't got a chance t

[jira] [Commented] (HIVE-17357) Similar to HIVE-17336, plugin jars are not properly added

[ https://issues.apache.org/jira/browse/HIVE-17357?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16133292#comment-16133292 ] Xuefu Zhang commented on HIVE-17357: +1 pending on tests. > Similar to HIVE-17336, pl

[jira] [Commented] (HIVE-15104) Hive on Spark generate more shuffle data than hive on mr

[ https://issues.apache.org/jira/browse/HIVE-15104?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16133290#comment-16133290 ] Xuefu Zhang commented on HIVE-15104: [~lirui], I found it difficulty to backport HIVE-

[jira] [Commented] (HIVE-17336) Missing class 'org.apache.hadoop.hive.hbase.HiveHBaseTableInputFormat' from Hive on Spark when inserting into hbase based table

[ https://issues.apache.org/jira/browse/HIVE-17336?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16131600#comment-16131600 ] Xuefu Zhang commented on HIVE-17336: Sorry for getting to this late. Thanks for fixing

[jira] [Commented] (HIVE-17347) TestMiniSparkOnYarnCliDriver[spark_dynamic_partition_pruning_mapjoin_only] is failing every time

[ https://issues.apache.org/jira/browse/HIVE-17347?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16130931#comment-16130931 ] Xuefu Zhang commented on HIVE-17347: This seems simple enough for me to review as well

[jira] [Commented] (HIVE-17321) HoS: analyze ORC table doesn't compute raw data size when noscan/partialscan is not specified

[ https://issues.apache.org/jira/browse/HIVE-17321?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16129911#comment-16129911 ] Xuefu Zhang commented on HIVE-17321: +1 patch looks good to me. [~kellyzly], please le

[jira] [Commented] (HIVE-15104) Hive on Spark generate more shuffle data than hive on mr

[ https://issues.apache.org/jira/browse/HIVE-15104?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16129895#comment-16129895 ] Xuefu Zhang commented on HIVE-15104: Hi [~lirui], thanks for continuing the work here.

[jira] [Commented] (HIVE-17292) Change TestMiniSparkOnYarnCliDriver test configuration to use the configured cores

[ https://issues.apache.org/jira/browse/HIVE-17292?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16129121#comment-16129121 ] Xuefu Zhang commented on HIVE-17292: Given that we need to update a lot of test files,

[jira] [Commented] (HIVE-17065) You can not successfully deploy hive clusters with Hive guidance documents

[ https://issues.apache.org/jira/browse/HIVE-17065?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16127690#comment-16127690 ] Xuefu Zhang commented on HIVE-17065: Sorry for replying late on this, but [~linzhangbi

[jira] [Commented] (HIVE-17291) Set the number of executors based on config if client does not provide information

[ https://issues.apache.org/jira/browse/HIVE-17291?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16126744#comment-16126744 ] Xuefu Zhang commented on HIVE-17291: [~lirui], that makes sense. > Set the number of

[jira] [Commented] (HIVE-17291) Set the number of executors based on config if client does not provide information

[ https://issues.apache.org/jira/browse/HIVE-17291?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16126284#comment-16126284 ] Xuefu Zhang commented on HIVE-17291: Did you confirm that the configuration is updated

[jira] [Commented] (HIVE-17291) Set the number of executors based on config if client does not provide information

[ https://issues.apache.org/jira/browse/HIVE-17291?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16126242#comment-16126242 ] Xuefu Zhang commented on HIVE-17291: Getting a value greater than 0 doesn't necessaril

[jira] [Commented] (HIVE-17291) Set the number of executors based on config if client does not provide information

[ https://issues.apache.org/jira/browse/HIVE-17291?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16126125#comment-16126125 ] Xuefu Zhang commented on HIVE-17291: For test result stability, I'm fine with whatever

[jira] [Commented] (HIVE-17300) WebUI query plan graphs

[ https://issues.apache.org/jira/browse/HIVE-17300?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16125996#comment-16125996 ] Xuefu Zhang commented on HIVE-17300: [~klcopp], Thanks for your patch. Could you pleas

[jira] [Commented] (HIVE-17287) HoS can not deal with skewed data group by

[ https://issues.apache.org/jira/browse/HIVE-17287?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16124263#comment-16124263 ] Xuefu Zhang commented on HIVE-17287: [~kellyzly], just curious, what error did you get

[jira] [Commented] (HIVE-17291) Set the number of executors based on config if client does not provide information

[ https://issues.apache.org/jira/browse/HIVE-17291?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16123835#comment-16123835 ] Xuefu Zhang commented on HIVE-17291: You're right. Thanks for the explanation. +1 to t

[jira] [Commented] (HIVE-17291) Set the number of executors based on config if client does not provide information

[ https://issues.apache.org/jira/browse/HIVE-17291?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16123749#comment-16123749 ] Xuefu Zhang commented on HIVE-17291: Thanks for working on this, [~pvary]. The patch l

[jira] [Assigned] (HIVE-17300) WebUI query plan graphs

[ https://issues.apache.org/jira/browse/HIVE-17300?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuefu Zhang reassigned HIVE-17300: -- Assignee: Karen Coppage > WebUI query plan graphs > --- > >

[jira] [Commented] (HIVE-17270) Qtest results show wrong number of executors

[ https://issues.apache.org/jira/browse/HIVE-17270?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16120310#comment-16120310 ] Xuefu Zhang commented on HIVE-17270: Thanks for the investigation, [~pvary]. Auto det

[jira] [Commented] (HIVE-17270) Qtest results show wrong number of executors

[ https://issues.apache.org/jira/browse/HIVE-17270?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16118797#comment-16118797 ] Xuefu Zhang commented on HIVE-17270: 1. The number of executors could be a matter of M

[jira] [Commented] (HIVE-15767) Hive On Spark is not working on secure clusters from Oozie

[ https://issues.apache.org/jira/browse/HIVE-15767?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16118589#comment-16118589 ] Xuefu Zhang commented on HIVE-15767: +1 > Hive On Spark is not working on secure clus

[jira] [Commented] (HIVE-17111) TestSparkCliDriver does not use LocalHiveSparkClient

[ https://issues.apache.org/jira/browse/HIVE-17111?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16117628#comment-16117628 ] Xuefu Zhang commented on HIVE-17111: My take is that local is for dev, local-cluster f

[jira] [Commented] (HIVE-15767) Hive On Spark is not working on secure clusters from Oozie

[ https://issues.apache.org/jira/browse/HIVE-15767?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16117614#comment-16117614 ] Xuefu Zhang commented on HIVE-15767: >From what I see, the patch seems logical, harmle

[jira] [Commented] (HIVE-17257) Hive should merge empty files

[ https://issues.apache.org/jira/browse/HIVE-17257?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16116933#comment-16116933 ] Xuefu Zhang commented on HIVE-17257: Patch looks simple and good to me. Is it possible

[jira] [Commented] (HIVE-17252) Insecure YARN Fair Scheduler when using HiveServer2 non-impersonation mode

[ https://issues.apache.org/jira/browse/HIVE-17252?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16114905#comment-16114905 ] Xuefu Zhang commented on HIVE-17252: I don't think Hive set any value to mapreduce.job

[jira] [Commented] (HIVE-17213) HoS: file merging doesn't work for union all

[ https://issues.apache.org/jira/browse/HIVE-17213?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16111946#comment-16111946 ] Xuefu Zhang commented on HIVE-17213: +1 pending on tests. > HoS: file merging doesn't

[jira] [Commented] (HIVE-17213) HoS: file merging doesn't work for union all

[ https://issues.apache.org/jira/browse/HIVE-17213?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16108352#comment-16108352 ] Xuefu Zhang commented on HIVE-17213: Patch #1 looks good. However, I'd suggest the fol

[jira] [Commented] (HIVE-15104) Hive on Spark generate more shuffle data than hive on mr

[ https://issues.apache.org/jira/browse/HIVE-15104?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16085324#comment-16085324 ] Xuefu Zhang commented on HIVE-15104: [~lirui], I'm wondering if there is anything new

[jira] [Updated] (HIVE-16961) Hive on Spark leaks spark application in case user cancels query and closes session

[ https://issues.apache.org/jira/browse/HIVE-16961?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuefu Zhang updated HIVE-16961: --- Resolution: Fixed Fix Version/s: 3.0.0 Status: Resolved (was: Patch Available) Comm

[jira] [Comment Edited] (HIVE-16962) Better error msg for Hive on Spark in case user cancels query and closes session

[ https://issues.apache.org/jira/browse/HIVE-16962?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16074240#comment-16074240 ] Xuefu Zhang edited comment on HIVE-16962 at 7/5/17 5:23 PM: I

[jira] [Updated] (HIVE-16962) Better error msg for Hive on Spark in case user cancels query and closes session

[ https://issues.apache.org/jira/browse/HIVE-16962?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuefu Zhang updated HIVE-16962: --- Fix Version/s: (was: 2.2.0) 3.0.0 > Better error msg for Hive on Spark in case

[jira] [Commented] (HIVE-17018) Small table is converted to map join even the total size of small tables exceeds the threshold(hive.auto.convert.join.noconditionaltask.size)

[ https://issues.apache.org/jira/browse/HIVE-17018?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16075106#comment-16075106 ] Xuefu Zhang commented on HIVE-17018: Ping [~csun] for comments. > Small table is conv

[jira] [Commented] (HIVE-16962) Better error msg for Hive on Spark in case user cancels query and closes session

[ https://issues.apache.org/jira/browse/HIVE-16962?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16074240#comment-16074240 ] Xuefu Zhang commented on HIVE-16962: @lefty, thank for pointing it out. I lost track o

[jira] [Commented] (HIVE-17015) CRLF of the script causes the startup service command to fail

[ https://issues.apache.org/jira/browse/HIVE-17015?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16074103#comment-16074103 ] Xuefu Zhang commented on HIVE-17015: I'm not sure if I understand the problem. If we d

[jira] [Commented] (HIVE-16984) HoS: avoid waiting for RemoteSparkJobStatus::getAppID() when remote driver died

[ https://issues.apache.org/jira/browse/HIVE-16984?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16069173#comment-16069173 ] Xuefu Zhang commented on HIVE-16984: The patch looks good. However, I'm thinking we'd

[jira] [Updated] (HIVE-16962) Better error msg for Hive on Spark in case user cancels query and closes session

[ https://issues.apache.org/jira/browse/HIVE-16962?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuefu Zhang updated HIVE-16962: --- Resolution: Fixed Fix Version/s: 2.2.0 Status: Resolved (was: Patch Available) Patc

[jira] [Commented] (HIVE-16962) Better error msg for Hive on Spark in case user cancels query and closes session

[ https://issues.apache.org/jira/browse/HIVE-16962?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16068329#comment-16068329 ] Xuefu Zhang commented on HIVE-16962: Thanks for the feedback. I corrected most of them

[jira] [Commented] (HIVE-16961) Hive on Spark leaks spark application in case user cancels query and closes session

[ https://issues.apache.org/jira/browse/HIVE-16961?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16068331#comment-16068331 ] Xuefu Zhang commented on HIVE-16961: [~lirui], could you please take another look? Tha

[jira] [Updated] (HIVE-16962) Better error msg for Hive on Spark in case user cancels query and closes session

[ https://issues.apache.org/jira/browse/HIVE-16962?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuefu Zhang updated HIVE-16962: --- Attachment: HIVE-16962.2.patch > Better error msg for Hive on Spark in case user cancels query and clo

[jira] [Commented] (HIVE-16978) HoS: add current thread ID to the log redirector for the RemoteDriver

[ https://issues.apache.org/jira/browse/HIVE-16978?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16066945#comment-16066945 ] Xuefu Zhang commented on HIVE-16978: +1 > HoS: add current thread ID to the log redir

[jira] [Commented] (HIVE-16978) HoS: add current thread ID to the log redirector for the RemoteDriver

[ https://issues.apache.org/jira/browse/HIVE-16978?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16066907#comment-16066907 ] Xuefu Zhang commented on HIVE-16978: Looks good. It seems the variable {{childIdGenera

[jira] [Updated] (HIVE-16962) Better error msg for Hive on Spark in case user cancels query and closes session

[ https://issues.apache.org/jira/browse/HIVE-16962?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuefu Zhang updated HIVE-16962: --- Attachment: HIVE-16962.patch Attach the same file to trigger the test again. > Better error msg for H

[jira] [Commented] (HIVE-16978) HoS: add current thread ID to the log redirector for the RemoteDriver

[ https://issues.apache.org/jira/browse/HIVE-16978?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16066837#comment-16066837 ] Xuefu Zhang commented on HIVE-16978: Thanks for working on this, [~csun]. The patch lo

[jira] [Updated] (HIVE-16961) Hive on Spark leaks spark application in case user cancels query and closes session

[ https://issues.apache.org/jira/browse/HIVE-16961?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuefu Zhang updated HIVE-16961: --- Attachment: HIVE-16961.patch > Hive on Spark leaks spark application in case user cancels query and cl

[jira] [Commented] (HIVE-16961) Hive on Spark leaks spark application in case user cancels query and closes session

[ https://issues.apache.org/jira/browse/HIVE-16961?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16066520#comment-16066520 ] Xuefu Zhang commented on HIVE-16961: Good point. I updated the patch. Thanks. > Hive

[jira] [Commented] (HIVE-16980) The partition of join is not divided evently in HOS

[ https://issues.apache.org/jira/browse/HIVE-16980?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16065908#comment-16065908 ] Xuefu Zhang commented on HIVE-16980: This is interesting. Have you checked your data f

[jira] [Updated] (HIVE-16962) Better error msg for Hive on Spark in case user cancels query and closes session

[ https://issues.apache.org/jira/browse/HIVE-16962?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuefu Zhang updated HIVE-16962: --- Attachment: HIVE-16962.patch > Better error msg for Hive on Spark in case user cancels query and close

[jira] [Updated] (HIVE-16962) Better error msg for Hive on Spark in case user cancels query and closes session

[ https://issues.apache.org/jira/browse/HIVE-16962?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuefu Zhang updated HIVE-16962: --- Status: Patch Available (was: Open) > Better error msg for Hive on Spark in case user cancels query a

[jira] [Updated] (HIVE-16961) Hive on Spark leaks spark application in case user cancels query and closes session

[ https://issues.apache.org/jira/browse/HIVE-16961?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuefu Zhang updated HIVE-16961: --- Attachment: HIVE-16961.patch > Hive on Spark leaks spark application in case user cancels query and cl

[jira] [Updated] (HIVE-16961) Hive on Spark leaks spark application in case user cancels query and closes session

[ https://issues.apache.org/jira/browse/HIVE-16961?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuefu Zhang updated HIVE-16961: --- Status: Patch Available (was: Open) > Hive on Spark leaks spark application in case user cancels quer

[jira] [Assigned] (HIVE-16962) Better error msg for Hive on Spark in case user cancels query and closes session

[ https://issues.apache.org/jira/browse/HIVE-16962?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuefu Zhang reassigned HIVE-16962: -- > Better error msg for Hive on Spark in case user cancels query and closes > session > ---

[jira] [Assigned] (HIVE-16961) Hive on Spark leaks spark application in case user cancels query and closes session

[ https://issues.apache.org/jira/browse/HIVE-16961?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuefu Zhang reassigned HIVE-16961: -- > Hive on Spark leaks spark application in case user cancels query and closes > session >

[jira] [Commented] (HIVE-16840) Investigate the performance of order by limit in HoS

[ https://issues.apache.org/jira/browse/HIVE-16840?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16057563#comment-16057563 ] Xuefu Zhang commented on HIVE-16840: Re: turning the optimization when limit number is

[jira] [Comment Edited] (HIVE-16840) Investigate the performance of order by limit in HoS

[ https://issues.apache.org/jira/browse/HIVE-16840?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16057563#comment-16057563 ] Xuefu Zhang edited comment on HIVE-16840 at 6/21/17 2:00 PM: -

[jira] [Commented] (HIVE-16876) RpcServer should be re-created when Rpc configs change

[ https://issues.apache.org/jira/browse/HIVE-16876?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16049986#comment-16049986 ] Xuefu Zhang commented on HIVE-16876: +1 > RpcServer should be re-created when Rpc con

[jira] [Commented] (HIVE-16876) RpcServer should be re-created when Rpc configs change

[ https://issues.apache.org/jira/browse/HIVE-16876?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16047316#comment-16047316 ] Xuefu Zhang commented on HIVE-16876: Yeah. Documentation is good to have. > RpcServer

[jira] [Commented] (HIVE-16840) Investigate the performance of order by limit in HoS

[ https://issues.apache.org/jira/browse/HIVE-16840?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16047194#comment-16047194 ] Xuefu Zhang commented on HIVE-16840: [~kellyzly], sorry for the confusion. I think you

[jira] [Commented] (HIVE-16876) RpcServer should be re-created when Rpc configs change

[ https://issues.apache.org/jira/browse/HIVE-16876?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16046891#comment-16046891 ] Xuefu Zhang commented on HIVE-16876: [~lirui], I'm wondering what kind of configuratio

[jira] [Commented] (HIVE-16854) SparkClientFactory is locked too aggressively

[ https://issues.apache.org/jira/browse/HIVE-16854?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16045762#comment-16045762 ] Xuefu Zhang commented on HIVE-16854: Thank [~lirui] for enhancing the fix. Removing th

[jira] [Commented] (HIVE-16840) Investigate the performance of order by limit in HoS

[ https://issues.apache.org/jira/browse/HIVE-16840?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16044058#comment-16044058 ] Xuefu Zhang commented on HIVE-16840: Re: only ensure the elements in each partition ar

[jira] [Commented] (HIVE-16840) Investigate the performance of order by limit in HoS

[ https://issues.apache.org/jira/browse/HIVE-16840?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16044007#comment-16044007 ] Xuefu Zhang commented on HIVE-16840: This might not fly. SparkContext is only availabl

[jira] [Commented] (HIVE-16840) Investigate the performance of order by limit in HoS

[ https://issues.apache.org/jira/browse/HIVE-16840?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16043985#comment-16043985 ] Xuefu Zhang commented on HIVE-16840: [~kellyzly], I believe take(n) and takeOrdered(n)

[jira] [Comment Edited] (HIVE-16840) Investigate the performance of order by limit in HoS

[ https://issues.apache.org/jira/browse/HIVE-16840?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16043964#comment-16043964 ] Xuefu Zhang edited comment on HIVE-16840 at 6/9/17 5:37 AM: [~

[jira] [Commented] (HIVE-16840) Investigate the performance of order by limit in HoS

[ https://issues.apache.org/jira/browse/HIVE-16840?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16043964#comment-16043964 ] Xuefu Zhang commented on HIVE-16840: [~kellyzly], Thanks for sharing the info. This mi

[jira] [Updated] (HIVE-16854) SparkClientFactory is locked too aggressively

[ https://issues.apache.org/jira/browse/HIVE-16854?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuefu Zhang updated HIVE-16854: --- Status: Patch Available (was: Open) > SparkClientFactory is locked too aggressively > ---

[jira] [Updated] (HIVE-16854) SparkClientFactory is locked too aggressively

[ https://issues.apache.org/jira/browse/HIVE-16854?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuefu Zhang updated HIVE-16854: --- Attachment: HIVE-16854.patch [~lirui], I has some thoughts on this and I put it as a patch. Could you

[jira] [Comment Edited] (HIVE-16840) Investigate the performance of order by limit in HoS

[ https://issues.apache.org/jira/browse/HIVE-16840?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16041829#comment-16041829 ] Xuefu Zhang edited comment on HIVE-16840 at 6/8/17 3:52 AM: [~

[jira] [Updated] (HIVE-16854) SparkClientFactory is locked too aggressively

[ https://issues.apache.org/jira/browse/HIVE-16854?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuefu Zhang updated HIVE-16854: --- Description: Most methods in SparkClientFactory are synchronized on the SparkClientFactory singleton.

[jira] [Updated] (HIVE-16854) SparkClientFactory is locked too aggressively

[ https://issues.apache.org/jira/browse/HIVE-16854?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuefu Zhang updated HIVE-16854: --- Attachment: 15763.jstack > SparkClientFactory is locked too aggressively > ---

[jira] [Commented] (HIVE-16854) SparkClientFactory is locked too aggressively

[ https://issues.apache.org/jira/browse/HIVE-16854?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16042139#comment-16042139 ] Xuefu Zhang commented on HIVE-16854: cc: [~lirui] > SparkClientFactory is locked too

[jira] [Commented] (HIVE-16840) Investigate the performance of order by limit in HoS

[ https://issues.apache.org/jira/browse/HIVE-16840?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16041829#comment-16041829 ] Xuefu Zhang commented on HIVE-16840: [~kellyzly], I think you're right and I was confu

[jira] [Commented] (HIVE-16840) Investigate the performance of order by limit in HoS

[ https://issues.apache.org/jira/browse/HIVE-16840?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16041432#comment-16041432 ] Xuefu Zhang commented on HIVE-16840: [~kellyzly], thanks for looking into this. I'm no

[jira] [Commented] (HIVE-6348) Order by/Sort by in subquery

[ https://issues.apache.org/jira/browse/HIVE-6348?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16041187#comment-16041187 ] Xuefu Zhang commented on HIVE-6348: --- Sounds good, [~lirui], [~vgarg]. As this is an optim

[jira] [Commented] (HIVE-6348) Order by/Sort by in subquery

[ https://issues.apache.org/jira/browse/HIVE-6348?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16037986#comment-16037986 ] Xuefu Zhang commented on HIVE-6348: --- [~lirui], I think it's better to remove it from oper

[jira] [Commented] (HIVE-6348) Order by/Sort by in subquery

[ https://issues.apache.org/jira/browse/HIVE-6348?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16037185#comment-16037185 ] Xuefu Zhang commented on HIVE-6348: --- I'm wondering if it makes more sense to optimize the

[jira] [Updated] (HIVE-16799) Control the max number of task for a stage in a spark job

[ https://issues.apache.org/jira/browse/HIVE-16799?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuefu Zhang updated HIVE-16799: --- Labels: TODOC3.0 (was: ) > Control the max number of task for a stage in a spark job > --

[jira] [Updated] (HIVE-16799) Control the max number of task for a stage in a spark job

[ https://issues.apache.org/jira/browse/HIVE-16799?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuefu Zhang updated HIVE-16799: --- Resolution: Fixed Fix Version/s: 3.0.0 Release Note: Document the new configuration.

<    1   2   3   4   5   6   7   8   9   10   >