[jira] [Assigned] (HIVE-16806) Utilities isEmptyPath Loads All Files

[ https://issues.apache.org/jira/browse/HIVE-16806?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuefu Zhang reassigned HIVE-16806: -- Assignee: BELUGA BEHR > Utilities isEmptyPath Loads All Files >

[jira] [Issue Comment Deleted] (HIVE-16799) Control the max number of task for a stage in a spark job

[ https://issues.apache.org/jira/browse/HIVE-16799?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuefu Zhang updated HIVE-16799: --- Comment: was deleted (was: Test failures seems unrelated. [~lirui], could you please review since

[jira] [Commented] (HIVE-16799) Control the max number of task for a stage in a spark job

[ https://issues.apache.org/jira/browse/HIVE-16799?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16033089#comment-16033089 ] Xuefu Zhang commented on HIVE-16799: Test failures seems unrelated. [~lirui], could you please review

[jira] [Updated] (HIVE-16799) Control the max number of task for a stage in a spark job

[ https://issues.apache.org/jira/browse/HIVE-16799?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuefu Zhang updated HIVE-16799: --- Status: Patch Available (was: Open) > Control the max number of task for a stage in a spark job >

[jira] [Updated] (HIVE-16799) Control the max number of task for a stage in a spark job

[ https://issues.apache.org/jira/browse/HIVE-16799?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuefu Zhang updated HIVE-16799: --- Attachment: HIVE-16799.patch > Control the max number of task for a stage in a spark job >

[jira] [Assigned] (HIVE-16799) Control the max number of task for a stage in a spark job

[ https://issues.apache.org/jira/browse/HIVE-16799?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuefu Zhang reassigned HIVE-16799: -- > Control the max number of task for a stage in a spark job >

[jira] [Commented] (HIVE-16613) SaslClientHandler.sendHello is eating exceptions

[ https://issues.apache.org/jira/browse/HIVE-16613?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16024102#comment-16024102 ] Xuefu Zhang commented on HIVE-16613: Sorry that I have missed this. +1 > SaslClientHandler.sendHello

[jira] [Commented] (HIVE-16600) Refactor SetSparkReducerParallelism#needSetParallelism to enable parallel order by in multi_insert cases

[ https://issues.apache.org/jira/browse/HIVE-16600?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16021627#comment-16021627 ] Xuefu Zhang commented on HIVE-16600: Yeah, I agree with [~lirui] that multi-insert operator tree

[jira] [Commented] (HIVE-16693) beeline "source" command freezes if you have a comment in it?

[ https://issues.apache.org/jira/browse/HIVE-16693?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16018210#comment-16018210 ] Xuefu Zhang commented on HIVE-16693: +1 > beeline "source" command freezes if you have a comment in

[jira] [Commented] (HIVE-16700) Log ZK discovery info (hostname & port) for HTTP mode when connection is established

[ https://issues.apache.org/jira/browse/HIVE-16700?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16014939#comment-16014939 ] Xuefu Zhang commented on HIVE-16700: +1 > Log ZK discovery info (hostname & port) for HTTP mode when

[jira] [Commented] (HIVE-16698) HoS should avoid mapjoin optimization in case of union and using table stats

[ https://issues.apache.org/jira/browse/HIVE-16698?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16014556#comment-16014556 ] Xuefu Zhang commented on HIVE-16698: +1 pending on tests > HoS should avoid mapjoin optimization in

[jira] [Commented] (HIVE-16696) Fix JoinCondDesc explain string

[ https://issues.apache.org/jira/browse/HIVE-16696?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16014395#comment-16014395 ] Xuefu Zhang commented on HIVE-16696: +1 pending on test > Fix JoinCondDesc explain string >

[jira] [Comment Edited] (HIVE-16600) Refactor SetSparkReducerParallelism#needSetParallelism to enable parallel order by in multi_insert cases

[ https://issues.apache.org/jira/browse/HIVE-16600?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16014389#comment-16014389 ] Xuefu Zhang edited comment on HIVE-16600 at 5/17/17 4:57 PM: - Hi [~lirui], For

[jira] [Commented] (HIVE-16600) Refactor SetSparkReducerParallelism#needSetParallelism to enable parallel order by in multi_insert cases

[ https://issues.apache.org/jira/browse/HIVE-16600?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16014389#comment-16014389 ] Xuefu Zhang commented on HIVE-16600: Hi [~lirui], For your example, my understanding is that the

[jira] [Issue Comment Deleted] (HIVE-6469) skipTrash option in hive command line

[ https://issues.apache.org/jira/browse/HIVE-6469?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuefu Zhang updated HIVE-6469: -- Comment: was deleted (was: ATTENTION: The email address for the person you have sent this message to

[jira] [Issue Comment Deleted] (HIVE-6469) skipTrash option in hive command line

[ https://issues.apache.org/jira/browse/HIVE-6469?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuefu Zhang updated HIVE-6469: -- Comment: was deleted (was: ATTENTION: The email address for the person you have sent this message to

[jira] [Issue Comment Deleted] (HIVE-6469) skipTrash option in hive command line

[ https://issues.apache.org/jira/browse/HIVE-6469?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuefu Zhang updated HIVE-6469: -- Comment: was deleted (was: ATTENTION: The email address for the person you have sent this message to

[jira] [Issue Comment Deleted] (HIVE-6469) skipTrash option in hive command line

[ https://issues.apache.org/jira/browse/HIVE-6469?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuefu Zhang updated HIVE-6469: -- Comment: was deleted (was: ATTENTION: The email address for the person you have sent this message to

[jira] [Commented] (HIVE-15104) Hive on Spark generate more shuffle data than hive on mr

[ https://issues.apache.org/jira/browse/HIVE-15104?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16008107#comment-16008107 ] Xuefu Zhang commented on HIVE-15104: [~lirui], great progress! Thanks for keeping up the effort. As

[jira] [Commented] (HIVE-16593) SparkClientFactory.stop may prevent JVM from exiting

[ https://issues.apache.org/jira/browse/HIVE-16593?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16003497#comment-16003497 ] Xuefu Zhang commented on HIVE-16593: +1 > SparkClientFactory.stop may prevent JVM from exiting >

[jira] [Updated] (HIVE-16456) Kill spark job when InterruptedException happens or driverContext.isShutdown is true.

[ https://issues.apache.org/jira/browse/HIVE-16456?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuefu Zhang updated HIVE-16456: --- Resolution: Fixed Fix Version/s: 3.0.0 Status: Resolved (was: Patch Available)

[jira] [Commented] (HIVE-14412) Add a timezone-aware timestamp

[ https://issues.apache.org/jira/browse/HIVE-14412?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16002794#comment-16002794 ] Xuefu Zhang commented on HIVE-14412: +1 > Add a timezone-aware timestamp >

[jira] [Commented] (HIVE-16456) Kill spark job when InterruptedException happens or driverContext.isShutdown is true.

[ https://issues.apache.org/jira/browse/HIVE-16456?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16001868#comment-16001868 ] Xuefu Zhang commented on HIVE-16456: [~zxu] See it now. Thanks for the explanation. +1 from me also.

[jira] [Commented] (HIVE-14412) Add a timezone-aware timestamp

[ https://issues.apache.org/jira/browse/HIVE-14412?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16001781#comment-16001781 ] Xuefu Zhang commented on HIVE-14412: Since session zone is not currently available in Hive, I think

[jira] [Commented] (HIVE-14412) Add a timezone-aware timestamp

[ https://issues.apache.org/jira/browse/HIVE-14412?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16000115#comment-16000115 ] Xuefu Zhang commented on HIVE-14412: Patch looks good. I had a couple of questions on RB. > Add a

[jira] [Commented] (HIVE-16456) Kill spark job when InterruptedException happens or driverContext.isShutdown is true.

[ https://issues.apache.org/jira/browse/HIVE-16456?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=1695#comment-1695 ] Xuefu Zhang commented on HIVE-16456: [~zxu], just as a FYI, I don't see your response on review board.

[jira] [Commented] (HIVE-16456) Kill spark job when InterruptedException happens or driverContext.isShutdown is true.

[ https://issues.apache.org/jira/browse/HIVE-16456?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15998910#comment-15998910 ] Xuefu Zhang commented on HIVE-16456: [~zxu], I had one comment on RB. Thanks. > Kill spark job when

[jira] [Commented] (HIVE-15997) Resource leaks when query is cancelled

[ https://issues.apache.org/jira/browse/HIVE-15997?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15998861#comment-15998861 ] Xuefu Zhang commented on HIVE-15997: Thanks for the explanation, [~ychena]. One more question: which

[jira] [Commented] (HIVE-16456) Kill spark job when InterruptedException happens or driverContext.isShutdown is true.

[ https://issues.apache.org/jira/browse/HIVE-16456?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15997060#comment-15997060 ] Xuefu Zhang commented on HIVE-16456: [~zxu], any thoughts on [~lirui]'s question above? Also, the

[jira] [Updated] (HIVE-16552) Limit the number of tasks a Spark job may contain

[ https://issues.apache.org/jira/browse/HIVE-16552?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuefu Zhang updated HIVE-16552: --- Resolution: Fixed Fix Version/s: 3.0.0 Status: Resolved (was: Patch Available) >

[jira] [Commented] (HIVE-16552) Limit the number of tasks a Spark job may contain

[ https://issues.apache.org/jira/browse/HIVE-16552?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15997032#comment-15997032 ] Xuefu Zhang commented on HIVE-16552: Committed to master. Thanks to Rui for the review. > Limit the

[jira] [Updated] (HIVE-16552) Limit the number of tasks a Spark job may contain

[ https://issues.apache.org/jira/browse/HIVE-16552?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuefu Zhang updated HIVE-16552: --- Attachment: HIVE-16552.4.patch UPdated with Rui's suggestion. > Limit the number of tasks a Spark

[jira] [Commented] (HIVE-16558) In the hiveserver2.jsp page, when you click Drilldown to view the details of the Closed Queries, the Chinese show garbled

[ https://issues.apache.org/jira/browse/HIVE-16558?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15995562#comment-15995562 ] Xuefu Zhang commented on HIVE-16558: +1 > In the hiveserver2.jsp page, when you click Drilldown to

[jira] [Updated] (HIVE-16552) Limit the number of tasks a Spark job may contain

[ https://issues.apache.org/jira/browse/HIVE-16552?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuefu Zhang updated HIVE-16552: --- Attachment: HIVE-16552.3.patch Patch #3 has the following updates: 1. Added a negative test 2. Keep

[jira] [Updated] (HIVE-16552) Limit the number of tasks a Spark job may contain

[ https://issues.apache.org/jira/browse/HIVE-16552?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuefu Zhang updated HIVE-16552: --- Attachment: HIVE-16552.2.patch > Limit the number of tasks a Spark job may contain >

[jira] [Commented] (HIVE-16552) Limit the number of tasks a Spark job may contain

[ https://issues.apache.org/jira/browse/HIVE-16552?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15993499#comment-15993499 ] Xuefu Zhang commented on HIVE-16552: Patch #2 addressed RB feedback. > Limit the number of tasks a

[jira] [Commented] (HIVE-16563) Alter table partition set location should use fully qualified path for non-default FS

[ https://issues.apache.org/jira/browse/HIVE-16563?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15993379#comment-15993379 ] Xuefu Zhang commented on HIVE-16563: +1 > Alter table partition set location should use fully

[jira] [Commented] (HIVE-11133) Support hive.explain.user for Spark

[ https://issues.apache.org/jira/browse/HIVE-11133?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15993332#comment-15993332 ] Xuefu Zhang commented on HIVE-11133: Patch #9 worked just fine. I guessed it needed java8 to compile.

[jira] [Resolved] (HIVE-11133) Support hive.explain.user for Spark

[ https://issues.apache.org/jira/browse/HIVE-11133?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuefu Zhang resolved HIVE-11133. Resolution: Fixed > Support hive.explain.user for Spark > --- > >

[jira] [Commented] (HIVE-11133) Support hive.explain.user for Spark

[ https://issues.apache.org/jira/browse/HIVE-11133?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15992341#comment-15992341 ] Xuefu Zhang commented on HIVE-11133: It didn't work. Please play it and make sure the patch works for

[jira] [Commented] (HIVE-16552) Limit the number of tasks a Spark job may contain

[ https://issues.apache.org/jira/browse/HIVE-16552?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15992334#comment-15992334 ] Xuefu Zhang commented on HIVE-16552: [~lirui], while you have a point, but the resource usage doesn't

[jira] [Commented] (HIVE-11133) Support hive.explain.user for Spark

[ https://issues.apache.org/jira/browse/HIVE-11133?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15992303#comment-15992303 ] Xuefu Zhang commented on HIVE-11133: Sorry for breaking the build. I should have built locally before

[jira] [Commented] (HIVE-16552) Limit the number of tasks a Spark job may contain

[ https://issues.apache.org/jira/browse/HIVE-16552?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15992296#comment-15992296 ] Xuefu Zhang commented on HIVE-16552: [~lirui], as mentioned in the description, the main use of this

[jira] [Updated] (HIVE-16524) Remove the redundant item type in hiveserver2.jsp and QueryProfileTmpl.jamon

[ https://issues.apache.org/jira/browse/HIVE-16524?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuefu Zhang updated HIVE-16524: --- Resolution: Fixed Fix Version/s: 3.0.0 Status: Resolved (was: Patch Available)

[jira] [Updated] (HIVE-11133) Support hive.explain.user for Spark

[ https://issues.apache.org/jira/browse/HIVE-11133?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuefu Zhang updated HIVE-11133: --- Labels: TODOC3.0 (was: ) > Support hive.explain.user for Spark > ---

[jira] [Updated] (HIVE-11133) Support hive.explain.user for Spark

[ https://issues.apache.org/jira/browse/HIVE-11133?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuefu Zhang updated HIVE-11133: --- Resolution: Fixed Fix Version/s: 3.0.0 Status: Resolved (was: Patch Available)

[jira] [Updated] (HIVE-5831) filter input files for bucketed tables

[ https://issues.apache.org/jira/browse/HIVE-5831?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuefu Zhang updated HIVE-5831: -- Resolution: Duplicate Status: Resolved (was: Patch Available) > filter input files for bucketed

[jira] [Commented] (HIVE-5831) filter input files for bucketed tables

[ https://issues.apache.org/jira/browse/HIVE-5831?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15991898#comment-15991898 ] Xuefu Zhang commented on HIVE-5831: --- Great! Thanks for the info, [~gopalv]! > filter input files for

[jira] [Commented] (HIVE-5831) filter input files for bucketed tables

[ https://issues.apache.org/jira/browse/HIVE-5831?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15991859#comment-15991859 ] Xuefu Zhang commented on HIVE-5831: --- Any interest in moving this forward? > filter input files for

[jira] [Commented] (HIVE-11133) Support hive.explain.user for Spark

[ https://issues.apache.org/jira/browse/HIVE-11133?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15991509#comment-15991509 ] Xuefu Zhang commented on HIVE-11133: Unfortunately, the patch doesn't apply clean on master.

[jira] [Updated] (HIVE-16552) Limit the number of tasks a Spark job may contain

[ https://issues.apache.org/jira/browse/HIVE-16552?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuefu Zhang updated HIVE-16552: --- Attachment: HIVE-16552.1.patch > Limit the number of tasks a Spark job may contain >

[jira] [Commented] (HIVE-16552) Limit the number of tasks a Spark job may contain

[ https://issues.apache.org/jira/browse/HIVE-16552?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15989201#comment-15989201 ] Xuefu Zhang commented on HIVE-16552: hi [~csun] and [~lirui], could you please review the changes?

[jira] [Commented] (HIVE-16524) Remove the redundant item type in hiveserver2.jsp and QueryProfileTmpl.jamon

[ https://issues.apache.org/jira/browse/HIVE-16524?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15989195#comment-15989195 ] Xuefu Zhang commented on HIVE-16524: +1 > Remove the redundant item type in hiveserver2.jsp and

[jira] [Commented] (HIVE-15997) Resource leaks when query is cancelled

[ https://issues.apache.org/jira/browse/HIVE-15997?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15988193#comment-15988193 ] Xuefu Zhang commented on HIVE-15997: [~ychena], Thanks for the explanation. I wasn't questioning the

[jira] [Commented] (HIVE-15997) Resource leaks when query is cancelled

[ https://issues.apache.org/jira/browse/HIVE-15997?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15987880#comment-15987880 ] Xuefu Zhang commented on HIVE-15997: Hi [~ychena]/[~ctang.ma], Thanks for looking into this. I'm

[jira] [Commented] (HIVE-16456) Kill spark job when InterruptedException happens or driverContext.isShutdown is true.

[ https://issues.apache.org/jira/browse/HIVE-16456?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15987607#comment-15987607 ] Xuefu Zhang commented on HIVE-16456: Hi [~zxu], Thanks for working on this. Could you please provide a

[jira] [Updated] (HIVE-16552) Limit the number of tasks a Spark job may contain

[ https://issues.apache.org/jira/browse/HIVE-16552?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuefu Zhang updated HIVE-16552: --- Attachment: HIVE-16552.patch > Limit the number of tasks a Spark job may contain >

[jira] [Updated] (HIVE-16552) Limit the number of tasks a Spark job may contain

[ https://issues.apache.org/jira/browse/HIVE-16552?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuefu Zhang updated HIVE-16552: --- Status: Patch Available (was: Open) > Limit the number of tasks a Spark job may contain >

[jira] [Updated] (HIVE-16552) Limit the number of tasks a Spark job may contain

[ https://issues.apache.org/jira/browse/HIVE-16552?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuefu Zhang updated HIVE-16552: --- Affects Version/s: 1.0.0 2.0.0 > Limit the number of tasks a Spark job may

[jira] [Assigned] (HIVE-16552) Limit the number of tasks a Spark job may contain

[ https://issues.apache.org/jira/browse/HIVE-16552?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuefu Zhang reassigned HIVE-16552: -- > Limit the number of tasks a Spark job may contain >

[jira] [Updated] (HIVE-12614) RESET command does not close spark session

[ https://issues.apache.org/jira/browse/HIVE-12614?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuefu Zhang updated HIVE-12614: --- Resolution: Fixed Fix Version/s: 2.2.0 Status: Resolved (was: Patch Available)

[jira] [Commented] (HIVE-12614) RESET command does not close spark session

[ https://issues.apache.org/jira/browse/HIVE-12614?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15982020#comment-15982020 ] Xuefu Zhang commented on HIVE-12614: +1 > RESET command does not close spark session >

[jira] [Commented] (HIVE-11133) Support hive.explain.user for Spark

[ https://issues.apache.org/jira/browse/HIVE-11133?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15979394#comment-15979394 ] Xuefu Zhang commented on HIVE-11133: Looks good. Two things: 1. Please update the patch based on the

[jira] [Commented] (HIVE-11133) Support hive.explain.user for Spark

[ https://issues.apache.org/jira/browse/HIVE-11133?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15979287#comment-15979287 ] Xuefu Zhang commented on HIVE-11133: [~stakiar], could you please provide an example where non-root

[jira] [Comment Edited] (HIVE-11133) Support hive.explain.user for Spark

[ https://issues.apache.org/jira/browse/HIVE-11133?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15977619#comment-15977619 ] Xuefu Zhang edited comment on HIVE-11133 at 4/20/17 9:53 PM: - [~stakiar], In

[jira] [Commented] (HIVE-11133) Support hive.explain.user for Spark

[ https://issues.apache.org/jira/browse/HIVE-11133?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15977619#comment-15977619 ] Xuefu Zhang commented on HIVE-11133: [~stakiar], In spark, any stage may have a vertex dependency. For

[jira] [Comment Edited] (HIVE-11133) Support hive.explain.user for Spark

[ https://issues.apache.org/jira/browse/HIVE-11133?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15975728#comment-15975728 ] Xuefu Zhang edited comment on HIVE-11133 at 4/19/17 11:18 PM: -- [~stakiar],

[jira] [Commented] (HIVE-11133) Support hive.explain.user for Spark

[ https://issues.apache.org/jira/browse/HIVE-11133?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15975728#comment-15975728 ] Xuefu Zhang commented on HIVE-11133: [~stakiar], Thanks for working on this. I left some minor

[jira] [Updated] (HIVE-11133) Support hive.explain.user for Spark

[ https://issues.apache.org/jira/browse/HIVE-11133?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuefu Zhang updated HIVE-11133: --- Summary: Support hive.explain.user for Spark (was: Support hive.explain.user for Spark [Spark

[jira] [Commented] (HIVE-16471) Add metrics for "waiting compilation time"

[ https://issues.apache.org/jira/browse/HIVE-16471?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15975697#comment-15975697 ] Xuefu Zhang commented on HIVE-16471: +1 > Add metrics for "waiting compilation time" >

[jira] [Commented] (HIVE-16484) Investigate SparkLauncher for HoS as alternative to bin/spark-submit

[ https://issues.apache.org/jira/browse/HIVE-16484?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15975693#comment-15975693 ] Xuefu Zhang commented on HIVE-16484: Hi [~stakiar], thanks for bringing it up. I think it would be

[jira] [Commented] (HIVE-16483) HoS should populate split related configurations to HiveConf

[ https://issues.apache.org/jira/browse/HIVE-16483?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15975652#comment-15975652 ] Xuefu Zhang commented on HIVE-16483: +1 pending on test results. > HoS should populate split related

[jira] [Commented] (HIVE-16311) Improve the performance for FastHiveDecimalImpl.fastDivide

[ https://issues.apache.org/jira/browse/HIVE-16311?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15974540#comment-15974540 ] Xuefu Zhang commented on HIVE-16311: +1 Patch looks good to me. > Improve the performance for

[jira] [Commented] (HIVE-15302) Relax the requirement that HoS needs Spark built w/o Hive

[ https://issues.apache.org/jira/browse/HIVE-15302?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15973590#comment-15973590 ] Xuefu Zhang commented on HIVE-15302: [~lirui] I think Marcelo's suggestion makes sense. It's quite

[jira] [Commented] (HIVE-16311) Improve the performance for FastHiveDecimalImpl.fastDivide

[ https://issues.apache.org/jira/browse/HIVE-16311?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15973275#comment-15973275 ] Xuefu Zhang commented on HIVE-16311: Patch looks good to me. Minor questions on RB for my understand.

[jira] [Commented] (HIVE-16459) Cancel outstanding RPCs when channel closes

[ https://issues.apache.org/jira/browse/HIVE-16459?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15972096#comment-15972096 ] Xuefu Zhang commented on HIVE-16459: +1 > Cancel outstanding RPCs when channel closes >

[jira] [Updated] (HIVE-16430) Add log to show the cancelled query id when cancelOperation is called.

[ https://issues.apache.org/jira/browse/HIVE-16430?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuefu Zhang updated HIVE-16430: --- Resolution: Fixed Fix Version/s: 3.0.0 Status: Resolved (was: Patch Available)

[jira] [Commented] (HIVE-16431) Support Parquet StatsNoJobTask for Spark & Tez engine

[ https://issues.apache.org/jira/browse/HIVE-16431?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15968286#comment-15968286 ] Xuefu Zhang commented on HIVE-16431: Cool then! +1 > Support Parquet StatsNoJobTask for Spark & Tez

[jira] [Commented] (HIVE-16431) Support Parquet StatsNoJobTask for Spark & Tez engine

[ https://issues.apache.org/jira/browse/HIVE-16431?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15968261#comment-15968261 ] Xuefu Zhang commented on HIVE-16431: I was looking at GenMRTableScan1.java. My code could be old

[jira] [Commented] (HIVE-16431) Support Parquet StatsNoJobTask for Spark & Tez engine

[ https://issues.apache.org/jira/browse/HIVE-16431?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15968233#comment-15968233 ] Xuefu Zhang commented on HIVE-16431: Patch looks good. I checked the same thing for MR and found over

[jira] [Commented] (HIVE-16418) Allow HiveKey to skip some bytes for comparison

[ https://issues.apache.org/jira/browse/HIVE-16418?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15968071#comment-15968071 ] Xuefu Zhang commented on HIVE-16418: For datatype "TIMESTAMP WITH TIME ZONE", I don't think there is a

[jira] [Commented] (HIVE-16430) Add log to show the cancelled query id when cancelOperation is called.

[ https://issues.apache.org/jira/browse/HIVE-16430?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15967140#comment-15967140 ] Xuefu Zhang commented on HIVE-16430: +1 > Add log to show the cancelled query id when cancelOperation

[jira] [Commented] (HIVE-16430) Add log to show the cancelled query id when cancelOperation is called.

[ https://issues.apache.org/jira/browse/HIVE-16430?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15966879#comment-15966879 ] Xuefu Zhang commented on HIVE-16430: Thanks for working on this, [~zxu]. The patch looks good. It

[jira] [Commented] (HIVE-12614) RESET command does not close spark session

[ https://issues.apache.org/jira/browse/HIVE-12614?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15966720#comment-15966720 ] Xuefu Zhang commented on HIVE-12614: Patch looks good. Minor comment on RB. > RESET command does not

[jira] [Commented] (HIVE-16328) HoS: more aggressive mapjoin optimization when hive.spark.use.file.size.for.mapjoin is true

[ https://issues.apache.org/jira/browse/HIVE-16328?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15964986#comment-15964986 ] Xuefu Zhang commented on HIVE-16328: +1 > HoS: more aggressive mapjoin optimization when >

[jira] [Commented] (HIVE-16257) Intermittent issue with incorrect resultset with Spark

[ https://issues.apache.org/jira/browse/HIVE-16257?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15961436#comment-15961436 ] Xuefu Zhang commented on HIVE-16257: [~ngangam], Yes, our build has HIVE-12768, which explains why we

[jira] [Commented] (HIVE-16385) StatsNoJobTask could exit early before all partitions have been processed

[ https://issues.apache.org/jira/browse/HIVE-16385?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15959757#comment-15959757 ] Xuefu Zhang commented on HIVE-16385: +1 > StatsNoJobTask could exit early before all partitions have

[jira] [Commented] (HIVE-16257) Intermittent issue with incorrect resultset with Spark

[ https://issues.apache.org/jira/browse/HIVE-16257?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15959366#comment-15959366 ] Xuefu Zhang commented on HIVE-16257: It's a little strange that you have 4 tasks in the first stage,

[jira] [Commented] (HIVE-10084) Improve common join performance [Spark Branch]

[ https://issues.apache.org/jira/browse/HIVE-10084?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15959215#comment-15959215 ] Xuefu Zhang commented on HIVE-10084: Hi [~stakiar], The conclusion came from a benchmark between Spark

[jira] [Commented] (HIVE-16311) Improve the performance for FastHiveDecimalImpl.fastDivide

[ https://issues.apache.org/jira/browse/HIVE-16311?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15959161#comment-15959161 ] Xuefu Zhang commented on HIVE-16311: I agree with [~mmccline] that Hive's methodology in dealing with

[jira] [Commented] (HIVE-16394) HoS does not support queue name change in middle of session

[ https://issues.apache.org/jira/browse/HIVE-16394?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15958214#comment-15958214 ] Xuefu Zhang commented on HIVE-16394: Patch looks good. Can you also check if spark.yarn.queue is also

[jira] [Comment Edited] (HIVE-16311) Improve the performance for FastHiveDecimalImpl.fastDivide

[ https://issues.apache.org/jira/browse/HIVE-16311?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15955628#comment-15955628 ] Xuefu Zhang edited comment on HIVE-16311 at 4/4/17 6:58 PM: [~colin_mjj], The

[jira] [Commented] (HIVE-16311) Improve the performance for FastHiveDecimalImpl.fastDivide

[ https://issues.apache.org/jira/browse/HIVE-16311?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15955628#comment-15955628 ] Xuefu Zhang commented on HIVE-16311: [~colin_mjj], The code changes looks good. However, I'm not sure

[jira] [Commented] (HIVE-13517) Hive logs in Spark Executor and Driver should show thread-id.

[ https://issues.apache.org/jira/browse/HIVE-13517?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15953928#comment-15953928 ] Xuefu Zhang commented on HIVE-13517: [~stakiar], Thanks for following up with this. I read thru the

[jira] [Commented] (HIVE-16348) HoS query is canceled but error message shows RPC is closed

[ https://issues.apache.org/jira/browse/HIVE-16348?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15951556#comment-15951556 ] Xuefu Zhang commented on HIVE-16348: +1 pending on test. > HoS query is canceled but error message

[jira] [Comment Edited] (HIVE-16311) Improve the performance for FastHiveDecimalImpl.fastDivide

[ https://issues.apache.org/jira/browse/HIVE-16311?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15945102#comment-15945102 ] Xuefu Zhang edited comment on HIVE-16311 at 3/28/17 1:01 PM: - [~colin_mjj],

[jira] [Commented] (HIVE-16311) Improve the performance for FastHiveDecimalImpl.fastDivide

[ https://issues.apache.org/jira/browse/HIVE-16311?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15945102#comment-15945102 ] Xuefu Zhang commented on HIVE-16311: [~colin_mjj], for decimal devision, I don't think your change is

[jira] [Commented] (HIVE-13517) Hive logs in Spark Executor and Driver should show thread-id.

[ https://issues.apache.org/jira/browse/HIVE-13517?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15941350#comment-15941350 ] Xuefu Zhang commented on HIVE-13517: [~stakiar], thanks for working on this. The patch looks good to

[jira] [Updated] (HIVE-16286) Log canceled query id

[ https://issues.apache.org/jira/browse/HIVE-16286?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuefu Zhang updated HIVE-16286: --- Resolution: Fixed Fix Version/s: 2.2.0 Status: Resolved (was: Patch Available)

[jira] [Commented] (HIVE-16286) Log canceled query id

[ https://issues.apache.org/jira/browse/HIVE-16286?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15939188#comment-15939188 ] Xuefu Zhang commented on HIVE-16286: +1 > Log canceled query id > - > >

<    1   2   3   4   5   6   7   8   9   10   >