[jira] [Assigned] (HIVE-20273) Spark jobs aren't cancelled if getSparkJobInfo or getSparkStagesInfo

[ https://issues.apache.org/jira/browse/HIVE-20273?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sahil Takiar reassigned HIVE-20273: --- Assignee: (was: Sahil Takiar) > Spark jobs aren't cancelled if getSparkJobInfo or getSpa

[jira] [Assigned] (HIVE-20519) Remove 30m min value for hive.spark.session.timeout

[ https://issues.apache.org/jira/browse/HIVE-20519?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sahil Takiar reassigned HIVE-20519: --- Assignee: (was: Sahil Takiar) > Remove 30m min value for hive.spark.session.timeout > --

[jira] [Assigned] (HIVE-20828) Upgrade to Spark 2.4.0

[ https://issues.apache.org/jira/browse/HIVE-20828?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sahil Takiar reassigned HIVE-20828: --- Assignee: (was: Sahil Takiar) > Upgrade to Spark 2.4.0 > -- > >

[jira] [Assigned] (HIVE-19821) Distributed HiveServer2

[ https://issues.apache.org/jira/browse/HIVE-19821?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sahil Takiar reassigned HIVE-19821: --- Assignee: (was: Sahil Takiar) > Distributed HiveServer2 > --- > >

[jira] [Commented] (HIVE-14165) Remove Hive file listing during split computation

[ https://issues.apache.org/jira/browse/HIVE-14165?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17033713#comment-17033713 ] Sahil Takiar commented on HIVE-14165: - Marking as unassigned as I am no longer workin

[jira] [Assigned] (HIVE-14165) Remove Hive file listing during split computation

[ https://issues.apache.org/jira/browse/HIVE-14165?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sahil Takiar reassigned HIVE-14165: --- Assignee: (was: Sahil Takiar) > Remove Hive file listing during split computation >

[jira] [Commented] (HIVE-16295) Add support for using Hadoop's S3A OutputCommitter

[ https://issues.apache.org/jira/browse/HIVE-16295?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17007583#comment-17007583 ] Sahil Takiar commented on HIVE-16295: - I'm no longer working on this, so marking as u

[jira] [Assigned] (HIVE-16295) Add support for using Hadoop's S3A OutputCommitter

[ https://issues.apache.org/jira/browse/HIVE-16295?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sahil Takiar reassigned HIVE-16295: --- Assignee: (was: Sahil Takiar) > Add support for using Hadoop's S3A OutputCommitter > ---

[jira] [Commented] (HIVE-20079) Populate more accurate rawDataSize for parquet format

[ https://issues.apache.org/jira/browse/HIVE-20079?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16773098#comment-16773098 ] Sahil Takiar commented on HIVE-20079: - How does ORC handle this? Is there a fundament

[jira] [Commented] (HIVE-20079) Populate more accurate rawDataSize for parquet format

[ https://issues.apache.org/jira/browse/HIVE-20079?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16773046#comment-16773046 ] Sahil Takiar commented on HIVE-20079: - FYI I don't think {{block.getTotalByteSize}} p

[jira] [Commented] (HIVE-20125) Typo in MetricsCollection for OutputMetrics

[ https://issues.apache.org/jira/browse/HIVE-20125?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16711806#comment-16711806 ] Sahil Takiar commented on HIVE-20125: - +1 LGTM > Typo in MetricsCollection for Outpu

[jira] [Commented] (HIVE-20440) Create better cache eviction policy for SmallTableCache

[ https://issues.apache.org/jira/browse/HIVE-20440?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16707458#comment-16707458 ] Sahil Takiar commented on HIVE-20440: - +1 LGTM > Create better cache eviction policy

[jira] [Updated] (HIVE-20828) Upgrade to Spark 2.4.0

[ https://issues.apache.org/jira/browse/HIVE-20828?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sahil Takiar updated HIVE-20828: Attachment: HIVE-20828.2.patch > Upgrade to Spark 2.4.0 > -- > >

[jira] [Commented] (HIVE-20969) HoS sessionId generation can cause race conditions when uploading files to HDFS

[ https://issues.apache.org/jira/browse/HIVE-20969?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16699412#comment-16699412 ] Sahil Takiar commented on HIVE-20969: - +1 LGTM pending tests. > HoS sessionId genera

[jira] [Commented] (HIVE-20969) HoS sessionId generation can cause race conditions when uploading files to HDFS

[ https://issues.apache.org/jira/browse/HIVE-20969?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16699343#comment-16699343 ] Sahil Takiar commented on HIVE-20969: - The intention of HIVE-19008 was so simplify th

[jira] [Updated] (HIVE-20512) Improve record and memory usage logging in SparkRecordHandler

[ https://issues.apache.org/jira/browse/HIVE-20512?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sahil Takiar updated HIVE-20512: Resolution: Fixed Fix Version/s: 4.0.0 Status: Resolved (was: Patch Available) P

[jira] [Commented] (HIVE-20512) Improve record and memory usage logging in SparkRecordHandler

[ https://issues.apache.org/jira/browse/HIVE-20512?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16680044#comment-16680044 ] Sahil Takiar commented on HIVE-20512: - +1 pending tests. > Improve record and memory

[jira] [Commented] (HIVE-20512) Improve record and memory usage logging in SparkRecordHandler

[ https://issues.apache.org/jira/browse/HIVE-20512?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16675889#comment-16675889 ] Sahil Takiar commented on HIVE-20512: - I'm not sure why {{awaitTermination}} would be

[jira] [Assigned] (HIVE-20079) Populate more accurate rawDataSize for parquet format

[ https://issues.apache.org/jira/browse/HIVE-20079?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sahil Takiar reassigned HIVE-20079: --- Assignee: (was: Sahil Takiar) > Populate more accurate rawDataSize for parquet format >

[jira] [Updated] (HIVE-20828) Upgrade to Spark 2.4.0

[ https://issues.apache.org/jira/browse/HIVE-20828?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sahil Takiar updated HIVE-20828: Attachment: HIVE-20828.1.patch > Upgrade to Spark 2.4.0 > -- > >

[jira] [Updated] (HIVE-20828) Upgrade to Spark 2.4.0

[ https://issues.apache.org/jira/browse/HIVE-20828?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sahil Takiar updated HIVE-20828: Status: Patch Available (was: Open) > Upgrade to Spark 2.4.0 > -- > >

[jira] [Updated] (HIVE-20828) Upgrade to Spark 2.4.0

[ https://issues.apache.org/jira/browse/HIVE-20828?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sahil Takiar updated HIVE-20828: Description: The Spark community is in the process of releasing Spark 2.4.0. We should do some test

[jira] [Assigned] (HIVE-20828) Upgrade to Spark 2.4.0

[ https://issues.apache.org/jira/browse/HIVE-20828?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sahil Takiar reassigned HIVE-20828: --- > Upgrade to Spark 2.4.0 > -- > > Key: HIVE-20828 >

[jira] [Commented] (HIVE-20512) Improve record and memory usage logging in SparkRecordHandler

[ https://issues.apache.org/jira/browse/HIVE-20512?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16667403#comment-16667403 ] Sahil Takiar commented on HIVE-20512: - +1 are the test failures related? Given there

[jira] [Updated] (HIVE-20273) Spark jobs aren't cancelled if getSparkJobInfo or getSparkStagesInfo

[ https://issues.apache.org/jira/browse/HIVE-20273?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sahil Takiar updated HIVE-20273: Attachment: HIVE-20273.2.patch > Spark jobs aren't cancelled if getSparkJobInfo or getSparkStagesIn

[jira] [Updated] (HIVE-20519) Remove 30m min value for hive.spark.session.timeout

[ https://issues.apache.org/jira/browse/HIVE-20519?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sahil Takiar updated HIVE-20519: Attachment: HIVE-20519.3.patch > Remove 30m min value for hive.spark.session.timeout >

[jira] [Comment Edited] (HIVE-20790) SparkSession should be able to close a session while it is being opened

[ https://issues.apache.org/jira/browse/HIVE-20790?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16662444#comment-16662444 ] Sahil Takiar edited comment on HIVE-20790 at 10/24/18 3:44 PM:

[jira] [Commented] (HIVE-20790) SparkSession should be able to close a session while it is being opened

[ https://issues.apache.org/jira/browse/HIVE-20790?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16662444#comment-16662444 ] Sahil Takiar commented on HIVE-20790: - Yet another edge to consider, guarding against

[jira] [Commented] (HIVE-20790) SparkSession should be able to close a session while it is being opened

[ https://issues.apache.org/jira/browse/HIVE-20790?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16662428#comment-16662428 ] Sahil Takiar commented on HIVE-20790: - As a follow up to HIVE-20737, we also want to

[jira] [Commented] (HIVE-20737) Local SparkContext is shared between user sessions and should be closed only when there is no active

[ https://issues.apache.org/jira/browse/HIVE-20737?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16661206#comment-16661206 ] Sahil Takiar commented on HIVE-20737: - Filed HIVE-20790 to fix the issue where we wan

[jira] [Commented] (HIVE-20519) Remove 30m min value for hive.spark.session.timeout

[ https://issues.apache.org/jira/browse/HIVE-20519?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16661203#comment-16661203 ] Sahil Takiar commented on HIVE-20519: - Aforementioned issue will be fixed in HIVE-207

[jira] [Updated] (HIVE-20488) SparkSubmitSparkClient#launchDriver should parse exceptions, not just errors

[ https://issues.apache.org/jira/browse/HIVE-20488?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sahil Takiar updated HIVE-20488: Resolution: Fixed Fix Version/s: 4.0.0 Status: Resolved (was: Patch Available) >

[jira] [Commented] (HIVE-20488) SparkSubmitSparkClient#launchDriver should parse exceptions, not just errors

[ https://issues.apache.org/jira/browse/HIVE-20488?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16655467#comment-16655467 ] Sahil Takiar commented on HIVE-20488: - Pushed to master. > SparkSubmitSparkClient#la

[jira] [Commented] (HIVE-20737) Local SparkContext is shared between user sessions and should be closed only when there is no active

[ https://issues.apache.org/jira/browse/HIVE-20737?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16655464#comment-16655464 ] Sahil Takiar commented on HIVE-20737: - Making getting an opened Spark Session + submi

[jira] [Comment Edited] (HIVE-20737) Local SparkContext is shared between user sessions and should be closed only when there is no active

[ https://issues.apache.org/jira/browse/HIVE-20737?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16655458#comment-16655458 ] Sahil Takiar edited comment on HIVE-20737 at 10/18/18 3:49 PM:

[jira] [Commented] (HIVE-20737) Local SparkContext is shared between user sessions and should be closed only when there is no active

[ https://issues.apache.org/jira/browse/HIVE-20737?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16655458#comment-16655458 ] Sahil Takiar commented on HIVE-20737: - {quote} Opening of a Spark session and Job sub

[jira] [Commented] (HIVE-20512) Improve record and memory usage logging in SparkRecordHandler

[ https://issues.apache.org/jira/browse/HIVE-20512?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16655439#comment-16655439 ] Sahil Takiar commented on HIVE-20512: - A few comments: (1) I think the logging should

[jira] [Commented] (HIVE-20737) Local SparkContext is shared between user sessions and should be closed only when there is no active

[ https://issues.apache.org/jira/browse/HIVE-20737?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16655398#comment-16655398 ] Sahil Takiar commented on HIVE-20737: - {quote} As the separate JIRA we are planning t

[jira] [Commented] (HIVE-20488) SparkSubmitSparkClient#launchDriver should parse exceptions, not just errors

[ https://issues.apache.org/jira/browse/HIVE-20488?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16651746#comment-16651746 ] Sahil Takiar commented on HIVE-20488: - +1 LGTM pending a clean run from Hive QA. > S

[jira] [Commented] (HIVE-20737) Local SparkContext is shared between user sessions and should be closed only when there is no active

[ https://issues.apache.org/jira/browse/HIVE-20737?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16651741#comment-16651741 ] Sahil Takiar commented on HIVE-20737: - [~dkuzmenko] left a few comments on the RB. >

[jira] [Commented] (HIVE-20742) SparkSessionManagerImpl maintenance thread only cleans up session once

[ https://issues.apache.org/jira/browse/HIVE-20742?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16651736#comment-16651736 ] Sahil Takiar commented on HIVE-20742: - Nice catch. Overall, LGTM. I think it would be

[jira] [Commented] (HIVE-20519) Remove 30m min value for hive.spark.session.timeout

[ https://issues.apache.org/jira/browse/HIVE-20519?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16651727#comment-16651727 ] Sahil Takiar commented on HIVE-20519: - Another issue that needs to be fixed with this

[jira] [Commented] (HIVE-20512) Improve record and memory usage logging in SparkRecordHandler

[ https://issues.apache.org/jira/browse/HIVE-20512?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16648296#comment-16648296 ] Sahil Takiar commented on HIVE-20512: - I mean time interval. So log the # of rows pro

[jira] [Commented] (HIVE-20737) LocalHiveSparkClient and SparkSession race condition fix

[ https://issues.apache.org/jira/browse/HIVE-20737?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16648287#comment-16648287 ] Sahil Takiar commented on HIVE-20737: - Can you describe the race condition? > LocalH

[jira] [Updated] (HIVE-17684) HoS memory issues with MapJoinMemoryExhaustionHandler

[ https://issues.apache.org/jira/browse/HIVE-17684?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sahil Takiar updated HIVE-17684: Resolution: Fixed Fix Version/s: 4.0.0 Status: Resolved (was: Patch Available) P

[jira] [Commented] (HIVE-17684) HoS memory issues with MapJoinMemoryExhaustionHandler

[ https://issues.apache.org/jira/browse/HIVE-17684?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16627851#comment-16627851 ] Sahil Takiar commented on HIVE-17684: - +1 latest patch LGTM > HoS memory issues with

[jira] [Updated] (HIVE-17684) HoS memory issues with MapJoinMemoryExhaustionHandler

[ https://issues.apache.org/jira/browse/HIVE-17684?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sahil Takiar updated HIVE-17684: Attachment: HIVE-17684.11.patch > HoS memory issues with MapJoinMemoryExhaustionHandler > -

[jira] [Commented] (HIVE-17684) HoS memory issues with MapJoinMemoryExhaustionHandler

[ https://issues.apache.org/jira/browse/HIVE-17684?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16622731#comment-16622731 ] Sahil Takiar commented on HIVE-17684: - [~mi...@cloudera.com] I'm not entirely sure wh

[jira] [Commented] (HIVE-20079) Populate more accurate rawDataSize for parquet format

[ https://issues.apache.org/jira/browse/HIVE-20079?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16615173#comment-16615173 ] Sahil Takiar commented on HIVE-20079: - [~aihuaxu] not sure if you are still planning

[jira] [Assigned] (HIVE-20079) Populate more accurate rawDataSize for parquet format

[ https://issues.apache.org/jira/browse/HIVE-20079?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sahil Takiar reassigned HIVE-20079: --- Assignee: Sahil Takiar (was: Aihua Xu) > Populate more accurate rawDataSize for parquet for

[jira] [Commented] (HIVE-17684) HoS memory issues with MapJoinMemoryExhaustionHandler

[ https://issues.apache.org/jira/browse/HIVE-17684?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16615134#comment-16615134 ] Sahil Takiar commented on HIVE-17684: - We haven't seen any issues or complaints about

[jira] [Commented] (HIVE-20273) Spark jobs aren't cancelled if getSparkJobInfo or getSparkStagesInfo

[ https://issues.apache.org/jira/browse/HIVE-20273?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16615124#comment-16615124 ] Sahil Takiar commented on HIVE-20273: - This patch makes the following fixes: * Fixes

[jira] [Updated] (HIVE-20273) Spark jobs aren't cancelled if getSparkJobInfo or getSparkStagesInfo

[ https://issues.apache.org/jira/browse/HIVE-20273?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sahil Takiar updated HIVE-20273: Description: HIVE-19053 and HIVE-19733 added handling of {{InterruptedException}} to {{RemoteSpark

[jira] [Updated] (HIVE-20273) Spark jobs aren't cancelled if getSparkJobInfo or getSparkStagesInfo

[ https://issues.apache.org/jira/browse/HIVE-20273?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sahil Takiar updated HIVE-20273: Description: HIVE-19053 and HIVE-19733 added handling of {{InterruptedException}} to {{RemoteSpark

[jira] [Updated] (HIVE-20519) Remove 30m min value for hive.spark.session.timeout

[ https://issues.apache.org/jira/browse/HIVE-20519?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sahil Takiar updated HIVE-20519: Attachment: HIVE-20519.2.patch > Remove 30m min value for hive.spark.session.timeout >

[jira] [Commented] (HIVE-17684) HoS memory issues with MapJoinMemoryExhaustionHandler

[ https://issues.apache.org/jira/browse/HIVE-17684?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16614097#comment-16614097 ] Sahil Takiar commented on HIVE-17684: - [~mi...@cloudera.com] I attached an updated pa

[jira] [Updated] (HIVE-17684) HoS memory issues with MapJoinMemoryExhaustionHandler

[ https://issues.apache.org/jira/browse/HIVE-17684?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sahil Takiar updated HIVE-17684: Attachment: HIVE-17684.08.patch > HoS memory issues with MapJoinMemoryExhaustionHandler > -

[jira] [Commented] (HIVE-20440) Create better cache eviction policy for SmallTableCache

[ https://issues.apache.org/jira/browse/HIVE-20440?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16613811#comment-16613811 ] Sahil Takiar commented on HIVE-20440: - Makes sense to me. > Create better cache evic

[jira] [Updated] (HIVE-19814) RPC Server port is always random for spark

[ https://issues.apache.org/jira/browse/HIVE-19814?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sahil Takiar updated HIVE-19814: Resolution: Fixed Fix Version/s: 4.0.0 Status: Resolved (was: Patch Available) P

[jira] [Updated] (HIVE-20519) Remove 30m min value for hive.spark.session.timeout

[ https://issues.apache.org/jira/browse/HIVE-20519?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sahil Takiar updated HIVE-20519: Status: Patch Available (was: Open) > Remove 30m min value for hive.spark.session.timeout > --

[jira] [Updated] (HIVE-20519) Remove 30m min value for hive.spark.session.timeout

[ https://issues.apache.org/jira/browse/HIVE-20519?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sahil Takiar updated HIVE-20519: Attachment: HIVE-20519.1.patch > Remove 30m min value for hive.spark.session.timeout >

[jira] [Commented] (HIVE-19814) RPC Server port is always random for spark

[ https://issues.apache.org/jira/browse/HIVE-19814?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16612515#comment-16612515 ] Sahil Takiar commented on HIVE-19814: - I think this patch is good to merge. I have a

[jira] [Commented] (HIVE-17684) HoS memory issues with MapJoinMemoryExhaustionHandler

[ https://issues.apache.org/jira/browse/HIVE-17684?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16610774#comment-16610774 ] Sahil Takiar commented on HIVE-17684: - Sounds good to me. > HoS memory issues with M

[jira] [Commented] (HIVE-19814) RPC Server port is always random for spark

[ https://issues.apache.org/jira/browse/HIVE-19814?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16610771#comment-16610771 ] Sahil Takiar commented on HIVE-19814: - +1 pending Hive QA > RPC Server port is alway

[jira] [Commented] (HIVE-20506) HOS times out when cluster is full while Hive-on-MR waits

[ https://issues.apache.org/jira/browse/HIVE-20506?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16609504#comment-16609504 ] Sahil Takiar commented on HIVE-20506: - I think you can ignore it. PTest is able to ap

[jira] [Commented] (HIVE-20440) Create better cache eviction policy for SmallTableCache

[ https://issues.apache.org/jira/browse/HIVE-20440?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16609496#comment-16609496 ] Sahil Takiar commented on HIVE-20440: - Then it might be better to have a two level ca

[jira] [Commented] (HIVE-17684) HoS memory issues with MapJoinMemoryExhaustionHandler

[ https://issues.apache.org/jira/browse/HIVE-17684?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16607622#comment-16607622 ] Sahil Takiar commented on HIVE-17684: - [~mi...@cloudera.com] yes we can configure it

[jira] [Assigned] (HIVE-20519) Remove 30m min value for hive.spark.session.timeout

[ https://issues.apache.org/jira/browse/HIVE-20519?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sahil Takiar reassigned HIVE-20519: --- > Remove 30m min value for hive.spark.session.timeout >

[jira] [Commented] (HIVE-20506) HOS times out when cluster is full while Hive-on-MR waits

[ https://issues.apache.org/jira/browse/HIVE-20506?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16607614#comment-16607614 ] Sahil Takiar commented on HIVE-20506: - Yeah, I'll file a follow up JIRA to do the re-

[jira] [Commented] (HIVE-20506) HOS times out when cluster is full while Hive-on-MR waits

[ https://issues.apache.org/jira/browse/HIVE-20506?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16607431#comment-16607431 ] Sahil Takiar commented on HIVE-20506: - The general idea makes sense to me. To confirm

[jira] [Commented] (HIVE-17684) HoS memory issues with MapJoinMemoryExhaustionHandler

[ https://issues.apache.org/jira/browse/HIVE-17684?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16606614#comment-16606614 ] Sahil Takiar commented on HIVE-17684: - [~mi...@cloudera.com] took a look through some

[jira] [Commented] (HIVE-17684) HoS memory issues with MapJoinMemoryExhaustionHandler

[ https://issues.apache.org/jira/browse/HIVE-17684?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16606358#comment-16606358 ] Sahil Takiar commented on HIVE-17684: - [~mi...@cloudera.com] will do. The logs got cl

[jira] [Updated] (HIVE-17684) HoS memory issues with MapJoinMemoryExhaustionHandler

[ https://issues.apache.org/jira/browse/HIVE-17684?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sahil Takiar updated HIVE-17684: Attachment: HIVE-17684.06.patch > HoS memory issues with MapJoinMemoryExhaustionHandler > -

[jira] [Commented] (HIVE-20440) Create better cache eviction policy for SmallTableCache

[ https://issues.apache.org/jira/browse/HIVE-20440?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16606353#comment-16606353 ] Sahil Takiar commented on HIVE-20440: - Few high level comments: (1) The Guava cache

[jira] [Commented] (HIVE-20506) HOS times out when cluster is full while Hive-on-MR waits

[ https://issues.apache.org/jira/browse/HIVE-20506?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16604809#comment-16604809 ] Sahil Takiar commented on HIVE-20506: - [~brocknoland] I think you might be hitting th

[jira] [Commented] (HIVE-17684) HoS memory issues with MapJoinMemoryExhaustionHandler

[ https://issues.apache.org/jira/browse/HIVE-17684?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16603530#comment-16603530 ] Sahil Takiar commented on HIVE-17684: - [~mi...@cloudera.com] sorry for the delay on t

[jira] [Updated] (HIVE-17684) HoS memory issues with MapJoinMemoryExhaustionHandler

[ https://issues.apache.org/jira/browse/HIVE-17684?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sahil Takiar updated HIVE-17684: Attachment: HIVE-17684.05.patch > HoS memory issues with MapJoinMemoryExhaustionHandler > -

[jira] [Commented] (HIVE-14162) Allow disabling of long running job on Hive On Spark On YARN

[ https://issues.apache.org/jira/browse/HIVE-14162?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16599265#comment-16599265 ] Sahil Takiar commented on HIVE-14162: - [~Tagar] it was pushed to master, which is Hiv

[jira] [Updated] (HIVE-14162) Allow disabling of long running job on Hive On Spark On YARN

[ https://issues.apache.org/jira/browse/HIVE-14162?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sahil Takiar updated HIVE-14162: Resolution: Fixed Fix Version/s: 4.0.0 Status: Resolved (was: Patch Available) P

[jira] [Commented] (HIVE-14162) Allow disabling of long running job on Hive On Spark On YARN

[ https://issues.apache.org/jira/browse/HIVE-14162?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16599260#comment-16599260 ] Sahil Takiar commented on HIVE-14162: - {{TestCliDriver.testCliDriver[test_teradatabin

[jira] [Updated] (HIVE-14162) Allow disabling of long running job on Hive On Spark On YARN

[ https://issues.apache.org/jira/browse/HIVE-14162?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sahil Takiar updated HIVE-14162: Attachment: HIVE-14162.9.patch > Allow disabling of long running job on Hive On Spark On YARN > ---

[jira] [Commented] (HIVE-14162) Allow disabling of long running job on Hive On Spark On YARN

[ https://issues.apache.org/jira/browse/HIVE-14162?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16598793#comment-16598793 ] Sahil Takiar commented on HIVE-14162: - Thanks Adam. Test failures don't look related,

[jira] [Commented] (HIVE-14162) Allow disabling of long running job on Hive On Spark On YARN

[ https://issues.apache.org/jira/browse/HIVE-14162?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16597637#comment-16597637 ] Sahil Takiar commented on HIVE-14162: - [~szita] thanks for taking a look. Addressed y

[jira] [Updated] (HIVE-14162) Allow disabling of long running job on Hive On Spark On YARN

[ https://issues.apache.org/jira/browse/HIVE-14162?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sahil Takiar updated HIVE-14162: Attachment: HIVE-14162.8.patch > Allow disabling of long running job on Hive On Spark On YARN > ---

[jira] [Commented] (HIVE-20479) Update content/people.mdtext in cms

[ https://issues.apache.org/jira/browse/HIVE-20479?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16595364#comment-16595364 ] Sahil Takiar commented on HIVE-20479: - +1 > Update content/people.mdtext in cms > -

[jira] [Commented] (HIVE-19814) RPC Server port is always random for spark

[ https://issues.apache.org/jira/browse/HIVE-19814?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16589134#comment-16589134 ] Sahil Takiar commented on HIVE-19814: - [~bharos92] the new unit test looks good. Just

[jira] [Commented] (HIVE-14162) Allow disabling of long running job on Hive On Spark On YARN

[ https://issues.apache.org/jira/browse/HIVE-14162?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16588781#comment-16588781 ] Sahil Takiar commented on HIVE-14162: - [~szita], [~asinkovits] could you take a look?

[jira] [Updated] (HIVE-19008) Improve Spark session id logging

[ https://issues.apache.org/jira/browse/HIVE-19008?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sahil Takiar updated HIVE-19008: Resolution: Fixed Fix Version/s: 4.0.0 Status: Resolved (was: Patch Available) P

[jira] [Updated] (HIVE-19937) Intern fields in MapWork on deserialization

[ https://issues.apache.org/jira/browse/HIVE-19937?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sahil Takiar updated HIVE-19937: Resolution: Fixed Fix Version/s: 4.0.0 Status: Resolved (was: Patch Available) T

[jira] [Updated] (HIVE-19937) Intern fields in MapWork on deserialization

[ https://issues.apache.org/jira/browse/HIVE-19937?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sahil Takiar updated HIVE-19937: Attachment: HIVE-19937.6.patch > Intern fields in MapWork on deserialization >

[jira] [Commented] (HIVE-14162) Allow disabling of long running job on Hive On Spark On YARN

[ https://issues.apache.org/jira/browse/HIVE-14162?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16569874#comment-16569874 ] Sahil Takiar commented on HIVE-14162: - [~ngangam], [~aihuaxu] could you take a look a

[jira] [Updated] (HIVE-14162) Allow disabling of long running job on Hive On Spark On YARN

[ https://issues.apache.org/jira/browse/HIVE-14162?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sahil Takiar updated HIVE-14162: Attachment: HIVE-14162.7.patch > Allow disabling of long running job on Hive On Spark On YARN > ---

[jira] [Updated] (HIVE-14162) Allow disabling of long running job on Hive On Spark On YARN

[ https://issues.apache.org/jira/browse/HIVE-14162?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sahil Takiar updated HIVE-14162: Attachment: HIVE-14162.6.patch > Allow disabling of long running job on Hive On Spark On YARN > ---

[jira] [Updated] (HIVE-14162) Allow disabling of long running job on Hive On Spark On YARN

[ https://issues.apache.org/jira/browse/HIVE-14162?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sahil Takiar updated HIVE-14162: Attachment: HIVE-14162.5.patch > Allow disabling of long running job on Hive On Spark On YARN > ---

[jira] [Updated] (HIVE-20273) Spark jobs aren't cancelled if getSparkJobInfo or getSparkStagesInfo

[ https://issues.apache.org/jira/browse/HIVE-20273?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sahil Takiar updated HIVE-20273: Status: Patch Available (was: Open) > Spark jobs aren't cancelled if getSparkJobInfo or getSparkSt

[jira] [Updated] (HIVE-20273) Spark jobs aren't cancelled if getSparkJobInfo or getSparkStagesInfo

[ https://issues.apache.org/jira/browse/HIVE-20273?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sahil Takiar updated HIVE-20273: Attachment: HIVE-20273.1.patch > Spark jobs aren't cancelled if getSparkJobInfo or getSparkStagesIn

[jira] [Commented] (HIVE-19008) Improve Spark session id logging

[ https://issues.apache.org/jira/browse/HIVE-19008?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16567404#comment-16567404 ] Sahil Takiar commented on HIVE-19008: - Ping [~aihuaxu] > Improve Spark session id lo

[jira] [Updated] (HIVE-18684) Race condition in RemoteSparkJobMonitor

[ https://issues.apache.org/jira/browse/HIVE-18684?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sahil Takiar updated HIVE-18684: Status: Open (was: Patch Available) > Race condition in RemoteSparkJobMonitor > --

[jira] [Commented] (HIVE-19937) Intern fields in MapWork on deserialization

[ https://issues.apache.org/jira/browse/HIVE-19937?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16567402#comment-16567402 ] Sahil Takiar commented on HIVE-19937: - Ping [~vihangk1] > Intern fields in MapWork o

[jira] [Assigned] (HIVE-20280) JobResultSerializer uses wrong registration id in KyroMessageCodec

[ https://issues.apache.org/jira/browse/HIVE-20280?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sahil Takiar reassigned HIVE-20280: --- > JobResultSerializer uses wrong registration id in KyroMessageCodec > -

  1   2   3   4   5   6   7   8   9   10   >