[jira] [Updated] (SPARK-37640) rolled event log still need be clean after compact

2022-01-09 Thread muhong (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37640?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] muhong updated SPARK-37640: --- Description: when we set "{{{}spark.eventLog.rolling.enabled{}}} =true", the eventlog will be roll and

[jira] [Updated] (SPARK-37640) rolled event log still need be clean after compact

2022-01-09 Thread muhong (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37640?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] muhong updated SPARK-37640: --- Description: when we set "{{{}spark.eventLog.rolling.enabled{}}} =true", the eventlog will be roll and

[jira] [Updated] (SPARK-37640) rolled event log still need be clean after compact

2022-01-09 Thread muhong (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37640?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] muhong updated SPARK-37640: --- Description: when we set "{{{}spark.eventLog.rolling.enabled{}}} =true", the eventlog will be roll and

[jira] [Updated] (SPARK-37640) rolled event log still need be clean after compact

2022-01-09 Thread muhong (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37640?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] muhong updated SPARK-37640: --- Description: when > rolled event log still need be clean after compact >

[jira] [Commented] (SPARK-37640) rolled event log still need be clean after compact

2022-01-09 Thread muhong (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37640?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17471684#comment-17471684 ] muhong commented on SPARK-37640: ok,i will add a more detail description > rolled event log still need

[jira] [Commented] (SPARK-37821) spark thrift server RDD ID overflow lead sql execute failed

2022-01-09 Thread muhong (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37821?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17471681#comment-17471681 ] muhong commented on SPARK-37821: yes,just the modification is much complicated; > spark thrift server

[jira] [Updated] (SPARK-37821) spark thrift server RDD ID overflow lead sql execute failed

2022-01-06 Thread muhong (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37821?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] muhong updated SPARK-37821: --- Description: this problem will happen in long run spark application,such as thrift server; as only one

[jira] [Updated] (SPARK-37821) spark thrift server RDD ID overflow lead sql execute failed

2022-01-06 Thread muhong (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37821?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] muhong updated SPARK-37821: --- Description: this problem will happen in long run spark application,such as thrift server; as only one

[jira] [Updated] (SPARK-37821) spark thrift server RDD ID overflow lead sql execute failed

2022-01-06 Thread muhong (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37821?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] muhong updated SPARK-37821: --- Description: this problem will happen in long run spark application,such as thrift server; as only one

[jira] [Updated] (SPARK-37821) spark thrift server RDD ID overflow lead sql execute failed

2022-01-06 Thread muhong (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37821?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] muhong updated SPARK-37821: --- Description: this problem will happen in long run spark application,such as thrift server; as only one

[jira] [Updated] (SPARK-37821) spark thrift server RDD ID overflow lead sql execute failed

2022-01-05 Thread muhong (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37821?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] muhong updated SPARK-37821: --- Description: this problem will happen in long run spark application,such as thrift server; as only one

[jira] [Created] (SPARK-37821) spark thrift server RDD ID overflow lead sql execute failed

2022-01-05 Thread muhong (Jira)
muhong created SPARK-37821: -- Summary: spark thrift server RDD ID overflow lead sql execute failed Key: SPARK-37821 URL: https://issues.apache.org/jira/browse/SPARK-37821 Project: Spark Issue Type:

[jira] [Comment Edited] (SPARK-37639) spark history server clean event log directory with out check status file

2021-12-14 Thread muhong (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37639?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17459673#comment-17459673 ] muhong edited comment on SPARK-37639 at 12/15/21, 6:31 AM: --- to solve the

[jira] [Commented] (SPARK-37639) spark history server clean event log directory with out check status file

2021-12-14 Thread muhong (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37639?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17459673#comment-17459673 ] muhong commented on SPARK-37639: to solve the problem, i modify the logic in EventLogFileWriters : when

[jira] [Updated] (SPARK-37639) spark history server clean event log directory with out check status file

2021-12-13 Thread muhong (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37639?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] muhong updated SPARK-37639: --- Description: i foud a problem, the thrift server create event log file(.inprogress file create at init),

[jira] [Created] (SPARK-37640) rolled event log still need be clean after compact

2021-12-13 Thread muhong (Jira)
muhong created SPARK-37640: -- Summary: rolled event log still need be clean after compact Key: SPARK-37640 URL: https://issues.apache.org/jira/browse/SPARK-37640 Project: Spark Issue Type:

[jira] [Created] (SPARK-37639) spark history server clean event log directory with out check status file

2021-12-13 Thread muhong (Jira)
muhong created SPARK-37639: -- Summary: spark history server clean event log directory with out check status file Key: SPARK-37639 URL: https://issues.apache.org/jira/browse/SPARK-37639 Project: Spark

[jira] [Commented] (SPARK-28869) Roll over event log files

2021-12-13 Thread muhong (Jira)
[ https://issues.apache.org/jira/browse/SPARK-28869?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17458931#comment-17458931 ] muhong commented on SPARK-28869: i foud a problem, the thrift server create event log file(.inprogress

[jira] [Commented] (SPARK-31602) memory leak of JobConf

2021-09-26 Thread muhong (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31602?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17420286#comment-17420286 ] muhong commented on SPARK-31602: we meet the same question on the spark driver side,but not find the