[jira] [Created] (SPARK-27021) Netty related thread leaks

Attila Zsolt Piros created SPARK-27021: -- Summary: Netty related thread leaks Key: SPARK-27021 URL: https://issues.apache.org/jira/browse/SPARK-27021 Project: Spark Issue Type: Bug

[jira] [Created] (SPARK-27090) Deplementing old LEGACY_DRIVER_IDENTIFIER ("")

Attila Zsolt Piros created SPARK-27090: -- Summary: Deplementing old LEGACY_DRIVER_IDENTIFIER ("") Key: SPARK-27090 URL: https://issues.apache.org/jira/browse/SPARK-27090 Project: Spark

[jira] [Commented] (SPARK-26845) Avro to_avro from_avro roundtrip fails if data type is string

[ https://issues.apache.org/jira/browse/SPARK-26845?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16763094#comment-16763094 ] Attila Zsolt Piros commented on SPARK-26845: This also works: {code} test("roundtrip in

[jira] [Commented] (SPARK-26845) Avro to_avro from_avro roundtrip fails if data type is string

[ https://issues.apache.org/jira/browse/SPARK-26845?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16763066#comment-16763066 ] Attila Zsolt Piros commented on SPARK-26845: The test would work if you replace the line

[jira] [Created] (SPARK-26891) Flaky test:YarnSchedulerBackendSuite."RequestExecutors reflects node blacklist and is serializable"

Attila Zsolt Piros created SPARK-26891: -- Summary: Flaky test:YarnSchedulerBackendSuite."RequestExecutors reflects node blacklist and is serializable" Key: SPARK-26891 URL:

[jira] [Updated] (SPARK-26891) Flaky test:YarnSchedulerBackendSuite."RequestExecutors reflects node blacklist and is serializable"

[ https://issues.apache.org/jira/browse/SPARK-26891?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Attila Zsolt Piros updated SPARK-26891: --- Description: For even an unrelated change sometimes the

[jira] [Commented] (SPARK-26891) Flaky test:YarnSchedulerBackendSuite."RequestExecutors reflects node blacklist and is serializable"

[ https://issues.apache.org/jira/browse/SPARK-26891?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16769323#comment-16769323 ] Attila Zsolt Piros commented on SPARK-26891: I am woking on it. > Flaky

[jira] [Commented] (SPARK-25035) Replicating disk-stored blocks should avoid memory mapping

[ https://issues.apache.org/jira/browse/SPARK-25035?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16755322#comment-16755322 ] Attila Zsolt Piros commented on SPARK-25035: I am working on this. > Replicating

[jira] [Commented] (SPARK-27090) Deplementing old LEGACY_DRIVER_IDENTIFIER ("")

[ https://issues.apache.org/jira/browse/SPARK-27090?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16787822#comment-16787822 ] Attila Zsolt Piros commented on SPARK-27090: I would have waited a little bit to find out

[jira] [Updated] (SPARK-27819) Retry cleanup of disk persisted RDD via external shuffle service when it failed via executor

[ https://issues.apache.org/jira/browse/SPARK-27819?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Attila Zsolt Piros updated SPARK-27819: --- Description: This issue is created for not losing the idea came up during

[jira] [Commented] (SPARK-27819) Retry cleanup of disk persisted RDD via external shuffle service when it failed via executor

[ https://issues.apache.org/jira/browse/SPARK-27819?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=1684#comment-1684 ] Attila Zsolt Piros commented on SPARK-27819: I am working on this. > Retry cleanup of disk

[jira] [Created] (SPARK-27819) Retry cleanup of disk persisted RDD via external shuffle service when it failed via executor

Attila Zsolt Piros created SPARK-27819: -- Summary: Retry cleanup of disk persisted RDD via external shuffle service when it failed via executor Key: SPARK-27819 URL:

[jira] [Comment Edited] (SPARK-27622) Avoid network communication when block manger fetches from the same host

[ https://issues.apache.org/jira/browse/SPARK-27622?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16831553#comment-16831553 ] Attila Zsolt Piros edited comment on SPARK-27622 at 5/6/19 6:22 PM:

[jira] [Updated] (SPARK-27622) Avoid the network when block manager fetches disk persisted RDD blocks from the same host

[ https://issues.apache.org/jira/browse/SPARK-27622?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Attila Zsolt Piros updated SPARK-27622: --- Summary: Avoid the network when block manager fetches disk persisted RDD blocks

[jira] [Updated] (SPARK-27622) Avoid network communication when block manager fetches disk persisted RDD blocks from the same host

[ https://issues.apache.org/jira/browse/SPARK-27622?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Attila Zsolt Piros updated SPARK-27622: --- Summary: Avoid network communication when block manager fetches disk persisted RDD

[jira] [Commented] (SPARK-27651) Avoid the network when block manager fetches shuffle blocks from the same host

[ https://issues.apache.org/jira/browse/SPARK-27651?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16834832#comment-16834832 ] Attila Zsolt Piros commented on SPARK-27651: I am already working on this. > Avoid the

[jira] [Created] (SPARK-27651) Avoid the network when block manager fetches shuffle blocks from the same host

Attila Zsolt Piros created SPARK-27651: -- Summary: Avoid the network when block manager fetches shuffle blocks from the same host Key: SPARK-27651 URL: https://issues.apache.org/jira/browse/SPARK-27651

[jira] [Created] (SPARK-27622) Avoiding network communication when block mangers are running on the host

Attila Zsolt Piros created SPARK-27622: -- Summary: Avoiding network communication when block mangers are running on the host Key: SPARK-27622 URL: https://issues.apache.org/jira/browse/SPARK-27622

[jira] [Commented] (SPARK-27622) Avoiding network communication when block mangers are running on the host

[ https://issues.apache.org/jira/browse/SPARK-27622?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16831553#comment-16831553 ] Attila Zsolt Piros commented on SPARK-27622: I am already working on this. A working

[jira] [Updated] (SPARK-27622) Avoiding network communication when block manger fetching from the same host

[ https://issues.apache.org/jira/browse/SPARK-27622?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Attila Zsolt Piros updated SPARK-27622: --- Summary: Avoiding network communication when block manger fetching from the same

[jira] [Updated] (SPARK-27622) Avoiding network communication when block mangers are running on the same host

[ https://issues.apache.org/jira/browse/SPARK-27622?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Attila Zsolt Piros updated SPARK-27622: --- Summary: Avoiding network communication when block mangers are running on the same

[jira] [Updated] (SPARK-27622) Avoid network communication when block manger fetches from the same host

[ https://issues.apache.org/jira/browse/SPARK-27622?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Attila Zsolt Piros updated SPARK-27622: --- Summary: Avoid network communication when block manger fetches from the same host

[jira] [Commented] (SPARK-25888) Service requests for persist() blocks via external service after dynamic deallocation

[ https://issues.apache.org/jira/browse/SPARK-25888?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16825248#comment-16825248 ] Attila Zsolt Piros commented on SPARK-25888: I am working on this. > Service requests for

[jira] [Commented] (SPARK-27021) Leaking Netty event loop group for shuffle chunk fetch requests

[ https://issues.apache.org/jira/browse/SPARK-27021?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16995538#comment-16995538 ] Attila Zsolt Piros commented on SPARK-27021: [~roncenzhao] # yes # I do not think so. This

[jira] [Commented] (SPARK-30235) Keeping compatibility with 2.4 external shuffle service regarding host local shuffle blocks reading

[ https://issues.apache.org/jira/browse/SPARK-30235?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16994672#comment-16994672 ] Attila Zsolt Piros commented on SPARK-30235: I am working on this. > Keeping compatibility

[jira] [Created] (SPARK-30235) Keeping compatibility with 2.4 external shuffle service regarding host local shuffle blocks reading

Attila Zsolt Piros created SPARK-30235: -- Summary: Keeping compatibility with 2.4 external shuffle service regarding host local shuffle blocks reading Key: SPARK-30235 URL:

[jira] [Commented] (SPARK-27021) Leaking Netty event loop group for shuffle chunk fetch requests

[ https://issues.apache.org/jira/browse/SPARK-27021?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16996571#comment-16996571 ] Attila Zsolt Piros commented on SPARK-27021: [~roncenzhao] it seems to me you bumped into 

[jira] [Updated] (SPARK-27651) Avoid the network when block manager fetches shuffle blocks from the same host

[ https://issues.apache.org/jira/browse/SPARK-27651?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Attila Zsolt Piros updated SPARK-27651: --- Description: When a shuffle block (content) is fetched the network is always used

[jira] [Commented] (SPARK-27651) Avoid the network when block manager fetches shuffle blocks from the same host

[ https://issues.apache.org/jira/browse/SPARK-27651?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17051995#comment-17051995 ] Attila Zsolt Piros commented on SPARK-27651: Yes, the final implementation works only when

[jira] [Commented] (SPARK-30688) Spark SQL Unix Timestamp produces incorrect result with unix_timestamp UDF

[ https://issues.apache.org/jira/browse/SPARK-30688?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17031614#comment-17031614 ] Attila Zsolt Piros commented on SPARK-30688: I have checked on Spark 3.0.0-preview2 and week

[jira] [Comment Edited] (SPARK-30688) Spark SQL Unix Timestamp produces incorrect result with unix_timestamp UDF

[ https://issues.apache.org/jira/browse/SPARK-30688?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17031614#comment-17031614 ] Attila Zsolt Piros edited comment on SPARK-30688 at 2/6/20 2:22 PM:

[jira] [Commented] (SPARK-27651) Avoid the network when block manager fetches shuffle blocks from the same host

[ https://issues.apache.org/jira/browse/SPARK-27651?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17052348#comment-17052348 ] Attila Zsolt Piros commented on SPARK-27651: well in case of dynamic allocation and a

[jira] [Comment Edited] (SPARK-28210) Shuffle Storage API: Reads

[ https://issues.apache.org/jira/browse/SPARK-28210?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17196013#comment-17196013 ] Attila Zsolt Piros edited comment on SPARK-28210 at 9/15/20, 9:38 AM:

[jira] [Commented] (SPARK-28210) Shuffle Storage API: Reads

[ https://issues.apache.org/jira/browse/SPARK-28210?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17196013#comment-17196013 ] Attila Zsolt Piros commented on SPARK-28210: [~tianczha] [~devaraj] I would like to work on

[jira] [Commented] (SPARK-32663) TransportClient getting closed when there are outstanding requests to the server

[ https://issues.apache.org/jira/browse/SPARK-32663?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17181138#comment-17181138 ] Attila Zsolt Piros commented on SPARK-32663: You are right. The clients will be closed via

[jira] [Updated] (SPARK-32293) Inconsistent default unit between Spark memory configs and JVM option

[ https://issues.apache.org/jira/browse/SPARK-32293?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Attila Zsolt Piros updated SPARK-32293: --- Target Version/s: 3.1.0 > Inconsistent default unit between Spark memory configs

[jira] [Commented] (SPARK-32149) Improve file path name normalisation at block resolution within the external shuffle service

[ https://issues.apache.org/jira/browse/SPARK-32149?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17149440#comment-17149440 ] Attila Zsolt Piros commented on SPARK-32149: I am working on this > Improve file path name

[jira] [Created] (SPARK-32149) Improve file path name normalisation at block resolution within the external shuffle service

Attila Zsolt Piros created SPARK-32149: -- Summary: Improve file path name normalisation at block resolution within the external shuffle service Key: SPARK-32149 URL:

[jira] [Updated] (SPARK-32149) Improve file path name normalisation at block resolution within the external shuffle service

[ https://issues.apache.org/jira/browse/SPARK-32149?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Attila Zsolt Piros updated SPARK-32149: --- Affects Version/s: (was: 3.0.1) 3.1.0 > Improve file

[jira] [Created] (SPARK-32293) Inconsistent default units for configuring Spark memory

Attila Zsolt Piros created SPARK-32293: -- Summary: Inconsistent default units for configuring Spark memory Key: SPARK-32293 URL: https://issues.apache.org/jira/browse/SPARK-32293 Project: Spark

[jira] [Commented] (SPARK-32293) Inconsistent default units for configuring Spark memory

[ https://issues.apache.org/jira/browse/SPARK-32293?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17156884#comment-17156884 ] Attila Zsolt Piros commented on SPARK-32293: I am working on this. > Inconsistent default

[jira] [Updated] (SPARK-32293) Inconsistent default unit between Spark memory configs and JVM option

[ https://issues.apache.org/jira/browse/SPARK-32293?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Attila Zsolt Piros updated SPARK-32293: --- Summary: Inconsistent default unit between Spark memory configs and JVM option

[jira] [Commented] (SPARK-33711) Race condition in Spark k8s Pod lifecycle management that leads to shutdowns

[ https://issues.apache.org/jira/browse/SPARK-33711?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17245993#comment-17245993 ] Attila Zsolt Piros commented on SPARK-33711: I am working on this and soon I will open a PR.

[jira] [Updated] (SPARK-33711) Race condition in Spark k8s Pod lifecycle manager that leads to shutdowns

[ https://issues.apache.org/jira/browse/SPARK-33711?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Attila Zsolt Piros updated SPARK-33711: --- Summary: Race condition in Spark k8s Pod lifecycle manager that leads to shutdowns

[jira] [Created] (SPARK-33711) Race condition in Spark k8s Pod lifecycle management that leads to shutdowns

Attila Zsolt Piros created SPARK-33711: -- Summary: Race condition in Spark k8s Pod lifecycle management that leads to shutdowns Key: SPARK-33711 URL: https://issues.apache.org/jira/browse/SPARK-33711

[jira] [Updated] (SPARK-33711) Race condition in Spark k8s Pod lifecycle manager that leads to shutdowns

[ https://issues.apache.org/jira/browse/SPARK-33711?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Attila Zsolt Piros updated SPARK-33711: --- Affects Version/s: (was: 3.0.1) 3.2.0

[jira] [Updated] (SPARK-33711) Race condition in Spark k8s Pod lifecycle manager that leads to shutdowns

[ https://issues.apache.org/jira/browse/SPARK-33711?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Attila Zsolt Piros updated SPARK-33711: --- Affects Version/s: 2.3.4 > Race condition in Spark k8s Pod lifecycle manager that

[jira] [Commented] (SPARK-33711) Race condition in Spark k8s Pod lifecycle manager that leads to shutdowns

[ https://issues.apache.org/jira/browse/SPARK-33711?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17246092#comment-17246092 ] Attila Zsolt Piros commented on SPARK-33711: Yes, it does. I have updated the affected

[jira] [Comment Edited] (SPARK-33711) Race condition in Spark k8s Pod lifecycle manager that leads to shutdowns

[ https://issues.apache.org/jira/browse/SPARK-33711?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17246092#comment-17246092 ] Attila Zsolt Piros edited comment on SPARK-33711 at 12/8/20, 7:21 PM:

[jira] [Commented] (SPARK-26836) Columns get switched in Spark SQL using Avro backed Hive table if schema evolves

[ https://issues.apache.org/jira/browse/SPARK-26836?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17261398#comment-17261398 ] Attila Zsolt Piros commented on SPARK-26836: I am working on a this > Columns get switched

[jira] [Comment Edited] (SPARK-26836) Columns get switched in Spark SQL using Avro backed Hive table if schema evolves

[ https://issues.apache.org/jira/browse/SPARK-26836?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17261398#comment-17261398 ] Attila Zsolt Piros edited comment on SPARK-26836 at 1/8/21, 4:15 PM: -

[jira] [Commented] (SPARK-34167) Reading parquet with Decimal(8,2) written as a Decimal64 blows up

[ https://issues.apache.org/jira/browse/SPARK-34167?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17269182#comment-17269182 ] Attila Zsolt Piros commented on SPARK-34167: [~razajafri] could you share with us how the

[jira] [Comment Edited] (SPARK-34167) Reading parquet with Decimal(8,2) written as a Decimal64 blows up

[ https://issues.apache.org/jira/browse/SPARK-34167?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17269182#comment-17269182 ] Attila Zsolt Piros edited comment on SPARK-34167 at 1/21/21, 9:49 AM:

[jira] [Commented] (SPARK-33711) Race condition in Spark k8s Pod lifecycle manager that leads to shutdowns

[ https://issues.apache.org/jira/browse/SPARK-33711?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17265863#comment-17265863 ] Attila Zsolt Piros commented on SPARK-33711: Sure. Working on that. > Race condition in

[jira] [Commented] (SPARK-32617) Upgrade kubernetes client version to support latest minikube version.

[ https://issues.apache.org/jira/browse/SPARK-32617?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17248168#comment-17248168 ] Attila Zsolt Piros commented on SPARK-32617: I will have PR for this soon. > Upgrade

[jira] [Commented] (SPARK-34154) Flaky Test: LocalityPlacementStrategySuite.handle large number of containers and tasks (SPARK-18750)

[ https://issues.apache.org/jira/browse/SPARK-34154?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17272867#comment-17272867 ] Attila Zsolt Piros commented on SPARK-34154: I tried to reproduce this issue by running it

[jira] [Commented] (SPARK-34194) Queries that only touch partition columns shouldn't scan through all files

[ https://issues.apache.org/jira/browse/SPARK-34194?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17275965#comment-17275965 ] Attila Zsolt Piros commented on SPARK-34194: [~nchammas] I suggest to check out this config

[jira] [Commented] (SPARK-29391) Default year-month units

[ https://issues.apache.org/jira/browse/SPARK-29391?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17275952#comment-17275952 ] Attila Zsolt Piros commented on SPARK-29391: If this helps in decision: the change itself

[jira] [Commented] (SPARK-34194) Queries that only touch partition columns shouldn't scan through all files

[ https://issues.apache.org/jira/browse/SPARK-34194?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17276874#comment-17276874 ] Attila Zsolt Piros commented on SPARK-34194: Yes. > Queries that only touch partition

[jira] [Comment Edited] (SPARK-34194) Queries that only touch partition columns shouldn't scan through all files

[ https://issues.apache.org/jira/browse/SPARK-34194?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17276874#comment-17276874 ] Attila Zsolt Piros edited comment on SPARK-34194 at 2/2/21, 6:59 AM: -

[jira] [Commented] (SPARK-34154) Flaky Test: LocalityPlacementStrategySuite.handle large number of containers and tasks (SPARK-18750)

[ https://issues.apache.org/jira/browse/SPARK-34154?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17272990#comment-17272990 ] Attila Zsolt Piros commented on SPARK-34154: In my PR the bug does not surfaced even after

[jira] [Commented] (SPARK-34179) examples provided in https://spark.apache.org/docs/latest/api/sql/index.html link not working

[ https://issues.apache.org/jira/browse/SPARK-34179?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17273348#comment-17273348 ] Attila Zsolt Piros commented on SPARK-34179: [~chetdb] The

[jira] [Commented] (SPARK-33763) Add metrics for better tracking of dynamic allocation

[ https://issues.apache.org/jira/browse/SPARK-33763?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17273923#comment-17273923 ] Attila Zsolt Piros commented on SPARK-33763: I started working on this. > Add metrics for

[jira] [Comment Edited] (SPARK-34285) Implement Parquet StringEndsWith、StringContains Filter

[ https://issues.apache.org/jira/browse/SPARK-34285?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17274458#comment-17274458 ] Attila Zsolt Piros edited comment on SPARK-34285 at 1/31/21, 4:50 AM:

[jira] [Commented] (SPARK-34280) Avoid migrating un-needed shuffle files

[ https://issues.apache.org/jira/browse/SPARK-34280?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17275783#comment-17275783 ] Attila Zsolt Piros commented on SPARK-34280: It would be interesting to know whether the

[jira] [Commented] (SPARK-29220) Flaky test: org.apache.spark.deploy.yarn.LocalityPlacementStrategySuite.handle large number of containers and tasks (SPARK-18750) [hadoop-3.2][java11]

[ https://issues.apache.org/jira/browse/SPARK-29220?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17275786#comment-17275786 ] Attila Zsolt Piros commented on SPARK-29220: I think we can close this as with

[jira] [Commented] (SPARK-33763) Add metrics for better tracking of dynamic allocation

[ https://issues.apache.org/jira/browse/SPARK-33763?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17277675#comment-17277675 ] Attila Zsolt Piros commented on SPARK-33763: I am ready with the executor removals (1 and 4

[jira] [Commented] (SPARK-29391) Default year-month units

[ https://issues.apache.org/jira/browse/SPARK-29391?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17278010#comment-17278010 ] Attila Zsolt Piros commented on SPARK-29391: This is fine but learning from this case we

[jira] [Comment Edited] (SPARK-29391) Default year-month units

[ https://issues.apache.org/jira/browse/SPARK-29391?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17278006#comment-17278006 ] Attila Zsolt Piros edited comment on SPARK-29391 at 2/3/21, 1:35 PM: -

[jira] [Resolved] (SPARK-29391) Default year-month units

[ https://issues.apache.org/jira/browse/SPARK-29391?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Attila Zsolt Piros resolved SPARK-29391. Resolution: Won't Fix As PostgreSQL feature parity is not a requirement anymore

[jira] [Commented] (SPARK-29391) Default year-month units

[ https://issues.apache.org/jira/browse/SPARK-29391?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17278015#comment-17278015 ] Attila Zsolt Piros commented on SPARK-29391: I found this:

[jira] [Commented] (SPARK-34334) ExecutorPodsAllocator fails to identify some excess requests during downscaling

[ https://issues.apache.org/jira/browse/SPARK-34334?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17277436#comment-17277436 ] Attila Zsolt Piros commented on SPARK-34334: I am working on the this. >

[jira] [Created] (SPARK-34334) ExecutorPodsAllocator fails to identify some excess requests during downscaling

Attila Zsolt Piros created SPARK-34334: -- Summary: ExecutorPodsAllocator fails to identify some excess requests during downscaling Key: SPARK-34334 URL: https://issues.apache.org/jira/browse/SPARK-34334

[jira] [Commented] (SPARK-27764) Feature Parity between PostgreSQL and Spark

[ https://issues.apache.org/jira/browse/SPARK-27764?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17278065#comment-17278065 ] Attila Zsolt Piros commented on SPARK-27764: Sorry to chime in but we have (after

[jira] [Resolved] (SPARK-35543) Small memory leak in BlockManagerMasterEndpoint

[ https://issues.apache.org/jira/browse/SPARK-35543?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Attila Zsolt Piros resolved SPARK-35543. Fix Version/s: 3.2.0 Resolution: Fixed Issue resolved by pull request

[jira] [Updated] (SPARK-35334) Spark should be more resilient to intermittent K8s flakiness

[ https://issues.apache.org/jira/browse/SPARK-35334?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Attila Zsolt Piros updated SPARK-35334: --- Description: Internal K8s errors such as an etcdserver leader election is

[jira] [Created] (SPARK-35334) Spark should be more resilient to intermittent K8s flakiness

Attila Zsolt Piros created SPARK-35334: -- Summary: Spark should be more resilient to intermittent K8s flakiness Key: SPARK-35334 URL: https://issues.apache.org/jira/browse/SPARK-35334 Project:

[jira] [Created] (SPARK-35430) Investigate the failure of "PVs with local storage" integration test on Docker driver

Attila Zsolt Piros created SPARK-35430: -- Summary: Investigate the failure of "PVs with local storage" integration test on Docker driver Key: SPARK-35430 URL: https://issues.apache.org/jira/browse/SPARK-35430

[jira] [Comment Edited] (SPARK-34738) Upgrade Minikube and kubernetes and move to docker 'virtualization' layer

[ https://issues.apache.org/jira/browse/SPARK-34738?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17346572#comment-17346572 ] Attila Zsolt Piros edited comment on SPARK-34738 at 5/18/21, 3:56 AM:

[jira] [Commented] (SPARK-34738) Upgrade Minikube and kubernetes and move to docker 'virtualization' layer

[ https://issues.apache.org/jira/browse/SPARK-34738?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17346572#comment-17346572 ] Attila Zsolt Piros commented on SPARK-34738: Thanks [~shaneknapp]! I opened a separate

[jira] [Commented] (SPARK-34738) Upgrade Minikube and kubernetes and move to docker 'virtualization' layer

[ https://issues.apache.org/jira/browse/SPARK-34738?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17342040#comment-17342040 ] Attila Zsolt Piros commented on SPARK-34738: [~shaneknapp] I am sorry to hear about the

[jira] [Resolved] (SPARK-34736) Kubernetes and Minikube version upgrade for integration tests

[ https://issues.apache.org/jira/browse/SPARK-34736?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Attila Zsolt Piros resolved SPARK-34736. Fix Version/s: 3.2.0 Resolution: Fixed Issue resolved by pull request

[jira] [Assigned] (SPARK-34736) Kubernetes and Minikube version upgrade for integration tests

[ https://issues.apache.org/jira/browse/SPARK-34736?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Attila Zsolt Piros reassigned SPARK-34736: -- Assignee: Attila Zsolt Piros > Kubernetes and Minikube version upgrade for

[jira] [Commented] (SPARK-34738) Upgrade Minikube and kubernetes and move to docker 'virtualization' layer

[ https://issues.apache.org/jira/browse/SPARK-34738?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17342018#comment-17342018 ] Attila Zsolt Piros commented on SPARK-34738: [~shaneknapp] I have merged my commit this

[jira] [Commented] (SPARK-35610) Memory leak in Spark interpreter

[ https://issues.apache.org/jira/browse/SPARK-35610?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17355614#comment-17355614 ] Attila Zsolt Piros commented on SPARK-35610: I am working on this, soon a PR will be opened.

[jira] [Updated] (SPARK-35610) Memory leak in Spark interpreter

[ https://issues.apache.org/jira/browse/SPARK-35610?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Attila Zsolt Piros updated SPARK-35610: --- Description: I have identified this leak by running the Livy tests (I know it is

[jira] [Updated] (SPARK-35610) Memory leak in Spark interpreter

[ https://issues.apache.org/jira/browse/SPARK-35610?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Attila Zsolt Piros updated SPARK-35610: --- Description: I have identified this leak by running the Livy tests (I know it is

[jira] [Created] (SPARK-35610) Memory leak in Spark interpreter

Attila Zsolt Piros created SPARK-35610: -- Summary: Memory leak in Spark interpreter Key: SPARK-35610 URL: https://issues.apache.org/jira/browse/SPARK-35610 Project: Spark Issue Type:

[jira] [Updated] (SPARK-35610) Memory leak in Spark interpreter

[ https://issues.apache.org/jira/browse/SPARK-35610?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Attila Zsolt Piros updated SPARK-35610: --- Description: I have identified this leak by running the Livy tests (I know it is

[jira] [Updated] (SPARK-35610) Memory leak in Spark interpreter

[ https://issues.apache.org/jira/browse/SPARK-35610?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Attila Zsolt Piros updated SPARK-35610: --- Description: I have identified this leak by running the Livy tests (I know it is

[jira] [Assigned] (SPARK-35610) Memory leak in Spark interpreter

[ https://issues.apache.org/jira/browse/SPARK-35610?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Attila Zsolt Piros reassigned SPARK-35610: -- Assignee: Attila Zsolt Piros > Memory leak in Spark interpreter >

[jira] [Updated] (SPARK-35610) Memory leak in Spark interpreter

[ https://issues.apache.org/jira/browse/SPARK-35610?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Attila Zsolt Piros updated SPARK-35610: --- Description: I have identified this leak by running the Livy tests (I know it is

[jira] [Updated] (SPARK-35610) Memory leak in Spark interpreter

[ https://issues.apache.org/jira/browse/SPARK-35610?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Attila Zsolt Piros updated SPARK-35610: --- Description: I have identified this leak by running the Livy tests (I know it is

[jira] [Updated] (SPARK-35610) Memory leak in Spark interpreter

[ https://issues.apache.org/jira/browse/SPARK-35610?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Attila Zsolt Piros updated SPARK-35610: --- Description: I have identified this leak by running the Livy tests (I know it is

[jira] [Updated] (SPARK-35610) Memory leak in Spark interpreter

[ https://issues.apache.org/jira/browse/SPARK-35610?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Attila Zsolt Piros updated SPARK-35610: --- Description: I have identified this leak by running the Livy tests (I know it is

[jira] [Updated] (SPARK-35610) Memory leak in Spark interpreter

[ https://issues.apache.org/jira/browse/SPARK-35610?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Attila Zsolt Piros updated SPARK-35610: --- Description: I have identified this leak by running the Livy tests (I know it is

[jira] [Updated] (SPARK-35610) Memory leak in Spark interpreter

[ https://issues.apache.org/jira/browse/SPARK-35610?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Attila Zsolt Piros updated SPARK-35610: --- Description: I have identified this leak by running the Livy tests (I know it is

[jira] [Assigned] (SPARK-35543) Small memory leak in BlockManagerMasterEndpoint

[ https://issues.apache.org/jira/browse/SPARK-35543?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Attila Zsolt Piros reassigned SPARK-35543: -- Assignee: Attila Zsolt Piros > Small memory leak in

[jira] [Updated] (SPARK-35543) Small memory leak in BlockManagerMasterEndpoint

[ https://issues.apache.org/jira/browse/SPARK-35543?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Attila Zsolt Piros updated SPARK-35543: --- Description: It is regarding _blockStatusByShuffleService_ when all the blocks are

[jira] [Created] (SPARK-35543) Small memory leak in BlockManagerMasterEndpoint

Attila Zsolt Piros created SPARK-35543: -- Summary: Small memory leak in BlockManagerMasterEndpoint Key: SPARK-35543 URL: https://issues.apache.org/jira/browse/SPARK-35543 Project: Spark

<    1   2   3   4   >