[jira] [Created] (SPARK-27090) Deplementing old LEGACY_DRIVER_IDENTIFIER ("")

Attila Zsolt Piros created SPARK-27090: -- Summary: Deplementing old LEGACY_DRIVER_IDENTIFIER ("") Key: SPARK-27090 URL: https://issues.apache.org/jira/browse/SPARK-27090 Project: Spark Is

[jira] [Commented] (SPARK-27090) Deplementing old LEGACY_DRIVER_IDENTIFIER ("")

[ https://issues.apache.org/jira/browse/SPARK-27090?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16787822#comment-16787822 ] Attila Zsolt Piros commented on SPARK-27090: I would have waited a little bi

[jira] [Commented] (SPARK-25888) Service requests for persist() blocks via external service after dynamic deallocation

[ https://issues.apache.org/jira/browse/SPARK-25888?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16825248#comment-16825248 ] Attila Zsolt Piros commented on SPARK-25888: I am working on this. > Servic

[jira] [Created] (SPARK-27622) Avoiding network communication when block mangers are running on the host

Attila Zsolt Piros created SPARK-27622: -- Summary: Avoiding network communication when block mangers are running on the host Key: SPARK-27622 URL: https://issues.apache.org/jira/browse/SPARK-27622

[jira] [Commented] (SPARK-27622) Avoiding network communication when block mangers are running on the host

[ https://issues.apache.org/jira/browse/SPARK-27622?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16831553#comment-16831553 ] Attila Zsolt Piros commented on SPARK-27622: I am already working on this. A

[jira] [Updated] (SPARK-27622) Avoiding network communication when block mangers are running on the same host

[ https://issues.apache.org/jira/browse/SPARK-27622?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Attila Zsolt Piros updated SPARK-27622: --- Summary: Avoiding network communication when block mangers are running on the same h

[jira] [Updated] (SPARK-27622) Avoiding network communication when block manger fetching from the same host

[ https://issues.apache.org/jira/browse/SPARK-27622?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Attila Zsolt Piros updated SPARK-27622: --- Summary: Avoiding network communication when block manger fetching from the same hos

[jira] [Updated] (SPARK-27622) Avoid network communication when block manger fetches from the same host

[ https://issues.apache.org/jira/browse/SPARK-27622?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Attila Zsolt Piros updated SPARK-27622: --- Summary: Avoid network communication when block manger fetches from the same host (

[jira] [Comment Edited] (SPARK-27622) Avoid network communication when block manger fetches from the same host

[ https://issues.apache.org/jira/browse/SPARK-27622?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16831553#comment-16831553 ] Attila Zsolt Piros edited comment on SPARK-27622 at 5/6/19 6:22 PM: --

[jira] [Updated] (SPARK-27622) Avoid the network when block manager fetches disk persisted RDD blocks from the same host

[ https://issues.apache.org/jira/browse/SPARK-27622?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Attila Zsolt Piros updated SPARK-27622: --- Summary: Avoid the network when block manager fetches disk persisted RDD blocks from

[jira] [Updated] (SPARK-27622) Avoid network communication when block manager fetches disk persisted RDD blocks from the same host

[ https://issues.apache.org/jira/browse/SPARK-27622?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Attila Zsolt Piros updated SPARK-27622: --- Summary: Avoid network communication when block manager fetches disk persisted RDD b

[jira] [Created] (SPARK-27651) Avoid the network when block manager fetches shuffle blocks from the same host

Attila Zsolt Piros created SPARK-27651: -- Summary: Avoid the network when block manager fetches shuffle blocks from the same host Key: SPARK-27651 URL: https://issues.apache.org/jira/browse/SPARK-27651

[jira] [Commented] (SPARK-27651) Avoid the network when block manager fetches shuffle blocks from the same host

[ https://issues.apache.org/jira/browse/SPARK-27651?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16834832#comment-16834832 ] Attila Zsolt Piros commented on SPARK-27651: I am already working on this.

[jira] [Commented] (SPARK-34167) Reading parquet with Decimal(8,2) written as a Decimal64 blows up

[ https://issues.apache.org/jira/browse/SPARK-34167?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17269182#comment-17269182 ] Attila Zsolt Piros commented on SPARK-34167: [~razajafri] could you share wi

[jira] [Comment Edited] (SPARK-34167) Reading parquet with Decimal(8,2) written as a Decimal64 blows up

[ https://issues.apache.org/jira/browse/SPARK-34167?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17269182#comment-17269182 ] Attila Zsolt Piros edited comment on SPARK-34167 at 1/21/21, 9:49 AM:

[jira] [Commented] (SPARK-34154) Flaky Test: LocalityPlacementStrategySuite.handle large number of containers and tasks (SPARK-18750)

[ https://issues.apache.org/jira/browse/SPARK-34154?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17272867#comment-17272867 ] Attila Zsolt Piros commented on SPARK-34154: I tried to reproduce this issue

[jira] [Commented] (SPARK-34154) Flaky Test: LocalityPlacementStrategySuite.handle large number of containers and tasks (SPARK-18750)

[ https://issues.apache.org/jira/browse/SPARK-34154?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17272990#comment-17272990 ] Attila Zsolt Piros commented on SPARK-34154: In my PR the bug does not surfa

[jira] [Comment Edited] (SPARK-34179) examples provided in https://spark.apache.org/docs/latest/api/sql/index.html link not working

[ https://issues.apache.org/jira/browse/SPARK-34179?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17273348#comment-17273348 ] Attila Zsolt Piros edited comment on SPARK-34179 at 1/28/21, 6:09 AM:

[jira] [Commented] (SPARK-34179) examples provided in https://spark.apache.org/docs/latest/api/sql/index.html link not working

[ https://issues.apache.org/jira/browse/SPARK-34179?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17273348#comment-17273348 ] Attila Zsolt Piros commented on SPARK-34179: [~chetdb] The "https://spark.ap

[jira] [Commented] (SPARK-34126) SQL running error, spark does not exit, resulting in data quality problems

[ https://issues.apache.org/jira/browse/SPARK-34126?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17273761#comment-17273761 ] Attila Zsolt Piros commented on SPARK-34126: [~shikui] are you using the " -

[jira] [Commented] (SPARK-33763) Add metrics for better tracking of dynamic allocation

[ https://issues.apache.org/jira/browse/SPARK-33763?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17273923#comment-17273923 ] Attila Zsolt Piros commented on SPARK-33763: I started working on this. >

[jira] [Commented] (SPARK-34285) Implement Parquet StringEndsWith、StringContains Filter

[ https://issues.apache.org/jira/browse/SPARK-34285?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17274458#comment-17274458 ] Attila Zsolt Piros commented on SPARK-34285: [~Xudingyu] predicate pushdown

[jira] [Comment Edited] (SPARK-34285) Implement Parquet StringEndsWith、StringContains Filter

[ https://issues.apache.org/jira/browse/SPARK-34285?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17274458#comment-17274458 ] Attila Zsolt Piros edited comment on SPARK-34285 at 1/31/21, 4:50 AM:

[jira] [Commented] (SPARK-34280) Avoid migrating un-needed shuffle files

[ https://issues.apache.org/jira/browse/SPARK-34280?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17275783#comment-17275783 ] Attila Zsolt Piros commented on SPARK-34280: It would be interesting to know

[jira] [Commented] (SPARK-29220) Flaky test: org.apache.spark.deploy.yarn.LocalityPlacementStrategySuite.handle large number of containers and tasks (SPARK-18750) [hadoop-3.2][java11]

[ https://issues.apache.org/jira/browse/SPARK-29220?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17275786#comment-17275786 ] Attila Zsolt Piros commented on SPARK-29220: I think we can close this as wi

[jira] [Commented] (SPARK-29391) Default year-month units

[ https://issues.apache.org/jira/browse/SPARK-29391?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17275926#comment-17275926 ] Attila Zsolt Piros commented on SPARK-29391: I am working on this and within

[jira] [Commented] (SPARK-29391) Default year-month units

[ https://issues.apache.org/jira/browse/SPARK-29391?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17275952#comment-17275952 ] Attila Zsolt Piros commented on SPARK-29391: If this helps in decision: the

[jira] [Commented] (SPARK-34194) Queries that only touch partition columns shouldn't scan through all files

[ https://issues.apache.org/jira/browse/SPARK-34194?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17275965#comment-17275965 ] Attila Zsolt Piros commented on SPARK-34194: [~nchammas] I suggest to check

[jira] [Commented] (SPARK-34194) Queries that only touch partition columns shouldn't scan through all files

[ https://issues.apache.org/jira/browse/SPARK-34194?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17276874#comment-17276874 ] Attila Zsolt Piros commented on SPARK-34194: Yes. > Queries that only touch

[jira] [Comment Edited] (SPARK-34194) Queries that only touch partition columns shouldn't scan through all files

[ https://issues.apache.org/jira/browse/SPARK-34194?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17276874#comment-17276874 ] Attila Zsolt Piros edited comment on SPARK-34194 at 2/2/21, 6:59 AM: -

[jira] [Commented] (SPARK-34334) ExecutorPodsAllocator fails to identify some excess requests during downscaling

[ https://issues.apache.org/jira/browse/SPARK-34334?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17277436#comment-17277436 ] Attila Zsolt Piros commented on SPARK-34334: I am working on the this. > Ex

[jira] [Created] (SPARK-34334) ExecutorPodsAllocator fails to identify some excess requests during downscaling

Attila Zsolt Piros created SPARK-34334: -- Summary: ExecutorPodsAllocator fails to identify some excess requests during downscaling Key: SPARK-34334 URL: https://issues.apache.org/jira/browse/SPARK-34334

[jira] [Commented] (SPARK-33763) Add metrics for better tracking of dynamic allocation

[ https://issues.apache.org/jira/browse/SPARK-33763?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17277675#comment-17277675 ] Attila Zsolt Piros commented on SPARK-33763: I am ready with the executor re

[jira] [Resolved] (SPARK-29391) Default year-month units

[ https://issues.apache.org/jira/browse/SPARK-29391?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Attila Zsolt Piros resolved SPARK-29391. Resolution: Won't Fix As PostgreSQL feature parity is not a requirement anymore an

[jira] [Comment Edited] (SPARK-29391) Default year-month units

[ https://issues.apache.org/jira/browse/SPARK-29391?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17278006#comment-17278006 ] Attila Zsolt Piros edited comment on SPARK-29391 at 2/3/21, 1:35 PM: -

[jira] [Commented] (SPARK-29391) Default year-month units

[ https://issues.apache.org/jira/browse/SPARK-29391?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17278010#comment-17278010 ] Attila Zsolt Piros commented on SPARK-29391: This is fine but learning from

[jira] [Commented] (SPARK-29391) Default year-month units

[ https://issues.apache.org/jira/browse/SPARK-29391?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17278015#comment-17278015 ] Attila Zsolt Piros commented on SPARK-29391: I found this: https://issues.ap

[jira] [Commented] (SPARK-27764) Feature Parity between PostgreSQL and Spark

[ https://issues.apache.org/jira/browse/SPARK-27764?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17278065#comment-17278065 ] Attila Zsolt Piros commented on SPARK-27764: Sorry to chime in but we have (

[jira] [Created] (SPARK-34361) Dynamic allocation on K8s kills executors with running tasks

Attila Zsolt Piros created SPARK-34361: -- Summary: Dynamic allocation on K8s kills executors with running tasks Key: SPARK-34361 URL: https://issues.apache.org/jira/browse/SPARK-34361 Project: Spa

[jira] [Commented] (SPARK-34361) Dynamic allocation on K8s kills executors with running tasks

[ https://issues.apache.org/jira/browse/SPARK-34361?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17278932#comment-17278932 ] Attila Zsolt Piros commented on SPARK-34361: I am working on this. > Dynami

[jira] [Created] (SPARK-34370) Supporting Avro schema evolution for partitioned Hive tables using "avro.schema.url"

Attila Zsolt Piros created SPARK-34370: -- Summary: Supporting Avro schema evolution for partitioned Hive tables using "avro.schema.url" Key: SPARK-34370 URL: https://issues.apache.org/jira/browse/SPARK-34370

[jira] [Updated] (SPARK-34370) Supporting Avro schema evolution for partitioned Hive tables using "avro.schema.url"

[ https://issues.apache.org/jira/browse/SPARK-34370?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Attila Zsolt Piros updated SPARK-34370: --- Description: This came up in https://github.com/apache/spark/pull/31133#issuecommen

[jira] [Commented] (SPARK-34370) Supporting Avro schema evolution for partitioned Hive tables using "avro.schema.url"

[ https://issues.apache.org/jira/browse/SPARK-34370?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17279156#comment-17279156 ] Attila Zsolt Piros commented on SPARK-34370: I am working on this. > Suppor

[jira] [Updated] (SPARK-34370) Supporting Avro schema evolution for partitioned Hive tables using "avro.schema.url"

[ https://issues.apache.org/jira/browse/SPARK-34370?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Attila Zsolt Piros updated SPARK-34370: --- Description: This came up in https://github.com/apache/spark/pull/31133#issuecommen

[jira] [Updated] (SPARK-34370) Supporting Avro schema evolution for partitioned Hive tables using "avro.schema.url"

[ https://issues.apache.org/jira/browse/SPARK-34370?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Attila Zsolt Piros updated SPARK-34370: --- Description: This came up in https://github.com/apache/spark/pull/31133#issuecommen

[jira] [Updated] (SPARK-34370) Supporting Avro schema evolution for partitioned Hive tables using "avro.schema.url"

[ https://issues.apache.org/jira/browse/SPARK-34370?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Attila Zsolt Piros updated SPARK-34370: --- Description: This came up in https://github.com/apache/spark/pull/31133#issuecommen

[jira] [Updated] (SPARK-34370) Supporting Avro schema evolution for partitioned Hive tables using "avro.schema.url"

[ https://issues.apache.org/jira/browse/SPARK-34370?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Attila Zsolt Piros updated SPARK-34370: --- Description: This came up in https://github.com/apache/spark/pull/31133#issuecommen

[jira] [Commented] (SPARK-34389) Spark job on Kubernetes scheduled For Zero or less than minimum number of executors and Wait indefinitely under resource starvation

[ https://issues.apache.org/jira/browse/SPARK-34389?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17281134#comment-17281134 ] Attila Zsolt Piros commented on SPARK-34389: [~ranju] I understand your conc

[jira] [Commented] (SPARK-34389) Spark job on Kubernetes scheduled For Zero or less than minimum number of executors and Wait indefinitely under resource starvation

[ https://issues.apache.org/jira/browse/SPARK-34389?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17281645#comment-17281645 ] Attila Zsolt Piros commented on SPARK-34389: > is it possible to get the ava

[jira] [Commented] (SPARK-34372) Speculation results in broken CSV files in Amazon S3

[ https://issues.apache.org/jira/browse/SPARK-34372?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17281815#comment-17281815 ] Attila Zsolt Piros commented on SPARK-34372: A Direct output committer with

[jira] [Comment Edited] (SPARK-33763) Add metrics for better tracking of dynamic allocation

[ https://issues.apache.org/jira/browse/SPARK-33763?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17282201#comment-17282201 ] Attila Zsolt Piros edited comment on SPARK-33763 at 2/10/21, 3:30 AM:

[jira] [Commented] (SPARK-33763) Add metrics for better tracking of dynamic allocation

[ https://issues.apache.org/jira/browse/SPARK-33763?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17282201#comment-17282201 ] Attila Zsolt Piros commented on SPARK-33763: I am not positive about the "st

[jira] [Commented] (SPARK-34389) Spark job on Kubernetes scheduled For Zero or less than minimum number of executors and Wait indefinitely under resource starvation

[ https://issues.apache.org/jira/browse/SPARK-34389?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17282614#comment-17282614 ] Attila Zsolt Piros commented on SPARK-34389: [~ranju] the description of thi

[jira] [Commented] (SPARK-34389) Spark job on Kubernetes scheduled For Zero or less than minimum number of executors and Wait indefinitely under resource starvation

[ https://issues.apache.org/jira/browse/SPARK-34389?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17282871#comment-17282871 ] Attila Zsolt Piros commented on SPARK-34389: @Ranju from the logs you attach

[jira] [Commented] (SPARK-34389) Spark job on Kubernetes scheduled For Zero or less than minimum number of executors and Wait indefinitely under resource starvation

[ https://issues.apache.org/jira/browse/SPARK-34389?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17282994#comment-17282994 ] Attila Zsolt Piros commented on SPARK-34389: [~ranju] as I see your question

[jira] [Comment Edited] (SPARK-34389) Spark job on Kubernetes scheduled For Zero or less than minimum number of executors and Wait indefinitely under resource starvation

[ https://issues.apache.org/jira/browse/SPARK-34389?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17282614#comment-17282614 ] Attila Zsolt Piros edited comment on SPARK-34389 at 2/12/21, 8:36 AM:

[jira] [Updated] (SPARK-34426) Add driver and executors POD logs to integration tests log when the test fails

[ https://issues.apache.org/jira/browse/SPARK-34426?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Attila Zsolt Piros updated SPARK-34426: --- Summary: Add driver and executors POD logs to integration tests log when the test fa

[jira] [Commented] (SPARK-34426) Add driver and executors POD logs to integration-tests log when the test fails

[ https://issues.apache.org/jira/browse/SPARK-34426?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17283974#comment-17283974 ] Attila Zsolt Piros commented on SPARK-34426: I am working on this. > Add dr

[jira] [Created] (SPARK-34426) Add driver and executors POD logs to integration-tests log when the test fails

Attila Zsolt Piros created SPARK-34426: -- Summary: Add driver and executors POD logs to integration-tests log when the test fails Key: SPARK-34426 URL: https://issues.apache.org/jira/browse/SPARK-34426

[jira] [Commented] (SPARK-34433) Lock jekyll version by Gemfile and Bundler

[ https://issues.apache.org/jira/browse/SPARK-34433?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17284287#comment-17284287 ] Attila Zsolt Piros commented on SPARK-34433: I am working on this. > Lock j

[jira] [Created] (SPARK-34433) Lock jekyll version by Gemfile and Bundler

Attila Zsolt Piros created SPARK-34433: -- Summary: Lock jekyll version by Gemfile and Bundler Key: SPARK-34433 URL: https://issues.apache.org/jira/browse/SPARK-34433 Project: Spark Issue

[jira] [Created] (SPARK-34509) Make dynamic allocation upscaling more progressive on K8S

Attila Zsolt Piros created SPARK-34509: -- Summary: Make dynamic allocation upscaling more progressive on K8S Key: SPARK-34509 URL: https://issues.apache.org/jira/browse/SPARK-34509 Project: Spark

[jira] [Commented] (SPARK-34509) Make dynamic allocation upscaling more progressive on K8S

[ https://issues.apache.org/jira/browse/SPARK-34509?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17289158#comment-17289158 ] Attila Zsolt Piros commented on SPARK-34509: I am working on this. > Make d

[jira] [Created] (SPARK-34732) The logForFailedTest throws an exception when driver is not started

Attila Zsolt Piros created SPARK-34732: -- Summary: The logForFailedTest throws an exception when driver is not started Key: SPARK-34732 URL: https://issues.apache.org/jira/browse/SPARK-34732 Proje

[jira] [Commented] (SPARK-34736) Kubernetes and Minikube version upgrade for integration tests

[ https://issues.apache.org/jira/browse/SPARK-34736?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17301046#comment-17301046 ] Attila Zsolt Piros commented on SPARK-34736: Working on this > Kubernetes a

[jira] [Created] (SPARK-34736) Kubernetes and Minikube version upgrade for integration tests

Attila Zsolt Piros created SPARK-34736: -- Summary: Kubernetes and Minikube version upgrade for integration tests Key: SPARK-34736 URL: https://issues.apache.org/jira/browse/SPARK-34736 Project: Sp

[jira] [Created] (SPARK-34738) Upgrade Minikube and kubernetes cluster version on Jenkins

Attila Zsolt Piros created SPARK-34738: -- Summary: Upgrade Minikube and kubernetes cluster version on Jenkins Key: SPARK-34738 URL: https://issues.apache.org/jira/browse/SPARK-34738 Project: Spark

[jira] [Commented] (SPARK-34738) Upgrade Minikube and kubernetes cluster version on Jenkins

[ https://issues.apache.org/jira/browse/SPARK-34738?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17303287#comment-17303287 ] Attila Zsolt Piros commented on SPARK-34738: Thanks Shane! This sounds great

[jira] [Created] (SPARK-34789) Introduce Jetty based construct for integration tests where HTTP(S) is used

Attila Zsolt Piros created SPARK-34789: -- Summary: Introduce Jetty based construct for integration tests where HTTP(S) is used Key: SPARK-34789 URL: https://issues.apache.org/jira/browse/SPARK-34789

[jira] [Commented] (SPARK-34789) Introduce Jetty based construct for integration tests where HTTP(S) is used

[ https://issues.apache.org/jira/browse/SPARK-34789?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17304245#comment-17304245 ] Attila Zsolt Piros commented on SPARK-34789: I am working on this > Introd

[jira] [Updated] (SPARK-34789) Introduce Jetty based construct for integration tests where HTTP(S) is used

[ https://issues.apache.org/jira/browse/SPARK-34789?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Attila Zsolt Piros updated SPARK-34789: --- Description: This came up during https://github.com/apache/spark/pull/31877#discuss

[jira] [Commented] (SPARK-34684) Hadoop config could not be successfully serilized from driver pods to executor pods

[ https://issues.apache.org/jira/browse/SPARK-34684?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17306895#comment-17306895 ] Attila Zsolt Piros commented on SPARK-34684: > spark pi example job keeps fa

[jira] [Commented] (SPARK-34684) Hadoop config could not be successfully serilized from driver pods to executor pods

[ https://issues.apache.org/jira/browse/SPARK-34684?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17307392#comment-17307392 ] Attila Zsolt Piros commented on SPARK-34684: > Have you tried to create a P

[jira] [Commented] (SPARK-34684) Hadoop config could not be successfully serilized from driver pods to executor pods

[ https://issues.apache.org/jira/browse/SPARK-34684?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17307710#comment-17307710 ] Attila Zsolt Piros commented on SPARK-34684: I did not say there is no error

[jira] [Created] (SPARK-34869) Extend k8s "EXTRA LOGS FOR THE FAILED TEST" section with pod describe output

Attila Zsolt Piros created SPARK-34869: -- Summary: Extend k8s "EXTRA LOGS FOR THE FAILED TEST" section with pod describe output Key: SPARK-34869 URL: https://issues.apache.org/jira/browse/SPARK-34869

[jira] [Updated] (SPARK-34869) Extend k8s "EXTRA LOGS FOR THE FAILED TEST" section with pod describe output

[ https://issues.apache.org/jira/browse/SPARK-34869?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Attila Zsolt Piros updated SPARK-34869: --- Description: As came up in https://github.com/apache/spark/pull/31923#issuecomment-

[jira] [Updated] (SPARK-34869) Extend k8s "EXTRA LOGS FOR THE FAILED TEST" section with pod describe output

[ https://issues.apache.org/jira/browse/SPARK-34869?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Attila Zsolt Piros updated SPARK-34869: --- Description: As came up in https://github.com/apache/spark/pull/31923#issuecomment-8

[jira] [Assigned] (SPARK-34869) Extend k8s "EXTRA LOGS FOR THE FAILED TEST" section with pod describe output

[ https://issues.apache.org/jira/browse/SPARK-34869?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Attila Zsolt Piros reassigned SPARK-34869: -- Assignee: Attila Zsolt Piros > Extend k8s "EXTRA LOGS FOR THE FAILED TEST" se

[jira] [Commented] (SPARK-34869) Extend k8s "EXTRA LOGS FOR THE FAILED TEST" section with pod describe output

[ https://issues.apache.org/jira/browse/SPARK-34869?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17308679#comment-17308679 ] Attila Zsolt Piros commented on SPARK-34869: I am working on this. > Extend

[jira] [Updated] (SPARK-34869) Extend k8s "EXTRA LOGS FOR THE FAILED TEST" section with describe pods output

[ https://issues.apache.org/jira/browse/SPARK-34869?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Attila Zsolt Piros updated SPARK-34869: --- Description: As came up in https://github.com/apache/spark/pull/31923#issuecomment-8

[jira] [Updated] (SPARK-34869) Extend k8s "EXTRA LOGS FOR THE FAILED TEST" section with describe pods output

[ https://issues.apache.org/jira/browse/SPARK-34869?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Attila Zsolt Piros updated SPARK-34869: --- Summary: Extend k8s "EXTRA LOGS FOR THE FAILED TEST" section with describe pods outp

[jira] [Commented] (SPARK-34738) Upgrade Minikube and kubernetes cluster version on Jenkins

[ https://issues.apache.org/jira/browse/SPARK-34738?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17312851#comment-17312851 ] Attila Zsolt Piros commented on SPARK-34738: Shane, as Docker is available o

[jira] [Commented] (SPARK-34738) Upgrade Minikube and kubernetes cluster version on Jenkins

[ https://issues.apache.org/jira/browse/SPARK-34738?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17313144#comment-17313144 ] Attila Zsolt Piros commented on SPARK-34738: So I wanted to check whether I

[jira] [Created] (SPARK-36965) Extend python test runner by logging out the temp output files

Attila Zsolt Piros created SPARK-36965: -- Summary: Extend python test runner by logging out the temp output files Key: SPARK-36965 URL: https://issues.apache.org/jira/browse/SPARK-36965 Project: S

[jira] [Updated] (SPARK-36965) Extend python test runner by logging out the temp output files

[ https://issues.apache.org/jira/browse/SPARK-36965?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Attila Zsolt Piros updated SPARK-36965: --- Priority: Minor (was: Major) > Extend python test runner by logging out the temp ou

[jira] [Updated] (SPARK-36965) Extend python test runner by logging out the temp output files

[ https://issues.apache.org/jira/browse/SPARK-36965?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Attila Zsolt Piros updated SPARK-36965: --- Description: I was running a python test which was extremely slow and I was surprise

[jira] [Updated] (SPARK-36965) Extend python test runner by logging out the temp output files

[ https://issues.apache.org/jira/browse/SPARK-36965?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Attila Zsolt Piros updated SPARK-36965: --- Description: I was running a python test which was extremely slow and I was surprise

[jira] [Updated] (SPARK-36965) Extend python test runner by logging out the temp output files

[ https://issues.apache.org/jira/browse/SPARK-36965?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Attila Zsolt Piros updated SPARK-36965: --- Description: I was running a python test which was extremely slow and I was surprise

[jira] [Resolved] (SPARK-36965) Extend python test runner by logging out the temp output files

[ https://issues.apache.org/jira/browse/SPARK-36965?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Attila Zsolt Piros resolved SPARK-36965. Fix Version/s: 3.3.0 Resolution: Fixed Issue resolved by pull request 34233

[jira] [Resolved] (SPARK-35672) Spark fails to launch executors with very large user classpath lists on YARN

[ https://issues.apache.org/jira/browse/SPARK-35672?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Attila Zsolt Piros resolved SPARK-35672. Fix Version/s: 3.3.0 Resolution: Fixed Issue resolved by pull request 34120

[jira] [Created] (SPARK-37373) Collect LocalSparkContext worker logs in case of test failure

Attila Zsolt Piros created SPARK-37373: -- Summary: Collect LocalSparkContext worker logs in case of test failure Key: SPARK-37373 URL: https://issues.apache.org/jira/browse/SPARK-37373 Project: Sp

[jira] [Updated] (SPARK-37373) Collect LocalSparkContext worker logs in case of test failure

[ https://issues.apache.org/jira/browse/SPARK-37373?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Attila Zsolt Piros updated SPARK-37373: --- Affects Version/s: 3.3.0 (was: 3.2.0) > Collect LocalSpar

[jira] [Created] (SPARK-39152) StreamCorruptedException cause job failure for disk persisted RDD

Attila Zsolt Piros created SPARK-39152: -- Summary: StreamCorruptedException cause job failure for disk persisted RDD Key: SPARK-39152 URL: https://issues.apache.org/jira/browse/SPARK-39152 Project

[jira] [Commented] (SPARK-39152) StreamCorruptedException cause job failure for disk persisted RDD

[ https://issues.apache.org/jira/browse/SPARK-39152?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17535044#comment-17535044 ] Attila Zsolt Piros commented on SPARK-39152: I am working on this > StreamC

[jira] [Created] (SPARK-39473) NullPointerException in SparkRackResolver

Attila Zsolt Piros created SPARK-39473: -- Summary: NullPointerException in SparkRackResolver Key: SPARK-39473 URL: https://issues.apache.org/jira/browse/SPARK-39473 Project: Spark Issue

[jira] [Resolved] (SPARK-39473) NullPointerException in SparkRackResolver

[ https://issues.apache.org/jira/browse/SPARK-39473?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Attila Zsolt Piros resolved SPARK-39473. Resolution: Invalid This is because of Scala 2.11 on latter version *asScala* is p

[jira] [Assigned] (SPARK-34779) ExecutorMetricsPoller should keep stage entry in stageTCMP until a heartbeat occurs

[ https://issues.apache.org/jira/browse/SPARK-34779?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Attila Zsolt Piros reassigned SPARK-34779: -- Assignee: Baohe Zhang > ExecutorMetricsPoller should keep stage entry in stag

[jira] [Resolved] (SPARK-34779) ExecutorMetricsPoller should keep stage entry in stageTCMP until a heartbeat occurs

[ https://issues.apache.org/jira/browse/SPARK-34779?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Attila Zsolt Piros resolved SPARK-34779. Fix Version/s: 3.2.0 Resolution: Fixed Issue resolved by pull request 31871

[jira] [Commented] (SPARK-34738) Upgrade Minikube and kubernetes cluster version on Jenkins

[ https://issues.apache.org/jira/browse/SPARK-34738?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17317034#comment-17317034 ] Attila Zsolt Piros commented on SPARK-34738: hi [~shaneknapp]! Can you ple

[jira] [Commented] (SPARK-34738) Upgrade Minikube and kubernetes cluster version on Jenkins

[ https://issues.apache.org/jira/browse/SPARK-34738?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17317381#comment-17317381 ] Attila Zsolt Piros commented on SPARK-34738: No worries. I have guess. Che

  1   2   3   4   >