[jira] [Resolved] (SPARK-28187) Add hadoop-cloud module to PR builders

[ https://issues.apache.org/jira/browse/SPARK-28187?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marcelo Vanzin resolved SPARK-28187. Resolution: Fixed Fix Version/s: 3.0.0 Issue resolved by pull request 24987 [https:

[jira] [Resolved] (SPARK-28150) Failure to create multiple contexts in same JVM with Kerberos auth

[ https://issues.apache.org/jira/browse/SPARK-28150?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marcelo Vanzin resolved SPARK-28150. Resolution: Fixed Fix Version/s: 3.0.0 Issue resolved by pull request 24955 [https:

[jira] [Assigned] (SPARK-28150) Failure to create multiple contexts in same JVM with Kerberos auth

[ https://issues.apache.org/jira/browse/SPARK-28150?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marcelo Vanzin reassigned SPARK-28150: -- Assignee: Marcelo Vanzin > Failure to create multiple contexts in same JVM with Kerbe

[jira] [Created] (SPARK-28187) Add hadoop-cloud module to PR builders

Marcelo Vanzin created SPARK-28187: -- Summary: Add hadoop-cloud module to PR builders Key: SPARK-28187 URL: https://issues.apache.org/jira/browse/SPARK-28187 Project: Spark Issue Type: Improv

[jira] [Resolved] (SPARK-27622) Avoid the network when block manager fetches disk persisted RDD blocks from the same host

[ https://issues.apache.org/jira/browse/SPARK-27622?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marcelo Vanzin resolved SPARK-27622. Resolution: Fixed Fix Version/s: 3.0.0 Issue resolved by pull request 24554 [https:

[jira] [Assigned] (SPARK-27622) Avoid the network when block manager fetches disk persisted RDD blocks from the same host

[ https://issues.apache.org/jira/browse/SPARK-27622?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marcelo Vanzin reassigned SPARK-27622: -- Assignee: Attila Zsolt Piros > Avoid the network when block manager fetches disk pers

[jira] [Assigned] (SPARK-24432) Add support for dynamic resource allocation

[ https://issues.apache.org/jira/browse/SPARK-24432?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marcelo Vanzin reassigned SPARK-24432: -- Assignee: (was: Marcelo Vanzin) > Add support for dynamic resource allocation > -

[jira] [Assigned] (SPARK-24432) Add support for dynamic resource allocation

[ https://issues.apache.org/jira/browse/SPARK-24432?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marcelo Vanzin reassigned SPARK-24432: -- Assignee: Marcelo Vanzin > Add support for dynamic resource allocation >

[jira] [Updated] (SPARK-28150) Failure to create multiple contexts in same JVM with Kerberos auth

[ https://issues.apache.org/jira/browse/SPARK-28150?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marcelo Vanzin updated SPARK-28150: --- Description: Take the following small app that creates multiple contexts (not concurrently):

[jira] [Created] (SPARK-28150) Failure to create multiple contexts in same JVM with Kerberos auth

Marcelo Vanzin created SPARK-28150: -- Summary: Failure to create multiple contexts in same JVM with Kerberos auth Key: SPARK-28150 URL: https://issues.apache.org/jira/browse/SPARK-28150 Project: Spark

[jira] [Commented] (SPARK-27963) Allow dynamic allocation without an external shuffle service

[ https://issues.apache.org/jira/browse/SPARK-27963?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16857146#comment-16857146 ] Marcelo Vanzin commented on SPARK-27963: FYI I have a WIP patch to implement thi

[jira] [Created] (SPARK-27963) Allow dynamic allocation without an external shuffle service

Marcelo Vanzin created SPARK-27963: -- Summary: Allow dynamic allocation without an external shuffle service Key: SPARK-27963 URL: https://issues.apache.org/jira/browse/SPARK-27963 Project: Spark

[jira] [Resolved] (SPARK-27748) Kafka consumer/producer password/token redaction

[ https://issues.apache.org/jira/browse/SPARK-27748?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marcelo Vanzin resolved SPARK-27748. Resolution: Fixed Assignee: Gabor Somogyi Fix Version/s: 3.0.0 > Kafka con

[jira] [Commented] (SPARK-27891) Long running spark jobs fail because of HDFS delegation token expires

[ https://issues.apache.org/jira/browse/SPARK-27891?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16852420#comment-16852420 ] Marcelo Vanzin commented on SPARK-27891: Ok, the updated logs show the issue. Bu

[jira] [Commented] (SPARK-27891) Long running spark jobs fail because of HDFS delegation token expires

[ https://issues.apache.org/jira/browse/SPARK-27891?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16852408#comment-16852408 ] Marcelo Vanzin commented on SPARK-27891: {{container_e48_1559242207407_0001_02_0

[jira] [Resolved] (SPARK-27891) Long running spark jobs fail because of HDFS delegation token expires

[ https://issues.apache.org/jira/browse/SPARK-27891?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marcelo Vanzin resolved SPARK-27891. Resolution: Not A Problem You have to provide a keytab for Spark for this to work. That's

[jira] [Resolved] (SPARK-27773) Add shuffle service metric for number of exceptions caught in ExternalShuffleBlockHandler

[ https://issues.apache.org/jira/browse/SPARK-27773?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marcelo Vanzin resolved SPARK-27773. Resolution: Fixed Fix Version/s: 3.0.0 Issue resolved by pull request 24645 [https:

[jira] [Assigned] (SPARK-27773) Add shuffle service metric for number of exceptions caught in ExternalShuffleBlockHandler

[ https://issues.apache.org/jira/browse/SPARK-27773?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marcelo Vanzin reassigned SPARK-27773: -- Assignee: Steven Rand > Add shuffle service metric for number of exceptions caught in

[jira] [Resolved] (SPARK-27378) spark-submit requests GPUs in YARN mode

[ https://issues.apache.org/jira/browse/SPARK-27378?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marcelo Vanzin resolved SPARK-27378. Resolution: Fixed Fix Version/s: 3.0.0 Issue resolved by pull request 24634 [https:

[jira] [Assigned] (SPARK-27378) spark-submit requests GPUs in YARN mode

[ https://issues.apache.org/jira/browse/SPARK-27378?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marcelo Vanzin reassigned SPARK-27378: -- Assignee: Thomas Graves > spark-submit requests GPUs in YARN mode > -

[jira] [Created] (SPARK-27868) Better document shuffle / RPC listen backlog

Marcelo Vanzin created SPARK-27868: -- Summary: Better document shuffle / RPC listen backlog Key: SPARK-27868 URL: https://issues.apache.org/jira/browse/SPARK-27868 Project: Spark Issue Type:

[jira] [Commented] (SPARK-24149) Automatic namespaces discovery in HDFS federation

[ https://issues.apache.org/jira/browse/SPARK-24149?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16847926#comment-16847926 ] Marcelo Vanzin commented on SPARK-24149: bq. If they are unrelated the user expl

[jira] [Commented] (SPARK-24149) Automatic namespaces discovery in HDFS federation

[ https://issues.apache.org/jira/browse/SPARK-24149?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16847888#comment-16847888 ] Marcelo Vanzin commented on SPARK-24149: bq. I think we are duplicating the logi

[jira] [Assigned] (SPARK-27677) Disk-persisted RDD blocks served by shuffle service, and ignored for Dynamic Allocation

[ https://issues.apache.org/jira/browse/SPARK-27677?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marcelo Vanzin reassigned SPARK-27677: -- Assignee: Attila Zsolt Piros > Disk-persisted RDD blocks served by shuffle service, a

[jira] [Resolved] (SPARK-27677) Disk-persisted RDD blocks served by shuffle service, and ignored for Dynamic Allocation

[ https://issues.apache.org/jira/browse/SPARK-27677?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marcelo Vanzin resolved SPARK-27677. Resolution: Fixed Fix Version/s: 3.0.0 Issue resolved by pull request 24499 [https:

[jira] [Resolved] (SPARK-27804) LiveListenerBus#addToQueue : create multiple AsyncEventQueues under race condition

[ https://issues.apache.org/jira/browse/SPARK-27804?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marcelo Vanzin resolved SPARK-27804. Resolution: Not A Problem > LiveListenerBus#addToQueue : create multiple AsyncEventQueues

[jira] [Commented] (SPARK-27797) Shuffle service metric "registeredConnections" not tracked correctly

[ https://issues.apache.org/jira/browse/SPARK-27797?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16846068#comment-16846068 ] Marcelo Vanzin commented on SPARK-27797: You're right. Looks just like some dead

[jira] [Created] (SPARK-27797) Shuffle service metric "registeredConnections" not tracked correctly

Marcelo Vanzin created SPARK-27797: -- Summary: Shuffle service metric "registeredConnections" not tracked correctly Key: SPARK-27797 URL: https://issues.apache.org/jira/browse/SPARK-27797 Project: Spa

[jira] [Updated] (SPARK-27726) Performance of InMemoryStore suffers under load

[ https://issues.apache.org/jira/browse/SPARK-27726?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marcelo Vanzin updated SPARK-27726: --- Fix Version/s: 2.4.4 > Performance of InMemoryStore suffers under load > ---

[jira] [Commented] (SPARK-27726) Performance of InMemoryStore suffers under load

[ https://issues.apache.org/jira/browse/SPARK-27726?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16845061#comment-16845061 ] Marcelo Vanzin commented on SPARK-27726: [~davidnavas] all of the sub-tasks were

[jira] [Assigned] (SPARK-27726) Performance of InMemoryStore suffers under load

[ https://issues.apache.org/jira/browse/SPARK-27726?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marcelo Vanzin reassigned SPARK-27726: -- Assignee: David C Navas > Performance of InMemoryStore suffers under load > -

[jira] [Resolved] (SPARK-27726) Performance of InMemoryStore suffers under load

[ https://issues.apache.org/jira/browse/SPARK-27726?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marcelo Vanzin resolved SPARK-27726. Resolution: Fixed Fix Version/s: 3.0.0 Issue resolved by pull request 24616 [https:

[jira] [Resolved] (SPARK-27745) build/mvn take wrong scala version when compile for scala 2.12

[ https://issues.apache.org/jira/browse/SPARK-27745?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marcelo Vanzin resolved SPARK-27745. Resolution: Not A Bug You need to run {{./dev/change-scala-version.sh}} first. Pretty sure

[jira] [Assigned] (SPARK-27678) Support Knox user impersonation in UI

[ https://issues.apache.org/jira/browse/SPARK-27678?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marcelo Vanzin reassigned SPARK-27678: -- Assignee: Marcelo Vanzin > Support Knox user impersonation in UI > --

[jira] [Resolved] (SPARK-27678) Support Knox user impersonation in UI

[ https://issues.apache.org/jira/browse/SPARK-27678?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marcelo Vanzin resolved SPARK-27678. Resolution: Fixed Fix Version/s: 3.0.0 Issue resolved by pull request 24582 [https:

[jira] [Commented] (SPARK-27681) Use scala.collection.Seq explicitly instead of scala.Seq alias

[ https://issues.apache.org/jira/browse/SPARK-27681?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16839674#comment-16839674 ] Marcelo Vanzin commented on SPARK-27681: bq. 2043 in method parameters, 1488 in

[jira] [Commented] (SPARK-27681) Use scala.collection.Seq explicitly instead of scala.Seq alias

[ https://issues.apache.org/jira/browse/SPARK-27681?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16838799#comment-16838799 ] Marcelo Vanzin commented on SPARK-27681: bq. The case to consider is, roughly, w

[jira] [Commented] (SPARK-27681) Use scala.collection.Seq explicitly instead of scala.Seq alias

[ https://issues.apache.org/jira/browse/SPARK-27681?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16838766#comment-16838766 ] Marcelo Vanzin commented on SPARK-27681: bq. But, user code that passes a non-im

[jira] [Commented] (SPARK-27681) Use scala.collection.Seq explicitly instead of scala.Seq alias

[ https://issues.apache.org/jira/browse/SPARK-27681?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16838715#comment-16838715 ] Marcelo Vanzin commented on SPARK-27681: bq. varargs methods in Scala will chang

[jira] [Commented] (SPARK-27681) Use scala.collection.Seq explicitly instead of scala.Seq alias

[ https://issues.apache.org/jira/browse/SPARK-27681?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16838693#comment-16838693 ] Marcelo Vanzin commented on SPARK-27681: bq. scala.Seq is just a type def for sc

[jira] [Comment Edited] (SPARK-27681) Use scala.collection.Seq explicitly instead of scala.Seq alias

[ https://issues.apache.org/jira/browse/SPARK-27681?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16837752#comment-16837752 ] Marcelo Vanzin edited comment on SPARK-27681 at 5/11/19 4:28 AM: -

[jira] [Commented] (SPARK-27681) Use scala.collection.Seq explicitly instead of scala.Seq alias

[ https://issues.apache.org/jira/browse/SPARK-27681?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16837753#comment-16837753 ] Marcelo Vanzin commented on SPARK-27681: bq. we don't need to do this until we s

[jira] [Commented] (SPARK-27681) Use scala.collection.Seq explicitly instead of scala.Seq alias

[ https://issues.apache.org/jira/browse/SPARK-27681?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16837752#comment-16837752 ] Marcelo Vanzin commented on SPARK-27681: Also the change you're proposing likely

[jira] [Commented] (SPARK-27681) Use scala.collection.Seq explicitly instead of scala.Seq alias

[ https://issues.apache.org/jira/browse/SPARK-27681?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16837749#comment-16837749 ] Marcelo Vanzin commented on SPARK-27681: OOC, what happens if we do nothing? As

[jira] [Created] (SPARK-27678) Support Knox user impersonation in UI

Marcelo Vanzin created SPARK-27678: -- Summary: Support Knox user impersonation in UI Key: SPARK-27678 URL: https://issues.apache.org/jira/browse/SPARK-27678 Project: Spark Issue Type: New Fea

[jira] [Resolved] (SPARK-26632) Separate Thread Configurations of Driver and Executor

[ https://issues.apache.org/jira/browse/SPARK-26632?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marcelo Vanzin resolved SPARK-26632. Resolution: Fixed Fix Version/s: 3.0.0 Issue resolved by pull request 23560 [https:

[jira] [Assigned] (SPARK-26632) Separate Thread Configurations of Driver and Executor

[ https://issues.apache.org/jira/browse/SPARK-26632?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marcelo Vanzin reassigned SPARK-26632: -- Assignee: jiafu zhang > Separate Thread Configurations of Driver and Executor > -

[jira] [Assigned] (SPARK-27294) Multi-cluster Kafka delegation token support

[ https://issues.apache.org/jira/browse/SPARK-27294?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marcelo Vanzin reassigned SPARK-27294: -- Assignee: Gabor Somogyi > Multi-cluster Kafka delegation token support >

[jira] [Resolved] (SPARK-27294) Multi-cluster Kafka delegation token support

[ https://issues.apache.org/jira/browse/SPARK-27294?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marcelo Vanzin resolved SPARK-27294. Resolution: Fixed Fix Version/s: 3.0.0 Issue resolved by pull request 24305 [https:

[jira] [Resolved] (SPARK-27610) Yarn external shuffle service fails to start when spark.shuffle.io.mode=EPOLL

[ https://issues.apache.org/jira/browse/SPARK-27610?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marcelo Vanzin resolved SPARK-27610. Resolution: Fixed Fix Version/s: 3.0.0 Issue resolved by pull request 24502 [https:

[jira] [Assigned] (SPARK-27610) Yarn external shuffle service fails to start when spark.shuffle.io.mode=EPOLL

[ https://issues.apache.org/jira/browse/SPARK-27610?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marcelo Vanzin reassigned SPARK-27610: -- Assignee: Adrian Muraru > Yarn external shuffle service fails to start when spark.shu

[jira] [Assigned] (SPARK-27194) Job failures when task attempts do not clean up spark-staging parquet files

[ https://issues.apache.org/jira/browse/SPARK-27194?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marcelo Vanzin reassigned SPARK-27194: -- Assignee: (was: Marcelo Vanzin) > Job failures when task attempts do not clean up

[jira] [Assigned] (SPARK-27194) Job failures when task attempts do not clean up spark-staging parquet files

[ https://issues.apache.org/jira/browse/SPARK-27194?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marcelo Vanzin reassigned SPARK-27194: -- Assignee: Marcelo Vanzin > Job failures when task attempts do not clean up spark-stag

[jira] [Resolved] (SPARK-16367) Wheelhouse Support for PySpark

[ https://issues.apache.org/jira/browse/SPARK-16367?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marcelo Vanzin resolved SPARK-16367. Resolution: Duplicate This is somewhat similar to SPARK-13587 so let's keep the discussion

[jira] [Assigned] (SPARK-13587) Support virtualenv in PySpark

[ https://issues.apache.org/jira/browse/SPARK-13587?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marcelo Vanzin reassigned SPARK-13587: -- Assignee: Marcelo Vanzin > Support virtualenv in PySpark > --

[jira] [Updated] (SPARK-13587) Support virtualenv in PySpark

[ https://issues.apache.org/jira/browse/SPARK-13587?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marcelo Vanzin updated SPARK-13587: --- Target Version/s: (was: 3.0.0) > Support virtualenv in PySpark > -

[jira] [Assigned] (SPARK-13587) Support virtualenv in PySpark

[ https://issues.apache.org/jira/browse/SPARK-13587?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marcelo Vanzin reassigned SPARK-13587: -- Assignee: (was: Marcelo Vanzin) > Support virtualenv in PySpark > ---

[jira] [Resolved] (SPARK-27575) Spark overwrites existing value of spark.yarn.dist.* instead of merging value

[ https://issues.apache.org/jira/browse/SPARK-27575?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marcelo Vanzin resolved SPARK-27575. Resolution: Fixed Fix Version/s: 3.0.0 Issue resolved by pull request 24465 [https:

[jira] [Assigned] (SPARK-27575) Spark overwrites existing value of spark.yarn.dist.* instead of merging value

[ https://issues.apache.org/jira/browse/SPARK-27575?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marcelo Vanzin reassigned SPARK-27575: -- Assignee: Jungtaek Lim > Spark overwrites existing value of spark.yarn.dist.* instead

[jira] [Resolved] (SPARK-23014) Migrate MemorySink fully to v2

[ https://issues.apache.org/jira/browse/SPARK-23014?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marcelo Vanzin resolved SPARK-23014. Resolution: Fixed Fix Version/s: 3.0.0 Issue resolved by pull request 24403 [https:

[jira] [Assigned] (SPARK-23014) Migrate MemorySink fully to v2

[ https://issues.apache.org/jira/browse/SPARK-23014?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marcelo Vanzin reassigned SPARK-23014: -- Assignee: Gabor Somogyi > Migrate MemorySink fully to v2 > --

[jira] [Assigned] (SPARK-27477) Kafka token provider should have provided dependency on Spark

[ https://issues.apache.org/jira/browse/SPARK-27477?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marcelo Vanzin reassigned SPARK-27477: -- Assignee: koert kuipers > Kafka token provider should have provided dependency on Spa

[jira] [Resolved] (SPARK-27477) Kafka token provider should have provided dependency on Spark

[ https://issues.apache.org/jira/browse/SPARK-27477?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marcelo Vanzin resolved SPARK-27477. Resolution: Fixed Issue resolved by pull request 24384 [https://github.com/apache/spark/pu

[jira] [Resolved] (SPARK-27515) [Deploy] When application master retry after a long time running, the hdfs delegation token may be expired

[ https://issues.apache.org/jira/browse/SPARK-27515?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marcelo Vanzin resolved SPARK-27515. Resolution: Duplicate > [Deploy] When application master retry after a long time running,

[jira] [Commented] (SPARK-11033) Launcher: add support for monitoring standalone/cluster apps

[ https://issues.apache.org/jira/browse/SPARK-11033?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16819274#comment-16819274 ] Marcelo Vanzin commented on SPARK-11033: It's definitely not that simple. > Lau

[jira] [Commented] (SPARK-11033) Launcher: add support for monitoring standalone/cluster apps

[ https://issues.apache.org/jira/browse/SPARK-11033?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16819211#comment-16819211 ] Marcelo Vanzin commented on SPARK-11033: I just filed the bug. I have no intenti

[jira] [Assigned] (SPARK-27270) Add Kafka dynamic JAAS authentication debug possibility

[ https://issues.apache.org/jira/browse/SPARK-27270?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marcelo Vanzin reassigned SPARK-27270: -- Assignee: Gabor Somogyi > Add Kafka dynamic JAAS authentication debug possibility > -

[jira] [Resolved] (SPARK-27270) Add Kafka dynamic JAAS authentication debug possibility

[ https://issues.apache.org/jira/browse/SPARK-27270?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marcelo Vanzin resolved SPARK-27270. Resolution: Fixed Fix Version/s: 3.0.0 Issue resolved by pull request 24204 [https:

[jira] [Resolved] (SPARK-27394) The staleness of UI may last minutes or hours when no tasks start or finish

[ https://issues.apache.org/jira/browse/SPARK-27394?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marcelo Vanzin resolved SPARK-27394. Resolution: Fixed Fix Version/s: 3.0.0 > The staleness of UI may last minutes or ho

[jira] [Resolved] (SPARK-11702) Guava ClassLoading Issue When Using Different Hive Metastore Version

[ https://issues.apache.org/jira/browse/SPARK-11702?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marcelo Vanzin resolved SPARK-11702. Resolution: Cannot Reproduce Pretty sure this does not happen in the 2.x line. > Guava Cl

[jira] [Resolved] (SPARK-25762) Upgrade guava version in spark dependency lists due to CVE issue

[ https://issues.apache.org/jira/browse/SPARK-25762?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marcelo Vanzin resolved SPARK-25762. Resolution: Duplicate Target Version/s: (was: 3.0.0) > Upgrade guava version i

[jira] [Resolved] (SPARK-26998) spark.ssl.keyStorePassword in plaintext on 'ps -ef' output of executor processes in Standalone mode

[ https://issues.apache.org/jira/browse/SPARK-26998?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marcelo Vanzin resolved SPARK-26998. Resolution: Fixed Fix Version/s: 2.3.4 2.4.2 3

[jira] [Assigned] (SPARK-26998) spark.ssl.keyStorePassword in plaintext on 'ps -ef' output of executor processes in Standalone mode

[ https://issues.apache.org/jira/browse/SPARK-26998?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marcelo Vanzin reassigned SPARK-26998: -- Assignee: Gabor Somogyi > spark.ssl.keyStorePassword in plaintext on 'ps -ef' output

[jira] [Assigned] (SPARK-24793) Make spark-submit more useful with k8s

[ https://issues.apache.org/jira/browse/SPARK-24793?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marcelo Vanzin reassigned SPARK-24793: -- Assignee: Stavros Kontopoulos > Make spark-submit more useful with k8s >

[jira] [Resolved] (SPARK-24793) Make spark-submit more useful with k8s

[ https://issues.apache.org/jira/browse/SPARK-24793?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marcelo Vanzin resolved SPARK-24793. Resolution: Fixed Fix Version/s: 3.0.0 Issue resolved by pull request 23599 [https:

[jira] [Assigned] (SPARK-24432) Add support for dynamic resource allocation

[ https://issues.apache.org/jira/browse/SPARK-24432?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marcelo Vanzin reassigned SPARK-24432: -- Assignee: Marcelo Vanzin > Add support for dynamic resource allocation >

[jira] [Assigned] (SPARK-24432) Add support for dynamic resource allocation

[ https://issues.apache.org/jira/browse/SPARK-24432?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marcelo Vanzin reassigned SPARK-24432: -- Assignee: (was: Marcelo Vanzin) > Add support for dynamic resource allocation > -

[jira] [Assigned] (SPARK-26606) parameters passed in extraJavaOptions are not being picked up

[ https://issues.apache.org/jira/browse/SPARK-26606?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marcelo Vanzin reassigned SPARK-26606: -- Assignee: Jungtaek Lim > parameters passed in extraJavaOptions are not being picked u

[jira] [Resolved] (SPARK-26606) parameters passed in extraJavaOptions are not being picked up

[ https://issues.apache.org/jira/browse/SPARK-26606?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marcelo Vanzin resolved SPARK-26606. Resolution: Fixed Fix Version/s: 2.3.4 2.4.2 3

[jira] [Resolved] (SPARK-26729) Spark on Kubernetes tooling hardcodes default image names

[ https://issues.apache.org/jira/browse/SPARK-26729?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marcelo Vanzin resolved SPARK-26729. Resolution: Fixed Fix Version/s: 3.0.0 Issue resolved by pull request 23846 [https:

[jira] [Assigned] (SPARK-26729) Spark on Kubernetes tooling hardcodes default image names

[ https://issues.apache.org/jira/browse/SPARK-26729?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marcelo Vanzin reassigned SPARK-26729: -- Assignee: Rob Vesse > Spark on Kubernetes tooling hardcodes default image names > ---

[jira] [Resolved] (SPARK-27215) Correct the kryo configurations

[ https://issues.apache.org/jira/browse/SPARK-27215?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marcelo Vanzin resolved SPARK-27215. Resolution: Fixed Fix Version/s: 3.0.0 Issue resolved by pull request 24156 [https:

[jira] [Assigned] (SPARK-27215) Correct the kryo configurations

[ https://issues.apache.org/jira/browse/SPARK-27215?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marcelo Vanzin reassigned SPARK-27215: -- Assignee: Lantao Jin > Correct the kryo configurations >

[jira] [Resolved] (SPARK-27094) Thread interrupt being swallowed while launching executors in YarnAllocator

[ https://issues.apache.org/jira/browse/SPARK-27094?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marcelo Vanzin resolved SPARK-27094. Resolution: Fixed Fix Version/s: 3.0.0 Issue resolved by pull request 24017 [https:

[jira] [Assigned] (SPARK-27094) Thread interrupt being swallowed while launching executors in YarnAllocator

[ https://issues.apache.org/jira/browse/SPARK-27094?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marcelo Vanzin reassigned SPARK-27094: -- Assignee: Marcelo Vanzin > Thread interrupt being swallowed while launching executors

[jira] [Created] (SPARK-27219) Misleading exceptions in transport code's SASL fallback path

Marcelo Vanzin created SPARK-27219: -- Summary: Misleading exceptions in transport code's SASL fallback path Key: SPARK-27219 URL: https://issues.apache.org/jira/browse/SPARK-27219 Project: Spark

[jira] [Assigned] (SPARK-21097) Dynamic allocation will preserve cached data

[ https://issues.apache.org/jira/browse/SPARK-21097?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marcelo Vanzin reassigned SPARK-21097: -- Assignee: (was: Marcelo Vanzin) > Dynamic allocation will preserve cached data >

[jira] [Assigned] (SPARK-21097) Dynamic allocation will preserve cached data

[ https://issues.apache.org/jira/browse/SPARK-21097?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marcelo Vanzin reassigned SPARK-21097: -- Assignee: Marcelo Vanzin > Dynamic allocation will preserve cached data > ---

[jira] [Updated] (SPARK-27194) Job failures when task attempts do not clean up spark-staging parquet files

[ https://issues.apache.org/jira/browse/SPARK-27194?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marcelo Vanzin updated SPARK-27194: --- Description: When a container fails for some reason (for example when killed by yarn for ex

[jira] [Resolved] (SPARK-27178) k8s test failing due to missing nss library in dockerfile

[ https://issues.apache.org/jira/browse/SPARK-27178?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marcelo Vanzin resolved SPARK-27178. Resolution: Fixed Fix Version/s: 3.0.0 2.4.2 > k8s test failing

[jira] [Commented] (SPARK-27038) Rack resolving takes a long time when initializing TaskSetManager

[ https://issues.apache.org/jira/browse/SPARK-27038?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16794002#comment-16794002 ] Marcelo Vanzin commented on SPARK-27038: I was looking for something completely

[jira] [Resolved] (SPARK-27038) Rack resolving takes a long time when initializing TaskSetManager

[ https://issues.apache.org/jira/browse/SPARK-27038?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marcelo Vanzin resolved SPARK-27038. Resolution: Duplicate > Rack resolving takes a long time when initializing TaskSetManager

[jira] [Resolved] (SPARK-26634) OutputCommitCoordinator may allow task of FetchFailureStage commit again

[ https://issues.apache.org/jira/browse/SPARK-26634?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marcelo Vanzin resolved SPARK-26634. Resolution: Duplicate > OutputCommitCoordinator may allow task of FetchFailureStage commit

[jira] [Resolved] (SPARK-26343) Speed up running the kubernetes integration tests locally

[ https://issues.apache.org/jira/browse/SPARK-26343?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marcelo Vanzin resolved SPARK-26343. Resolution: Fixed Fix Version/s: 3.0.0 Issue resolved by pull request 23380 [https:

[jira] [Resolved] (SPARK-27145) Close store after test, in the SQLAppStatusListenerSuite

[ https://issues.apache.org/jira/browse/SPARK-27145?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marcelo Vanzin resolved SPARK-27145. Resolution: Fixed Fix Version/s: 3.0.0 Issue resolved by pull request 24079 [https:

[jira] [Assigned] (SPARK-27145) Close store after test, in the SQLAppStatusListenerSuite

[ https://issues.apache.org/jira/browse/SPARK-27145?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marcelo Vanzin reassigned SPARK-27145: -- Assignee: shahid > Close store after test, in the SQLAppStatusListenerSuite > ---

[jira] [Commented] (SPARK-27142) Provide REST API for SQL level information

[ https://issues.apache.org/jira/browse/SPARK-27142?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16792975#comment-16792975 ] Marcelo Vanzin commented on SPARK-27142: I'm not sure I understand your point, S

[jira] [Updated] (SPARK-26742) Bump Kubernetes Client Version to 4.1.2

[ https://issues.apache.org/jira/browse/SPARK-26742?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marcelo Vanzin updated SPARK-26742: --- Fix Version/s: 2.4.2 > Bump Kubernetes Client Version to 4.1.2 > ---

[jira] [Resolved] (SPARK-26742) Bump Kubernetes Client Version to 4.1.2

[ https://issues.apache.org/jira/browse/SPARK-26742?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marcelo Vanzin resolved SPARK-26742. Resolution: Fixed Issue resolved by pull request 24002 [https://github.com/apache/spark/pu

[jira] [Assigned] (SPARK-26742) Bump Kubernetes Client Version to 4.1.2

[ https://issues.apache.org/jira/browse/SPARK-26742?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marcelo Vanzin reassigned SPARK-26742: -- Assignee: Jiaxin Shan > Bump Kubernetes Client Version to 4.1.2 > ---

<    1   2   3   4   5   6   7   8   9   10   >