Venkata Sai Akhil Gudesa created SPARK-44476:
------------------------------------------------
Summary: JobArtifactSet is populated with all artifacts if it is
not associated with an artifact
Key: SPARK-44476
URL: https://issues.apache.org/jira/browse/SPARK-44476
Project: Spark
Issue Type: Bug
Components: Connect
Affects Versions: 3.5.0, 4.0.0
Reporter: Venkata Sai Akhil Gudesa
Fix For: 3.5.0, 4.0.0
Consider each artifact type - files/jars/archives. For each artifact type, the
following bug exists:
# Initialise a `JobArtifactState` with no artifacts added to it.
# Create a `JobArtifactSet` from the `JobArtifactState`.
# Add an artifact with the same active `JobArtifactState`.
# Create another `JobArtifactSet`
In the current behaviour, the set created in step 2 contains all the artifacts
(through `sc.allAddedFiles` for example) while step 3 contains only the single
artifact added in step 3.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org
