[
https://issues.apache.org/jira/browse/SPARK-44476?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hyukjin Kwon resolved SPARK-44476.
----------------------------------
Resolution: Fixed
Issue resolved by pull request 42062
[https://github.com/apache/spark/pull/42062]
> JobArtifactSet is populated with all artifacts if it is not associated with
> an artifact
> ---------------------------------------------------------------------------------------
>
> Key: SPARK-44476
> URL: https://issues.apache.org/jira/browse/SPARK-44476
> Project: Spark
> Issue Type: Bug
> Components: Connect
> Affects Versions: 3.5.0, 4.0.0
> Reporter: Venkata Sai Akhil Gudesa
> Assignee: Venkata Sai Akhil Gudesa
> Priority: Major
> Fix For: 3.5.0, 4.0.0
>
>
> Consider each artifact type - files/jars/archives. For each artifact type,
> the following bug exists:
> # Initialise a `JobArtifactState` with no artifacts added to it.
> # Create a `JobArtifactSet` from the `JobArtifactState`.
> # Add an artifact with the same active `JobArtifactState`.
> # Create another `JobArtifactSet`
> In the current behaviour, the set created in step 2 contains all the
> artifacts (through `sc.allAddedFiles` for example) while step 3 contains only
> the single artifact added in step 3.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
