warrenzhu25 opened a new pull request, #53698:
URL: https://github.com/apache/spark/pull/53698

   ### What changes were proposed in this pull request?
   
   This PR adds a new `parentIds` field to the `StageData` model and its 
corresponding protobuf representation. It also fixes a compilation error in 
`JobPage.scala` caused by the updated `StageData` constructor and updates the 
`KVStoreProtobufSerializerSuite` to verify the new field.
   
   Specific changes include:
   - Updated `store_types.proto` to include `repeated int64 parent_ids`.
   - Added `parentIds` to `v1.StageData` in `api.scala`.
   - Updated `LiveStage`, `AppStatusStore`, and `StageDataWrapperSerializer` to 
handle `parentIds`.
   - Corrected `StageData` instantiation in `JobPage.scala` to resolve 
compilation errors.
   - Added tests for `parentIds` in `KVStoreProtobufSerializerSuite`.
   
   ### Why are the changes needed?
   
   The `parentIds` field is necessary for tracking stage dependencies in the 
Spark UI and other status-related tools. The compilation fix in `JobPage.scala` 
is required to restore the build after the model change.
   
   ### Does this PR introduce _any_ user-facing change?
   
   No, this change updates internal models and the REST API but does not alter 
the primary user-facing UI or behavior.
   
   ### How was this patch tested?
   
   The changes were tested by running the `KVStoreProtobufSerializerSuite`:
   ```
   build/sbt "core/testOnly 
org.apache.spark.status.protobuf.KVStoreProtobufSerializerSuite"
   ```
   All 20 tests passed.
   
   ### Was this patch authored or co-authored using generative AI tooling?
   
   Yes, assisted by Gemini.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: [email protected]

For queries about this service, please contact Infrastructure at:
[email protected]


---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]

Reply via email to