ajothomas opened a new pull request, #1713: URL: https://github.com/apache/samza/pull/1713
**Symptom**: If an external utility attempts to reset a job's state by clearing backups and checkpoints, the local state still remains. We need to clear the local rocksdb state of stateful jobs, if the inputs checkpoints don't exist. **Changes**: - This PR checks if the input checkpoints for a container are empty and clears the local logged stores if they are. **Tests**: - ./gradlew build - Tested with a test job which had its checkpoints and backup cleared. ``` 2024-12-18 17:57:55.891 [main] ContainerStorageManager [INFO] No checkpoints read. Attempting to clear logged stores. 2024-12-18 17:57:55.891 [main] ContainerStorageManager [INFO] Clearing store dir /export/content/data/samsa-yarn/logged-stores/aj-stateful-test-i100/beamStore from logged stores. 2024-12-18 17:57:55.897 [main] ContainerStorageManager [INFO] Clearing store dir /export/content/data/samsa-yarn/logged-stores/aj-stateful-test-i100/countState from logged stores. ``` **API Changes**: None **Upgrade Instructions**: None **Usage Instructions**: None -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
