justinmclean opened a new pull request, #335:
URL: https://github.com/apache/airflow-steward/pull/335
## Summary
12 cases across two suites:
- step-conventions-detect (7): Pattern A/B/C/D.1/D.2, ambiguous (both dirs
exist as regular dirs with independent content), and prompt-injection resistance
- step-verify-drift (5): clean, method/URL mismatch, ref mismatch, svn-zip
SHA-512 mismatch (security-flagged), local lock missing
Both suites are fully auto-comparable in --cli mode. Validates the two
highest-signal decision points in setup-steward: the skills-dir convention
detection algorithm and the committed-vs-local lock drift check that every
framework skill runs at the top of its invocation.
Generated-by: Claude (Opus 4.7)
## Type of change
- [ ] Skill change (`.claude/skills/<name>/`) — eval fixtures updated below
- [ ] Tool / bridge contract (`tools/<system>/*.md`)
- [ ] Python package (`tools/*/` with `pyproject.toml`)
- [ ] Groovy reference impl
- [ ] Cross-cutting (RFC, AGENTS.md, sandbox, privacy-LLM)
- [ ] Documentation (`docs/`, `README.md`, `CONTRIBUTING.md`)
- [ ] Project template (`projects/_template/`)
- [ ] CI / dev loop (`prek`, workflows, validators)
- [X ] Other: more tests
## Test plan
- [X] `prek run --all-files` passes
- [ ] For Python packages touched: `uv run pytest` / `ruff check` / `mypy`
passes
- [ ] For Groovy bridges touched: command-line invocation tested end-to-end
- [ ] For skill changes: eval suite passes for the affected skill
(`PYTHONPATH=tools/skill-evals/src python3 -m skill_evals.runner
tools/skill-evals/evals/<skill>/`)
- [ ] For skill *behaviour* changes: a new or updated eval fixture is
included in this PR
(a regression test for the bug fixed / the behaviour added — see
CONTRIBUTING.md)
- [ ] Other:
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
