Add gatecheck to Mutation Testing - #119
Merged
Merged
Conversation
Mutation testing applied to validators and quality gates rather than to source code. Stdlib only, no dependencies.
|
Review changes with |
Reviewer's guide (collapsed on small PRs)Reviewer's GuideThe PR documents gatecheck in the Mutation Testing section of the README, positioning it as a stdlib-only tool that mutates checker inputs to evaluate gate rejection behavior rather than mutating program code. File-Level Changes
Tips and commandsInteracting with Sourcery
Customizing Your ExperienceAccess your dashboard to:
Getting Help
|
Code Review by Qodo🐞 Bugs (0) 📘 Rule violations (0) 📎 Requirement gaps (0)
Great, no issues found!Qodo reviewed your code and found no material issues that require reviewTip of the day💡 Did you know, you can group findings by type and pick your Finding display, from Minimal to Full |
PR Summary by QodoAdd gatecheck to mutation testing resources
AI Description
High-Level Assessment
Files changed (1)
|
Contributor
|
Tick the box to add this pull request to the merge queue (same as
|
There was a problem hiding this comment.
LlamaPReview — No blocking issues found
One-line README addition to the curated Mutation Testing list; no executable code, configuration, or public interface changes, so there is no PR-created mechanism that can regress behavior.
Review details and evidence
Material unknowns
- Whether the external link target https://github.com/simin-yuan/self-auditing-agent/tree/main/gatecheck is reachable. Confirmed unreachability would change the posture from clear to request changes so the broken entry is cleaned up; the absence of a fetch check does not establish a broken link.
- Check: Optionally open the linked URL once to confirm it resolves.
- Whether pointing at a subdirectory (self-auditing-agent/tree/main/gatecheck) rather than a repository or package root satisfies this list's curation convention. If the list convention requires a repo/package-root URL, the entry would need a URL edit; this is a maintainer policy question not decidable from the supplied repository evidence.
- Check: If required by convention, ask the author for a repo/package-root URL; the author has already disclosed ownership of the linked work in the PR description.
LlamaPReview checks
- Reviewed changed regions in
README.md. - Read the complete PR-head file
README.md.
LlamaPReview is an open-source pull request reviewer. Tell the maintainers where this review got it wrong.
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
2 participants
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Adds one entry to Mutation Testing.
It is mutation testing, but pointed at a different subject: instead of mutating the program to see whether the tests catch it, it mutates the checker's input to see whether the gate rejects it. That question — "does my validator actually reject anything?" — is the same failure mode mutation testing exists to expose, one level up.
Stdlib only, so it installs with nothing.
Disclosure: this is my own work. If it doesn't clear the bar for this section, closing it is a fine outcome.
Summary by Sourcery
New Features: