This is a public, read-only report. Striff reads this repository's docs, turns each sentence that makes a claim about the code into a rule, and checks the rule against the code on the default branch. How this works
Each sentence below has a stale name: a type the default branch doesn't declare, or declares somewhere else. Edit the doc so it matches the code, or bring the type back.
Tracks to RuntimeVariable (the call, time and token totals are summed over all LLMAgent instances of a run, each agent adding its usage since its last report):
LLMAgent depends on RuntimeVariable
Holdslarge_language_model → utils
FunctionDeserialization (dataclass): one function's outcome — test_case: TestCase, counts: Counter[Disposition].
2 rules from this sentence
FunctionDeserialization has test_case
checks “test_case: TestCase”
Holds
FunctionDeserialization has counts
checks “counts: Counter[Disposition]”
Holds
DeserializationResult (dataclass): the outcome of deserializing a chunk of LLM-emitted source — test_cases: list[TestCase], status: ParseStatus, counts: Counter[Disposition] (aggregated across all functions).
3 rules from this sentence
DeserializationResult has test_cases
checks “test_cases: list[TestCase]”
Holds
DeserializationResult has status
checks “status: ParseStatus”
Holds
DeserializationResult has counts
checks “counts: Counter[Disposition]”
Holds
Runs rewrite_tests() first, then cst.parse_modules the joined result and hands every top-level test_*/seed_test_*FunctionDef to a CstStatementDeserializer. The module-level imports that rewrite_tests surfaces (RewrittenTests.module_imports) are passed as module_level_imports= so each function's referenced imports are hoisted in (mirrors the seeding path).
CstStatementDeserializer depends on GenericFunction
Holdslarge_language_model → utils
deserialize_function(fn) -> FunctionDeserialization walks the (already rewriter-normalized and SUT-alias-normalized) function body, tagging each statement with a Disposition. Compound statements (if/for/with/...) are admitted whole as opaque executable blocks (ADMITTED_COMPOUND).
CstStatementDeserializer has a deserialize_function method
Holds
parse_assertion(node: cst.Assert | str, known_vars: Mapping[str, type | None]) -> tuple[str, Assertion] | None: module-level and shared with pynguin.assertion.llmassertiongenerator.
parse_assertion is in src/pynguin/large_language_model/parsing