Plan the PromptKit 0.8 upgrade

This commit is contained in:
2026-08-25 19:11:30 +00:00
parent 5e5c69bf9d
commit 55247c47ab
3 changed files with 1269 additions and 419 deletions

View File

@@ -15,34 +15,11 @@ is warranted.
### 1. Upgrade To PromptKit v0.8.0
- Upgrade the PromptKit dependency and follow the upstream v0.8.0 release
guide, including its now-active `repair_attempts` behavior and compatibility
checks for prompt definitions, prepared execution, validation results,
capacity accounting, error adaptation, debug data, and cumulative token
usage.
- Use PromptKit's bounded repair loop for eligible structural output failures.
A repair must resend the immutable original prompt followed by the latest
defective assistant response and one bounded user correction message. It
must not accumulate the history of every defective candidate.
- Review every maintained LLM prompt's structural repair budget. Prefer a
small positive budget where a corrected structured response can be useful,
while retaining zero where a second call would be inappropriate or where
observational evidence does not justify it.
- Keep PromptKit repair attempts distinct from Notarius stage retries.
PromptKit repairs a response that fails its deterministic `basic`, `json`, or
`json_schema` contract within one stage attempt; Notarius may later retry a
complete stage candidate after application validation. Document and test the
multiplicative maximum provider-call cost created by both configured
budgets, including PromptKit repair calls made by any LLM-backed validators.
Attribute generation count, token usage, latency, and failure provenance to
the producer, validator, PromptKit repair, and Notarius correction layers so
operators can explain the actual cost of a run.
- Treat exhaustion of PromptKit structural repair as the absence of a usable
structured candidate. The default terminal policy is to fail the run after
the applicable Notarius stage-attempt budget is also exhausted. A future
configurable alternative may reject the affected stage or lane where the
pipeline can represent that outcome, but it must never accept undecodable or
structurally invalid output merely with a warning.
This item has been promoted to the standalone
[PromptKit v0.8.0 Upgrade](promptkit-v0.8.md) roadmap. That document owns the
release-by-release compatibility review, adopted features, structured-repair
policy, target integration boundary, acceptance criteria, and settled design
decisions.
### 2. Feedback-Aware Stage Validation Retries
@@ -245,8 +222,7 @@ The implemented source-backed core and initial D&D registry adoption are
described by [Module Internals](../internal/modules.md#semantic-reconciliation)
and
[D&D Module Internals](../internal/dnd.md#semantic-registry-reconciliation).
The [Semantic Reconciliation Roadmap](semantic-reconciliation.md) retains the
original feature scope; the sections below keep broader extensions deferred.
The sections below keep broader extensions deferred.
### Large-Collection Semantic Reconciliation