All checks were successful
ci/woodpecker/tag/release Pipeline was successful
7.2 KiB
7.2 KiB
Troubleshooting
Purpose
Canonical operator troubleshooting guide for recurring implemented Narratio failures.
Config file discovery failure
Symptom:
run,plan,resume, orrun-stagefails with config/session not found.
Likely Cause:
pipeline.ymlorsession.ymlis missing from discovery paths.- wrong working directory when relying on
./session.yml.
Diagnostics:
pwd
ls -l ./session.yml
ls -l /usr/local/etc/narratio/pipeline.yml /etc/narratio/pipeline.yml
Safe Fix:
- pass explicit
--configand--session. - or place files in documented discovery paths.
Links:
Session template rendering failure
Symptom:
- load fails with unresolved placeholder or
session_idmismatch.
Likely Cause:
- templated
session.ymlused without--session-id. - rendered
session_iddiffers from passed--session-id.
Diagnostics:
narratio plan --session ./session.yml --session-id 2026-04-04
Safe Fix:
- pass
--session-idwhen template placeholders are present. - ensure rendered
session_idmatches intended run session id.
Links:
Strict YAML decode or validation failure
Symptom:
- config load fails with unknown field or validation error.
Likely Cause:
- typo/stale field name.
- missing required fields or invalid constraints.
Diagnostics:
narratio plan --config /path/to/pipeline.yml --session /path/to/session.yml --session-id 2026-04-04
Safe Fix:
- align fields/values to canonical config reference and examples.
Links:
--artifacts selection failure
Symptom:
run/resume/run-stagefails with invalid or unknown artifact selection.
Likely Cause:
--artifactscontains blank names or unknown artifact keys.pipeline.scriptorium.artifactsmissing while using--artifacts.
Diagnostics:
narratio run --config /path/to/pipeline.yml --session /path/to/session.yml --session-id 2026-04-04 --artifacts player_handout
Safe Fix:
- use configured artifact keys only.
- ensure
pipeline.scriptorium.artifactsis defined.
Links:
run-stage --artifacts on non-analyze stage
Symptom:
run-stagefails with--artifacts is only supported for stage "analyze".
Likely Cause:
--artifactswas used with a non-analyzestage.
Diagnostics:
narratio run-stage --config /path/to/pipeline.yml --session /path/to/session.yml --session-id 2026-04-04 --artifacts session_recap polish
Safe Fix:
- use
--artifactsonly withrun-stage ... analyze.
Links:
Configured artifact dependency/input validation failure
Symptom:
- config validation fails for
depends_on,narratio.artifact.<name>source, or artifact output path.
Likely Cause:
narratio.artifact.<name>source missing matchingdepends_onkey.- dependency references unknown artifact key.
- dependency self-reference or enabled dependency cycle.
- artifact output path missing/invalid/outside
artifacts/root.
Diagnostics:
narratio plan --config /path/to/pipeline.yml --session /path/to/session.yml --session-id 2026-04-04
Safe Fix:
- ensure artifact-to-artifact inputs have explicit
depends_onentries using artifact keys. - ensure referenced artifacts exist and define valid
output_pathvalues. - keep output paths relative and under
artifacts/.
Links:
Required configured artifact input unavailable at analyze time
Symptom:
- analyze fails because configured input source is unavailable.
Likely Cause:
- required upstream configured artifact was not selected/executed this run.
- non-executable dependency output file is missing or invalid on disk.
Diagnostics:
narratio status --manifest /path/to/manifest.json
narratio run-stage --config /path/to/pipeline.yml --session /path/to/session.yml --session-id 2026-04-04 --artifacts player_handout analyze
Safe Fix:
- run analyze with needed artifacts selected.
- or ensure dependency output file exists at configured path and is valid.
Links:
Manifest/status path failure
Symptom:
statusfails because manifest path is missing, unreadable, or invalid.
Likely Cause:
- wrong manifest path.
- manifest removed after cleanup.
--manifestomitted.
Diagnostics:
narratio status --manifest /path/to/manifest.json
ls -l /path/to/manifest.json
Safe Fix:
- use manifest path printed by
run,resume, orrun-stage.
Links:
Session lock conflict (.lock)
Symptom:
- run fails with lock conflict for session workdir.
Likely Cause:
- another Narratio process is running same session.
- stale lock from interrupted prior run.
Diagnostics:
ls -l {workspace.root}/work/{campaign}/{session_id}/.lock
cat {workspace.root}/work/{campaign}/{session_id}/.lock
ps aux | grep narratio
Safe Fix:
- wait for active run to finish.
- if no process is active, remove only stale session
.lockfile.
Links:
Secrets env-dir or credential-env failure
Symptom:
- startup fails loading secrets directory, or stage fails due to missing credential env vars.
Likely Cause:
- invalid
pipeline.secrets.env_dirpath/permissions. - required credential env var unset/empty.
Diagnostics:
ls -la /path/to/secrets_dir
env | grep -E 'AUDITA|OBJECT_STORAGE|AWS|SCRIPTORIUM'
Safe Fix:
- fix secrets directory and credential env vars.
- keep secret values out of YAML.
Links:
S3-audio prepare failure
Symptom:
preparefails in S3 mode (listing/downloading/no audio/backend error).
Likely Cause:
- wrong
session.inputs.audio_s3.prefix. - no
.flacfiles at resolved prefix. - invalid/missing object-store credentials or backend config.
- mixed local+S3 audio input config.
Diagnostics:
narratio run-stage --config /path/to/pipeline.yml --session /path/to/session.yml --session-id 2026-04-04 prepare
Safe Fix:
- configure exactly one audio source mode.
- verify
.flacfiles and storage access.
Links:
Archive promotion/current-pointer failure
Symptom:
- archive fails on required promotion source missing or pointer write failure.
Likely Cause:
- required promoted file absent (including analyze outputs not generated for this run).
- storage upload failed before
current/run_id.txtcommit marker write.
Diagnostics:
narratio status --manifest /path/to/manifest.json
narratio run-stage --config /path/to/pipeline.yml --session /path/to/session.yml --session-id 2026-04-04 archive
Safe Fix:
- rerun or resume upstream stages to generate required files.
- adjust promotion rules to match files that must exist.
- retry after storage issue is resolved.
Links: