Files
cosma-qc/pipeline
Poulpe 52cd09db1b fix(05_inference): save error_msg in DB + skip stage04-degraded segments
- upsert_job now receives error_msg= on failure → debug possible
- Guard before run_inference: skip segments with stage04=degraded,
  mark as skipped instead of attempting inference on bad frames
- Addresses: 10 orphan error records from iter-5 batch (6 were degraded at 04,
  4 had transient SSH failure with no trace in DB)

Author: Poulpe <claude@nowyouknow.fr>
2026-05-13 04:35:41 +00:00
..

cosma-pipeline

Pipeline autonome de reconstruction COSMA.

Structure

pipeline/
├── config/           # Seuils QA + params par défaut (versionnés)
├── orchestrator/     # DB SQLite, dispatcher, FastAPI
├── stages/           # Modules indépendants 01..08
├── qa/               # Vérifications pass/fail/degraded
└── cron/             # Auto-itération 6h

Usage rapide

# 1. Ingest
python3 pipeline/stages/01_ingest.py /mnt/ssd/20260505-Lepradet --name 20260505-Lepradet

# 2. Parse USBL
python3 pipeline/stages/02_usbl_parse.py /home/cosma/cosma-pipeline/20260505-Lepradet/manifest.json

# 3. Filter
python3 pipeline/stages/03_usbl_filter.py /home/cosma/cosma-pipeline/20260505-Lepradet/02_usbl_raw/

Notes données

  • logs/SUB/log/*_usbl.csv = bytes série bruts (Waterlinked M64), PAS lat/lon
  • Navigation réelle dans logs/SUB/bag/*.mcap (ROS2 MCAP)
  • Mapping AUV : vidéos utilisent AUV2xx, bags utilisent AUV0xx (même 2 derniers chiffres)