Control layer for ContrailNet data pipelines
Cockpit is the orchestration layer for ContrailNet pipelines, built on a modern Python data engineering stack:
| Component | Role |
|---|---|
| Dagster | Pipeline orchestration & data catalogue |
| Pandera | Data contracts & DataFrame validation |
| Polars | High-performance DataFrame processing |
| Delta Lake | ACID storage with time travel |
git clone https://github.com/eurocontrol-asu/cockpit
cd cockpit
make installmake check # Lint + Type Check + Tests + Security Audit
make test # Run tests with coverage
make format # Auto-format code
make docs # Serve documentation locallysrc/cockpit/
├── core/ # Pipeline definitions
├── operators/ # Data transformation operators
└── resources/ # External resources (Delta Lake, MinIO)