Skip to content

Repository files navigation

🛡️ SchemaSentinel-Strands

Autonomous Self-Healing Data Reliability Agent for Streaming Pipelines
Powered by Strands Agents SDK on AWS Bedrock Mantle with Nebius Studio SOTA LLM Fallback • AST Security Sandbox • Dead Letter Queue (DLQ)


⚡ The Problem & Why SchemaSentinel Exists

Imagine this: It's 2:00 AM. A third-party company pushes an update and silently changes a single field name: "user_id" becomes "userId".

Instantly, your entire data pipeline crashes. Red alert sirens go off on PagerDuty. Critical executive dashboards freeze, analytics reports show zero, and engineers are woken up in the middle of the night to write an emergency 2-line code fix.

Data pipes shouldn't be this fragile.

SchemaSentinel acts as an autonomous shock-absorber for your data. Think of it like a smart universal adapter: the moment incoming data shifts or changes shape, SchemaSentinel automatically catches it, rewires the mismatch in 300 milliseconds using pure multi-cloud agentic reasoning, and flows clean data straight into your warehouse—no broken pipelines, no midnight alarms, and zero downtime.


🏗️ Multi-Cloud Resilience Architecture

[ Upstream Ingress Stream ] (GitHub REST API + Tavily Grounding)
            │
            ▼
[ Tier-1: Linguistic Entropy Guard ] (Rejects keyboard mash in 0.1ms)
            │
            ▼
[ Warehouse Contract Validator ]
    ├── Matches DDL  ────────► [ ✅ Clean Ingress ] ────┐
    └── Drift Detected                                  │
            │                                           ▼
            ▼                                 [ Live Warehouse ]
  [ Strands Agent Engine ]                     (tech_projects)
    ├── Primary: AWS Bedrock Mantle           (0% Schema Downtime)
    └── Fallback: Nebius Studio SOTA LLM                ▲
            │                                           │
            ▼                                           │
  [ AST Security Sandbox ]                              │
    ├── Compile Passed ──────► Auto-Heals & Conforms ───┘
    └── Compile Failed ──────► [ Dead Letter Queue (DLQ) ]
                               (tech_projects_dlq)
                               (Zero Warehouse Pollution)

🚀 Quickstart

# 1. Clone & Install
git clone https://github.com/lvhNaruto/SchemaSentinel-Strands.git
cd SchemaSentinel-Strands
pip install -r requirements.txt

# 2. Environment Configuration (.env)
AWS_ACCESS_KEY_ID=your_aws_key
AWS_SECRET_ACCESS_KEY=your_aws_secret
AWS_REGION=us-west-2
NEBIUS_API_KEY=your_nebius_studio_key
TAVILY_API_KEY=your_tavily_key

# 3. Launch Dashboard
streamlit run app.py

About

Autonomous self-healing data pipeline powered by Strands Agents on AWS Bedrock Mantle (Grok 4.6) with AST-sandboxed code synthesis.

Topics

Resources

Stars

1 star

Watchers

0 watching

Forks

Releases

Packages

Contributors

Languages