Skip to content

Feat/validator rule engine#37

Merged
dosorio79 merged 7 commits intomainfrom
feat/validator-rule-engine
Jan 29, 2026
Merged

Feat/validator rule engine#37
dosorio79 merged 7 commits intomainfrom
feat/validator-rule-engine

Conversation

@dosorio79
Copy link
Copy Markdown
Owner

This pull request introduces a new advisory rule engine for Python code blocks, adds a runtime smoke test feature for Python code validation, and improves telemetry details and Makefile test targets. Environment configuration files are now better organized and documented, and telemetry can optionally include detailed rule/runtime hint payloads. These changes enhance code validation, developer experience, and operational clarity.

Advisory Python code validation and runtime smoke test:

  • Added a new AST-based advisory rule engine in app/agents/validator_rules.py to detect common Python code issues, such as unused expressions, suspicious attributes, and missing terminal operations. These rules provide non-blocking, informative hints for Python blocks.
  • Implemented a runtime smoke test for Python blocks in ValidatorAgent (app/agents/validator.py), which safely executes code with restricted builtins and a timeout, capturing exceptions as advisory hints. This feature is controlled by new environment variables. [1] [2] [3] [4]

Telemetry and configuration improvements:

  • Telemetry can now include detailed rule and runtime hint payloads (controlled by TELEMETRY_INCLUDE_HINT_DETAILS), and separates rule/runtime hints from MCP hints. Environment variables for these features are documented and loaded in app/core/config.py, .env-example, and README.md. [1] [2] [3] [4]

Makefile and test workflow enhancements:

  • Added a test-hints target to the Makefile to run rule engine and MCP hint tests, and a sync-dev target for developer dependency management. Test commands now consistently load environment variables for reproducible runs. [1] [2] [3] [4]

Changelog and documentation updates:

  • Updated CHANGELOG.md to reflect new advisory rule engine, runtime smoke test, telemetry improvements, and Makefile changes.

Integration with MCP hint workflow:

  • Integrated rule engine outcomes into MCP hint collection and explanation in app/mcp/python_code_hints.py. [1] [2]

…MCP hints and update related models and tests
…ore loading

Enhance ValidatorAgent to skip runtime smoke tests on non-main threads and improve signal handling
Update Home.test.tsx to ensure proper async handling of button click and output verification
@dosorio79 dosorio79 merged commit a55b074 into main Jan 29, 2026
5 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant