Skip to content

sonnyb9/ai-system

Repository files navigation

=====================================================================

=====================================================================

=====================================================================

=====================================================================

=====================================================================

=====================================================================

=====================================================================

=====================================================================

Multi-Modal AI Agent System

=====================================================================

=====================================================================

=====================================================================

=====================================================================

=====================================================================

=====================================================================

=====================================================================

[TOC]

===================================================================

===================================================================

===================================================================

===================================================================

===================================================================

===================================================================

===================================================================

==================================================================

==================================================================

==================================================================

==================================================================

==================================================================

==================================================================

==================================================================

=====================================================================

=====================================================================

=====================================================================

=====================================================================

===================================================================

==================================================================

==================================================================

=====================================================================

==================================================================

==================================================================

==================================================================

==================================================================

==================================================================

==================================================================

==================================================================

=====================================================================

===================================================================

==================================================================

==================================================================

=====================================================================

===================================================================

==================================================================

==================================================================

=====================================================================

=== =============================================================

=== =============================================================

=== =============================================================

=== =============================================================

=== =============================================================

=== =============================================================

=== =============================================================

=== =============================================================

=== =============================================================

=== =============================================================

=== =============================================================

=== =============================================================

=== =============================================================

=== =============================================================

=== =============================================================

=== =============================================================

=== =============================================================

=== =============================================================

=== =============================================================

=== =============================================================

=== =============================================================

=== =============================================================

=== =============================================================

=== =============================================================

=== =============================================================

=== =============================================================

=== =============================================================

=== =============================================================

=== =============================================================

=== =============================================================

=== =============================================================

=== =============================================================

=== =============================================================

=== =============================================================

=== =============================================================

=== =============================================================

=== =============================================================

=== =============================================================

=== =============================================================

=== =============================================================

=== =============================================================

=== =============================================================

=== =============================================================

=== =============================================================

=== =============================================================

=== =============================================================

=== =============================================================

=== =============================================================

=== =============================================================

=== =============================================================

=== =============================================================

=== =============================================================

=== =============================================================

=== =============================================================

=== =============================================================

=== ============================================================

=== =============================================================

=== =============================================================

=== =============================================================

=== ===========================================================

=================================================================

=================================================================

=================================================================

=================================================================

=== ==============================================================

=== ==============================================================

=== ==============================================================

=================================================================

=================================================================

=================================================================

:==========:==================================================

:==========:==================================================

:==========:==================================================

:========:===================================================

:========:===================================================

:========:===================================================

::========::=================================================

::========::=================================================

::========::=================================================

:::========:::===============================================

:::========:::===============================================

:::========:::===============================================

::::========::::=============================================

::::========::::=============================================

::::========::::=============================================

:::::========:::::============================================

:::::========:::::============================================

:::::========:::::============================================

::::::=========::::::===========================================

::::::=========::::::===========================================

::::::=========::::::===========================================

============================== ================= =================

============================== ================= =================

============================== ================= =================

============================== ================= =================

============================== === ===============================

============================== === ===============================

============================== === ===============================

============================== === ================================

============================== === ================================

============================== === ================================

================================ === ===============================

================================ === ===============================

================================ === ===============================

===========================================================================

=========================================================================

==========================================================================

=============================================================================

-------------------------------------------------------------------------

--------------------------------------

---------------------------------------------

===========================================

=============================================

===============================================

==============================================

================================================

-------------------------------------------------------------

============================================

===============================================

=================================================================

=====================================================================

======================================================================

============================================================

----------------------------------------------------

========================================================

===========================================================

=========================================================

==========================================================

============================================

===========================================

==========================================

=========================================

========================================

=======================================

======================================

=====================================

====================================

===================================

==================================

=================================

==========

=====

===

==

===============

=================

===================

====================

=====================

======================

=======================

========================

=========================

==========================

===========================

===========================

===========================

=============================

==============================

===============================

================================

=================================

==================================

===================================

====================================

====================================

=====================================

=====================================

======================================

=======================================

=======================================

========================================

========================================

=========================================

==========================================

===========================================

===========================================

============================================

============================================

===========================================

============================================

=============================================

==============================================

==============================================

==============================================

==============================================

==============================================

==============================================

==============================================

==============================================

=============================================

=============================================

=============================================

=============================================

=============================================

=============================================

=============================================

=============================================

=============================================

=============================================

=============================================

=============================================

=============================================

=============================================

=============================================

=============================================

=============================================

=============================================

=============================================

=============================================

Installation & Setup

----------------------------------------------------------

1. Install Python 3.9 or higher

----------------------------------------------------------

2. Install dependencies: pip install -r requirements.txt

----------------------------------------------------------

3. Run the agent: python3 run_agent.py

----------------------------------------------------------

Usage Instructions

-------------------------------

1. Make sure Ollama is running locally on port 11434

2. Set up provider configurations in providers/

3. Configure routing.json with your preferred providers

4. Run: python3 run_agent.py

5. Monitor output in terminal

Project Structure

---------------------

root/

├── agent_controller.py # Main orchestration logic

├── json_handlers/ # Task processing

│ ├── file_processor.py # File operations

│ ├── text_processor.py # Text analysis

│ └── image_processor.py # Vision capabilities

├── tools/ # Function capabilities

│ ├── calculator.py # Mathematical tools

│ ├── search.py # Web search

│ ├── code_runner.py # Code execution

│ └── file_handler.py # File manipulation

├── providers/ # Provider configurations JSON

│ ├── pi5_lightweight.json

│ ├── aurora_local_deepseek.json

│ └── claude_sonnet_4_5.json

├── routing/

│ └── routing.json # Provider routing configuration

├── config.py # Environment configuration

├── requirements.txt # Python dependencies

└── README.md # This file

Supported Capabilities

----------------------

- [x] Text Generation

- [x] Code Analysis & Debugging

- [ ] Vision (Image Processing)

- [x] File System Operations

- [x] Web Search

- [x] Code Execution

- [x] Mathematical Functions

- [x] Tool Use & API Integration

Known Limitations

------------------

- Vision capabilities require additional setup

- Some tools may require API keys

- Local models: Ollama must be running

- External APIs: Requires valid credentials

Getting Help

------------

Check logs for error messages

Review provider configurations

Verify endpoint accessibility

Report issues in issue tracker

====================================================================

====================================================================

====================================================================

====================================================================

====================================================================

====================================================================

====================================================================

====================================================================

====================================================================

====================================================================

====================================================================

====================================================================

====================================================================

====================================================================

====================================================================

====================================================================

EOF

echo "=== Created README.md ==="

About

AI orchestration layer

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

 
 
 

Contributors