distributed agent creation? #8
|
as the app scales to handle many users creating agents simultaneously, the CLI approach may struggle with resource contention. How can we integrate a task queue like Celery to distribute agent creation tasks across workers? |
Answered by
kunwar-vikrant
Aug 22, 2025
Replies: 1 comment
|
this is a good problem to solve , we can integrate Celery with Redis as a message broker to queue and process agent creation tasks asynchronously.basically i am thinking of creating a service which could offload agent creation to workers, scaling horizontally by adding more workers also we should monitor task queues and add retry logic for failed tasks. |
0 replies
Answer selected by
sorcerer2073
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
this is a good problem to solve , we can integrate Celery with Redis as a message broker to queue and process agent creation tasks asynchronously.basically i am thinking of creating a service which could offload agent creation to workers, scaling horizontally by adding more workers also we should monitor task queues and add retry logic for failed tasks.