Severe Database Latency – Queries Running Up to 20 Minutes starting around 11am

[KarissaBrummell]

What product are you having troubles with?

Console

What Console version are you using?

Mia-Platform v14.5.1

Description

We are currently experiencing severe performance degradation in our Mia Platform Console environment, which is connected to a cloud-hosted MongoDB Atlas instance.

Beginning at approximately 11:00 AM CST today, we observed a significant spike in latency. Database queries that would normally complete quickly are now taking up to 20 minutes to execute.

Impact:
Console load times are extremely high and often timing out
Application responsiveness is significantly degraded
Operations dependent on MongoDB queries are timing out or severely delayed

Environment Details:
Mia Platform Console
MongoDB Atlas (cloud-hosted)
We upgraded to console version v14.5.1 last night around 8:30PM CST.

Actual Outcome

No response

Expected Outcome

No response

[swageblock]

DBA created indexes based on MongoDB recommendations:

Created indexes on console.deploy_history:
__STATE___1_environment_1_projectId_1_status_1_createdAt_-1
__STATE___1_environment_1_projectId_1_createdAt_-1

Created indexes on console.configurations:
__STATE___1_configType_1_projectId_1_createdAt_-1

[swageblock]

This seems to have addressed the performance issues we were seeing.

[ivanpasq]

Hi @KarissaBrummell,

thank you for the feedback, and @swageblock thank you for sharing with us the indexes that resolved the issue.

We will try to include those indexes in the default configuration of the CRUD Service working alongside the Console, so that when upgrading or installing the Console, the collections will have them automatically setup.

Best regards!