Image 1. CDC replicate 100 x 1GB insert transaction.
When TiCDC syncs a very large upstream transaction, CDC can run out of memory.
The current EventBroker scan path may scan a whole transaction from eventstore and keep the scanned DML events in memory before sending them downstream. For very large transactions, this can build a large in-memory batch and cause OOM.
This is addressed by #5511.
When TiCDC syncs a very large upstream transaction, CDC can run out of memory.
The current EventBroker scan path may scan a whole transaction from eventstore and keep the scanned DML events in memory before sending them downstream. For very large transactions, this can build a large in-memory batch and cause OOM.
This is addressed by #5511.