Skip to content

Implement CDC - Capture Data Change #752

@eolivelli

Description

@eolivelli

FEATURE REQUEST

  1. Please describe the feature you are requesting.

All databases have a way to send a log of mutation to third party tools (like Debezium).

Implementing CDC in HerdDB is trivial as we can just provide a way to 'tail' the logs and send the changes somewhere instead of building a local copy of the database.

Basically we can create a new type of follower node that reads the log and forward the changes to some configurable component (Sink)

  1. Indicate the importance of this issue to you
    Nice to have

  2. Provide any additional detail on your proposed use case for this feature.

The first sink of this CDC flow may be an Apache Pulsar topic.
Pulsar IO users will be able to consume the stream of Mutations and process them.

Metadata

Metadata

Assignees

No one assigned

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions