Parent issue: #3764
Implement a source connector module that consumes messages from an upstream Iggy (cluster) into the connectors runtime. This issue serves as the overall implementation tracker. Please refer to the original proposal for detailed design.
Milestones
M1: Basic functionality
- Messages flow from upstream Iggy (source) through the connector to downstream Iggy
- Configurable stream and topic selection
- Progress persistence with resumable offset tracking
M2: Fine-grained configuration
- TLS support
- Additional authentication methods (username/password, token)
- Flow control: finer-grained concurrency control and batching
M3: Enhancement
- Compression and pro-active retry
- Partition-aware offset tracking
Parent issue: #3764
Implement a source connector module that consumes messages from an upstream Iggy (cluster) into the connectors runtime. This issue serves as the overall implementation tracker. Please refer to the original proposal for detailed design.
Milestones
M1: Basic functionality
M2: Fine-grained configuration
M3: Enhancement