Apify MCP Service Integration #19
Description
Task 001: Apify MCP Service Integration
Description
Create ApifyMCPService class that mirrors FirecrawlService structure. Implement Actor execution, result retrieval, caching, and error handling.
Size
L (3 days)
Acceptance Criteria
- ApifyMCPService class created in lib/services/apify-mcp.ts
- Methods: runActor(), waitForRun(), getDataset()
- 5-minute timeout per actor run
- Result caching with 24hr TTL
- Parallel execution support (10 concurrent max)
- Error handling with retries
- Unit tests for service methods
- APIFY_API_KEY environment variable documented in .env.example
Technical Details
The service should follow the same architectural patterns as FirecrawlService:
- Singleton pattern for service instance
- Async/await for all operations
- Proper TypeScript typing
- Integration with existing error handling infrastructure
- Compatible with the agent architecture
Dependencies
None - This is a foundational task
Notes
This service will serve as the foundation for integrating Apify actors into the fire-enrich system, enabling web scraping and data extraction capabilities beyond what Firecrawl provides.