Add performance optimization for large packages

[oscarvalenzuelab]

Description

Implement performance optimizations for handling large package files efficiently.

Requirements

• Streaming extraction for large archives
• Memory-efficient processing
• Selective file extraction
• Progress reporting

Performance Targets

• Small packages (< 1MB): < 500ms
• Medium packages (1-50MB): < 2 seconds
• Large packages (50-500MB): < 10 seconds
• Memory usage: < 100MB for packages under 100MB

Tasks

• Implement streaming extraction strategies
• Add file size detection and strategy selection
• Implement selective extraction (metadata files only)
• Add memory usage monitoring
• Create progress callbacks
• Implement parallel processing where applicable
• Write performance benchmarks

Optimization Strategies

• Stream large archives without full extraction
• Extract only metadata-relevant files
• Cache frequently accessed data
• Use memory-mapped files for large content
• Implement early exit strategies

Acceptance Criteria

• Meets performance targets
• Memory usage stays within limits
• No functionality regression
• Progress reporting for long operations

Priority

Medium - Performance enhancement